2024-09-12T00:20:46.844 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T00:20:46.865 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:20:46.954 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901870 branch: wip-cls-rgw-busy-resharding description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7901870' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: true frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 tenant: RGW33333333333333333 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIxxfrGVLm8NG+dIy/Q5wgEQO1FIMQDRmRodwobAu9mjN5jJODdCpX5D1iE6wZEpT21mAyz58wKaqeEzaTB6epM= smithi077.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO1ByYXPjHqh8DHPX6owGRuNjojGZbJOCk4t9ulUeq/Kn37MuZwtvxYcDwK8roqpaex0nJhE0Ol42daWy3Lr4fA= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: force-branch: wip-67986 rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T00:20:46.955 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-12T00:20:46.955 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-12T00:20:46.955 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T00:20:46.957 INFO:teuthology.task.internal:Checking packages... 2024-09-12T00:20:46.979 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-12T00:20:46.979 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T00:20:46.979 INFO:teuthology.packaging:ref: None 2024-09-12T00:20:46.979 INFO:teuthology.packaging:tag: None 2024-09-12T00:20:46.979 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-12T00:20:46.979 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:20:46.979 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-12T00:20:47.129 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753.gd011c522 2024-09-12T00:20:47.131 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T00:20:47.137 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T00:20:47.137 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T00:20:47.154 INFO:teuthology.task.internal:Saving configuration 2024-09-12T00:20:47.169 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T00:20:47.176 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T00:20:47.207 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901870', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 00:14:55.319943', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIxxfrGVLm8NG+dIy/Q5wgEQO1FIMQDRmRodwobAu9mjN5jJODdCpX5D1iE6wZEpT21mAyz58wKaqeEzaTB6epM='} 2024-09-12T00:20:47.235 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi077.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901870', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 00:14:55.318531', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO1ByYXPjHqh8DHPX6owGRuNjojGZbJOCk4t9ulUeq/Kn37MuZwtvxYcDwK8roqpaex0nJhE0Ol42daWy3Lr4fA='} 2024-09-12T00:20:47.236 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T00:20:47.240 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:20:47.241 INFO:teuthology.task.internal:roles: ubuntu@smithi077.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:20:47.241 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T00:20:47.333 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7251aab490>, signals=[15]) 2024-09-12T00:20:47.333 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T00:20:47.338 INFO:teuthology.task.internal:Opening connections... 2024-09-12T00:20:47.338 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T00:20:47.339 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:20:47.424 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi077.front.sepia.ceph.com 2024-09-12T00:20:47.425 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:20:47.506 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T00:20:47.511 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2024-09-12T00:20:47.530 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2024-09-12T00:20:47.530 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2024-09-12T00:20:47.589 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="CentOS Stream" 2024-09-12T00:20:47.589 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="9" 2024-09-12T00:20:47.589 INFO:teuthology.orchestra.run.smithi062.stdout:ID="centos" 2024-09-12T00:20:47.589 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE="rhel fedora" 2024-09-12T00:20:47.589 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="9" 2024-09-12T00:20:47.589 INFO:teuthology.orchestra.run.smithi062.stdout:PLATFORM_ID="platform:el9" 2024-09-12T00:20:47.589 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T00:20:47.589 INFO:teuthology.orchestra.run.smithi062.stdout:ANSI_COLOR="0;31" 2024-09-12T00:20:47.589 INFO:teuthology.orchestra.run.smithi062.stdout:LOGO="fedora-logo-icon" 2024-09-12T00:20:47.589 INFO:teuthology.orchestra.run.smithi062.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T00:20:47.590 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://centos.org/" 2024-09-12T00:20:47.590 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T00:20:47.590 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T00:20:47.590 INFO:teuthology.orchestra.run.smithi062.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T00:20:47.590 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2024-09-12T00:20:47.618 DEBUG:teuthology.orchestra.run.smithi077:> uname -m 2024-09-12T00:20:47.637 INFO:teuthology.orchestra.run.smithi077.stdout:x86_64 2024-09-12T00:20:47.637 DEBUG:teuthology.orchestra.run.smithi077:> cat /etc/os-release 2024-09-12T00:20:47.695 INFO:teuthology.orchestra.run.smithi077.stdout:NAME="CentOS Stream" 2024-09-12T00:20:47.695 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION="9" 2024-09-12T00:20:47.695 INFO:teuthology.orchestra.run.smithi077.stdout:ID="centos" 2024-09-12T00:20:47.695 INFO:teuthology.orchestra.run.smithi077.stdout:ID_LIKE="rhel fedora" 2024-09-12T00:20:47.695 INFO:teuthology.orchestra.run.smithi077.stdout:VERSION_ID="9" 2024-09-12T00:20:47.695 INFO:teuthology.orchestra.run.smithi077.stdout:PLATFORM_ID="platform:el9" 2024-09-12T00:20:47.695 INFO:teuthology.orchestra.run.smithi077.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T00:20:47.695 INFO:teuthology.orchestra.run.smithi077.stdout:ANSI_COLOR="0;31" 2024-09-12T00:20:47.695 INFO:teuthology.orchestra.run.smithi077.stdout:LOGO="fedora-logo-icon" 2024-09-12T00:20:47.695 INFO:teuthology.orchestra.run.smithi077.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T00:20:47.695 INFO:teuthology.orchestra.run.smithi077.stdout:HOME_URL="https://centos.org/" 2024-09-12T00:20:47.696 INFO:teuthology.orchestra.run.smithi077.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T00:20:47.696 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T00:20:47.696 INFO:teuthology.orchestra.run.smithi077.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T00:20:47.696 INFO:teuthology.lock.ops:Updating smithi077.front.sepia.ceph.com on lock server 2024-09-12T00:20:47.727 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T00:20:47.734 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T00:20:47.738 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T00:20:47.738 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:20:47.741 DEBUG:teuthology.orchestra.run.smithi077:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:20:47.758 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T00:20:47.762 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T00:20:47.763 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:20:47.799 DEBUG:teuthology.orchestra.run.smithi077:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:20:47.907 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T00:20:47.976 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T00:20:47.991 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T00:20:47.991 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T00:20:47.991 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:20:47.992 DEBUG:teuthology.orchestra.run.smithi077:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:20:48.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:20:48.009 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-09-12T00:20:48.010 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:20:48.010 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-09-12T00:20:48.066 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-503.el9.x86_64 2024-09-12T00:20:48.067 INFO:teuthology.task.kernel:Running kernel on smithi062: 5.14.0-503.el9.x86_64 2024-09-12T00:20:48.067 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum install -y kernel 2024-09-12T00:20:48.068 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-503.el9.x86_64 2024-09-12T00:20:48.068 INFO:teuthology.task.kernel:Running kernel on smithi077: 5.14.0-503.el9.x86_64 2024-09-12T00:20:48.068 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum install -y kernel 2024-09-12T00:20:51.701 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.2 MB 00:01 2024-09-12T00:20:51.786 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 4.4 MB/s | 8.2 MB 00:01 2024-09-12T00:20:53.796 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 23 MB/s | 20 MB 00:00 2024-09-12T00:20:57.243 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 4.6 MB/s | 20 MB 00:04 2024-09-12T00:21:00.488 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 2.4 MB/s | 6.5 MB 00:02 2024-09-12T00:21:01.611 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-09-12T00:21:02.288 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 19 kB 00:00 2024-09-12T00:21:03.078 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 71 kB/s | 19 kB 00:00 2024-09-12T00:21:03.167 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-12T00:21:03.949 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-12T00:21:08.815 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-09-12T00:21:09.413 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T00:21:10.913 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T00:21:10.914 INFO:teuthology.orchestra.run.smithi062.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T00:21:11.008 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-09-12T00:21:11.017 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-09-12T00:21:11.017 INFO:teuthology.orchestra.run.smithi062.stdout: Package Architecture Version Repository Size 2024-09-12T00:21:11.017 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-09-12T00:21:11.017 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-09-12T00:21:11.017 INFO:teuthology.orchestra.run.smithi062.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T00:21:11.017 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-09-12T00:21:11.018 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T00:21:11.018 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T00:21:11.018 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T00:21:11.018 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:21:11.018 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-09-12T00:21:11.018 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-09-12T00:21:11.018 INFO:teuthology.orchestra.run.smithi062.stdout:Install 4 Packages 2024-09-12T00:21:11.018 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:21:11.019 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 79 M 2024-09-12T00:21:11.019 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 126 M 2024-09-12T00:21:11.019 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-09-12T00:21:11.411 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T00:21:11.411 INFO:teuthology.orchestra.run.smithi077.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T00:21:11.441 INFO:teuthology.orchestra.run.smithi062.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 77 kB/s | 23 kB 00:00 2024-09-12T00:21:11.504 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-12T00:21:11.514 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-12T00:21:11.514 INFO:teuthology.orchestra.run.smithi077.stdout: Package Architecture Version Repository Size 2024-09-12T00:21:11.514 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-12T00:21:11.514 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-12T00:21:11.514 INFO:teuthology.orchestra.run.smithi077.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T00:21:11.514 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-12T00:21:11.514 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T00:21:11.514 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T00:21:11.514 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T00:21:11.514 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:21:11.515 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-12T00:21:11.515 INFO:teuthology.orchestra.run.smithi077.stdout:================================================================================ 2024-09-12T00:21:11.515 INFO:teuthology.orchestra.run.smithi077.stdout:Install 4 Packages 2024-09-12T00:21:11.515 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:21:11.515 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 79 M 2024-09-12T00:21:11.515 INFO:teuthology.orchestra.run.smithi077.stdout:Installed size: 126 M 2024-09-12T00:21:11.516 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-12T00:21:11.690 INFO:teuthology.orchestra.run.smithi077.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 148 kB/s | 23 kB 00:00 2024-09-12T00:21:13.675 INFO:teuthology.orchestra.run.smithi062.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-12T00:21:14.075 INFO:teuthology.orchestra.run.smithi062.stdout:(3/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.3 MB/s | 16 MB 00:02 2024-09-12T00:21:14.717 INFO:teuthology.orchestra.run.smithi062.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 9.7 MB/s | 35 MB 00:03 2024-09-12T00:21:14.717 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:21:14.717 INFO:teuthology.orchestra.run.smithi062.stdout:Total 21 MB/s | 79 MB 00:03 2024-09-12T00:21:15.426 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-09-12T00:21:15.809 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-09-12T00:21:15.809 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-09-12T00:21:16.266 INFO:teuthology.orchestra.run.smithi077.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 3.3 MB/s | 16 MB 00:04 2024-09-12T00:21:16.785 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-09-12T00:21:16.785 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-09-12T00:21:18.798 INFO:teuthology.orchestra.run.smithi077.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 4.0 MB/s | 29 MB 00:07 2024-09-12T00:21:19.351 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-09-12T00:21:19.681 INFO:teuthology.orchestra.run.smithi077.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 4.2 MB/s | 35 MB 00:08 2024-09-12T00:21:19.682 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:21:19.682 INFO:teuthology.orchestra.run.smithi077.stdout:Total 9.6 MB/s | 79 MB 00:08 2024-09-12T00:21:20.019 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:21:20.100 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:21:20.364 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-12T00:21:20.709 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-12T00:21:20.709 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-12T00:21:21.686 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-12T00:21:21.686 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-12T00:21:22.896 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:21:23.019 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:21:24.160 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-12T00:21:24.811 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:21:24.900 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:21:27.705 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:21:27.854 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:21:28.150 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:21:28.195 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:21:32.704 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:21:32.804 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:21:33.343 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:21:37.655 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:22:12.333 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:22:12.374 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:22:12.656 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:22:12.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:22:12.656 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:22:12.657 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:22:13.502 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:22:13.503 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:22:13.503 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-09-12T00:22:13.503 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T00:22:13.503 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T00:22:13.503 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T00:22:13.503 INFO:teuthology.orchestra.run.smithi062.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T00:22:13.503 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:22:13.503 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-09-12T00:22:13.834 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:22:13.956 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:22:13.957 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:22:13.957 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T00:22:13.957 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:22:13.957 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:22:13.957 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T00:22:13.958 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi062.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:22:13.958 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:22:14.016 INFO:teuthology.orchestra.run.smithi062.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:22:14.016 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:22:14.016 DEBUG:teuthology.orchestra.run.smithi062:> sudo rpm -qi grub2-tools 2024-09-12T00:22:14.056 INFO:teuthology.orchestra.run.smithi062.stdout:Name : grub2-tools 2024-09-12T00:22:14.056 INFO:teuthology.orchestra.run.smithi062.stdout:Epoch : 1 2024-09-12T00:22:14.057 INFO:teuthology.orchestra.run.smithi062.stdout:Version : 2.06 2024-09-12T00:22:14.057 INFO:teuthology.orchestra.run.smithi062.stdout:Release : 82.el9 2024-09-12T00:22:14.057 INFO:teuthology.orchestra.run.smithi062.stdout:Architecture: x86_64 2024-09-12T00:22:14.057 INFO:teuthology.orchestra.run.smithi062.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T00:22:14.057 INFO:teuthology.orchestra.run.smithi062.stdout:Group : Unspecified 2024-09-12T00:22:14.057 INFO:teuthology.orchestra.run.smithi062.stdout:Size : 8274670 2024-09-12T00:22:14.057 INFO:teuthology.orchestra.run.smithi062.stdout:License : GPLv3+ 2024-09-12T00:22:14.057 INFO:teuthology.orchestra.run.smithi062.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T00:22:14.057 INFO:teuthology.orchestra.run.smithi062.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T00:22:14.057 INFO:teuthology.orchestra.run.smithi062.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T00:22:14.057 INFO:teuthology.orchestra.run.smithi062.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T00:22:14.057 INFO:teuthology.orchestra.run.smithi062.stdout:Packager : builder@centos.org 2024-09-12T00:22:14.057 INFO:teuthology.orchestra.run.smithi062.stdout:Vendor : CentOS 2024-09-12T00:22:14.058 INFO:teuthology.orchestra.run.smithi062.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T00:22:14.058 INFO:teuthology.orchestra.run.smithi062.stdout:Summary : Support tools for GRUB. 2024-09-12T00:22:14.058 INFO:teuthology.orchestra.run.smithi062.stdout:Description : 2024-09-12T00:22:14.058 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:22:14.058 INFO:teuthology.orchestra.run.smithi062.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T00:22:14.058 INFO:teuthology.orchestra.run.smithi062.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T00:22:14.058 INFO:teuthology.orchestra.run.smithi062.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T00:22:14.060 INFO:teuthology.orchestra.run.smithi062.stdout:hardware devices. 2024-09-12T00:22:14.060 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:22:14.060 INFO:teuthology.orchestra.run.smithi062.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T00:22:14.061 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T00:22:14.061 INFO:teuthology.task.kernel:Updating grub on smithi062 to boot 5.14.0-505.el9.x86_64 2024-09-12T00:22:14.061 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T00:22:14.733 INFO:teuthology.orchestra.run.smithi062.stderr:Generating grub configuration file ... 2024-09-12T00:22:15.864 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:22:15.905 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:22:16.040 INFO:teuthology.orchestra.run.smithi062.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T00:22:16.069 INFO:teuthology.orchestra.run.smithi062.stderr:done 2024-09-12T00:22:16.077 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-09-12T00:22:16.093 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.XShstrSMJf 2024-09-12T00:22:16.093 DEBUG:teuthology.orchestra.run.smithi062:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.XShstrSMJf 2024-09-12T00:22:16.159 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.XShstrSMJf 2024-09-12T00:22:16.203 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:22:16.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:22:16.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:22:16.204 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:22:16.295 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.XShstrSMJf is 6KB 2024-09-12T00:22:16.344 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.XShstrSMJf 2024-09-12T00:22:16.360 DEBUG:teuthology.orchestra.run.smithi062:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T00:22:16.432 INFO:teuthology.orchestra.run.smithi062.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T00:22:16.432 INFO:teuthology.orchestra.run.smithi062.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T00:22:16.432 INFO:teuthology.orchestra.run.smithi062.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T00:22:16.432 INFO:teuthology.orchestra.run.smithi062.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T00:22:16.433 DEBUG:teuthology.orchestra.run.smithi062:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T00:22:16.598 DEBUG:teuthology.orchestra.run.smithi062:> sudo shutdown -r now 2024-09-12T00:22:17.057 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:22:17.058 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:22:17.058 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-12T00:22:17.058 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T00:22:17.058 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T00:22:17.058 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T00:22:17.058 INFO:teuthology.orchestra.run.smithi077.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T00:22:17.058 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:22:17.058 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-12T00:22:17.372 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:22:17.449 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:22:17.449 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:22:17.450 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T00:22:17.450 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:22:17.450 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:22:17.450 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T00:22:17.450 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi077.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:22:17.450 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:22:17.508 INFO:teuthology.orchestra.run.smithi077.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:22:17.509 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:22:17.509 DEBUG:teuthology.orchestra.run.smithi077:> sudo rpm -qi grub2-tools 2024-09-12T00:22:17.540 INFO:teuthology.orchestra.run.smithi077.stdout:Name : grub2-tools 2024-09-12T00:22:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:Epoch : 1 2024-09-12T00:22:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:Version : 2.06 2024-09-12T00:22:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:Release : 82.el9 2024-09-12T00:22:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:Architecture: x86_64 2024-09-12T00:22:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T00:22:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:Group : Unspecified 2024-09-12T00:22:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:Size : 8274670 2024-09-12T00:22:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:License : GPLv3+ 2024-09-12T00:22:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T00:22:17.541 INFO:teuthology.orchestra.run.smithi077.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T00:22:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T00:22:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T00:22:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:Packager : builder@centos.org 2024-09-12T00:22:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:Vendor : CentOS 2024-09-12T00:22:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T00:22:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:Summary : Support tools for GRUB. 2024-09-12T00:22:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:Description : 2024-09-12T00:22:17.542 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:22:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T00:22:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T00:22:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T00:22:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:hardware devices. 2024-09-12T00:22:17.542 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:22:17.542 INFO:teuthology.orchestra.run.smithi077.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T00:22:17.543 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T00:22:17.543 INFO:teuthology.task.kernel:Updating grub on smithi077 to boot 5.14.0-505.el9.x86_64 2024-09-12T00:22:17.543 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T00:22:18.183 INFO:teuthology.orchestra.run.smithi077.stderr:Generating grub configuration file ... 2024-09-12T00:22:19.527 INFO:teuthology.orchestra.run.smithi077.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T00:22:19.554 INFO:teuthology.orchestra.run.smithi077.stderr:done 2024-09-12T00:22:19.556 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-09-12T00:22:19.572 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.H78vD0HH3s 2024-09-12T00:22:19.573 DEBUG:teuthology.orchestra.run.smithi077:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.H78vD0HH3s 2024-09-12T00:22:19.638 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.H78vD0HH3s 2024-09-12T00:22:19.796 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.H78vD0HH3s is 6KB 2024-09-12T00:22:19.816 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.H78vD0HH3s 2024-09-12T00:22:19.830 DEBUG:teuthology.orchestra.run.smithi077:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T00:22:19.893 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T00:22:19.894 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T00:22:19.894 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T00:22:19.894 INFO:teuthology.orchestra.run.smithi077.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T00:22:19.895 DEBUG:teuthology.orchestra.run.smithi077:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T00:22:20.046 DEBUG:teuthology.orchestra.run.smithi077:> sudo shutdown -r now 2024-09-12T00:22:46.625 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T00:22:46.626 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T00:22:46.627 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:22:50.053 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T00:22:50.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-12T00:22:50.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:23:05.021 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-09-12T00:23:08.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-09-12T00:23:14.025 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T00:23:14.026 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:23:17.085 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.62 2024-09-12T00:23:17.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-12T00:23:17.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:23:20.673 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-09-12T00:23:29.093 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T00:23:29.094 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:23:32.765 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-12T00:23:32.766 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:23:51.105 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.77 2024-09-12T00:24:01.176 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-09-12T00:24:01.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T00:24:01.825 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T00:24:01.825 DEBUG:teuthology.orchestra.run.smithi062:> uname -r 2024-09-12T00:24:01.869 INFO:teuthology.orchestra.run.smithi062.stdout:5.14.0-505.el9.x86_64 2024-09-12T00:24:01.870 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T00:24:01.870 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:24:01.870 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T00:24:02.871 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T00:24:02.871 DEBUG:teuthology.orchestra.run.smithi062:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:24:03.019 INFO:teuthology.orchestra.run.smithi062.stdout:ttyS1 2024-09-12T00:24:03.248 DEBUG:teuthology.parallel:result is None 2024-09-12T00:24:06.106 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-12T00:24:06.107 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:24:06.490 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-09-12T00:24:06.910 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-12T00:24:06.911 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T00:24:06.911 DEBUG:teuthology.orchestra.run.smithi077:> uname -r 2024-09-12T00:24:06.946 INFO:teuthology.orchestra.run.smithi077.stdout:5.14.0-505.el9.x86_64 2024-09-12T00:24:06.946 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T00:24:06.946 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:24:06.946 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T00:24:07.947 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T00:24:07.947 DEBUG:teuthology.orchestra.run.smithi077:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:24:08.018 INFO:teuthology.orchestra.run.smithi077.stdout:ttyS1 2024-09-12T00:24:08.195 DEBUG:teuthology.parallel:result is None 2024-09-12T00:24:08.195 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T00:24:08.282 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T00:24:08.283 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:24:08.286 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:24:08.302 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T00:24:08.312 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T00:24:08.319 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T00:24:08.320 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:24:08.345 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:24:08.409 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T00:24:08.463 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T00:24:08.464 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:24:08.466 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:24:08.496 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:24:08.500 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:24:08.506 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:24:08.512 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:24:08.514 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T00:24:08.526 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T00:24:08.526 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:24:08.557 DEBUG:teuthology.orchestra.run.smithi077:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:24:08.585 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T00:24:08.604 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T00:24:08.604 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:24:08.627 DEBUG:teuthology.orchestra.run.smithi077:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:24:08.643 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:24:08.729 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:24:08.777 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:24:08.863 DEBUG:teuthology.orchestra.run.smithi062:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:24:08.904 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:24:08.904 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:24:08.971 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:24:09.018 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:24:09.070 DEBUG:teuthology.orchestra.run.smithi077:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:24:09.156 DEBUG:teuthology.orchestra.run.smithi077:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:24:09.192 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:24:09.192 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:24:09.256 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2024-09-12T00:24:09.259 DEBUG:teuthology.orchestra.run.smithi077:> sudo service rsyslog restart 2024-09-12T00:24:09.304 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:24:09.341 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:24:09.727 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T00:24:09.843 INFO:teuthology.task.internal:Starting timer... 2024-09-12T00:24:09.844 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T00:24:09.861 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T00:24:09.871 DEBUG:teuthology.orchestra.run.smithi062:> sudo service auditd rotate 2024-09-12T00:24:09.937 INFO:teuthology.orchestra.run.smithi062.stdout:Rotating logs: 2024-09-12T00:24:09.939 DEBUG:teuthology.orchestra.run.smithi077:> sudo service auditd rotate 2024-09-12T00:24:09.995 INFO:teuthology.orchestra.run.smithi077.stdout:Rotating logs: 2024-09-12T00:24:09.997 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T00:24:09.998 DEBUG:teuthology.orchestra.run.smithi062:> /usr/sbin/getenforce 2024-09-12T00:24:10.023 INFO:teuthology.orchestra.run.smithi062.stdout:Permissive 2024-09-12T00:24:10.024 DEBUG:teuthology.orchestra.run.smithi077:> /usr/sbin/getenforce 2024-09-12T00:24:10.047 INFO:teuthology.orchestra.run.smithi077.stdout:Permissive 2024-09-12T00:24:10.047 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi062.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi077.front.sepia.ceph.com': 'permissive'} 2024-09-12T00:24:10.048 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T00:24:10.094 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:24:10.094 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T00:24:10.121 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:24:10.121 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T00:24:10.121 DEBUG:teuthology.orchestra.run.smithi062:> sudo /usr/sbin/setenforce permissive 2024-09-12T00:24:10.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo /usr/sbin/setenforce permissive 2024-09-12T00:24:10.202 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T00:24:10.290 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-12T00:24:10.293 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-12T00:24:10.408 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T00:24:10.418 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T00:24:10.419 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi077.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T00:27:57.314 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi077.front.sepia.ceph.com')] 2024-09-12T00:27:57.316 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T00:27:57.317 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:27:57.402 DEBUG:teuthology.orchestra.run.smithi062:> true 2024-09-12T00:27:57.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi062.front.sepia.ceph.com' 2024-09-12T00:27:57.484 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-12T00:27:57.485 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi077.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:27:57.586 DEBUG:teuthology.orchestra.run.smithi077:> true 2024-09-12T00:27:57.664 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi077.front.sepia.ceph.com' 2024-09-12T00:27:57.665 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T00:27:57.675 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T00:27:57.676 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:27:57.676 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:27:57.679 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:27:57.679 DEBUG:teuthology.orchestra.run.smithi077:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:27:57.706 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T00:27:57.721 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T00:27:57.733 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T00:27:57.746 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: ntpd: command not found 2024-09-12T00:27:57.747 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T00:27:57.757 INFO:teuthology.orchestra.run.smithi062.stdout:506 Cannot talk to daemon 2024-09-12T00:27:57.771 INFO:teuthology.orchestra.run.smithi077.stderr:sudo: ntpd: command not found 2024-09-12T00:27:57.772 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T00:27:57.782 INFO:teuthology.orchestra.run.smithi077.stdout:506 Cannot talk to daemon 2024-09-12T00:27:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T00:27:57.796 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T00:27:57.810 INFO:teuthology.orchestra.run.smithi077.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T00:27:57.843 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:27:57.847 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:27:57.847 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-09-12T00:27:57.847 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:27:57.847 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:27:57.847 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:27:57.847 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:27:57.866 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:27:57.869 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:27:57.870 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-09-12T00:27:57.870 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:27:57.870 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:27:57.870 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:27:57.870 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:27:57.871 INFO:teuthology.run_tasks:Running task install... 2024-09-12T00:27:57.879 DEBUG:teuthology.task.install:project ceph 2024-09-12T00:27:57.879 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-12T00:27:57.879 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-12T00:27:57.880 INFO:teuthology.task.install:Using flavor: default 2024-09-12T00:27:57.885 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T00:27:57.885 INFO:teuthology.task.install:extra packages: [] 2024-09-12T00:27:57.886 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'tag': None, 'wait_for_package': False} 2024-09-12T00:27:57.886 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:27:57.888 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'tag': None, 'wait_for_package': False} 2024-09-12T00:27:57.889 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:27:58.050 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/ 2024-09-12T00:27:58.050 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4753.gd011c522 2024-09-12T00:27:58.062 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/ 2024-09-12T00:27:58.062 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4753.gd011c522 2024-09-12T00:27:58.168 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T00:27:58.168 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:27:58.169 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T00:27:58.181 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T00:27:58.181 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:27:58.181 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T00:27:58.196 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T00:27:58.196 DEBUG:teuthology.orchestra.run.smithi062:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d011c522bb171e70fc5782f1e7a71ce5f37e573f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T00:27:58.207 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T00:27:58.207 DEBUG:teuthology.orchestra.run.smithi077:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d011c522bb171e70fc5782f1e7a71ce5f37e573f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T00:27:58.264 DEBUG:teuthology.orchestra.run.smithi062:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T00:27:58.273 DEBUG:teuthology.orchestra.run.smithi077:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T00:27:58.342 DEBUG:teuthology.orchestra.run.smithi062:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T00:27:58.347 DEBUG:teuthology.orchestra.run.smithi077:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T00:27:58.407 INFO:teuthology.orchestra.run.smithi062.stdout:check_obsoletes = 1 2024-09-12T00:27:58.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum clean all 2024-09-12T00:27:58.412 INFO:teuthology.orchestra.run.smithi077.stdout:check_obsoletes = 1 2024-09-12T00:27:58.413 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum clean all 2024-09-12T00:27:58.637 INFO:teuthology.orchestra.run.smithi077.stdout:45 files removed 2024-09-12T00:27:58.643 INFO:teuthology.orchestra.run.smithi062.stdout:45 files removed 2024-09-12T00:27:58.664 DEBUG:teuthology.orchestra.run.smithi077:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T00:27:58.671 DEBUG:teuthology.orchestra.run.smithi062:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T00:27:59.226 INFO:teuthology.orchestra.run.smithi077.stdout:ceph packages for x86_64 302 kB/s | 84 kB 00:00 2024-09-12T00:27:59.238 INFO:teuthology.orchestra.run.smithi062.stdout:ceph packages for x86_64 313 kB/s | 84 kB 00:00 2024-09-12T00:27:59.518 INFO:teuthology.orchestra.run.smithi077.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-12T00:27:59.531 INFO:teuthology.orchestra.run.smithi062.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-12T00:27:59.794 INFO:teuthology.orchestra.run.smithi077.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-12T00:27:59.823 INFO:teuthology.orchestra.run.smithi062.stdout:ceph source packages 7.6 kB/s | 1.9 kB 00:00 2024-09-12T00:28:01.182 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.2 MB 00:01 2024-09-12T00:28:01.561 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - BaseOS 4.8 MB/s | 8.2 MB 00:01 2024-09-12T00:28:03.612 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-12T00:28:07.980 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-12T00:28:09.588 INFO:teuthology.orchestra.run.smithi077.stdout:CentOS Stream 9 - Extras packages 74 kB/s | 19 kB 00:00 2024-09-12T00:28:10.351 INFO:teuthology.orchestra.run.smithi077.stdout:Extra Packages for Enterprise Linux 35 MB/s | 23 MB 00:00 2024-09-12T00:28:15.707 INFO:teuthology.orchestra.run.smithi077.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-09-12T00:28:18.000 INFO:teuthology.orchestra.run.smithi077.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:28:18.001 INFO:teuthology.orchestra.run.smithi077.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:28:18.089 INFO:teuthology.orchestra.run.smithi077.stdout:Dependencies resolved. 2024-09-12T00:28:18.108 INFO:teuthology.orchestra.run.smithi077.stdout:====================================================================================================== 2024-09-12T00:28:18.109 INFO:teuthology.orchestra.run.smithi077.stdout: Package Arch Version Repository Size 2024-09-12T00:28:18.109 INFO:teuthology.orchestra.run.smithi077.stdout:====================================================================================================== 2024-09-12T00:28:18.109 INFO:teuthology.orchestra.run.smithi077.stdout:Installing: 2024-09-12T00:28:18.109 INFO:teuthology.orchestra.run.smithi077.stdout: ceph x86_64 2:19.3.0-4753.gd011c522.el9 ceph 6.6 k 2024-09-12T00:28:18.109 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:28:18.109 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 899 k 2024-09-12T00:28:18.109 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4753.gd011c522.el9 ceph 145 k 2024-09-12T00:28:18.109 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr x86_64 2:19.3.0-4753.gd011c522.el9 ceph 1.5 M 2024-09-12T00:28:18.109 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 154 k 2024-09-12T00:28:18.109 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 14 M 2024-09-12T00:28:18.109 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 7.4 M 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 49 k 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 11 M 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test x86_64 2:19.3.0-4753.gd011c522.el9 ceph 50 M 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 285 k 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 782 k 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 32 k 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 755 k 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 126 k 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi077.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T00:28:18.110 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:28:18.111 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados x86_64 2:19.3.0-4753.gd011c522.el9 ceph 322 k 2024-09-12T00:28:18.111 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 306 k 2024-09-12T00:28:18.111 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 99 k 2024-09-12T00:28:18.111 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 85 k 2024-09-12T00:28:18.111 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:28:18.111 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 170 k 2024-09-12T00:28:18.111 INFO:teuthology.orchestra.run.smithi077.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T00:28:18.111 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrading: 2024-09-12T00:28:18.111 INFO:teuthology.orchestra.run.smithi077.stdout: librados2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.5 M 2024-09-12T00:28:18.111 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:28:18.111 INFO:teuthology.orchestra.run.smithi077.stdout:Installing dependencies: 2024-09-12T00:28:18.111 INFO:teuthology.orchestra.run.smithi077.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T00:28:18.112 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T00:28:18.112 INFO:teuthology.orchestra.run.smithi077.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T00:28:18.112 INFO:teuthology.orchestra.run.smithi077.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T00:28:18.112 INFO:teuthology.orchestra.run.smithi077.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T00:28:18.112 INFO:teuthology.orchestra.run.smithi077.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T00:28:18.112 INFO:teuthology.orchestra.run.smithi077.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T00:28:18.112 INFO:teuthology.orchestra.run.smithi077.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T00:28:18.112 INFO:teuthology.orchestra.run.smithi077.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T00:28:18.112 INFO:teuthology.orchestra.run.smithi077.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T00:28:18.112 INFO:teuthology.orchestra.run.smithi077.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T00:28:18.112 INFO:teuthology.orchestra.run.smithi077.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T00:28:18.113 INFO:teuthology.orchestra.run.smithi077.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T00:28:18.113 INFO:teuthology.orchestra.run.smithi077.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T00:28:18.113 INFO:teuthology.orchestra.run.smithi077.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T00:28:18.113 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T00:28:18.113 INFO:teuthology.orchestra.run.smithi077.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T00:28:18.113 INFO:teuthology.orchestra.run.smithi077.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T00:28:18.113 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 22 M 2024-09-12T00:28:18.113 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 34 k 2024-09-12T00:28:18.113 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds x86_64 2:19.3.0-4753.gd011c522.el9 ceph 2.4 M 2024-09-12T00:28:18.114 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 291 k 2024-09-12T00:28:18.114 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon x86_64 2:19.3.0-4753.gd011c522.el9 ceph 4.8 M 2024-09-12T00:28:18.114 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 17 M 2024-09-12T00:28:18.114 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 16 k 2024-09-12T00:28:18.114 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux x86_64 2:19.3.0-4753.gd011c522.el9 ceph 25 k 2024-09-12T00:28:18.114 INFO:teuthology.orchestra.run.smithi077.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T00:28:18.114 INFO:teuthology.orchestra.run.smithi077.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T00:28:18.114 INFO:teuthology.orchestra.run.smithi077.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T00:28:18.114 INFO:teuthology.orchestra.run.smithi077.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T00:28:18.114 INFO:teuthology.orchestra.run.smithi077.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T00:28:18.114 INFO:teuthology.orchestra.run.smithi077.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T00:28:18.114 INFO:teuthology.orchestra.run.smithi077.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T00:28:18.115 INFO:teuthology.orchestra.run.smithi077.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T00:28:18.115 INFO:teuthology.orchestra.run.smithi077.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T00:28:18.115 INFO:teuthology.orchestra.run.smithi077.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T00:28:18.115 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T00:28:18.115 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T00:28:18.115 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T00:28:18.115 INFO:teuthology.orchestra.run.smithi077.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T00:28:18.115 INFO:teuthology.orchestra.run.smithi077.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T00:28:18.115 INFO:teuthology.orchestra.run.smithi077.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T00:28:18.115 INFO:teuthology.orchestra.run.smithi077.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T00:28:18.115 INFO:teuthology.orchestra.run.smithi077.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T00:28:18.115 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T00:28:18.115 INFO:teuthology.orchestra.run.smithi077.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T00:28:18.116 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T00:28:18.116 INFO:teuthology.orchestra.run.smithi077.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T00:28:18.116 INFO:teuthology.orchestra.run.smithi077.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T00:28:18.116 INFO:teuthology.orchestra.run.smithi077.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T00:28:18.116 INFO:teuthology.orchestra.run.smithi077.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T00:28:18.116 INFO:teuthology.orchestra.run.smithi077.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T00:28:18.116 INFO:teuthology.orchestra.run.smithi077.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T00:28:18.116 INFO:teuthology.orchestra.run.smithi077.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T00:28:18.116 INFO:teuthology.orchestra.run.smithi077.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T00:28:18.116 INFO:teuthology.orchestra.run.smithi077.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T00:28:18.116 INFO:teuthology.orchestra.run.smithi077.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T00:28:18.116 INFO:teuthology.orchestra.run.smithi077.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T00:28:18.117 INFO:teuthology.orchestra.run.smithi077.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T00:28:18.117 INFO:teuthology.orchestra.run.smithi077.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T00:28:18.117 INFO:teuthology.orchestra.run.smithi077.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T00:28:18.117 INFO:teuthology.orchestra.run.smithi077.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T00:28:18.117 INFO:teuthology.orchestra.run.smithi077.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T00:28:18.117 INFO:teuthology.orchestra.run.smithi077.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T00:28:18.117 INFO:teuthology.orchestra.run.smithi077.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T00:28:18.117 INFO:teuthology.orchestra.run.smithi077.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T00:28:18.117 INFO:teuthology.orchestra.run.smithi077.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T00:28:18.117 INFO:teuthology.orchestra.run.smithi077.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T00:28:18.117 INFO:teuthology.orchestra.run.smithi077.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T00:28:18.117 INFO:teuthology.orchestra.run.smithi077.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T00:28:18.118 INFO:teuthology.orchestra.run.smithi077.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T00:28:18.118 INFO:teuthology.orchestra.run.smithi077.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T00:28:18.118 INFO:teuthology.orchestra.run.smithi077.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T00:28:18.118 INFO:teuthology.orchestra.run.smithi077.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T00:28:18.118 INFO:teuthology.orchestra.run.smithi077.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T00:28:18.118 INFO:teuthology.orchestra.run.smithi077.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T00:28:18.118 INFO:teuthology.orchestra.run.smithi077.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T00:28:18.118 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T00:28:18.118 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T00:28:18.118 INFO:teuthology.orchestra.run.smithi077.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T00:28:18.118 INFO:teuthology.orchestra.run.smithi077.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T00:28:18.119 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:28:18.119 INFO:teuthology.orchestra.run.smithi077.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T00:28:18.119 INFO:teuthology.orchestra.run.smithi077.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T00:28:18.119 INFO:teuthology.orchestra.run.smithi077.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T00:28:18.119 INFO:teuthology.orchestra.run.smithi077.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T00:28:18.119 INFO:teuthology.orchestra.run.smithi077.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T00:28:18.119 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T00:28:18.119 INFO:teuthology.orchestra.run.smithi077.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T00:28:18.119 INFO:teuthology.orchestra.run.smithi077.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T00:28:18.119 INFO:teuthology.orchestra.run.smithi077.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T00:28:18.119 INFO:teuthology.orchestra.run.smithi077.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T00:28:18.119 INFO:teuthology.orchestra.run.smithi077.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T00:28:18.119 INFO:teuthology.orchestra.run.smithi077.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T00:28:18.120 INFO:teuthology.orchestra.run.smithi077.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T00:28:18.120 INFO:teuthology.orchestra.run.smithi077.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T00:28:18.120 INFO:teuthology.orchestra.run.smithi077.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T00:28:18.120 INFO:teuthology.orchestra.run.smithi077.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T00:28:18.120 INFO:teuthology.orchestra.run.smithi077.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T00:28:18.120 INFO:teuthology.orchestra.run.smithi077.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T00:28:18.120 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T00:28:18.120 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T00:28:18.120 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T00:28:18.120 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 508 k 2024-09-12T00:28:18.120 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T00:28:18.120 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:28:18.120 INFO:teuthology.orchestra.run.smithi077.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T00:28:18.121 INFO:teuthology.orchestra.run.smithi077.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T00:28:18.121 INFO:teuthology.orchestra.run.smithi077.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T00:28:18.121 INFO:teuthology.orchestra.run.smithi077.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T00:28:18.121 INFO:teuthology.orchestra.run.smithi077.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T00:28:18.121 INFO:teuthology.orchestra.run.smithi077.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T00:28:18.121 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T00:28:18.121 INFO:teuthology.orchestra.run.smithi077.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T00:28:18.121 INFO:teuthology.orchestra.run.smithi077.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T00:28:18.121 INFO:teuthology.orchestra.run.smithi077.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T00:28:18.121 INFO:teuthology.orchestra.run.smithi077.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T00:28:18.121 INFO:teuthology.orchestra.run.smithi077.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T00:28:18.121 INFO:teuthology.orchestra.run.smithi077.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T00:28:18.122 INFO:teuthology.orchestra.run.smithi077.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T00:28:18.122 INFO:teuthology.orchestra.run.smithi077.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T00:28:18.122 INFO:teuthology.orchestra.run.smithi077.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T00:28:18.122 INFO:teuthology.orchestra.run.smithi077.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T00:28:18.122 INFO:teuthology.orchestra.run.smithi077.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T00:28:18.122 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T00:28:18.122 INFO:teuthology.orchestra.run.smithi077.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T00:28:18.122 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T00:28:18.122 INFO:teuthology.orchestra.run.smithi077.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T00:28:18.122 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T00:28:18.122 INFO:teuthology.orchestra.run.smithi077.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T00:28:18.123 INFO:teuthology.orchestra.run.smithi077.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T00:28:18.123 INFO:teuthology.orchestra.run.smithi077.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T00:28:18.123 INFO:teuthology.orchestra.run.smithi077.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T00:28:18.123 INFO:teuthology.orchestra.run.smithi077.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T00:28:18.123 INFO:teuthology.orchestra.run.smithi077.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T00:28:18.123 INFO:teuthology.orchestra.run.smithi077.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T00:28:18.123 INFO:teuthology.orchestra.run.smithi077.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T00:28:18.123 INFO:teuthology.orchestra.run.smithi077.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T00:28:18.123 INFO:teuthology.orchestra.run.smithi077.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T00:28:18.123 INFO:teuthology.orchestra.run.smithi077.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T00:28:18.123 INFO:teuthology.orchestra.run.smithi077.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T00:28:18.123 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T00:28:18.123 INFO:teuthology.orchestra.run.smithi077.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T00:28:18.124 INFO:teuthology.orchestra.run.smithi077.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T00:28:18.124 INFO:teuthology.orchestra.run.smithi077.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T00:28:18.124 INFO:teuthology.orchestra.run.smithi077.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T00:28:18.124 INFO:teuthology.orchestra.run.smithi077.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T00:28:18.124 INFO:teuthology.orchestra.run.smithi077.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T00:28:18.124 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T00:28:18.124 INFO:teuthology.orchestra.run.smithi077.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T00:28:18.124 INFO:teuthology.orchestra.run.smithi077.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T00:28:18.124 INFO:teuthology.orchestra.run.smithi077.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T00:28:18.124 INFO:teuthology.orchestra.run.smithi077.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T00:28:18.124 INFO:teuthology.orchestra.run.smithi077.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T00:28:18.124 INFO:teuthology.orchestra.run.smithi077.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T00:28:18.125 INFO:teuthology.orchestra.run.smithi077.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T00:28:18.125 INFO:teuthology.orchestra.run.smithi077.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T00:28:18.125 INFO:teuthology.orchestra.run.smithi077.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T00:28:18.125 INFO:teuthology.orchestra.run.smithi077.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T00:28:18.125 INFO:teuthology.orchestra.run.smithi077.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T00:28:18.125 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T00:28:18.125 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T00:28:18.125 INFO:teuthology.orchestra.run.smithi077.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T00:28:18.125 INFO:teuthology.orchestra.run.smithi077.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T00:28:18.125 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T00:28:18.125 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T00:28:18.125 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T00:28:18.125 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T00:28:18.126 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 45 k 2024-09-12T00:28:18.126 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 143 k 2024-09-12T00:28:18.126 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T00:28:18.126 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T00:28:18.126 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T00:28:18.126 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T00:28:18.126 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T00:28:18.126 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T00:28:18.126 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T00:28:18.126 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T00:28:18.126 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T00:28:18.126 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T00:28:18.126 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T00:28:18.126 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T00:28:18.127 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T00:28:18.127 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T00:28:18.127 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T00:28:18.127 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T00:28:18.127 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T00:28:18.127 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T00:28:18.127 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T00:28:18.127 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T00:28:18.127 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T00:28:18.127 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T00:28:18.127 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T00:28:18.127 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T00:28:18.127 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T00:28:18.128 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T00:28:18.128 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T00:28:18.128 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T00:28:18.128 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T00:28:18.128 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T00:28:18.128 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T00:28:18.128 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T00:28:18.128 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T00:28:18.128 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T00:28:18.128 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T00:28:18.128 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T00:28:18.128 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T00:28:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T00:28:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T00:28:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T00:28:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T00:28:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T00:28:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T00:28:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T00:28:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T00:28:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T00:28:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T00:28:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T00:28:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T00:28:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T00:28:18.129 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T00:28:18.130 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T00:28:18.130 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T00:28:18.130 INFO:teuthology.orchestra.run.smithi077.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T00:28:18.130 INFO:teuthology.orchestra.run.smithi077.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T00:28:18.130 INFO:teuthology.orchestra.run.smithi077.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T00:28:18.130 INFO:teuthology.orchestra.run.smithi077.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T00:28:18.130 INFO:teuthology.orchestra.run.smithi077.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T00:28:18.130 INFO:teuthology.orchestra.run.smithi077.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T00:28:18.130 INFO:teuthology.orchestra.run.smithi077.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T00:28:18.130 INFO:teuthology.orchestra.run.smithi077.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T00:28:18.130 INFO:teuthology.orchestra.run.smithi077.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T00:28:18.130 INFO:teuthology.orchestra.run.smithi077.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T00:28:18.131 INFO:teuthology.orchestra.run.smithi077.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T00:28:18.131 INFO:teuthology.orchestra.run.smithi077.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T00:28:18.131 INFO:teuthology.orchestra.run.smithi077.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T00:28:18.131 INFO:teuthology.orchestra.run.smithi077.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T00:28:18.131 INFO:teuthology.orchestra.run.smithi077.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T00:28:18.131 INFO:teuthology.orchestra.run.smithi077.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T00:28:18.131 INFO:teuthology.orchestra.run.smithi077.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T00:28:18.131 INFO:teuthology.orchestra.run.smithi077.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T00:28:18.131 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T00:28:18.131 INFO:teuthology.orchestra.run.smithi077.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T00:28:18.131 INFO:teuthology.orchestra.run.smithi077.stdout:Installing weak dependencies: 2024-09-12T00:28:18.131 INFO:teuthology.orchestra.run.smithi077.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T00:28:18.131 INFO:teuthology.orchestra.run.smithi077.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T00:28:18.132 INFO:teuthology.orchestra.run.smithi077.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T00:28:18.132 INFO:teuthology.orchestra.run.smithi077.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T00:28:18.132 INFO:teuthology.orchestra.run.smithi077.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T00:28:18.132 INFO:teuthology.orchestra.run.smithi077.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T00:28:18.132 INFO:teuthology.orchestra.run.smithi077.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T00:28:18.132 INFO:teuthology.orchestra.run.smithi077.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T00:28:18.132 INFO:teuthology.orchestra.run.smithi077.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T00:28:18.132 INFO:teuthology.orchestra.run.smithi077.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T00:28:18.132 INFO:teuthology.orchestra.run.smithi077.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T00:28:18.132 INFO:teuthology.orchestra.run.smithi077.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T00:28:18.132 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T00:28:18.132 INFO:teuthology.orchestra.run.smithi077.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T00:28:18.132 INFO:teuthology.orchestra.run.smithi077.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T00:28:18.133 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:28:18.133 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction Summary 2024-09-12T00:28:18.133 INFO:teuthology.orchestra.run.smithi077.stdout:====================================================================================================== 2024-09-12T00:28:18.133 INFO:teuthology.orchestra.run.smithi077.stdout:Install 283 Packages 2024-09-12T00:28:18.133 INFO:teuthology.orchestra.run.smithi077.stdout:Upgrade 2 Packages 2024-09-12T00:28:18.133 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:28:18.133 INFO:teuthology.orchestra.run.smithi077.stdout:Total download size: 327 M 2024-09-12T00:28:18.134 INFO:teuthology.orchestra.run.smithi077.stdout:Downloading Packages: 2024-09-12T00:28:18.608 INFO:teuthology.orchestra.run.smithi077.stdout:(1/285): ceph-19.3.0-4753.gd011c522.el9.x86_64. 47 kB/s | 6.6 kB 00:00 2024-09-12T00:28:18.942 INFO:teuthology.orchestra.run.smithi077.stdout:(2/285): ceph-base-19.3.0-4753.gd011c522.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-12T00:28:18.975 INFO:teuthology.orchestra.run.smithi077.stdout:(3/285): ceph-fuse-19.3.0-4753.gd011c522.el9.x8 2.4 MB/s | 899 kB 00:00 2024-09-12T00:28:19.001 INFO:teuthology.orchestra.run.smithi077.stdout:(4/285): ceph-immutable-object-cache-19.3.0-475 2.4 MB/s | 145 kB 00:00 2024-09-12T00:28:19.093 INFO:teuthology.orchestra.run.smithi077.stdout:(5/285): ceph-mgr-19.3.0-4753.gd011c522.el9.x86 17 MB/s | 1.5 MB 00:00 2024-09-12T00:28:19.360 INFO:teuthology.orchestra.run.smithi077.stdout:(6/285): ceph-mon-19.3.0-4753.gd011c522.el9.x86 18 MB/s | 4.8 MB 00:00 2024-09-12T00:28:19.585 INFO:teuthology.orchestra.run.smithi077.stdout:(7/285): ceph-common-19.3.0-4753.gd011c522.el9. 19 MB/s | 22 MB 00:01 2024-09-12T00:28:19.635 INFO:teuthology.orchestra.run.smithi077.stdout:(8/285): ceph-mds-19.3.0-4753.gd011c522.el9.x86 3.6 MB/s | 2.4 MB 00:00 2024-09-12T00:28:19.702 INFO:teuthology.orchestra.run.smithi077.stdout:(9/285): ceph-selinux-19.3.0-4753.gd011c522.el9 378 kB/s | 25 kB 00:00 2024-09-12T00:28:20.002 INFO:teuthology.orchestra.run.smithi077.stdout:(10/285): ceph-radosgw-19.3.0-4753.gd011c522.el 26 MB/s | 11 MB 00:00 2024-09-12T00:28:20.044 INFO:teuthology.orchestra.run.smithi077.stdout:(11/285): libcephfs-devel-19.3.0-4753.gd011c522 771 kB/s | 32 kB 00:00 2024-09-12T00:28:20.048 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 20 MB 00:17 2024-09-12T00:28:20.119 INFO:teuthology.orchestra.run.smithi077.stdout:(12/285): libcephfs2-19.3.0-4753.gd011c522.el9. 9.8 MB/s | 755 kB 00:00 2024-09-12T00:28:20.178 INFO:teuthology.orchestra.run.smithi077.stdout:(13/285): libcephsqlite-19.3.0-4753.gd011c522.e 2.7 MB/s | 161 kB 00:00 2024-09-12T00:28:20.370 INFO:teuthology.orchestra.run.smithi077.stdout:(14/285): ceph-osd-19.3.0-4753.gd011c522.el9.x8 17 MB/s | 17 MB 00:01 2024-09-12T00:28:20.395 INFO:teuthology.orchestra.run.smithi077.stdout:(15/285): librados-devel-19.3.0-4753.gd011c522. 583 kB/s | 126 kB 00:00 2024-09-12T00:28:20.420 INFO:teuthology.orchestra.run.smithi077.stdout:(16/285): libradosstriper1-19.3.0-4753.gd011c52 10 MB/s | 508 kB 00:00 2024-09-12T00:28:20.479 INFO:teuthology.orchestra.run.smithi077.stdout:(17/285): python3-ceph-argparse-19.3.0-4753.gd0 772 kB/s | 45 kB 00:00 2024-09-12T00:28:20.596 INFO:teuthology.orchestra.run.smithi077.stdout:(18/285): librgw2-19.3.0-4753.gd011c522.el9.x86 28 MB/s | 5.5 MB 00:00 2024-09-12T00:28:20.621 INFO:teuthology.orchestra.run.smithi077.stdout:(19/285): python3-ceph-common-19.3.0-4753.gd011 1.0 MB/s | 143 kB 00:00 2024-09-12T00:28:20.646 INFO:teuthology.orchestra.run.smithi077.stdout:(20/285): python3-cephfs-19.3.0-4753.gd011c522. 3.1 MB/s | 161 kB 00:00 2024-09-12T00:28:20.672 INFO:teuthology.orchestra.run.smithi077.stdout:(21/285): python3-rados-19.3.0-4753.gd011c522.e 6.3 MB/s | 322 kB 00:00 2024-09-12T00:28:20.697 INFO:teuthology.orchestra.run.smithi077.stdout:(22/285): python3-rbd-19.3.0-4753.gd011c522.el9 5.9 MB/s | 306 kB 00:00 2024-09-12T00:28:20.722 INFO:teuthology.orchestra.run.smithi077.stdout:(23/285): python3-rgw-19.3.0-4753.gd011c522.el9 1.9 MB/s | 99 kB 00:00 2024-09-12T00:28:20.758 INFO:teuthology.orchestra.run.smithi077.stdout:(24/285): rbd-fuse-19.3.0-4753.gd011c522.el9.x8 1.4 MB/s | 85 kB 00:00 2024-09-12T00:28:20.817 INFO:teuthology.orchestra.run.smithi077.stdout:(25/285): rbd-nbd-19.3.0-4753.gd011c522.el9.x86 2.9 MB/s | 170 kB 00:00 2024-09-12T00:28:20.875 INFO:teuthology.orchestra.run.smithi077.stdout:(26/285): rbd-mirror-19.3.0-4753.gd011c522.el9. 21 MB/s | 3.2 MB 00:00 2024-09-12T00:28:20.900 INFO:teuthology.orchestra.run.smithi077.stdout:(27/285): ceph-grafana-dashboards-19.3.0-4753.g 410 kB/s | 34 kB 00:00 2024-09-12T00:28:20.926 INFO:teuthology.orchestra.run.smithi077.stdout:(28/285): ceph-mgr-cephadm-19.3.0-4753.gd011c52 3.0 MB/s | 154 kB 00:00 2024-09-12T00:28:21.459 INFO:teuthology.orchestra.run.smithi077.stdout:(29/285): ceph-mgr-dashboard-19.3.0-4753.gd011c 25 MB/s | 14 MB 00:00 2024-09-12T00:28:21.543 INFO:teuthology.orchestra.run.smithi077.stdout:(30/285): ceph-mgr-diskprediction-local-19.3.0- 12 MB/s | 7.4 MB 00:00 2024-09-12T00:28:21.568 INFO:teuthology.orchestra.run.smithi077.stdout:(31/285): ceph-mgr-modules-core-19.3.0-4753.gd0 2.6 MB/s | 291 kB 00:00 2024-09-12T00:28:21.585 INFO:teuthology.orchestra.run.smithi077.stdout:(32/285): ceph-mgr-rook-19.3.0-4753.gd011c522.e 1.2 MB/s | 49 kB 00:00 2024-09-12T00:28:21.602 INFO:teuthology.orchestra.run.smithi077.stdout:(33/285): ceph-prometheus-alerts-19.3.0-4753.gd 490 kB/s | 16 kB 00:00 2024-09-12T00:28:21.636 INFO:teuthology.orchestra.run.smithi077.stdout:(34/285): ceph-volume-19.3.0-4753.gd011c522.el9 5.5 MB/s | 285 kB 00:00 2024-09-12T00:28:21.669 INFO:teuthology.orchestra.run.smithi077.stdout:(35/285): cephadm-19.3.0-4753.gd011c522.el9.noa 11 MB/s | 782 kB 00:00 2024-09-12T00:28:21.803 INFO:teuthology.orchestra.run.smithi077.stdout:(36/285): bluez-libs-5.56-6.el9.x86_64.rpm 635 kB/s | 85 kB 00:00 2024-09-12T00:28:21.828 INFO:teuthology.orchestra.run.smithi077.stdout:(37/285): ModemManager-glib-1.20.2-1.el9.x86_64 1.7 MB/s | 335 kB 00:00 2024-09-12T00:28:21.887 INFO:teuthology.orchestra.run.smithi077.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 590 kB/s | 49 kB 00:00 2024-09-12T00:28:21.921 INFO:teuthology.orchestra.run.smithi077.stdout:(39/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.8 MB/s | 262 kB 00:00 2024-09-12T00:28:21.962 INFO:teuthology.orchestra.run.smithi077.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 1.0 MB/s | 80 kB 00:00 2024-09-12T00:28:22.046 INFO:teuthology.orchestra.run.smithi077.stdout:(41/285): libgfortran-11.5.0-2.el9.x86_64.rpm 6.3 MB/s | 801 kB 00:00 2024-09-12T00:28:22.071 INFO:teuthology.orchestra.run.smithi077.stdout:(42/285): libpciaccess-0.16-7.el9.x86_64.rpm 247 kB/s | 27 kB 00:00 2024-09-12T00:28:22.122 INFO:teuthology.orchestra.run.smithi077.stdout:(43/285): libquadmath-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 191 kB 00:00 2024-09-12T00:28:22.164 INFO:teuthology.orchestra.run.smithi077.stdout:(44/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.0 MB/s | 94 kB 00:00 2024-09-12T00:28:22.206 INFO:teuthology.orchestra.run.smithi077.stdout:(45/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-12T00:28:22.281 INFO:teuthology.orchestra.run.smithi077.stdout:(46/285): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-12T00:28:22.323 INFO:teuthology.orchestra.run.smithi077.stdout:(47/285): python3-cryptography-36.0.1-4.el9.x86 7.7 MB/s | 1.2 MB 00:00 2024-09-12T00:28:22.356 INFO:teuthology.orchestra.run.smithi077.stdout:(48/285): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-09-12T00:28:22.398 INFO:teuthology.orchestra.run.smithi077.stdout:(49/285): python3-requests-2.25.1-8.el9.noarch. 1.6 MB/s | 125 kB 00:00 2024-09-12T00:28:22.432 INFO:teuthology.orchestra.run.smithi077.stdout:(50/285): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-12T00:28:22.574 INFO:teuthology.orchestra.run.smithi077.stdout:(51/285): adwaita-cursor-theme-40.1.1-3.el9.noa 3.6 MB/s | 650 kB 00:00 2024-09-12T00:28:22.624 INFO:teuthology.orchestra.run.smithi077.stdout:(52/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 10 MB/s | 523 kB 00:00 2024-09-12T00:28:22.701 INFO:teuthology.orchestra.run.smithi077.stdout:(53/285): apache-commons-cli-1.4-17.el9.noarch. 924 kB/s | 71 kB 00:00 2024-09-12T00:28:22.742 INFO:teuthology.orchestra.run.smithi077.stdout:(54/285): apache-commons-codec-1.15-7.el9.noarc 7.4 MB/s | 302 kB 00:00 2024-09-12T00:28:22.884 INFO:teuthology.orchestra.run.smithi077.stdout:(55/285): adwaita-icon-theme-40.1.1-3.el9.noarc 26 MB/s | 12 MB 00:00 2024-09-12T00:28:22.909 INFO:teuthology.orchestra.run.smithi077.stdout:(56/285): apache-commons-io-2.8.0-8.el9.noarch. 1.7 MB/s | 283 kB 00:00 2024-09-12T00:28:22.959 INFO:teuthology.orchestra.run.smithi077.stdout:(57/285): apache-commons-lang3-3.12.0-6.el9.noa 7.3 MB/s | 559 kB 00:00 2024-09-12T00:28:22.976 INFO:teuthology.orchestra.run.smithi077.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2024-09-12T00:28:23.001 INFO:teuthology.orchestra.run.smithi077.stdout:(59/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 4.6 MB/s | 195 kB 00:00 2024-09-12T00:28:23.026 INFO:teuthology.orchestra.run.smithi077.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 464 kB/s | 23 kB 00:00 2024-09-12T00:28:23.052 INFO:teuthology.orchestra.run.smithi077.stdout:(61/285): atk-2.36.0-5.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T00:28:23.077 INFO:teuthology.orchestra.run.smithi077.stdout:(62/285): avahi-glib-0.8-21.el9.x86_64.rpm 296 kB/s | 15 kB 00:00 2024-09-12T00:28:23.102 INFO:teuthology.orchestra.run.smithi077.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-12T00:28:23.127 INFO:teuthology.orchestra.run.smithi077.stdout:(64/285): cdi-api-2.0.2-6.el9.noarch.rpm 1.0 MB/s | 53 kB 00:00 2024-09-12T00:28:23.153 INFO:teuthology.orchestra.run.smithi077.stdout:(65/285): colord-libs-1.4.5-4.el9.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2024-09-12T00:28:23.178 INFO:teuthology.orchestra.run.smithi077.stdout:(66/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-12T00:28:23.195 INFO:teuthology.orchestra.run.smithi077.stdout:(67/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 676 kB/s | 28 kB 00:00 2024-09-12T00:28:23.212 INFO:teuthology.orchestra.run.smithi077.stdout:(68/285): dconf-0.40.0-6.el9.x86_64.rpm 3.3 MB/s | 113 kB 00:00 2024-09-12T00:28:23.246 INFO:teuthology.orchestra.run.smithi077.stdout:(69/285): exempi-2.6.0-0.2.20211007gite23c213.e 10 MB/s | 525 kB 00:00 2024-09-12T00:28:23.279 INFO:teuthology.orchestra.run.smithi077.stdout:(70/285): exiv2-0.27.5-2.el9.x86_64.rpm 14 MB/s | 980 kB 00:00 2024-09-12T00:28:23.321 INFO:teuthology.orchestra.run.smithi077.stdout:(71/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 10 MB/s | 781 kB 00:00 2024-09-12T00:28:23.346 INFO:teuthology.orchestra.run.smithi077.stdout:(72/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 4.8 MB/s | 325 kB 00:00 2024-09-12T00:28:23.372 INFO:teuthology.orchestra.run.smithi077.stdout:(73/285): flac-libs-1.3.3-12.el9.x86_64.rpm 4.3 MB/s | 218 kB 00:00 2024-09-12T00:28:23.422 INFO:teuthology.orchestra.run.smithi077.stdout:(74/285): flatpak-1.12.9-1.el9.x86_64.rpm 23 MB/s | 1.7 MB 00:00 2024-09-12T00:28:23.447 INFO:teuthology.orchestra.run.smithi077.stdout:(75/285): flatpak-selinux-1.12.9-1.el9.noarch.r 287 kB/s | 22 kB 00:00 2024-09-12T00:28:23.472 INFO:teuthology.orchestra.run.smithi077.stdout:(76/285): flatpak-session-helper-1.12.9-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-09-12T00:28:23.498 INFO:teuthology.orchestra.run.smithi077.stdout:(77/285): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-12T00:28:23.565 INFO:teuthology.orchestra.run.smithi077.stdout:(78/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2024-09-12T00:28:23.590 INFO:teuthology.orchestra.run.smithi077.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-09-12T00:28:23.624 INFO:teuthology.orchestra.run.smithi077.stdout:(80/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.5 MB/s | 89 kB 00:00 2024-09-12T00:28:23.649 INFO:teuthology.orchestra.run.smithi077.stdout:(81/285): geoclue2-2.6.0-7.el9.x86_64.rpm 2.1 MB/s | 124 kB 00:00 2024-09-12T00:28:23.674 INFO:teuthology.orchestra.run.smithi077.stdout:(82/285): giflib-5.2.1-9.el9.x86_64.rpm 966 kB/s | 49 kB 00:00 2024-09-12T00:28:23.700 INFO:teuthology.orchestra.run.smithi077.stdout:(83/285): google-guice-4.2.3-9.el9.noarch.rpm 9.2 MB/s | 473 kB 00:00 2024-09-12T00:28:23.725 INFO:teuthology.orchestra.run.smithi077.stdout:(84/285): graphene-1.10.6-2.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-09-12T00:28:23.750 INFO:teuthology.orchestra.run.smithi077.stdout:(85/285): gsm-1.0.19-6.el9.x86_64.rpm 678 kB/s | 34 kB 00:00 2024-09-12T00:28:23.792 INFO:teuthology.orchestra.run.smithi077.stdout:(86/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 21 MB/s | 1.4 MB 00:00 2024-09-12T00:28:23.834 INFO:teuthology.orchestra.run.smithi077.stdout:(87/285): gtk-update-icon-cache-3.24.31-5.el9.x 800 kB/s | 33 kB 00:00 2024-09-12T00:28:23.885 INFO:teuthology.orchestra.run.smithi077.stdout:(88/285): gstreamer1-plugins-base-1.22.1-2.el9. 17 MB/s | 2.2 MB 00:00 2024-09-12T00:28:23.968 INFO:teuthology.orchestra.run.smithi077.stdout:(89/285): gtk3-3.24.31-5.el9.x86_64.rpm 37 MB/s | 4.9 MB 00:00 2024-09-12T00:28:24.019 INFO:teuthology.orchestra.run.smithi077.stdout:(90/285): guava-30.1-6.el9.noarch.rpm 17 MB/s | 2.3 MB 00:00 2024-09-12T00:28:24.043 INFO:teuthology.orchestra.run.smithi077.stdout:(91/285): hicolor-icon-theme-0.17-13.el9.noarch 2.9 MB/s | 219 kB 00:00 2024-09-12T00:28:24.077 INFO:teuthology.orchestra.run.smithi077.stdout:(92/285): httpcomponents-client-4.5.13-3.el9.no 11 MB/s | 657 kB 00:00 2024-09-12T00:28:24.128 INFO:teuthology.orchestra.run.smithi077.stdout:(93/285): httpcomponents-core-4.4.13-7.el9.noar 7.4 MB/s | 632 kB 00:00 2024-09-12T00:28:24.194 INFO:teuthology.orchestra.run.smithi077.stdout:(94/285): iso-codes-4.6.0-3.el9.noarch.rpm 30 MB/s | 3.5 MB 00:00 2024-09-12T00:28:24.220 INFO:teuthology.orchestra.run.smithi077.stdout:(95/285): jakarta-annotations-1.3.5-13.el9.noar 491 kB/s | 45 kB 00:00 2024-09-12T00:28:24.245 INFO:teuthology.orchestra.run.smithi077.stdout:(96/285): jansi-2.3.3-6.el9.x86_64.rpm 2.1 MB/s | 110 kB 00:00 2024-09-12T00:28:24.270 INFO:teuthology.orchestra.run.smithi077.stdout:(97/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 8.1 MB/s | 413 kB 00:00 2024-09-12T00:28:24.337 INFO:teuthology.orchestra.run.smithi077.stdout:(98/285): java-11-openjdk-devel-11.0.20.1.1-2.e 36 MB/s | 3.3 MB 00:00 2024-09-12T00:28:24.379 INFO:teuthology.orchestra.run.smithi077.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 315 kB/s | 13 kB 00:00 2024-09-12T00:28:24.421 INFO:teuthology.orchestra.run.smithi077.stdout:(100/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.3 MB/s | 53 kB 00:00 2024-09-12T00:28:24.463 INFO:teuthology.orchestra.run.smithi077.stdout:(101/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 579 kB/s | 24 kB 00:00 2024-09-12T00:28:24.505 INFO:teuthology.orchestra.run.smithi077.stdout:(102/285): jsoup-1.13.1-10.el9.noarch.rpm 8.9 MB/s | 377 kB 00:00 2024-09-12T00:28:24.539 INFO:teuthology.orchestra.run.smithi077.stdout:(103/285): jsr-305-3.0.2-6.el9.noarch.rpm 1.0 MB/s | 35 kB 00:00 2024-09-12T00:28:24.580 INFO:teuthology.orchestra.run.smithi077.stdout:(104/285): lcms2-2.12-3.el9.x86_64.rpm 3.9 MB/s | 168 kB 00:00 2024-09-12T00:28:24.614 INFO:teuthology.orchestra.run.smithi077.stdout:(105/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 335 kB/s | 11 kB 00:00 2024-09-12T00:28:24.648 INFO:teuthology.orchestra.run.smithi077.stdout:(106/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 726 kB/s | 24 kB 00:00 2024-09-12T00:28:24.682 INFO:teuthology.orchestra.run.smithi077.stdout:(107/285): libXcursor-1.2.0-7.el9.x86_64.rpm 925 kB/s | 31 kB 00:00 2024-09-12T00:28:24.715 INFO:teuthology.orchestra.run.smithi077.stdout:(108/285): libXdamage-1.1.5-7.el9.x86_64.rpm 692 kB/s | 23 kB 00:00 2024-09-12T00:28:25.074 INFO:teuthology.orchestra.run.smithi077.stdout:(109/285): java-11-openjdk-headless-11.0.20.1.1 49 MB/s | 39 MB 00:00 2024-09-12T00:28:25.099 INFO:teuthology.orchestra.run.smithi077.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 52 kB/s | 20 kB 00:00 2024-09-12T00:28:25.124 INFO:teuthology.orchestra.run.smithi077.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 794 kB/s | 40 kB 00:00 2024-09-12T00:28:25.149 INFO:teuthology.orchestra.run.smithi077.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 300 kB/s | 15 kB 00:00 2024-09-12T00:28:25.175 INFO:teuthology.orchestra.run.smithi077.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 565 kB/s | 28 kB 00:00 2024-09-12T00:28:25.200 INFO:teuthology.orchestra.run.smithi077.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 426 kB/s | 21 kB 00:00 2024-09-12T00:28:25.250 INFO:teuthology.orchestra.run.smithi077.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 254 kB/s | 19 kB 00:00 2024-09-12T00:28:25.276 INFO:teuthology.orchestra.run.smithi077.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 250 kB/s | 19 kB 00:00 2024-09-12T00:28:25.301 INFO:teuthology.orchestra.run.smithi077.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 606 kB/s | 30 kB 00:00 2024-09-12T00:28:25.326 INFO:teuthology.orchestra.run.smithi077.stdout:(118/285): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-09-12T00:28:25.352 INFO:teuthology.orchestra.run.smithi077.stdout:(119/285): libcanberra-gtk3-0.30-27.el9.x86_64. 635 kB/s | 32 kB 00:00 2024-09-12T00:28:25.377 INFO:teuthology.orchestra.run.smithi077.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 3.1 MB/s | 161 kB 00:00 2024-09-12T00:28:25.402 INFO:teuthology.orchestra.run.smithi077.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-09-12T00:28:25.428 INFO:teuthology.orchestra.run.smithi077.stdout:(122/285): libexif-0.6.22-6.el9.x86_64.rpm 8.5 MB/s | 435 kB 00:00 2024-09-12T00:28:25.453 INFO:teuthology.orchestra.run.smithi077.stdout:(123/285): libfontenc-1.1.3-17.el9.x86_64.rpm 619 kB/s | 31 kB 00:00 2024-09-12T00:28:25.478 INFO:teuthology.orchestra.run.smithi077.stdout:(124/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-09-12T00:28:25.503 INFO:teuthology.orchestra.run.smithi077.stdout:(125/285): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-09-12T00:28:25.529 INFO:teuthology.orchestra.run.smithi077.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 732 kB/s | 37 kB 00:00 2024-09-12T00:28:25.554 INFO:teuthology.orchestra.run.smithi077.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.8 MB/s | 142 kB 00:00 2024-09-12T00:28:25.579 INFO:teuthology.orchestra.run.smithi077.stdout:(128/285): libgsf-1.14.47-5.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-09-12T00:28:25.604 INFO:teuthology.orchestra.run.smithi077.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-09-12T00:28:25.629 INFO:teuthology.orchestra.run.smithi077.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-12T00:28:25.654 INFO:teuthology.orchestra.run.smithi077.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 825 kB/s | 41 kB 00:00 2024-09-12T00:28:25.680 INFO:teuthology.orchestra.run.smithi077.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 871 kB/s | 44 kB 00:00 2024-09-12T00:28:25.705 INFO:teuthology.orchestra.run.smithi077.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 667 kB/s | 34 kB 00:00 2024-09-12T00:28:25.765 INFO:teuthology.orchestra.run.smithi077.stdout:(134/285): libosinfo-1.10.0-1.el9.x86_64.rpm 3.7 MB/s | 319 kB 00:00 2024-09-12T00:28:25.903 INFO:teuthology.orchestra.run.smithi077.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 813 kB/s | 160 kB 00:00 2024-09-12T00:28:25.923 INFO:teuthology.orchestra.run.smithi077.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 287 kB/s | 45 kB 00:00 2024-09-12T00:28:25.956 INFO:teuthology.orchestra.run.smithi077.stdout:(137/285): librdkafka-1.6.1-102.el9.x86_64.rpm 12 MB/s | 662 kB 00:00 2024-09-12T00:28:25.982 INFO:teuthology.orchestra.run.smithi077.stdout:(138/285): libsbc-1.4-9.el9.x86_64.rpm 767 kB/s | 45 kB 00:00 2024-09-12T00:28:26.007 INFO:teuthology.orchestra.run.smithi077.stdout:(139/285): libsndfile-1.0.31-8.el9.x86_64.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T00:28:26.032 INFO:teuthology.orchestra.run.smithi077.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 3.2 MB/s | 164 kB 00:00 2024-09-12T00:28:26.058 INFO:teuthology.orchestra.run.smithi077.stdout:(141/285): libtiff-4.4.0-13.el9.x86_64.rpm 3.8 MB/s | 198 kB 00:00 2024-09-12T00:28:26.065 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-12T00:28:26.083 INFO:teuthology.orchestra.run.smithi077.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 710 kB/s | 36 kB 00:00 2024-09-12T00:28:26.117 INFO:teuthology.orchestra.run.smithi077.stdout:(143/285): libtracker-sparql-3.1.2-3.el9.x86_64 5.4 MB/s | 324 kB 00:00 2024-09-12T00:28:26.142 INFO:teuthology.orchestra.run.smithi077.stdout:(144/285): libvisual-0.4.0-34.el9.x86_64.rpm 2.4 MB/s | 144 kB 00:00 2024-09-12T00:28:26.167 INFO:teuthology.orchestra.run.smithi077.stdout:(145/285): libvorbis-1.3.7-5.el9.x86_64.rpm 3.8 MB/s | 193 kB 00:00 2024-09-12T00:28:26.193 INFO:teuthology.orchestra.run.smithi077.stdout:(146/285): libwayland-client-1.21.0-1.el9.x86_6 662 kB/s | 33 kB 00:00 2024-09-12T00:28:26.218 INFO:teuthology.orchestra.run.smithi077.stdout:(147/285): libwayland-cursor-1.21.0-1.el9.x86_6 388 kB/s | 19 kB 00:00 2024-09-12T00:28:26.243 INFO:teuthology.orchestra.run.smithi077.stdout:(148/285): libwayland-egl-1.21.0-1.el9.x86_64.r 257 kB/s | 13 kB 00:00 2024-09-12T00:28:26.268 INFO:teuthology.orchestra.run.smithi077.stdout:(149/285): libwayland-server-1.21.0-1.el9.x86_6 833 kB/s | 42 kB 00:00 2024-09-12T00:28:26.294 INFO:teuthology.orchestra.run.smithi077.stdout:(150/285): libwebp-1.2.0-8.el9.x86_64.rpm 5.4 MB/s | 277 kB 00:00 2024-09-12T00:28:26.319 INFO:teuthology.orchestra.run.smithi077.stdout:(151/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.6 MB/s | 133 kB 00:00 2024-09-12T00:28:26.344 INFO:teuthology.orchestra.run.smithi077.stdout:(152/285): libxshmfence-1.3-10.el9.x86_64.rpm 251 kB/s | 13 kB 00:00 2024-09-12T00:28:26.369 INFO:teuthology.orchestra.run.smithi077.stdout:(153/285): low-memory-monitor-2.1-4.el9.x86_64. 716 kB/s | 36 kB 00:00 2024-09-12T00:28:26.395 INFO:teuthology.orchestra.run.smithi077.stdout:(154/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-12T00:28:26.420 INFO:teuthology.orchestra.run.smithi077.stdout:(155/285): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-12T00:28:26.445 INFO:teuthology.orchestra.run.smithi077.stdout:(156/285): lua-posix-35.0-8.el9.x86_64.rpm 3.0 MB/s | 151 kB 00:00 2024-09-12T00:28:26.470 INFO:teuthology.orchestra.run.smithi077.stdout:(157/285): maven-3.6.3-15.el9.noarch.rpm 354 kB/s | 18 kB 00:00 2024-09-12T00:28:26.512 INFO:teuthology.orchestra.run.smithi077.stdout:(158/285): maven-lib-3.6.3-15.el9.noarch.rpm 22 MB/s | 1.5 MB 00:00 2024-09-12T00:28:26.538 INFO:teuthology.orchestra.run.smithi077.stdout:(159/285): maven-openjdk11-3.6.3-15.el9.noarch. 135 kB/s | 9.0 kB 00:00 2024-09-12T00:28:26.579 INFO:teuthology.orchestra.run.smithi077.stdout:(160/285): maven-resolver-1.6.1-10.el9.noarch.r 7.6 MB/s | 517 kB 00:00 2024-09-12T00:28:26.605 INFO:teuthology.orchestra.run.smithi077.stdout:(161/285): maven-shared-utils-3.3.4-3.el9.noarc 2.2 MB/s | 151 kB 00:00 2024-09-12T00:28:26.630 INFO:teuthology.orchestra.run.smithi077.stdout:(162/285): maven-wagon-3.4.2-7.el9.noarch.rpm 2.2 MB/s | 112 kB 00:00 2024-09-12T00:28:26.672 INFO:teuthology.orchestra.run.smithi077.stdout:(163/285): mesa-filesystem-24.1.2-3.el9.x86_64. 270 kB/s | 11 kB 00:00 2024-09-12T00:28:26.706 INFO:teuthology.orchestra.run.smithi077.stdout:(164/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 4.1 MB/s | 139 kB 00:00 2024-09-12T00:28:27.139 INFO:teuthology.orchestra.run.smithi077.stdout:(165/285): ceph-test-19.3.0-4753.gd011c522.el9. 6.8 MB/s | 50 MB 00:07 2024-09-12T00:28:27.165 INFO:teuthology.orchestra.run.smithi077.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 372 kB/s | 171 kB 00:00 2024-09-12T00:28:27.265 INFO:teuthology.orchestra.run.smithi077.stdout:(167/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 13 MB/s | 8.8 MB 00:00 2024-09-12T00:28:27.290 INFO:teuthology.orchestra.run.smithi077.stdout:(168/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 241 kB/s | 36 kB 00:00 2024-09-12T00:28:27.315 INFO:teuthology.orchestra.run.smithi077.stdout:(169/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 305 kB/s | 46 kB 00:00 2024-09-12T00:28:27.340 INFO:teuthology.orchestra.run.smithi077.stdout:(170/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 430 kB/s | 32 kB 00:00 2024-09-12T00:28:27.366 INFO:teuthology.orchestra.run.smithi077.stdout:(171/285): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-12T00:28:27.391 INFO:teuthology.orchestra.run.smithi077.stdout:(172/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 3.2 MB/s | 163 kB 00:00 2024-09-12T00:28:27.417 INFO:teuthology.orchestra.run.smithi077.stdout:(173/285): opus-1.3.1-10.el9.x86_64.rpm 3.9 MB/s | 200 kB 00:00 2024-09-12T00:28:27.450 INFO:teuthology.orchestra.run.smithi077.stdout:(174/285): orc-0.4.31-8.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-12T00:28:27.484 INFO:teuthology.orchestra.run.smithi077.stdout:(175/285): osinfo-db-20240701-2.el9.noarch.rpm 7.7 MB/s | 531 kB 00:00 2024-09-12T00:28:27.517 INFO:teuthology.orchestra.run.smithi077.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.1 MB/s | 74 kB 00:00 2024-09-12T00:28:27.551 INFO:teuthology.orchestra.run.smithi077.stdout:(177/285): ostree-libs-2024.7-2.el9.x86_64.rpm 6.9 MB/s | 468 kB 00:00 2024-09-12T00:28:27.576 INFO:teuthology.orchestra.run.smithi077.stdout:(178/285): p11-kit-server-0.25.3-2.el9.x86_64.r 4.1 MB/s | 246 kB 00:00 2024-09-12T00:28:27.593 INFO:teuthology.orchestra.run.smithi077.stdout:(179/285): pipewire-1.0.1-1.el9.x86_64.rpm 2.5 MB/s | 107 kB 00:00 2024-09-12T00:28:27.646 INFO:teuthology.orchestra.run.smithi077.stdout:(180/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.7 MB/s | 57 kB 00:00 2024-09-12T00:28:27.646 INFO:teuthology.orchestra.run.smithi077.stdout:(181/285): pipewire-jack-audio-connection-kit-1 272 kB/s | 9.1 kB 00:00 2024-09-12T00:28:27.652 INFO:teuthology.orchestra.run.smithi077.stdout:(182/285): pipewire-jack-audio-connection-kit-l 3.2 MB/s | 135 kB 00:00 2024-09-12T00:28:27.658 INFO:teuthology.orchestra.run.smithi062.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 19 kB 00:00 2024-09-12T00:28:27.728 INFO:teuthology.orchestra.run.smithi077.stdout:(183/285): openblas-openmp-0.3.26-2.el9.x86_64. 12 MB/s | 4.9 MB 00:00 2024-09-12T00:28:27.769 INFO:teuthology.orchestra.run.smithi077.stdout:(184/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 14 MB/s | 1.9 MB 00:00 2024-09-12T00:28:27.795 INFO:teuthology.orchestra.run.smithi077.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 387 kB/s | 26 kB 00:00 2024-09-12T00:28:27.820 INFO:teuthology.orchestra.run.smithi077.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-12T00:28:27.845 INFO:teuthology.orchestra.run.smithi077.stdout:(187/285): plexus-containers-component-annotati 366 kB/s | 18 kB 00:00 2024-09-12T00:28:27.870 INFO:teuthology.orchestra.run.smithi077.stdout:(188/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 881 kB/s | 192 kB 00:00 2024-09-12T00:28:27.887 INFO:teuthology.orchestra.run.smithi077.stdout:(189/285): plexus-interpolation-1.26-11.el9.noa 1.2 MB/s | 80 kB 00:00 2024-09-12T00:28:27.913 INFO:teuthology.orchestra.run.smithi077.stdout:(190/285): plexus-sec-dispatcher-1.4-37.el9.noa 501 kB/s | 34 kB 00:00 2024-09-12T00:28:27.938 INFO:teuthology.orchestra.run.smithi077.stdout:(191/285): plexus-utils-3.3.0-10.el9.noarch.rpm 3.7 MB/s | 254 kB 00:00 2024-09-12T00:28:27.971 INFO:teuthology.orchestra.run.smithi077.stdout:(192/285): poppler-21.01.0-21.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-09-12T00:28:27.997 INFO:teuthology.orchestra.run.smithi077.stdout:(193/285): poppler-glib-21.01.0-21.el9.x86_64.r 2.5 MB/s | 152 kB 00:00 2024-09-12T00:28:28.039 INFO:teuthology.orchestra.run.smithi077.stdout:(194/285): poppler-data-0.4.9-9.el9.noarch.rpm 15 MB/s | 1.9 MB 00:00 2024-09-12T00:28:28.064 INFO:teuthology.orchestra.run.smithi077.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 1.2 MB/s | 83 kB 00:00 2024-09-12T00:28:28.097 INFO:teuthology.orchestra.run.smithi077.stdout:(196/285): protobuf-3.14.0-13.el9.x86_64.rpm 8.0 MB/s | 1.0 MB 00:00 2024-09-12T00:28:28.131 INFO:teuthology.orchestra.run.smithi077.stdout:(197/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 7.2 MB/s | 679 kB 00:00 2024-09-12T00:28:28.156 INFO:teuthology.orchestra.run.smithi077.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-12T00:28:28.182 INFO:teuthology.orchestra.run.smithi077.stdout:(199/285): python3-jinja2-2.11.3-6.el9.noarch.r 4.8 MB/s | 248 kB 00:00 2024-09-12T00:28:28.207 INFO:teuthology.orchestra.run.smithi077.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 510 kB/s | 26 kB 00:00 2024-09-12T00:28:28.232 INFO:teuthology.orchestra.run.smithi077.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 381 kB/s | 19 kB 00:00 2024-09-12T00:28:28.257 INFO:teuthology.orchestra.run.smithi077.stdout:(202/285): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-12T00:28:28.282 INFO:teuthology.orchestra.run.smithi077.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 696 kB/s | 35 kB 00:00 2024-09-12T00:28:28.324 INFO:teuthology.orchestra.run.smithi077.stdout:(204/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 5.9 MB/s | 250 kB 00:00 2024-09-12T00:28:28.391 INFO:teuthology.orchestra.run.smithi077.stdout:(205/285): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-12T00:28:28.417 INFO:teuthology.orchestra.run.smithi077.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 2.4 MB/s | 222 kB 00:00 2024-09-12T00:28:28.442 INFO:teuthology.orchestra.run.smithi077.stdout:(207/285): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-09-12T00:28:28.454 INFO:teuthology.orchestra.run.smithi062.stdout:Extra Packages for Enterprise Linux 34 MB/s | 23 MB 00:00 2024-09-12T00:28:28.467 INFO:teuthology.orchestra.run.smithi077.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 842 kB/s | 42 kB 00:00 2024-09-12T00:28:28.493 INFO:teuthology.orchestra.run.smithi077.stdout:(209/285): python3-protobuf-3.14.0-13.el9.noarc 5.2 MB/s | 269 kB 00:00 2024-09-12T00:28:28.518 INFO:teuthology.orchestra.run.smithi077.stdout:(210/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 3.1 MB/s | 159 kB 00:00 2024-09-12T00:28:28.543 INFO:teuthology.orchestra.run.smithi077.stdout:(211/285): python3-pyasn1-modules-0.4.8-6.el9.n 5.4 MB/s | 279 kB 00:00 2024-09-12T00:28:28.569 INFO:teuthology.orchestra.run.smithi077.stdout:(212/285): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-12T00:28:28.594 INFO:teuthology.orchestra.run.smithi077.stdout:(213/285): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-09-12T00:28:28.661 INFO:teuthology.orchestra.run.smithi077.stdout:(214/285): python3-numpy-1.20.1-5.el9.x86_64.rp 13 MB/s | 5.1 MB 00:00 2024-09-12T00:28:28.705 INFO:teuthology.orchestra.run.smithi077.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 383 kB/s | 42 kB 00:00 2024-09-12T00:28:28.728 INFO:teuthology.orchestra.run.smithi077.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-12T00:28:28.745 INFO:teuthology.orchestra.run.smithi077.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 860 kB/s | 36 kB 00:00 2024-09-12T00:28:28.762 INFO:teuthology.orchestra.run.smithi077.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-09-12T00:28:28.779 INFO:teuthology.orchestra.run.smithi077.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 1.6 MB/s | 56 kB 00:00 2024-09-12T00:28:28.804 INFO:teuthology.orchestra.run.smithi077.stdout:(220/285): sisu-0.3.4-10.el9.noarch.rpm 12 MB/s | 510 kB 00:00 2024-09-12T00:28:28.829 INFO:teuthology.orchestra.run.smithi077.stdout:(221/285): slf4j-1.7.30-13.el9.noarch.rpm 1.3 MB/s | 69 kB 00:00 2024-09-12T00:28:28.854 INFO:teuthology.orchestra.run.smithi077.stdout:(222/285): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-12T00:28:28.880 INFO:teuthology.orchestra.run.smithi077.stdout:(223/285): sound-theme-freedesktop-0.8-17.el9.n 7.4 MB/s | 383 kB 00:00 2024-09-12T00:28:28.906 INFO:teuthology.orchestra.run.smithi077.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 3.0 MB/s | 152 kB 00:00 2024-09-12T00:28:28.930 INFO:teuthology.orchestra.run.smithi077.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 11 MB/s | 555 kB 00:00 2024-09-12T00:28:28.964 INFO:teuthology.orchestra.run.smithi077.stdout:(226/285): tracker-miners-3.1.2-4.el9.x86_64.rp 16 MB/s | 944 kB 00:00 2024-09-12T00:28:28.989 INFO:teuthology.orchestra.run.smithi077.stdout:(227/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 907 kB/s | 53 kB 00:00 2024-09-12T00:28:29.015 INFO:teuthology.orchestra.run.smithi077.stdout:(228/285): tzdata-java-2024a-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-12T00:28:29.040 INFO:teuthology.orchestra.run.smithi077.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 3.4 MB/s | 173 kB 00:00 2024-09-12T00:28:29.073 INFO:teuthology.orchestra.run.smithi077.stdout:(230/285): webrtc-audio-processing-0.3.1-8.el9. 5.1 MB/s | 306 kB 00:00 2024-09-12T00:28:29.099 INFO:teuthology.orchestra.run.smithi077.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-12T00:28:29.124 INFO:teuthology.orchestra.run.smithi077.stdout:(232/285): wireplumber-libs-0.4.14-1.el9.x86_64 7.0 MB/s | 358 kB 00:00 2024-09-12T00:28:29.149 INFO:teuthology.orchestra.run.smithi077.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 847 kB/s | 42 kB 00:00 2024-09-12T00:28:29.174 INFO:teuthology.orchestra.run.smithi077.stdout:(234/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 7.5 MB/s | 385 kB 00:00 2024-09-12T00:28:29.200 INFO:teuthology.orchestra.run.smithi077.stdout:(235/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.6 MB/s | 134 kB 00:00 2024-09-12T00:28:29.242 INFO:teuthology.orchestra.run.smithi077.stdout:(236/285): xkeyboard-config-2.33-2.el9.noarch.r 13 MB/s | 859 kB 00:00 2024-09-12T00:28:29.267 INFO:teuthology.orchestra.run.smithi077.stdout:(237/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 950 kB/s | 64 kB 00:00 2024-09-12T00:28:29.292 INFO:teuthology.orchestra.run.smithi077.stdout:(238/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 9.8 MB/s | 505 kB 00:00 2024-09-12T00:28:29.485 INFO:teuthology.orchestra.run.smithi077.stdout:(239/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-12T00:28:29.510 INFO:teuthology.orchestra.run.smithi077.stdout:(240/285): lua-devel-5.4.4-4.el9.x86_64.rpm 92 kB/s | 22 kB 00:00 2024-09-12T00:28:29.568 INFO:teuthology.orchestra.run.smithi077.stdout:(241/285): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-12T00:28:29.594 INFO:teuthology.orchestra.run.smithi077.stdout:(242/285): grpc-data-1.46.7-10.el9.noarch.rpm 785 kB/s | 19 kB 00:00 2024-09-12T00:28:29.619 INFO:teuthology.orchestra.run.smithi077.stdout:(243/285): gperftools-libs-2.9.1-2.el9.x86_64.r 2.8 MB/s | 309 kB 00:00 2024-09-12T00:28:29.644 INFO:teuthology.orchestra.run.smithi077.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T00:28:29.669 INFO:teuthology.orchestra.run.smithi077.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T00:28:29.695 INFO:teuthology.orchestra.run.smithi077.stdout:(246/285): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T00:28:29.720 INFO:teuthology.orchestra.run.smithi077.stdout:(247/285): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T00:28:29.762 INFO:teuthology.orchestra.run.smithi077.stdout:(248/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-12T00:28:29.796 INFO:teuthology.orchestra.run.smithi077.stdout:(249/285): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-12T00:28:29.821 INFO:teuthology.orchestra.run.smithi077.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T00:28:29.846 INFO:teuthology.orchestra.run.smithi077.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T00:28:29.879 INFO:teuthology.orchestra.run.smithi077.stdout:(252/285): protobuf-compiler-3.14.0-13.el9.x86_ 1.4 MB/s | 863 kB 00:00 2024-09-12T00:28:29.905 INFO:teuthology.orchestra.run.smithi077.stdout:(253/285): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-09-12T00:28:29.947 INFO:teuthology.orchestra.run.smithi077.stdout:(254/285): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-12T00:28:30.014 INFO:teuthology.orchestra.run.smithi077.stdout:(255/285): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-12T00:28:30.039 INFO:teuthology.orchestra.run.smithi077.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 2.4 MB/s | 220 kB 00:00 2024-09-12T00:28:30.064 INFO:teuthology.orchestra.run.smithi077.stdout:(257/285): python3-cheroot-8.6.0-4.el9.noarch.r 932 kB/s | 172 kB 00:00 2024-09-12T00:28:30.081 INFO:teuthology.orchestra.run.smithi077.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 651 kB/s | 11 kB 00:00 2024-09-12T00:28:30.106 INFO:teuthology.orchestra.run.smithi077.stdout:(259/285): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-09-12T00:28:30.123 INFO:teuthology.orchestra.run.smithi077.stdout:(260/285): python3-jaraco-classes-3.2.1-5.el9.n 422 kB/s | 18 kB 00:00 2024-09-12T00:28:30.149 INFO:teuthology.orchestra.run.smithi077.stdout:(261/285): python3-jaraco-collections-3.0.0-8.e 553 kB/s | 23 kB 00:00 2024-09-12T00:28:30.174 INFO:teuthology.orchestra.run.smithi077.stdout:(262/285): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-12T00:28:30.199 INFO:teuthology.orchestra.run.smithi077.stdout:(263/285): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-12T00:28:30.224 INFO:teuthology.orchestra.run.smithi077.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T00:28:30.241 INFO:teuthology.orchestra.run.smithi077.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 4.7 MB/s | 79 kB 00:00 2024-09-12T00:28:30.267 INFO:teuthology.orchestra.run.smithi077.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T00:28:30.300 INFO:teuthology.orchestra.run.smithi077.stdout:(267/285): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T00:28:30.325 INFO:teuthology.orchestra.run.smithi077.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-12T00:28:30.351 INFO:teuthology.orchestra.run.smithi077.stdout:(269/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-12T00:28:30.376 INFO:teuthology.orchestra.run.smithi077.stdout:(270/285): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-12T00:28:30.410 INFO:teuthology.orchestra.run.smithi077.stdout:(271/285): python3-kubernetes-26.1.0-2.el9.noar 4.3 MB/s | 1.0 MB 00:00 2024-09-12T00:28:30.436 INFO:teuthology.orchestra.run.smithi077.stdout:(272/285): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T00:28:30.460 INFO:teuthology.orchestra.run.smithi077.stdout:(273/285): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2024-09-12T00:28:30.486 INFO:teuthology.orchestra.run.smithi077.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-12T00:28:30.511 INFO:teuthology.orchestra.run.smithi077.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T00:28:30.536 INFO:teuthology.orchestra.run.smithi077.stdout:(276/285): python3-webob-1.8.8-2.el9.noarch.rpm 4.5 MB/s | 230 kB 00:00 2024-09-12T00:28:30.561 INFO:teuthology.orchestra.run.smithi077.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-12T00:28:30.604 INFO:teuthology.orchestra.run.smithi077.stdout:(278/285): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-12T00:28:30.629 INFO:teuthology.orchestra.run.smithi077.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 298 kB/s | 20 kB 00:00 2024-09-12T00:28:30.654 INFO:teuthology.orchestra.run.smithi077.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T00:28:30.680 INFO:teuthology.orchestra.run.smithi077.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T00:28:30.713 INFO:teuthology.orchestra.run.smithi077.stdout:(282/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2024-09-12T00:28:30.763 INFO:teuthology.orchestra.run.smithi077.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T00:28:30.972 INFO:teuthology.orchestra.run.smithi077.stdout:(284/285): librbd1-19.3.0-4753.gd011c522.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-12T00:28:31.105 INFO:teuthology.orchestra.run.smithi077.stdout:(285/285): librados2-19.3.0-4753.gd011c522.el9. 8.1 MB/s | 3.5 MB 00:00 2024-09-12T00:28:31.111 INFO:teuthology.orchestra.run.smithi077.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:28:31.111 INFO:teuthology.orchestra.run.smithi077.stdout:Total 25 MB/s | 327 MB 00:12 2024-09-12T00:28:34.052 INFO:teuthology.orchestra.run.smithi062.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-12T00:28:34.153 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction check 2024-09-12T00:28:34.339 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction check succeeded. 2024-09-12T00:28:34.340 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction test 2024-09-12T00:28:36.473 INFO:teuthology.orchestra.run.smithi062.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:28:36.474 INFO:teuthology.orchestra.run.smithi062.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:28:36.570 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-09-12T00:28:36.598 INFO:teuthology.orchestra.run.smithi062.stdout:====================================================================================================== 2024-09-12T00:28:36.598 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-09-12T00:28:36.598 INFO:teuthology.orchestra.run.smithi062.stdout:====================================================================================================== 2024-09-12T00:28:36.598 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-09-12T00:28:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: ceph x86_64 2:19.3.0-4753.gd011c522.el9 ceph 6.6 k 2024-09-12T00:28:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:28:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 899 k 2024-09-12T00:28:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4753.gd011c522.el9 ceph 145 k 2024-09-12T00:28:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr x86_64 2:19.3.0-4753.gd011c522.el9 ceph 1.5 M 2024-09-12T00:28:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 154 k 2024-09-12T00:28:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 14 M 2024-09-12T00:28:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 7.4 M 2024-09-12T00:28:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 49 k 2024-09-12T00:28:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 11 M 2024-09-12T00:28:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test x86_64 2:19.3.0-4753.gd011c522.el9 ceph 50 M 2024-09-12T00:28:36.599 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 285 k 2024-09-12T00:28:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 782 k 2024-09-12T00:28:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 32 k 2024-09-12T00:28:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 755 k 2024-09-12T00:28:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 126 k 2024-09-12T00:28:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T00:28:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:28:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados x86_64 2:19.3.0-4753.gd011c522.el9 ceph 322 k 2024-09-12T00:28:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 306 k 2024-09-12T00:28:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 99 k 2024-09-12T00:28:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 85 k 2024-09-12T00:28:36.600 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:28:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 170 k 2024-09-12T00:28:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T00:28:36.601 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrading: 2024-09-12T00:28:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: librados2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.5 M 2024-09-12T00:28:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:28:36.601 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-09-12T00:28:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T00:28:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T00:28:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T00:28:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T00:28:36.601 INFO:teuthology.orchestra.run.smithi062.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T00:28:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T00:28:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T00:28:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T00:28:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T00:28:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T00:28:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T00:28:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T00:28:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T00:28:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T00:28:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T00:28:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T00:28:36.602 INFO:teuthology.orchestra.run.smithi062.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T00:28:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T00:28:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 22 M 2024-09-12T00:28:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 34 k 2024-09-12T00:28:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds x86_64 2:19.3.0-4753.gd011c522.el9 ceph 2.4 M 2024-09-12T00:28:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 291 k 2024-09-12T00:28:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon x86_64 2:19.3.0-4753.gd011c522.el9 ceph 4.8 M 2024-09-12T00:28:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 17 M 2024-09-12T00:28:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 16 k 2024-09-12T00:28:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux x86_64 2:19.3.0-4753.gd011c522.el9 ceph 25 k 2024-09-12T00:28:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T00:28:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T00:28:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T00:28:36.603 INFO:teuthology.orchestra.run.smithi062.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T00:28:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T00:28:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T00:28:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T00:28:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T00:28:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T00:28:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T00:28:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T00:28:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T00:28:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T00:28:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T00:28:36.604 INFO:teuthology.orchestra.run.smithi062.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T00:28:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T00:28:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T00:28:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T00:28:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T00:28:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T00:28:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T00:28:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T00:28:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T00:28:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T00:28:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T00:28:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T00:28:36.605 INFO:teuthology.orchestra.run.smithi062.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T00:28:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T00:28:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T00:28:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T00:28:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T00:28:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T00:28:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T00:28:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T00:28:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T00:28:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T00:28:36.606 INFO:teuthology.orchestra.run.smithi062.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T00:28:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T00:28:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T00:28:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T00:28:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T00:28:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T00:28:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T00:28:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T00:28:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T00:28:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T00:28:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T00:28:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T00:28:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T00:28:36.607 INFO:teuthology.orchestra.run.smithi062.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T00:28:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T00:28:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T00:28:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T00:28:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T00:28:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T00:28:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:28:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T00:28:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T00:28:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T00:28:36.608 INFO:teuthology.orchestra.run.smithi062.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T00:28:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T00:28:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T00:28:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T00:28:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T00:28:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T00:28:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T00:28:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T00:28:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T00:28:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T00:28:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T00:28:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T00:28:36.609 INFO:teuthology.orchestra.run.smithi062.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T00:28:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T00:28:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T00:28:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T00:28:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T00:28:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T00:28:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 508 k 2024-09-12T00:28:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T00:28:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:28:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T00:28:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T00:28:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T00:28:36.610 INFO:teuthology.orchestra.run.smithi062.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T00:28:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T00:28:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T00:28:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T00:28:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T00:28:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T00:28:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T00:28:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T00:28:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T00:28:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T00:28:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T00:28:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T00:28:36.611 INFO:teuthology.orchestra.run.smithi062.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T00:28:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T00:28:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T00:28:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T00:28:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T00:28:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T00:28:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T00:28:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T00:28:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T00:28:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T00:28:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T00:28:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T00:28:36.612 INFO:teuthology.orchestra.run.smithi062.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T00:28:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T00:28:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T00:28:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T00:28:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T00:28:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T00:28:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T00:28:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T00:28:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T00:28:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T00:28:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T00:28:36.613 INFO:teuthology.orchestra.run.smithi062.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T00:28:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T00:28:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T00:28:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T00:28:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T00:28:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T00:28:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T00:28:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T00:28:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T00:28:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T00:28:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T00:28:36.614 INFO:teuthology.orchestra.run.smithi062.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T00:28:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T00:28:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T00:28:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T00:28:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T00:28:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T00:28:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T00:28:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T00:28:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T00:28:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T00:28:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T00:28:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T00:28:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T00:28:36.615 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 45 k 2024-09-12T00:28:36.616 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 143 k 2024-09-12T00:28:36.616 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T00:28:36.616 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T00:28:36.616 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T00:28:36.616 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T00:28:36.616 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T00:28:36.616 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T00:28:36.616 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T00:28:36.616 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T00:28:36.616 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T00:28:36.617 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T00:28:36.617 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T00:28:36.617 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T00:28:36.617 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T00:28:36.617 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T00:28:36.617 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T00:28:36.617 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T00:28:36.617 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T00:28:36.617 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T00:28:36.617 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T00:28:36.617 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T00:28:36.617 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T00:28:36.618 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T00:28:36.618 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T00:28:36.618 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T00:28:36.618 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T00:28:36.618 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T00:28:36.618 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T00:28:36.618 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T00:28:36.618 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T00:28:36.618 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T00:28:36.618 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T00:28:36.618 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T00:28:36.618 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T00:28:36.618 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T00:28:36.618 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T00:28:36.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T00:28:36.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T00:28:36.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T00:28:36.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T00:28:36.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T00:28:36.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T00:28:36.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T00:28:36.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T00:28:36.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T00:28:36.619 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T00:28:36.620 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T00:28:36.620 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T00:28:36.620 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T00:28:36.620 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T00:28:36.620 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T00:28:36.620 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T00:28:36.620 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T00:28:36.620 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T00:28:36.620 INFO:teuthology.orchestra.run.smithi062.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T00:28:36.620 INFO:teuthology.orchestra.run.smithi062.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T00:28:36.620 INFO:teuthology.orchestra.run.smithi062.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T00:28:36.620 INFO:teuthology.orchestra.run.smithi062.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T00:28:36.621 INFO:teuthology.orchestra.run.smithi062.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T00:28:36.621 INFO:teuthology.orchestra.run.smithi062.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T00:28:36.621 INFO:teuthology.orchestra.run.smithi062.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T00:28:36.621 INFO:teuthology.orchestra.run.smithi062.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T00:28:36.621 INFO:teuthology.orchestra.run.smithi062.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T00:28:36.621 INFO:teuthology.orchestra.run.smithi062.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T00:28:36.621 INFO:teuthology.orchestra.run.smithi062.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T00:28:36.621 INFO:teuthology.orchestra.run.smithi062.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T00:28:36.621 INFO:teuthology.orchestra.run.smithi062.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T00:28:36.621 INFO:teuthology.orchestra.run.smithi062.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T00:28:36.622 INFO:teuthology.orchestra.run.smithi062.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T00:28:36.622 INFO:teuthology.orchestra.run.smithi062.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T00:28:36.622 INFO:teuthology.orchestra.run.smithi062.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T00:28:36.622 INFO:teuthology.orchestra.run.smithi062.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T00:28:36.622 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T00:28:36.622 INFO:teuthology.orchestra.run.smithi062.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T00:28:36.622 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2024-09-12T00:28:36.622 INFO:teuthology.orchestra.run.smithi062.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T00:28:36.622 INFO:teuthology.orchestra.run.smithi062.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T00:28:36.622 INFO:teuthology.orchestra.run.smithi062.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T00:28:36.622 INFO:teuthology.orchestra.run.smithi062.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T00:28:36.622 INFO:teuthology.orchestra.run.smithi062.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T00:28:36.622 INFO:teuthology.orchestra.run.smithi062.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T00:28:36.623 INFO:teuthology.orchestra.run.smithi062.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T00:28:36.623 INFO:teuthology.orchestra.run.smithi062.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T00:28:36.623 INFO:teuthology.orchestra.run.smithi062.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T00:28:36.623 INFO:teuthology.orchestra.run.smithi062.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T00:28:36.623 INFO:teuthology.orchestra.run.smithi062.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T00:28:36.623 INFO:teuthology.orchestra.run.smithi062.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T00:28:36.623 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T00:28:36.623 INFO:teuthology.orchestra.run.smithi062.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T00:28:36.623 INFO:teuthology.orchestra.run.smithi062.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T00:28:36.623 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:28:36.623 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-09-12T00:28:36.623 INFO:teuthology.orchestra.run.smithi062.stdout:====================================================================================================== 2024-09-12T00:28:36.624 INFO:teuthology.orchestra.run.smithi062.stdout:Install 283 Packages 2024-09-12T00:28:36.624 INFO:teuthology.orchestra.run.smithi062.stdout:Upgrade 2 Packages 2024-09-12T00:28:36.624 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:28:36.625 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 327 M 2024-09-12T00:28:36.625 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-09-12T00:28:37.610 INFO:teuthology.orchestra.run.smithi077.stdout:Transaction test succeeded. 2024-09-12T00:28:37.610 INFO:teuthology.orchestra.run.smithi077.stdout:Running transaction 2024-09-12T00:28:37.638 INFO:teuthology.orchestra.run.smithi062.stdout:(1/285): ceph-19.3.0-4753.gd011c522.el9.x86_64. 48 kB/s | 6.6 kB 00:00 2024-09-12T00:28:37.889 INFO:teuthology.orchestra.run.smithi062.stdout:(2/285): ceph-fuse-19.3.0-4753.gd011c522.el9.x8 3.5 MB/s | 899 kB 00:00 2024-09-12T00:28:37.969 INFO:teuthology.orchestra.run.smithi062.stdout:(3/285): ceph-base-19.3.0-4753.gd011c522.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-12T00:28:37.989 INFO:teuthology.orchestra.run.smithi062.stdout:(4/285): ceph-immutable-object-cache-19.3.0-475 1.4 MB/s | 145 kB 00:00 2024-09-12T00:28:38.206 INFO:teuthology.orchestra.run.smithi062.stdout:(5/285): ceph-mds-19.3.0-4753.gd011c522.el9.x86 9.8 MB/s | 2.4 MB 00:00 2024-09-12T00:28:38.256 INFO:teuthology.orchestra.run.smithi062.stdout:(6/285): ceph-mgr-19.3.0-4753.gd011c522.el9.x86 5.7 MB/s | 1.5 MB 00:00 2024-09-12T00:28:38.431 INFO:teuthology.orchestra.run.smithi062.stdout:(7/285): ceph-mon-19.3.0-4753.gd011c522.el9.x86 21 MB/s | 4.8 MB 00:00 2024-09-12T00:28:38.815 INFO:teuthology.orchestra.run.smithi062.stdout:(8/285): ceph-common-19.3.0-4753.gd011c522.el9. 16 MB/s | 22 MB 00:01 2024-09-12T00:28:38.866 INFO:teuthology.orchestra.run.smithi062.stdout:(9/285): ceph-selinux-19.3.0-4753.gd011c522.el9 506 kB/s | 25 kB 00:00 2024-09-12T00:28:39.057 INFO:teuthology.orchestra.run.smithi062.stdout:(10/285): ceph-radosgw-19.3.0-4753.gd011c522.el 17 MB/s | 11 MB 00:00 2024-09-12T00:28:39.108 INFO:teuthology.orchestra.run.smithi062.stdout:(11/285): libcephfs-devel-19.3.0-4753.gd011c522 636 kB/s | 32 kB 00:00 2024-09-12T00:28:39.200 INFO:teuthology.orchestra.run.smithi062.stdout:(12/285): libcephfs2-19.3.0-4753.gd011c522.el9. 8.1 MB/s | 755 kB 00:00 2024-09-12T00:28:39.275 INFO:teuthology.orchestra.run.smithi062.stdout:(13/285): libcephsqlite-19.3.0-4753.gd011c522.e 2.1 MB/s | 161 kB 00:00 2024-09-12T00:28:39.342 INFO:teuthology.orchestra.run.smithi062.stdout:(14/285): librados-devel-19.3.0-4753.gd011c522. 1.9 MB/s | 126 kB 00:00 2024-09-12T00:28:39.417 INFO:teuthology.orchestra.run.smithi062.stdout:(15/285): libradosstriper1-19.3.0-4753.gd011c52 6.6 MB/s | 508 kB 00:00 2024-09-12T00:28:39.767 INFO:teuthology.orchestra.run.smithi062.stdout:(16/285): librgw2-19.3.0-4753.gd011c522.el9.x86 16 MB/s | 5.5 MB 00:00 2024-09-12T00:28:39.809 INFO:teuthology.orchestra.run.smithi062.stdout:(17/285): python3-ceph-argparse-19.3.0-4753.gd0 1.1 MB/s | 45 kB 00:00 2024-09-12T00:28:39.876 INFO:teuthology.orchestra.run.smithi062.stdout:(18/285): python3-ceph-common-19.3.0-4753.gd011 2.1 MB/s | 143 kB 00:00 2024-09-12T00:28:39.943 INFO:teuthology.orchestra.run.smithi062.stdout:(19/285): python3-cephfs-19.3.0-4753.gd011c522. 2.4 MB/s | 161 kB 00:00 2024-09-12T00:28:40.010 INFO:teuthology.orchestra.run.smithi062.stdout:(20/285): python3-rados-19.3.0-4753.gd011c522.e 4.7 MB/s | 322 kB 00:00 2024-09-12T00:28:40.202 INFO:teuthology.orchestra.run.smithi062.stdout:(21/285): ceph-osd-19.3.0-4753.gd011c522.el9.x8 8.8 MB/s | 17 MB 00:01 2024-09-12T00:28:40.227 INFO:teuthology.orchestra.run.smithi062.stdout:(22/285): python3-rbd-19.3.0-4753.gd011c522.el9 1.4 MB/s | 306 kB 00:00 2024-09-12T00:28:40.261 INFO:teuthology.orchestra.run.smithi062.stdout:(23/285): python3-rgw-19.3.0-4753.gd011c522.el9 1.7 MB/s | 99 kB 00:00 2024-09-12T00:28:40.286 INFO:teuthology.orchestra.run.smithi062.stdout:(24/285): rbd-fuse-19.3.0-4753.gd011c522.el9.x8 1.4 MB/s | 85 kB 00:00 2024-09-12T00:28:40.336 INFO:teuthology.orchestra.run.smithi062.stdout:(25/285): rbd-nbd-19.3.0-4753.gd011c522.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-12T00:28:40.404 INFO:teuthology.orchestra.run.smithi062.stdout:(26/285): ceph-grafana-dashboards-19.3.0-4753.g 512 kB/s | 34 kB 00:00 2024-09-12T00:28:40.862 INFO:teuthology.orchestra.run.smithi062.stdout:(27/285): ceph-test-19.3.0-4753.gd011c522.el9.x 25 MB/s | 50 MB 00:01 2024-09-12T00:28:40.887 INFO:teuthology.orchestra.run.smithi062.stdout:(28/285): ceph-mgr-cephadm-19.3.0-4753.gd011c52 319 kB/s | 154 kB 00:00 2024-09-12T00:28:40.938 INFO:teuthology.orchestra.run.smithi062.stdout:(29/285): rbd-mirror-19.3.0-4753.gd011c522.el9. 4.7 MB/s | 3.2 MB 00:00 2024-09-12T00:28:41.080 INFO:teuthology.orchestra.run.smithi062.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4753.gd0 2.0 MB/s | 291 kB 00:00 2024-09-12T00:28:41.163 INFO:teuthology.orchestra.run.smithi062.stdout:(31/285): ceph-mgr-rook-19.3.0-4753.gd011c522.e 593 kB/s | 49 kB 00:00 2024-09-12T00:28:41.247 INFO:teuthology.orchestra.run.smithi062.stdout:(32/285): ceph-prometheus-alerts-19.3.0-4753.gd 198 kB/s | 16 kB 00:00 2024-09-12T00:28:41.355 INFO:teuthology.orchestra.run.smithi062.stdout:(33/285): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-09-12T00:28:41.380 INFO:teuthology.orchestra.run.smithi062.stdout:(34/285): ceph-volume-19.3.0-4753.gd011c522.el9 2.1 MB/s | 285 kB 00:00 2024-09-12T00:28:41.414 INFO:teuthology.orchestra.run.smithi062.stdout:(35/285): cephadm-19.3.0-4753.gd011c522.el9.noa 13 MB/s | 782 kB 00:00 2024-09-12T00:28:41.556 INFO:teuthology.orchestra.run.smithi062.stdout:(36/285): ceph-mgr-dashboard-19.3.0-4753.gd011c 20 MB/s | 14 MB 00:00 2024-09-12T00:28:41.715 INFO:teuthology.orchestra.run.smithi062.stdout:(37/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 313 kB/s | 49 kB 00:00 2024-09-12T00:28:41.757 INFO:teuthology.orchestra.run.smithi062.stdout:(38/285): bluez-libs-5.56-6.el9.x86_64.rpm 247 kB/s | 85 kB 00:00 2024-09-12T00:28:41.782 INFO:teuthology.orchestra.run.smithi062.stdout:(39/285): ModemManager-glib-1.20.2-1.el9.x86_64 836 kB/s | 335 kB 00:00 2024-09-12T00:28:41.849 INFO:teuthology.orchestra.run.smithi062.stdout:(40/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 1.9 MB/s | 262 kB 00:00 2024-09-12T00:28:41.874 INFO:teuthology.orchestra.run.smithi062.stdout:(41/285): fuse-2.9.9-16.el9.x86_64.rpm 682 kB/s | 80 kB 00:00 2024-09-12T00:28:41.907 INFO:teuthology.orchestra.run.smithi062.stdout:(42/285): libpciaccess-0.16-7.el9.x86_64.rpm 461 kB/s | 27 kB 00:00 2024-09-12T00:28:41.974 INFO:teuthology.orchestra.run.smithi062.stdout:(43/285): libquadmath-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-12T00:28:42.000 INFO:teuthology.orchestra.run.smithi062.stdout:(44/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.0 MB/s | 94 kB 00:00 2024-09-12T00:28:42.058 INFO:teuthology.orchestra.run.smithi062.stdout:(45/285): libgfortran-11.5.0-2.el9.x86_64.rpm 2.8 MB/s | 801 kB 00:00 2024-09-12T00:28:42.084 INFO:teuthology.orchestra.run.smithi062.stdout:(46/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-09-12T00:28:42.134 INFO:teuthology.orchestra.run.smithi062.stdout:(47/285): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-09-12T00:28:42.176 INFO:teuthology.orchestra.run.smithi062.stdout:(48/285): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-09-12T00:28:42.201 INFO:teuthology.orchestra.run.smithi062.stdout:(49/285): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 135 kB 00:00 2024-09-12T00:28:42.226 INFO:teuthology.orchestra.run.smithi062.stdout:(50/285): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-09-12T00:28:42.252 INFO:teuthology.orchestra.run.smithi062.stdout:(51/285): python3-urllib3-1.26.5-6.el9.noarch.r 2.8 MB/s | 215 kB 00:00 2024-09-12T00:28:42.469 INFO:teuthology.orchestra.run.smithi062.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 2.4 MB/s | 650 kB 00:00 2024-09-12T00:28:42.494 INFO:teuthology.orchestra.run.smithi062.stdout:(53/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 2.1 MB/s | 523 kB 00:00 2024-09-12T00:28:42.519 INFO:teuthology.orchestra.run.smithi062.stdout:(54/285): apache-commons-cli-1.4-17.el9.noarch. 1.4 MB/s | 71 kB 00:00 2024-09-12T00:28:42.553 INFO:teuthology.orchestra.run.smithi062.stdout:(55/285): apache-commons-codec-1.15-7.el9.noarc 5.0 MB/s | 302 kB 00:00 2024-09-12T00:28:42.578 INFO:teuthology.orchestra.run.smithi062.stdout:(56/285): apache-commons-io-2.8.0-8.el9.noarch. 4.7 MB/s | 283 kB 00:00 2024-09-12T00:28:42.629 INFO:teuthology.orchestra.run.smithi062.stdout:(57/285): apache-commons-lang3-3.12.0-6.el9.noa 7.2 MB/s | 559 kB 00:00 2024-09-12T00:28:42.654 INFO:teuthology.orchestra.run.smithi062.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2024-09-12T00:28:42.695 INFO:teuthology.orchestra.run.smithi062.stdout:(59/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-09-12T00:28:42.721 INFO:teuthology.orchestra.run.smithi062.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 347 kB/s | 23 kB 00:00 2024-09-12T00:28:42.754 INFO:teuthology.orchestra.run.smithi062.stdout:(61/285): atk-2.36.0-5.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-12T00:28:42.780 INFO:teuthology.orchestra.run.smithi062.stdout:(62/285): avahi-glib-0.8-21.el9.x86_64.rpm 254 kB/s | 15 kB 00:00 2024-09-12T00:28:42.814 INFO:teuthology.orchestra.run.smithi062.stdout:(63/285): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-12T00:28:42.939 INFO:teuthology.orchestra.run.smithi062.stdout:(64/285): adwaita-icon-theme-40.1.1-3.el9.noarc 17 MB/s | 12 MB 00:00 2024-09-12T00:28:42.964 INFO:teuthology.orchestra.run.smithi062.stdout:(65/285): cdi-api-2.0.2-6.el9.noarch.rpm 290 kB/s | 53 kB 00:00 2024-09-12T00:28:42.989 INFO:teuthology.orchestra.run.smithi062.stdout:(66/285): colord-libs-1.4.5-4.el9.x86_64.rpm 1.3 MB/s | 229 kB 00:00 2024-09-12T00:28:43.015 INFO:teuthology.orchestra.run.smithi062.stdout:(67/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-12T00:28:43.040 INFO:teuthology.orchestra.run.smithi062.stdout:(68/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 376 kB/s | 28 kB 00:00 2024-09-12T00:28:43.066 INFO:teuthology.orchestra.run.smithi062.stdout:(69/285): dconf-0.40.0-6.el9.x86_64.rpm 1.5 MB/s | 113 kB 00:00 2024-09-12T00:28:43.090 INFO:teuthology.orchestra.run.smithi062.stdout:(70/285): exempi-2.6.0-0.2.20211007gite23c213.e 6.8 MB/s | 525 kB 00:00 2024-09-12T00:28:43.132 INFO:teuthology.orchestra.run.smithi062.stdout:(71/285): exiv2-0.27.5-2.el9.x86_64.rpm 10 MB/s | 980 kB 00:00 2024-09-12T00:28:43.163 INFO:teuthology.orchestra.run.smithi062.stdout:(72/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 4.8 MB/s | 325 kB 00:00 2024-09-12T00:28:43.191 INFO:teuthology.orchestra.run.smithi062.stdout:(73/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 6.1 MB/s | 781 kB 00:00 2024-09-12T00:28:43.217 INFO:teuthology.orchestra.run.smithi062.stdout:(74/285): flac-libs-1.3.3-12.el9.x86_64.rpm 2.5 MB/s | 218 kB 00:00 2024-09-12T00:28:43.263 INFO:teuthology.orchestra.run.smithi062.stdout:(75/285): flatpak-selinux-1.12.9-1.el9.noarch.r 370 kB/s | 22 kB 00:00 2024-09-12T00:28:43.292 INFO:teuthology.orchestra.run.smithi062.stdout:(76/285): flatpak-1.12.9-1.el9.x86_64.rpm 13 MB/s | 1.7 MB 00:00 2024-09-12T00:28:43.309 INFO:teuthology.orchestra.run.smithi062.stdout:(77/285): flatpak-session-helper-1.12.9-1.el9.x 793 kB/s | 73 kB 00:00 2024-09-12T00:28:43.334 INFO:teuthology.orchestra.run.smithi062.stdout:(78/285): flexiblas-3.0.4-8.el9.x86_64.rpm 390 kB/s | 33 kB 00:00 2024-09-12T00:28:43.368 INFO:teuthology.orchestra.run.smithi062.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 313 kB/s | 18 kB 00:00 2024-09-12T00:28:43.395 INFO:teuthology.orchestra.run.smithi062.stdout:(80/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.5 MB/s | 89 kB 00:00 2024-09-12T00:28:43.429 INFO:teuthology.orchestra.run.smithi062.stdout:(81/285): geoclue2-2.6.0-7.el9.x86_64.rpm 2.1 MB/s | 124 kB 00:00 2024-09-12T00:28:43.456 INFO:teuthology.orchestra.run.smithi062.stdout:(82/285): giflib-5.2.1-9.el9.x86_64.rpm 830 kB/s | 49 kB 00:00 2024-09-12T00:28:43.513 INFO:teuthology.orchestra.run.smithi062.stdout:(83/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 16 MB/s | 3.0 MB 00:00 2024-09-12T00:28:43.527 INFO:teuthology.orchestra.run.smithi062.stdout:(84/285): graphene-1.10.6-2.el9.x86_64.rpm 858 kB/s | 64 kB 00:00 2024-09-12T00:28:43.553 INFO:teuthology.orchestra.run.smithi062.stdout:(85/285): google-guice-4.2.3-9.el9.noarch.rpm 3.7 MB/s | 473 kB 00:00 2024-09-12T00:28:43.578 INFO:teuthology.orchestra.run.smithi062.stdout:(86/285): gsm-1.0.19-6.el9.x86_64.rpm 452 kB/s | 34 kB 00:00 2024-09-12T00:28:43.728 INFO:teuthology.orchestra.run.smithi062.stdout:(87/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 7.1 MB/s | 1.4 MB 00:00 2024-09-12T00:28:43.753 INFO:teuthology.orchestra.run.smithi062.stdout:(88/285): gtk-update-icon-cache-3.24.31-5.el9.x 189 kB/s | 33 kB 00:00 2024-09-12T00:28:43.795 INFO:teuthology.orchestra.run.smithi062.stdout:(89/285): gstreamer1-plugins-base-1.22.1-2.el9. 9.3 MB/s | 2.2 MB 00:00 2024-09-12T00:28:43.862 INFO:teuthology.orchestra.run.smithi062.stdout:(90/285): hicolor-icon-theme-0.17-13.el9.noarch 3.2 MB/s | 219 kB 00:00 2024-09-12T00:28:43.913 INFO:teuthology.orchestra.run.smithi062.stdout:(91/285): guava-30.1-6.el9.noarch.rpm 15 MB/s | 2.3 MB 00:00 2024-09-12T00:28:43.946 INFO:teuthology.orchestra.run.smithi062.stdout:(92/285): httpcomponents-client-4.5.13-3.el9.no 7.7 MB/s | 657 kB 00:00 2024-09-12T00:28:43.980 INFO:teuthology.orchestra.run.smithi062.stdout:(93/285): httpcomponents-core-4.4.13-7.el9.noar 9.2 MB/s | 632 kB 00:00 2024-09-12T00:28:44.055 INFO:teuthology.orchestra.run.smithi062.stdout:(94/285): gtk3-3.24.31-5.el9.x86_64.rpm 15 MB/s | 4.9 MB 00:00 2024-09-12T00:28:44.080 INFO:teuthology.orchestra.run.smithi062.stdout:(95/285): jakarta-annotations-1.3.5-13.el9.noar 450 kB/s | 45 kB 00:00 2024-09-12T00:28:44.147 INFO:teuthology.orchestra.run.smithi062.stdout:(96/285): iso-codes-4.6.0-3.el9.noarch.rpm 18 MB/s | 3.5 MB 00:00 2024-09-12T00:28:44.172 INFO:teuthology.orchestra.run.smithi062.stdout:(97/285): jansi-2.3.3-6.el9.x86_64.rpm 938 kB/s | 110 kB 00:00 2024-09-12T00:28:44.198 INFO:teuthology.orchestra.run.smithi062.stdout:(98/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 3.4 MB/s | 413 kB 00:00 2024-09-12T00:28:44.273 INFO:teuthology.orchestra.run.smithi062.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 174 kB/s | 13 kB 00:00 2024-09-12T00:28:44.331 INFO:teuthology.orchestra.run.smithi062.stdout:(100/285): java-11-openjdk-devel-11.0.20.1.1-2. 18 MB/s | 3.3 MB 00:00 2024-09-12T00:28:44.357 INFO:teuthology.orchestra.run.smithi062.stdout:(101/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 634 kB/s | 53 kB 00:00 2024-09-12T00:28:44.390 INFO:teuthology.orchestra.run.smithi062.stdout:(102/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 410 kB/s | 24 kB 00:00 2024-09-12T00:28:44.416 INFO:teuthology.orchestra.run.smithi062.stdout:(103/285): jsoup-1.13.1-10.el9.noarch.rpm 6.3 MB/s | 377 kB 00:00 2024-09-12T00:28:44.449 INFO:teuthology.orchestra.run.smithi062.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 607 kB/s | 35 kB 00:00 2024-09-12T00:28:44.474 INFO:teuthology.orchestra.run.smithi062.stdout:(105/285): lcms2-2.12-3.el9.x86_64.rpm 2.8 MB/s | 168 kB 00:00 2024-09-12T00:28:44.500 INFO:teuthology.orchestra.run.smithi062.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 221 kB/s | 11 kB 00:00 2024-09-12T00:28:44.525 INFO:teuthology.orchestra.run.smithi062.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 480 kB/s | 24 kB 00:00 2024-09-12T00:28:44.550 INFO:teuthology.orchestra.run.smithi062.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 614 kB/s | 31 kB 00:00 2024-09-12T00:28:44.584 INFO:teuthology.orchestra.run.smithi062.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 392 kB/s | 23 kB 00:00 2024-09-12T00:28:44.609 INFO:teuthology.orchestra.run.smithi062.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 337 kB/s | 20 kB 00:00 2024-09-12T00:28:44.643 INFO:teuthology.orchestra.run.smithi062.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 676 kB/s | 40 kB 00:00 2024-09-12T00:28:44.668 INFO:teuthology.orchestra.run.smithi062.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 257 kB/s | 15 kB 00:00 2024-09-12T00:28:44.701 INFO:teuthology.orchestra.run.smithi062.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 486 kB/s | 28 kB 00:00 2024-09-12T00:28:44.727 INFO:teuthology.orchestra.run.smithi062.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 367 kB/s | 21 kB 00:00 2024-09-12T00:28:44.752 INFO:teuthology.orchestra.run.smithi062.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 379 kB/s | 19 kB 00:00 2024-09-12T00:28:44.786 INFO:teuthology.orchestra.run.smithi062.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 320 kB/s | 19 kB 00:00 2024-09-12T00:28:44.811 INFO:teuthology.orchestra.run.smithi062.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 519 kB/s | 30 kB 00:00 2024-09-12T00:28:44.863 INFO:teuthology.orchestra.run.smithi062.stdout:(118/285): libcanberra-0.30-27.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2024-09-12T00:28:45.018 INFO:teuthology.orchestra.run.smithi062.stdout:(119/285): libcanberra-gtk3-0.30-27.el9.x86_64. 154 kB/s | 32 kB 00:00 2024-09-12T00:28:45.079 INFO:teuthology.orchestra.run.smithi062.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 746 kB/s | 161 kB 00:00 2024-09-12T00:28:45.104 INFO:teuthology.orchestra.run.smithi062.stdout:(121/285): libepoxy-1.5.5-4.el9.x86_64.rpm 2.8 MB/s | 241 kB 00:00 2024-09-12T00:28:45.146 INFO:teuthology.orchestra.run.smithi062.stdout:(122/285): libexif-0.6.22-6.el9.x86_64.rpm 6.4 MB/s | 435 kB 00:00 2024-09-12T00:28:45.171 INFO:teuthology.orchestra.run.smithi062.stdout:(123/285): libfontenc-1.1.3-17.el9.x86_64.rpm 464 kB/s | 31 kB 00:00 2024-09-12T00:28:45.205 INFO:teuthology.orchestra.run.smithi062.stdout:(124/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.4 MB/s | 83 kB 00:00 2024-09-12T00:28:45.255 INFO:teuthology.orchestra.run.smithi062.stdout:(125/285): libglvnd-1.3.4-1.el9.x86_64.rpm 1.6 MB/s | 135 kB 00:00 2024-09-12T00:28:45.280 INFO:teuthology.orchestra.run.smithi062.stdout:(126/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 487 kB/s | 37 kB 00:00 2024-09-12T00:28:45.314 INFO:teuthology.orchestra.run.smithi062.stdout:(127/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.4 MB/s | 142 kB 00:00 2024-09-12T00:28:45.339 INFO:teuthology.orchestra.run.smithi062.stdout:(128/285): libgsf-1.14.47-5.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-09-12T00:28:45.373 INFO:teuthology.orchestra.run.smithi062.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-09-12T00:28:45.398 INFO:teuthology.orchestra.run.smithi062.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.0 MB/s | 61 kB 00:00 2024-09-12T00:28:45.432 INFO:teuthology.orchestra.run.smithi062.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 705 kB/s | 41 kB 00:00 2024-09-12T00:28:45.457 INFO:teuthology.orchestra.run.smithi062.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 745 kB/s | 44 kB 00:00 2024-09-12T00:28:45.490 INFO:teuthology.orchestra.run.smithi062.stdout:(133/285): libogg-1.3.4-6.el9.x86_64.rpm 575 kB/s | 34 kB 00:00 2024-09-12T00:28:45.516 INFO:teuthology.orchestra.run.smithi062.stdout:(134/285): libosinfo-1.10.0-1.el9.x86_64.rpm 5.3 MB/s | 319 kB 00:00 2024-09-12T00:28:45.550 INFO:teuthology.orchestra.run.smithi062.stdout:(135/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-12T00:28:45.575 INFO:teuthology.orchestra.run.smithi062.stdout:(136/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-09-12T00:28:45.609 INFO:teuthology.orchestra.run.smithi062.stdout:(137/285): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-12T00:28:45.634 INFO:teuthology.orchestra.run.smithi062.stdout:(138/285): libsbc-1.4-9.el9.x86_64.rpm 763 kB/s | 45 kB 00:00 2024-09-12T00:28:45.984 INFO:teuthology.orchestra.run.smithi062.stdout:(139/285): java-11-openjdk-headless-11.0.20.1.1 22 MB/s | 39 MB 00:01 2024-09-12T00:28:46.009 INFO:teuthology.orchestra.run.smithi062.stdout:(140/285): libtheora-1.1.1-31.el9.x86_64.rpm 437 kB/s | 164 kB 00:00 2024-09-12T00:28:46.035 INFO:teuthology.orchestra.run.smithi062.stdout:(141/285): libsndfile-1.0.31-8.el9.x86_64.rpm 485 kB/s | 206 kB 00:00 2024-09-12T00:28:46.060 INFO:teuthology.orchestra.run.smithi062.stdout:(142/285): libtiff-4.4.0-13.el9.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2024-09-12T00:28:46.085 INFO:teuthology.orchestra.run.smithi062.stdout:(143/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 471 kB/s | 36 kB 00:00 2024-09-12T00:28:46.110 INFO:teuthology.orchestra.run.smithi062.stdout:(144/285): libtracker-sparql-3.1.2-3.el9.x86_64 4.2 MB/s | 324 kB 00:00 2024-09-12T00:28:46.136 INFO:teuthology.orchestra.run.smithi062.stdout:(145/285): libvisual-0.4.0-34.el9.x86_64.rpm 1.9 MB/s | 144 kB 00:00 2024-09-12T00:28:46.161 INFO:teuthology.orchestra.run.smithi062.stdout:(146/285): libvorbis-1.3.7-5.el9.x86_64.rpm 2.5 MB/s | 193 kB 00:00 2024-09-12T00:28:46.186 INFO:teuthology.orchestra.run.smithi062.stdout:(147/285): libwayland-client-1.21.0-1.el9.x86_6 443 kB/s | 33 kB 00:00 2024-09-12T00:28:46.211 INFO:teuthology.orchestra.run.smithi062.stdout:(148/285): libwayland-cursor-1.21.0-1.el9.x86_6 258 kB/s | 19 kB 00:00 2024-09-12T00:28:46.237 INFO:teuthology.orchestra.run.smithi062.stdout:(149/285): libwayland-egl-1.21.0-1.el9.x86_64.r 170 kB/s | 13 kB 00:00 2024-09-12T00:28:46.271 INFO:teuthology.orchestra.run.smithi062.stdout:(150/285): libwayland-server-1.21.0-1.el9.x86_6 496 kB/s | 42 kB 00:00 2024-09-12T00:28:46.296 INFO:teuthology.orchestra.run.smithi062.stdout:(151/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.2 MB/s | 133 kB 00:00 2024-09-12T00:28:46.330 INFO:teuthology.orchestra.run.smithi062.stdout:(152/285): libwebp-1.2.0-8.el9.x86_64.rpm 2.3 MB/s | 277 kB 00:00 2024-09-12T00:28:46.355 INFO:teuthology.orchestra.run.smithi062.stdout:(153/285): libxshmfence-1.3-10.el9.x86_64.rpm 150 kB/s | 13 kB 00:00 2024-09-12T00:28:46.380 INFO:teuthology.orchestra.run.smithi062.stdout:(154/285): low-memory-monitor-2.1-4.el9.x86_64. 427 kB/s | 36 kB 00:00 2024-09-12T00:28:46.405 INFO:teuthology.orchestra.run.smithi062.stdout:(155/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-12T00:28:46.430 INFO:teuthology.orchestra.run.smithi062.stdout:(156/285): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-12T00:28:46.455 INFO:teuthology.orchestra.run.smithi062.stdout:(157/285): lua-posix-35.0-8.el9.x86_64.rpm 2.0 MB/s | 151 kB 00:00 2024-09-12T00:28:46.473 INFO:teuthology.orchestra.run.smithi062.stdout:(158/285): maven-3.6.3-15.el9.noarch.rpm 263 kB/s | 18 kB 00:00 2024-09-12T00:28:46.498 INFO:teuthology.orchestra.run.smithi062.stdout:(159/285): maven-openjdk11-3.6.3-15.el9.noarch. 215 kB/s | 9.0 kB 00:00 2024-09-12T00:28:46.557 INFO:teuthology.orchestra.run.smithi062.stdout:(160/285): maven-lib-3.6.3-15.el9.noarch.rpm 12 MB/s | 1.5 MB 00:00 2024-09-12T00:28:46.590 INFO:teuthology.orchestra.run.smithi062.stdout:(161/285): maven-resolver-1.6.1-10.el9.noarch.r 4.3 MB/s | 517 kB 00:00 2024-09-12T00:28:46.615 INFO:teuthology.orchestra.run.smithi062.stdout:(162/285): maven-shared-utils-3.3.4-3.el9.noarc 1.3 MB/s | 151 kB 00:00 2024-09-12T00:28:46.641 INFO:teuthology.orchestra.run.smithi062.stdout:(163/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.3 MB/s | 112 kB 00:00 2024-09-12T00:28:46.666 INFO:teuthology.orchestra.run.smithi062.stdout:(164/285): mesa-filesystem-24.1.2-3.el9.x86_64. 224 kB/s | 11 kB 00:00 2024-09-12T00:28:46.699 INFO:teuthology.orchestra.run.smithi062.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.3 MB/s | 139 kB 00:00 2024-09-12T00:28:46.733 INFO:teuthology.orchestra.run.smithi062.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-12T00:28:46.758 INFO:teuthology.orchestra.run.smithi062.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 619 kB/s | 36 kB 00:00 2024-09-12T00:28:46.792 INFO:teuthology.orchestra.run.smithi062.stdout:(168/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 785 kB/s | 46 kB 00:00 2024-09-12T00:28:46.817 INFO:teuthology.orchestra.run.smithi062.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 551 kB/s | 32 kB 00:00 2024-09-12T00:28:46.851 INFO:teuthology.orchestra.run.smithi062.stdout:(170/285): openblas-0.3.26-2.el9.x86_64.rpm 658 kB/s | 38 kB 00:00 2024-09-12T00:28:46.959 INFO:teuthology.orchestra.run.smithi062.stdout:(171/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 24 MB/s | 8.8 MB 00:00 2024-09-12T00:28:46.994 INFO:teuthology.orchestra.run.smithi062.stdout:(172/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.1 MB/s | 163 kB 00:00 2024-09-12T00:28:47.019 INFO:teuthology.orchestra.run.smithi062.stdout:(173/285): opus-1.3.1-10.el9.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2024-09-12T00:28:47.052 INFO:teuthology.orchestra.run.smithi062.stdout:(174/285): orc-0.4.31-8.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-12T00:28:47.086 INFO:teuthology.orchestra.run.smithi062.stdout:(175/285): osinfo-db-20240701-2.el9.noarch.rpm 7.8 MB/s | 531 kB 00:00 2024-09-12T00:28:47.112 INFO:teuthology.orchestra.run.smithi062.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.2 MB/s | 74 kB 00:00 2024-09-12T00:28:47.187 INFO:teuthology.orchestra.run.smithi062.stdout:(177/285): openblas-openmp-0.3.26-2.el9.x86_64. 13 MB/s | 4.9 MB 00:00 2024-09-12T00:28:47.212 INFO:teuthology.orchestra.run.smithi062.stdout:(178/285): p11-kit-server-0.25.3-2.el9.x86_64.r 2.4 MB/s | 246 kB 00:00 2024-09-12T00:28:47.237 INFO:teuthology.orchestra.run.smithi062.stdout:(179/285): ostree-libs-2024.7-2.el9.x86_64.rpm 3.0 MB/s | 468 kB 00:00 2024-09-12T00:28:47.262 INFO:teuthology.orchestra.run.smithi062.stdout:(180/285): pipewire-1.0.1-1.el9.x86_64.rpm 1.4 MB/s | 107 kB 00:00 2024-09-12T00:28:47.288 INFO:teuthology.orchestra.run.smithi062.stdout:(181/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 758 kB/s | 57 kB 00:00 2024-09-12T00:28:47.313 INFO:teuthology.orchestra.run.smithi062.stdout:(182/285): pipewire-jack-audio-connection-kit-1 121 kB/s | 9.1 kB 00:00 2024-09-12T00:28:47.339 INFO:teuthology.orchestra.run.smithi062.stdout:(183/285): pipewire-jack-audio-connection-kit-l 1.7 MB/s | 135 kB 00:00 2024-09-12T00:28:47.372 INFO:teuthology.orchestra.run.smithi062.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 3.2 MB/s | 192 kB 00:00 2024-09-12T00:28:47.397 INFO:teuthology.orchestra.run.smithi062.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 442 kB/s | 26 kB 00:00 2024-09-12T00:28:47.448 INFO:teuthology.orchestra.run.smithi062.stdout:(186/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 12 MB/s | 1.9 MB 00:00 2024-09-12T00:28:47.473 INFO:teuthology.orchestra.run.smithi062.stdout:(187/285): plexus-containers-component-annotati 244 kB/s | 18 kB 00:00 2024-09-12T00:28:47.498 INFO:teuthology.orchestra.run.smithi062.stdout:(188/285): plexus-classworlds-2.6.0-11.el9.noar 478 kB/s | 60 kB 00:00 2024-09-12T00:28:47.523 INFO:teuthology.orchestra.run.smithi062.stdout:(189/285): plexus-interpolation-1.26-11.el9.noa 1.0 MB/s | 80 kB 00:00 2024-09-12T00:28:47.549 INFO:teuthology.orchestra.run.smithi062.stdout:(190/285): plexus-sec-dispatcher-1.4-37.el9.noa 445 kB/s | 34 kB 00:00 2024-09-12T00:28:47.574 INFO:teuthology.orchestra.run.smithi062.stdout:(191/285): plexus-utils-3.3.0-10.el9.noarch.rpm 3.3 MB/s | 254 kB 00:00 2024-09-12T00:28:47.608 INFO:teuthology.orchestra.run.smithi062.stdout:(192/285): poppler-21.01.0-21.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-09-12T00:28:47.633 INFO:teuthology.orchestra.run.smithi062.stdout:(193/285): poppler-glib-21.01.0-21.el9.x86_64.r 2.6 MB/s | 152 kB 00:00 2024-09-12T00:28:47.683 INFO:teuthology.orchestra.run.smithi062.stdout:(194/285): poppler-data-0.4.9-9.el9.noarch.rpm 14 MB/s | 1.9 MB 00:00 2024-09-12T00:28:47.708 INFO:teuthology.orchestra.run.smithi062.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 1.1 MB/s | 83 kB 00:00 2024-09-12T00:28:47.745 INFO:teuthology.orchestra.run.smithi062.stdout:(196/285): protobuf-3.14.0-13.el9.x86_64.rpm 7.5 MB/s | 1.0 MB 00:00 2024-09-12T00:28:47.771 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T00:28:47.775 INFO:teuthology.orchestra.run.smithi062.stdout:(197/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 7.2 MB/s | 679 kB 00:00 2024-09-12T00:28:47.801 INFO:teuthology.orchestra.run.smithi062.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-12T00:28:47.834 INFO:teuthology.orchestra.run.smithi062.stdout:(199/285): python3-jinja2-2.11.3-6.el9.noarch.r 4.2 MB/s | 248 kB 00:00 2024-09-12T00:28:47.859 INFO:teuthology.orchestra.run.smithi062.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 438 kB/s | 26 kB 00:00 2024-09-12T00:28:47.893 INFO:teuthology.orchestra.run.smithi062.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 327 kB/s | 19 kB 00:00 2024-09-12T00:28:47.918 INFO:teuthology.orchestra.run.smithi062.stdout:(202/285): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-12T00:28:47.927 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T00:28:47.952 INFO:teuthology.orchestra.run.smithi062.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 594 kB/s | 35 kB 00:00 2024-09-12T00:28:48.036 INFO:teuthology.orchestra.run.smithi062.stdout:(204/285): python3-babel-2.9.1-2.el9.noarch.rpm 18 MB/s | 6.0 MB 00:00 2024-09-12T00:28:48.061 INFO:teuthology.orchestra.run.smithi062.stdout:(205/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 2.3 MB/s | 250 kB 00:00 2024-09-12T00:28:48.080 INFO:teuthology.orchestra.run.smithi077.stdout: Preparing : 1/1 2024-09-12T00:28:48.094 INFO:teuthology.orchestra.run.smithi062.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 3.7 MB/s | 222 kB 00:00 2024-09-12T00:28:48.120 INFO:teuthology.orchestra.run.smithi062.stdout:(207/285): python3-packaging-20.9-5.el9.noarch. 1.3 MB/s | 77 kB 00:00 2024-09-12T00:28:48.145 INFO:teuthology.orchestra.run.smithi062.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 840 kB/s | 42 kB 00:00 2024-09-12T00:28:48.160 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T00:28:48.179 INFO:teuthology.orchestra.run.smithi062.stdout:(209/285): python3-protobuf-3.14.0-13.el9.noarc 4.5 MB/s | 269 kB 00:00 2024-09-12T00:28:48.192 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T00:28:48.246 INFO:teuthology.orchestra.run.smithi062.stdout:(210/285): python3-numpy-1.20.1-5.el9.x86_64.rp 16 MB/s | 5.1 MB 00:00 2024-09-12T00:28:48.266 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T00:28:48.271 INFO:teuthology.orchestra.run.smithi062.stdout:(211/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 1.2 MB/s | 159 kB 00:00 2024-09-12T00:28:48.296 INFO:teuthology.orchestra.run.smithi062.stdout:(212/285): python3-pyasn1-modules-0.4.8-6.el9.n 2.3 MB/s | 279 kB 00:00 2024-09-12T00:28:48.315 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T00:28:48.321 INFO:teuthology.orchestra.run.smithi062.stdout:(213/285): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-09-12T00:28:48.347 INFO:teuthology.orchestra.run.smithi062.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 710 kB/s | 54 kB 00:00 2024-09-12T00:28:48.370 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T00:28:48.372 INFO:teuthology.orchestra.run.smithi062.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 824 kB/s | 42 kB 00:00 2024-09-12T00:28:48.406 INFO:teuthology.orchestra.run.smithi062.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T00:28:48.443 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T00:28:48.451 INFO:teuthology.orchestra.run.smithi062.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 455 kB/s | 36 kB 00:00 2024-09-12T00:28:48.481 INFO:teuthology.orchestra.run.smithi062.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-12T00:28:48.507 INFO:teuthology.orchestra.run.smithi062.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-09-12T00:28:48.557 INFO:teuthology.orchestra.run.smithi062.stdout:(220/285): sisu-0.3.4-10.el9.noarch.rpm 6.6 MB/s | 510 kB 00:00 2024-09-12T00:28:48.582 INFO:teuthology.orchestra.run.smithi062.stdout:(221/285): slf4j-1.7.30-13.el9.noarch.rpm 916 kB/s | 69 kB 00:00 2024-09-12T00:28:48.612 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T00:28:48.624 INFO:teuthology.orchestra.run.smithi062.stdout:(222/285): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-12T00:28:48.649 INFO:teuthology.orchestra.run.smithi062.stdout:(223/285): sound-theme-freedesktop-0.8-17.el9.n 5.6 MB/s | 383 kB 00:00 2024-09-12T00:28:48.683 INFO:teuthology.orchestra.run.smithi062.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 2.5 MB/s | 152 kB 00:00 2024-09-12T00:28:48.717 INFO:teuthology.orchestra.run.smithi062.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 8.1 MB/s | 555 kB 00:00 2024-09-12T00:28:48.753 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T00:28:48.758 INFO:teuthology.orchestra.run.smithi062.stdout:(226/285): tracker-miners-3.1.2-4.el9.x86_64.rp 12 MB/s | 944 kB 00:00 2024-09-12T00:28:48.917 INFO:teuthology.orchestra.run.smithi062.stdout:(227/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 26 MB/s | 16 MB 00:00 2024-09-12T00:28:48.942 INFO:teuthology.orchestra.run.smithi062.stdout:(228/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 236 kB/s | 53 kB 00:00 2024-09-12T00:28:48.967 INFO:teuthology.orchestra.run.smithi062.stdout:(229/285): tzdata-java-2024a-2.el9.noarch.rpm 1.1 MB/s | 230 kB 00:00 2024-09-12T00:28:48.993 INFO:teuthology.orchestra.run.smithi062.stdout:(230/285): upower-0.99.11-11.el9.x86_64.rpm 2.2 MB/s | 173 kB 00:00 2024-09-12T00:28:49.018 INFO:teuthology.orchestra.run.smithi062.stdout:(231/285): webrtc-audio-processing-0.3.1-8.el9. 4.0 MB/s | 306 kB 00:00 2024-09-12T00:28:49.043 INFO:teuthology.orchestra.run.smithi062.stdout:(232/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.2 MB/s | 96 kB 00:00 2024-09-12T00:28:49.068 INFO:teuthology.orchestra.run.smithi062.stdout:(233/285): wireplumber-libs-0.4.14-1.el9.x86_64 4.6 MB/s | 358 kB 00:00 2024-09-12T00:28:49.086 INFO:teuthology.orchestra.run.smithi062.stdout:(234/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 633 kB/s | 42 kB 00:00 2024-09-12T00:28:49.095 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T00:28:49.120 INFO:teuthology.orchestra.run.smithi062.stdout:(235/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 5.0 MB/s | 385 kB 00:00 2024-09-12T00:28:49.145 INFO:teuthology.orchestra.run.smithi062.stdout:(236/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.7 MB/s | 134 kB 00:00 2024-09-12T00:28:49.187 INFO:teuthology.orchestra.run.smithi062.stdout:(237/285): xkeyboard-config-2.33-2.el9.noarch.r 8.4 MB/s | 859 kB 00:00 2024-09-12T00:28:49.212 INFO:teuthology.orchestra.run.smithi062.stdout:(238/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 690 kB/s | 64 kB 00:00 2024-09-12T00:28:49.212 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:28:49.237 INFO:teuthology.orchestra.run.smithi062.stdout:(239/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.3 MB/s | 505 kB 00:00 2024-09-12T00:28:49.287 INFO:teuthology.orchestra.run.smithi062.stdout:(240/285): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T00:28:49.313 INFO:teuthology.orchestra.run.smithi062.stdout:(241/285): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-09-12T00:28:49.334 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:28:49.338 INFO:teuthology.orchestra.run.smithi062.stdout:(242/285): lua-devel-5.4.4-4.el9.x86_64.rpm 148 kB/s | 22 kB 00:00 2024-09-12T00:28:49.363 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:28:49.371 INFO:teuthology.orchestra.run.smithi062.stdout:(243/285): grpc-data-1.46.7-10.el9.noarch.rpm 332 kB/s | 19 kB 00:00 2024-09-12T00:28:49.396 INFO:teuthology.orchestra.run.smithi062.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-12T00:28:49.422 INFO:teuthology.orchestra.run.smithi062.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T00:28:49.447 INFO:teuthology.orchestra.run.smithi062.stdout:(246/285): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-12T00:28:49.470 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:28:49.472 INFO:teuthology.orchestra.run.smithi062.stdout:(247/285): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-12T00:28:49.500 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:28:49.514 INFO:teuthology.orchestra.run.smithi062.stdout:(248/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-12T00:28:49.539 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T00:28:49.548 INFO:teuthology.orchestra.run.smithi062.stdout:(249/285): protobuf-compiler-3.14.0-13.el9.x86_ 2.5 MB/s | 863 kB 00:00 2024-09-12T00:28:49.576 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T00:28:49.590 INFO:teuthology.orchestra.run.smithi062.stdout:(250/285): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-12T00:28:49.602 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T00:28:49.615 INFO:teuthology.orchestra.run.smithi062.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.4 MB/s | 32 kB 00:00 2024-09-12T00:28:49.628 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T00:28:49.641 INFO:teuthology.orchestra.run.smithi062.stdout:(252/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 472 kB/s | 43 kB 00:00 2024-09-12T00:28:49.661 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T00:28:49.666 INFO:teuthology.orchestra.run.smithi062.stdout:(253/285): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-12T00:28:49.685 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T00:28:49.699 INFO:teuthology.orchestra.run.smithi062.stdout:(254/285): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-12T00:28:49.714 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T00:28:49.733 INFO:teuthology.orchestra.run.smithi062.stdout:(255/285): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-09-12T00:28:49.766 INFO:teuthology.orchestra.run.smithi062.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 3.2 MB/s | 220 kB 00:00 2024-09-12T00:28:49.793 INFO:teuthology.orchestra.run.smithi062.stdout:(257/285): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-12T00:28:49.817 INFO:teuthology.orchestra.run.smithi062.stdout:(258/285): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-12T00:28:49.842 INFO:teuthology.orchestra.run.smithi062.stdout:(259/285): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-12T00:28:49.855 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T00:28:49.868 INFO:teuthology.orchestra.run.smithi062.stdout:(260/285): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-09-12T00:28:49.893 INFO:teuthology.orchestra.run.smithi062.stdout:(261/285): python3-jaraco-functools-3.5.0-2.el9 779 kB/s | 19 kB 00:00 2024-09-12T00:28:49.918 INFO:teuthology.orchestra.run.smithi062.stdout:(262/285): python3-jaraco-text-3.2.0-6.el9.noar 789 kB/s | 20 kB 00:00 2024-09-12T00:28:49.992 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T00:28:50.002 INFO:teuthology.orchestra.run.smithi062.stdout:(263/285): libarrow-9.0.0-11.el9.x86_64.rpm 6.6 MB/s | 4.4 MB 00:00 2024-09-12T00:28:50.027 INFO:teuthology.orchestra.run.smithi062.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T00:28:50.036 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T00:28:50.052 INFO:teuthology.orchestra.run.smithi062.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T00:28:50.072 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T00:28:50.086 INFO:teuthology.orchestra.run.smithi062.stdout:(266/285): python3-kubernetes-26.1.0-2.el9.noar 6.1 MB/s | 1.0 MB 00:00 2024-09-12T00:28:50.100 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:28:50.111 INFO:teuthology.orchestra.run.smithi062.stdout:(267/285): python3-natsort-7.1.1-5.el9.noarch.r 987 kB/s | 58 kB 00:00 2024-09-12T00:28:50.137 INFO:teuthology.orchestra.run.smithi062.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-09-12T00:28:50.162 INFO:teuthology.orchestra.run.smithi062.stdout:(269/285): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-12T00:28:50.189 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:28:50.204 INFO:teuthology.orchestra.run.smithi062.stdout:(270/285): python3-grpcio-1.46.7-10.el9.x86_64. 4.3 MB/s | 2.0 MB 00:00 2024-09-12T00:28:50.218 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:28:50.229 INFO:teuthology.orchestra.run.smithi062.stdout:(271/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 976 kB/s | 90 kB 00:00 2024-09-12T00:28:50.254 INFO:teuthology.orchestra.run.smithi062.stdout:(272/285): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-09-12T00:28:50.279 INFO:teuthology.orchestra.run.smithi062.stdout:(273/285): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T00:28:50.281 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:28:50.304 INFO:teuthology.orchestra.run.smithi062.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 720 kB/s | 36 kB 00:00 2024-09-12T00:28:50.305 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T00:28:50.328 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:28:50.330 INFO:teuthology.orchestra.run.smithi062.stdout:(275/285): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-09-12T00:28:50.351 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:28:50.355 INFO:teuthology.orchestra.run.smithi062.stdout:(276/285): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T00:28:50.372 INFO:teuthology.orchestra.run.smithi062.stdout:(277/285): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-09-12T00:28:50.398 INFO:teuthology.orchestra.run.smithi062.stdout:(278/285): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-12T00:28:50.423 INFO:teuthology.orchestra.run.smithi062.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-09-12T00:28:50.456 INFO:teuthology.orchestra.run.smithi062.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 5.7 MB/s | 191 kB 00:00 2024-09-12T00:28:50.482 INFO:teuthology.orchestra.run.smithi062.stdout:(281/285): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-09-12T00:28:50.507 INFO:teuthology.orchestra.run.smithi062.stdout:(282/285): s3cmd-2.4.0-1.el9.noarch.rpm 2.4 MB/s | 206 kB 00:00 2024-09-12T00:28:50.548 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:28:50.557 INFO:teuthology.orchestra.run.smithi062.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T00:28:50.578 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:28:50.697 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T00:28:50.724 INFO:teuthology.orchestra.run.smithi062.stdout:(284/285): librados2-19.3.0-4753.gd011c522.el9. 14 MB/s | 3.5 MB 00:00 2024-09-12T00:28:50.734 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T00:28:50.770 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T00:28:50.870 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T00:28:50.908 INFO:teuthology.orchestra.run.smithi062.stdout:(285/285): librbd1-19.3.0-4753.gd011c522.el9.x8 8.1 MB/s | 3.2 MB 00:00 2024-09-12T00:28:50.915 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:28:50.915 INFO:teuthology.orchestra.run.smithi062.stdout:Total 23 MB/s | 327 MB 00:14 2024-09-12T00:28:50.925 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T00:28:50.973 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T00:28:51.024 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T00:28:51.049 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T00:28:51.076 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T00:28:51.101 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T00:28:51.127 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T00:28:51.155 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T00:28:51.187 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T00:28:51.220 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T00:28:51.262 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T00:28:51.293 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:28:51.364 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:28:51.420 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T00:28:51.449 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T00:28:51.493 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T00:28:51.528 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T00:28:51.561 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T00:28:51.640 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T00:28:51.679 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 51/287 2024-09-12T00:28:51.723 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 52/287 2024-09-12T00:28:51.765 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 53/287 2024-09-12T00:28:51.841 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T00:28:51.977 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T00:28:52.026 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T00:28:52.566 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T00:28:52.655 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T00:28:52.683 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T00:28:52.753 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T00:28:52.796 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T00:28:52.832 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T00:28:52.862 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T00:28:52.950 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T00:28:52.989 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T00:28:53.022 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T00:28:53.066 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T00:28:53.104 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 68/287 2024-09-12T00:28:53.136 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T00:28:53.168 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T00:28:53.210 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T00:28:53.269 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:28:53.303 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T00:28:53.340 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T00:28:53.436 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T00:28:53.672 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T00:28:53.761 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T00:28:53.791 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T00:28:53.828 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T00:28:53.874 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T00:28:53.928 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T00:28:53.970 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T00:28:54.110 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T00:28:54.164 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T00:28:54.205 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T00:28:54.214 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-09-12T00:28:54.310 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T00:28:54.346 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T00:28:54.401 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T00:28:54.423 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-09-12T00:28:54.423 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-09-12T00:28:54.428 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/287 2024-09-12T00:28:54.453 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T00:28:54.548 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T00:28:54.674 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T00:28:54.719 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T00:28:54.925 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T00:28:54.973 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T00:28:55.004 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T00:28:55.042 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T00:28:55.084 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T00:28:55.121 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:28:55.134 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:28:55.134 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T00:28:55.135 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:28:55.325 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T00:28:55.402 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T00:28:55.452 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T00:28:55.476 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:28:55.505 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:28:55.528 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T00:28:56.016 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:28:56.057 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:28:56.071 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:28:56.071 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T00:28:56.071 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:28:56.113 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T00:28:56.147 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T00:28:56.180 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T00:28:56.222 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T00:28:56.248 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T00:28:56.336 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T00:28:56.386 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T00:28:56.418 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T00:28:56.525 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T00:28:56.585 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T00:28:57.332 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T00:28:57.382 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T00:28:57.416 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T00:28:57.515 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T00:28:57.565 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T00:28:57.750 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T00:28:57.799 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T00:28:57.834 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-09-12T00:28:57.834 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-09-12T00:28:57.846 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T00:28:58.355 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T00:28:58.415 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T00:28:58.452 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T00:28:58.486 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T00:28:58.519 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T00:28:58.705 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T00:28:58.726 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T00:28:58.803 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T00:28:59.496 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T00:28:59.617 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T00:29:00.896 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T00:29:00.994 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T00:29:01.057 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T00:29:01.104 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T00:29:01.132 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T00:29:01.161 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:29:01.173 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:29:01.173 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T00:29:01.173 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:29:01.227 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T00:29:01.256 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T00:29:01.285 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T00:29:01.613 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T00:29:01.656 INFO:teuthology.orchestra.run.smithi077.stdout: Upgrading : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:29:01.755 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:29:01.788 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 145/287 2024-09-12T00:29:01.820 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T00:29:01.849 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T00:29:01.914 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T00:29:01.957 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T00:29:01.982 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T00:29:02.021 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T00:29:02.047 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:29:02.299 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:29:02.340 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T00:29:02.369 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T00:29:02.394 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T00:29:02.419 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T00:29:02.445 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T00:29:02.469 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T00:29:02.498 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T00:29:02.534 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T00:29:02.576 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T00:29:02.618 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T00:29:02.666 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T00:29:02.700 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T00:29:03.150 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T00:29:03.284 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T00:29:03.340 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T00:29:03.365 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T00:29:03.393 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T00:29:03.461 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T00:29:03.509 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T00:29:03.533 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:29:03.552 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:29:03.579 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T00:29:03.605 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T00:29:03.644 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T00:29:03.669 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:29:08.382 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T00:29:08.579 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T00:29:08.746 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-09-12T00:29:08.815 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T00:29:08.845 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T00:29:08.922 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T00:29:08.977 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T00:29:09.032 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T00:29:09.073 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T00:29:09.106 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T00:29:09.159 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T00:29:09.552 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T00:29:09.623 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:29:09.733 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:29:09.758 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:29:09.859 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:29:09.887 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:29:09.939 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T00:29:09.971 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T00:29:09.997 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T00:29:10.023 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T00:29:10.055 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T00:29:10.080 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T00:29:10.109 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T00:29:10.272 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T00:29:10.413 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T00:29:10.464 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T00:29:10.501 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T00:29:10.537 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:29:10.644 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:29:10.672 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:29:10.735 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:29:10.767 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T00:29:10.790 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:29:10.817 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:29:11.035 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:29:11.065 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:29:11.183 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T00:29:11.213 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T00:29:11.249 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T00:29:11.326 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T00:29:11.379 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T00:29:11.418 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T00:29:11.461 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T00:29:11.485 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T00:29:11.512 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T00:29:11.537 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T00:29:11.562 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T00:29:11.591 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T00:29:11.623 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T00:29:11.648 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T00:29:11.694 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T00:29:11.721 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:29:11.800 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:29:11.857 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T00:29:11.886 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T00:29:11.932 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T00:29:11.974 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T00:29:12.006 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T00:29:12.087 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T00:29:12.125 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 51/287 2024-09-12T00:29:12.168 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 52/287 2024-09-12T00:29:12.210 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 53/287 2024-09-12T00:29:12.290 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T00:29:12.447 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T00:29:12.506 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T00:29:13.091 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T00:29:13.179 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T00:29:13.220 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T00:29:13.293 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T00:29:13.343 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T00:29:13.379 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T00:29:13.408 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T00:29:13.486 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T00:29:13.536 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T00:29:13.569 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T00:29:13.604 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T00:29:13.642 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 68/287 2024-09-12T00:29:13.675 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T00:29:13.707 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T00:29:13.749 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T00:29:13.808 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:29:13.841 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T00:29:13.878 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T00:29:13.977 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T00:29:14.037 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T00:29:14.111 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T00:29:14.155 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T00:29:14.192 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T00:29:14.240 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T00:29:14.285 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T00:29:14.326 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T00:29:14.476 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T00:29:14.519 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T00:29:14.561 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T00:29:14.672 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T00:29:14.718 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T00:29:14.760 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T00:29:14.791 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/287 2024-09-12T00:29:14.793 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:29:14.816 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T00:29:14.834 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T00:29:14.862 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T00:29:14.905 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T00:29:14.906 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T00:29:14.937 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T00:29:14.973 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T00:29:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T00:29:15.091 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T00:29:15.318 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T00:29:15.362 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T00:29:15.393 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T00:29:15.423 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T00:29:15.464 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T00:29:15.492 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:29:15.505 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:29:15.506 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T00:29:15.506 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:29:15.514 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T00:29:15.545 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:29:15.625 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:29:15.655 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 184/287 2024-09-12T00:29:15.705 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T00:29:15.788 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T00:29:15.841 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T00:29:15.867 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:29:15.898 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:29:15.927 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T00:29:16.767 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:29:16.797 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:29:16.813 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:29:16.813 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T00:29:16.813 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:29:16.862 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T00:29:16.897 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T00:29:16.930 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T00:29:16.973 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T00:29:17.006 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T00:29:17.102 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T00:29:17.163 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T00:29:17.200 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T00:29:17.330 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T00:29:17.387 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T00:29:17.983 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:29:18.020 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:29:18.193 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T00:29:18.240 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T00:29:18.273 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T00:29:18.384 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T00:29:18.431 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T00:29:18.576 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:29:18.624 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:29:18.639 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T00:29:18.679 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T00:29:18.702 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:29:18.702 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T00:29:18.702 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T00:29:18.702 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:29:18.733 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:29:18.735 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T00:29:19.298 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T00:29:19.370 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T00:29:19.417 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T00:29:19.450 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T00:29:19.483 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T00:29:19.676 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T00:29:19.706 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T00:29:19.787 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T00:29:20.523 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T00:29:20.637 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T00:29:22.030 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T00:29:22.100 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T00:29:22.154 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T00:29:22.185 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T00:29:22.221 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T00:29:22.267 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:29:22.280 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:29:22.280 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T00:29:22.280 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:29:22.340 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T00:29:22.371 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T00:29:22.400 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T00:29:22.737 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T00:29:22.779 INFO:teuthology.orchestra.run.smithi062.stdout: Upgrading : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:29:22.880 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:29:22.911 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 145/287 2024-09-12T00:29:22.943 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T00:29:22.972 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T00:29:23.034 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T00:29:23.072 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T00:29:23.097 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T00:29:23.138 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T00:29:23.161 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:29:23.452 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:29:23.488 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T00:29:23.516 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T00:29:23.541 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T00:29:23.567 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T00:29:23.592 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T00:29:23.617 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T00:29:23.662 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T00:29:23.699 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T00:29:23.743 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T00:29:23.774 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T00:29:23.823 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T00:29:23.857 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T00:29:24.360 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T00:29:24.504 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T00:29:24.564 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T00:29:24.597 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T00:29:24.626 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T00:29:24.710 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T00:29:24.758 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T00:29:24.789 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:29:24.811 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:29:24.844 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T00:29:24.870 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T00:29:24.905 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T00:29:24.924 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:29:27.905 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:29:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /sys 2024-09-12T00:29:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /proc 2024-09-12T00:29:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /mnt 2024-09-12T00:29:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /var/tmp 2024-09-12T00:29:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /home 2024-09-12T00:29:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /root 2024-09-12T00:29:27.905 INFO:teuthology.orchestra.run.smithi077.stdout:skipping the directory /tmp 2024-09-12T00:29:27.905 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:29:28.081 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:29:28.096 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:29:28.097 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:29:28.097 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:29:28.097 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:29:29.553 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:29:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:29:30.352 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:29:30.352 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:29:30.352 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:29:30.352 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:29:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:29:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:29:30.352 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:29:30.352 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:29:30.353 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:29:30.353 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:29:30.353 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:29:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:29:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:29:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:29:30.353 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:29:30.353 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:29:30.353 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:29:30.353 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:29:30.353 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:29:30.391 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T00:29:33.187 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T00:29:33.291 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T00:29:33.348 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T00:29:33.404 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T00:29:33.587 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T00:29:33.645 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T00:29:33.722 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T00:29:33.811 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T00:29:33.949 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T00:29:33.987 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T00:29:34.020 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T00:29:34.880 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T00:29:34.926 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:29:35.279 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:29:35.316 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T00:29:35.347 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T00:29:35.374 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T00:29:35.409 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T00:29:35.446 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T00:29:35.473 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T00:29:35.500 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T00:29:35.525 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T00:29:35.549 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T00:29:35.576 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T00:29:35.602 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T00:29:35.628 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T00:29:35.659 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T00:29:35.686 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T00:29:35.713 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T00:29:35.749 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T00:29:35.780 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T00:29:35.814 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T00:29:35.848 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T00:29:35.876 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T00:29:35.915 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T00:29:35.957 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T00:29:36.002 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T00:29:36.033 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T00:29:36.056 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T00:29:36.109 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T00:29:36.142 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T00:29:36.172 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T00:29:36.201 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T00:29:36.227 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T00:29:36.396 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T00:29:36.427 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T00:29:36.454 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T00:29:36.490 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T00:29:36.522 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T00:29:36.657 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T00:29:36.720 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T00:29:36.789 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T00:29:36.826 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:29:36.944 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:29:37.006 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:29:37.022 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:29:37.025 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:29:37.052 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T00:29:37.067 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T00:29:37.074 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T00:29:37.103 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T00:29:37.143 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T00:29:37.178 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T00:29:37.215 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T00:29:37.505 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:29:37.536 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:29:37.553 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:29:37.553 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T00:29:37.553 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:29:37.753 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T00:29:37.777 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:29:37.778 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T00:29:37.841 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T00:29:37.859 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:29:37.888 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 184/287 2024-09-12T00:29:37.911 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T00:29:37.948 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T00:29:37.973 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T00:29:38.347 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:29:38.377 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:29:38.392 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:29:38.923 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:29:39.005 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:29:39.043 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:29:39.071 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:29:39.277 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T00:29:39.333 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T00:29:39.359 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:29:39.380 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:29:39.410 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:29:39.476 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:29:39.512 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:29:39.523 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:29:39.546 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:29:39.566 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:29:39.589 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T00:29:40.033 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:29:40.063 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:29:40.096 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 265/287 2024-09-12T00:29:40.162 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 266/287 2024-09-12T00:29:40.187 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:29:40.363 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:29:40.403 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:29:41.002 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:29:41.048 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:29:41.139 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:29:41.139 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T00:29:41.139 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T00:29:41.139 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:29:41.174 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:29:43.400 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:29:43.468 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:29:44.434 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:29:44.468 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:29:44.583 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:29:44.755 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 270/287 2024-09-12T00:29:44.812 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:29:44.835 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:29:44.835 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:29:44.835 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:29:44.836 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:29:44.836 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:29:44.836 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:29:44.887 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:29:44.899 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:29:44.922 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 273/287 2024-09-12T00:29:44.951 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T00:29:44.999 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T00:29:45.022 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:29:45.038 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:29:45.038 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T00:29:45.038 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:29:45.999 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:29:46.022 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:29:46.022 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:29:46.022 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:29:46.022 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:29:46.023 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:29:46.023 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:29:46.066 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:29:46.089 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:29:46.089 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:29:46.089 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:29:46.089 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:29:46.408 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:29:46.431 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:29:46.431 INFO:teuthology.orchestra.run.smithi077.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:29:46.432 INFO:teuthology.orchestra.run.smithi077.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:29:46.432 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:29:46.432 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:29:46.432 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:29:51.021 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:29:51.021 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /sys 2024-09-12T00:29:51.021 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /proc 2024-09-12T00:29:51.021 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /mnt 2024-09-12T00:29:51.021 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /var/tmp 2024-09-12T00:29:51.022 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /home 2024-09-12T00:29:51.022 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /root 2024-09-12T00:29:51.022 INFO:teuthology.orchestra.run.smithi062.stdout:skipping the directory /tmp 2024-09-12T00:29:51.022 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:29:51.195 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 280/287 2024-09-12T00:29:51.205 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:29:51.222 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:29:51.222 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:29:51.222 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:29:51.222 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:29:51.236 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 281/287 2024-09-12T00:29:51.268 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 282/287 2024-09-12T00:29:51.372 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 283/287 2024-09-12T00:29:51.444 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:29:51.476 INFO:teuthology.orchestra.run.smithi077.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T00:29:51.476 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:29:51.568 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:29:51.568 INFO:teuthology.orchestra.run.smithi077.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:29:51.642 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:29:51.668 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T00:29:51.674 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T00:29:51.683 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T00:29:51.693 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T00:29:51.694 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:29:51.694 INFO:teuthology.orchestra.run.smithi077.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:29:51.694 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:29:51.763 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:29:51.831 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:29:52.773 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:29:52.802 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:29:52.802 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:29:52.802 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:29:52.802 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:29:52.802 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:29:52.802 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:29:53.040 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:29:53.065 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:29:53.065 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:29:53.065 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:29:53.065 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:29:53.065 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:29:53.066 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:29:53.541 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:29:53.566 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:29:53.566 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:29:53.567 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:29:53.567 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:29:53.567 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:29:53.567 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:29:53.673 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T00:29:56.813 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T00:29:56.918 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T00:29:56.976 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T00:29:57.042 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T00:29:57.248 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T00:29:57.296 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T00:29:57.379 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T00:29:57.478 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T00:29:57.746 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T00:29:57.795 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T00:29:57.829 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T00:29:58.735 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T00:29:58.785 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:29:59.295 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:29:59.342 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T00:29:59.373 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T00:29:59.400 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T00:29:59.435 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T00:29:59.472 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T00:29:59.500 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T00:29:59.525 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T00:29:59.551 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T00:29:59.575 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T00:29:59.602 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T00:29:59.627 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T00:29:59.654 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T00:29:59.693 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T00:29:59.720 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T00:29:59.756 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T00:29:59.791 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T00:29:59.822 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T00:29:59.857 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T00:29:59.891 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T00:29:59.928 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T00:29:59.967 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T00:30:00.009 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T00:30:00.053 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T00:30:00.084 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T00:30:00.107 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T00:30:00.163 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T00:30:00.193 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T00:30:00.223 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T00:30:00.252 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T00:30:00.277 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T00:30:01.015 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T00:30:01.016 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T00:30:01.016 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T00:30:01.016 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T00:30:01.016 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T00:30:01.016 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T00:30:01.016 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T00:30:01.016 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T00:30:01.016 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:30:01.016 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:30:01.148 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:30:01.175 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:30:01.211 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T00:30:01.233 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T00:30:01.668 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:30:01.696 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:30:01.714 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:30:01.714 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T00:30:01.714 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:01.740 INFO:teuthology.orchestra.run.smithi077.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:30:01.740 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 1/287 2024-09-12T00:30:01.740 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2/287 2024-09-12T00:30:01.741 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 3/287 2024-09-12T00:30:01.741 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 4/287 2024-09-12T00:30:01.741 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 5/287 2024-09-12T00:30:01.741 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 6/287 2024-09-12T00:30:01.741 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 7/287 2024-09-12T00:30:01.741 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 8/287 2024-09-12T00:30:01.741 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 9/287 2024-09-12T00:30:01.741 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:30:01.741 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:30:01.741 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:30:01.741 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 13/287 2024-09-12T00:30:01.741 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 14/287 2024-09-12T00:30:01.741 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 15/287 2024-09-12T00:30:01.742 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 16/287 2024-09-12T00:30:01.742 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 17/287 2024-09-12T00:30:01.742 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 18/287 2024-09-12T00:30:01.742 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 19/287 2024-09-12T00:30:01.742 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 20/287 2024-09-12T00:30:01.742 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 21/287 2024-09-12T00:30:01.742 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 22/287 2024-09-12T00:30:01.742 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 23/287 2024-09-12T00:30:01.742 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:30:01.742 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 25/287 2024-09-12T00:30:01.742 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 26/287 2024-09-12T00:30:01.742 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 27/287 2024-09-12T00:30:01.742 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 28/287 2024-09-12T00:30:01.743 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 29/287 2024-09-12T00:30:01.743 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 30/287 2024-09-12T00:30:01.765 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 31/287 2024-09-12T00:30:01.765 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 32/287 2024-09-12T00:30:01.765 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 33/287 2024-09-12T00:30:01.766 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 34/287 2024-09-12T00:30:01.766 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 35/287 2024-09-12T00:30:01.766 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 36/287 2024-09-12T00:30:01.766 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T00:30:01.766 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T00:30:01.766 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T00:30:01.766 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T00:30:01.766 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T00:30:01.766 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T00:30:01.766 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T00:30:01.766 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T00:30:01.767 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T00:30:01.767 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T00:30:01.767 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T00:30:01.767 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T00:30:01.767 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T00:30:01.767 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T00:30:01.767 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T00:30:01.767 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T00:30:01.767 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T00:30:01.767 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T00:30:01.767 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T00:30:01.767 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T00:30:01.768 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T00:30:01.768 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T00:30:01.768 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T00:30:01.768 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T00:30:01.768 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T00:30:01.768 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T00:30:01.768 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T00:30:01.768 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T00:30:01.768 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T00:30:01.768 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T00:30:01.768 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T00:30:01.768 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T00:30:01.769 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T00:30:01.769 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T00:30:01.769 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T00:30:01.769 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:30:01.769 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T00:30:01.769 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T00:30:01.769 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T00:30:01.769 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T00:30:01.769 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T00:30:01.769 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T00:30:01.769 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T00:30:01.769 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T00:30:01.770 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T00:30:01.770 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T00:30:01.770 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T00:30:01.770 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T00:30:01.770 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T00:30:01.770 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T00:30:01.770 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T00:30:01.770 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T00:30:01.770 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T00:30:01.770 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T00:30:01.770 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T00:30:01.770 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T00:30:01.770 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T00:30:01.771 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T00:30:01.771 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T00:30:01.771 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T00:30:01.771 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T00:30:01.771 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T00:30:01.771 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T00:30:01.771 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T00:30:01.771 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T00:30:01.771 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T00:30:01.771 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T00:30:01.771 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T00:30:01.771 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T00:30:01.772 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T00:30:01.772 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T00:30:01.772 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T00:30:01.772 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T00:30:01.772 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T00:30:01.772 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T00:30:01.772 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T00:30:01.772 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T00:30:01.772 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T00:30:01.772 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T00:30:01.772 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T00:30:01.772 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T00:30:01.773 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T00:30:01.773 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T00:30:01.773 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T00:30:01.773 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T00:30:01.773 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T00:30:01.773 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T00:30:01.773 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T00:30:01.773 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T00:30:01.773 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T00:30:01.773 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T00:30:01.773 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T00:30:01.773 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T00:30:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T00:30:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T00:30:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T00:30:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T00:30:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T00:30:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T00:30:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T00:30:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T00:30:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T00:30:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T00:30:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T00:30:01.774 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T00:30:01.775 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T00:30:01.775 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T00:30:01.775 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T00:30:01.775 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T00:30:01.775 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T00:30:01.775 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T00:30:01.775 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T00:30:01.775 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T00:30:01.775 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T00:30:01.775 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T00:30:01.775 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T00:30:01.775 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T00:30:01.776 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T00:30:01.776 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T00:30:01.776 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T00:30:01.778 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T00:30:01.778 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T00:30:01.778 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T00:30:01.779 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T00:30:01.779 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T00:30:01.779 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T00:30:01.779 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T00:30:01.779 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T00:30:01.779 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T00:30:01.779 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T00:30:01.779 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T00:30:01.779 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T00:30:01.779 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T00:30:01.779 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T00:30:01.779 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T00:30:01.780 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T00:30:01.780 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T00:30:01.780 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T00:30:01.780 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T00:30:01.780 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T00:30:01.780 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T00:30:01.780 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T00:30:01.780 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T00:30:01.780 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T00:30:01.780 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T00:30:01.780 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T00:30:01.780 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T00:30:01.781 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T00:30:01.781 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T00:30:01.781 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T00:30:01.781 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T00:30:01.781 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T00:30:01.781 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T00:30:01.781 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T00:30:01.781 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T00:30:01.781 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T00:30:01.781 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T00:30:01.781 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T00:30:01.781 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T00:30:01.782 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T00:30:01.782 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T00:30:01.782 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T00:30:01.782 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T00:30:01.782 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T00:30:01.782 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T00:30:01.782 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T00:30:01.782 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T00:30:01.782 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T00:30:01.782 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T00:30:01.782 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T00:30:01.782 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T00:30:01.782 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T00:30:01.783 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T00:30:01.783 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T00:30:01.783 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T00:30:01.783 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T00:30:01.783 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T00:30:01.783 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T00:30:01.783 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T00:30:01.783 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T00:30:01.783 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T00:30:01.783 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T00:30:01.783 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T00:30:01.784 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T00:30:01.784 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T00:30:01.784 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T00:30:01.784 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T00:30:01.784 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T00:30:01.784 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T00:30:01.784 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T00:30:01.784 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T00:30:01.784 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T00:30:01.784 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T00:30:01.784 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T00:30:01.784 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T00:30:01.784 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T00:30:01.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T00:30:01.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T00:30:01.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T00:30:01.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T00:30:01.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T00:30:01.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T00:30:01.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T00:30:01.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T00:30:01.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T00:30:01.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T00:30:01.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 243/287 2024-09-12T00:30:01.785 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T00:30:01.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T00:30:01.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T00:30:01.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T00:30:01.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T00:30:01.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T00:30:01.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T00:30:01.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T00:30:01.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T00:30:01.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T00:30:01.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T00:30:01.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T00:30:01.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T00:30:01.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T00:30:01.786 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T00:30:01.787 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T00:30:01.787 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T00:30:01.787 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T00:30:01.787 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T00:30:01.787 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T00:30:01.787 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T00:30:01.787 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T00:30:01.787 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T00:30:01.787 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T00:30:01.787 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T00:30:01.787 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T00:30:01.787 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T00:30:01.788 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T00:30:01.788 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T00:30:01.788 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T00:30:01.788 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T00:30:01.788 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T00:30:01.788 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T00:30:01.788 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T00:30:01.788 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T00:30:01.788 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T00:30:01.788 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T00:30:01.788 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T00:30:01.788 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T00:30:01.788 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T00:30:01.788 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:30:01.789 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T00:30:01.789 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 286/287 2024-09-12T00:30:01.952 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T00:30:02.032 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T00:30:02.082 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T00:30:02.118 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T00:30:02.143 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T00:30:02.569 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:30:02.606 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:30:02.624 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:30:03.232 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:30:03.323 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:30:03.363 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:30:03.394 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:30:03.613 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T00:30:03.672 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T00:30:03.697 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:30:03.720 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:30:03.747 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:30:03.820 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:30:03.850 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:30:03.862 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:30:03.892 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:30:03.918 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:30:03.943 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T00:30:04.399 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:30:04.424 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:30:04.459 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 265/287 2024-09-12T00:30:04.530 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 266/287 2024-09-12T00:30:04.566 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:30:05.363 INFO:teuthology.orchestra.run.smithi077.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:30:05.364 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:05.364 INFO:teuthology.orchestra.run.smithi077.stdout:Upgraded: 2024-09-12T00:30:05.364 INFO:teuthology.orchestra.run.smithi077.stdout: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.364 INFO:teuthology.orchestra.run.smithi077.stdout: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.364 INFO:teuthology.orchestra.run.smithi077.stdout:Installed: 2024-09-12T00:30:05.364 INFO:teuthology.orchestra.run.smithi077.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T00:30:05.364 INFO:teuthology.orchestra.run.smithi077.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:30:05.364 INFO:teuthology.orchestra.run.smithi077.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T00:30:05.364 INFO:teuthology.orchestra.run.smithi077.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T00:30:05.364 INFO:teuthology.orchestra.run.smithi077.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T00:30:05.364 INFO:teuthology.orchestra.run.smithi077.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T00:30:05.365 INFO:teuthology.orchestra.run.smithi077.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T00:30:05.365 INFO:teuthology.orchestra.run.smithi077.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T00:30:05.365 INFO:teuthology.orchestra.run.smithi077.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T00:30:05.365 INFO:teuthology.orchestra.run.smithi077.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T00:30:05.365 INFO:teuthology.orchestra.run.smithi077.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T00:30:05.365 INFO:teuthology.orchestra.run.smithi077.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T00:30:05.365 INFO:teuthology.orchestra.run.smithi077.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T00:30:05.365 INFO:teuthology.orchestra.run.smithi077.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T00:30:05.365 INFO:teuthology.orchestra.run.smithi077.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T00:30:05.365 INFO:teuthology.orchestra.run.smithi077.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:30:05.365 INFO:teuthology.orchestra.run.smithi077.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T00:30:05.365 INFO:teuthology.orchestra.run.smithi077.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T00:30:05.366 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.366 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.366 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.366 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.366 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-grafana-dashboards-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:05.366 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-immutable-object-cache-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.366 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.366 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.366 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:05.366 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:05.366 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:05.366 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:05.366 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:05.367 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.367 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.367 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:05.367 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.367 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.367 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.367 INFO:teuthology.orchestra.run.smithi077.stdout: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:05.367 INFO:teuthology.orchestra.run.smithi077.stdout: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:05.367 INFO:teuthology.orchestra.run.smithi077.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T00:30:05.367 INFO:teuthology.orchestra.run.smithi077.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T00:30:05.367 INFO:teuthology.orchestra.run.smithi077.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T00:30:05.368 INFO:teuthology.orchestra.run.smithi077.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T00:30:05.368 INFO:teuthology.orchestra.run.smithi077.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T00:30:05.368 INFO:teuthology.orchestra.run.smithi077.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T00:30:05.368 INFO:teuthology.orchestra.run.smithi077.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T00:30:05.368 INFO:teuthology.orchestra.run.smithi077.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T00:30:05.368 INFO:teuthology.orchestra.run.smithi077.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T00:30:05.368 INFO:teuthology.orchestra.run.smithi077.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T00:30:05.368 INFO:teuthology.orchestra.run.smithi077.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T00:30:05.368 INFO:teuthology.orchestra.run.smithi077.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T00:30:05.368 INFO:teuthology.orchestra.run.smithi077.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T00:30:05.368 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:30:05.368 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:30:05.368 INFO:teuthology.orchestra.run.smithi077.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:30:05.369 INFO:teuthology.orchestra.run.smithi077.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:30:05.369 INFO:teuthology.orchestra.run.smithi077.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T00:30:05.369 INFO:teuthology.orchestra.run.smithi077.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T00:30:05.369 INFO:teuthology.orchestra.run.smithi077.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T00:30:05.369 INFO:teuthology.orchestra.run.smithi077.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T00:30:05.369 INFO:teuthology.orchestra.run.smithi077.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:30:05.369 INFO:teuthology.orchestra.run.smithi077.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T00:30:05.369 INFO:teuthology.orchestra.run.smithi077.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:30:05.369 INFO:teuthology.orchestra.run.smithi077.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T00:30:05.369 INFO:teuthology.orchestra.run.smithi077.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T00:30:05.370 INFO:teuthology.orchestra.run.smithi077.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T00:30:05.370 INFO:teuthology.orchestra.run.smithi077.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T00:30:05.370 INFO:teuthology.orchestra.run.smithi077.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T00:30:05.370 INFO:teuthology.orchestra.run.smithi077.stdout: guava-30.1-6.el9.noarch 2024-09-12T00:30:05.370 INFO:teuthology.orchestra.run.smithi077.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T00:30:05.370 INFO:teuthology.orchestra.run.smithi077.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T00:30:05.370 INFO:teuthology.orchestra.run.smithi077.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T00:30:05.370 INFO:teuthology.orchestra.run.smithi077.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T00:30:05.370 INFO:teuthology.orchestra.run.smithi077.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T00:30:05.370 INFO:teuthology.orchestra.run.smithi077.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T00:30:05.371 INFO:teuthology.orchestra.run.smithi077.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:30:05.371 INFO:teuthology.orchestra.run.smithi077.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:30:05.371 INFO:teuthology.orchestra.run.smithi077.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:30:05.371 INFO:teuthology.orchestra.run.smithi077.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T00:30:05.371 INFO:teuthology.orchestra.run.smithi077.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T00:30:05.371 INFO:teuthology.orchestra.run.smithi077.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T00:30:05.371 INFO:teuthology.orchestra.run.smithi077.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T00:30:05.371 INFO:teuthology.orchestra.run.smithi077.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T00:30:05.371 INFO:teuthology.orchestra.run.smithi077.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T00:30:05.371 INFO:teuthology.orchestra.run.smithi077.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T00:30:05.371 INFO:teuthology.orchestra.run.smithi077.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T00:30:05.371 INFO:teuthology.orchestra.run.smithi077.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T00:30:05.371 INFO:teuthology.orchestra.run.smithi077.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T00:30:05.372 INFO:teuthology.orchestra.run.smithi077.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T00:30:05.372 INFO:teuthology.orchestra.run.smithi077.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T00:30:05.372 INFO:teuthology.orchestra.run.smithi077.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T00:30:05.372 INFO:teuthology.orchestra.run.smithi077.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T00:30:05.372 INFO:teuthology.orchestra.run.smithi077.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T00:30:05.372 INFO:teuthology.orchestra.run.smithi077.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T00:30:05.372 INFO:teuthology.orchestra.run.smithi077.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T00:30:05.372 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:30:05.372 INFO:teuthology.orchestra.run.smithi077.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:30:05.372 INFO:teuthology.orchestra.run.smithi077.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T00:30:05.372 INFO:teuthology.orchestra.run.smithi077.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T00:30:05.372 INFO:teuthology.orchestra.run.smithi077.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T00:30:05.372 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.373 INFO:teuthology.orchestra.run.smithi077.stdout: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.373 INFO:teuthology.orchestra.run.smithi077.stdout: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.373 INFO:teuthology.orchestra.run.smithi077.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T00:30:05.373 INFO:teuthology.orchestra.run.smithi077.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T00:30:05.373 INFO:teuthology.orchestra.run.smithi077.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T00:30:05.373 INFO:teuthology.orchestra.run.smithi077.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T00:30:05.373 INFO:teuthology.orchestra.run.smithi077.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T00:30:05.373 INFO:teuthology.orchestra.run.smithi077.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:30:05.373 INFO:teuthology.orchestra.run.smithi077.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T00:30:05.373 INFO:teuthology.orchestra.run.smithi077.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T00:30:05.373 INFO:teuthology.orchestra.run.smithi077.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T00:30:05.373 INFO:teuthology.orchestra.run.smithi077.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T00:30:05.373 INFO:teuthology.orchestra.run.smithi077.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T00:30:05.374 INFO:teuthology.orchestra.run.smithi077.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T00:30:05.374 INFO:teuthology.orchestra.run.smithi077.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T00:30:05.374 INFO:teuthology.orchestra.run.smithi077.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T00:30:05.374 INFO:teuthology.orchestra.run.smithi077.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:30:05.374 INFO:teuthology.orchestra.run.smithi077.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T00:30:05.374 INFO:teuthology.orchestra.run.smithi077.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T00:30:05.374 INFO:teuthology.orchestra.run.smithi077.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T00:30:05.374 INFO:teuthology.orchestra.run.smithi077.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:30:05.374 INFO:teuthology.orchestra.run.smithi077.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:30:05.374 INFO:teuthology.orchestra.run.smithi077.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:30:05.374 INFO:teuthology.orchestra.run.smithi077.stdout: librados-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.374 INFO:teuthology.orchestra.run.smithi077.stdout: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.375 INFO:teuthology.orchestra.run.smithi077.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:30:05.375 INFO:teuthology.orchestra.run.smithi077.stdout: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.375 INFO:teuthology.orchestra.run.smithi077.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T00:30:05.375 INFO:teuthology.orchestra.run.smithi077.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T00:30:05.375 INFO:teuthology.orchestra.run.smithi077.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T00:30:05.375 INFO:teuthology.orchestra.run.smithi077.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T00:30:05.375 INFO:teuthology.orchestra.run.smithi077.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T00:30:05.375 INFO:teuthology.orchestra.run.smithi077.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T00:30:05.375 INFO:teuthology.orchestra.run.smithi077.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:30:05.375 INFO:teuthology.orchestra.run.smithi077.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T00:30:05.375 INFO:teuthology.orchestra.run.smithi077.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T00:30:05.375 INFO:teuthology.orchestra.run.smithi077.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T00:30:05.375 INFO:teuthology.orchestra.run.smithi077.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T00:30:05.376 INFO:teuthology.orchestra.run.smithi077.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T00:30:05.376 INFO:teuthology.orchestra.run.smithi077.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T00:30:05.376 INFO:teuthology.orchestra.run.smithi077.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T00:30:05.376 INFO:teuthology.orchestra.run.smithi077.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T00:30:05.376 INFO:teuthology.orchestra.run.smithi077.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T00:30:05.376 INFO:teuthology.orchestra.run.smithi077.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T00:30:05.376 INFO:teuthology.orchestra.run.smithi077.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T00:30:05.376 INFO:teuthology.orchestra.run.smithi077.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:30:05.376 INFO:teuthology.orchestra.run.smithi077.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:30:05.376 INFO:teuthology.orchestra.run.smithi077.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:30:05.376 INFO:teuthology.orchestra.run.smithi077.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T00:30:05.376 INFO:teuthology.orchestra.run.smithi077.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:30:05.376 INFO:teuthology.orchestra.run.smithi077.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T00:30:05.377 INFO:teuthology.orchestra.run.smithi077.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T00:30:05.377 INFO:teuthology.orchestra.run.smithi077.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T00:30:05.377 INFO:teuthology.orchestra.run.smithi077.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T00:30:05.377 INFO:teuthology.orchestra.run.smithi077.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T00:30:05.377 INFO:teuthology.orchestra.run.smithi077.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T00:30:05.377 INFO:teuthology.orchestra.run.smithi077.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T00:30:05.377 INFO:teuthology.orchestra.run.smithi077.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T00:30:05.377 INFO:teuthology.orchestra.run.smithi077.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T00:30:05.377 INFO:teuthology.orchestra.run.smithi077.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T00:30:05.377 INFO:teuthology.orchestra.run.smithi077.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T00:30:05.377 INFO:teuthology.orchestra.run.smithi077.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T00:30:05.377 INFO:teuthology.orchestra.run.smithi077.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T00:30:05.378 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:30:05.378 INFO:teuthology.orchestra.run.smithi077.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:30:05.378 INFO:teuthology.orchestra.run.smithi077.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T00:30:05.379 INFO:teuthology.orchestra.run.smithi077.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T00:30:05.379 INFO:teuthology.orchestra.run.smithi077.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T00:30:05.379 INFO:teuthology.orchestra.run.smithi077.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T00:30:05.379 INFO:teuthology.orchestra.run.smithi077.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T00:30:05.379 INFO:teuthology.orchestra.run.smithi077.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T00:30:05.379 INFO:teuthology.orchestra.run.smithi077.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T00:30:05.379 INFO:teuthology.orchestra.run.smithi077.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:30:05.379 INFO:teuthology.orchestra.run.smithi077.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T00:30:05.379 INFO:teuthology.orchestra.run.smithi077.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T00:30:05.379 INFO:teuthology.orchestra.run.smithi077.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T00:30:05.379 INFO:teuthology.orchestra.run.smithi077.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T00:30:05.379 INFO:teuthology.orchestra.run.smithi077.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T00:30:05.379 INFO:teuthology.orchestra.run.smithi077.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T00:30:05.380 INFO:teuthology.orchestra.run.smithi077.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T00:30:05.380 INFO:teuthology.orchestra.run.smithi077.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T00:30:05.380 INFO:teuthology.orchestra.run.smithi077.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T00:30:05.380 INFO:teuthology.orchestra.run.smithi077.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T00:30:05.380 INFO:teuthology.orchestra.run.smithi077.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T00:30:05.380 INFO:teuthology.orchestra.run.smithi077.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T00:30:05.380 INFO:teuthology.orchestra.run.smithi077.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T00:30:05.380 INFO:teuthology.orchestra.run.smithi077.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T00:30:05.380 INFO:teuthology.orchestra.run.smithi077.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T00:30:05.380 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:30:05.380 INFO:teuthology.orchestra.run.smithi077.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:30:05.380 INFO:teuthology.orchestra.run.smithi077.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T00:30:05.381 INFO:teuthology.orchestra.run.smithi077.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T00:30:05.381 INFO:teuthology.orchestra.run.smithi077.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:30:05.381 INFO:teuthology.orchestra.run.smithi077.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:30:05.381 INFO:teuthology.orchestra.run.smithi077.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:30:05.381 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:30:05.381 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-argparse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.381 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.381 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.381 INFO:teuthology.orchestra.run.smithi077.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:30:05.381 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:30:05.381 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:30:05.381 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:30:05.382 INFO:teuthology.orchestra.run.smithi077.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:30:05.382 INFO:teuthology.orchestra.run.smithi077.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:30:05.382 INFO:teuthology.orchestra.run.smithi077.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:30:05.382 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:30:05.382 INFO:teuthology.orchestra.run.smithi077.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:30:05.382 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:30:05.382 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:30:05.382 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:30:05.382 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:30:05.382 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:30:05.382 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:30:05.382 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:30:05.383 INFO:teuthology.orchestra.run.smithi077.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:30:05.383 INFO:teuthology.orchestra.run.smithi077.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:30:05.383 INFO:teuthology.orchestra.run.smithi077.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:30:05.383 INFO:teuthology.orchestra.run.smithi077.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:30:05.383 INFO:teuthology.orchestra.run.smithi077.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:30:05.383 INFO:teuthology.orchestra.run.smithi077.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:30:05.383 INFO:teuthology.orchestra.run.smithi077.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:30:05.383 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:30:05.383 INFO:teuthology.orchestra.run.smithi077.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:30:05.383 INFO:teuthology.orchestra.run.smithi077.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:30:05.383 INFO:teuthology.orchestra.run.smithi077.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:30:05.383 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:30:05.384 INFO:teuthology.orchestra.run.smithi077.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:30:05.384 INFO:teuthology.orchestra.run.smithi077.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:30:05.384 INFO:teuthology.orchestra.run.smithi077.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:30:05.384 INFO:teuthology.orchestra.run.smithi077.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:30:05.384 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:30:05.384 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:30:05.384 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:30:05.384 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:30:05.384 INFO:teuthology.orchestra.run.smithi077.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:30:05.384 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.384 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.384 INFO:teuthology.orchestra.run.smithi077.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:30:05.385 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:30:05.385 INFO:teuthology.orchestra.run.smithi077.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:30:05.385 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.385 INFO:teuthology.orchestra.run.smithi077.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:30:05.385 INFO:teuthology.orchestra.run.smithi077.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:30:05.385 INFO:teuthology.orchestra.run.smithi077.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:30:05.385 INFO:teuthology.orchestra.run.smithi077.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:30:05.385 INFO:teuthology.orchestra.run.smithi077.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:30:05.385 INFO:teuthology.orchestra.run.smithi077.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:30:05.385 INFO:teuthology.orchestra.run.smithi077.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:30:05.385 INFO:teuthology.orchestra.run.smithi077.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:30:05.385 INFO:teuthology.orchestra.run.smithi077.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:30:05.385 INFO:teuthology.orchestra.run.smithi077.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:30:05.386 INFO:teuthology.orchestra.run.smithi077.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:30:05.386 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:30:05.386 INFO:teuthology.orchestra.run.smithi077.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:30:05.386 INFO:teuthology.orchestra.run.smithi077.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:30:05.386 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.386 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.386 INFO:teuthology.orchestra.run.smithi077.stdout: rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:05.386 INFO:teuthology.orchestra.run.smithi077.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:30:05.386 INFO:teuthology.orchestra.run.smithi077.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T00:30:05.386 INFO:teuthology.orchestra.run.smithi077.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T00:30:05.386 INFO:teuthology.orchestra.run.smithi077.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T00:30:05.386 INFO:teuthology.orchestra.run.smithi077.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T00:30:05.387 INFO:teuthology.orchestra.run.smithi077.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:30:05.387 INFO:teuthology.orchestra.run.smithi077.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T00:30:05.387 INFO:teuthology.orchestra.run.smithi077.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:30:05.387 INFO:teuthology.orchestra.run.smithi077.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T00:30:05.387 INFO:teuthology.orchestra.run.smithi077.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T00:30:05.387 INFO:teuthology.orchestra.run.smithi077.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T00:30:05.387 INFO:teuthology.orchestra.run.smithi077.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T00:30:05.387 INFO:teuthology.orchestra.run.smithi077.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T00:30:05.387 INFO:teuthology.orchestra.run.smithi077.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T00:30:05.387 INFO:teuthology.orchestra.run.smithi077.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T00:30:05.387 INFO:teuthology.orchestra.run.smithi077.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T00:30:05.387 INFO:teuthology.orchestra.run.smithi077.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T00:30:05.388 INFO:teuthology.orchestra.run.smithi077.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T00:30:05.388 INFO:teuthology.orchestra.run.smithi077.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T00:30:05.388 INFO:teuthology.orchestra.run.smithi077.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T00:30:05.388 INFO:teuthology.orchestra.run.smithi077.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T00:30:05.388 INFO:teuthology.orchestra.run.smithi077.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:30:05.388 INFO:teuthology.orchestra.run.smithi077.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T00:30:05.389 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:05.389 INFO:teuthology.orchestra.run.smithi077.stdout:Complete! 2024-09-12T00:30:05.779 DEBUG:teuthology.parallel:result is None 2024-09-12T00:30:07.992 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:30:08.055 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:30:09.071 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:30:09.105 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:30:09.229 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:30:09.400 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 270/287 2024-09-12T00:30:09.432 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:30:09.457 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:30:09.457 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:30:09.457 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:30:09.457 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:30:09.458 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:30:09.458 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:09.508 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:30:09.520 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:30:09.542 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 273/287 2024-09-12T00:30:09.572 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T00:30:09.621 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T00:30:09.652 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:30:09.669 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:30:09.669 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T00:30:09.669 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:10.696 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:30:10.723 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:30:10.723 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:30:10.723 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:30:10.724 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:30:10.724 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:30:10.724 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:10.764 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:30:10.789 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:30:10.789 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:30:10.789 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:30:10.789 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:11.124 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:30:11.149 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:30:11.149 INFO:teuthology.orchestra.run.smithi062.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:30:11.149 INFO:teuthology.orchestra.run.smithi062.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:30:11.149 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:30:11.150 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:30:11.150 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:16.111 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 280/287 2024-09-12T00:30:16.153 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 281/287 2024-09-12T00:30:16.192 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 282/287 2024-09-12T00:30:16.301 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 283/287 2024-09-12T00:30:16.363 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:30:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T00:30:16.400 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:30:16.476 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:30:16.476 INFO:teuthology.orchestra.run.smithi062.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:30:16.559 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:30:16.583 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T00:30:16.590 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T00:30:16.600 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T00:30:16.611 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T00:30:16.611 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:30:16.611 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:30:16.611 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:16.667 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:30:16.742 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:30:26.725 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:30:26.725 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 1/287 2024-09-12T00:30:26.726 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2/287 2024-09-12T00:30:26.726 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 3/287 2024-09-12T00:30:26.726 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 4/287 2024-09-12T00:30:26.726 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 5/287 2024-09-12T00:30:26.726 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 6/287 2024-09-12T00:30:26.726 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 7/287 2024-09-12T00:30:26.726 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 8/287 2024-09-12T00:30:26.726 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 9/287 2024-09-12T00:30:26.726 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:30:26.726 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:30:26.727 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:30:26.727 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 13/287 2024-09-12T00:30:26.727 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 14/287 2024-09-12T00:30:26.727 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 15/287 2024-09-12T00:30:26.727 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 16/287 2024-09-12T00:30:26.727 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 17/287 2024-09-12T00:30:26.727 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 18/287 2024-09-12T00:30:26.727 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 19/287 2024-09-12T00:30:26.727 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 20/287 2024-09-12T00:30:26.728 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 21/287 2024-09-12T00:30:26.728 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 22/287 2024-09-12T00:30:26.728 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 23/287 2024-09-12T00:30:26.728 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:30:26.728 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 25/287 2024-09-12T00:30:26.728 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 26/287 2024-09-12T00:30:26.728 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 27/287 2024-09-12T00:30:26.753 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 28/287 2024-09-12T00:30:26.753 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 29/287 2024-09-12T00:30:26.753 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 30/287 2024-09-12T00:30:26.753 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 31/287 2024-09-12T00:30:26.754 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 32/287 2024-09-12T00:30:26.754 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 33/287 2024-09-12T00:30:26.754 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 34/287 2024-09-12T00:30:26.754 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 35/287 2024-09-12T00:30:26.754 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 36/287 2024-09-12T00:30:26.754 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T00:30:26.754 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T00:30:26.754 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T00:30:26.754 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T00:30:26.754 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T00:30:26.754 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T00:30:26.754 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T00:30:26.755 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T00:30:26.755 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T00:30:26.755 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T00:30:26.755 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T00:30:26.755 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T00:30:26.755 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T00:30:26.756 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T00:30:26.756 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T00:30:26.756 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T00:30:26.756 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T00:30:26.756 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T00:30:26.756 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T00:30:26.756 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T00:30:26.756 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T00:30:26.756 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T00:30:26.756 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T00:30:26.756 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T00:30:26.756 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T00:30:26.757 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T00:30:26.757 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T00:30:26.757 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T00:30:26.757 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T00:30:26.757 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T00:30:26.757 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T00:30:26.757 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T00:30:26.757 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T00:30:26.757 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T00:30:26.757 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T00:30:26.757 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:30:26.757 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T00:30:26.757 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T00:30:26.758 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T00:30:26.758 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T00:30:26.758 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T00:30:26.758 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T00:30:26.758 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T00:30:26.758 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T00:30:26.758 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T00:30:26.758 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T00:30:26.758 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T00:30:26.758 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T00:30:26.758 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T00:30:26.758 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T00:30:26.759 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T00:30:26.759 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T00:30:26.759 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T00:30:26.759 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T00:30:26.759 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T00:30:26.759 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T00:30:26.759 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T00:30:26.759 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T00:30:26.759 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T00:30:26.759 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T00:30:26.759 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T00:30:26.759 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T00:30:26.759 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T00:30:26.760 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T00:30:26.760 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T00:30:26.760 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T00:30:26.760 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T00:30:26.760 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T00:30:26.760 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T00:30:26.760 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T00:30:26.760 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T00:30:26.760 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T00:30:26.760 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T00:30:26.760 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T00:30:26.761 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T00:30:26.761 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T00:30:26.761 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T00:30:26.761 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T00:30:26.761 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T00:30:26.761 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T00:30:26.761 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T00:30:26.761 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T00:30:26.761 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T00:30:26.761 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T00:30:26.761 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T00:30:26.761 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T00:30:26.761 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T00:30:26.762 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T00:30:26.762 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T00:30:26.762 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T00:30:26.762 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T00:30:26.762 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T00:30:26.762 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T00:30:26.762 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T00:30:26.762 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T00:30:26.762 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T00:30:26.762 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T00:30:26.762 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T00:30:26.762 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T00:30:26.762 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T00:30:26.763 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T00:30:26.763 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T00:30:26.763 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T00:30:26.763 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T00:30:26.763 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T00:30:26.763 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T00:30:26.763 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T00:30:26.763 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T00:30:26.763 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T00:30:26.763 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T00:30:26.763 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T00:30:26.764 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T00:30:26.764 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T00:30:26.764 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T00:30:26.764 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T00:30:26.764 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T00:30:26.764 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T00:30:26.764 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T00:30:26.764 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T00:30:26.764 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T00:30:26.765 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T00:30:26.765 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T00:30:26.765 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T00:30:26.765 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T00:30:26.765 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T00:30:26.765 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T00:30:26.765 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T00:30:26.765 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T00:30:26.765 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T00:30:26.765 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T00:30:26.765 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T00:30:26.765 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T00:30:26.766 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T00:30:26.766 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T00:30:26.766 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T00:30:26.766 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T00:30:26.766 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T00:30:26.766 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T00:30:26.766 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T00:30:26.766 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T00:30:26.766 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T00:30:26.766 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T00:30:26.766 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T00:30:26.766 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T00:30:26.766 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T00:30:26.767 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T00:30:26.767 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T00:30:26.767 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T00:30:26.767 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T00:30:26.767 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T00:30:26.767 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T00:30:26.767 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T00:30:26.767 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T00:30:26.767 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T00:30:26.767 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T00:30:26.767 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T00:30:26.767 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T00:30:26.768 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T00:30:26.768 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T00:30:26.768 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T00:30:26.768 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T00:30:26.768 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T00:30:26.768 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T00:30:26.768 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T00:30:26.768 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T00:30:26.768 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T00:30:26.768 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T00:30:26.768 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T00:30:26.768 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T00:30:26.769 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T00:30:26.769 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T00:30:26.769 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T00:30:26.769 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T00:30:26.770 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T00:30:26.770 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T00:30:26.770 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T00:30:26.770 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T00:30:26.770 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T00:30:26.770 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T00:30:26.770 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T00:30:26.770 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T00:30:26.770 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T00:30:26.770 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T00:30:26.770 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T00:30:26.770 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T00:30:26.771 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T00:30:26.771 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T00:30:26.771 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T00:30:26.771 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T00:30:26.771 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T00:30:26.771 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T00:30:26.771 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T00:30:26.771 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T00:30:26.771 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T00:30:26.771 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T00:30:26.771 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T00:30:26.771 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T00:30:26.772 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T00:30:26.772 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T00:30:26.772 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T00:30:26.772 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T00:30:26.772 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T00:30:26.772 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T00:30:26.772 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T00:30:26.772 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T00:30:26.772 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T00:30:26.772 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 243/287 2024-09-12T00:30:26.772 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T00:30:26.772 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T00:30:26.772 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T00:30:26.773 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T00:30:26.773 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T00:30:26.773 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T00:30:26.773 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T00:30:26.773 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T00:30:26.773 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T00:30:26.773 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T00:30:26.773 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T00:30:26.773 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T00:30:26.773 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T00:30:26.773 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T00:30:26.773 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T00:30:26.773 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T00:30:26.774 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T00:30:26.774 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T00:30:26.774 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T00:30:26.774 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T00:30:26.774 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T00:30:26.774 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T00:30:26.774 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T00:30:26.774 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T00:30:26.774 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T00:30:26.774 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T00:30:26.774 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T00:30:26.774 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T00:30:26.774 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T00:30:26.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T00:30:26.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T00:30:26.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T00:30:26.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T00:30:26.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T00:30:26.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T00:30:26.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T00:30:26.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T00:30:26.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T00:30:26.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T00:30:26.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T00:30:26.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:30:26.775 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T00:30:26.776 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 286/287 2024-09-12T00:30:30.004 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:30:30.004 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:30.005 INFO:teuthology.orchestra.run.smithi062.stdout:Upgraded: 2024-09-12T00:30:30.005 INFO:teuthology.orchestra.run.smithi062.stdout: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.005 INFO:teuthology.orchestra.run.smithi062.stdout: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.005 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-09-12T00:30:30.005 INFO:teuthology.orchestra.run.smithi062.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T00:30:30.005 INFO:teuthology.orchestra.run.smithi062.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:30:30.005 INFO:teuthology.orchestra.run.smithi062.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T00:30:30.005 INFO:teuthology.orchestra.run.smithi062.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T00:30:30.006 INFO:teuthology.orchestra.run.smithi062.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T00:30:30.006 INFO:teuthology.orchestra.run.smithi062.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T00:30:30.006 INFO:teuthology.orchestra.run.smithi062.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T00:30:30.006 INFO:teuthology.orchestra.run.smithi062.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T00:30:30.006 INFO:teuthology.orchestra.run.smithi062.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T00:30:30.006 INFO:teuthology.orchestra.run.smithi062.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T00:30:30.006 INFO:teuthology.orchestra.run.smithi062.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T00:30:30.006 INFO:teuthology.orchestra.run.smithi062.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T00:30:30.006 INFO:teuthology.orchestra.run.smithi062.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T00:30:30.006 INFO:teuthology.orchestra.run.smithi062.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T00:30:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T00:30:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:30:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T00:30:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T00:30:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-grafana-dashboards-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-immutable-object-cache-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.007 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.008 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.009 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:30.009 INFO:teuthology.orchestra.run.smithi062.stdout: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:30:30.009 INFO:teuthology.orchestra.run.smithi062.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T00:30:30.009 INFO:teuthology.orchestra.run.smithi062.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T00:30:30.009 INFO:teuthology.orchestra.run.smithi062.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T00:30:30.009 INFO:teuthology.orchestra.run.smithi062.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T00:30:30.009 INFO:teuthology.orchestra.run.smithi062.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T00:30:30.009 INFO:teuthology.orchestra.run.smithi062.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T00:30:30.009 INFO:teuthology.orchestra.run.smithi062.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T00:30:30.009 INFO:teuthology.orchestra.run.smithi062.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T00:30:30.009 INFO:teuthology.orchestra.run.smithi062.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T00:30:30.009 INFO:teuthology.orchestra.run.smithi062.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T00:30:30.010 INFO:teuthology.orchestra.run.smithi062.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T00:30:30.010 INFO:teuthology.orchestra.run.smithi062.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T00:30:30.010 INFO:teuthology.orchestra.run.smithi062.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T00:30:30.010 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:30:30.010 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:30:30.010 INFO:teuthology.orchestra.run.smithi062.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:30:30.010 INFO:teuthology.orchestra.run.smithi062.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:30:30.010 INFO:teuthology.orchestra.run.smithi062.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T00:30:30.010 INFO:teuthology.orchestra.run.smithi062.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T00:30:30.010 INFO:teuthology.orchestra.run.smithi062.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T00:30:30.010 INFO:teuthology.orchestra.run.smithi062.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T00:30:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:30:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T00:30:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:30:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T00:30:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T00:30:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T00:30:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T00:30:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T00:30:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: guava-30.1-6.el9.noarch 2024-09-12T00:30:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T00:30:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T00:30:30.011 INFO:teuthology.orchestra.run.smithi062.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T00:30:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T00:30:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T00:30:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T00:30:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:30:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:30:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:30:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T00:30:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T00:30:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T00:30:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T00:30:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T00:30:30.012 INFO:teuthology.orchestra.run.smithi062.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T00:30:30.013 INFO:teuthology.orchestra.run.smithi062.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T00:30:30.013 INFO:teuthology.orchestra.run.smithi062.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T00:30:30.013 INFO:teuthology.orchestra.run.smithi062.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T00:30:30.013 INFO:teuthology.orchestra.run.smithi062.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T00:30:30.013 INFO:teuthology.orchestra.run.smithi062.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T00:30:30.013 INFO:teuthology.orchestra.run.smithi062.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T00:30:30.013 INFO:teuthology.orchestra.run.smithi062.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T00:30:30.013 INFO:teuthology.orchestra.run.smithi062.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T00:30:30.013 INFO:teuthology.orchestra.run.smithi062.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T00:30:30.013 INFO:teuthology.orchestra.run.smithi062.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T00:30:30.013 INFO:teuthology.orchestra.run.smithi062.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T00:30:30.014 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:30:30.014 INFO:teuthology.orchestra.run.smithi062.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:30:30.014 INFO:teuthology.orchestra.run.smithi062.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T00:30:30.014 INFO:teuthology.orchestra.run.smithi062.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T00:30:30.014 INFO:teuthology.orchestra.run.smithi062.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T00:30:30.014 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T00:30:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T00:30:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T00:30:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T00:30:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T00:30:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:30:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T00:30:30.015 INFO:teuthology.orchestra.run.smithi062.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T00:30:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T00:30:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T00:30:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T00:30:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T00:30:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T00:30:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T00:30:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:30:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T00:30:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T00:30:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T00:30:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:30:30.016 INFO:teuthology.orchestra.run.smithi062.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:30:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:30:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: librados-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:30:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T00:30:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T00:30:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T00:30:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T00:30:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T00:30:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T00:30:30.017 INFO:teuthology.orchestra.run.smithi062.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:30:30.018 INFO:teuthology.orchestra.run.smithi062.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T00:30:30.018 INFO:teuthology.orchestra.run.smithi062.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T00:30:30.018 INFO:teuthology.orchestra.run.smithi062.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T00:30:30.018 INFO:teuthology.orchestra.run.smithi062.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T00:30:30.018 INFO:teuthology.orchestra.run.smithi062.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T00:30:30.018 INFO:teuthology.orchestra.run.smithi062.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T00:30:30.018 INFO:teuthology.orchestra.run.smithi062.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T00:30:30.018 INFO:teuthology.orchestra.run.smithi062.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T00:30:30.019 INFO:teuthology.orchestra.run.smithi062.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T00:30:30.019 INFO:teuthology.orchestra.run.smithi062.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T00:30:30.019 INFO:teuthology.orchestra.run.smithi062.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T00:30:30.019 INFO:teuthology.orchestra.run.smithi062.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:30:30.019 INFO:teuthology.orchestra.run.smithi062.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:30:30.019 INFO:teuthology.orchestra.run.smithi062.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:30:30.019 INFO:teuthology.orchestra.run.smithi062.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T00:30:30.019 INFO:teuthology.orchestra.run.smithi062.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:30:30.019 INFO:teuthology.orchestra.run.smithi062.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T00:30:30.019 INFO:teuthology.orchestra.run.smithi062.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T00:30:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T00:30:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T00:30:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T00:30:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T00:30:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T00:30:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T00:30:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T00:30:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T00:30:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T00:30:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T00:30:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T00:30:30.020 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:30:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:30:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T00:30:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T00:30:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T00:30:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T00:30:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T00:30:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T00:30:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T00:30:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:30:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T00:30:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T00:30:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T00:30:30.021 INFO:teuthology.orchestra.run.smithi062.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T00:30:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T00:30:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T00:30:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T00:30:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T00:30:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T00:30:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T00:30:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T00:30:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T00:30:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T00:30:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T00:30:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T00:30:30.022 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:30:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:30:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T00:30:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T00:30:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:30:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:30:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:30:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:30:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:30:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:30:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:30:30.023 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:30:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:30:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:30:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:30:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:30:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:30:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:30:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:30:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:30:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:30:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:30:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:30:30.024 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:30:30.025 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:30:30.025 INFO:teuthology.orchestra.run.smithi062.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:30:30.025 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:30:30.025 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:30:30.025 INFO:teuthology.orchestra.run.smithi062.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:30:30.025 INFO:teuthology.orchestra.run.smithi062.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:30:30.025 INFO:teuthology.orchestra.run.smithi062.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:30:30.025 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:30:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:30:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:30:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:30:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:30:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:30:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:30:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:30:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:30:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:30:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:30:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:30:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:30:30.026 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:30:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:30:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:30:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:30:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:30:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:30:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:30:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:30:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:30:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:30:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:30:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:30:30.027 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:30:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:30:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:30:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:30:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:30:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:30:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:30:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:30:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T00:30:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T00:30:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T00:30:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T00:30:30.028 INFO:teuthology.orchestra.run.smithi062.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:30:30.029 INFO:teuthology.orchestra.run.smithi062.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T00:30:30.029 INFO:teuthology.orchestra.run.smithi062.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:30:30.029 INFO:teuthology.orchestra.run.smithi062.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T00:30:30.029 INFO:teuthology.orchestra.run.smithi062.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T00:30:30.029 INFO:teuthology.orchestra.run.smithi062.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T00:30:30.029 INFO:teuthology.orchestra.run.smithi062.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T00:30:30.029 INFO:teuthology.orchestra.run.smithi062.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T00:30:30.029 INFO:teuthology.orchestra.run.smithi062.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T00:30:30.029 INFO:teuthology.orchestra.run.smithi062.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T00:30:30.029 INFO:teuthology.orchestra.run.smithi062.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T00:30:30.029 INFO:teuthology.orchestra.run.smithi062.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T00:30:30.030 INFO:teuthology.orchestra.run.smithi062.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T00:30:30.030 INFO:teuthology.orchestra.run.smithi062.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T00:30:30.030 INFO:teuthology.orchestra.run.smithi062.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T00:30:30.030 INFO:teuthology.orchestra.run.smithi062.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T00:30:30.030 INFO:teuthology.orchestra.run.smithi062.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:30:30.031 INFO:teuthology.orchestra.run.smithi062.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T00:30:30.031 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:30.031 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-09-12T00:30:30.422 DEBUG:teuthology.parallel:result is None 2024-09-12T00:30:30.422 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:30:30.580 DEBUG:teuthology.orchestra.run.smithi062:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:30:30.655 INFO:teuthology.orchestra.run.smithi062.stdout:19.3.0-4753.gd011c522.el9 2024-09-12T00:30:30.656 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753.gd011c522.el9 2024-09-12T00:30:30.656 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753.gd011c522 is installed. 2024-09-12T00:30:30.658 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:30:30.804 DEBUG:teuthology.orchestra.run.smithi077:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:30:30.888 INFO:teuthology.orchestra.run.smithi077.stdout:19.3.0-4753.gd011c522.el9 2024-09-12T00:30:30.888 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753.gd011c522.el9 2024-09-12T00:30:30.888 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753.gd011c522 is installed. 2024-09-12T00:30:30.890 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:30:30.890 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:30:30.890 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:30:30.936 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:30:30.936 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:30:30.984 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:30:30.984 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:30:30.984 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:30:31.027 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:30:31.109 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:30:31.109 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:30:31.154 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:30:31.235 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:30:31.236 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:30:31.236 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:30:31.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:30:31.381 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:30:31.381 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:30:31.422 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:30:31.502 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:30:31.502 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:30:31.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:30:31.545 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:30:31.626 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:30:31.626 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:30:31.665 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:30:31.744 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:30:31.831 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:30:31.831 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2024-09-12T00:30:31.833 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 777 /var/log/ceph 2024-09-12T00:30:31.871 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:30:31.872 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:30:31.914 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:30:31.952 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:30:31.952 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:30:31.994 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:30:32.043 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:30:32.043 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:30:32.044 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901870', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7901870', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': True, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIxxfrGVLm8NG+dIy/Q5wgEQO1FIMQDRmRodwobAu9mjN5jJODdCpX5D1iE6wZEpT21mAyz58wKaqeEzaTB6epM=', 'smithi077.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO1ByYXPjHqh8DHPX6owGRuNjojGZbJOCk4t9ulUeq/Kn37MuZwtvxYcDwK8roqpaex0nJhE0Ol42daWy3Lr4fA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:30:32.044 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:30:32.074 DEBUG:teuthology.orchestra.run.smithi077:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:30:32.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:30:32.144 DEBUG:teuthology.orchestra.run.smithi077:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:30:32.182 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:30:32.182 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:30:32.252 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:30:32.252 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2024-09-12T00:30:32.322 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:30:32.322 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:30:32.322 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T00:30:32.322 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:30:32.322 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:30:32.323 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 00:30:17.790919936 +0000 2024-09-12T00:30:32.323 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 00:27:37.782865469 +0000 2024-09-12T00:30:32.323 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 00:27:37.782865469 +0000 2024-09-12T00:30:32.323 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-12 00:27:37.782865469 +0000 2024-09-12T00:30:32.323 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:30:32.401 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T00:30:32.402 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T00:30:32.402 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000200573 s, 2.6 MB/s 2024-09-12T00:30:32.403 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:30:32.474 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2024-09-12T00:30:32.542 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:30:32.543 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:30:32.543 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T00:30:32.543 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:30:32.543 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:30:32.543 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 00:30:17.790919936 +0000 2024-09-12T00:30:32.543 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 00:27:38.119860010 +0000 2024-09-12T00:30:32.543 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 00:27:38.119860010 +0000 2024-09-12T00:30:32.543 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-12 00:27:38.119860010 +0000 2024-09-12T00:30:32.543 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:30:32.620 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T00:30:32.621 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T00:30:32.621 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000175428 s, 2.9 MB/s 2024-09-12T00:30:32.622 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:30:32.693 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2024-09-12T00:30:32.763 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:30:32.763 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:30:32.764 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-12T00:30:32.764 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:30:32.764 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:30:32.764 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 00:30:17.790919936 +0000 2024-09-12T00:30:32.764 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 00:27:38.451854633 +0000 2024-09-12T00:30:32.764 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 00:27:38.451854633 +0000 2024-09-12T00:30:32.764 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-12 00:27:38.451854633 +0000 2024-09-12T00:30:32.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:30:32.842 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T00:30:32.842 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T00:30:32.842 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000207458 s, 2.5 MB/s 2024-09-12T00:30:32.843 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:30:32.915 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2024-09-12T00:30:32.984 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:30:32.984 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:30:32.984 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-12T00:30:32.984 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:30:32.984 INFO:teuthology.orchestra.run.smithi062.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:30:32.984 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2024-09-12 00:30:17.791919920 +0000 2024-09-12T00:30:32.984 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2024-09-12 00:27:38.775849384 +0000 2024-09-12T00:30:32.984 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2024-09-12 00:27:38.775849384 +0000 2024-09-12T00:30:32.985 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: 2024-09-12 00:27:38.775849384 +0000 2024-09-12T00:30:32.985 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:30:33.063 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2024-09-12T00:30:33.063 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2024-09-12T00:30:33.063 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000180478 s, 2.8 MB/s 2024-09-12T00:30:33.064 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:30:33.135 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:30:33.135 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:30:33.135 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:30:33.170 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:30:33.170 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_1 2024-09-12T00:30:33.244 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:30:33.244 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:30:33.244 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-12T00:30:33.244 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:30:33.244 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:30:33.244 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-12 00:29:52.806272310 +0000 2024-09-12T00:30:33.244 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-12 00:27:33.800266138 +0000 2024-09-12T00:30:33.244 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-12 00:27:33.800266138 +0000 2024-09-12T00:30:33.244 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-12 00:27:33.800266138 +0000 2024-09-12T00:30:33.245 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:30:33.322 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-12T00:30:33.323 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-12T00:30:33.323 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000190402 s, 2.7 MB/s 2024-09-12T00:30:33.324 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:30:33.396 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_2 2024-09-12T00:30:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:30:33.466 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:30:33.466 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-12T00:30:33.466 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:30:33.466 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:30:33.466 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-12 00:29:52.806272310 +0000 2024-09-12T00:30:33.466 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-12 00:27:34.116259395 +0000 2024-09-12T00:30:33.467 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-12 00:27:34.116259395 +0000 2024-09-12T00:30:33.467 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-12 00:27:34.116259395 +0000 2024-09-12T00:30:33.467 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:30:33.544 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-12T00:30:33.544 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-12T00:30:33.544 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000229778 s, 2.2 MB/s 2024-09-12T00:30:33.545 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:30:33.615 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_3 2024-09-12T00:30:33.683 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:30:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:30:33.684 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-12T00:30:33.684 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:30:33.684 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:30:33.684 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-12 00:29:52.807272288 +0000 2024-09-12T00:30:33.684 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-12 00:27:34.434252608 +0000 2024-09-12T00:30:33.684 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-12 00:27:34.434252608 +0000 2024-09-12T00:30:33.684 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-12 00:27:34.434252608 +0000 2024-09-12T00:30:33.684 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:30:33.761 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-12T00:30:33.761 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-12T00:30:33.761 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000180967 s, 2.8 MB/s 2024-09-12T00:30:33.762 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:30:33.832 DEBUG:teuthology.orchestra.run.smithi077:> stat /dev/vg_nvme/lv_4 2024-09-12T00:30:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:30:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:30:33.901 INFO:teuthology.orchestra.run.smithi077.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-12T00:30:33.901 INFO:teuthology.orchestra.run.smithi077.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:30:33.901 INFO:teuthology.orchestra.run.smithi077.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:30:33.901 INFO:teuthology.orchestra.run.smithi077.stdout:Access: 2024-09-12 00:29:52.808272267 +0000 2024-09-12T00:30:33.901 INFO:teuthology.orchestra.run.smithi077.stdout:Modify: 2024-09-12 00:27:34.762245609 +0000 2024-09-12T00:30:33.901 INFO:teuthology.orchestra.run.smithi077.stdout:Change: 2024-09-12 00:27:34.762245609 +0000 2024-09-12T00:30:33.901 INFO:teuthology.orchestra.run.smithi077.stdout: Birth: 2024-09-12 00:27:34.762245609 +0000 2024-09-12T00:30:33.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:30:33.978 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records in 2024-09-12T00:30:33.978 INFO:teuthology.orchestra.run.smithi077.stderr:1+0 records out 2024-09-12T00:30:33.978 INFO:teuthology.orchestra.run.smithi077.stderr:512 bytes copied, 0.000205088 s, 2.5 MB/s 2024-09-12T00:30:33.979 DEBUG:teuthology.orchestra.run.smithi077:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:30:34.050 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:30:34.050 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:30:34.050 INFO:tasks.ceph:Generating config... 2024-09-12T00:30:34.052 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T00:30:34.052 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T00:30:34.052 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T00:30:34.052 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T00:30:34.052 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T00:30:34.053 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:30:34.053 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-12T00:30:34.053 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-12T00:30:34.053 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T00:30:34.053 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T00:30:34.053 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T00:30:34.053 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T00:30:34.053 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T00:30:34.053 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T00:30:34.053 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T00:30:34.053 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T00:30:34.053 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T00:30:34.053 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-12T00:30:34.054 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T00:30:34.054 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T00:30:34.054 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-09-12T00:30:34.054 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:30:34.054 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:30:34.054 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:30:34.054 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:30:34.054 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:30:34.054 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-12T00:30:34.054 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:30:34.054 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:30:34.054 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:30:34.054 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:30:34.054 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:30:34.055 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:30:34.055 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:30:34.055 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:30:34.055 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T00:30:34.055 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:30:34.055 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:30:34.055 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:30:34.055 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:30:34.055 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:30:34.055 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:30:34.055 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-12T00:30:34.055 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:30:34.055 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T00:30:34.056 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:30:34.056 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:30:34.152 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:30:34.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:30:34.217 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:30:34.257 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.62'), ('mon.c', '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]'), ('mon.b', '172.21.15.77')] 2024-09-12T00:30:34.258 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],172.21.15.77', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T00:30:34.259 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:30:34.259 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:30:34.329 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.62 --addv c '[v2:172.21.15.62:3301,v1:172.21.15.62:6790]' --add b 172.21.15.77 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:30:34.429 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:34.430 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:30:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: generated fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:30:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:setting min_mon_release = quincy 2024-09-12T00:30:34.430 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 0 2024-09-12T00:30:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:30:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:30:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:30:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:min_mon_release 17 (quincy) 2024-09-12T00:30:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:election_strategy: 1 2024-09-12T00:30:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:30:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:30:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:30:34.431 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T00:30:34.432 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:30:34.461 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 96ca3065-0479-453c-a9a3-396e70051c3b... 2024-09-12T00:30:34.462 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:30:34.504 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:30:34.561 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2024-09-12T00:30:34.561 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2024-09-12T00:30:34.561 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:30:34.561 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2024-09-12T00:30:34.561 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.561 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2024-09-12T00:30:34.561 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.562 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2024-09-12T00:30:34.562 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.562 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2024-09-12T00:30:34.562 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2024-09-12T00:30:34.562 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.562 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2024-09-12T00:30:34.562 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2024-09-12T00:30:34.562 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.562 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:30:34.562 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2024-09-12T00:30:34.562 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.562 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:30:34.563 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:30:34.563 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.563 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2024-09-12T00:30:34.563 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.563 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2024-09-12T00:30:34.563 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2024-09-12T00:30:34.563 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:30:34.563 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:30:34.563 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2024-09-12T00:30:34.563 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:30:34.563 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2024-09-12T00:30:34.563 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:30:34.563 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:30:34.564 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2024-09-12T00:30:34.564 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.564 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:30:34.564 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.564 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2024-09-12T00:30:34.564 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.564 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2024-09-12T00:30:34.564 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.564 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2024-09-12T00:30:34.564 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2024-09-12T00:30:34.564 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2024-09-12T00:30:34.564 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],172.21.15.77" 2024-09-12T00:30:34.565 INFO:teuthology.orchestra.run.smithi062.stdout: mon client directed command retry = 5 2024-09-12T00:30:34.565 INFO:teuthology.orchestra.run.smithi062.stdout: ms inject socket failures = 5000 2024-09-12T00:30:34.565 INFO:teuthology.orchestra.run.smithi062.stdout: osd heartbeat grace = 40 2024-09-12T00:30:34.565 INFO:teuthology.orchestra.run.smithi062.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:30:34.565 INFO:teuthology.orchestra.run.smithi062.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:30:34.565 INFO:teuthology.orchestra.run.smithi062.stdout: rgw override bucket index max shards = 1 2024-09-12T00:30:34.565 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:30:34.565 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.565 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2024-09-12T00:30:34.565 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2024-09-12T00:30:34.565 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.565 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2024-09-12T00:30:34.565 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2024-09-12T00:30:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:30:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2024-09-12T00:30:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2024-09-12T00:30:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2024-09-12T00:30:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2024-09-12T00:30:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2024-09-12T00:30:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug trim objects = true 2024-09-12T00:30:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2024-09-12T00:30:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2024-09-12T00:30:34.566 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.567 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:30:34.567 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.567 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2024-09-12T00:30:34.567 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.567 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2024-09-12T00:30:34.567 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.567 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:30:34.567 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2024-09-12T00:30:34.567 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.567 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2024-09-12T00:30:34.567 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2024-09-12T00:30:34.567 INFO:teuthology.orchestra.run.smithi062.stdout: bdev async discard = True 2024-09-12T00:30:34.567 INFO:teuthology.orchestra.run.smithi062.stdout: bdev enable discard = True 2024-09-12T00:30:34.568 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore allocator = bitmap 2024-09-12T00:30:34.568 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2024-09-12T00:30:34.568 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2024-09-12T00:30:34.568 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 1/20 2024-09-12T00:30:34.568 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 1/20 2024-09-12T00:30:34.568 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-12T00:30:34.568 INFO:teuthology.orchestra.run.smithi062.stdout: debug objclass = 20 2024-09-12T00:30:34.568 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2024-09-12T00:30:34.568 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 4/10 2024-09-12T00:30:34.568 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:30:34.568 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2024-09-12T00:30:34.568 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:30:34.569 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:30:34.569 INFO:teuthology.orchestra.run.smithi062.stdout: osd fast shutdown = False 2024-09-12T00:30:34.569 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2024-09-12T00:30:34.569 INFO:teuthology.orchestra.run.smithi062.stdout: osd shutdown pgref assert = True 2024-09-12T00:30:34.569 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.569 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2024-09-12T00:30:34.569 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-12T00:30:34.570 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2024-09-12T00:30:34.570 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-09-12T00:30:34.570 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-09-12T00:30:34.570 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:30:34.570 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:30:34.570 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2024-09-12T00:30:34.570 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.570 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2024-09-12T00:30:34.570 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2024-09-12T00:30:34.570 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2024-09-12T00:30:34.570 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2024-09-12T00:30:34.570 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2024-09-12T00:30:34.571 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2024-09-12T00:30:34.571 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2024-09-12T00:30:34.571 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:30:34.571 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2024-09-12T00:30:34.571 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2024-09-12T00:30:34.571 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:30:34.571 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.571 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:30:34.572 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:30:34.572 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:30:34.573 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.573 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:30:34.573 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:30:34.573 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:30:34.573 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.573 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2024-09-12T00:30:34.573 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:30:34.573 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.573 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:30:34.573 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd crush smoke test = False 2024-09-12T00:30:34.573 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:30:34.573 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2024-09-12T00:30:34.573 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2024-09-12T00:30:34.574 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2024-09-12T00:30:34.574 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2024-09-12T00:30:34.574 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:30:34.574 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:30:34.574 INFO:teuthology.orchestra.run.smithi062.stdout: debug rgw = 20 2024-09-12T00:30:34.574 INFO:teuthology.orchestra.run.smithi062.stdout: debug rgw notification = 20 2024-09-12T00:30:34.574 INFO:teuthology.orchestra.run.smithi062.stdout: rgw bucket counters cache = True 2024-09-12T00:30:34.574 INFO:teuthology.orchestra.run.smithi062.stdout: rgw crypt require ssl = False 2024-09-12T00:30:34.575 INFO:teuthology.orchestra.run.smithi062.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:30:34.575 INFO:teuthology.orchestra.run.smithi062.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:30:34.575 INFO:teuthology.orchestra.run.smithi062.stdout: rgw max chunk size = 4194304 2024-09-12T00:30:34.575 INFO:teuthology.orchestra.run.smithi062.stdout: rgw obj stripe size = 6291456 2024-09-12T00:30:34.575 INFO:teuthology.orchestra.run.smithi062.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:30:34.575 INFO:teuthology.orchestra.run.smithi062.stdout: rgw s3 auth use sts = True 2024-09-12T00:30:34.575 INFO:teuthology.orchestra.run.smithi062.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:30:34.576 INFO:teuthology.orchestra.run.smithi062.stdout: rgw torrent flag = True 2024-09-12T00:30:34.576 INFO:teuthology.orchestra.run.smithi062.stdout: rgw user counters cache = True 2024-09-12T00:30:34.576 INFO:teuthology.orchestra.run.smithi062.stdout: setgroup = ceph 2024-09-12T00:30:34.576 INFO:teuthology.orchestra.run.smithi062.stdout: setuser = ceph 2024-09-12T00:30:34.576 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2024-09-12T00:30:34.576 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2024-09-12T00:30:34.576 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2024-09-12T00:30:34.578 INFO:teuthology.orchestra.run.smithi077.stdout:[global] 2024-09-12T00:30:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: chdir = "" 2024-09-12T00:30:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:30:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: auth supported = cephx 2024-09-12T00:30:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: filestore xattr use omap = true 2024-09-12T00:30:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: mon clock drift allowed = 1.000 2024-09-12T00:30:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: osd crush chooseleaf type = 0 2024-09-12T00:30:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: auth debug = true 2024-09-12T00:30:34.578 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on old message = true 2024-09-12T00:30:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: ms die on bug = true 2024-09-12T00:30:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:30:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: mon pg warn max object skew = 0 2024-09-12T00:30:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:30:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:30:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default size = 2 2024-09-12T00:30:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow primary affinity = true 2024-09-12T00:30:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd allow pg remap = true 2024-09-12T00:30:34.579 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:30:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:30:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on no sortbitwise = false 2024-09-12T00:30:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:30:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: mon warn on too few osds = false 2024-09-12T00:30:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:30:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:30:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: mon_allow_pool_size_one = true 2024-09-12T00:30:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:30:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: osd default data pool replay window = 5 2024-09-12T00:30:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.580 INFO:teuthology.orchestra.run.smithi077.stdout: mon allow pool delete = true 2024-09-12T00:30:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: mon cluster log file level = debug 2024-09-12T00:30:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: debug asserts on shutdown = true 2024-09-12T00:30:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: mon health detail to clog = false 2024-09-12T00:30:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: mon host = "172.21.15.62,[v2:172.21.15.62:3301,v1:172.21.15.62:6790],172.21.15.77" 2024-09-12T00:30:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: mon client directed command retry = 5 2024-09-12T00:30:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: ms inject socket failures = 5000 2024-09-12T00:30:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: osd heartbeat grace = 40 2024-09-12T00:30:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:30:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:30:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: rgw override bucket index max shards = 1 2024-09-12T00:30:34.581 INFO:teuthology.orchestra.run.smithi077.stdout: fsid = 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:30:34.582 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.582 INFO:teuthology.orchestra.run.smithi077.stdout:[osd] 2024-09-12T00:30:34.582 INFO:teuthology.orchestra.run.smithi077.stdout: osd journal size = 100 2024-09-12T00:30:34.582 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.582 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub load threshold = 5.0 2024-09-12T00:30:34.582 INFO:teuthology.orchestra.run.smithi077.stdout: osd scrub max interval = 600 2024-09-12T00:30:34.582 INFO:teuthology.orchestra.run.smithi077.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:30:34.582 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.582 INFO:teuthology.orchestra.run.smithi077.stdout: osd recover clone overlap = true 2024-09-12T00:30:34.582 INFO:teuthology.orchestra.run.smithi077.stdout: osd recovery max chunk = 1048576 2024-09-12T00:30:34.582 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.582 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug shutdown = true 2024-09-12T00:30:34.582 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug op order = true 2024-09-12T00:30:34.582 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug verify stray on activate = true 2024-09-12T00:30:34.583 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug trim objects = true 2024-09-12T00:30:34.583 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.583 INFO:teuthology.orchestra.run.smithi077.stdout: osd open classes on start = true 2024-09-12T00:30:34.583 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug pg log writeout = true 2024-09-12T00:30:34.583 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.583 INFO:teuthology.orchestra.run.smithi077.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:30:34.583 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.583 INFO:teuthology.orchestra.run.smithi077.stdout: osd map max advance = 10 2024-09-12T00:30:34.583 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.583 INFO:teuthology.orchestra.run.smithi077.stdout: journal zero on create = true 2024-09-12T00:30:34.583 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.583 INFO:teuthology.orchestra.run.smithi077.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:30:34.583 INFO:teuthology.orchestra.run.smithi077.stdout: filestore apply finisher threads = 3 2024-09-12T00:30:34.583 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.584 INFO:teuthology.orchestra.run.smithi077.stdout: bdev debug aio = true 2024-09-12T00:30:34.584 INFO:teuthology.orchestra.run.smithi077.stdout: osd debug misdirected ops = true 2024-09-12T00:30:34.584 INFO:teuthology.orchestra.run.smithi077.stdout: bdev async discard = True 2024-09-12T00:30:34.584 INFO:teuthology.orchestra.run.smithi077.stdout: bdev enable discard = True 2024-09-12T00:30:34.584 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore allocator = bitmap 2024-09-12T00:30:34.584 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore block size = 96636764160 2024-09-12T00:30:34.584 INFO:teuthology.orchestra.run.smithi077.stdout: bluestore fsck on mount = True 2024-09-12T00:30:34.584 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluefs = 1/20 2024-09-12T00:30:34.584 INFO:teuthology.orchestra.run.smithi077.stdout: debug bluestore = 1/20 2024-09-12T00:30:34.584 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-12T00:30:34.584 INFO:teuthology.orchestra.run.smithi077.stdout: debug objclass = 20 2024-09-12T00:30:34.584 INFO:teuthology.orchestra.run.smithi077.stdout: debug osd = 20 2024-09-12T00:30:34.584 INFO:teuthology.orchestra.run.smithi077.stdout: debug rocksdb = 4/10 2024-09-12T00:30:34.585 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:30:34.585 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd full ratio = 0.9 2024-09-12T00:30:34.585 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:30:34.585 INFO:teuthology.orchestra.run.smithi077.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:30:34.585 INFO:teuthology.orchestra.run.smithi077.stdout: osd fast shutdown = False 2024-09-12T00:30:34.585 INFO:teuthology.orchestra.run.smithi077.stdout: osd objectstore = bluestore 2024-09-12T00:30:34.585 INFO:teuthology.orchestra.run.smithi077.stdout: osd shutdown pgref assert = True 2024-09-12T00:30:34.585 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.585 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr] 2024-09-12T00:30:34.585 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-12T00:30:34.585 INFO:teuthology.orchestra.run.smithi077.stdout: debug mgr = 20 2024-09-12T00:30:34.585 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-12T00:30:34.585 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-12T00:30:34.586 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:30:34.586 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:30:34.586 INFO:teuthology.orchestra.run.smithi077.stdout: mgr/telemetry/nag = false 2024-09-12T00:30:34.586 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.586 INFO:teuthology.orchestra.run.smithi077.stdout:[mon] 2024-09-12T00:30:34.586 INFO:teuthology.orchestra.run.smithi077.stdout: debug ms = 1 2024-09-12T00:30:34.586 INFO:teuthology.orchestra.run.smithi077.stdout: debug mon = 20 2024-09-12T00:30:34.586 INFO:teuthology.orchestra.run.smithi077.stdout: debug paxos = 20 2024-09-12T00:30:34.586 INFO:teuthology.orchestra.run.smithi077.stdout: debug auth = 20 2024-09-12T00:30:34.586 INFO:teuthology.orchestra.run.smithi077.stdout: mon data avail warn = 5 2024-09-12T00:30:34.586 INFO:teuthology.orchestra.run.smithi077.stdout: mon mgr mkfs grace = 240 2024-09-12T00:30:34.586 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:30:34.586 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd reporter subtree level = osd 2024-09-12T00:30:34.586 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd prime pg temp = true 2024-09-12T00:30:34.587 INFO:teuthology.orchestra.run.smithi077.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:30:34.587 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.587 INFO:teuthology.orchestra.run.smithi077.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:30:34.587 INFO:teuthology.orchestra.run.smithi077.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:30:34.587 INFO:teuthology.orchestra.run.smithi077.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:30:34.587 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.587 INFO:teuthology.orchestra.run.smithi077.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:30:34.587 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:30:34.587 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:30:34.587 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.587 INFO:teuthology.orchestra.run.smithi077.stdout: # 1m isn't quite enough 2024-09-12T00:30:34.587 INFO:teuthology.orchestra.run.smithi077.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:30:34.587 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.588 INFO:teuthology.orchestra.run.smithi077.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:30:34.588 INFO:teuthology.orchestra.run.smithi077.stdout: mon osd crush smoke test = False 2024-09-12T00:30:34.588 INFO:teuthology.orchestra.run.smithi077.stdout: 2024-09-12T00:30:34.588 INFO:teuthology.orchestra.run.smithi077.stdout:[client] 2024-09-12T00:30:34.588 INFO:teuthology.orchestra.run.smithi077.stdout: rgw cache enabled = true 2024-09-12T00:30:34.588 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable ops log = true 2024-09-12T00:30:34.588 INFO:teuthology.orchestra.run.smithi077.stdout: rgw enable usage log = true 2024-09-12T00:30:34.588 INFO:teuthology.orchestra.run.smithi077.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:30:34.588 INFO:teuthology.orchestra.run.smithi077.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:30:34.588 INFO:teuthology.orchestra.run.smithi077.stdout: debug rgw = 20 2024-09-12T00:30:34.588 INFO:teuthology.orchestra.run.smithi077.stdout: debug rgw notification = 20 2024-09-12T00:30:34.588 INFO:teuthology.orchestra.run.smithi077.stdout: rgw bucket counters cache = True 2024-09-12T00:30:34.588 INFO:teuthology.orchestra.run.smithi077.stdout: rgw crypt require ssl = False 2024-09-12T00:30:34.588 INFO:teuthology.orchestra.run.smithi077.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:30:34.589 INFO:teuthology.orchestra.run.smithi077.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:30:34.589 INFO:teuthology.orchestra.run.smithi077.stdout: rgw max chunk size = 4194304 2024-09-12T00:30:34.589 INFO:teuthology.orchestra.run.smithi077.stdout: rgw obj stripe size = 6291456 2024-09-12T00:30:34.589 INFO:teuthology.orchestra.run.smithi077.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:30:34.589 INFO:teuthology.orchestra.run.smithi077.stdout: rgw s3 auth use sts = True 2024-09-12T00:30:34.589 INFO:teuthology.orchestra.run.smithi077.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:30:34.589 INFO:teuthology.orchestra.run.smithi077.stdout: rgw torrent flag = True 2024-09-12T00:30:34.589 INFO:teuthology.orchestra.run.smithi077.stdout: rgw user counters cache = True 2024-09-12T00:30:34.589 INFO:teuthology.orchestra.run.smithi077.stdout: setgroup = ceph 2024-09-12T00:30:34.589 INFO:teuthology.orchestra.run.smithi077.stdout: setuser = ceph 2024-09-12T00:30:34.589 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.a] 2024-09-12T00:30:34.589 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.c] 2024-09-12T00:30:34.589 INFO:teuthology.orchestra.run.smithi077.stdout:[mon.b] 2024-09-12T00:30:34.590 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:30:34.590 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:30:34.689 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:30:34.689 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:30:34.689 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:30:34.719 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:30:34.719 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:30:34.788 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T00:30:34.788 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:30:34.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:30:34.789 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:30:34.878 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:30:34.879 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:30:34.948 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi077.front.sepia.ceph.com 2024-09-12T00:30:34.949 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:30:34.949 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:30:34.949 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:30:35.001 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:30:35.001 DEBUG:teuthology.orchestra.run.smithi077:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:30:35.073 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:30:35.073 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:30:35.074 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:30:35.142 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:30:35.145 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:30:35.217 INFO:teuthology.orchestra.run.smithi077.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:30:35.219 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:30:35.220 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:30:35.220 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:30:35.277 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:30:35.290 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T00:30:35.344 INFO:teuthology.orchestra.run.smithi077.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T00:30:35.357 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:30:35.358 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi077.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:30:35.358 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:30:35.397 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:30:35.397 INFO:tasks.ceph:role: osd.0 2024-09-12T00:30:35.397 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T00:30:35.397 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:30:35.485 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:30:35.485 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:30:35.485 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:30:35.485 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:30:35.485 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:30:35.486 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:30:35.486 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:30:35.486 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:30:35.486 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:30:35.486 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:30:35.998 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-09-12T00:30:36.000 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-09-12T00:30:36.000 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:30:36.106 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:30:36.154 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:30:36.194 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:30:36.194 INFO:tasks.ceph:role: osd.1 2024-09-12T00:30:36.194 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T00:30:36.194 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:30:36.282 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:30:36.283 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:30:36.283 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:30:36.283 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:30:36.283 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:30:36.283 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:30:36.283 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:30:36.283 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:30:36.283 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:30:36.283 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:30:36.744 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-09-12T00:30:36.746 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-09-12T00:30:36.746 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T00:30:36.812 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:30:36.856 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:30:36.895 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:30:36.896 INFO:tasks.ceph:role: osd.2 2024-09-12T00:30:36.896 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T00:30:36.896 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:30:36.984 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:30:36.985 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:30:36.985 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:30:36.985 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:30:36.985 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:30:36.985 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:30:36.985 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:30:36.985 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:30:36.985 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:30:36.985 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:30:37.472 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-09-12T00:30:37.474 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-09-12T00:30:37.474 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T00:30:37.591 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:30:37.635 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:30:37.674 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:30:37.674 INFO:tasks.ceph:role: osd.3 2024-09-12T00:30:37.674 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T00:30:37.674 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:30:37.762 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:30:37.762 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:30:37.762 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:30:37.763 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:30:37.763 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:30:37.763 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:30:37.763 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:30:37.763 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:30:37.763 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:30:37.763 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:30:38.294 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2024-09-12T00:30:38.296 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2024-09-12T00:30:38.296 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T00:30:38.406 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:30:38.456 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:30:38.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:38.526+0000 7f7d995bb640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:30:38.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:38.526+0000 7f7d995bb640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:30:38.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:38.526+0000 7f7d995bb640 -1 bdev(0x559debbcb800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:30:38.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:38.526+0000 7f7d995bb640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:30:41.447 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:30:41.495 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:30:41.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:41.562+0000 7f0669413640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:30:41.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:41.562+0000 7f0669413640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:30:41.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:41.562+0000 7f0669413640 -1 bdev(0x557a6f9c5800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:30:41.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:41.562+0000 7f0669413640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:30:44.983 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:30:45.029 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:30:45.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:45.095+0000 7f772fed6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:30:45.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:45.095+0000 7f772fed6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:30:45.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:45.095+0000 7f772fed6640 -1 bdev(0x5622dabc7800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:30:45.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:45.095+0000 7f772fed6640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:30:48.255 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:30:48.301 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:30:48.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:48.367+0000 7efc081db640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:30:48.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:48.367+0000 7efc081db640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:30:48.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:48.367+0000 7efc081db640 -1 bdev(0x561e272ad800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:30:48.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:30:48.367+0000 7efc081db640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:30:52.042 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:30:52.088 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T00:30:52.133 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:30:52.133 INFO:tasks.ceph:role: osd.4 2024-09-12T00:30:52.134 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-12T00:30:52.134 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:30:52.183 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:30:52.183 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:30:52.183 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:30:52.183 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:30:52.184 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:30:52.184 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:30:52.184 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:30:52.184 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:30:52.184 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:30:52.184 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:30:52.648 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-12T00:30:52.650 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-12T00:30:52.650 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T00:30:52.762 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T00:30:52.810 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T00:30:52.850 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:30:52.850 INFO:tasks.ceph:role: osd.5 2024-09-12T00:30:52.851 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-12T00:30:52.851 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:30:52.936 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:30:52.937 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:30:52.937 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:30:52.937 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:30:52.937 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:30:52.937 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:30:52.937 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:30:52.937 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:30:52.937 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:30:52.937 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:30:53.390 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-12T00:30:53.392 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-12T00:30:53.392 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T00:30:53.481 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T00:30:53.524 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T00:30:53.602 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:30:53.602 INFO:tasks.ceph:role: osd.6 2024-09-12T00:30:53.602 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-12T00:30:53.602 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:30:53.688 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:30:53.689 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:30:53.689 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:30:53.689 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:30:53.689 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:30:53.689 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:30:53.689 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:30:53.689 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:30:53.689 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:30:53.689 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:30:54.168 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-12T00:30:54.170 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-12T00:30:54.171 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T00:30:54.239 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T00:30:54.283 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T00:30:54.362 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:30:54.362 INFO:tasks.ceph:role: osd.7 2024-09-12T00:30:54.362 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-12T00:30:54.363 DEBUG:teuthology.orchestra.run.smithi077:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:30:54.449 INFO:teuthology.orchestra.run.smithi077.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:30:54.449 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:30:54.449 INFO:teuthology.orchestra.run.smithi077.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:30:54.449 INFO:teuthology.orchestra.run.smithi077.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:30:54.450 INFO:teuthology.orchestra.run.smithi077.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:30:54.450 INFO:teuthology.orchestra.run.smithi077.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:30:54.450 INFO:teuthology.orchestra.run.smithi077.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:30:54.450 INFO:teuthology.orchestra.run.smithi077.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:30:54.450 INFO:teuthology.orchestra.run.smithi077.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:30:54.450 INFO:teuthology.orchestra.run.smithi077.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:30:54.962 INFO:teuthology.orchestra.run.smithi077.stdout:Discarding blocks...Done. 2024-09-12T00:30:54.964 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi077.front.sepia.ceph.com -o noatime 2024-09-12T00:30:54.964 DEBUG:teuthology.orchestra.run.smithi077:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T00:30:55.079 DEBUG:teuthology.orchestra.run.smithi077:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T00:30:55.124 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:30:55.189 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:30:55.189+0000 7efcc0c1d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T00:30:55.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:30:55.194+0000 7efcc0c1d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T00:30:55.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:30:55.194+0000 7efcc0c1d640 -1 bdev(0x55acc4a29800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T00:30:55.194 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:30:55.194+0000 7efcc0c1d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T00:30:58.603 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T00:30:58.645 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:30:58.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:30:58.751+0000 7f5102624640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T00:30:58.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:30:58.751+0000 7f5102624640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T00:30:58.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:30:58.751+0000 7f5102624640 -1 bdev(0x556a7bc61800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T00:30:58.750 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:30:58.751+0000 7f5102624640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T00:31:02.411 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T00:31:02.456 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:31:02.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:31:02.559+0000 7fabb2fdd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T00:31:02.558 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:31:02.559+0000 7fabb2fdd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T00:31:02.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:31:02.559+0000 7fabb2fdd640 -1 bdev(0x559cf3f03800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T00:31:02.559 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:31:02.560+0000 7fabb2fdd640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T00:31:05.972 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T00:31:06.013 DEBUG:teuthology.orchestra.run.smithi077:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:31:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:31:06.115+0000 7f9531ce0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T00:31:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:31:06.115+0000 7f9531ce0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T00:31:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:31:06.115+0000 7f9531ce0640 -1 bdev(0x55f1403d5800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T00:31:06.115 INFO:teuthology.orchestra.run.smithi077.stderr:2024-09-12T00:31:06.115+0000 7f9531ce0640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T00:31:09.515 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T00:31:09.560 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:31:09.560 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:31:09.560 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T00:31:09.607 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:31:09.608 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:31:09.693 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:31:09.697 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:31:09.775 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:31:09.775 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:31:09.857 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:31:09.858 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:31:09.937 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:31:09.938 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:31:09.984 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:31:09.984 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T00:31:10.067 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:31:10.067 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T00:31:10.148 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:31:10.148 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T00:31:10.228 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:31:10.228 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T00:31:10.309 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:31:10.309 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:31:10.340 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:31:10.340 DEBUG:teuthology.orchestra.run.smithi077:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T00:31:10.378 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:31:10.378 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:31:10.383 DEBUG:teuthology.orchestra.run.smithi077:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:31:10.422 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2024-09-12T00:31:10.422 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQArNuJmeaCiCBAA8QmK+ox5uLY2PPLhHRWLjQ== 2024-09-12T00:31:10.422 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2024-09-12T00:31:10.422 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAuNuJmHRtvHxAAE4Uqj2fnKiOfBUWIlayJjg== 2024-09-12T00:31:10.422 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2024-09-12T00:31:10.422 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAxNuJmRIeSIRAA5zUXyitFx/1aYusvb/up8w== 2024-09-12T00:31:10.423 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2024-09-12T00:31:10.423 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA1NuJmady9BRAAh67eG0oyBKs0s4LhflcN0g== 2024-09-12T00:31:10.423 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2024-09-12T00:31:10.423 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA4NuJm13j0FRAAvGbVGSQd4nIc0YLGrtwhuw== 2024-09-12T00:31:10.423 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2024-09-12T00:31:10.423 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQArNuJmxVMXDRAA4uiUf6GW8CbScT7mMdprxg== 2024-09-12T00:31:10.423 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2024-09-12T00:31:10.423 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA/NuJmrVNlCxAARGDA9oYxpQVOxwux6Aw1pA== 2024-09-12T00:31:10.423 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2024-09-12T00:31:10.423 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBCNuJm4g7TLBAAPujYUPu5Lcnpdkzjp/xCyQ== 2024-09-12T00:31:10.423 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2024-09-12T00:31:10.423 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBGNuJmqdZpIRAANpdCo80GzNG0k/SlQwdYng== 2024-09-12T00:31:10.424 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2024-09-12T00:31:10.424 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQBKNuJmFaDwBhAAkyXrq/72ViDpXe8uZUHCtw== 2024-09-12T00:31:10.424 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2024-09-12T00:31:10.424 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQArNuJmMvWXEBAAnrbaRzH0sL/CILyq4XLjXA== 2024-09-12T00:31:10.424 INFO:teuthology.orchestra.run.smithi062.stdout:[client.1] 2024-09-12T00:31:10.424 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQArNuJmBBqwFBAAT0Go02ZvwEKlIK5tXizsmA== 2024-09-12T00:31:10.456 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.y] 2024-09-12T00:31:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQArNuJmeaCiCBAA8QmK+ox5uLY2PPLhHRWLjQ== 2024-09-12T00:31:10.456 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.0] 2024-09-12T00:31:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAuNuJmHRtvHxAAE4Uqj2fnKiOfBUWIlayJjg== 2024-09-12T00:31:10.456 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.1] 2024-09-12T00:31:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQAxNuJmRIeSIRAA5zUXyitFx/1aYusvb/up8w== 2024-09-12T00:31:10.456 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.2] 2024-09-12T00:31:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQA1NuJmady9BRAAh67eG0oyBKs0s4LhflcN0g== 2024-09-12T00:31:10.456 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.3] 2024-09-12T00:31:10.456 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQA4NuJm13j0FRAAvGbVGSQd4nIc0YLGrtwhuw== 2024-09-12T00:31:10.456 INFO:teuthology.orchestra.run.smithi077.stdout:[mgr.x] 2024-09-12T00:31:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQArNuJmxVMXDRAA4uiUf6GW8CbScT7mMdprxg== 2024-09-12T00:31:10.457 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.4] 2024-09-12T00:31:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQA/NuJmrVNlCxAARGDA9oYxpQVOxwux6Aw1pA== 2024-09-12T00:31:10.457 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.5] 2024-09-12T00:31:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBCNuJm4g7TLBAAPujYUPu5Lcnpdkzjp/xCyQ== 2024-09-12T00:31:10.457 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.6] 2024-09-12T00:31:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBGNuJmqdZpIRAANpdCo80GzNG0k/SlQwdYng== 2024-09-12T00:31:10.457 INFO:teuthology.orchestra.run.smithi077.stdout:[osd.7] 2024-09-12T00:31:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQBKNuJmFaDwBhAAkyXrq/72ViDpXe8uZUHCtw== 2024-09-12T00:31:10.457 INFO:teuthology.orchestra.run.smithi077.stdout:[client.0] 2024-09-12T00:31:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQArNuJmMvWXEBAAnrbaRzH0sL/CILyq4XLjXA== 2024-09-12T00:31:10.457 INFO:teuthology.orchestra.run.smithi077.stdout:[client.1] 2024-09-12T00:31:10.457 INFO:teuthology.orchestra.run.smithi077.stdout: key = AQArNuJmBBqwFBAAT0Go02ZvwEKlIK5tXizsmA== 2024-09-12T00:31:10.458 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:31:10.468 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:31:10.564 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:10.567 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:10.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:10.634 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:10.698 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:10.701 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:10.766 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:10.768 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:10.833 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:31:10.835 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:31:10.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:10.902 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:10.967 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:10.971 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:11.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:11.038 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:11.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:11.105 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:31:11.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:31:11.173 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:31:11.240 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:31:11.243 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:31:11.311 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:31:11.311 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:31:11.351 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:31:11.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:31:11.503 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T00:31:11.583 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:31:11.695 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T00:31:11.735 DEBUG:teuthology.orchestra.run.smithi077:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T00:31:11.774 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:31:11.883 DEBUG:teuthology.orchestra.run.smithi077:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T00:31:11.922 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:31:11.924 DEBUG:teuthology.orchestra.run.smithi077:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:31:11.991 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:31:11.991 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:31:11.991 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:31:11.995 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:31:11.995 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T00:31:11.995 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T00:31:11.997 INFO:tasks.ceph.mon.c:Started 2024-09-12T00:31:11.997 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T00:31:11.997 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T00:31:12.033 INFO:tasks.ceph.mon.b:Started 2024-09-12T00:31:12.033 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:31:12.033 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T00:31:12.033 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T00:31:12.035 INFO:tasks.ceph.mgr.y:Started 2024-09-12T00:31:12.036 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:31:12.036 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:31:12.038 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:31:12.038 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:31:12.038 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:31:12.038 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:31:17.417 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2024-09-12T00:31:17.430 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:31:17.430 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:31:17.430 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:31:17.431 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:31:17.472 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:31:17.473 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:31:17.552 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:31:17.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:31:17.632 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:31:17.632 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:31:17.713 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:31:17.713 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T00:31:17.760 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:31:17.760 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T00:31:17.843 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:31:17.843 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T00:31:17.922 DEBUG:teuthology.orchestra.run.smithi077:> set -ex 2024-09-12T00:31:17.922 DEBUG:teuthology.orchestra.run.smithi077:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T00:31:18.003 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 6da28c6f-a13c-4f37-8ff1-8a4e33e22ca5 0 2024-09-12T00:31:18.242 INFO:teuthology.orchestra.run.smithi077.stdout:0 2024-09-12T00:31:18.253 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 9d244f54-e9a7-4574-876f-faeb37483f71 1 2024-09-12T00:31:18.453 INFO:teuthology.orchestra.run.smithi077.stdout:1 2024-09-12T00:31:18.464 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new f87e5588-6367-47e0-8786-7de4d746ca46 2 2024-09-12T00:31:18.658 INFO:teuthology.orchestra.run.smithi077.stdout:2 2024-09-12T00:31:18.669 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 8cd55f6b-48ff-4cb3-ab16-8f53ea750769 3 2024-09-12T00:31:18.861 INFO:teuthology.orchestra.run.smithi077.stdout:3 2024-09-12T00:31:18.873 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 65af27ce-105f-4dd8-b963-64061b9a3e14 4 2024-09-12T00:31:19.066 INFO:teuthology.orchestra.run.smithi077.stdout:4 2024-09-12T00:31:19.077 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 60dbda0d-1c25-4821-b67e-1df8c03847cf 5 2024-09-12T00:31:19.273 INFO:teuthology.orchestra.run.smithi077.stdout:5 2024-09-12T00:31:19.285 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new 7d93020d-ee02-41f4-970b-05c3ad20e318 6 2024-09-12T00:31:19.477 INFO:teuthology.orchestra.run.smithi077.stdout:6 2024-09-12T00:31:19.488 DEBUG:teuthology.orchestra.run.smithi077:> sudo ceph --cluster ceph osd new e4ca495c-287b-4741-9b0d-53f121e90155 7 2024-09-12T00:31:19.681 INFO:teuthology.orchestra.run.smithi077.stdout:7 2024-09-12T00:31:19.693 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:31:19.693 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:31:19.695 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:31:19.695 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:31:19.695 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:31:19.697 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:31:19.697 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:31:19.698 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:31:19.699 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:31:19.700 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:31:19.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:31:19.702 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:31:19.702 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T00:31:19.702 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T00:31:19.704 INFO:tasks.ceph.osd.4:Started 2024-09-12T00:31:19.705 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T00:31:19.705 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T00:31:19.707 INFO:tasks.ceph.osd.5:Started 2024-09-12T00:31:19.707 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T00:31:19.707 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T00:31:19.709 INFO:tasks.ceph.osd.6:Started 2024-09-12T00:31:19.709 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T00:31:19.709 DEBUG:teuthology.orchestra.run.smithi077:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T00:31:19.712 INFO:tasks.ceph.osd.7:Started 2024-09-12T00:31:19.712 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:31:19.943 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:31:19.943 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":10,"fsid":"96ca3065-0479-453c-a9a3-396e70051c3b","created":"2024-09-12T00:31:17.323087+0000","modified":"2024-09-12T00:31:19.681132+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:31:19.681132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6da28c6f-a13c-4f37-8ff1-8a4e33e22ca5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d244f54-e9a7-4574-876f-faeb37483f71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f87e5588-6367-47e0-8786-7de4d746ca46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8cd55f6b-48ff-4cb3-ab16-8f53ea750769","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"65af27ce-105f-4dd8-b963-64061b9a3e14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"60dbda0d-1c25-4821-b67e-1df8c03847cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7d93020d-ee02-41f4-970b-05c3ad20e318","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e4ca495c-287b-4741-9b0d-53f121e90155","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:31:19.954 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:31:19.955 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:31:20.701 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-12T00:31:20.702+0000 7f8bb9ba8640 -1 Falling back to public interface 2024-09-12T00:31:20.761 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:31:20.938 INFO:teuthology.misc.health.smithi062.stdout: 2024-09-12T00:31:20.938 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":10,"fsid":"96ca3065-0479-453c-a9a3-396e70051c3b","created":"2024-09-12T00:31:17.323087+0000","modified":"2024-09-12T00:31:19.681132+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:31:19.681132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6da28c6f-a13c-4f37-8ff1-8a4e33e22ca5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d244f54-e9a7-4574-876f-faeb37483f71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f87e5588-6367-47e0-8786-7de4d746ca46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8cd55f6b-48ff-4cb3-ab16-8f53ea750769","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"65af27ce-105f-4dd8-b963-64061b9a3e14","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"60dbda0d-1c25-4821-b67e-1df8c03847cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"7d93020d-ee02-41f4-970b-05c3ad20e318","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e4ca495c-287b-4741-9b0d-53f121e90155","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:31:20.942 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-09-12T00:31:20.943+0000 7f6ca2f45640 -1 Falling back to public interface 2024-09-12T00:31:20.946 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-09-12T00:31:20.947+0000 7f903c20b640 -1 Falling back to public interface 2024-09-12T00:31:20.949 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:31:21.167 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-09-12T00:31:21.168+0000 7fd0e2218640 -1 Falling back to public interface 2024-09-12T00:31:21.213 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-09-12T00:31:21.214+0000 7fbdcca18640 -1 Falling back to public interface 2024-09-12T00:31:21.215 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-12T00:31:21.216+0000 7f4d98c2f640 -1 Falling back to public interface 2024-09-12T00:31:21.428 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-12T00:31:21.429+0000 7f806d640640 -1 Falling back to public interface 2024-09-12T00:31:21.437 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-12T00:31:21.438+0000 7f583b012640 -1 Falling back to public interface 2024-09-12T00:31:23.404 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-12T00:31:23.403+0000 7f213ea81640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T00:31:23.404 INFO:tasks.ceph.mgr.x.smithi077.stderr:2024-09-12T00:31:23.404+0000 7f213ea81640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T00:31:24.272 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-12T00:31:24.273+0000 7f8bb9ba8640 -1 osd.5 0 log_to_monitors true 2024-09-12T00:31:24.529 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-09-12T00:31:24.530+0000 7f903c20b640 -1 osd.0 0 log_to_monitors true 2024-09-12T00:31:24.763 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-09-12T00:31:24.764+0000 7f6ca2f45640 -1 osd.2 0 log_to_monitors true 2024-09-12T00:31:24.956 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-09-12T00:31:24.957+0000 7fd0e2218640 -1 osd.1 0 log_to_monitors true 2024-09-12T00:31:24.965 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-12T00:31:24.966+0000 7f806d640640 -1 osd.4 0 log_to_monitors true 2024-09-12T00:31:25.285 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-09-12T00:31:25.286+0000 7fbdcca18640 -1 osd.3 0 log_to_monitors true 2024-09-12T00:31:25.530 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-12T00:31:25.531+0000 7f583b012640 -1 osd.7 0 log_to_monitors true 2024-09-12T00:31:25.550 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-12T00:31:25.551+0000 7f4d98c2f640 -1 osd.6 0 log_to_monitors true 2024-09-12T00:31:26.270 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-12T00:31:26.271+0000 7f8bb5b3c640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:31:26.293 INFO:tasks.ceph.osd.5.smithi077.stderr:2024-09-12T00:31:26.294+0000 7f8bad95b640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:31:27.301 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-12T00:31:27.302+0000 7f8069de8640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:31:27.312 INFO:tasks.ceph.osd.4.smithi077.stderr:2024-09-12T00:31:27.314+0000 7f80613f3640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:31:27.755 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:31:28.285 INFO:teuthology.misc.health.smithi062.stdout: 2024-09-12T00:31:28.285 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":14,"fsid":"96ca3065-0479-453c-a9a3-396e70051c3b","created":"2024-09-12T00:31:17.323087+0000","modified":"2024-09-12T00:31:27.406019+0000","last_up_change":"2024-09-12T00:31:27.406019+0000","last_in_change":"2024-09-12T00:31:19.681132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"6da28c6f-a13c-4f37-8ff1-8a4e33e22ca5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"9d244f54-e9a7-4574-876f-faeb37483f71","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f87e5588-6367-47e0-8786-7de4d746ca46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"8cd55f6b-48ff-4cb3-ab16-8f53ea750769","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"65af27ce-105f-4dd8-b963-64061b9a3e14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6817","nonce":3177889521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6819","nonce":3177889521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6823","nonce":3177889521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6821","nonce":3177889521}]},"public_addr":"172.21.15.77:6817/3177889521","cluster_addr":"172.21.15.77:6819/3177889521","heartbeat_back_addr":"172.21.15.77:6823/3177889521","heartbeat_front_addr":"172.21.15.77:6821/3177889521","state":["exists","up"]},{"osd":5,"uuid":"60dbda0d-1c25-4821-b67e-1df8c03847cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6801","nonce":200143849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6803","nonce":200143849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6807","nonce":200143849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6805","nonce":200143849}]},"public_addr":"172.21.15.77:6801/200143849","cluster_addr":"172.21.15.77:6803/200143849","heartbeat_back_addr":"172.21.15.77:6807/200143849","heartbeat_front_addr":"172.21.15.77:6805/200143849","state":["exists","up"]},{"osd":6,"uuid":"7d93020d-ee02-41f4-970b-05c3ad20e318","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e4ca495c-287b-4741-9b0d-53f121e90155","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.299243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:31:28.303 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-09-12T00:31:28.467 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-09-12T00:31:28.468+0000 7f9037bfe640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:31:28.485 INFO:tasks.ceph.osd.0.smithi062.stderr:2024-09-12T00:31:28.487+0000 7f902fa1d640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:31:28.563 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-09-12T00:31:28.564+0000 7fd0de3b5640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:31:28.566 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-09-12T00:31:28.567+0000 7f6c9eed9640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:31:28.573 INFO:tasks.ceph.osd.1.smithi062.stderr:2024-09-12T00:31:28.574+0000 7fd0d59c0640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:31:28.576 INFO:tasks.ceph.osd.2.smithi062.stderr:2024-09-12T00:31:28.578+0000 7f6c96cf8640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:31:28.587 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-09-12T00:31:28.589+0000 7fbdc842b640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:31:28.598 INFO:tasks.ceph.osd.3.smithi062.stderr:2024-09-12T00:31:28.599+0000 7fbdc024a640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:31:28.782 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-12T00:31:28.783+0000 7f58369de640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:31:28.793 INFO:tasks.ceph.osd.7.smithi077.stderr:2024-09-12T00:31:28.795+0000 7f582e7fd640 -1 osd.7 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:31:28.814 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-12T00:31:28.816+0000 7f4d953d7640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:31:28.825 INFO:tasks.ceph.osd.6.smithi077.stderr:2024-09-12T00:31:28.827+0000 7f4d8c9e2640 -1 osd.6 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:31:35.110 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:31:35.428 INFO:teuthology.misc.health.smithi062.stdout: 2024-09-12T00:31:35.428 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":17,"fsid":"96ca3065-0479-453c-a9a3-396e70051c3b","created":"2024-09-12T00:31:17.323087+0000","modified":"2024-09-12T00:31:30.747391+0000","last_up_change":"2024-09-12T00:31:29.740147+0000","last_in_change":"2024-09-12T00:31:19.681132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:31:28.413017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6da28c6f-a13c-4f37-8ff1-8a4e33e22ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6809","nonce":741930476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6811","nonce":741930476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6815","nonce":741930476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6813","nonce":741930476}]},"public_addr":"172.21.15.62:6809/741930476","cluster_addr":"172.21.15.62:6811/741930476","heartbeat_back_addr":"172.21.15.62:6815/741930476","heartbeat_front_addr":"172.21.15.62:6813/741930476","state":["exists","up"]},{"osd":1,"uuid":"9d244f54-e9a7-4574-876f-faeb37483f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6817","nonce":3104025159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6819","nonce":3104025159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6823","nonce":3104025159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6821","nonce":3104025159}]},"public_addr":"172.21.15.62:6817/3104025159","cluster_addr":"172.21.15.62:6819/3104025159","heartbeat_back_addr":"172.21.15.62:6823/3104025159","heartbeat_front_addr":"172.21.15.62:6821/3104025159","state":["exists","up"]},{"osd":2,"uuid":"f87e5588-6367-47e0-8786-7de4d746ca46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6801","nonce":3528810202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6803","nonce":3528810202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6807","nonce":3528810202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6805","nonce":3528810202}]},"public_addr":"172.21.15.62:6801/3528810202","cluster_addr":"172.21.15.62:6803/3528810202","heartbeat_back_addr":"172.21.15.62:6807/3528810202","heartbeat_front_addr":"172.21.15.62:6805/3528810202","state":["exists","up"]},{"osd":3,"uuid":"8cd55f6b-48ff-4cb3-ab16-8f53ea750769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6825","nonce":1212805223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6827","nonce":1212805223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6831","nonce":1212805223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6829","nonce":1212805223}]},"public_addr":"172.21.15.62:6825/1212805223","cluster_addr":"172.21.15.62:6827/1212805223","heartbeat_back_addr":"172.21.15.62:6831/1212805223","heartbeat_front_addr":"172.21.15.62:6829/1212805223","state":["exists","up"]},{"osd":4,"uuid":"65af27ce-105f-4dd8-b963-64061b9a3e14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6817","nonce":3177889521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6819","nonce":3177889521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6823","nonce":3177889521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6821","nonce":3177889521}]},"public_addr":"172.21.15.77:6817/3177889521","cluster_addr":"172.21.15.77:6819/3177889521","heartbeat_back_addr":"172.21.15.77:6823/3177889521","heartbeat_front_addr":"172.21.15.77:6821/3177889521","state":["exists","up"]},{"osd":5,"uuid":"60dbda0d-1c25-4821-b67e-1df8c03847cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6801","nonce":200143849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6803","nonce":200143849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6807","nonce":200143849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6805","nonce":200143849}]},"public_addr":"172.21.15.77:6801/200143849","cluster_addr":"172.21.15.77:6803/200143849","heartbeat_back_addr":"172.21.15.77:6807/200143849","heartbeat_front_addr":"172.21.15.77:6805/200143849","state":["exists","up"]},{"osd":6,"uuid":"7d93020d-ee02-41f4-970b-05c3ad20e318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6809","nonce":1500154120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6811","nonce":1500154120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6815","nonce":1500154120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6813","nonce":1500154120}]},"public_addr":"172.21.15.77:6809/1500154120","cluster_addr":"172.21.15.77:6811/1500154120","heartbeat_back_addr":"172.21.15.77:6815/1500154120","heartbeat_front_addr":"172.21.15.77:6813/1500154120","state":["exists","up"]},{"osd":7,"uuid":"e4ca495c-287b-4741-9b0d-53f121e90155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6825","nonce":2669672722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6827","nonce":2669672722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6831","nonce":2669672722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6829","nonce":2669672722}]},"public_addr":"172.21.15.77:6825/2669672722","cluster_addr":"172.21.15.77:6827/2669672722","heartbeat_back_addr":"172.21.15.77:6831/2669672722","heartbeat_front_addr":"172.21.15.77:6829/2669672722","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.580166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.958476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.776070+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:26.260747+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.918923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.299243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:26.525427+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:26.516270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:31:35.440 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T00:31:35.440 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:31:35.440 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:31:35.762 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'rbd' created 2024-09-12T00:31:35.778 DEBUG:teuthology.orchestra.run.smithi062:> rbd --cluster ceph pool init rbd 2024-09-12T00:31:35.845 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:35.845 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:38.811 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:31:38.812 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:31:38.813 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:31:39.139 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:31:39.151 INFO:teuthology.orchestra.run.smithi062.stdout:[{"version":9,"timestamp":"2024-09-12T00:31:28.817863+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"6467.148106"}]}] 2024-09-12T00:31:39.151 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T00:31:39.152 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:31:39.152 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:31:39.152 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:31:39.518 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:31:39.528 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"flags":0,"active_gid":4109,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6832","nonce":1419612558},{"type":"v1","addr":"172.21.15.77:6833","nonce":1419612558}]},"active_addr":"172.21.15.77:6833/1419612558","active_change":"2024-09-12T00:31:22.392346+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4103,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":2840278530}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":349826376}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":2560238716}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.77:0","nonce":1401198165}]}]} 2024-09-12T00:31:39.536 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:31:39.536 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:31:39.537 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:31:39.852 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:31:39.852 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"fsid":"96ca3065-0479-453c-a9a3-396e70051c3b","created":"2024-09-12T00:31:17.323087+0000","modified":"2024-09-12T00:31:38.776768+0000","last_up_change":"2024-09-12T00:31:29.740147+0000","last_in_change":"2024-09-12T00:31:19.681132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:31:28.413017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:31:35.753990+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6da28c6f-a13c-4f37-8ff1-8a4e33e22ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6809","nonce":741930476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6811","nonce":741930476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6815","nonce":741930476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6813","nonce":741930476}]},"public_addr":"172.21.15.62:6809/741930476","cluster_addr":"172.21.15.62:6811/741930476","heartbeat_back_addr":"172.21.15.62:6815/741930476","heartbeat_front_addr":"172.21.15.62:6813/741930476","state":["exists","up"]},{"osd":1,"uuid":"9d244f54-e9a7-4574-876f-faeb37483f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6817","nonce":3104025159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6819","nonce":3104025159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6823","nonce":3104025159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6821","nonce":3104025159}]},"public_addr":"172.21.15.62:6817/3104025159","cluster_addr":"172.21.15.62:6819/3104025159","heartbeat_back_addr":"172.21.15.62:6823/3104025159","heartbeat_front_addr":"172.21.15.62:6821/3104025159","state":["exists","up"]},{"osd":2,"uuid":"f87e5588-6367-47e0-8786-7de4d746ca46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6801","nonce":3528810202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6803","nonce":3528810202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6807","nonce":3528810202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6805","nonce":3528810202}]},"public_addr":"172.21.15.62:6801/3528810202","cluster_addr":"172.21.15.62:6803/3528810202","heartbeat_back_addr":"172.21.15.62:6807/3528810202","heartbeat_front_addr":"172.21.15.62:6805/3528810202","state":["exists","up"]},{"osd":3,"uuid":"8cd55f6b-48ff-4cb3-ab16-8f53ea750769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6825","nonce":1212805223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6827","nonce":1212805223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6831","nonce":1212805223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6829","nonce":1212805223}]},"public_addr":"172.21.15.62:6825/1212805223","cluster_addr":"172.21.15.62:6827/1212805223","heartbeat_back_addr":"172.21.15.62:6831/1212805223","heartbeat_front_addr":"172.21.15.62:6829/1212805223","state":["exists","up"]},{"osd":4,"uuid":"65af27ce-105f-4dd8-b963-64061b9a3e14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6817","nonce":3177889521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6819","nonce":3177889521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6823","nonce":3177889521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6821","nonce":3177889521}]},"public_addr":"172.21.15.77:6817/3177889521","cluster_addr":"172.21.15.77:6819/3177889521","heartbeat_back_addr":"172.21.15.77:6823/3177889521","heartbeat_front_addr":"172.21.15.77:6821/3177889521","state":["exists","up"]},{"osd":5,"uuid":"60dbda0d-1c25-4821-b67e-1df8c03847cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6801","nonce":200143849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6803","nonce":200143849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6807","nonce":200143849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6805","nonce":200143849}]},"public_addr":"172.21.15.77:6801/200143849","cluster_addr":"172.21.15.77:6803/200143849","heartbeat_back_addr":"172.21.15.77:6807/200143849","heartbeat_front_addr":"172.21.15.77:6805/200143849","state":["exists","up"]},{"osd":6,"uuid":"7d93020d-ee02-41f4-970b-05c3ad20e318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6809","nonce":1500154120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6811","nonce":1500154120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6815","nonce":1500154120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6813","nonce":1500154120}]},"public_addr":"172.21.15.77:6809/1500154120","cluster_addr":"172.21.15.77:6811/1500154120","heartbeat_back_addr":"172.21.15.77:6815/1500154120","heartbeat_front_addr":"172.21.15.77:6813/1500154120","state":["exists","up"]},{"osd":7,"uuid":"e4ca495c-287b-4741-9b0d-53f121e90155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6825","nonce":2669672722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6827","nonce":2669672722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6831","nonce":2669672722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6829","nonce":2669672722}]},"public_addr":"172.21.15.77:6825/2669672722","cluster_addr":"172.21.15.77:6827/2669672722","heartbeat_back_addr":"172.21.15.77:6831/2669672722","heartbeat_front_addr":"172.21.15.77:6829/2669672722","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.580166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.958476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.776070+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:26.260747+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.918923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.299243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:26.525427+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:26.516270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:31:39.865 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:31:39.865 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:31:40.180 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:31:40.180 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":21,"fsid":"96ca3065-0479-453c-a9a3-396e70051c3b","created":"2024-09-12T00:31:17.323087+0000","modified":"2024-09-12T00:31:38.776768+0000","last_up_change":"2024-09-12T00:31:29.740147+0000","last_in_change":"2024-09-12T00:31:19.681132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:31:28.413017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:31:35.753990+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6da28c6f-a13c-4f37-8ff1-8a4e33e22ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6809","nonce":741930476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6811","nonce":741930476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6815","nonce":741930476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6813","nonce":741930476}]},"public_addr":"172.21.15.62:6809/741930476","cluster_addr":"172.21.15.62:6811/741930476","heartbeat_back_addr":"172.21.15.62:6815/741930476","heartbeat_front_addr":"172.21.15.62:6813/741930476","state":["exists","up"]},{"osd":1,"uuid":"9d244f54-e9a7-4574-876f-faeb37483f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6817","nonce":3104025159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6819","nonce":3104025159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6823","nonce":3104025159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6821","nonce":3104025159}]},"public_addr":"172.21.15.62:6817/3104025159","cluster_addr":"172.21.15.62:6819/3104025159","heartbeat_back_addr":"172.21.15.62:6823/3104025159","heartbeat_front_addr":"172.21.15.62:6821/3104025159","state":["exists","up"]},{"osd":2,"uuid":"f87e5588-6367-47e0-8786-7de4d746ca46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6801","nonce":3528810202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6803","nonce":3528810202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6807","nonce":3528810202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6805","nonce":3528810202}]},"public_addr":"172.21.15.62:6801/3528810202","cluster_addr":"172.21.15.62:6803/3528810202","heartbeat_back_addr":"172.21.15.62:6807/3528810202","heartbeat_front_addr":"172.21.15.62:6805/3528810202","state":["exists","up"]},{"osd":3,"uuid":"8cd55f6b-48ff-4cb3-ab16-8f53ea750769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6825","nonce":1212805223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6827","nonce":1212805223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6831","nonce":1212805223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6829","nonce":1212805223}]},"public_addr":"172.21.15.62:6825/1212805223","cluster_addr":"172.21.15.62:6827/1212805223","heartbeat_back_addr":"172.21.15.62:6831/1212805223","heartbeat_front_addr":"172.21.15.62:6829/1212805223","state":["exists","up"]},{"osd":4,"uuid":"65af27ce-105f-4dd8-b963-64061b9a3e14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6817","nonce":3177889521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6819","nonce":3177889521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6823","nonce":3177889521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6821","nonce":3177889521}]},"public_addr":"172.21.15.77:6817/3177889521","cluster_addr":"172.21.15.77:6819/3177889521","heartbeat_back_addr":"172.21.15.77:6823/3177889521","heartbeat_front_addr":"172.21.15.77:6821/3177889521","state":["exists","up"]},{"osd":5,"uuid":"60dbda0d-1c25-4821-b67e-1df8c03847cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6801","nonce":200143849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6803","nonce":200143849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6807","nonce":200143849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6805","nonce":200143849}]},"public_addr":"172.21.15.77:6801/200143849","cluster_addr":"172.21.15.77:6803/200143849","heartbeat_back_addr":"172.21.15.77:6807/200143849","heartbeat_front_addr":"172.21.15.77:6805/200143849","state":["exists","up"]},{"osd":6,"uuid":"7d93020d-ee02-41f4-970b-05c3ad20e318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6809","nonce":1500154120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6811","nonce":1500154120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6815","nonce":1500154120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6813","nonce":1500154120}]},"public_addr":"172.21.15.77:6809/1500154120","cluster_addr":"172.21.15.77:6811/1500154120","heartbeat_back_addr":"172.21.15.77:6815/1500154120","heartbeat_front_addr":"172.21.15.77:6813/1500154120","state":["exists","up"]},{"osd":7,"uuid":"e4ca495c-287b-4741-9b0d-53f121e90155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6825","nonce":2669672722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6827","nonce":2669672722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6831","nonce":2669672722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6829","nonce":2669672722}]},"public_addr":"172.21.15.77:6825/2669672722","cluster_addr":"172.21.15.77:6827/2669672722","heartbeat_back_addr":"172.21.15.77:6831/2669672722","heartbeat_front_addr":"172.21.15.77:6829/2669672722","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.580166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.958476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.776070+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:26.260747+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.918923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.299243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:26.525427+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:26.516270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:31:40.193 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:31:40.193 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:31:40.194 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:31:40.195 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:31:40.195 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:31:40.196 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:31:40.196 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:31:40.196 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:31:40.467 INFO:teuthology.orchestra.run.smithi062.stdout:60129542149 2024-09-12T00:31:40.468 INFO:teuthology.orchestra.run.smithi062.stdout:68719476741 2024-09-12T00:31:40.469 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:31:40.469 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:31:40.470 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2024-09-12T00:31:40.470 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:31:40.471 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2024-09-12T00:31:40.472 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:31:40.473 INFO:teuthology.orchestra.run.smithi062.stdout:55834574854 2024-09-12T00:31:40.473 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:31:40.475 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2024-09-12T00:31:40.475 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:31:40.477 INFO:teuthology.orchestra.run.smithi062.stdout:64424509447 2024-09-12T00:31:40.477 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:31:40.479 INFO:teuthology.orchestra.run.smithi062.stdout:68719476742 2024-09-12T00:31:40.479 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:31:41.113 INFO:teuthology.orchestra.run.smithi062.stdout:60129542148 2024-09-12T00:31:41.126 INFO:teuthology.orchestra.run.smithi062.stdout:64424509445 2024-09-12T00:31:41.130 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2024-09-12T00:31:41.131 INFO:teuthology.orchestra.run.smithi062.stdout:64424509445 2024-09-12T00:31:41.133 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542148 for osd.4 2024-09-12T00:31:41.134 INFO:teuthology.orchestra.run.smithi062.stdout:68719476741 2024-09-12T00:31:41.134 INFO:teuthology.orchestra.run.smithi062.stdout:68719476740 2024-09-12T00:31:41.145 INFO:teuthology.orchestra.run.smithi062.stdout:55834574853 2024-09-12T00:31:41.150 INFO:teuthology.orchestra.run.smithi062.stdout:64424509445 2024-09-12T00:31:41.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.0 2024-09-12T00:31:41.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509446 for osd.3 2024-09-12T00:31:41.156 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.2 2024-09-12T00:31:41.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.7 2024-09-12T00:31:41.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476740 for osd.6 2024-09-12T00:31:41.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-09-12T00:31:41.167 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509445 for osd.1 2024-09-12T00:31:42.134 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:31:42.153 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:31:42.155 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:31:42.157 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:31:42.158 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:31:42.161 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:31:42.166 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:31:42.168 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:31:42.801 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2024-09-12T00:31:42.836 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-09-12T00:31:42.836 DEBUG:teuthology.parallel:result is None 2024-09-12T00:31:42.840 INFO:teuthology.orchestra.run.smithi062.stdout:64424509447 2024-09-12T00:31:42.856 INFO:teuthology.orchestra.run.smithi062.stdout:55834574854 2024-09-12T00:31:42.860 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-09-12T00:31:42.860 DEBUG:teuthology.parallel:result is None 2024-09-12T00:31:42.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-09-12T00:31:42.871 INFO:teuthology.orchestra.run.smithi062.stdout:68719476743 2024-09-12T00:31:42.871 DEBUG:teuthology.parallel:result is None 2024-09-12T00:31:42.888 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476743 for osd.7 2024-09-12T00:31:42.888 DEBUG:teuthology.parallel:result is None 2024-09-12T00:31:42.889 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2024-09-12T00:31:42.895 INFO:teuthology.orchestra.run.smithi062.stdout:60129542149 2024-09-12T00:31:42.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-09-12T00:31:42.903 DEBUG:teuthology.parallel:result is None 2024-09-12T00:31:42.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.4 2024-09-12T00:31:42.913 DEBUG:teuthology.parallel:result is None 2024-09-12T00:31:42.953 INFO:teuthology.orchestra.run.smithi062.stdout:64424509446 2024-09-12T00:31:42.955 INFO:teuthology.orchestra.run.smithi062.stdout:68719476742 2024-09-12T00:31:42.967 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.0 2024-09-12T00:31:42.968 DEBUG:teuthology.parallel:result is None 2024-09-12T00:31:42.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476742 for osd.6 2024-09-12T00:31:42.969 DEBUG:teuthology.parallel:result is None 2024-09-12T00:31:42.969 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:31:42.969 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:31:43.323 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:31:43.324 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T00:31:43.336 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-12T00:31:42.402799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223236,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751484,"statfs":{"total":773094113280,"available":772865519616,"internally_reserved":0,"allocated":2867200,"data_stored":1743694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001224"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.792390+0000","last_change":"2024-09-12T00:31:38.792390+0000","last_active":"2024-09-12T00:31:38.792390+0000","last_peered":"2024-09-12T00:31:38.792390+0000","last_clean":"2024-09-12T00:31:38.792390+0000","last_became_active":"2024-09-12T00:31:37.434487+0000","last_became_peered":"2024-09-12T00:31:37.434487+0000","last_unstale":"2024-09-12T00:31:38.792390+0000","last_undegraded":"2024-09-12T00:31:38.792390+0000","last_fullsized":"2024-09-12T00:31:38.792390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.146992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.828352+0000","last_change":"2024-09-12T00:31:38.828567+0000","last_active":"2024-09-12T00:31:38.828352+0000","last_peered":"2024-09-12T00:31:38.828352+0000","last_clean":"2024-09-12T00:31:38.828352+0000","last_became_active":"2024-09-12T00:31:37.434707+0000","last_became_peered":"2024-09-12T00:31:37.434707+0000","last_unstale":"2024-09-12T00:31:38.828352+0000","last_undegraded":"2024-09-12T00:31:38.828352+0000","last_fullsized":"2024-09-12T00:31:38.828352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:44.992055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041578299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.791827+0000","last_change":"2024-09-12T00:31:38.791827+0000","last_active":"2024-09-12T00:31:38.791827+0000","last_peered":"2024-09-12T00:31:38.791827+0000","last_clean":"2024-09-12T00:31:38.791827+0000","last_became_active":"2024-09-12T00:31:36.774289+0000","last_became_peered":"2024-09-12T00:31:36.774289+0000","last_unstale":"2024-09-12T00:31:38.791827+0000","last_undegraded":"2024-09-12T00:31:38.791827+0000","last_fullsized":"2024-09-12T00:31:38.791827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:55.526735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063853100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.786491+0000","last_change":"2024-09-12T00:31:38.786719+0000","last_active":"2024-09-12T00:31:38.786491+0000","last_peered":"2024-09-12T00:31:38.786491+0000","last_clean":"2024-09-12T00:31:38.786491+0000","last_became_active":"2024-09-12T00:31:37.736507+0000","last_became_peered":"2024-09-12T00:31:37.736507+0000","last_unstale":"2024-09-12T00:31:38.786491+0000","last_undegraded":"2024-09-12T00:31:38.786491+0000","last_fullsized":"2024-09-12T00:31:38.786491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:48.124334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050928200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.798131+0000","last_change":"2024-09-12T00:31:38.792511+0000","last_active":"2024-09-12T00:31:38.798131+0000","last_peered":"2024-09-12T00:31:38.798131+0000","last_clean":"2024-09-12T00:31:38.798131+0000","last_became_active":"2024-09-12T00:31:37.736683+0000","last_became_peered":"2024-09-12T00:31:37.736683+0000","last_unstale":"2024-09-12T00:31:38.798131+0000","last_undegraded":"2024-09-12T00:31:38.798131+0000","last_fullsized":"2024-09-12T00:31:38.798131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:32.835722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001295757,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.791033+0000","last_change":"2024-09-12T00:31:38.791033+0000","last_active":"2024-09-12T00:31:38.791033+0000","last_peered":"2024-09-12T00:31:38.791033+0000","last_clean":"2024-09-12T00:31:38.791033+0000","last_became_active":"2024-09-12T00:31:36.774484+0000","last_became_peered":"2024-09-12T00:31:36.774484+0000","last_unstale":"2024-09-12T00:31:38.791033+0000","last_undegraded":"2024-09-12T00:31:38.791033+0000","last_fullsized":"2024-09-12T00:31:38.791033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:00.370174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040283499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.791836+0000","last_change":"2024-09-12T00:31:38.791836+0000","last_active":"2024-09-12T00:31:38.791836+0000","last_peered":"2024-09-12T00:31:38.791836+0000","last_clean":"2024-09-12T00:31:38.791836+0000","last_became_active":"2024-09-12T00:31:36.772301+0000","last_became_peered":"2024-09-12T00:31:36.772301+0000","last_unstale":"2024-09-12T00:31:38.791836+0000","last_undegraded":"2024-09-12T00:31:38.791836+0000","last_fullsized":"2024-09-12T00:31:38.791836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:18.261088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070272599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.792167+0000","last_change":"2024-09-12T00:31:38.792167+0000","last_active":"2024-09-12T00:31:38.792167+0000","last_peered":"2024-09-12T00:31:38.792167+0000","last_clean":"2024-09-12T00:31:38.792167+0000","last_became_active":"2024-09-12T00:31:36.970959+0000","last_became_peered":"2024-09-12T00:31:36.970959+0000","last_unstale":"2024-09-12T00:31:38.792167+0000","last_undegraded":"2024-09-12T00:31:38.792167+0000","last_fullsized":"2024-09-12T00:31:38.792167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:16.364886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098350799999999991,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:39.457866+0000","last_change":"2024-09-12T00:31:29.750620+0000","last_active":"2024-09-12T00:31:39.457866+0000","last_peered":"2024-09-12T00:31:39.457866+0000","last_clean":"2024-09-12T00:31:39.457866+0000","last_became_active":"2024-09-12T00:31:29.750331+0000","last_became_peered":"2024-09-12T00:31:29.750331+0000","last_unstale":"2024-09-12T00:31:39.457866+0000","last_undegraded":"2024-09-12T00:31:39.457866+0000","last_fullsized":"2024-09-12T00:31:39.457866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:28.736382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:28.736382+0000","last_clean_scrub_stamp":"2024-09-12T00:31:28.736382+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:30.636870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476743,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":70365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":70384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":70384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":70365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":660733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":70365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":70365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":660733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:31:43.338 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:31:43.646 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:31:43.647 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T00:31:43.659 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-12T00:31:42.402799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223236,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751484,"statfs":{"total":773094113280,"available":772865519616,"internally_reserved":0,"allocated":2867200,"data_stored":1743694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001224"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.792390+0000","last_change":"2024-09-12T00:31:38.792390+0000","last_active":"2024-09-12T00:31:38.792390+0000","last_peered":"2024-09-12T00:31:38.792390+0000","last_clean":"2024-09-12T00:31:38.792390+0000","last_became_active":"2024-09-12T00:31:37.434487+0000","last_became_peered":"2024-09-12T00:31:37.434487+0000","last_unstale":"2024-09-12T00:31:38.792390+0000","last_undegraded":"2024-09-12T00:31:38.792390+0000","last_fullsized":"2024-09-12T00:31:38.792390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.146992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.828352+0000","last_change":"2024-09-12T00:31:38.828567+0000","last_active":"2024-09-12T00:31:38.828352+0000","last_peered":"2024-09-12T00:31:38.828352+0000","last_clean":"2024-09-12T00:31:38.828352+0000","last_became_active":"2024-09-12T00:31:37.434707+0000","last_became_peered":"2024-09-12T00:31:37.434707+0000","last_unstale":"2024-09-12T00:31:38.828352+0000","last_undegraded":"2024-09-12T00:31:38.828352+0000","last_fullsized":"2024-09-12T00:31:38.828352+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:44.992055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041578299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.791827+0000","last_change":"2024-09-12T00:31:38.791827+0000","last_active":"2024-09-12T00:31:38.791827+0000","last_peered":"2024-09-12T00:31:38.791827+0000","last_clean":"2024-09-12T00:31:38.791827+0000","last_became_active":"2024-09-12T00:31:36.774289+0000","last_became_peered":"2024-09-12T00:31:36.774289+0000","last_unstale":"2024-09-12T00:31:38.791827+0000","last_undegraded":"2024-09-12T00:31:38.791827+0000","last_fullsized":"2024-09-12T00:31:38.791827+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:55.526735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063853100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.786491+0000","last_change":"2024-09-12T00:31:38.786719+0000","last_active":"2024-09-12T00:31:38.786491+0000","last_peered":"2024-09-12T00:31:38.786491+0000","last_clean":"2024-09-12T00:31:38.786491+0000","last_became_active":"2024-09-12T00:31:37.736507+0000","last_became_peered":"2024-09-12T00:31:37.736507+0000","last_unstale":"2024-09-12T00:31:38.786491+0000","last_undegraded":"2024-09-12T00:31:38.786491+0000","last_fullsized":"2024-09-12T00:31:38.786491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:48.124334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050928200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.798131+0000","last_change":"2024-09-12T00:31:38.792511+0000","last_active":"2024-09-12T00:31:38.798131+0000","last_peered":"2024-09-12T00:31:38.798131+0000","last_clean":"2024-09-12T00:31:38.798131+0000","last_became_active":"2024-09-12T00:31:37.736683+0000","last_became_peered":"2024-09-12T00:31:37.736683+0000","last_unstale":"2024-09-12T00:31:38.798131+0000","last_undegraded":"2024-09-12T00:31:38.798131+0000","last_fullsized":"2024-09-12T00:31:38.798131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:32.835722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001295757,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.791033+0000","last_change":"2024-09-12T00:31:38.791033+0000","last_active":"2024-09-12T00:31:38.791033+0000","last_peered":"2024-09-12T00:31:38.791033+0000","last_clean":"2024-09-12T00:31:38.791033+0000","last_became_active":"2024-09-12T00:31:36.774484+0000","last_became_peered":"2024-09-12T00:31:36.774484+0000","last_unstale":"2024-09-12T00:31:38.791033+0000","last_undegraded":"2024-09-12T00:31:38.791033+0000","last_fullsized":"2024-09-12T00:31:38.791033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:00.370174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040283499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.791836+0000","last_change":"2024-09-12T00:31:38.791836+0000","last_active":"2024-09-12T00:31:38.791836+0000","last_peered":"2024-09-12T00:31:38.791836+0000","last_clean":"2024-09-12T00:31:38.791836+0000","last_became_active":"2024-09-12T00:31:36.772301+0000","last_became_peered":"2024-09-12T00:31:36.772301+0000","last_unstale":"2024-09-12T00:31:38.791836+0000","last_undegraded":"2024-09-12T00:31:38.791836+0000","last_fullsized":"2024-09-12T00:31:38.791836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:18.261088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070272599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:38.792167+0000","last_change":"2024-09-12T00:31:38.792167+0000","last_active":"2024-09-12T00:31:38.792167+0000","last_peered":"2024-09-12T00:31:38.792167+0000","last_clean":"2024-09-12T00:31:38.792167+0000","last_became_active":"2024-09-12T00:31:36.970959+0000","last_became_peered":"2024-09-12T00:31:36.970959+0000","last_unstale":"2024-09-12T00:31:38.792167+0000","last_undegraded":"2024-09-12T00:31:38.792167+0000","last_fullsized":"2024-09-12T00:31:38.792167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:16.364886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098350799999999991,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":111,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-12T00:31:39.457866+0000","last_change":"2024-09-12T00:31:29.750620+0000","last_active":"2024-09-12T00:31:39.457866+0000","last_peered":"2024-09-12T00:31:39.457866+0000","last_clean":"2024-09-12T00:31:39.457866+0000","last_became_active":"2024-09-12T00:31:29.750331+0000","last_became_peered":"2024-09-12T00:31:29.750331+0000","last_unstale":"2024-09-12T00:31:39.457866+0000","last_undegraded":"2024-09-12T00:31:39.457866+0000","last_fullsized":"2024-09-12T00:31:39.457866+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:28.736382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:28.736382+0000","last_clean_scrub_stamp":"2024-09-12T00:31:28.736382+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:30.636870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476743,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":70365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476742,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":70384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":212992,"data_stored":70384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":70365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":802816,"data_stored":660733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":70365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":70365,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":802816,"data_stored":660733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:31:43.660 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:31:43.660 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:31:43.660 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:31:43.660 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:31:44.012 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:31:44.012 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:31:44.025 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:31:44.025 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T00:31:44.037 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:31:44.062 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-12T00:31:44.062 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:31:44.062 INFO:tasks.rgw:Creating data pools 2024-09-12T00:31:44.062 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:31:44.062 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-12T00:31:44.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T00:31:46.807 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:31:46.838 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:31:48.107 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:31:48.123 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:31:49.121 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:31:49.139 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:31:50.110 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:31:50.136 DEBUG:tasks.rgw:Pools created 2024-09-12T00:31:50.137 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T00:31:50.137 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:31:50.137 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:31:50.137 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:31:50.251 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:50.251 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:52.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.183+0000 7f57e7146640 0 -- 172.21.15.62:0/976376964 >> [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] conn(0x7f56bc076380 msgr2=0x7f56bc078840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:52.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.187+0000 7f57ead2c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:52.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.188+0000 7f57e7146640 0 -- 172.21.15.62:0/3000763302 >> [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] conn(0x7f56ac076470 msgr2=0x7f56ac078930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:52.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.189+0000 7f57ead2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:52.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.189+0000 7f57ead2c800 20 realm 2024-09-12T00:31:52.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.189+0000 7f57ead2c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:52.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.189+0000 7f57ead2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:52.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.189+0000 7f57ead2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:52.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.189+0000 7f57ead2c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:52.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.190+0000 7f57ead2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:52.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.190+0000 7f57ead2c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:52.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.190+0000 7f57ead2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:52.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.190+0000 7f57ead2c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:52.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.191+0000 7f57ead2c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:31:52.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.191+0000 7f57ead2c800 20 searching for the correct realm 2024-09-12T00:31:52.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.202+0000 7f57ead2c800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:31:52.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.202+0000 7f57ead2c800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:31:52.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.202+0000 7f57ead2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:52.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.202+0000 7f57ead2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:52.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.202+0000 7f57ead2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:52.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.202+0000 7f57ead2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:52.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.202+0000 7f57ead2c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:52.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.203+0000 7f57ead2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:52.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.203+0000 7f57ead2c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:52.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.203+0000 7f57ead2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:52.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.203+0000 7f57ead2c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:52.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.204+0000 7f57ead2c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:31:52.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.204+0000 7f57ead2c800 20 zone default found 2024-09-12T00:31:52.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.204+0000 7f57ead2c800 4 Realm: () 2024-09-12T00:31:52.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.204+0000 7f57ead2c800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:31:52.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.204+0000 7f57ead2c800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:31:52.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.204+0000 7f57ead2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:52.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.204+0000 7f57ead2c800 20 zonegroup default 2024-09-12T00:31:52.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.204+0000 7f57ead2c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:52.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.204+0000 7f57ead2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:52.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:52.204+0000 7f57ead2c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:54.168+0000 7f57ead2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:54.168+0000 7f57ead2c800 20 rados->read ofs=0 len=0 2024-09-12T00:31:54.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:54.168+0000 7f57ead2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:54.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:54.168+0000 7f57ead2c800 20 started sync module instance, tier type = 2024-09-12T00:31:54.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:54.168+0000 7f57ead2c800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:31:56.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.197+0000 7f57ead2c800 20 add_watcher() i=0 2024-09-12T00:31:56.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.197+0000 7f57ead2c800 20 add_watcher() i=1 2024-09-12T00:31:56.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.197+0000 7f57ead2c800 20 add_watcher() i=2 2024-09-12T00:31:56.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.197+0000 7f57ead2c800 20 add_watcher() i=3 2024-09-12T00:31:56.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.197+0000 7f57ead2c800 20 add_watcher() i=4 2024-09-12T00:31:56.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.197+0000 7f57ead2c800 20 add_watcher() i=5 2024-09-12T00:31:56.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.197+0000 7f57ead2c800 20 add_watcher() i=6 2024-09-12T00:31:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.199+0000 7f57ead2c800 20 add_watcher() i=7 2024-09-12T00:31:56.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.199+0000 7f57ead2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.200+0000 7f57ead2c800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T00:31:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.200+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T00:31:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.200+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.200+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T00:31:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.200+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T00:31:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.200+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.200+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T00:31:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.200+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T00:31:56.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.200+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.200+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T00:31:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.200+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T00:31:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.200+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.201+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T00:31:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.201+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T00:31:56.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.201+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.201+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T00:31:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.201+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T00:31:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.201+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.201+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T00:31:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.201+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T00:31:56.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.201+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.202+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T00:31:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.202+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T00:31:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.202+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.202+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T00:31:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.202+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T00:31:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.202+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.202+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T00:31:56.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.202+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T00:31:56.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.202+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.203+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T00:31:56.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.203+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T00:31:56.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.203+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.203+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T00:31:56.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.203+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T00:31:56.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.203+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.203+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T00:31:56.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.203+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T00:31:56.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.203+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.204+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T00:31:56.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.204+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T00:31:56.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.204+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.204+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T00:31:56.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.204+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T00:31:56.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.204+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.204+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T00:31:56.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.204+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T00:31:56.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.204+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.204+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T00:31:56.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.204+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T00:31:56.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.204+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.205+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T00:31:56.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.205+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T00:31:56.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.205+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.205+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T00:31:56.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.205+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T00:31:56.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.205+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.205+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T00:31:56.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.205+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T00:31:56.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.205+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.206+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T00:31:56.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.206+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T00:31:56.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.206+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.206+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T00:31:56.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.206+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T00:31:56.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.206+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.206+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T00:31:56.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.206+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T00:31:56.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.206+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.206+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T00:31:56.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.206+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T00:31:56.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.206+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.207+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T00:31:56.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.207+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T00:31:56.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.207+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.207+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T00:31:56.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.207+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T00:31:56.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.207+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.207+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T00:31:56.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.207+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T00:31:56.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.207+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.207+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T00:31:56.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.207+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T00:31:56.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.207+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.208+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T00:31:56.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.208+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T00:31:56.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.208+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.208+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T00:31:56.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.208+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T00:31:56.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.208+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.208+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T00:31:56.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.208+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T00:31:56.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.208+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.209+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T00:31:56.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.209+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T00:31:56.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.209+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.209+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T00:31:56.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.209+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T00:31:56.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.209+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.209+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T00:31:56.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.209+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T00:31:56.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.209+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.209+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T00:31:56.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.209+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T00:31:56.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.209+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.210+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T00:31:56.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.210+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T00:31:56.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.210+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.210+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T00:31:56.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.210+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T00:31:56.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.210+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.210+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T00:31:56.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.210+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T00:31:56.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.210+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.210+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T00:31:56.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.210+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T00:31:56.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.210+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.211+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T00:31:56.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.211+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T00:31:56.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.211+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.211+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T00:31:56.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.211+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T00:31:56.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.211+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.211+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T00:31:56.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.211+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T00:31:56.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.211+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.212+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T00:31:56.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.212+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T00:31:56.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.212+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.212+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T00:31:56.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.212+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T00:31:56.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.212+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.212+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T00:31:56.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.212+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T00:31:56.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.212+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.212+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T00:31:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.212+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T00:31:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.212+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.213+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T00:31:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.213+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T00:31:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.213+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.213+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T00:31:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.213+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T00:31:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.213+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.213+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T00:31:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.213+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T00:31:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.213+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.214+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T00:31:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.214+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T00:31:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.214+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.214+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T00:31:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.214+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T00:31:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.214+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.214+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T00:31:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.214+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T00:31:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.214+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.214+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T00:31:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.214+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T00:31:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.214+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.215+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T00:31:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.215+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T00:31:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.215+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.215+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T00:31:56.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.215+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T00:31:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.215+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.215+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T00:31:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.215+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T00:31:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.215+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.215+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T00:31:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.215+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T00:31:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.215+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.216+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T00:31:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.216+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T00:31:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.216+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.216+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T00:31:56.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.216+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T00:31:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.216+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.216+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T00:31:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.216+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T00:31:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.216+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.217+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T00:31:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.217+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T00:31:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.217+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.217+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T00:31:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.217+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T00:31:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.217+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.217+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T00:31:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.217+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T00:31:56.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.217+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.218+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T00:31:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.218+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T00:31:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.218+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.218+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T00:31:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.218+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T00:31:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.218+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.218+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T00:31:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.218+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T00:31:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.218+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.218+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T00:31:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.218+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T00:31:56.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.218+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.219+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T00:31:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.219+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T00:31:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.219+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.219+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T00:31:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.219+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T00:31:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.219+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.219+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T00:31:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.219+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T00:31:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.219+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.219+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T00:31:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.219+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T00:31:56.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.219+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.220+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T00:31:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.220+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T00:31:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.220+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.220+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T00:31:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.220+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T00:31:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.220+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.220+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T00:31:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.220+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T00:31:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.220+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.220+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T00:31:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.220+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T00:31:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.220+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.221+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T00:31:56.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.221+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T00:31:56.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.221+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.221+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T00:31:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.221+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T00:31:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.221+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.221+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T00:31:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.221+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T00:31:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.221+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.222+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T00:31:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.222+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T00:31:56.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.222+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.222+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T00:31:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.222+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T00:31:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.222+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.222+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T00:31:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.222+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T00:31:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.222+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.223+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T00:31:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.223+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T00:31:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.223+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.223+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T00:31:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.223+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T00:31:56.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.223+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.223+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T00:31:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.223+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T00:31:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.223+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.224+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T00:31:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.224+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T00:31:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.224+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.224+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T00:31:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.224+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T00:31:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.224+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.225+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T00:31:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.225+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T00:31:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.225+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.225+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T00:31:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.225+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T00:31:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.225+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.225+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T00:31:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.225+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T00:31:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.225+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.225+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T00:31:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.225+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T00:31:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.225+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.226+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T00:31:56.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.226+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T00:31:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.226+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.226+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T00:31:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.226+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T00:31:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.226+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.226+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T00:31:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.226+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T00:31:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.226+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.226+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T00:31:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.226+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T00:31:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.226+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.227+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T00:31:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.227+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T00:31:56.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.227+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.227+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T00:31:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.227+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T00:31:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.227+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.227+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T00:31:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.227+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T00:31:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.227+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.227+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T00:31:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.227+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T00:31:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.227+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.228+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T00:31:56.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.228+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T00:31:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.228+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.228+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T00:31:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.228+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T00:31:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.228+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.228+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T00:31:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.228+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T00:31:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.228+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.228+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T00:31:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.228+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T00:31:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.228+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.229+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T00:31:56.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.229+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T00:31:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.229+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.229+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T00:31:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.229+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T00:31:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.229+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.230+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T00:31:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.230+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T00:31:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.230+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.230+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T00:31:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.230+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T00:31:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.230+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.230+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T00:31:56.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.230+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T00:31:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.230+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.230+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T00:31:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.230+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T00:31:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.230+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.231+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T00:31:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.231+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T00:31:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.231+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.231+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T00:31:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.231+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T00:31:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.231+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.231+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T00:31:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.231+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T00:31:56.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.231+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.231+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T00:31:56.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.231+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T00:31:56.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.231+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.232+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T00:31:56.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.232+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T00:31:56.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.232+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.232+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T00:31:56.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.232+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T00:31:56.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.232+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.232+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T00:31:56.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.232+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T00:31:56.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.232+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.232+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T00:31:56.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.232+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T00:31:56.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.232+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.233+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T00:31:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.233+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T00:31:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.233+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.233+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T00:31:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.233+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T00:31:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.233+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.233+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T00:31:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.233+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T00:31:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.233+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.233+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T00:31:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.233+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T00:31:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.233+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.234+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T00:31:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.234+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T00:31:56.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.234+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.234+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T00:31:56.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.234+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T00:31:56.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.234+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.234+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T00:31:56.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.234+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T00:31:56.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.234+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.234+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T00:31:56.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.234+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T00:31:56.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.234+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.235+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T00:31:56.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.235+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T00:31:56.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.235+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.235+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T00:31:56.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.235+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T00:31:56.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.235+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.235+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T00:31:56.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.235+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T00:31:56.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.235+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.235+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T00:31:56.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.235+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T00:31:56.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.235+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.236+0000 7f57ead2c800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T00:31:56.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.236+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T00:31:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.237+0000 7f57ead2c800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:31:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.244+0000 7f56997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.244+0000 7f57ead2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:56.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:56.244+0000 7f57ead2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:59.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.176+0000 7f57ead2c800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T00:31:59.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.176+0000 7f57ead2c800 5 note: GC not initialized 2024-09-12T00:31:59.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.176+0000 7f55fbfff640 20 reqs_thread_entry: start 2024-09-12T00:31:59.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.177+0000 7f57ead2c800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:59.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.177+0000 7f57ead2c800 20 Filter name: none 2024-09-12T00:31:59.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.177+0000 7f55f9ffb640 20 reqs_thread_entry: start 2024-09-12T00:31:59.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.206+0000 7f56997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:59.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.209+0000 7f57ead2c800 20 remove_watcher() i=0 2024-09-12T00:31:59.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.209+0000 7f57ead2c800 2 removed watcher, disabling cache 2024-09-12T00:31:59.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.210+0000 7f57ead2c800 20 remove_watcher() i=1 2024-09-12T00:31:59.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.211+0000 7f57ead2c800 20 remove_watcher() i=2 2024-09-12T00:31:59.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.213+0000 7f57ead2c800 20 remove_watcher() i=3 2024-09-12T00:31:59.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.215+0000 7f57ead2c800 20 remove_watcher() i=4 2024-09-12T00:31:59.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.216+0000 7f57ead2c800 20 remove_watcher() i=5 2024-09-12T00:31:59.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.220+0000 7f57ead2c800 20 remove_watcher() i=6 2024-09-12T00:31:59.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.221+0000 7f57ead2c800 20 remove_watcher() i=7 2024-09-12T00:31:59.239 INFO:teuthology.orchestra.run.smithi062.stdout:[] 2024-09-12T00:31:59.239 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:31:59.240 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:31:59.240 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:31:59.240 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T00:31:59.308 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:59.308 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.338+0000 7f1ee7c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:59.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.338+0000 7f1ee7c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:59.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.342+0000 7f1d237fe640 20 reqs_thread_entry: start 2024-09-12T00:31:59.358 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"8f0c480c-ec81-4324-89bc-22952673ff0b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:31:59.358 DEBUG:tasks.util.rgw: json result: {'id': '8f0c480c-ec81-4324-89bc-22952673ff0b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:31:59.359 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:31:59.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:31:59.359 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:31:59.416 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:59.416 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:59.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.453+0000 7f23cbd1f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.455+0000 7f23cbd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.455+0000 7f23cbd1f800 20 realm 2024-09-12T00:31:59.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.455+0000 7f23cbd1f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.455+0000 7f23cbd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.455+0000 7f23cbd1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:59.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.455+0000 7f23cbd1f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.456+0000 7f23cbd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.456+0000 7f23cbd1f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.456+0000 7f23cbd1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:59.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.456+0000 7f23cbd1f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.457+0000 7f23cbd1f800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:31:59.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.457+0000 7f23cbd1f800 20 searching for the correct realm 2024-09-12T00:31:59.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.460+0000 7f23c720b640 0 -- 172.21.15.62:0/2485128676 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f23c0066a10 msgr2=0x7f23c009e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:59.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.666+0000 7f23c820d640 0 -- 172.21.15.62:0/2485128676 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55c8a9ecbef0 msgr2=0x55c8a9ece380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:59.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.670+0000 7f23cbd1f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:31:59.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.670+0000 7f23cbd1f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:31:59.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.670+0000 7f23cbd1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:59.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.670+0000 7f23cbd1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:59.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.670+0000 7f23cbd1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:59.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.670+0000 7f23cbd1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:59.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.670+0000 7f23cbd1f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.670+0000 7f23cbd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.670+0000 7f23cbd1f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.670+0000 7f23cbd1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:59.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.670+0000 7f23cbd1f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.671+0000 7f23cbd1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:31:59.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.671+0000 7f23cbd1f800 20 zone default found 2024-09-12T00:31:59.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.671+0000 7f23cbd1f800 4 Realm: () 2024-09-12T00:31:59.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.671+0000 7f23cbd1f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:31:59.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.671+0000 7f23cbd1f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:31:59.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.671+0000 7f23cbd1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:59.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.671+0000 7f23cbd1f800 20 zonegroup default 2024-09-12T00:31:59.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.671+0000 7f23cbd1f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.671+0000 7f23cbd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.671+0000 7f23cbd1f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.671+0000 7f23cbd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.671+0000 7f23cbd1f800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.672+0000 7f23cbd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.672+0000 7f23cbd1f800 20 started sync module instance, tier type = 2024-09-12T00:31:59.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.672+0000 7f23cbd1f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:31:59.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.686+0000 7f23cbd1f800 20 add_watcher() i=0 2024-09-12T00:31:59.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.686+0000 7f23cbd1f800 20 add_watcher() i=1 2024-09-12T00:31:59.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.686+0000 7f23cbd1f800 20 add_watcher() i=2 2024-09-12T00:31:59.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.686+0000 7f23cbd1f800 20 add_watcher() i=3 2024-09-12T00:31:59.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.686+0000 7f23cbd1f800 20 add_watcher() i=4 2024-09-12T00:31:59.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.686+0000 7f23cbd1f800 20 add_watcher() i=5 2024-09-12T00:31:59.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.686+0000 7f23cbd1f800 20 add_watcher() i=6 2024-09-12T00:31:59.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.687+0000 7f23cbd1f800 20 add_watcher() i=7 2024-09-12T00:31:59.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.687+0000 7f23cbd1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:59.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.690+0000 7f227dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:59.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.690+0000 7f23cbd1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:59.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.690+0000 7f23cbd1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:59.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.690+0000 7f23cbd1f800 5 note: GC not initialized 2024-09-12T00:31:59.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.690+0000 7f227cfe1640 20 reqs_thread_entry: start 2024-09-12T00:31:59.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.690+0000 7f23cbd1f800 20 init_complete bucket index max shards: 1 2024-09-12T00:31:59.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.690+0000 7f23cbd1f800 20 Filter name: none 2024-09-12T00:31:59.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.690+0000 7f21f67fc640 20 reqs_thread_entry: start 2024-09-12T00:31:59.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.700+0000 7f227dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:59.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.702+0000 7f23cbd1f800 20 remove_watcher() i=0 2024-09-12T00:31:59.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.702+0000 7f23cbd1f800 2 removed watcher, disabling cache 2024-09-12T00:31:59.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.703+0000 7f23cbd1f800 20 remove_watcher() i=1 2024-09-12T00:31:59.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.705+0000 7f23cbd1f800 20 remove_watcher() i=2 2024-09-12T00:31:59.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.706+0000 7f23cbd1f800 20 remove_watcher() i=3 2024-09-12T00:31:59.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.708+0000 7f23cbd1f800 20 remove_watcher() i=4 2024-09-12T00:31:59.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.710+0000 7f23cbd1f800 20 remove_watcher() i=5 2024-09-12T00:31:59.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.711+0000 7f23cbd1f800 20 remove_watcher() i=6 2024-09-12T00:31:59.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.712+0000 7f23cbd1f800 20 remove_watcher() i=7 2024-09-12T00:31:59.722 INFO:teuthology.orchestra.run.smithi062.stdout:[] 2024-09-12T00:31:59.722 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:31:59.722 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:31:59.722 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-12T00:31:59.723 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-12T00:31:59.786 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:59.786 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:59.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.814+0000 7f9851b35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:59.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.814+0000 7f9851b35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:59.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.818+0000 7f9710fe1640 20 reqs_thread_entry: start 2024-09-12T00:31:59.833 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"8f0c480c-ec81-4324-89bc-22952673ff0b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:31:59.833 DEBUG:tasks.util.rgw: json result: {'id': '8f0c480c-ec81-4324-89bc-22952673ff0b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:31:59.833 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:31:59.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:31:59.834 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:31:59.891 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:59.891 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:59.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.927+0000 7fb5851af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.929+0000 7fb5851af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.929+0000 7fb5851af800 20 realm 2024-09-12T00:31:59.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.929+0000 7fb5851af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.929+0000 7fb5851af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.929+0000 7fb5851af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:59.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.929+0000 7fb5851af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.929+0000 7fb5851af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.929+0000 7fb5851af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.930+0000 7fb5851af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:59.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.930+0000 7fb5851af800 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.931+0000 7fb5851af800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:31:59.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.931+0000 7fb5851af800 20 searching for the correct realm 2024-09-12T00:31:59.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:31:59.934+0000 7fb582498640 0 -- 172.21.15.62:0/2747154408 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fb57c00f430 msgr2=0x7fb57c00f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:00.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.139+0000 7fb58349a640 0 -- 172.21.15.62:0/2747154408 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x559b87fa42b0 msgr2=0x559b87fa66c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:00.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.143+0000 7fb5851af800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:32:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.143+0000 7fb5851af800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:32:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.143+0000 7fb5851af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.143+0000 7fb5851af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.143+0000 7fb5851af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.143+0000 7fb5851af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.143+0000 7fb5851af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.144+0000 7fb5851af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.144+0000 7fb5851af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.144+0000 7fb5851af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:00.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.144+0000 7fb5851af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.144+0000 7fb5851af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:32:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.144+0000 7fb5851af800 20 zone default found 2024-09-12T00:32:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.144+0000 7fb5851af800 4 Realm: () 2024-09-12T00:32:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.144+0000 7fb5851af800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:32:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.144+0000 7fb5851af800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:32:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.144+0000 7fb5851af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.144+0000 7fb5851af800 20 zonegroup default 2024-09-12T00:32:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.144+0000 7fb5851af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.145+0000 7fb5851af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.145+0000 7fb5851af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.145+0000 7fb5851af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.145+0000 7fb5851af800 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.145+0000 7fb5851af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.145+0000 7fb5851af800 20 started sync module instance, tier type = 2024-09-12T00:32:00.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.145+0000 7fb5851af800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:32:00.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.157+0000 7fb5851af800 20 add_watcher() i=0 2024-09-12T00:32:00.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.157+0000 7fb5851af800 20 add_watcher() i=1 2024-09-12T00:32:00.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.157+0000 7fb5851af800 20 add_watcher() i=2 2024-09-12T00:32:00.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.157+0000 7fb5851af800 20 add_watcher() i=3 2024-09-12T00:32:00.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.157+0000 7fb5851af800 20 add_watcher() i=4 2024-09-12T00:32:00.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.157+0000 7fb5851af800 20 add_watcher() i=5 2024-09-12T00:32:00.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.157+0000 7fb5851af800 20 add_watcher() i=6 2024-09-12T00:32:00.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.159+0000 7fb5851af800 20 add_watcher() i=7 2024-09-12T00:32:00.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.159+0000 7fb5851af800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.161+0000 7fb4397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.161+0000 7fb5851af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.161+0000 7fb5851af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.161+0000 7fb5851af800 5 note: GC not initialized 2024-09-12T00:32:00.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.161+0000 7fb3b3fff640 20 reqs_thread_entry: start 2024-09-12T00:32:00.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.161+0000 7fb5851af800 20 init_complete bucket index max shards: 1 2024-09-12T00:32:00.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.161+0000 7fb5851af800 20 Filter name: none 2024-09-12T00:32:00.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.161+0000 7fb3b1ffb640 20 reqs_thread_entry: start 2024-09-12T00:32:00.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.171+0000 7fb4397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:00.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.173+0000 7fb5851af800 20 remove_watcher() i=0 2024-09-12T00:32:00.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.173+0000 7fb5851af800 2 removed watcher, disabling cache 2024-09-12T00:32:00.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.175+0000 7fb5851af800 20 remove_watcher() i=1 2024-09-12T00:32:00.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.176+0000 7fb5851af800 20 remove_watcher() i=2 2024-09-12T00:32:00.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.177+0000 7fb5851af800 20 remove_watcher() i=3 2024-09-12T00:32:00.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.178+0000 7fb5851af800 20 remove_watcher() i=4 2024-09-12T00:32:00.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.180+0000 7fb5851af800 20 remove_watcher() i=5 2024-09-12T00:32:00.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.181+0000 7fb5851af800 20 remove_watcher() i=6 2024-09-12T00:32:00.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.182+0000 7fb5851af800 20 remove_watcher() i=7 2024-09-12T00:32:00.192 INFO:teuthology.orchestra.run.smithi062.stdout:[] 2024-09-12T00:32:00.192 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:32:00.192 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T00:32:00.192 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:32:00.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:32:00.192 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T00:32:00.257 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:00.257 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:00.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.285+0000 7f5902f31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:00.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.285+0000 7f5902f31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:00.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.289+0000 7f57c17e2640 20 reqs_thread_entry: start 2024-09-12T00:32:00.303 INFO:teuthology.orchestra.run.smithi062.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T00:32:00.303 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T00:32:00.303 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:32:00.303 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:32:00.303 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T00:32:00.369 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:00.369 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:00.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.398+0000 7fe556535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:00.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.398+0000 7fe556535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:00.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.402+0000 7fe414fe1640 20 reqs_thread_entry: start 2024-09-12T00:32:00.416 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"8f0c480c-ec81-4324-89bc-22952673ff0b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:32:00.417 DEBUG:tasks.util.rgw: json result: {'id': '8f0c480c-ec81-4324-89bc-22952673ff0b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:32:00.417 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T00:32:00.417 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:32:00.417 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:32:00.418 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T00:32:00.481 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:00.481 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:00.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.510+0000 7f072770c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:00.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.510+0000 7f072770c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:00.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.513+0000 7f05e8fd9640 20 reqs_thread_entry: start 2024-09-12T00:32:00.527 INFO:teuthology.orchestra.run.smithi062.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T00:32:00.527 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T00:32:00.528 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:32:00.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:32:00.528 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T00:32:00.594 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:00.594 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:00.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.622+0000 7efdf8f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:00.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.622+0000 7efdf8f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:00.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:32:00.626+0000 7efcb37fe640 20 reqs_thread_entry: start 2024-09-12T00:32:00.641 INFO:teuthology.orchestra.run.smithi062.stdout:{"id":"8f0c480c-ec81-4324-89bc-22952673ff0b","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-12T00:32:00.641 DEBUG:tasks.util.rgw: json result: {'id': '8f0c480c-ec81-4324-89bc-22952673ff0b', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-12T00:32:00.641 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:32:00.642 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-12T00:32:00.642 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:32:00.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo echo -n http://smithi062.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:32:00.683 INFO:teuthology.orchestra.run.smithi062.stdout:http://smithi062.front.sepia.ceph.com:80 2024-09-12T00:32:00.683 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:32:00.763 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-12T00:32:00.763 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:32:00.764 DEBUG:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:32:00.806 INFO:tasks.rgw.client.0:Started 2024-09-12T00:32:00.806 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi062.front.sepia.ceph.com:80/ 2024-09-12T00:32:00.806 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-09-12T00:32:00.854 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:32:00.855 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:32:00.855 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:32:00.855 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:32:00.855 INFO:teuthology.orchestra.run.smithi062.stderr:curl: (7) Failed to connect to smithi062.front.sepia.ceph.com port 80: Connection refused 2024-09-12T00:32:01.856 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-09-12T00:32:01.893 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:32:01.893 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:32:01.895 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:32:01.896 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:32:01.896 INFO:teuthology.orchestra.run.smithi062.stderr:curl: (7) Failed to connect to smithi062.front.sepia.ceph.com port 80: Connection refused 2024-09-12T00:32:03.896 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-09-12T00:32:03.930 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:32:03.930 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:32:03.932 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:32:03.932 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:32:03.932 INFO:teuthology.orchestra.run.smithi062.stderr:curl: (7) Failed to connect to smithi062.front.sepia.ceph.com port 80: Connection refused 2024-09-12T00:32:07.933 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-09-12T00:32:07.969 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:32:07.969 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:32:07.971 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:32:07.971 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:32:07.971 INFO:teuthology.orchestra.run.smithi062.stderr:curl: (7) Failed to connect to smithi062.front.sepia.ceph.com port 80: Connection refused 2024-09-12T00:32:15.973 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-09-12T00:32:16.007 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:32:16.008 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:32:16.008 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:32:16.008 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:32:16.008 INFO:teuthology.orchestra.run.smithi062.stderr:curl: (7) Failed to connect to smithi062.front.sepia.ceph.com port 80: Connection refused 2024-09-12T00:32:32.009 DEBUG:teuthology.orchestra.run.smithi062:> curl http://smithi062.front.sepia.ceph.com:80/ 2024-09-12T00:32:32.049 INFO:teuthology.orchestra.run.smithi062.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:32:32.050 INFO:teuthology.orchestra.run.smithi062.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:32:32.376 INFO:teuthology.orchestra.run.smithi062.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 573 0 --:--:-- --:--:-- --:--:-- 573 2024-09-12T00:32:32.377 INFO:teuthology.orchestra.run.smithi062.stdout:anonymous 2024-09-12T00:32:32.377 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T00:32:32.390 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T00:32:32.391 DEBUG:teuthology.orchestra.run.smithi062:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T00:32:34.777 DEBUG:teuthology.orchestra.run.smithi062:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T00:32:35.306 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting tox==3.15.0 2024-09-12T00:32:35.359 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T00:32:35.512 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T00:32:35.529 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T00:32:35.632 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting packaging>=14 2024-09-12T00:32:35.680 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T00:32:35.778 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting six<2,>=1.14.0 2024-09-12T00:32:35.792 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:32:35.891 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting py<2,>=1.4.17 2024-09-12T00:32:35.917 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T00:32:36.199 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T00:32:36.215 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T00:32:36.427 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T00:32:36.443 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T00:32:36.550 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting toml>=0.9.4 2024-09-12T00:32:36.569 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T00:32:36.804 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T00:32:36.817 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T00:32:36.935 INFO:teuthology.orchestra.run.smithi062.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T00:32:36.949 INFO:teuthology.orchestra.run.smithi062.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T00:32:37.075 INFO:teuthology.orchestra.run.smithi062.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-12T00:32:38.127 INFO:teuthology.orchestra.run.smithi062.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T00:32:38.334 INFO:teuthology.orchestra.run.smithi062.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-12T00:32:38.334 INFO:teuthology.orchestra.run.smithi062.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-12T00:32:38.397 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:32:38.413 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:32:38.414 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:32:38.414 DEBUG:teuthology.orchestra.run.smithi062:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:32:38.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:32:38.444 INFO:teuthology.orchestra.run.smithi062.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:32:38.445 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:32:38.514 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:32:38.514 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:32:38.583 INFO:tasks.workunit:timeout=3h 2024-09-12T00:32:38.583 INFO:tasks.workunit:cleanup=True 2024-09-12T00:32:38.584 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:32:38.654 INFO:tasks.workunit.client.0.smithi062.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:33:24.239 INFO:tasks.workunit.client.0.smithi062.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:33:24.240 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:24.240 INFO:tasks.workunit.client.0.smithi062.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:33:24.240 INFO:tasks.workunit.client.0.smithi062.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:33:24.240 INFO:tasks.workunit.client.0.smithi062.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:33:24.240 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:24.240 INFO:tasks.workunit.client.0.smithi062.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:33:24.240 INFO:tasks.workunit.client.0.smithi062.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:33:24.241 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:24.241 INFO:tasks.workunit.client.0.smithi062.stderr: git switch -c 2024-09-12T00:33:24.241 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:24.241 INFO:tasks.workunit.client.0.smithi062.stderr:Or undo this operation with: 2024-09-12T00:33:24.241 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:24.241 INFO:tasks.workunit.client.0.smithi062.stderr: git switch - 2024-09-12T00:33:24.241 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:24.241 INFO:tasks.workunit.client.0.smithi062.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:33:24.241 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:24.241 INFO:tasks.workunit.client.0.smithi062.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:33:24.243 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:33:24.321 INFO:tasks.workunit.client.0.smithi062.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:33:24.323 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:33:24.323 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:33:24.957 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:33:25.037 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:33:25.079 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:33:25.081 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:33:25.081 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:33:25.122 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:33:25.126 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:33:25.126 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:33:25.196 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T00:33:25.197 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T00:33:25.198 DEBUG:teuthology.orchestra.run.smithi062:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:33:25.271 INFO:tasks.workunit.client.0.smithi062.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:33:25.271 INFO:tasks.workunit.client.0.smithi062.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:33:25.272 INFO:tasks.workunit.client.0.smithi062.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:33:27.635 INFO:tasks.workunit.client.0.smithi062.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:33:27.635 INFO:tasks.workunit.client.0.smithi062.stderr:++ deactivate nondestructive 2024-09-12T00:33:27.635 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n '' ']' 2024-09-12T00:33:27.635 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n '' ']' 2024-09-12T00:33:27.635 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:33:27.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ hash -r 2024-09-12T00:33:27.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n '' ']' 2024-09-12T00:33:27.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:33:27.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:33:27.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:33:27.636 INFO:tasks.workunit.client.0.smithi062.stderr:++ export VIRTUAL_ENV 2024-09-12T00:33:27.637 INFO:tasks.workunit.client.0.smithi062.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:33:27.637 INFO:tasks.workunit.client.0.smithi062.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:33:27.637 INFO:tasks.workunit.client.0.smithi062.stderr:++ export PATH 2024-09-12T00:33:27.637 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n '' ']' 2024-09-12T00:33:27.637 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-09-12T00:33:27.638 INFO:tasks.workunit.client.0.smithi062.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:33:27.638 INFO:tasks.workunit.client.0.smithi062.stderr:++ PS1='(rgw) ' 2024-09-12T00:33:27.638 INFO:tasks.workunit.client.0.smithi062.stderr:++ export PS1 2024-09-12T00:33:27.638 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:33:27.638 INFO:tasks.workunit.client.0.smithi062.stderr:++ hash -r 2024-09-12T00:33:27.638 INFO:tasks.workunit.client.0.smithi062.stderr:+ pip install pip --upgrade 2024-09-12T00:33:27.872 INFO:tasks.workunit.client.0.smithi062.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:33:28.063 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting pip 2024-09-12T00:33:28.119 INFO:tasks.workunit.client.0.smithi062.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:33:28.275 INFO:tasks.workunit.client.0.smithi062.stdout:Installing collected packages: pip 2024-09-12T00:33:28.275 INFO:tasks.workunit.client.0.smithi062.stdout: Attempting uninstall: pip 2024-09-12T00:33:28.275 INFO:tasks.workunit.client.0.smithi062.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:33:28.440 INFO:tasks.workunit.client.0.smithi062.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:33:28.446 INFO:tasks.workunit.client.0.smithi062.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:33:29.210 INFO:tasks.workunit.client.0.smithi062.stdout:Successfully installed pip-24.2 2024-09-12T00:33:29.447 INFO:tasks.workunit.client.0.smithi062.stderr:+ pip install boto3 2024-09-12T00:33:30.372 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting boto3 2024-09-12T00:33:30.415 INFO:tasks.workunit.client.0.smithi062.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:33:31.106 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:33:31.121 INFO:tasks.workunit.client.0.smithi062.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:33:31.224 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:33:31.238 INFO:tasks.workunit.client.0.smithi062.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:33:31.363 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:33:31.380 INFO:tasks.workunit.client.0.smithi062.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:33:31.507 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:33:31.526 INFO:tasks.workunit.client.0.smithi062.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:33:31.686 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:33:31.704 INFO:tasks.workunit.client.0.smithi062.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:33:32.055 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:33:32.069 INFO:tasks.workunit.client.0.smithi062.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:33:32.137 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:33:32.218 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:33:32.471 INFO:tasks.workunit.client.0.smithi062.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 51.7 MB/s eta 0:00:00 2024-09-12T00:33:32.485 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:33:32.532 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:33:32.598 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:33:32.667 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:33:32.736 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:33:32.865 INFO:tasks.workunit.client.0.smithi062.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:33:33.951 INFO:tasks.workunit.client.0.smithi062.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:33:34.071 INFO:tasks.workunit.client.0.smithi062.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T00:33:34.212 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T00:33:34.247 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:34.247 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:34.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.289+0000 7f0601814800 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.291+0000 7f0601814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:34.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.291+0000 7f0601814800 20 realm 2024-09-12T00:33:34.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.291+0000 7f0601814800 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.291+0000 7f0601814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:34.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.291+0000 7f0601814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:34.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.291+0000 7f0601814800 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.291+0000 7f0601814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:34.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.291+0000 7f0601814800 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.292+0000 7f0601814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:34.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.292+0000 7f0601814800 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.293+0000 7f0601814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:34.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.293+0000 7f0601814800 20 searching for the correct realm 2024-09-12T00:33:34.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.295+0000 7f05fc7df640 0 -- 172.21.15.62:0/1102174734 >> [v2:172.21.15.62:6808/741930476,v1:172.21.15.62:6809/741930476] conn(0x55d47ed97660 msgr2=0x55d47ed97aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:34.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.299+0000 7f05fcfe0640 0 -- 172.21.15.62:0/1102174734 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f05f4099060 msgr2=0x7f05f4065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:34.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.506+0000 7f0601814800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:34.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.506+0000 7f0601814800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:34.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.506+0000 7f0601814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:34.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.506+0000 7f0601814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:34.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.506+0000 7f0601814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:34.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.506+0000 7f0601814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:34.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.507+0000 7f0601814800 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.507+0000 7f0601814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:34.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.507+0000 7f0601814800 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.507+0000 7f0601814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:34.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.507+0000 7f0601814800 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.508+0000 7f0601814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:34.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.508+0000 7f0601814800 20 zone default found 2024-09-12T00:33:34.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.508+0000 7f0601814800 4 Realm: () 2024-09-12T00:33:34.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.508+0000 7f0601814800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:34.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.508+0000 7f0601814800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:34.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.508+0000 7f0601814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:34.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.508+0000 7f0601814800 20 zonegroup default 2024-09-12T00:33:34.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.508+0000 7f0601814800 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.508+0000 7f0601814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:34.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.508+0000 7f0601814800 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.508+0000 7f0601814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:34.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.508+0000 7f0601814800 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.508+0000 7f0601814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:34.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.508+0000 7f0601814800 20 started sync module instance, tier type = 2024-09-12T00:33:34.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.508+0000 7f0601814800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:34.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.527+0000 7f0601814800 20 add_watcher() i=0 2024-09-12T00:33:34.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.527+0000 7f0601814800 20 add_watcher() i=1 2024-09-12T00:33:34.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.527+0000 7f0601814800 20 add_watcher() i=2 2024-09-12T00:33:34.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.527+0000 7f0601814800 20 add_watcher() i=3 2024-09-12T00:33:34.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.527+0000 7f0601814800 20 add_watcher() i=4 2024-09-12T00:33:34.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.528+0000 7f0601814800 20 add_watcher() i=5 2024-09-12T00:33:34.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.529+0000 7f0601814800 20 add_watcher() i=6 2024-09-12T00:33:34.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.530+0000 7f0601814800 20 add_watcher() i=7 2024-09-12T00:33:34.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.530+0000 7f0601814800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:34.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.532+0000 7f04b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:34.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.532+0000 7f0601814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:34.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.532+0000 7f0601814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:34.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.532+0000 7f0601814800 5 note: GC not initialized 2024-09-12T00:33:34.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.532+0000 7f04b1fe3640 20 reqs_thread_entry: start 2024-09-12T00:33:34.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.533+0000 7f0601814800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:34.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.533+0000 7f0601814800 20 Filter name: none 2024-09-12T00:33:34.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.533+0000 7f04237fe640 20 reqs_thread_entry: start 2024-09-12T00:33:34.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.533+0000 7f0601814800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T00:33:34.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.533+0000 7f0601814800 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.533+0000 7f0601814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:34.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.533+0000 7f0601814800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T00:33:34.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.533+0000 7f0601814800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:33:34.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.533+0000 7f0601814800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T00:33:34.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.533+0000 7f0601814800 20 rados->read ofs=0 len=0 2024-09-12T00:33:34.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.533+0000 7f0601814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:34.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.533+0000 7f0601814800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T00:33:34.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.533+0000 7f0601814800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:33:34.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.533+0000 7f0601814800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:33:34.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.533+0000 7f0601814800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:33:34.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.535+0000 7f0601814800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:33:34.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.535+0000 7f0601814800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:33:34.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.535+0000 7f0601814800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T00:33:34.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.535+0000 7f04d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 94371149624544 notifier 4565 bl.length()=593 2024-09-12T00:33:34.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.535+0000 7f04d3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:33:34.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.535+0000 7f04d3fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:33:34.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.561+0000 7f0601814800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:33:34.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.561+0000 7f0601814800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:33:34.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.561+0000 7f0601814800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T00:33:34.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.561+0000 7f04d3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 94371149626752 notifier 4565 bl.length()=186 2024-09-12T00:33:34.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.561+0000 7f04d3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:33:34.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.561+0000 7f04d3fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:33:34.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.563+0000 7f04b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:34.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.566+0000 7f0601814800 20 remove_watcher() i=0 2024-09-12T00:33:34.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.566+0000 7f0601814800 2 removed watcher, disabling cache 2024-09-12T00:33:34.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.567+0000 7f0601814800 20 remove_watcher() i=1 2024-09-12T00:33:34.567 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.568+0000 7f0601814800 20 remove_watcher() i=2 2024-09-12T00:33:34.568 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.569+0000 7f0601814800 20 remove_watcher() i=3 2024-09-12T00:33:34.570 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.571+0000 7f0601814800 20 remove_watcher() i=4 2024-09-12T00:33:34.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.572+0000 7f0601814800 20 remove_watcher() i=5 2024-09-12T00:33:34.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.574+0000 7f0601814800 20 remove_watcher() i=6 2024-09-12T00:33:34.574 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:34.575+0000 7f0601814800 20 remove_watcher() i=7 2024-09-12T00:33:36.447 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T00:33:36.447 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:36.448 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:33:36.479 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:36.479 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:36.518 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.519+0000 7fc71db26800 20 rados->read ofs=0 len=0 2024-09-12T00:33:36.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.521+0000 7fc71db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:36.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.521+0000 7fc71db26800 20 realm 2024-09-12T00:33:36.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.521+0000 7fc71db26800 20 rados->read ofs=0 len=0 2024-09-12T00:33:36.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.521+0000 7fc71db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:36.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.521+0000 7fc71db26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:36.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.521+0000 7fc71db26800 20 rados->read ofs=0 len=0 2024-09-12T00:33:36.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.521+0000 7fc71db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:36.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.521+0000 7fc71db26800 20 rados->read ofs=0 len=0 2024-09-12T00:33:36.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.522+0000 7fc71db26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:36.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.522+0000 7fc71db26800 20 rados->read ofs=0 len=0 2024-09-12T00:33:36.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.523+0000 7fc71db26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:36.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.523+0000 7fc71db26800 20 searching for the correct realm 2024-09-12T00:33:36.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.526+0000 7fc718f08640 0 -- 172.21.15.62:0/51340385 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fc714088e10 msgr2=0x7fc71405fd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:36.731 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.732+0000 7fc718f08640 0 -- 172.21.15.62:0/51340385 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x556203710b10 msgr2=0x556203712f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:36.736 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.737+0000 7fc71db26800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:36.736 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.737+0000 7fc71db26800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:36.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.737+0000 7fc71db26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:36.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.737+0000 7fc71db26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:36.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.737+0000 7fc71db26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:36.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.737+0000 7fc71db26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:36.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.737+0000 7fc71db26800 20 rados->read ofs=0 len=0 2024-09-12T00:33:36.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.737+0000 7fc71db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:36.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.737+0000 7fc71db26800 20 rados->read ofs=0 len=0 2024-09-12T00:33:36.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.738+0000 7fc71db26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:36.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.738+0000 7fc71db26800 20 rados->read ofs=0 len=0 2024-09-12T00:33:36.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.738+0000 7fc71db26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:36.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.738+0000 7fc71db26800 20 zone default found 2024-09-12T00:33:36.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.738+0000 7fc71db26800 4 Realm: () 2024-09-12T00:33:36.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.738+0000 7fc71db26800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:36.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.738+0000 7fc71db26800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:36.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.738+0000 7fc71db26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:36.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.738+0000 7fc71db26800 20 zonegroup default 2024-09-12T00:33:36.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.738+0000 7fc71db26800 20 rados->read ofs=0 len=0 2024-09-12T00:33:36.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.738+0000 7fc71db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:36.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.738+0000 7fc71db26800 20 rados->read ofs=0 len=0 2024-09-12T00:33:36.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.739+0000 7fc71db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:36.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.739+0000 7fc71db26800 20 rados->read ofs=0 len=0 2024-09-12T00:33:36.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.739+0000 7fc71db26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:36.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.739+0000 7fc71db26800 20 started sync module instance, tier type = 2024-09-12T00:33:36.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.739+0000 7fc71db26800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:36.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.751+0000 7fc71db26800 20 add_watcher() i=0 2024-09-12T00:33:36.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.751+0000 7fc71db26800 20 add_watcher() i=1 2024-09-12T00:33:36.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.751+0000 7fc71db26800 20 add_watcher() i=2 2024-09-12T00:33:36.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.751+0000 7fc71db26800 20 add_watcher() i=3 2024-09-12T00:33:36.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.751+0000 7fc71db26800 20 add_watcher() i=4 2024-09-12T00:33:36.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.751+0000 7fc71db26800 20 add_watcher() i=5 2024-09-12T00:33:36.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.751+0000 7fc71db26800 20 add_watcher() i=6 2024-09-12T00:33:36.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.753+0000 7fc71db26800 20 add_watcher() i=7 2024-09-12T00:33:36.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.753+0000 7fc71db26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:36.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.754+0000 7fc5cffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:36.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.755+0000 7fc71db26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:36.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.755+0000 7fc71db26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:36.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.755+0000 7fc71db26800 5 note: GC not initialized 2024-09-12T00:33:36.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.755+0000 7fc5cefe5640 20 reqs_thread_entry: start 2024-09-12T00:33:36.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.755+0000 7fc71db26800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:36.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.755+0000 7fc71db26800 20 Filter name: none 2024-09-12T00:33:36.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.755+0000 7fc5ccfe1640 20 reqs_thread_entry: start 2024-09-12T00:33:36.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.756+0000 7fc71db26800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:33:36.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.756+0000 7fc71db26800 20 rados->read ofs=0 len=0 2024-09-12T00:33:36.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.756+0000 7fc71db26800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:36.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.756+0000 7fc71db26800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:33:36.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.756+0000 7fc71db26800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:33:36.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.756+0000 7fc71db26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 : miss 2024-09-12T00:33:36.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.756+0000 7fc71db26800 20 rados->read ofs=0 len=0 2024-09-12T00:33:36.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.757+0000 7fc71db26800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:36.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.757+0000 7fc71db26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 info.flags=0x17 2024-09-12T00:33:36.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.757+0000 7fc71db26800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 to cache LRU end 2024-09-12T00:33:36.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.757+0000 7fc71db26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:36.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.757+0000 7fc71db26800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:33:36.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.757+0000 7fc71db26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 2024-09-12T00:33:36.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.757+0000 7fc71db26800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:36.759 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.760+0000 7fc5cffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:36.762 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.763+0000 7fc71db26800 20 remove_watcher() i=0 2024-09-12T00:33:36.762 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.763+0000 7fc71db26800 2 removed watcher, disabling cache 2024-09-12T00:33:36.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.764+0000 7fc71db26800 20 remove_watcher() i=1 2024-09-12T00:33:36.764 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.765+0000 7fc71db26800 20 remove_watcher() i=2 2024-09-12T00:33:36.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.767+0000 7fc71db26800 20 remove_watcher() i=3 2024-09-12T00:33:36.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.768+0000 7fc71db26800 20 remove_watcher() i=4 2024-09-12T00:33:36.767 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.769+0000 7fc71db26800 20 remove_watcher() i=5 2024-09-12T00:33:36.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.770+0000 7fc71db26800 20 remove_watcher() i=6 2024-09-12T00:33:36.770 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:36.771+0000 7fc71db26800 20 remove_watcher() i=7 2024-09-12T00:33:36.782 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:33:36.811 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:36.811 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:37.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.053+0000 7fb41bd24800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.055+0000 7fb41bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:37.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.055+0000 7fb41bd24800 20 realm 2024-09-12T00:33:37.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.055+0000 7fb41bd24800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.055+0000 7fb41bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:37.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.055+0000 7fb41bd24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:37.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.055+0000 7fb41bd24800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.055+0000 7fb41bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:37.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.055+0000 7fb41bd24800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.056+0000 7fb41bd24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:37.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.056+0000 7fb41bd24800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.057+0000 7fb41bd24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:37.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.057+0000 7fb41bd24800 20 searching for the correct realm 2024-09-12T00:33:37.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.060+0000 7fb418157640 0 -- 172.21.15.62:0/656499724 >> [v2:172.21.15.77:6816/3177889521,v1:172.21.15.77:6817/3177889521] conn(0x5559b363dc80 msgr2=0x5559b3640140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:37.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.063+0000 7fb417956640 0 -- 172.21.15.62:0/656499724 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7fb41002c610 msgr2=0x7fb41003b3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:37.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.271+0000 7fb41bd24800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:37.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.271+0000 7fb41bd24800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:37.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.271+0000 7fb41bd24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:37.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.271+0000 7fb41bd24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:37.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.271+0000 7fb41bd24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:37.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.271+0000 7fb41bd24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:37.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.271+0000 7fb41bd24800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.271+0000 7fb41bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:37.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.271+0000 7fb41bd24800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.271+0000 7fb41bd24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:37.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.272+0000 7fb41bd24800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.272+0000 7fb41bd24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:37.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.272+0000 7fb41bd24800 20 zone default found 2024-09-12T00:33:37.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.272+0000 7fb41bd24800 4 Realm: () 2024-09-12T00:33:37.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.272+0000 7fb41bd24800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:37.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.272+0000 7fb41bd24800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:37.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.272+0000 7fb41bd24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:37.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.272+0000 7fb41bd24800 20 zonegroup default 2024-09-12T00:33:37.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.272+0000 7fb41bd24800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.272+0000 7fb41bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:37.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.272+0000 7fb41bd24800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.272+0000 7fb41bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:37.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.272+0000 7fb41bd24800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.273+0000 7fb41bd24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:37.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.273+0000 7fb41bd24800 20 started sync module instance, tier type = 2024-09-12T00:33:37.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.273+0000 7fb41bd24800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:37.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.286+0000 7fb41bd24800 20 add_watcher() i=0 2024-09-12T00:33:37.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.286+0000 7fb41bd24800 20 add_watcher() i=1 2024-09-12T00:33:37.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.286+0000 7fb41bd24800 20 add_watcher() i=2 2024-09-12T00:33:37.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.286+0000 7fb41bd24800 20 add_watcher() i=3 2024-09-12T00:33:37.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.286+0000 7fb41bd24800 20 add_watcher() i=4 2024-09-12T00:33:37.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.286+0000 7fb41bd24800 20 add_watcher() i=5 2024-09-12T00:33:37.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.286+0000 7fb41bd24800 20 add_watcher() i=6 2024-09-12T00:33:37.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.288+0000 7fb41bd24800 20 add_watcher() i=7 2024-09-12T00:33:37.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.288+0000 7fb41bd24800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:37.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.289+0000 7fb2cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:37.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.290+0000 7fb41bd24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:37.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.290+0000 7fb41bd24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:37.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.290+0000 7fb41bd24800 5 note: GC not initialized 2024-09-12T00:33:37.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.290+0000 7fb2ccfe1640 20 reqs_thread_entry: start 2024-09-12T00:33:37.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.290+0000 7fb41bd24800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:37.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.290+0000 7fb41bd24800 20 Filter name: none 2024-09-12T00:33:37.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.290+0000 7fb2467fc640 20 reqs_thread_entry: start 2024-09-12T00:33:37.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.291+0000 7fb41bd24800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.291+0000 7fb41bd24800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:37.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.291+0000 7fb41bd24800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.292+0000 7fb41bd24800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:37.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.292+0000 7fb41bd24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:37.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.292+0000 7fb41bd24800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.292+0000 7fb41bd24800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:37.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.292+0000 7fb41bd24800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.292+0000 7fb41bd24800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:37.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.292+0000 7fb41bd24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:37.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.294+0000 7fb2cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:37.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.296+0000 7fb41bd24800 20 remove_watcher() i=0 2024-09-12T00:33:37.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.296+0000 7fb41bd24800 2 removed watcher, disabling cache 2024-09-12T00:33:37.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.297+0000 7fb41bd24800 20 remove_watcher() i=1 2024-09-12T00:33:37.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.298+0000 7fb41bd24800 20 remove_watcher() i=2 2024-09-12T00:33:37.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.299+0000 7fb41bd24800 20 remove_watcher() i=3 2024-09-12T00:33:37.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.300+0000 7fb41bd24800 20 remove_watcher() i=4 2024-09-12T00:33:37.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.301+0000 7fb41bd24800 20 remove_watcher() i=5 2024-09-12T00:33:37.301 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.302+0000 7fb41bd24800 20 remove_watcher() i=6 2024-09-12T00:33:37.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.304+0000 7fb41bd24800 20 remove_watcher() i=7 2024-09-12T00:33:37.314 INFO:tasks.workunit.client.0.smithi062.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 95, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T00:33:37.314 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T00:33:37.314 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:37.316 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:33:37.349 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:37.350 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:37.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.391+0000 7f3bbf240800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.392+0000 7f3bbf240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:37.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.392+0000 7f3bbf240800 20 realm 2024-09-12T00:33:37.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.392+0000 7f3bbf240800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.393+0000 7f3bbf240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:37.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.393+0000 7f3bbf240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:37.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.393+0000 7f3bbf240800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.393+0000 7f3bbf240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:37.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.393+0000 7f3bbf240800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.394+0000 7f3bbf240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:37.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.394+0000 7f3bbf240800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.394+0000 7f3bbf240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:37.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.394+0000 7f3bbf240800 20 searching for the correct realm 2024-09-12T00:33:37.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.397+0000 7f3bbc529640 0 -- 172.21.15.62:0/2949554947 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f3bb40655e0 msgr2=0x7f3bb4068610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:37.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.603+0000 7f3bbc529640 0 -- 172.21.15.62:0/2949554947 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55aab92465f0 msgr2=0x55aab92489e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:37.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.608+0000 7f3bbf240800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:37.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.608+0000 7f3bbf240800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:37.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.608+0000 7f3bbf240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:37.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.608+0000 7f3bbf240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:37.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.608+0000 7f3bbf240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:37.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.608+0000 7f3bbf240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:37.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.608+0000 7f3bbf240800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.608+0000 7f3bbf240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:37.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.608+0000 7f3bbf240800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.608+0000 7f3bbf240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:37.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.608+0000 7f3bbf240800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.609+0000 7f3bbf240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:37.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.609+0000 7f3bbf240800 20 zone default found 2024-09-12T00:33:37.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.609+0000 7f3bbf240800 4 Realm: () 2024-09-12T00:33:37.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.609+0000 7f3bbf240800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:37.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.609+0000 7f3bbf240800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:37.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.609+0000 7f3bbf240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:37.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.609+0000 7f3bbf240800 20 zonegroup default 2024-09-12T00:33:37.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.609+0000 7f3bbf240800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.609+0000 7f3bbf240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:37.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.609+0000 7f3bbf240800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.609+0000 7f3bbf240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:37.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.609+0000 7f3bbf240800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.610+0000 7f3bbf240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:37.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.610+0000 7f3bbf240800 20 started sync module instance, tier type = 2024-09-12T00:33:37.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.610+0000 7f3bbf240800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:37.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.621+0000 7f3bbf240800 20 add_watcher() i=0 2024-09-12T00:33:37.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.621+0000 7f3bbf240800 20 add_watcher() i=1 2024-09-12T00:33:37.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.621+0000 7f3bbf240800 20 add_watcher() i=2 2024-09-12T00:33:37.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.621+0000 7f3bbf240800 20 add_watcher() i=3 2024-09-12T00:33:37.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.621+0000 7f3bbf240800 20 add_watcher() i=4 2024-09-12T00:33:37.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.621+0000 7f3bbf240800 20 add_watcher() i=5 2024-09-12T00:33:37.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.621+0000 7f3bbf240800 20 add_watcher() i=6 2024-09-12T00:33:37.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.622+0000 7f3bbf240800 20 add_watcher() i=7 2024-09-12T00:33:37.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.622+0000 7f3bbf240800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:37.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.625+0000 7f3a72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:37.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.625+0000 7f3bbf240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:37.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.625+0000 7f3bbf240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:37.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.625+0000 7f3bbf240800 5 note: GC not initialized 2024-09-12T00:33:37.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.625+0000 7f3a71fe3640 20 reqs_thread_entry: start 2024-09-12T00:33:37.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.625+0000 7f3bbf240800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:37.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.625+0000 7f3bbf240800 20 Filter name: none 2024-09-12T00:33:37.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.625+0000 7f39e37fe640 20 reqs_thread_entry: start 2024-09-12T00:33:37.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.626+0000 7f3bbf240800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:33:37.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.626+0000 7f3bbf240800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.626+0000 7f3bbf240800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:37.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.626+0000 7f3bbf240800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:33:37.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.626+0000 7f3bbf240800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:33:37.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.626+0000 7f3bbf240800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 : miss 2024-09-12T00:33:37.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.626+0000 7f3bbf240800 20 rados->read ofs=0 len=0 2024-09-12T00:33:37.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.626+0000 7f3bbf240800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:37.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.626+0000 7f3bbf240800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 info.flags=0x17 2024-09-12T00:33:37.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.626+0000 7f3bbf240800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 to cache LRU end 2024-09-12T00:33:37.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.626+0000 7f3bbf240800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:37.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.626+0000 7f3bbf240800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:33:37.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.626+0000 7f3bbf240800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 2024-09-12T00:33:37.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.627+0000 7f3bbf240800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:37.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.627+0000 7f3bbf240800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:33:37.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.627+0000 7f3bbf240800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:33:37.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.628+0000 7f3a72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:37.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.631+0000 7f3bbf240800 20 remove_watcher() i=0 2024-09-12T00:33:37.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.631+0000 7f3bbf240800 2 removed watcher, disabling cache 2024-09-12T00:33:37.630 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.632+0000 7f3bbf240800 20 remove_watcher() i=1 2024-09-12T00:33:37.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.633+0000 7f3bbf240800 20 remove_watcher() i=2 2024-09-12T00:33:37.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.634+0000 7f3bbf240800 20 remove_watcher() i=3 2024-09-12T00:33:37.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.635+0000 7f3bbf240800 20 remove_watcher() i=4 2024-09-12T00:33:37.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.636+0000 7f3bbf240800 20 remove_watcher() i=5 2024-09-12T00:33:37.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.637+0000 7f3bbf240800 20 remove_watcher() i=6 2024-09-12T00:33:37.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:37.638+0000 7f3bbf240800 20 remove_watcher() i=7 2024-09-12T00:33:37.650 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:33:38.068 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:33:39.592 INFO:tasks.workunit.client.0.smithi062.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:33:39.593 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:33:39.627 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:39.628 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:39.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.669+0000 7f2110ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:39.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.671+0000 7f2110ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:39.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.671+0000 7f2110ebb800 20 realm 2024-09-12T00:33:39.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.671+0000 7f2110ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:39.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.671+0000 7f2110ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:39.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.671+0000 7f2110ebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:39.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.671+0000 7f2110ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:39.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.672+0000 7f2110ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:39.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.672+0000 7f2110ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:39.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.672+0000 7f2110ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:39.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.672+0000 7f2110ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:39.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.673+0000 7f2110ebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:39.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.673+0000 7f2110ebb800 20 searching for the correct realm 2024-09-12T00:33:39.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.676+0000 7f210e1a4640 0 -- 172.21.15.62:0/1323485093 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f210806dc70 msgr2=0x7f210808a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:39.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.881+0000 7f210e1a4640 0 -- 172.21.15.62:0/1323485093 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x56312ccc58b0 msgr2=0x56312ccc7d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:39.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.886+0000 7f2110ebb800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:39.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.886+0000 7f2110ebb800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:39.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.886+0000 7f2110ebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:39.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.886+0000 7f2110ebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:39.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.886+0000 7f2110ebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:39.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.886+0000 7f2110ebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:39.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.886+0000 7f2110ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:39.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.886+0000 7f2110ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:39.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.886+0000 7f2110ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:39.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.886+0000 7f2110ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:39.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.886+0000 7f2110ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:39.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.887+0000 7f2110ebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:39.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.887+0000 7f2110ebb800 20 zone default found 2024-09-12T00:33:39.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.887+0000 7f2110ebb800 4 Realm: () 2024-09-12T00:33:39.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.887+0000 7f2110ebb800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:39.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.887+0000 7f2110ebb800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:39.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.887+0000 7f2110ebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:39.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.887+0000 7f2110ebb800 20 zonegroup default 2024-09-12T00:33:39.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.887+0000 7f2110ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:39.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.887+0000 7f2110ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:39.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.887+0000 7f2110ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:39.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.887+0000 7f2110ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:39.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.887+0000 7f2110ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:39.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.888+0000 7f2110ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:39.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.888+0000 7f2110ebb800 20 started sync module instance, tier type = 2024-09-12T00:33:39.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.888+0000 7f2110ebb800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:39.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.901+0000 7f2110ebb800 20 add_watcher() i=0 2024-09-12T00:33:39.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.901+0000 7f2110ebb800 20 add_watcher() i=1 2024-09-12T00:33:39.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.901+0000 7f2110ebb800 20 add_watcher() i=2 2024-09-12T00:33:39.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.901+0000 7f2110ebb800 20 add_watcher() i=3 2024-09-12T00:33:39.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.901+0000 7f2110ebb800 20 add_watcher() i=4 2024-09-12T00:33:39.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.901+0000 7f2110ebb800 20 add_watcher() i=5 2024-09-12T00:33:39.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.901+0000 7f2110ebb800 20 add_watcher() i=6 2024-09-12T00:33:39.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.902+0000 7f2110ebb800 20 add_watcher() i=7 2024-09-12T00:33:39.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.902+0000 7f2110ebb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:39.906 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.904+0000 7f1fc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:39.906 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.905+0000 7f2110ebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:39.906 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.905+0000 7f2110ebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:39.906 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.905+0000 7f2110ebb800 5 note: GC not initialized 2024-09-12T00:33:39.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.905+0000 7f1f3ffff640 20 reqs_thread_entry: start 2024-09-12T00:33:39.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.905+0000 7f2110ebb800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:39.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.905+0000 7f2110ebb800 20 Filter name: none 2024-09-12T00:33:39.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.905+0000 7f1f3dffb640 20 reqs_thread_entry: start 2024-09-12T00:33:39.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.905+0000 7f2110ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:39.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.906+0000 7f2110ebb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:39.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.906+0000 7f2110ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:39.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.906+0000 7f2110ebb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:39.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.906+0000 7f2110ebb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:39.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.906+0000 7f2110ebb800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:33:39.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.906+0000 7f2110ebb800 20 INFO: main: starting shard=0 2024-09-12T00:33:39.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.906+0000 7f2110ebb800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:39.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.907+0000 7f2110ebb800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:33:39.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.907+0000 7f2110ebb800 20 INFO: main: done 2024-09-12T00:33:39.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.908+0000 7f1fc57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:39.909 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.910+0000 7f2110ebb800 20 remove_watcher() i=0 2024-09-12T00:33:39.909 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.910+0000 7f2110ebb800 2 removed watcher, disabling cache 2024-09-12T00:33:39.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.911+0000 7f2110ebb800 20 remove_watcher() i=1 2024-09-12T00:33:39.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.912+0000 7f2110ebb800 20 remove_watcher() i=2 2024-09-12T00:33:39.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.913+0000 7f2110ebb800 20 remove_watcher() i=3 2024-09-12T00:33:39.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.915+0000 7f2110ebb800 20 remove_watcher() i=4 2024-09-12T00:33:39.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.916+0000 7f2110ebb800 20 remove_watcher() i=5 2024-09-12T00:33:39.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.917+0000 7f2110ebb800 20 remove_watcher() i=6 2024-09-12T00:33:39.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:39.918+0000 7f2110ebb800 20 remove_watcher() i=7 2024-09-12T00:33:40.071 INFO:tasks.workunit.client.0.smithi062.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:33:40.072 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:33:40.105 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:40.106 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:40.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.145+0000 7f978ac87800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.147+0000 7f978ac87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.147+0000 7f978ac87800 20 realm 2024-09-12T00:33:40.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.147+0000 7f978ac87800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.147+0000 7f978ac87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.147+0000 7f978ac87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:40.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.147+0000 7f978ac87800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.147+0000 7f978ac87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.147+0000 7f978ac87800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.148+0000 7f978ac87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:40.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.148+0000 7f978ac87800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.149+0000 7f978ac87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:40.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.149+0000 7f978ac87800 20 searching for the correct realm 2024-09-12T00:33:40.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.152+0000 7f977ffff640 0 -- 172.21.15.62:0/1763359031 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f9780090bb0 msgr2=0x7f9780065a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:40.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.156+0000 7f977ffff640 0 -- 172.21.15.62:0/1763359031 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5587a05af180 msgr2=0x5587a05b1640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:40.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.160+0000 7f978ac87800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:40.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.160+0000 7f978ac87800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:40.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.160+0000 7f978ac87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:40.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.160+0000 7f978ac87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:40.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.160+0000 7f978ac87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:40.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.160+0000 7f978ac87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:40.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.160+0000 7f978ac87800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.160+0000 7f978ac87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.160+0000 7f978ac87800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.160+0000 7f978ac87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:40.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.160+0000 7f978ac87800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.161+0000 7f978ac87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:40.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.161+0000 7f978ac87800 20 zone default found 2024-09-12T00:33:40.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.161+0000 7f978ac87800 4 Realm: () 2024-09-12T00:33:40.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.161+0000 7f978ac87800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:40.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.161+0000 7f978ac87800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:40.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.161+0000 7f978ac87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:40.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.161+0000 7f978ac87800 20 zonegroup default 2024-09-12T00:33:40.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.161+0000 7f978ac87800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.161+0000 7f978ac87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.161+0000 7f978ac87800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.162+0000 7f978ac87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.162+0000 7f978ac87800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.162+0000 7f978ac87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.162+0000 7f978ac87800 20 started sync module instance, tier type = 2024-09-12T00:33:40.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.162+0000 7f978ac87800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:40.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.173+0000 7f978ac87800 20 add_watcher() i=0 2024-09-12T00:33:40.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.173+0000 7f978ac87800 20 add_watcher() i=1 2024-09-12T00:33:40.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.173+0000 7f978ac87800 20 add_watcher() i=2 2024-09-12T00:33:40.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.173+0000 7f978ac87800 20 add_watcher() i=3 2024-09-12T00:33:40.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.173+0000 7f978ac87800 20 add_watcher() i=4 2024-09-12T00:33:40.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.173+0000 7f978ac87800 20 add_watcher() i=5 2024-09-12T00:33:40.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.173+0000 7f978ac87800 20 add_watcher() i=6 2024-09-12T00:33:40.173 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.174+0000 7f978ac87800 20 add_watcher() i=7 2024-09-12T00:33:40.173 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.174+0000 7f978ac87800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:40.174 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.176+0000 7f963efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:40.176 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.176+0000 7f978ac87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:40.176 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.176+0000 7f978ac87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:40.176 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.176+0000 7f978ac87800 5 note: GC not initialized 2024-09-12T00:33:40.176 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.176+0000 7f963dfdb640 20 reqs_thread_entry: start 2024-09-12T00:33:40.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.176+0000 7f978ac87800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:40.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.176+0000 7f978ac87800 20 Filter name: none 2024-09-12T00:33:40.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.177+0000 7f95af7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:40.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.177+0000 7f978ac87800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.177+0000 7f978ac87800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:40.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.177+0000 7f978ac87800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.177+0000 7f978ac87800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:40.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.177+0000 7f978ac87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:40.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.177+0000 7f978ac87800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:33:40.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.177+0000 7f978ac87800 20 INFO: main: starting shard=0 2024-09-12T00:33:40.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.177+0000 7f978ac87800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:40.178 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.178+0000 7f978ac87800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:33:40.178 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.178+0000 7f978ac87800 20 INFO: main: done 2024-09-12T00:33:40.178 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.179+0000 7f963efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:40.180 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.181+0000 7f978ac87800 20 remove_watcher() i=0 2024-09-12T00:33:40.180 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.181+0000 7f978ac87800 2 removed watcher, disabling cache 2024-09-12T00:33:40.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.182+0000 7f978ac87800 20 remove_watcher() i=1 2024-09-12T00:33:40.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.183+0000 7f978ac87800 20 remove_watcher() i=2 2024-09-12T00:33:40.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.184+0000 7f978ac87800 20 remove_watcher() i=3 2024-09-12T00:33:40.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.185+0000 7f978ac87800 20 remove_watcher() i=4 2024-09-12T00:33:40.185 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.186+0000 7f978ac87800 20 remove_watcher() i=5 2024-09-12T00:33:40.186 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.187+0000 7f978ac87800 20 remove_watcher() i=6 2024-09-12T00:33:40.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.189+0000 7f978ac87800 20 remove_watcher() i=7 2024-09-12T00:33:40.344 INFO:tasks.workunit.client.0.smithi062.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:33:40.345 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:33:40.377 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:40.377 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:40.415 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.416+0000 7f5ed520f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.418+0000 7f5ed520f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.418+0000 7f5ed520f800 20 realm 2024-09-12T00:33:40.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.418+0000 7f5ed520f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.418+0000 7f5ed520f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.418+0000 7f5ed520f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:40.418 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.418+0000 7f5ed520f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.418 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.419+0000 7f5ed520f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.418 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.419+0000 7f5ed520f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.418 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.419+0000 7f5ed520f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:40.418 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.419+0000 7f5ed520f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.420+0000 7f5ed520f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:40.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.420+0000 7f5ed520f800 20 searching for the correct realm 2024-09-12T00:33:40.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.423+0000 7f5ecbfff640 0 -- 172.21.15.62:0/1702702662 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f5ecc06a5e0 msgr2=0x7f5ecc083050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:40.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.629+0000 7f5ed1123640 0 -- 172.21.15.62:0/1702702662 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55dec3bf9680 msgr2=0x55dec3bfba70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:40.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.633+0000 7f5ed520f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:40.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.633+0000 7f5ed520f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:40.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.633+0000 7f5ed520f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:40.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.633+0000 7f5ed520f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:40.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.633+0000 7f5ed520f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:40.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.633+0000 7f5ed520f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:40.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.633+0000 7f5ed520f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.633+0000 7f5ed520f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.633+0000 7f5ed520f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.633+0000 7f5ed520f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:40.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.634+0000 7f5ed520f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.634+0000 7f5ed520f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:40.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.634+0000 7f5ed520f800 20 zone default found 2024-09-12T00:33:40.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.634+0000 7f5ed520f800 4 Realm: () 2024-09-12T00:33:40.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.634+0000 7f5ed520f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:40.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.634+0000 7f5ed520f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:40.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.634+0000 7f5ed520f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:40.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.634+0000 7f5ed520f800 20 zonegroup default 2024-09-12T00:33:40.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.634+0000 7f5ed520f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.634+0000 7f5ed520f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.634+0000 7f5ed520f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.634+0000 7f5ed520f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.634+0000 7f5ed520f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.635+0000 7f5ed520f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.635+0000 7f5ed520f800 20 started sync module instance, tier type = 2024-09-12T00:33:40.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.635+0000 7f5ed520f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:40.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.649+0000 7f5ed520f800 20 add_watcher() i=0 2024-09-12T00:33:40.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.649+0000 7f5ed520f800 20 add_watcher() i=1 2024-09-12T00:33:40.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.649+0000 7f5ed520f800 20 add_watcher() i=2 2024-09-12T00:33:40.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.649+0000 7f5ed520f800 20 add_watcher() i=3 2024-09-12T00:33:40.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.649+0000 7f5ed520f800 20 add_watcher() i=4 2024-09-12T00:33:40.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.649+0000 7f5ed520f800 20 add_watcher() i=5 2024-09-12T00:33:40.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.649+0000 7f5ed520f800 20 add_watcher() i=6 2024-09-12T00:33:40.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.650+0000 7f5ed520f800 20 add_watcher() i=7 2024-09-12T00:33:40.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.650+0000 7f5ed520f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:40.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.651+0000 7f5d86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:40.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.652+0000 7f5ed520f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:40.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.652+0000 7f5ed520f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:40.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.652+0000 7f5ed520f800 5 note: GC not initialized 2024-09-12T00:33:40.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.652+0000 7f5d85fe3640 20 reqs_thread_entry: start 2024-09-12T00:33:40.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.652+0000 7f5ed520f800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:40.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.652+0000 7f5ed520f800 20 Filter name: none 2024-09-12T00:33:40.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.652+0000 7f5cf77fe640 20 reqs_thread_entry: start 2024-09-12T00:33:40.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.652+0000 7f5ed520f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.653+0000 7f5ed520f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:40.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.653+0000 7f5ed520f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.653+0000 7f5ed520f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:40.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.653+0000 7f5ed520f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:40.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.653+0000 7f5ed520f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:33:40.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.653+0000 7f5ed520f800 20 INFO: main: starting shard=0 2024-09-12T00:33:40.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.653+0000 7f5ed520f800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:40.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.654+0000 7f5ed520f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:33:40.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.654+0000 7f5ed520f800 20 INFO: main: done 2024-09-12T00:33:40.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.655+0000 7f5d86fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:40.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.657+0000 7f5ed520f800 20 remove_watcher() i=0 2024-09-12T00:33:40.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.657+0000 7f5ed520f800 2 removed watcher, disabling cache 2024-09-12T00:33:40.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.658+0000 7f5ed520f800 20 remove_watcher() i=1 2024-09-12T00:33:40.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.659+0000 7f5ed520f800 20 remove_watcher() i=2 2024-09-12T00:33:40.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.660+0000 7f5ed520f800 20 remove_watcher() i=3 2024-09-12T00:33:40.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.663+0000 7f5ed520f800 20 remove_watcher() i=4 2024-09-12T00:33:40.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.664+0000 7f5ed520f800 20 remove_watcher() i=5 2024-09-12T00:33:40.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.666+0000 7f5ed520f800 20 remove_watcher() i=6 2024-09-12T00:33:40.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.667+0000 7f5ed520f800 20 remove_watcher() i=7 2024-09-12T00:33:40.792 INFO:tasks.workunit.client.0.smithi062.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:33:40.793 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:33:40.825 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:40.825 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:40.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.864+0000 7f678ff46800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.866+0000 7f678ff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.866+0000 7f678ff46800 20 realm 2024-09-12T00:33:40.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.866+0000 7f678ff46800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.866+0000 7f678ff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.866+0000 7f678ff46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:40.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.866+0000 7f678ff46800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.866+0000 7f678ff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.866+0000 7f678ff46800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.867+0000 7f678ff46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:40.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.867+0000 7f678ff46800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.868+0000 7f678ff46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:40.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.868+0000 7f678ff46800 20 searching for the correct realm 2024-09-12T00:33:40.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.871+0000 7f678da37640 0 -- 172.21.15.62:0/3503444538 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7f678801f040 msgr2=0x7f678801f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:40.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.875+0000 7f678da37640 0 -- 172.21.15.62:0/3503444538 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f678803b920 msgr2=0x7f67880393f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:40.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.879+0000 7f678ff46800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:40.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.879+0000 7f678ff46800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:40.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.879+0000 7f678ff46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:40.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.879+0000 7f678ff46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:40.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.879+0000 7f678ff46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:40.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.879+0000 7f678ff46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:40.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.879+0000 7f678ff46800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.879+0000 7f678ff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.879+0000 7f678ff46800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.879+0000 7f678ff46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:40.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.879+0000 7f678ff46800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.880+0000 7f678ff46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:40.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.880+0000 7f678ff46800 20 zone default found 2024-09-12T00:33:40.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.880+0000 7f678ff46800 4 Realm: () 2024-09-12T00:33:40.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.880+0000 7f678ff46800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:40.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.880+0000 7f678ff46800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:40.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.880+0000 7f678ff46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:40.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.880+0000 7f678ff46800 20 zonegroup default 2024-09-12T00:33:40.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.880+0000 7f678ff46800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.880+0000 7f678ff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.880+0000 7f678ff46800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.880+0000 7f678ff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.880+0000 7f678ff46800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.880+0000 7f678ff46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:40.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.880+0000 7f678ff46800 20 started sync module instance, tier type = 2024-09-12T00:33:40.882 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.880+0000 7f678ff46800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:40.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.895+0000 7f678ff46800 20 add_watcher() i=0 2024-09-12T00:33:40.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.895+0000 7f678ff46800 20 add_watcher() i=1 2024-09-12T00:33:40.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.895+0000 7f678ff46800 20 add_watcher() i=2 2024-09-12T00:33:40.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.895+0000 7f678ff46800 20 add_watcher() i=3 2024-09-12T00:33:40.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.895+0000 7f678ff46800 20 add_watcher() i=4 2024-09-12T00:33:40.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.895+0000 7f678ff46800 20 add_watcher() i=5 2024-09-12T00:33:40.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.895+0000 7f678ff46800 20 add_watcher() i=6 2024-09-12T00:33:40.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.896+0000 7f678ff46800 20 add_watcher() i=7 2024-09-12T00:33:40.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.896+0000 7f678ff46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:40.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.898+0000 7f663f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:40.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.899+0000 7f678ff46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:40.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.899+0000 7f678ff46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:40.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.899+0000 7f678ff46800 5 note: GC not initialized 2024-09-12T00:33:40.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.899+0000 7f663e7fc640 20 reqs_thread_entry: start 2024-09-12T00:33:40.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.899+0000 7f678ff46800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:40.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.899+0000 7f678ff46800 20 Filter name: none 2024-09-12T00:33:40.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.899+0000 7f65affff640 20 reqs_thread_entry: start 2024-09-12T00:33:40.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.899+0000 7f678ff46800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.900+0000 7f678ff46800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:40.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.900+0000 7f678ff46800 20 rados->read ofs=0 len=0 2024-09-12T00:33:40.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.900+0000 7f678ff46800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:40.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.900+0000 7f678ff46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:40.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.900+0000 7f678ff46800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:33:40.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.900+0000 7f678ff46800 20 INFO: main: starting shard=0 2024-09-12T00:33:40.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.900+0000 7f678ff46800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:40.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.900+0000 7f678ff46800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:33:40.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.900+0000 7f678ff46800 20 INFO: main: done 2024-09-12T00:33:40.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.901+0000 7f663f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:40.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.904+0000 7f678ff46800 20 remove_watcher() i=0 2024-09-12T00:33:40.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.904+0000 7f678ff46800 2 removed watcher, disabling cache 2024-09-12T00:33:40.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.905+0000 7f678ff46800 20 remove_watcher() i=1 2024-09-12T00:33:40.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.906+0000 7f678ff46800 20 remove_watcher() i=2 2024-09-12T00:33:40.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.908+0000 7f678ff46800 20 remove_watcher() i=3 2024-09-12T00:33:40.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.911+0000 7f678ff46800 20 remove_watcher() i=4 2024-09-12T00:33:40.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.912+0000 7f678ff46800 20 remove_watcher() i=5 2024-09-12T00:33:40.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.913+0000 7f678ff46800 20 remove_watcher() i=6 2024-09-12T00:33:40.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:40.914+0000 7f678ff46800 20 remove_watcher() i=7 2024-09-12T00:33:40.951 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:33:41.359 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:33:41.763 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T00:33:41.763 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:41.764 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:33:41.798 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:41.798 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:41.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:41.838+0000 7fe78ef40800 20 rados->read ofs=0 len=0 2024-09-12T00:33:41.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:41.840+0000 7fe78ef40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:41.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:41.840+0000 7fe78ef40800 20 realm 2024-09-12T00:33:41.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:41.840+0000 7fe78ef40800 20 rados->read ofs=0 len=0 2024-09-12T00:33:41.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:41.840+0000 7fe78ef40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:41.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:41.840+0000 7fe78ef40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:41.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:41.840+0000 7fe78ef40800 20 rados->read ofs=0 len=0 2024-09-12T00:33:41.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:41.840+0000 7fe78ef40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:41.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:41.840+0000 7fe78ef40800 20 rados->read ofs=0 len=0 2024-09-12T00:33:41.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:41.841+0000 7fe78ef40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:41.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:41.841+0000 7fe78ef40800 20 rados->read ofs=0 len=0 2024-09-12T00:33:41.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:41.842+0000 7fe78ef40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:41.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:41.842+0000 7fe78ef40800 20 searching for the correct realm 2024-09-12T00:33:41.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:41.844+0000 7fe78b4c1640 0 -- 172.21.15.62:0/4274714903 >> [v2:172.21.15.77:6816/3177889521,v1:172.21.15.77:6817/3177889521] conn(0x5639987b8540 msgr2=0x5639987ba930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:41.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:41.847+0000 7fe78acc0640 0 -- 172.21.15.62:0/4274714903 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7fe784098920 msgr2=0x7fe78409f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:42.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.055+0000 7fe78ef40800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:42.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.055+0000 7fe78ef40800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:42.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.055+0000 7fe78ef40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:42.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.055+0000 7fe78ef40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:42.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.055+0000 7fe78ef40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:42.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.055+0000 7fe78ef40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:42.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.055+0000 7fe78ef40800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.056+0000 7fe78ef40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:42.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.056+0000 7fe78ef40800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.056+0000 7fe78ef40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:42.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.056+0000 7fe78ef40800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.056+0000 7fe78ef40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:42.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.056+0000 7fe78ef40800 20 zone default found 2024-09-12T00:33:42.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.056+0000 7fe78ef40800 4 Realm: () 2024-09-12T00:33:42.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.056+0000 7fe78ef40800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:42.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.056+0000 7fe78ef40800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:42.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.056+0000 7fe78ef40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:42.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.056+0000 7fe78ef40800 20 zonegroup default 2024-09-12T00:33:42.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.056+0000 7fe78ef40800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.057+0000 7fe78ef40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:42.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.057+0000 7fe78ef40800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.057+0000 7fe78ef40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:42.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.057+0000 7fe78ef40800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.057+0000 7fe78ef40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:42.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.057+0000 7fe78ef40800 20 started sync module instance, tier type = 2024-09-12T00:33:42.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.057+0000 7fe78ef40800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:42.066 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.067+0000 7fe78ef40800 20 add_watcher() i=0 2024-09-12T00:33:42.066 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.067+0000 7fe78ef40800 20 add_watcher() i=1 2024-09-12T00:33:42.066 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.067+0000 7fe78ef40800 20 add_watcher() i=2 2024-09-12T00:33:42.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.067+0000 7fe78ef40800 20 add_watcher() i=3 2024-09-12T00:33:42.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.067+0000 7fe78ef40800 20 add_watcher() i=4 2024-09-12T00:33:42.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.067+0000 7fe78ef40800 20 add_watcher() i=5 2024-09-12T00:33:42.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.068+0000 7fe78ef40800 20 add_watcher() i=6 2024-09-12T00:33:42.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.069+0000 7fe78ef40800 20 add_watcher() i=7 2024-09-12T00:33:42.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.069+0000 7fe78ef40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:42.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.071+0000 7fe6417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:42.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.071+0000 7fe78ef40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:42.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.071+0000 7fe78ef40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:42.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.071+0000 7fe78ef40800 5 note: GC not initialized 2024-09-12T00:33:42.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.071+0000 7fe5bbfff640 20 reqs_thread_entry: start 2024-09-12T00:33:42.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.071+0000 7fe78ef40800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:42.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.072+0000 7fe78ef40800 20 Filter name: none 2024-09-12T00:33:42.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.072+0000 7fe5b9ffb640 20 reqs_thread_entry: start 2024-09-12T00:33:42.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.072+0000 7fe78ef40800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:33:42.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.072+0000 7fe78ef40800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.072+0000 7fe78ef40800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:42.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.072+0000 7fe78ef40800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:33:42.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.072+0000 7fe78ef40800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:33:42.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.072+0000 7fe78ef40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 : miss 2024-09-12T00:33:42.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.072+0000 7fe78ef40800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.073+0000 7fe78ef40800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:42.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.073+0000 7fe78ef40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 info.flags=0x17 2024-09-12T00:33:42.073 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.073+0000 7fe78ef40800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 to cache LRU end 2024-09-12T00:33:42.073 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.073+0000 7fe78ef40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:42.073 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.073+0000 7fe78ef40800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:33:42.073 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.073+0000 7fe78ef40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 2024-09-12T00:33:42.073 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.073+0000 7fe78ef40800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.073 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.075+0000 7fe78ef40800 1 NOTICE: finished shard 0 (4 entries found) 2024-09-12T00:33:42.073 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.075+0000 7fe78ef40800 1 NOTICE: finished all shards (4 entries found) 2024-09-12T00:33:42.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.076+0000 7fe6417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:42.077 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.078+0000 7fe78ef40800 20 remove_watcher() i=0 2024-09-12T00:33:42.077 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.078+0000 7fe78ef40800 2 removed watcher, disabling cache 2024-09-12T00:33:42.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.080+0000 7fe78ef40800 20 remove_watcher() i=1 2024-09-12T00:33:42.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.081+0000 7fe78ef40800 20 remove_watcher() i=2 2024-09-12T00:33:42.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.082+0000 7fe78ef40800 20 remove_watcher() i=3 2024-09-12T00:33:42.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.083+0000 7fe78ef40800 20 remove_watcher() i=4 2024-09-12T00:33:42.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.084+0000 7fe78ef40800 20 remove_watcher() i=5 2024-09-12T00:33:42.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.085+0000 7fe78ef40800 20 remove_watcher() i=6 2024-09-12T00:33:42.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.087+0000 7fe78ef40800 20 remove_watcher() i=7 2024-09-12T00:33:42.097 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: unlinked entries are not listable 2024-09-12T00:33:42.097 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:42.213 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T00:33:42.213 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:42.350 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T00:33:42.350 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:42.351 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:33:42.387 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:42.387 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:42.427 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.428+0000 7f19c2f19800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.429+0000 7f19c2f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:42.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.429+0000 7f19c2f19800 20 realm 2024-09-12T00:33:42.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.429+0000 7f19c2f19800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.430+0000 7f19c2f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:42.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.430+0000 7f19c2f19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:42.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.430+0000 7f19c2f19800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.430+0000 7f19c2f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:42.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.430+0000 7f19c2f19800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.430 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.431+0000 7f19c2f19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:42.430 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.431+0000 7f19c2f19800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.430 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.431+0000 7f19c2f19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:42.430 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.431+0000 7f19c2f19800 20 searching for the correct realm 2024-09-12T00:33:42.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.435+0000 7f19c0202640 0 -- 172.21.15.62:0/3306355545 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f19b804e550 msgr2=0x7f19b806f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:42.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.640+0000 7f19c1204640 0 -- 172.21.15.62:0/3306355545 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x558da9090220 msgr2=0x558da90926c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:42.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.645+0000 7f19c2f19800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:42.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.645+0000 7f19c2f19800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:42.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.645+0000 7f19c2f19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:42.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.645+0000 7f19c2f19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:42.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.645+0000 7f19c2f19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:42.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.645+0000 7f19c2f19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:42.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.645+0000 7f19c2f19800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.645+0000 7f19c2f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:42.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.645+0000 7f19c2f19800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.645+0000 7f19c2f19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:42.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.645+0000 7f19c2f19800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.646+0000 7f19c2f19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:42.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.646+0000 7f19c2f19800 20 zone default found 2024-09-12T00:33:42.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.646+0000 7f19c2f19800 4 Realm: () 2024-09-12T00:33:42.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.646+0000 7f19c2f19800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:42.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.646+0000 7f19c2f19800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:42.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.646+0000 7f19c2f19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:42.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.646+0000 7f19c2f19800 20 zonegroup default 2024-09-12T00:33:42.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.646+0000 7f19c2f19800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.646+0000 7f19c2f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:42.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.646+0000 7f19c2f19800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.647+0000 7f19c2f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:42.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.647+0000 7f19c2f19800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.647+0000 7f19c2f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:42.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.647+0000 7f19c2f19800 20 started sync module instance, tier type = 2024-09-12T00:33:42.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.647+0000 7f19c2f19800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:42.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.661+0000 7f19c2f19800 20 add_watcher() i=0 2024-09-12T00:33:42.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.661+0000 7f19c2f19800 20 add_watcher() i=1 2024-09-12T00:33:42.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.661+0000 7f19c2f19800 20 add_watcher() i=2 2024-09-12T00:33:42.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.661+0000 7f19c2f19800 20 add_watcher() i=3 2024-09-12T00:33:42.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.661+0000 7f19c2f19800 20 add_watcher() i=4 2024-09-12T00:33:42.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.661+0000 7f19c2f19800 20 add_watcher() i=5 2024-09-12T00:33:42.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.661+0000 7f19c2f19800 20 add_watcher() i=6 2024-09-12T00:33:42.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.662+0000 7f19c2f19800 20 add_watcher() i=7 2024-09-12T00:33:42.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.662+0000 7f19c2f19800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:42.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.664+0000 7f1876fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:42.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.665+0000 7f19c2f19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:42.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.665+0000 7f19c2f19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:42.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.665+0000 7f19c2f19800 5 note: GC not initialized 2024-09-12T00:33:42.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.665+0000 7f1875fe3640 20 reqs_thread_entry: start 2024-09-12T00:33:42.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.665+0000 7f19c2f19800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:42.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.665+0000 7f19c2f19800 20 Filter name: none 2024-09-12T00:33:42.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.665+0000 7f17e77fe640 20 reqs_thread_entry: start 2024-09-12T00:33:42.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.665+0000 7f19c2f19800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:33:42.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.665+0000 7f19c2f19800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.666+0000 7f19c2f19800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:42.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.666+0000 7f19c2f19800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:33:42.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.666+0000 7f19c2f19800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:33:42.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.666+0000 7f19c2f19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 : miss 2024-09-12T00:33:42.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.666+0000 7f19c2f19800 20 rados->read ofs=0 len=0 2024-09-12T00:33:42.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.666+0000 7f19c2f19800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:42.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.666+0000 7f19c2f19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 info.flags=0x17 2024-09-12T00:33:42.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.666+0000 7f19c2f19800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 to cache LRU end 2024-09-12T00:33:42.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.666+0000 7f19c2f19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:42.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.666+0000 7f19c2f19800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:33:42.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.666+0000 7f19c2f19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 2024-09-12T00:33:42.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.666+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.667+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.667+0000 7f19c2f19800 20 get_obj_state: octx=0x558da8e05690 obj=check-bucket:c state=0x558da90d4138 s->prefetch_data=0 2024-09-12T00:33:42.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.668+0000 7f19c2f19800 20 get_obj_state: setting s->obj_tag to jcm7ezcslbq2v4a7vj5pefsxzmdnzmq7 2024-09-12T00:33:42.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.668+0000 7f19c2f19800 20 get_obj_state_impl: setting s->olh_tag to vk67en38z9b6gvmjej1mn1pvwtsby8fz 2024-09-12T00:33:42.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.668+0000 7f19c2f19800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vk67en38z9b6gvmjej1mn1pvwtsby8fz 2024-09-12T00:33:42.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.670+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.669 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.671+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.671+0000 7f19c2f19800 20 olh_log_entry: epoch=3 op=3 key=c[j-9UF9Sepsv.FpEg8rfT3wHbE.t8dTF] 2024-09-12T00:33:42.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.671+0000 7f19c2f19800 20 get_obj_state: octx=0x558da8e05690 obj=check-bucket:_:j-9UF9Sepsv.FpEg8rfT3wHbE.t8dTF_c state=0x558da910aa78 s->prefetch_data=0 2024-09-12T00:33:42.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.672+0000 7f19c2f19800 10 manifest: total_size = 22 2024-09-12T00:33:42.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.672+0000 7f19c2f19800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3598274371940869576 2024-09-12T00:33:42.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.672+0000 7f19c2f19800 20 get_obj_state: octx=0x558da8e05690 obj=check-bucket:_:j-9UF9Sepsv.FpEg8rfT3wHbE.t8dTF_c state=0x558da910aa78 s->prefetch_data=0 2024-09-12T00:33:42.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.672+0000 7f19c2f19800 20 prepare_atomic_modification: state is not atomic. state=0x558da910aa78 2024-09-12T00:33:42.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.672+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.674+0000 7f19c2f19800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:33:42.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.674+0000 7f19c2f19800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:33:42.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.674+0000 7f19c2f19800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:33:42.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.674+0000 7f19c2f19800 5 delete_objs_inline: removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1__shadow:j-9UF9Sepsv.FpEg8rfT3wHbE.t8dTF_.0AV2UovVk1kNjIGcmuXgG29DpcWSxgb_0 2024-09-12T00:33:42.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.675+0000 7f1897fff640 20 handle_completion(): completion ok for obj=c[j-9UF9Sepsv.FpEg8rfT3wHbE.t8dTF] 2024-09-12T00:33:42.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.676+0000 7f19c2f19800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:33:42.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.678+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.678+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.682+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.682+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.682+0000 7f19c2f19800 20 get_obj_state: octx=0x558da8e05690 obj=check-bucket:d state=0x558da90cd818 s->prefetch_data=0 2024-09-12T00:33:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.683+0000 7f19c2f19800 20 get_obj_state: setting s->obj_tag to 23rih8m87nwxcakngx2t3a5go00mp6zz 2024-09-12T00:33:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.683+0000 7f19c2f19800 20 get_obj_state_impl: setting s->olh_tag to ftn972qe10soe0cshdpki3poxj23kesd 2024-09-12T00:33:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.683+0000 7f19c2f19800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ftn972qe10soe0cshdpki3poxj23kesd 2024-09-12T00:33:42.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.684+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.688+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.688+0000 7f19c2f19800 20 olh_log_entry: epoch=3 op=3 key=d[gH0-k1xAGDDi5LO30z0LzPaTGwbheVx] 2024-09-12T00:33:42.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.688+0000 7f19c2f19800 20 get_obj_state: octx=0x558da8e05690 obj=check-bucket:_:gH0-k1xAGDDi5LO30z0LzPaTGwbheVx_d state=0x558da910aa78 s->prefetch_data=0 2024-09-12T00:33:42.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.688+0000 7f19c2f19800 10 manifest: total_size = 9 2024-09-12T00:33:42.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.688+0000 7f19c2f19800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14232970340551027231 2024-09-12T00:33:42.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.688+0000 7f19c2f19800 20 get_obj_state: octx=0x558da8e05690 obj=check-bucket:_:gH0-k1xAGDDi5LO30z0LzPaTGwbheVx_d state=0x558da910aa78 s->prefetch_data=0 2024-09-12T00:33:42.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.688+0000 7f19c2f19800 20 prepare_atomic_modification: state is not atomic. state=0x558da910aa78 2024-09-12T00:33:42.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.688+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.691+0000 7f19c2f19800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:33:42.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.691+0000 7f19c2f19800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:33:42.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.691+0000 7f19c2f19800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:33:42.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.691+0000 7f19c2f19800 5 delete_objs_inline: removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1__shadow:gH0-k1xAGDDi5LO30z0LzPaTGwbheVx_.VLUEIoR2xVU7Fo5sUTi6EsYo-d58lvU_0 2024-09-12T00:33:42.694 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.695+0000 7f1897fff640 20 handle_completion(): completion ok for obj=d[gH0-k1xAGDDi5LO30z0LzPaTGwbheVx] 2024-09-12T00:33:42.694 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.695+0000 7f19c2f19800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:33:42.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.696+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.696+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.698 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.699+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.698 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.700+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.699 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.700+0000 7f19c2f19800 20 get_obj_state: octx=0x558da8e05690 obj=check-bucket:e state=0x558da90cefb8 s->prefetch_data=0 2024-09-12T00:33:42.699 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.700+0000 7f19c2f19800 20 get_obj_state: setting s->obj_tag to siqe81wsj9ae5xph93067jf04067yvqq 2024-09-12T00:33:42.699 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.700+0000 7f19c2f19800 20 get_obj_state_impl: setting s->olh_tag to ra5uzul8a0xczxgt4travvtljnta58jv 2024-09-12T00:33:42.699 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.700+0000 7f19c2f19800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ra5uzul8a0xczxgt4travvtljnta58jv 2024-09-12T00:33:42.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.702+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.704+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.704+0000 7f19c2f19800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:33:42.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.704+0000 7f19c2f19800 20 olh_log_entry: epoch=2 op=3 key=e[9XrRUHzex9hrwaf7GSW6u4A63JhgbaY] 2024-09-12T00:33:42.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.704+0000 7f19c2f19800 20 get_obj_state: octx=0x558da8e05690 obj=check-bucket:_:9XrRUHzex9hrwaf7GSW6u4A63JhgbaY_e state=0x558da910aa78 s->prefetch_data=0 2024-09-12T00:33:42.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.705+0000 7f19c2f19800 10 manifest: total_size = 22 2024-09-12T00:33:42.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.705+0000 7f19c2f19800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3428245235431525411 2024-09-12T00:33:42.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.705+0000 7f19c2f19800 20 get_obj_state: octx=0x558da8e05690 obj=check-bucket:_:9XrRUHzex9hrwaf7GSW6u4A63JhgbaY_e state=0x558da910aa78 s->prefetch_data=0 2024-09-12T00:33:42.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.705+0000 7f19c2f19800 20 prepare_atomic_modification: state is not atomic. state=0x558da910aa78 2024-09-12T00:33:42.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.705+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.708+0000 7f19c2f19800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:33:42.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.708+0000 7f19c2f19800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:33:42.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.708+0000 7f19c2f19800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:33:42.707 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.708+0000 7f19c2f19800 5 delete_objs_inline: removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1__shadow:9XrRUHzex9hrwaf7GSW6u4A63JhgbaY_.madiO4nQQ-LZKsJWKO1FGsbXz7char5_0 2024-09-12T00:33:42.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.709+0000 7f19c2f19800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:33:42.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.709+0000 7f18977fe640 20 handle_completion(): completion ok for obj=e[9XrRUHzex9hrwaf7GSW6u4A63JhgbaY] 2024-09-12T00:33:42.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.712+0000 7f19c2f19800 20 get_obj_state: octx=0x558da8e05690 obj=check-bucket:e state=0x558da90cefb8 s->prefetch_data=0 2024-09-12T00:33:42.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.712+0000 7f19c2f19800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ra5uzul8a0xczxgt4travvtljnta58jv 2024-09-12T00:33:42.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.723+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.725+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.726+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.727+0000 7f19c2f19800 20 get_obj_state: octx=0x558da8e05690 obj=check-bucket:f state=0x558da90cefb8 s->prefetch_data=0 2024-09-12T00:33:42.726 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.727+0000 7f19c2f19800 20 get_obj_state: setting s->obj_tag to uui5gku9xbg90lrphrbh8pb74o8m216l 2024-09-12T00:33:42.726 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.727+0000 7f19c2f19800 20 get_obj_state_impl: setting s->olh_tag to wpwmmmdhjj5u3p0cxw0f8awrb8lhnmup 2024-09-12T00:33:42.726 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.727+0000 7f19c2f19800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wpwmmmdhjj5u3p0cxw0f8awrb8lhnmup 2024-09-12T00:33:42.727 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.728+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.728 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.730+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.730+0000 7f19c2f19800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:33:42.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.730+0000 7f19c2f19800 20 olh_log_entry: epoch=2 op=3 key=f[vA9BAwiAmbym4rGGpqb8YkCUlNF5fdd] 2024-09-12T00:33:42.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.730+0000 7f19c2f19800 20 get_obj_state: octx=0x558da8e05690 obj=check-bucket:_:vA9BAwiAmbym4rGGpqb8YkCUlNF5fdd_f state=0x558da910aa78 s->prefetch_data=0 2024-09-12T00:33:42.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.730+0000 7f19c2f19800 10 manifest: total_size = 9 2024-09-12T00:33:42.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.730+0000 7f19c2f19800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2636656238020451550 2024-09-12T00:33:42.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.730+0000 7f19c2f19800 20 get_obj_state: octx=0x558da8e05690 obj=check-bucket:_:vA9BAwiAmbym4rGGpqb8YkCUlNF5fdd_f state=0x558da910aa78 s->prefetch_data=0 2024-09-12T00:33:42.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.730+0000 7f19c2f19800 20 prepare_atomic_modification: state is not atomic. state=0x558da910aa78 2024-09-12T00:33:42.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.730+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.733+0000 7f19c2f19800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:33:42.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.733+0000 7f19c2f19800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-12T00:33:42.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.733+0000 7f19c2f19800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:33:42.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.733+0000 7f19c2f19800 5 delete_objs_inline: removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1__shadow:vA9BAwiAmbym4rGGpqb8YkCUlNF5fdd_.fbVT85KBUP2kdDT1ssPgjaahPY7fASh_0 2024-09-12T00:33:42.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.735+0000 7f1897fff640 20 handle_completion(): completion ok for obj=f[vA9BAwiAmbym4rGGpqb8YkCUlNF5fdd] 2024-09-12T00:33:42.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.738+0000 7f19c2f19800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:33:42.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.740+0000 7f19c2f19800 20 get_obj_state: octx=0x558da8e05690 obj=check-bucket:f state=0x558da90cefb8 s->prefetch_data=0 2024-09-12T00:33:42.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.740+0000 7f19c2f19800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wpwmmmdhjj5u3p0cxw0f8awrb8lhnmup 2024-09-12T00:33:42.742 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.743+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.743 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.744+0000 7f19c2f19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:42.743 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.744+0000 7f19c2f19800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T00:33:42.743 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.744+0000 7f19c2f19800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:33:42.744 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.745+0000 7f1876fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:42.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.747+0000 7f19c2f19800 20 remove_watcher() i=0 2024-09-12T00:33:42.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.747+0000 7f19c2f19800 2 removed watcher, disabling cache 2024-09-12T00:33:42.747 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.748+0000 7f19c2f19800 20 remove_watcher() i=1 2024-09-12T00:33:42.748 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.749+0000 7f19c2f19800 20 remove_watcher() i=2 2024-09-12T00:33:42.749 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.751+0000 7f19c2f19800 20 remove_watcher() i=3 2024-09-12T00:33:42.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.752+0000 7f19c2f19800 20 remove_watcher() i=4 2024-09-12T00:33:42.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.753+0000 7f19c2f19800 20 remove_watcher() i=5 2024-09-12T00:33:42.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.754+0000 7f19c2f19800 20 remove_watcher() i=6 2024-09-12T00:33:42.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:42.755+0000 7f19c2f19800 20 remove_watcher() i=7 2024-09-12T00:33:42.850 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T00:33:42.850 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:43.015 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T00:33:43.015 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:43.017 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:33:43.050 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:43.050 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:43.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.091+0000 7fcf17323800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.092+0000 7fcf17323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.092+0000 7fcf17323800 20 realm 2024-09-12T00:33:43.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.092+0000 7fcf17323800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.092+0000 7fcf17323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.092+0000 7fcf17323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:43.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.092+0000 7fcf17323800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.092+0000 7fcf17323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.092+0000 7fcf17323800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.093+0000 7fcf17323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:43.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.093+0000 7fcf17323800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.094+0000 7fcf17323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:43.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.094+0000 7fcf17323800 20 searching for the correct realm 2024-09-12T00:33:43.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.096+0000 7fcf1280b640 0 -- 172.21.15.62:0/2958385763 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fcf0c025040 msgr2=0x7fcf0c036940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:43.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.302+0000 7fcf1380d640 0 -- 172.21.15.62:0/2958385763 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x564dc57ca3d0 msgr2=0x564dc57cc840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:43.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.306+0000 7fcf17323800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:43.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.306+0000 7fcf17323800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:43.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.306+0000 7fcf17323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:43.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.306+0000 7fcf17323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:43.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.306+0000 7fcf17323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:43.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.306+0000 7fcf17323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:43.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.306+0000 7fcf17323800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.306+0000 7fcf17323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.306+0000 7fcf17323800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.306+0000 7fcf17323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:43.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.306+0000 7fcf17323800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.307+0000 7fcf17323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:43.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.307+0000 7fcf17323800 20 zone default found 2024-09-12T00:33:43.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.307+0000 7fcf17323800 4 Realm: () 2024-09-12T00:33:43.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.307+0000 7fcf17323800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:43.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.307+0000 7fcf17323800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:43.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.307+0000 7fcf17323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:43.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.307+0000 7fcf17323800 20 zonegroup default 2024-09-12T00:33:43.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.307+0000 7fcf17323800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.307+0000 7fcf17323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.307+0000 7fcf17323800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.307+0000 7fcf17323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.307+0000 7fcf17323800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.308+0000 7fcf17323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.308+0000 7fcf17323800 20 started sync module instance, tier type = 2024-09-12T00:33:43.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.308+0000 7fcf17323800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:43.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.324+0000 7fcf17323800 20 add_watcher() i=0 2024-09-12T00:33:43.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.324+0000 7fcf17323800 20 add_watcher() i=1 2024-09-12T00:33:43.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.324+0000 7fcf17323800 20 add_watcher() i=2 2024-09-12T00:33:43.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.324+0000 7fcf17323800 20 add_watcher() i=3 2024-09-12T00:33:43.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.324+0000 7fcf17323800 20 add_watcher() i=4 2024-09-12T00:33:43.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.324+0000 7fcf17323800 20 add_watcher() i=5 2024-09-12T00:33:43.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.324+0000 7fcf17323800 20 add_watcher() i=6 2024-09-12T00:33:43.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.325+0000 7fcf17323800 20 add_watcher() i=7 2024-09-12T00:33:43.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.325+0000 7fcf17323800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:43.326 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.328+0000 7fcdc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:43.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.328+0000 7fcf17323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:43.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.328+0000 7fcf17323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:43.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.328+0000 7fcf17323800 5 note: GC not initialized 2024-09-12T00:33:43.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.328+0000 7fcdc8fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:43.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.328+0000 7fcf17323800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:43.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.328+0000 7fcf17323800 20 Filter name: none 2024-09-12T00:33:43.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.329+0000 7fcd427fc640 20 reqs_thread_entry: start 2024-09-12T00:33:43.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.329+0000 7fcf17323800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:33:43.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.329+0000 7fcf17323800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.329+0000 7fcf17323800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:43.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.329+0000 7fcf17323800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:33:43.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.329+0000 7fcf17323800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:33:43.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.329+0000 7fcf17323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 : miss 2024-09-12T00:33:43.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.329+0000 7fcf17323800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.329+0000 7fcf17323800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.329+0000 7fcf17323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 info.flags=0x17 2024-09-12T00:33:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.329+0000 7fcf17323800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 to cache LRU end 2024-09-12T00:33:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.329+0000 7fcf17323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.329+0000 7fcf17323800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:33:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.330+0000 7fcf17323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 2024-09-12T00:33:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.330+0000 7fcf17323800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.330+0000 7fcf17323800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:33:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.330+0000 7fcf17323800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:33:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.331+0000 7fcdc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:43.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.334+0000 7fcf17323800 20 remove_watcher() i=0 2024-09-12T00:33:43.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.334+0000 7fcf17323800 2 removed watcher, disabling cache 2024-09-12T00:33:43.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.335+0000 7fcf17323800 20 remove_watcher() i=1 2024-09-12T00:33:43.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.337+0000 7fcf17323800 20 remove_watcher() i=2 2024-09-12T00:33:43.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.338+0000 7fcf17323800 20 remove_watcher() i=3 2024-09-12T00:33:43.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.339+0000 7fcf17323800 20 remove_watcher() i=4 2024-09-12T00:33:43.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.340+0000 7fcf17323800 20 remove_watcher() i=5 2024-09-12T00:33:43.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.341+0000 7fcf17323800 20 remove_watcher() i=6 2024-09-12T00:33:43.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.342+0000 7fcf17323800 20 remove_watcher() i=7 2024-09-12T00:33:43.552 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:33:43.583 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:43.583 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:43.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.623+0000 7fd83f40e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.625+0000 7fd83f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.625+0000 7fd83f40e800 20 realm 2024-09-12T00:33:43.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.625+0000 7fd83f40e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.626+0000 7fd83f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.626+0000 7fd83f40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:43.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.626+0000 7fd83f40e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.626+0000 7fd83f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.626+0000 7fd83f40e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.626+0000 7fd83f40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:43.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.626+0000 7fd83f40e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.627+0000 7fd83f40e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:43.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.627+0000 7fd83f40e800 20 searching for the correct realm 2024-09-12T00:33:43.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.630+0000 7fd83a3df640 0 -- 172.21.15.62:0/1092356916 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fd8340b25d0 msgr2=0x7fd8340df910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:43.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.835+0000 7fd83a3df640 0 -- 172.21.15.62:0/1092356916 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55ff6cad1570 msgr2=0x55ff6cad3960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:43.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.839+0000 7fd83f40e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:43.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.839+0000 7fd83f40e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:43.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.839+0000 7fd83f40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:43.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.839+0000 7fd83f40e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:43.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.839+0000 7fd83f40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:43.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.839+0000 7fd83f40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:43.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.839+0000 7fd83f40e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.839+0000 7fd83f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.839+0000 7fd83f40e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.840+0000 7fd83f40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:43.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.840+0000 7fd83f40e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.840+0000 7fd83f40e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:43.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.840+0000 7fd83f40e800 20 zone default found 2024-09-12T00:33:43.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.840+0000 7fd83f40e800 4 Realm: () 2024-09-12T00:33:43.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.840+0000 7fd83f40e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:43.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.840+0000 7fd83f40e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:43.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.840+0000 7fd83f40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:43.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.840+0000 7fd83f40e800 20 zonegroup default 2024-09-12T00:33:43.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.840+0000 7fd83f40e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.840+0000 7fd83f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.840+0000 7fd83f40e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.841+0000 7fd83f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.841+0000 7fd83f40e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.841+0000 7fd83f40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.841+0000 7fd83f40e800 20 started sync module instance, tier type = 2024-09-12T00:33:43.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.841+0000 7fd83f40e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:43.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.851+0000 7fd83f40e800 20 add_watcher() i=0 2024-09-12T00:33:43.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.851+0000 7fd83f40e800 20 add_watcher() i=1 2024-09-12T00:33:43.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.851+0000 7fd83f40e800 20 add_watcher() i=2 2024-09-12T00:33:43.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.851+0000 7fd83f40e800 20 add_watcher() i=3 2024-09-12T00:33:43.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.851+0000 7fd83f40e800 20 add_watcher() i=4 2024-09-12T00:33:43.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.851+0000 7fd83f40e800 20 add_watcher() i=5 2024-09-12T00:33:43.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.851+0000 7fd83f40e800 20 add_watcher() i=6 2024-09-12T00:33:43.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.852+0000 7fd83f40e800 20 add_watcher() i=7 2024-09-12T00:33:43.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.852+0000 7fd83f40e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:43.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.853+0000 7fd6f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:43.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.854+0000 7fd83f40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:43.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.854+0000 7fd83f40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:43.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.854+0000 7fd83f40e800 5 note: GC not initialized 2024-09-12T00:33:43.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.854+0000 7fd66bfff640 20 reqs_thread_entry: start 2024-09-12T00:33:43.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.854+0000 7fd83f40e800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:43.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.854+0000 7fd83f40e800 20 Filter name: none 2024-09-12T00:33:43.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.854+0000 7fd669ffb640 20 reqs_thread_entry: start 2024-09-12T00:33:43.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.854+0000 7fd83f40e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.855+0000 7fd83f40e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:43.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.855+0000 7fd83f40e800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.855+0000 7fd83f40e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:43.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.855+0000 7fd83f40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:43.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.855+0000 7fd83f40e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:33:43.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.855+0000 7fd83f40e800 20 INFO: main: starting shard=0 2024-09-12T00:33:43.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.855+0000 7fd83f40e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:43.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.856+0000 7fd83f40e800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:33:43.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.856+0000 7fd83f40e800 20 INFO: main: done 2024-09-12T00:33:43.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.857+0000 7fd6f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:43.858 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.859+0000 7fd83f40e800 20 remove_watcher() i=0 2024-09-12T00:33:43.858 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.859+0000 7fd83f40e800 2 removed watcher, disabling cache 2024-09-12T00:33:43.859 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.860+0000 7fd83f40e800 20 remove_watcher() i=1 2024-09-12T00:33:43.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.861+0000 7fd83f40e800 20 remove_watcher() i=2 2024-09-12T00:33:43.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.862+0000 7fd83f40e800 20 remove_watcher() i=3 2024-09-12T00:33:43.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.863+0000 7fd83f40e800 20 remove_watcher() i=4 2024-09-12T00:33:43.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.864+0000 7fd83f40e800 20 remove_watcher() i=5 2024-09-12T00:33:43.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.865+0000 7fd83f40e800 20 remove_watcher() i=6 2024-09-12T00:33:43.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.868+0000 7fd83f40e800 20 remove_watcher() i=7 2024-09-12T00:33:43.880 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:33:43.911 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:43.912 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:43.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.953+0000 7f038d339800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.955+0000 7f038d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.955+0000 7f038d339800 20 realm 2024-09-12T00:33:43.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.955+0000 7f038d339800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.955+0000 7f038d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.955+0000 7f038d339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:43.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.955+0000 7f038d339800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.956+0000 7f038d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:43.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.956+0000 7f038d339800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.956+0000 7f038d339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:43.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.956+0000 7f038d339800 20 rados->read ofs=0 len=0 2024-09-12T00:33:43.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.957+0000 7f038d339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:43.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.957+0000 7f038d339800 20 searching for the correct realm 2024-09-12T00:33:43.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:43.960+0000 7f03887c6640 0 -- 172.21.15.62:0/2642606697 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f0380040db0 msgr2=0x7f038003d9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:44.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.166+0000 7f03887c6640 0 -- 172.21.15.62:0/2642606697 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55be5d7b0510 msgr2=0x55be5d7b2900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:44.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.169+0000 7f038d339800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:44.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.169+0000 7f038d339800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:44.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.169+0000 7f038d339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:44.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.169+0000 7f038d339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:44.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.169+0000 7f038d339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:44.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.169+0000 7f038d339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:44.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.169+0000 7f038d339800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.170+0000 7f038d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.170+0000 7f038d339800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.170+0000 7f038d339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:44.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.170+0000 7f038d339800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.170+0000 7f038d339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:44.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.170+0000 7f038d339800 20 zone default found 2024-09-12T00:33:44.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.170+0000 7f038d339800 4 Realm: () 2024-09-12T00:33:44.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.170+0000 7f038d339800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:44.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.170+0000 7f038d339800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:44.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.170+0000 7f038d339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:44.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.170+0000 7f038d339800 20 zonegroup default 2024-09-12T00:33:44.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.170+0000 7f038d339800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.171+0000 7f038d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.171+0000 7f038d339800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.171+0000 7f038d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.171+0000 7f038d339800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.171+0000 7f038d339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.171+0000 7f038d339800 20 started sync module instance, tier type = 2024-09-12T00:33:44.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.171+0000 7f038d339800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:44.185 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.187+0000 7f038d339800 20 add_watcher() i=0 2024-09-12T00:33:44.185 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.187+0000 7f038d339800 20 add_watcher() i=1 2024-09-12T00:33:44.185 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.187+0000 7f038d339800 20 add_watcher() i=2 2024-09-12T00:33:44.185 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.187+0000 7f038d339800 20 add_watcher() i=3 2024-09-12T00:33:44.185 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.187+0000 7f038d339800 20 add_watcher() i=4 2024-09-12T00:33:44.186 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.187+0000 7f038d339800 20 add_watcher() i=5 2024-09-12T00:33:44.186 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.187+0000 7f038d339800 20 add_watcher() i=6 2024-09-12T00:33:44.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.189+0000 7f038d339800 20 add_watcher() i=7 2024-09-12T00:33:44.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.189+0000 7f038d339800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:44.190 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.191+0000 7f023efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:44.191 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.192+0000 7f038d339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:44.191 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.192+0000 7f038d339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:44.191 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.192+0000 7f038d339800 5 note: GC not initialized 2024-09-12T00:33:44.191 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.192+0000 7f023dfe3640 20 reqs_thread_entry: start 2024-09-12T00:33:44.191 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.192+0000 7f038d339800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:44.191 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.192+0000 7f038d339800 20 Filter name: none 2024-09-12T00:33:44.191 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.192+0000 7f01af7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:44.191 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.192+0000 7f038d339800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.192 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.193+0000 7f038d339800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:44.192 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.193+0000 7f038d339800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.192 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.193+0000 7f038d339800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:44.192 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.193+0000 7f038d339800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:44.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.193+0000 7f038d339800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:33:44.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.193+0000 7f038d339800 20 INFO: main: starting shard=0 2024-09-12T00:33:44.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.193+0000 7f038d339800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:44.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.193+0000 7f038d339800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:33:44.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.194+0000 7f038d339800 20 INFO: main: done 2024-09-12T00:33:44.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.194+0000 7f023efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:44.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.197+0000 7f038d339800 20 remove_watcher() i=0 2024-09-12T00:33:44.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.197+0000 7f038d339800 2 removed watcher, disabling cache 2024-09-12T00:33:44.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.198+0000 7f038d339800 20 remove_watcher() i=1 2024-09-12T00:33:44.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.199+0000 7f038d339800 20 remove_watcher() i=2 2024-09-12T00:33:44.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.200+0000 7f038d339800 20 remove_watcher() i=3 2024-09-12T00:33:44.199 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.201+0000 7f038d339800 20 remove_watcher() i=4 2024-09-12T00:33:44.200 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.202+0000 7f038d339800 20 remove_watcher() i=5 2024-09-12T00:33:44.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.203+0000 7f038d339800 20 remove_watcher() i=6 2024-09-12T00:33:44.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.204+0000 7f038d339800 20 remove_watcher() i=7 2024-09-12T00:33:44.214 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T00:33:44.214 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:44.215 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:33:44.248 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:44.248 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:44.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.288+0000 7fb1ba620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.289+0000 7fb1ba620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.289+0000 7fb1ba620800 20 realm 2024-09-12T00:33:44.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.289+0000 7fb1ba620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.290+0000 7fb1ba620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.290+0000 7fb1ba620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:44.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.290+0000 7fb1ba620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.290+0000 7fb1ba620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.290+0000 7fb1ba620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.291+0000 7fb1ba620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:44.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.291+0000 7fb1ba620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.291+0000 7fb1ba620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:44.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.291+0000 7fb1ba620800 20 searching for the correct realm 2024-09-12T00:33:44.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.294+0000 7fb1b7909640 0 -- 172.21.15.62:0/1795656801 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fb1b0068be0 msgr2=0x7fb1b0027800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:44.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.499+0000 7fb1b7909640 0 -- 172.21.15.62:0/1795656801 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x560bf998e820 msgr2=0x560bf9990cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.503+0000 7fb1ba620800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.503+0000 7fb1ba620800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.503+0000 7fb1ba620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.503+0000 7fb1ba620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.503+0000 7fb1ba620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.503+0000 7fb1ba620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.503+0000 7fb1ba620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.504+0000 7fb1ba620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.504+0000 7fb1ba620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.504+0000 7fb1ba620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:44.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.504+0000 7fb1ba620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.504+0000 7fb1ba620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:44.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.504+0000 7fb1ba620800 20 zone default found 2024-09-12T00:33:44.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.504+0000 7fb1ba620800 4 Realm: () 2024-09-12T00:33:44.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.504+0000 7fb1ba620800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:44.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.504+0000 7fb1ba620800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:44.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.504+0000 7fb1ba620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:44.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.504+0000 7fb1ba620800 20 zonegroup default 2024-09-12T00:33:44.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.504+0000 7fb1ba620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.504+0000 7fb1ba620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.504+0000 7fb1ba620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.505+0000 7fb1ba620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.505+0000 7fb1ba620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.505+0000 7fb1ba620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.505+0000 7fb1ba620800 20 started sync module instance, tier type = 2024-09-12T00:33:44.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.505+0000 7fb1ba620800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:44.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.516+0000 7fb1ba620800 20 add_watcher() i=0 2024-09-12T00:33:44.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.516+0000 7fb1ba620800 20 add_watcher() i=1 2024-09-12T00:33:44.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.516+0000 7fb1ba620800 20 add_watcher() i=2 2024-09-12T00:33:44.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.516+0000 7fb1ba620800 20 add_watcher() i=3 2024-09-12T00:33:44.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.516+0000 7fb1ba620800 20 add_watcher() i=4 2024-09-12T00:33:44.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.516+0000 7fb1ba620800 20 add_watcher() i=5 2024-09-12T00:33:44.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.516+0000 7fb1ba620800 20 add_watcher() i=6 2024-09-12T00:33:44.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.517+0000 7fb1ba620800 20 add_watcher() i=7 2024-09-12T00:33:44.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.517+0000 7fb1ba620800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:44.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.518+0000 7fb06efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:44.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.518+0000 7fb1ba620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:44.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.518+0000 7fb1ba620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:44.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.518+0000 7fb1ba620800 5 note: GC not initialized 2024-09-12T00:33:44.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.519+0000 7fb06dfdb640 20 reqs_thread_entry: start 2024-09-12T00:33:44.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.519+0000 7fb1ba620800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:44.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.519+0000 7fb1ba620800 20 Filter name: none 2024-09-12T00:33:44.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.519+0000 7fafdf7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:44.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.519+0000 7fb1ba620800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:33:44.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.519+0000 7fb1ba620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.519+0000 7fb1ba620800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:44.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.519+0000 7fb1ba620800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:33:44.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.519+0000 7fb1ba620800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:33:44.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.519+0000 7fb1ba620800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 : miss 2024-09-12T00:33:44.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.519+0000 7fb1ba620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.520+0000 7fb1ba620800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:44.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.520+0000 7fb1ba620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 info.flags=0x17 2024-09-12T00:33:44.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.520+0000 7fb1ba620800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 to cache LRU end 2024-09-12T00:33:44.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.520+0000 7fb1ba620800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:44.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.520+0000 7fb1ba620800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:33:44.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.520+0000 7fb1ba620800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 2024-09-12T00:33:44.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.520+0000 7fb1ba620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:44.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.521+0000 7fb1ba620800 1 NOTICE: finished shard 0 (2 entries found) 2024-09-12T00:33:44.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.521+0000 7fb1ba620800 1 NOTICE: finished all shards (2 entries found) 2024-09-12T00:33:44.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.522+0000 7fb06efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:44.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.524+0000 7fb1ba620800 20 remove_watcher() i=0 2024-09-12T00:33:44.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.524+0000 7fb1ba620800 2 removed watcher, disabling cache 2024-09-12T00:33:44.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.525+0000 7fb1ba620800 20 remove_watcher() i=1 2024-09-12T00:33:44.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.526+0000 7fb1ba620800 20 remove_watcher() i=2 2024-09-12T00:33:44.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.527+0000 7fb1ba620800 20 remove_watcher() i=3 2024-09-12T00:33:44.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.528+0000 7fb1ba620800 20 remove_watcher() i=4 2024-09-12T00:33:44.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.529+0000 7fb1ba620800 20 remove_watcher() i=5 2024-09-12T00:33:44.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.530+0000 7fb1ba620800 20 remove_watcher() i=6 2024-09-12T00:33:44.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.531+0000 7fb1ba620800 20 remove_watcher() i=7 2024-09-12T00:33:44.540 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T00:33:44.540 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:44.542 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:33:44.575 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:44.575 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:44.614 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.616+0000 7fc3bd519800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.617+0000 7fc3bd519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.617+0000 7fc3bd519800 20 realm 2024-09-12T00:33:44.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.617+0000 7fc3bd519800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.617+0000 7fc3bd519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.617+0000 7fc3bd519800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:44.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.617+0000 7fc3bd519800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.617+0000 7fc3bd519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.617+0000 7fc3bd519800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.618+0000 7fc3bd519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:44.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.618+0000 7fc3bd519800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.619+0000 7fc3bd519800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:44.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.619+0000 7fc3bd519800 20 searching for the correct realm 2024-09-12T00:33:44.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.621+0000 7fc3ba802640 0 -- 172.21.15.62:0/57112135 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fc3b4060a10 msgr2=0x7fc3b4096950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:44.824 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.826+0000 7fc3bb804640 0 -- 172.21.15.62:0/57112135 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5590e76920f0 msgr2=0x5590e7694560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:44.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.829+0000 7fc3bd519800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:44.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.829+0000 7fc3bd519800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:44.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.829+0000 7fc3bd519800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:44.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.829+0000 7fc3bd519800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:44.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.829+0000 7fc3bd519800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:44.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.829+0000 7fc3bd519800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:44.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.829+0000 7fc3bd519800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.829+0000 7fc3bd519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.829+0000 7fc3bd519800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.830+0000 7fc3bd519800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:44.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.830+0000 7fc3bd519800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.830+0000 7fc3bd519800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:44.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.830+0000 7fc3bd519800 20 zone default found 2024-09-12T00:33:44.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.830+0000 7fc3bd519800 4 Realm: () 2024-09-12T00:33:44.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.830+0000 7fc3bd519800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:44.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.830+0000 7fc3bd519800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:44.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.830+0000 7fc3bd519800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:44.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.830+0000 7fc3bd519800 20 zonegroup default 2024-09-12T00:33:44.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.830+0000 7fc3bd519800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.831+0000 7fc3bd519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.831+0000 7fc3bd519800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.831+0000 7fc3bd519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.831+0000 7fc3bd519800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.831+0000 7fc3bd519800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:44.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.831+0000 7fc3bd519800 20 started sync module instance, tier type = 2024-09-12T00:33:44.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.831+0000 7fc3bd519800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:44.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.842+0000 7fc3bd519800 20 add_watcher() i=0 2024-09-12T00:33:44.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.842+0000 7fc3bd519800 20 add_watcher() i=1 2024-09-12T00:33:44.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.842+0000 7fc3bd519800 20 add_watcher() i=2 2024-09-12T00:33:44.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.842+0000 7fc3bd519800 20 add_watcher() i=3 2024-09-12T00:33:44.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.842+0000 7fc3bd519800 20 add_watcher() i=4 2024-09-12T00:33:44.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.842+0000 7fc3bd519800 20 add_watcher() i=5 2024-09-12T00:33:44.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.842+0000 7fc3bd519800 20 add_watcher() i=6 2024-09-12T00:33:44.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.844+0000 7fc3bd519800 20 add_watcher() i=7 2024-09-12T00:33:44.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.844+0000 7fc3bd519800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:44.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.845+0000 7fc2717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.846+0000 7fc3bd519800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.846+0000 7fc3bd519800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.846+0000 7fc3bd519800 5 note: GC not initialized 2024-09-12T00:33:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.846+0000 7fc1ebfff640 20 reqs_thread_entry: start 2024-09-12T00:33:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.846+0000 7fc3bd519800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.846+0000 7fc3bd519800 20 Filter name: none 2024-09-12T00:33:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.846+0000 7fc1e9ffb640 20 reqs_thread_entry: start 2024-09-12T00:33:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.846+0000 7fc3bd519800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:33:44.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.846+0000 7fc3bd519800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.847+0000 7fc3bd519800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:44.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.847+0000 7fc3bd519800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:33:44.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.847+0000 7fc3bd519800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:33:44.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.847+0000 7fc3bd519800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 : miss 2024-09-12T00:33:44.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.847+0000 7fc3bd519800 20 rados->read ofs=0 len=0 2024-09-12T00:33:44.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.847+0000 7fc3bd519800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:44.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.847+0000 7fc3bd519800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 info.flags=0x17 2024-09-12T00:33:44.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.847+0000 7fc3bd519800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 to cache LRU end 2024-09-12T00:33:44.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.847+0000 7fc3bd519800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:44.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.847+0000 7fc3bd519800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:33:44.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.847+0000 7fc3bd519800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 2024-09-12T00:33:44.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.847+0000 7fc3bd519800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:44.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.848+0000 7fc3bd519800 20 get_obj_state: octx=0x5590e7407660 obj=check-bucket:c state=0x5590e76d0018 s->prefetch_data=0 2024-09-12T00:33:44.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.848+0000 7fc3bd519800 20 get_obj_state: setting s->obj_tag to jcm7ezcslbq2v4a7vj5pefsxzmdnzmq7 2024-09-12T00:33:44.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.848+0000 7fc3bd519800 20 get_obj_state_impl: setting s->olh_tag to vk67en38z9b6gvmjej1mn1pvwtsby8fz 2024-09-12T00:33:44.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.848+0000 7fc3bd519800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:44.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.848+0000 7fc3bd519800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T00:33:44.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.848+0000 7fc3bd519800 20 olh_log_entry: epoch=4 op=3 key=c[1uv-H8ze527Ddql-0xxZNxqknpy6oMc] 2024-09-12T00:33:44.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.848+0000 7fc3bd519800 20 get_obj_state: octx=0x5590e770a0b0 obj=check-bucket:_:1uv-H8ze527Ddql-0xxZNxqknpy6oMc_c state=0x5590e76cf348 s->prefetch_data=0 2024-09-12T00:33:44.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.850+0000 7fc3bd519800 20 get_obj_state: octx=0x5590e770a0b0 obj=check-bucket:c state=0x5590e770aac8 s->prefetch_data=0 2024-09-12T00:33:44.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.850+0000 7fc3bd519800 20 get_obj_state: setting s->obj_tag to jcm7ezcslbq2v4a7vj5pefsxzmdnzmq7 2024-09-12T00:33:44.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.850+0000 7fc3bd519800 20 get_obj_state_impl: setting s->olh_tag to vk67en38z9b6gvmjej1mn1pvwtsby8fz 2024-09-12T00:33:44.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.850+0000 7fc3bd519800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=vk67en38z9b6gvmjej1mn1pvwtsby8fz 2024-09-12T00:33:44.857 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.859+0000 7fc3bd519800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:44.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.862+0000 7fc3bd519800 20 get_obj_state: octx=0x5590e7407660 obj=check-bucket:d state=0x5590e76d0018 s->prefetch_data=0 2024-09-12T00:33:44.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.863+0000 7fc3bd519800 20 get_obj_state: setting s->obj_tag to 23rih8m87nwxcakngx2t3a5go00mp6zz 2024-09-12T00:33:44.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.863+0000 7fc3bd519800 20 get_obj_state_impl: setting s->olh_tag to ftn972qe10soe0cshdpki3poxj23kesd 2024-09-12T00:33:44.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.863+0000 7fc3bd519800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:44.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.863+0000 7fc3bd519800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T00:33:44.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.863+0000 7fc3bd519800 20 olh_log_entry: epoch=4 op=3 key=d[9JBXXBjcAjRJvkgoAh.oUJwrYrJIeac] 2024-09-12T00:33:44.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.863+0000 7fc3bd519800 20 get_obj_state: octx=0x5590e770a0b0 obj=check-bucket:_:9JBXXBjcAjRJvkgoAh.oUJwrYrJIeac_d state=0x5590e76d25c8 s->prefetch_data=0 2024-09-12T00:33:44.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.865+0000 7fc3bd519800 20 get_obj_state: octx=0x5590e770a0b0 obj=check-bucket:d state=0x5590e76ce338 s->prefetch_data=0 2024-09-12T00:33:44.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.866+0000 7fc3bd519800 20 get_obj_state: setting s->obj_tag to 23rih8m87nwxcakngx2t3a5go00mp6zz 2024-09-12T00:33:44.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.866+0000 7fc3bd519800 20 get_obj_state_impl: setting s->olh_tag to ftn972qe10soe0cshdpki3poxj23kesd 2024-09-12T00:33:44.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.866+0000 7fc3bd519800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ftn972qe10soe0cshdpki3poxj23kesd 2024-09-12T00:33:44.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.868+0000 7fc3bd519800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:44.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.869+0000 7fc3bd519800 1 NOTICE: finished shard 0 (2 entries removed) 2024-09-12T00:33:44.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.869+0000 7fc3bd519800 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T00:33:44.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.870+0000 7fc2717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:44.871 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.873+0000 7fc3bd519800 20 remove_watcher() i=0 2024-09-12T00:33:44.871 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.873+0000 7fc3bd519800 2 removed watcher, disabling cache 2024-09-12T00:33:44.872 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.874+0000 7fc3bd519800 20 remove_watcher() i=1 2024-09-12T00:33:44.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.875+0000 7fc3bd519800 20 remove_watcher() i=2 2024-09-12T00:33:44.874 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.876+0000 7fc3bd519800 20 remove_watcher() i=3 2024-09-12T00:33:44.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.877+0000 7fc3bd519800 20 remove_watcher() i=4 2024-09-12T00:33:44.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.878+0000 7fc3bd519800 20 remove_watcher() i=5 2024-09-12T00:33:44.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.878+0000 7fc3bd519800 20 remove_watcher() i=6 2024-09-12T00:33:44.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.879+0000 7fc3bd519800 20 remove_watcher() i=7 2024-09-12T00:33:44.890 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:33:44.922 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:44.922 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:44.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:44.963+0000 7f2d98498800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.166+0000 7f2d98498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.166+0000 7f2d98498800 20 realm 2024-09-12T00:33:45.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.166+0000 7f2d98498800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.167+0000 7f2d98498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.167+0000 7f2d98498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:45.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.167+0000 7f2d98498800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.167+0000 7f2d98498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.167+0000 7f2d98498800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.168+0000 7f2d98498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:45.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.168+0000 7f2d98498800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.168+0000 7f2d98498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:45.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.168+0000 7f2d98498800 20 searching for the correct realm 2024-09-12T00:33:45.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.170+0000 7f2d95f82640 0 -- 172.21.15.62:0/1492718591 >> [v2:172.21.15.62:6816/3104025159,v1:172.21.15.62:6817/3104025159] conn(0x556f31c05700 msgr2=0x556f31c07af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:45.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.174+0000 7f2d95f82640 0 -- 172.21.15.62:0/1492718591 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f2d9008b110 msgr2=0x7f2d9005e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:45.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.380+0000 7f2d98498800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:45.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.380+0000 7f2d98498800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:45.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.380+0000 7f2d98498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:45.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.380+0000 7f2d98498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:45.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.380+0000 7f2d98498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:45.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.380+0000 7f2d98498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:45.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.380+0000 7f2d98498800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.380+0000 7f2d98498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.380+0000 7f2d98498800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.380+0000 7f2d98498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:45.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.380+0000 7f2d98498800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.381+0000 7f2d98498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:45.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.381+0000 7f2d98498800 20 zone default found 2024-09-12T00:33:45.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.381+0000 7f2d98498800 4 Realm: () 2024-09-12T00:33:45.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.381+0000 7f2d98498800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:45.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.381+0000 7f2d98498800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:45.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.381+0000 7f2d98498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:45.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.381+0000 7f2d98498800 20 zonegroup default 2024-09-12T00:33:45.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.381+0000 7f2d98498800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.381+0000 7f2d98498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.381+0000 7f2d98498800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.381+0000 7f2d98498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.381+0000 7f2d98498800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.382+0000 7f2d98498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.382+0000 7f2d98498800 20 started sync module instance, tier type = 2024-09-12T00:33:45.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.382+0000 7f2d98498800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:45.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.391+0000 7f2d98498800 20 add_watcher() i=0 2024-09-12T00:33:45.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.391+0000 7f2d98498800 20 add_watcher() i=1 2024-09-12T00:33:45.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.391+0000 7f2d98498800 20 add_watcher() i=2 2024-09-12T00:33:45.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.391+0000 7f2d98498800 20 add_watcher() i=3 2024-09-12T00:33:45.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.391+0000 7f2d98498800 20 add_watcher() i=4 2024-09-12T00:33:45.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.391+0000 7f2d98498800 20 add_watcher() i=5 2024-09-12T00:33:45.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.391+0000 7f2d98498800 20 add_watcher() i=6 2024-09-12T00:33:45.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.392+0000 7f2d98498800 20 add_watcher() i=7 2024-09-12T00:33:45.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.392+0000 7f2d98498800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:45.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.394+0000 7f2c3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:45.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.394+0000 7f2d98498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:45.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.394+0000 7f2d98498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:45.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.394+0000 7f2d98498800 5 note: GC not initialized 2024-09-12T00:33:45.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.394+0000 7f2c3e7fc640 20 reqs_thread_entry: start 2024-09-12T00:33:45.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.395+0000 7f2d98498800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:45.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.395+0000 7f2d98498800 20 Filter name: none 2024-09-12T00:33:45.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.395+0000 7f2bb7fff640 20 reqs_thread_entry: start 2024-09-12T00:33:45.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.395+0000 7f2d98498800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.395+0000 7f2d98498800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:45.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.395+0000 7f2d98498800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.396+0000 7f2d98498800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:45.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.396+0000 7f2d98498800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:45.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.396+0000 7f2d98498800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:33:45.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.396+0000 7f2d98498800 20 INFO: main: starting shard=0 2024-09-12T00:33:45.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.396+0000 7f2d98498800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:45.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.396+0000 7f2d98498800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:33:45.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.396+0000 7f2d98498800 20 INFO: main: done 2024-09-12T00:33:45.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.397+0000 7f2c3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:45.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.400+0000 7f2d98498800 20 remove_watcher() i=0 2024-09-12T00:33:45.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.400+0000 7f2d98498800 2 removed watcher, disabling cache 2024-09-12T00:33:45.399 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.401+0000 7f2d98498800 20 remove_watcher() i=1 2024-09-12T00:33:45.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.402+0000 7f2d98498800 20 remove_watcher() i=2 2024-09-12T00:33:45.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.403+0000 7f2d98498800 20 remove_watcher() i=3 2024-09-12T00:33:45.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.404+0000 7f2d98498800 20 remove_watcher() i=4 2024-09-12T00:33:45.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.405+0000 7f2d98498800 20 remove_watcher() i=5 2024-09-12T00:33:45.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.406+0000 7f2d98498800 20 remove_watcher() i=6 2024-09-12T00:33:45.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.407+0000 7f2d98498800 20 remove_watcher() i=7 2024-09-12T00:33:45.418 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:33:45.450 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:45.450 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:45.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.490+0000 7f82d8726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.492+0000 7f82d8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.492+0000 7f82d8726800 20 realm 2024-09-12T00:33:45.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.492+0000 7f82d8726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.492+0000 7f82d8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.492+0000 7f82d8726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:45.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.492+0000 7f82d8726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.493+0000 7f82d8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.493+0000 7f82d8726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.493+0000 7f82d8726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:45.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.493+0000 7f82d8726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.494+0000 7f82d8726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:45.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.494+0000 7f82d8726800 20 searching for the correct realm 2024-09-12T00:33:45.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.497+0000 7f82d3b08640 0 -- 172.21.15.62:0/1238076618 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f82cc061040 msgr2=0x7f82cc0a6720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:45.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.500+0000 7f82d3b08640 0 -- 172.21.15.62:0/1238076618 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55b447fa7c10 msgr2=0x55b447faa0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:45.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.504+0000 7f82d8726800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:45.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.504+0000 7f82d8726800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:45.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.504+0000 7f82d8726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:45.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.504+0000 7f82d8726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:45.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.504+0000 7f82d8726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:45.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.504+0000 7f82d8726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:45.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.504+0000 7f82d8726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.504+0000 7f82d8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.504+0000 7f82d8726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.505+0000 7f82d8726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:45.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.505+0000 7f82d8726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.505+0000 7f82d8726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:45.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.505+0000 7f82d8726800 20 zone default found 2024-09-12T00:33:45.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.505+0000 7f82d8726800 4 Realm: () 2024-09-12T00:33:45.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.505+0000 7f82d8726800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:45.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.505+0000 7f82d8726800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:45.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.505+0000 7f82d8726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:45.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.505+0000 7f82d8726800 20 zonegroup default 2024-09-12T00:33:45.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.505+0000 7f82d8726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.505+0000 7f82d8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.505+0000 7f82d8726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.506+0000 7f82d8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.506+0000 7f82d8726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.506+0000 7f82d8726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.506+0000 7f82d8726800 20 started sync module instance, tier type = 2024-09-12T00:33:45.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.506+0000 7f82d8726800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:45.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.514+0000 7f82d8726800 20 add_watcher() i=0 2024-09-12T00:33:45.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.514+0000 7f82d8726800 20 add_watcher() i=1 2024-09-12T00:33:45.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.514+0000 7f82d8726800 20 add_watcher() i=2 2024-09-12T00:33:45.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.514+0000 7f82d8726800 20 add_watcher() i=3 2024-09-12T00:33:45.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.514+0000 7f82d8726800 20 add_watcher() i=4 2024-09-12T00:33:45.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.514+0000 7f82d8726800 20 add_watcher() i=5 2024-09-12T00:33:45.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.514+0000 7f82d8726800 20 add_watcher() i=6 2024-09-12T00:33:45.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.515+0000 7f82d8726800 20 add_watcher() i=7 2024-09-12T00:33:45.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.515+0000 7f82d8726800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:45.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.517+0000 7f818a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:45.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.518+0000 7f82d8726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:45.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.518+0000 7f82d8726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:45.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.518+0000 7f82d8726800 5 note: GC not initialized 2024-09-12T00:33:45.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.518+0000 7f81897e2640 20 reqs_thread_entry: start 2024-09-12T00:33:45.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.518+0000 7f82d8726800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:45.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.518+0000 7f82d8726800 20 Filter name: none 2024-09-12T00:33:45.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.518+0000 7f80faffd640 20 reqs_thread_entry: start 2024-09-12T00:33:45.518 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.518+0000 7f82d8726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.518 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.519+0000 7f82d8726800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:45.518 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.519+0000 7f82d8726800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.518 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.519+0000 7f82d8726800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:45.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.519+0000 7f82d8726800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:45.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.519+0000 7f82d8726800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:33:45.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.519+0000 7f82d8726800 20 INFO: main: starting shard=0 2024-09-12T00:33:45.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.519+0000 7f82d8726800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:45.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.520+0000 7f82d8726800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:33:45.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.520+0000 7f82d8726800 20 INFO: main: done 2024-09-12T00:33:45.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.520+0000 7f818a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:45.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.523+0000 7f82d8726800 20 remove_watcher() i=0 2024-09-12T00:33:45.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.523+0000 7f82d8726800 2 removed watcher, disabling cache 2024-09-12T00:33:45.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.524+0000 7f82d8726800 20 remove_watcher() i=1 2024-09-12T00:33:45.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.525+0000 7f82d8726800 20 remove_watcher() i=2 2024-09-12T00:33:45.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.526+0000 7f82d8726800 20 remove_watcher() i=3 2024-09-12T00:33:45.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.527+0000 7f82d8726800 20 remove_watcher() i=4 2024-09-12T00:33:45.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.528+0000 7f82d8726800 20 remove_watcher() i=5 2024-09-12T00:33:45.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.529+0000 7f82d8726800 20 remove_watcher() i=6 2024-09-12T00:33:45.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.529+0000 7f82d8726800 20 remove_watcher() i=7 2024-09-12T00:33:45.540 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T00:33:45.540 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:45.541 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:33:45.573 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:45.573 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:45.613 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.614+0000 7febfd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.614 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.615+0000 7febfd40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.614 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.615+0000 7febfd40f800 20 realm 2024-09-12T00:33:45.614 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.615+0000 7febfd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.615 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.616+0000 7febfd40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.615 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.616+0000 7febfd40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:45.615 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.616+0000 7febfd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.615 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.616+0000 7febfd40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.615 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.616+0000 7febfd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.615 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.616+0000 7febfd40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:45.615 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.616+0000 7febfd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.617+0000 7febfd40f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:45.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.617+0000 7febfd40f800 20 searching for the correct realm 2024-09-12T00:33:45.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.620+0000 7febfa6f8640 0 -- 172.21.15.62:0/938207634 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7febf4069040 msgr2=0x7febf406d490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:45.824 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.825+0000 7febfa6f8640 0 -- 172.21.15.62:0/938207634 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55fd769ad0f0 msgr2=0x55fd769af5b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:45.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.829+0000 7febfd40f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:45.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.829+0000 7febfd40f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:45.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.829+0000 7febfd40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:45.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.829+0000 7febfd40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:45.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.829+0000 7febfd40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:45.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.829+0000 7febfd40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:45.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.829+0000 7febfd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.830+0000 7febfd40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.830+0000 7febfd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.830+0000 7febfd40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:45.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.830+0000 7febfd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.830+0000 7febfd40f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:45.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.830+0000 7febfd40f800 20 zone default found 2024-09-12T00:33:45.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.830+0000 7febfd40f800 4 Realm: () 2024-09-12T00:33:45.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.830+0000 7febfd40f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:45.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.830+0000 7febfd40f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:45.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.830+0000 7febfd40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:45.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.830+0000 7febfd40f800 20 zonegroup default 2024-09-12T00:33:45.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.830+0000 7febfd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.830+0000 7febfd40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.830+0000 7febfd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.831+0000 7febfd40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.831+0000 7febfd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.831+0000 7febfd40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:45.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.831+0000 7febfd40f800 20 started sync module instance, tier type = 2024-09-12T00:33:45.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.831+0000 7febfd40f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:45.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.842+0000 7febfd40f800 20 add_watcher() i=0 2024-09-12T00:33:45.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.842+0000 7febfd40f800 20 add_watcher() i=1 2024-09-12T00:33:45.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.842+0000 7febfd40f800 20 add_watcher() i=2 2024-09-12T00:33:45.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.842+0000 7febfd40f800 20 add_watcher() i=3 2024-09-12T00:33:45.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.842+0000 7febfd40f800 20 add_watcher() i=4 2024-09-12T00:33:45.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.842+0000 7febfd40f800 20 add_watcher() i=5 2024-09-12T00:33:45.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.842+0000 7febfd40f800 20 add_watcher() i=6 2024-09-12T00:33:45.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.843+0000 7febfd40f800 20 add_watcher() i=7 2024-09-12T00:33:45.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.843+0000 7febfd40f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:45.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.844+0000 7feab17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:45.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.844+0000 7febfd40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:45.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.844+0000 7febfd40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:45.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.845+0000 7febfd40f800 5 note: GC not initialized 2024-09-12T00:33:45.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.845+0000 7fea2bfff640 20 reqs_thread_entry: start 2024-09-12T00:33:45.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.845+0000 7febfd40f800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:45.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.845+0000 7febfd40f800 20 Filter name: none 2024-09-12T00:33:45.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.845+0000 7fea29ffb640 20 reqs_thread_entry: start 2024-09-12T00:33:45.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.845+0000 7febfd40f800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:33:45.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.845+0000 7febfd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.845+0000 7febfd40f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:45.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.845+0000 7febfd40f800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:33:45.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.845+0000 7febfd40f800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:33:45.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.845+0000 7febfd40f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 : miss 2024-09-12T00:33:45.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.845+0000 7febfd40f800 20 rados->read ofs=0 len=0 2024-09-12T00:33:45.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.846+0000 7febfd40f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:45.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.846+0000 7febfd40f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 info.flags=0x17 2024-09-12T00:33:45.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.846+0000 7febfd40f800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 to cache LRU end 2024-09-12T00:33:45.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.846+0000 7febfd40f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:45.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.846+0000 7febfd40f800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:33:45.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.846+0000 7febfd40f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 2024-09-12T00:33:45.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.846+0000 7febfd40f800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:45.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.847+0000 7febfd40f800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:33:45.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.847+0000 7febfd40f800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:33:45.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.848+0000 7feab17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:45.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.850+0000 7febfd40f800 20 remove_watcher() i=0 2024-09-12T00:33:45.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.850+0000 7febfd40f800 2 removed watcher, disabling cache 2024-09-12T00:33:45.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.851+0000 7febfd40f800 20 remove_watcher() i=1 2024-09-12T00:33:45.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.852+0000 7febfd40f800 20 remove_watcher() i=2 2024-09-12T00:33:45.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.853+0000 7febfd40f800 20 remove_watcher() i=3 2024-09-12T00:33:45.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.853+0000 7febfd40f800 20 remove_watcher() i=4 2024-09-12T00:33:45.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.854+0000 7febfd40f800 20 remove_watcher() i=5 2024-09-12T00:33:45.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.855+0000 7febfd40f800 20 remove_watcher() i=6 2024-09-12T00:33:45.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:45.856+0000 7febfd40f800 20 remove_watcher() i=7 2024-09-12T00:33:45.866 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T00:33:45.866 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:45.983 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T00:33:45.983 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:33:46.771 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:33:47.195 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:33:48.729 INFO:tasks.workunit.client.0.smithi062.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:33:48.731 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:33:48.765 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:48.766 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:48.806 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:48.806+0000 7ff875e17800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:48.809+0000 7ff875e17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:48.809+0000 7ff875e17800 20 realm 2024-09-12T00:33:48.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:48.809+0000 7ff875e17800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:48.809+0000 7ff875e17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:48.809+0000 7ff875e17800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:48.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:48.809+0000 7ff875e17800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:48.809+0000 7ff875e17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:48.809+0000 7ff875e17800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:48.810+0000 7ff875e17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:48.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:48.810+0000 7ff875e17800 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:48.810+0000 7ff875e17800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:48.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:48.810+0000 7ff875e17800 20 searching for the correct realm 2024-09-12T00:33:48.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:48.813+0000 7ff870de6640 0 -- 172.21.15.62:0/2073110318 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7ff86c06d030 msgr2=0x7ff86c068170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:49.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.018+0000 7ff871de8640 0 -- 172.21.15.62:0/2073110318 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55b532c3ac50 msgr2=0x55b532c3d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.023+0000 7ff875e17800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.023+0000 7ff875e17800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.023+0000 7ff875e17800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.023+0000 7ff875e17800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.023+0000 7ff875e17800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.023+0000 7ff875e17800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.023+0000 7ff875e17800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.023+0000 7ff875e17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.023+0000 7ff875e17800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.023+0000 7ff875e17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:49.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.023+0000 7ff875e17800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.024+0000 7ff875e17800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:49.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.024+0000 7ff875e17800 20 zone default found 2024-09-12T00:33:49.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.024+0000 7ff875e17800 4 Realm: () 2024-09-12T00:33:49.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.024+0000 7ff875e17800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:49.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.024+0000 7ff875e17800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:49.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.024+0000 7ff875e17800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:49.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.024+0000 7ff875e17800 20 zonegroup default 2024-09-12T00:33:49.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.024+0000 7ff875e17800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.024+0000 7ff875e17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.024+0000 7ff875e17800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.024+0000 7ff875e17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.024+0000 7ff875e17800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.025+0000 7ff875e17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.025+0000 7ff875e17800 20 started sync module instance, tier type = 2024-09-12T00:33:49.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.025+0000 7ff875e17800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:49.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.034+0000 7ff875e17800 20 add_watcher() i=0 2024-09-12T00:33:49.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.034+0000 7ff875e17800 20 add_watcher() i=1 2024-09-12T00:33:49.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.034+0000 7ff875e17800 20 add_watcher() i=2 2024-09-12T00:33:49.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.034+0000 7ff875e17800 20 add_watcher() i=3 2024-09-12T00:33:49.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.034+0000 7ff875e17800 20 add_watcher() i=4 2024-09-12T00:33:49.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.034+0000 7ff875e17800 20 add_watcher() i=5 2024-09-12T00:33:49.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.034+0000 7ff875e17800 20 add_watcher() i=6 2024-09-12T00:33:49.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.037+0000 7ff875e17800 20 add_watcher() i=7 2024-09-12T00:33:49.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.037+0000 7ff875e17800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:49.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.039+0000 7ff7277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:49.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.039+0000 7ff875e17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:49.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.039+0000 7ff875e17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:49.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.039+0000 7ff875e17800 5 note: GC not initialized 2024-09-12T00:33:49.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.040+0000 7ff7267e4640 20 reqs_thread_entry: start 2024-09-12T00:33:49.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.040+0000 7ff875e17800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:49.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.040+0000 7ff875e17800 20 Filter name: none 2024-09-12T00:33:49.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.040+0000 7ff697fff640 20 reqs_thread_entry: start 2024-09-12T00:33:49.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.040+0000 7ff875e17800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.041+0000 7ff875e17800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:49.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.041+0000 7ff875e17800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.041+0000 7ff875e17800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:49.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.041+0000 7ff875e17800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:49.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.041+0000 7ff875e17800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:33:49.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.041+0000 7ff875e17800 20 INFO: main: starting shard=0 2024-09-12T00:33:49.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.041+0000 7ff875e17800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:49.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.042+0000 7ff875e17800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:33:49.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.042+0000 7ff875e17800 20 INFO: main: done 2024-09-12T00:33:49.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.043+0000 7ff7277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:49.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.045+0000 7ff875e17800 20 remove_watcher() i=0 2024-09-12T00:33:49.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.045+0000 7ff875e17800 2 removed watcher, disabling cache 2024-09-12T00:33:49.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.046+0000 7ff875e17800 20 remove_watcher() i=1 2024-09-12T00:33:49.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.047+0000 7ff875e17800 20 remove_watcher() i=2 2024-09-12T00:33:49.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.048+0000 7ff875e17800 20 remove_watcher() i=3 2024-09-12T00:33:49.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.049+0000 7ff875e17800 20 remove_watcher() i=4 2024-09-12T00:33:49.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.050+0000 7ff875e17800 20 remove_watcher() i=5 2024-09-12T00:33:49.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.052+0000 7ff875e17800 20 remove_watcher() i=6 2024-09-12T00:33:49.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.053+0000 7ff875e17800 20 remove_watcher() i=7 2024-09-12T00:33:49.181 INFO:tasks.workunit.client.0.smithi062.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:33:49.182 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:33:49.214 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:49.214 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:49.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.254+0000 7f85bfc11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.256+0000 7f85bfc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.256+0000 7f85bfc11800 20 realm 2024-09-12T00:33:49.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.256+0000 7f85bfc11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.256+0000 7f85bfc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.256+0000 7f85bfc11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:49.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.256+0000 7f85bfc11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.256+0000 7f85bfc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.256+0000 7f85bfc11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.257+0000 7f85bfc11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:49.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.257+0000 7f85bfc11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.258+0000 7f85bfc11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:49.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.258+0000 7f85bfc11800 20 searching for the correct realm 2024-09-12T00:33:49.259 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.261+0000 7f85bab91640 0 -- 172.21.15.62:0/4027985646 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f85b40722b0 msgr2=0x7f85b40769a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:49.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.467+0000 7f85bbb93640 0 -- 172.21.15.62:0/4027985646 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x556d8e5073b0 msgr2=0x556d8e5097c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:49.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.472+0000 7f85bfc11800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:49.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.472+0000 7f85bfc11800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:49.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.472+0000 7f85bfc11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:49.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.472+0000 7f85bfc11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:49.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.472+0000 7f85bfc11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:49.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.472+0000 7f85bfc11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:49.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.472+0000 7f85bfc11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.472+0000 7f85bfc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.472+0000 7f85bfc11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.472 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.472+0000 7f85bfc11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:49.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.472+0000 7f85bfc11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.473+0000 7f85bfc11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:49.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.473+0000 7f85bfc11800 20 zone default found 2024-09-12T00:33:49.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.473+0000 7f85bfc11800 4 Realm: () 2024-09-12T00:33:49.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.473+0000 7f85bfc11800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:49.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.473+0000 7f85bfc11800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:49.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.473+0000 7f85bfc11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:49.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.473+0000 7f85bfc11800 20 zonegroup default 2024-09-12T00:33:49.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.473+0000 7f85bfc11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.473+0000 7f85bfc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.473+0000 7f85bfc11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.473+0000 7f85bfc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.473+0000 7f85bfc11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.474+0000 7f85bfc11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.474+0000 7f85bfc11800 20 started sync module instance, tier type = 2024-09-12T00:33:49.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.474+0000 7f85bfc11800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:49.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.484+0000 7f85bfc11800 20 add_watcher() i=0 2024-09-12T00:33:49.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.484+0000 7f85bfc11800 20 add_watcher() i=1 2024-09-12T00:33:49.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.484+0000 7f85bfc11800 20 add_watcher() i=2 2024-09-12T00:33:49.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.484+0000 7f85bfc11800 20 add_watcher() i=3 2024-09-12T00:33:49.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.484+0000 7f85bfc11800 20 add_watcher() i=4 2024-09-12T00:33:49.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.484+0000 7f85bfc11800 20 add_watcher() i=5 2024-09-12T00:33:49.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.484+0000 7f85bfc11800 20 add_watcher() i=6 2024-09-12T00:33:49.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.486+0000 7f85bfc11800 20 add_watcher() i=7 2024-09-12T00:33:49.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.486+0000 7f85bfc11800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:49.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.488+0000 7f8471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:49.487 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.488+0000 7f85bfc11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:49.487 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.488+0000 7f85bfc11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:49.487 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.488+0000 7f85bfc11800 5 note: GC not initialized 2024-09-12T00:33:49.487 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.488+0000 7f8470fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:49.487 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.488+0000 7f85bfc11800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:49.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.488+0000 7f85bfc11800 20 Filter name: none 2024-09-12T00:33:49.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.488+0000 7f83ea7fc640 20 reqs_thread_entry: start 2024-09-12T00:33:49.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.489+0000 7f85bfc11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.489+0000 7f85bfc11800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:49.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.489+0000 7f85bfc11800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.489+0000 7f85bfc11800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:49.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.489+0000 7f85bfc11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:49.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.489+0000 7f85bfc11800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:33:49.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.489+0000 7f85bfc11800 20 INFO: main: starting shard=0 2024-09-12T00:33:49.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.489+0000 7f85bfc11800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:49.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.490+0000 7f85bfc11800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:33:49.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.490+0000 7f85bfc11800 20 INFO: main: done 2024-09-12T00:33:49.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.491+0000 7f8471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:49.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.494+0000 7f85bfc11800 20 remove_watcher() i=0 2024-09-12T00:33:49.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.494+0000 7f85bfc11800 2 removed watcher, disabling cache 2024-09-12T00:33:49.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.495+0000 7f85bfc11800 20 remove_watcher() i=1 2024-09-12T00:33:49.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.496+0000 7f85bfc11800 20 remove_watcher() i=2 2024-09-12T00:33:49.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.497+0000 7f85bfc11800 20 remove_watcher() i=3 2024-09-12T00:33:49.497 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.498+0000 7f85bfc11800 20 remove_watcher() i=4 2024-09-12T00:33:49.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.499+0000 7f85bfc11800 20 remove_watcher() i=5 2024-09-12T00:33:49.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.500+0000 7f85bfc11800 20 remove_watcher() i=6 2024-09-12T00:33:49.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.501+0000 7f85bfc11800 20 remove_watcher() i=7 2024-09-12T00:33:49.626 INFO:tasks.workunit.client.0.smithi062.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:33:49.627 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:33:49.658 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:49.659 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:49.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.699+0000 7f95980bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.700+0000 7f95980bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.700+0000 7f95980bb800 20 realm 2024-09-12T00:33:49.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.700+0000 7f95980bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.701+0000 7f95980bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.701+0000 7f95980bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:49.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.701+0000 7f95980bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.701+0000 7f95980bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.701+0000 7f95980bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.702+0000 7f95980bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:49.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.702+0000 7f95980bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.702+0000 7f95980bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:49.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.702+0000 7f95980bb800 20 searching for the correct realm 2024-09-12T00:33:49.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.705+0000 7f95953a4640 0 -- 172.21.15.62:0/3142295298 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f9590048be0 msgr2=0x7f959004c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:49.909 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.910+0000 7f95963a6640 0 -- 172.21.15.62:0/3142295298 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55fd9e2fdc80 msgr2=0x55fd9e300070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:49.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.915+0000 7f95980bb800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:49.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.915+0000 7f95980bb800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:49.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.915+0000 7f95980bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:49.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.915+0000 7f95980bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:49.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.915+0000 7f95980bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:49.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.915+0000 7f95980bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:49.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.915+0000 7f95980bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.915+0000 7f95980bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.915+0000 7f95980bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.916+0000 7f95980bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:49.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.916+0000 7f95980bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.916+0000 7f95980bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:49.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.916+0000 7f95980bb800 20 zone default found 2024-09-12T00:33:49.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.916+0000 7f95980bb800 4 Realm: () 2024-09-12T00:33:49.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.916+0000 7f95980bb800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:49.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.916+0000 7f95980bb800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:49.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.916+0000 7f95980bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:49.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.916+0000 7f95980bb800 20 zonegroup default 2024-09-12T00:33:49.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.916+0000 7f95980bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.916+0000 7f95980bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.916+0000 7f95980bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.917+0000 7f95980bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.917+0000 7f95980bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.917+0000 7f95980bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.917+0000 7f95980bb800 20 started sync module instance, tier type = 2024-09-12T00:33:49.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.917+0000 7f95980bb800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:49.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.929+0000 7f95980bb800 20 add_watcher() i=0 2024-09-12T00:33:49.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.929+0000 7f95980bb800 20 add_watcher() i=1 2024-09-12T00:33:49.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.929+0000 7f95980bb800 20 add_watcher() i=2 2024-09-12T00:33:49.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.929+0000 7f95980bb800 20 add_watcher() i=3 2024-09-12T00:33:49.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.929+0000 7f95980bb800 20 add_watcher() i=4 2024-09-12T00:33:49.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.929+0000 7f95980bb800 20 add_watcher() i=5 2024-09-12T00:33:49.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.929+0000 7f95980bb800 20 add_watcher() i=6 2024-09-12T00:33:49.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.930+0000 7f95980bb800 20 add_watcher() i=7 2024-09-12T00:33:49.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.930+0000 7f95980bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:49.930 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.931+0000 7f94477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:49.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.932+0000 7f95980bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:49.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.932+0000 7f95980bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:49.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.932+0000 7f95980bb800 5 note: GC not initialized 2024-09-12T00:33:49.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.932+0000 7f94467fc640 20 reqs_thread_entry: start 2024-09-12T00:33:49.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.932+0000 7f95980bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:49.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.932+0000 7f95980bb800 20 Filter name: none 2024-09-12T00:33:49.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.932+0000 7f93b7fff640 20 reqs_thread_entry: start 2024-09-12T00:33:49.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.932+0000 7f95980bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.933+0000 7f95980bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:49.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.933+0000 7f95980bb800 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.933+0000 7f95980bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:49.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.933+0000 7f95980bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:49.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.933+0000 7f95980bb800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:33:49.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.933+0000 7f95980bb800 20 INFO: main: starting shard=0 2024-09-12T00:33:49.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.933+0000 7f95980bb800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:49.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.934+0000 7f95980bb800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:33:49.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.934+0000 7f95980bb800 20 INFO: main: done 2024-09-12T00:33:49.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.935+0000 7f94477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:49.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.937+0000 7f95980bb800 20 remove_watcher() i=0 2024-09-12T00:33:49.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.937+0000 7f95980bb800 2 removed watcher, disabling cache 2024-09-12T00:33:49.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.938+0000 7f95980bb800 20 remove_watcher() i=1 2024-09-12T00:33:49.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.939+0000 7f95980bb800 20 remove_watcher() i=2 2024-09-12T00:33:49.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.940+0000 7f95980bb800 20 remove_watcher() i=3 2024-09-12T00:33:49.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.941+0000 7f95980bb800 20 remove_watcher() i=4 2024-09-12T00:33:49.941 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.942+0000 7f95980bb800 20 remove_watcher() i=5 2024-09-12T00:33:49.942 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.944+0000 7f95980bb800 20 remove_watcher() i=6 2024-09-12T00:33:49.943 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:49.945+0000 7f95980bb800 20 remove_watcher() i=7 2024-09-12T00:33:50.068 INFO:tasks.workunit.client.0.smithi062.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:33:50.069 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:33:50.102 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:50.102 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:50.141 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.142+0000 7f8cc09af800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.144+0000 7f8cc09af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.144+0000 7f8cc09af800 20 realm 2024-09-12T00:33:50.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.144+0000 7f8cc09af800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.144+0000 7f8cc09af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.144+0000 7f8cc09af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:50.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.144+0000 7f8cc09af800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.145+0000 7f8cc09af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.145+0000 7f8cc09af800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.145+0000 7f8cc09af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:50.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.145+0000 7f8cc09af800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.146+0000 7f8cc09af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:50.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.146+0000 7f8cc09af800 20 searching for the correct realm 2024-09-12T00:33:50.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.149+0000 7f8cbdc98640 0 -- 172.21.15.62:0/1691976922 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f8cb806ed90 msgr2=0x7f8cb806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:50.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.354+0000 7f8cbdc98640 0 -- 172.21.15.62:0/1691976922 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55b9ad5b3260 msgr2=0x55b9ad5b56d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:50.357 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.358+0000 7f8cc09af800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:50.357 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.358+0000 7f8cc09af800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:50.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.358+0000 7f8cc09af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:50.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.358+0000 7f8cc09af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:50.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.358+0000 7f8cc09af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:50.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.358+0000 7f8cc09af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:50.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.358+0000 7f8cc09af800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.358+0000 7f8cc09af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.358+0000 7f8cc09af800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.359+0000 7f8cc09af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:50.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.359+0000 7f8cc09af800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.359+0000 7f8cc09af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:50.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.359+0000 7f8cc09af800 20 zone default found 2024-09-12T00:33:50.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.359+0000 7f8cc09af800 4 Realm: () 2024-09-12T00:33:50.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.359+0000 7f8cc09af800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:50.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.359+0000 7f8cc09af800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:50.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.359+0000 7f8cc09af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:50.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.359+0000 7f8cc09af800 20 zonegroup default 2024-09-12T00:33:50.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.359+0000 7f8cc09af800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.359+0000 7f8cc09af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.359+0000 7f8cc09af800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.360+0000 7f8cc09af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.360+0000 7f8cc09af800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.360+0000 7f8cc09af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.360+0000 7f8cc09af800 20 started sync module instance, tier type = 2024-09-12T00:33:50.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.360+0000 7f8cc09af800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:50.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.369+0000 7f8cc09af800 20 add_watcher() i=0 2024-09-12T00:33:50.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.369+0000 7f8cc09af800 20 add_watcher() i=1 2024-09-12T00:33:50.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.369+0000 7f8cc09af800 20 add_watcher() i=2 2024-09-12T00:33:50.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.369+0000 7f8cc09af800 20 add_watcher() i=3 2024-09-12T00:33:50.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.369+0000 7f8cc09af800 20 add_watcher() i=4 2024-09-12T00:33:50.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.369+0000 7f8cc09af800 20 add_watcher() i=5 2024-09-12T00:33:50.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.369+0000 7f8cc09af800 20 add_watcher() i=6 2024-09-12T00:33:50.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.370+0000 7f8cc09af800 20 add_watcher() i=7 2024-09-12T00:33:50.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.370+0000 7f8cc09af800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:50.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.372+0000 7f8b74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:50.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.373+0000 7f8cc09af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:50.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.373+0000 7f8cc09af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:50.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.373+0000 7f8cc09af800 5 note: GC not initialized 2024-09-12T00:33:50.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.373+0000 7f8aef7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:50.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.373+0000 7f8cc09af800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:50.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.373+0000 7f8cc09af800 20 Filter name: none 2024-09-12T00:33:50.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.373+0000 7f8aed7fa640 20 reqs_thread_entry: start 2024-09-12T00:33:50.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.373+0000 7f8cc09af800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.374+0000 7f8cc09af800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:50.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.374+0000 7f8cc09af800 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.374+0000 7f8cc09af800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:50.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.374+0000 7f8cc09af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:50.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.374+0000 7f8cc09af800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T00:33:50.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.374+0000 7f8cc09af800 20 INFO: main: starting shard=0 2024-09-12T00:33:50.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.374+0000 7f8cc09af800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:50.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.374+0000 7f8cc09af800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:33:50.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.375+0000 7f8cc09af800 20 INFO: main: done 2024-09-12T00:33:50.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.376+0000 7f8b74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:50.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.379+0000 7f8cc09af800 20 remove_watcher() i=0 2024-09-12T00:33:50.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.379+0000 7f8cc09af800 2 removed watcher, disabling cache 2024-09-12T00:33:50.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.380+0000 7f8cc09af800 20 remove_watcher() i=1 2024-09-12T00:33:50.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.380+0000 7f8cc09af800 20 remove_watcher() i=2 2024-09-12T00:33:50.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.382+0000 7f8cc09af800 20 remove_watcher() i=3 2024-09-12T00:33:50.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.383+0000 7f8cc09af800 20 remove_watcher() i=4 2024-09-12T00:33:50.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.384+0000 7f8cc09af800 20 remove_watcher() i=5 2024-09-12T00:33:50.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.385+0000 7f8cc09af800 20 remove_watcher() i=6 2024-09-12T00:33:50.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:50.386+0000 7f8cc09af800 20 remove_watcher() i=7 2024-09-12T00:33:50.422 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:33:50.834 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:33:51.251 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:33:51.281 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:51.281 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:51.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.321+0000 7faf172b9800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.322+0000 7faf172b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.322+0000 7faf172b9800 20 realm 2024-09-12T00:33:51.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.322+0000 7faf172b9800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.323+0000 7faf172b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.323+0000 7faf172b9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:51.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.323+0000 7faf172b9800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.323+0000 7faf172b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.323+0000 7faf172b9800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.324+0000 7faf172b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:51.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.324+0000 7faf172b9800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.324+0000 7faf172b9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:51.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.324+0000 7faf172b9800 20 searching for the correct realm 2024-09-12T00:33:51.326 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.327+0000 7faf145a2640 0 -- 172.21.15.62:0/3437975117 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7faf0c028920 msgr2=0x7faf0c018400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:51.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.532+0000 7faf155a4640 0 -- 172.21.15.62:0/3437975117 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5573a7d70b50 msgr2=0x5573a7d73010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:51.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.536+0000 7faf172b9800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:51.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.536+0000 7faf172b9800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:51.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.536+0000 7faf172b9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:51.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.536+0000 7faf172b9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:51.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.536+0000 7faf172b9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:51.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.536+0000 7faf172b9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:51.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.536+0000 7faf172b9800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.537+0000 7faf172b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.537+0000 7faf172b9800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.537+0000 7faf172b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:51.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.537+0000 7faf172b9800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.537+0000 7faf172b9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:51.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.537+0000 7faf172b9800 20 zone default found 2024-09-12T00:33:51.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.537+0000 7faf172b9800 4 Realm: () 2024-09-12T00:33:51.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.537+0000 7faf172b9800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:51.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.537+0000 7faf172b9800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:51.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.537+0000 7faf172b9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:51.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.537+0000 7faf172b9800 20 zonegroup default 2024-09-12T00:33:51.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.537+0000 7faf172b9800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.538+0000 7faf172b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.538+0000 7faf172b9800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.538+0000 7faf172b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.538+0000 7faf172b9800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.538+0000 7faf172b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.538+0000 7faf172b9800 20 started sync module instance, tier type = 2024-09-12T00:33:51.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.538+0000 7faf172b9800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:51.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.549+0000 7faf172b9800 20 add_watcher() i=0 2024-09-12T00:33:51.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.549+0000 7faf172b9800 20 add_watcher() i=1 2024-09-12T00:33:51.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.549+0000 7faf172b9800 20 add_watcher() i=2 2024-09-12T00:33:51.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.549+0000 7faf172b9800 20 add_watcher() i=3 2024-09-12T00:33:51.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.549+0000 7faf172b9800 20 add_watcher() i=4 2024-09-12T00:33:51.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.549+0000 7faf172b9800 20 add_watcher() i=5 2024-09-12T00:33:51.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.549+0000 7faf172b9800 20 add_watcher() i=6 2024-09-12T00:33:51.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.550+0000 7faf172b9800 20 add_watcher() i=7 2024-09-12T00:33:51.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.550+0000 7faf172b9800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:51.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.552+0000 7fadcb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:51.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.552+0000 7faf172b9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:51.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.552+0000 7faf172b9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:51.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.553+0000 7faf172b9800 5 note: GC not initialized 2024-09-12T00:33:51.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.553+0000 7fadca7e4640 20 reqs_thread_entry: start 2024-09-12T00:33:51.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.553+0000 7faf172b9800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:51.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.553+0000 7faf172b9800 20 Filter name: none 2024-09-12T00:33:51.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.553+0000 7fadc3fff640 20 reqs_thread_entry: start 2024-09-12T00:33:51.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.553+0000 7faf172b9800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:33:51.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.553+0000 7faf172b9800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.554+0000 7faf172b9800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:51.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.554+0000 7faf172b9800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:33:51.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.554+0000 7faf172b9800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:33:51.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.554+0000 7faf172b9800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 : miss 2024-09-12T00:33:51.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.554+0000 7faf172b9800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.554+0000 7faf172b9800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:51.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.554+0000 7faf172b9800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 info.flags=0x17 2024-09-12T00:33:51.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.554+0000 7faf172b9800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 to cache LRU end 2024-09-12T00:33:51.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.554+0000 7faf172b9800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:51.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.554+0000 7faf172b9800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:33:51.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.554+0000 7faf172b9800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 2024-09-12T00:33:51.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.554+0000 7faf172b9800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.559+0000 7fadcb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:51.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.561+0000 7faf172b9800 20 remove_watcher() i=0 2024-09-12T00:33:51.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.561+0000 7faf172b9800 2 removed watcher, disabling cache 2024-09-12T00:33:51.561 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.562+0000 7faf172b9800 20 remove_watcher() i=1 2024-09-12T00:33:51.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.563+0000 7faf172b9800 20 remove_watcher() i=2 2024-09-12T00:33:51.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.564+0000 7faf172b9800 20 remove_watcher() i=3 2024-09-12T00:33:51.564 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.565+0000 7faf172b9800 20 remove_watcher() i=4 2024-09-12T00:33:51.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.566+0000 7faf172b9800 20 remove_watcher() i=5 2024-09-12T00:33:51.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.568+0000 7faf172b9800 20 remove_watcher() i=6 2024-09-12T00:33:51.567 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.569+0000 7faf172b9800 20 remove_watcher() i=7 2024-09-12T00:33:51.580 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:33:51.616 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:51.616 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:51.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.658+0000 7f06a0620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.660+0000 7f06a0620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.660+0000 7f06a0620800 20 realm 2024-09-12T00:33:51.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.660+0000 7f06a0620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.660+0000 7f06a0620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.660+0000 7f06a0620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:51.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.660+0000 7f06a0620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.660+0000 7f06a0620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.660+0000 7f06a0620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.661+0000 7f06a0620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:51.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.661+0000 7f06a0620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.662+0000 7f06a0620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:51.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.662+0000 7f06a0620800 20 searching for the correct realm 2024-09-12T00:33:51.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.665+0000 7f069d909640 0 -- 172.21.15.62:0/1768883829 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f06980663c0 msgr2=0x7f069806a040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:51.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.871+0000 7f069d909640 0 -- 172.21.15.62:0/1768883829 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55a73c82dcf0 msgr2=0x55a73c8300e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.876+0000 7f06a0620800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.876+0000 7f06a0620800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.876+0000 7f06a0620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.876+0000 7f06a0620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.876+0000 7f06a0620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.876+0000 7f06a0620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:51.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.876+0000 7f06a0620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.876+0000 7f06a0620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.876+0000 7f06a0620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.877+0000 7f06a0620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.877+0000 7f06a0620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.877+0000 7f06a0620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.877+0000 7f06a0620800 20 zone default found 2024-09-12T00:33:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.877+0000 7f06a0620800 4 Realm: () 2024-09-12T00:33:51.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.877+0000 7f06a0620800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.877+0000 7f06a0620800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.877+0000 7f06a0620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.877+0000 7f06a0620800 20 zonegroup default 2024-09-12T00:33:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.877+0000 7f06a0620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.877+0000 7f06a0620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.877+0000 7f06a0620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.878+0000 7f06a0620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.878+0000 7f06a0620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.878+0000 7f06a0620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.878+0000 7f06a0620800 20 started sync module instance, tier type = 2024-09-12T00:33:51.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.878+0000 7f06a0620800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:51.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.891+0000 7f06a0620800 20 add_watcher() i=0 2024-09-12T00:33:51.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.891+0000 7f06a0620800 20 add_watcher() i=1 2024-09-12T00:33:51.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.891+0000 7f06a0620800 20 add_watcher() i=2 2024-09-12T00:33:51.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.891+0000 7f06a0620800 20 add_watcher() i=3 2024-09-12T00:33:51.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.891+0000 7f06a0620800 20 add_watcher() i=4 2024-09-12T00:33:51.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.891+0000 7f06a0620800 20 add_watcher() i=5 2024-09-12T00:33:51.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.891+0000 7f06a0620800 20 add_watcher() i=6 2024-09-12T00:33:51.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.892+0000 7f06a0620800 20 add_watcher() i=7 2024-09-12T00:33:51.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.892+0000 7f06a0620800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:51.893 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.894+0000 7f0554fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:51.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.894+0000 7f06a0620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:51.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.894+0000 7f06a0620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:51.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.895+0000 7f06a0620800 5 note: GC not initialized 2024-09-12T00:33:51.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.895+0000 7f04cf7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:51.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.895+0000 7f06a0620800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:51.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.895+0000 7f06a0620800 20 Filter name: none 2024-09-12T00:33:51.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.895+0000 7f04cd7fa640 20 reqs_thread_entry: start 2024-09-12T00:33:51.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.895+0000 7f06a0620800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:33:51.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.895+0000 7f06a0620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.895+0000 7f06a0620800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:51.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.895+0000 7f06a0620800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:33:51.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.896+0000 7f06a0620800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:33:51.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.896+0000 7f06a0620800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 : miss 2024-09-12T00:33:51.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.896+0000 7f06a0620800 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.896+0000 7f06a0620800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:51.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.896+0000 7f06a0620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 info.flags=0x17 2024-09-12T00:33:51.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.896+0000 7f06a0620800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 to cache LRU end 2024-09-12T00:33:51.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.896+0000 7f06a0620800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:51.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.896+0000 7f06a0620800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:33:51.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.896+0000 7f06a0620800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1 2024-09-12T00:33:51.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.896+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.897+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.897+0000 7f06a0620800 20 get_obj_state: octx=0x55a73c5a3690 obj=check-bucket:c state=0x55a73c86ddc8 s->prefetch_data=0 2024-09-12T00:33:51.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.898+0000 7f06a0620800 20 get_obj_state: setting s->obj_tag to 2bnglplnk08wzij6t7b0fl0rr5brpbsu 2024-09-12T00:33:51.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.898+0000 7f06a0620800 20 get_obj_state_impl: setting s->olh_tag to 10n66no4sh7k6ak3pp1zsdz2nvpcem55 2024-09-12T00:33:51.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.898+0000 7f06a0620800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=10n66no4sh7k6ak3pp1zsdz2nvpcem55 2024-09-12T00:33:51.898 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.899+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.901+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.901+0000 7f06a0620800 20 olh_log_entry: epoch=3 op=3 key=c[GM9vO8StlytliQQLeDTCqYPKrmG9Fm.] 2024-09-12T00:33:51.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.901+0000 7f06a0620800 20 get_obj_state: octx=0x55a73c5a3690 obj=check-bucket:_:GM9vO8StlytliQQLeDTCqYPKrmG9Fm._c state=0x55a73c8a9888 s->prefetch_data=0 2024-09-12T00:33:51.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.902+0000 7f06a0620800 10 manifest: total_size = 12 2024-09-12T00:33:51.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.902+0000 7f06a0620800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15237535844256027062 2024-09-12T00:33:51.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.902+0000 7f06a0620800 20 get_obj_state: octx=0x55a73c5a3690 obj=check-bucket:_:GM9vO8StlytliQQLeDTCqYPKrmG9Fm._c state=0x55a73c8a9888 s->prefetch_data=0 2024-09-12T00:33:51.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.902+0000 7f06a0620800 20 prepare_atomic_modification: state is not atomic. state=0x55a73c8a9888 2024-09-12T00:33:51.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.902+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.904+0000 7f06a0620800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:33:51.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.904+0000 7f06a0620800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:33:51.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.904+0000 7f06a0620800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:33:51.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.904+0000 7f06a0620800 5 delete_objs_inline: removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1__shadow:GM9vO8StlytliQQLeDTCqYPKrmG9Fm._.lnOmiHNGn2oMw8YNJ7fqc0ar0CcRg7n_0 2024-09-12T00:33:51.906 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.907+0000 7f0581ffb640 20 handle_completion(): completion ok for obj=c[GM9vO8StlytliQQLeDTCqYPKrmG9Fm.] 2024-09-12T00:33:51.906 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.907+0000 7f06a0620800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:33:51.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.909+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.909+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.911+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.911+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.912+0000 7f06a0620800 20 get_obj_state: octx=0x55a73c5a3690 obj=check-bucket:d state=0x55a73c86ddc8 s->prefetch_data=0 2024-09-12T00:33:51.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.912+0000 7f06a0620800 20 get_obj_state: setting s->obj_tag to nwu0lvb94dy7nqlt4ui0of7a66qtimxk 2024-09-12T00:33:51.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.912+0000 7f06a0620800 20 get_obj_state_impl: setting s->olh_tag to 78a0jrrvy2plrkh06awlqo916bbf3mzg 2024-09-12T00:33:51.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.912+0000 7f06a0620800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=78a0jrrvy2plrkh06awlqo916bbf3mzg 2024-09-12T00:33:51.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.914+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.915+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.916+0000 7f06a0620800 20 olh_log_entry: epoch=3 op=3 key=d[EBBipkU4mfGconOJ5z3W1.cj4dI0mlG] 2024-09-12T00:33:51.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.916+0000 7f06a0620800 20 get_obj_state: octx=0x55a73c5a3690 obj=check-bucket:_:EBBipkU4mfGconOJ5z3W1.cj4dI0mlG_d state=0x55a73c8701c8 s->prefetch_data=0 2024-09-12T00:33:51.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.916+0000 7f06a0620800 10 manifest: total_size = 12 2024-09-12T00:33:51.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.916+0000 7f06a0620800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11515383325291344055 2024-09-12T00:33:51.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.916+0000 7f06a0620800 20 get_obj_state: octx=0x55a73c5a3690 obj=check-bucket:_:EBBipkU4mfGconOJ5z3W1.cj4dI0mlG_d state=0x55a73c8701c8 s->prefetch_data=0 2024-09-12T00:33:51.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.916+0000 7f06a0620800 20 prepare_atomic_modification: state is not atomic. state=0x55a73c8701c8 2024-09-12T00:33:51.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.916+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.918+0000 7f06a0620800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:33:51.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.918+0000 7f06a0620800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:33:51.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.918+0000 7f06a0620800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:33:51.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.918+0000 7f06a0620800 5 delete_objs_inline: removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1__shadow:EBBipkU4mfGconOJ5z3W1.cj4dI0mlG_.LAaECurkhfMPQ7KiUk-3QyKSBXev6_o_0 2024-09-12T00:33:51.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.922+0000 7f0581ffb640 20 handle_completion(): completion ok for obj=d[EBBipkU4mfGconOJ5z3W1.cj4dI0mlG] 2024-09-12T00:33:51.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.923+0000 7f06a0620800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:33:51.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.927+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.927+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.928+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.929+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.929+0000 7f06a0620800 20 get_obj_state: octx=0x55a73c5a3690 obj=check-bucket:e state=0x55a73c86ddc8 s->prefetch_data=0 2024-09-12T00:33:51.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.929+0000 7f06a0620800 20 get_obj_state: setting s->obj_tag to zv8ulvmyo36nwpy51k7ojcg03hf4wxyv 2024-09-12T00:33:51.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.929+0000 7f06a0620800 20 get_obj_state_impl: setting s->olh_tag to l545a1ta528hfc1eujamieg3om3n3gq5 2024-09-12T00:33:51.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.929+0000 7f06a0620800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=l545a1ta528hfc1eujamieg3om3n3gq5 2024-09-12T00:33:51.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.931+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.932+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.932+0000 7f06a0620800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:33:51.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.932+0000 7f06a0620800 20 olh_log_entry: epoch=2 op=3 key=e[HE6nWd2kkZFMNbPoX3mWO700ASG7orR] 2024-09-12T00:33:51.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.932+0000 7f06a0620800 20 get_obj_state: octx=0x55a73c5a3690 obj=check-bucket:_:HE6nWd2kkZFMNbPoX3mWO700ASG7orR_e state=0x55a73c8701c8 s->prefetch_data=0 2024-09-12T00:33:51.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.933+0000 7f06a0620800 10 manifest: total_size = 12 2024-09-12T00:33:51.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.933+0000 7f06a0620800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4644170461059317979 2024-09-12T00:33:51.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.933+0000 7f06a0620800 20 get_obj_state: octx=0x55a73c5a3690 obj=check-bucket:_:HE6nWd2kkZFMNbPoX3mWO700ASG7orR_e state=0x55a73c8701c8 s->prefetch_data=0 2024-09-12T00:33:51.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.933+0000 7f06a0620800 20 prepare_atomic_modification: state is not atomic. state=0x55a73c8701c8 2024-09-12T00:33:51.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.933+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.936+0000 7f06a0620800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:33:51.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.936+0000 7f06a0620800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-12T00:33:51.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.936+0000 7f06a0620800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:33:51.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.936+0000 7f06a0620800 5 delete_objs_inline: removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1__shadow:HE6nWd2kkZFMNbPoX3mWO700ASG7orR_.AxIxhsUzeVnMPnDuCmX-l7xcjoU2Q0E_0 2024-09-12T00:33:51.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.937+0000 7f0581ffb640 20 handle_completion(): completion ok for obj=e[HE6nWd2kkZFMNbPoX3mWO700ASG7orR] 2024-09-12T00:33:51.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.937+0000 7f06a0620800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:33:51.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.938+0000 7f06a0620800 20 get_obj_state: octx=0x55a73c5a3690 obj=check-bucket:e state=0x55a73c86ddc8 s->prefetch_data=0 2024-09-12T00:33:51.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.938+0000 7f06a0620800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=l545a1ta528hfc1eujamieg3om3n3gq5 2024-09-12T00:33:51.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.941+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.941 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.942+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.941 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.943+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.942 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.943+0000 7f06a0620800 20 get_obj_state: octx=0x55a73c5a3690 obj=check-bucket:f state=0x55a73c86ddc8 s->prefetch_data=0 2024-09-12T00:33:51.942 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.943+0000 7f06a0620800 20 get_obj_state: setting s->obj_tag to s4advpo1qgayhxtj2e8slxtjm5krmi7t 2024-09-12T00:33:51.942 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.943+0000 7f06a0620800 20 get_obj_state_impl: setting s->olh_tag to yij3emah3e80rhewy3xnxm1smzfxww5k 2024-09-12T00:33:51.942 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.943+0000 7f06a0620800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yij3emah3e80rhewy3xnxm1smzfxww5k 2024-09-12T00:33:51.943 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.945+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.946+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.946+0000 7f06a0620800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:33:51.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.946+0000 7f06a0620800 20 olh_log_entry: epoch=2 op=3 key=f[DPuFAx1YoZHrI0hUlKH2IFACaHDGCOs] 2024-09-12T00:33:51.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.946+0000 7f06a0620800 20 get_obj_state: octx=0x55a73c5a3690 obj=check-bucket:_:DPuFAx1YoZHrI0hUlKH2IFACaHDGCOs_f state=0x55a73c8701c8 s->prefetch_data=0 2024-09-12T00:33:51.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.947+0000 7f06a0620800 10 manifest: total_size = 22 2024-09-12T00:33:51.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.947+0000 7f06a0620800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17209424873037809672 2024-09-12T00:33:51.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.947+0000 7f06a0620800 20 get_obj_state: octx=0x55a73c5a3690 obj=check-bucket:_:DPuFAx1YoZHrI0hUlKH2IFACaHDGCOs_f state=0x55a73c8701c8 s->prefetch_data=0 2024-09-12T00:33:51.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.947+0000 7f06a0620800 20 prepare_atomic_modification: state is not atomic. state=0x55a73c8701c8 2024-09-12T00:33:51.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.947+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.949+0000 7f06a0620800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:33:51.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.949+0000 7f06a0620800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:33:51.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.949+0000 7f06a0620800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:33:51.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.949+0000 7f06a0620800 5 delete_objs_inline: removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1__shadow:DPuFAx1YoZHrI0hUlKH2IFACaHDGCOs_.WESW6MTLMvy76ZnG5ZVRILXx-Xg3c5x_0 2024-09-12T00:33:51.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.951+0000 7f0581ffb640 20 handle_completion(): completion ok for obj=f[DPuFAx1YoZHrI0hUlKH2IFACaHDGCOs] 2024-09-12T00:33:51.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.952+0000 7f06a0620800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:33:51.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.954+0000 7f06a0620800 20 get_obj_state: octx=0x55a73c5a3690 obj=check-bucket:f state=0x55a73c86ddc8 s->prefetch_data=0 2024-09-12T00:33:51.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.954+0000 7f06a0620800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yij3emah3e80rhewy3xnxm1smzfxww5k 2024-09-12T00:33:51.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.958+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.959+0000 7f06a0620800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1.0 2024-09-12T00:33:51.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.959+0000 7f06a0620800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-12T00:33:51.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.959+0000 7f06a0620800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:33:51.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.960+0000 7f0554fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:51.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.962+0000 7f06a0620800 20 remove_watcher() i=0 2024-09-12T00:33:51.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.962+0000 7f06a0620800 2 removed watcher, disabling cache 2024-09-12T00:33:51.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.963+0000 7f06a0620800 20 remove_watcher() i=1 2024-09-12T00:33:51.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.964+0000 7f06a0620800 20 remove_watcher() i=2 2024-09-12T00:33:51.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.965+0000 7f06a0620800 20 remove_watcher() i=3 2024-09-12T00:33:51.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.966+0000 7f06a0620800 20 remove_watcher() i=4 2024-09-12T00:33:51.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.967+0000 7f06a0620800 20 remove_watcher() i=5 2024-09-12T00:33:51.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.969+0000 7f06a0620800 20 remove_watcher() i=6 2024-09-12T00:33:51.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:51.970+0000 7f06a0620800 20 remove_watcher() i=7 2024-09-12T00:33:52.201 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:33:52.226 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:52.226 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:52.265 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.266+0000 7f2dbb146800 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.269+0000 7f2dbb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.269+0000 7f2dbb146800 20 realm 2024-09-12T00:33:52.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.269+0000 7f2dbb146800 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.269+0000 7f2dbb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.269+0000 7f2dbb146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:52.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.269+0000 7f2dbb146800 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.269+0000 7f2dbb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.269+0000 7f2dbb146800 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.270+0000 7f2dbb146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:52.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.270+0000 7f2dbb146800 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.270+0000 7f2dbb146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:52.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.271+0000 7f2dbb146800 20 searching for the correct realm 2024-09-12T00:33:52.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.274+0000 7f2db842f640 0 -- 172.21.15.62:0/3415788049 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f2db006a490 msgr2=0x7f2db0097960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:52.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.277+0000 7f2db9431640 0 -- 172.21.15.62:0/3415788049 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55f959447d80 msgr2=0x55f95944a1b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:52.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.281+0000 7f2dbb146800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:33:52.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.281+0000 7f2dbb146800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:33:52.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.281+0000 7f2dbb146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:52.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.281+0000 7f2dbb146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:52.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.281+0000 7f2dbb146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:52.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.281+0000 7f2dbb146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:52.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.281+0000 7f2dbb146800 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.282+0000 7f2dbb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.282+0000 7f2dbb146800 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.282+0000 7f2dbb146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:52.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.282+0000 7f2dbb146800 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.282+0000 7f2dbb146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:52.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.282+0000 7f2dbb146800 20 zone default found 2024-09-12T00:33:52.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.282+0000 7f2dbb146800 4 Realm: () 2024-09-12T00:33:52.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.282+0000 7f2dbb146800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:33:52.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.282+0000 7f2dbb146800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:33:52.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.282+0000 7f2dbb146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:52.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.282+0000 7f2dbb146800 20 zonegroup default 2024-09-12T00:33:52.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.282+0000 7f2dbb146800 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.282+0000 7f2dbb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.282+0000 7f2dbb146800 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.283+0000 7f2dbb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.283+0000 7f2dbb146800 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.283 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.283+0000 7f2dbb146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.283 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.283+0000 7f2dbb146800 20 started sync module instance, tier type = 2024-09-12T00:33:52.283 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.283+0000 7f2dbb146800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:33:52.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.294+0000 7f2dbb146800 20 add_watcher() i=0 2024-09-12T00:33:52.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.294+0000 7f2dbb146800 20 add_watcher() i=1 2024-09-12T00:33:52.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.294+0000 7f2dbb146800 20 add_watcher() i=2 2024-09-12T00:33:52.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.294+0000 7f2dbb146800 20 add_watcher() i=3 2024-09-12T00:33:52.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.294+0000 7f2dbb146800 20 add_watcher() i=4 2024-09-12T00:33:52.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.294+0000 7f2dbb146800 20 add_watcher() i=5 2024-09-12T00:33:52.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.294+0000 7f2dbb146800 20 add_watcher() i=6 2024-09-12T00:33:52.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.295+0000 7f2dbb146800 20 add_watcher() i=7 2024-09-12T00:33:52.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.295+0000 7f2dbb146800 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:52.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.297+0000 7f2c6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:52.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.297+0000 7f2dbb146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:52.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.297+0000 7f2dbb146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:52.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.297+0000 7f2dbb146800 5 note: GC not initialized 2024-09-12T00:33:52.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.298+0000 7f2c6e7e4640 20 reqs_thread_entry: start 2024-09-12T00:33:52.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.298+0000 7f2dbb146800 20 init_complete bucket index max shards: 1 2024-09-12T00:33:52.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.298+0000 7f2dbb146800 20 Filter name: none 2024-09-12T00:33:52.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.298+0000 7f2c67fff640 20 reqs_thread_entry: start 2024-09-12T00:33:52.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.298+0000 7f2dbb146800 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.298+0000 7f2dbb146800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:52.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.298+0000 7f2dbb146800 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.299+0000 7f2dbb146800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:52.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.299+0000 7f2dbb146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:52.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.299+0000 7f2dbb146800 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.299+0000 7f2dbb146800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:33:52.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.299+0000 7f2dbb146800 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.299+0000 7f2dbb146800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:33:52.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.300+0000 7f2dbb146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:52.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.301+0000 7f2c6f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:52.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.303+0000 7f2dbb146800 20 remove_watcher() i=0 2024-09-12T00:33:52.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.303+0000 7f2dbb146800 2 removed watcher, disabling cache 2024-09-12T00:33:52.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.304+0000 7f2dbb146800 20 remove_watcher() i=1 2024-09-12T00:33:52.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.305+0000 7f2dbb146800 20 remove_watcher() i=2 2024-09-12T00:33:52.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.306+0000 7f2dbb146800 20 remove_watcher() i=3 2024-09-12T00:33:52.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.307+0000 7f2dbb146800 20 remove_watcher() i=4 2024-09-12T00:33:52.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.308+0000 7f2dbb146800 20 remove_watcher() i=5 2024-09-12T00:33:52.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.309+0000 7f2dbb146800 20 remove_watcher() i=6 2024-09-12T00:33:52.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:33:52.310+0000 7f2dbb146800 20 remove_watcher() i=7 2024-09-12T00:33:52.320 INFO:tasks.workunit.client.0.smithi062.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:33:52.320 INFO:tasks.workunit.client.0.smithi062.stderr:Deleting bucket check-bucket 2024-09-12T00:33:52.488 INFO:tasks.workunit.client.0.smithi062.stderr:Completed bucket check tests 2024-09-12T00:33:52.488 INFO:tasks.workunit.client.0.smithi062.stdout:connected to http://localhost:80 2024-09-12T00:33:52.547 INFO:tasks.workunit.client.0.smithi062.stderr:+ deactivate 2024-09-12T00:33:52.547 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:33:52.547 INFO:tasks.workunit.client.0.smithi062.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:33:52.547 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-09-12T00:33:52.547 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:33:52.548 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -n '' ']' 2024-09-12T00:33:52.548 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:33:52.548 INFO:tasks.workunit.client.0.smithi062.stderr:+ hash -r 2024-09-12T00:33:52.548 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -n '' ']' 2024-09-12T00:33:52.548 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:33:52.548 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:33:52.548 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset -f deactivate 2024-09-12T00:33:52.548 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo OK. 2024-09-12T00:33:52.549 INFO:tasks.workunit.client.0.smithi062.stdout:OK. 2024-09-12T00:33:52.549 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:33:52.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:33:52.630 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T00:33:52.631 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:33:53.023 DEBUG:teuthology.parallel:result is None 2024-09-12T00:33:53.023 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:33:53.062 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:33:53.063 DEBUG:teuthology.orchestra.run.smithi062:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:33:53.194 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:33:53.194 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:33:53.206 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:33:53.206 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:33:53.207 DEBUG:teuthology.orchestra.run.smithi062:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:33:53.236 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:33:53.237 INFO:teuthology.orchestra.run.smithi062.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:33:53.237 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:33:53.307 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:33:53.308 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:33:53.377 INFO:tasks.workunit:timeout=3h 2024-09-12T00:33:53.377 INFO:tasks.workunit:cleanup=True 2024-09-12T00:33:53.378 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:33:53.447 INFO:tasks.workunit.client.0.smithi062.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:34:39.010 INFO:tasks.workunit.client.0.smithi062.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:34:39.011 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:34:39.011 INFO:tasks.workunit.client.0.smithi062.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:34:39.011 INFO:tasks.workunit.client.0.smithi062.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:34:39.011 INFO:tasks.workunit.client.0.smithi062.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:34:39.011 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:34:39.011 INFO:tasks.workunit.client.0.smithi062.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:34:39.011 INFO:tasks.workunit.client.0.smithi062.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:34:39.011 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:34:39.011 INFO:tasks.workunit.client.0.smithi062.stderr: git switch -c 2024-09-12T00:34:39.012 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:34:39.012 INFO:tasks.workunit.client.0.smithi062.stderr:Or undo this operation with: 2024-09-12T00:34:39.012 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:34:39.012 INFO:tasks.workunit.client.0.smithi062.stderr: git switch - 2024-09-12T00:34:39.012 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:34:39.012 INFO:tasks.workunit.client.0.smithi062.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:34:39.012 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:34:39.012 INFO:tasks.workunit.client.0.smithi062.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:34:39.015 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:34:39.085 INFO:tasks.workunit.client.0.smithi062.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:34:39.087 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:34:39.087 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:34:39.137 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:34:39.188 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:34:39.229 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:34:39.230 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:34:39.230 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:34:39.271 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:34:39.274 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:34:39.274 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:34:39.345 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T00:34:39.347 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T00:34:39.348 DEBUG:teuthology.orchestra.run.smithi062:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T00:34:39.430 INFO:tasks.workunit.client.0.smithi062.stdout:Running main() from gmock_main.cc 2024-09-12T00:34:39.431 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:34:39.431 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:34:39.431 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 11 tests from ClsLock 2024-09-12T00:34:39.431 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T00:34:41.184 INFO:tasks.workunit.client.0.smithi062.stdout:lock: mylock 2024-09-12T00:34:41.184 INFO:tasks.workunit.client.0.smithi062.stdout: lock_type: exclusive 2024-09-12T00:34:41.185 INFO:tasks.workunit.client.0.smithi062.stdout: tag: 2024-09-12T00:34:41.185 INFO:tasks.workunit.client.0.smithi062.stdout: lockers: 2024-09-12T00:34:41.185 INFO:tasks.workunit.client.0.smithi062.stdout: client.5187 expiration=2024-09-12T00:36:41.182034+0000 addr=v1:172.21.15.62:0/3500841630 cookie= 2024-09-12T00:34:41.189 INFO:tasks.workunit.client.0.smithi062.stdout:lock: mylock 2024-09-12T00:34:41.189 INFO:tasks.workunit.client.0.smithi062.stdout: lock_type: shared 2024-09-12T00:34:41.189 INFO:tasks.workunit.client.0.smithi062.stdout: tag: 2024-09-12T00:34:41.189 INFO:tasks.workunit.client.0.smithi062.stdout: lockers: 2024-09-12T00:34:41.189 INFO:tasks.workunit.client.0.smithi062.stdout: client.5021 expiration=0.000000 addr=v1:172.21.15.62:0/1509416700 cookie= 2024-09-12T00:34:41.189 INFO:tasks.workunit.client.0.smithi062.stdout: client.5187 expiration=2024-09-12T00:36:41.189760+0000 addr=v1:172.21.15.62:0/3500841630 cookie= 2024-09-12T00:34:41.190 INFO:tasks.workunit.client.0.smithi062.stdout:lock: mylock 2024-09-12T00:34:41.190 INFO:tasks.workunit.client.0.smithi062.stdout: lock_type: shared 2024-09-12T00:34:41.190 INFO:tasks.workunit.client.0.smithi062.stdout: tag: 2024-09-12T00:34:41.191 INFO:tasks.workunit.client.0.smithi062.stdout: lockers: 2024-09-12T00:34:41.191 INFO:tasks.workunit.client.0.smithi062.stdout: client.5021 expiration=0.000000 addr=v1:172.21.15.62:0/1509416700 cookie= 2024-09-12T00:34:42.156 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestMultiLocking (2726 ms) 2024-09-12T00:34:42.156 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T00:34:44.409 INFO:tasks.workunit.client.0.smithi062.stdout:lock: mylock 2024-09-12T00:34:44.409 INFO:tasks.workunit.client.0.smithi062.stdout: lock_type: shared 2024-09-12T00:34:44.409 INFO:tasks.workunit.client.0.smithi062.stdout: tag: 2024-09-12T00:34:44.409 INFO:tasks.workunit.client.0.smithi062.stdout: lockers: 2024-09-12T00:34:44.410 INFO:tasks.workunit.client.0.smithi062.stdout: client.5208 expiration=0.000000 addr=v1:172.21.15.62:0/1742759365 cookie= 2024-09-12T00:34:44.412 INFO:tasks.workunit.client.0.smithi062.stdout:lock: mylock 2024-09-12T00:34:44.412 INFO:tasks.workunit.client.0.smithi062.stdout: lock_type: exclusive 2024-09-12T00:34:44.412 INFO:tasks.workunit.client.0.smithi062.stdout: tag: new_tag 2024-09-12T00:34:44.412 INFO:tasks.workunit.client.0.smithi062.stdout: lockers: 2024-09-12T00:34:44.412 INFO:tasks.workunit.client.0.smithi062.stdout: client.5199 expiration=0.000000 addr=v1:172.21.15.62:0/2936115504 cookie= 2024-09-12T00:34:45.181 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestMeta (3025 ms) 2024-09-12T00:34:45.181 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T00:34:47.204 INFO:tasks.workunit.client.0.smithi062.stdout:lock: mylock 2024-09-12T00:34:47.204 INFO:tasks.workunit.client.0.smithi062.stdout: lock_type: exclusive 2024-09-12T00:34:47.204 INFO:tasks.workunit.client.0.smithi062.stdout: tag: 2024-09-12T00:34:47.205 INFO:tasks.workunit.client.0.smithi062.stdout: lockers: 2024-09-12T00:34:47.206 INFO:tasks.workunit.client.0.smithi062.stdout:lock: mylock 2024-09-12T00:34:47.206 INFO:tasks.workunit.client.0.smithi062.stdout: lock_type: shared 2024-09-12T00:34:47.206 INFO:tasks.workunit.client.0.smithi062.stdout: tag: 2024-09-12T00:34:47.206 INFO:tasks.workunit.client.0.smithi062.stdout: lockers: 2024-09-12T00:34:47.206 INFO:tasks.workunit.client.0.smithi062.stdout: client.5214 expiration=0.000000 addr=v1:172.21.15.62:0/1673865560 cookie= 2024-09-12T00:34:47.207 INFO:tasks.workunit.client.0.smithi062.stdout: client.5214 expiration=0.000000 addr=v1:172.21.15.62:0/1673865560 cookie=new cookie 2024-09-12T00:34:48.185 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestCookie (3001 ms) 2024-09-12T00:34:48.185 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T00:34:51.231 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestMultipleLocks (3049 ms) 2024-09-12T00:34:51.232 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T00:34:58.275 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestLockDuration (7043 ms) 2024-09-12T00:34:58.276 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T00:35:01.289 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestAssertLocked (3015 ms) 2024-09-12T00:35:01.289 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T00:35:04.305 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestSetCookie (3016 ms) 2024-09-12T00:35:04.306 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T00:35:24.570 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestRenew (20263 ms) 2024-09-12T00:35:24.570 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T00:35:31.601 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7033 ms) 2024-09-12T00:35:31.602 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T00:35:39.625 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8024 ms) 2024-09-12T00:35:39.626 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T00:35:47.663 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8038 ms) 2024-09-12T00:35:47.664 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 11 tests from ClsLock (68233 ms total) 2024-09-12T00:35:47.664 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:35:47.664 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:35:47.664 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 11 tests from 1 test suite ran. (68233 ms total) 2024-09-12T00:35:47.664 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 11 tests. 2024-09-12T00:35:47.668 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:35:47.668 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:35:47.715 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T00:35:47.716 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T00:35:47.716 DEBUG:teuthology.orchestra.run.smithi062:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T00:35:47.764 INFO:tasks.workunit.client.0.smithi062.stdout:Running main() from gmock_main.cc 2024-09-12T00:35:47.764 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:35:47.764 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:35:47.765 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 4 tests from cls_log 2024-09-12T00:35:47.765 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T00:35:50.698 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_log.test_log_add_same_time (2934 ms) 2024-09-12T00:35:50.698 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T00:35:53.710 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_log.test_log_add_different_time (3011 ms) 2024-09-12T00:35:53.710 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T00:35:56.736 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_log.trim_by_time (3025 ms) 2024-09-12T00:35:56.736 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T00:35:59.746 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_log.trim_by_marker (3011 ms) 2024-09-12T00:35:59.746 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 4 tests from cls_log (11982 ms total) 2024-09-12T00:35:59.746 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:35:59.746 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:35:59.746 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 4 tests from 1 test suite ran. (11982 ms total) 2024-09-12T00:35:59.747 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 4 tests. 2024-09-12T00:35:59.750 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:35:59.750 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:35:59.795 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T00:35:59.797 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T00:35:59.797 DEBUG:teuthology.orchestra.run.smithi062:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T00:35:59.844 INFO:tasks.workunit.client.0.smithi062.stdout:Running main() from gmock_main.cc 2024-09-12T00:35:59.844 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:35:59.844 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:35:59.844 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 10 tests from cls_refcount 2024-09-12T00:35:59.844 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T00:36:02.776 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_refcount.test_implicit (2932 ms) 2024-09-12T00:36:02.776 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T00:36:05.789 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3013 ms) 2024-09-12T00:36:05.790 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T00:36:14.839 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_refcount.test_put_snap (9050 ms) 2024-09-12T00:36:14.840 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T00:36:17.859 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_refcount.test_explicit (3020 ms) 2024-09-12T00:36:17.859 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_refcount.set 2024-09-12T00:36:20.872 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_refcount.set (3013 ms) 2024-09-12T00:36:20.872 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T00:36:27.902 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_refcount.test_implicit_ec (7030 ms) 2024-09-12T00:36:27.902 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T00:36:34.924 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7021 ms) 2024-09-12T00:36:34.924 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T00:36:47.017 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_refcount.test_put_snap_ec (12094 ms) 2024-09-12T00:36:47.017 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T00:36:54.045 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_refcount.test_explicit_ec (7027 ms) 2024-09-12T00:36:54.045 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T00:37:01.060 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_refcount.set_ec (7016 ms) 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 10 tests from cls_refcount (61216 ms total) 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 10 tests from 1 test suite ran. (61216 ms total) 2024-09-12T00:37:01.061 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 10 tests. 2024-09-12T00:37:01.064 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:37:01.064 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:37:01.109 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T00:37:01.110 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T00:37:01.110 DEBUG:teuthology.orchestra.run.smithi062:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T00:37:01.200 INFO:tasks.workunit.client.0.smithi062.stdout:Running main() from gmock_main.cc 2024-09-12T00:37:01.200 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:37:01.200 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:37:01.201 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 19 tests from cls_rgw 2024-09-12T00:37:03.084 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T00:37:03.132 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.index_basic (48 ms) 2024-09-12T00:37:03.132 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T00:37:03.165 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (33 ms) 2024-09-12T00:37:03.165 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.index_remove_object (41 ms) 2024-09-12T00:37:03.206 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T00:37:04.700 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.index_suggest (1494 ms) 2024-09-12T00:37:04.701 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T00:37:04.707 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.index_suggest_complete (7 ms) 2024-09-12T00:37:04.707 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T00:37:04.735 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.index_list (28 ms) 2024-09-12T00:37:04.735 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T00:37:27.689 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.index_list_delimited (22954 ms) 2024-09-12T00:37:27.690 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T00:37:27.782 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.bi_list (93 ms) 2024-09-12T00:37:27.782 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T00:37:27.794 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.gc_set (13 ms) 2024-09-12T00:37:27.794 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T00:37:27.806 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.gc_list (11 ms) 2024-09-12T00:37:27.806 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T00:37:34.586 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.gc_defer (6780 ms) 2024-09-12T00:37:34.587 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T00:37:34.669 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.usage_basic (83 ms) 2024-09-12T00:37:34.669 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T00:37:34.674 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.usage_clear_no_obj (5 ms) 2024-09-12T00:37:34.674 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T00:37:34.769 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.usage_clear (95 ms) 2024-09-12T00:37:34.769 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T00:37:34.819 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.bi_log_trim (50 ms) 2024-09-12T00:37:34.820 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T00:37:34.833 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.index_racing_removes (13 ms) 2024-09-12T00:37:34.833 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T00:37:34.847 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.reshardlog_list (14 ms) 2024-09-12T00:37:34.847 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T00:37:34.857 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.reshardlog_num (10 ms) 2024-09-12T00:37:34.857 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-12T00:37:34.878 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw.bi_put_entries (21 ms) 2024-09-12T00:37:35.592 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 19 tests from cls_rgw (31794 ms total) 2024-09-12T00:37:35.592 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:37:35.593 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:37:35.593 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 19 tests from 1 test suite ran. (34392 ms total) 2024-09-12T00:37:35.593 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 19 tests. 2024-09-12T00:37:35.596 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:37:35.597 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:37:35.641 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T00:37:35.642 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T00:37:35.642 DEBUG:teuthology.orchestra.run.smithi062:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T00:37:35.728 INFO:tasks.workunit.client.0.smithi062.stdout:Running main() from gmock_main.cc 2024-09-12T00:37:35.728 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:37:35.729 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:37:35.729 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T00:37:35.729 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T00:37:37.610 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw_gc.init (1881 ms) 2024-09-12T00:37:37.610 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T00:37:37.635 INFO:tasks.workunit.client.0.smithi062.stderr:[ ] list info tag = chain-0 2024-09-12T00:37:37.636 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (26 ms) 2024-09-12T00:37:37.636 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T00:37:37.642 INFO:tasks.workunit.client.0.smithi062.stderr:[ ] next_marker is: = 0/4263 2024-09-12T00:37:37.642 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (7 ms) 2024-09-12T00:37:37.642 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T00:37:37.651 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (9 ms) 2024-09-12T00:37:37.651 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T00:37:37.659 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (8 ms) 2024-09-12T00:37:37.659 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T00:37:37.667 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (8 ms) 2024-09-12T00:37:37.667 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T00:37:37.675 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (8 ms) 2024-09-12T00:37:37.675 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T00:37:37.683 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (9 ms) 2024-09-12T00:37:37.684 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw_gc.finalize (934 ms) 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 9 tests from cls_rgw_gc (2890 ms total) 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 9 tests from 1 test suite ran. (2890 ms total) 2024-09-12T00:37:38.619 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 9 tests. 2024-09-12T00:37:38.621 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:37:38.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:37:38.667 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T00:37:38.669 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T00:37:38.670 DEBUG:teuthology.orchestra.run.smithi062:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T00:37:38.727 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:38.727 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:38.728 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T00:37:38.728 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:37:40.620 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T00:37:40.621 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T00:37:40.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.634+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=65ES6C7IAAIJ type=del size=674199 2024-09-12T00:37:40.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.637+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=825089NAHHA7 type=del size=2222766 2024-09-12T00:37:40.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.639+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=T91WCHJKJGSH type=write size=541210 2024-09-12T00:37:40.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.641+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=TPN3B8IDIZD6 type=del size=925763 2024-09-12T00:37:40.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.643+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=SDOHVEZJBY54 type=del size=2326619 2024-09-12T00:37:40.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.644+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=4SBEVVP9VJX4 type=write size=873229 2024-09-12T00:37:40.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.646+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=6PO13Y003G8U type=del size=2722895 2024-09-12T00:37:40.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.648+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=Z5V17NDC1LWL type=del size=2363154 2024-09-12T00:37:40.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.649+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=N4ZYQ578HDXP type=del size=2700947 2024-09-12T00:37:40.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.651+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=JILOTZ402PV7 type=del size=2023689 2024-09-12T00:37:40.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.652+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=08XYRHN6R2AF type=del size=895081 2024-09-12T00:37:40.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.655+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~A0KGZ19I2KHN.0 size=28268 2024-09-12T00:37:40.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.655+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=A0KGZ19I2KHN tag=FYZLHPQG648O type=write size=1076844 2024-09-12T00:37:40.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.657+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=3KJUA0K1NZEE type=del size=1728275 2024-09-12T00:37:40.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.658+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=XJF6N2UXQJAL type=del size=1491702 2024-09-12T00:37:40.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.660+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=NYSZWW1SJVPB type=del size=4191255 2024-09-12T00:37:40.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.662+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=KIA7SC9K5NL5 type=del size=3479764 2024-09-12T00:37:40.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.663+0000 7fcd44281780 1 < completed delete operation key=XTNXNF3D0HFK tag=65ES6C7IAAIJ type=del 2024-09-12T00:37:40.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.666+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~DYZ2B9EQBZQ6.0 size=526442 2024-09-12T00:37:40.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.666+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=DYZ2B9EQBZQ6 tag=33GD9E76Y0G9 type=write size=1575018 2024-09-12T00:37:40.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.668+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=825089NAHHA7 type=del 2024-09-12T00:37:40.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.669+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=TG0SRRTM9EA4 type=del size=1950886 2024-09-12T00:37:40.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.672+0000 7fcd44281780 1 < suggested update operation key=0O62FO4WVZG6 tag=T91WCHJKJGSH type=write size=541210 2024-09-12T00:37:40.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.674+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=92IHLA7WVK1I type=del size=1722148 2024-09-12T00:37:40.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.675+0000 7fcd44281780 -1 < failed to complete operation key=0O62FO4WVZG6 tag=TPN3B8IDIZD6 type=del size=925763: (22) Invalid argument 2024-09-12T00:37:40.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.678+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~NWTM5TOC3OIB.0 size=1048576 2024-09-12T00:37:40.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.679+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~NWTM5TOC3OIB.1 size=570922 2024-09-12T00:37:40.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.679+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=NWTM5TOC3OIB tag=XATT26GEVV90 type=write size=2668074 2024-09-12T00:37:40.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.681+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=SDOHVEZJBY54 type=del 2024-09-12T00:37:40.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.684+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~KPKDY93C9I80.0 size=1048576 2024-09-12T00:37:40.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.685+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~KPKDY93C9I80.1 size=1048576 2024-09-12T00:37:40.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.687+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~KPKDY93C9I80.2 size=939953 2024-09-12T00:37:40.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.687+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=KPKDY93C9I80 tag=WUK6059TQVPG type=write size=4085681 2024-09-12T00:37:40.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.690+0000 7fcd44281780 1 < completed write operation key=Z6I6598B6J5I tag=4SBEVVP9VJX4 type=write size=873229 2024-09-12T00:37:40.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.691+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=O9N87K3X0LH1 type=del size=194443 2024-09-12T00:37:40.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.693+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=6PO13Y003G8U type=del 2024-09-12T00:37:40.694 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.695+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~1ZUTGV58HJL3.0 size=293707 2024-09-12T00:37:40.694 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.695+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=1ZUTGV58HJL3 tag=8MWILY7EXN1L type=write size=1342283 2024-09-12T00:37:40.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.698+0000 7fcd44281780 1 < suggested update operation key=G8O8VXTUPQVP tag=Z5V17NDC1LWL type=del size=2363154 2024-09-12T00:37:40.699 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.700+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=WQ7732NJM95I type=del size=2513539 2024-09-12T00:37:40.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.701+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=N4ZYQ578HDXP type=del 2024-09-12T00:37:40.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.704+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~68Q6OM86L38V.0 size=1048576 2024-09-12T00:37:40.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.705+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~68Q6OM86L38V.1 size=127413 2024-09-12T00:37:40.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.705+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=68Q6OM86L38V tag=A0R969QMKILC type=write size=2224565 2024-09-12T00:37:40.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.707+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=JILOTZ402PV7 type=del 2024-09-12T00:37:40.707 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.708+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=7C8G84BHYKGF type=del size=3437380 2024-09-12T00:37:40.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.710+0000 7fcd44281780 1 < canceled operation key=UWS056JN3IXO tag=08XYRHN6R2AF type=del size=895081 2024-09-12T00:37:40.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.712+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=9S56PNB93WDX type=del size=4067087 2024-09-12T00:37:40.712 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.713+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~A0KGZ19I2KHN.0 size=28268 2024-09-12T00:37:40.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.716+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=A0KGZ19I2KHN tag=FYZLHPQG648O type=write size=1076844 2024-09-12T00:37:40.716 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.717+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=Z4O6YY4A0KYM type=write size=526657 2024-09-12T00:37:40.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.721+0000 7fcd44281780 1 < suggested remove operation key=526O814C10YW tag=3KJUA0K1NZEE type=del 2024-09-12T00:37:40.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.722+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=O5KUBYI7G43W type=del size=2579884 2024-09-12T00:37:40.722 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.724+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=XJF6N2UXQJAL type=del 2024-09-12T00:37:40.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.726+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~8VOH6JX4F0S3.0 size=225681 2024-09-12T00:37:40.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.726+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=8VOH6JX4F0S3 tag=HP6VURBQMIRD type=write size=1274257 2024-09-12T00:37:40.728 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.729+0000 7fcd44281780 1 < suggested update operation key=U4EPPPA4QGGD tag=NYSZWW1SJVPB type=del size=4191255 2024-09-12T00:37:40.730 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.732+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~JZTZBIHLXR1T.0 size=280369 2024-09-12T00:37:40.730 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.732+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=JZTZBIHLXR1T tag=AX1YPA2WPC57 type=write size=1328945 2024-09-12T00:37:40.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.733+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=KIA7SC9K5NL5 type=del 2024-09-12T00:37:40.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.735+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=WPU8JD7EJ9PB type=write size=255326 2024-09-12T00:37:40.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.737+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~DYZ2B9EQBZQ6.0 size=526442 2024-09-12T00:37:40.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.739+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=DYZ2B9EQBZQ6 tag=33GD9E76Y0G9 type=write size=1575018 2024-09-12T00:37:40.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.741+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=ARFAD4SMDQ39 type=del size=1807691 2024-09-12T00:37:40.743 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.742+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=TG0SRRTM9EA4 type=del 2024-09-12T00:37:40.744 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.745+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~V0FH8LT6W5Q5.0 size=1048576 2024-09-12T00:37:40.744 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.746+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~V0FH8LT6W5Q5.1 size=1048576 2024-09-12T00:37:40.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.747+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~V0FH8LT6W5Q5.2 size=301584 2024-09-12T00:37:40.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.747+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=V0FH8LT6W5Q5 tag=F9FZ5LNZZ7VT type=write size=3447312 2024-09-12T00:37:40.747 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.749+0000 7fcd44281780 1 < completed delete operation key=0OEDZ5O2LN8H tag=92IHLA7WVK1I type=del 2024-09-12T00:37:40.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.751+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~EHTEXOKDTVRJ.0 size=1048576 2024-09-12T00:37:40.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.753+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~EHTEXOKDTVRJ.1 size=389210 2024-09-12T00:37:40.752 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.753+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=EHTEXOKDTVRJ tag=2ZKKPAG1AVEK type=write size=2486362 2024-09-12T00:37:40.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.754+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~NWTM5TOC3OIB.0 size=1048576 2024-09-12T00:37:40.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.755+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~NWTM5TOC3OIB.1 size=570922 2024-09-12T00:37:40.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.758+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=NWTM5TOC3OIB tag=XATT26GEVV90 type=write size=2668074 2024-09-12T00:37:40.758 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.759+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=18TERTT6ZBCA type=del size=4182932 2024-09-12T00:37:40.760 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.761+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~KPKDY93C9I80.0 size=1048576 2024-09-12T00:37:40.761 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.762+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~KPKDY93C9I80.1 size=1048576 2024-09-12T00:37:40.762 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.763+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~KPKDY93C9I80.2 size=939953 2024-09-12T00:37:40.764 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.765+0000 7fcd44281780 1 < completed multipart upload key=0AVE0W4OV1AU upload=KPKDY93C9I80 tag=WUK6059TQVPG type=write size=4085681 2024-09-12T00:37:40.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.766+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=OCPDDEXQRJXZ type=del size=1913130 2024-09-12T00:37:40.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.769+0000 7fcd44281780 1 < suggested update operation key=7UCICX0GHHQ1 tag=O9N87K3X0LH1 type=del size=194443 2024-09-12T00:37:40.771 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.772+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~U8M0KG5UGXKB.0 size=1048576 2024-09-12T00:37:40.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.773+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~U8M0KG5UGXKB.1 size=1048576 2024-09-12T00:37:40.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.774+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~U8M0KG5UGXKB.2 size=616006 2024-09-12T00:37:40.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.774+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=U8M0KG5UGXKB tag=86T2Z8I32C9K type=write size=3761734 2024-09-12T00:37:40.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.775+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~1ZUTGV58HJL3.0 size=293707 2024-09-12T00:37:40.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.778+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=1ZUTGV58HJL3 tag=8MWILY7EXN1L type=write size=1342283 2024-09-12T00:37:40.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.781+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~E6SFSRU8BX4L.0 size=1048576 2024-09-12T00:37:40.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.782+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~E6SFSRU8BX4L.1 size=556504 2024-09-12T00:37:40.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.782+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=E6SFSRU8BX4L tag=KIB2PVW4CB10 type=write size=2653656 2024-09-12T00:37:40.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.784+0000 7fcd44281780 -1 < failed to complete operation key=7UCICX0GHHQ1 tag=WQ7732NJM95I type=del size=2513539: (22) Invalid argument 2024-09-12T00:37:40.784 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.785+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=JUY05PD9GWS2 type=del size=2767493 2024-09-12T00:37:40.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.787+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~68Q6OM86L38V.0 size=1048576 2024-09-12T00:37:40.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.787+0000 7fcd44281780 1 < canceled part key=_multipart_UWS056JN3IXO.2~68Q6OM86L38V.1 size=127413 2024-09-12T00:37:40.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.790+0000 7fcd44281780 1 < canceled multipart upload key=UWS056JN3IXO upload=68Q6OM86L38V tag=A0R969QMKILC type=write size=2224565 2024-09-12T00:37:40.790 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.791+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=PDQNHSTIGEG1 type=del size=131761 2024-09-12T00:37:40.791 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.792+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=7C8G84BHYKGF type=del 2024-09-12T00:37:40.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.797+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~4323Y3MDONJS.0 size=1048576 2024-09-12T00:37:40.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.798+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~4323Y3MDONJS.1 size=738373 2024-09-12T00:37:40.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.798+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=4323Y3MDONJS tag=6NDWFCCWQVDS type=write size=2835525 2024-09-12T00:37:40.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.800+0000 7fcd44281780 1 < canceled operation key=B5OH55MQGSGJ tag=9S56PNB93WDX type=del size=4067087 2024-09-12T00:37:40.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.802+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=E7EDD14RY5F4 type=del size=853332 2024-09-12T00:37:40.802 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.803+0000 7fcd44281780 1 < completed write operation key=O12Z8THB62AJ tag=Z4O6YY4A0KYM type=write size=526657 2024-09-12T00:37:40.804 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.804+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=YILZA3GZQOZU type=del size=3209300 2024-09-12T00:37:40.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.806+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=O5KUBYI7G43W type=del 2024-09-12T00:37:40.806 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.807+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=GS9QA6H16KT3 type=del size=3217049 2024-09-12T00:37:40.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.809+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~8VOH6JX4F0S3.0 size=225681 2024-09-12T00:37:40.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.811+0000 7fcd44281780 1 < completed multipart upload key=B5OH55MQGSGJ upload=8VOH6JX4F0S3 tag=HP6VURBQMIRD type=write size=1274257 2024-09-12T00:37:40.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.812+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=Z22LJCNXG32L type=del size=1707484 2024-09-12T00:37:40.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.814+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~JZTZBIHLXR1T.0 size=280369 2024-09-12T00:37:40.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.816+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=JZTZBIHLXR1T tag=AX1YPA2WPC57 type=write size=1328945 2024-09-12T00:37:40.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.817+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=OA9PDBHM94H1 type=del size=1454486 2024-09-12T00:37:40.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.818+0000 7fcd44281780 1 < completed write operation key=WXBMIJ4FC0VX tag=WPU8JD7EJ9PB type=write size=255326 2024-09-12T00:37:40.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.820+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=VRQW66IAG4FW type=write size=246825 2024-09-12T00:37:40.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.822+0000 7fcd44281780 1 < suggested update operation key=UXY6K0AVI4EK tag=ARFAD4SMDQ39 type=del size=1807691 2024-09-12T00:37:40.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.824+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=YHVYLVGPL17Y type=del size=329201 2024-09-12T00:37:40.824 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.825+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~V0FH8LT6W5Q5.0 size=1048576 2024-09-12T00:37:40.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.826+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~V0FH8LT6W5Q5.1 size=1048576 2024-09-12T00:37:40.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.827+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~V0FH8LT6W5Q5.2 size=301584 2024-09-12T00:37:40.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.829+0000 7fcd44281780 1 < completed multipart upload key=4RU6HTH4J0U1 upload=V0FH8LT6W5Q5 tag=F9FZ5LNZZ7VT type=write size=3447312 2024-09-12T00:37:40.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.831+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=ZASHANC6V39I type=del size=2504581 2024-09-12T00:37:40.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.833+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~EHTEXOKDTVRJ.0 size=1048576 2024-09-12T00:37:40.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.834+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~EHTEXOKDTVRJ.1 size=389210 2024-09-12T00:37:40.835 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.836+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=EHTEXOKDTVRJ tag=2ZKKPAG1AVEK type=write size=2486362 2024-09-12T00:37:40.836 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.837+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=NGAAWV46VIIA type=write size=713816 2024-09-12T00:37:40.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.839+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=18TERTT6ZBCA type=del 2024-09-12T00:37:40.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.840+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=E0AEK4H0U6GO type=del size=2996809 2024-09-12T00:37:40.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.841+0000 7fcd44281780 1 < canceled operation key=NIDHAXQF55WX tag=OCPDDEXQRJXZ type=del size=1913130 2024-09-12T00:37:40.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.844+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~Y6H338TUJNGD.0 size=377195 2024-09-12T00:37:40.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.844+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=Y6H338TUJNGD tag=3K0MTXJ1TYOV type=write size=1425771 2024-09-12T00:37:40.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.844+0000 7fcd44281780 1 < canceled part key=_multipart_G8O8VXTUPQVP.2~U8M0KG5UGXKB.0 size=1048576 2024-09-12T00:37:40.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.845+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~U8M0KG5UGXKB.1 size=1048576 2024-09-12T00:37:40.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.846+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~U8M0KG5UGXKB.2 size=616006 2024-09-12T00:37:40.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.849+0000 7fcd44281780 1 < canceled multipart upload key=G8O8VXTUPQVP upload=U8M0KG5UGXKB tag=86T2Z8I32C9K type=write size=3761734 2024-09-12T00:37:40.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.851+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~7T7CVEQ4HVW8.0 size=704614 2024-09-12T00:37:40.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.851+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=7T7CVEQ4HVW8 tag=GWK021WM9XCU type=write size=1753190 2024-09-12T00:37:40.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.852+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~E6SFSRU8BX4L.0 size=1048576 2024-09-12T00:37:40.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.854+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~E6SFSRU8BX4L.1 size=556504 2024-09-12T00:37:40.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.856+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=E6SFSRU8BX4L tag=KIB2PVW4CB10 type=write size=2653656 2024-09-12T00:37:40.857 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.858+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=5NR4NTJK1CP8 type=del size=3457167 2024-09-12T00:37:40.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.861+0000 7fcd44281780 1 < suggested update operation key=RYSE2CKE5IRT tag=JUY05PD9GWS2 type=del size=2767493 2024-09-12T00:37:40.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.863+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=HXZIVEQNXQ7E type=del size=1143010 2024-09-12T00:37:40.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.866+0000 7fcd44281780 1 < suggested remove operation key=UWS056JN3IXO tag=PDQNHSTIGEG1 type=del 2024-09-12T00:37:40.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.867+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=JQXXGT8C49D8 type=del size=4141753 2024-09-12T00:37:40.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.868+0000 7fcd44281780 1 < canceled part key=_multipart_XRW0CRE12S5B.2~4323Y3MDONJS.0 size=1048576 2024-09-12T00:37:40.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.869+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~4323Y3MDONJS.1 size=738373 2024-09-12T00:37:40.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.871+0000 7fcd44281780 1 < canceled multipart upload key=XRW0CRE12S5B upload=4323Y3MDONJS tag=6NDWFCCWQVDS type=write size=2835525 2024-09-12T00:37:40.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.873+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=GZ3WD2H7A3ZS type=del size=3166118 2024-09-12T00:37:40.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.876+0000 7fcd44281780 1 < suggested update operation key=AJ5AUTM2J9MT tag=E7EDD14RY5F4 type=del size=853332 2024-09-12T00:37:40.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.878+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=8LKO0KHUL8UQ type=del size=2175672 2024-09-12T00:37:40.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.880+0000 7fcd44281780 1 < suggested update operation key=U4EPPPA4QGGD tag=YILZA3GZQOZU type=del size=3209300 2024-09-12T00:37:40.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.882+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=VY9FZRYGQZ1X type=write size=778577 2024-09-12T00:37:40.882 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.883+0000 7fcd44281780 1 < completed delete operation key=4RU6HTH4J0U1 tag=GS9QA6H16KT3 type=del 2024-09-12T00:37:40.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.886+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~1DPAHR420RH1.0 size=606605 2024-09-12T00:37:40.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.886+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=1DPAHR420RH1 tag=D5BYLDZC5MGK type=write size=1655181 2024-09-12T00:37:40.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.887+0000 7fcd44281780 -1 < failed to complete operation key=AJ5AUTM2J9MT tag=Z22LJCNXG32L type=del size=1707484: (22) Invalid argument 2024-09-12T00:37:40.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.889+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~Y1B8CZ53P752.0 size=216638 2024-09-12T00:37:40.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.889+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=Y1B8CZ53P752 tag=IGB8Y0K4WKOG type=write size=1265214 2024-09-12T00:37:40.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.891+0000 7fcd44281780 1 < completed delete operation key=XTNXNF3D0HFK tag=OA9PDBHM94H1 type=del 2024-09-12T00:37:40.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.892+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=QG7S48XVDQW2 type=write size=970837 2024-09-12T00:37:40.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.893+0000 7fcd44281780 1 < completed write operation key=QVULC3H9QGXE tag=VRQW66IAG4FW type=write size=246825 2024-09-12T00:37:40.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.895+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=TV4R96BLNRUG type=del size=2725007 2024-09-12T00:37:40.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.896+0000 7fcd44281780 1 < canceled operation key=CF7B7J3V1YFG tag=YHVYLVGPL17Y type=del size=329201 2024-09-12T00:37:40.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.898+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=GCG2APN1GP6E type=write size=43199 2024-09-12T00:37:40.898 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.899+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=ZASHANC6V39I type=del 2024-09-12T00:37:40.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.900+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=0KPOTQUC3HYX type=write size=719795 2024-09-12T00:37:40.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.902+0000 7fcd44281780 1 < completed write operation key=CF7B7J3V1YFG tag=NGAAWV46VIIA type=write size=713816 2024-09-12T00:37:40.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.904+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~2M3H49AIZ21A.0 size=1048576 2024-09-12T00:37:40.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.906+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~2M3H49AIZ21A.1 size=504041 2024-09-12T00:37:40.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.906+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=2M3H49AIZ21A tag=7B4NXTQHWCLL type=write size=2601193 2024-09-12T00:37:40.906 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.907+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=E0AEK4H0U6GO type=del 2024-09-12T00:37:40.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.910+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~OHO913RTW3S8.0 size=1048576 2024-09-12T00:37:40.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.911+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~OHO913RTW3S8.1 size=846717 2024-09-12T00:37:40.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.911+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=OHO913RTW3S8 tag=B5RJ1QEO2LAY type=write size=2943869 2024-09-12T00:37:40.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.912+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~Y6H338TUJNGD.0 size=377195 2024-09-12T00:37:40.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.915+0000 7fcd44281780 1 < completed multipart upload key=B5OH55MQGSGJ upload=Y6H338TUJNGD tag=3K0MTXJ1TYOV type=write size=1425771 2024-09-12T00:37:40.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.916+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=YVQCVUDTZBM8 type=del size=2464573 2024-09-12T00:37:40.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.917+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~7T7CVEQ4HVW8.0 size=704614 2024-09-12T00:37:40.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.919+0000 7fcd44281780 1 < completed multipart upload key=UWS056JN3IXO upload=7T7CVEQ4HVW8 tag=GWK021WM9XCU type=write size=1753190 2024-09-12T00:37:40.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.922+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~CNSWFMPVAKTO.0 size=420013 2024-09-12T00:37:40.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.922+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=CNSWFMPVAKTO tag=WOSKCIHAYX3A type=write size=1468589 2024-09-12T00:37:40.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.925+0000 7fcd44281780 1 < suggested remove operation key=8U004LC8IYLQ tag=5NR4NTJK1CP8 type=del 2024-09-12T00:37:40.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.926+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=W8BVI3FXIOZX type=del size=1582505 2024-09-12T00:37:40.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.927+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=HXZIVEQNXQ7E type=del 2024-09-12T00:37:40.930 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.931+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~IUG5JBFU3C24.0 size=1048576 2024-09-12T00:37:40.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.934+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~IUG5JBFU3C24.1 size=1048576 2024-09-12T00:37:40.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.935+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~IUG5JBFU3C24.2 size=122650 2024-09-12T00:37:40.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.935+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=IUG5JBFU3C24 tag=BF7JHL27A61D type=write size=3268378 2024-09-12T00:37:40.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.938+0000 7fcd44281780 1 < suggested update operation key=KJ0C43WLAFLI tag=JQXXGT8C49D8 type=del size=4141753 2024-09-12T00:37:40.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.939+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=0NJLN14TBEEC type=del size=1275420 2024-09-12T00:37:40.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.941+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=GZ3WD2H7A3ZS type=del 2024-09-12T00:37:40.941 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.942+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=MI221Z9S1KZ9 type=del size=346677 2024-09-12T00:37:40.942 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.944+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=8LKO0KHUL8UQ type=del 2024-09-12T00:37:40.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.945+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=5RYNO0DA4C3M type=del size=1505527 2024-09-12T00:37:40.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.946+0000 7fcd44281780 1 < canceled operation key=0AVE0W4OV1AU tag=VY9FZRYGQZ1X type=write size=778577 2024-09-12T00:37:40.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.948+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=3WGQUVGR9E5C type=del size=825583 2024-09-12T00:37:40.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.949+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~1DPAHR420RH1.0 size=606605 2024-09-12T00:37:40.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.952+0000 7fcd44281780 1 < completed multipart upload key=0AVE0W4OV1AU upload=1DPAHR420RH1 tag=D5BYLDZC5MGK type=write size=1655181 2024-09-12T00:37:40.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.954+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~9SINN8XT85IA.0 size=558961 2024-09-12T00:37:40.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.954+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=9SINN8XT85IA tag=MULASZSN0CYC type=write size=1607537 2024-09-12T00:37:40.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.955+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~Y1B8CZ53P752.0 size=216638 2024-09-12T00:37:40.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.958+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=Y1B8CZ53P752 tag=IGB8Y0K4WKOG type=write size=1265214 2024-09-12T00:37:40.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.959+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=EBVG24MH9KMK type=write size=921183 2024-09-12T00:37:40.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.960+0000 7fcd44281780 1 < canceled operation key=VXDTFEG8P23H tag=QG7S48XVDQW2 type=write size=970837 2024-09-12T00:37:40.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.963+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~ER8YUEIHWUX4.0 size=1048576 2024-09-12T00:37:40.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.964+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~ER8YUEIHWUX4.1 size=912447 2024-09-12T00:37:40.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.964+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=ER8YUEIHWUX4 tag=4TNMNL44CPHU type=write size=3009599 2024-09-12T00:37:40.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.967+0000 7fcd44281780 1 < suggested remove operation key=U4EPPPA4QGGD tag=TV4R96BLNRUG type=del 2024-09-12T00:37:40.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.969+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=OZM9ZLBGSE29 type=del size=1830829 2024-09-12T00:37:40.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.970+0000 7fcd44281780 1 < completed write operation key=0O62FO4WVZG6 tag=GCG2APN1GP6E type=write size=43199 2024-09-12T00:37:40.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.973+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~9ZZ1ABVQBDQF.0 size=1048576 2024-09-12T00:37:40.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.974+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~9ZZ1ABVQBDQF.1 size=22739 2024-09-12T00:37:40.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.974+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=9ZZ1ABVQBDQF tag=TISAA7OP13J5 type=write size=2119891 2024-09-12T00:37:40.974 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.975+0000 7fcd44281780 1 < canceled operation key=EXP8U6QNSMQ0 tag=0KPOTQUC3HYX type=write size=719795 2024-09-12T00:37:40.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.977+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=E4UWZY1OGHLD type=del size=2452114 2024-09-12T00:37:40.977 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.978+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~2M3H49AIZ21A.0 size=1048576 2024-09-12T00:37:40.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.980+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~2M3H49AIZ21A.1 size=504041 2024-09-12T00:37:40.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.982+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=2M3H49AIZ21A tag=7B4NXTQHWCLL type=write size=2601193 2024-09-12T00:37:40.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.985+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~S4PZ7NS6NYOI.0 size=871583 2024-09-12T00:37:40.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.985+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=S4PZ7NS6NYOI tag=HDSZ8MCKCWJH type=write size=1920159 2024-09-12T00:37:40.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.987+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~OHO913RTW3S8.0 size=1048576 2024-09-12T00:37:40.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.988+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~OHO913RTW3S8.1 size=846717 2024-09-12T00:37:40.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.990+0000 7fcd44281780 1 < completed multipart upload key=0AVE0W4OV1AU upload=OHO913RTW3S8 tag=B5RJ1QEO2LAY type=write size=2943869 2024-09-12T00:37:40.990 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.991+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=RIM8HIOYA7KN type=del size=1839170 2024-09-12T00:37:40.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.993+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=YVQCVUDTZBM8 type=del 2024-09-12T00:37:40.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.995+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~PA9Y5R3CL4XG.0 size=1048576 2024-09-12T00:37:40.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.996+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~PA9Y5R3CL4XG.1 size=1048576 2024-09-12T00:37:40.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.997+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~PA9Y5R3CL4XG.2 size=264772 2024-09-12T00:37:40.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.997+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=PA9Y5R3CL4XG tag=HNWPUJNAYH3F type=write size=3410500 2024-09-12T00:37:40.997 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:40.998+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~CNSWFMPVAKTO.0 size=420013 2024-09-12T00:37:40.999 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.001+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=CNSWFMPVAKTO tag=WOSKCIHAYX3A type=write size=1468589 2024-09-12T00:37:41.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.003+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~CU6CFLJOUMXK.0 size=1048576 2024-09-12T00:37:41.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.005+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~CU6CFLJOUMXK.1 size=1048576 2024-09-12T00:37:41.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.006+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~CU6CFLJOUMXK.2 size=918777 2024-09-12T00:37:41.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.006+0000 7fcd44281780 1 > prepared multipart upload key=U4EPPPA4QGGD upload=CU6CFLJOUMXK tag=P839TKWGMQ95 type=write size=4064505 2024-09-12T00:37:41.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.007+0000 7fcd44281780 1 < canceled operation key=VOO70F2NBKL0 tag=W8BVI3FXIOZX type=del size=1582505 2024-09-12T00:37:41.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.010+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~OI1IZK6112RG.0 size=1048576 2024-09-12T00:37:41.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.011+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~OI1IZK6112RG.1 size=863451 2024-09-12T00:37:41.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.011+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=OI1IZK6112RG tag=EV9XV6T8TSZI type=write size=2960603 2024-09-12T00:37:41.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.012+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~IUG5JBFU3C24.0 size=1048576 2024-09-12T00:37:41.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.013+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~IUG5JBFU3C24.1 size=1048576 2024-09-12T00:37:41.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.014+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~IUG5JBFU3C24.2 size=122650 2024-09-12T00:37:41.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.017+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=IUG5JBFU3C24 tag=BF7JHL27A61D type=write size=3268378 2024-09-12T00:37:41.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.018+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=9JHKA3YZKBNV type=del size=3433576 2024-09-12T00:37:41.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.020+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=0NJLN14TBEEC type=del 2024-09-12T00:37:41.021 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.022+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~FIG5364SQA46.0 size=1048576 2024-09-12T00:37:41.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.023+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~FIG5364SQA46.1 size=1048576 2024-09-12T00:37:41.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.024+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~FIG5364SQA46.2 size=449999 2024-09-12T00:37:41.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.024+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=FIG5364SQA46 tag=6XA0EJ4EEYTJ type=write size=3595727 2024-09-12T00:37:41.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.027+0000 7fcd44281780 1 < suggested remove operation key=UWS056JN3IXO tag=MI221Z9S1KZ9 type=del 2024-09-12T00:37:41.029 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.030+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~G1LQL6C9LBH4.0 size=1048576 2024-09-12T00:37:41.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.031+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~G1LQL6C9LBH4.1 size=1048576 2024-09-12T00:37:41.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.032+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~G1LQL6C9LBH4.2 size=620406 2024-09-12T00:37:41.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.032+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=G1LQL6C9LBH4 tag=Y8JYZZDFHLZ0 type=write size=3766134 2024-09-12T00:37:41.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.034+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=5RYNO0DA4C3M type=del 2024-09-12T00:37:41.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.035+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=NQ3KN17G4N39 type=del size=3517907 2024-09-12T00:37:41.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.037+0000 7fcd44281780 1 < canceled operation key=0OEDZ5O2LN8H tag=3WGQUVGR9E5C type=del size=825583 2024-09-12T00:37:41.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.038+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=A19CRC6ZNCND type=del size=2491106 2024-09-12T00:37:41.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.039+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~9SINN8XT85IA.0 size=558961 2024-09-12T00:37:41.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.042+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=9SINN8XT85IA tag=MULASZSN0CYC type=write size=1607537 2024-09-12T00:37:41.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.044+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~7FXSM1071LVW.0 size=1048576 2024-09-12T00:37:41.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.045+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~7FXSM1071LVW.1 size=1048576 2024-09-12T00:37:41.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.046+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~7FXSM1071LVW.2 size=230276 2024-09-12T00:37:41.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.046+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=7FXSM1071LVW tag=1S335HUNHE6U type=write size=3376004 2024-09-12T00:37:41.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.048+0000 7fcd44281780 1 < completed write operation key=ZQSZDU87GAMV tag=EBVG24MH9KMK type=write size=921183 2024-09-12T00:37:41.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.049+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=S8YF95SO9B07 type=del size=3223947 2024-09-12T00:37:41.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.051+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~ER8YUEIHWUX4.0 size=1048576 2024-09-12T00:37:41.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.052+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~ER8YUEIHWUX4.1 size=912447 2024-09-12T00:37:41.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.054+0000 7fcd44281780 1 < completed multipart upload key=526O814C10YW upload=ER8YUEIHWUX4 tag=4TNMNL44CPHU type=write size=3009599 2024-09-12T00:37:41.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.056+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=2ZTCQU37VXT1 type=write size=900923 2024-09-12T00:37:41.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.057+0000 7fcd44281780 1 < canceled operation key=B5OH55MQGSGJ tag=OZM9ZLBGSE29 type=del size=1830829 2024-09-12T00:37:41.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.059+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~UAB173TZHMJ5.0 size=647866 2024-09-12T00:37:41.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.059+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=UAB173TZHMJ5 tag=XHENCH33X1V3 type=write size=1696442 2024-09-12T00:37:41.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.062+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~9ZZ1ABVQBDQF.0 size=1048576 2024-09-12T00:37:41.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.063+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~9ZZ1ABVQBDQF.1 size=22739 2024-09-12T00:37:41.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.066+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=9ZZ1ABVQBDQF tag=TISAA7OP13J5 type=write size=2119891 2024-09-12T00:37:41.066 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.067+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=9P36WIE1CE7D type=del size=428805 2024-09-12T00:37:41.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.069+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=E4UWZY1OGHLD type=del 2024-09-12T00:37:41.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.070+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=GJR252A82RTS type=del size=1049782 2024-09-12T00:37:41.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.072+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~S4PZ7NS6NYOI.0 size=871583 2024-09-12T00:37:41.073 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.074+0000 7fcd44281780 1 < completed multipart upload key=4RU6HTH4J0U1 upload=S4PZ7NS6NYOI tag=HDSZ8MCKCWJH type=write size=1920159 2024-09-12T00:37:41.076 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.077+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~BMELJ2IGX342.0 size=1048576 2024-09-12T00:37:41.077 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.078+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~BMELJ2IGX342.1 size=1048576 2024-09-12T00:37:41.077 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.079+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~BMELJ2IGX342.2 size=601750 2024-09-12T00:37:41.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.079+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=BMELJ2IGX342 tag=AZWBR62ZEDHI type=write size=3747478 2024-09-12T00:37:41.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.082+0000 7fcd44281780 1 < suggested update operation key=0O62FO4WVZG6 tag=RIM8HIOYA7KN type=del size=1839170 2024-09-12T00:37:41.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.084+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=8C5WETEZASNN type=del size=2721306 2024-09-12T00:37:41.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.085+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~PA9Y5R3CL4XG.0 size=1048576 2024-09-12T00:37:41.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.085+0000 7fcd44281780 1 < canceled part key=_multipart_EXP8U6QNSMQ0.2~PA9Y5R3CL4XG.1 size=1048576 2024-09-12T00:37:41.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.086+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~PA9Y5R3CL4XG.2 size=264772 2024-09-12T00:37:41.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.089+0000 7fcd44281780 1 < canceled multipart upload key=EXP8U6QNSMQ0 upload=PA9Y5R3CL4XG tag=HNWPUJNAYH3F type=write size=3410500 2024-09-12T00:37:41.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.091+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~WTU3IK2JHLHN.0 size=1048576 2024-09-12T00:37:41.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.092+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~WTU3IK2JHLHN.1 size=859327 2024-09-12T00:37:41.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.092+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=WTU3IK2JHLHN tag=S6OTSHQMZN3E type=write size=2956479 2024-09-12T00:37:41.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.094+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~CU6CFLJOUMXK.0 size=1048576 2024-09-12T00:37:41.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.095+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~CU6CFLJOUMXK.1 size=1048576 2024-09-12T00:37:41.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.096+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~CU6CFLJOUMXK.2 size=918777 2024-09-12T00:37:41.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.099+0000 7fcd44281780 1 < completed multipart upload key=U4EPPPA4QGGD upload=CU6CFLJOUMXK tag=P839TKWGMQ95 type=write size=4064505 2024-09-12T00:37:41.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.101+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~CJUPJLFJCD6P.0 size=1048576 2024-09-12T00:37:41.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.102+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~CJUPJLFJCD6P.1 size=869165 2024-09-12T00:37:41.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.102+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=CJUPJLFJCD6P tag=4U518PX2G8O6 type=write size=2966317 2024-09-12T00:37:41.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.103+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~OI1IZK6112RG.0 size=1048576 2024-09-12T00:37:41.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.105+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~OI1IZK6112RG.1 size=863451 2024-09-12T00:37:41.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.107+0000 7fcd44281780 1 < completed multipart upload key=526O814C10YW upload=OI1IZK6112RG tag=EV9XV6T8TSZI type=write size=2960603 2024-09-12T00:37:41.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.110+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~RTF1OB4R2M2K.0 size=707066 2024-09-12T00:37:41.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.110+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=RTF1OB4R2M2K tag=GXXGAZ9MUDJW type=write size=1755642 2024-09-12T00:37:41.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.113+0000 7fcd44281780 1 < suggested remove operation key=KJ0C43WLAFLI tag=9JHKA3YZKBNV type=del 2024-09-12T00:37:41.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.114+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=SCV7WJNRUJS9 type=write size=529835 2024-09-12T00:37:41.115 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.116+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~FIG5364SQA46.0 size=1048576 2024-09-12T00:37:41.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.117+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~FIG5364SQA46.1 size=1048576 2024-09-12T00:37:41.117 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.119+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~FIG5364SQA46.2 size=449999 2024-09-12T00:37:41.120 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.121+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=FIG5364SQA46 tag=6XA0EJ4EEYTJ type=write size=3595727 2024-09-12T00:37:41.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.123+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=209H2AIOQ7LL type=del size=3798692 2024-09-12T00:37:41.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.123+0000 7fcd44281780 1 < canceled part key=_multipart_526O814C10YW.2~G1LQL6C9LBH4.0 size=1048576 2024-09-12T00:37:41.123 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.124+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~G1LQL6C9LBH4.1 size=1048576 2024-09-12T00:37:41.124 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.125+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~G1LQL6C9LBH4.2 size=620406 2024-09-12T00:37:41.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.128+0000 7fcd44281780 1 < canceled multipart upload key=526O814C10YW upload=G1LQL6C9LBH4 tag=Y8JYZZDFHLZ0 type=write size=3766134 2024-09-12T00:37:41.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.130+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~23J7DZ0SOX6F.0 size=1048576 2024-09-12T00:37:41.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.131+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~23J7DZ0SOX6F.1 size=411531 2024-09-12T00:37:41.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.131+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=23J7DZ0SOX6F tag=G4Y7X0CITYR8 type=write size=2508683 2024-09-12T00:37:41.131 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.133+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=NQ3KN17G4N39 type=del 2024-09-12T00:37:41.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.134+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=IRX0Z97I7IJ1 type=del size=3920052 2024-09-12T00:37:41.134 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.135+0000 7fcd44281780 1 < completed delete operation key=QVULC3H9QGXE tag=A19CRC6ZNCND type=del 2024-09-12T00:37:41.135 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.137+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=DFMJD9P4YFHE type=del size=213015 2024-09-12T00:37:41.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.138+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~7FXSM1071LVW.0 size=1048576 2024-09-12T00:37:41.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.139+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~7FXSM1071LVW.1 size=1048576 2024-09-12T00:37:41.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.140+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~7FXSM1071LVW.2 size=230276 2024-09-12T00:37:41.141 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.142+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=7FXSM1071LVW tag=1S335HUNHE6U type=write size=3376004 2024-09-12T00:37:41.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.144+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=0HQ5GGQJGIJA type=del size=536970 2024-09-12T00:37:41.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.145+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=S8YF95SO9B07 type=del 2024-09-12T00:37:41.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.147+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=B8PXIKYZRIK4 type=write size=240496 2024-09-12T00:37:41.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.148+0000 7fcd44281780 1 < completed write operation key=UWS056JN3IXO tag=2ZTCQU37VXT1 type=write size=900923 2024-09-12T00:37:41.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.150+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~DWN12XO6K5M0.0 size=161415 2024-09-12T00:37:41.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.150+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=DWN12XO6K5M0 tag=1JCMSQKU4AME type=write size=1209991 2024-09-12T00:37:41.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.150+0000 7fcd44281780 1 < canceled part key=_multipart_XRW0CRE12S5B.2~UAB173TZHMJ5.0 size=647866 2024-09-12T00:37:41.151 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.153+0000 7fcd44281780 1 < canceled multipart upload key=XRW0CRE12S5B upload=UAB173TZHMJ5 tag=XHENCH33X1V3 type=write size=1696442 2024-09-12T00:37:41.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.154+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=DDA2NVQJIJ7C type=del size=2019418 2024-09-12T00:37:41.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.157+0000 7fcd44281780 1 < suggested remove operation key=8U004LC8IYLQ tag=9P36WIE1CE7D type=del 2024-09-12T00:37:41.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.158+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=NQHDRUD0GDM5 type=del size=3788273 2024-09-12T00:37:41.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.159+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=GJR252A82RTS type=del 2024-09-12T00:37:41.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.161+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=1WR39S3NJEI5 type=del size=2608982 2024-09-12T00:37:41.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.161+0000 7fcd44281780 1 < canceled part key=_multipart_KNBCXZF3JGNL.2~BMELJ2IGX342.0 size=1048576 2024-09-12T00:37:41.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.162+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~BMELJ2IGX342.1 size=1048576 2024-09-12T00:37:41.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.163+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~BMELJ2IGX342.2 size=601750 2024-09-12T00:37:41.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.165+0000 7fcd44281780 1 < canceled multipart upload key=KNBCXZF3JGNL upload=BMELJ2IGX342 tag=AZWBR62ZEDHI type=write size=3747478 2024-09-12T00:37:41.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.168+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~20DV0A16N28P.0 size=1048576 2024-09-12T00:37:41.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.169+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~20DV0A16N28P.1 size=1048576 2024-09-12T00:37:41.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.170+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~20DV0A16N28P.2 size=645411 2024-09-12T00:37:41.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.170+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=20DV0A16N28P tag=LVBFHQ9GP3YF type=write size=3791139 2024-09-12T00:37:41.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.172+0000 7fcd44281780 1 < completed delete operation key=0OEDZ5O2LN8H tag=8C5WETEZASNN type=del 2024-09-12T00:37:41.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.173+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=S15CK4MMTEOJ type=del size=3898642 2024-09-12T00:37:41.174 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.175+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~WTU3IK2JHLHN.0 size=1048576 2024-09-12T00:37:41.175 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.176+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~WTU3IK2JHLHN.1 size=859327 2024-09-12T00:37:41.178 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.179+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=WTU3IK2JHLHN tag=S6OTSHQMZN3E type=write size=2956479 2024-09-12T00:37:41.180 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.182+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~9M0G2VI5R27E.0 size=247540 2024-09-12T00:37:41.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.182+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=9M0G2VI5R27E tag=YIGTJKH3H347 type=write size=1296116 2024-09-12T00:37:41.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.183+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~CJUPJLFJCD6P.0 size=1048576 2024-09-12T00:37:41.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.184+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~CJUPJLFJCD6P.1 size=869165 2024-09-12T00:37:41.186 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.187+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=CJUPJLFJCD6P tag=4U518PX2G8O6 type=write size=2966317 2024-09-12T00:37:41.187 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.188+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=MM2AE5V3VH7Y type=del size=3078571 2024-09-12T00:37:41.187 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.188+0000 7fcd44281780 1 < canceled part key=_multipart_EXP8U6QNSMQ0.2~RTF1OB4R2M2K.0 size=707066 2024-09-12T00:37:41.189 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.191+0000 7fcd44281780 1 < canceled multipart upload key=EXP8U6QNSMQ0 upload=RTF1OB4R2M2K tag=GXXGAZ9MUDJW type=write size=1755642 2024-09-12T00:37:41.192 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.193+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=G4BY1TWSS66I type=del size=3931862 2024-09-12T00:37:41.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.194+0000 7fcd44281780 1 < completed write operation key=ZQSZDU87GAMV tag=SCV7WJNRUJS9 type=write size=529835 2024-09-12T00:37:41.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.196+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=O44NK0OIVT6P type=del size=4024282 2024-09-12T00:37:41.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.199+0000 7fcd44281780 1 < suggested remove operation key=RYSE2CKE5IRT tag=209H2AIOQ7LL type=del 2024-09-12T00:37:41.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.200+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=I7SSJ5YHEI62 type=del size=2084613 2024-09-12T00:37:41.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.202+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~23J7DZ0SOX6F.0 size=1048576 2024-09-12T00:37:41.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.203+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~23J7DZ0SOX6F.1 size=411531 2024-09-12T00:37:41.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.205+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=23J7DZ0SOX6F tag=G4Y7X0CITYR8 type=write size=2508683 2024-09-12T00:37:41.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.206+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=ICOACTNL1C6F type=del size=2676033 2024-09-12T00:37:41.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.209+0000 7fcd44281780 1 < suggested update operation key=VOO70F2NBKL0 tag=IRX0Z97I7IJ1 type=del size=3920052 2024-09-12T00:37:41.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.212+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~UPSALS90KLG7.0 size=680362 2024-09-12T00:37:41.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.212+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=UPSALS90KLG7 tag=05557SDY13KW type=write size=1728938 2024-09-12T00:37:41.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.213+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=DFMJD9P4YFHE type=del 2024-09-12T00:37:41.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.214+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=E41IAPDCK3GI type=del size=3022022 2024-09-12T00:37:41.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.215+0000 7fcd44281780 1 < completed delete operation key=XTNXNF3D0HFK tag=0HQ5GGQJGIJA type=del 2024-09-12T00:37:41.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.217+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=EY7FWXK4ZKFG type=del size=3288437 2024-09-12T00:37:41.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.218+0000 7fcd44281780 1 < completed write operation key=0OEDZ5O2LN8H tag=B8PXIKYZRIK4 type=write size=240496 2024-09-12T00:37:41.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.220+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=252PA28OYJH9 type=del size=1197544 2024-09-12T00:37:41.220 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.221+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~DWN12XO6K5M0.0 size=161415 2024-09-12T00:37:41.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.223+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=DWN12XO6K5M0 tag=1JCMSQKU4AME type=write size=1209991 2024-09-12T00:37:41.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.226+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~822H6NWDCGW1.0 size=662677 2024-09-12T00:37:41.225 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.226+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=822H6NWDCGW1 tag=ZWKJQWUI3RSD type=write size=1711253 2024-09-12T00:37:41.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.227+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=DDA2NVQJIJ7C type=del 2024-09-12T00:37:41.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.229+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=NFG05QG929WU type=del size=394283 2024-09-12T00:37:41.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.230+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=NQHDRUD0GDM5 type=del 2024-09-12T00:37:41.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.233+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~8OTQ6MRT57UF.0 size=194587 2024-09-12T00:37:41.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.233+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=8OTQ6MRT57UF tag=3K68W70JNJAJ type=write size=1243163 2024-09-12T00:37:41.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.234+0000 7fcd44281780 1 < completed delete operation key=QVULC3H9QGXE tag=1WR39S3NJEI5 type=del 2024-09-12T00:37:41.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.236+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=OEU005UW08NB type=del size=2474088 2024-09-12T00:37:41.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.237+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~20DV0A16N28P.0 size=1048576 2024-09-12T00:37:41.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.238+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~20DV0A16N28P.1 size=1048576 2024-09-12T00:37:41.238 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.239+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~20DV0A16N28P.2 size=645411 2024-09-12T00:37:41.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.242+0000 7fcd44281780 1 < completed multipart upload key=526O814C10YW upload=20DV0A16N28P tag=LVBFHQ9GP3YF type=write size=3791139 2024-09-12T00:37:41.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.243+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=QTD36M3JGNLK type=del size=2271435 2024-09-12T00:37:41.243 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.245+0000 7fcd44281780 1 < canceled operation key=G8O8VXTUPQVP tag=S15CK4MMTEOJ type=del size=3898642 2024-09-12T00:37:41.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.247+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~J1JGX94OL0TA.0 size=1048576 2024-09-12T00:37:41.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.248+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~J1JGX94OL0TA.1 size=334758 2024-09-12T00:37:41.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.248+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=J1JGX94OL0TA tag=MOLF6V55TDFB type=write size=2431910 2024-09-12T00:37:41.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.250+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~9M0G2VI5R27E.0 size=247540 2024-09-12T00:37:41.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.252+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=9M0G2VI5R27E tag=YIGTJKH3H347 type=write size=1296116 2024-09-12T00:37:41.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.254+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=8FZVQ9NRLAZQ type=write size=788390 2024-09-12T00:37:41.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.255+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=MM2AE5V3VH7Y type=del 2024-09-12T00:37:41.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.258+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~AQ4PYF4VGIP1.0 size=1048576 2024-09-12T00:37:41.258 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.259+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~AQ4PYF4VGIP1.1 size=870421 2024-09-12T00:37:41.258 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.259+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=AQ4PYF4VGIP1 tag=YK7WO4C3Z9CT type=write size=2967573 2024-09-12T00:37:41.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.262+0000 7fcd44281780 1 < suggested update operation key=WXBMIJ4FC0VX tag=G4BY1TWSS66I type=del size=3931862 2024-09-12T00:37:41.263 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.264+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~HBQPA0PHGLVC.0 size=1048576 2024-09-12T00:37:41.264 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.266+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~HBQPA0PHGLVC.1 size=1048576 2024-09-12T00:37:41.265 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.267+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~HBQPA0PHGLVC.2 size=53884 2024-09-12T00:37:41.266 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.267+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=HBQPA0PHGLVC tag=9Z5ONR70MNX2 type=write size=3199612 2024-09-12T00:37:41.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.270+0000 7fcd44281780 1 < suggested update operation key=0ELZXPZCRPGP tag=O44NK0OIVT6P type=del size=4024282 2024-09-12T00:37:41.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.271+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=H34AWCA40B3Y type=del size=826418 2024-09-12T00:37:41.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.273+0000 7fcd44281780 1 < canceled operation key=DKJ44Z9COIIK tag=I7SSJ5YHEI62 type=del size=2084613 2024-09-12T00:37:41.274 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.275+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~UWG7V3YLGBNK.0 size=638367 2024-09-12T00:37:41.274 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.275+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=UWG7V3YLGBNK tag=COZ1AKDY6RX4 type=write size=1686943 2024-09-12T00:37:41.275 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.276+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=ICOACTNL1C6F type=del 2024-09-12T00:37:41.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.278+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=CH8PJYQJK4BB type=write size=364102 2024-09-12T00:37:41.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.279+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~UPSALS90KLG7.0 size=680362 2024-09-12T00:37:41.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.282+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=UPSALS90KLG7 tag=05557SDY13KW type=write size=1728938 2024-09-12T00:37:41.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.283+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=8A9PMR18SBII type=del size=622380 2024-09-12T00:37:41.283 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.284+0000 7fcd44281780 1 < canceled operation key=UWS056JN3IXO tag=E41IAPDCK3GI type=del size=3022022 2024-09-12T00:37:41.284 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.286+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=CAAFZRWE2FB5 type=write size=928553 2024-09-12T00:37:41.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.287+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=EY7FWXK4ZKFG type=del 2024-09-12T00:37:41.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.290+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~KTMFH21PZM32.0 size=1048576 2024-09-12T00:37:41.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.291+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~KTMFH21PZM32.1 size=808453 2024-09-12T00:37:41.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.291+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=KTMFH21PZM32 tag=6T24D651BTQX type=write size=2905605 2024-09-12T00:37:41.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.292+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=252PA28OYJH9 type=del 2024-09-12T00:37:41.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.294+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=2XNVK6ZQJ0L3 type=write size=698726 2024-09-12T00:37:41.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.295+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~822H6NWDCGW1.0 size=662677 2024-09-12T00:37:41.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.297+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=822H6NWDCGW1 tag=ZWKJQWUI3RSD type=write size=1711253 2024-09-12T00:37:41.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.299+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=G6BEKNS8995N type=del size=871750 2024-09-12T00:37:41.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.300+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=NFG05QG929WU type=del 2024-09-12T00:37:41.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.303+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~B6LZM29Y67SS.0 size=1048576 2024-09-12T00:37:41.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.304+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~B6LZM29Y67SS.1 size=616239 2024-09-12T00:37:41.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.304+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=B6LZM29Y67SS tag=OEKESH2DL0T9 type=write size=2713391 2024-09-12T00:37:41.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.306+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~8OTQ6MRT57UF.0 size=194587 2024-09-12T00:37:41.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.308+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=8OTQ6MRT57UF tag=3K68W70JNJAJ type=write size=1243163 2024-09-12T00:37:41.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.310+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~XXIIZPUEJ31S.0 size=350245 2024-09-12T00:37:41.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.310+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=XXIIZPUEJ31S tag=6400F0YG5KHU type=write size=1398821 2024-09-12T00:37:41.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.313+0000 7fcd44281780 1 < suggested remove operation key=CF7B7J3V1YFG tag=OEU005UW08NB type=del 2024-09-12T00:37:41.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.314+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=N7X923VCVA8U type=del size=2161574 2024-09-12T00:37:41.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.316+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=QTD36M3JGNLK type=del 2024-09-12T00:37:41.316 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.317+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=DP0IDZ3L1VZO type=del size=2508363 2024-09-12T00:37:41.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.318+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~J1JGX94OL0TA.0 size=1048576 2024-09-12T00:37:41.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.320+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~J1JGX94OL0TA.1 size=334758 2024-09-12T00:37:41.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.323+0000 7fcd44281780 1 < completed multipart upload key=B5OH55MQGSGJ upload=J1JGX94OL0TA tag=MOLF6V55TDFB type=write size=2431910 2024-09-12T00:37:41.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.325+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=0C4OX5OWZE24 type=del size=2940121 2024-09-12T00:37:41.326 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.327+0000 7fcd44281780 1 < completed write operation key=RYSE2CKE5IRT tag=8FZVQ9NRLAZQ type=write size=788390 2024-09-12T00:37:41.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.330+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~CGYW4VTIZ4MP.0 size=1048576 2024-09-12T00:37:41.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.331+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~CGYW4VTIZ4MP.1 size=1048576 2024-09-12T00:37:41.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.332+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~CGYW4VTIZ4MP.2 size=504285 2024-09-12T00:37:41.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.332+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=CGYW4VTIZ4MP tag=NI85TOZM0470 type=write size=3650013 2024-09-12T00:37:41.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.334+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~AQ4PYF4VGIP1.0 size=1048576 2024-09-12T00:37:41.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.335+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~AQ4PYF4VGIP1.1 size=870421 2024-09-12T00:37:41.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.337+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=AQ4PYF4VGIP1 tag=YK7WO4C3Z9CT type=write size=2967573 2024-09-12T00:37:41.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.339+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=JQ1CCADEXTRF type=del size=297645 2024-09-12T00:37:41.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.340+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~HBQPA0PHGLVC.0 size=1048576 2024-09-12T00:37:41.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.341+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~HBQPA0PHGLVC.1 size=1048576 2024-09-12T00:37:41.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.342+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~HBQPA0PHGLVC.2 size=53884 2024-09-12T00:37:41.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.345+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=HBQPA0PHGLVC tag=9Z5ONR70MNX2 type=write size=3199612 2024-09-12T00:37:41.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.346+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=H6OS34YZ8SV5 type=del size=3571634 2024-09-12T00:37:41.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.348+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=H34AWCA40B3Y type=del 2024-09-12T00:37:41.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.350+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~9024XEXLXVPX.0 size=1038395 2024-09-12T00:37:41.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.350+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=9024XEXLXVPX tag=S91VMWMUIMT4 type=write size=2086971 2024-09-12T00:37:41.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.352+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~UWG7V3YLGBNK.0 size=638367 2024-09-12T00:37:41.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.354+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=UWG7V3YLGBNK tag=COZ1AKDY6RX4 type=write size=1686943 2024-09-12T00:37:41.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.355+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=7W6U2R9JN98A type=del size=2005869 2024-09-12T00:37:41.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.357+0000 7fcd44281780 1 < canceled operation key=0ELZXPZCRPGP tag=CH8PJYQJK4BB type=write size=364102 2024-09-12T00:37:41.357 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.358+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=VBB087VKY3NK type=del size=3981267 2024-09-12T00:37:41.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.361+0000 7fcd44281780 1 < suggested update operation key=XTNXNF3D0HFK tag=8A9PMR18SBII type=del size=622380 2024-09-12T00:37:41.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.362+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=HCVCLK3L929S type=del size=4042415 2024-09-12T00:37:41.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.363+0000 7fcd44281780 1 < completed write operation key=VOO70F2NBKL0 tag=CAAFZRWE2FB5 type=write size=928553 2024-09-12T00:37:41.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.366+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~9LRSOP7DPBHJ.0 size=1048576 2024-09-12T00:37:41.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.367+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~9LRSOP7DPBHJ.1 size=52561 2024-09-12T00:37:41.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.367+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=9LRSOP7DPBHJ tag=45BD2UH37HOT type=write size=2149713 2024-09-12T00:37:41.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.368+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~KTMFH21PZM32.0 size=1048576 2024-09-12T00:37:41.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.370+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~KTMFH21PZM32.1 size=808453 2024-09-12T00:37:41.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.372+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=KTMFH21PZM32 tag=6T24D651BTQX type=write size=2905605 2024-09-12T00:37:41.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.374+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~SHYCU3ABR4B7.0 size=1048576 2024-09-12T00:37:41.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.375+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~SHYCU3ABR4B7.1 size=185810 2024-09-12T00:37:41.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.375+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=SHYCU3ABR4B7 tag=WR914BA7IVQ3 type=write size=2282962 2024-09-12T00:37:41.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.378+0000 7fcd44281780 1 < suggested update operation key=AN6GRGZ22INA tag=2XNVK6ZQJ0L3 type=write size=698726 2024-09-12T00:37:41.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.380+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=9QPGXW80JHLX type=del size=2461561 2024-09-12T00:37:41.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.381+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=G6BEKNS8995N type=del 2024-09-12T00:37:41.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.383+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=UG33A0UH2Y2O type=write size=600529 2024-09-12T00:37:41.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.385+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~B6LZM29Y67SS.0 size=1048576 2024-09-12T00:37:41.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.386+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~B6LZM29Y67SS.1 size=616239 2024-09-12T00:37:41.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.388+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=B6LZM29Y67SS tag=OEKESH2DL0T9 type=write size=2713391 2024-09-12T00:37:41.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.390+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=JHOIIUZ4I5IA type=write size=919083 2024-09-12T00:37:41.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.391+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~XXIIZPUEJ31S.0 size=350245 2024-09-12T00:37:41.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.393+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=XXIIZPUEJ31S tag=6400F0YG5KHU type=write size=1398821 2024-09-12T00:37:41.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.395+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=W3Z6XJLU16DZ type=del size=959131 2024-09-12T00:37:41.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.397+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=N7X923VCVA8U type=del 2024-09-12T00:37:41.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.399+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~DMOZ75WC0VN7.0 size=1048576 2024-09-12T00:37:41.399 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.400+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~DMOZ75WC0VN7.1 size=1048576 2024-09-12T00:37:41.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.402+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~DMOZ75WC0VN7.2 size=884280 2024-09-12T00:37:41.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.402+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=DMOZ75WC0VN7 tag=JWO1JCJZ2QIT type=write size=4030008 2024-09-12T00:37:41.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.405+0000 7fcd44281780 1 < suggested update operation key=0AVE0W4OV1AU tag=DP0IDZ3L1VZO type=del size=2508363 2024-09-12T00:37:41.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.407+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~PCMC1H20T0A3.0 size=1048576 2024-09-12T00:37:41.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.409+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~PCMC1H20T0A3.1 size=1048576 2024-09-12T00:37:41.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.410+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~PCMC1H20T0A3.2 size=76932 2024-09-12T00:37:41.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.410+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=PCMC1H20T0A3 tag=QDGS0FLMQ6CD type=write size=3222660 2024-09-12T00:37:41.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.411+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=0C4OX5OWZE24 type=del 2024-09-12T00:37:41.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.412+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=CORBO2DJ5JTG type=del size=2330502 2024-09-12T00:37:41.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.414+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~CGYW4VTIZ4MP.0 size=1048576 2024-09-12T00:37:41.414 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.415+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~CGYW4VTIZ4MP.1 size=1048576 2024-09-12T00:37:41.414 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.415+0000 7fcd44281780 1 < canceled part key=_multipart_NIDHAXQF55WX.2~CGYW4VTIZ4MP.2 size=504285 2024-09-12T00:37:41.416 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.417+0000 7fcd44281780 1 < canceled multipart upload key=NIDHAXQF55WX upload=CGYW4VTIZ4MP tag=NI85TOZM0470 type=write size=3650013 2024-09-12T00:37:41.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.420+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~BQI4EBUDW6L6.0 size=1048576 2024-09-12T00:37:41.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.421+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~BQI4EBUDW6L6.1 size=1048576 2024-09-12T00:37:41.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.422+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~BQI4EBUDW6L6.2 size=347521 2024-09-12T00:37:41.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.422+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=BQI4EBUDW6L6 tag=WJLLWTEQ87N8 type=write size=3493249 2024-09-12T00:37:41.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.423+0000 7fcd44281780 -1 < failed to complete operation key=XTNXNF3D0HFK tag=JQ1CCADEXTRF type=del size=297645: (22) Invalid argument 2024-09-12T00:37:41.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.425+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=PYRCZ1VEDO4Z type=del size=1757452 2024-09-12T00:37:41.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.427+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=H6OS34YZ8SV5 type=del 2024-09-12T00:37:41.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.428+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=2E8YMS1EO3KR type=del size=1486196 2024-09-12T00:37:41.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.429+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~9024XEXLXVPX.0 size=1038395 2024-09-12T00:37:41.430 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.431+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=9024XEXLXVPX tag=S91VMWMUIMT4 type=write size=2086971 2024-09-12T00:37:41.431 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.432+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=17PAZYPDQLLB type=del size=2586003 2024-09-12T00:37:41.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.435+0000 7fcd44281780 1 < suggested update operation key=KJ0C43WLAFLI tag=7W6U2R9JN98A type=del size=2005869 2024-09-12T00:37:41.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.436+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=2XIX5E66TA7H type=del size=3325926 2024-09-12T00:37:41.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.439+0000 7fcd44281780 1 < suggested remove operation key=CF7B7J3V1YFG tag=VBB087VKY3NK type=del 2024-09-12T00:37:41.439 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.440+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=QIYY45OON4WX type=del size=3078320 2024-09-12T00:37:41.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.442+0000 7fcd44281780 1 < canceled operation key=UXY6K0AVI4EK tag=HCVCLK3L929S type=del size=4042415 2024-09-12T00:37:41.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.444+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~FFEZVRAPDUIB.0 size=1048576 2024-09-12T00:37:41.444 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.445+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~FFEZVRAPDUIB.1 size=98376 2024-09-12T00:37:41.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.445+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=FFEZVRAPDUIB tag=3EEZVNAJQIE2 type=write size=2195528 2024-09-12T00:37:41.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.447+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~9LRSOP7DPBHJ.0 size=1048576 2024-09-12T00:37:41.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.448+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~9LRSOP7DPBHJ.1 size=52561 2024-09-12T00:37:41.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.450+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=9LRSOP7DPBHJ tag=45BD2UH37HOT type=write size=2149713 2024-09-12T00:37:41.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.451+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=XMCD0ON6V36F type=del size=1794076 2024-09-12T00:37:41.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.452+0000 7fcd44281780 1 < canceled part key=_multipart_G8O8VXTUPQVP.2~SHYCU3ABR4B7.0 size=1048576 2024-09-12T00:37:41.452 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.453+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~SHYCU3ABR4B7.1 size=185810 2024-09-12T00:37:41.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.455+0000 7fcd44281780 1 < canceled multipart upload key=G8O8VXTUPQVP upload=SHYCU3ABR4B7 tag=WR914BA7IVQ3 type=write size=2282962 2024-09-12T00:37:41.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.459+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~DGT8177WJX3I.0 size=1048576 2024-09-12T00:37:41.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.460+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~DGT8177WJX3I.1 size=780408 2024-09-12T00:37:41.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.460+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=DGT8177WJX3I tag=OFDDLWTC15KE type=write size=2877560 2024-09-12T00:37:41.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.463+0000 7fcd44281780 1 < suggested update operation key=0AVE0W4OV1AU tag=9QPGXW80JHLX type=del size=2461561 2024-09-12T00:37:41.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.464+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=60UOA6GM38DH type=del size=372293 2024-09-12T00:37:41.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.465+0000 7fcd44281780 -1 < failed to complete operation key=CF7B7J3V1YFG tag=UG33A0UH2Y2O type=write size=600529: (22) Invalid argument 2024-09-12T00:37:41.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.467+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=ZFKPYL4F9FTN type=write size=269987 2024-09-12T00:37:41.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.468+0000 7fcd44281780 1 < completed write operation key=WXBMIJ4FC0VX tag=JHOIIUZ4I5IA type=write size=919083 2024-09-12T00:37:41.468 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.470+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=ELTVWST6C8E1 type=del size=1900981 2024-09-12T00:37:41.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.471+0000 7fcd44281780 -1 < failed to complete operation key=0AVE0W4OV1AU tag=W3Z6XJLU16DZ type=del size=959131: (22) Invalid argument 2024-09-12T00:37:41.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.472+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=N1OM3WXL2R6I type=write size=833759 2024-09-12T00:37:41.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.474+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~DMOZ75WC0VN7.0 size=1048576 2024-09-12T00:37:41.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.475+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~DMOZ75WC0VN7.1 size=1048576 2024-09-12T00:37:41.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.476+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~DMOZ75WC0VN7.2 size=884280 2024-09-12T00:37:41.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.478+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=DMOZ75WC0VN7 tag=JWO1JCJZ2QIT type=write size=4030008 2024-09-12T00:37:41.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.481+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~I1VKX93JCL0C.0 size=142722 2024-09-12T00:37:41.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.481+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=I1VKX93JCL0C tag=VPLT2RJKOFZ8 type=write size=1191298 2024-09-12T00:37:41.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.482+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~PCMC1H20T0A3.0 size=1048576 2024-09-12T00:37:41.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.482+0000 7fcd44281780 1 < canceled part key=_multipart_ZQSZDU87GAMV.2~PCMC1H20T0A3.1 size=1048576 2024-09-12T00:37:41.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.483+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~PCMC1H20T0A3.2 size=76932 2024-09-12T00:37:41.485 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.486+0000 7fcd44281780 1 < canceled multipart upload key=ZQSZDU87GAMV upload=PCMC1H20T0A3 tag=QDGS0FLMQ6CD type=write size=3222660 2024-09-12T00:37:41.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.487+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=TRF3LJ07XPQ9 type=del size=1400418 2024-09-12T00:37:41.487 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.489+0000 7fcd44281780 -1 < failed to complete operation key=0AVE0W4OV1AU tag=CORBO2DJ5JTG type=del size=2330502: (22) Invalid argument 2024-09-12T00:37:41.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.491+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~008NX8CN1OYV.0 size=1048576 2024-09-12T00:37:41.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.492+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~008NX8CN1OYV.1 size=428140 2024-09-12T00:37:41.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.492+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=008NX8CN1OYV tag=WTJ92F7FMVXT type=write size=2525292 2024-09-12T00:37:41.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.494+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~BQI4EBUDW6L6.0 size=1048576 2024-09-12T00:37:41.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.495+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~BQI4EBUDW6L6.1 size=1048576 2024-09-12T00:37:41.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.496+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~BQI4EBUDW6L6.2 size=347521 2024-09-12T00:37:41.497 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.498+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=BQI4EBUDW6L6 tag=WJLLWTEQ87N8 type=write size=3493249 2024-09-12T00:37:41.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.500+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=RIMI3M3A0LVL type=del size=3498955 2024-09-12T00:37:41.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.502+0000 7fcd44281780 1 < suggested remove operation key=NIDHAXQF55WX tag=PYRCZ1VEDO4Z type=del 2024-09-12T00:37:41.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.504+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=5D3J3GEYH94Q type=del size=2969836 2024-09-12T00:37:41.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.507+0000 7fcd44281780 1 < suggested update operation key=0AVE0W4OV1AU tag=2E8YMS1EO3KR type=del size=1486196 2024-09-12T00:37:41.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.508+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=EFQVLBOAZO3G type=write size=60556 2024-09-12T00:37:41.510 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.511+0000 7fcd44281780 1 < suggested update operation key=IK8POOY7ZWNF tag=17PAZYPDQLLB type=del size=2586003 2024-09-12T00:37:41.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.512+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=F0LVUC60280U type=del size=4157519 2024-09-12T00:37:41.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.514+0000 7fcd44281780 1 < canceled operation key=G8O8VXTUPQVP tag=2XIX5E66TA7H type=del size=3325926 2024-09-12T00:37:41.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.517+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~2LLLGGGYNO1U.0 size=1048576 2024-09-12T00:37:41.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.518+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~2LLLGGGYNO1U.1 size=1048576 2024-09-12T00:37:41.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.519+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~2LLLGGGYNO1U.2 size=685204 2024-09-12T00:37:41.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.519+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=2LLLGGGYNO1U tag=55SNIYGU5F92 type=write size=3830932 2024-09-12T00:37:41.518 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.520+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=QIYY45OON4WX type=del 2024-09-12T00:37:41.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.521+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=6X4H8SMFD6EG type=del size=2097920 2024-09-12T00:37:41.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.522+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~FFEZVRAPDUIB.0 size=1048576 2024-09-12T00:37:41.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.524+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~FFEZVRAPDUIB.1 size=98376 2024-09-12T00:37:41.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.526+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=FFEZVRAPDUIB tag=3EEZVNAJQIE2 type=write size=2195528 2024-09-12T00:37:41.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.528+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=QRQR0DQNB38U type=del size=1358249 2024-09-12T00:37:41.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.529+0000 7fcd44281780 1 < canceled operation key=7UCICX0GHHQ1 tag=XMCD0ON6V36F type=del size=1794076 2024-09-12T00:37:41.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.532+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~CX37DQPZURYU.0 size=1048576 2024-09-12T00:37:41.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.533+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~CX37DQPZURYU.1 size=186810 2024-09-12T00:37:41.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.533+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=CX37DQPZURYU tag=Q5UIL1640Y6Y type=write size=2283962 2024-09-12T00:37:41.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.534+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~DGT8177WJX3I.0 size=1048576 2024-09-12T00:37:41.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.535+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~DGT8177WJX3I.1 size=780408 2024-09-12T00:37:41.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.538+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=DGT8177WJX3I tag=OFDDLWTC15KE type=write size=2877560 2024-09-12T00:37:41.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.541+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~GST3WXO1I2D2.0 size=1048576 2024-09-12T00:37:41.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.542+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~GST3WXO1I2D2.1 size=1048576 2024-09-12T00:37:41.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.543+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~GST3WXO1I2D2.2 size=116554 2024-09-12T00:37:41.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.543+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=GST3WXO1I2D2 tag=LE91OCZ4H73Y type=write size=3262282 2024-09-12T00:37:41.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.544+0000 7fcd44281780 1 < completed delete operation key=4RU6HTH4J0U1 tag=60UOA6GM38DH type=del 2024-09-12T00:37:41.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.546+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=8FC7YYRC3X9Y type=write size=599061 2024-09-12T00:37:41.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.547+0000 7fcd44281780 1 < completed write operation key=XTNXNF3D0HFK tag=ZFKPYL4F9FTN type=write size=269987 2024-09-12T00:37:41.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.549+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=N17W750DOP86 type=del size=2056912 2024-09-12T00:37:41.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.552+0000 7fcd44281780 1 < suggested update operation key=UXY6K0AVI4EK tag=ELTVWST6C8E1 type=del size=1900981 2024-09-12T00:37:41.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.553+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=E8ZJNAH9NXPA type=del size=1509764 2024-09-12T00:37:41.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.554+0000 7fcd44281780 1 < completed write operation key=KNBCXZF3JGNL tag=N1OM3WXL2R6I type=write size=833759 2024-09-12T00:37:41.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.556+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=K0VDKOW5FAJ4 type=del size=395923 2024-09-12T00:37:41.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.557+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~I1VKX93JCL0C.0 size=142722 2024-09-12T00:37:41.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.559+0000 7fcd44281780 1 < completed multipart upload key=4RU6HTH4J0U1 upload=I1VKX93JCL0C tag=VPLT2RJKOFZ8 type=write size=1191298 2024-09-12T00:37:41.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.561+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~JZRG3GMKJ5DQ.0 size=1048576 2024-09-12T00:37:41.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.563+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~JZRG3GMKJ5DQ.1 size=1048576 2024-09-12T00:37:41.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.564+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~JZRG3GMKJ5DQ.2 size=269435 2024-09-12T00:37:41.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.564+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=JZRG3GMKJ5DQ tag=6F733AGQ9MEB type=write size=3415163 2024-09-12T00:37:41.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.567+0000 7fcd44281780 1 < suggested update operation key=KJ0C43WLAFLI tag=TRF3LJ07XPQ9 type=del size=1400418 2024-09-12T00:37:41.567 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.568+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=10KYJJ5E27KD type=del size=2261460 2024-09-12T00:37:41.568 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.569+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~008NX8CN1OYV.0 size=1048576 2024-09-12T00:37:41.569 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.570+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~008NX8CN1OYV.1 size=428140 2024-09-12T00:37:41.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.573+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=008NX8CN1OYV tag=WTJ92F7FMVXT type=write size=2525292 2024-09-12T00:37:41.573 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.574+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=CIEYMDDT7VM2 type=write size=899213 2024-09-12T00:37:41.576 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.577+0000 7fcd44281780 1 < suggested update operation key=CF7B7J3V1YFG tag=RIMI3M3A0LVL type=del size=3498955 2024-09-12T00:37:41.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.578+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=LLJMKW0F027V type=del size=3829594 2024-09-12T00:37:41.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.580+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=5D3J3GEYH94Q type=del 2024-09-12T00:37:41.580 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.581+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=K3GRZ7QPRA6M type=del size=3723162 2024-09-12T00:37:41.581 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.583+0000 7fcd44281780 1 < completed write operation key=8U004LC8IYLQ tag=EFQVLBOAZO3G type=write size=60556 2024-09-12T00:37:41.583 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.584+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=MXAGQ3XOP1RJ type=del size=2292493 2024-09-12T00:37:41.584 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.585+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=F0LVUC60280U type=del 2024-09-12T00:37:41.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.587+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=OLT19BNX2OQR type=del size=405753 2024-09-12T00:37:41.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.589+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~2LLLGGGYNO1U.0 size=1048576 2024-09-12T00:37:41.589 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.590+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~2LLLGGGYNO1U.1 size=1048576 2024-09-12T00:37:41.590 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.591+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~2LLLGGGYNO1U.2 size=685204 2024-09-12T00:37:41.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.593+0000 7fcd44281780 1 < completed multipart upload key=UWS056JN3IXO upload=2LLLGGGYNO1U tag=55SNIYGU5F92 type=write size=3830932 2024-09-12T00:37:41.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.594+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=DFE014UJTJG8 type=del size=471452 2024-09-12T00:37:41.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.596+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=6X4H8SMFD6EG type=del 2024-09-12T00:37:41.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.597+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=W9HG52GHAWB3 type=write size=480289 2024-09-12T00:37:41.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.599+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=QRQR0DQNB38U type=del 2024-09-12T00:37:41.599 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.600+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=HX0RETRDKLIG type=del size=3494559 2024-09-12T00:37:41.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.601+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~CX37DQPZURYU.0 size=1048576 2024-09-12T00:37:41.601 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.602+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~CX37DQPZURYU.1 size=186810 2024-09-12T00:37:41.603 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.605+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=CX37DQPZURYU tag=Q5UIL1640Y6Y type=write size=2283962 2024-09-12T00:37:41.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.606+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=503E6A07F36S type=del size=560260 2024-09-12T00:37:41.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.608+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~GST3WXO1I2D2.0 size=1048576 2024-09-12T00:37:41.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.609+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~GST3WXO1I2D2.1 size=1048576 2024-09-12T00:37:41.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.610+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~GST3WXO1I2D2.2 size=116554 2024-09-12T00:37:41.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.613+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=GST3WXO1I2D2 tag=LE91OCZ4H73Y type=write size=3262282 2024-09-12T00:37:41.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.615+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~F3OTB67J6W81.0 size=1048576 2024-09-12T00:37:41.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.616+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~F3OTB67J6W81.1 size=787568 2024-09-12T00:37:41.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.616+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=F3OTB67J6W81 tag=E5MA4VESMZJ2 type=write size=2884720 2024-09-12T00:37:41.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.617+0000 7fcd44281780 1 < completed write operation key=IK8POOY7ZWNF tag=8FC7YYRC3X9Y type=write size=599061 2024-09-12T00:37:41.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.628+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~QJ3WAVSQSKW8.0 size=34949 2024-09-12T00:37:41.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.628+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=QJ3WAVSQSKW8 tag=7BWFBYMXSCDW type=write size=1083525 2024-09-12T00:37:41.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.629+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=N17W750DOP86 type=del 2024-09-12T00:37:41.630 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.631+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~MKPCB1SYVB1Y.0 size=1048576 2024-09-12T00:37:41.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.632+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~MKPCB1SYVB1Y.1 size=1048576 2024-09-12T00:37:41.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.634+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~MKPCB1SYVB1Y.2 size=86304 2024-09-12T00:37:41.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.634+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=MKPCB1SYVB1Y tag=7SMJG4OXHLIJ type=write size=3232032 2024-09-12T00:37:41.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.635+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=E8ZJNAH9NXPA type=del 2024-09-12T00:37:41.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.638+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~Y78E7X8ZJY0S.0 size=1048576 2024-09-12T00:37:41.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.639+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~Y78E7X8ZJY0S.1 size=1048576 2024-09-12T00:37:41.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.640+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~Y78E7X8ZJY0S.2 size=799979 2024-09-12T00:37:41.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.640+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=Y78E7X8ZJY0S tag=L0NR2AV93C83 type=write size=3945707 2024-09-12T00:37:41.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.641+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=K0VDKOW5FAJ4 type=del 2024-09-12T00:37:41.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.644+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=Z93IDBJ4HDKC type=del size=3700350 2024-09-12T00:37:41.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.646+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~JZRG3GMKJ5DQ.0 size=1048576 2024-09-12T00:37:41.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.648+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~JZRG3GMKJ5DQ.1 size=1048576 2024-09-12T00:37:41.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.649+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~JZRG3GMKJ5DQ.2 size=269435 2024-09-12T00:37:41.650 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.651+0000 7fcd44281780 1 < completed multipart upload key=UWS056JN3IXO upload=JZRG3GMKJ5DQ tag=6F733AGQ9MEB type=write size=3415163 2024-09-12T00:37:41.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.652+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=TWPXJC4G4PAC type=del size=1106439 2024-09-12T00:37:41.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.654+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=10KYJJ5E27KD type=del 2024-09-12T00:37:41.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.657+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~0OAD7CQJ21O8.0 size=1048576 2024-09-12T00:37:41.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.658+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~0OAD7CQJ21O8.1 size=580488 2024-09-12T00:37:41.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.658+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=0OAD7CQJ21O8 tag=N4PWYMJL3CVF type=write size=2677640 2024-09-12T00:37:41.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.659+0000 7fcd44281780 1 < completed write operation key=Z6I6598B6J5I tag=CIEYMDDT7VM2 type=write size=899213 2024-09-12T00:37:41.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.661+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=KIBH1YD2DS48 type=del size=3715304 2024-09-12T00:37:41.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.663+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=LLJMKW0F027V type=del 2024-09-12T00:37:41.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.665+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~1O7TPL0PCGEF.0 size=1048576 2024-09-12T00:37:41.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.667+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~1O7TPL0PCGEF.1 size=214555 2024-09-12T00:37:41.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.667+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=1O7TPL0PCGEF tag=YWXA06I8X77L type=write size=2311707 2024-09-12T00:37:41.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.670+0000 7fcd44281780 1 < suggested update operation key=ZQSZDU87GAMV tag=K3GRZ7QPRA6M type=del size=3723162 2024-09-12T00:37:41.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.672+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~L0498C6WMI1I.0 size=1022725 2024-09-12T00:37:41.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.672+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=L0498C6WMI1I tag=4W8J5NB1FGUQ type=write size=2071301 2024-09-12T00:37:41.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.674+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=MXAGQ3XOP1RJ type=del 2024-09-12T00:37:41.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.675+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=F59B3JWBC3GT type=del size=874084 2024-09-12T00:37:41.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.676+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=OLT19BNX2OQR type=del 2024-09-12T00:37:41.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.678+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=A2UZ43EX2BXE type=del size=648040 2024-09-12T00:37:41.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.679+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=DFE014UJTJG8 type=del 2024-09-12T00:37:41.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.681+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=1DG34FUNN94B type=del size=564337 2024-09-12T00:37:41.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.682+0000 7fcd44281780 1 < completed write operation key=AJ5AUTM2J9MT tag=W9HG52GHAWB3 type=write size=480289 2024-09-12T00:37:41.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.683+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=O03KU42XUGEH type=write size=791425 2024-09-12T00:37:41.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.686+0000 7fcd44281780 1 < suggested update operation key=UXY6K0AVI4EK tag=HX0RETRDKLIG type=del size=3494559 2024-09-12T00:37:41.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.687+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=K6SRN8VSW9Y4 type=del size=2778116 2024-09-12T00:37:41.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.689+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=503E6A07F36S type=del 2024-09-12T00:37:41.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.691+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~PJK0CMRENKHZ.0 size=818816 2024-09-12T00:37:41.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.691+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=PJK0CMRENKHZ tag=EZ2VKA0TAPUV type=write size=1867392 2024-09-12T00:37:41.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.693+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~F3OTB67J6W81.0 size=1048576 2024-09-12T00:37:41.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.694+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~F3OTB67J6W81.1 size=787568 2024-09-12T00:37:41.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.696+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=F3OTB67J6W81 tag=E5MA4VESMZJ2 type=write size=2884720 2024-09-12T00:37:41.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.697+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=40KZ908BL87L type=del size=4054744 2024-09-12T00:37:41.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.698+0000 7fcd44281780 1 < canceled part key=_multipart_QVULC3H9QGXE.2~QJ3WAVSQSKW8.0 size=34949 2024-09-12T00:37:41.699 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.700+0000 7fcd44281780 1 < canceled multipart upload key=QVULC3H9QGXE upload=QJ3WAVSQSKW8 tag=7BWFBYMXSCDW type=write size=1083525 2024-09-12T00:37:41.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.702+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=VIITAD4DCGVG type=del size=1601711 2024-09-12T00:37:41.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.703+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~MKPCB1SYVB1Y.0 size=1048576 2024-09-12T00:37:41.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.703+0000 7fcd44281780 1 < canceled part key=_multipart_KJ0C43WLAFLI.2~MKPCB1SYVB1Y.1 size=1048576 2024-09-12T00:37:41.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.704+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~MKPCB1SYVB1Y.2 size=86304 2024-09-12T00:37:41.707 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.708+0000 7fcd44281780 1 < canceled multipart upload key=KJ0C43WLAFLI upload=MKPCB1SYVB1Y tag=7SMJG4OXHLIJ type=write size=3232032 2024-09-12T00:37:41.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.710+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=PVC430GT2IID type=del size=3837164 2024-09-12T00:37:41.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.711+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~Y78E7X8ZJY0S.0 size=1048576 2024-09-12T00:37:41.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.712+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~Y78E7X8ZJY0S.1 size=1048576 2024-09-12T00:37:41.712 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.713+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~Y78E7X8ZJY0S.2 size=799979 2024-09-12T00:37:41.714 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.716+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=Y78E7X8ZJY0S tag=L0NR2AV93C83 type=write size=3945707 2024-09-12T00:37:41.716 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.717+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=ESMX9X7XEOPO type=del size=2870287 2024-09-12T00:37:41.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.719+0000 7fcd44281780 1 < canceled operation key=RYSE2CKE5IRT tag=Z93IDBJ4HDKC type=del size=3700350 2024-09-12T00:37:41.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.720+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=YNMIIB7POD9H type=del size=1708631 2024-09-12T00:37:41.722 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.723+0000 7fcd44281780 1 < suggested remove operation key=0ELZXPZCRPGP tag=TWPXJC4G4PAC type=del 2024-09-12T00:37:41.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.725+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=YBMBNMKQHLK3 type=del size=350397 2024-09-12T00:37:41.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.726+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~0OAD7CQJ21O8.0 size=1048576 2024-09-12T00:37:41.726 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.727+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~0OAD7CQJ21O8.1 size=580488 2024-09-12T00:37:41.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.730+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=0OAD7CQJ21O8 tag=N4PWYMJL3CVF type=write size=2677640 2024-09-12T00:37:41.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.733+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~HZQQ11GXMJZU.0 size=1048576 2024-09-12T00:37:41.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.736+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~HZQQ11GXMJZU.1 size=172536 2024-09-12T00:37:41.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.736+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=HZQQ11GXMJZU tag=YBOE9O184Q0T type=write size=2269688 2024-09-12T00:37:41.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.739+0000 7fcd44281780 1 < suggested update operation key=WXBMIJ4FC0VX tag=KIBH1YD2DS48 type=del size=3715304 2024-09-12T00:37:41.740 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.741+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=SENQCL8PYMNA type=del size=2955839 2024-09-12T00:37:41.741 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.742+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~1O7TPL0PCGEF.0 size=1048576 2024-09-12T00:37:41.742 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.743+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~1O7TPL0PCGEF.1 size=214555 2024-09-12T00:37:41.745 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.746+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=1O7TPL0PCGEF tag=YWXA06I8X77L type=write size=2311707 2024-09-12T00:37:41.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.747+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=R4UD9WKOMP0C type=del size=4151647 2024-09-12T00:37:41.747 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.749+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~L0498C6WMI1I.0 size=1022725 2024-09-12T00:37:41.749 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.751+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=L0498C6WMI1I tag=4W8J5NB1FGUQ type=write size=2071301 2024-09-12T00:37:41.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.752+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=WDPDJ583PF99 type=del size=330182 2024-09-12T00:37:41.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.753+0000 7fcd44281780 -1 < failed to complete operation key=UXY6K0AVI4EK tag=F59B3JWBC3GT type=del size=874084: (22) Invalid argument 2024-09-12T00:37:41.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.756+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~FYAJTP4ZVACH.0 size=1048576 2024-09-12T00:37:41.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.757+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~FYAJTP4ZVACH.1 size=764650 2024-09-12T00:37:41.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.757+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=FYAJTP4ZVACH tag=UMLZ31EK8J2Q type=write size=2861802 2024-09-12T00:37:41.758 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.760+0000 7fcd44281780 1 < suggested update operation key=VOO70F2NBKL0 tag=A2UZ43EX2BXE type=del size=648040 2024-09-12T00:37:41.760 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.761+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=4HIAFMJ2X0LH type=write size=90449 2024-09-12T00:37:41.762 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.763+0000 7fcd44281780 -1 < failed to complete operation key=UXY6K0AVI4EK tag=1DG34FUNN94B type=del size=564337: (22) Invalid argument 2024-09-12T00:37:41.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.765+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=ENZNOFDYU4M2 type=del size=3146385 2024-09-12T00:37:41.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.767+0000 7fcd44281780 1 < suggested remove operation key=RYSE2CKE5IRT tag=O03KU42XUGEH type=write 2024-09-12T00:37:41.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.769+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=LZ5M23T9OAPN type=del size=1365905 2024-09-12T00:37:41.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.770+0000 7fcd44281780 1 < completed delete operation key=XTNXNF3D0HFK tag=K6SRN8VSW9Y4 type=del 2024-09-12T00:37:41.770 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.771+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=R0FVP8GHPDXB type=del size=1874577 2024-09-12T00:37:41.771 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.773+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~PJK0CMRENKHZ.0 size=818816 2024-09-12T00:37:41.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.775+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=PJK0CMRENKHZ tag=EZ2VKA0TAPUV type=write size=1867392 2024-09-12T00:37:41.775 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.776+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=VAFVO6QN3R5Z type=del size=198314 2024-09-12T00:37:41.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.779+0000 7fcd44281780 1 < suggested update operation key=G8O8VXTUPQVP tag=40KZ908BL87L type=del size=4054744 2024-09-12T00:37:41.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.781+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=WXDAZQBUGD6V type=write size=858628 2024-09-12T00:37:41.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.782+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=VIITAD4DCGVG type=del 2024-09-12T00:37:41.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.783+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=VNBIO7PO26XC type=del size=338460 2024-09-12T00:37:41.784 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.785+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=PVC430GT2IID type=del 2024-09-12T00:37:41.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.788+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~TLBW5D0SKE3C.0 size=856687 2024-09-12T00:37:41.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.788+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=TLBW5D0SKE3C tag=V98VG8GOBI71 type=write size=1905263 2024-09-12T00:37:41.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.789+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=ESMX9X7XEOPO type=del 2024-09-12T00:37:41.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.790+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=6W1WMS9DYB1V type=del size=2825371 2024-09-12T00:37:41.790 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.792+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=YNMIIB7POD9H type=del 2024-09-12T00:37:41.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.793+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=XKYZRUXGRI02 type=del size=3662279 2024-09-12T00:37:41.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.794+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=YBMBNMKQHLK3 type=del 2024-09-12T00:37:41.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.796+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=CGM0RKY8DINF type=write size=870477 2024-09-12T00:37:41.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.797+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~HZQQ11GXMJZU.0 size=1048576 2024-09-12T00:37:41.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.798+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~HZQQ11GXMJZU.1 size=172536 2024-09-12T00:37:41.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.801+0000 7fcd44281780 1 < completed multipart upload key=B5OH55MQGSGJ upload=HZQQ11GXMJZU tag=YBOE9O184Q0T type=write size=2269688 2024-09-12T00:37:41.802 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.803+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~CX5M2P1QC22A.0 size=1048576 2024-09-12T00:37:41.803 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.804+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~CX5M2P1QC22A.1 size=224919 2024-09-12T00:37:41.803 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.804+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=CX5M2P1QC22A tag=B63RMGTBXH04 type=write size=2322071 2024-09-12T00:37:41.804 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.806+0000 7fcd44281780 -1 < failed to complete operation key=VOO70F2NBKL0 tag=SENQCL8PYMNA type=del size=2955839: (22) Invalid argument 2024-09-12T00:37:41.806 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.807+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=T292QSQFPCHD type=write size=558466 2024-09-12T00:37:41.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.808+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=R4UD9WKOMP0C type=del 2024-09-12T00:37:41.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.810+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=NJP1Q9WX5G0P type=del size=292750 2024-09-12T00:37:41.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.811+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=WDPDJ583PF99 type=del 2024-09-12T00:37:41.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.814+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~KM2RRK75B3XA.0 size=1048576 2024-09-12T00:37:41.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.814+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~KM2RRK75B3XA.1 size=1017995 2024-09-12T00:37:41.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.814+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=KM2RRK75B3XA tag=C8G237164M29 type=write size=3115147 2024-09-12T00:37:41.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.816+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~FYAJTP4ZVACH.0 size=1048576 2024-09-12T00:37:41.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.817+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~FYAJTP4ZVACH.1 size=764650 2024-09-12T00:37:41.820 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.819+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=FYAJTP4ZVACH tag=UMLZ31EK8J2Q type=write size=2861802 2024-09-12T00:37:41.820 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.820+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=JOW66IWWLRYV type=del size=1701536 2024-09-12T00:37:41.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.822+0000 7fcd44281780 1 < completed write operation key=4RU6HTH4J0U1 tag=4HIAFMJ2X0LH type=write size=90449 2024-09-12T00:37:41.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.823+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=TOS0SJOUA6T1 type=del size=1796350 2024-09-12T00:37:41.823 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.825+0000 7fcd44281780 -1 < failed to complete operation key=RYSE2CKE5IRT tag=ENZNOFDYU4M2 type=del size=3146385: (22) Invalid argument 2024-09-12T00:37:41.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.827+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~XRTIIIIVW4AY.0 size=861853 2024-09-12T00:37:41.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.827+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=XRTIIIIVW4AY tag=W7W10LPFP6KJ type=write size=1910429 2024-09-12T00:37:41.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.828+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=LZ5M23T9OAPN type=del 2024-09-12T00:37:41.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.830+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=RFS9M94EMNOE type=del size=1636449 2024-09-12T00:37:41.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.831+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=R0FVP8GHPDXB type=del 2024-09-12T00:37:41.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.832+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=4G0GKSFD5RBD type=del size=3180590 2024-09-12T00:37:41.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.833+0000 7fcd44281780 1 < canceled operation key=DKJ44Z9COIIK tag=VAFVO6QN3R5Z type=del size=198314 2024-09-12T00:37:41.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.835+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=0NK5UEJ1KR0I type=del size=2538425 2024-09-12T00:37:41.836 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.838+0000 7fcd44281780 1 < completed write operation key=CF7B7J3V1YFG tag=WXDAZQBUGD6V type=write size=858628 2024-09-12T00:37:41.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.839+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=ZLG10G7SY5KC type=del size=914440 2024-09-12T00:37:41.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.840+0000 7fcd44281780 1 < canceled operation key=NIDHAXQF55WX tag=VNBIO7PO26XC type=del size=338460 2024-09-12T00:37:41.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.842+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=EOA6E6C20609 type=del size=384786 2024-09-12T00:37:41.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.843+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~TLBW5D0SKE3C.0 size=856687 2024-09-12T00:37:41.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.845+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=TLBW5D0SKE3C tag=V98VG8GOBI71 type=write size=1905263 2024-09-12T00:37:41.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.846+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=YM29DE28034Q type=del size=1656909 2024-09-12T00:37:41.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.848+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=6W1WMS9DYB1V type=del 2024-09-12T00:37:41.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.849+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=LDUZPAUKC7Q5 type=del size=2393593 2024-09-12T00:37:41.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.850+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=XKYZRUXGRI02 type=del 2024-09-12T00:37:41.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.853+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~SZU4C71OPNPZ.0 size=1048576 2024-09-12T00:37:41.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.854+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~SZU4C71OPNPZ.1 size=665131 2024-09-12T00:37:41.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.854+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=SZU4C71OPNPZ tag=TXY6OJIBL398 type=write size=2762283 2024-09-12T00:37:41.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.856+0000 7fcd44281780 1 < suggested update operation key=Z6I6598B6J5I tag=CGM0RKY8DINF type=write size=870477 2024-09-12T00:37:41.857 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.858+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=YXHHSCU0UYAT type=del size=1303308 2024-09-12T00:37:41.858 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.859+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~CX5M2P1QC22A.0 size=1048576 2024-09-12T00:37:41.859 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.861+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~CX5M2P1QC22A.1 size=224919 2024-09-12T00:37:41.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.863+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=CX5M2P1QC22A tag=B63RMGTBXH04 type=write size=2322071 2024-09-12T00:37:41.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.866+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~FGWC64FH4GG0.0 size=1048576 2024-09-12T00:37:41.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.867+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~FGWC64FH4GG0.1 size=983471 2024-09-12T00:37:41.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.867+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=FGWC64FH4GG0 tag=W5CZ13FBI2QJ type=write size=3080623 2024-09-12T00:37:41.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.870+0000 7fcd44281780 1 < suggested remove operation key=8U004LC8IYLQ tag=T292QSQFPCHD type=write 2024-09-12T00:37:41.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.872+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=AE1KD0R9JNJB type=del size=2614790 2024-09-12T00:37:41.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.874+0000 7fcd44281780 1 < suggested remove operation key=UWS056JN3IXO tag=NJP1Q9WX5G0P type=del 2024-09-12T00:37:41.874 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.875+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=YNSHWCU30FW9 type=del size=3280032 2024-09-12T00:37:41.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.877+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~KM2RRK75B3XA.0 size=1048576 2024-09-12T00:37:41.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.878+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~KM2RRK75B3XA.1 size=1017995 2024-09-12T00:37:41.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.880+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=KM2RRK75B3XA tag=C8G237164M29 type=write size=3115147 2024-09-12T00:37:41.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.883+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~RK5MYQ6TC2QU.0 size=850929 2024-09-12T00:37:41.882 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.883+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=RK5MYQ6TC2QU tag=T2U75737100F type=write size=1899505 2024-09-12T00:37:41.883 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.884+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=JOW66IWWLRYV type=del 2024-09-12T00:37:41.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.886+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~HGORT63VDBZ2.0 size=429021 2024-09-12T00:37:41.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.886+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=HGORT63VDBZ2 tag=SQXYNM2QGI1K type=write size=1477597 2024-09-12T00:37:41.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.888+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=TOS0SJOUA6T1 type=del 2024-09-12T00:37:41.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.889+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=H0R6Q9G4HJTJ type=write size=169149 2024-09-12T00:37:41.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.891+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~XRTIIIIVW4AY.0 size=861853 2024-09-12T00:37:41.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.893+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=XRTIIIIVW4AY tag=W7W10LPFP6KJ type=write size=1910429 2024-09-12T00:37:41.893 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.894+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=URQ0MY0S53NQ type=write size=706063 2024-09-12T00:37:41.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.896+0000 7fcd44281780 1 < completed delete operation key=4RU6HTH4J0U1 tag=RFS9M94EMNOE type=del 2024-09-12T00:37:41.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.897+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=WN8L0V4MO7RP type=del size=1630657 2024-09-12T00:37:41.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.898+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=4G0GKSFD5RBD type=del 2024-09-12T00:37:41.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.900+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=18DT9IIKYSAK type=write size=217184 2024-09-12T00:37:41.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.901+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=0NK5UEJ1KR0I type=del 2024-09-12T00:37:41.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.903+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=O12MKLXXDLPY type=del size=2675043 2024-09-12T00:37:41.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.905+0000 7fcd44281780 1 < suggested remove operation key=IK8POOY7ZWNF tag=ZLG10G7SY5KC type=del 2024-09-12T00:37:41.906 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.907+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=ORXSOJ9AY629 type=write size=35067 2024-09-12T00:37:41.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.909+0000 7fcd44281780 1 < suggested remove operation key=UXY6K0AVI4EK tag=EOA6E6C20609 type=del 2024-09-12T00:37:41.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.911+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=KHKZYQ2ZD1F2 type=write size=347763 2024-09-12T00:37:41.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.912+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=YM29DE28034Q type=del 2024-09-12T00:37:41.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.914+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=T9I0YZVOK0HC type=del size=3758776 2024-09-12T00:37:41.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.915+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=LDUZPAUKC7Q5 type=del 2024-09-12T00:37:41.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.917+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=2ESHZ92D7OOO type=del size=612388 2024-09-12T00:37:41.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.918+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~SZU4C71OPNPZ.0 size=1048576 2024-09-12T00:37:41.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.919+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~SZU4C71OPNPZ.1 size=665131 2024-09-12T00:37:41.920 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.921+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=SZU4C71OPNPZ tag=TXY6OJIBL398 type=write size=2762283 2024-09-12T00:37:41.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.924+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~021ALF3Z8G8Z.0 size=1048576 2024-09-12T00:37:41.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.925+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~021ALF3Z8G8Z.1 size=1048576 2024-09-12T00:37:41.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.926+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~021ALF3Z8G8Z.2 size=981186 2024-09-12T00:37:41.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.926+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=021ALF3Z8G8Z tag=PUBSTTTJSQM7 type=write size=4126914 2024-09-12T00:37:41.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.928+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=YXHHSCU0UYAT type=del 2024-09-12T00:37:41.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.929+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=HZK6X749Q2ZS type=del size=3928251 2024-09-12T00:37:41.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.930+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~FGWC64FH4GG0.0 size=1048576 2024-09-12T00:37:41.930 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.931+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~FGWC64FH4GG0.1 size=983471 2024-09-12T00:37:41.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.934+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=FGWC64FH4GG0 tag=W5CZ13FBI2QJ type=write size=3080623 2024-09-12T00:37:41.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.936+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~C8XL1B29BOJ5.0 size=1048576 2024-09-12T00:37:41.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.937+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~C8XL1B29BOJ5.1 size=1048576 2024-09-12T00:37:41.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.938+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~C8XL1B29BOJ5.2 size=138912 2024-09-12T00:37:41.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.938+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=C8XL1B29BOJ5 tag=MNIAAARAK8CC type=write size=3284640 2024-09-12T00:37:41.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.941+0000 7fcd44281780 1 < suggested update operation key=U4EPPPA4QGGD tag=AE1KD0R9JNJB type=del size=2614790 2024-09-12T00:37:41.943 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.945+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~GXPAU2B4N3UW.0 size=1048576 2024-09-12T00:37:41.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.946+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~GXPAU2B4N3UW.1 size=1048576 2024-09-12T00:37:41.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.947+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~GXPAU2B4N3UW.2 size=196108 2024-09-12T00:37:41.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.947+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=GXPAU2B4N3UW tag=Z2HEK6EA07DY type=write size=3341836 2024-09-12T00:37:41.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.948+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=YNSHWCU30FW9 type=del 2024-09-12T00:37:41.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.950+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=3SEJSVA6T202 type=del size=3938397 2024-09-12T00:37:41.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.952+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~RK5MYQ6TC2QU.0 size=850929 2024-09-12T00:37:41.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.954+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=RK5MYQ6TC2QU tag=T2U75737100F type=write size=1899505 2024-09-12T00:37:41.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.955+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=XGWM1B21XLKG type=write size=906642 2024-09-12T00:37:41.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.956+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~HGORT63VDBZ2.0 size=429021 2024-09-12T00:37:41.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.958+0000 7fcd44281780 1 < completed multipart upload key=0AVE0W4OV1AU upload=HGORT63VDBZ2 tag=SQXYNM2QGI1K type=write size=1477597 2024-09-12T00:37:41.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.961+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~K2JHSFJYUV3R.0 size=1048576 2024-09-12T00:37:41.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.962+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~K2JHSFJYUV3R.1 size=526489 2024-09-12T00:37:41.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.962+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=K2JHSFJYUV3R tag=REMG955ZY4IX type=write size=2623641 2024-09-12T00:37:41.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.964+0000 7fcd44281780 1 < completed write operation key=ZQSZDU87GAMV tag=H0R6Q9G4HJTJ type=write size=169149 2024-09-12T00:37:41.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.967+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~LKXU3C7M5V89.0 size=957602 2024-09-12T00:37:41.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.967+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=LKXU3C7M5V89 tag=IP12D12DQ0GS type=write size=2006178 2024-09-12T00:37:41.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.970+0000 7fcd44281780 1 < suggested remove operation key=VXDTFEG8P23H tag=URQ0MY0S53NQ type=write 2024-09-12T00:37:41.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.973+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~BRRGEQRFYJO5.0 size=1048576 2024-09-12T00:37:41.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.973+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~BRRGEQRFYJO5.1 size=1048576 2024-09-12T00:37:41.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.975+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~BRRGEQRFYJO5.2 size=451368 2024-09-12T00:37:41.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.975+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=BRRGEQRFYJO5 tag=CP8UE08TH6KL type=write size=3597096 2024-09-12T00:37:41.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.976+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=WN8L0V4MO7RP type=del 2024-09-12T00:37:41.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.977+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=CTKAGDB4ROEA type=del size=1937202 2024-09-12T00:37:41.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.979+0000 7fcd44281780 1 < completed write operation key=RYSE2CKE5IRT tag=18DT9IIKYSAK type=write size=217184 2024-09-12T00:37:41.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.981+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~8IYQQX689PJP.0 size=1048576 2024-09-12T00:37:41.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.982+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~8IYQQX689PJP.1 size=156458 2024-09-12T00:37:41.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.982+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=8IYQQX689PJP tag=MDPZCRCRXG5B type=write size=2253610 2024-09-12T00:37:41.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.984+0000 7fcd44281780 -1 < failed to complete operation key=VXDTFEG8P23H tag=O12MKLXXDLPY type=del size=2675043: (22) Invalid argument 2024-09-12T00:37:41.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.986+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~XUXYC76YJNVZ.0 size=33501 2024-09-12T00:37:41.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.986+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=XUXYC76YJNVZ tag=H6BKXYF0FM2P type=write size=1082077 2024-09-12T00:37:41.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.988+0000 7fcd44281780 1 < completed write operation key=IK8POOY7ZWNF tag=ORXSOJ9AY629 type=write size=35067 2024-09-12T00:37:41.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.989+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=9T238U2DDCVS type=del size=2284473 2024-09-12T00:37:41.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.992+0000 7fcd44281780 1 < suggested remove operation key=8U004LC8IYLQ tag=KHKZYQ2ZD1F2 type=write 2024-09-12T00:37:41.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.993+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=KB1XI1YMLEGZ type=del size=3944593 2024-09-12T00:37:41.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.995+0000 7fcd44281780 1 < completed delete operation key=4RU6HTH4J0U1 tag=T9I0YZVOK0HC type=del 2024-09-12T00:37:41.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.996+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=I5QI0A3JS8GZ type=del size=380039 2024-09-12T00:37:41.998 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:41.999+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=2ESHZ92D7OOO type=del 2024-09-12T00:37:42.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.002+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~0L29M3NF7HH1.0 size=1048576 2024-09-12T00:37:42.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.003+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~0L29M3NF7HH1.1 size=61078 2024-09-12T00:37:42.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.003+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=0L29M3NF7HH1 tag=B2978M91VPOF type=write size=2158230 2024-09-12T00:37:42.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.004+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~021ALF3Z8G8Z.0 size=1048576 2024-09-12T00:37:42.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.005+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~021ALF3Z8G8Z.1 size=1048576 2024-09-12T00:37:42.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.006+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~021ALF3Z8G8Z.2 size=981186 2024-09-12T00:37:42.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.009+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=021ALF3Z8G8Z tag=PUBSTTTJSQM7 type=write size=4126914 2024-09-12T00:37:42.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.011+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~4EGVISCNL5Q9.0 size=1048576 2024-09-12T00:37:42.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.012+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~4EGVISCNL5Q9.1 size=630492 2024-09-12T00:37:42.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.012+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=4EGVISCNL5Q9 tag=OH02BH5T46ZO type=write size=2727644 2024-09-12T00:37:42.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.014+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=HZK6X749Q2ZS type=del 2024-09-12T00:37:42.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.015+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=PDO3VRQXI2YF type=del size=3556564 2024-09-12T00:37:42.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.017+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~C8XL1B29BOJ5.0 size=1048576 2024-09-12T00:37:42.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.017+0000 7fcd44281780 1 < canceled part key=_multipart_0AVE0W4OV1AU.2~C8XL1B29BOJ5.1 size=1048576 2024-09-12T00:37:42.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.018+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~C8XL1B29BOJ5.2 size=138912 2024-09-12T00:37:42.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.020+0000 7fcd44281780 1 < canceled multipart upload key=0AVE0W4OV1AU upload=C8XL1B29BOJ5 tag=MNIAAARAK8CC type=write size=3284640 2024-09-12T00:37:42.020 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.022+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=69G63S6DZ635 type=del size=4022352 2024-09-12T00:37:42.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.023+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~GXPAU2B4N3UW.0 size=1048576 2024-09-12T00:37:42.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.024+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~GXPAU2B4N3UW.1 size=1048576 2024-09-12T00:37:42.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.025+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~GXPAU2B4N3UW.2 size=196108 2024-09-12T00:37:42.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.028+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=GXPAU2B4N3UW tag=Z2HEK6EA07DY type=write size=3341836 2024-09-12T00:37:42.029 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.030+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~RZYV6HR4DP7P.0 size=1048576 2024-09-12T00:37:42.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.031+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~RZYV6HR4DP7P.1 size=595366 2024-09-12T00:37:42.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.031+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=RZYV6HR4DP7P tag=G9G679N1AJD1 type=write size=2692518 2024-09-12T00:37:42.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.032+0000 7fcd44281780 -1 < no bi entry to suggest for operation key=VXDTFEG8P23H tag=3SEJSVA6T202 type=del size=3938397: (2) No such file or directory 2024-09-12T00:37:42.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.033+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=T27ZPJU3SR7B type=del size=417948 2024-09-12T00:37:42.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.035+0000 7fcd44281780 1 < completed write operation key=AJ5AUTM2J9MT tag=XGWM1B21XLKG type=write size=906642 2024-09-12T00:37:42.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.037+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~5EYFWGWYVFE3.0 size=1048576 2024-09-12T00:37:42.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.039+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~5EYFWGWYVFE3.1 size=1048576 2024-09-12T00:37:42.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.040+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~5EYFWGWYVFE3.2 size=748869 2024-09-12T00:37:42.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.040+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=5EYFWGWYVFE3 tag=9CF7SK691OBX type=write size=3894597 2024-09-12T00:37:42.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.041+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~K2JHSFJYUV3R.0 size=1048576 2024-09-12T00:37:42.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.041+0000 7fcd44281780 1 < canceled part key=_multipart_0OEDZ5O2LN8H.2~K2JHSFJYUV3R.1 size=526489 2024-09-12T00:37:42.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.044+0000 7fcd44281780 1 < canceled multipart upload key=0OEDZ5O2LN8H upload=K2JHSFJYUV3R tag=REMG955ZY4IX type=write size=2623641 2024-09-12T00:37:42.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.046+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=ZSU8DS6L6S53 type=del size=378742 2024-09-12T00:37:42.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.047+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~LKXU3C7M5V89.0 size=957602 2024-09-12T00:37:42.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.049+0000 7fcd44281780 1 < completed multipart upload key=526O814C10YW upload=LKXU3C7M5V89 tag=IP12D12DQ0GS type=write size=2006178 2024-09-12T00:37:42.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.051+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=LRWCXTS7JG4Q type=write size=548656 2024-09-12T00:37:42.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.053+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~BRRGEQRFYJO5.0 size=1048576 2024-09-12T00:37:42.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.053+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~BRRGEQRFYJO5.1 size=1048576 2024-09-12T00:37:42.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.055+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~BRRGEQRFYJO5.2 size=451368 2024-09-12T00:37:42.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.057+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=BRRGEQRFYJO5 tag=CP8UE08TH6KL type=write size=3597096 2024-09-12T00:37:42.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.058+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=P4VZFSTSHGKS type=del size=779488 2024-09-12T00:37:42.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.060+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=CTKAGDB4ROEA type=del 2024-09-12T00:37:42.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.061+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=DMVF0W15W44K type=del size=3161219 2024-09-12T00:37:42.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.063+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~8IYQQX689PJP.0 size=1048576 2024-09-12T00:37:42.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.063+0000 7fcd44281780 1 < canceled part key=_multipart_4RU6HTH4J0U1.2~8IYQQX689PJP.1 size=156458 2024-09-12T00:37:42.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.065+0000 7fcd44281780 1 < canceled multipart upload key=4RU6HTH4J0U1 upload=8IYQQX689PJP tag=MDPZCRCRXG5B type=write size=2253610 2024-09-12T00:37:42.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.068+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~OPTUCTPUB29O.0 size=1048576 2024-09-12T00:37:42.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.069+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~OPTUCTPUB29O.1 size=527017 2024-09-12T00:37:42.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.069+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=OPTUCTPUB29O tag=NPMDNRSAT1O2 type=write size=2624169 2024-09-12T00:37:42.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.070+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~XUXYC76YJNVZ.0 size=33501 2024-09-12T00:37:42.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.072+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=XUXYC76YJNVZ tag=H6BKXYF0FM2P type=write size=1082077 2024-09-12T00:37:42.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.074+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=UMK0GT7WI7P5 type=del size=3114698 2024-09-12T00:37:42.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.075+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=9T238U2DDCVS type=del 2024-09-12T00:37:42.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.076+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=F3D1F6A2UCO0 type=del size=3977291 2024-09-12T00:37:42.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.079+0000 7fcd44281780 1 < suggested remove operation key=B5OH55MQGSGJ tag=KB1XI1YMLEGZ type=del 2024-09-12T00:37:42.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.080+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=MDSD1QX1R6W0 type=del size=1828873 2024-09-12T00:37:42.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.083+0000 7fcd44281780 1 < suggested update operation key=4RU6HTH4J0U1 tag=I5QI0A3JS8GZ type=del size=380039 2024-09-12T00:37:42.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.086+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~PEDSLDGWN28Y.0 size=1048576 2024-09-12T00:37:42.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.087+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~PEDSLDGWN28Y.1 size=962232 2024-09-12T00:37:42.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.087+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=PEDSLDGWN28Y tag=WGS0ED0TEQ0E type=write size=3059384 2024-09-12T00:37:42.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.089+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~0L29M3NF7HH1.0 size=1048576 2024-09-12T00:37:42.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.090+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~0L29M3NF7HH1.1 size=61078 2024-09-12T00:37:42.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.092+0000 7fcd44281780 1 < completed multipart upload key=0AVE0W4OV1AU upload=0L29M3NF7HH1 tag=B2978M91VPOF type=write size=2158230 2024-09-12T00:37:42.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.093+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=AXLYMUZZRV8S type=write size=542006 2024-09-12T00:37:42.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.095+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~4EGVISCNL5Q9.0 size=1048576 2024-09-12T00:37:42.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.096+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~4EGVISCNL5Q9.1 size=630492 2024-09-12T00:37:42.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.098+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=4EGVISCNL5Q9 tag=OH02BH5T46ZO type=write size=2727644 2024-09-12T00:37:42.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.101+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~NR3U8IZP0A3C.0 size=1048576 2024-09-12T00:37:42.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.102+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~NR3U8IZP0A3C.1 size=991842 2024-09-12T00:37:42.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.102+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=NR3U8IZP0A3C tag=1QRLAUNAWKEO type=write size=3088994 2024-09-12T00:37:42.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.103+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=PDO3VRQXI2YF type=del 2024-09-12T00:37:42.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.106+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~HV4778UTYE1P.0 size=1048576 2024-09-12T00:37:42.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.108+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~HV4778UTYE1P.1 size=1048576 2024-09-12T00:37:42.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.109+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~HV4778UTYE1P.2 size=382465 2024-09-12T00:37:42.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.109+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=HV4778UTYE1P tag=J0MW9PHP33AJ type=write size=3528193 2024-09-12T00:37:42.110 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.112+0000 7fcd44281780 1 < suggested remove operation key=O12Z8THB62AJ tag=69G63S6DZ635 type=del 2024-09-12T00:37:42.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.114+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~DV9DE0L6BSJU.0 size=698469 2024-09-12T00:37:42.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.114+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=DV9DE0L6BSJU tag=VHKXY31RTDN6 type=write size=1747045 2024-09-12T00:37:42.115 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.116+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~RZYV6HR4DP7P.0 size=1048576 2024-09-12T00:37:42.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.117+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~RZYV6HR4DP7P.1 size=595366 2024-09-12T00:37:42.118 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.119+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=RZYV6HR4DP7P tag=G9G679N1AJD1 type=write size=2692518 2024-09-12T00:37:42.121 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.122+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~PFHQEBGYOS31.0 size=1048576 2024-09-12T00:37:42.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.123+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~PFHQEBGYOS31.1 size=1048576 2024-09-12T00:37:42.123 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.124+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~PFHQEBGYOS31.2 size=1008364 2024-09-12T00:37:42.123 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.124+0000 7fcd44281780 1 > prepared multipart upload key=U4EPPPA4QGGD upload=PFHQEBGYOS31 tag=GVZ3QA46PQAX type=write size=4154092 2024-09-12T00:37:42.124 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.125+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=T27ZPJU3SR7B type=del 2024-09-12T00:37:42.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.129+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~DHCUYXSCGV17.0 size=1048576 2024-09-12T00:37:42.128 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.130+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~DHCUYXSCGV17.1 size=1048576 2024-09-12T00:37:42.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.131+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~DHCUYXSCGV17.2 size=983515 2024-09-12T00:37:42.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.131+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=DHCUYXSCGV17 tag=R987ISPPNRVM type=write size=4129243 2024-09-12T00:37:42.131 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.132+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~5EYFWGWYVFE3.0 size=1048576 2024-09-12T00:37:42.132 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.133+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~5EYFWGWYVFE3.1 size=1048576 2024-09-12T00:37:42.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.134+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~5EYFWGWYVFE3.2 size=748869 2024-09-12T00:37:42.135 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.137+0000 7fcd44281780 1 < completed multipart upload key=526O814C10YW upload=5EYFWGWYVFE3 tag=9CF7SK691OBX type=write size=3894597 2024-09-12T00:37:42.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.139+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~HO6N2KWJV2LV.0 size=194498 2024-09-12T00:37:42.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.139+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=HO6N2KWJV2LV tag=0NVUSTE03SI6 type=write size=1243074 2024-09-12T00:37:42.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.140+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=ZSU8DS6L6S53 type=del 2024-09-12T00:37:42.141 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.142+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=QRR5ZM0BAV08 type=del size=2714969 2024-09-12T00:37:42.142 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.143+0000 7fcd44281780 1 < completed write operation key=0ELZXPZCRPGP tag=LRWCXTS7JG4Q type=write size=548656 2024-09-12T00:37:42.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.146+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~SK1KYZ1Q6K0O.0 size=1048576 2024-09-12T00:37:42.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.147+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~SK1KYZ1Q6K0O.1 size=149210 2024-09-12T00:37:42.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.147+0000 7fcd44281780 1 > prepared multipart upload key=U4EPPPA4QGGD upload=SK1KYZ1Q6K0O tag=SP8KX9NPWM1O type=write size=2246362 2024-09-12T00:37:42.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.148+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=P4VZFSTSHGKS type=del 2024-09-12T00:37:42.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.150+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=UTIVKSURZ6F0 type=del size=2700935 2024-09-12T00:37:42.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.151+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=DMVF0W15W44K type=del 2024-09-12T00:37:42.151 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.152+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=F9ZZ15P2NHE3 type=del size=3768342 2024-09-12T00:37:42.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.154+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~OPTUCTPUB29O.0 size=1048576 2024-09-12T00:37:42.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.155+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~OPTUCTPUB29O.1 size=527017 2024-09-12T00:37:42.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.157+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=OPTUCTPUB29O tag=NPMDNRSAT1O2 type=write size=2624169 2024-09-12T00:37:42.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.159+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~HMZSA7DF7AWL.0 size=1048576 2024-09-12T00:37:42.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.160+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~HMZSA7DF7AWL.1 size=365738 2024-09-12T00:37:42.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.160+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=HMZSA7DF7AWL tag=AOY7AGWU5Z8W type=write size=2462890 2024-09-12T00:37:42.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.162+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=UMK0GT7WI7P5 type=del 2024-09-12T00:37:42.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.163+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=0X830S54UBE2 type=del size=1878604 2024-09-12T00:37:42.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.164+0000 7fcd44281780 1 < canceled operation key=0ELZXPZCRPGP tag=F3D1F6A2UCO0 type=del size=3977291 2024-09-12T00:37:42.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.167+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~X9M12PH9518I.0 size=1048576 2024-09-12T00:37:42.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.168+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~X9M12PH9518I.1 size=1048576 2024-09-12T00:37:42.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.169+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~X9M12PH9518I.2 size=52868 2024-09-12T00:37:42.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.169+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=X9M12PH9518I tag=TZM1WEAXDFDN type=write size=3198596 2024-09-12T00:37:42.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.170+0000 7fcd44281780 1 < canceled operation key=0AVE0W4OV1AU tag=MDSD1QX1R6W0 type=del size=1828873 2024-09-12T00:37:42.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.173+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~ZSWK2UJJA190.0 size=699811 2024-09-12T00:37:42.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.173+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=ZSWK2UJJA190 tag=Z6XLZKWPQU1H type=write size=1748387 2024-09-12T00:37:42.173 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.174+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~PEDSLDGWN28Y.0 size=1048576 2024-09-12T00:37:42.174 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.175+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~PEDSLDGWN28Y.1 size=962232 2024-09-12T00:37:42.176 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.178+0000 7fcd44281780 1 < completed multipart upload key=4RU6HTH4J0U1 upload=PEDSLDGWN28Y tag=WGS0ED0TEQ0E type=write size=3059384 2024-09-12T00:37:42.178 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.179+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=0W46Y63UX3VQ type=write size=1020416 2024-09-12T00:37:42.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.180+0000 7fcd44281780 1 < completed write operation key=AN6GRGZ22INA tag=AXLYMUZZRV8S type=write size=542006 2024-09-12T00:37:42.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.183+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~HAZP3YQNJIZS.0 size=1048576 2024-09-12T00:37:42.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.184+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~HAZP3YQNJIZS.1 size=1048576 2024-09-12T00:37:42.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.185+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~HAZP3YQNJIZS.2 size=915837 2024-09-12T00:37:42.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.185+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=HAZP3YQNJIZS tag=6HK8OUY0D77Y type=write size=4061565 2024-09-12T00:37:42.185 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.186+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~NR3U8IZP0A3C.0 size=1048576 2024-09-12T00:37:42.186 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.187+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~NR3U8IZP0A3C.1 size=991842 2024-09-12T00:37:42.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.190+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=NR3U8IZP0A3C tag=1QRLAUNAWKEO type=write size=3088994 2024-09-12T00:37:42.190 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.191+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=7SLR5L7HN6NF type=del size=2375897 2024-09-12T00:37:42.191 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.193+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~HV4778UTYE1P.0 size=1048576 2024-09-12T00:37:42.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.194+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~HV4778UTYE1P.1 size=1048576 2024-09-12T00:37:42.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.195+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~HV4778UTYE1P.2 size=382465 2024-09-12T00:37:42.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.197+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=HV4778UTYE1P tag=J0MW9PHP33AJ type=write size=3528193 2024-09-12T00:37:42.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.199+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=49T1K2UYIY95 type=del size=3261630 2024-09-12T00:37:42.199 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.200+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~DV9DE0L6BSJU.0 size=698469 2024-09-12T00:37:42.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.202+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=DV9DE0L6BSJU tag=VHKXY31RTDN6 type=write size=1747045 2024-09-12T00:37:42.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.204+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=THDVJX0WSRX4 type=del size=3099429 2024-09-12T00:37:42.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.205+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~PFHQEBGYOS31.0 size=1048576 2024-09-12T00:37:42.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.206+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~PFHQEBGYOS31.1 size=1048576 2024-09-12T00:37:42.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.206+0000 7fcd44281780 1 < canceled part key=_multipart_U4EPPPA4QGGD.2~PFHQEBGYOS31.2 size=1008364 2024-09-12T00:37:42.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.209+0000 7fcd44281780 1 < canceled multipart upload key=U4EPPPA4QGGD upload=PFHQEBGYOS31 tag=GVZ3QA46PQAX type=write size=4154092 2024-09-12T00:37:42.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.210+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=2P6H5G5RV1JW type=write size=885706 2024-09-12T00:37:42.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.212+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~DHCUYXSCGV17.0 size=1048576 2024-09-12T00:37:42.212 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.213+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~DHCUYXSCGV17.1 size=1048576 2024-09-12T00:37:42.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.214+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~DHCUYXSCGV17.2 size=983515 2024-09-12T00:37:42.215 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.216+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=DHCUYXSCGV17 tag=R987ISPPNRVM type=write size=4129243 2024-09-12T00:37:42.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.218+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=CR377HZ14S36 type=del size=978586 2024-09-12T00:37:42.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.220+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~HO6N2KWJV2LV.0 size=194498 2024-09-12T00:37:42.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.222+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=HO6N2KWJV2LV tag=0NVUSTE03SI6 type=write size=1243074 2024-09-12T00:37:42.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.224+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=BHHD370V02SH type=write size=622101 2024-09-12T00:37:42.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.225+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=QRR5ZM0BAV08 type=del 2024-09-12T00:37:42.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.227+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=B51WGDN6LDT3 type=del size=1726469 2024-09-12T00:37:42.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.229+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~SK1KYZ1Q6K0O.0 size=1048576 2024-09-12T00:37:42.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.230+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~SK1KYZ1Q6K0O.1 size=149210 2024-09-12T00:37:42.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.232+0000 7fcd44281780 1 < completed multipart upload key=U4EPPPA4QGGD upload=SK1KYZ1Q6K0O tag=SP8KX9NPWM1O type=write size=2246362 2024-09-12T00:37:42.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.233+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=ESDXXU6DPKMV type=del size=2506300 2024-09-12T00:37:42.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.235+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=UTIVKSURZ6F0 type=del 2024-09-12T00:37:42.235 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.236+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=IXMO8DZBN0S2 type=write size=502596 2024-09-12T00:37:42.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.238+0000 7fcd44281780 1 < canceled operation key=EXP8U6QNSMQ0 tag=F9ZZ15P2NHE3 type=del size=3768342 2024-09-12T00:37:42.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.241+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~41Z8O764H312.0 size=1048576 2024-09-12T00:37:42.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.242+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~41Z8O764H312.1 size=1004683 2024-09-12T00:37:42.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.242+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=41Z8O764H312 tag=F3C4ZM2MWX6O type=write size=3101835 2024-09-12T00:37:42.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.242+0000 7fcd44281780 1 < canceled part key=_multipart_KNBCXZF3JGNL.2~HMZSA7DF7AWL.0 size=1048576 2024-09-12T00:37:42.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.242+0000 7fcd44281780 1 < canceled part key=_multipart_KNBCXZF3JGNL.2~HMZSA7DF7AWL.1 size=365738 2024-09-12T00:37:42.243 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.245+0000 7fcd44281780 1 < canceled multipart upload key=KNBCXZF3JGNL upload=HMZSA7DF7AWL tag=AOY7AGWU5Z8W type=write size=2462890 2024-09-12T00:37:42.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.247+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~Z8XXU0AO2NTN.0 size=1048576 2024-09-12T00:37:42.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.248+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~Z8XXU0AO2NTN.1 size=587502 2024-09-12T00:37:42.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.248+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=Z8XXU0AO2NTN tag=RBCPPRTTV5UH type=write size=2684654 2024-09-12T00:37:42.248 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.250+0000 7fcd44281780 1 < completed delete operation key=0OEDZ5O2LN8H tag=0X830S54UBE2 type=del 2024-09-12T00:37:42.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.251+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=I6X68NHYPKV1 type=del size=3839414 2024-09-12T00:37:42.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.253+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~X9M12PH9518I.0 size=1048576 2024-09-12T00:37:42.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.254+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~X9M12PH9518I.1 size=1048576 2024-09-12T00:37:42.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.255+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~X9M12PH9518I.2 size=52868 2024-09-12T00:37:42.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.258+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=X9M12PH9518I tag=TZM1WEAXDFDN type=write size=3198596 2024-09-12T00:37:42.260 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.261+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~X2VUSP91JM5D.0 size=1048576 2024-09-12T00:37:42.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.262+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~X2VUSP91JM5D.1 size=761946 2024-09-12T00:37:42.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.262+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=X2VUSP91JM5D tag=LZB6U0Z6LGEI type=write size=2859098 2024-09-12T00:37:42.262 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.264+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~ZSWK2UJJA190.0 size=699811 2024-09-12T00:37:42.265 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.266+0000 7fcd44281780 1 < completed multipart upload key=UWS056JN3IXO upload=ZSWK2UJJA190 tag=Z6XLZKWPQU1H type=write size=1748387 2024-09-12T00:37:42.266 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.267+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=XCUR5KCIO5NE type=write size=568092 2024-09-12T00:37:42.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.269+0000 7fcd44281780 1 < completed write operation key=NIDHAXQF55WX tag=0W46Y63UX3VQ type=write size=1020416 2024-09-12T00:37:42.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.270+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=4M0K1DYVVVV9 type=del size=3981498 2024-09-12T00:37:42.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.271+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~HAZP3YQNJIZS.0 size=1048576 2024-09-12T00:37:42.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.273+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~HAZP3YQNJIZS.1 size=1048576 2024-09-12T00:37:42.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.274+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~HAZP3YQNJIZS.2 size=915837 2024-09-12T00:37:42.275 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.276+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=HAZP3YQNJIZS tag=6HK8OUY0D77Y type=write size=4061565 2024-09-12T00:37:42.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.278+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=5SP8FIHT63Y6 type=del size=1213702 2024-09-12T00:37:42.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.279+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=7SLR5L7HN6NF type=del 2024-09-12T00:37:42.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.282+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~5XP0214J0IAG.0 size=804649 2024-09-12T00:37:42.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.282+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=5XP0214J0IAG tag=5SS7EWXXXU61 type=write size=1853225 2024-09-12T00:37:42.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.283+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=49T1K2UYIY95 type=del 2024-09-12T00:37:42.284 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.285+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=04GB1ZR6MSYV type=del size=2271341 2024-09-12T00:37:42.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.286+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=THDVJX0WSRX4 type=del 2024-09-12T00:37:42.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.288+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~1E8ZJMVNPH8M.0 size=1048576 2024-09-12T00:37:42.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.290+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~1E8ZJMVNPH8M.1 size=1048576 2024-09-12T00:37:42.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.291+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~1E8ZJMVNPH8M.2 size=724085 2024-09-12T00:37:42.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.291+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=1E8ZJMVNPH8M tag=9XF4PXD6BXOF type=write size=3869813 2024-09-12T00:37:42.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.292+0000 7fcd44281780 1 < completed write operation key=G8O8VXTUPQVP tag=2P6H5G5RV1JW type=write size=885706 2024-09-12T00:37:42.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.294+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=JBU9BJ7J9UFK type=del size=25515 2024-09-12T00:37:42.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.295+0000 7fcd44281780 1 < canceled operation key=AJ5AUTM2J9MT tag=CR377HZ14S36 type=del size=978586 2024-09-12T00:37:42.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.298+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~VIWC3VSNJ8OY.0 size=1048576 2024-09-12T00:37:42.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.299+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~VIWC3VSNJ8OY.1 size=359142 2024-09-12T00:37:42.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.299+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=VIWC3VSNJ8OY tag=00YCVYABVQMV type=write size=2456294 2024-09-12T00:37:42.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.300+0000 7fcd44281780 1 < completed write operation key=B5OH55MQGSGJ tag=BHHD370V02SH type=write size=622101 2024-09-12T00:37:42.301 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.303+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~PQRFP2Z9926L.0 size=1048576 2024-09-12T00:37:42.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.304+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~PQRFP2Z9926L.1 size=1048576 2024-09-12T00:37:42.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.305+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~PQRFP2Z9926L.2 size=573729 2024-09-12T00:37:42.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.305+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=PQRFP2Z9926L tag=GKWCZZXG9KZV type=write size=3719457 2024-09-12T00:37:42.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.308+0000 7fcd44281780 1 < suggested update operation key=VXDTFEG8P23H tag=B51WGDN6LDT3 type=del size=1726469 2024-09-12T00:37:42.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.310+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=49ESJZWC20R9 type=del size=1750773 2024-09-12T00:37:42.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.311+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=ESDXXU6DPKMV type=del 2024-09-12T00:37:42.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.313+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=Q60OBKDK86IL type=write size=427193 2024-09-12T00:37:42.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.315+0000 7fcd44281780 1 < completed write operation key=0OEDZ5O2LN8H tag=IXMO8DZBN0S2 type=write size=502596 2024-09-12T00:37:42.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.316+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=3WAJ3H06PB98 type=del size=190639 2024-09-12T00:37:42.316 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.318+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~41Z8O764H312.0 size=1048576 2024-09-12T00:37:42.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.319+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~41Z8O764H312.1 size=1004683 2024-09-12T00:37:42.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.321+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=41Z8O764H312 tag=F3C4ZM2MWX6O type=write size=3101835 2024-09-12T00:37:42.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.322+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=U28HKGMX0ZPO type=del size=1905379 2024-09-12T00:37:42.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.324+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~Z8XXU0AO2NTN.0 size=1048576 2024-09-12T00:37:42.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.327+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~Z8XXU0AO2NTN.1 size=587502 2024-09-12T00:37:42.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.329+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=Z8XXU0AO2NTN tag=RBCPPRTTV5UH type=write size=2684654 2024-09-12T00:37:42.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.332+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~JA1OFKUDT4L6.0 size=1048576 2024-09-12T00:37:42.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.333+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~JA1OFKUDT4L6.1 size=629893 2024-09-12T00:37:42.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.333+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=JA1OFKUDT4L6 tag=N8ICXGUZUZ8A type=write size=2727045 2024-09-12T00:37:42.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.336+0000 7fcd44281780 1 < suggested remove operation key=8U004LC8IYLQ tag=I6X68NHYPKV1 type=del 2024-09-12T00:37:42.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.338+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~Z0LF51ER5K3G.0 size=1048576 2024-09-12T00:37:42.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.339+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~Z0LF51ER5K3G.1 size=64208 2024-09-12T00:37:42.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.339+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=Z0LF51ER5K3G tag=LW0JFP6M4XE6 type=write size=2161360 2024-09-12T00:37:42.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.340+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~X2VUSP91JM5D.0 size=1048576 2024-09-12T00:37:42.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.342+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~X2VUSP91JM5D.1 size=761946 2024-09-12T00:37:42.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.344+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=X2VUSP91JM5D tag=LZB6U0Z6LGEI type=write size=2859098 2024-09-12T00:37:42.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.345+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=WNCQRII2BC8F type=del size=3582637 2024-09-12T00:37:42.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.347+0000 7fcd44281780 1 < completed write operation key=WXBMIJ4FC0VX tag=XCUR5KCIO5NE type=write size=568092 2024-09-12T00:37:42.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.348+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=06W92MA4ZQ0T type=write size=785886 2024-09-12T00:37:42.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.349+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=4M0K1DYVVVV9 type=del 2024-09-12T00:37:42.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.351+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=Z168AY9R00HB type=del size=3837864 2024-09-12T00:37:42.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.352+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=5SP8FIHT63Y6 type=del 2024-09-12T00:37:42.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.355+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~UGQM0QGSM3AZ.0 size=1048576 2024-09-12T00:37:42.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.355+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~UGQM0QGSM3AZ.1 size=1048576 2024-09-12T00:37:42.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.356+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~UGQM0QGSM3AZ.2 size=890195 2024-09-12T00:37:42.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.356+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=UGQM0QGSM3AZ tag=KT59DVST7QEU type=write size=4035923 2024-09-12T00:37:42.357 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.358+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~5XP0214J0IAG.0 size=804649 2024-09-12T00:37:42.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.360+0000 7fcd44281780 1 < completed multipart upload key=526O814C10YW upload=5XP0214J0IAG tag=5SS7EWXXXU61 type=write size=1853225 2024-09-12T00:37:42.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.362+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~9UEUT1FZ1GMW.0 size=1048576 2024-09-12T00:37:42.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.363+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~9UEUT1FZ1GMW.1 size=1048576 2024-09-12T00:37:42.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.365+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~9UEUT1FZ1GMW.2 size=210612 2024-09-12T00:37:42.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.365+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=9UEUT1FZ1GMW tag=ME7TW146FDH5 type=write size=3356340 2024-09-12T00:37:42.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.366+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=04GB1ZR6MSYV type=del 2024-09-12T00:37:42.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.369+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~4D12J7VY94OC.0 size=1048576 2024-09-12T00:37:42.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.370+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~4D12J7VY94OC.1 size=1025502 2024-09-12T00:37:42.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.370+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=4D12J7VY94OC tag=64XWNEOK0ST2 type=write size=3122654 2024-09-12T00:37:42.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.371+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~1E8ZJMVNPH8M.0 size=1048576 2024-09-12T00:37:42.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.372+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~1E8ZJMVNPH8M.1 size=1048576 2024-09-12T00:37:42.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.373+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~1E8ZJMVNPH8M.2 size=724085 2024-09-12T00:37:42.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.375+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=1E8ZJMVNPH8M tag=9XF4PXD6BXOF type=write size=3869813 2024-09-12T00:37:42.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.378+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~BI5OIFJQG5AC.0 size=897689 2024-09-12T00:37:42.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.378+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=BI5OIFJQG5AC tag=311LC8DJNIMK type=write size=1946265 2024-09-12T00:37:42.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.380+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=JBU9BJ7J9UFK type=del 2024-09-12T00:37:42.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.381+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=51E9KZRW9FY1 type=del size=1658434 2024-09-12T00:37:42.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.383+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~VIWC3VSNJ8OY.0 size=1048576 2024-09-12T00:37:42.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.384+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~VIWC3VSNJ8OY.1 size=359142 2024-09-12T00:37:42.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.387+0000 7fcd44281780 1 < completed multipart upload key=4RU6HTH4J0U1 upload=VIWC3VSNJ8OY tag=00YCVYABVQMV type=write size=2456294 2024-09-12T00:37:42.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.389+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=WPVKZ0FBOWBP type=del size=327182 2024-09-12T00:37:42.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.391+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~PQRFP2Z9926L.0 size=1048576 2024-09-12T00:37:42.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.392+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~PQRFP2Z9926L.1 size=1048576 2024-09-12T00:37:42.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.393+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~PQRFP2Z9926L.2 size=573729 2024-09-12T00:37:42.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.396+0000 7fcd44281780 1 < completed multipart upload key=0AVE0W4OV1AU upload=PQRFP2Z9926L tag=GKWCZZXG9KZV type=write size=3719457 2024-09-12T00:37:42.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.399+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~NGX376LVI32S.0 size=1048576 2024-09-12T00:37:42.399 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.400+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~NGX376LVI32S.1 size=1048576 2024-09-12T00:37:42.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.401+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~NGX376LVI32S.2 size=743090 2024-09-12T00:37:42.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.401+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=NGX376LVI32S tag=GQGUL3FF90H0 type=write size=3888818 2024-09-12T00:37:42.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.402+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=49ESJZWC20R9 type=del 2024-09-12T00:37:42.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.404+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=TNHW0NB0OA48 type=del size=1403674 2024-09-12T00:37:42.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.406+0000 7fcd44281780 1 < completed write operation key=KNBCXZF3JGNL tag=Q60OBKDK86IL type=write size=427193 2024-09-12T00:37:42.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.408+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~QA1BBAFUMX5C.0 size=1048576 2024-09-12T00:37:42.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.410+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~QA1BBAFUMX5C.1 size=1048576 2024-09-12T00:37:42.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.411+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~QA1BBAFUMX5C.2 size=109106 2024-09-12T00:37:42.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.411+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=QA1BBAFUMX5C tag=2XKWS6QLKCWE type=write size=3254834 2024-09-12T00:37:42.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.412+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=3WAJ3H06PB98 type=del 2024-09-12T00:37:42.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.414+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=C9SRS1JCY3FI type=del size=1374007 2024-09-12T00:37:42.414 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.416+0000 7fcd44281780 1 < canceled operation key=0O62FO4WVZG6 tag=U28HKGMX0ZPO type=del size=1905379 2024-09-12T00:37:42.416 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.417+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=ERWCV5C0KFTZ type=write size=696333 2024-09-12T00:37:42.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.419+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~JA1OFKUDT4L6.0 size=1048576 2024-09-12T00:37:42.418 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.420+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~JA1OFKUDT4L6.1 size=629893 2024-09-12T00:37:42.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.422+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=JA1OFKUDT4L6 tag=N8ICXGUZUZ8A type=write size=2727045 2024-09-12T00:37:42.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.423+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=G1C8HYXRUU8Q type=del size=678202 2024-09-12T00:37:42.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.425+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~Z0LF51ER5K3G.0 size=1048576 2024-09-12T00:37:42.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.426+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~Z0LF51ER5K3G.1 size=64208 2024-09-12T00:37:42.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.429+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=Z0LF51ER5K3G tag=LW0JFP6M4XE6 type=write size=2161360 2024-09-12T00:37:42.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.430+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=IBLA8SZ8SJEZ type=del size=323114 2024-09-12T00:37:42.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.433+0000 7fcd44281780 1 < suggested remove operation key=KNBCXZF3JGNL tag=WNCQRII2BC8F type=del 2024-09-12T00:37:42.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.435+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=UYD1TI95T60F type=del size=850815 2024-09-12T00:37:42.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.436+0000 7fcd44281780 1 < completed write operation key=UWS056JN3IXO tag=06W92MA4ZQ0T type=write size=785886 2024-09-12T00:37:42.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.439+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~0LCTYX4XEANW.0 size=1048576 2024-09-12T00:37:42.439 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.440+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~0LCTYX4XEANW.1 size=1048576 2024-09-12T00:37:42.439 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.441+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~0LCTYX4XEANW.2 size=144457 2024-09-12T00:37:42.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.441+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=0LCTYX4XEANW tag=MMKOYO4XBVYS type=write size=3290185 2024-09-12T00:37:42.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.442+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=Z168AY9R00HB type=del 2024-09-12T00:37:42.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.443+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=AU5REL6E82SD type=del size=3394013 2024-09-12T00:37:42.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.445+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~UGQM0QGSM3AZ.0 size=1048576 2024-09-12T00:37:42.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.446+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~UGQM0QGSM3AZ.1 size=1048576 2024-09-12T00:37:42.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.447+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~UGQM0QGSM3AZ.2 size=890195 2024-09-12T00:37:42.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.449+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=UGQM0QGSM3AZ tag=KT59DVST7QEU type=write size=4035923 2024-09-12T00:37:42.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.451+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=2GP2J41S0036 type=del size=2974246 2024-09-12T00:37:42.451 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.452+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~9UEUT1FZ1GMW.0 size=1048576 2024-09-12T00:37:42.452 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.453+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~9UEUT1FZ1GMW.1 size=1048576 2024-09-12T00:37:42.453 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.454+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~9UEUT1FZ1GMW.2 size=210612 2024-09-12T00:37:42.455 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.456+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=9UEUT1FZ1GMW tag=ME7TW146FDH5 type=write size=3356340 2024-09-12T00:37:42.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.459+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~MZRSANWF3DLS.0 size=1048576 2024-09-12T00:37:42.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.460+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~MZRSANWF3DLS.1 size=1020105 2024-09-12T00:37:42.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.460+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=MZRSANWF3DLS tag=ZF2KP7JM3Z0O type=write size=3117257 2024-09-12T00:37:42.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.461+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~4D12J7VY94OC.0 size=1048576 2024-09-12T00:37:42.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.461+0000 7fcd44281780 1 < canceled part key=_multipart_ZQSZDU87GAMV.2~4D12J7VY94OC.1 size=1025502 2024-09-12T00:37:42.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.463+0000 7fcd44281780 1 < canceled multipart upload key=ZQSZDU87GAMV upload=4D12J7VY94OC tag=64XWNEOK0ST2 type=write size=3122654 2024-09-12T00:37:42.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.465+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=EI3C7S62D803 type=del size=3938029 2024-09-12T00:37:42.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.466+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~BI5OIFJQG5AC.0 size=897689 2024-09-12T00:37:42.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.468+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=BI5OIFJQG5AC tag=311LC8DJNIMK type=write size=1946265 2024-09-12T00:37:42.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.471+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~MNO5H24NWUA5.0 size=1048576 2024-09-12T00:37:42.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.472+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~MNO5H24NWUA5.1 size=645131 2024-09-12T00:37:42.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.472+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=MNO5H24NWUA5 tag=DXZ8MLZ9VMA1 type=write size=2742283 2024-09-12T00:37:42.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.474+0000 7fcd44281780 1 < suggested update operation key=NIDHAXQF55WX tag=51E9KZRW9FY1 type=del size=1658434 2024-09-12T00:37:42.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.475+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=BMESB70HH6D8 type=write size=822416 2024-09-12T00:37:42.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.477+0000 7fcd44281780 1 < canceled operation key=G8O8VXTUPQVP tag=WPVKZ0FBOWBP type=del size=327182 2024-09-12T00:37:42.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.479+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=TXGO4AZHQGBX type=del size=3735047 2024-09-12T00:37:42.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.480+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~NGX376LVI32S.0 size=1048576 2024-09-12T00:37:42.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.480+0000 7fcd44281780 1 < canceled part key=_multipart_0O62FO4WVZG6.2~NGX376LVI32S.1 size=1048576 2024-09-12T00:37:42.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.481+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~NGX376LVI32S.2 size=743090 2024-09-12T00:37:42.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.484+0000 7fcd44281780 1 < canceled multipart upload key=0O62FO4WVZG6 upload=NGX376LVI32S tag=GQGUL3FF90H0 type=write size=3888818 2024-09-12T00:37:42.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.485+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=TGJ10K4MYH1M type=del size=2609331 2024-09-12T00:37:42.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.487+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=TNHW0NB0OA48 type=del 2024-09-12T00:37:42.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.489+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~GJHRXUJVBPW2.0 size=1048576 2024-09-12T00:37:42.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.490+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~GJHRXUJVBPW2.1 size=1048576 2024-09-12T00:37:42.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.491+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~GJHRXUJVBPW2.2 size=698580 2024-09-12T00:37:42.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.491+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=GJHRXUJVBPW2 tag=YDJFH9LIDDPY type=write size=3844308 2024-09-12T00:37:42.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.493+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~QA1BBAFUMX5C.0 size=1048576 2024-09-12T00:37:42.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.494+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~QA1BBAFUMX5C.1 size=1048576 2024-09-12T00:37:42.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.495+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~QA1BBAFUMX5C.2 size=109106 2024-09-12T00:37:42.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.497+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=QA1BBAFUMX5C tag=2XKWS6QLKCWE type=write size=3254834 2024-09-12T00:37:42.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.499+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=00Q0M6TPN8YO type=write size=125520 2024-09-12T00:37:42.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.500+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=C9SRS1JCY3FI type=del 2024-09-12T00:37:42.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.502+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=QG11D2G8TN0K type=del size=491557 2024-09-12T00:37:42.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.503+0000 7fcd44281780 1 < completed write operation key=XRW0CRE12S5B tag=ERWCV5C0KFTZ type=write size=696333 2024-09-12T00:37:42.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.504+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=QG92X0GGAXYK type=del size=2741582 2024-09-12T00:37:42.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.506+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=G1C8HYXRUU8Q type=del 2024-09-12T00:37:42.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.507+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=TV6QL8FA161B type=del size=2416093 2024-09-12T00:37:42.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.509+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=IBLA8SZ8SJEZ type=del 2024-09-12T00:37:42.510 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.511+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~BRV9WDTTNZYN.0 size=1048576 2024-09-12T00:37:42.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.512+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~BRV9WDTTNZYN.1 size=268387 2024-09-12T00:37:42.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.513+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=BRV9WDTTNZYN tag=A4POGRRQRK0V type=write size=2365539 2024-09-12T00:37:42.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.514+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=UYD1TI95T60F type=del 2024-09-12T00:37:42.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.515+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=EX3JNAC3VBZ0 type=write size=465655 2024-09-12T00:37:42.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.517+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~0LCTYX4XEANW.0 size=1048576 2024-09-12T00:37:42.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.518+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~0LCTYX4XEANW.1 size=1048576 2024-09-12T00:37:42.518 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.519+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~0LCTYX4XEANW.2 size=144457 2024-09-12T00:37:42.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.521+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=0LCTYX4XEANW tag=MMKOYO4XBVYS type=write size=3290185 2024-09-12T00:37:42.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.524+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~QJDNR8YD0756.0 size=1048576 2024-09-12T00:37:42.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.525+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~QJDNR8YD0756.1 size=1048576 2024-09-12T00:37:42.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.526+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~QJDNR8YD0756.2 size=896283 2024-09-12T00:37:42.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.526+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=QJDNR8YD0756 tag=4VU9FR6TC1DU type=write size=4042011 2024-09-12T00:37:42.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.529+0000 7fcd44281780 1 < suggested update operation key=IK8POOY7ZWNF tag=AU5REL6E82SD type=del size=3394013 2024-09-12T00:37:42.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.531+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~0GCJ29TEN3A6.0 size=863989 2024-09-12T00:37:42.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.531+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=0GCJ29TEN3A6 tag=E241H4OXWY72 type=write size=1912565 2024-09-12T00:37:42.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.533+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=2GP2J41S0036 type=del 2024-09-12T00:37:42.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.535+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~AZJQTVTVQYQF.0 size=1048576 2024-09-12T00:37:42.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.536+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~AZJQTVTVQYQF.1 size=1048576 2024-09-12T00:37:42.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.537+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~AZJQTVTVQYQF.2 size=842328 2024-09-12T00:37:42.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.537+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=AZJQTVTVQYQF tag=VP860XEOKMJ9 type=write size=3988056 2024-09-12T00:37:42.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.538+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~MZRSANWF3DLS.0 size=1048576 2024-09-12T00:37:42.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.539+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~MZRSANWF3DLS.1 size=1020105 2024-09-12T00:37:42.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.542+0000 7fcd44281780 1 < completed multipart upload key=UWS056JN3IXO upload=MZRSANWF3DLS tag=ZF2KP7JM3Z0O type=write size=3117257 2024-09-12T00:37:42.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.544+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~1R4ANLFO69U6.0 size=1048576 2024-09-12T00:37:42.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.545+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~1R4ANLFO69U6.1 size=804999 2024-09-12T00:37:42.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.545+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=1R4ANLFO69U6 tag=3P1MZV8FANAO type=write size=2902151 2024-09-12T00:37:42.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.547+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=EI3C7S62D803 type=del 2024-09-12T00:37:42.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.550+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~OJZ102JR01LH.0 size=1048576 2024-09-12T00:37:42.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.550+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~OJZ102JR01LH.1 size=175688 2024-09-12T00:37:42.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.550+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=OJZ102JR01LH tag=C0YL0B3JZT6W type=write size=2272840 2024-09-12T00:37:42.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.552+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~MNO5H24NWUA5.0 size=1048576 2024-09-12T00:37:42.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.553+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~MNO5H24NWUA5.1 size=645131 2024-09-12T00:37:42.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.555+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=MNO5H24NWUA5 tag=DXZ8MLZ9VMA1 type=write size=2742283 2024-09-12T00:37:42.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.556+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=78GD8ABPJSEK type=del size=3516181 2024-09-12T00:37:42.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.559+0000 7fcd44281780 1 < suggested update operation key=U4EPPPA4QGGD tag=BMESB70HH6D8 type=write size=822416 2024-09-12T00:37:42.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.561+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~NNR2U3USM5T0.0 size=1048576 2024-09-12T00:37:42.561 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.562+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~NNR2U3USM5T0.1 size=1048576 2024-09-12T00:37:42.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.563+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~NNR2U3USM5T0.2 size=691603 2024-09-12T00:37:42.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.563+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=NNR2U3USM5T0 tag=JFTT7SJRO0XS type=write size=3837331 2024-09-12T00:37:42.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.565+0000 7fcd44281780 1 < completed delete operation key=8U004LC8IYLQ tag=TXGO4AZHQGBX type=del 2024-09-12T00:37:42.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.566+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=F18HBMB97GCJ type=del size=2566617 2024-09-12T00:37:42.567 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.568+0000 7fcd44281780 -1 < failed to complete operation key=U4EPPPA4QGGD tag=TGJ10K4MYH1M type=del size=2609331: (22) Invalid argument 2024-09-12T00:37:42.569 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.571+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~Z3TBJZKY7C3A.0 size=1048576 2024-09-12T00:37:42.570 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.572+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~Z3TBJZKY7C3A.1 size=892919 2024-09-12T00:37:42.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.572+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=Z3TBJZKY7C3A tag=M1A0CR8PYPW9 type=write size=2990071 2024-09-12T00:37:42.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.573+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~GJHRXUJVBPW2.0 size=1048576 2024-09-12T00:37:42.573 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.574+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~GJHRXUJVBPW2.1 size=1048576 2024-09-12T00:37:42.574 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.576+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~GJHRXUJVBPW2.2 size=698580 2024-09-12T00:37:42.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.578+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=GJHRXUJVBPW2 tag=YDJFH9LIDDPY type=write size=3844308 2024-09-12T00:37:42.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.581+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~8PLP63D00JOT.0 size=1048576 2024-09-12T00:37:42.580 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.581+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~8PLP63D00JOT.1 size=1048576 2024-09-12T00:37:42.581 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.582+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~8PLP63D00JOT.2 size=688778 2024-09-12T00:37:42.581 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.582+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=8PLP63D00JOT tag=ZUB8508QV71W type=write size=3834506 2024-09-12T00:37:42.584 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.585+0000 7fcd44281780 1 < suggested remove operation key=EXP8U6QNSMQ0 tag=00Q0M6TPN8YO type=write 2024-09-12T00:37:42.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.586+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=R7PCWZ3U3CPQ type=write size=672576 2024-09-12T00:37:42.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.588+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=QG11D2G8TN0K type=del 2024-09-12T00:37:42.589 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.590+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~M0NHGNPC9T5Z.0 size=1048576 2024-09-12T00:37:42.590 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.591+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~M0NHGNPC9T5Z.1 size=1048576 2024-09-12T00:37:42.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.592+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~M0NHGNPC9T5Z.2 size=170877 2024-09-12T00:37:42.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.592+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=M0NHGNPC9T5Z tag=P9FJL18NBEW1 type=write size=3316605 2024-09-12T00:37:42.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.594+0000 7fcd44281780 1 < canceled operation key=KNBCXZF3JGNL tag=QG92X0GGAXYK type=del size=2741582 2024-09-12T00:37:42.595 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.597+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~V0E3U4VSM8LO.0 size=1048576 2024-09-12T00:37:42.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.598+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~V0E3U4VSM8LO.1 size=825669 2024-09-12T00:37:42.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.598+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=V0E3U4VSM8LO tag=3N8A58U2RXK6 type=write size=2922821 2024-09-12T00:37:42.599 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.601+0000 7fcd44281780 1 < suggested update operation key=B5OH55MQGSGJ tag=TV6QL8FA161B type=del size=2416093 2024-09-12T00:37:42.601 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.602+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=FPTM5ZG8EXMM type=del size=828415 2024-09-12T00:37:42.601 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.603+0000 7fcd44281780 1 < canceled part key=_multipart_526O814C10YW.2~BRV9WDTTNZYN.0 size=1048576 2024-09-12T00:37:42.603 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.604+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~BRV9WDTTNZYN.1 size=268387 2024-09-12T00:37:42.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.606+0000 7fcd44281780 1 < canceled multipart upload key=526O814C10YW upload=BRV9WDTTNZYN tag=A4POGRRQRK0V type=write size=2365539 2024-09-12T00:37:42.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.608+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=X0GW8XGJC1B3 type=del size=2741748 2024-09-12T00:37:42.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.609+0000 7fcd44281780 1 < canceled operation key=0ELZXPZCRPGP tag=EX3JNAC3VBZ0 type=write size=465655 2024-09-12T00:37:42.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.611+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=AR48OUJV1UZC type=del size=923222 2024-09-12T00:37:42.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.612+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~QJDNR8YD0756.0 size=1048576 2024-09-12T00:37:42.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.612+0000 7fcd44281780 1 < canceled part key=_multipart_Z6I6598B6J5I.2~QJDNR8YD0756.1 size=1048576 2024-09-12T00:37:42.612 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.613+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~QJDNR8YD0756.2 size=896283 2024-09-12T00:37:42.614 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.616+0000 7fcd44281780 1 < canceled multipart upload key=Z6I6598B6J5I upload=QJDNR8YD0756 tag=4VU9FR6TC1DU type=write size=4042011 2024-09-12T00:37:42.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.617+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=MB2SRYCPLLDB type=del size=2353807 2024-09-12T00:37:42.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.618+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~0GCJ29TEN3A6.0 size=863989 2024-09-12T00:37:42.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.621+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=0GCJ29TEN3A6 tag=E241H4OXWY72 type=write size=1912565 2024-09-12T00:37:42.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.622+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=1JP0J06UCU61 type=del size=3719424 2024-09-12T00:37:42.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.624+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~AZJQTVTVQYQF.0 size=1048576 2024-09-12T00:37:42.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.625+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~AZJQTVTVQYQF.1 size=1048576 2024-09-12T00:37:42.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.626+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~AZJQTVTVQYQF.2 size=842328 2024-09-12T00:37:42.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.628+0000 7fcd44281780 1 < completed multipart upload key=B5OH55MQGSGJ upload=AZJQTVTVQYQF tag=VP860XEOKMJ9 type=write size=3988056 2024-09-12T00:37:42.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.630+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=912DU3U2C5XH type=del size=1654469 2024-09-12T00:37:42.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.632+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~1R4ANLFO69U6.0 size=1048576 2024-09-12T00:37:42.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.633+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~1R4ANLFO69U6.1 size=804999 2024-09-12T00:37:42.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.636+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=1R4ANLFO69U6 tag=3P1MZV8FANAO type=write size=2902151 2024-09-12T00:37:42.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.638+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~YECOJ0U4XGVN.0 size=71158 2024-09-12T00:37:42.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.638+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=YECOJ0U4XGVN tag=SSU8TR94EDLH type=write size=1119734 2024-09-12T00:37:42.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.640+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~OJZ102JR01LH.0 size=1048576 2024-09-12T00:37:42.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.641+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~OJZ102JR01LH.1 size=175688 2024-09-12T00:37:42.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.643+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=OJZ102JR01LH tag=C0YL0B3JZT6W type=write size=2272840 2024-09-12T00:37:42.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.646+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~E844LRHY1LE6.0 size=14502 2024-09-12T00:37:42.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.646+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=E844LRHY1LE6 tag=3UUFX0SZBLTV type=write size=1063078 2024-09-12T00:37:42.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.648+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=78GD8ABPJSEK type=del 2024-09-12T00:37:42.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.650+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~GSX6300LVZDR.0 size=1048576 2024-09-12T00:37:42.650 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.651+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~GSX6300LVZDR.1 size=1048576 2024-09-12T00:37:42.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.652+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~GSX6300LVZDR.2 size=462271 2024-09-12T00:37:42.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.652+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=GSX6300LVZDR tag=S1FBI15G69V5 type=write size=3607999 2024-09-12T00:37:42.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.653+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~NNR2U3USM5T0.0 size=1048576 2024-09-12T00:37:42.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.655+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~NNR2U3USM5T0.1 size=1048576 2024-09-12T00:37:42.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.656+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~NNR2U3USM5T0.2 size=691603 2024-09-12T00:37:42.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.658+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=NNR2U3USM5T0 tag=JFTT7SJRO0XS type=write size=3837331 2024-09-12T00:37:42.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.659+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=ROFBRKA8XB0F type=del size=2050159 2024-09-12T00:37:42.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.662+0000 7fcd44281780 1 < suggested update operation key=0ELZXPZCRPGP tag=F18HBMB97GCJ type=del size=2566617 2024-09-12T00:37:42.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.663+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=VSXH24FNXION type=del size=2099933 2024-09-12T00:37:42.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.664+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~Z3TBJZKY7C3A.0 size=1048576 2024-09-12T00:37:42.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.666+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~Z3TBJZKY7C3A.1 size=892919 2024-09-12T00:37:42.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.668+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=Z3TBJZKY7C3A tag=M1A0CR8PYPW9 type=write size=2990071 2024-09-12T00:37:42.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.669+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=UGNCVZ4HFNRA type=del size=1330049 2024-09-12T00:37:42.669 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.671+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~8PLP63D00JOT.0 size=1048576 2024-09-12T00:37:42.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.672+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~8PLP63D00JOT.1 size=1048576 2024-09-12T00:37:42.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.673+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~8PLP63D00JOT.2 size=688778 2024-09-12T00:37:42.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.675+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=8PLP63D00JOT tag=ZUB8508QV71W type=write size=3834506 2024-09-12T00:37:42.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.676+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=OJWFJFEWFOQL type=write size=505339 2024-09-12T00:37:42.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.678+0000 7fcd44281780 1 < completed write operation key=0O62FO4WVZG6 tag=R7PCWZ3U3CPQ type=write size=672576 2024-09-12T00:37:42.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.679+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=SEA9DU7D6VNB type=del size=2002127 2024-09-12T00:37:42.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.679+0000 7fcd44281780 1 < canceled part key=_multipart_ZQSZDU87GAMV.2~M0NHGNPC9T5Z.0 size=1048576 2024-09-12T00:37:42.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.680+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~M0NHGNPC9T5Z.1 size=1048576 2024-09-12T00:37:42.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.681+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~M0NHGNPC9T5Z.2 size=170877 2024-09-12T00:37:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.684+0000 7fcd44281780 1 < canceled multipart upload key=ZQSZDU87GAMV upload=M0NHGNPC9T5Z tag=P9FJL18NBEW1 type=write size=3316605 2024-09-12T00:37:42.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.685+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=GUTR5IFYX1YJ type=del size=1520062 2024-09-12T00:37:42.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.686+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~V0E3U4VSM8LO.0 size=1048576 2024-09-12T00:37:42.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.687+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~V0E3U4VSM8LO.1 size=825669 2024-09-12T00:37:42.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.690+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=V0E3U4VSM8LO tag=3N8A58U2RXK6 type=write size=2922821 2024-09-12T00:37:42.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.691+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=031KZZS6W6OE type=del size=1504969 2024-09-12T00:37:42.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.692+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=FPTM5ZG8EXMM type=del 2024-09-12T00:37:42.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.695+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~58T7QKODQU5B.0 size=433915 2024-09-12T00:37:42.694 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.695+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=58T7QKODQU5B tag=WT7C8E52NPZ4 type=write size=1482491 2024-09-12T00:37:42.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.696+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=X0GW8XGJC1B3 type=del 2024-09-12T00:37:42.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.698+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~BJYNAL70WADU.0 size=298650 2024-09-12T00:37:42.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.698+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=BJYNAL70WADU tag=69CIGQ6H856Z type=write size=1347226 2024-09-12T00:37:42.698 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.699+0000 7fcd44281780 1 < completed delete operation key=4RU6HTH4J0U1 tag=AR48OUJV1UZC type=del 2024-09-12T00:37:42.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.701+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=Q16K2W49VS4C type=del size=937021 2024-09-12T00:37:42.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.702+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=MB2SRYCPLLDB type=del 2024-09-12T00:37:42.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.705+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~GTXVYBURK7NS.0 size=1048576 2024-09-12T00:37:42.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.706+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~GTXVYBURK7NS.1 size=908732 2024-09-12T00:37:42.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.706+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=GTXVYBURK7NS tag=V6NUNWQABT3T type=write size=3005884 2024-09-12T00:37:42.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.707+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=1JP0J06UCU61 type=del 2024-09-12T00:37:42.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.709+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=99QAU9D9SZMX type=write size=615209 2024-09-12T00:37:42.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.710+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=912DU3U2C5XH type=del 2024-09-12T00:37:42.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.712+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=RNAA34QX9UAQ type=del size=508401 2024-09-12T00:37:42.712 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.713+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~YECOJ0U4XGVN.0 size=71158 2024-09-12T00:37:42.714 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.716+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=YECOJ0U4XGVN tag=SSU8TR94EDLH type=write size=1119734 2024-09-12T00:37:42.716 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.717+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=MNZ408R0UVB5 type=del size=3850607 2024-09-12T00:37:42.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.718+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~E844LRHY1LE6.0 size=14502 2024-09-12T00:37:42.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.721+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=E844LRHY1LE6 tag=3UUFX0SZBLTV type=write size=1063078 2024-09-12T00:37:42.722 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.723+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~TZPTGEPY0TQZ.0 size=631960 2024-09-12T00:37:42.722 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.724+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=TZPTGEPY0TQZ tag=UI8BWLOP0OH7 type=write size=1680536 2024-09-12T00:37:42.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.725+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~GSX6300LVZDR.0 size=1048576 2024-09-12T00:37:42.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.726+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~GSX6300LVZDR.1 size=1048576 2024-09-12T00:37:42.726 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.728+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~GSX6300LVZDR.2 size=462271 2024-09-12T00:37:42.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.730+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=GSX6300LVZDR tag=S1FBI15G69V5 type=write size=3607999 2024-09-12T00:37:42.731 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.733+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~7XL6C1WK5QRS.0 size=1048576 2024-09-12T00:37:42.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.734+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~7XL6C1WK5QRS.1 size=5960 2024-09-12T00:37:42.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.734+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=7XL6C1WK5QRS tag=7QOF9X7JQVMB type=write size=2103112 2024-09-12T00:37:42.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.735+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=ROFBRKA8XB0F type=del 2024-09-12T00:37:42.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.738+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~5MP37G4YM11T.0 size=965655 2024-09-12T00:37:42.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.738+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=5MP37G4YM11T tag=XQ2XD36TRYNL type=write size=2014231 2024-09-12T00:37:42.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.739+0000 7fcd44281780 1 < completed delete operation key=0OEDZ5O2LN8H tag=VSXH24FNXION type=del 2024-09-12T00:37:42.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.741+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=6WOZHVAMWTE2 type=del size=3116189 2024-09-12T00:37:42.741 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.742+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=UGNCVZ4HFNRA type=del 2024-09-12T00:37:42.744 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.745+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~46829TUT9PRI.0 size=1048576 2024-09-12T00:37:42.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.746+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~46829TUT9PRI.1 size=1048576 2024-09-12T00:37:42.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.747+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~46829TUT9PRI.2 size=994815 2024-09-12T00:37:42.747 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.747+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=46829TUT9PRI tag=FA2YG1UR7REJ type=write size=4140543 2024-09-12T00:37:42.749 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.750+0000 7fcd44281780 1 < suggested update operation key=8U004LC8IYLQ tag=OJWFJFEWFOQL type=write size=505339 2024-09-12T00:37:42.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.751+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=YNWT8TFK0I23 type=del size=1346220 2024-09-12T00:37:42.752 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.753+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=SEA9DU7D6VNB type=del 2024-09-12T00:37:42.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.755+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=ZMGH0MQH2TQ1 type=write size=892979 2024-09-12T00:37:42.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.757+0000 7fcd44281780 1 < suggested remove operation key=526O814C10YW tag=GUTR5IFYX1YJ type=del 2024-09-12T00:37:42.758 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.759+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=D0FAWIWOXBFB type=del size=4007386 2024-09-12T00:37:42.759 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.760+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=031KZZS6W6OE type=del 2024-09-12T00:37:42.760 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.762+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=3RFM37N1UE42 type=del size=2122739 2024-09-12T00:37:42.762 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.763+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~58T7QKODQU5B.0 size=433915 2024-09-12T00:37:42.764 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.766+0000 7fcd44281780 1 < completed multipart upload key=526O814C10YW upload=58T7QKODQU5B tag=WT7C8E52NPZ4 type=write size=1482491 2024-09-12T00:37:42.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.767+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=3H158AMADKXC type=del size=3949815 2024-09-12T00:37:42.767 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.768+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~BJYNAL70WADU.0 size=298650 2024-09-12T00:37:42.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.771+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=BJYNAL70WADU tag=69CIGQ6H856Z type=write size=1347226 2024-09-12T00:37:42.771 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.772+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=REVANPSAUPPS type=write size=1027844 2024-09-12T00:37:42.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.774+0000 7fcd44281780 1 < completed delete operation key=4RU6HTH4J0U1 tag=Q16K2W49VS4C type=del 2024-09-12T00:37:42.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.776+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=59F1PTC30CRM type=write size=1014162 2024-09-12T00:37:42.776 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.777+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~GTXVYBURK7NS.0 size=1048576 2024-09-12T00:37:42.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.778+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~GTXVYBURK7NS.1 size=908732 2024-09-12T00:37:42.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.781+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=GTXVYBURK7NS tag=V6NUNWQABT3T type=write size=3005884 2024-09-12T00:37:42.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.783+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~G6LXHMWAV6C1.0 size=523620 2024-09-12T00:37:42.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.783+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=G6LXHMWAV6C1 tag=ZDLS6UF3PXUH type=write size=1572196 2024-09-12T00:37:42.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.784+0000 7fcd44281780 -1 < failed to complete operation key=526O814C10YW tag=99QAU9D9SZMX type=write size=615209: (22) Invalid argument 2024-09-12T00:37:42.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.787+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~QHS9L2RMR4WQ.0 size=108404 2024-09-12T00:37:42.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.787+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=QHS9L2RMR4WQ tag=QS8M3S7KOFPG type=write size=1156980 2024-09-12T00:37:42.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.788+0000 7fcd44281780 1 < canceled operation key=WXBMIJ4FC0VX tag=RNAA34QX9UAQ type=del size=508401 2024-09-12T00:37:42.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.790+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=2EESZ7JD6ESQ type=del size=1950597 2024-09-12T00:37:42.790 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.791+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=MNZ408R0UVB5 type=del 2024-09-12T00:37:42.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.793+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~XNBTADMYR199.0 size=513945 2024-09-12T00:37:42.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.794+0000 7fcd44281780 1 > prepared multipart upload key=U4EPPPA4QGGD upload=XNBTADMYR199 tag=GFF0X6LAKMP6 type=write size=1562521 2024-09-12T00:37:42.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.795+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~TZPTGEPY0TQZ.0 size=631960 2024-09-12T00:37:42.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.798+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=TZPTGEPY0TQZ tag=UI8BWLOP0OH7 type=write size=1680536 2024-09-12T00:37:42.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.799+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=0PK30OV044UO type=write size=440599 2024-09-12T00:37:42.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.800+0000 7fcd44281780 1 < canceled part key=_multipart_EXP8U6QNSMQ0.2~7XL6C1WK5QRS.0 size=1048576 2024-09-12T00:37:42.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.801+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~7XL6C1WK5QRS.1 size=5960 2024-09-12T00:37:42.802 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.803+0000 7fcd44281780 1 < canceled multipart upload key=EXP8U6QNSMQ0 upload=7XL6C1WK5QRS tag=7QOF9X7JQVMB type=write size=2103112 2024-09-12T00:37:42.804 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.806+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~UI22QDZ32FFU.0 size=1001183 2024-09-12T00:37:42.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.806+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=UI22QDZ32FFU tag=E4YJVBY2FRTD type=write size=2049759 2024-09-12T00:37:42.806 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.807+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~5MP37G4YM11T.0 size=965655 2024-09-12T00:37:42.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.809+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=5MP37G4YM11T tag=XQ2XD36TRYNL type=write size=2014231 2024-09-12T00:37:42.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.810+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=VILU7YKSU4G3 type=del size=2427589 2024-09-12T00:37:42.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.812+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=6WOZHVAMWTE2 type=del 2024-09-12T00:37:42.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.814+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~IJ913M28OQLC.0 size=1048576 2024-09-12T00:37:42.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.815+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~IJ913M28OQLC.1 size=639362 2024-09-12T00:37:42.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.815+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=IJ913M28OQLC tag=WJTZYGI5IH4L type=write size=2736514 2024-09-12T00:37:42.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.816+0000 7fcd44281780 1 < canceled part key=_multipart_KJ0C43WLAFLI.2~46829TUT9PRI.0 size=1048576 2024-09-12T00:37:42.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.817+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~46829TUT9PRI.1 size=1048576 2024-09-12T00:37:42.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.818+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~46829TUT9PRI.2 size=994815 2024-09-12T00:37:42.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.820+0000 7fcd44281780 1 < canceled multipart upload key=KJ0C43WLAFLI upload=46829TUT9PRI tag=FA2YG1UR7REJ type=write size=4140543 2024-09-12T00:37:42.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.822+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~AQLQLRTJ27QF.0 size=1048576 2024-09-12T00:37:42.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.823+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~AQLQLRTJ27QF.1 size=1048576 2024-09-12T00:37:42.823 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.824+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~AQLQLRTJ27QF.2 size=303457 2024-09-12T00:37:42.823 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.824+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=AQLQLRTJ27QF tag=4G2HSG3YBOD2 type=write size=3449185 2024-09-12T00:37:42.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.828+0000 7fcd44281780 1 < suggested remove operation key=ZQSZDU87GAMV tag=YNWT8TFK0I23 type=del 2024-09-12T00:37:42.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.829+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=7JVU33Q3X33X type=del size=1553230 2024-09-12T00:37:42.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.830+0000 7fcd44281780 -1 < failed to complete operation key=526O814C10YW tag=ZMGH0MQH2TQ1 type=write size=892979: (22) Invalid argument 2024-09-12T00:37:42.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.832+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=R69441H6MI0J type=del size=3353372 2024-09-12T00:37:42.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.834+0000 7fcd44281780 1 < canceled operation key=NIDHAXQF55WX tag=D0FAWIWOXBFB type=del size=4007386 2024-09-12T00:37:42.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.835+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=HVT1TNXNI5AU type=del size=2998108 2024-09-12T00:37:42.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.838+0000 7fcd44281780 1 < suggested remove operation key=XRW0CRE12S5B tag=3RFM37N1UE42 type=del 2024-09-12T00:37:42.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.841+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~LGEZ7T36WCFU.0 size=1048576 2024-09-12T00:37:42.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.842+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~LGEZ7T36WCFU.1 size=1048576 2024-09-12T00:37:42.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.843+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~LGEZ7T36WCFU.2 size=794110 2024-09-12T00:37:42.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.843+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=LGEZ7T36WCFU tag=SXDLE02LRK3K type=write size=3939838 2024-09-12T00:37:42.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.844+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=3H158AMADKXC type=del 2024-09-12T00:37:42.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.846+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=R06Y7MUQ9RS9 type=del size=435056 2024-09-12T00:37:42.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.847+0000 7fcd44281780 1 < completed write operation key=IK8POOY7ZWNF tag=REVANPSAUPPS type=write size=1027844 2024-09-12T00:37:42.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.850+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~3Z04JZN6BH05.0 size=586249 2024-09-12T00:37:42.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.850+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=3Z04JZN6BH05 tag=94ZBMVPS886E type=write size=1634825 2024-09-12T00:37:42.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.853+0000 7fcd44281780 1 < suggested update operation key=UXY6K0AVI4EK tag=59F1PTC30CRM type=write size=1014162 2024-09-12T00:37:42.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.855+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~IUBN74VR91C6.0 size=359583 2024-09-12T00:37:42.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.855+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=IUBN74VR91C6 tag=27SXXPRU82IB type=write size=1408159 2024-09-12T00:37:42.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.856+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~G6LXHMWAV6C1.0 size=523620 2024-09-12T00:37:42.858 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.859+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=G6LXHMWAV6C1 tag=ZDLS6UF3PXUH type=write size=1572196 2024-09-12T00:37:42.859 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.861+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=WB8A33YIMIR1 type=del size=3205753 2024-09-12T00:37:42.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.862+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~QHS9L2RMR4WQ.0 size=108404 2024-09-12T00:37:42.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.864+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=QHS9L2RMR4WQ tag=QS8M3S7KOFPG type=write size=1156980 2024-09-12T00:37:42.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.867+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~BMDRWJSTVANQ.0 size=1048576 2024-09-12T00:37:42.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.868+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~BMDRWJSTVANQ.1 size=1048576 2024-09-12T00:37:42.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.869+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~BMDRWJSTVANQ.2 size=496644 2024-09-12T00:37:42.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.869+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=BMDRWJSTVANQ tag=9CFZWZ0VOK71 type=write size=3642372 2024-09-12T00:37:42.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.871+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=2EESZ7JD6ESQ type=del 2024-09-12T00:37:42.871 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.872+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=B2PB3G815TFO type=del size=2103695 2024-09-12T00:37:42.872 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.873+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~XNBTADMYR199.0 size=513945 2024-09-12T00:37:42.874 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.876+0000 7fcd44281780 1 < completed multipart upload key=U4EPPPA4QGGD upload=XNBTADMYR199 tag=GFF0X6LAKMP6 type=write size=1562521 2024-09-12T00:37:42.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.877+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=R5TGTZDGZKDU type=del size=4170491 2024-09-12T00:37:42.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.879+0000 7fcd44281780 1 < completed write operation key=8U004LC8IYLQ tag=0PK30OV044UO type=write size=440599 2024-09-12T00:37:42.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.880+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=N0YNLCMISGM7 type=del size=3364389 2024-09-12T00:37:42.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.882+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~UI22QDZ32FFU.0 size=1001183 2024-09-12T00:37:42.882 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.884+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=UI22QDZ32FFU tag=E4YJVBY2FRTD type=write size=2049759 2024-09-12T00:37:42.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.887+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=I90V0PW4E790 type=del size=1739221 2024-09-12T00:37:42.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.888+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=VILU7YKSU4G3 type=del 2024-09-12T00:37:42.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.892+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~CHVWP81W5VUT.0 size=608535 2024-09-12T00:37:42.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.892+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=CHVWP81W5VUT tag=TCNQKKWX5JU5 type=write size=1657111 2024-09-12T00:37:42.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.893+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~IJ913M28OQLC.0 size=1048576 2024-09-12T00:37:42.893 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.894+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~IJ913M28OQLC.1 size=639362 2024-09-12T00:37:42.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.896+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=IJ913M28OQLC tag=WJTZYGI5IH4L type=write size=2736514 2024-09-12T00:37:42.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.898+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=9IXHMS5D3I4T type=del size=2522304 2024-09-12T00:37:42.898 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.899+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~AQLQLRTJ27QF.0 size=1048576 2024-09-12T00:37:42.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.900+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~AQLQLRTJ27QF.1 size=1048576 2024-09-12T00:37:42.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.901+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~AQLQLRTJ27QF.2 size=303457 2024-09-12T00:37:42.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.904+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=AQLQLRTJ27QF tag=4G2HSG3YBOD2 type=write size=3449185 2024-09-12T00:37:42.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.905+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=EIT0JOE9PYUL type=del size=3788792 2024-09-12T00:37:42.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.907+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=7JVU33Q3X33X type=del 2024-09-12T00:37:42.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.909+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=RQL9WG9KN0KD type=del size=1000097 2024-09-12T00:37:42.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.912+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=R69441H6MI0J type=del 2024-09-12T00:37:42.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.913+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=H8BVPA6MX3ZK type=del size=634450 2024-09-12T00:37:42.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.914+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=HVT1TNXNI5AU type=del 2024-09-12T00:37:42.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.916+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=86SMNTCNV3UZ type=del size=125394 2024-09-12T00:37:42.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.917+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~LGEZ7T36WCFU.0 size=1048576 2024-09-12T00:37:42.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.917+0000 7fcd44281780 1 < canceled part key=_multipart_QVULC3H9QGXE.2~LGEZ7T36WCFU.1 size=1048576 2024-09-12T00:37:42.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.918+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~LGEZ7T36WCFU.2 size=794110 2024-09-12T00:37:42.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.920+0000 7fcd44281780 1 < canceled multipart upload key=QVULC3H9QGXE upload=LGEZ7T36WCFU tag=SXDLE02LRK3K type=write size=3939838 2024-09-12T00:37:42.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.922+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=QICQ1KBCVK9M type=del size=1781416 2024-09-12T00:37:42.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.923+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=R06Y7MUQ9RS9 type=del 2024-09-12T00:37:42.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.924+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=CZD2MP373KRN type=del size=2420347 2024-09-12T00:37:42.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.926+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~3Z04JZN6BH05.0 size=586249 2024-09-12T00:37:42.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.928+0000 7fcd44281780 1 < completed multipart upload key=526O814C10YW upload=3Z04JZN6BH05 tag=94ZBMVPS886E type=write size=1634825 2024-09-12T00:37:42.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.931+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~BA24V1XEBVB9.0 size=1048576 2024-09-12T00:37:42.930 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.932+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~BA24V1XEBVB9.1 size=188144 2024-09-12T00:37:42.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.932+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=BA24V1XEBVB9 tag=TA04WFHM4GNO type=write size=2285296 2024-09-12T00:37:42.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.933+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~IUBN74VR91C6.0 size=359583 2024-09-12T00:37:42.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.935+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=IUBN74VR91C6 tag=27SXXPRU82IB type=write size=1408159 2024-09-12T00:37:42.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.936+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=HQLK7FKKEPVC type=write size=364257 2024-09-12T00:37:42.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.938+0000 7fcd44281780 1 < completed delete operation key=8U004LC8IYLQ tag=WB8A33YIMIR1 type=del 2024-09-12T00:37:42.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.939+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=BVN5L36U78CW type=del size=2738259 2024-09-12T00:37:42.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.940+0000 7fcd44281780 1 < canceled part key=_multipart_NIDHAXQF55WX.2~BMDRWJSTVANQ.0 size=1048576 2024-09-12T00:37:42.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.941+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~BMDRWJSTVANQ.1 size=1048576 2024-09-12T00:37:42.941 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.942+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~BMDRWJSTVANQ.2 size=496644 2024-09-12T00:37:42.943 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.944+0000 7fcd44281780 1 < canceled multipart upload key=NIDHAXQF55WX upload=BMDRWJSTVANQ tag=9CFZWZ0VOK71 type=write size=3642372 2024-09-12T00:37:42.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.945+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=BH3415DJ603F type=del size=2410821 2024-09-12T00:37:42.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.947+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=B2PB3G815TFO type=del 2024-09-12T00:37:42.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.948+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=19VW9VMEE29U type=del size=739279 2024-09-12T00:37:42.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.949+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=R5TGTZDGZKDU type=del 2024-09-12T00:37:42.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.951+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=555L0A5AP4A2 type=write size=833524 2024-09-12T00:37:42.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.953+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=N0YNLCMISGM7 type=del 2024-09-12T00:37:42.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.954+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=5THNW6FB287M type=del size=1202463 2024-09-12T00:37:42.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.955+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=I90V0PW4E790 type=del 2024-09-12T00:37:42.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.957+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=T89TL52NEYXM type=write size=391476 2024-09-12T00:37:42.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.958+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~CHVWP81W5VUT.0 size=608535 2024-09-12T00:37:42.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.960+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=CHVWP81W5VUT tag=TCNQKKWX5JU5 type=write size=1657111 2024-09-12T00:37:42.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.962+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=UU89T5PMZ6C4 type=del size=1448062 2024-09-12T00:37:42.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.965+0000 7fcd44281780 1 < suggested update operation key=DKJ44Z9COIIK tag=9IXHMS5D3I4T type=del size=2522304 2024-09-12T00:37:42.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.966+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=J8U0232AZSZG type=write size=662128 2024-09-12T00:37:42.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.967+0000 7fcd44281780 1 < canceled operation key=UWS056JN3IXO tag=EIT0JOE9PYUL type=del size=3788792 2024-09-12T00:37:42.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.969+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=9EM0T8V4FN65 type=write size=247895 2024-09-12T00:37:42.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.970+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=RQL9WG9KN0KD type=del 2024-09-12T00:37:42.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.971+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=DZ6KF9COQMSJ type=del size=3473281 2024-09-12T00:37:42.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.972+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=H8BVPA6MX3ZK type=del 2024-09-12T00:37:42.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.974+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=4HU51346WWOK type=del size=3068187 2024-09-12T00:37:42.974 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.975+0000 7fcd44281780 -1 < failed to complete operation key=DKJ44Z9COIIK tag=86SMNTCNV3UZ type=del size=125394: (22) Invalid argument 2024-09-12T00:37:42.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.977+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=UZNTAVLM6T3Q type=del size=1879876 2024-09-12T00:37:42.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.980+0000 7fcd44281780 1 < suggested update operation key=VOO70F2NBKL0 tag=QICQ1KBCVK9M type=del size=1781416 2024-09-12T00:37:42.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.982+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=N557YIG2FYNW type=del size=3009620 2024-09-12T00:37:42.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.984+0000 7fcd44281780 1 < suggested remove operation key=AJ5AUTM2J9MT tag=CZD2MP373KRN type=del 2024-09-12T00:37:42.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.986+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=Y3JB6W4RY28R type=del size=3378205 2024-09-12T00:37:42.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.987+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~BA24V1XEBVB9.0 size=1048576 2024-09-12T00:37:42.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.988+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~BA24V1XEBVB9.1 size=188144 2024-09-12T00:37:42.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.990+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=BA24V1XEBVB9 tag=TA04WFHM4GNO type=write size=2285296 2024-09-12T00:37:42.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.993+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~LY9NJAEUZWFW.0 size=230223 2024-09-12T00:37:42.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.993+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=LY9NJAEUZWFW tag=5H73EBGWLZW9 type=write size=1278799 2024-09-12T00:37:42.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.996+0000 7fcd44281780 1 < suggested remove operation key=KJ0C43WLAFLI tag=HQLK7FKKEPVC type=write 2024-09-12T00:37:42.998 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.999+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~GW37PKUIK86P.0 size=1043058 2024-09-12T00:37:42.998 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:42.999+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=GW37PKUIK86P tag=XNI82HMURZQC type=write size=2091634 2024-09-12T00:37:42.999 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.000+0000 7fcd44281780 1 < canceled operation key=0O62FO4WVZG6 tag=BVN5L36U78CW type=del size=2738259 2024-09-12T00:37:43.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.001+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=S1UFD6MRFIEH type=write size=492362 2024-09-12T00:37:43.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.003+0000 7fcd44281780 1 < canceled operation key=NIDHAXQF55WX tag=BH3415DJ603F type=del size=2410821 2024-09-12T00:37:43.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.005+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~G4U1DR2WWT59.0 size=276216 2024-09-12T00:37:43.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.005+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=G4U1DR2WWT59 tag=2HUDD8RCOIEF type=write size=1324792 2024-09-12T00:37:43.007 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.008+0000 7fcd44281780 1 < suggested remove operation key=O12Z8THB62AJ tag=19VW9VMEE29U type=del 2024-09-12T00:37:43.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.011+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~JQOU8N7FZG1A.0 size=1048576 2024-09-12T00:37:43.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.012+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~JQOU8N7FZG1A.1 size=644625 2024-09-12T00:37:43.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.012+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=JQOU8N7FZG1A tag=EBJV0EV9QHUG type=write size=2741777 2024-09-12T00:37:43.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.014+0000 7fcd44281780 1 < suggested update operation key=UXY6K0AVI4EK tag=555L0A5AP4A2 type=write size=833524 2024-09-12T00:37:43.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.016+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=5DL7E2PWIR7O type=write size=887668 2024-09-12T00:37:43.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.017+0000 7fcd44281780 1 < canceled operation key=0OEDZ5O2LN8H tag=5THNW6FB287M type=del size=1202463 2024-09-12T00:37:43.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.020+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~K1WC0L9CK6TA.0 size=716331 2024-09-12T00:37:43.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.020+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=K1WC0L9CK6TA tag=436JX0413USA type=write size=1764907 2024-09-12T00:37:43.021 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.022+0000 7fcd44281780 1 < completed write operation key=4RU6HTH4J0U1 tag=T89TL52NEYXM type=write size=391476 2024-09-12T00:37:43.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.024+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=GFVZLIE2WJ7X type=del size=105091 2024-09-12T00:37:43.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.024+0000 7fcd44281780 -1 < no bi entry to suggest for operation key=O12Z8THB62AJ tag=UU89T5PMZ6C4 type=del size=1448062: (2) No such file or directory 2024-09-12T00:37:43.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.027+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~PTIQJG9YDBDE.0 size=332057 2024-09-12T00:37:43.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.027+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=PTIQJG9YDBDE tag=M9AXJSD5EUXH type=write size=1380633 2024-09-12T00:37:43.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.028+0000 7fcd44281780 1 < completed write operation key=G8O8VXTUPQVP tag=J8U0232AZSZG type=write size=662128 2024-09-12T00:37:43.028 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.029+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=S7FU5B3CNXLT type=del size=1016781 2024-09-12T00:37:43.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.031+0000 7fcd44281780 1 < completed write operation key=Z6I6598B6J5I tag=9EM0T8V4FN65 type=write size=247895 2024-09-12T00:37:43.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.033+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~9HCFDHD7PUTW.0 size=29696 2024-09-12T00:37:43.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.033+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=9HCFDHD7PUTW tag=BKMP70DPODUG type=write size=1078272 2024-09-12T00:37:43.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.035+0000 7fcd44281780 1 < completed delete operation key=QVULC3H9QGXE tag=DZ6KF9COQMSJ type=del 2024-09-12T00:37:43.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.036+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=SOS6U6EN9EMK type=write size=387044 2024-09-12T00:37:43.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.038+0000 7fcd44281780 1 < completed delete operation key=XTNXNF3D0HFK tag=4HU51346WWOK type=del 2024-09-12T00:37:43.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.040+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=EYPCKFUZM8Y8 type=del size=1133083 2024-09-12T00:37:43.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.041+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=UZNTAVLM6T3Q type=del 2024-09-12T00:37:43.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.042+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=5XT3L4832L3L type=del size=3522628 2024-09-12T00:37:43.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.044+0000 7fcd44281780 -1 < failed to complete operation key=O12Z8THB62AJ tag=N557YIG2FYNW type=del size=3009620: (22) Invalid argument 2024-09-12T00:37:43.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.046+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=5D964UCTC80C type=del size=1797228 2024-09-12T00:37:43.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.048+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=Y3JB6W4RY28R type=del 2024-09-12T00:37:43.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.049+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=09U9T44CIC81 type=del size=3546428 2024-09-12T00:37:43.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.051+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~LY9NJAEUZWFW.0 size=230223 2024-09-12T00:37:43.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.053+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=LY9NJAEUZWFW tag=5H73EBGWLZW9 type=write size=1278799 2024-09-12T00:37:43.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.056+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~BWKDSJ9GSQ61.0 size=369243 2024-09-12T00:37:43.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.056+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=BWKDSJ9GSQ61 tag=GEK5OS0RELWO type=write size=1417819 2024-09-12T00:37:43.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.057+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~GW37PKUIK86P.0 size=1043058 2024-09-12T00:37:43.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.059+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=GW37PKUIK86P tag=XNI82HMURZQC type=write size=2091634 2024-09-12T00:37:43.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.062+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~WZ0NMZH5MX9D.0 size=540611 2024-09-12T00:37:43.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.062+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=WZ0NMZH5MX9D tag=KJDAK9E0N0QG type=write size=1589187 2024-09-12T00:37:43.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.063+0000 7fcd44281780 1 < completed write operation key=526O814C10YW tag=S1UFD6MRFIEH type=write size=492362 2024-09-12T00:37:43.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.065+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=HAM9OFIRHXDI type=del size=1296769 2024-09-12T00:37:43.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.066+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~G4U1DR2WWT59.0 size=276216 2024-09-12T00:37:43.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.068+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=G4U1DR2WWT59 tag=2HUDD8RCOIEF type=write size=1324792 2024-09-12T00:37:43.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.071+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~41AWCA9FK047.0 size=1048576 2024-09-12T00:37:43.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.072+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~41AWCA9FK047.1 size=389349 2024-09-12T00:37:43.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.072+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=41AWCA9FK047 tag=ML9H5UXZ4C8S type=write size=2486501 2024-09-12T00:37:43.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.073+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~JQOU8N7FZG1A.0 size=1048576 2024-09-12T00:37:43.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.075+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~JQOU8N7FZG1A.1 size=644625 2024-09-12T00:37:43.076 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.077+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=JQOU8N7FZG1A tag=EBJV0EV9QHUG type=write size=2741777 2024-09-12T00:37:43.077 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.078+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=ZJ8XWCNHQJ6Z type=del size=3981117 2024-09-12T00:37:43.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.080+0000 7fcd44281780 1 < completed write operation key=UWS056JN3IXO tag=5DL7E2PWIR7O type=write size=887668 2024-09-12T00:37:43.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.081+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=QRIJFDWXX2OW type=del size=2213593 2024-09-12T00:37:43.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.082+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~K1WC0L9CK6TA.0 size=716331 2024-09-12T00:37:43.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.085+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=K1WC0L9CK6TA tag=436JX0413USA type=write size=1764907 2024-09-12T00:37:43.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.087+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~HFNGN6GTGTYD.0 size=925564 2024-09-12T00:37:43.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.088+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=HFNGN6GTGTYD tag=6Z21BPAS28H2 type=write size=1974140 2024-09-12T00:37:43.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.090+0000 7fcd44281780 1 < suggested update operation key=UWS056JN3IXO tag=GFVZLIE2WJ7X type=del size=105091 2024-09-12T00:37:43.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.092+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=2XVXQ2TR6OUK type=del size=2535399 2024-09-12T00:37:43.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.093+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~PTIQJG9YDBDE.0 size=332057 2024-09-12T00:37:43.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.096+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=PTIQJG9YDBDE tag=M9AXJSD5EUXH type=write size=1380633 2024-09-12T00:37:43.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.097+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=21UBQE9E1V2L type=write size=887060 2024-09-12T00:37:43.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.099+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=S7FU5B3CNXLT type=del 2024-09-12T00:37:43.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.100+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=J3PEFVJTM4LE type=del size=748267 2024-09-12T00:37:43.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.102+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~9HCFDHD7PUTW.0 size=29696 2024-09-12T00:37:43.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.104+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=9HCFDHD7PUTW tag=BKMP70DPODUG type=write size=1078272 2024-09-12T00:37:43.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.106+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~GN34N0J2M2AD.0 size=1026729 2024-09-12T00:37:43.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.106+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=GN34N0J2M2AD tag=7L5U00V7FQZG type=write size=2075305 2024-09-12T00:37:43.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.108+0000 7fcd44281780 1 < completed write operation key=QVULC3H9QGXE tag=SOS6U6EN9EMK type=write size=387044 2024-09-12T00:37:43.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.109+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=DH3GLOWGPJ0J type=del size=4146827 2024-09-12T00:37:43.111 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.112+0000 7fcd44281780 1 < suggested remove operation key=0OEDZ5O2LN8H tag=EYPCKFUZM8Y8 type=del 2024-09-12T00:37:43.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.114+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=R6H2IEMZ7P2G type=del size=3121689 2024-09-12T00:37:43.114 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.115+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=5XT3L4832L3L type=del 2024-09-12T00:37:43.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.118+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~DQWSEE85Y7FJ.0 size=1048576 2024-09-12T00:37:43.118 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.119+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~DQWSEE85Y7FJ.1 size=177675 2024-09-12T00:37:43.118 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.119+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=DQWSEE85Y7FJ tag=IUSK69XLA917 type=write size=2274827 2024-09-12T00:37:43.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.121+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=5D964UCTC80C type=del 2024-09-12T00:37:43.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.123+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~GYMOUOOUZXY9.0 size=1048576 2024-09-12T00:37:43.123 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.125+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~GYMOUOOUZXY9.1 size=1048576 2024-09-12T00:37:43.125 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.126+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~GYMOUOOUZXY9.2 size=86742 2024-09-12T00:37:43.125 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.126+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=GYMOUOOUZXY9 tag=N91F4IKDUIRK type=write size=3232470 2024-09-12T00:37:43.126 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.127+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=09U9T44CIC81 type=del 2024-09-12T00:37:43.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.129+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=5VKVMI0X3JUJ type=del size=1975474 2024-09-12T00:37:43.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.131+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~BWKDSJ9GSQ61.0 size=369243 2024-09-12T00:37:43.132 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.133+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=BWKDSJ9GSQ61 tag=GEK5OS0RELWO type=write size=1417819 2024-09-12T00:37:43.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.134+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=8DLWF560BMRV type=write size=253425 2024-09-12T00:37:43.135 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.136+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~WZ0NMZH5MX9D.0 size=540611 2024-09-12T00:37:43.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.139+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=WZ0NMZH5MX9D tag=KJDAK9E0N0QG type=write size=1589187 2024-09-12T00:37:43.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.142+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~QA9UKK785DCN.0 size=1048576 2024-09-12T00:37:43.142 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.143+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~QA9UKK785DCN.1 size=910752 2024-09-12T00:37:43.142 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.143+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=QA9UKK785DCN tag=ZGOYE1A8VQ81 type=write size=3007904 2024-09-12T00:37:43.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.145+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=HAM9OFIRHXDI type=del 2024-09-12T00:37:43.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.146+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=VRO2RXBR60CO type=del size=380775 2024-09-12T00:37:43.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.148+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~41AWCA9FK047.0 size=1048576 2024-09-12T00:37:43.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.149+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~41AWCA9FK047.1 size=389349 2024-09-12T00:37:43.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.151+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=41AWCA9FK047 tag=ML9H5UXZ4C8S type=write size=2486501 2024-09-12T00:37:43.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.154+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~8D6G50VPVJVZ.0 size=1048576 2024-09-12T00:37:43.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.155+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~8D6G50VPVJVZ.1 size=1048576 2024-09-12T00:37:43.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.157+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~8D6G50VPVJVZ.2 size=97870 2024-09-12T00:37:43.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.157+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=8D6G50VPVJVZ tag=N9HRUQ1BJLT7 type=write size=3243598 2024-09-12T00:37:43.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.158+0000 7fcd44281780 1 < canceled operation key=KJ0C43WLAFLI tag=ZJ8XWCNHQJ6Z type=del size=3981117 2024-09-12T00:37:43.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.161+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~ELMHYFTIQP0A.0 size=347247 2024-09-12T00:37:43.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.161+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=ELMHYFTIQP0A tag=Q44DMSD6RNQB type=write size=1395823 2024-09-12T00:37:43.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.164+0000 7fcd44281780 1 < suggested remove operation key=AJ5AUTM2J9MT tag=QRIJFDWXX2OW type=del 2024-09-12T00:37:43.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.167+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~AAF704J6K58C.0 size=882443 2024-09-12T00:37:43.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.167+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=AAF704J6K58C tag=VY795AO5KF8M type=write size=1931019 2024-09-12T00:37:43.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.168+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~HFNGN6GTGTYD.0 size=925564 2024-09-12T00:37:43.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.171+0000 7fcd44281780 1 < completed multipart upload key=4RU6HTH4J0U1 upload=HFNGN6GTGTYD tag=6Z21BPAS28H2 type=write size=1974140 2024-09-12T00:37:43.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.172+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=673RWJPS3U78 type=del size=379760 2024-09-12T00:37:43.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.174+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=2XVXQ2TR6OUK type=del 2024-09-12T00:37:43.175 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.176+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~RBQJ76XQK1AJ.0 size=834942 2024-09-12T00:37:43.175 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.176+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=RBQJ76XQK1AJ tag=YROD0KF8AXD3 type=write size=1883518 2024-09-12T00:37:43.176 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.178+0000 7fcd44281780 1 < completed write operation key=NIDHAXQF55WX tag=21UBQE9E1V2L type=write size=887060 2024-09-12T00:37:43.178 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.179+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=VER506YN1LIL type=write size=802777 2024-09-12T00:37:43.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.180+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=J3PEFVJTM4LE type=del 2024-09-12T00:37:43.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.184+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~CT2KRAC4YBRG.0 size=1048576 2024-09-12T00:37:43.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.185+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~CT2KRAC4YBRG.1 size=1048576 2024-09-12T00:37:43.185 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.186+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~CT2KRAC4YBRG.2 size=329106 2024-09-12T00:37:43.185 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.186+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=CT2KRAC4YBRG tag=U0AKM3LYW42B type=write size=3474834 2024-09-12T00:37:43.186 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.187+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~GN34N0J2M2AD.0 size=1026729 2024-09-12T00:37:43.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.189+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=GN34N0J2M2AD tag=7L5U00V7FQZG type=write size=2075305 2024-09-12T00:37:43.189 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.191+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=2HJKW46D5MEC type=del size=3669090 2024-09-12T00:37:43.191 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.192+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=DH3GLOWGPJ0J type=del 2024-09-12T00:37:43.192 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.193+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=VDXWQ7FZWRF5 type=write size=472678 2024-09-12T00:37:43.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.195+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=R6H2IEMZ7P2G type=del 2024-09-12T00:37:43.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.197+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=M8GC3B1754FT type=del size=1777122 2024-09-12T00:37:43.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.198+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~DQWSEE85Y7FJ.0 size=1048576 2024-09-12T00:37:43.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.199+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~DQWSEE85Y7FJ.1 size=177675 2024-09-12T00:37:43.200 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.201+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=DQWSEE85Y7FJ tag=IUSK69XLA917 type=write size=2274827 2024-09-12T00:37:43.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.204+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~NUBRA8KX777B.0 size=1048576 2024-09-12T00:37:43.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.205+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~NUBRA8KX777B.1 size=392141 2024-09-12T00:37:43.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.205+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=NUBRA8KX777B tag=U082NCMCO5RV type=write size=2489293 2024-09-12T00:37:43.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.206+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~GYMOUOOUZXY9.0 size=1048576 2024-09-12T00:37:43.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.207+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~GYMOUOOUZXY9.1 size=1048576 2024-09-12T00:37:43.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.208+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~GYMOUOOUZXY9.2 size=86742 2024-09-12T00:37:43.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.211+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=GYMOUOOUZXY9 tag=N91F4IKDUIRK type=write size=3232470 2024-09-12T00:37:43.212 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.213+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~4NE4SX9B2CS1.0 size=1048576 2024-09-12T00:37:43.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.214+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~4NE4SX9B2CS1.1 size=799488 2024-09-12T00:37:43.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.214+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=4NE4SX9B2CS1 tag=0WNKRO8YA9IL type=write size=2896640 2024-09-12T00:37:43.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.216+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=5VKVMI0X3JUJ type=del 2024-09-12T00:37:43.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.218+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~OQV1BDZFJKJ0.0 size=1048576 2024-09-12T00:37:43.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.219+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~OQV1BDZFJKJ0.1 size=341097 2024-09-12T00:37:43.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.219+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=OQV1BDZFJKJ0 tag=X7ZKYMFRAKSX type=write size=2438249 2024-09-12T00:37:43.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.222+0000 7fcd44281780 1 < suggested remove operation key=DKJ44Z9COIIK tag=8DLWF560BMRV type=write 2024-09-12T00:37:43.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.225+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~LVPND7FWTNQD.0 size=1048576 2024-09-12T00:37:43.225 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.226+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~LVPND7FWTNQD.1 size=1048576 2024-09-12T00:37:43.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.227+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~LVPND7FWTNQD.2 size=184195 2024-09-12T00:37:43.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.227+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=LVPND7FWTNQD tag=Y6BFGRGC2FP1 type=write size=3329923 2024-09-12T00:37:43.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.228+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~QA9UKK785DCN.0 size=1048576 2024-09-12T00:37:43.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.230+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~QA9UKK785DCN.1 size=910752 2024-09-12T00:37:43.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.232+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=QA9UKK785DCN tag=ZGOYE1A8VQ81 type=write size=3007904 2024-09-12T00:37:43.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.235+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~RALBU9ON2G4M.0 size=1048576 2024-09-12T00:37:43.235 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.236+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~RALBU9ON2G4M.1 size=1048576 2024-09-12T00:37:43.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.237+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~RALBU9ON2G4M.2 size=871983 2024-09-12T00:37:43.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.237+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=RALBU9ON2G4M tag=YLZQ8GINYPEV type=write size=4017711 2024-09-12T00:37:43.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.239+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=VRO2RXBR60CO type=del 2024-09-12T00:37:43.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.241+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~0T8ILWRHFP0L.0 size=1048576 2024-09-12T00:37:43.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.242+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~0T8ILWRHFP0L.1 size=1048576 2024-09-12T00:37:43.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.244+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~0T8ILWRHFP0L.2 size=137604 2024-09-12T00:37:43.243 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.244+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=0T8ILWRHFP0L tag=48WW2BB37EV8 type=write size=3283332 2024-09-12T00:37:43.244 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.245+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~8D6G50VPVJVZ.0 size=1048576 2024-09-12T00:37:43.245 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.247+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~8D6G50VPVJVZ.1 size=1048576 2024-09-12T00:37:43.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.248+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~8D6G50VPVJVZ.2 size=97870 2024-09-12T00:37:43.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.250+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=8D6G50VPVJVZ tag=N9HRUQ1BJLT7 type=write size=3243598 2024-09-12T00:37:43.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.252+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=GC6FMSP8C9QW type=del size=2723735 2024-09-12T00:37:43.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.253+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~ELMHYFTIQP0A.0 size=347247 2024-09-12T00:37:43.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.256+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=ELMHYFTIQP0A tag=Q44DMSD6RNQB type=write size=1395823 2024-09-12T00:37:43.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.257+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=R0CDFIYEUBXI type=del size=268057 2024-09-12T00:37:43.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.258+0000 7fcd44281780 1 < canceled part key=_multipart_KNBCXZF3JGNL.2~AAF704J6K58C.0 size=882443 2024-09-12T00:37:43.259 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.260+0000 7fcd44281780 1 < canceled multipart upload key=KNBCXZF3JGNL upload=AAF704J6K58C tag=VY795AO5KF8M type=write size=1931019 2024-09-12T00:37:43.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.263+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~DGBZY5EJCRBV.0 size=1048576 2024-09-12T00:37:43.262 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.264+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~DGBZY5EJCRBV.1 size=652237 2024-09-12T00:37:43.263 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.264+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=DGBZY5EJCRBV tag=GO4QIW2CDSID type=write size=2749389 2024-09-12T00:37:43.264 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.265+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=673RWJPS3U78 type=del 2024-09-12T00:37:43.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.268+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~KLHMAYHMR0NG.0 size=425892 2024-09-12T00:37:43.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.268+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=KLHMAYHMR0NG tag=D242CPZ9I7Q3 type=write size=1474468 2024-09-12T00:37:43.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.269+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~RBQJ76XQK1AJ.0 size=834942 2024-09-12T00:37:43.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.272+0000 7fcd44281780 1 < completed multipart upload key=UWS056JN3IXO upload=RBQJ76XQK1AJ tag=YROD0KF8AXD3 type=write size=1883518 2024-09-12T00:37:43.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.275+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~JRENLR0ZFNXI.0 size=680098 2024-09-12T00:37:43.274 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.275+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=JRENLR0ZFNXI tag=1MJAZZ4TM56S type=write size=1728674 2024-09-12T00:37:43.275 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.276+0000 7fcd44281780 1 < completed write operation key=UXY6K0AVI4EK tag=VER506YN1LIL type=write size=802777 2024-09-12T00:37:43.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.277+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=FQMGQDOPJVXT type=write size=588208 2024-09-12T00:37:43.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.279+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~CT2KRAC4YBRG.0 size=1048576 2024-09-12T00:37:43.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.280+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~CT2KRAC4YBRG.1 size=1048576 2024-09-12T00:37:43.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.280+0000 7fcd44281780 1 < canceled part key=_multipart_7UCICX0GHHQ1.2~CT2KRAC4YBRG.2 size=329106 2024-09-12T00:37:43.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.282+0000 7fcd44281780 1 < canceled multipart upload key=7UCICX0GHHQ1 upload=CT2KRAC4YBRG tag=U0AKM3LYW42B type=write size=3474834 2024-09-12T00:37:43.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.284+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=9LV0PPKVZIP4 type=del size=2738718 2024-09-12T00:37:43.284 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.285+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=2HJKW46D5MEC type=del 2024-09-12T00:37:43.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.288+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~FW1XIU94TD9F.0 size=1048576 2024-09-12T00:37:43.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.289+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~FW1XIU94TD9F.1 size=1048576 2024-09-12T00:37:43.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.290+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~FW1XIU94TD9F.2 size=1032416 2024-09-12T00:37:43.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.290+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=FW1XIU94TD9F tag=RJIREK9XZJVB type=write size=4178144 2024-09-12T00:37:43.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.292+0000 7fcd44281780 1 < completed write operation key=QVULC3H9QGXE tag=VDXWQ7FZWRF5 type=write size=472678 2024-09-12T00:37:43.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.293+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=8XO0NF32F9A4 type=del size=2208311 2024-09-12T00:37:43.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.295+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=M8GC3B1754FT type=del 2024-09-12T00:37:43.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.298+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~E0R4V1LT6AOW.0 size=1048576 2024-09-12T00:37:43.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.299+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~E0R4V1LT6AOW.1 size=35711 2024-09-12T00:37:43.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.299+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=E0R4V1LT6AOW tag=Q01Y95MTM0AK type=write size=2132863 2024-09-12T00:37:43.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.300+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~NUBRA8KX777B.0 size=1048576 2024-09-12T00:37:43.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.301+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~NUBRA8KX777B.1 size=392141 2024-09-12T00:37:43.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.304+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=NUBRA8KX777B tag=U082NCMCO5RV type=write size=2489293 2024-09-12T00:37:43.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.305+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=9X03R9O1A5US type=write size=766381 2024-09-12T00:37:43.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.307+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~4NE4SX9B2CS1.0 size=1048576 2024-09-12T00:37:43.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.308+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~4NE4SX9B2CS1.1 size=799488 2024-09-12T00:37:43.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.311+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=4NE4SX9B2CS1 tag=0WNKRO8YA9IL type=write size=2896640 2024-09-12T00:37:43.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.313+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=0BEAH0A9RJ9Q type=del size=1574668 2024-09-12T00:37:43.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.314+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~OQV1BDZFJKJ0.0 size=1048576 2024-09-12T00:37:43.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.316+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~OQV1BDZFJKJ0.1 size=341097 2024-09-12T00:37:43.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.318+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=OQV1BDZFJKJ0 tag=X7ZKYMFRAKSX type=write size=2438249 2024-09-12T00:37:43.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.321+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~ZMMMAW5S0FV7.0 size=210953 2024-09-12T00:37:43.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.321+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=ZMMMAW5S0FV7 tag=PH3L9DJ3LRGG type=write size=1259529 2024-09-12T00:37:43.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.322+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~LVPND7FWTNQD.0 size=1048576 2024-09-12T00:37:43.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.322+0000 7fcd44281780 1 < canceled part key=_multipart_QVULC3H9QGXE.2~LVPND7FWTNQD.1 size=1048576 2024-09-12T00:37:43.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.322+0000 7fcd44281780 1 < canceled part key=_multipart_QVULC3H9QGXE.2~LVPND7FWTNQD.2 size=184195 2024-09-12T00:37:43.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.324+0000 7fcd44281780 1 < canceled multipart upload key=QVULC3H9QGXE upload=LVPND7FWTNQD tag=Y6BFGRGC2FP1 type=write size=3329923 2024-09-12T00:37:43.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.326+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=4S5M27GM40IZ type=write size=373225 2024-09-12T00:37:43.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.328+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~RALBU9ON2G4M.0 size=1048576 2024-09-12T00:37:43.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.329+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~RALBU9ON2G4M.1 size=1048576 2024-09-12T00:37:43.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.330+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~RALBU9ON2G4M.2 size=871983 2024-09-12T00:37:43.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.333+0000 7fcd44281780 1 < completed multipart upload key=UWS056JN3IXO upload=RALBU9ON2G4M tag=YLZQ8GINYPEV type=write size=4017711 2024-09-12T00:37:43.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.334+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=0K0AAFKR4JEL type=write size=52995 2024-09-12T00:37:43.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.336+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~0T8ILWRHFP0L.0 size=1048576 2024-09-12T00:37:43.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.337+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~0T8ILWRHFP0L.1 size=1048576 2024-09-12T00:37:43.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.338+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~0T8ILWRHFP0L.2 size=137604 2024-09-12T00:37:43.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.340+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=0T8ILWRHFP0L tag=48WW2BB37EV8 type=write size=3283332 2024-09-12T00:37:43.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.343+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~2PAATCQX51P7.0 size=1048576 2024-09-12T00:37:43.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.344+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~2PAATCQX51P7.1 size=55607 2024-09-12T00:37:43.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.344+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=2PAATCQX51P7 tag=MM8SA7VSJGZ0 type=write size=2152759 2024-09-12T00:37:43.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.345+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=GC6FMSP8C9QW type=del 2024-09-12T00:37:43.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.347+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=TYGIR6RCXUYC type=write size=863509 2024-09-12T00:37:43.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.348+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=R0CDFIYEUBXI type=del 2024-09-12T00:37:43.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.350+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=MC88CW2X0CH7 type=del size=2111422 2024-09-12T00:37:43.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.351+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~DGBZY5EJCRBV.0 size=1048576 2024-09-12T00:37:43.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.353+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~DGBZY5EJCRBV.1 size=652237 2024-09-12T00:37:43.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.355+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=DGBZY5EJCRBV tag=GO4QIW2CDSID type=write size=2749389 2024-09-12T00:37:43.357 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.358+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~P78XZKV2TIS0.0 size=1048576 2024-09-12T00:37:43.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.360+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~P78XZKV2TIS0.1 size=1048576 2024-09-12T00:37:43.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.361+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~P78XZKV2TIS0.2 size=828403 2024-09-12T00:37:43.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.361+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=P78XZKV2TIS0 tag=VY086ZICM9DM type=write size=3974131 2024-09-12T00:37:43.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.363+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~KLHMAYHMR0NG.0 size=425892 2024-09-12T00:37:43.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.365+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=KLHMAYHMR0NG tag=D242CPZ9I7Q3 type=write size=1474468 2024-09-12T00:37:43.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.366+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=2APED22WRUKE type=del size=2437358 2024-09-12T00:37:43.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.368+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~JRENLR0ZFNXI.0 size=680098 2024-09-12T00:37:43.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.370+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=JRENLR0ZFNXI tag=1MJAZZ4TM56S type=write size=1728674 2024-09-12T00:37:43.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.372+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=DG1HDN5STOXV type=del size=738861 2024-09-12T00:37:43.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.373+0000 7fcd44281780 1 < completed write operation key=IK8POOY7ZWNF tag=FQMGQDOPJVXT type=write size=588208 2024-09-12T00:37:43.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.376+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~2OAF1XCCNDZV.0 size=1048576 2024-09-12T00:37:43.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.377+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~2OAF1XCCNDZV.1 size=1048576 2024-09-12T00:37:43.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.377+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~2OAF1XCCNDZV.2 size=216846 2024-09-12T00:37:43.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.377+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=2OAF1XCCNDZV tag=M4O0C2SY7S2C type=write size=3362574 2024-09-12T00:37:43.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.379+0000 7fcd44281780 1 < completed delete operation key=XTNXNF3D0HFK tag=9LV0PPKVZIP4 type=del 2024-09-12T00:37:43.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.380+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=E4F0QRJU4P3M type=write size=40609 2024-09-12T00:37:43.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.382+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~FW1XIU94TD9F.0 size=1048576 2024-09-12T00:37:43.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.383+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~FW1XIU94TD9F.1 size=1048576 2024-09-12T00:37:43.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.384+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~FW1XIU94TD9F.2 size=1032416 2024-09-12T00:37:43.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.386+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=FW1XIU94TD9F tag=RJIREK9XZJVB type=write size=4178144 2024-09-12T00:37:43.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.389+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~UL6FVQ5ELESW.0 size=1048576 2024-09-12T00:37:43.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.390+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~UL6FVQ5ELESW.1 size=790079 2024-09-12T00:37:43.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.390+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=UL6FVQ5ELESW tag=8KWZAIYT6BAA type=write size=2887231 2024-09-12T00:37:43.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.392+0000 7fcd44281780 1 < completed delete operation key=8U004LC8IYLQ tag=8XO0NF32F9A4 type=del 2024-09-12T00:37:43.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.394+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~E0TM4AU6Q1PE.0 size=1048576 2024-09-12T00:37:43.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.395+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~E0TM4AU6Q1PE.1 size=981459 2024-09-12T00:37:43.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.395+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=E0TM4AU6Q1PE tag=XIVMR55EM5TU type=write size=3078611 2024-09-12T00:37:43.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.397+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~E0R4V1LT6AOW.0 size=1048576 2024-09-12T00:37:43.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.398+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~E0R4V1LT6AOW.1 size=35711 2024-09-12T00:37:43.399 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.400+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=E0R4V1LT6AOW tag=Q01Y95MTM0AK type=write size=2132863 2024-09-12T00:37:43.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.402+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=G9CWAGZIWROU type=del size=3921146 2024-09-12T00:37:43.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.403+0000 7fcd44281780 1 < completed write operation key=UWS056JN3IXO tag=9X03R9O1A5US type=write size=766381 2024-09-12T00:37:43.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.405+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=CJHVKSH4NUAJ type=del size=3190317 2024-09-12T00:37:43.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.406+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=0BEAH0A9RJ9Q type=del 2024-09-12T00:37:43.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.408+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=9IJ31UL2KUY2 type=del size=1592487 2024-09-12T00:37:43.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.409+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~ZMMMAW5S0FV7.0 size=210953 2024-09-12T00:37:43.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.411+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=ZMMMAW5S0FV7 tag=PH3L9DJ3LRGG type=write size=1259529 2024-09-12T00:37:43.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.413+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=O2D2H1HJIFDC type=del size=1114195 2024-09-12T00:37:43.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.414+0000 7fcd44281780 1 < completed write operation key=UXY6K0AVI4EK tag=4S5M27GM40IZ type=write size=373225 2024-09-12T00:37:43.415 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.416+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=W9ASWVFAFKK8 type=del size=3911537 2024-09-12T00:37:43.416 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.417+0000 7fcd44281780 1 < completed write operation key=0ELZXPZCRPGP tag=0K0AAFKR4JEL type=write size=52995 2024-09-12T00:37:43.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.420+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~LK4YB9FXT6S9.0 size=1048576 2024-09-12T00:37:43.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.421+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~LK4YB9FXT6S9.1 size=1048576 2024-09-12T00:37:43.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.422+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~LK4YB9FXT6S9.2 size=22929 2024-09-12T00:37:43.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.422+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=LK4YB9FXT6S9 tag=1A7OP94XN528 type=write size=3168657 2024-09-12T00:37:43.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.424+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~2PAATCQX51P7.0 size=1048576 2024-09-12T00:37:43.423 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.425+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~2PAATCQX51P7.1 size=55607 2024-09-12T00:37:43.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.427+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=2PAATCQX51P7 tag=MM8SA7VSJGZ0 type=write size=2152759 2024-09-12T00:37:43.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.430+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~T1UCEV5W5X8F.0 size=1048576 2024-09-12T00:37:43.430 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.431+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~T1UCEV5W5X8F.1 size=1048576 2024-09-12T00:37:43.431 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.432+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~T1UCEV5W5X8F.2 size=258368 2024-09-12T00:37:43.431 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.432+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=T1UCEV5W5X8F tag=WXVWM09RQ1RQ type=write size=3404096 2024-09-12T00:37:43.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.434+0000 7fcd44281780 1 < completed write operation key=DKJ44Z9COIIK tag=TYGIR6RCXUYC type=write size=863509 2024-09-12T00:37:43.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.436+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~900GORF4JF6N.0 size=1048576 2024-09-12T00:37:43.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.438+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~900GORF4JF6N.1 size=1048576 2024-09-12T00:37:43.437 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.439+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~900GORF4JF6N.2 size=918090 2024-09-12T00:37:43.437 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.439+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=900GORF4JF6N tag=E93NBRJXOZWI type=write size=4063818 2024-09-12T00:37:43.439 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.440+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=MC88CW2X0CH7 type=del 2024-09-12T00:37:43.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.442+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=7JYNSOJPPADV type=del size=3467804 2024-09-12T00:37:43.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.443+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~P78XZKV2TIS0.0 size=1048576 2024-09-12T00:37:43.444 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.445+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~P78XZKV2TIS0.1 size=1048576 2024-09-12T00:37:43.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.448+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~P78XZKV2TIS0.2 size=828403 2024-09-12T00:37:43.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.451+0000 7fcd44281780 1 < completed multipart upload key=526O814C10YW upload=P78XZKV2TIS0 tag=VY086ZICM9DM type=write size=3974131 2024-09-12T00:37:43.451 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.452+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=D76MFZ2C20DQ type=write size=883441 2024-09-12T00:37:43.453 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.455+0000 7fcd44281780 1 < suggested update operation key=EXP8U6QNSMQ0 tag=2APED22WRUKE type=del size=2437358 2024-09-12T00:37:43.455 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.456+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=79VPG5SIKFWQ type=del size=3795089 2024-09-12T00:37:43.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.458+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=DG1HDN5STOXV type=del 2024-09-12T00:37:43.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.460+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~MK6HXEIZ7FI2.0 size=940391 2024-09-12T00:37:43.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.460+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=MK6HXEIZ7FI2 tag=RPQF36ZVXKQ5 type=write size=1988967 2024-09-12T00:37:43.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.462+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~2OAF1XCCNDZV.0 size=1048576 2024-09-12T00:37:43.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.463+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~2OAF1XCCNDZV.1 size=1048576 2024-09-12T00:37:43.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.464+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~2OAF1XCCNDZV.2 size=216846 2024-09-12T00:37:43.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.467+0000 7fcd44281780 1 < completed multipart upload key=B5OH55MQGSGJ upload=2OAF1XCCNDZV tag=M4O0C2SY7S2C type=write size=3362574 2024-09-12T00:37:43.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.468+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=XVOFDN10X9P7 type=write size=58639 2024-09-12T00:37:43.468 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.469+0000 7fcd44281780 1 < completed write operation key=QVULC3H9QGXE tag=E4F0QRJU4P3M type=write size=40609 2024-09-12T00:37:43.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.472+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~5TXQE1TU45WZ.0 size=488201 2024-09-12T00:37:43.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.472+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=5TXQE1TU45WZ tag=NQBEB3TXEUCZ type=write size=1536777 2024-09-12T00:37:43.472 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.474+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~UL6FVQ5ELESW.0 size=1048576 2024-09-12T00:37:43.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.475+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~UL6FVQ5ELESW.1 size=790079 2024-09-12T00:37:43.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.477+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=UL6FVQ5ELESW tag=8KWZAIYT6BAA type=write size=2887231 2024-09-12T00:37:43.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.478+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=CXAQN46AJAES type=del size=21755 2024-09-12T00:37:43.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.479+0000 7fcd44281780 1 < canceled part key=_multipart_0O62FO4WVZG6.2~E0TM4AU6Q1PE.0 size=1048576 2024-09-12T00:37:43.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.480+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~E0TM4AU6Q1PE.1 size=981459 2024-09-12T00:37:43.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.482+0000 7fcd44281780 1 < canceled multipart upload key=0O62FO4WVZG6 upload=E0TM4AU6Q1PE tag=XIVMR55EM5TU type=write size=3078611 2024-09-12T00:37:43.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.485+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~1D0ZFPGYNU1C.0 size=1048576 2024-09-12T00:37:43.485 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.486+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~1D0ZFPGYNU1C.1 size=277784 2024-09-12T00:37:43.485 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.486+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=1D0ZFPGYNU1C tag=HLZLWQIC6N8J type=write size=2374936 2024-09-12T00:37:43.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.488+0000 7fcd44281780 1 < canceled operation key=7UCICX0GHHQ1 tag=G9CWAGZIWROU type=del size=3921146 2024-09-12T00:37:43.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.490+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~M5SPXHA7KIDX.0 size=1048576 2024-09-12T00:37:43.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.491+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~M5SPXHA7KIDX.1 size=1048576 2024-09-12T00:37:43.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.493+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~M5SPXHA7KIDX.2 size=955385 2024-09-12T00:37:43.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.493+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=M5SPXHA7KIDX tag=ERQQLMR0KNSO type=write size=4101113 2024-09-12T00:37:43.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.494+0000 7fcd44281780 -1 < failed to complete operation key=EXP8U6QNSMQ0 tag=CJHVKSH4NUAJ type=del size=3190317: (22) Invalid argument 2024-09-12T00:37:43.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.497+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~L768NL2V4HPQ.0 size=1048576 2024-09-12T00:37:43.497 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.498+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~L768NL2V4HPQ.1 size=147692 2024-09-12T00:37:43.497 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.498+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=L768NL2V4HPQ tag=ZYBDMTZR19TY type=write size=2244844 2024-09-12T00:37:43.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.500+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=9IJ31UL2KUY2 type=del 2024-09-12T00:37:43.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.501+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=FZMQEMKMY5W5 type=write size=939220 2024-09-12T00:37:43.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.504+0000 7fcd44281780 1 < suggested update operation key=QVULC3H9QGXE tag=O2D2H1HJIFDC type=del size=1114195 2024-09-12T00:37:43.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.507+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~M9KRTWJVWORX.0 size=1048576 2024-09-12T00:37:43.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.508+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~M9KRTWJVWORX.1 size=1048576 2024-09-12T00:37:43.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.509+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~M9KRTWJVWORX.2 size=248540 2024-09-12T00:37:43.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.509+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=M9KRTWJVWORX tag=2KWSYX7GIQAL type=write size=3394268 2024-09-12T00:37:43.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.511+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=W9ASWVFAFKK8 type=del 2024-09-12T00:37:43.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.512+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=BZ0RVSN9DSP8 type=write size=364400 2024-09-12T00:37:43.512 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.513+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~LK4YB9FXT6S9.0 size=1048576 2024-09-12T00:37:43.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.515+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~LK4YB9FXT6S9.1 size=1048576 2024-09-12T00:37:43.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.516+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~LK4YB9FXT6S9.2 size=22929 2024-09-12T00:37:43.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.518+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=LK4YB9FXT6S9 tag=1A7OP94XN528 type=write size=3168657 2024-09-12T00:37:43.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.521+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~OR8R58Z248TQ.0 size=72148 2024-09-12T00:37:43.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.521+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=OR8R58Z248TQ tag=3S3V1F0VQHGS type=write size=1120724 2024-09-12T00:37:43.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.521+0000 7fcd44281780 1 < canceled part key=_multipart_UWS056JN3IXO.2~T1UCEV5W5X8F.0 size=1048576 2024-09-12T00:37:43.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.523+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~T1UCEV5W5X8F.1 size=1048576 2024-09-12T00:37:43.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.524+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~T1UCEV5W5X8F.2 size=258368 2024-09-12T00:37:43.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.526+0000 7fcd44281780 1 < canceled multipart upload key=UWS056JN3IXO upload=T1UCEV5W5X8F tag=WXVWM09RQ1RQ type=write size=3404096 2024-09-12T00:37:43.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.527+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=K3GIEPX0ITMD type=del size=792083 2024-09-12T00:37:43.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.529+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~900GORF4JF6N.0 size=1048576 2024-09-12T00:37:43.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.530+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~900GORF4JF6N.1 size=1048576 2024-09-12T00:37:43.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.531+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~900GORF4JF6N.2 size=918090 2024-09-12T00:37:43.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.534+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=900GORF4JF6N tag=E93NBRJXOZWI type=write size=4063818 2024-09-12T00:37:43.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.536+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=9ALTR1OAZ17Q type=write size=829954 2024-09-12T00:37:43.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.538+0000 7fcd44281780 1 < suggested remove operation key=EXP8U6QNSMQ0 tag=7JYNSOJPPADV type=del 2024-09-12T00:37:43.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.540+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=3VA23AYM310J type=del size=3032849 2024-09-12T00:37:43.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.544+0000 7fcd44281780 1 < suggested update operation key=0O62FO4WVZG6 tag=D76MFZ2C20DQ type=write size=883441 2024-09-12T00:37:43.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.545+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=J1OE1YN9PSJV type=del size=2111228 2024-09-12T00:37:43.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.547+0000 7fcd44281780 -1 < failed to complete operation key=QVULC3H9QGXE tag=79VPG5SIKFWQ type=del size=3795089: (22) Invalid argument 2024-09-12T00:37:43.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.548+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=CHLSP46TB87B type=del size=914066 2024-09-12T00:37:43.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.550+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~MK6HXEIZ7FI2.0 size=940391 2024-09-12T00:37:43.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.552+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=MK6HXEIZ7FI2 tag=RPQF36ZVXKQ5 type=write size=1988967 2024-09-12T00:37:43.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.554+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=O1YWVD48UU0D type=del size=1795737 2024-09-12T00:37:43.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.555+0000 7fcd44281780 1 < completed write operation key=4RU6HTH4J0U1 tag=XVOFDN10X9P7 type=write size=58639 2024-09-12T00:37:43.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.557+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=HHI9UDVD264S type=del size=1611524 2024-09-12T00:37:43.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.558+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~5TXQE1TU45WZ.0 size=488201 2024-09-12T00:37:43.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.561+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=5TXQE1TU45WZ tag=NQBEB3TXEUCZ type=write size=1536777 2024-09-12T00:37:43.561 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.562+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=1FU3222XOREV type=del size=2769915 2024-09-12T00:37:43.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.564+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=CXAQN46AJAES type=del 2024-09-12T00:37:43.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.566+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~N74VZBLMQNF9.0 size=1048576 2024-09-12T00:37:43.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.567+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~N74VZBLMQNF9.1 size=169883 2024-09-12T00:37:43.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.567+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=N74VZBLMQNF9 tag=VFZO7L5WYD59 type=write size=2267035 2024-09-12T00:37:43.567 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.568+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~1D0ZFPGYNU1C.0 size=1048576 2024-09-12T00:37:43.568 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.570+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~1D0ZFPGYNU1C.1 size=277784 2024-09-12T00:37:43.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.572+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=1D0ZFPGYNU1C tag=HLZLWQIC6N8J type=write size=2374936 2024-09-12T00:37:43.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.573+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=8JT445GJM238 type=del size=4071645 2024-09-12T00:37:43.573 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.575+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~M5SPXHA7KIDX.0 size=1048576 2024-09-12T00:37:43.574 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.576+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~M5SPXHA7KIDX.1 size=1048576 2024-09-12T00:37:43.576 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.577+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~M5SPXHA7KIDX.2 size=955385 2024-09-12T00:37:43.578 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.579+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=M5SPXHA7KIDX tag=ERQQLMR0KNSO type=write size=4101113 2024-09-12T00:37:43.580 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.581+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=H71XPL325V71 type=del size=2143139 2024-09-12T00:37:43.581 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.582+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~L768NL2V4HPQ.0 size=1048576 2024-09-12T00:37:43.582 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.584+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~L768NL2V4HPQ.1 size=147692 2024-09-12T00:37:43.584 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.586+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=L768NL2V4HPQ tag=ZYBDMTZR19TY type=write size=2244844 2024-09-12T00:37:43.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.588+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~4VQKFFTO3T5C.0 size=1048576 2024-09-12T00:37:43.588 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.589+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~4VQKFFTO3T5C.1 size=1048576 2024-09-12T00:37:43.589 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.590+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~4VQKFFTO3T5C.2 size=936963 2024-09-12T00:37:43.589 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.590+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=4VQKFFTO3T5C tag=UL70ALEWELPU type=write size=4082691 2024-09-12T00:37:43.590 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.591+0000 7fcd44281780 1 < completed write operation key=8U004LC8IYLQ tag=FZMQEMKMY5W5 type=write size=939220 2024-09-12T00:37:43.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.595+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~ZBO6H7K44MGF.0 size=1048576 2024-09-12T00:37:43.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.596+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~ZBO6H7K44MGF.1 size=42914 2024-09-12T00:37:43.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.596+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=ZBO6H7K44MGF tag=AVT51J491A6S type=write size=2140066 2024-09-12T00:37:43.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.597+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~M9KRTWJVWORX.0 size=1048576 2024-09-12T00:37:43.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.598+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~M9KRTWJVWORX.1 size=1048576 2024-09-12T00:37:43.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.599+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~M9KRTWJVWORX.2 size=248540 2024-09-12T00:37:43.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.601+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=M9KRTWJVWORX tag=2KWSYX7GIQAL type=write size=3394268 2024-09-12T00:37:43.601 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.602+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=C0A8C9L1MY15 type=del size=3948487 2024-09-12T00:37:43.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.603+0000 7fcd44281780 1 < canceled operation key=DKJ44Z9COIIK tag=BZ0RVSN9DSP8 type=write size=364400 2024-09-12T00:37:43.603 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.605+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=1V2Q8HYPMQ5P type=del size=4143995 2024-09-12T00:37:43.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.606+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~OR8R58Z248TQ.0 size=72148 2024-09-12T00:37:43.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.608+0000 7fcd44281780 1 < completed multipart upload key=526O814C10YW upload=OR8R58Z248TQ tag=3S3V1F0VQHGS type=write size=1120724 2024-09-12T00:37:43.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.611+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~09X92WL0PEHO.0 size=34092 2024-09-12T00:37:43.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.611+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=09X92WL0PEHO tag=IKGPCF75B4XE type=write size=1082668 2024-09-12T00:37:43.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.612+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=K3GIEPX0ITMD type=del 2024-09-12T00:37:43.612 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.613+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=ZNJTTV60LQGB type=del size=2166640 2024-09-12T00:37:43.613 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.615+0000 7fcd44281780 1 < completed write operation key=0AVE0W4OV1AU tag=9ALTR1OAZ17Q type=write size=829954 2024-09-12T00:37:43.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.617+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~Q8J4AZ3M7AQV.0 size=1048576 2024-09-12T00:37:43.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.618+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~Q8J4AZ3M7AQV.1 size=543237 2024-09-12T00:37:43.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.618+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=Q8J4AZ3M7AQV tag=X05Z77NS67GQ type=write size=2640389 2024-09-12T00:37:43.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.619+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=3VA23AYM310J type=del 2024-09-12T00:37:43.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.622+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~CB5L1SXG4LTW.0 size=1048576 2024-09-12T00:37:43.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.623+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~CB5L1SXG4LTW.1 size=1048576 2024-09-12T00:37:43.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.624+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~CB5L1SXG4LTW.2 size=320997 2024-09-12T00:37:43.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.624+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=CB5L1SXG4LTW tag=NXO0HT0N4NMP type=write size=3466725 2024-09-12T00:37:43.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.626+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=J1OE1YN9PSJV type=del 2024-09-12T00:37:43.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.627+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=ETZ3NHI8MUFP type=del size=2293623 2024-09-12T00:37:43.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.629+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=CHLSP46TB87B type=del 2024-09-12T00:37:43.630 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.632+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~UNIJ843QXV08.0 size=1048576 2024-09-12T00:37:43.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.633+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~UNIJ843QXV08.1 size=1048576 2024-09-12T00:37:43.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.634+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~UNIJ843QXV08.2 size=450468 2024-09-12T00:37:43.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.634+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=UNIJ843QXV08 tag=FD3Z8GJEQH5D type=write size=3596196 2024-09-12T00:37:43.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.637+0000 7fcd44281780 1 < suggested update operation key=O12Z8THB62AJ tag=O1YWVD48UU0D type=del size=1795737 2024-09-12T00:37:43.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.638+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=31UR7M3AZPJX type=write size=515654 2024-09-12T00:37:43.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.641+0000 7fcd44281780 1 < suggested remove operation key=B5OH55MQGSGJ tag=HHI9UDVD264S type=del 2024-09-12T00:37:43.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.642+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=YPUZFC036EBV type=write size=1036692 2024-09-12T00:37:43.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.643+0000 7fcd44281780 1 < canceled operation key=0AVE0W4OV1AU tag=1FU3222XOREV type=del size=2769915 2024-09-12T00:37:43.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.645+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=SY09J0EZIP7P type=del size=603538 2024-09-12T00:37:43.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.646+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~N74VZBLMQNF9.0 size=1048576 2024-09-12T00:37:43.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.648+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~N74VZBLMQNF9.1 size=169883 2024-09-12T00:37:43.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.650+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=N74VZBLMQNF9 tag=VFZO7L5WYD59 type=write size=2267035 2024-09-12T00:37:43.650 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.651+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=ATHZP6CAT6GR type=del size=2684261 2024-09-12T00:37:43.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.653+0000 7fcd44281780 1 < canceled operation key=XRW0CRE12S5B tag=8JT445GJM238 type=del size=4071645 2024-09-12T00:37:43.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.656+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~VJLEALQDB6IR.0 size=800659 2024-09-12T00:37:43.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.656+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=VJLEALQDB6IR tag=6YKVIH5BS0UM type=write size=1849235 2024-09-12T00:37:43.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.657+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=H71XPL325V71 type=del 2024-09-12T00:37:43.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.658+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=MI6IX4JUIVZJ type=write size=147341 2024-09-12T00:37:43.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.660+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~4VQKFFTO3T5C.0 size=1048576 2024-09-12T00:37:43.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.661+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~4VQKFFTO3T5C.1 size=1048576 2024-09-12T00:37:43.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.662+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~4VQKFFTO3T5C.2 size=936963 2024-09-12T00:37:43.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.665+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=4VQKFFTO3T5C tag=UL70ALEWELPU type=write size=4082691 2024-09-12T00:37:43.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.667+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~SRDRE45568OE.0 size=1048576 2024-09-12T00:37:43.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.668+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~SRDRE45568OE.1 size=227834 2024-09-12T00:37:43.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.668+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=SRDRE45568OE tag=JOCFOW36QKBT type=write size=2324986 2024-09-12T00:37:43.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.669+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~ZBO6H7K44MGF.0 size=1048576 2024-09-12T00:37:43.669 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.670+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~ZBO6H7K44MGF.1 size=42914 2024-09-12T00:37:43.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.672+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=ZBO6H7K44MGF tag=AVT51J491A6S type=write size=2140066 2024-09-12T00:37:43.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.674+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=GK0KSKMBUDDH type=write size=165063 2024-09-12T00:37:43.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.677+0000 7fcd44281780 1 < suggested update operation key=VOO70F2NBKL0 tag=C0A8C9L1MY15 type=del size=3948487 2024-09-12T00:37:43.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.678+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=8A1QY991VLB9 type=del size=2217337 2024-09-12T00:37:43.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.680+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=1V2Q8HYPMQ5P type=del 2024-09-12T00:37:43.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.681+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=56JR8Z43XCZ1 type=del size=3629562 2024-09-12T00:37:43.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.683+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~09X92WL0PEHO.0 size=34092 2024-09-12T00:37:43.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.685+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=09X92WL0PEHO tag=IKGPCF75B4XE type=write size=1082668 2024-09-12T00:37:43.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.687+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=WGWAFWPTEHCR type=del size=3474825 2024-09-12T00:37:43.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.688+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=ZNJTTV60LQGB type=del 2024-09-12T00:37:43.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.689+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=T3BGHSNAHV1J type=write size=847970 2024-09-12T00:37:43.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.691+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~Q8J4AZ3M7AQV.0 size=1048576 2024-09-12T00:37:43.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.692+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~Q8J4AZ3M7AQV.1 size=543237 2024-09-12T00:37:43.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.694+0000 7fcd44281780 1 < completed multipart upload key=UWS056JN3IXO upload=Q8J4AZ3M7AQV tag=X05Z77NS67GQ type=write size=2640389 2024-09-12T00:37:43.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.696+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=KAVOUJ1ZHRIA type=del size=3036307 2024-09-12T00:37:43.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.697+0000 7fcd44281780 1 < canceled part key=_multipart_8U004LC8IYLQ.2~CB5L1SXG4LTW.0 size=1048576 2024-09-12T00:37:43.698 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.699+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~CB5L1SXG4LTW.1 size=1048576 2024-09-12T00:37:43.699 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.700+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~CB5L1SXG4LTW.2 size=320997 2024-09-12T00:37:43.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.702+0000 7fcd44281780 1 < canceled multipart upload key=8U004LC8IYLQ upload=CB5L1SXG4LTW tag=NXO0HT0N4NMP type=write size=3466725 2024-09-12T00:37:43.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.705+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~3SN80Z05CABI.0 size=1048576 2024-09-12T00:37:43.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.706+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~3SN80Z05CABI.1 size=652269 2024-09-12T00:37:43.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.706+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=3SN80Z05CABI tag=JLFBRDOCWB9O type=write size=2749421 2024-09-12T00:37:43.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.708+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=ETZ3NHI8MUFP type=del 2024-09-12T00:37:43.707 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.709+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=45XOIZHGJSJ0 type=del size=2095645 2024-09-12T00:37:43.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.709+0000 7fcd44281780 1 < canceled part key=_multipart_526O814C10YW.2~UNIJ843QXV08.0 size=1048576 2024-09-12T00:37:43.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.711+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~UNIJ843QXV08.1 size=1048576 2024-09-12T00:37:43.712 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.713+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~UNIJ843QXV08.2 size=450468 2024-09-12T00:37:43.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.716+0000 7fcd44281780 1 < canceled multipart upload key=526O814C10YW upload=UNIJ843QXV08 tag=FD3Z8GJEQH5D type=write size=3596196 2024-09-12T00:37:43.716 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.717+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=1ZCL0L4IEM7T type=del size=1360546 2024-09-12T00:37:43.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.720+0000 7fcd44281780 1 < suggested update operation key=0AVE0W4OV1AU tag=31UR7M3AZPJX type=write size=515654 2024-09-12T00:37:43.722 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.723+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~RRH4L7HZA2AA.0 size=1048576 2024-09-12T00:37:43.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.724+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~RRH4L7HZA2AA.1 size=365236 2024-09-12T00:37:43.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.724+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=RRH4L7HZA2AA tag=S1IS1MAOBOCK type=write size=2462388 2024-09-12T00:37:43.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.726+0000 7fcd44281780 1 < completed write operation key=XTNXNF3D0HFK tag=YPUZFC036EBV type=write size=1036692 2024-09-12T00:37:43.726 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.727+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=PKS6X74VVYAU type=del size=3175730 2024-09-12T00:37:43.727 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.728+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=SY09J0EZIP7P type=del 2024-09-12T00:37:43.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.730+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=NV39KPQA5AIO type=del size=75656 2024-09-12T00:37:43.730 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.731+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=ATHZP6CAT6GR type=del 2024-09-12T00:37:43.731 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.733+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=BFWP3T05PPUD type=del size=612641 2024-09-12T00:37:43.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.734+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~VJLEALQDB6IR.0 size=800659 2024-09-12T00:37:43.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.736+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=VJLEALQDB6IR tag=6YKVIH5BS0UM type=write size=1849235 2024-09-12T00:37:43.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.738+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=32LKRH28JL2C type=del size=2986509 2024-09-12T00:37:43.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.740+0000 7fcd44281780 1 < completed write operation key=O12Z8THB62AJ tag=MI6IX4JUIVZJ type=write size=147341 2024-09-12T00:37:43.740 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.741+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=D8MURF3D7PWQ type=del size=3110299 2024-09-12T00:37:43.741 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.742+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~SRDRE45568OE.0 size=1048576 2024-09-12T00:37:43.742 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.744+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~SRDRE45568OE.1 size=227834 2024-09-12T00:37:43.745 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.746+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=SRDRE45568OE tag=JOCFOW36QKBT type=write size=2324986 2024-09-12T00:37:43.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.747+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=5SOS9XXOPEBT type=del size=3504633 2024-09-12T00:37:43.747 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.749+0000 7fcd44281780 1 < completed write operation key=RYSE2CKE5IRT tag=GK0KSKMBUDDH type=write size=165063 2024-09-12T00:37:43.749 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.750+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=1FK5PHNYL3G5 type=del size=3742418 2024-09-12T00:37:43.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.751+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=8A1QY991VLB9 type=del 2024-09-12T00:37:43.752 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.753+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=PGG75N4S7FV6 type=del size=3509492 2024-09-12T00:37:43.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.754+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=56JR8Z43XCZ1 type=del 2024-09-12T00:37:43.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.756+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=4OEU7K2WDZTI type=write size=167119 2024-09-12T00:37:43.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.757+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=WGWAFWPTEHCR type=del 2024-09-12T00:37:43.757 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.758+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=C1002OZMKIK4 type=del size=2220137 2024-09-12T00:37:43.759 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.760+0000 7fcd44281780 1 < completed write operation key=O12Z8THB62AJ tag=T3BGHSNAHV1J type=write size=847970 2024-09-12T00:37:43.760 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.761+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=FSQ1XPIROGZ8 type=write size=565180 2024-09-12T00:37:43.762 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.763+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=KAVOUJ1ZHRIA type=del 2024-09-12T00:37:43.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.764+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=JRAL06G82SBG type=del size=3744067 2024-09-12T00:37:43.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.766+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~3SN80Z05CABI.0 size=1048576 2024-09-12T00:37:43.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.767+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~3SN80Z05CABI.1 size=652269 2024-09-12T00:37:43.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.770+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=3SN80Z05CABI tag=JLFBRDOCWB9O type=write size=2749421 2024-09-12T00:37:43.770 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.771+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=TTUS5C7UOB2M type=del size=2948324 2024-09-12T00:37:43.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.774+0000 7fcd44281780 1 < suggested update operation key=CF7B7J3V1YFG tag=45XOIZHGJSJ0 type=del size=2095645 2024-09-12T00:37:43.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.775+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=GPWX0UZURJ31 type=del size=3301971 2024-09-12T00:37:43.775 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.777+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=1ZCL0L4IEM7T type=del 2024-09-12T00:37:43.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.778+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=AP5WJV21EQ0Z type=del size=137484 2024-09-12T00:37:43.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.779+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~RRH4L7HZA2AA.0 size=1048576 2024-09-12T00:37:43.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.781+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~RRH4L7HZA2AA.1 size=365236 2024-09-12T00:37:43.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.783+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=RRH4L7HZA2AA tag=S1IS1MAOBOCK type=write size=2462388 2024-09-12T00:37:43.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.785+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=LIHTE3Y2D07L type=write size=569510 2024-09-12T00:37:43.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.786+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=PKS6X74VVYAU type=del 2024-09-12T00:37:43.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.788+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=HS8TZV4WKIC9 type=del size=2775615 2024-09-12T00:37:43.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.789+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=NV39KPQA5AIO type=del 2024-09-12T00:37:43.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.790+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=T9SJ70GLS57I type=del size=4093438 2024-09-12T00:37:43.790 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.792+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=BFWP3T05PPUD type=del 2024-09-12T00:37:43.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.793+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=VXQCHT2E8RWX type=del size=1623985 2024-09-12T00:37:43.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.795+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=32LKRH28JL2C type=del 2024-09-12T00:37:43.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.796+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=XKX8MO8ANOB5 type=del size=2201518 2024-09-12T00:37:43.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.798+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=D8MURF3D7PWQ type=del 2024-09-12T00:37:43.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.799+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=YLA6CU4Z2INV type=write size=143448 2024-09-12T00:37:43.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.801+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=5SOS9XXOPEBT type=del 2024-09-12T00:37:43.802 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.804+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~H84S21ILFZMZ.0 size=1048576 2024-09-12T00:37:43.803 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.805+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~H84S21ILFZMZ.1 size=492338 2024-09-12T00:37:43.803 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.805+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=H84S21ILFZMZ tag=YVKERK4X7X0J type=write size=2589490 2024-09-12T00:37:43.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.806+0000 7fcd44281780 1 < canceled operation key=ZQSZDU87GAMV tag=1FK5PHNYL3G5 type=del size=3742418 2024-09-12T00:37:43.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.809+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~0E1UK39JEQFU.0 size=1048576 2024-09-12T00:37:43.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.810+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~0E1UK39JEQFU.1 size=1010742 2024-09-12T00:37:43.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.810+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=0E1UK39JEQFU tag=NYTYCTH6Y415 type=write size=3107894 2024-09-12T00:37:43.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.812+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=PGG75N4S7FV6 type=del 2024-09-12T00:37:43.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.813+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=DGVFY21RBAPU type=del size=2438718 2024-09-12T00:37:43.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.816+0000 7fcd44281780 1 < suggested update operation key=EXP8U6QNSMQ0 tag=4OEU7K2WDZTI type=write size=167119 2024-09-12T00:37:43.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.818+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=ACDE0IGYON7O type=write size=928403 2024-09-12T00:37:43.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.819+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=C1002OZMKIK4 type=del 2024-09-12T00:37:43.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.822+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~GFFUFMOM3FW8.0 size=1048576 2024-09-12T00:37:43.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.823+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~GFFUFMOM3FW8.1 size=116164 2024-09-12T00:37:43.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.823+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=GFFUFMOM3FW8 tag=8VVGSOH30C80 type=write size=2213316 2024-09-12T00:37:43.824 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.825+0000 7fcd44281780 1 < completed write operation key=VOO70F2NBKL0 tag=FSQ1XPIROGZ8 type=write size=565180 2024-09-12T00:37:43.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.826+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=QXCKXSQXSWYW type=del size=2691917 2024-09-12T00:37:43.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.828+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=JRAL06G82SBG type=del 2024-09-12T00:37:43.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.830+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~3KHZZ5W7AL1S.0 size=1048576 2024-09-12T00:37:43.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.831+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~3KHZZ5W7AL1S.1 size=1048576 2024-09-12T00:37:43.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.833+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~3KHZZ5W7AL1S.2 size=856724 2024-09-12T00:37:43.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.833+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=3KHZZ5W7AL1S tag=Z7H0QN2T26KK type=write size=4002452 2024-09-12T00:37:43.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.834+0000 7fcd44281780 1 < completed delete operation key=QVULC3H9QGXE tag=TTUS5C7UOB2M type=del 2024-09-12T00:37:43.835 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.837+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~Z2BNY02AACDB.0 size=1048576 2024-09-12T00:37:43.836 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.838+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~Z2BNY02AACDB.1 size=222679 2024-09-12T00:37:43.836 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.838+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=Z2BNY02AACDB tag=XHHAN658LBXX type=write size=2319831 2024-09-12T00:37:43.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.839+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=GPWX0UZURJ31 type=del 2024-09-12T00:37:43.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.842+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~H8KFCOUJB2QL.0 size=1048576 2024-09-12T00:37:43.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.843+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~H8KFCOUJB2QL.1 size=347210 2024-09-12T00:37:43.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.843+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=H8KFCOUJB2QL tag=VQL6445JSCKP type=write size=2444362 2024-09-12T00:37:43.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.844+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=AP5WJV21EQ0Z type=del 2024-09-12T00:37:43.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.847+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~TN4O5CDIWS18.0 size=85312 2024-09-12T00:37:43.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.847+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=TN4O5CDIWS18 tag=O8M8MSM80Z66 type=write size=1133888 2024-09-12T00:37:43.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.848+0000 7fcd44281780 1 < completed write operation key=QVULC3H9QGXE tag=LIHTE3Y2D07L type=write size=569510 2024-09-12T00:37:43.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.851+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=T6HBFVRZDNPH type=write size=20559 2024-09-12T00:37:43.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.854+0000 7fcd44281780 1 < suggested remove operation key=KNBCXZF3JGNL tag=HS8TZV4WKIC9 type=del 2024-09-12T00:37:43.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.855+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=Z6SWP016KK73 type=del size=2738062 2024-09-12T00:37:43.857 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.858+0000 7fcd44281780 1 < suggested remove operation key=KJ0C43WLAFLI tag=T9SJ70GLS57I type=del 2024-09-12T00:37:43.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.861+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~I70GZOGDCPTF.0 size=1048576 2024-09-12T00:37:43.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.862+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~I70GZOGDCPTF.1 size=950575 2024-09-12T00:37:43.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.862+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=I70GZOGDCPTF tag=64VB1GU6GBCM type=write size=3047727 2024-09-12T00:37:43.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.863+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=VXQCHT2E8RWX type=del 2024-09-12T00:37:43.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.865+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=0NM32G28WC9U type=del size=12344 2024-09-12T00:37:43.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.866+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=XKX8MO8ANOB5 type=del 2024-09-12T00:37:43.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.869+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~IF9W13J17WQ4.0 size=660674 2024-09-12T00:37:43.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.869+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=IF9W13J17WQ4 tag=GNH7QAV2O3BC type=write size=1709250 2024-09-12T00:37:43.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.870+0000 7fcd44281780 1 < completed write operation key=7UCICX0GHHQ1 tag=YLA6CU4Z2INV type=write size=143448 2024-09-12T00:37:43.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.871+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=I9ZY20KF4IG8 type=del size=3377045 2024-09-12T00:37:43.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.873+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~H84S21ILFZMZ.0 size=1048576 2024-09-12T00:37:43.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.874+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~H84S21ILFZMZ.1 size=492338 2024-09-12T00:37:43.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.876+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=H84S21ILFZMZ tag=YVKERK4X7X0J type=write size=2589490 2024-09-12T00:37:43.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.877+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=2TG4I58JPFF3 type=del size=1433056 2024-09-12T00:37:43.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.879+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~0E1UK39JEQFU.0 size=1048576 2024-09-12T00:37:43.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.880+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~0E1UK39JEQFU.1 size=1010742 2024-09-12T00:37:43.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.882+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=0E1UK39JEQFU tag=NYTYCTH6Y415 type=write size=3107894 2024-09-12T00:37:43.883 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.884+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=3JY6LRV8OYDR type=del size=462858 2024-09-12T00:37:43.884 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.885+0000 7fcd44281780 1 < canceled operation key=7UCICX0GHHQ1 tag=DGVFY21RBAPU type=del size=2438718 2024-09-12T00:37:43.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.888+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~V212Z2GHAMZ8.0 size=244016 2024-09-12T00:37:43.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.888+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=V212Z2GHAMZ8 tag=SRYBUZQ0VG3U type=write size=1292592 2024-09-12T00:37:43.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.889+0000 7fcd44281780 1 < completed write operation key=VXDTFEG8P23H tag=ACDE0IGYON7O type=write size=928403 2024-09-12T00:37:43.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.891+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=TEGNRZ1WWOFY type=del size=274078 2024-09-12T00:37:43.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.892+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~GFFUFMOM3FW8.0 size=1048576 2024-09-12T00:37:43.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.893+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~GFFUFMOM3FW8.1 size=116164 2024-09-12T00:37:43.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.895+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=GFFUFMOM3FW8 tag=8VVGSOH30C80 type=write size=2213316 2024-09-12T00:37:43.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.897+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=Z0I8BV67ANSL type=del size=1309839 2024-09-12T00:37:43.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.898+0000 7fcd44281780 1 < completed delete operation key=QVULC3H9QGXE tag=QXCKXSQXSWYW type=del 2024-09-12T00:37:43.898 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.900+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=132K9YP4VWTN type=write size=166160 2024-09-12T00:37:43.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.901+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~3KHZZ5W7AL1S.0 size=1048576 2024-09-12T00:37:43.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.902+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~3KHZZ5W7AL1S.1 size=1048576 2024-09-12T00:37:43.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.904+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~3KHZZ5W7AL1S.2 size=856724 2024-09-12T00:37:43.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.906+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=3KHZZ5W7AL1S tag=Z7H0QN2T26KK type=write size=4002452 2024-09-12T00:37:43.906 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.908+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=KQ1SYUOVVCLU type=del size=1945632 2024-09-12T00:37:43.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.909+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~Z2BNY02AACDB.0 size=1048576 2024-09-12T00:37:43.909 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.911+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~Z2BNY02AACDB.1 size=222679 2024-09-12T00:37:43.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.913+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=Z2BNY02AACDB tag=XHHAN658LBXX type=write size=2319831 2024-09-12T00:37:43.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.916+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~DM5JP6K4T9FS.0 size=1048576 2024-09-12T00:37:43.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.917+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~DM5JP6K4T9FS.1 size=1048576 2024-09-12T00:37:43.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.918+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~DM5JP6K4T9FS.2 size=73525 2024-09-12T00:37:43.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.918+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=DM5JP6K4T9FS tag=D765PSI4T8PX type=write size=3219253 2024-09-12T00:37:43.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.920+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~H8KFCOUJB2QL.0 size=1048576 2024-09-12T00:37:43.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.920+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~H8KFCOUJB2QL.1 size=347210 2024-09-12T00:37:43.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.923+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=H8KFCOUJB2QL tag=VQL6445JSCKP type=write size=2444362 2024-09-12T00:37:43.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.925+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~62FRFKUGLU9J.0 size=1048576 2024-09-12T00:37:43.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.926+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~62FRFKUGLU9J.1 size=117198 2024-09-12T00:37:43.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.927+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=62FRFKUGLU9J tag=BSIYA4ZMO2ZK type=write size=2214350 2024-09-12T00:37:43.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.928+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~TN4O5CDIWS18.0 size=85312 2024-09-12T00:37:43.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.930+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=TN4O5CDIWS18 tag=O8M8MSM80Z66 type=write size=1133888 2024-09-12T00:37:43.930 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.932+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=C30II8H54GHO type=write size=926789 2024-09-12T00:37:43.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.933+0000 7fcd44281780 1 < completed write operation key=7UCICX0GHHQ1 tag=T6HBFVRZDNPH type=write size=20559 2024-09-12T00:37:43.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.936+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~ZND45AHIT910.0 size=1048576 2024-09-12T00:37:43.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.937+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~ZND45AHIT910.1 size=671299 2024-09-12T00:37:43.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.937+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=ZND45AHIT910 tag=8WN9ET63TEPL type=write size=2768451 2024-09-12T00:37:43.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.938+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=Z6SWP016KK73 type=del 2024-09-12T00:37:43.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.940+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=HDVCJFR0JMLK type=del size=1071809 2024-09-12T00:37:43.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.941+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~I70GZOGDCPTF.0 size=1048576 2024-09-12T00:37:43.941 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.943+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~I70GZOGDCPTF.1 size=950575 2024-09-12T00:37:43.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.945+0000 7fcd44281780 1 < completed multipart upload key=B5OH55MQGSGJ upload=I70GZOGDCPTF tag=64VB1GU6GBCM type=write size=3047727 2024-09-12T00:37:43.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.946+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=K45MBZBB7G7T type=write size=717274 2024-09-12T00:37:43.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.948+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=0NM32G28WC9U type=del 2024-09-12T00:37:43.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.950+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~2GRD5QAI0T00.0 size=1048576 2024-09-12T00:37:43.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.951+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~2GRD5QAI0T00.1 size=211835 2024-09-12T00:37:43.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.951+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=2GRD5QAI0T00 tag=L8MDRXCAIID5 type=write size=2308987 2024-09-12T00:37:43.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.953+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~IF9W13J17WQ4.0 size=660674 2024-09-12T00:37:43.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.955+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=IF9W13J17WQ4 tag=GNH7QAV2O3BC type=write size=1709250 2024-09-12T00:37:43.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.956+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=BA2E5JPLZ04Q type=del size=1442492 2024-09-12T00:37:43.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.958+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=I9ZY20KF4IG8 type=del 2024-09-12T00:37:43.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.960+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~RTKKXPG32DLI.0 size=127816 2024-09-12T00:37:43.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.960+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=RTKKXPG32DLI tag=7F6DAQVCF0PL type=write size=1176392 2024-09-12T00:37:43.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.962+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=2TG4I58JPFF3 type=del 2024-09-12T00:37:43.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.965+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~7D0ULW5BG67U.0 size=681258 2024-09-12T00:37:43.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.965+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=7D0ULW5BG67U tag=C19UQOVJ76N8 type=write size=1729834 2024-09-12T00:37:43.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.966+0000 7fcd44281780 1 < canceled operation key=VXDTFEG8P23H tag=3JY6LRV8OYDR type=del size=462858 2024-09-12T00:37:43.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.967+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=URICAJ79E2VD type=del size=2618354 2024-09-12T00:37:43.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.969+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~V212Z2GHAMZ8.0 size=244016 2024-09-12T00:37:43.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.971+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=V212Z2GHAMZ8 tag=SRYBUZQ0VG3U type=write size=1292592 2024-09-12T00:37:43.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.973+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=A0KUV9EA2CJG type=del size=3391911 2024-09-12T00:37:43.974 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.976+0000 7fcd44281780 1 < suggested update operation key=XRW0CRE12S5B tag=TEGNRZ1WWOFY type=del size=274078 2024-09-12T00:37:43.977 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.978+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~4H5RZ0OKQONT.0 size=1048576 2024-09-12T00:37:43.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.979+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~4H5RZ0OKQONT.1 size=728940 2024-09-12T00:37:43.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.979+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=4H5RZ0OKQONT tag=0Z8RPBFW6GGB type=write size=2826092 2024-09-12T00:37:43.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.981+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=Z0I8BV67ANSL type=del 2024-09-12T00:37:43.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.984+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=QKJP291OYUI1 type=del size=3104740 2024-09-12T00:37:43.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.985+0000 7fcd44281780 1 < completed write operation key=0OEDZ5O2LN8H tag=132K9YP4VWTN type=write size=166160 2024-09-12T00:37:43.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.987+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=0L71J0GFJ8D9 type=del size=2263597 2024-09-12T00:37:43.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.988+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=KQ1SYUOVVCLU type=del 2024-09-12T00:37:43.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.990+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=QJF1AFJD69V0 type=del size=4174496 2024-09-12T00:37:43.990 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.991+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~DM5JP6K4T9FS.0 size=1048576 2024-09-12T00:37:43.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.992+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~DM5JP6K4T9FS.1 size=1048576 2024-09-12T00:37:43.993 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.994+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~DM5JP6K4T9FS.2 size=73525 2024-09-12T00:37:43.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.996+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=DM5JP6K4T9FS tag=D765PSI4T8PX type=write size=3219253 2024-09-12T00:37:43.998 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.999+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~Y8ZCOT262DH3.0 size=213876 2024-09-12T00:37:43.998 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:43.999+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=Y8ZCOT262DH3 tag=T5UAVDXO54R1 type=write size=1262452 2024-09-12T00:37:44.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.001+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~62FRFKUGLU9J.0 size=1048576 2024-09-12T00:37:44.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.002+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~62FRFKUGLU9J.1 size=117198 2024-09-12T00:37:44.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.005+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=62FRFKUGLU9J tag=BSIYA4ZMO2ZK type=write size=2214350 2024-09-12T00:37:44.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.007+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~I552Z5EKZRO4.0 size=847398 2024-09-12T00:37:44.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.007+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=I552Z5EKZRO4 tag=GLDT91MWJ058 type=write size=1895974 2024-09-12T00:37:44.007 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.009+0000 7fcd44281780 1 < completed write operation key=DKJ44Z9COIIK tag=C30II8H54GHO type=write size=926789 2024-09-12T00:37:44.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.011+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~YS0BI0IIYE96.0 size=191110 2024-09-12T00:37:44.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.011+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=YS0BI0IIYE96 tag=77AXY1KRQS3H type=write size=1239686 2024-09-12T00:37:44.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.012+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~ZND45AHIT910.0 size=1048576 2024-09-12T00:37:44.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.014+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~ZND45AHIT910.1 size=671299 2024-09-12T00:37:44.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.016+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=ZND45AHIT910 tag=8WN9ET63TEPL type=write size=2768451 2024-09-12T00:37:44.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.017+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=B3PABY9K19VM type=del size=1478708 2024-09-12T00:37:44.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.019+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=HDVCJFR0JMLK type=del 2024-09-12T00:37:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.020+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=J1KRZCKR9SDK type=del size=4101000 2024-09-12T00:37:44.021 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.022+0000 7fcd44281780 1 < canceled operation key=RYSE2CKE5IRT tag=K45MBZBB7G7T type=write size=717274 2024-09-12T00:37:44.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.025+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~C01GGNN9BLQB.0 size=1048576 2024-09-12T00:37:44.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.026+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~C01GGNN9BLQB.1 size=1048576 2024-09-12T00:37:44.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.027+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~C01GGNN9BLQB.2 size=583333 2024-09-12T00:37:44.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.027+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=C01GGNN9BLQB tag=VMYTW1TLIEYN type=write size=3729061 2024-09-12T00:37:44.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.029+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~2GRD5QAI0T00.0 size=1048576 2024-09-12T00:37:44.029 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.030+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~2GRD5QAI0T00.1 size=211835 2024-09-12T00:37:44.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.032+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=2GRD5QAI0T00 tag=L8MDRXCAIID5 type=write size=2308987 2024-09-12T00:37:44.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.035+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~AVPZB7G84QTL.0 size=754635 2024-09-12T00:37:44.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.035+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=AVPZB7G84QTL tag=Q7GIFJ6PLDHB type=write size=1803211 2024-09-12T00:37:44.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.036+0000 7fcd44281780 1 < completed delete operation key=0OEDZ5O2LN8H tag=BA2E5JPLZ04Q type=del 2024-09-12T00:37:44.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.038+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=JUHBB25ANQV4 type=write size=687483 2024-09-12T00:37:44.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.039+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~RTKKXPG32DLI.0 size=127816 2024-09-12T00:37:44.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.041+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=RTKKXPG32DLI tag=7F6DAQVCF0PL type=write size=1176392 2024-09-12T00:37:44.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.044+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~XWPDHXF79NTR.0 size=1048576 2024-09-12T00:37:44.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.045+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~XWPDHXF79NTR.1 size=131584 2024-09-12T00:37:44.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.045+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=XWPDHXF79NTR tag=M4U7AYNHMHM5 type=write size=2228736 2024-09-12T00:37:44.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.047+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~7D0ULW5BG67U.0 size=681258 2024-09-12T00:37:44.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.049+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=7D0ULW5BG67U tag=C19UQOVJ76N8 type=write size=1729834 2024-09-12T00:37:44.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.050+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=T6L8G1LZEJLR type=del size=1749645 2024-09-12T00:37:44.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.051+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=URICAJ79E2VD type=del 2024-09-12T00:37:44.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.053+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=C26XPKUL1SH1 type=del size=504268 2024-09-12T00:37:44.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.054+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=A0KUV9EA2CJG type=del 2024-09-12T00:37:44.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.057+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~ECNHWA9FYLJK.0 size=1048576 2024-09-12T00:37:44.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.058+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~ECNHWA9FYLJK.1 size=701893 2024-09-12T00:37:44.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.058+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=ECNHWA9FYLJK tag=F80113RUWX2P type=write size=2799045 2024-09-12T00:37:44.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.059+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~4H5RZ0OKQONT.0 size=1048576 2024-09-12T00:37:44.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.060+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~4H5RZ0OKQONT.1 size=728940 2024-09-12T00:37:44.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.063+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=4H5RZ0OKQONT tag=0Z8RPBFW6GGB type=write size=2826092 2024-09-12T00:37:44.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.065+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~W0Q8U47EHYYL.0 size=501653 2024-09-12T00:37:44.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.065+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=W0Q8U47EHYYL tag=68VB4TKXPT23 type=write size=1550229 2024-09-12T00:37:44.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.067+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=QKJP291OYUI1 type=del 2024-09-12T00:37:44.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.068+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=ZU0VE29WAHGA type=write size=606437 2024-09-12T00:37:44.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.069+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=0L71J0GFJ8D9 type=del 2024-09-12T00:37:44.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.071+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=US5GT96KWK78 type=del size=989387 2024-09-12T00:37:44.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.072+0000 7fcd44281780 1 < completed delete operation key=4RU6HTH4J0U1 tag=QJF1AFJD69V0 type=del 2024-09-12T00:37:44.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.074+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=2TO78ZXDTLQW type=del size=1647314 2024-09-12T00:37:44.073 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.074+0000 7fcd44281780 1 < canceled part key=_multipart_CF7B7J3V1YFG.2~Y8ZCOT262DH3.0 size=213876 2024-09-12T00:37:44.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.076+0000 7fcd44281780 1 < canceled multipart upload key=CF7B7J3V1YFG upload=Y8ZCOT262DH3 tag=T5UAVDXO54R1 type=write size=1262452 2024-09-12T00:37:44.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.078+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=VUJS17968R69 type=del size=1499301 2024-09-12T00:37:44.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.079+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~I552Z5EKZRO4.0 size=847398 2024-09-12T00:37:44.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.081+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=I552Z5EKZRO4 tag=GLDT91MWJ058 type=write size=1895974 2024-09-12T00:37:44.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.084+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~0H0E1MOLB5DD.0 size=1048576 2024-09-12T00:37:44.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.085+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~0H0E1MOLB5DD.1 size=293416 2024-09-12T00:37:44.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.085+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=0H0E1MOLB5DD tag=RZOEP76190LL type=write size=2390568 2024-09-12T00:37:44.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.086+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~YS0BI0IIYE96.0 size=191110 2024-09-12T00:37:44.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.088+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=YS0BI0IIYE96 tag=77AXY1KRQS3H type=write size=1239686 2024-09-12T00:37:44.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.091+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~USU3CXWJSW23.0 size=1048576 2024-09-12T00:37:44.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.092+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~USU3CXWJSW23.1 size=1048576 2024-09-12T00:37:44.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.093+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~USU3CXWJSW23.2 size=823529 2024-09-12T00:37:44.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.093+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=USU3CXWJSW23 tag=PJY8K9U2JJWX type=write size=3969257 2024-09-12T00:37:44.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.096+0000 7fcd44281780 1 < suggested update operation key=B5OH55MQGSGJ tag=B3PABY9K19VM type=del size=1478708 2024-09-12T00:37:44.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.098+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=DXXZ2CYM9KA7 type=del size=335983 2024-09-12T00:37:44.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.099+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=J1KRZCKR9SDK type=del 2024-09-12T00:37:44.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.101+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=3TNT8Q1OZV26 type=write size=650790 2024-09-12T00:37:44.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.102+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~C01GGNN9BLQB.0 size=1048576 2024-09-12T00:37:44.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.104+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~C01GGNN9BLQB.1 size=1048576 2024-09-12T00:37:44.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.105+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~C01GGNN9BLQB.2 size=583333 2024-09-12T00:37:44.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.107+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=C01GGNN9BLQB tag=VMYTW1TLIEYN type=write size=3729061 2024-09-12T00:37:44.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.109+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=M780E9V4IYOL type=del size=1083938 2024-09-12T00:37:44.110 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.111+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~AVPZB7G84QTL.0 size=754635 2024-09-12T00:37:44.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.114+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=AVPZB7G84QTL tag=Q7GIFJ6PLDHB type=write size=1803211 2024-09-12T00:37:44.114 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.115+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=X1WADI3JTSKL type=del size=663685 2024-09-12T00:37:44.117 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.119+0000 7fcd44281780 1 < suggested remove operation key=G8O8VXTUPQVP tag=JUHBB25ANQV4 type=write 2024-09-12T00:37:44.120 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.121+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~VMCHHP2PM88F.0 size=780408 2024-09-12T00:37:44.120 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.121+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=VMCHHP2PM88F tag=VFRJ389386RJ type=write size=1828984 2024-09-12T00:37:44.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.123+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~XWPDHXF79NTR.0 size=1048576 2024-09-12T00:37:44.123 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.124+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~XWPDHXF79NTR.1 size=131584 2024-09-12T00:37:44.125 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.126+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=XWPDHXF79NTR tag=M4U7AYNHMHM5 type=write size=2228736 2024-09-12T00:37:44.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.129+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~O9QDYLK6735Y.0 size=1048576 2024-09-12T00:37:44.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.130+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~O9QDYLK6735Y.1 size=1001406 2024-09-12T00:37:44.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.130+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=O9QDYLK6735Y tag=Q0SY9GHCC3H4 type=write size=3098558 2024-09-12T00:37:44.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.131+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=T6L8G1LZEJLR type=del 2024-09-12T00:37:44.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.134+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~V5Z3EMHLWOMA.0 size=713159 2024-09-12T00:37:44.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.134+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=V5Z3EMHLWOMA tag=7BJ41ZF676A3 type=write size=1761735 2024-09-12T00:37:44.135 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.137+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=C26XPKUL1SH1 type=del 2024-09-12T00:37:44.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.139+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~OGN3QEILPBH3.0 size=983000 2024-09-12T00:37:44.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.139+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=OGN3QEILPBH3 tag=DFWU2JO11ZW0 type=write size=2031576 2024-09-12T00:37:44.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.141+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~ECNHWA9FYLJK.0 size=1048576 2024-09-12T00:37:44.141 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.142+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~ECNHWA9FYLJK.1 size=701893 2024-09-12T00:37:44.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.144+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=ECNHWA9FYLJK tag=F80113RUWX2P type=write size=2799045 2024-09-12T00:37:44.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.147+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~IEFYQGMN4DAM.0 size=1048576 2024-09-12T00:37:44.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.148+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~IEFYQGMN4DAM.1 size=534322 2024-09-12T00:37:44.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.148+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=IEFYQGMN4DAM tag=DFXYJANVLMUR type=write size=2631474 2024-09-12T00:37:44.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.149+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~W0Q8U47EHYYL.0 size=501653 2024-09-12T00:37:44.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.151+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=W0Q8U47EHYYL tag=68VB4TKXPT23 type=write size=1550229 2024-09-12T00:37:44.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.153+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=LBWUMQ2BNF2D type=del size=3917534 2024-09-12T00:37:44.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.155+0000 7fcd44281780 1 < suggested remove operation key=0ELZXPZCRPGP tag=ZU0VE29WAHGA type=write 2024-09-12T00:37:44.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.157+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=386BWXAU2J89 type=write size=631622 2024-09-12T00:37:44.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.158+0000 7fcd44281780 1 < canceled operation key=O12Z8THB62AJ tag=US5GT96KWK78 type=del size=989387 2024-09-12T00:37:44.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.160+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=7ZG4Y8YO6D8G type=del size=3017381 2024-09-12T00:37:44.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.161+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=2TO78ZXDTLQW type=del 2024-09-12T00:37:44.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.164+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~MX1JF7R32KSV.0 size=1048576 2024-09-12T00:37:44.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.165+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~MX1JF7R32KSV.1 size=1048576 2024-09-12T00:37:44.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.166+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~MX1JF7R32KSV.2 size=307199 2024-09-12T00:37:44.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.166+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=MX1JF7R32KSV tag=9G7Q1ADH9IEC type=write size=3452927 2024-09-12T00:37:44.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.169+0000 7fcd44281780 1 < suggested remove operation key=VXDTFEG8P23H tag=VUJS17968R69 type=del 2024-09-12T00:37:44.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.170+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=R557RBQNQNHB type=write size=132848 2024-09-12T00:37:44.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.171+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~0H0E1MOLB5DD.0 size=1048576 2024-09-12T00:37:44.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.173+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~0H0E1MOLB5DD.1 size=293416 2024-09-12T00:37:44.174 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.175+0000 7fcd44281780 1 < completed multipart upload key=4RU6HTH4J0U1 upload=0H0E1MOLB5DD tag=RZOEP76190LL type=write size=2390568 2024-09-12T00:37:44.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.178+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~L22GOM3DZGD1.0 size=1048576 2024-09-12T00:37:44.178 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.179+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~L22GOM3DZGD1.1 size=1048576 2024-09-12T00:37:44.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.180+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~L22GOM3DZGD1.2 size=349102 2024-09-12T00:37:44.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.180+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=L22GOM3DZGD1 tag=NCT617IQ69IA type=write size=3494830 2024-09-12T00:37:44.180 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.182+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~USU3CXWJSW23.0 size=1048576 2024-09-12T00:37:44.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.183+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~USU3CXWJSW23.1 size=1048576 2024-09-12T00:37:44.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.184+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~USU3CXWJSW23.2 size=823529 2024-09-12T00:37:44.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.186+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=USU3CXWJSW23 tag=PJY8K9U2JJWX type=write size=3969257 2024-09-12T00:37:44.187 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.188+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~UOOWLP1K7AII.0 size=973689 2024-09-12T00:37:44.187 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.188+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=UOOWLP1K7AII tag=H33544G2QZ7W type=write size=2022265 2024-09-12T00:37:44.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.189+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=DXXZ2CYM9KA7 type=del 2024-09-12T00:37:44.189 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.190+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=LVGTD33NQIPU type=write size=292512 2024-09-12T00:37:44.190 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.192+0000 7fcd44281780 1 < completed write operation key=ZQSZDU87GAMV tag=3TNT8Q1OZV26 type=write size=650790 2024-09-12T00:37:44.192 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.193+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=Z3VY5ALLD35D type=del size=1724816 2024-09-12T00:37:44.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.194+0000 7fcd44281780 1 < canceled operation key=0O62FO4WVZG6 tag=M780E9V4IYOL type=del size=1083938 2024-09-12T00:37:44.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.195+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=O1DQ159Z0K18 type=write size=153524 2024-09-12T00:37:44.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.196+0000 7fcd44281780 -1 < failed to complete operation key=VXDTFEG8P23H tag=X1WADI3JTSKL type=del size=663685: (22) Invalid argument 2024-09-12T00:37:44.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.198+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=LIESC4GPHYZW type=del size=4052807 2024-09-12T00:37:44.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.199+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~VMCHHP2PM88F.0 size=780408 2024-09-12T00:37:44.200 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.202+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=VMCHHP2PM88F tag=VFRJ389386RJ type=write size=1828984 2024-09-12T00:37:44.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.203+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=M8X7VTIE6IM2 type=del size=32076 2024-09-12T00:37:44.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.204+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~O9QDYLK6735Y.0 size=1048576 2024-09-12T00:37:44.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.205+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~O9QDYLK6735Y.1 size=1001406 2024-09-12T00:37:44.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.207+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=O9QDYLK6735Y tag=Q0SY9GHCC3H4 type=write size=3098558 2024-09-12T00:37:44.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.209+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=KIY3C6IZPFXC type=del size=2466126 2024-09-12T00:37:44.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.210+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~V5Z3EMHLWOMA.0 size=713159 2024-09-12T00:37:44.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.213+0000 7fcd44281780 1 < completed multipart upload key=4RU6HTH4J0U1 upload=V5Z3EMHLWOMA tag=7BJ41ZF676A3 type=write size=1761735 2024-09-12T00:37:44.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.214+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=PP0EO6R8ODP7 type=del size=1346376 2024-09-12T00:37:44.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.215+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~OGN3QEILPBH3.0 size=983000 2024-09-12T00:37:44.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.217+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=OGN3QEILPBH3 tag=DFWU2JO11ZW0 type=write size=2031576 2024-09-12T00:37:44.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.219+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=QGML1TT37A0D type=write size=178334 2024-09-12T00:37:44.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.220+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~IEFYQGMN4DAM.0 size=1048576 2024-09-12T00:37:44.220 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.221+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~IEFYQGMN4DAM.1 size=534322 2024-09-12T00:37:44.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.225+0000 7fcd44281780 1 < completed multipart upload key=0AVE0W4OV1AU upload=IEFYQGMN4DAM tag=DFXYJANVLMUR type=write size=2631474 2024-09-12T00:37:44.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.227+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~CQ3KCV15ZSA7.0 size=880587 2024-09-12T00:37:44.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.227+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=CQ3KCV15ZSA7 tag=0ETMCHMT69GP type=write size=1929163 2024-09-12T00:37:44.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.230+0000 7fcd44281780 1 < suggested remove operation key=WXBMIJ4FC0VX tag=LBWUMQ2BNF2D type=del 2024-09-12T00:37:44.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.231+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=01SAJS7D5JPC type=del size=334064 2024-09-12T00:37:44.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.233+0000 7fcd44281780 1 < canceled operation key=AJ5AUTM2J9MT tag=386BWXAU2J89 type=write size=631622 2024-09-12T00:37:44.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.234+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=3V88B0TFIOBD type=del size=3417278 2024-09-12T00:37:44.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.236+0000 7fcd44281780 -1 < failed to complete operation key=VXDTFEG8P23H tag=7ZG4Y8YO6D8G type=del size=3017381: (22) Invalid argument 2024-09-12T00:37:44.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.237+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=3UX6NH8SVM0L type=del size=570925 2024-09-12T00:37:44.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.238+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~MX1JF7R32KSV.0 size=1048576 2024-09-12T00:37:44.238 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.240+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~MX1JF7R32KSV.1 size=1048576 2024-09-12T00:37:44.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.241+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~MX1JF7R32KSV.2 size=307199 2024-09-12T00:37:44.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.243+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=MX1JF7R32KSV tag=9G7Q1ADH9IEC type=write size=3452927 2024-09-12T00:37:44.243 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.245+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=7Q73RB9PWEBU type=del size=3594162 2024-09-12T00:37:44.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.247+0000 7fcd44281780 1 < canceled operation key=NIDHAXQF55WX tag=R557RBQNQNHB type=write size=132848 2024-09-12T00:37:44.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.249+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=2CL9TOWMYY3B type=write size=266451 2024-09-12T00:37:44.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.250+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~L22GOM3DZGD1.0 size=1048576 2024-09-12T00:37:44.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.251+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~L22GOM3DZGD1.1 size=1048576 2024-09-12T00:37:44.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.252+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~L22GOM3DZGD1.2 size=349102 2024-09-12T00:37:44.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.255+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=L22GOM3DZGD1 tag=NCT617IQ69IA type=write size=3494830 2024-09-12T00:37:44.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.257+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~8LC6GWBLIUHA.0 size=1048576 2024-09-12T00:37:44.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.258+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~8LC6GWBLIUHA.1 size=901274 2024-09-12T00:37:44.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.258+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=8LC6GWBLIUHA tag=OMHNC9OP24LS type=write size=2998426 2024-09-12T00:37:44.258 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.260+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~UOOWLP1K7AII.0 size=973689 2024-09-12T00:37:44.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.262+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=UOOWLP1K7AII tag=H33544G2QZ7W type=write size=2022265 2024-09-12T00:37:44.263 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.264+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~ZONQWRWWPI48.0 size=1048576 2024-09-12T00:37:44.264 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.265+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~ZONQWRWWPI48.1 size=478750 2024-09-12T00:37:44.264 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.265+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=ZONQWRWWPI48 tag=UEMLGM5T4N7Z type=write size=2575902 2024-09-12T00:37:44.265 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.267+0000 7fcd44281780 1 < completed write operation key=0ELZXPZCRPGP tag=LVGTD33NQIPU type=write size=292512 2024-09-12T00:37:44.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.269+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~QUS0YUMFM3H8.0 size=1048576 2024-09-12T00:37:44.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.270+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~QUS0YUMFM3H8.1 size=1048576 2024-09-12T00:37:44.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.271+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~QUS0YUMFM3H8.2 size=737413 2024-09-12T00:37:44.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.271+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=QUS0YUMFM3H8 tag=0J6K1THKMW7Q type=write size=3883141 2024-09-12T00:37:44.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.273+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=Z3VY5ALLD35D type=del 2024-09-12T00:37:44.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.274+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=FTDR6E8TUCC4 type=write size=698927 2024-09-12T00:37:44.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.277+0000 7fcd44281780 1 < suggested update operation key=KJ0C43WLAFLI tag=O1DQ159Z0K18 type=write size=153524 2024-09-12T00:37:44.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.279+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=UYBWJ2H5RTOX type=del size=493097 2024-09-12T00:37:44.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.280+0000 7fcd44281780 1 < canceled operation key=KNBCXZF3JGNL tag=LIESC4GPHYZW type=del size=4052807 2024-09-12T00:37:44.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.282+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=T0VYGJX8MCKW type=del size=1568449 2024-09-12T00:37:44.284 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.284+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=M8X7VTIE6IM2 type=del 2024-09-12T00:37:44.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.286+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~CH4I0SQ5KB5K.0 size=1048576 2024-09-12T00:37:44.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.288+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~CH4I0SQ5KB5K.1 size=1048576 2024-09-12T00:37:44.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.289+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~CH4I0SQ5KB5K.2 size=530833 2024-09-12T00:37:44.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.289+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=CH4I0SQ5KB5K tag=2EOYWXYCFNN8 type=write size=3676561 2024-09-12T00:37:44.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.290+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=KIY3C6IZPFXC type=del 2024-09-12T00:37:44.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.292+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=V1HZ0ZRYOQRG type=write size=817423 2024-09-12T00:37:44.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.293+0000 7fcd44281780 1 < canceled operation key=U4EPPPA4QGGD tag=PP0EO6R8ODP7 type=del size=1346376 2024-09-12T00:37:44.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.295+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=ZYD6QGDHTFOT type=write size=957430 2024-09-12T00:37:44.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.297+0000 7fcd44281780 1 < canceled operation key=KNBCXZF3JGNL tag=QGML1TT37A0D type=write size=178334 2024-09-12T00:37:44.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.299+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~NZ7XBA8YSO6Y.0 size=663283 2024-09-12T00:37:44.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.299+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=NZ7XBA8YSO6Y tag=ZEXXBCM7GLN9 type=write size=1711859 2024-09-12T00:37:44.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.301+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~CQ3KCV15ZSA7.0 size=880587 2024-09-12T00:37:44.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.304+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=CQ3KCV15ZSA7 tag=0ETMCHMT69GP type=write size=1929163 2024-09-12T00:37:44.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.305+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=WQLY4CJP5SMC type=del size=1051588 2024-09-12T00:37:44.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.307+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=01SAJS7D5JPC type=del 2024-09-12T00:37:44.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.309+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~AIFD82U0S05I.0 size=845418 2024-09-12T00:37:44.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.309+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=AIFD82U0S05I tag=B4LWA94AIAFP type=write size=1893994 2024-09-12T00:37:44.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.311+0000 7fcd44281780 1 < completed delete operation key=8U004LC8IYLQ tag=3V88B0TFIOBD type=del 2024-09-12T00:37:44.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.314+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~R0KFQAX5TM2U.0 size=947871 2024-09-12T00:37:44.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.314+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=R0KFQAX5TM2U tag=YSJWUBAOEZB0 type=write size=1996447 2024-09-12T00:37:44.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.316+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=3UX6NH8SVM0L type=del 2024-09-12T00:37:44.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.318+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~1I043I0RLXZK.0 size=1048576 2024-09-12T00:37:44.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.319+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~1I043I0RLXZK.1 size=1048576 2024-09-12T00:37:44.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.320+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~1I043I0RLXZK.2 size=73504 2024-09-12T00:37:44.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.320+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=1I043I0RLXZK tag=HFAFDHAJGRY6 type=write size=3219232 2024-09-12T00:37:44.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.322+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=7Q73RB9PWEBU type=del 2024-09-12T00:37:44.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.323+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=1L8Q99X3AG30 type=del size=1628464 2024-09-12T00:37:44.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.325+0000 7fcd44281780 1 < completed write operation key=AN6GRGZ22INA tag=2CL9TOWMYY3B type=write size=266451 2024-09-12T00:37:44.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.326+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=CKKKH5SCK34Z type=write size=61777 2024-09-12T00:37:44.326 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.326+0000 7fcd44281780 1 < canceled part key=_multipart_AN6GRGZ22INA.2~8LC6GWBLIUHA.0 size=1048576 2024-09-12T00:37:44.326 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.327+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~8LC6GWBLIUHA.1 size=901274 2024-09-12T00:37:44.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.330+0000 7fcd44281780 1 < canceled multipart upload key=AN6GRGZ22INA upload=8LC6GWBLIUHA tag=OMHNC9OP24LS type=write size=2998426 2024-09-12T00:37:44.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.331+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=QWJ4Z7V6J5YJ type=del size=1576372 2024-09-12T00:37:44.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.333+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~ZONQWRWWPI48.0 size=1048576 2024-09-12T00:37:44.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.334+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~ZONQWRWWPI48.1 size=478750 2024-09-12T00:37:44.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.336+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=ZONQWRWWPI48 tag=UEMLGM5T4N7Z type=write size=2575902 2024-09-12T00:37:44.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.338+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=4B26CZ80O37U type=del size=3586860 2024-09-12T00:37:44.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.340+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~QUS0YUMFM3H8.0 size=1048576 2024-09-12T00:37:44.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.341+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~QUS0YUMFM3H8.1 size=1048576 2024-09-12T00:37:44.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.342+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~QUS0YUMFM3H8.2 size=737413 2024-09-12T00:37:44.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.345+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=QUS0YUMFM3H8 tag=0J6K1THKMW7Q type=write size=3883141 2024-09-12T00:37:44.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.348+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~XV2B0B3AJ8M8.0 size=722671 2024-09-12T00:37:44.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.348+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=XV2B0B3AJ8M8 tag=FJIXGUY45HCO type=write size=1771247 2024-09-12T00:37:44.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.349+0000 7fcd44281780 1 < completed write operation key=XRW0CRE12S5B tag=FTDR6E8TUCC4 type=write size=698927 2024-09-12T00:37:44.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.351+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=3GIFXH145L6E type=del size=4170513 2024-09-12T00:37:44.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.352+0000 7fcd44281780 1 < canceled operation key=WXBMIJ4FC0VX tag=UYBWJ2H5RTOX type=del size=493097 2024-09-12T00:37:44.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.354+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=HJLFLMN26GRB type=del size=1955397 2024-09-12T00:37:44.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.357+0000 7fcd44281780 1 < suggested update operation key=DKJ44Z9COIIK tag=T0VYGJX8MCKW type=del size=1568449 2024-09-12T00:37:44.357 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.358+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=YFKAIRR3TWWT type=del size=2189078 2024-09-12T00:37:44.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.359+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~CH4I0SQ5KB5K.0 size=1048576 2024-09-12T00:37:44.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.361+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~CH4I0SQ5KB5K.1 size=1048576 2024-09-12T00:37:44.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.362+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~CH4I0SQ5KB5K.2 size=530833 2024-09-12T00:37:44.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.364+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=CH4I0SQ5KB5K tag=2EOYWXYCFNN8 type=write size=3676561 2024-09-12T00:37:44.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.366+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=Y47SM1L5BOHL type=del size=533453 2024-09-12T00:37:44.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.367+0000 7fcd44281780 1 < completed write operation key=KNBCXZF3JGNL tag=V1HZ0ZRYOQRG type=write size=817423 2024-09-12T00:37:44.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.370+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~MQZBB03SZ6X6.0 size=793916 2024-09-12T00:37:44.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.370+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=MQZBB03SZ6X6 tag=C6ZPVIWMNM60 type=write size=1842492 2024-09-12T00:37:44.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.371+0000 7fcd44281780 1 < completed write operation key=8U004LC8IYLQ tag=ZYD6QGDHTFOT type=write size=957430 2024-09-12T00:37:44.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.373+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=91VF2A6KSTQ6 type=del size=1027983 2024-09-12T00:37:44.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.374+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~NZ7XBA8YSO6Y.0 size=663283 2024-09-12T00:37:44.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.377+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=NZ7XBA8YSO6Y tag=ZEXXBCM7GLN9 type=write size=1711859 2024-09-12T00:37:44.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.379+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~AXSUCB1YHLUE.0 size=4137 2024-09-12T00:37:44.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.379+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=AXSUCB1YHLUE tag=5JXO3JZRMXE6 type=write size=1052713 2024-09-12T00:37:44.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.381+0000 7fcd44281780 1 < canceled operation key=0ELZXPZCRPGP tag=WQLY4CJP5SMC type=del size=1051588 2024-09-12T00:37:44.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.384+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~MVQISPTBS0EW.0 size=1048576 2024-09-12T00:37:44.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.386+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~MVQISPTBS0EW.1 size=1048576 2024-09-12T00:37:44.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.387+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~MVQISPTBS0EW.2 size=1020464 2024-09-12T00:37:44.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.387+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=MVQISPTBS0EW tag=CU2C3VJX9QEK type=write size=4166192 2024-09-12T00:37:44.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.388+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~AIFD82U0S05I.0 size=845418 2024-09-12T00:37:44.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.391+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=AIFD82U0S05I tag=B4LWA94AIAFP type=write size=1893994 2024-09-12T00:37:44.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.393+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~E6IYG54C3WRG.0 size=1048576 2024-09-12T00:37:44.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.394+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~E6IYG54C3WRG.1 size=1048576 2024-09-12T00:37:44.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.395+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~E6IYG54C3WRG.2 size=530195 2024-09-12T00:37:44.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.395+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=E6IYG54C3WRG tag=YZUY5UINDLFY type=write size=3675923 2024-09-12T00:37:44.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.396+0000 7fcd44281780 1 < canceled part key=_multipart_VOO70F2NBKL0.2~R0KFQAX5TM2U.0 size=947871 2024-09-12T00:37:44.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.398+0000 7fcd44281780 1 < canceled multipart upload key=VOO70F2NBKL0 upload=R0KFQAX5TM2U tag=YSJWUBAOEZB0 type=write size=1996447 2024-09-12T00:37:44.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.400+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=ZC050P7NWI3Y type=write size=551593 2024-09-12T00:37:44.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.401+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~1I043I0RLXZK.0 size=1048576 2024-09-12T00:37:44.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.402+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~1I043I0RLXZK.1 size=1048576 2024-09-12T00:37:44.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.403+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~1I043I0RLXZK.2 size=73504 2024-09-12T00:37:44.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.406+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=1I043I0RLXZK tag=HFAFDHAJGRY6 type=write size=3219232 2024-09-12T00:37:44.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.407+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=6CDYUXWGZ3WH type=del size=2194984 2024-09-12T00:37:44.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.408+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=1L8Q99X3AG30 type=del 2024-09-12T00:37:44.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.410+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=YA5B8YX9L6XY type=del size=1754882 2024-09-12T00:37:44.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.413+0000 7fcd44281780 1 < suggested remove operation key=B5OH55MQGSGJ tag=CKKKH5SCK34Z type=write 2024-09-12T00:37:44.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.414+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=XJ0ZIK52EAPY type=del size=2025033 2024-09-12T00:37:44.414 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.416+0000 7fcd44281780 1 < completed delete operation key=4RU6HTH4J0U1 tag=QWJ4Z7V6J5YJ type=del 2024-09-12T00:37:44.416 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.417+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=A3NTZAZ7AY2E type=write size=110442 2024-09-12T00:37:44.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.418+0000 7fcd44281780 1 < completed delete operation key=QVULC3H9QGXE tag=4B26CZ80O37U type=del 2024-09-12T00:37:44.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.420+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=TW5C69V87HL5 type=del size=542163 2024-09-12T00:37:44.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.422+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~XV2B0B3AJ8M8.0 size=722671 2024-09-12T00:37:44.423 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.424+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=XV2B0B3AJ8M8 tag=FJIXGUY45HCO type=write size=1771247 2024-09-12T00:37:44.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.425+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=IQW2Z80N8ITS type=write size=448499 2024-09-12T00:37:44.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.427+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=3GIFXH145L6E type=del 2024-09-12T00:37:44.427 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.429+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=R05A0R0089K0 type=del size=737987 2024-09-12T00:37:44.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.430+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=HJLFLMN26GRB type=del 2024-09-12T00:37:44.430 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.432+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=DCLES1WBM7JI type=write size=1034897 2024-09-12T00:37:44.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.433+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=YFKAIRR3TWWT type=del 2024-09-12T00:37:44.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.436+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~LXKWF1R937OF.0 size=1048576 2024-09-12T00:37:44.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.437+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~LXKWF1R937OF.1 size=787977 2024-09-12T00:37:44.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.437+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=LXKWF1R937OF tag=X3P2Z3M5COB2 type=write size=2885129 2024-09-12T00:37:44.437 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.438+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=Y47SM1L5BOHL type=del 2024-09-12T00:37:44.439 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.441+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~ZZX044TRM3UI.0 size=405287 2024-09-12T00:37:44.439 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.441+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=ZZX044TRM3UI tag=XY165BFO02AT type=write size=1453863 2024-09-12T00:37:44.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.442+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~MQZBB03SZ6X6.0 size=793916 2024-09-12T00:37:44.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.444+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=MQZBB03SZ6X6 tag=C6ZPVIWMNM60 type=write size=1842492 2024-09-12T00:37:44.444 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.446+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=LY1ATIKPM9ON type=del size=1037811 2024-09-12T00:37:44.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.447+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=91VF2A6KSTQ6 type=del 2024-09-12T00:37:44.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.449+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=5B7RFFEEQGKS type=del size=2507090 2024-09-12T00:37:44.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.450+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~AXSUCB1YHLUE.0 size=4137 2024-09-12T00:37:44.451 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.452+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=AXSUCB1YHLUE tag=5JXO3JZRMXE6 type=write size=1052713 2024-09-12T00:37:44.453 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.454+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=KTLTUDAT1DGK type=del size=3903367 2024-09-12T00:37:44.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.456+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~MVQISPTBS0EW.0 size=1048576 2024-09-12T00:37:44.455 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.457+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~MVQISPTBS0EW.1 size=1048576 2024-09-12T00:37:44.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.458+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~MVQISPTBS0EW.2 size=1020464 2024-09-12T00:37:44.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.460+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=MVQISPTBS0EW tag=CU2C3VJX9QEK type=write size=4166192 2024-09-12T00:37:44.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.462+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~X51OHHYBXZSZ.0 size=1048576 2024-09-12T00:37:44.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.464+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~X51OHHYBXZSZ.1 size=288079 2024-09-12T00:37:44.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.464+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=X51OHHYBXZSZ tag=Q1WVY5EN9HXM type=write size=2385231 2024-09-12T00:37:44.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.465+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~E6IYG54C3WRG.0 size=1048576 2024-09-12T00:37:44.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.466+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~E6IYG54C3WRG.1 size=1048576 2024-09-12T00:37:44.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.468+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~E6IYG54C3WRG.2 size=530195 2024-09-12T00:37:44.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.470+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=E6IYG54C3WRG tag=YZUY5UINDLFY type=write size=3675923 2024-09-12T00:37:44.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.472+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=GLMSY70PSHX4 type=del size=145632 2024-09-12T00:37:44.472 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.473+0000 7fcd44281780 1 < completed write operation key=XTNXNF3D0HFK tag=ZC050P7NWI3Y type=write size=551593 2024-09-12T00:37:44.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.475+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=P90VZKNRUDR2 type=del size=2771984 2024-09-12T00:37:44.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.476+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=6CDYUXWGZ3WH type=del 2024-09-12T00:37:44.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.479+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~2MDIJ5ZOORI0.0 size=1048576 2024-09-12T00:37:44.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.480+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~2MDIJ5ZOORI0.1 size=496558 2024-09-12T00:37:44.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.480+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=2MDIJ5ZOORI0 tag=1BD7UI1A55MT type=write size=2593710 2024-09-12T00:37:44.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.481+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=YA5B8YX9L6XY type=del 2024-09-12T00:37:44.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.483+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=UVFEJ5J3IP1R type=write size=77878 2024-09-12T00:37:44.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.484+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=XJ0ZIK52EAPY type=del 2024-09-12T00:37:44.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.486+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=CVS86Z85X39G type=del size=1177863 2024-09-12T00:37:44.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.487+0000 7fcd44281780 1 < completed write operation key=B5OH55MQGSGJ tag=A3NTZAZ7AY2E type=write size=110442 2024-09-12T00:37:44.487 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.489+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=F8KAQ0IT9U2D type=del size=2780503 2024-09-12T00:37:44.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.490+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=TW5C69V87HL5 type=del 2024-09-12T00:37:44.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.491+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=X00F62S1KYZ4 type=del size=2535913 2024-09-12T00:37:44.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.493+0000 7fcd44281780 1 < completed write operation key=DKJ44Z9COIIK tag=IQW2Z80N8ITS type=write size=448499 2024-09-12T00:37:44.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.495+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~W0Z7LPCDCQUM.0 size=1048576 2024-09-12T00:37:44.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.496+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~W0Z7LPCDCQUM.1 size=707156 2024-09-12T00:37:44.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.496+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=W0Z7LPCDCQUM tag=VK3MFNCOMOZ6 type=write size=2804308 2024-09-12T00:37:44.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.500+0000 7fcd44281780 1 < suggested update operation key=ZQSZDU87GAMV tag=R05A0R0089K0 type=del size=737987 2024-09-12T00:37:44.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.502+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~9WORWR2H3VAL.0 size=707750 2024-09-12T00:37:44.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.502+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=9WORWR2H3VAL tag=5ZFC1YQPO7NM type=write size=1756326 2024-09-12T00:37:44.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.503+0000 7fcd44281780 1 < canceled operation key=526O814C10YW tag=DCLES1WBM7JI type=write size=1034897 2024-09-12T00:37:44.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.505+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=POK88X80PT0T type=del size=164711 2024-09-12T00:37:44.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.506+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~LXKWF1R937OF.0 size=1048576 2024-09-12T00:37:44.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.507+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~LXKWF1R937OF.1 size=787977 2024-09-12T00:37:44.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.510+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=LXKWF1R937OF tag=X3P2Z3M5COB2 type=write size=2885129 2024-09-12T00:37:44.510 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.511+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=A18YPF3SR1GV type=del size=661832 2024-09-12T00:37:44.512 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.513+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~ZZX044TRM3UI.0 size=405287 2024-09-12T00:37:44.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.515+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=ZZX044TRM3UI tag=XY165BFO02AT type=write size=1453863 2024-09-12T00:37:44.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.517+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=2E91HD0TC915 type=write size=540560 2024-09-12T00:37:44.518 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.519+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=LY1ATIKPM9ON type=del 2024-09-12T00:37:44.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.522+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~SCIP55XQ646B.0 size=255355 2024-09-12T00:37:44.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.522+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=SCIP55XQ646B tag=FX0XA0FT5420 type=write size=1303931 2024-09-12T00:37:44.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.524+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=5B7RFFEEQGKS type=del 2024-09-12T00:37:44.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.525+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=GDP8IOK6MH5C type=del size=465031 2024-09-12T00:37:44.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.527+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=KTLTUDAT1DGK type=del 2024-09-12T00:37:44.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.530+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~V5JHC07GFK36.0 size=1048576 2024-09-12T00:37:44.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.531+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~V5JHC07GFK36.1 size=1048576 2024-09-12T00:37:44.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.532+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~V5JHC07GFK36.2 size=749459 2024-09-12T00:37:44.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.532+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=V5JHC07GFK36 tag=Q9IRGGO8T1JQ type=write size=3895187 2024-09-12T00:37:44.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.533+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~X51OHHYBXZSZ.0 size=1048576 2024-09-12T00:37:44.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.535+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~X51OHHYBXZSZ.1 size=288079 2024-09-12T00:37:44.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.537+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=X51OHHYBXZSZ tag=Q1WVY5EN9HXM type=write size=2385231 2024-09-12T00:37:44.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.539+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=DT2GIIMTEYYO type=del size=1411118 2024-09-12T00:37:44.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.540+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=GLMSY70PSHX4 type=del 2024-09-12T00:37:44.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.543+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~4Q0XD3Q71BDS.0 size=1048576 2024-09-12T00:37:44.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.544+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~4Q0XD3Q71BDS.1 size=852712 2024-09-12T00:37:44.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.544+0000 7fcd44281780 1 > prepared multipart upload key=U4EPPPA4QGGD upload=4Q0XD3Q71BDS tag=QVKEP032CIAI type=write size=2949864 2024-09-12T00:37:44.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.546+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=P90VZKNRUDR2 type=del 2024-09-12T00:37:44.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.547+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=S6AJYO01IP62 type=del size=1116186 2024-09-12T00:37:44.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.549+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~2MDIJ5ZOORI0.0 size=1048576 2024-09-12T00:37:44.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.549+0000 7fcd44281780 1 < canceled part key=_multipart_XRW0CRE12S5B.2~2MDIJ5ZOORI0.1 size=496558 2024-09-12T00:37:44.550 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.551+0000 7fcd44281780 1 < canceled multipart upload key=XRW0CRE12S5B upload=2MDIJ5ZOORI0 tag=1BD7UI1A55MT type=write size=2593710 2024-09-12T00:37:44.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.554+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~2F5VMQJILSLR.0 size=1048576 2024-09-12T00:37:44.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.555+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~2F5VMQJILSLR.1 size=1048576 2024-09-12T00:37:44.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.556+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~2F5VMQJILSLR.2 size=328736 2024-09-12T00:37:44.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.556+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=2F5VMQJILSLR tag=HXWA66UOKB6Z type=write size=3474464 2024-09-12T00:37:44.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.558+0000 7fcd44281780 1 < completed write operation key=526O814C10YW tag=UVFEJ5J3IP1R type=write size=77878 2024-09-12T00:37:44.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.559+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=IWSA37RPCTP0 type=write size=869155 2024-09-12T00:37:44.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.561+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=CVS86Z85X39G type=del 2024-09-12T00:37:44.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.563+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~LBLS46CON1I2.0 size=115565 2024-09-12T00:37:44.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.563+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=LBLS46CON1I2 tag=JWAICU98KBFB type=write size=1164141 2024-09-12T00:37:44.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.565+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=F8KAQ0IT9U2D type=del 2024-09-12T00:37:44.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.566+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=Y2QNB982M54G type=write size=146899 2024-09-12T00:37:44.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.567+0000 7fcd44281780 1 < completed delete operation key=4RU6HTH4J0U1 tag=X00F62S1KYZ4 type=del 2024-09-12T00:37:44.569 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.570+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~UC7CBBO3BYC2.0 size=1048576 2024-09-12T00:37:44.570 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.571+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~UC7CBBO3BYC2.1 size=951903 2024-09-12T00:37:44.570 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.571+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=UC7CBBO3BYC2 tag=YA0ZG19N877J type=write size=3049055 2024-09-12T00:37:44.570 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.572+0000 7fcd44281780 1 < canceled part key=_multipart_VOO70F2NBKL0.2~W0Z7LPCDCQUM.0 size=1048576 2024-09-12T00:37:44.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.573+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~W0Z7LPCDCQUM.1 size=707156 2024-09-12T00:37:44.574 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.575+0000 7fcd44281780 1 < canceled multipart upload key=VOO70F2NBKL0 upload=W0Z7LPCDCQUM tag=VK3MFNCOMOZ6 type=write size=2804308 2024-09-12T00:37:44.576 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.578+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~BOGEH2UU6XNZ.0 size=1048576 2024-09-12T00:37:44.578 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.579+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~BOGEH2UU6XNZ.1 size=1048576 2024-09-12T00:37:44.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.580+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~BOGEH2UU6XNZ.2 size=763146 2024-09-12T00:37:44.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.580+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=BOGEH2UU6XNZ tag=ISLJ676IQ7UT type=write size=3908874 2024-09-12T00:37:44.581 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.582+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~9WORWR2H3VAL.0 size=707750 2024-09-12T00:37:44.583 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.584+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=9WORWR2H3VAL tag=5ZFC1YQPO7NM type=write size=1756326 2024-09-12T00:37:44.586 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.587+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~EPNN0ZQLRABM.0 size=1048576 2024-09-12T00:37:44.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.588+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~EPNN0ZQLRABM.1 size=779109 2024-09-12T00:37:44.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.588+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=EPNN0ZQLRABM tag=FG0O68BYXGF9 type=write size=2876261 2024-09-12T00:37:44.589 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.590+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=POK88X80PT0T type=del 2024-09-12T00:37:44.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.592+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~IJU6VIV6H0Q4.0 size=1048576 2024-09-12T00:37:44.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.593+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~IJU6VIV6H0Q4.1 size=1048576 2024-09-12T00:37:44.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.595+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~IJU6VIV6H0Q4.2 size=219164 2024-09-12T00:37:44.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.595+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=IJU6VIV6H0Q4 tag=ZDYU6ICT70FX type=write size=3364892 2024-09-12T00:37:44.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.598+0000 7fcd44281780 1 < suggested update operation key=AN6GRGZ22INA tag=A18YPF3SR1GV type=del size=661832 2024-09-12T00:37:44.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.599+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=E5CMGU5SNG18 type=del size=1618439 2024-09-12T00:37:44.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.601+0000 7fcd44281780 1 < completed write operation key=UXY6K0AVI4EK tag=2E91HD0TC915 type=write size=540560 2024-09-12T00:37:44.601 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.602+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=PDX3PLGND9V0 type=write size=429806 2024-09-12T00:37:44.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.604+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~SCIP55XQ646B.0 size=255355 2024-09-12T00:37:44.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.606+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=SCIP55XQ646B tag=FX0XA0FT5420 type=write size=1303931 2024-09-12T00:37:44.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.608+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=0B0H6K71NJU1 type=del size=3772960 2024-09-12T00:37:44.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.611+0000 7fcd44281780 1 < suggested update operation key=4RU6HTH4J0U1 tag=GDP8IOK6MH5C type=del size=465031 2024-09-12T00:37:44.612 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.613+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~19YBHY2583HK.0 size=1048576 2024-09-12T00:37:44.613 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.615+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~19YBHY2583HK.1 size=907357 2024-09-12T00:37:44.614 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.615+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=19YBHY2583HK tag=4VWH2QAQ46IP type=write size=3004509 2024-09-12T00:37:44.615 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.616+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~V5JHC07GFK36.0 size=1048576 2024-09-12T00:37:44.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.618+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~V5JHC07GFK36.1 size=1048576 2024-09-12T00:37:44.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.619+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~V5JHC07GFK36.2 size=749459 2024-09-12T00:37:44.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.622+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=V5JHC07GFK36 tag=Q9IRGGO8T1JQ type=write size=3895187 2024-09-12T00:37:44.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.623+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=PPGGMH4Y2U33 type=write size=460635 2024-09-12T00:37:44.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.626+0000 7fcd44281780 1 < suggested remove operation key=XTNXNF3D0HFK tag=DT2GIIMTEYYO type=del 2024-09-12T00:37:44.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.628+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=RSAPBP4G8T6R type=del size=3633588 2024-09-12T00:37:44.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.629+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~4Q0XD3Q71BDS.0 size=1048576 2024-09-12T00:37:44.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.629+0000 7fcd44281780 1 < canceled part key=_multipart_U4EPPPA4QGGD.2~4Q0XD3Q71BDS.1 size=852712 2024-09-12T00:37:44.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.632+0000 7fcd44281780 1 < canceled multipart upload key=U4EPPPA4QGGD upload=4Q0XD3Q71BDS tag=QVKEP032CIAI type=write size=2949864 2024-09-12T00:37:44.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.635+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~8U09XLLEAZK2.0 size=1048576 2024-09-12T00:37:44.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.636+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~8U09XLLEAZK2.1 size=1048576 2024-09-12T00:37:44.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.637+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~8U09XLLEAZK2.2 size=997050 2024-09-12T00:37:44.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.637+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=8U09XLLEAZK2 tag=9LKUFFCBCHEY type=write size=4142778 2024-09-12T00:37:44.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.641+0000 7fcd44281780 1 < suggested update operation key=G8O8VXTUPQVP tag=S6AJYO01IP62 type=del size=1116186 2024-09-12T00:37:44.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.643+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~26N87CRO8SJM.0 size=637655 2024-09-12T00:37:44.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.643+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=26N87CRO8SJM tag=N4L6CWBCC94Q type=write size=1686231 2024-09-12T00:37:44.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.645+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~2F5VMQJILSLR.0 size=1048576 2024-09-12T00:37:44.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.646+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~2F5VMQJILSLR.1 size=1048576 2024-09-12T00:37:44.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.647+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~2F5VMQJILSLR.2 size=328736 2024-09-12T00:37:44.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.649+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=2F5VMQJILSLR tag=HXWA66UOKB6Z type=write size=3474464 2024-09-12T00:37:44.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.651+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=CSVWG8U1OJJZ type=del size=857499 2024-09-12T00:37:44.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.652+0000 7fcd44281780 1 < completed write operation key=0OEDZ5O2LN8H tag=IWSA37RPCTP0 type=write size=869155 2024-09-12T00:37:44.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.653+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=H9RAYUZ238FI type=del size=952831 2024-09-12T00:37:44.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.655+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~LBLS46CON1I2.0 size=115565 2024-09-12T00:37:44.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.658+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=LBLS46CON1I2 tag=JWAICU98KBFB type=write size=1164141 2024-09-12T00:37:44.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.659+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=Q29BQ0KA4P0K type=write size=772519 2024-09-12T00:37:44.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.661+0000 7fcd44281780 1 < completed write operation key=526O814C10YW tag=Y2QNB982M54G type=write size=146899 2024-09-12T00:37:44.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.662+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=RQPC0NXQ0GT7 type=del size=4010184 2024-09-12T00:37:44.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.663+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~UC7CBBO3BYC2.0 size=1048576 2024-09-12T00:37:44.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.664+0000 7fcd44281780 1 < canceled part key=_multipart_0OEDZ5O2LN8H.2~UC7CBBO3BYC2.1 size=951903 2024-09-12T00:37:44.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.666+0000 7fcd44281780 1 < canceled multipart upload key=0OEDZ5O2LN8H upload=UC7CBBO3BYC2 tag=YA0ZG19N877J type=write size=3049055 2024-09-12T00:37:44.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.668+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~LY6TM7RA8CHW.0 size=407567 2024-09-12T00:37:44.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.668+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=LY6TM7RA8CHW tag=RK16KCA38VJ0 type=write size=1456143 2024-09-12T00:37:44.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.670+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~BOGEH2UU6XNZ.0 size=1048576 2024-09-12T00:37:44.669 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.671+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~BOGEH2UU6XNZ.1 size=1048576 2024-09-12T00:37:44.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.672+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~BOGEH2UU6XNZ.2 size=763146 2024-09-12T00:37:44.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.674+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=BOGEH2UU6XNZ tag=ISLJ676IQ7UT type=write size=3908874 2024-09-12T00:37:44.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.677+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~4WO3DVJLNQL8.0 size=992339 2024-09-12T00:37:44.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.677+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=4WO3DVJLNQL8 tag=4KID52ALONRH type=write size=2040915 2024-09-12T00:37:44.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.678+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~EPNN0ZQLRABM.0 size=1048576 2024-09-12T00:37:44.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.680+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~EPNN0ZQLRABM.1 size=779109 2024-09-12T00:37:44.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.682+0000 7fcd44281780 1 < completed multipart upload key=B5OH55MQGSGJ upload=EPNN0ZQLRABM tag=FG0O68BYXGF9 type=write size=2876261 2024-09-12T00:37:44.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.685+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~KW1OGNU7X8MP.0 size=1048576 2024-09-12T00:37:44.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.685+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~KW1OGNU7X8MP.1 size=1048576 2024-09-12T00:37:44.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.686+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~KW1OGNU7X8MP.2 size=759467 2024-09-12T00:37:44.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.686+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=KW1OGNU7X8MP tag=U0E8UCMHFMJ3 type=write size=3905195 2024-09-12T00:37:44.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.688+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~IJU6VIV6H0Q4.0 size=1048576 2024-09-12T00:37:44.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.689+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~IJU6VIV6H0Q4.1 size=1048576 2024-09-12T00:37:44.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.690+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~IJU6VIV6H0Q4.2 size=219164 2024-09-12T00:37:44.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.692+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=IJU6VIV6H0Q4 tag=ZDYU6ICT70FX type=write size=3364892 2024-09-12T00:37:44.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.693+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=CYQOIKSV9GZW type=del size=3502713 2024-09-12T00:37:44.694 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.695+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=E5CMGU5SNG18 type=del 2024-09-12T00:37:44.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.697+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=ZJD05S1087A9 type=write size=878360 2024-09-12T00:37:44.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.698+0000 7fcd44281780 1 < completed write operation key=RYSE2CKE5IRT tag=PDX3PLGND9V0 type=write size=429806 2024-09-12T00:37:44.699 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.701+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~A3KMRG2NBOUB.0 size=1048576 2024-09-12T00:37:44.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.702+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~A3KMRG2NBOUB.1 size=1048576 2024-09-12T00:37:44.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.703+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~A3KMRG2NBOUB.2 size=113837 2024-09-12T00:37:44.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.703+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=A3KMRG2NBOUB tag=H9YCQBKGRI4W type=write size=3259565 2024-09-12T00:37:44.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.704+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=0B0H6K71NJU1 type=del 2024-09-12T00:37:44.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.707+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~4GCJNRO8P6O7.0 size=934677 2024-09-12T00:37:44.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.707+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=4GCJNRO8P6O7 tag=AEEZYGW0H9YG type=write size=1983253 2024-09-12T00:37:44.707 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.709+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~19YBHY2583HK.0 size=1048576 2024-09-12T00:37:44.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.710+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~19YBHY2583HK.1 size=907357 2024-09-12T00:37:44.712 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.713+0000 7fcd44281780 1 < completed multipart upload key=0AVE0W4OV1AU upload=19YBHY2583HK tag=4VWH2QAQ46IP type=write size=3004509 2024-09-12T00:37:44.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.716+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~50O356K4IDC8.0 size=52146 2024-09-12T00:37:44.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.716+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=50O356K4IDC8 tag=52LUUXBIML0L type=write size=1100722 2024-09-12T00:37:44.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.718+0000 7fcd44281780 -1 < failed to complete operation key=XTNXNF3D0HFK tag=PPGGMH4Y2U33 type=write size=460635: (22) Invalid argument 2024-09-12T00:37:44.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.719+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=OZSFYSDBG67L type=del size=3250239 2024-09-12T00:37:44.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.721+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=RSAPBP4G8T6R type=del 2024-09-12T00:37:44.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.724+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~LXADTVBBW5E4.0 size=1048576 2024-09-12T00:37:44.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.725+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~LXADTVBBW5E4.1 size=1048576 2024-09-12T00:37:44.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.726+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~LXADTVBBW5E4.2 size=32915 2024-09-12T00:37:44.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.726+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=LXADTVBBW5E4 tag=7XM42IS5UD98 type=write size=3178643 2024-09-12T00:37:44.727 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.728+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~8U09XLLEAZK2.0 size=1048576 2024-09-12T00:37:44.728 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.729+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~8U09XLLEAZK2.1 size=1048576 2024-09-12T00:37:44.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.730+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~8U09XLLEAZK2.2 size=997050 2024-09-12T00:37:44.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.733+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=8U09XLLEAZK2 tag=9LKUFFCBCHEY type=write size=4142778 2024-09-12T00:37:44.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.734+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=AEJ594C171MQ type=write size=540441 2024-09-12T00:37:44.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.736+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~26N87CRO8SJM.0 size=637655 2024-09-12T00:37:44.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.738+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=26N87CRO8SJM tag=N4L6CWBCC94Q type=write size=1686231 2024-09-12T00:37:44.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.740+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=FXY16A87QMTY type=del size=1510567 2024-09-12T00:37:44.741 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.742+0000 7fcd44281780 1 < suggested update operation key=IK8POOY7ZWNF tag=CSVWG8U1OJJZ type=del size=857499 2024-09-12T00:37:44.743 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.744+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=WA9QCR1SSMVH type=del size=1082611 2024-09-12T00:37:44.744 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.746+0000 7fcd44281780 -1 < failed to complete operation key=IK8POOY7ZWNF tag=H9RAYUZ238FI type=del size=952831: (22) Invalid argument 2024-09-12T00:37:44.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.747+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=86PDZQFC0LVB type=del size=56611 2024-09-12T00:37:44.748 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.749+0000 7fcd44281780 1 < completed write operation key=B5OH55MQGSGJ tag=Q29BQ0KA4P0K type=write size=772519 2024-09-12T00:37:44.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.752+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~BW6ER5AG8PGA.0 size=1048576 2024-09-12T00:37:44.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.753+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~BW6ER5AG8PGA.1 size=1048576 2024-09-12T00:37:44.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.754+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~BW6ER5AG8PGA.2 size=396197 2024-09-12T00:37:44.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.754+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=BW6ER5AG8PGA tag=JQQHBM5LU5I9 type=write size=3541925 2024-09-12T00:37:44.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.757+0000 7fcd44281780 1 < suggested update operation key=7UCICX0GHHQ1 tag=RQPC0NXQ0GT7 type=del size=4010184 2024-09-12T00:37:44.758 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.760+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~DK0L6G0KNRAR.0 size=1048576 2024-09-12T00:37:44.759 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.761+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~DK0L6G0KNRAR.1 size=690228 2024-09-12T00:37:44.760 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.761+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=DK0L6G0KNRAR tag=ALTPTIDXLZ4V type=write size=2787380 2024-09-12T00:37:44.761 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.762+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~LY6TM7RA8CHW.0 size=407567 2024-09-12T00:37:44.764 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.765+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=LY6TM7RA8CHW tag=RK16KCA38VJ0 type=write size=1456143 2024-09-12T00:37:44.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.767+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~SNDMF9MFMIWH.0 size=382283 2024-09-12T00:37:44.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.767+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=SNDMF9MFMIWH tag=9FRV83Y3KIDM type=write size=1430859 2024-09-12T00:37:44.767 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.769+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~4WO3DVJLNQL8.0 size=992339 2024-09-12T00:37:44.770 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.771+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=4WO3DVJLNQL8 tag=4KID52ALONRH type=write size=2040915 2024-09-12T00:37:44.771 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.772+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=GAM53AM4IGJB type=del size=624788 2024-09-12T00:37:44.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.774+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~KW1OGNU7X8MP.0 size=1048576 2024-09-12T00:37:44.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.775+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~KW1OGNU7X8MP.1 size=1048576 2024-09-12T00:37:44.775 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.776+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~KW1OGNU7X8MP.2 size=759467 2024-09-12T00:37:44.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.779+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=KW1OGNU7X8MP tag=U0E8UCMHFMJ3 type=write size=3905195 2024-09-12T00:37:44.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.781+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~U16X3L63OARJ.0 size=1048576 2024-09-12T00:37:44.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.783+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~U16X3L63OARJ.1 size=1048576 2024-09-12T00:37:44.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.784+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~U16X3L63OARJ.2 size=833797 2024-09-12T00:37:44.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.784+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=U16X3L63OARJ tag=INH39RQVW4TQ type=write size=3979525 2024-09-12T00:37:44.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.787+0000 7fcd44281780 1 < suggested remove operation key=DKJ44Z9COIIK tag=CYQOIKSV9GZW type=del 2024-09-12T00:37:44.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.788+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=6229NSNQBHCL type=write size=243367 2024-09-12T00:37:44.791 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.792+0000 7fcd44281780 1 < suggested remove operation key=0AVE0W4OV1AU tag=ZJD05S1087A9 type=write 2024-09-12T00:37:44.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.794+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=S7SG4F96OAKB type=del size=983105 2024-09-12T00:37:44.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.795+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~A3KMRG2NBOUB.0 size=1048576 2024-09-12T00:37:44.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.796+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~A3KMRG2NBOUB.1 size=1048576 2024-09-12T00:37:44.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.796+0000 7fcd44281780 1 < canceled part key=_multipart_EXP8U6QNSMQ0.2~A3KMRG2NBOUB.2 size=113837 2024-09-12T00:37:44.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.799+0000 7fcd44281780 1 < canceled multipart upload key=EXP8U6QNSMQ0 upload=A3KMRG2NBOUB tag=H9YCQBKGRI4W type=write size=3259565 2024-09-12T00:37:44.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.801+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~88AV51AQJWPU.0 size=941960 2024-09-12T00:37:44.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.801+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=88AV51AQJWPU tag=SVM7E3RLT8NM type=write size=1990536 2024-09-12T00:37:44.802 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.803+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~4GCJNRO8P6O7.0 size=934677 2024-09-12T00:37:44.804 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.805+0000 7fcd44281780 1 < completed multipart upload key=4RU6HTH4J0U1 upload=4GCJNRO8P6O7 tag=AEEZYGW0H9YG type=write size=1983253 2024-09-12T00:37:44.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.807+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=GJWPEMWZFS7L type=del size=714151 2024-09-12T00:37:44.806 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.807+0000 7fcd44281780 1 < canceled part key=_multipart_526O814C10YW.2~50O356K4IDC8.0 size=52146 2024-09-12T00:37:44.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.809+0000 7fcd44281780 1 < canceled multipart upload key=526O814C10YW upload=50O356K4IDC8 tag=52LUUXBIML0L type=write size=1100722 2024-09-12T00:37:44.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.810+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=I1X719R3KF4T type=del size=1390915 2024-09-12T00:37:44.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.812+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=OZSFYSDBG67L type=del 2024-09-12T00:37:44.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.814+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~CUQXZIKYMRJT.0 size=864570 2024-09-12T00:37:44.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.814+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=CUQXZIKYMRJT tag=IHOY5188M2LG type=write size=1913146 2024-09-12T00:37:44.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.816+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~LXADTVBBW5E4.0 size=1048576 2024-09-12T00:37:44.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.817+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~LXADTVBBW5E4.1 size=1048576 2024-09-12T00:37:44.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.818+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~LXADTVBBW5E4.2 size=32915 2024-09-12T00:37:44.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.820+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=LXADTVBBW5E4 tag=7XM42IS5UD98 type=write size=3178643 2024-09-12T00:37:44.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.822+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=5QNFTCU68Z3L type=write size=65351 2024-09-12T00:37:44.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.824+0000 7fcd44281780 1 < completed write operation key=0O62FO4WVZG6 tag=AEJ594C171MQ type=write size=540441 2024-09-12T00:37:44.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.826+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~PCXZVXDXI3C7.0 size=1048576 2024-09-12T00:37:44.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.827+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~PCXZVXDXI3C7.1 size=911858 2024-09-12T00:37:44.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.827+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=PCXZVXDXI3C7 tag=UERIXUMGYQTO type=write size=3009010 2024-09-12T00:37:44.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.828+0000 7fcd44281780 1 < completed delete operation key=XTNXNF3D0HFK tag=FXY16A87QMTY type=del 2024-09-12T00:37:44.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.830+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=8VS9KS4KKCRP type=write size=450315 2024-09-12T00:37:44.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.831+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=WA9QCR1SSMVH type=del 2024-09-12T00:37:44.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.834+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~V9IOTF9T9ZD2.0 size=1048576 2024-09-12T00:37:44.836 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.836+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~V9IOTF9T9ZD2.1 size=1048576 2024-09-12T00:37:44.836 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.837+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~V9IOTF9T9ZD2.2 size=908654 2024-09-12T00:37:44.836 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.837+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=V9IOTF9T9ZD2 tag=OCORSU34OWBD type=write size=4054382 2024-09-12T00:37:44.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.838+0000 7fcd44281780 -1 < failed to complete operation key=7UCICX0GHHQ1 tag=86PDZQFC0LVB type=del size=56611: (22) Invalid argument 2024-09-12T00:37:44.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.841+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~HOU73N454KIR.0 size=1048576 2024-09-12T00:37:44.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.842+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~HOU73N454KIR.1 size=1048576 2024-09-12T00:37:44.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.843+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~HOU73N454KIR.2 size=906065 2024-09-12T00:37:44.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.843+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=HOU73N454KIR tag=Q9XZFN9OXONI type=write size=4051793 2024-09-12T00:37:44.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.844+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~BW6ER5AG8PGA.0 size=1048576 2024-09-12T00:37:44.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.846+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~BW6ER5AG8PGA.1 size=1048576 2024-09-12T00:37:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.847+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~BW6ER5AG8PGA.2 size=396197 2024-09-12T00:37:44.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.849+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=BW6ER5AG8PGA tag=JQQHBM5LU5I9 type=write size=3541925 2024-09-12T00:37:44.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.851+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=WSPAZFUJJHGJ type=del size=3210616 2024-09-12T00:37:44.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.852+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~DK0L6G0KNRAR.0 size=1048576 2024-09-12T00:37:44.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.853+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~DK0L6G0KNRAR.1 size=690228 2024-09-12T00:37:44.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.856+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=DK0L6G0KNRAR tag=ALTPTIDXLZ4V type=write size=2787380 2024-09-12T00:37:44.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.857+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=D24ACT5WBTPK type=write size=864508 2024-09-12T00:37:44.857 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.859+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~SNDMF9MFMIWH.0 size=382283 2024-09-12T00:37:44.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.861+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=SNDMF9MFMIWH tag=9FRV83Y3KIDM type=write size=1430859 2024-09-12T00:37:44.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.862+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=81GQSP3J8J6O type=del size=780060 2024-09-12T00:37:44.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.863+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=GAM53AM4IGJB type=del 2024-09-12T00:37:44.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.866+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~NR9J1S2HBJX2.0 size=1048576 2024-09-12T00:37:44.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.867+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~NR9J1S2HBJX2.1 size=451322 2024-09-12T00:37:44.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.867+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=NR9J1S2HBJX2 tag=1FH0XIAKRJKX type=write size=2548474 2024-09-12T00:37:44.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.867+0000 7fcd44281780 1 < canceled part key=_multipart_AN6GRGZ22INA.2~U16X3L63OARJ.0 size=1048576 2024-09-12T00:37:44.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.868+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~U16X3L63OARJ.1 size=1048576 2024-09-12T00:37:44.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.868+0000 7fcd44281780 1 < canceled part key=_multipart_AN6GRGZ22INA.2~U16X3L63OARJ.2 size=833797 2024-09-12T00:37:44.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.870+0000 7fcd44281780 1 < canceled multipart upload key=AN6GRGZ22INA upload=U16X3L63OARJ tag=INH39RQVW4TQ type=write size=3979525 2024-09-12T00:37:44.872 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.873+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~UKBA6WKGMI8U.0 size=107168 2024-09-12T00:37:44.872 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.873+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=UKBA6WKGMI8U tag=GG8YUTA522EL type=write size=1155744 2024-09-12T00:37:44.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.877+0000 7fcd44281780 1 < suggested update operation key=526O814C10YW tag=6229NSNQBHCL type=write size=243367 2024-09-12T00:37:44.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.880+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~EOC4ACYE32CI.0 size=1048576 2024-09-12T00:37:44.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.881+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~EOC4ACYE32CI.1 size=1048576 2024-09-12T00:37:44.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.882+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~EOC4ACYE32CI.2 size=409388 2024-09-12T00:37:44.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.882+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=EOC4ACYE32CI tag=BA6DMWW0043Z type=write size=3555116 2024-09-12T00:37:44.882 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.883+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=S7SG4F96OAKB type=del 2024-09-12T00:37:44.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.886+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~3SDTEBDHE0TR.0 size=1048576 2024-09-12T00:37:44.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.887+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~3SDTEBDHE0TR.1 size=168393 2024-09-12T00:37:44.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.887+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=3SDTEBDHE0TR tag=G08M2MRH82OH type=write size=2265545 2024-09-12T00:37:44.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.889+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~88AV51AQJWPU.0 size=941960 2024-09-12T00:37:44.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.891+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=88AV51AQJWPU tag=SVM7E3RLT8NM type=write size=1990536 2024-09-12T00:37:44.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.892+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=WGUZ1MJJJLQ5 type=del size=431566 2024-09-12T00:37:44.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.894+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=GJWPEMWZFS7L type=del 2024-09-12T00:37:44.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.895+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=78F9HU7L6OY8 type=del size=3756761 2024-09-12T00:37:44.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.896+0000 7fcd44281780 1 < completed delete operation key=8U004LC8IYLQ tag=I1X719R3KF4T type=del 2024-09-12T00:37:44.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.898+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=EOJ0T18GARKF type=del size=2933552 2024-09-12T00:37:44.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.898+0000 7fcd44281780 1 < canceled part key=_multipart_IK8POOY7ZWNF.2~CUQXZIKYMRJT.0 size=864570 2024-09-12T00:37:44.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.900+0000 7fcd44281780 1 < canceled multipart upload key=IK8POOY7ZWNF upload=CUQXZIKYMRJT tag=IHOY5188M2LG type=write size=1913146 2024-09-12T00:37:44.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.903+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~7H2UBTC9DUK2.0 size=1048576 2024-09-12T00:37:44.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.904+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~7H2UBTC9DUK2.1 size=404271 2024-09-12T00:37:44.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.904+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=7H2UBTC9DUK2 tag=X6YCWQVDKGOT type=write size=2501423 2024-09-12T00:37:44.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.905+0000 7fcd44281780 1 < completed write operation key=WXBMIJ4FC0VX tag=5QNFTCU68Z3L type=write size=65351 2024-09-12T00:37:44.906 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.907+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=0TQLF20KK4Q6 type=del size=4192044 2024-09-12T00:37:44.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.909+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~PCXZVXDXI3C7.0 size=1048576 2024-09-12T00:37:44.909 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.910+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~PCXZVXDXI3C7.1 size=911858 2024-09-12T00:37:44.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.912+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=PCXZVXDXI3C7 tag=UERIXUMGYQTO type=write size=3009010 2024-09-12T00:37:44.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.913+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=T45FRHG5R9BO type=del size=228085 2024-09-12T00:37:44.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.917+0000 7fcd44281780 1 < suggested update operation key=G8O8VXTUPQVP tag=8VS9KS4KKCRP type=write size=450315 2024-09-12T00:37:44.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.919+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~FUZNU5X7QZP0.0 size=1048576 2024-09-12T00:37:44.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.921+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~FUZNU5X7QZP0.1 size=1048576 2024-09-12T00:37:44.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.923+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~FUZNU5X7QZP0.2 size=647861 2024-09-12T00:37:44.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.923+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=FUZNU5X7QZP0 tag=TYTZ51691HVZ type=write size=3793589 2024-09-12T00:37:44.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.925+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~V9IOTF9T9ZD2.0 size=1048576 2024-09-12T00:37:44.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.925+0000 7fcd44281780 1 < canceled part key=_multipart_IK8POOY7ZWNF.2~V9IOTF9T9ZD2.1 size=1048576 2024-09-12T00:37:44.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.926+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~V9IOTF9T9ZD2.2 size=908654 2024-09-12T00:37:44.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.928+0000 7fcd44281780 1 < canceled multipart upload key=IK8POOY7ZWNF upload=V9IOTF9T9ZD2 tag=OCORSU34OWBD type=write size=4054382 2024-09-12T00:37:44.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.930+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=11IJRNUAXT99 type=write size=618562 2024-09-12T00:37:44.930 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.931+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~HOU73N454KIR.0 size=1048576 2024-09-12T00:37:44.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.932+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~HOU73N454KIR.1 size=1048576 2024-09-12T00:37:44.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.934+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~HOU73N454KIR.2 size=906065 2024-09-12T00:37:44.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.936+0000 7fcd44281780 1 < completed multipart upload key=UWS056JN3IXO upload=HOU73N454KIR tag=Q9XZFN9OXONI type=write size=4051793 2024-09-12T00:37:44.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.939+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~31376FGM652V.0 size=1048576 2024-09-12T00:37:44.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.940+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~31376FGM652V.1 size=940250 2024-09-12T00:37:44.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.940+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=31376FGM652V tag=54THRLITY11V type=write size=3037402 2024-09-12T00:37:44.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.941+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=WSPAZFUJJHGJ type=del 2024-09-12T00:37:44.942 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.943+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=26FVH2TWKOJH type=del size=2544990 2024-09-12T00:37:44.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.947+0000 7fcd44281780 1 < suggested update operation key=QVULC3H9QGXE tag=D24ACT5WBTPK type=write size=864508 2024-09-12T00:37:44.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.949+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=I11T9KYUO9KG type=write size=775110 2024-09-12T00:37:44.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.950+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=81GQSP3J8J6O type=del 2024-09-12T00:37:44.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.952+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=LWBCMTX6VWAS type=del size=3694406 2024-09-12T00:37:44.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.953+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~NR9J1S2HBJX2.0 size=1048576 2024-09-12T00:37:44.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.954+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~NR9J1S2HBJX2.1 size=451322 2024-09-12T00:37:44.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.957+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=NR9J1S2HBJX2 tag=1FH0XIAKRJKX type=write size=2548474 2024-09-12T00:37:44.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.958+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=UW6ZBT1HJWQH type=del size=1951681 2024-09-12T00:37:44.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.959+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~UKBA6WKGMI8U.0 size=107168 2024-09-12T00:37:44.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.962+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=UKBA6WKGMI8U tag=GG8YUTA522EL type=write size=1155744 2024-09-12T00:37:44.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.964+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=PFA7Y0JZROEB type=del size=3805946 2024-09-12T00:37:44.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.964+0000 7fcd44281780 1 < canceled part key=_multipart_XTNXNF3D0HFK.2~EOC4ACYE32CI.0 size=1048576 2024-09-12T00:37:44.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.965+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~EOC4ACYE32CI.1 size=1048576 2024-09-12T00:37:44.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.966+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~EOC4ACYE32CI.2 size=409388 2024-09-12T00:37:44.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.968+0000 7fcd44281780 1 < canceled multipart upload key=XTNXNF3D0HFK upload=EOC4ACYE32CI tag=BA6DMWW0043Z type=write size=3555116 2024-09-12T00:37:44.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.970+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=CT4AIWCCC5LK type=del size=3220979 2024-09-12T00:37:44.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.971+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~3SDTEBDHE0TR.0 size=1048576 2024-09-12T00:37:44.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.972+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~3SDTEBDHE0TR.1 size=168393 2024-09-12T00:37:44.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.975+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=3SDTEBDHE0TR tag=G08M2MRH82OH type=write size=2265545 2024-09-12T00:37:44.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.976+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=T53J7GLKGTXB type=del size=2222327 2024-09-12T00:37:44.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.978+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=WGUZ1MJJJLQ5 type=del 2024-09-12T00:37:44.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.980+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~6Z7D7OEJAT1E.0 size=854765 2024-09-12T00:37:44.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.980+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=6Z7D7OEJAT1E tag=11RN4YQXNME6 type=write size=1903341 2024-09-12T00:37:44.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.981+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=78F9HU7L6OY8 type=del 2024-09-12T00:37:44.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.984+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~0QM183MD7FX1.0 size=1048576 2024-09-12T00:37:44.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.985+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~0QM183MD7FX1.1 size=29579 2024-09-12T00:37:44.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.985+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=0QM183MD7FX1 tag=8NRXKAFHMO4I type=write size=2126731 2024-09-12T00:37:44.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.986+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=EOJ0T18GARKF type=del 2024-09-12T00:37:44.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.988+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=KGH0B0WUUZMM type=write size=974156 2024-09-12T00:37:44.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.989+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~7H2UBTC9DUK2.0 size=1048576 2024-09-12T00:37:44.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.990+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~7H2UBTC9DUK2.1 size=404271 2024-09-12T00:37:44.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.993+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=7H2UBTC9DUK2 tag=X6YCWQVDKGOT type=write size=2501423 2024-09-12T00:37:44.993 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.994+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=P4HEFLXG5TQV type=write size=859529 2024-09-12T00:37:44.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.996+0000 7fcd44281780 1 < completed delete operation key=0OEDZ5O2LN8H tag=0TQLF20KK4Q6 type=del 2024-09-12T00:37:44.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.997+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=T4ME20GWLOF3 type=write size=191861 2024-09-12T00:37:44.997 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:44.999+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=T45FRHG5R9BO type=del 2024-09-12T00:37:44.999 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.000+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=UJLR30QU0RNR type=del size=1850710 2024-09-12T00:37:45.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.002+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~FUZNU5X7QZP0.0 size=1048576 2024-09-12T00:37:45.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.003+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~FUZNU5X7QZP0.1 size=1048576 2024-09-12T00:37:45.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.004+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~FUZNU5X7QZP0.2 size=647861 2024-09-12T00:37:45.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.006+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=FUZNU5X7QZP0 tag=TYTZ51691HVZ type=write size=3793589 2024-09-12T00:37:45.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.008+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=ECUJT89JRGAC type=del size=2602551 2024-09-12T00:37:45.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.009+0000 7fcd44281780 1 < completed write operation key=NIDHAXQF55WX tag=11IJRNUAXT99 type=write size=618562 2024-09-12T00:37:45.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.011+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=657TBGBW0HN5 type=del size=3023800 2024-09-12T00:37:45.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.011+0000 7fcd44281780 1 < canceled part key=_multipart_8U004LC8IYLQ.2~31376FGM652V.0 size=1048576 2024-09-12T00:37:45.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.011+0000 7fcd44281780 1 < canceled part key=_multipart_8U004LC8IYLQ.2~31376FGM652V.1 size=940250 2024-09-12T00:37:45.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.013+0000 7fcd44281780 1 < canceled multipart upload key=8U004LC8IYLQ upload=31376FGM652V tag=54THRLITY11V type=write size=3037402 2024-09-12T00:37:45.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.016+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~T3L1H0R18KEX.0 size=1048576 2024-09-12T00:37:45.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.017+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~T3L1H0R18KEX.1 size=1048576 2024-09-12T00:37:45.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.018+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~T3L1H0R18KEX.2 size=916786 2024-09-12T00:37:45.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.018+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=T3L1H0R18KEX tag=4AVV6TOK53ST type=write size=4062514 2024-09-12T00:37:45.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.020+0000 7fcd44281780 1 < suggested update operation key=8U004LC8IYLQ tag=26FVH2TWKOJH type=del size=2544990 2024-09-12T00:37:45.021 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.022+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=81MJD0VABBIT type=write size=574754 2024-09-12T00:37:45.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.023+0000 7fcd44281780 1 < completed write operation key=KJ0C43WLAFLI tag=I11T9KYUO9KG type=write size=775110 2024-09-12T00:37:45.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.026+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~3MTG00FAIGET.0 size=554400 2024-09-12T00:37:45.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.026+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=3MTG00FAIGET tag=OJLV200L20AX type=write size=1602976 2024-09-12T00:37:45.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.027+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=LWBCMTX6VWAS type=del 2024-09-12T00:37:45.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.029+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=OS95JZRI5TZX type=del size=2441991 2024-09-12T00:37:45.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.032+0000 7fcd44281780 1 < suggested update operation key=DKJ44Z9COIIK tag=UW6ZBT1HJWQH type=del size=1951681 2024-09-12T00:37:45.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.033+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=KO62B8ZWQ4SA type=write size=802996 2024-09-12T00:37:45.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.035+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=PFA7Y0JZROEB type=del 2024-09-12T00:37:45.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.036+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=7CB73Y972JC9 type=del size=75815 2024-09-12T00:37:45.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.039+0000 7fcd44281780 1 < suggested remove operation key=G8O8VXTUPQVP tag=CT4AIWCCC5LK type=del 2024-09-12T00:37:45.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.040+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=K3OEIZ35J19Q type=del size=197356 2024-09-12T00:37:45.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.043+0000 7fcd44281780 1 < suggested remove operation key=B5OH55MQGSGJ tag=T53J7GLKGTXB type=del 2024-09-12T00:37:45.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.044+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=3KEOC447N87K type=del size=1625420 2024-09-12T00:37:45.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.046+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~6Z7D7OEJAT1E.0 size=854765 2024-09-12T00:37:45.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.048+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=6Z7D7OEJAT1E tag=11RN4YQXNME6 type=write size=1903341 2024-09-12T00:37:45.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.050+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=8H0J15RMFIHI type=del size=3713975 2024-09-12T00:37:45.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.052+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~0QM183MD7FX1.0 size=1048576 2024-09-12T00:37:45.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.052+0000 7fcd44281780 1 < canceled part key=_multipart_IK8POOY7ZWNF.2~0QM183MD7FX1.1 size=29579 2024-09-12T00:37:45.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.054+0000 7fcd44281780 1 < canceled multipart upload key=IK8POOY7ZWNF upload=0QM183MD7FX1 tag=8NRXKAFHMO4I type=write size=2126731 2024-09-12T00:37:45.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.055+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=4EUG6OTUO1CD type=del size=3360187 2024-09-12T00:37:45.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.057+0000 7fcd44281780 1 < completed write operation key=RYSE2CKE5IRT tag=KGH0B0WUUZMM type=write size=974156 2024-09-12T00:37:45.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.061+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=IN6QT38FES0P type=del size=3067292 2024-09-12T00:37:45.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.063+0000 7fcd44281780 1 < completed write operation key=0OEDZ5O2LN8H tag=P4HEFLXG5TQV type=write size=859529 2024-09-12T00:37:45.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.066+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~WI7382XG3EF1.0 size=1048576 2024-09-12T00:37:45.066 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.067+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~WI7382XG3EF1.1 size=1048576 2024-09-12T00:37:45.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.068+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~WI7382XG3EF1.2 size=923221 2024-09-12T00:37:45.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.068+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=WI7382XG3EF1 tag=FIPTK9ZQQG22 type=write size=4068949 2024-09-12T00:37:45.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.070+0000 7fcd44281780 1 < completed write operation key=VXDTFEG8P23H tag=T4ME20GWLOF3 type=write size=191861 2024-09-12T00:37:45.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.073+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~XL36IT1JWIVR.0 size=1048576 2024-09-12T00:37:45.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.075+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~XL36IT1JWIVR.1 size=36424 2024-09-12T00:37:45.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.075+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=XL36IT1JWIVR tag=UGDCGHGAKI06 type=write size=2133576 2024-09-12T00:37:45.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.076+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=UJLR30QU0RNR type=del 2024-09-12T00:37:45.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.079+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~QI3YD02EBN9T.0 size=410473 2024-09-12T00:37:45.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.079+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=QI3YD02EBN9T tag=3F2RMJKZZX2V type=write size=1459049 2024-09-12T00:37:45.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.082+0000 7fcd44281780 1 < suggested update operation key=U4EPPPA4QGGD tag=ECUJT89JRGAC type=del size=2602551 2024-09-12T00:37:45.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.084+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=DFNK9SDEJT0E type=del size=3695387 2024-09-12T00:37:45.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.086+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=657TBGBW0HN5 type=del 2024-09-12T00:37:45.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.088+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~XL1N10CK03F9.0 size=1048576 2024-09-12T00:37:45.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.090+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~XL1N10CK03F9.1 size=548240 2024-09-12T00:37:45.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.090+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=XL1N10CK03F9 tag=AS90DY060QUB type=write size=2645392 2024-09-12T00:37:45.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.091+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~T3L1H0R18KEX.0 size=1048576 2024-09-12T00:37:45.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.092+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~T3L1H0R18KEX.1 size=1048576 2024-09-12T00:37:45.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.093+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~T3L1H0R18KEX.2 size=916786 2024-09-12T00:37:45.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.096+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=T3L1H0R18KEX tag=4AVV6TOK53ST type=write size=4062514 2024-09-12T00:37:45.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.099+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~A6LHJMZZNXCJ.0 size=1048576 2024-09-12T00:37:45.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.100+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~A6LHJMZZNXCJ.1 size=509752 2024-09-12T00:37:45.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.100+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=A6LHJMZZNXCJ tag=6G37WABMASEI type=write size=2606904 2024-09-12T00:37:45.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.102+0000 7fcd44281780 1 < completed write operation key=IK8POOY7ZWNF tag=81MJD0VABBIT type=write size=574754 2024-09-12T00:37:45.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.105+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~E51W6GJ7KPY6.0 size=1048576 2024-09-12T00:37:45.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.105+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~E51W6GJ7KPY6.1 size=298725 2024-09-12T00:37:45.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.105+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=E51W6GJ7KPY6 tag=6I3M80NPMJ2H type=write size=2395877 2024-09-12T00:37:45.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.107+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~3MTG00FAIGET.0 size=554400 2024-09-12T00:37:45.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.110+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=3MTG00FAIGET tag=OJLV200L20AX type=write size=1602976 2024-09-12T00:37:45.111 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.113+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~S320JFR4OS5W.0 size=1048576 2024-09-12T00:37:45.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.113+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~S320JFR4OS5W.1 size=86103 2024-09-12T00:37:45.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.113+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=S320JFR4OS5W tag=KBPFH0T7LN7P type=write size=2183255 2024-09-12T00:37:45.114 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.115+0000 7fcd44281780 -1 < failed to complete operation key=B5OH55MQGSGJ tag=OS95JZRI5TZX type=del size=2441991: (22) Invalid argument 2024-09-12T00:37:45.115 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.116+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=PZOKC2UN0BE9 type=del size=3006925 2024-09-12T00:37:45.117 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.118+0000 7fcd44281780 1 < completed write operation key=QVULC3H9QGXE tag=KO62B8ZWQ4SA type=write size=802996 2024-09-12T00:37:45.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.120+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=I9VLS0L58B93 type=del size=3449262 2024-09-12T00:37:45.120 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.122+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=7CB73Y972JC9 type=del 2024-09-12T00:37:45.123 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.124+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~X50ZFL2DKOND.0 size=1048576 2024-09-12T00:37:45.124 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.126+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~X50ZFL2DKOND.1 size=822734 2024-09-12T00:37:45.124 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.126+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=X50ZFL2DKOND tag=7KAPI8F0DYOY type=write size=2919886 2024-09-12T00:37:45.125 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.127+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=K3OEIZ35J19Q type=del 2024-09-12T00:37:45.128 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.129+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~9ZAL3WEU93TN.0 size=1048576 2024-09-12T00:37:45.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.130+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~9ZAL3WEU93TN.1 size=592023 2024-09-12T00:37:45.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.130+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=9ZAL3WEU93TN tag=3KLSFHGFHOVT type=write size=2689175 2024-09-12T00:37:45.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.132+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=3KEOC447N87K type=del 2024-09-12T00:37:45.132 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.133+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=JPSM4B5Q6CI9 type=del size=715793 2024-09-12T00:37:45.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.135+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=8H0J15RMFIHI type=del 2024-09-12T00:37:45.136 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.137+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~EXF9156801CM.0 size=1048576 2024-09-12T00:37:45.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.138+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~EXF9156801CM.1 size=1048576 2024-09-12T00:37:45.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.139+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~EXF9156801CM.2 size=400953 2024-09-12T00:37:45.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.139+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=EXF9156801CM tag=41IQPB1WBAYZ type=write size=3546681 2024-09-12T00:37:45.141 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.143+0000 7fcd44281780 1 < suggested update operation key=UWS056JN3IXO tag=4EUG6OTUO1CD type=del size=3360187 2024-09-12T00:37:45.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.145+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~AWEYNY34GAN1.0 size=733074 2024-09-12T00:37:45.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.145+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=AWEYNY34GAN1 tag=NTO9H7W7W7GO type=write size=1781650 2024-09-12T00:37:45.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.147+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=IN6QT38FES0P type=del 2024-09-12T00:37:45.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.150+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~BD3VZ2TYC52B.0 size=1048576 2024-09-12T00:37:45.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.151+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~BD3VZ2TYC52B.1 size=1048576 2024-09-12T00:37:45.151 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.152+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~BD3VZ2TYC52B.2 size=377894 2024-09-12T00:37:45.151 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.152+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=BD3VZ2TYC52B tag=Y3YM4VE6ZS1N type=write size=3523622 2024-09-12T00:37:45.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.154+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~WI7382XG3EF1.0 size=1048576 2024-09-12T00:37:45.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.156+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~WI7382XG3EF1.1 size=1048576 2024-09-12T00:37:45.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.157+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~WI7382XG3EF1.2 size=923221 2024-09-12T00:37:45.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.160+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=WI7382XG3EF1 tag=FIPTK9ZQQG22 type=write size=4068949 2024-09-12T00:37:45.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.161+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=VIP7CNBV0EXV type=del size=3109067 2024-09-12T00:37:45.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.161+0000 7fcd44281780 1 < canceled part key=_multipart_RYSE2CKE5IRT.2~XL36IT1JWIVR.0 size=1048576 2024-09-12T00:37:45.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.163+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~XL36IT1JWIVR.1 size=36424 2024-09-12T00:37:45.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.165+0000 7fcd44281780 1 < canceled multipart upload key=RYSE2CKE5IRT upload=XL36IT1JWIVR tag=UGDCGHGAKI06 type=write size=2133576 2024-09-12T00:37:45.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.168+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~L101BNUUTA2Q.0 size=1048576 2024-09-12T00:37:45.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.169+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~L101BNUUTA2Q.1 size=488354 2024-09-12T00:37:45.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.169+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=L101BNUUTA2Q tag=PSHLHEZU8V9F type=write size=2585506 2024-09-12T00:37:45.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.170+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~QI3YD02EBN9T.0 size=410473 2024-09-12T00:37:45.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.173+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=QI3YD02EBN9T tag=3F2RMJKZZX2V type=write size=1459049 2024-09-12T00:37:45.173 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.174+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=EJ3XEDLXTQQQ type=del size=485895 2024-09-12T00:37:45.176 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.177+0000 7fcd44281780 1 < suggested remove operation key=O12Z8THB62AJ tag=DFNK9SDEJT0E type=del 2024-09-12T00:37:45.178 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.179+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=NT25UTYOQFTS type=write size=820585 2024-09-12T00:37:45.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.181+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~XL1N10CK03F9.0 size=1048576 2024-09-12T00:37:45.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.182+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~XL1N10CK03F9.1 size=548240 2024-09-12T00:37:45.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.184+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=XL1N10CK03F9 tag=AS90DY060QUB type=write size=2645392 2024-09-12T00:37:45.185 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.186+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=KA16SJQRJX1P type=write size=473810 2024-09-12T00:37:45.186 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.188+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~A6LHJMZZNXCJ.0 size=1048576 2024-09-12T00:37:45.186 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.188+0000 7fcd44281780 1 < canceled part key=_multipart_WXBMIJ4FC0VX.2~A6LHJMZZNXCJ.1 size=509752 2024-09-12T00:37:45.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.190+0000 7fcd44281780 1 < canceled multipart upload key=WXBMIJ4FC0VX upload=A6LHJMZZNXCJ tag=6G37WABMASEI type=write size=2606904 2024-09-12T00:37:45.190 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.191+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=RLSOLS8QMBXH type=del size=2609425 2024-09-12T00:37:45.192 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.193+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~E51W6GJ7KPY6.0 size=1048576 2024-09-12T00:37:45.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.195+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~E51W6GJ7KPY6.1 size=298725 2024-09-12T00:37:45.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.197+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=E51W6GJ7KPY6 tag=6I3M80NPMJ2H type=write size=2395877 2024-09-12T00:37:45.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.198+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=JWV1JZ92CDKB type=write size=21938 2024-09-12T00:37:45.199 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.200+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~S320JFR4OS5W.0 size=1048576 2024-09-12T00:37:45.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.203+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~S320JFR4OS5W.1 size=86103 2024-09-12T00:37:45.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.205+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=S320JFR4OS5W tag=KBPFH0T7LN7P type=write size=2183255 2024-09-12T00:37:45.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.207+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~7GKELC2CON89.0 size=1048576 2024-09-12T00:37:45.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.209+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~7GKELC2CON89.1 size=1048576 2024-09-12T00:37:45.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.209+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~7GKELC2CON89.2 size=76156 2024-09-12T00:37:45.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.209+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=7GKELC2CON89 tag=A6ABM0W6Z02A type=write size=3221884 2024-09-12T00:37:45.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.212+0000 7fcd44281780 1 < suggested update operation key=WXBMIJ4FC0VX tag=PZOKC2UN0BE9 type=del size=3006925 2024-09-12T00:37:45.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.215+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~0A0AW5WCSC6D.0 size=568057 2024-09-12T00:37:45.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.215+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=0A0AW5WCSC6D tag=XYUUE5S1UWGK type=write size=1616633 2024-09-12T00:37:45.215 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.216+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=I9VLS0L58B93 type=del 2024-09-12T00:37:45.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.217+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=08P972SIHHV0 type=del size=1432365 2024-09-12T00:37:45.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.219+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~X50ZFL2DKOND.0 size=1048576 2024-09-12T00:37:45.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.220+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~X50ZFL2DKOND.1 size=822734 2024-09-12T00:37:45.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.222+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=X50ZFL2DKOND tag=7KAPI8F0DYOY type=write size=2919886 2024-09-12T00:37:45.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.223+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=NCTHK2X32R91 type=del size=3814197 2024-09-12T00:37:45.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.224+0000 7fcd44281780 1 < canceled part key=_multipart_AJ5AUTM2J9MT.2~9ZAL3WEU93TN.0 size=1048576 2024-09-12T00:37:45.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.225+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~9ZAL3WEU93TN.1 size=592023 2024-09-12T00:37:45.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.227+0000 7fcd44281780 1 < canceled multipart upload key=AJ5AUTM2J9MT upload=9ZAL3WEU93TN tag=3KLSFHGFHOVT type=write size=2689175 2024-09-12T00:37:45.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.228+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=88HUXE7J8YR8 type=del size=2347642 2024-09-12T00:37:45.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.230+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=JPSM4B5Q6CI9 type=del 2024-09-12T00:37:45.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.231+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=DIKFNB20YJOQ type=del size=786608 2024-09-12T00:37:45.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.232+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~EXF9156801CM.0 size=1048576 2024-09-12T00:37:45.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.233+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~EXF9156801CM.1 size=1048576 2024-09-12T00:37:45.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.235+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~EXF9156801CM.2 size=400953 2024-09-12T00:37:45.235 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.237+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=EXF9156801CM tag=41IQPB1WBAYZ type=write size=3546681 2024-09-12T00:37:45.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.238+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=98S9RZCGR2XY type=del size=1818833 2024-09-12T00:37:45.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.239+0000 7fcd44281780 1 < canceled part key=_multipart_WXBMIJ4FC0VX.2~AWEYNY34GAN1.0 size=733074 2024-09-12T00:37:45.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.241+0000 7fcd44281780 1 < canceled multipart upload key=WXBMIJ4FC0VX upload=AWEYNY34GAN1 tag=NTO9H7W7W7GO type=write size=1781650 2024-09-12T00:37:45.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.243+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~OBT8DSS32LG8.0 size=816678 2024-09-12T00:37:45.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.243+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=OBT8DSS32LG8 tag=FUNWH6DWSBD8 type=write size=1865254 2024-09-12T00:37:45.243 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.245+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~BD3VZ2TYC52B.0 size=1048576 2024-09-12T00:37:45.244 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.246+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~BD3VZ2TYC52B.1 size=1048576 2024-09-12T00:37:45.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.247+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~BD3VZ2TYC52B.2 size=377894 2024-09-12T00:37:45.248 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.249+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=BD3VZ2TYC52B tag=Y3YM4VE6ZS1N type=write size=3523622 2024-09-12T00:37:45.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.250+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=5WY5JM1HMG6B type=del size=1625829 2024-09-12T00:37:45.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.253+0000 7fcd44281780 1 < suggested update operation key=8U004LC8IYLQ tag=VIP7CNBV0EXV type=del size=3109067 2024-09-12T00:37:45.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.254+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=T1GCE8PZ8FD4 type=del size=4184099 2024-09-12T00:37:45.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.256+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~L101BNUUTA2Q.0 size=1048576 2024-09-12T00:37:45.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.256+0000 7fcd44281780 1 < canceled part key=_multipart_VXDTFEG8P23H.2~L101BNUUTA2Q.1 size=488354 2024-09-12T00:37:45.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.258+0000 7fcd44281780 1 < canceled multipart upload key=VXDTFEG8P23H upload=L101BNUUTA2Q tag=PSHLHEZU8V9F type=write size=2585506 2024-09-12T00:37:45.258 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.259+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=LIT74I1FN0YF type=del size=443979 2024-09-12T00:37:45.259 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.261+0000 7fcd44281780 1 < completed delete operation key=4RU6HTH4J0U1 tag=EJ3XEDLXTQQQ type=del 2024-09-12T00:37:45.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.262+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=QBXDD7UNSA4V type=del size=715490 2024-09-12T00:37:45.262 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.263+0000 7fcd44281780 1 < completed write operation key=EXP8U6QNSMQ0 tag=NT25UTYOQFTS type=write size=820585 2024-09-12T00:37:45.265 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.266+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~F7RDGUTES320.0 size=1048576 2024-09-12T00:37:45.266 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.267+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~F7RDGUTES320.1 size=996014 2024-09-12T00:37:45.266 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.267+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=F7RDGUTES320 tag=JH38IF1JJAWV type=write size=3093166 2024-09-12T00:37:45.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.268+0000 7fcd44281780 1 < completed write operation key=NIDHAXQF55WX tag=KA16SJQRJX1P type=write size=473810 2024-09-12T00:37:45.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.270+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=9O7W5A8L4OTX type=write size=458131 2024-09-12T00:37:45.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.273+0000 7fcd44281780 1 < suggested update operation key=UWS056JN3IXO tag=RLSOLS8QMBXH type=del size=2609425 2024-09-12T00:37:45.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.274+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=UC6UAUWUME2P type=write size=650879 2024-09-12T00:37:45.274 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.276+0000 7fcd44281780 1 < canceled operation key=RYSE2CKE5IRT tag=JWV1JZ92CDKB type=write size=21938 2024-09-12T00:37:45.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.278+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~OK77JVBZS2RU.0 size=63779 2024-09-12T00:37:45.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.278+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=OK77JVBZS2RU tag=LTSMWTO6G9RE type=write size=1112355 2024-09-12T00:37:45.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.280+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~7GKELC2CON89.0 size=1048576 2024-09-12T00:37:45.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.281+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~7GKELC2CON89.1 size=1048576 2024-09-12T00:37:45.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.282+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~7GKELC2CON89.2 size=76156 2024-09-12T00:37:45.283 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.284+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=7GKELC2CON89 tag=A6ABM0W6Z02A type=write size=3221884 2024-09-12T00:37:45.284 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.286+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=QVGHCEO3VYC5 type=write size=133895 2024-09-12T00:37:45.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.287+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~0A0AW5WCSC6D.0 size=568057 2024-09-12T00:37:45.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.289+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=0A0AW5WCSC6D tag=XYUUE5S1UWGK type=write size=1616633 2024-09-12T00:37:45.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.291+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=ZJMT5EF1X1DK type=del size=1436398 2024-09-12T00:37:45.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.292+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=08P972SIHHV0 type=del 2024-09-12T00:37:45.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.294+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~X5B4RDLKVEE0.0 size=1048576 2024-09-12T00:37:45.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.296+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~X5B4RDLKVEE0.1 size=1048576 2024-09-12T00:37:45.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.297+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~X5B4RDLKVEE0.2 size=685729 2024-09-12T00:37:45.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.297+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=X5B4RDLKVEE0 tag=S1BVY4OTAK3O type=write size=3831457 2024-09-12T00:37:45.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.298+0000 7fcd44281780 -1 < failed to complete operation key=UWS056JN3IXO tag=NCTHK2X32R91 type=del size=3814197: (22) Invalid argument 2024-09-12T00:37:45.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.299+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=QXE0X0NE2TX2 type=del size=376430 2024-09-12T00:37:45.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.301+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=88HUXE7J8YR8 type=del 2024-09-12T00:37:45.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.304+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~DORL2AWPOIUO.0 size=1048576 2024-09-12T00:37:45.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.305+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~DORL2AWPOIUO.1 size=276347 2024-09-12T00:37:45.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.305+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=DORL2AWPOIUO tag=825YUWNW003P type=write size=2373499 2024-09-12T00:37:45.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.308+0000 7fcd44281780 1 < suggested remove operation key=QVULC3H9QGXE tag=DIKFNB20YJOQ type=del 2024-09-12T00:37:45.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.309+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=W8VNJACOFFRB type=write size=621361 2024-09-12T00:37:45.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.310+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=98S9RZCGR2XY type=del 2024-09-12T00:37:45.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.312+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=7LBLFY9YBSV3 type=del size=3634475 2024-09-12T00:37:45.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.313+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~OBT8DSS32LG8.0 size=816678 2024-09-12T00:37:45.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.315+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=OBT8DSS32LG8 tag=FUNWH6DWSBD8 type=write size=1865254 2024-09-12T00:37:45.316 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.317+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=0IAXD00KK27H type=del size=3282271 2024-09-12T00:37:45.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.318+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=5WY5JM1HMG6B type=del 2024-09-12T00:37:45.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.319+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=DN7O4G2A5V2W type=write size=807679 2024-09-12T00:37:45.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.322+0000 7fcd44281780 1 < suggested update operation key=KNBCXZF3JGNL tag=T1GCE8PZ8FD4 type=del size=4184099 2024-09-12T00:37:45.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.325+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~BRCXYP46MM08.0 size=509304 2024-09-12T00:37:45.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.325+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=BRCXYP46MM08 tag=YN527P1HI1YM type=write size=1557880 2024-09-12T00:37:45.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.326+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=LIT74I1FN0YF type=del 2024-09-12T00:37:45.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.329+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~KLEPN1ZTCHVB.0 size=599153 2024-09-12T00:37:45.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.329+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=KLEPN1ZTCHVB tag=JPIGLEIUFK7J type=write size=1647729 2024-09-12T00:37:45.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.331+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=QBXDD7UNSA4V type=del 2024-09-12T00:37:45.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.333+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=5GOIAPNMHF2F type=write size=175132 2024-09-12T00:37:45.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.334+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~F7RDGUTES320.0 size=1048576 2024-09-12T00:37:45.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.334+0000 7fcd44281780 1 < canceled part key=_multipart_O12Z8THB62AJ.2~F7RDGUTES320.1 size=996014 2024-09-12T00:37:45.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.336+0000 7fcd44281780 1 < canceled multipart upload key=O12Z8THB62AJ upload=F7RDGUTES320 tag=JH38IF1JJAWV type=write size=3093166 2024-09-12T00:37:45.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.339+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~9OPD7V4WAY7J.0 size=1048576 2024-09-12T00:37:45.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.340+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~9OPD7V4WAY7J.1 size=652331 2024-09-12T00:37:45.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.340+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=9OPD7V4WAY7J tag=I1SJLC1724Z6 type=write size=2749483 2024-09-12T00:37:45.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.341+0000 7fcd44281780 1 < completed write operation key=0O62FO4WVZG6 tag=9O7W5A8L4OTX type=write size=458131 2024-09-12T00:37:45.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.342+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=7G2P3GQC0QGZ type=del size=1836238 2024-09-12T00:37:45.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.344+0000 7fcd44281780 1 < completed write operation key=WXBMIJ4FC0VX tag=UC6UAUWUME2P type=write size=650879 2024-09-12T00:37:45.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.345+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=1LNT4GWFUIHG type=write size=423292 2024-09-12T00:37:45.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.347+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~OK77JVBZS2RU.0 size=63779 2024-09-12T00:37:45.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.349+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=OK77JVBZS2RU tag=LTSMWTO6G9RE type=write size=1112355 2024-09-12T00:37:45.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.350+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=9XN0C02QZC4G type=del size=3854001 2024-09-12T00:37:45.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.354+0000 7fcd44281780 1 < suggested remove operation key=AJ5AUTM2J9MT tag=QVGHCEO3VYC5 type=write 2024-09-12T00:37:45.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.355+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=4ZMV7RM12Y23 type=del size=219821 2024-09-12T00:37:45.357 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.358+0000 7fcd44281780 1 < suggested update operation key=IK8POOY7ZWNF tag=ZJMT5EF1X1DK type=del size=1436398 2024-09-12T00:37:45.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.360+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=PGNHY6Z2A60M type=del size=3813591 2024-09-12T00:37:45.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.361+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~X5B4RDLKVEE0.0 size=1048576 2024-09-12T00:37:45.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.362+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~X5B4RDLKVEE0.1 size=1048576 2024-09-12T00:37:45.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.363+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~X5B4RDLKVEE0.2 size=685729 2024-09-12T00:37:45.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.365+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=X5B4RDLKVEE0 tag=S1BVY4OTAK3O type=write size=3831457 2024-09-12T00:37:45.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.367+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=9XT48MFO5OXC type=write size=45092 2024-09-12T00:37:45.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.368+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=QXE0X0NE2TX2 type=del 2024-09-12T00:37:45.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.369+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=7A7GXLHIV54U type=write size=730872 2024-09-12T00:37:45.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.371+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~DORL2AWPOIUO.0 size=1048576 2024-09-12T00:37:45.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.372+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~DORL2AWPOIUO.1 size=276347 2024-09-12T00:37:45.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.374+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=DORL2AWPOIUO tag=825YUWNW003P type=write size=2373499 2024-09-12T00:37:45.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.375+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=8LGGLL3QH6NT type=write size=647401 2024-09-12T00:37:45.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.378+0000 7fcd44281780 1 < suggested update operation key=XTNXNF3D0HFK tag=W8VNJACOFFRB type=write size=621361 2024-09-12T00:37:45.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.381+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~D9S1K6BDSFVB.0 size=256689 2024-09-12T00:37:45.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.381+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=D9S1K6BDSFVB tag=RNM0KWKD2LWM type=write size=1305265 2024-09-12T00:37:45.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.383+0000 7fcd44281780 1 < suggested update operation key=7UCICX0GHHQ1 tag=7LBLFY9YBSV3 type=del size=3634475 2024-09-12T00:37:45.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.385+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=RPS8AUGK4TAK type=del size=2225808 2024-09-12T00:37:45.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.386+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=0IAXD00KK27H type=del 2024-09-12T00:37:45.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.389+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~OAQZT1L2E4GU.0 size=1048576 2024-09-12T00:37:45.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.390+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~OAQZT1L2E4GU.1 size=1048576 2024-09-12T00:37:45.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.391+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~OAQZT1L2E4GU.2 size=921321 2024-09-12T00:37:45.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.391+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=OAQZT1L2E4GU tag=358PRYXOVMBZ type=write size=4067049 2024-09-12T00:37:45.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.393+0000 7fcd44281780 1 < suggested remove operation key=O12Z8THB62AJ tag=DN7O4G2A5V2W type=write 2024-09-12T00:37:45.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.395+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=DSPOG7LRXJLI type=del size=1410236 2024-09-12T00:37:45.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.396+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~BRCXYP46MM08.0 size=509304 2024-09-12T00:37:45.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.399+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=BRCXYP46MM08 tag=YN527P1HI1YM type=write size=1557880 2024-09-12T00:37:45.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.401+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~AUMSWDCWBEY2.0 size=1048576 2024-09-12T00:37:45.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.403+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~AUMSWDCWBEY2.1 size=74048 2024-09-12T00:37:45.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.403+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=AUMSWDCWBEY2 tag=Z5N8CM1UF3SP type=write size=2171200 2024-09-12T00:37:45.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.404+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~KLEPN1ZTCHVB.0 size=599153 2024-09-12T00:37:45.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.407+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=KLEPN1ZTCHVB tag=JPIGLEIUFK7J type=write size=1647729 2024-09-12T00:37:45.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.408+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=R0P80L3U0W9Q type=del size=99069 2024-09-12T00:37:45.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.411+0000 7fcd44281780 1 < suggested remove operation key=0OEDZ5O2LN8H tag=5GOIAPNMHF2F type=write 2024-09-12T00:37:45.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.412+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=XIZEY19FUTPD type=del size=1138417 2024-09-12T00:37:45.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.413+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~9OPD7V4WAY7J.0 size=1048576 2024-09-12T00:37:45.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.414+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~9OPD7V4WAY7J.1 size=652331 2024-09-12T00:37:45.416 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.417+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=9OPD7V4WAY7J tag=I1SJLC1724Z6 type=write size=2749483 2024-09-12T00:37:45.418 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.419+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~GLQMH34WP24R.0 size=1048576 2024-09-12T00:37:45.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.421+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~GLQMH34WP24R.1 size=1048576 2024-09-12T00:37:45.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.422+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~GLQMH34WP24R.2 size=829676 2024-09-12T00:37:45.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.422+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=GLQMH34WP24R tag=ZL712Y04RLKZ type=write size=3975404 2024-09-12T00:37:45.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.423+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=7G2P3GQC0QGZ type=del 2024-09-12T00:37:45.423 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.425+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=CDU7IAHV83QV type=del size=3103237 2024-09-12T00:37:45.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.426+0000 7fcd44281780 1 < completed write operation key=0AVE0W4OV1AU tag=1LNT4GWFUIHG type=write size=423292 2024-09-12T00:37:45.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.428+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=JH3UQ9EGLXD9 type=del size=1310937 2024-09-12T00:37:45.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.429+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=9XN0C02QZC4G type=del 2024-09-12T00:37:45.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.431+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=QA47T7BWLSBZ type=del size=3997802 2024-09-12T00:37:45.431 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.432+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=4ZMV7RM12Y23 type=del 2024-09-12T00:37:45.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.434+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=CT8ISITV0W6C type=del size=1500720 2024-09-12T00:37:45.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.435+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=PGNHY6Z2A60M type=del 2024-09-12T00:37:45.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.437+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=8JRKXYHPIL5G type=del size=1921555 2024-09-12T00:37:45.437 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.438+0000 7fcd44281780 1 < completed write operation key=ZQSZDU87GAMV tag=9XT48MFO5OXC type=write size=45092 2024-09-12T00:37:45.439 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.440+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=GDI0U1FVU9C3 type=write size=220141 2024-09-12T00:37:45.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.441+0000 7fcd44281780 1 < completed write operation key=U4EPPPA4QGGD tag=7A7GXLHIV54U type=write size=730872 2024-09-12T00:37:45.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.443+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=1YQE8PIPG0WP type=del size=2846838 2024-09-12T00:37:45.444 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.445+0000 7fcd44281780 1 < suggested remove operation key=DKJ44Z9COIIK tag=8LGGLL3QH6NT type=write 2024-09-12T00:37:45.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.448+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~W8AG0L0LA717.0 size=1048576 2024-09-12T00:37:45.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.450+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~W8AG0L0LA717.1 size=490345 2024-09-12T00:37:45.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.450+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=W8AG0L0LA717 tag=WZPBJFO059CW type=write size=2587497 2024-09-12T00:37:45.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.451+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~D9S1K6BDSFVB.0 size=256689 2024-09-12T00:37:45.452 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.453+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=D9S1K6BDSFVB tag=RNM0KWKD2LWM type=write size=1305265 2024-09-12T00:37:45.453 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.454+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=KVHSBBKIY3LR type=del size=2907626 2024-09-12T00:37:45.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.455+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=RPS8AUGK4TAK type=del 2024-09-12T00:37:45.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.458+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~MMEL318GTMKV.0 size=1048576 2024-09-12T00:37:45.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.459+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~MMEL318GTMKV.1 size=1048576 2024-09-12T00:37:45.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.460+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~MMEL318GTMKV.2 size=268523 2024-09-12T00:37:45.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.460+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=MMEL318GTMKV tag=F8XWVGBWKCTF type=write size=3414251 2024-09-12T00:37:45.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.462+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~OAQZT1L2E4GU.0 size=1048576 2024-09-12T00:37:45.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.464+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~OAQZT1L2E4GU.1 size=1048576 2024-09-12T00:37:45.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.465+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~OAQZT1L2E4GU.2 size=921321 2024-09-12T00:37:45.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.468+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=OAQZT1L2E4GU tag=358PRYXOVMBZ type=write size=4067049 2024-09-12T00:37:45.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.470+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~2DNUQPJVJ03A.0 size=1048576 2024-09-12T00:37:45.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.471+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~2DNUQPJVJ03A.1 size=802754 2024-09-12T00:37:45.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.471+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=2DNUQPJVJ03A tag=239XSO1JQZMD type=write size=2899906 2024-09-12T00:37:45.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.473+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=DSPOG7LRXJLI type=del 2024-09-12T00:37:45.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.474+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=NWEIK2OYQX7D type=write size=490105 2024-09-12T00:37:45.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.475+0000 7fcd44281780 1 < canceled part key=_multipart_KJ0C43WLAFLI.2~AUMSWDCWBEY2.0 size=1048576 2024-09-12T00:37:45.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.476+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~AUMSWDCWBEY2.1 size=74048 2024-09-12T00:37:45.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.478+0000 7fcd44281780 1 < canceled multipart upload key=KJ0C43WLAFLI upload=AUMSWDCWBEY2 tag=Z5N8CM1UF3SP type=write size=2171200 2024-09-12T00:37:45.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.479+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=DVNZW4J676H6 type=del size=4020129 2024-09-12T00:37:45.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.481+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=R0P80L3U0W9Q type=del 2024-09-12T00:37:45.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.484+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~P2QQOHVNL081.0 size=1048576 2024-09-12T00:37:45.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.485+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~P2QQOHVNL081.1 size=1048576 2024-09-12T00:37:45.485 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.486+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~P2QQOHVNL081.2 size=606364 2024-09-12T00:37:45.485 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.486+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=P2QQOHVNL081 tag=ZJC6KQSP92AN type=write size=3752092 2024-09-12T00:37:45.487 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.488+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=XIZEY19FUTPD type=del 2024-09-12T00:37:45.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.489+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=PAV0E7Z8Q6BS type=del size=3706775 2024-09-12T00:37:45.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.491+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~GLQMH34WP24R.0 size=1048576 2024-09-12T00:37:45.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.492+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~GLQMH34WP24R.1 size=1048576 2024-09-12T00:37:45.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.493+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~GLQMH34WP24R.2 size=829676 2024-09-12T00:37:45.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.495+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=GLQMH34WP24R tag=ZL712Y04RLKZ type=write size=3975404 2024-09-12T00:37:45.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.496+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=F7D39VFIS4CN type=del size=1636730 2024-09-12T00:37:45.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.498+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=CDU7IAHV83QV type=del 2024-09-12T00:37:45.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.501+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~385FOOFMUBGR.0 size=1048576 2024-09-12T00:37:45.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.502+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~385FOOFMUBGR.1 size=1048576 2024-09-12T00:37:45.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.503+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~385FOOFMUBGR.2 size=71638 2024-09-12T00:37:45.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.503+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=385FOOFMUBGR tag=8FHPNS1P2HU6 type=write size=3217366 2024-09-12T00:37:45.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.505+0000 7fcd44281780 1 < suggested update operation key=7UCICX0GHHQ1 tag=JH3UQ9EGLXD9 type=del size=1310937 2024-09-12T00:37:45.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.507+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=SSM1IXU5W5FS type=del size=3691206 2024-09-12T00:37:45.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.510+0000 7fcd44281780 1 < suggested update operation key=CF7B7J3V1YFG tag=QA47T7BWLSBZ type=del size=3997802 2024-09-12T00:37:45.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.511+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=SPBMMKBK5KOH type=del size=1757802 2024-09-12T00:37:45.512 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.513+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=CT8ISITV0W6C type=del 2024-09-12T00:37:45.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.516+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~PX72FSICVTCQ.0 size=1048576 2024-09-12T00:37:45.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.517+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~PX72FSICVTCQ.1 size=355997 2024-09-12T00:37:45.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.517+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=PX72FSICVTCQ tag=5WE1977OZB6E type=write size=2453149 2024-09-12T00:37:45.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.518+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=8JRKXYHPIL5G type=del 2024-09-12T00:37:45.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.521+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~S2PAKK85PD44.0 size=697023 2024-09-12T00:37:45.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.521+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=S2PAKK85PD44 tag=JJY3KF2154WL type=write size=1745599 2024-09-12T00:37:45.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.524+0000 7fcd44281780 1 < suggested update operation key=B5OH55MQGSGJ tag=GDI0U1FVU9C3 type=write size=220141 2024-09-12T00:37:45.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.525+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=Y3ET6CJAZA35 type=del size=2659783 2024-09-12T00:37:45.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.527+0000 7fcd44281780 1 < suggested remove operation key=UXY6K0AVI4EK tag=1YQE8PIPG0WP type=del 2024-09-12T00:37:45.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.530+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~RF2785U1LTQD.0 size=733564 2024-09-12T00:37:45.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.530+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=RF2785U1LTQD tag=49JTW95D7Y9E type=write size=1782140 2024-09-12T00:37:45.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.531+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~W8AG0L0LA717.0 size=1048576 2024-09-12T00:37:45.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.533+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~W8AG0L0LA717.1 size=490345 2024-09-12T00:37:45.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.535+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=W8AG0L0LA717 tag=WZPBJFO059CW type=write size=2587497 2024-09-12T00:37:45.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.536+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=Q2TPQA5Y99EB type=del size=771441 2024-09-12T00:37:45.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.539+0000 7fcd44281780 1 < suggested remove operation key=Z6I6598B6J5I tag=KVHSBBKIY3LR type=del 2024-09-12T00:37:45.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.541+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=JHO0PKSQOE36 type=del size=2221437 2024-09-12T00:37:45.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.542+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~MMEL318GTMKV.0 size=1048576 2024-09-12T00:37:45.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.543+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~MMEL318GTMKV.1 size=1048576 2024-09-12T00:37:45.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.544+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~MMEL318GTMKV.2 size=268523 2024-09-12T00:37:45.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.547+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=MMEL318GTMKV tag=F8XWVGBWKCTF type=write size=3414251 2024-09-12T00:37:45.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.548+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=A9Y0XPGRPIHQ type=del size=2601423 2024-09-12T00:37:45.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.550+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~2DNUQPJVJ03A.0 size=1048576 2024-09-12T00:37:45.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.551+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~2DNUQPJVJ03A.1 size=802754 2024-09-12T00:37:45.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.553+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=2DNUQPJVJ03A tag=239XSO1JQZMD type=write size=2899906 2024-09-12T00:37:45.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.554+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=BBT9A90YXA37 type=del size=141120 2024-09-12T00:37:45.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.556+0000 7fcd44281780 1 < completed write operation key=RYSE2CKE5IRT tag=NWEIK2OYQX7D type=write size=490105 2024-09-12T00:37:45.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.558+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~ER9M82OICTKV.0 size=1048576 2024-09-12T00:37:45.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.559+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~ER9M82OICTKV.1 size=1048576 2024-09-12T00:37:45.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.560+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~ER9M82OICTKV.2 size=539689 2024-09-12T00:37:45.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.560+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=ER9M82OICTKV tag=KCRRV25GK8IU type=write size=3685417 2024-09-12T00:37:45.561 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.562+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=DVNZW4J676H6 type=del 2024-09-12T00:37:45.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.565+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~5109ZM077T1U.0 size=519784 2024-09-12T00:37:45.564 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.565+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=5109ZM077T1U tag=Y76REIJK1TSZ type=write size=1568360 2024-09-12T00:37:45.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.566+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~P2QQOHVNL081.0 size=1048576 2024-09-12T00:37:45.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.567+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~P2QQOHVNL081.1 size=1048576 2024-09-12T00:37:45.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.567+0000 7fcd44281780 1 < canceled part key=_multipart_AJ5AUTM2J9MT.2~P2QQOHVNL081.2 size=606364 2024-09-12T00:37:45.569 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.570+0000 7fcd44281780 1 < canceled multipart upload key=AJ5AUTM2J9MT upload=P2QQOHVNL081 tag=ZJC6KQSP92AN type=write size=3752092 2024-09-12T00:37:45.570 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.571+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=UEWI885XKB1T type=del size=3743957 2024-09-12T00:37:45.573 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.574+0000 7fcd44281780 1 < suggested update operation key=0ELZXPZCRPGP tag=PAV0E7Z8Q6BS type=del size=3706775 2024-09-12T00:37:45.574 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.575+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=R4AS8QEHRRMB type=del size=532756 2024-09-12T00:37:45.575 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.577+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=F7D39VFIS4CN type=del 2024-09-12T00:37:45.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.578+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=MMRIQAQWOSFD type=del size=1066732 2024-09-12T00:37:45.578 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.580+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~385FOOFMUBGR.0 size=1048576 2024-09-12T00:37:45.580 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.581+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~385FOOFMUBGR.1 size=1048576 2024-09-12T00:37:45.581 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.582+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~385FOOFMUBGR.2 size=71638 2024-09-12T00:37:45.583 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.584+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=385FOOFMUBGR tag=8FHPNS1P2HU6 type=write size=3217366 2024-09-12T00:37:45.584 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.586+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=O4ALVKKRN3GU type=del size=2800216 2024-09-12T00:37:45.586 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.587+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=SSM1IXU5W5FS type=del 2024-09-12T00:37:45.590 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.591+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~80CCHZOJ89QS.0 size=1048576 2024-09-12T00:37:45.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.592+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~80CCHZOJ89QS.1 size=1048576 2024-09-12T00:37:45.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.594+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~80CCHZOJ89QS.2 size=138620 2024-09-12T00:37:45.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.594+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=80CCHZOJ89QS tag=EBC4Q0FCGIF3 type=write size=3284348 2024-09-12T00:37:45.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.595+0000 7fcd44281780 1 < canceled operation key=G8O8VXTUPQVP tag=SPBMMKBK5KOH type=del size=1757802 2024-09-12T00:37:45.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.598+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=HV648BSQC5P8 type=write size=689922 2024-09-12T00:37:45.599 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.600+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~PX72FSICVTCQ.0 size=1048576 2024-09-12T00:37:45.599 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.600+0000 7fcd44281780 1 < canceled part key=_multipart_AN6GRGZ22INA.2~PX72FSICVTCQ.1 size=355997 2024-09-12T00:37:45.601 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.602+0000 7fcd44281780 1 < canceled multipart upload key=AN6GRGZ22INA upload=PX72FSICVTCQ tag=5WE1977OZB6E type=write size=2453149 2024-09-12T00:37:45.603 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.604+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=1A3RPKWF5SEK type=del size=3370442 2024-09-12T00:37:45.604 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.605+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~S2PAKK85PD44.0 size=697023 2024-09-12T00:37:45.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.607+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=S2PAKK85PD44 tag=JJY3KF2154WL type=write size=1745599 2024-09-12T00:37:45.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.609+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=VAHPJJI4XE20 type=write size=287774 2024-09-12T00:37:45.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.611+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=Y3ET6CJAZA35 type=del 2024-09-12T00:37:45.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.612+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=5WXVF8C1IZC6 type=del size=904721 2024-09-12T00:37:45.612 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.613+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~RF2785U1LTQD.0 size=733564 2024-09-12T00:37:45.614 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.615+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=RF2785U1LTQD tag=49JTW95D7Y9E type=write size=1782140 2024-09-12T00:37:45.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.617+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=CV31E0UOJ8XV type=write size=922174 2024-09-12T00:37:45.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.618+0000 7fcd44281780 1 < canceled operation key=EXP8U6QNSMQ0 tag=Q2TPQA5Y99EB type=del size=771441 2024-09-12T00:37:45.619 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.620+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=HIE1GX8WO2IW type=del size=1511645 2024-09-12T00:37:45.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.621+0000 7fcd44281780 -1 < failed to complete operation key=0ELZXPZCRPGP tag=JHO0PKSQOE36 type=del size=2221437: (22) Invalid argument 2024-09-12T00:37:45.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.624+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~3023TXT2M28N.0 size=1048576 2024-09-12T00:37:45.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.625+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~3023TXT2M28N.1 size=870063 2024-09-12T00:37:45.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.625+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=3023TXT2M28N tag=V0CMZ4MYMF2N type=write size=2967215 2024-09-12T00:37:45.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.626+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=A9Y0XPGRPIHQ type=del 2024-09-12T00:37:45.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.628+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=H2EKBJKY3FDI type=del size=3404138 2024-09-12T00:37:45.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.629+0000 7fcd44281780 1 < canceled operation key=O12Z8THB62AJ tag=BBT9A90YXA37 type=del size=141120 2024-09-12T00:37:45.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.631+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=L911OUDFUVZ1 type=del size=3495319 2024-09-12T00:37:45.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.632+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~ER9M82OICTKV.0 size=1048576 2024-09-12T00:37:45.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.633+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~ER9M82OICTKV.1 size=1048576 2024-09-12T00:37:45.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.634+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~ER9M82OICTKV.2 size=539689 2024-09-12T00:37:45.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.637+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=ER9M82OICTKV tag=KCRRV25GK8IU type=write size=3685417 2024-09-12T00:37:45.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.638+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=43TM2NGQ26XM type=del size=881544 2024-09-12T00:37:45.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.639+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~5109ZM077T1U.0 size=519784 2024-09-12T00:37:45.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.642+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=5109ZM077T1U tag=Y76REIJK1TSZ type=write size=1568360 2024-09-12T00:37:45.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.644+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~X1Q3B3CH7UI0.0 size=47504 2024-09-12T00:37:45.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.644+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=X1Q3B3CH7UI0 tag=PU0EDKPA8UI0 type=write size=1096080 2024-09-12T00:37:45.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.646+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=UEWI885XKB1T type=del 2024-09-12T00:37:45.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.648+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~18T4NDV29Z9E.0 size=1048576 2024-09-12T00:37:45.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.649+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~18T4NDV29Z9E.1 size=804373 2024-09-12T00:37:45.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.649+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=18T4NDV29Z9E tag=IH5MV7NJTO3Y type=write size=2901525 2024-09-12T00:37:45.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.651+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=R4AS8QEHRRMB type=del 2024-09-12T00:37:45.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.652+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=RVS8U0XOF4IH type=del size=2227168 2024-09-12T00:37:45.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.653+0000 7fcd44281780 1 < canceled operation key=UWS056JN3IXO tag=MMRIQAQWOSFD type=del size=1066732 2024-09-12T00:37:45.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.656+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~X7YEN7OD313J.0 size=1048576 2024-09-12T00:37:45.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.657+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~X7YEN7OD313J.1 size=489541 2024-09-12T00:37:45.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.657+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=X7YEN7OD313J tag=7X5ZUUJEZAGK type=write size=2586693 2024-09-12T00:37:45.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.658+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=O4ALVKKRN3GU type=del 2024-09-12T00:37:45.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.660+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=I7D337DA7BQY type=write size=59964 2024-09-12T00:37:45.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.661+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~80CCHZOJ89QS.0 size=1048576 2024-09-12T00:37:45.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.662+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~80CCHZOJ89QS.1 size=1048576 2024-09-12T00:37:45.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.662+0000 7fcd44281780 1 < canceled part key=_multipart_UXY6K0AVI4EK.2~80CCHZOJ89QS.2 size=138620 2024-09-12T00:37:45.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.664+0000 7fcd44281780 1 < canceled multipart upload key=UXY6K0AVI4EK upload=80CCHZOJ89QS tag=EBC4Q0FCGIF3 type=write size=3284348 2024-09-12T00:37:45.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.666+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=MR055ZZ6VKXK type=del size=4090309 2024-09-12T00:37:45.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.668+0000 7fcd44281780 1 < suggested remove operation key=QVULC3H9QGXE tag=HV648BSQC5P8 type=write 2024-09-12T00:37:45.669 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.671+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~3MYRQFBRT5RG.0 size=870592 2024-09-12T00:37:45.669 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.671+0000 7fcd44281780 1 > prepared multipart upload key=U4EPPPA4QGGD upload=3MYRQFBRT5RG tag=UAEH01WQGIJA type=write size=1919168 2024-09-12T00:37:45.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.673+0000 7fcd44281780 1 < suggested remove operation key=7UCICX0GHHQ1 tag=1A3RPKWF5SEK type=del 2024-09-12T00:37:45.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.676+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~2R100OQGOE3Q.0 size=1048576 2024-09-12T00:37:45.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.677+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~2R100OQGOE3Q.1 size=1048576 2024-09-12T00:37:45.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.678+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~2R100OQGOE3Q.2 size=252998 2024-09-12T00:37:45.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.678+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=2R100OQGOE3Q tag=GPFTDO9JY6UT type=write size=3398726 2024-09-12T00:37:45.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.679+0000 7fcd44281780 1 < completed write operation key=AN6GRGZ22INA tag=VAHPJJI4XE20 type=write size=287774 2024-09-12T00:37:45.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.681+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=ZC09FXVADNNF type=write size=338569 2024-09-12T00:37:45.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.682+0000 7fcd44281780 1 < canceled operation key=VOO70F2NBKL0 tag=5WXVF8C1IZC6 type=del size=904721 2024-09-12T00:37:45.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.685+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~VQKS6YYMB3Q2.0 size=1048576 2024-09-12T00:37:45.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.686+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~VQKS6YYMB3Q2.1 size=763129 2024-09-12T00:37:45.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.686+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=VQKS6YYMB3Q2 tag=E1ZY05FMBV28 type=write size=2860281 2024-09-12T00:37:45.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.687+0000 7fcd44281780 1 < canceled operation key=B5OH55MQGSGJ tag=CV31E0UOJ8XV type=write size=922174 2024-09-12T00:37:45.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.688+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=XZR0QIOHFS9N type=del size=2166015 2024-09-12T00:37:45.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.690+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=HIE1GX8WO2IW type=del 2024-09-12T00:37:45.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.692+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~46UW1YVPFLF9.0 size=701110 2024-09-12T00:37:45.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.692+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=46UW1YVPFLF9 tag=H1A48IORXUJU type=write size=1749686 2024-09-12T00:37:45.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.693+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~3023TXT2M28N.0 size=1048576 2024-09-12T00:37:45.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.695+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~3023TXT2M28N.1 size=870063 2024-09-12T00:37:45.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.697+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=3023TXT2M28N tag=V0CMZ4MYMF2N type=write size=2967215 2024-09-12T00:37:45.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.698+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=WDK69LNJ0P2I type=del size=1561943 2024-09-12T00:37:45.698 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.699+0000 7fcd44281780 -1 < failed to complete operation key=QVULC3H9QGXE tag=H2EKBJKY3FDI type=del size=3404138: (22) Invalid argument 2024-09-12T00:37:45.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.702+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~0ZX2Z4ZT6N59.0 size=1048576 2024-09-12T00:37:45.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.703+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~0ZX2Z4ZT6N59.1 size=1048576 2024-09-12T00:37:45.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.704+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~0ZX2Z4ZT6N59.2 size=734725 2024-09-12T00:37:45.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.704+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=0ZX2Z4ZT6N59 tag=93TM8MAGLJJM type=write size=3880453 2024-09-12T00:37:45.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.705+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=L911OUDFUVZ1 type=del 2024-09-12T00:37:45.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.707+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~A5TXP2IYWJX0.0 size=1048576 2024-09-12T00:37:45.707 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.708+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~A5TXP2IYWJX0.1 size=1048576 2024-09-12T00:37:45.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.709+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~A5TXP2IYWJX0.2 size=164214 2024-09-12T00:37:45.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.709+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=A5TXP2IYWJX0 tag=GR2C1T36CCKP type=write size=3309942 2024-09-12T00:37:45.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.711+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=43TM2NGQ26XM type=del 2024-09-12T00:37:45.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.713+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=PQEI1CYMFR8T type=write size=242011 2024-09-12T00:37:45.713 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.714+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~X1Q3B3CH7UI0.0 size=47504 2024-09-12T00:37:45.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.716+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=X1Q3B3CH7UI0 tag=PU0EDKPA8UI0 type=write size=1096080 2024-09-12T00:37:45.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.719+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~ITIVTBTLEI63.0 size=914922 2024-09-12T00:37:45.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.719+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=ITIVTBTLEI63 tag=34GLGZREGCRX type=write size=1963498 2024-09-12T00:37:45.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.721+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~18T4NDV29Z9E.0 size=1048576 2024-09-12T00:37:45.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.722+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~18T4NDV29Z9E.1 size=804373 2024-09-12T00:37:45.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.725+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=18T4NDV29Z9E tag=IH5MV7NJTO3Y type=write size=2901525 2024-09-12T00:37:45.727 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.728+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=U3GOGJPD6B4U type=del size=2994844 2024-09-12T00:37:45.730 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.731+0000 7fcd44281780 1 < suggested remove operation key=RYSE2CKE5IRT tag=RVS8U0XOF4IH type=del 2024-09-12T00:37:45.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.733+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=I9H2YSOQE5I4 type=del size=2901625 2024-09-12T00:37:45.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.734+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~X7YEN7OD313J.0 size=1048576 2024-09-12T00:37:45.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.736+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~X7YEN7OD313J.1 size=489541 2024-09-12T00:37:45.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.738+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=X7YEN7OD313J tag=7X5ZUUJEZAGK type=write size=2586693 2024-09-12T00:37:45.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.740+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=QXJHK01DOQ5S type=write size=371445 2024-09-12T00:37:45.740 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.741+0000 7fcd44281780 1 < completed write operation key=Z6I6598B6J5I tag=I7D337DA7BQY type=write size=59964 2024-09-12T00:37:45.742 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.743+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~SVAZ11VVGUGY.0 size=1048576 2024-09-12T00:37:45.743 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.745+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~SVAZ11VVGUGY.1 size=146335 2024-09-12T00:37:45.744 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.745+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=SVAZ11VVGUGY tag=NQGW9XPOMSJD type=write size=2243487 2024-09-12T00:37:45.745 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.746+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=MR055ZZ6VKXK type=del 2024-09-12T00:37:45.748 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.749+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~9L4V4SPKK5IG.0 size=1048576 2024-09-12T00:37:45.749 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.750+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~9L4V4SPKK5IG.1 size=1048576 2024-09-12T00:37:45.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.751+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~9L4V4SPKK5IG.2 size=479665 2024-09-12T00:37:45.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.751+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=9L4V4SPKK5IG tag=6OOJMDQR46C0 type=write size=3625393 2024-09-12T00:37:45.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.753+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~3MYRQFBRT5RG.0 size=870592 2024-09-12T00:37:45.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.755+0000 7fcd44281780 1 < completed multipart upload key=U4EPPPA4QGGD upload=3MYRQFBRT5RG tag=UAEH01WQGIJA type=write size=1919168 2024-09-12T00:37:45.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.758+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~Y4D9FT83O2OU.0 size=754023 2024-09-12T00:37:45.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.758+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=Y4D9FT83O2OU tag=0STAKM40NA3C type=write size=1802599 2024-09-12T00:37:45.757 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.758+0000 7fcd44281780 1 < canceled part key=_multipart_VXDTFEG8P23H.2~2R100OQGOE3Q.0 size=1048576 2024-09-12T00:37:45.757 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.759+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~2R100OQGOE3Q.1 size=1048576 2024-09-12T00:37:45.759 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.760+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~2R100OQGOE3Q.2 size=252998 2024-09-12T00:37:45.761 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.762+0000 7fcd44281780 1 < canceled multipart upload key=VXDTFEG8P23H upload=2R100OQGOE3Q tag=GPFTDO9JY6UT type=write size=3398726 2024-09-12T00:37:45.762 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.764+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=F75CRMNWBEQR type=del size=1641986 2024-09-12T00:37:45.764 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.765+0000 7fcd44281780 1 < completed write operation key=B5OH55MQGSGJ tag=ZC09FXVADNNF type=write size=338569 2024-09-12T00:37:45.767 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.768+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~I5P25U1O178E.0 size=1048576 2024-09-12T00:37:45.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.769+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~I5P25U1O178E.1 size=1048576 2024-09-12T00:37:45.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.770+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~I5P25U1O178E.2 size=58080 2024-09-12T00:37:45.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.770+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=I5P25U1O178E tag=QOC2LF3ASC8I type=write size=3203808 2024-09-12T00:37:45.771 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.771+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~VQKS6YYMB3Q2.0 size=1048576 2024-09-12T00:37:45.771 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.773+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~VQKS6YYMB3Q2.1 size=763129 2024-09-12T00:37:45.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.775+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=VQKS6YYMB3Q2 tag=E1ZY05FMBV28 type=write size=2860281 2024-09-12T00:37:45.776 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.777+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~ZGOSFWIUQOZR.0 size=1048576 2024-09-12T00:37:45.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.778+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~ZGOSFWIUQOZR.1 size=744023 2024-09-12T00:37:45.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.778+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=ZGOSFWIUQOZR tag=Q8MTPVIDLQHE type=write size=2841175 2024-09-12T00:37:45.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.780+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=XZR0QIOHFS9N type=del 2024-09-12T00:37:45.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.782+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~HANET4Z4WTD8.0 size=1048576 2024-09-12T00:37:45.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.783+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~HANET4Z4WTD8.1 size=1048576 2024-09-12T00:37:45.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.784+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~HANET4Z4WTD8.2 size=291321 2024-09-12T00:37:45.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.784+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=HANET4Z4WTD8 tag=7IN16RQZJ42U type=write size=3437049 2024-09-12T00:37:45.784 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.786+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~46UW1YVPFLF9.0 size=701110 2024-09-12T00:37:45.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.788+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=46UW1YVPFLF9 tag=H1A48IORXUJU type=write size=1749686 2024-09-12T00:37:45.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.789+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=4K9NF15DR9H1 type=del size=3902781 2024-09-12T00:37:45.791 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.792+0000 7fcd44281780 1 < suggested remove operation key=QVULC3H9QGXE tag=WDK69LNJ0P2I type=del 2024-09-12T00:37:45.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.794+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=LKTFWEQKVMFL type=del size=3515845 2024-09-12T00:37:45.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.795+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~0ZX2Z4ZT6N59.0 size=1048576 2024-09-12T00:37:45.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.797+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~0ZX2Z4ZT6N59.1 size=1048576 2024-09-12T00:37:45.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.798+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~0ZX2Z4ZT6N59.2 size=734725 2024-09-12T00:37:45.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.800+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=0ZX2Z4ZT6N59 tag=93TM8MAGLJJM type=write size=3880453 2024-09-12T00:37:45.801 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.803+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~UMMV0OBU8D89.0 size=1048576 2024-09-12T00:37:45.803 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.804+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~UMMV0OBU8D89.1 size=199040 2024-09-12T00:37:45.803 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.804+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=UMMV0OBU8D89 tag=JRVNHDAZ2MZC type=write size=2296192 2024-09-12T00:37:45.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.805+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~A5TXP2IYWJX0.0 size=1048576 2024-09-12T00:37:45.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.806+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~A5TXP2IYWJX0.1 size=1048576 2024-09-12T00:37:45.806 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.807+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~A5TXP2IYWJX0.2 size=164214 2024-09-12T00:37:45.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.809+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=A5TXP2IYWJX0 tag=GR2C1T36CCKP type=write size=3309942 2024-09-12T00:37:45.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.812+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~5BTSNHVHXDX4.0 size=1048576 2024-09-12T00:37:45.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.813+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~5BTSNHVHXDX4.1 size=320982 2024-09-12T00:37:45.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.813+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=5BTSNHVHXDX4 tag=15X3PDPYDZ41 type=write size=2418134 2024-09-12T00:37:45.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.814+0000 7fcd44281780 1 < completed write operation key=7UCICX0GHHQ1 tag=PQEI1CYMFR8T type=write size=242011 2024-09-12T00:37:45.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.817+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~6LY9XMVFVJBG.0 size=1048576 2024-09-12T00:37:45.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.818+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~6LY9XMVFVJBG.1 size=1048576 2024-09-12T00:37:45.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.819+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~6LY9XMVFVJBG.2 size=93278 2024-09-12T00:37:45.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.819+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=6LY9XMVFVJBG tag=MZ1K6G0V7FS9 type=write size=3239006 2024-09-12T00:37:45.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.820+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~ITIVTBTLEI63.0 size=914922 2024-09-12T00:37:45.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.822+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=ITIVTBTLEI63 tag=34GLGZREGCRX type=write size=1963498 2024-09-12T00:37:45.823 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.825+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~SIV9JC0LZ7MZ.0 size=1048576 2024-09-12T00:37:45.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.826+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~SIV9JC0LZ7MZ.1 size=1048576 2024-09-12T00:37:45.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.827+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~SIV9JC0LZ7MZ.2 size=331963 2024-09-12T00:37:45.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.827+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=SIV9JC0LZ7MZ tag=WADVKN09VSQ9 type=write size=3477691 2024-09-12T00:37:45.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.830+0000 7fcd44281780 1 < suggested remove operation key=Z6I6598B6J5I tag=U3GOGJPD6B4U type=del 2024-09-12T00:37:45.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.832+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~G5ETCOOP87SG.0 size=142271 2024-09-12T00:37:45.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.832+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=G5ETCOOP87SG tag=P790QB69DG2J type=write size=1190847 2024-09-12T00:37:45.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.834+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=I9H2YSOQE5I4 type=del 2024-09-12T00:37:45.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.835+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=XYY3I47C8HZ7 type=del size=1491479 2024-09-12T00:37:45.836 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.837+0000 7fcd44281780 1 < completed write operation key=0ELZXPZCRPGP tag=QXJHK01DOQ5S type=write size=371445 2024-09-12T00:37:45.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.838+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=IAYYG8W0ENM2 type=del size=1452475 2024-09-12T00:37:45.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.840+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~SVAZ11VVGUGY.0 size=1048576 2024-09-12T00:37:45.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.843+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~SVAZ11VVGUGY.1 size=146335 2024-09-12T00:37:45.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.845+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=SVAZ11VVGUGY tag=NQGW9XPOMSJD type=write size=2243487 2024-09-12T00:37:45.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.847+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=6L0GI8IHEMKW type=write size=991163 2024-09-12T00:37:45.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.848+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~9L4V4SPKK5IG.0 size=1048576 2024-09-12T00:37:45.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.850+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~9L4V4SPKK5IG.1 size=1048576 2024-09-12T00:37:45.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.851+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~9L4V4SPKK5IG.2 size=479665 2024-09-12T00:37:45.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.853+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=9L4V4SPKK5IG tag=6OOJMDQR46C0 type=write size=3625393 2024-09-12T00:37:45.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.856+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~1GBUPR3YS277.0 size=1048576 2024-09-12T00:37:45.857 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.858+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~1GBUPR3YS277.1 size=55447 2024-09-12T00:37:45.857 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.858+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=1GBUPR3YS277 tag=9S2E13HUD2LE type=write size=2152599 2024-09-12T00:37:45.859 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.860+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~Y4D9FT83O2OU.0 size=754023 2024-09-12T00:37:45.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.862+0000 7fcd44281780 1 < completed multipart upload key=4RU6HTH4J0U1 upload=Y4D9FT83O2OU tag=0STAKM40NA3C type=write size=1802599 2024-09-12T00:37:45.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.865+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~5MJ6WWKC3I7E.0 size=1048576 2024-09-12T00:37:45.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.866+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~5MJ6WWKC3I7E.1 size=1048576 2024-09-12T00:37:45.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.868+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~5MJ6WWKC3I7E.2 size=805792 2024-09-12T00:37:45.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.868+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=5MJ6WWKC3I7E tag=L1VDOCFRZNYM type=write size=3951520 2024-09-12T00:37:45.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.871+0000 7fcd44281780 1 < suggested remove operation key=WXBMIJ4FC0VX tag=F75CRMNWBEQR type=del 2024-09-12T00:37:45.872 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.873+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~XV5BRZ24C4TH.0 size=431359 2024-09-12T00:37:45.872 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.873+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=XV5BRZ24C4TH tag=4UL01L9GIF2T type=write size=1479935 2024-09-12T00:37:45.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.874+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~I5P25U1O178E.0 size=1048576 2024-09-12T00:37:45.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.876+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~I5P25U1O178E.1 size=1048576 2024-09-12T00:37:45.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.877+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~I5P25U1O178E.2 size=58080 2024-09-12T00:37:45.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.879+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=I5P25U1O178E tag=QOC2LF3ASC8I type=write size=3203808 2024-09-12T00:37:45.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.882+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~G13T2P2A8WHI.0 size=1048576 2024-09-12T00:37:45.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.882+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~G13T2P2A8WHI.1 size=873328 2024-09-12T00:37:45.882 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.882+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=G13T2P2A8WHI tag=P1UW1XXZWHZQ type=write size=2970480 2024-09-12T00:37:45.883 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.884+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~ZGOSFWIUQOZR.0 size=1048576 2024-09-12T00:37:45.884 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.885+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~ZGOSFWIUQOZR.1 size=744023 2024-09-12T00:37:45.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.887+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=ZGOSFWIUQOZR tag=Q8MTPVIDLQHE type=write size=2841175 2024-09-12T00:37:45.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.889+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=Q36A2MDH7DJM type=del size=598972 2024-09-12T00:37:45.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.890+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~HANET4Z4WTD8.0 size=1048576 2024-09-12T00:37:45.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.892+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~HANET4Z4WTD8.1 size=1048576 2024-09-12T00:37:45.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.893+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~HANET4Z4WTD8.2 size=291321 2024-09-12T00:37:45.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.895+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=HANET4Z4WTD8 tag=7IN16RQZJ42U type=write size=3437049 2024-09-12T00:37:45.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.897+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~A66B8XWY0WQP.0 size=1048576 2024-09-12T00:37:45.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.898+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~A66B8XWY0WQP.1 size=1048576 2024-09-12T00:37:45.898 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.899+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~A66B8XWY0WQP.2 size=901900 2024-09-12T00:37:45.898 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.899+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=A66B8XWY0WQP tag=1TBGGFTUBPBR type=write size=4047628 2024-09-12T00:37:45.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.900+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=4K9NF15DR9H1 type=del 2024-09-12T00:37:45.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.903+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~2CUQJ94HA9Q7.0 size=1048576 2024-09-12T00:37:45.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.904+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~2CUQJ94HA9Q7.1 size=1048576 2024-09-12T00:37:45.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.905+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~2CUQJ94HA9Q7.2 size=915196 2024-09-12T00:37:45.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.905+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=2CUQJ94HA9Q7 tag=M8SKFJT14E4O type=write size=4060924 2024-09-12T00:37:45.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.907+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=LKTFWEQKVMFL type=del 2024-09-12T00:37:45.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.908+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=DVJSMGEK4QMG type=del size=2187641 2024-09-12T00:37:45.909 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.910+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~UMMV0OBU8D89.0 size=1048576 2024-09-12T00:37:45.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.911+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~UMMV0OBU8D89.1 size=199040 2024-09-12T00:37:45.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.914+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=UMMV0OBU8D89 tag=JRVNHDAZ2MZC type=write size=2296192 2024-09-12T00:37:45.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.917+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~3O2PQQLRU80T.0 size=1048576 2024-09-12T00:37:45.920 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.918+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~3O2PQQLRU80T.1 size=932742 2024-09-12T00:37:45.920 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.918+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=3O2PQQLRU80T tag=VP11DNY6BFHP type=write size=3029894 2024-09-12T00:37:45.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.919+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~5BTSNHVHXDX4.0 size=1048576 2024-09-12T00:37:45.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.919+0000 7fcd44281780 1 < canceled part key=_multipart_AN6GRGZ22INA.2~5BTSNHVHXDX4.1 size=320982 2024-09-12T00:37:45.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.922+0000 7fcd44281780 1 < canceled multipart upload key=AN6GRGZ22INA upload=5BTSNHVHXDX4 tag=15X3PDPYDZ41 type=write size=2418134 2024-09-12T00:37:45.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.923+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=7LZUT9BTXJDJ type=del size=3002354 2024-09-12T00:37:45.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.925+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~6LY9XMVFVJBG.0 size=1048576 2024-09-12T00:37:45.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.925+0000 7fcd44281780 1 < canceled part key=_multipart_7UCICX0GHHQ1.2~6LY9XMVFVJBG.1 size=1048576 2024-09-12T00:37:45.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.926+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~6LY9XMVFVJBG.2 size=93278 2024-09-12T00:37:45.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.929+0000 7fcd44281780 1 < canceled multipart upload key=7UCICX0GHHQ1 upload=6LY9XMVFVJBG tag=MZ1K6G0V7FS9 type=write size=3239006 2024-09-12T00:37:45.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.930+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=CJZ6FK5ZP2PZ type=write size=22267 2024-09-12T00:37:45.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.930+0000 7fcd44281780 1 < canceled part key=_multipart_526O814C10YW.2~SIV9JC0LZ7MZ.0 size=1048576 2024-09-12T00:37:45.930 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.932+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~SIV9JC0LZ7MZ.1 size=1048576 2024-09-12T00:37:45.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.933+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~SIV9JC0LZ7MZ.2 size=331963 2024-09-12T00:37:45.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.937+0000 7fcd44281780 1 < canceled multipart upload key=526O814C10YW upload=SIV9JC0LZ7MZ tag=WADVKN09VSQ9 type=write size=3477691 2024-09-12T00:37:45.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.939+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~IZCERMKJA1WN.0 size=1048576 2024-09-12T00:37:45.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.940+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~IZCERMKJA1WN.1 size=1048576 2024-09-12T00:37:45.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.941+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~IZCERMKJA1WN.2 size=462090 2024-09-12T00:37:45.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.941+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=IZCERMKJA1WN tag=ZDAYR5D0TL9W type=write size=3607818 2024-09-12T00:37:45.941 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.943+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~G5ETCOOP87SG.0 size=142271 2024-09-12T00:37:45.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.945+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=G5ETCOOP87SG tag=P790QB69DG2J type=write size=1190847 2024-09-12T00:37:45.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.948+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~3TEYUP212YGC.0 size=1002891 2024-09-12T00:37:45.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.948+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=3TEYUP212YGC tag=PDOZME8532BB type=write size=2051467 2024-09-12T00:37:45.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.949+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=XYY3I47C8HZ7 type=del 2024-09-12T00:37:45.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.952+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~V1IFMKNN28FY.0 size=1048576 2024-09-12T00:37:45.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.953+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~V1IFMKNN28FY.1 size=270776 2024-09-12T00:37:45.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.953+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=V1IFMKNN28FY tag=DK28Q0UKP9ZF type=write size=2367928 2024-09-12T00:37:45.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.954+0000 7fcd44281780 1 < completed delete operation key=0OEDZ5O2LN8H tag=IAYYG8W0ENM2 type=del 2024-09-12T00:37:45.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.956+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=B1KNBWEE0E8W type=del size=3211081 2024-09-12T00:37:45.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.958+0000 7fcd44281780 1 < completed write operation key=KJ0C43WLAFLI tag=6L0GI8IHEMKW type=write size=991163 2024-09-12T00:37:45.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.960+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~F4HQSM4VBMWD.0 size=1048576 2024-09-12T00:37:45.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.961+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~F4HQSM4VBMWD.1 size=533841 2024-09-12T00:37:45.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.961+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=F4HQSM4VBMWD tag=XLPUZW74480D type=write size=2630993 2024-09-12T00:37:45.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.962+0000 7fcd44281780 1 < canceled part key=_multipart_B5OH55MQGSGJ.2~1GBUPR3YS277.0 size=1048576 2024-09-12T00:37:45.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.963+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~1GBUPR3YS277.1 size=55447 2024-09-12T00:37:45.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.966+0000 7fcd44281780 1 < canceled multipart upload key=B5OH55MQGSGJ upload=1GBUPR3YS277 tag=9S2E13HUD2LE type=write size=2152599 2024-09-12T00:37:45.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.967+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=0IEPFMGJLPD4 type=del size=196779 2024-09-12T00:37:45.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.969+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~5MJ6WWKC3I7E.0 size=1048576 2024-09-12T00:37:45.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.969+0000 7fcd44281780 1 < canceled part key=_multipart_KNBCXZF3JGNL.2~5MJ6WWKC3I7E.1 size=1048576 2024-09-12T00:37:45.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.970+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~5MJ6WWKC3I7E.2 size=805792 2024-09-12T00:37:45.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.972+0000 7fcd44281780 1 < canceled multipart upload key=KNBCXZF3JGNL upload=5MJ6WWKC3I7E tag=L1VDOCFRZNYM type=write size=3951520 2024-09-12T00:37:45.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.973+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=1E576H0HSNQR type=del size=2420275 2024-09-12T00:37:45.974 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.975+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~XV5BRZ24C4TH.0 size=431359 2024-09-12T00:37:45.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.978+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=XV5BRZ24C4TH tag=4UL01L9GIF2T type=write size=1479935 2024-09-12T00:37:45.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.980+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=JUCPLYITP3Q2 type=del size=2785633 2024-09-12T00:37:45.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.981+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~G13T2P2A8WHI.0 size=1048576 2024-09-12T00:37:45.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.982+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~G13T2P2A8WHI.1 size=873328 2024-09-12T00:37:45.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.984+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=G13T2P2A8WHI tag=P1UW1XXZWHZQ type=write size=2970480 2024-09-12T00:37:45.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.986+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=0175J21UBHVG type=write size=308092 2024-09-12T00:37:45.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.989+0000 7fcd44281780 1 < suggested update operation key=DKJ44Z9COIIK tag=Q36A2MDH7DJM type=del size=598972 2024-09-12T00:37:45.990 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.991+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=5C4FD70JPZ1B type=del size=4138157 2024-09-12T00:37:45.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.993+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~A66B8XWY0WQP.0 size=1048576 2024-09-12T00:37:45.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.994+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~A66B8XWY0WQP.1 size=1048576 2024-09-12T00:37:45.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.995+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~A66B8XWY0WQP.2 size=901900 2024-09-12T00:37:45.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.997+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=A66B8XWY0WQP tag=1TBGGFTUBPBR type=write size=4047628 2024-09-12T00:37:45.997 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:45.998+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=QVYS1IQO46S3 type=del size=3410155 2024-09-12T00:37:45.998 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.000+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~2CUQJ94HA9Q7.0 size=1048576 2024-09-12T00:37:45.999 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.001+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~2CUQJ94HA9Q7.1 size=1048576 2024-09-12T00:37:45.999 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.001+0000 7fcd44281780 1 < canceled part key=_multipart_O12Z8THB62AJ.2~2CUQJ94HA9Q7.2 size=915196 2024-09-12T00:37:46.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.003+0000 7fcd44281780 1 < canceled multipart upload key=O12Z8THB62AJ upload=2CUQJ94HA9Q7 tag=M8SKFJT14E4O type=write size=4060924 2024-09-12T00:37:46.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.005+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=QBS0J8VRTB28 type=del size=1176598 2024-09-12T00:37:46.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.006+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=DVJSMGEK4QMG type=del 2024-09-12T00:37:46.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.008+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=9Y02PYNCG2TD type=del size=2331367 2024-09-12T00:37:46.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.009+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~3O2PQQLRU80T.0 size=1048576 2024-09-12T00:37:46.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.010+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~3O2PQQLRU80T.1 size=932742 2024-09-12T00:37:46.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.013+0000 7fcd44281780 1 < completed multipart upload key=B5OH55MQGSGJ upload=3O2PQQLRU80T tag=VP11DNY6BFHP type=write size=3029894 2024-09-12T00:37:46.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.015+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~SMVLHX1831MO.0 size=972818 2024-09-12T00:37:46.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.015+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=SMVLHX1831MO tag=NB90YYKLUNKL type=write size=2021394 2024-09-12T00:37:46.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.018+0000 7fcd44281780 1 < suggested update operation key=UXY6K0AVI4EK tag=7LZUT9BTXJDJ type=del size=3002354 2024-09-12T00:37:46.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.021+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~YX64B3QP7DKT.0 size=1010610 2024-09-12T00:37:46.020 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.021+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=YX64B3QP7DKT tag=KJU25OCCO7IK type=write size=2059186 2024-09-12T00:37:46.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.023+0000 7fcd44281780 1 < suggested remove operation key=G8O8VXTUPQVP tag=CJZ6FK5ZP2PZ type=write 2024-09-12T00:37:46.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.025+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=YFVRDBFEKNH8 type=del size=3388684 2024-09-12T00:37:46.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.026+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~IZCERMKJA1WN.0 size=1048576 2024-09-12T00:37:46.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.028+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~IZCERMKJA1WN.1 size=1048576 2024-09-12T00:37:46.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.029+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~IZCERMKJA1WN.2 size=462090 2024-09-12T00:37:46.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.031+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=IZCERMKJA1WN tag=ZDAYR5D0TL9W type=write size=3607818 2024-09-12T00:37:46.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.033+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=GJKIO9Y8MJF8 type=del size=3998870 2024-09-12T00:37:46.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.034+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~3TEYUP212YGC.0 size=1002891 2024-09-12T00:37:46.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.036+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=3TEYUP212YGC tag=PDOZME8532BB type=write size=2051467 2024-09-12T00:37:46.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.038+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=NI8WE4F2ZD1B type=del size=146858 2024-09-12T00:37:46.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.039+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~V1IFMKNN28FY.0 size=1048576 2024-09-12T00:37:46.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.040+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~V1IFMKNN28FY.1 size=270776 2024-09-12T00:37:46.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.043+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=V1IFMKNN28FY tag=DK28Q0UKP9ZF type=write size=2367928 2024-09-12T00:37:46.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.044+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=1OC6KDQAWZO3 type=del size=2407411 2024-09-12T00:37:46.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.046+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=B1KNBWEE0E8W type=del 2024-09-12T00:37:46.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.047+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=EC1KN7KSB3QX type=del size=1219387 2024-09-12T00:37:46.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.048+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~F4HQSM4VBMWD.0 size=1048576 2024-09-12T00:37:46.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.050+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~F4HQSM4VBMWD.1 size=533841 2024-09-12T00:37:46.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.052+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=F4HQSM4VBMWD tag=XLPUZW74480D type=write size=2630993 2024-09-12T00:37:46.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.054+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=1PM4KJHSYGND type=del size=3966504 2024-09-12T00:37:46.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.056+0000 7fcd44281780 1 < suggested update operation key=B5OH55MQGSGJ tag=0IEPFMGJLPD4 type=del size=196779 2024-09-12T00:37:46.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.059+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~SMM06PUQX0TL.0 size=1048576 2024-09-12T00:37:46.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.060+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~SMM06PUQX0TL.1 size=300619 2024-09-12T00:37:46.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.060+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=SMM06PUQX0TL tag=2TTHB0HO69O1 type=write size=2397771 2024-09-12T00:37:46.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.062+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=1E576H0HSNQR type=del 2024-09-12T00:37:46.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.063+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=M0TYIMN487IA type=write size=524434 2024-09-12T00:37:46.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.064+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=JUCPLYITP3Q2 type=del 2024-09-12T00:37:46.066 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.068+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~NCUGIS0AR01E.0 size=133359 2024-09-12T00:37:46.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.068+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=NCUGIS0AR01E tag=ZLOUBZQZOBTJ type=write size=1181935 2024-09-12T00:37:46.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.069+0000 7fcd44281780 -1 < failed to complete operation key=B5OH55MQGSGJ tag=0175J21UBHVG type=write size=308092: (22) Invalid argument 2024-09-12T00:37:46.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.072+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~ORW7H7WRCJ5F.0 size=849456 2024-09-12T00:37:46.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.072+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=ORW7H7WRCJ5F tag=V54PMG2UEAOH type=write size=1898032 2024-09-12T00:37:46.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.073+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=5C4FD70JPZ1B type=del 2024-09-12T00:37:46.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.075+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=1TK5WOF2KUCO type=del size=1070421 2024-09-12T00:37:46.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.076+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=QVYS1IQO46S3 type=del 2024-09-12T00:37:46.076 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.078+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=WSVVAYZ9ZSTB type=write size=679047 2024-09-12T00:37:46.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.079+0000 7fcd44281780 -1 < failed to complete operation key=B5OH55MQGSGJ tag=QBS0J8VRTB28 type=del size=1176598: (22) Invalid argument 2024-09-12T00:37:46.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.082+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~U2EUZPE8CC5D.0 size=1048576 2024-09-12T00:37:46.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.083+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~U2EUZPE8CC5D.1 size=1048576 2024-09-12T00:37:46.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.084+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~U2EUZPE8CC5D.2 size=806308 2024-09-12T00:37:46.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.084+0000 7fcd44281780 1 > prepared multipart upload key=U4EPPPA4QGGD upload=U2EUZPE8CC5D tag=CBO9M1AGKEV4 type=write size=3952036 2024-09-12T00:37:46.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.087+0000 7fcd44281780 1 < suggested remove operation key=QVULC3H9QGXE tag=9Y02PYNCG2TD type=del 2024-09-12T00:37:46.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.090+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~CRSTNRJ7RA3A.0 size=252988 2024-09-12T00:37:46.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.090+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=CRSTNRJ7RA3A tag=NKKT3V6ES0AN type=write size=1301564 2024-09-12T00:37:46.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.091+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~SMVLHX1831MO.0 size=972818 2024-09-12T00:37:46.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.093+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=SMVLHX1831MO tag=NB90YYKLUNKL type=write size=2021394 2024-09-12T00:37:46.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.094+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=6MFJHFO5883L type=del size=4116400 2024-09-12T00:37:46.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.096+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~YX64B3QP7DKT.0 size=1010610 2024-09-12T00:37:46.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.098+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=YX64B3QP7DKT tag=KJU25OCCO7IK type=write size=2059186 2024-09-12T00:37:46.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.100+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~AW2SIN4BF22J.0 size=1048576 2024-09-12T00:37:46.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.102+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~AW2SIN4BF22J.1 size=1048576 2024-09-12T00:37:46.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.103+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~AW2SIN4BF22J.2 size=216812 2024-09-12T00:37:46.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.103+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=AW2SIN4BF22J tag=PAAIT5Z3T1B5 type=write size=3362540 2024-09-12T00:37:46.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.104+0000 7fcd44281780 1 < completed delete operation key=0OEDZ5O2LN8H tag=YFVRDBFEKNH8 type=del 2024-09-12T00:37:46.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.107+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~MHDE99KHK8WT.0 size=1048576 2024-09-12T00:37:46.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.108+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~MHDE99KHK8WT.1 size=1048576 2024-09-12T00:37:46.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.109+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~MHDE99KHK8WT.2 size=650246 2024-09-12T00:37:46.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.109+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=MHDE99KHK8WT tag=RG9ERZXQ70NH type=write size=3795974 2024-09-12T00:37:46.111 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.112+0000 7fcd44281780 1 < suggested update operation key=XTNXNF3D0HFK tag=GJKIO9Y8MJF8 type=del size=3998870 2024-09-12T00:37:46.114 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.115+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~OW9A7D9XLKQY.0 size=1048576 2024-09-12T00:37:46.115 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.116+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~OW9A7D9XLKQY.1 size=194608 2024-09-12T00:37:46.115 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.116+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=OW9A7D9XLKQY tag=99K6YQOWR34W type=write size=2291760 2024-09-12T00:37:46.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.118+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=NI8WE4F2ZD1B type=del 2024-09-12T00:37:46.118 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.119+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=B1OAZYBRLP3D type=del size=3942817 2024-09-12T00:37:46.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.120+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=1OC6KDQAWZO3 type=del 2024-09-12T00:37:46.124 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.124+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~KROVDNZFWUHS.0 size=1027479 2024-09-12T00:37:46.124 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.124+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=KROVDNZFWUHS tag=3HXJ6ZS28IXZ type=write size=2076055 2024-09-12T00:37:46.125 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.126+0000 7fcd44281780 -1 < failed to complete operation key=XTNXNF3D0HFK tag=EC1KN7KSB3QX type=del size=1219387: (22) Invalid argument 2024-09-12T00:37:46.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.128+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~KE1XDBN1B2LK.0 size=669603 2024-09-12T00:37:46.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.128+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=KE1XDBN1B2LK tag=R0CW47F8T0CN type=write size=1718179 2024-09-12T00:37:46.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.130+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=1PM4KJHSYGND type=del 2024-09-12T00:37:46.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.131+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=PZR0P1TJM49U type=del size=3036268 2024-09-12T00:37:46.131 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.133+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~SMM06PUQX0TL.0 size=1048576 2024-09-12T00:37:46.132 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.134+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~SMM06PUQX0TL.1 size=300619 2024-09-12T00:37:46.135 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.136+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=SMM06PUQX0TL tag=2TTHB0HO69O1 type=write size=2397771 2024-09-12T00:37:46.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.139+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~ML4B9P5THJG7.0 size=1048576 2024-09-12T00:37:46.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.140+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~ML4B9P5THJG7.1 size=156831 2024-09-12T00:37:46.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.140+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=ML4B9P5THJG7 tag=BAMPNLGT1XN6 type=write size=2253983 2024-09-12T00:37:46.142 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.143+0000 7fcd44281780 1 < suggested remove operation key=AJ5AUTM2J9MT tag=M0TYIMN487IA type=write 2024-09-12T00:37:46.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.145+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=FHES5O2219FZ type=del size=1716594 2024-09-12T00:37:46.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.146+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~NCUGIS0AR01E.0 size=133359 2024-09-12T00:37:46.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.149+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=NCUGIS0AR01E tag=ZLOUBZQZOBTJ type=write size=1181935 2024-09-12T00:37:46.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.150+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=ZW1WBOO2GT6V type=del size=4031206 2024-09-12T00:37:46.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.152+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~ORW7H7WRCJ5F.0 size=849456 2024-09-12T00:37:46.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.154+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=ORW7H7WRCJ5F tag=V54PMG2UEAOH type=write size=1898032 2024-09-12T00:37:46.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.157+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~V1HULNECV543.0 size=1048576 2024-09-12T00:37:46.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.158+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~V1HULNECV543.1 size=1048576 2024-09-12T00:37:46.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.159+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~V1HULNECV543.2 size=302775 2024-09-12T00:37:46.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.159+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=V1HULNECV543 tag=FRNQ6Y12LNY7 type=write size=3448503 2024-09-12T00:37:46.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.160+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=1TK5WOF2KUCO type=del 2024-09-12T00:37:46.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.162+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=A2YGSYIYEJTP type=del size=1422834 2024-09-12T00:37:46.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.164+0000 7fcd44281780 1 < completed write operation key=RYSE2CKE5IRT tag=WSVVAYZ9ZSTB type=write size=679047 2024-09-12T00:37:46.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.165+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=1B178QWTU901 type=del size=3774820 2024-09-12T00:37:46.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.166+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~U2EUZPE8CC5D.0 size=1048576 2024-09-12T00:37:46.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.167+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~U2EUZPE8CC5D.1 size=1048576 2024-09-12T00:37:46.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.168+0000 7fcd44281780 1 < canceled part key=_multipart_U4EPPPA4QGGD.2~U2EUZPE8CC5D.2 size=806308 2024-09-12T00:37:46.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.170+0000 7fcd44281780 1 < canceled multipart upload key=U4EPPPA4QGGD upload=U2EUZPE8CC5D tag=CBO9M1AGKEV4 type=write size=3952036 2024-09-12T00:37:46.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.172+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~2W7AKG8YPU3I.0 size=1048576 2024-09-12T00:37:46.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.173+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~2W7AKG8YPU3I.1 size=1048576 2024-09-12T00:37:46.173 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.174+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~2W7AKG8YPU3I.2 size=477324 2024-09-12T00:37:46.173 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.174+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=2W7AKG8YPU3I tag=SA2T1QZWB4GD type=write size=3623052 2024-09-12T00:37:46.175 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.176+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~CRSTNRJ7RA3A.0 size=252988 2024-09-12T00:37:46.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.178+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=CRSTNRJ7RA3A tag=NKKT3V6ES0AN type=write size=1301564 2024-09-12T00:37:46.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.181+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~TTXY4Y2X3R6U.0 size=1048576 2024-09-12T00:37:46.180 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.182+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~TTXY4Y2X3R6U.1 size=1048576 2024-09-12T00:37:46.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.183+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~TTXY4Y2X3R6U.2 size=1010824 2024-09-12T00:37:46.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.183+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=TTXY4Y2X3R6U tag=59OWV1RHGW07 type=write size=4156552 2024-09-12T00:37:46.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.185+0000 7fcd44281780 1 < suggested update operation key=XTNXNF3D0HFK tag=6MFJHFO5883L type=del size=4116400 2024-09-12T00:37:46.187 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.188+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~433BLXWEFC4Z.0 size=1048576 2024-09-12T00:37:46.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.189+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~433BLXWEFC4Z.1 size=280652 2024-09-12T00:37:46.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.189+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=433BLXWEFC4Z tag=R6UZYUONC080 type=write size=2377804 2024-09-12T00:37:46.189 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.191+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~AW2SIN4BF22J.0 size=1048576 2024-09-12T00:37:46.190 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.191+0000 7fcd44281780 1 < canceled part key=_multipart_0ELZXPZCRPGP.2~AW2SIN4BF22J.1 size=1048576 2024-09-12T00:37:46.191 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.192+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~AW2SIN4BF22J.2 size=216812 2024-09-12T00:37:46.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.194+0000 7fcd44281780 1 < canceled multipart upload key=0ELZXPZCRPGP upload=AW2SIN4BF22J tag=PAAIT5Z3T1B5 type=write size=3362540 2024-09-12T00:37:46.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.195+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=9BG0E7M9O4QE type=del size=38367 2024-09-12T00:37:46.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.197+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~MHDE99KHK8WT.0 size=1048576 2024-09-12T00:37:46.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.198+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~MHDE99KHK8WT.1 size=1048576 2024-09-12T00:37:46.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.199+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~MHDE99KHK8WT.2 size=650246 2024-09-12T00:37:46.200 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.202+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=MHDE99KHK8WT tag=RG9ERZXQ70NH type=write size=3795974 2024-09-12T00:37:46.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.203+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=AMGXQO0OPFJ9 type=del size=3647966 2024-09-12T00:37:46.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.204+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~OW9A7D9XLKQY.0 size=1048576 2024-09-12T00:37:46.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.205+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~OW9A7D9XLKQY.1 size=194608 2024-09-12T00:37:46.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.208+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=OW9A7D9XLKQY tag=99K6YQOWR34W type=write size=2291760 2024-09-12T00:37:46.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.209+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=UE2QHF968DKS type=del size=190745 2024-09-12T00:37:46.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.211+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=B1OAZYBRLP3D type=del 2024-09-12T00:37:46.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.212+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=20ZLMDQT05N2 type=del size=2048157 2024-09-12T00:37:46.212 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.213+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~KROVDNZFWUHS.0 size=1027479 2024-09-12T00:37:46.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.215+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=KROVDNZFWUHS tag=3HXJ6ZS28IXZ type=write size=2076055 2024-09-12T00:37:46.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.217+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=VP37OI6AMQRF type=del size=2693610 2024-09-12T00:37:46.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.218+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~KE1XDBN1B2LK.0 size=669603 2024-09-12T00:37:46.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.220+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=KE1XDBN1B2LK tag=R0CW47F8T0CN type=write size=1718179 2024-09-12T00:37:46.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.222+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=1DJFBGUUE3PW type=del size=2626427 2024-09-12T00:37:46.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.223+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=PZR0P1TJM49U type=del 2024-09-12T00:37:46.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.226+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~Q2MJL9HBSRD7.0 size=1048576 2024-09-12T00:37:46.225 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.227+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~Q2MJL9HBSRD7.1 size=54247 2024-09-12T00:37:46.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.227+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=Q2MJL9HBSRD7 tag=M6WDAXLZDT2B type=write size=2151399 2024-09-12T00:37:46.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.227+0000 7fcd44281780 1 < canceled part key=_multipart_QVULC3H9QGXE.2~ML4B9P5THJG7.0 size=1048576 2024-09-12T00:37:46.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.228+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~ML4B9P5THJG7.1 size=156831 2024-09-12T00:37:46.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.231+0000 7fcd44281780 1 < canceled multipart upload key=QVULC3H9QGXE upload=ML4B9P5THJG7 tag=BAMPNLGT1XN6 type=write size=2253983 2024-09-12T00:37:46.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.233+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~XY2A98N4P9J1.0 size=1048576 2024-09-12T00:37:46.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.234+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~XY2A98N4P9J1.1 size=1008696 2024-09-12T00:37:46.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.234+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=XY2A98N4P9J1 tag=12JYUW3331Q7 type=write size=3105848 2024-09-12T00:37:46.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.237+0000 7fcd44281780 1 < suggested update operation key=U4EPPPA4QGGD tag=FHES5O2219FZ type=del size=1716594 2024-09-12T00:37:46.238 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.239+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~LK0P26GEM520.0 size=1048576 2024-09-12T00:37:46.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.241+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~LK0P26GEM520.1 size=61954 2024-09-12T00:37:46.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.241+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=LK0P26GEM520 tag=24G7S72IQHIW type=write size=2159106 2024-09-12T00:37:46.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.242+0000 7fcd44281780 1 < completed delete operation key=QVULC3H9QGXE tag=ZW1WBOO2GT6V type=del 2024-09-12T00:37:46.244 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.245+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~N5XTCLSW1UJO.0 size=1048576 2024-09-12T00:37:46.245 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.246+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~N5XTCLSW1UJO.1 size=895408 2024-09-12T00:37:46.245 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.246+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=N5XTCLSW1UJO tag=B5LZ5F34OLHI type=write size=2992560 2024-09-12T00:37:46.245 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.246+0000 7fcd44281780 1 < canceled part key=_multipart_AN6GRGZ22INA.2~V1HULNECV543.0 size=1048576 2024-09-12T00:37:46.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.247+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~V1HULNECV543.1 size=1048576 2024-09-12T00:37:46.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.249+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~V1HULNECV543.2 size=302775 2024-09-12T00:37:46.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.251+0000 7fcd44281780 1 < canceled multipart upload key=AN6GRGZ22INA upload=V1HULNECV543 tag=FRNQ6Y12LNY7 type=write size=3448503 2024-09-12T00:37:46.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.255+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~YNH03WRF4Z7X.0 size=1048576 2024-09-12T00:37:46.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.256+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~YNH03WRF4Z7X.1 size=899463 2024-09-12T00:37:46.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.256+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=YNH03WRF4Z7X tag=TGMTDPKXDRD2 type=write size=2996615 2024-09-12T00:37:46.258 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.259+0000 7fcd44281780 1 < suggested remove operation key=4RU6HTH4J0U1 tag=A2YGSYIYEJTP type=del 2024-09-12T00:37:46.260 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.262+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~F88P042BXVWV.0 size=1048576 2024-09-12T00:37:46.262 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.263+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~F88P042BXVWV.1 size=17908 2024-09-12T00:37:46.262 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.263+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=F88P042BXVWV tag=IAGO8UVHVIF1 type=write size=2115060 2024-09-12T00:37:46.263 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.264+0000 7fcd44281780 -1 < failed to complete operation key=XTNXNF3D0HFK tag=1B178QWTU901 type=del size=3774820: (22) Invalid argument 2024-09-12T00:37:46.264 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.266+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=A11BINPQH9AM type=del size=4182361 2024-09-12T00:37:46.266 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.267+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~2W7AKG8YPU3I.0 size=1048576 2024-09-12T00:37:46.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.268+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~2W7AKG8YPU3I.1 size=1048576 2024-09-12T00:37:46.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.269+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~2W7AKG8YPU3I.2 size=477324 2024-09-12T00:37:46.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.272+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=2W7AKG8YPU3I tag=SA2T1QZWB4GD type=write size=3623052 2024-09-12T00:37:46.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.274+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~0Q1PTUMSJ01K.0 size=866702 2024-09-12T00:37:46.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.274+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=0Q1PTUMSJ01K tag=YF2JAL87E30G type=write size=1915278 2024-09-12T00:37:46.274 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.276+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~TTXY4Y2X3R6U.0 size=1048576 2024-09-12T00:37:46.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.277+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~TTXY4Y2X3R6U.1 size=1048576 2024-09-12T00:37:46.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.278+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~TTXY4Y2X3R6U.2 size=1010824 2024-09-12T00:37:46.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.280+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=TTXY4Y2X3R6U tag=59OWV1RHGW07 type=write size=4156552 2024-09-12T00:37:46.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.283+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~GH8KK790Y0FM.0 size=341830 2024-09-12T00:37:46.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.283+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=GH8KK790Y0FM tag=VXL7L0POCSHH type=write size=1390406 2024-09-12T00:37:46.283 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.284+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~433BLXWEFC4Z.0 size=1048576 2024-09-12T00:37:46.284 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.286+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~433BLXWEFC4Z.1 size=280652 2024-09-12T00:37:46.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.288+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=433BLXWEFC4Z tag=R6UZYUONC080 type=write size=2377804 2024-09-12T00:37:46.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.289+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=UO5DCD6GAV6E type=del size=2778927 2024-09-12T00:37:46.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.291+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=9BG0E7M9O4QE type=del 2024-09-12T00:37:46.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.292+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=MLI9XRFIY1TP type=del size=2139635 2024-09-12T00:37:46.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.294+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=AMGXQO0OPFJ9 type=del 2024-09-12T00:37:46.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.295+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=T09D21V2CK81 type=write size=905684 2024-09-12T00:37:46.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.296+0000 7fcd44281780 1 < canceled operation key=NIDHAXQF55WX tag=UE2QHF968DKS type=del size=190745 2024-09-12T00:37:46.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.299+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~D66BR1XDF0FH.0 size=1048576 2024-09-12T00:37:46.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.300+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~D66BR1XDF0FH.1 size=1048576 2024-09-12T00:37:46.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.301+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~D66BR1XDF0FH.2 size=244705 2024-09-12T00:37:46.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.301+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=D66BR1XDF0FH tag=B4E04D025VPN type=write size=3390433 2024-09-12T00:37:46.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.304+0000 7fcd44281780 1 < suggested remove operation key=WXBMIJ4FC0VX tag=20ZLMDQT05N2 type=del 2024-09-12T00:37:46.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.306+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~6EPF9UQLRM3W.0 size=130606 2024-09-12T00:37:46.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.306+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=6EPF9UQLRM3W tag=R67FWORBU412 type=write size=1179182 2024-09-12T00:37:46.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.308+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=VP37OI6AMQRF type=del 2024-09-12T00:37:46.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.310+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=VKTFQB6LIOAJ type=del size=4111722 2024-09-12T00:37:46.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.311+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=1DJFBGUUE3PW type=del 2024-09-12T00:37:46.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.314+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~BWGPOREHV8K1.0 size=1048576 2024-09-12T00:37:46.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.315+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~BWGPOREHV8K1.1 size=140179 2024-09-12T00:37:46.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.315+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=BWGPOREHV8K1 tag=LBX8KR2DEP5A type=write size=2237331 2024-09-12T00:37:46.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.316+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~Q2MJL9HBSRD7.0 size=1048576 2024-09-12T00:37:46.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.316+0000 7fcd44281780 1 < canceled part key=_multipart_IK8POOY7ZWNF.2~Q2MJL9HBSRD7.1 size=54247 2024-09-12T00:37:46.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.319+0000 7fcd44281780 1 < canceled multipart upload key=IK8POOY7ZWNF upload=Q2MJL9HBSRD7 tag=M6WDAXLZDT2B type=write size=2151399 2024-09-12T00:37:46.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.320+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=OH4UY4S98CI5 type=del size=1328997 2024-09-12T00:37:46.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.321+0000 7fcd44281780 1 < canceled part key=_multipart_EXP8U6QNSMQ0.2~XY2A98N4P9J1.0 size=1048576 2024-09-12T00:37:46.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.322+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~XY2A98N4P9J1.1 size=1008696 2024-09-12T00:37:46.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.324+0000 7fcd44281780 1 < canceled multipart upload key=EXP8U6QNSMQ0 upload=XY2A98N4P9J1 tag=12JYUW3331Q7 type=write size=3105848 2024-09-12T00:37:46.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.326+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=40HPCS3RA0MO type=del size=3815054 2024-09-12T00:37:46.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.327+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~LK0P26GEM520.0 size=1048576 2024-09-12T00:37:46.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.328+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~LK0P26GEM520.1 size=61954 2024-09-12T00:37:46.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.331+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=LK0P26GEM520 tag=24G7S72IQHIW type=write size=2159106 2024-09-12T00:37:46.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.333+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~TA9ARWCA9PYH.0 size=1048576 2024-09-12T00:37:46.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.335+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~TA9ARWCA9PYH.1 size=373650 2024-09-12T00:37:46.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.335+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=TA9ARWCA9PYH tag=9LV5Y0G8WMV0 type=write size=2470802 2024-09-12T00:37:46.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.337+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~N5XTCLSW1UJO.0 size=1048576 2024-09-12T00:37:46.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.338+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~N5XTCLSW1UJO.1 size=895408 2024-09-12T00:37:46.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.340+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=N5XTCLSW1UJO tag=B5LZ5F34OLHI type=write size=2992560 2024-09-12T00:37:46.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.341+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=2DNBUDNFD25M type=del size=1438621 2024-09-12T00:37:46.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.343+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~YNH03WRF4Z7X.0 size=1048576 2024-09-12T00:37:46.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.344+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~YNH03WRF4Z7X.1 size=899463 2024-09-12T00:37:46.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.346+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=YNH03WRF4Z7X tag=TGMTDPKXDRD2 type=write size=2996615 2024-09-12T00:37:46.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.348+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=3NEN702NLQKL type=del size=4160826 2024-09-12T00:37:46.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.349+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~F88P042BXVWV.0 size=1048576 2024-09-12T00:37:46.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.350+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~F88P042BXVWV.1 size=17908 2024-09-12T00:37:46.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.353+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=F88P042BXVWV tag=IAGO8UVHVIF1 type=write size=2115060 2024-09-12T00:37:46.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.355+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~51SIWMB060PL.0 size=49939 2024-09-12T00:37:46.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.355+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=51SIWMB060PL tag=535HIYOL2ICJ type=write size=1098515 2024-09-12T00:37:46.357 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.358+0000 7fcd44281780 1 < suggested remove operation key=IK8POOY7ZWNF tag=A11BINPQH9AM type=del 2024-09-12T00:37:46.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.361+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~JHZ3XJ8KBF8C.0 size=1048576 2024-09-12T00:37:46.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.362+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~JHZ3XJ8KBF8C.1 size=669875 2024-09-12T00:37:46.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.362+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=JHZ3XJ8KBF8C tag=EJENQP4J3FTP type=write size=2767027 2024-09-12T00:37:46.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.363+0000 7fcd44281780 1 < canceled part key=_multipart_UXY6K0AVI4EK.2~0Q1PTUMSJ01K.0 size=866702 2024-09-12T00:37:46.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.365+0000 7fcd44281780 1 < canceled multipart upload key=UXY6K0AVI4EK upload=0Q1PTUMSJ01K tag=YF2JAL87E30G type=write size=1915278 2024-09-12T00:37:46.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.367+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~EY71PXTLXMYU.0 size=107367 2024-09-12T00:37:46.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.367+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=EY71PXTLXMYU tag=A6I5XAW7RNQ6 type=write size=1155943 2024-09-12T00:37:46.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.369+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~GH8KK790Y0FM.0 size=341830 2024-09-12T00:37:46.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.371+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=GH8KK790Y0FM tag=VXL7L0POCSHH type=write size=1390406 2024-09-12T00:37:46.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.374+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~90EBFRTZRVPH.0 size=1048576 2024-09-12T00:37:46.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.375+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~90EBFRTZRVPH.1 size=1048576 2024-09-12T00:37:46.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.376+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~90EBFRTZRVPH.2 size=708145 2024-09-12T00:37:46.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.376+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=90EBFRTZRVPH tag=SRK36BFGGWZN type=write size=3853873 2024-09-12T00:37:46.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.377+0000 7fcd44281780 -1 < failed to complete operation key=IK8POOY7ZWNF tag=UO5DCD6GAV6E type=del size=2778927: (22) Invalid argument 2024-09-12T00:37:46.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.379+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=7LGAMU1SS1LT type=del size=3992915 2024-09-12T00:37:46.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.380+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=MLI9XRFIY1TP type=del 2024-09-12T00:37:46.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.382+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=SPEAS2XY9WU7 type=del size=3469697 2024-09-12T00:37:46.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.385+0000 7fcd44281780 1 < suggested remove operation key=RYSE2CKE5IRT tag=T09D21V2CK81 type=write 2024-09-12T00:37:46.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.387+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=A0HTCZFT8N48 type=del size=1698468 2024-09-12T00:37:46.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.389+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~D66BR1XDF0FH.0 size=1048576 2024-09-12T00:37:46.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.389+0000 7fcd44281780 1 < canceled part key=_multipart_VOO70F2NBKL0.2~D66BR1XDF0FH.1 size=1048576 2024-09-12T00:37:46.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.390+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~D66BR1XDF0FH.2 size=244705 2024-09-12T00:37:46.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.392+0000 7fcd44281780 1 < canceled multipart upload key=VOO70F2NBKL0 upload=D66BR1XDF0FH tag=B4E04D025VPN type=write size=3390433 2024-09-12T00:37:46.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.395+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~RYI07WSU0BG3.0 size=1048576 2024-09-12T00:37:46.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.396+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~RYI07WSU0BG3.1 size=23789 2024-09-12T00:37:46.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.396+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=RYI07WSU0BG3 tag=6KRRI776X3WG type=write size=2120941 2024-09-12T00:37:46.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.397+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~6EPF9UQLRM3W.0 size=130606 2024-09-12T00:37:46.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.399+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=6EPF9UQLRM3W tag=R67FWORBU412 type=write size=1179182 2024-09-12T00:37:46.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.402+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~CRB0MLDUIPNX.0 size=1048576 2024-09-12T00:37:46.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.403+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~CRB0MLDUIPNX.1 size=1048576 2024-09-12T00:37:46.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.404+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~CRB0MLDUIPNX.2 size=24142 2024-09-12T00:37:46.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.404+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=CRB0MLDUIPNX tag=X8IFFA4PYIMV type=write size=3169870 2024-09-12T00:37:46.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.407+0000 7fcd44281780 1 < suggested update operation key=UXY6K0AVI4EK tag=VKTFQB6LIOAJ type=del size=4111722 2024-09-12T00:37:46.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.409+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~29I3P5I9OK9A.0 size=1048576 2024-09-12T00:37:46.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.410+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~29I3P5I9OK9A.1 size=724191 2024-09-12T00:37:46.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.410+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=29I3P5I9OK9A tag=K7KP7OR1AL5X type=write size=2821343 2024-09-12T00:37:46.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.412+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~BWGPOREHV8K1.0 size=1048576 2024-09-12T00:37:46.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.413+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~BWGPOREHV8K1.1 size=140179 2024-09-12T00:37:46.414 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.415+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=BWGPOREHV8K1 tag=LBX8KR2DEP5A type=write size=2237331 2024-09-12T00:37:46.415 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.417+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=06Y86AIJFENT type=del size=4070809 2024-09-12T00:37:46.418 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.420+0000 7fcd44281780 1 < suggested remove operation key=AJ5AUTM2J9MT tag=OH4UY4S98CI5 type=del 2024-09-12T00:37:46.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.421+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=VBOLKMUUVL8S type=del size=1421724 2024-09-12T00:37:46.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.423+0000 7fcd44281780 -1 < failed to complete operation key=IK8POOY7ZWNF tag=40HPCS3RA0MO type=del size=3815054: (22) Invalid argument 2024-09-12T00:37:46.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.425+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~LWN5EP7FMQ41.0 size=1048576 2024-09-12T00:37:46.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.426+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~LWN5EP7FMQ41.1 size=981383 2024-09-12T00:37:46.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.426+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=LWN5EP7FMQ41 tag=JOP8GM4BT4LI type=write size=3078535 2024-09-12T00:37:46.427 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.428+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~TA9ARWCA9PYH.0 size=1048576 2024-09-12T00:37:46.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.429+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~TA9ARWCA9PYH.1 size=373650 2024-09-12T00:37:46.430 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.431+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=TA9ARWCA9PYH tag=9LV5Y0G8WMV0 type=write size=2470802 2024-09-12T00:37:46.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.434+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~5WO0NC43S38U.0 size=680298 2024-09-12T00:37:46.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.434+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=5WO0NC43S38U tag=BFMR9L998ITS type=write size=1728874 2024-09-12T00:37:46.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.437+0000 7fcd44281780 1 < suggested remove operation key=526O814C10YW tag=2DNBUDNFD25M type=del 2024-09-12T00:37:46.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.440+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~P767QU46YTYF.0 size=920840 2024-09-12T00:37:46.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.440+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=P767QU46YTYF tag=XAT3AJLBHARC type=write size=1969416 2024-09-12T00:37:46.439 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.440+0000 7fcd44281780 -1 < no bi entry to suggest for operation key=AJ5AUTM2J9MT tag=3NEN702NLQKL type=del size=4160826: (2) No such file or directory 2024-09-12T00:37:46.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.442+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=I6C3SESC28H8 type=del size=1194148 2024-09-12T00:37:46.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.443+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~51SIWMB060PL.0 size=49939 2024-09-12T00:37:46.444 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.446+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=51SIWMB060PL tag=535HIYOL2ICJ type=write size=1098515 2024-09-12T00:37:46.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.447+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=J0XHKF2YMU9X type=del size=3695510 2024-09-12T00:37:46.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.448+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~JHZ3XJ8KBF8C.0 size=1048576 2024-09-12T00:37:46.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.448+0000 7fcd44281780 1 < canceled part key=_multipart_526O814C10YW.2~JHZ3XJ8KBF8C.1 size=669875 2024-09-12T00:37:46.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.451+0000 7fcd44281780 1 < canceled multipart upload key=526O814C10YW upload=JHZ3XJ8KBF8C tag=EJENQP4J3FTP type=write size=2767027 2024-09-12T00:37:46.452 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.453+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~ZD13A14I7DHN.0 size=1048576 2024-09-12T00:37:46.453 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.454+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~ZD13A14I7DHN.1 size=1048576 2024-09-12T00:37:46.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.455+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~ZD13A14I7DHN.2 size=870778 2024-09-12T00:37:46.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.455+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=ZD13A14I7DHN tag=N61BRFUM3GVM type=write size=4016506 2024-09-12T00:37:46.455 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.457+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~EY71PXTLXMYU.0 size=107367 2024-09-12T00:37:46.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.459+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=EY71PXTLXMYU tag=A6I5XAW7RNQ6 type=write size=1155943 2024-09-12T00:37:46.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.461+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=ZFS0G0XUWBCR type=del size=3196152 2024-09-12T00:37:46.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.462+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~90EBFRTZRVPH.0 size=1048576 2024-09-12T00:37:46.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.463+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~90EBFRTZRVPH.1 size=1048576 2024-09-12T00:37:46.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.464+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~90EBFRTZRVPH.2 size=708145 2024-09-12T00:37:46.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.467+0000 7fcd44281780 1 < completed multipart upload key=UWS056JN3IXO upload=90EBFRTZRVPH tag=SRK36BFGGWZN type=write size=3853873 2024-09-12T00:37:46.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.468+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=ZEQJL5CZ11CW type=write size=65285 2024-09-12T00:37:46.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.470+0000 7fcd44281780 1 < canceled operation key=IK8POOY7ZWNF tag=7LGAMU1SS1LT type=del size=3992915 2024-09-12T00:37:46.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.471+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=3A1ESV6LIFK6 type=write size=296844 2024-09-12T00:37:46.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.474+0000 7fcd44281780 1 < suggested update operation key=0ELZXPZCRPGP tag=SPEAS2XY9WU7 type=del size=3469697 2024-09-12T00:37:46.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.476+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~B4Q6ET7RH7WZ.0 size=1048576 2024-09-12T00:37:46.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.477+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~B4Q6ET7RH7WZ.1 size=738082 2024-09-12T00:37:46.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.477+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=B4Q6ET7RH7WZ tag=4ISJ4T6010NI type=write size=2835234 2024-09-12T00:37:46.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.478+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=A0HTCZFT8N48 type=del 2024-09-12T00:37:46.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.481+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~RZWL9I8XT4A3.0 size=674015 2024-09-12T00:37:46.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.481+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=RZWL9I8XT4A3 tag=KANMKV8ETIJ6 type=write size=1722591 2024-09-12T00:37:46.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.482+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~RYI07WSU0BG3.0 size=1048576 2024-09-12T00:37:46.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.484+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~RYI07WSU0BG3.1 size=23789 2024-09-12T00:37:46.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.486+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=RYI07WSU0BG3 tag=6KRRI776X3WG type=write size=2120941 2024-09-12T00:37:46.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.487+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=ERD55NTY821W type=write size=356710 2024-09-12T00:37:46.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.489+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~CRB0MLDUIPNX.0 size=1048576 2024-09-12T00:37:46.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.490+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~CRB0MLDUIPNX.1 size=1048576 2024-09-12T00:37:46.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.491+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~CRB0MLDUIPNX.2 size=24142 2024-09-12T00:37:46.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.493+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=CRB0MLDUIPNX tag=X8IFFA4PYIMV type=write size=3169870 2024-09-12T00:37:46.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.494+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=HOEXDYM13W39 type=del size=3578063 2024-09-12T00:37:46.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.496+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~29I3P5I9OK9A.0 size=1048576 2024-09-12T00:37:46.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.497+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~29I3P5I9OK9A.1 size=724191 2024-09-12T00:37:46.497 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.499+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=29I3P5I9OK9A tag=K7KP7OR1AL5X type=write size=2821343 2024-09-12T00:37:46.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.500+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=LNQL1MAELPBK type=del size=3298399 2024-09-12T00:37:46.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.503+0000 7fcd44281780 1 < suggested remove operation key=7UCICX0GHHQ1 tag=06Y86AIJFENT type=del 2024-09-12T00:37:46.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.504+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=XARFNLCEL6O4 type=write size=310275 2024-09-12T00:37:46.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.506+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=VBOLKMUUVL8S type=del 2024-09-12T00:37:46.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.507+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=07PAUZEW7U3H type=write size=272007 2024-09-12T00:37:46.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.509+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~LWN5EP7FMQ41.0 size=1048576 2024-09-12T00:37:46.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.510+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~LWN5EP7FMQ41.1 size=981383 2024-09-12T00:37:46.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.512+0000 7fcd44281780 1 < completed multipart upload key=4RU6HTH4J0U1 upload=LWN5EP7FMQ41 tag=JOP8GM4BT4LI type=write size=3078535 2024-09-12T00:37:46.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.514+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=E1XXN3XEYK61 type=del size=235815 2024-09-12T00:37:46.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.515+0000 7fcd44281780 1 < canceled part key=_multipart_VXDTFEG8P23H.2~5WO0NC43S38U.0 size=680298 2024-09-12T00:37:46.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.517+0000 7fcd44281780 1 < canceled multipart upload key=VXDTFEG8P23H upload=5WO0NC43S38U tag=BFMR9L998ITS type=write size=1728874 2024-09-12T00:37:46.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.518+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=0B7A8VNK1F3Y type=del size=2176471 2024-09-12T00:37:46.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.520+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~P767QU46YTYF.0 size=920840 2024-09-12T00:37:46.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.522+0000 7fcd44281780 1 < completed multipart upload key=UWS056JN3IXO upload=P767QU46YTYF tag=XAT3AJLBHARC type=write size=1969416 2024-09-12T00:37:46.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.523+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=1NVWUH3UKCS7 type=del size=3964476 2024-09-12T00:37:46.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.525+0000 7fcd44281780 1 < canceled operation key=G8O8VXTUPQVP tag=I6C3SESC28H8 type=del size=1194148 2024-09-12T00:37:46.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.527+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~492BFP4AD1QZ.0 size=1048576 2024-09-12T00:37:46.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.528+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~492BFP4AD1QZ.1 size=566070 2024-09-12T00:37:46.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.528+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=492BFP4AD1QZ tag=ILZ27RB930WS type=write size=2663222 2024-09-12T00:37:46.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.530+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=J0XHKF2YMU9X type=del 2024-09-12T00:37:46.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.531+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=DCVL7SE5ZEYN type=del size=2085451 2024-09-12T00:37:46.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.533+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~ZD13A14I7DHN.0 size=1048576 2024-09-12T00:37:46.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.534+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~ZD13A14I7DHN.1 size=1048576 2024-09-12T00:37:46.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.535+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~ZD13A14I7DHN.2 size=870778 2024-09-12T00:37:46.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.537+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=ZD13A14I7DHN tag=N61BRFUM3GVM type=write size=4016506 2024-09-12T00:37:46.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.539+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=K1XQGNB5X44E type=del size=2959762 2024-09-12T00:37:46.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.540+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=ZFS0G0XUWBCR type=del 2024-09-12T00:37:46.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.541+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=02S7QPH202UZ type=del size=1207511 2024-09-12T00:37:46.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.544+0000 7fcd44281780 1 < suggested update operation key=EXP8U6QNSMQ0 tag=ZEQJL5CZ11CW type=write size=65285 2024-09-12T00:37:46.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.545+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=KU1JXEC9C5KL type=del size=1184771 2024-09-12T00:37:46.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.548+0000 7fcd44281780 1 < suggested remove operation key=4RU6HTH4J0U1 tag=3A1ESV6LIFK6 type=write 2024-09-12T00:37:46.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.549+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=Y0HZZFOIKEUD type=del size=3143622 2024-09-12T00:37:46.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.551+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~B4Q6ET7RH7WZ.0 size=1048576 2024-09-12T00:37:46.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.552+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~B4Q6ET7RH7WZ.1 size=738082 2024-09-12T00:37:46.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.554+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=B4Q6ET7RH7WZ tag=4ISJ4T6010NI type=write size=2835234 2024-09-12T00:37:46.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.556+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~3CK9RV6X01DA.0 size=122101 2024-09-12T00:37:46.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.556+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=3CK9RV6X01DA tag=D9U05CECAREV type=write size=1170677 2024-09-12T00:37:46.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.558+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~RZWL9I8XT4A3.0 size=674015 2024-09-12T00:37:46.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.560+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=RZWL9I8XT4A3 tag=KANMKV8ETIJ6 type=write size=1722591 2024-09-12T00:37:46.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.561+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=OXAG4RKJ1R2C type=del size=3866136 2024-09-12T00:37:46.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.563+0000 7fcd44281780 1 < completed write operation key=UXY6K0AVI4EK tag=ERD55NTY821W type=write size=356710 2024-09-12T00:37:46.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.564+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=087UI8NPK5A6 type=del size=2316612 2024-09-12T00:37:46.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.566+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=HOEXDYM13W39 type=del 2024-09-12T00:37:46.567 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.568+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~CMD6CDN2CMC3.0 size=955080 2024-09-12T00:37:46.567 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.568+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=CMD6CDN2CMC3 tag=I8CZ5OH4KPU0 type=write size=2003656 2024-09-12T00:37:46.569 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.571+0000 7fcd44281780 1 < suggested update operation key=RYSE2CKE5IRT tag=LNQL1MAELPBK type=del size=3298399 2024-09-12T00:37:46.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.572+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=Z5D79RCHTB43 type=write size=540751 2024-09-12T00:37:46.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.573+0000 7fcd44281780 1 < completed write operation key=IK8POOY7ZWNF tag=XARFNLCEL6O4 type=write size=310275 2024-09-12T00:37:46.574 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.575+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~CWUOYI43KJPQ.0 size=1048576 2024-09-12T00:37:46.575 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.576+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~CWUOYI43KJPQ.1 size=1048576 2024-09-12T00:37:46.576 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.577+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~CWUOYI43KJPQ.2 size=830840 2024-09-12T00:37:46.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.577+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=CWUOYI43KJPQ tag=R3Y530BN1VNF type=write size=3976568 2024-09-12T00:37:46.578 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.579+0000 7fcd44281780 1 < completed write operation key=AJ5AUTM2J9MT tag=07PAUZEW7U3H type=write size=272007 2024-09-12T00:37:46.580 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.581+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~3FE94VHAV47Q.0 size=411217 2024-09-12T00:37:46.580 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.581+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=3FE94VHAV47Q tag=SJYFMGQ1CG26 type=write size=1459793 2024-09-12T00:37:46.583 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.584+0000 7fcd44281780 1 < suggested update operation key=EXP8U6QNSMQ0 tag=E1XXN3XEYK61 type=del size=235815 2024-09-12T00:37:46.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.587+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~3U1TH4E6IGB0.0 size=1048576 2024-09-12T00:37:46.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.588+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~3U1TH4E6IGB0.1 size=1048576 2024-09-12T00:37:46.588 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.589+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~3U1TH4E6IGB0.2 size=664478 2024-09-12T00:37:46.588 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.589+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=3U1TH4E6IGB0 tag=LIHMUV9YQTMV type=write size=3810206 2024-09-12T00:37:46.590 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.591+0000 7fcd44281780 1 < canceled operation key=AJ5AUTM2J9MT tag=0B7A8VNK1F3Y type=del size=2176471 2024-09-12T00:37:46.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.593+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=NSKZC6M440YI type=del size=1444106 2024-09-12T00:37:46.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.594+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=1NVWUH3UKCS7 type=del 2024-09-12T00:37:46.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.596+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=SXLS2E0ZZBA6 type=write size=844924 2024-09-12T00:37:46.595 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.596+0000 7fcd44281780 1 < canceled part key=_multipart_AJ5AUTM2J9MT.2~492BFP4AD1QZ.0 size=1048576 2024-09-12T00:37:46.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.597+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~492BFP4AD1QZ.1 size=566070 2024-09-12T00:37:46.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.600+0000 7fcd44281780 1 < canceled multipart upload key=AJ5AUTM2J9MT upload=492BFP4AD1QZ tag=ILZ27RB930WS type=write size=2663222 2024-09-12T00:37:46.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.602+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=HVJVG7W090FS type=del size=1934933 2024-09-12T00:37:46.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.603+0000 7fcd44281780 1 < completed delete operation key=8U004LC8IYLQ tag=DCVL7SE5ZEYN type=del 2024-09-12T00:37:46.604 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.605+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=DI5TXGSJ3T1Q type=del size=3575825 2024-09-12T00:37:46.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.606+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=K1XQGNB5X44E type=del 2024-09-12T00:37:46.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.608+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=98NZKSNVN7H5 type=write size=103197 2024-09-12T00:37:46.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.610+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=02S7QPH202UZ type=del 2024-09-12T00:37:46.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.611+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=PRVVP9CADAZT type=del size=3297039 2024-09-12T00:37:46.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.613+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=KU1JXEC9C5KL type=del 2024-09-12T00:37:46.613 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.614+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=FSYLM3WDZS5D type=del size=1291183 2024-09-12T00:37:46.615 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.616+0000 7fcd44281780 -1 < failed to complete operation key=EXP8U6QNSMQ0 tag=Y0HZZFOIKEUD type=del size=3143622: (22) Invalid argument 2024-09-12T00:37:46.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.618+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~BKGK8TYUSWSO.0 size=783798 2024-09-12T00:37:46.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.618+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=BKGK8TYUSWSO tag=98HAPG5G0NML type=write size=1832374 2024-09-12T00:37:46.619 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.620+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~3CK9RV6X01DA.0 size=122101 2024-09-12T00:37:46.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.622+0000 7fcd44281780 1 < completed multipart upload key=0AVE0W4OV1AU upload=3CK9RV6X01DA tag=D9U05CECAREV type=write size=1170677 2024-09-12T00:37:46.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.625+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~72CXPVRESMZ4.0 size=1048576 2024-09-12T00:37:46.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.626+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~72CXPVRESMZ4.1 size=780504 2024-09-12T00:37:46.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.626+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=72CXPVRESMZ4 tag=R3JAR5CB75J2 type=write size=2877656 2024-09-12T00:37:46.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.627+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=OXAG4RKJ1R2C type=del 2024-09-12T00:37:46.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.629+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=JFSN6ILLRALI type=del size=1982171 2024-09-12T00:37:46.630 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.632+0000 7fcd44281780 1 < suggested remove operation key=4RU6HTH4J0U1 tag=087UI8NPK5A6 type=del 2024-09-12T00:37:46.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.634+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~R5FD19G4KJRF.0 size=884609 2024-09-12T00:37:46.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.634+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=R5FD19G4KJRF tag=MMX8K8CL3R5Z type=write size=1933185 2024-09-12T00:37:46.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.636+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~CMD6CDN2CMC3.0 size=955080 2024-09-12T00:37:46.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.638+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=CMD6CDN2CMC3 tag=I8CZ5OH4KPU0 type=write size=2003656 2024-09-12T00:37:46.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.639+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=ZRO2W5T2GCXO type=del size=2040532 2024-09-12T00:37:46.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.641+0000 7fcd44281780 1 < completed write operation key=QVULC3H9QGXE tag=Z5D79RCHTB43 type=write size=540751 2024-09-12T00:37:46.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.642+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=YNNEQ6Z9FG7K type=write size=11284 2024-09-12T00:37:46.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.644+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~CWUOYI43KJPQ.0 size=1048576 2024-09-12T00:37:46.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.645+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~CWUOYI43KJPQ.1 size=1048576 2024-09-12T00:37:46.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.646+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~CWUOYI43KJPQ.2 size=830840 2024-09-12T00:37:46.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.649+0000 7fcd44281780 1 < completed multipart upload key=526O814C10YW upload=CWUOYI43KJPQ tag=R3Y530BN1VNF type=write size=3976568 2024-09-12T00:37:46.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.652+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~FCMFPZPBRRLP.0 size=1048576 2024-09-12T00:37:46.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.653+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~FCMFPZPBRRLP.1 size=1048576 2024-09-12T00:37:46.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.655+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~FCMFPZPBRRLP.2 size=364573 2024-09-12T00:37:46.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.655+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=FCMFPZPBRRLP tag=GOH8525CZV44 type=write size=3510301 2024-09-12T00:37:46.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.656+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~3FE94VHAV47Q.0 size=411217 2024-09-12T00:37:46.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.658+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=3FE94VHAV47Q tag=SJYFMGQ1CG26 type=write size=1459793 2024-09-12T00:37:46.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.660+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=TQA8BC86WNB7 type=del size=3813076 2024-09-12T00:37:46.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.662+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~3U1TH4E6IGB0.0 size=1048576 2024-09-12T00:37:46.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.663+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~3U1TH4E6IGB0.1 size=1048576 2024-09-12T00:37:46.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.664+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~3U1TH4E6IGB0.2 size=664478 2024-09-12T00:37:46.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.666+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=3U1TH4E6IGB0 tag=LIHMUV9YQTMV type=write size=3810206 2024-09-12T00:37:46.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.668+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=DV61U1BJMW75 type=del size=1384646 2024-09-12T00:37:46.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.669+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=NSKZC6M440YI type=del 2024-09-12T00:37:46.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.672+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~BWGRV091XYDI.0 size=1048576 2024-09-12T00:37:46.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.673+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~BWGRV091XYDI.1 size=1048576 2024-09-12T00:37:46.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.674+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~BWGRV091XYDI.2 size=8200 2024-09-12T00:37:46.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.674+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=BWGRV091XYDI tag=PW17RRQ7ICLB type=write size=3153928 2024-09-12T00:37:46.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.675+0000 7fcd44281780 1 < completed write operation key=DKJ44Z9COIIK tag=SXLS2E0ZZBA6 type=write size=844924 2024-09-12T00:37:46.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.677+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~B8L1AIPM0Z53.0 size=131750 2024-09-12T00:37:46.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.678+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=B8L1AIPM0Z53 tag=HKDHWECSV0E5 type=write size=1180326 2024-09-12T00:37:46.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.679+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=HVJVG7W090FS type=del 2024-09-12T00:37:46.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.680+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=YGTOHE91N99A type=write size=363443 2024-09-12T00:37:46.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.682+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=DI5TXGSJ3T1Q type=del 2024-09-12T00:37:46.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.684+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~90DX06UUUZEJ.0 size=1048576 2024-09-12T00:37:46.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.685+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~90DX06UUUZEJ.1 size=1048576 2024-09-12T00:37:46.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.686+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~90DX06UUUZEJ.2 size=85695 2024-09-12T00:37:46.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.686+0000 7fcd44281780 1 > prepared multipart upload key=U4EPPPA4QGGD upload=90DX06UUUZEJ tag=39IOH7XBKETW type=write size=3231423 2024-09-12T00:37:46.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.688+0000 7fcd44281780 1 < completed write operation key=KJ0C43WLAFLI tag=98NZKSNVN7H5 type=write size=103197 2024-09-12T00:37:46.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.689+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=51214GFUPXVX type=del size=1209532 2024-09-12T00:37:46.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.692+0000 7fcd44281780 1 < suggested remove operation key=0OEDZ5O2LN8H tag=PRVVP9CADAZT type=del 2024-09-12T00:37:46.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.694+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~Z9ZY04X0UT86.0 size=664688 2024-09-12T00:37:46.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.694+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=Z9ZY04X0UT86 tag=F7L7V5N38ES5 type=write size=1713264 2024-09-12T00:37:46.694 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.695+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=FSYLM3WDZS5D type=del 2024-09-12T00:37:46.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.697+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=WJMBQTEI01N1 type=del size=696209 2024-09-12T00:37:46.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.698+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~BKGK8TYUSWSO.0 size=783798 2024-09-12T00:37:46.699 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.701+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=BKGK8TYUSWSO tag=98HAPG5G0NML type=write size=1832374 2024-09-12T00:37:46.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.702+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=WLZG3CKR0MKP type=del size=1779467 2024-09-12T00:37:46.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.703+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~72CXPVRESMZ4.0 size=1048576 2024-09-12T00:37:46.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.704+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~72CXPVRESMZ4.1 size=780504 2024-09-12T00:37:46.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.707+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=72CXPVRESMZ4 tag=R3JAR5CB75J2 type=write size=2877656 2024-09-12T00:37:46.707 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.708+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=XGS1FHVO1WPC type=del size=2147855 2024-09-12T00:37:46.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.710+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=JFSN6ILLRALI type=del 2024-09-12T00:37:46.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.711+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=FRKVKROG44R3 type=write size=180015 2024-09-12T00:37:46.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.712+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~R5FD19G4KJRF.0 size=884609 2024-09-12T00:37:46.713 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.714+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=R5FD19G4KJRF tag=MMX8K8CL3R5Z type=write size=1933185 2024-09-12T00:37:46.716 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.717+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~01BV3G1UDY0Z.0 size=1048576 2024-09-12T00:37:46.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.719+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~01BV3G1UDY0Z.1 size=1048576 2024-09-12T00:37:46.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.720+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~01BV3G1UDY0Z.2 size=500869 2024-09-12T00:37:46.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.720+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=01BV3G1UDY0Z tag=RRT7VRVCIMHD type=write size=3646597 2024-09-12T00:37:46.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.721+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=ZRO2W5T2GCXO type=del 2024-09-12T00:37:46.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.724+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~BI7UM0DTBY9A.0 size=1048576 2024-09-12T00:37:46.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.725+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~BI7UM0DTBY9A.1 size=998599 2024-09-12T00:37:46.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.725+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=BI7UM0DTBY9A tag=8638U0J0BGZF type=write size=3095751 2024-09-12T00:37:46.726 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.727+0000 7fcd44281780 1 < completed write operation key=0AVE0W4OV1AU tag=YNNEQ6Z9FG7K type=write size=11284 2024-09-12T00:37:46.727 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.728+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=9GBYGKG0PDF1 type=write size=5234 2024-09-12T00:37:46.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.730+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~FCMFPZPBRRLP.0 size=1048576 2024-09-12T00:37:46.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.731+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~FCMFPZPBRRLP.1 size=1048576 2024-09-12T00:37:46.731 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.732+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~FCMFPZPBRRLP.2 size=364573 2024-09-12T00:37:46.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.734+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=FCMFPZPBRRLP tag=GOH8525CZV44 type=write size=3510301 2024-09-12T00:37:46.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.736+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=V0GF5RL27FEU type=del size=2055702 2024-09-12T00:37:46.736 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.737+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=TQA8BC86WNB7 type=del 2024-09-12T00:37:46.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.738+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=0IBNB4G7WDU6 type=del size=306730 2024-09-12T00:37:46.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.740+0000 7fcd44281780 -1 < failed to complete operation key=0OEDZ5O2LN8H tag=DV61U1BJMW75 type=del size=1384646: (22) Invalid argument 2024-09-12T00:37:46.741 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.743+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~HVK3JSTCS9UP.0 size=1048576 2024-09-12T00:37:46.742 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.744+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~HVK3JSTCS9UP.1 size=1048576 2024-09-12T00:37:46.743 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.745+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~HVK3JSTCS9UP.2 size=950860 2024-09-12T00:37:46.743 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.745+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=HVK3JSTCS9UP tag=9BE5502E1JR8 type=write size=4096588 2024-09-12T00:37:46.745 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.746+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~BWGRV091XYDI.0 size=1048576 2024-09-12T00:37:46.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.747+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~BWGRV091XYDI.1 size=1048576 2024-09-12T00:37:46.747 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.748+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~BWGRV091XYDI.2 size=8200 2024-09-12T00:37:46.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.751+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=BWGRV091XYDI tag=PW17RRQ7ICLB type=write size=3153928 2024-09-12T00:37:46.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.752+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=N44KZEZM7F53 type=del size=431254 2024-09-12T00:37:46.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.754+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~B8L1AIPM0Z53.0 size=131750 2024-09-12T00:37:46.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.756+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=B8L1AIPM0Z53 tag=HKDHWECSV0E5 type=write size=1180326 2024-09-12T00:37:46.757 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.758+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~ZJM5XTX3QNIG.0 size=1048576 2024-09-12T00:37:46.758 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.760+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~ZJM5XTX3QNIG.1 size=1048576 2024-09-12T00:37:46.759 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.761+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~ZJM5XTX3QNIG.2 size=308485 2024-09-12T00:37:46.760 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.761+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=ZJM5XTX3QNIG tag=IG42BQGCMH1W type=write size=3454213 2024-09-12T00:37:46.761 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.762+0000 7fcd44281780 1 < completed write operation key=O12Z8THB62AJ tag=YGTOHE91N99A type=write size=363443 2024-09-12T00:37:46.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.764+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=22WNFWEH3RF5 type=del size=3106130 2024-09-12T00:37:46.764 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.765+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~90DX06UUUZEJ.0 size=1048576 2024-09-12T00:37:46.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.767+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~90DX06UUUZEJ.1 size=1048576 2024-09-12T00:37:46.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.768+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~90DX06UUUZEJ.2 size=85695 2024-09-12T00:37:46.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.770+0000 7fcd44281780 1 < completed multipart upload key=U4EPPPA4QGGD upload=90DX06UUUZEJ tag=39IOH7XBKETW type=write size=3231423 2024-09-12T00:37:46.770 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.772+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=IVYRUH8VPZNV type=write size=764298 2024-09-12T00:37:46.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.773+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=51214GFUPXVX type=del 2024-09-12T00:37:46.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.774+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=HPV8NXUFIDXI type=del size=1448171 2024-09-12T00:37:46.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.776+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~Z9ZY04X0UT86.0 size=664688 2024-09-12T00:37:46.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.779+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=Z9ZY04X0UT86 tag=F7L7V5N38ES5 type=write size=1713264 2024-09-12T00:37:46.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.780+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=CGL1C4YPAWDE type=del size=3636557 2024-09-12T00:37:46.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.781+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=WJMBQTEI01N1 type=del 2024-09-12T00:37:46.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.783+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=7A13YES7AI4J type=del size=3703259 2024-09-12T00:37:46.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.785+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=WLZG3CKR0MKP type=del 2024-09-12T00:37:46.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.786+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=757LRUR2MFRX type=write size=521156 2024-09-12T00:37:46.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.789+0000 7fcd44281780 1 < suggested remove operation key=DKJ44Z9COIIK tag=XGS1FHVO1WPC type=del 2024-09-12T00:37:46.791 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.792+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~4C38XORU44PY.0 size=1048576 2024-09-12T00:37:46.791 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.793+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~4C38XORU44PY.1 size=1048576 2024-09-12T00:37:46.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.794+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~4C38XORU44PY.2 size=435193 2024-09-12T00:37:46.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.794+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=4C38XORU44PY tag=NW88SW21MQ78 type=write size=3580921 2024-09-12T00:37:46.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.796+0000 7fcd44281780 1 < canceled operation key=O12Z8THB62AJ tag=FRKVKROG44R3 type=write size=180015 2024-09-12T00:37:46.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.797+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=2EPYGBYOOBL7 type=del size=2777988 2024-09-12T00:37:46.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.798+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~01BV3G1UDY0Z.0 size=1048576 2024-09-12T00:37:46.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.798+0000 7fcd44281780 1 < canceled part key=_multipart_UWS056JN3IXO.2~01BV3G1UDY0Z.1 size=1048576 2024-09-12T00:37:46.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.799+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~01BV3G1UDY0Z.2 size=500869 2024-09-12T00:37:46.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.801+0000 7fcd44281780 1 < canceled multipart upload key=UWS056JN3IXO upload=01BV3G1UDY0Z tag=RRT7VRVCIMHD type=write size=3646597 2024-09-12T00:37:46.802 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.803+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=CMC74IWYT8NR type=del size=2607978 2024-09-12T00:37:46.802 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.803+0000 7fcd44281780 1 < canceled part key=_multipart_Z6I6598B6J5I.2~BI7UM0DTBY9A.0 size=1048576 2024-09-12T00:37:46.803 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.804+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~BI7UM0DTBY9A.1 size=998599 2024-09-12T00:37:46.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.807+0000 7fcd44281780 1 < canceled multipart upload key=Z6I6598B6J5I upload=BI7UM0DTBY9A tag=8638U0J0BGZF type=write size=3095751 2024-09-12T00:37:46.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.809+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~41XO0UFEHMLN.0 size=1048576 2024-09-12T00:37:46.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.810+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~41XO0UFEHMLN.1 size=1048576 2024-09-12T00:37:46.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.811+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~41XO0UFEHMLN.2 size=305652 2024-09-12T00:37:46.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.811+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=41XO0UFEHMLN tag=QL32NNIAUNZK type=write size=3451380 2024-09-12T00:37:46.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.813+0000 7fcd44281780 1 < canceled operation key=Z6I6598B6J5I tag=9GBYGKG0PDF1 type=write size=5234 2024-09-12T00:37:46.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.814+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=NKC9853L5TEK type=write size=80515 2024-09-12T00:37:46.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.816+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=V0GF5RL27FEU type=del 2024-09-12T00:37:46.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.818+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~IZLI0YNOPI32.0 size=1048576 2024-09-12T00:37:46.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.819+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~IZLI0YNOPI32.1 size=435066 2024-09-12T00:37:46.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.819+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=IZLI0YNOPI32 tag=FQEGL5W0GAVU type=write size=2532218 2024-09-12T00:37:46.820 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.821+0000 7fcd44281780 1 < canceled operation key=WXBMIJ4FC0VX tag=0IBNB4G7WDU6 type=del size=306730 2024-09-12T00:37:46.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.822+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=FRF2OR0NM315 type=del size=3385788 2024-09-12T00:37:46.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.824+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~HVK3JSTCS9UP.0 size=1048576 2024-09-12T00:37:46.823 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.825+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~HVK3JSTCS9UP.1 size=1048576 2024-09-12T00:37:46.824 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.825+0000 7fcd44281780 1 < canceled part key=_multipart_0AVE0W4OV1AU.2~HVK3JSTCS9UP.2 size=950860 2024-09-12T00:37:46.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.827+0000 7fcd44281780 1 < canceled multipart upload key=0AVE0W4OV1AU upload=HVK3JSTCS9UP tag=9BE5502E1JR8 type=write size=4096588 2024-09-12T00:37:46.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.828+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=NS9VJVU034XH type=del size=204730 2024-09-12T00:37:46.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.830+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=N44KZEZM7F53 type=del 2024-09-12T00:37:46.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.832+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~3IBBY8XARU6Q.0 size=1048576 2024-09-12T00:37:46.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.833+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~3IBBY8XARU6Q.1 size=1048576 2024-09-12T00:37:46.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.834+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~3IBBY8XARU6Q.2 size=430476 2024-09-12T00:37:46.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.834+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=3IBBY8XARU6Q tag=CBYG16J90KX5 type=write size=3576204 2024-09-12T00:37:46.835 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.836+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~ZJM5XTX3QNIG.0 size=1048576 2024-09-12T00:37:46.835 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.836+0000 7fcd44281780 1 < canceled part key=_multipart_0OEDZ5O2LN8H.2~ZJM5XTX3QNIG.1 size=1048576 2024-09-12T00:37:46.836 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.837+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~ZJM5XTX3QNIG.2 size=308485 2024-09-12T00:37:46.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.839+0000 7fcd44281780 1 < canceled multipart upload key=0OEDZ5O2LN8H upload=ZJM5XTX3QNIG tag=IG42BQGCMH1W type=write size=3454213 2024-09-12T00:37:46.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.841+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=7N395UQ48W94 type=del size=1598999 2024-09-12T00:37:46.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.842+0000 7fcd44281780 1 < completed delete operation key=QVULC3H9QGXE tag=22WNFWEH3RF5 type=del 2024-09-12T00:37:46.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.845+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~LCOJ52MOGZ1D.0 size=1048576 2024-09-12T00:37:46.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.846+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~LCOJ52MOGZ1D.1 size=1048576 2024-09-12T00:37:46.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.847+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~LCOJ52MOGZ1D.2 size=590141 2024-09-12T00:37:46.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.847+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=LCOJ52MOGZ1D tag=XE6W1YZQALHL type=write size=3735869 2024-09-12T00:37:46.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.848+0000 7fcd44281780 1 < completed write operation key=KJ0C43WLAFLI tag=IVYRUH8VPZNV type=write size=764298 2024-09-12T00:37:46.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.850+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=XWZU1UHYLSVB type=del size=516879 2024-09-12T00:37:46.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.853+0000 7fcd44281780 1 < suggested update operation key=NIDHAXQF55WX tag=HPV8NXUFIDXI type=del size=1448171 2024-09-12T00:37:46.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.854+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=XPN7QMVV6NXH type=del size=2135916 2024-09-12T00:37:46.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.857+0000 7fcd44281780 1 < suggested update operation key=VXDTFEG8P23H tag=CGL1C4YPAWDE type=del size=3636557 2024-09-12T00:37:46.858 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.860+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~3826VZNQU464.0 size=1048576 2024-09-12T00:37:46.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.861+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~3826VZNQU464.1 size=1048576 2024-09-12T00:37:46.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.862+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~3826VZNQU464.2 size=397851 2024-09-12T00:37:46.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.862+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=3826VZNQU464 tag=ZX237FDLTCR6 type=write size=3543579 2024-09-12T00:37:46.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.864+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=7A13YES7AI4J type=del 2024-09-12T00:37:46.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.865+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=E6V2GBQQ0DR5 type=write size=675186 2024-09-12T00:37:46.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.868+0000 7fcd44281780 1 < suggested remove operation key=UXY6K0AVI4EK tag=757LRUR2MFRX type=write 2024-09-12T00:37:46.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.870+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=1P8Z6QJFRLMS type=del size=3016453 2024-09-12T00:37:46.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.871+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~4C38XORU44PY.0 size=1048576 2024-09-12T00:37:46.871 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.873+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~4C38XORU44PY.1 size=1048576 2024-09-12T00:37:46.872 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.873+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~4C38XORU44PY.2 size=435193 2024-09-12T00:37:46.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.876+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=4C38XORU44PY tag=NW88SW21MQ78 type=write size=3580921 2024-09-12T00:37:46.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.877+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=OHMZKR7JJNLZ type=write size=526406 2024-09-12T00:37:46.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.880+0000 7fcd44281780 1 < suggested remove operation key=QVULC3H9QGXE tag=2EPYGBYOOBL7 type=del 2024-09-12T00:37:46.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.881+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=XV9ZZXVGMUVE type=write size=807668 2024-09-12T00:37:46.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.883+0000 7fcd44281780 1 < canceled operation key=WXBMIJ4FC0VX tag=CMC74IWYT8NR type=del size=2607978 2024-09-12T00:37:46.883 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.884+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=AQTHLYZCOASN type=write size=17334 2024-09-12T00:37:46.884 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.885+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~41XO0UFEHMLN.0 size=1048576 2024-09-12T00:37:46.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.886+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~41XO0UFEHMLN.1 size=1048576 2024-09-12T00:37:46.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.888+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~41XO0UFEHMLN.2 size=305652 2024-09-12T00:37:46.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.890+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=41XO0UFEHMLN tag=QL32NNIAUNZK type=write size=3451380 2024-09-12T00:37:46.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.892+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~91QQGPHC5DZW.0 size=419830 2024-09-12T00:37:46.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.892+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=91QQGPHC5DZW tag=8OTX2271KK9U type=write size=1468406 2024-09-12T00:37:46.893 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.894+0000 7fcd44281780 1 < completed write operation key=WXBMIJ4FC0VX tag=NKC9853L5TEK type=write size=80515 2024-09-12T00:37:46.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.896+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~TGPVOR0LDQXY.0 size=388946 2024-09-12T00:37:46.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.896+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=TGPVOR0LDQXY tag=5G9R3FZ63L41 type=write size=1437522 2024-09-12T00:37:46.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.897+0000 7fcd44281780 1 < canceled part key=_multipart_0O62FO4WVZG6.2~IZLI0YNOPI32.0 size=1048576 2024-09-12T00:37:46.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.898+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~IZLI0YNOPI32.1 size=435066 2024-09-12T00:37:46.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.900+0000 7fcd44281780 1 < canceled multipart upload key=0O62FO4WVZG6 upload=IZLI0YNOPI32 tag=FQEGL5W0GAVU type=write size=2532218 2024-09-12T00:37:46.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.901+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=6IRSGT3LZNIP type=del size=2914723 2024-09-12T00:37:46.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.903+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=FRF2OR0NM315 type=del 2024-09-12T00:37:46.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.905+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~DWW4ZTDOQG5K.0 size=1048576 2024-09-12T00:37:46.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.906+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~DWW4ZTDOQG5K.1 size=66790 2024-09-12T00:37:46.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.907+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=DWW4ZTDOQG5K tag=9BAVRS78GWRN type=write size=2163942 2024-09-12T00:37:46.909 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.910+0000 7fcd44281780 1 < suggested update operation key=O12Z8THB62AJ tag=NS9VJVU034XH type=del size=204730 2024-09-12T00:37:46.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.913+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~NZX3ZARQRG3V.0 size=1048576 2024-09-12T00:37:46.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.914+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~NZX3ZARQRG3V.1 size=179263 2024-09-12T00:37:46.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.914+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=NZX3ZARQRG3V tag=HAYSQR24IFLX type=write size=2276415 2024-09-12T00:37:46.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.915+0000 7fcd44281780 1 < canceled part key=_multipart_UWS056JN3IXO.2~3IBBY8XARU6Q.0 size=1048576 2024-09-12T00:37:46.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.916+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~3IBBY8XARU6Q.1 size=1048576 2024-09-12T00:37:46.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.917+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~3IBBY8XARU6Q.2 size=430476 2024-09-12T00:37:46.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.919+0000 7fcd44281780 1 < canceled multipart upload key=UWS056JN3IXO upload=3IBBY8XARU6Q tag=CBYG16J90KX5 type=write size=3576204 2024-09-12T00:37:46.920 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.921+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~8SMZ8HEL9OON.0 size=1048576 2024-09-12T00:37:46.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.922+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~8SMZ8HEL9OON.1 size=757482 2024-09-12T00:37:46.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.922+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=8SMZ8HEL9OON tag=51FPPWKJR8ZL type=write size=2854634 2024-09-12T00:37:46.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.924+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=7N395UQ48W94 type=del 2024-09-12T00:37:46.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.926+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=U5RODPM61X66 type=del size=1685262 2024-09-12T00:37:46.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.927+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~LCOJ52MOGZ1D.0 size=1048576 2024-09-12T00:37:46.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.928+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~LCOJ52MOGZ1D.1 size=1048576 2024-09-12T00:37:46.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.929+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~LCOJ52MOGZ1D.2 size=590141 2024-09-12T00:37:46.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.932+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=LCOJ52MOGZ1D tag=XE6W1YZQALHL type=write size=3735869 2024-09-12T00:37:46.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.933+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=8JC68EBPY0E5 type=write size=401964 2024-09-12T00:37:46.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.935+0000 7fcd44281780 -1 < failed to complete operation key=UXY6K0AVI4EK tag=XWZU1UHYLSVB type=del size=516879: (22) Invalid argument 2024-09-12T00:37:46.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.937+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~LUR9E4BGGMPO.0 size=1048576 2024-09-12T00:37:46.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.939+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~LUR9E4BGGMPO.1 size=349358 2024-09-12T00:37:46.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.939+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=LUR9E4BGGMPO tag=TB6QW90CJFRO type=write size=2446510 2024-09-12T00:37:46.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.942+0000 7fcd44281780 1 < suggested remove operation key=XTNXNF3D0HFK tag=XPN7QMVV6NXH type=del 2024-09-12T00:37:46.942 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.943+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=P06U7OG0BMYK type=del size=190375 2024-09-12T00:37:46.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.945+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~3826VZNQU464.0 size=1048576 2024-09-12T00:37:46.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.946+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~3826VZNQU464.1 size=1048576 2024-09-12T00:37:46.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.947+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~3826VZNQU464.2 size=397851 2024-09-12T00:37:46.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.949+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=3826VZNQU464 tag=ZX237FDLTCR6 type=write size=3543579 2024-09-12T00:37:46.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.952+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~RYV9X6QHCCU8.0 size=1048576 2024-09-12T00:37:46.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.953+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~RYV9X6QHCCU8.1 size=216545 2024-09-12T00:37:46.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.953+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=RYV9X6QHCCU8 tag=M10WZC1WWHH6 type=write size=2313697 2024-09-12T00:37:46.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.956+0000 7fcd44281780 1 < suggested update operation key=IK8POOY7ZWNF tag=E6V2GBQQ0DR5 type=write size=675186 2024-09-12T00:37:46.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.957+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=9EZ2BBUDCO1Y type=del size=1670882 2024-09-12T00:37:46.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.959+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=1P8Z6QJFRLMS type=del 2024-09-12T00:37:46.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.961+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~RUE8GNWXDS5I.0 size=1048576 2024-09-12T00:37:46.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.962+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~RUE8GNWXDS5I.1 size=1048576 2024-09-12T00:37:46.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.963+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~RUE8GNWXDS5I.2 size=843325 2024-09-12T00:37:46.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.964+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=RUE8GNWXDS5I tag=DTGJ7CM2X0UF type=write size=3989053 2024-09-12T00:37:46.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.965+0000 7fcd44281780 -1 < failed to complete operation key=O12Z8THB62AJ tag=OHMZKR7JJNLZ type=write size=526406: (22) Invalid argument 2024-09-12T00:37:46.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.967+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=WQQGWEUNQUNT type=del size=2909683 2024-09-12T00:37:46.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.968+0000 7fcd44281780 1 < completed write operation key=G8O8VXTUPQVP tag=XV9ZZXVGMUVE type=write size=807668 2024-09-12T00:37:46.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.971+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~9QT0TNR15E7T.0 size=1048576 2024-09-12T00:37:46.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.972+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~9QT0TNR15E7T.1 size=666583 2024-09-12T00:37:46.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.972+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=9QT0TNR15E7T tag=K9R9BDMQKKVC type=write size=2763735 2024-09-12T00:37:46.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.973+0000 7fcd44281780 1 < completed write operation key=8U004LC8IYLQ tag=AQTHLYZCOASN type=write size=17334 2024-09-12T00:37:46.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.975+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=AAZY87GUROPL type=del size=3984157 2024-09-12T00:37:46.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.976+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~91QQGPHC5DZW.0 size=419830 2024-09-12T00:37:46.977 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.978+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=91QQGPHC5DZW tag=8OTX2271KK9U type=write size=1468406 2024-09-12T00:37:46.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.981+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~1AZS0FNP1JYS.0 size=383669 2024-09-12T00:37:46.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.981+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=1AZS0FNP1JYS tag=XIXHK5XE9NKR type=write size=1432245 2024-09-12T00:37:46.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.982+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~TGPVOR0LDQXY.0 size=388946 2024-09-12T00:37:46.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.984+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=TGPVOR0LDQXY tag=5G9R3FZ63L41 type=write size=1437522 2024-09-12T00:37:46.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.986+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=BEX0ZD1A7J1T type=del size=982794 2024-09-12T00:37:46.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.987+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=6IRSGT3LZNIP type=del 2024-09-12T00:37:46.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.989+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=0IWEKRA8XBXV type=del size=3919268 2024-09-12T00:37:46.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.990+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~DWW4ZTDOQG5K.0 size=1048576 2024-09-12T00:37:46.990 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.991+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~DWW4ZTDOQG5K.1 size=66790 2024-09-12T00:37:46.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.994+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=DWW4ZTDOQG5K tag=9BAVRS78GWRN type=write size=2163942 2024-09-12T00:37:46.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.996+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~IUTU6XTIMXSM.0 size=1048576 2024-09-12T00:37:46.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.997+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~IUTU6XTIMXSM.1 size=362760 2024-09-12T00:37:46.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.997+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=IUTU6XTIMXSM tag=2XIGI6X2K3FY type=write size=2459912 2024-09-12T00:37:46.998 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:46.999+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~NZX3ZARQRG3V.0 size=1048576 2024-09-12T00:37:46.999 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.000+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~NZX3ZARQRG3V.1 size=179263 2024-09-12T00:37:47.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.002+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=NZX3ZARQRG3V tag=HAYSQR24IFLX type=write size=2276415 2024-09-12T00:37:47.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.005+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~TAXTKY2CJ83V.0 size=1048576 2024-09-12T00:37:47.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.006+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~TAXTKY2CJ83V.1 size=488136 2024-09-12T00:37:47.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.006+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=TAXTKY2CJ83V tag=1HYFPE66KRLT type=write size=2585288 2024-09-12T00:37:47.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.007+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~8SMZ8HEL9OON.0 size=1048576 2024-09-12T00:37:47.007 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.008+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~8SMZ8HEL9OON.1 size=757482 2024-09-12T00:37:47.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.011+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=8SMZ8HEL9OON tag=51FPPWKJR8ZL type=write size=2854634 2024-09-12T00:37:47.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.012+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=ENYR7Q58IB7X type=write size=615797 2024-09-12T00:37:47.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.013+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=U5RODPM61X66 type=del 2024-09-12T00:37:47.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.016+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~BF5KKE7X2NWI.0 size=1048576 2024-09-12T00:37:47.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.017+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~BF5KKE7X2NWI.1 size=69510 2024-09-12T00:37:47.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.017+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=BF5KKE7X2NWI tag=FFXX16EKMYKT type=write size=2166662 2024-09-12T00:37:47.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.019+0000 7fcd44281780 1 < canceled operation key=CF7B7J3V1YFG tag=8JC68EBPY0E5 type=write size=401964 2024-09-12T00:37:47.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.020+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=983PH5Q8KCLU type=del size=2713510 2024-09-12T00:37:47.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.021+0000 7fcd44281780 1 < canceled part key=_multipart_DKJ44Z9COIIK.2~LUR9E4BGGMPO.0 size=1048576 2024-09-12T00:37:47.020 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.021+0000 7fcd44281780 1 < canceled part key=_multipart_DKJ44Z9COIIK.2~LUR9E4BGGMPO.1 size=349358 2024-09-12T00:37:47.021 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.023+0000 7fcd44281780 1 < canceled multipart upload key=DKJ44Z9COIIK upload=LUR9E4BGGMPO tag=TB6QW90CJFRO type=write size=2446510 2024-09-12T00:37:47.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.024+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=92JEVS5CQON8 type=del size=1115597 2024-09-12T00:37:47.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.026+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=P06U7OG0BMYK type=del 2024-09-12T00:37:47.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.029+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~NI2S3T2GLU1N.0 size=1048576 2024-09-12T00:37:47.029 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.030+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~NI2S3T2GLU1N.1 size=326918 2024-09-12T00:37:47.029 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.030+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=NI2S3T2GLU1N tag=1BM12FXCW4YV type=write size=2424070 2024-09-12T00:37:47.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.031+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~RYV9X6QHCCU8.0 size=1048576 2024-09-12T00:37:47.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.032+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~RYV9X6QHCCU8.1 size=216545 2024-09-12T00:37:47.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.034+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=RYV9X6QHCCU8 tag=M10WZC1WWHH6 type=write size=2313697 2024-09-12T00:37:47.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.037+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~GSANDELYFRHK.0 size=80916 2024-09-12T00:37:47.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.037+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=GSANDELYFRHK tag=DRWF61JK0SIO type=write size=1129492 2024-09-12T00:37:47.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.041+0000 7fcd44281780 1 < suggested update operation key=XTNXNF3D0HFK tag=9EZ2BBUDCO1Y type=del size=1670882 2024-09-12T00:37:47.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.044+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~9RAHSUHKW1LQ.0 size=392071 2024-09-12T00:37:47.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.044+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=9RAHSUHKW1LQ tag=C090LCGJ0TY8 type=write size=1440647 2024-09-12T00:37:47.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.045+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~RUE8GNWXDS5I.0 size=1048576 2024-09-12T00:37:47.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.047+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~RUE8GNWXDS5I.1 size=1048576 2024-09-12T00:37:47.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.048+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~RUE8GNWXDS5I.2 size=843325 2024-09-12T00:37:47.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.050+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=RUE8GNWXDS5I tag=DTGJ7CM2X0UF type=write size=3989053 2024-09-12T00:37:47.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.052+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=TDATHYPZ7YM5 type=del size=2464938 2024-09-12T00:37:47.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.053+0000 7fcd44281780 1 < completed delete operation key=0OEDZ5O2LN8H tag=WQQGWEUNQUNT type=del 2024-09-12T00:37:47.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.056+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~ZZA9UCTZGRFR.0 size=1048576 2024-09-12T00:37:47.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.057+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~ZZA9UCTZGRFR.1 size=1048576 2024-09-12T00:37:47.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.058+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~ZZA9UCTZGRFR.2 size=320571 2024-09-12T00:37:47.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.058+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=ZZA9UCTZGRFR tag=KPP0E4SW9T2F type=write size=3466299 2024-09-12T00:37:47.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.060+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~9QT0TNR15E7T.0 size=1048576 2024-09-12T00:37:47.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.061+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~9QT0TNR15E7T.1 size=666583 2024-09-12T00:37:47.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.063+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=9QT0TNR15E7T tag=K9R9BDMQKKVC type=write size=2763735 2024-09-12T00:37:47.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.065+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=PYISHMFOUOT2 type=del size=41998 2024-09-12T00:37:47.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.066+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=AAZY87GUROPL type=del 2024-09-12T00:37:47.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.069+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~67XP745A29O1.0 size=1048576 2024-09-12T00:37:47.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.070+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~67XP745A29O1.1 size=1048576 2024-09-12T00:37:47.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.071+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~67XP745A29O1.2 size=548423 2024-09-12T00:37:47.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.071+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=67XP745A29O1 tag=KSTW0ASKLBLR type=write size=3694151 2024-09-12T00:37:47.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.073+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~1AZS0FNP1JYS.0 size=383669 2024-09-12T00:37:47.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.075+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=1AZS0FNP1JYS tag=XIXHK5XE9NKR type=write size=1432245 2024-09-12T00:37:47.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.077+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=RN55LOD0SQTD type=del size=107375 2024-09-12T00:37:47.077 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.078+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=BEX0ZD1A7J1T type=del 2024-09-12T00:37:47.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.080+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=Z7JMOOL799BP type=del size=2321566 2024-09-12T00:37:47.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.081+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=0IWEKRA8XBXV type=del 2024-09-12T00:37:47.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.083+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=5F2CZ3OO3PA2 type=del size=2842701 2024-09-12T00:37:47.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.084+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~IUTU6XTIMXSM.0 size=1048576 2024-09-12T00:37:47.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.086+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~IUTU6XTIMXSM.1 size=362760 2024-09-12T00:37:47.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.088+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=IUTU6XTIMXSM tag=2XIGI6X2K3FY type=write size=2459912 2024-09-12T00:37:47.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.090+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~I59ZQ8XUZPTQ.0 size=1048576 2024-09-12T00:37:47.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.092+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~I59ZQ8XUZPTQ.1 size=1048576 2024-09-12T00:37:47.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.093+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~I59ZQ8XUZPTQ.2 size=39852 2024-09-12T00:37:47.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.093+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=I59ZQ8XUZPTQ tag=ZXSSUPTUGUG9 type=write size=3185580 2024-09-12T00:37:47.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.093+0000 7fcd44281780 1 < canceled part key=_multipart_DKJ44Z9COIIK.2~TAXTKY2CJ83V.0 size=1048576 2024-09-12T00:37:47.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.094+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~TAXTKY2CJ83V.1 size=488136 2024-09-12T00:37:47.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.096+0000 7fcd44281780 1 < canceled multipart upload key=DKJ44Z9COIIK upload=TAXTKY2CJ83V tag=1HYFPE66KRLT type=write size=2585288 2024-09-12T00:37:47.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.099+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~5ICXZ97VK78P.0 size=1048576 2024-09-12T00:37:47.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.100+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~5ICXZ97VK78P.1 size=1048576 2024-09-12T00:37:47.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.101+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~5ICXZ97VK78P.2 size=436411 2024-09-12T00:37:47.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.101+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=5ICXZ97VK78P tag=JCC7Q14SWRSC type=write size=3582139 2024-09-12T00:37:47.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.103+0000 7fcd44281780 1 < completed write operation key=KNBCXZF3JGNL tag=ENYR7Q58IB7X type=write size=615797 2024-09-12T00:37:47.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.105+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=PS1XBYAMSXIA type=del size=1764938 2024-09-12T00:37:47.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.106+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~BF5KKE7X2NWI.0 size=1048576 2024-09-12T00:37:47.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.107+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~BF5KKE7X2NWI.1 size=69510 2024-09-12T00:37:47.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.110+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=BF5KKE7X2NWI tag=FFXX16EKMYKT type=write size=2166662 2024-09-12T00:37:47.110 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.112+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=0V32B049QOQ7 type=del size=3082318 2024-09-12T00:37:47.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.113+0000 7fcd44281780 1 < canceled operation key=8U004LC8IYLQ tag=983PH5Q8KCLU type=del size=2713510 2024-09-12T00:37:47.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.114+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=EBJX7CGP60KV type=del size=179891 2024-09-12T00:37:47.115 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.116+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=92JEVS5CQON8 type=del 2024-09-12T00:37:47.118 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.119+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~7SA2AINRTZ1U.0 size=1048576 2024-09-12T00:37:47.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.120+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~7SA2AINRTZ1U.1 size=1048576 2024-09-12T00:37:47.120 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.121+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~7SA2AINRTZ1U.2 size=354578 2024-09-12T00:37:47.120 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.121+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=7SA2AINRTZ1U tag=AJEQRD3DMX7L type=write size=3500306 2024-09-12T00:37:47.121 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.122+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~NI2S3T2GLU1N.0 size=1048576 2024-09-12T00:37:47.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.123+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~NI2S3T2GLU1N.1 size=326918 2024-09-12T00:37:47.124 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.126+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=NI2S3T2GLU1N tag=1BM12FXCW4YV type=write size=2424070 2024-09-12T00:37:47.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.128+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~DQGV8L76KUAU.0 size=1048576 2024-09-12T00:37:47.128 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.129+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~DQGV8L76KUAU.1 size=875265 2024-09-12T00:37:47.128 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.129+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=DQGV8L76KUAU tag=EE0166PXHPGK type=write size=2972417 2024-09-12T00:37:47.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.131+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~GSANDELYFRHK.0 size=80916 2024-09-12T00:37:47.132 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.133+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=GSANDELYFRHK tag=DRWF61JK0SIO type=write size=1129492 2024-09-12T00:37:47.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.135+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=3J97D1D541GE type=write size=680801 2024-09-12T00:37:47.135 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.136+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~9RAHSUHKW1LQ.0 size=392071 2024-09-12T00:37:47.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.138+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=9RAHSUHKW1LQ tag=C090LCGJ0TY8 type=write size=1440647 2024-09-12T00:37:47.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.140+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=EON98NFIGGGQ type=write size=946580 2024-09-12T00:37:47.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.141+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=TDATHYPZ7YM5 type=del 2024-09-12T00:37:47.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.144+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~37U0ET3KN8GM.0 size=908586 2024-09-12T00:37:47.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.144+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=37U0ET3KN8GM tag=9OQLR9WLHO7V type=write size=1957162 2024-09-12T00:37:47.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.145+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~ZZA9UCTZGRFR.0 size=1048576 2024-09-12T00:37:47.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.146+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~ZZA9UCTZGRFR.1 size=1048576 2024-09-12T00:37:47.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.149+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~ZZA9UCTZGRFR.2 size=320571 2024-09-12T00:37:47.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.151+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=ZZA9UCTZGRFR tag=KPP0E4SW9T2F type=write size=3466299 2024-09-12T00:37:47.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.153+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=LNRLP4CX5BA4 type=del size=1205578 2024-09-12T00:37:47.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.154+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=PYISHMFOUOT2 type=del 2024-09-12T00:37:47.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.156+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=N08RJG2J05OZ type=del size=3433705 2024-09-12T00:37:47.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.157+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~67XP745A29O1.0 size=1048576 2024-09-12T00:37:47.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.158+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~67XP745A29O1.1 size=1048576 2024-09-12T00:37:47.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.159+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~67XP745A29O1.2 size=548423 2024-09-12T00:37:47.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.161+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=67XP745A29O1 tag=KSTW0ASKLBLR type=write size=3694151 2024-09-12T00:37:47.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.163+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=P4007Q9237RC type=del size=588873 2024-09-12T00:37:47.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.164+0000 7fcd44281780 1 < canceled operation key=ZQSZDU87GAMV tag=RN55LOD0SQTD type=del size=107375 2024-09-12T00:37:47.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.167+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~AEBP1GUWYHKH.0 size=1048576 2024-09-12T00:37:47.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.168+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~AEBP1GUWYHKH.1 size=713600 2024-09-12T00:37:47.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.168+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=AEBP1GUWYHKH tag=8XOSYWIU7FIR type=write size=2810752 2024-09-12T00:37:47.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.170+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=Z7JMOOL799BP type=del 2024-09-12T00:37:47.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.173+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=0SFM7YZVR1N3 type=del size=3042267 2024-09-12T00:37:47.174 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.175+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=5F2CZ3OO3PA2 type=del 2024-09-12T00:37:47.175 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.177+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=6R0KM9SV9W5Z type=del size=1449675 2024-09-12T00:37:47.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.178+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~I59ZQ8XUZPTQ.0 size=1048576 2024-09-12T00:37:47.178 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.179+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~I59ZQ8XUZPTQ.1 size=1048576 2024-09-12T00:37:47.180 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.181+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~I59ZQ8XUZPTQ.2 size=39852 2024-09-12T00:37:47.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.184+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=I59ZQ8XUZPTQ tag=ZXSSUPTUGUG9 type=write size=3185580 2024-09-12T00:37:47.186 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.187+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~RTR444CO4WGW.0 size=1048576 2024-09-12T00:37:47.187 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.188+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~RTR444CO4WGW.1 size=1048576 2024-09-12T00:37:47.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.189+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~RTR444CO4WGW.2 size=588373 2024-09-12T00:37:47.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.189+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=RTR444CO4WGW tag=KACU77R9R9WD type=write size=3734101 2024-09-12T00:37:47.189 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.191+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~5ICXZ97VK78P.0 size=1048576 2024-09-12T00:37:47.190 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.192+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~5ICXZ97VK78P.1 size=1048576 2024-09-12T00:37:47.191 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.193+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~5ICXZ97VK78P.2 size=436411 2024-09-12T00:37:47.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.195+0000 7fcd44281780 1 < completed multipart upload key=B5OH55MQGSGJ upload=5ICXZ97VK78P tag=JCC7Q14SWRSC type=write size=3582139 2024-09-12T00:37:47.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.196+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=H1MJO8FUS43C type=del size=2120134 2024-09-12T00:37:47.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.198+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=PS1XBYAMSXIA type=del 2024-09-12T00:37:47.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.199+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=RLKFHZLZABN4 type=del size=3334622 2024-09-12T00:37:47.199 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.201+0000 7fcd44281780 1 < canceled operation key=526O814C10YW tag=0V32B049QOQ7 type=del size=3082318 2024-09-12T00:37:47.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.203+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~I7JLEMCKBMXG.0 size=251901 2024-09-12T00:37:47.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.203+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=I7JLEMCKBMXG tag=TN39Z6MMIEFK type=write size=1300477 2024-09-12T00:37:47.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.204+0000 7fcd44281780 1 < completed delete operation key=XTNXNF3D0HFK tag=EBJX7CGP60KV type=del 2024-09-12T00:37:47.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.206+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=BBMJ1YF6YTO8 type=del size=2762262 2024-09-12T00:37:47.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.206+0000 7fcd44281780 1 < canceled part key=_multipart_RYSE2CKE5IRT.2~7SA2AINRTZ1U.0 size=1048576 2024-09-12T00:37:47.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.207+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~7SA2AINRTZ1U.1 size=1048576 2024-09-12T00:37:47.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.208+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~7SA2AINRTZ1U.2 size=354578 2024-09-12T00:37:47.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.211+0000 7fcd44281780 1 < canceled multipart upload key=RYSE2CKE5IRT upload=7SA2AINRTZ1U tag=AJEQRD3DMX7L type=write size=3500306 2024-09-12T00:37:47.212 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.213+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~AGA63G4EFD7R.0 size=1048576 2024-09-12T00:37:47.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.214+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~AGA63G4EFD7R.1 size=527351 2024-09-12T00:37:47.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.214+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=AGA63G4EFD7R tag=VQLDZELRCHHL type=write size=2624503 2024-09-12T00:37:47.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.216+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~DQGV8L76KUAU.0 size=1048576 2024-09-12T00:37:47.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.217+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~DQGV8L76KUAU.1 size=875265 2024-09-12T00:37:47.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.219+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=DQGV8L76KUAU tag=EE0166PXHPGK type=write size=2972417 2024-09-12T00:37:47.220 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.221+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=NG7XVKM4HYK0 type=del size=3627557 2024-09-12T00:37:47.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.222+0000 7fcd44281780 1 < completed write operation key=KNBCXZF3JGNL tag=3J97D1D541GE type=write size=680801 2024-09-12T00:37:47.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.224+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=EXV8QWEXURIA type=del size=3377853 2024-09-12T00:37:47.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.225+0000 7fcd44281780 1 < completed write operation key=O12Z8THB62AJ tag=EON98NFIGGGQ type=write size=946580 2024-09-12T00:37:47.225 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.226+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=D1H9R6TJYDWB type=write size=777871 2024-09-12T00:37:47.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.228+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~37U0ET3KN8GM.0 size=908586 2024-09-12T00:37:47.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.230+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=37U0ET3KN8GM tag=9OQLR9WLHO7V type=write size=1957162 2024-09-12T00:37:47.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.231+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=3W6SPAD6X4SK type=del size=2798109 2024-09-12T00:37:47.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.233+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=LNRLP4CX5BA4 type=del 2024-09-12T00:37:47.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.234+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=N3FMME5807D6 type=del size=4064918 2024-09-12T00:37:47.235 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.236+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=N08RJG2J05OZ type=del 2024-09-12T00:37:47.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.237+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=9RPKIET71CAO type=write size=238388 2024-09-12T00:37:47.238 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.239+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=P4007Q9237RC type=del 2024-09-12T00:37:47.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.240+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=A0G49Z5073MT type=del size=115194 2024-09-12T00:37:47.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.242+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~AEBP1GUWYHKH.0 size=1048576 2024-09-12T00:37:47.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.243+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~AEBP1GUWYHKH.1 size=713600 2024-09-12T00:37:47.244 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.246+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=AEBP1GUWYHKH tag=8XOSYWIU7FIR type=write size=2810752 2024-09-12T00:37:47.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.247+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=Q7HAIYNNUNCZ type=del size=1036953 2024-09-12T00:37:47.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.248+0000 7fcd44281780 1 < canceled operation key=WXBMIJ4FC0VX tag=0SFM7YZVR1N3 type=del size=3042267 2024-09-12T00:37:47.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.250+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=GR79BXH7MRDS type=write size=738744 2024-09-12T00:37:47.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.251+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=6R0KM9SV9W5Z type=del 2024-09-12T00:37:47.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.253+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=4RW3YOV5TLWB type=write size=746545 2024-09-12T00:37:47.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.254+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~RTR444CO4WGW.0 size=1048576 2024-09-12T00:37:47.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.255+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~RTR444CO4WGW.1 size=1048576 2024-09-12T00:37:47.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.255+0000 7fcd44281780 1 < canceled part key=_multipart_UWS056JN3IXO.2~RTR444CO4WGW.2 size=588373 2024-09-12T00:37:47.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.257+0000 7fcd44281780 1 < canceled multipart upload key=UWS056JN3IXO upload=RTR444CO4WGW tag=KACU77R9R9WD type=write size=3734101 2024-09-12T00:37:47.259 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.260+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~82L147LD9KVF.0 size=1048576 2024-09-12T00:37:47.260 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.261+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~82L147LD9KVF.1 size=1021294 2024-09-12T00:37:47.260 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.261+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=82L147LD9KVF tag=ZOK59D5XQS54 type=write size=3118446 2024-09-12T00:37:47.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.262+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=H1MJO8FUS43C type=del 2024-09-12T00:37:47.262 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.264+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=MQJGWO1ZOR3O type=del size=2883778 2024-09-12T00:37:47.263 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.265+0000 7fcd44281780 1 < canceled operation key=ZQSZDU87GAMV tag=RLKFHZLZABN4 type=del size=3334622 2024-09-12T00:37:47.265 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.266+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=5QSDJDR0CTX7 type=del size=608010 2024-09-12T00:37:47.266 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.268+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~I7JLEMCKBMXG.0 size=251901 2024-09-12T00:37:47.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.270+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=I7JLEMCKBMXG tag=TN39Z6MMIEFK type=write size=1300477 2024-09-12T00:37:47.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.271+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=3Z2NTMHZX9E4 type=del size=1459908 2024-09-12T00:37:47.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.272+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=BBMJ1YF6YTO8 type=del 2024-09-12T00:37:47.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.273+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=7S9CW2VNZWL5 type=del size=2281733 2024-09-12T00:37:47.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.275+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~AGA63G4EFD7R.0 size=1048576 2024-09-12T00:37:47.274 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.276+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~AGA63G4EFD7R.1 size=527351 2024-09-12T00:37:47.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.278+0000 7fcd44281780 1 < completed multipart upload key=UWS056JN3IXO upload=AGA63G4EFD7R tag=VQLDZELRCHHL type=write size=2624503 2024-09-12T00:37:47.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.280+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~ODFNSOK2Y7B1.0 size=1048576 2024-09-12T00:37:47.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.281+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~ODFNSOK2Y7B1.1 size=1048576 2024-09-12T00:37:47.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.282+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~ODFNSOK2Y7B1.2 size=953916 2024-09-12T00:37:47.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.282+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=ODFNSOK2Y7B1 tag=CT429C7TC9JW type=write size=4099644 2024-09-12T00:37:47.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.284+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=NG7XVKM4HYK0 type=del 2024-09-12T00:37:47.284 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.285+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=3N4LS7U3JLIZ type=del size=1677391 2024-09-12T00:37:47.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.286+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=EXV8QWEXURIA type=del 2024-09-12T00:37:47.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.288+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=O3YSFNI439FY type=del size=892698 2024-09-12T00:37:47.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.291+0000 7fcd44281780 1 < suggested update operation key=0OEDZ5O2LN8H tag=D1H9R6TJYDWB type=write size=777871 2024-09-12T00:37:47.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.292+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=T556XZPLR33K type=write size=429274 2024-09-12T00:37:47.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.293+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=3W6SPAD6X4SK type=del 2024-09-12T00:37:47.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.296+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~OFFZ1PR9FFKT.0 size=1048576 2024-09-12T00:37:47.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.297+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~OFFZ1PR9FFKT.1 size=1048576 2024-09-12T00:37:47.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.298+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~OFFZ1PR9FFKT.2 size=777674 2024-09-12T00:37:47.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.298+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=OFFZ1PR9FFKT tag=03SBP1GFRLQV type=write size=3923402 2024-09-12T00:37:47.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.299+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=N3FMME5807D6 type=del 2024-09-12T00:37:47.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.300+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=QV8ELQF9D30M type=write size=475530 2024-09-12T00:37:47.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.302+0000 7fcd44281780 1 < completed write operation key=4RU6HTH4J0U1 tag=9RPKIET71CAO type=write size=238388 2024-09-12T00:37:47.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.303+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=CMSA4AMYUDM0 type=del size=1978014 2024-09-12T00:37:47.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.306+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=A0G49Z5073MT type=del 2024-09-12T00:37:47.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.309+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~6DKEWLBU6RJU.0 size=878774 2024-09-12T00:37:47.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.309+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=6DKEWLBU6RJU tag=H6M1GVWMG5HX type=write size=1927350 2024-09-12T00:37:47.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.310+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=Q7HAIYNNUNCZ type=del 2024-09-12T00:37:47.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.313+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~UTF8SH27ZQ3R.0 size=766397 2024-09-12T00:37:47.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.313+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=UTF8SH27ZQ3R tag=SOGN99BGB53Y type=write size=1814973 2024-09-12T00:37:47.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.314+0000 7fcd44281780 1 < completed write operation key=IK8POOY7ZWNF tag=GR79BXH7MRDS type=write size=738744 2024-09-12T00:37:47.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.316+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=YEY4EA2PEN3I type=del size=1071235 2024-09-12T00:37:47.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.318+0000 7fcd44281780 1 < suggested update operation key=4RU6HTH4J0U1 tag=4RW3YOV5TLWB type=write size=746545 2024-09-12T00:37:47.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.319+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=5OJQZUNPWSSG type=del size=3725254 2024-09-12T00:37:47.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.321+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~82L147LD9KVF.0 size=1048576 2024-09-12T00:37:47.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.322+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~82L147LD9KVF.1 size=1021294 2024-09-12T00:37:47.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.324+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=82L147LD9KVF tag=ZOK59D5XQS54 type=write size=3118446 2024-09-12T00:37:47.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.325+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=N9SFLXLU1YXS type=del size=3031872 2024-09-12T00:37:47.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.328+0000 7fcd44281780 1 < suggested remove operation key=NIDHAXQF55WX tag=MQJGWO1ZOR3O type=del 2024-09-12T00:37:47.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.330+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=0GE7BIA31JNC type=del size=2948428 2024-09-12T00:37:47.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.331+0000 7fcd44281780 -1 < failed to complete operation key=0OEDZ5O2LN8H tag=5QSDJDR0CTX7 type=del size=608010: (22) Invalid argument 2024-09-12T00:37:47.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.334+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~VT0KTFZTGN6B.0 size=1048576 2024-09-12T00:37:47.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.335+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~VT0KTFZTGN6B.1 size=119329 2024-09-12T00:37:47.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.335+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=VT0KTFZTGN6B tag=IGOC0MMWDXLB type=write size=2216481 2024-09-12T00:37:47.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.337+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=3Z2NTMHZX9E4 type=del 2024-09-12T00:37:47.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.338+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=7ASKPOBTAD1E type=del size=1623281 2024-09-12T00:37:47.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.340+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=7S9CW2VNZWL5 type=del 2024-09-12T00:37:47.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.342+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~FP6RHFE6K6BS.0 size=358048 2024-09-12T00:37:47.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.342+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=FP6RHFE6K6BS tag=HPADK9HKSTTK type=write size=1406624 2024-09-12T00:37:47.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.344+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~ODFNSOK2Y7B1.0 size=1048576 2024-09-12T00:37:47.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.344+0000 7fcd44281780 1 < canceled part key=_multipart_7UCICX0GHHQ1.2~ODFNSOK2Y7B1.1 size=1048576 2024-09-12T00:37:47.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.344+0000 7fcd44281780 1 < canceled part key=_multipart_7UCICX0GHHQ1.2~ODFNSOK2Y7B1.2 size=953916 2024-09-12T00:37:47.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.346+0000 7fcd44281780 1 < canceled multipart upload key=7UCICX0GHHQ1 upload=ODFNSOK2Y7B1 tag=CT429C7TC9JW type=write size=4099644 2024-09-12T00:37:47.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.349+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~6NJ2ETK3BHXL.0 size=27090 2024-09-12T00:37:47.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.349+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=6NJ2ETK3BHXL tag=YKCT4F8MSWBW type=write size=1075666 2024-09-12T00:37:47.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.350+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=3N4LS7U3JLIZ type=del 2024-09-12T00:37:47.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.352+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=R1NF7YWRTDGF type=del size=21576 2024-09-12T00:37:47.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.355+0000 7fcd44281780 1 < suggested remove operation key=KNBCXZF3JGNL tag=O3YSFNI439FY type=del 2024-09-12T00:37:47.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.357+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~ZLM16VU71ACM.0 size=1048576 2024-09-12T00:37:47.357 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.359+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~ZLM16VU71ACM.1 size=1048576 2024-09-12T00:37:47.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.360+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~ZLM16VU71ACM.2 size=256196 2024-09-12T00:37:47.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.360+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=ZLM16VU71ACM tag=83EZDDEVJEJX type=write size=3401924 2024-09-12T00:37:47.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.363+0000 7fcd44281780 1 < suggested remove operation key=WXBMIJ4FC0VX tag=T556XZPLR33K type=write 2024-09-12T00:37:47.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.364+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=S7Z2IQNINPYN type=del size=3088830 2024-09-12T00:37:47.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.365+0000 7fcd44281780 1 < canceled part key=_multipart_0AVE0W4OV1AU.2~OFFZ1PR9FFKT.0 size=1048576 2024-09-12T00:37:47.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.366+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~OFFZ1PR9FFKT.1 size=1048576 2024-09-12T00:37:47.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.367+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~OFFZ1PR9FFKT.2 size=777674 2024-09-12T00:37:47.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.369+0000 7fcd44281780 1 < canceled multipart upload key=0AVE0W4OV1AU upload=OFFZ1PR9FFKT tag=03SBP1GFRLQV type=write size=3923402 2024-09-12T00:37:47.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.371+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=OZH2QTLM1J92 type=del size=1431050 2024-09-12T00:37:47.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.373+0000 7fcd44281780 1 < suggested update operation key=0AVE0W4OV1AU tag=QV8ELQF9D30M type=write size=475530 2024-09-12T00:37:47.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.375+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=S2CDJ4UGERDS type=del size=75613 2024-09-12T00:37:47.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.377+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=CMSA4AMYUDM0 type=del 2024-09-12T00:37:47.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.378+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=8Y1HSML99D1T type=del size=3728022 2024-09-12T00:37:47.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.379+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~6DKEWLBU6RJU.0 size=878774 2024-09-12T00:37:47.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.381+0000 7fcd44281780 1 < completed multipart upload key=526O814C10YW upload=6DKEWLBU6RJU tag=H6M1GVWMG5HX type=write size=1927350 2024-09-12T00:37:47.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.383+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=5S42PIPX7OOC type=del size=2422221 2024-09-12T00:37:47.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.384+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~UTF8SH27ZQ3R.0 size=766397 2024-09-12T00:37:47.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.386+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=UTF8SH27ZQ3R tag=SOGN99BGB53Y type=write size=1814973 2024-09-12T00:37:47.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.388+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=8TRCJP6CW5US type=del size=541050 2024-09-12T00:37:47.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.389+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=YEY4EA2PEN3I type=del 2024-09-12T00:37:47.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.391+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=XWN8G2G8F9JP type=del size=1148810 2024-09-12T00:37:47.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.392+0000 7fcd44281780 -1 < failed to complete operation key=0AVE0W4OV1AU tag=5OJQZUNPWSSG type=del size=3725254: (22) Invalid argument 2024-09-12T00:37:47.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.395+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~9C5NQ5XUTVRF.0 size=1048576 2024-09-12T00:37:47.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.396+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~9C5NQ5XUTVRF.1 size=1048576 2024-09-12T00:37:47.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.397+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~9C5NQ5XUTVRF.2 size=862434 2024-09-12T00:37:47.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.397+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=9C5NQ5XUTVRF tag=8ENXOGP1CMY1 type=write size=4008162 2024-09-12T00:37:47.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.398+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=N9SFLXLU1YXS type=del 2024-09-12T00:37:47.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.400+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=WJULQ1JGZA0U type=write size=20352 2024-09-12T00:37:47.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.401+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=0GE7BIA31JNC type=del 2024-09-12T00:37:47.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.404+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~8857IAFBQJVX.0 size=129382 2024-09-12T00:37:47.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.404+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=8857IAFBQJVX tag=UC1OI6OMPTDS type=write size=1177958 2024-09-12T00:37:47.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.405+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~VT0KTFZTGN6B.0 size=1048576 2024-09-12T00:37:47.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.406+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~VT0KTFZTGN6B.1 size=119329 2024-09-12T00:37:47.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.408+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=VT0KTFZTGN6B tag=IGOC0MMWDXLB type=write size=2216481 2024-09-12T00:37:47.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.411+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~DT5KC98RXSEL.0 size=1048576 2024-09-12T00:37:47.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.412+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~DT5KC98RXSEL.1 size=579487 2024-09-12T00:37:47.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.412+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=DT5KC98RXSEL tag=X4TJS76VPVJ9 type=write size=2676639 2024-09-12T00:37:47.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.413+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=7ASKPOBTAD1E type=del 2024-09-12T00:37:47.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.415+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=AUEUSHG9WR8C type=del size=3207181 2024-09-12T00:37:47.415 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.416+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~FP6RHFE6K6BS.0 size=358048 2024-09-12T00:37:47.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.418+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=FP6RHFE6K6BS tag=HPADK9HKSTTK type=write size=1406624 2024-09-12T00:37:47.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.420+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=PB6CZTOIVGGX type=write size=170255 2024-09-12T00:37:47.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.422+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~6NJ2ETK3BHXL.0 size=27090 2024-09-12T00:37:47.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.424+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=6NJ2ETK3BHXL tag=YKCT4F8MSWBW type=write size=1075666 2024-09-12T00:37:47.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.426+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~X57U0S8TLJAE.0 size=517978 2024-09-12T00:37:47.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.426+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=X57U0S8TLJAE tag=2EVAH7EKX7EC type=write size=1566554 2024-09-12T00:37:47.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.428+0000 7fcd44281780 1 < canceled operation key=8U004LC8IYLQ tag=R1NF7YWRTDGF type=del size=21576 2024-09-12T00:37:47.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.429+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=P5EQEOCHY52B type=del size=1786187 2024-09-12T00:37:47.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.430+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~ZLM16VU71ACM.0 size=1048576 2024-09-12T00:37:47.430 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.431+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~ZLM16VU71ACM.1 size=1048576 2024-09-12T00:37:47.431 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.433+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~ZLM16VU71ACM.2 size=256196 2024-09-12T00:37:47.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.435+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=ZLM16VU71ACM tag=83EZDDEVJEJX type=write size=3401924 2024-09-12T00:37:47.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.436+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=VJ09H3RMV6ID type=del size=1647481 2024-09-12T00:37:47.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.439+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=S7Z2IQNINPYN type=del 2024-09-12T00:37:47.439 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.440+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=YQQQWF8HMYUP type=del size=2980482 2024-09-12T00:37:47.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.442+0000 7fcd44281780 -1 < failed to complete operation key=0AVE0W4OV1AU tag=OZH2QTLM1J92 type=del size=1431050: (22) Invalid argument 2024-09-12T00:37:47.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.443+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=YYEKIOEDM8B9 type=del size=2449287 2024-09-12T00:37:47.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.444+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=S2CDJ4UGERDS type=del 2024-09-12T00:37:47.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.447+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~0I3TE057UJ5N.0 size=1048576 2024-09-12T00:37:47.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.448+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~0I3TE057UJ5N.1 size=1048576 2024-09-12T00:37:47.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.449+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~0I3TE057UJ5N.2 size=754360 2024-09-12T00:37:47.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.449+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=0I3TE057UJ5N tag=MMRU4RIPGF32 type=write size=3900088 2024-09-12T00:37:47.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.450+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=8Y1HSML99D1T type=del 2024-09-12T00:37:47.451 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.452+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=UCWWJXQVF8AX type=del size=630534 2024-09-12T00:37:47.452 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.453+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=5S42PIPX7OOC type=del 2024-09-12T00:37:47.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.455+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=CGT7432WAOO8 type=del size=4184067 2024-09-12T00:37:47.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.458+0000 7fcd44281780 1 < suggested remove operation key=8U004LC8IYLQ tag=8TRCJP6CW5US type=del 2024-09-12T00:37:47.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.460+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~IXRQ0KESUCMD.0 size=1048576 2024-09-12T00:37:47.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.461+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~IXRQ0KESUCMD.1 size=147952 2024-09-12T00:37:47.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.461+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=IXRQ0KESUCMD tag=17ARYEXMCUC9 type=write size=2245104 2024-09-12T00:37:47.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.463+0000 7fcd44281780 -1 < failed to complete operation key=8U004LC8IYLQ tag=XWN8G2G8F9JP type=del size=1148810: (22) Invalid argument 2024-09-12T00:37:47.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.466+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~2J04KDNK49LP.0 size=970668 2024-09-12T00:37:47.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.466+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=2J04KDNK49LP tag=V4H4U0STVGCO type=write size=2019244 2024-09-12T00:37:47.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.467+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~9C5NQ5XUTVRF.0 size=1048576 2024-09-12T00:37:47.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.468+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~9C5NQ5XUTVRF.1 size=1048576 2024-09-12T00:37:47.468 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.469+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~9C5NQ5XUTVRF.2 size=862434 2024-09-12T00:37:47.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.472+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=9C5NQ5XUTVRF tag=8ENXOGP1CMY1 type=write size=4008162 2024-09-12T00:37:47.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.474+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~8ORJJJ7LZZY2.0 size=1048576 2024-09-12T00:37:47.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.475+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~8ORJJJ7LZZY2.1 size=376687 2024-09-12T00:37:47.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.475+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=8ORJJJ7LZZY2 tag=Z9AL4W26W4HC type=write size=2473839 2024-09-12T00:37:47.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.476+0000 7fcd44281780 1 < completed write operation key=KNBCXZF3JGNL tag=WJULQ1JGZA0U type=write size=20352 2024-09-12T00:37:47.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.478+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=ADJU9JK80E4Q type=del size=801979 2024-09-12T00:37:47.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.479+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~8857IAFBQJVX.0 size=129382 2024-09-12T00:37:47.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.481+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=8857IAFBQJVX tag=UC1OI6OMPTDS type=write size=1177958 2024-09-12T00:37:47.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.483+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=7IZS26ZY9SUP type=del size=300725 2024-09-12T00:37:47.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.484+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~DT5KC98RXSEL.0 size=1048576 2024-09-12T00:37:47.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.485+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~DT5KC98RXSEL.1 size=579487 2024-09-12T00:37:47.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.488+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=DT5KC98RXSEL tag=X4TJS76VPVJ9 type=write size=2676639 2024-09-12T00:37:47.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.490+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~XDH1OD7NF1MH.0 size=402370 2024-09-12T00:37:47.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.490+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=XDH1OD7NF1MH tag=15H3OT3SYQEB type=write size=1450946 2024-09-12T00:37:47.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.491+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=AUEUSHG9WR8C type=del 2024-09-12T00:37:47.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.493+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=XZ1PP04E9KV6 type=write size=535451 2024-09-12T00:37:47.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.494+0000 7fcd44281780 1 < completed write operation key=XTNXNF3D0HFK tag=PB6CZTOIVGGX type=write size=170255 2024-09-12T00:37:47.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.495+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=BZ0DPDVSOS5R type=del size=2136137 2024-09-12T00:37:47.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.497+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~X57U0S8TLJAE.0 size=517978 2024-09-12T00:37:47.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.499+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=X57U0S8TLJAE tag=2EVAH7EKX7EC type=write size=1566554 2024-09-12T00:37:47.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.502+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~BJDCH8VTPODL.0 size=1048576 2024-09-12T00:37:47.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.503+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~BJDCH8VTPODL.1 size=1048576 2024-09-12T00:37:47.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.504+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~BJDCH8VTPODL.2 size=775624 2024-09-12T00:37:47.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.504+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=BJDCH8VTPODL tag=8EB452RP1GPA type=write size=3921352 2024-09-12T00:37:47.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.505+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=P5EQEOCHY52B type=del 2024-09-12T00:37:47.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.507+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=HTEU5JNLC9SU type=del size=1744417 2024-09-12T00:37:47.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.509+0000 7fcd44281780 1 < completed delete operation key=4RU6HTH4J0U1 tag=VJ09H3RMV6ID type=del 2024-09-12T00:37:47.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.510+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=9P54LVDIZ8UR type=del size=1573098 2024-09-12T00:37:47.512 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.513+0000 7fcd44281780 1 < suggested remove operation key=VOO70F2NBKL0 tag=YQQQWF8HMYUP type=del 2024-09-12T00:37:47.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.516+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~P5H8OLZQVHRU.0 size=1048576 2024-09-12T00:37:47.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.517+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~P5H8OLZQVHRU.1 size=589022 2024-09-12T00:37:47.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.517+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=P5H8OLZQVHRU tag=E3RCOQ7TO9N1 type=write size=2686174 2024-09-12T00:37:47.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.519+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=YYEKIOEDM8B9 type=del 2024-09-12T00:37:47.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.521+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~00BV0HTEKA8Q.0 size=489640 2024-09-12T00:37:47.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.521+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=00BV0HTEKA8Q tag=LEE5DJU5LHZK type=write size=1538216 2024-09-12T00:37:47.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.523+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~0I3TE057UJ5N.0 size=1048576 2024-09-12T00:37:47.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.524+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~0I3TE057UJ5N.1 size=1048576 2024-09-12T00:37:47.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.525+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~0I3TE057UJ5N.2 size=754360 2024-09-12T00:37:47.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.528+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=0I3TE057UJ5N tag=MMRU4RIPGF32 type=write size=3900088 2024-09-12T00:37:47.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.529+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=BSALPOWJATHL type=del size=2262046 2024-09-12T00:37:47.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.531+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=UCWWJXQVF8AX type=del 2024-09-12T00:37:47.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.532+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=RY3ISX47VW5C type=del size=1981353 2024-09-12T00:37:47.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.534+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=CGT7432WAOO8 type=del 2024-09-12T00:37:47.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.535+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=ZA2PZRC8OIZX type=del size=2578767 2024-09-12T00:37:47.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.536+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~IXRQ0KESUCMD.0 size=1048576 2024-09-12T00:37:47.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.537+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~IXRQ0KESUCMD.1 size=147952 2024-09-12T00:37:47.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.540+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=IXRQ0KESUCMD tag=17ARYEXMCUC9 type=write size=2245104 2024-09-12T00:37:47.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.541+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=L4Q1EOVC2QM1 type=del size=460067 2024-09-12T00:37:47.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.543+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~2J04KDNK49LP.0 size=970668 2024-09-12T00:37:47.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.545+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=2J04KDNK49LP tag=V4H4U0STVGCO type=write size=2019244 2024-09-12T00:37:47.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.547+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~G0YF6KO79ZQR.0 size=189273 2024-09-12T00:37:47.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.547+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=G0YF6KO79ZQR tag=PNPF8Q1YKOPM type=write size=1237849 2024-09-12T00:37:47.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.549+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~8ORJJJ7LZZY2.0 size=1048576 2024-09-12T00:37:47.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.550+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~8ORJJJ7LZZY2.1 size=376687 2024-09-12T00:37:47.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.552+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=8ORJJJ7LZZY2 tag=Z9AL4W26W4HC type=write size=2473839 2024-09-12T00:37:47.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.555+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~BTKB9X2RGY79.0 size=1048576 2024-09-12T00:37:47.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.556+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~BTKB9X2RGY79.1 size=1048576 2024-09-12T00:37:47.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.558+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~BTKB9X2RGY79.2 size=116987 2024-09-12T00:37:47.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.558+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=BTKB9X2RGY79 tag=QV3HHU43QGI0 type=write size=3262715 2024-09-12T00:37:47.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.559+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=ADJU9JK80E4Q type=del 2024-09-12T00:37:47.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.560+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=YECUY11DJVD7 type=write size=517013 2024-09-12T00:37:47.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.561+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=7IZS26ZY9SUP type=del 2024-09-12T00:37:47.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.564+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~QARCGTIN4DTO.0 size=1048576 2024-09-12T00:37:47.564 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.565+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~QARCGTIN4DTO.1 size=289707 2024-09-12T00:37:47.564 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.565+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=QARCGTIN4DTO tag=O8O18KPAC1H0 type=write size=2386859 2024-09-12T00:37:47.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.567+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~XDH1OD7NF1MH.0 size=402370 2024-09-12T00:37:47.568 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.570+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=XDH1OD7NF1MH tag=15H3OT3SYQEB type=write size=1450946 2024-09-12T00:37:47.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.572+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~1Z7T5QZNKITC.0 size=1048576 2024-09-12T00:37:47.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.573+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~1Z7T5QZNKITC.1 size=100476 2024-09-12T00:37:47.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.573+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=1Z7T5QZNKITC tag=5MHSNLN9QH6R type=write size=2197628 2024-09-12T00:37:47.573 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.575+0000 7fcd44281780 1 < completed write operation key=AN6GRGZ22INA tag=XZ1PP04E9KV6 type=write size=535451 2024-09-12T00:37:47.576 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.577+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~FB8M4FQZU02O.0 size=1048576 2024-09-12T00:37:47.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.578+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~FB8M4FQZU02O.1 size=627628 2024-09-12T00:37:47.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.578+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=FB8M4FQZU02O tag=A46HLCJGDSX5 type=write size=2724780 2024-09-12T00:37:47.580 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.581+0000 7fcd44281780 1 < suggested update operation key=UWS056JN3IXO tag=BZ0DPDVSOS5R type=del size=2136137 2024-09-12T00:37:47.582 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.584+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~5K7XBGFEL1IU.0 size=1048576 2024-09-12T00:37:47.583 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.585+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~5K7XBGFEL1IU.1 size=1048576 2024-09-12T00:37:47.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.586+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~5K7XBGFEL1IU.2 size=113665 2024-09-12T00:37:47.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.586+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=5K7XBGFEL1IU tag=DDCB7EQ3CVSL type=write size=3259393 2024-09-12T00:37:47.586 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.587+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~BJDCH8VTPODL.0 size=1048576 2024-09-12T00:37:47.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.588+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~BJDCH8VTPODL.1 size=1048576 2024-09-12T00:37:47.588 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.590+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~BJDCH8VTPODL.2 size=775624 2024-09-12T00:37:47.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.592+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=BJDCH8VTPODL tag=8EB452RP1GPA type=write size=3921352 2024-09-12T00:37:47.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.594+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=M29AWO8BR4EM type=write size=266535 2024-09-12T00:37:47.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.595+0000 7fcd44281780 1 < completed delete operation key=QVULC3H9QGXE tag=HTEU5JNLC9SU type=del 2024-09-12T00:37:47.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.598+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~06KQLJ9ZH24X.0 size=1048576 2024-09-12T00:37:47.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.599+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~06KQLJ9ZH24X.1 size=1048576 2024-09-12T00:37:47.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.600+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~06KQLJ9ZH24X.2 size=688703 2024-09-12T00:37:47.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.600+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=06KQLJ9ZH24X tag=IVDEHLGPIHV8 type=write size=3834431 2024-09-12T00:37:47.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.601+0000 7fcd44281780 1 < completed delete operation key=QVULC3H9QGXE tag=9P54LVDIZ8UR type=del 2024-09-12T00:37:47.601 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.602+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=OKZP1UILV5DJ type=del size=3963624 2024-09-12T00:37:47.603 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.604+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~P5H8OLZQVHRU.0 size=1048576 2024-09-12T00:37:47.604 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.605+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~P5H8OLZQVHRU.1 size=589022 2024-09-12T00:37:47.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.607+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=P5H8OLZQVHRU tag=E3RCOQ7TO9N1 type=write size=2686174 2024-09-12T00:37:47.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.610+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~FB0HCDSZWEJR.0 size=1048576 2024-09-12T00:37:47.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.611+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~FB0HCDSZWEJR.1 size=1048576 2024-09-12T00:37:47.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.612+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~FB0HCDSZWEJR.2 size=831407 2024-09-12T00:37:47.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.612+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=FB0HCDSZWEJR tag=YXVRCQK3NJY7 type=write size=3977135 2024-09-12T00:37:47.612 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.613+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~00BV0HTEKA8Q.0 size=489640 2024-09-12T00:37:47.614 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.616+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=00BV0HTEKA8Q tag=LEE5DJU5LHZK type=write size=1538216 2024-09-12T00:37:47.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.617+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=1CEVG6LMMGFD type=write size=184421 2024-09-12T00:37:47.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.618+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=BSALPOWJATHL type=del 2024-09-12T00:37:47.619 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.621+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~KEGNT99I8XZT.0 size=1048576 2024-09-12T00:37:47.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.622+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~KEGNT99I8XZT.1 size=1048576 2024-09-12T00:37:47.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.623+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~KEGNT99I8XZT.2 size=869086 2024-09-12T00:37:47.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.623+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=KEGNT99I8XZT tag=73JFXN37VMP3 type=write size=4014814 2024-09-12T00:37:47.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.624+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=RY3ISX47VW5C type=del 2024-09-12T00:37:47.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.625+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=LHXRYM1JYFXW type=del size=2648625 2024-09-12T00:37:47.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.627+0000 7fcd44281780 1 < completed delete operation key=4RU6HTH4J0U1 tag=ZA2PZRC8OIZX type=del 2024-09-12T00:37:47.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.628+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=91MADZOMC6SV type=del size=3679886 2024-09-12T00:37:47.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.630+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=L4Q1EOVC2QM1 type=del 2024-09-12T00:37:47.630 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.631+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=78LW107IY705 type=write size=477894 2024-09-12T00:37:47.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.633+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~G0YF6KO79ZQR.0 size=189273 2024-09-12T00:37:47.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.635+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=G0YF6KO79ZQR tag=PNPF8Q1YKOPM type=write size=1237849 2024-09-12T00:37:47.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.638+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~Y4CPIBSXSXKT.0 size=1048576 2024-09-12T00:37:47.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.638+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~Y4CPIBSXSXKT.1 size=1048576 2024-09-12T00:37:47.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.640+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~Y4CPIBSXSXKT.2 size=881777 2024-09-12T00:37:47.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.640+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=Y4CPIBSXSXKT tag=LP2O1P202Z2K type=write size=4027505 2024-09-12T00:37:47.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.640+0000 7fcd44281780 1 < canceled part key=_multipart_KNBCXZF3JGNL.2~BTKB9X2RGY79.0 size=1048576 2024-09-12T00:37:47.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.641+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~BTKB9X2RGY79.1 size=1048576 2024-09-12T00:37:47.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.642+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~BTKB9X2RGY79.2 size=116987 2024-09-12T00:37:47.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.646+0000 7fcd44281780 1 < canceled multipart upload key=KNBCXZF3JGNL upload=BTKB9X2RGY79 tag=QV3HHU43QGI0 type=write size=3262715 2024-09-12T00:37:47.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.647+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=FMH0JR9JPRTB type=del size=2561510 2024-09-12T00:37:47.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.651+0000 7fcd44281780 1 < suggested update operation key=ZQSZDU87GAMV tag=YECUY11DJVD7 type=write size=517013 2024-09-12T00:37:47.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.652+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=UGB2DBTAD9AL type=del size=1906584 2024-09-12T00:37:47.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.654+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~QARCGTIN4DTO.0 size=1048576 2024-09-12T00:37:47.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.655+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~QARCGTIN4DTO.1 size=289707 2024-09-12T00:37:47.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.657+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=QARCGTIN4DTO tag=O8O18KPAC1H0 type=write size=2386859 2024-09-12T00:37:47.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.660+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~G8QUGL0VT1NC.0 size=813462 2024-09-12T00:37:47.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.660+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=G8QUGL0VT1NC tag=NLFWFEZ96RXT type=write size=1862038 2024-09-12T00:37:47.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.662+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~1Z7T5QZNKITC.0 size=1048576 2024-09-12T00:37:47.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.663+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~1Z7T5QZNKITC.1 size=100476 2024-09-12T00:37:47.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.665+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=1Z7T5QZNKITC tag=5MHSNLN9QH6R type=write size=2197628 2024-09-12T00:37:47.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.667+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=U1RH0DRE27R8 type=del size=1249347 2024-09-12T00:37:47.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.668+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~FB8M4FQZU02O.0 size=1048576 2024-09-12T00:37:47.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.668+0000 7fcd44281780 1 < canceled part key=_multipart_0O62FO4WVZG6.2~FB8M4FQZU02O.1 size=627628 2024-09-12T00:37:47.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.672+0000 7fcd44281780 1 < canceled multipart upload key=0O62FO4WVZG6 upload=FB8M4FQZU02O tag=A46HLCJGDSX5 type=write size=2724780 2024-09-12T00:37:47.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.673+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=W218ZBPI8EFP type=del size=4188104 2024-09-12T00:37:47.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.675+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~5K7XBGFEL1IU.0 size=1048576 2024-09-12T00:37:47.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.676+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~5K7XBGFEL1IU.1 size=1048576 2024-09-12T00:37:47.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.678+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~5K7XBGFEL1IU.2 size=113665 2024-09-12T00:37:47.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.680+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=5K7XBGFEL1IU tag=DDCB7EQ3CVSL type=write size=3259393 2024-09-12T00:37:47.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.683+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~56RID2I043UT.0 size=1048576 2024-09-12T00:37:47.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.684+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~56RID2I043UT.1 size=853723 2024-09-12T00:37:47.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.684+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=56RID2I043UT tag=3I9QB7ZW1RYR type=write size=2950875 2024-09-12T00:37:47.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.686+0000 7fcd44281780 1 < completed write operation key=U4EPPPA4QGGD tag=M29AWO8BR4EM type=write size=266535 2024-09-12T00:37:47.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.688+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~DHNFEDSK3F19.0 size=1048576 2024-09-12T00:37:47.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.690+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~DHNFEDSK3F19.1 size=298880 2024-09-12T00:37:47.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.690+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=DHNFEDSK3F19 tag=MDS72MAU4FGF type=write size=2396032 2024-09-12T00:37:47.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.691+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~06KQLJ9ZH24X.0 size=1048576 2024-09-12T00:37:47.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.692+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~06KQLJ9ZH24X.1 size=1048576 2024-09-12T00:37:47.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.693+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~06KQLJ9ZH24X.2 size=688703 2024-09-12T00:37:47.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.696+0000 7fcd44281780 1 < completed multipart upload key=4RU6HTH4J0U1 upload=06KQLJ9ZH24X tag=IVDEHLGPIHV8 type=write size=3834431 2024-09-12T00:37:47.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.697+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=HGUQ2Z0KDX2G type=del size=3621449 2024-09-12T00:37:47.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.702+0000 7fcd44281780 1 < suggested update operation key=Z6I6598B6J5I tag=OKZP1UILV5DJ type=del size=3963624 2024-09-12T00:37:47.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.704+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=PWS86PC8PN3E type=del size=3056479 2024-09-12T00:37:47.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.706+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~FB0HCDSZWEJR.0 size=1048576 2024-09-12T00:37:47.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.707+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~FB0HCDSZWEJR.1 size=1048576 2024-09-12T00:37:47.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.707+0000 7fcd44281780 1 < canceled part key=_multipart_XTNXNF3D0HFK.2~FB0HCDSZWEJR.2 size=831407 2024-09-12T00:37:47.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.710+0000 7fcd44281780 1 < canceled multipart upload key=XTNXNF3D0HFK upload=FB0HCDSZWEJR tag=YXVRCQK3NJY7 type=write size=3977135 2024-09-12T00:37:47.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.711+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=M36LIEPFDB7G type=del size=3866844 2024-09-12T00:37:47.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.712+0000 7fcd44281780 1 < completed write operation key=4RU6HTH4J0U1 tag=1CEVG6LMMGFD type=write size=184421 2024-09-12T00:37:47.713 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.714+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=227M5ZKEIL9P type=write size=963772 2024-09-12T00:37:47.714 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.716+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~KEGNT99I8XZT.0 size=1048576 2024-09-12T00:37:47.716 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.717+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~KEGNT99I8XZT.1 size=1048576 2024-09-12T00:37:47.716 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.718+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~KEGNT99I8XZT.2 size=869086 2024-09-12T00:37:47.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.720+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=KEGNT99I8XZT tag=73JFXN37VMP3 type=write size=4014814 2024-09-12T00:37:47.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.721+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=OBOYEWQRBB0H type=del size=483373 2024-09-12T00:37:47.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.725+0000 7fcd44281780 1 < suggested update operation key=KJ0C43WLAFLI tag=LHXRYM1JYFXW type=del size=2648625 2024-09-12T00:37:47.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.726+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=VRQ49IG8S9Q9 type=del size=3422809 2024-09-12T00:37:47.726 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.727+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=91MADZOMC6SV type=del 2024-09-12T00:37:47.728 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.729+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=YXL6V0G62ZMZ type=del size=199440 2024-09-12T00:37:47.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.730+0000 7fcd44281780 1 < completed write operation key=KNBCXZF3JGNL tag=78LW107IY705 type=write size=477894 2024-09-12T00:37:47.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.733+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~KMF63YFMV0YV.0 size=1048576 2024-09-12T00:37:47.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.734+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~KMF63YFMV0YV.1 size=1048576 2024-09-12T00:37:47.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.735+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~KMF63YFMV0YV.2 size=971692 2024-09-12T00:37:47.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.735+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=KMF63YFMV0YV tag=Y782UOZJNH30 type=write size=4117420 2024-09-12T00:37:47.736 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.737+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~Y4CPIBSXSXKT.0 size=1048576 2024-09-12T00:37:47.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.738+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~Y4CPIBSXSXKT.1 size=1048576 2024-09-12T00:37:47.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.739+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~Y4CPIBSXSXKT.2 size=881777 2024-09-12T00:37:47.740 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.741+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=Y4CPIBSXSXKT tag=LP2O1P202Z2K type=write size=4027505 2024-09-12T00:37:47.741 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.743+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=W9G5RC0FIIGU type=del size=3384736 2024-09-12T00:37:47.743 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.744+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=FMH0JR9JPRTB type=del 2024-09-12T00:37:47.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.747+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~FULGA4MHA603.0 size=722760 2024-09-12T00:37:47.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.747+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=FULGA4MHA603 tag=1LBPK66YU0OC type=write size=1771336 2024-09-12T00:37:47.747 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.748+0000 7fcd44281780 1 < canceled operation key=4RU6HTH4J0U1 tag=UGB2DBTAD9AL type=del size=1906584 2024-09-12T00:37:47.749 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.751+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~S3HO0WHWY960.0 size=444300 2024-09-12T00:37:47.749 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.751+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=S3HO0WHWY960 tag=78LNVXN3FW7N type=write size=1492876 2024-09-12T00:37:47.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.752+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~G8QUGL0VT1NC.0 size=813462 2024-09-12T00:37:47.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.754+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=G8QUGL0VT1NC tag=NLFWFEZ96RXT type=write size=1862038 2024-09-12T00:37:47.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.755+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=KOTHLS0L1TFX type=del size=3215357 2024-09-12T00:37:47.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.757+0000 7fcd44281780 1 < canceled operation key=EXP8U6QNSMQ0 tag=U1RH0DRE27R8 type=del size=1249347 2024-09-12T00:37:47.760 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.760+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~NQQRSBNWRZ5I.0 size=1048576 2024-09-12T00:37:47.760 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.761+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~NQQRSBNWRZ5I.1 size=1048576 2024-09-12T00:37:47.761 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.762+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~NQQRSBNWRZ5I.2 size=484902 2024-09-12T00:37:47.761 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.762+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=NQQRSBNWRZ5I tag=D9YOFO8NI4HR type=write size=3630630 2024-09-12T00:37:47.762 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.764+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=W218ZBPI8EFP type=del 2024-09-12T00:37:47.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.766+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~NWJX6TU0UXQE.0 size=1048576 2024-09-12T00:37:47.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.767+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~NWJX6TU0UXQE.1 size=1048576 2024-09-12T00:37:47.767 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.768+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~NWJX6TU0UXQE.2 size=808825 2024-09-12T00:37:47.767 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.768+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=NWJX6TU0UXQE tag=P3ILT3C1E8YH type=write size=3954553 2024-09-12T00:37:47.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.770+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~56RID2I043UT.0 size=1048576 2024-09-12T00:37:47.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.771+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~56RID2I043UT.1 size=853723 2024-09-12T00:37:47.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.773+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=56RID2I043UT tag=3I9QB7ZW1RYR type=write size=2950875 2024-09-12T00:37:47.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.775+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=6YICWBPXX3NY type=write size=529673 2024-09-12T00:37:47.775 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.776+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~DHNFEDSK3F19.0 size=1048576 2024-09-12T00:37:47.776 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.777+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~DHNFEDSK3F19.1 size=298880 2024-09-12T00:37:47.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.779+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=DHNFEDSK3F19 tag=MDS72MAU4FGF type=write size=2396032 2024-09-12T00:37:47.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.781+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=FCZEMAZIG6U7 type=write size=711063 2024-09-12T00:37:47.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.782+0000 7fcd44281780 1 < completed delete operation key=XTNXNF3D0HFK tag=HGUQ2Z0KDX2G type=del 2024-09-12T00:37:47.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.783+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=KP86GMIZ4ETE type=del size=2881389 2024-09-12T00:37:47.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.784+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=PWS86PC8PN3E type=del 2024-09-12T00:37:47.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.786+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=YL53VDLW5KKI type=del size=652781 2024-09-12T00:37:47.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.787+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=M36LIEPFDB7G type=del 2024-09-12T00:37:47.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.789+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=8X24B4ETULML type=write size=433205 2024-09-12T00:37:47.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.790+0000 7fcd44281780 1 < completed write operation key=RYSE2CKE5IRT tag=227M5ZKEIL9P type=write size=963772 2024-09-12T00:37:47.791 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.793+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~VB3WPT0Z54ZT.0 size=1048576 2024-09-12T00:37:47.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.794+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~VB3WPT0Z54ZT.1 size=887544 2024-09-12T00:37:47.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.794+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=VB3WPT0Z54ZT tag=M2DESV24N00Y type=write size=2984696 2024-09-12T00:37:47.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.795+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=OBOYEWQRBB0H type=del 2024-09-12T00:37:47.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.798+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~MLYP64K1AE6G.0 size=916127 2024-09-12T00:37:47.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.798+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=MLYP64K1AE6G tag=R8J4ENBT8DR6 type=write size=1964703 2024-09-12T00:37:47.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.800+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=VRQ49IG8S9Q9 type=del 2024-09-12T00:37:47.801 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.803+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~X7Q1L2GXLFVN.0 size=1048576 2024-09-12T00:37:47.803 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.804+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~X7Q1L2GXLFVN.1 size=640771 2024-09-12T00:37:47.803 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.804+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=X7Q1L2GXLFVN tag=PPPN2AFNYK9Z type=write size=2737923 2024-09-12T00:37:47.804 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.805+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=YXL6V0G62ZMZ type=del 2024-09-12T00:37:47.806 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.807+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=JNLT1ISJ6I56 type=del size=2823356 2024-09-12T00:37:47.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.808+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~KMF63YFMV0YV.0 size=1048576 2024-09-12T00:37:47.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.809+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~KMF63YFMV0YV.1 size=1048576 2024-09-12T00:37:47.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.810+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~KMF63YFMV0YV.2 size=971692 2024-09-12T00:37:47.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.813+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=KMF63YFMV0YV tag=Y782UOZJNH30 type=write size=4117420 2024-09-12T00:37:47.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.815+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~UDUXN9CN4N3Y.0 size=1048576 2024-09-12T00:37:47.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.816+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~UDUXN9CN4N3Y.1 size=1048576 2024-09-12T00:37:47.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.817+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~UDUXN9CN4N3Y.2 size=324241 2024-09-12T00:37:47.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.817+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=UDUXN9CN4N3Y tag=B2WNGWLMWHZU type=write size=3469969 2024-09-12T00:37:47.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.819+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=W9G5RC0FIIGU type=del 2024-09-12T00:37:47.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.820+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=MIIUFBF5FWX7 type=del size=999403 2024-09-12T00:37:47.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.822+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~FULGA4MHA603.0 size=722760 2024-09-12T00:37:47.823 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.824+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=FULGA4MHA603 tag=1LBPK66YU0OC type=write size=1771336 2024-09-12T00:37:47.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.827+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~DHGHYP0AV8QV.0 size=1048576 2024-09-12T00:37:47.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.828+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~DHGHYP0AV8QV.1 size=595477 2024-09-12T00:37:47.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.828+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=DHGHYP0AV8QV tag=07RE6V35HAB2 type=write size=2692629 2024-09-12T00:37:47.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.830+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~S3HO0WHWY960.0 size=444300 2024-09-12T00:37:47.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.832+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=S3HO0WHWY960 tag=78LNVXN3FW7N type=write size=1492876 2024-09-12T00:37:47.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.833+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=8K046LVUCJ00 type=del size=3088571 2024-09-12T00:37:47.835 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.836+0000 7fcd44281780 1 < canceled operation key=ZQSZDU87GAMV tag=KOTHLS0L1TFX type=del size=3215357 2024-09-12T00:37:47.836 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.837+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=AQNFS6BLHYRP type=write size=560916 2024-09-12T00:37:47.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.839+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~NQQRSBNWRZ5I.0 size=1048576 2024-09-12T00:37:47.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.840+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~NQQRSBNWRZ5I.1 size=1048576 2024-09-12T00:37:47.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.841+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~NQQRSBNWRZ5I.2 size=484902 2024-09-12T00:37:47.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.843+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=NQQRSBNWRZ5I tag=D9YOFO8NI4HR type=write size=3630630 2024-09-12T00:37:47.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.846+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~FF4LYZOOPC91.0 size=1048576 2024-09-12T00:37:47.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.847+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~FF4LYZOOPC91.1 size=513767 2024-09-12T00:37:47.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.847+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=FF4LYZOOPC91 tag=F2HBKON9IOCG type=write size=2610919 2024-09-12T00:37:47.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.848+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~NWJX6TU0UXQE.0 size=1048576 2024-09-12T00:37:47.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.849+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~NWJX6TU0UXQE.1 size=1048576 2024-09-12T00:37:47.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.850+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~NWJX6TU0UXQE.2 size=808825 2024-09-12T00:37:47.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.852+0000 7fcd44281780 1 < completed multipart upload key=0AVE0W4OV1AU upload=NWJX6TU0UXQE tag=P3ILT3C1E8YH type=write size=3954553 2024-09-12T00:37:47.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.854+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=Z8RLFRSCXB5N type=write size=21464 2024-09-12T00:37:47.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.855+0000 7fcd44281780 1 < completed write operation key=XRW0CRE12S5B tag=6YICWBPXX3NY type=write size=529673 2024-09-12T00:37:47.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.857+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=KW61MEF9SMIE type=del size=3126280 2024-09-12T00:37:47.857 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.858+0000 7fcd44281780 1 < completed write operation key=8U004LC8IYLQ tag=FCZEMAZIG6U7 type=write size=711063 2024-09-12T00:37:47.859 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.861+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~OW5F2IKKNDL7.0 size=1048576 2024-09-12T00:37:47.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.862+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~OW5F2IKKNDL7.1 size=1048576 2024-09-12T00:37:47.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.863+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~OW5F2IKKNDL7.2 size=486815 2024-09-12T00:37:47.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.863+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=OW5F2IKKNDL7 tag=XEWEKVP7I3KO type=write size=3632543 2024-09-12T00:37:47.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.864+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=KP86GMIZ4ETE type=del 2024-09-12T00:37:47.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.867+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~AS883EBR66Y8.0 size=1041079 2024-09-12T00:37:47.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.867+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=AS883EBR66Y8 tag=8KUPBB48OJHF type=write size=2089655 2024-09-12T00:37:47.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.869+0000 7fcd44281780 1 < suggested update operation key=526O814C10YW tag=YL53VDLW5KKI type=del size=652781 2024-09-12T00:37:47.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.871+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=1XDPLHKN8IB4 type=write size=783591 2024-09-12T00:37:47.871 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.872+0000 7fcd44281780 1 < completed write operation key=EXP8U6QNSMQ0 tag=8X24B4ETULML type=write size=433205 2024-09-12T00:37:47.872 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.874+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=6XZ6H13U8EXC type=del size=4016809 2024-09-12T00:37:47.874 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.875+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~VB3WPT0Z54ZT.0 size=1048576 2024-09-12T00:37:47.874 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.875+0000 7fcd44281780 1 < canceled part key=_multipart_QVULC3H9QGXE.2~VB3WPT0Z54ZT.1 size=887544 2024-09-12T00:37:47.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.877+0000 7fcd44281780 1 < canceled multipart upload key=QVULC3H9QGXE upload=VB3WPT0Z54ZT tag=M2DESV24N00Y type=write size=2984696 2024-09-12T00:37:47.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.878+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=NH0Q5CNHTWSI type=del size=1253955 2024-09-12T00:37:47.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.880+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~MLYP64K1AE6G.0 size=916127 2024-09-12T00:37:47.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.882+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=MLYP64K1AE6G tag=R8J4ENBT8DR6 type=write size=1964703 2024-09-12T00:37:47.883 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.885+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~QNULUIC4K1KB.0 size=742044 2024-09-12T00:37:47.884 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.885+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=QNULUIC4K1KB tag=7TATAC61GDQ2 type=write size=1790620 2024-09-12T00:37:47.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.886+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~X7Q1L2GXLFVN.0 size=1048576 2024-09-12T00:37:47.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.887+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~X7Q1L2GXLFVN.1 size=640771 2024-09-12T00:37:47.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.889+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=X7Q1L2GXLFVN tag=PPPN2AFNYK9Z type=write size=2737923 2024-09-12T00:37:47.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.891+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=CS0MR79NVXGA type=del size=1446306 2024-09-12T00:37:47.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.893+0000 7fcd44281780 1 < suggested update operation key=WXBMIJ4FC0VX tag=JNLT1ISJ6I56 type=del size=2823356 2024-09-12T00:37:47.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.895+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=MQWVE3K2T8Z7 type=del size=3360364 2024-09-12T00:37:47.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.895+0000 7fcd44281780 1 < canceled part key=_multipart_0ELZXPZCRPGP.2~UDUXN9CN4N3Y.0 size=1048576 2024-09-12T00:37:47.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.896+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~UDUXN9CN4N3Y.1 size=1048576 2024-09-12T00:37:47.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.897+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~UDUXN9CN4N3Y.2 size=324241 2024-09-12T00:37:47.898 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.899+0000 7fcd44281780 1 < canceled multipart upload key=0ELZXPZCRPGP upload=UDUXN9CN4N3Y tag=B2WNGWLMWHZU type=write size=3469969 2024-09-12T00:37:47.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.901+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=SNQZQYWYP3DG type=write size=251395 2024-09-12T00:37:47.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.902+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=MIIUFBF5FWX7 type=del 2024-09-12T00:37:47.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.904+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=EGZD00ZRLZQ5 type=del size=633095 2024-09-12T00:37:47.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.905+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~DHGHYP0AV8QV.0 size=1048576 2024-09-12T00:37:47.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.906+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~DHGHYP0AV8QV.1 size=595477 2024-09-12T00:37:47.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.909+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=DHGHYP0AV8QV tag=07RE6V35HAB2 type=write size=2692629 2024-09-12T00:37:47.909 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.910+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=2WY6MM6AFGQ3 type=del size=2850204 2024-09-12T00:37:47.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.912+0000 7fcd44281780 1 < completed delete operation key=0OEDZ5O2LN8H tag=8K046LVUCJ00 type=del 2024-09-12T00:37:47.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.915+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~ZFITD16NFFXE.0 size=1048576 2024-09-12T00:37:47.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.916+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~ZFITD16NFFXE.1 size=521240 2024-09-12T00:37:47.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.916+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=ZFITD16NFFXE tag=YXHKY7NX6QD3 type=write size=2618392 2024-09-12T00:37:47.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.917+0000 7fcd44281780 1 < completed write operation key=XRW0CRE12S5B tag=AQNFS6BLHYRP type=write size=560916 2024-09-12T00:37:47.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.919+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=915JREYR1T26 type=write size=391100 2024-09-12T00:37:47.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.920+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~FF4LYZOOPC91.0 size=1048576 2024-09-12T00:37:47.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.922+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~FF4LYZOOPC91.1 size=513767 2024-09-12T00:37:47.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.924+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=FF4LYZOOPC91 tag=F2HBKON9IOCG type=write size=2610919 2024-09-12T00:37:47.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.925+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=5PWYVP45QODF type=del size=2546813 2024-09-12T00:37:47.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.927+0000 7fcd44281780 1 < completed write operation key=AJ5AUTM2J9MT tag=Z8RLFRSCXB5N type=write size=21464 2024-09-12T00:37:47.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.928+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=XYZES6JFI8EV type=del size=2656547 2024-09-12T00:37:47.930 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.931+0000 7fcd44281780 1 < suggested remove operation key=7UCICX0GHHQ1 tag=KW61MEF9SMIE type=del 2024-09-12T00:37:47.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.934+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~4A00PP4P2X3B.0 size=1048576 2024-09-12T00:37:47.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.935+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~4A00PP4P2X3B.1 size=692572 2024-09-12T00:37:47.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.935+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=4A00PP4P2X3B tag=D199TN0CZYAV type=write size=2789724 2024-09-12T00:37:47.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.937+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~OW5F2IKKNDL7.0 size=1048576 2024-09-12T00:37:47.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.938+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~OW5F2IKKNDL7.1 size=1048576 2024-09-12T00:37:47.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.939+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~OW5F2IKKNDL7.2 size=486815 2024-09-12T00:37:47.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.941+0000 7fcd44281780 1 < completed multipart upload key=4RU6HTH4J0U1 upload=OW5F2IKKNDL7 tag=XEWEKVP7I3KO type=write size=3632543 2024-09-12T00:37:47.941 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.942+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=Z7DJ46R4S69W type=del size=100026 2024-09-12T00:37:47.942 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.943+0000 7fcd44281780 1 < canceled part key=_multipart_VXDTFEG8P23H.2~AS883EBR66Y8.0 size=1041079 2024-09-12T00:37:47.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.946+0000 7fcd44281780 1 < canceled multipart upload key=VXDTFEG8P23H upload=AS883EBR66Y8 tag=8KUPBB48OJHF type=write size=2089655 2024-09-12T00:37:47.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.949+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~HGM42L4MHFQ9.0 size=142022 2024-09-12T00:37:47.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.949+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=HGM42L4MHFQ9 tag=FRWHPE8P22MU type=write size=1190598 2024-09-12T00:37:47.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.950+0000 7fcd44281780 1 < completed write operation key=UWS056JN3IXO tag=1XDPLHKN8IB4 type=write size=783591 2024-09-12T00:37:47.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.951+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=Q7CROY8VDUY9 type=del size=875443 2024-09-12T00:37:47.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.954+0000 7fcd44281780 1 < suggested update operation key=AN6GRGZ22INA tag=6XZ6H13U8EXC type=del size=4016809 2024-09-12T00:37:47.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.957+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~JU37S89MJGP4.0 size=853774 2024-09-12T00:37:47.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.957+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=JU37S89MJGP4 tag=8BK3CTODZ6F4 type=write size=1902350 2024-09-12T00:37:47.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.959+0000 7fcd44281780 1 < canceled operation key=NIDHAXQF55WX tag=NH0Q5CNHTWSI type=del size=1253955 2024-09-12T00:37:47.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.960+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=WJ78TTMG8VXE type=del size=2670043 2024-09-12T00:37:47.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.962+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~QNULUIC4K1KB.0 size=742044 2024-09-12T00:37:47.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.964+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=QNULUIC4K1KB tag=7TATAC61GDQ2 type=write size=1790620 2024-09-12T00:37:47.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.965+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=KXF228REWK1V type=del size=3180527 2024-09-12T00:37:47.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.967+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=CS0MR79NVXGA type=del 2024-09-12T00:37:47.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.969+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=TJ35ZNPJD7E4 type=write size=103492 2024-09-12T00:37:47.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.970+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=MQWVE3K2T8Z7 type=del 2024-09-12T00:37:47.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.973+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~0VPDY1C0RV1F.0 size=238228 2024-09-12T00:37:47.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.973+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=0VPDY1C0RV1F tag=7F3GR3OYLMHU type=write size=1286804 2024-09-12T00:37:47.974 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.975+0000 7fcd44281780 1 < suggested remove operation key=WXBMIJ4FC0VX tag=SNQZQYWYP3DG type=write 2024-09-12T00:37:47.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.977+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=RRJUS9NCVMAD type=del size=717790 2024-09-12T00:37:47.977 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.978+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=EGZD00ZRLZQ5 type=del 2024-09-12T00:37:47.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.980+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=3DOYWWPU6I1U type=del size=930179 2024-09-12T00:37:47.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.981+0000 7fcd44281780 1 < canceled operation key=IK8POOY7ZWNF tag=2WY6MM6AFGQ3 type=del size=2850204 2024-09-12T00:37:47.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.983+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=DDS2PR1HT44D type=del size=2161141 2024-09-12T00:37:47.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.984+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~ZFITD16NFFXE.0 size=1048576 2024-09-12T00:37:47.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.986+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~ZFITD16NFFXE.1 size=521240 2024-09-12T00:37:47.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.988+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=ZFITD16NFFXE tag=YXHKY7NX6QD3 type=write size=2618392 2024-09-12T00:37:47.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.990+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=0K15FNMJ4D7B type=write size=1028721 2024-09-12T00:37:47.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.993+0000 7fcd44281780 1 < suggested update operation key=0ELZXPZCRPGP tag=915JREYR1T26 type=write size=391100 2024-09-12T00:37:47.993 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.994+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=TKLK7V28UHIK type=del size=2230850 2024-09-12T00:37:47.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.996+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=5PWYVP45QODF type=del 2024-09-12T00:37:47.998 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:47.999+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~ZGHYJT7X1LQI.0 size=1048576 2024-09-12T00:37:47.999 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.000+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~ZGHYJT7X1LQI.1 size=1048576 2024-09-12T00:37:48.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.001+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~ZGHYJT7X1LQI.2 size=467022 2024-09-12T00:37:48.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.001+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=ZGHYJT7X1LQI tag=HC9AFXCPOU57 type=write size=3612750 2024-09-12T00:37:48.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.002+0000 7fcd44281780 -1 < failed to complete operation key=0ELZXPZCRPGP tag=XYZES6JFI8EV type=del size=2656547: (22) Invalid argument 2024-09-12T00:37:48.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.005+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~4MYY2XUGP8RQ.0 size=1048576 2024-09-12T00:37:48.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.006+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~4MYY2XUGP8RQ.1 size=850014 2024-09-12T00:37:48.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.006+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=4MYY2XUGP8RQ tag=814F2B47C6OS type=write size=2947166 2024-09-12T00:37:48.007 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.008+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~4A00PP4P2X3B.0 size=1048576 2024-09-12T00:37:48.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.009+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~4A00PP4P2X3B.1 size=692572 2024-09-12T00:37:48.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.011+0000 7fcd44281780 1 < completed multipart upload key=526O814C10YW upload=4A00PP4P2X3B tag=D199TN0CZYAV type=write size=2789724 2024-09-12T00:37:48.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.014+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~0X6PAXW5SNBZ.0 size=1048576 2024-09-12T00:37:48.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.015+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~0X6PAXW5SNBZ.1 size=1048576 2024-09-12T00:37:48.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.016+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~0X6PAXW5SNBZ.2 size=294270 2024-09-12T00:37:48.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.016+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=0X6PAXW5SNBZ tag=M1PWIWAQ19YT type=write size=3439998 2024-09-12T00:37:48.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.018+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=Z7DJ46R4S69W type=del 2024-09-12T00:37:48.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.019+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=6EYDVC82HL72 type=del size=701891 2024-09-12T00:37:48.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.019+0000 7fcd44281780 1 < canceled part key=_multipart_AJ5AUTM2J9MT.2~HGM42L4MHFQ9.0 size=142022 2024-09-12T00:37:48.020 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.022+0000 7fcd44281780 1 < canceled multipart upload key=AJ5AUTM2J9MT upload=HGM42L4MHFQ9 tag=FRWHPE8P22MU type=write size=1190598 2024-09-12T00:37:48.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.023+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=218UETGQL1WD type=del size=436268 2024-09-12T00:37:48.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.025+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=Q7CROY8VDUY9 type=del 2024-09-12T00:37:48.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.026+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=5EW1BHPOLZDA type=write size=67310 2024-09-12T00:37:48.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.027+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~JU37S89MJGP4.0 size=853774 2024-09-12T00:37:48.028 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.029+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=JU37S89MJGP4 tag=8BK3CTODZ6F4 type=write size=1902350 2024-09-12T00:37:48.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.032+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~UTXQX2KLBNEA.0 size=1048576 2024-09-12T00:37:48.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.033+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~UTXQX2KLBNEA.1 size=1048576 2024-09-12T00:37:48.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.034+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~UTXQX2KLBNEA.2 size=53912 2024-09-12T00:37:48.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.034+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=UTXQX2KLBNEA tag=I6FXR7FO5JWA type=write size=3199640 2024-09-12T00:37:48.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.037+0000 7fcd44281780 1 < suggested remove operation key=VXDTFEG8P23H tag=WJ78TTMG8VXE type=del 2024-09-12T00:37:48.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.039+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=JPMDISVPIS9K type=del size=844945 2024-09-12T00:37:48.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.042+0000 7fcd44281780 1 < suggested update operation key=0OEDZ5O2LN8H tag=KXF228REWK1V type=del size=3180527 2024-09-12T00:37:48.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.043+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=BI4L30HCTWGJ type=del size=2389883 2024-09-12T00:37:48.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.045+0000 7fcd44281780 1 < completed write operation key=0AVE0W4OV1AU tag=TJ35ZNPJD7E4 type=write size=103492 2024-09-12T00:37:48.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.047+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=4U5Q62Y9Z6OX type=del size=441568 2024-09-12T00:37:48.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.048+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~0VPDY1C0RV1F.0 size=238228 2024-09-12T00:37:48.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.050+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=0VPDY1C0RV1F tag=7F3GR3OYLMHU type=write size=1286804 2024-09-12T00:37:48.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.052+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=6ICARGI79XJI type=write size=145914 2024-09-12T00:37:48.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.053+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=RRJUS9NCVMAD type=del 2024-09-12T00:37:48.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.055+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~3OXV1SWZ3JOP.0 size=1048576 2024-09-12T00:37:48.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.057+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~3OXV1SWZ3JOP.1 size=1048576 2024-09-12T00:37:48.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.058+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~3OXV1SWZ3JOP.2 size=332068 2024-09-12T00:37:48.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.058+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=3OXV1SWZ3JOP tag=G7QS7YYZL2SK type=write size=3477796 2024-09-12T00:37:48.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.059+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=3DOYWWPU6I1U type=del 2024-09-12T00:37:48.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.061+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=VFZXBGOJOSSV type=del size=3153138 2024-09-12T00:37:48.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.063+0000 7fcd44281780 1 < suggested remove operation key=Z6I6598B6J5I tag=DDS2PR1HT44D type=del 2024-09-12T00:37:48.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.065+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=NQIXWJRP8M5C type=del size=3877598 2024-09-12T00:37:48.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.066+0000 7fcd44281780 1 < completed write operation key=XRW0CRE12S5B tag=0K15FNMJ4D7B type=write size=1028721 2024-09-12T00:37:48.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.069+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~C8H9J6DCU66N.0 size=175282 2024-09-12T00:37:48.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.069+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=C8H9J6DCU66N tag=0J8GM4BY82P2 type=write size=1223858 2024-09-12T00:37:48.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.070+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=TKLK7V28UHIK type=del 2024-09-12T00:37:48.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.072+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~YWPXF51UAE52.0 size=973685 2024-09-12T00:37:48.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.072+0000 7fcd44281780 1 > prepared multipart upload key=U4EPPPA4QGGD upload=YWPXF51UAE52 tag=WO4J45M0I6TW type=write size=2022261 2024-09-12T00:37:48.073 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.074+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~ZGHYJT7X1LQI.0 size=1048576 2024-09-12T00:37:48.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.075+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~ZGHYJT7X1LQI.1 size=1048576 2024-09-12T00:37:48.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.076+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~ZGHYJT7X1LQI.2 size=467022 2024-09-12T00:37:48.077 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.079+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=ZGHYJT7X1LQI tag=HC9AFXCPOU57 type=write size=3612750 2024-09-12T00:37:48.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.081+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~XGIEBS3LV9DA.0 size=1048576 2024-09-12T00:37:48.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.082+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~XGIEBS3LV9DA.1 size=27754 2024-09-12T00:37:48.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.082+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=XGIEBS3LV9DA tag=NUTXFDB9T876 type=write size=2124906 2024-09-12T00:37:48.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.083+0000 7fcd44281780 1 < canceled part key=_multipart_Z6I6598B6J5I.2~4MYY2XUGP8RQ.0 size=1048576 2024-09-12T00:37:48.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.083+0000 7fcd44281780 1 < canceled part key=_multipart_Z6I6598B6J5I.2~4MYY2XUGP8RQ.1 size=850014 2024-09-12T00:37:48.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.085+0000 7fcd44281780 1 < canceled multipart upload key=Z6I6598B6J5I upload=4MYY2XUGP8RQ tag=814F2B47C6OS type=write size=2947166 2024-09-12T00:37:48.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.086+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=T3WMQ31Y5D82 type=del size=1862955 2024-09-12T00:37:48.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.088+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~0X6PAXW5SNBZ.0 size=1048576 2024-09-12T00:37:48.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.089+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~0X6PAXW5SNBZ.1 size=1048576 2024-09-12T00:37:48.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.090+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~0X6PAXW5SNBZ.2 size=294270 2024-09-12T00:37:48.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.093+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=0X6PAXW5SNBZ tag=M1PWIWAQ19YT type=write size=3439998 2024-09-12T00:37:48.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.094+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=N2UAIEMO8JL6 type=write size=958415 2024-09-12T00:37:48.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.095+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=6EYDVC82HL72 type=del 2024-09-12T00:37:48.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.098+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~25C43OWNCTJV.0 size=795931 2024-09-12T00:37:48.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.098+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=25C43OWNCTJV tag=I2CO6W9C61YU type=write size=1844507 2024-09-12T00:37:48.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.100+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=218UETGQL1WD type=del 2024-09-12T00:37:48.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.102+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=0CTQXLSKV5K9 type=del size=3312922 2024-09-12T00:37:48.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.104+0000 7fcd44281780 1 < suggested remove operation key=QVULC3H9QGXE tag=5EW1BHPOLZDA type=write 2024-09-12T00:37:48.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.107+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~BTAKCO97Q0VY.0 size=1048576 2024-09-12T00:37:48.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.108+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~BTAKCO97Q0VY.1 size=1048576 2024-09-12T00:37:48.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.109+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~BTAKCO97Q0VY.2 size=291160 2024-09-12T00:37:48.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.109+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=BTAKCO97Q0VY tag=SPIDUAHDEE0L type=write size=3436888 2024-09-12T00:37:48.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.110+0000 7fcd44281780 1 < canceled part key=_multipart_UXY6K0AVI4EK.2~UTXQX2KLBNEA.0 size=1048576 2024-09-12T00:37:48.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.110+0000 7fcd44281780 1 < canceled part key=_multipart_UXY6K0AVI4EK.2~UTXQX2KLBNEA.1 size=1048576 2024-09-12T00:37:48.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.110+0000 7fcd44281780 1 < canceled part key=_multipart_UXY6K0AVI4EK.2~UTXQX2KLBNEA.2 size=53912 2024-09-12T00:37:48.110 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.112+0000 7fcd44281780 1 < canceled multipart upload key=UXY6K0AVI4EK upload=UTXQX2KLBNEA tag=I6FXR7FO5JWA type=write size=3199640 2024-09-12T00:37:48.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.113+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=HMLFG611PRO8 type=del size=2369157 2024-09-12T00:37:48.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.114+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=JPMDISVPIS9K type=del 2024-09-12T00:37:48.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.117+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~J5KF1VEWMQYB.0 size=472982 2024-09-12T00:37:48.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.117+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=J5KF1VEWMQYB tag=ONS65VV6LG1Y type=write size=1521558 2024-09-12T00:37:48.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.120+0000 7fcd44281780 1 < suggested update operation key=XRW0CRE12S5B tag=BI4L30HCTWGJ type=del size=2389883 2024-09-12T00:37:48.121 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.122+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~M717Q8IZJUJG.0 size=476156 2024-09-12T00:37:48.121 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.122+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=M717Q8IZJUJG tag=QEG2UBPN9FLE type=write size=1524732 2024-09-12T00:37:48.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.124+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=4U5Q62Y9Z6OX type=del 2024-09-12T00:37:48.124 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.125+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=X7ICDNK9VWPS type=del size=1028245 2024-09-12T00:37:48.126 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.128+0000 7fcd44281780 1 < suggested remove operation key=XTNXNF3D0HFK tag=6ICARGI79XJI type=write 2024-09-12T00:37:48.128 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.129+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=X70P52NCJ0PN type=del size=1135804 2024-09-12T00:37:48.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.131+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~3OXV1SWZ3JOP.0 size=1048576 2024-09-12T00:37:48.131 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.132+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~3OXV1SWZ3JOP.1 size=1048576 2024-09-12T00:37:48.132 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.133+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~3OXV1SWZ3JOP.2 size=332068 2024-09-12T00:37:48.134 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.135+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=3OXV1SWZ3JOP tag=G7QS7YYZL2SK type=write size=3477796 2024-09-12T00:37:48.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.138+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~FEL8LD22I97I.0 size=191319 2024-09-12T00:37:48.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.138+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=FEL8LD22I97I tag=WJI45733VBOS type=write size=1239895 2024-09-12T00:37:48.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.139+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=VFZXBGOJOSSV type=del 2024-09-12T00:37:48.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.142+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~0S14INO9K4LH.0 size=1048576 2024-09-12T00:37:48.141 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.143+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~0S14INO9K4LH.1 size=287985 2024-09-12T00:37:48.141 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.143+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=0S14INO9K4LH tag=8SMPVCB1MO1Q type=write size=2385137 2024-09-12T00:37:48.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.144+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=NQIXWJRP8M5C type=del 2024-09-12T00:37:48.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.145+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=I2FV5TRF1712 type=write size=605168 2024-09-12T00:37:48.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.147+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~C8H9J6DCU66N.0 size=175282 2024-09-12T00:37:48.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.149+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=C8H9J6DCU66N tag=0J8GM4BY82P2 type=write size=1223858 2024-09-12T00:37:48.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.150+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=VVX8LC3D2EL5 type=del size=1992892 2024-09-12T00:37:48.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.152+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~YWPXF51UAE52.0 size=973685 2024-09-12T00:37:48.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.154+0000 7fcd44281780 1 < completed multipart upload key=U4EPPPA4QGGD upload=YWPXF51UAE52 tag=WO4J45M0I6TW type=write size=2022261 2024-09-12T00:37:48.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.157+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~081ODC0BN0MM.0 size=1048576 2024-09-12T00:37:48.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.158+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~081ODC0BN0MM.1 size=571662 2024-09-12T00:37:48.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.158+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=081ODC0BN0MM tag=3KVHT48OYFIT type=write size=2668814 2024-09-12T00:37:48.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.161+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~XGIEBS3LV9DA.0 size=1048576 2024-09-12T00:37:48.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.162+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~XGIEBS3LV9DA.1 size=27754 2024-09-12T00:37:48.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.164+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=XGIEBS3LV9DA tag=NUTXFDB9T876 type=write size=2124906 2024-09-12T00:37:48.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.166+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=FSTF3P2CREV9 type=del size=3268933 2024-09-12T00:37:48.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.167+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=T3WMQ31Y5D82 type=del 2024-09-12T00:37:48.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.170+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~P5JYBKF1O0CE.0 size=1048576 2024-09-12T00:37:48.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.171+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~P5JYBKF1O0CE.1 size=1048576 2024-09-12T00:37:48.173 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.172+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~P5JYBKF1O0CE.2 size=205486 2024-09-12T00:37:48.173 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.172+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=P5JYBKF1O0CE tag=UTUWO5IUK2GL type=write size=3351214 2024-09-12T00:37:48.173 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.173+0000 7fcd44281780 1 < completed write operation key=526O814C10YW tag=N2UAIEMO8JL6 type=write size=958415 2024-09-12T00:37:48.175 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.176+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~S8SCG5ZCRTKL.0 size=1048576 2024-09-12T00:37:48.176 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.177+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~S8SCG5ZCRTKL.1 size=751257 2024-09-12T00:37:48.176 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.177+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=S8SCG5ZCRTKL tag=YWM2Y6J2YKZM type=write size=2848409 2024-09-12T00:37:48.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.178+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~25C43OWNCTJV.0 size=795931 2024-09-12T00:37:48.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.180+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=25C43OWNCTJV tag=I2CO6W9C61YU type=write size=1844507 2024-09-12T00:37:48.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.182+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=4G9Z3TCG9FKZ type=del size=3861272 2024-09-12T00:37:48.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.184+0000 7fcd44281780 1 < suggested remove operation key=WXBMIJ4FC0VX tag=0CTQXLSKV5K9 type=del 2024-09-12T00:37:48.185 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.186+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=RZESIMD5UYWC type=del size=1715971 2024-09-12T00:37:48.186 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.187+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~BTAKCO97Q0VY.0 size=1048576 2024-09-12T00:37:48.187 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.188+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~BTAKCO97Q0VY.1 size=1048576 2024-09-12T00:37:48.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.189+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~BTAKCO97Q0VY.2 size=291160 2024-09-12T00:37:48.190 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.192+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=BTAKCO97Q0VY tag=SPIDUAHDEE0L type=write size=3436888 2024-09-12T00:37:48.192 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.193+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=QBSAE23XOZZO type=del size=1010573 2024-09-12T00:37:48.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.195+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=HMLFG611PRO8 type=del 2024-09-12T00:37:48.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.196+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=0GZF2E3V2K8X type=del size=1007182 2024-09-12T00:37:48.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.198+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~J5KF1VEWMQYB.0 size=472982 2024-09-12T00:37:48.199 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.200+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=J5KF1VEWMQYB tag=ONS65VV6LG1Y type=write size=1521558 2024-09-12T00:37:48.200 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.201+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=0UK6C6I848A6 type=del size=3372389 2024-09-12T00:37:48.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.203+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~M717Q8IZJUJG.0 size=476156 2024-09-12T00:37:48.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.205+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=M717Q8IZJUJG tag=QEG2UBPN9FLE type=write size=1524732 2024-09-12T00:37:48.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.207+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=C1UDNOTY23CF type=del size=1934039 2024-09-12T00:37:48.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.208+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=X7ICDNK9VWPS type=del 2024-09-12T00:37:48.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.211+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~ABDWLK41RQ8S.0 size=925261 2024-09-12T00:37:48.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.211+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=ABDWLK41RQ8S tag=ECMCA0TLR2HR type=write size=1973837 2024-09-12T00:37:48.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.212+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=X70P52NCJ0PN type=del 2024-09-12T00:37:48.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.214+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=HB4BCCVHNO35 type=del size=184389 2024-09-12T00:37:48.215 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.215+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~FEL8LD22I97I.0 size=191319 2024-09-12T00:37:48.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.218+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=FEL8LD22I97I tag=WJI45733VBOS type=write size=1239895 2024-09-12T00:37:48.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.219+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=TONUCJWYV7KD type=del size=928857 2024-09-12T00:37:48.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.221+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~0S14INO9K4LH.0 size=1048576 2024-09-12T00:37:48.220 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.222+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~0S14INO9K4LH.1 size=287985 2024-09-12T00:37:48.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.224+0000 7fcd44281780 1 < completed multipart upload key=0AVE0W4OV1AU upload=0S14INO9K4LH tag=8SMPVCB1MO1Q type=write size=2385137 2024-09-12T00:37:48.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.225+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=06QRICY0DBUW type=write size=958915 2024-09-12T00:37:48.225 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.227+0000 7fcd44281780 1 < completed write operation key=526O814C10YW tag=I2FV5TRF1712 type=write size=605168 2024-09-12T00:37:48.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.229+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~60X5TQFGMFHY.0 size=1048576 2024-09-12T00:37:48.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.230+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~60X5TQFGMFHY.1 size=82280 2024-09-12T00:37:48.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.230+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=60X5TQFGMFHY tag=RLZ6Q35OYFIU type=write size=2179432 2024-09-12T00:37:48.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.235+0000 7fcd44281780 1 < suggested update operation key=UWS056JN3IXO tag=VVX8LC3D2EL5 type=del size=1992892 2024-09-12T00:37:48.235 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.236+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=V5QXFGAEGY0A type=del size=1762906 2024-09-12T00:37:48.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.237+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~081ODC0BN0MM.0 size=1048576 2024-09-12T00:37:48.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.239+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~081ODC0BN0MM.1 size=571662 2024-09-12T00:37:48.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.241+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=081ODC0BN0MM tag=3KVHT48OYFIT type=write size=2668814 2024-09-12T00:37:48.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.243+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~GJ7FXTIZ0J8D.0 size=985721 2024-09-12T00:37:48.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.243+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=GJ7FXTIZ0J8D tag=282B0AP915FX type=write size=2034297 2024-09-12T00:37:48.244 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.245+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=FSTF3P2CREV9 type=del 2024-09-12T00:37:48.245 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.246+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=4KKHFIYAA41H type=del size=3025495 2024-09-12T00:37:48.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.248+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~P5JYBKF1O0CE.0 size=1048576 2024-09-12T00:37:48.248 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.249+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~P5JYBKF1O0CE.1 size=1048576 2024-09-12T00:37:48.248 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.249+0000 7fcd44281780 1 < canceled part key=_multipart_QVULC3H9QGXE.2~P5JYBKF1O0CE.2 size=205486 2024-09-12T00:37:48.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.251+0000 7fcd44281780 1 < canceled multipart upload key=QVULC3H9QGXE upload=P5JYBKF1O0CE tag=UTUWO5IUK2GL type=write size=3351214 2024-09-12T00:37:48.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.252+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=GMIK8J5TYP1I type=del size=495103 2024-09-12T00:37:48.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.253+0000 7fcd44281780 1 < canceled part key=_multipart_QVULC3H9QGXE.2~S8SCG5ZCRTKL.0 size=1048576 2024-09-12T00:37:48.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.254+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~S8SCG5ZCRTKL.1 size=751257 2024-09-12T00:37:48.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.256+0000 7fcd44281780 1 < canceled multipart upload key=QVULC3H9QGXE upload=S8SCG5ZCRTKL tag=YWM2Y6J2YKZM type=write size=2848409 2024-09-12T00:37:48.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.257+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=G09AB9Y7DWOM type=del size=307454 2024-09-12T00:37:48.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.258+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=4G9Z3TCG9FKZ type=del 2024-09-12T00:37:48.260 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.261+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~6MD0EV2JOOS2.0 size=71401 2024-09-12T00:37:48.260 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.261+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=6MD0EV2JOOS2 tag=1CO1FWWCMB29 type=write size=1119977 2024-09-12T00:37:48.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.262+0000 7fcd44281780 1 < canceled operation key=0O62FO4WVZG6 tag=RZESIMD5UYWC type=del size=1715971 2024-09-12T00:37:48.263 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.265+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~UON57UZ4R0L2.0 size=1048576 2024-09-12T00:37:48.265 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.266+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~UON57UZ4R0L2.1 size=1048576 2024-09-12T00:37:48.266 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.267+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~UON57UZ4R0L2.2 size=870246 2024-09-12T00:37:48.266 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.267+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=UON57UZ4R0L2 tag=6JFXTOS4JN54 type=write size=4015974 2024-09-12T00:37:48.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.268+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=QBSAE23XOZZO type=del 2024-09-12T00:37:48.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.270+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=9RTUPXM5AEG5 type=del size=96760 2024-09-12T00:37:48.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.271+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=0GZF2E3V2K8X type=del 2024-09-12T00:37:48.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.272+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=XKXVVJQBVQMX type=del size=1051497 2024-09-12T00:37:48.274 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.275+0000 7fcd44281780 1 < suggested remove operation key=0O62FO4WVZG6 tag=0UK6C6I848A6 type=del 2024-09-12T00:37:48.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.278+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~J98ERAJ7DSF9.0 size=1048576 2024-09-12T00:37:48.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.279+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~J98ERAJ7DSF9.1 size=1048576 2024-09-12T00:37:48.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.280+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~J98ERAJ7DSF9.2 size=559259 2024-09-12T00:37:48.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.280+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=J98ERAJ7DSF9 tag=3IF91EIZIZ96 type=write size=3704987 2024-09-12T00:37:48.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.282+0000 7fcd44281780 1 < suggested remove operation key=AJ5AUTM2J9MT tag=C1UDNOTY23CF type=del 2024-09-12T00:37:48.283 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.285+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~XWI0NQYSDOGW.0 size=1048576 2024-09-12T00:37:48.284 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.286+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~XWI0NQYSDOGW.1 size=814760 2024-09-12T00:37:48.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.286+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=XWI0NQYSDOGW tag=ZECC0YN84TSF type=write size=2911912 2024-09-12T00:37:48.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.287+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~ABDWLK41RQ8S.0 size=925261 2024-09-12T00:37:48.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.289+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=ABDWLK41RQ8S tag=ECMCA0TLR2HR type=write size=1973837 2024-09-12T00:37:48.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.292+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~P5V7GTTFL5Z4.0 size=1048576 2024-09-12T00:37:48.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.293+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~P5V7GTTFL5Z4.1 size=745595 2024-09-12T00:37:48.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.293+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=P5V7GTTFL5Z4 tag=FBIEYESOWP2F type=write size=2842747 2024-09-12T00:37:48.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.294+0000 7fcd44281780 1 < completed delete operation key=8U004LC8IYLQ tag=HB4BCCVHNO35 type=del 2024-09-12T00:37:48.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.296+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=0HW9S9QG6H2Q type=del size=1275170 2024-09-12T00:37:48.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.298+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=TONUCJWYV7KD type=del 2024-09-12T00:37:48.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.300+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~PWPQGSF7EB8R.0 size=1048576 2024-09-12T00:37:48.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.301+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~PWPQGSF7EB8R.1 size=723562 2024-09-12T00:37:48.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.301+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=PWPQGSF7EB8R tag=AZRL0VFTU00F type=write size=2820714 2024-09-12T00:37:48.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.303+0000 7fcd44281780 1 < completed write operation key=0ELZXPZCRPGP tag=06QRICY0DBUW type=write size=958915 2024-09-12T00:37:48.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.304+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=MSU3MO1I9OY3 type=del size=361220 2024-09-12T00:37:48.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.306+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~60X5TQFGMFHY.0 size=1048576 2024-09-12T00:37:48.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.307+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~60X5TQFGMFHY.1 size=82280 2024-09-12T00:37:48.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.309+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=60X5TQFGMFHY tag=RLZ6Q35OYFIU type=write size=2179432 2024-09-12T00:37:48.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.312+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~8VNM1SRAGPN1.0 size=105266 2024-09-12T00:37:48.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.312+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=8VNM1SRAGPN1 tag=T6SO6B5ZMRZW type=write size=1153842 2024-09-12T00:37:48.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.313+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=V5QXFGAEGY0A type=del 2024-09-12T00:37:48.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.316+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~VBI5KR2D3LSP.0 size=1048576 2024-09-12T00:37:48.316 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.318+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~VBI5KR2D3LSP.1 size=1048576 2024-09-12T00:37:48.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.319+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~VBI5KR2D3LSP.2 size=651029 2024-09-12T00:37:48.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.319+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=VBI5KR2D3LSP tag=FZNLJUAXE85P type=write size=3796757 2024-09-12T00:37:48.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.320+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~GJ7FXTIZ0J8D.0 size=985721 2024-09-12T00:37:48.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.323+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=GJ7FXTIZ0J8D tag=282B0AP915FX type=write size=2034297 2024-09-12T00:37:48.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.324+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=O0587WS7DHAD type=del size=112650 2024-09-12T00:37:48.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.326+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=4KKHFIYAA41H type=del 2024-09-12T00:37:48.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.328+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~ZZXDV4WDD120.0 size=1048576 2024-09-12T00:37:48.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.329+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~ZZXDV4WDD120.1 size=516018 2024-09-12T00:37:48.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.329+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=ZZXDV4WDD120 tag=2E3PU5LP1TBY type=write size=2613170 2024-09-12T00:37:48.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.331+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=GMIK8J5TYP1I type=del 2024-09-12T00:37:48.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.332+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=HL1S8GMIIHZM type=del size=3280702 2024-09-12T00:37:48.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.333+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=G09AB9Y7DWOM type=del 2024-09-12T00:37:48.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.336+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~SI8HJZWLZDLZ.0 size=1048576 2024-09-12T00:37:48.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.337+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~SI8HJZWLZDLZ.1 size=486498 2024-09-12T00:37:48.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.337+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=SI8HJZWLZDLZ tag=S6UPHTDCR6CS type=write size=2583650 2024-09-12T00:37:48.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.338+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~6MD0EV2JOOS2.0 size=71401 2024-09-12T00:37:48.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.341+0000 7fcd44281780 1 < completed multipart upload key=B5OH55MQGSGJ upload=6MD0EV2JOOS2 tag=1CO1FWWCMB29 type=write size=1119977 2024-09-12T00:37:48.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.342+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=RSPLL1TW8TWM type=write size=661901 2024-09-12T00:37:48.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.343+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~UON57UZ4R0L2.0 size=1048576 2024-09-12T00:37:48.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.344+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~UON57UZ4R0L2.1 size=1048576 2024-09-12T00:37:48.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.346+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~UON57UZ4R0L2.2 size=870246 2024-09-12T00:37:48.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.348+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=UON57UZ4R0L2 tag=6JFXTOS4JN54 type=write size=4015974 2024-09-12T00:37:48.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.351+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~NDYH2ARKSXVT.0 size=1048576 2024-09-12T00:37:48.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.352+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~NDYH2ARKSXVT.1 size=1048576 2024-09-12T00:37:48.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.353+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~NDYH2ARKSXVT.2 size=342951 2024-09-12T00:37:48.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.353+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=NDYH2ARKSXVT tag=DBY35D10W755 type=write size=3488679 2024-09-12T00:37:48.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.356+0000 7fcd44281780 1 < suggested update operation key=CF7B7J3V1YFG tag=9RTUPXM5AEG5 type=del size=96760 2024-09-12T00:37:48.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.357+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=0BKD8U4WH6E8 type=del size=55511 2024-09-12T00:37:48.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.359+0000 7fcd44281780 1 < canceled operation key=QVULC3H9QGXE tag=XKXVVJQBVQMX type=del size=1051497 2024-09-12T00:37:48.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.363+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~4C81H3R1T1D2.0 size=1048576 2024-09-12T00:37:48.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.364+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~4C81H3R1T1D2.1 size=34168 2024-09-12T00:37:48.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.364+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=4C81H3R1T1D2 tag=V6765GVP5W03 type=write size=2131320 2024-09-12T00:37:48.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.365+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~J98ERAJ7DSF9.0 size=1048576 2024-09-12T00:37:48.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.366+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~J98ERAJ7DSF9.1 size=1048576 2024-09-12T00:37:48.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.367+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~J98ERAJ7DSF9.2 size=559259 2024-09-12T00:37:48.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.370+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=J98ERAJ7DSF9 tag=3IF91EIZIZ96 type=write size=3704987 2024-09-12T00:37:48.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.371+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=1W5U7BA58HL5 type=del size=653689 2024-09-12T00:37:48.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.373+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~XWI0NQYSDOGW.0 size=1048576 2024-09-12T00:37:48.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.374+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~XWI0NQYSDOGW.1 size=814760 2024-09-12T00:37:48.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.376+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=XWI0NQYSDOGW tag=ZECC0YN84TSF type=write size=2911912 2024-09-12T00:37:48.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.378+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=W6P3D10C4GX2 type=del size=360729 2024-09-12T00:37:48.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.379+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~P5V7GTTFL5Z4.0 size=1048576 2024-09-12T00:37:48.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.380+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~P5V7GTTFL5Z4.1 size=745595 2024-09-12T00:37:48.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.383+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=P5V7GTTFL5Z4 tag=FBIEYESOWP2F type=write size=2842747 2024-09-12T00:37:48.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.384+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=G887WTQU7RK4 type=del size=2494928 2024-09-12T00:37:48.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.385+0000 7fcd44281780 1 < completed delete operation key=4RU6HTH4J0U1 tag=0HW9S9QG6H2Q type=del 2024-09-12T00:37:48.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.388+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~1IUTCA0L8TOZ.0 size=1048576 2024-09-12T00:37:48.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.389+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~1IUTCA0L8TOZ.1 size=647504 2024-09-12T00:37:48.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.389+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=1IUTCA0L8TOZ tag=M40PJYZT7K31 type=write size=2744656 2024-09-12T00:37:48.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.391+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~PWPQGSF7EB8R.0 size=1048576 2024-09-12T00:37:48.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.392+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~PWPQGSF7EB8R.1 size=723562 2024-09-12T00:37:48.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.394+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=PWPQGSF7EB8R tag=AZRL0VFTU00F type=write size=2820714 2024-09-12T00:37:48.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.395+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=1E9DVZHPSHF9 type=del size=1497652 2024-09-12T00:37:48.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.397+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=MSU3MO1I9OY3 type=del 2024-09-12T00:37:48.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.398+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=63YM5ESRVNHD type=del size=3629194 2024-09-12T00:37:48.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.399+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~8VNM1SRAGPN1.0 size=105266 2024-09-12T00:37:48.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.402+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=8VNM1SRAGPN1 tag=T6SO6B5ZMRZW type=write size=1153842 2024-09-12T00:37:48.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.403+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=L7W5RAYTFBCV type=del size=3700543 2024-09-12T00:37:48.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.405+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~VBI5KR2D3LSP.0 size=1048576 2024-09-12T00:37:48.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.406+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~VBI5KR2D3LSP.1 size=1048576 2024-09-12T00:37:48.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.407+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~VBI5KR2D3LSP.2 size=651029 2024-09-12T00:37:48.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.409+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=VBI5KR2D3LSP tag=FZNLJUAXE85P type=write size=3796757 2024-09-12T00:37:48.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.411+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=LS3YGN1SBIHQ type=del size=817136 2024-09-12T00:37:48.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.412+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=O0587WS7DHAD type=del 2024-09-12T00:37:48.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.415+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~7IB51D0KX0R0.0 size=1048576 2024-09-12T00:37:48.414 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.416+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~7IB51D0KX0R0.1 size=328258 2024-09-12T00:37:48.415 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.416+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=7IB51D0KX0R0 tag=PE83WOD04EP8 type=write size=2425410 2024-09-12T00:37:48.416 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.417+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~ZZXDV4WDD120.0 size=1048576 2024-09-12T00:37:48.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.418+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~ZZXDV4WDD120.1 size=516018 2024-09-12T00:37:48.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.421+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=ZZXDV4WDD120 tag=2E3PU5LP1TBY type=write size=2613170 2024-09-12T00:37:48.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.422+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=FO5XQPDD89X8 type=del size=81106 2024-09-12T00:37:48.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.423+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=HL1S8GMIIHZM type=del 2024-09-12T00:37:48.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.426+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~4Z9Z9SMORXPN.0 size=1048576 2024-09-12T00:37:48.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.427+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~4Z9Z9SMORXPN.1 size=1048576 2024-09-12T00:37:48.427 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.428+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~4Z9Z9SMORXPN.2 size=626891 2024-09-12T00:37:48.427 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.428+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=4Z9Z9SMORXPN tag=MZK2Z8J4TAP3 type=write size=3772619 2024-09-12T00:37:48.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.430+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~SI8HJZWLZDLZ.0 size=1048576 2024-09-12T00:37:48.430 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.431+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~SI8HJZWLZDLZ.1 size=486498 2024-09-12T00:37:48.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.433+0000 7fcd44281780 1 < completed multipart upload key=0AVE0W4OV1AU upload=SI8HJZWLZDLZ tag=S6UPHTDCR6CS type=write size=2583650 2024-09-12T00:37:48.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.435+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=UQ9208SB3NT8 type=del size=346785 2024-09-12T00:37:48.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.436+0000 7fcd44281780 1 < completed write operation key=QVULC3H9QGXE tag=RSPLL1TW8TWM type=write size=661901 2024-09-12T00:37:48.437 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.439+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~HV0G09L26KZZ.0 size=1048576 2024-09-12T00:37:48.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.440+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~HV0G09L26KZZ.1 size=1048576 2024-09-12T00:37:48.439 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.441+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~HV0G09L26KZZ.2 size=273904 2024-09-12T00:37:48.439 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.441+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=HV0G09L26KZZ tag=2YHZK5Y5DT5H type=write size=3419632 2024-09-12T00:37:48.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.441+0000 7fcd44281780 1 < canceled part key=_multipart_RYSE2CKE5IRT.2~NDYH2ARKSXVT.0 size=1048576 2024-09-12T00:37:48.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.442+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~NDYH2ARKSXVT.1 size=1048576 2024-09-12T00:37:48.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.443+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~NDYH2ARKSXVT.2 size=342951 2024-09-12T00:37:48.444 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.446+0000 7fcd44281780 1 < canceled multipart upload key=RYSE2CKE5IRT upload=NDYH2ARKSXVT tag=DBY35D10W755 type=write size=3488679 2024-09-12T00:37:48.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.447+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=V6BHEZ8H11J6 type=del size=2191794 2024-09-12T00:37:48.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.448+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=0BKD8U4WH6E8 type=del 2024-09-12T00:37:48.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.450+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=Y2RON43IOYH9 type=del size=2287344 2024-09-12T00:37:48.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.451+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~4C81H3R1T1D2.0 size=1048576 2024-09-12T00:37:48.451 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.452+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~4C81H3R1T1D2.1 size=34168 2024-09-12T00:37:48.453 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.455+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=4C81H3R1T1D2 tag=V6765GVP5W03 type=write size=2131320 2024-09-12T00:37:48.455 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.456+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=RK208LWEGYRP type=del size=813978 2024-09-12T00:37:48.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.458+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=1W5U7BA58HL5 type=del 2024-09-12T00:37:48.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.459+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=KQ2FWH25KDJ9 type=del size=3862692 2024-09-12T00:37:48.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.461+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=W6P3D10C4GX2 type=del 2024-09-12T00:37:48.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.464+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~12BG8EF28CG1.0 size=166430 2024-09-12T00:37:48.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.464+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=12BG8EF28CG1 tag=KN3CU1Z30FSH type=write size=1215006 2024-09-12T00:37:48.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.466+0000 7fcd44281780 1 < suggested update operation key=7UCICX0GHHQ1 tag=G887WTQU7RK4 type=del size=2494928 2024-09-12T00:37:48.468 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.469+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~326R6V2WK1X2.0 size=1048576 2024-09-12T00:37:48.468 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.470+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~326R6V2WK1X2.1 size=815533 2024-09-12T00:37:48.468 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.470+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=326R6V2WK1X2 tag=PU5AFPK41X01 type=write size=2912685 2024-09-12T00:37:48.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.471+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~1IUTCA0L8TOZ.0 size=1048576 2024-09-12T00:37:48.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.472+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~1IUTCA0L8TOZ.1 size=647504 2024-09-12T00:37:48.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.475+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=1IUTCA0L8TOZ tag=M40PJYZT7K31 type=write size=2744656 2024-09-12T00:37:48.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.476+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=MHKNQ8WMOGH0 type=del size=1452001 2024-09-12T00:37:48.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.477+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=1E9DVZHPSHF9 type=del 2024-09-12T00:37:48.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.480+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~FMAZ50RH0GG4.0 size=217871 2024-09-12T00:37:48.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.480+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=FMAZ50RH0GG4 tag=MVMKJNM6VREM type=write size=1266447 2024-09-12T00:37:48.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.481+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=63YM5ESRVNHD type=del 2024-09-12T00:37:48.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.483+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=773BLHZ84XYU type=write size=1016567 2024-09-12T00:37:48.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.485+0000 7fcd44281780 1 < completed delete operation key=8U004LC8IYLQ tag=L7W5RAYTFBCV type=del 2024-09-12T00:37:48.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.488+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~6RTEDTJ1R4KS.0 size=1048576 2024-09-12T00:37:48.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.489+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~6RTEDTJ1R4KS.1 size=587812 2024-09-12T00:37:48.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.489+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=6RTEDTJ1R4KS tag=GGAWGBHCX84N type=write size=2684964 2024-09-12T00:37:48.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.490+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=LS3YGN1SBIHQ type=del 2024-09-12T00:37:48.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.494+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~RU0TKBFJTOMN.0 size=1048576 2024-09-12T00:37:48.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.495+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~RU0TKBFJTOMN.1 size=1048576 2024-09-12T00:37:48.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.496+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~RU0TKBFJTOMN.2 size=627074 2024-09-12T00:37:48.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.496+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=RU0TKBFJTOMN tag=QEDMA5WH9RWF type=write size=3772802 2024-09-12T00:37:48.497 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.498+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~7IB51D0KX0R0.0 size=1048576 2024-09-12T00:37:48.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.499+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~7IB51D0KX0R0.1 size=328258 2024-09-12T00:37:48.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.502+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=7IB51D0KX0R0 tag=PE83WOD04EP8 type=write size=2425410 2024-09-12T00:37:48.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.504+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=861BC9QU7M6G type=del size=3131672 2024-09-12T00:37:48.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.505+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=FO5XQPDD89X8 type=del 2024-09-12T00:37:48.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.507+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=2MJQS4JB5SW0 type=del size=3607900 2024-09-12T00:37:48.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.508+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~4Z9Z9SMORXPN.0 size=1048576 2024-09-12T00:37:48.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.509+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~4Z9Z9SMORXPN.1 size=1048576 2024-09-12T00:37:48.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.511+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~4Z9Z9SMORXPN.2 size=626891 2024-09-12T00:37:48.512 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.513+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=4Z9Z9SMORXPN tag=MZK2Z8J4TAP3 type=write size=3772619 2024-09-12T00:37:48.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.514+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=BEHBTF788X18 type=del size=3695780 2024-09-12T00:37:48.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.516+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=UQ9208SB3NT8 type=del 2024-09-12T00:37:48.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.518+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=08ME4S91MUPA type=del size=3748764 2024-09-12T00:37:48.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.519+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~HV0G09L26KZZ.0 size=1048576 2024-09-12T00:37:48.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.520+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~HV0G09L26KZZ.1 size=1048576 2024-09-12T00:37:48.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.521+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~HV0G09L26KZZ.2 size=273904 2024-09-12T00:37:48.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.523+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=HV0G09L26KZZ tag=2YHZK5Y5DT5H type=write size=3419632 2024-09-12T00:37:48.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.526+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~QD9H9EB11SW3.0 size=1048576 2024-09-12T00:37:48.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.527+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~QD9H9EB11SW3.1 size=1048576 2024-09-12T00:37:48.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.528+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~QD9H9EB11SW3.2 size=742345 2024-09-12T00:37:48.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.528+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=QD9H9EB11SW3 tag=D9K0OMB4IZ0A type=write size=3888073 2024-09-12T00:37:48.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.529+0000 7fcd44281780 1 < completed delete operation key=XTNXNF3D0HFK tag=V6BHEZ8H11J6 type=del 2024-09-12T00:37:48.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.530+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=N2W2L0HQT50T type=del size=1310984 2024-09-12T00:37:48.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.532+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=Y2RON43IOYH9 type=del 2024-09-12T00:37:48.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.533+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=6U6EN40O59EE type=del size=3816147 2024-09-12T00:37:48.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.535+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=RK208LWEGYRP type=del 2024-09-12T00:37:48.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.536+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=IPK7BN7YLEIC type=del size=2343520 2024-09-12T00:37:48.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.538+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=KQ2FWH25KDJ9 type=del 2024-09-12T00:37:48.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.540+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~O7HTHJ3E8YW2.0 size=1048576 2024-09-12T00:37:48.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.541+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~O7HTHJ3E8YW2.1 size=814420 2024-09-12T00:37:48.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.541+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=O7HTHJ3E8YW2 tag=ENMUJ5YLTBOT type=write size=2911572 2024-09-12T00:37:48.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.543+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~12BG8EF28CG1.0 size=166430 2024-09-12T00:37:48.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.545+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=12BG8EF28CG1 tag=KN3CU1Z30FSH type=write size=1215006 2024-09-12T00:37:48.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.546+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=B6WXGJ27PP7I type=del size=3184813 2024-09-12T00:37:48.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.548+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~326R6V2WK1X2.0 size=1048576 2024-09-12T00:37:48.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.549+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~326R6V2WK1X2.1 size=815533 2024-09-12T00:37:48.550 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.551+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=326R6V2WK1X2 tag=PU5AFPK41X01 type=write size=2912685 2024-09-12T00:37:48.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.554+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~JSXMDBZUP3SC.0 size=1048576 2024-09-12T00:37:48.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.555+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~JSXMDBZUP3SC.1 size=716188 2024-09-12T00:37:48.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.555+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=JSXMDBZUP3SC tag=FKZX708EPB2P type=write size=2813340 2024-09-12T00:37:48.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.556+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=MHKNQ8WMOGH0 type=del 2024-09-12T00:37:48.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.558+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=C2PZSD1KTXQ7 type=del size=1126905 2024-09-12T00:37:48.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.559+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~FMAZ50RH0GG4.0 size=217871 2024-09-12T00:37:48.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.561+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=FMAZ50RH0GG4 tag=MVMKJNM6VREM type=write size=1266447 2024-09-12T00:37:48.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.563+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=B09C6EH67P2Z type=del size=10317 2024-09-12T00:37:48.564 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.566+0000 7fcd44281780 1 < suggested remove operation key=AJ5AUTM2J9MT tag=773BLHZ84XYU type=write 2024-09-12T00:37:48.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.567+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=59VL3AIQ437M type=write size=818005 2024-09-12T00:37:48.567 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.569+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~6RTEDTJ1R4KS.0 size=1048576 2024-09-12T00:37:48.568 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.570+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~6RTEDTJ1R4KS.1 size=587812 2024-09-12T00:37:48.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.572+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=6RTEDTJ1R4KS tag=GGAWGBHCX84N type=write size=2684964 2024-09-12T00:37:48.573 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.575+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~MNGCF6Z3GUXO.0 size=1048576 2024-09-12T00:37:48.574 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.575+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~MNGCF6Z3GUXO.1 size=1048576 2024-09-12T00:37:48.575 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.577+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~MNGCF6Z3GUXO.2 size=854958 2024-09-12T00:37:48.575 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.577+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=MNGCF6Z3GUXO tag=YIGI0CHQVTQD type=write size=4000686 2024-09-12T00:37:48.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.578+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~RU0TKBFJTOMN.0 size=1048576 2024-09-12T00:37:48.580 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.579+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~RU0TKBFJTOMN.1 size=1048576 2024-09-12T00:37:48.580 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.579+0000 7fcd44281780 1 < canceled part key=_multipart_AJ5AUTM2J9MT.2~RU0TKBFJTOMN.2 size=627074 2024-09-12T00:37:48.580 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.582+0000 7fcd44281780 1 < canceled multipart upload key=AJ5AUTM2J9MT upload=RU0TKBFJTOMN tag=QEDMA5WH9RWF type=write size=3772802 2024-09-12T00:37:48.582 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.583+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=JY7BIA2N3CRH type=write size=796659 2024-09-12T00:37:48.583 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.585+0000 7fcd44281780 -1 < failed to complete operation key=AJ5AUTM2J9MT tag=861BC9QU7M6G type=del size=3131672: (22) Invalid argument 2024-09-12T00:37:48.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.586+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=X7WPMR3LMUCR type=del size=805731 2024-09-12T00:37:48.586 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.587+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=2MJQS4JB5SW0 type=del 2024-09-12T00:37:48.588 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.589+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=E11NFSI3FYBU type=del size=3281400 2024-09-12T00:37:48.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.592+0000 7fcd44281780 1 < suggested remove operation key=0OEDZ5O2LN8H tag=BEHBTF788X18 type=del 2024-09-12T00:37:48.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.594+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=ICSY22GYCEHD type=write size=996383 2024-09-12T00:37:48.595 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.596+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=08ME4S91MUPA type=del 2024-09-12T00:37:48.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.597+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=0J2W6ZR9T84X type=write size=80005 2024-09-12T00:37:48.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.599+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~QD9H9EB11SW3.0 size=1048576 2024-09-12T00:37:48.599 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.600+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~QD9H9EB11SW3.1 size=1048576 2024-09-12T00:37:48.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.601+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~QD9H9EB11SW3.2 size=742345 2024-09-12T00:37:48.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.604+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=QD9H9EB11SW3 tag=D9K0OMB4IZ0A type=write size=3888073 2024-09-12T00:37:48.604 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.605+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=ZMZ8RC7Z0A3S type=write size=770677 2024-09-12T00:37:48.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.609+0000 7fcd44281780 1 < suggested update operation key=CF7B7J3V1YFG tag=N2W2L0HQT50T type=del size=1310984 2024-09-12T00:37:48.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.610+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=Z8WWPVIN0Y1S type=del size=3533295 2024-09-12T00:37:48.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.612+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=6U6EN40O59EE type=del 2024-09-12T00:37:48.612 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.613+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=HCSGX45X2K2B type=write size=134742 2024-09-12T00:37:48.613 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.614+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=IPK7BN7YLEIC type=del 2024-09-12T00:37:48.615 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.616+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=2P2H35SDJMI2 type=write size=152097 2024-09-12T00:37:48.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.617+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~O7HTHJ3E8YW2.0 size=1048576 2024-09-12T00:37:48.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.618+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~O7HTHJ3E8YW2.1 size=814420 2024-09-12T00:37:48.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.621+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=O7HTHJ3E8YW2 tag=ENMUJ5YLTBOT type=write size=2911572 2024-09-12T00:37:48.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.622+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=IO9D47R9WFUS type=del size=3739317 2024-09-12T00:37:48.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.624+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=B6WXGJ27PP7I type=del 2024-09-12T00:37:48.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.626+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=HT0ECDM8O42M type=del size=3827131 2024-09-12T00:37:48.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.629+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~JSXMDBZUP3SC.0 size=1048576 2024-09-12T00:37:48.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.631+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~JSXMDBZUP3SC.1 size=716188 2024-09-12T00:37:48.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.634+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=JSXMDBZUP3SC tag=FKZX708EPB2P type=write size=2813340 2024-09-12T00:37:48.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.636+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~N34XSOS589BR.0 size=43476 2024-09-12T00:37:48.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.636+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=N34XSOS589BR tag=GC1X7MR4KK3M type=write size=1092052 2024-09-12T00:37:48.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.637+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=C2PZSD1KTXQ7 type=del 2024-09-12T00:37:48.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.639+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=ILH4IOAWHKNX type=del size=520643 2024-09-12T00:37:48.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.643+0000 7fcd44281780 1 < suggested update operation key=0AVE0W4OV1AU tag=B09C6EH67P2Z type=del size=10317 2024-09-12T00:37:48.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.644+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=JWVT0ILR9Z5O type=del size=1190282 2024-09-12T00:37:48.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.647+0000 7fcd44281780 1 < suggested remove operation key=WXBMIJ4FC0VX tag=59VL3AIQ437M type=write 2024-09-12T00:37:48.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.649+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~X84DBFYUJ1JG.0 size=1048576 2024-09-12T00:37:48.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.651+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~X84DBFYUJ1JG.1 size=1048576 2024-09-12T00:37:48.650 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.651+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~X84DBFYUJ1JG.2 size=623436 2024-09-12T00:37:48.650 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.652+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=X84DBFYUJ1JG tag=V832Z8HGL2I7 type=write size=3769164 2024-09-12T00:37:48.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.653+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~MNGCF6Z3GUXO.0 size=1048576 2024-09-12T00:37:48.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.653+0000 7fcd44281780 1 < canceled part key=_multipart_AJ5AUTM2J9MT.2~MNGCF6Z3GUXO.1 size=1048576 2024-09-12T00:37:48.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.654+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~MNGCF6Z3GUXO.2 size=854958 2024-09-12T00:37:48.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.656+0000 7fcd44281780 1 < canceled multipart upload key=AJ5AUTM2J9MT upload=MNGCF6Z3GUXO tag=YIGI0CHQVTQD type=write size=4000686 2024-09-12T00:37:48.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.659+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~G6PH56GT05GQ.0 size=1048576 2024-09-12T00:37:48.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.660+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~G6PH56GT05GQ.1 size=1048576 2024-09-12T00:37:48.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.661+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~G6PH56GT05GQ.2 size=217288 2024-09-12T00:37:48.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.661+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=G6PH56GT05GQ tag=5WLDTCRR1GSW type=write size=3363016 2024-09-12T00:37:48.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.662+0000 7fcd44281780 1 < completed write operation key=O12Z8THB62AJ tag=JY7BIA2N3CRH type=write size=796659 2024-09-12T00:37:48.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.665+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~GF5R8Z4C3PZY.0 size=1048576 2024-09-12T00:37:48.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.666+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~GF5R8Z4C3PZY.1 size=842292 2024-09-12T00:37:48.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.666+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=GF5R8Z4C3PZY tag=BJWX0WQD2FS3 type=write size=2939444 2024-09-12T00:37:48.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.667+0000 7fcd44281780 1 < completed delete operation key=QVULC3H9QGXE tag=X7WPMR3LMUCR type=del 2024-09-12T00:37:48.669 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.670+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~81QY0FIOQKJI.0 size=1048576 2024-09-12T00:37:48.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.671+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~81QY0FIOQKJI.1 size=1048576 2024-09-12T00:37:48.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.673+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~81QY0FIOQKJI.2 size=862485 2024-09-12T00:37:48.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.673+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=81QY0FIOQKJI tag=KIBHA2U2W029 type=write size=4008213 2024-09-12T00:37:48.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.674+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=E11NFSI3FYBU type=del 2024-09-12T00:37:48.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.676+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=FMY6Q5WALZ1P type=del size=874927 2024-09-12T00:37:48.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.677+0000 7fcd44281780 1 < canceled operation key=UWS056JN3IXO tag=ICSY22GYCEHD type=write size=996383 2024-09-12T00:37:48.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.679+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~YI2AE63APVMD.0 size=1048576 2024-09-12T00:37:48.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.680+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~YI2AE63APVMD.1 size=1048576 2024-09-12T00:37:48.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.681+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~YI2AE63APVMD.2 size=518859 2024-09-12T00:37:48.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.681+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=YI2AE63APVMD tag=R19M3QQ65GNS type=write size=3664587 2024-09-12T00:37:48.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.683+0000 7fcd44281780 1 < completed write operation key=0OEDZ5O2LN8H tag=0J2W6ZR9T84X type=write size=80005 2024-09-12T00:37:48.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.686+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~YDQOA9CYD25Z.0 size=1048576 2024-09-12T00:37:48.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.687+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~YDQOA9CYD25Z.1 size=1048576 2024-09-12T00:37:48.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.688+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~YDQOA9CYD25Z.2 size=961717 2024-09-12T00:37:48.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.688+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=YDQOA9CYD25Z tag=2EWBYB5LA7JR type=write size=4107445 2024-09-12T00:37:48.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.690+0000 7fcd44281780 1 < completed write operation key=8U004LC8IYLQ tag=ZMZ8RC7Z0A3S type=write size=770677 2024-09-12T00:37:48.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.693+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~6WYHQAHR8ZPF.0 size=49520 2024-09-12T00:37:48.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.693+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=6WYHQAHR8ZPF tag=HC77R49MWSPP type=write size=1098096 2024-09-12T00:37:48.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.694+0000 7fcd44281780 1 < completed delete operation key=8U004LC8IYLQ tag=Z8WWPVIN0Y1S type=del 2024-09-12T00:37:48.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.696+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=JU3AHT2CO796 type=write size=266732 2024-09-12T00:37:48.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.698+0000 7fcd44281780 1 < completed write operation key=UXY6K0AVI4EK tag=HCSGX45X2K2B type=write size=134742 2024-09-12T00:37:48.699 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.700+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~0JJW3O03RTBA.0 size=1048576 2024-09-12T00:37:48.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.701+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~0JJW3O03RTBA.1 size=1048576 2024-09-12T00:37:48.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.702+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~0JJW3O03RTBA.2 size=909800 2024-09-12T00:37:48.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.702+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=0JJW3O03RTBA tag=GY704YL56V33 type=write size=4055528 2024-09-12T00:37:48.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.704+0000 7fcd44281780 1 < suggested update operation key=EXP8U6QNSMQ0 tag=2P2H35SDJMI2 type=write size=152097 2024-09-12T00:37:48.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.707+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~5V9RIQI9A2T9.0 size=1048576 2024-09-12T00:37:48.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.708+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~5V9RIQI9A2T9.1 size=1036371 2024-09-12T00:37:48.707 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.708+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=5V9RIQI9A2T9 tag=YZAW3AIKC9TY type=write size=3133523 2024-09-12T00:37:48.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.709+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=IO9D47R9WFUS type=del 2024-09-12T00:37:48.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.710+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=KWF1B3Z812AC type=del size=1748756 2024-09-12T00:37:48.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.712+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=HT0ECDM8O42M type=del 2024-09-12T00:37:48.712 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.713+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=M1SYHI0JPDZ4 type=write size=108097 2024-09-12T00:37:48.714 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.715+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~N34XSOS589BR.0 size=43476 2024-09-12T00:37:48.716 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.717+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=N34XSOS589BR tag=GC1X7MR4KK3M type=write size=1092052 2024-09-12T00:37:48.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.718+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=AK2BWESVMHPK type=del size=4140808 2024-09-12T00:37:48.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.721+0000 7fcd44281780 1 < suggested remove operation key=G8O8VXTUPQVP tag=ILH4IOAWHKNX type=del 2024-09-12T00:37:48.722 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.723+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=TQ4MCJXR1Q4H type=write size=312427 2024-09-12T00:37:48.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.724+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=JWVT0ILR9Z5O type=del 2024-09-12T00:37:48.726 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.727+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=Y6R262M4Z6FB type=del size=969855 2024-09-12T00:37:48.727 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.728+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~X84DBFYUJ1JG.0 size=1048576 2024-09-12T00:37:48.728 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.729+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~X84DBFYUJ1JG.1 size=1048576 2024-09-12T00:37:48.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.730+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~X84DBFYUJ1JG.2 size=623436 2024-09-12T00:37:48.731 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.732+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=X84DBFYUJ1JG tag=V832Z8HGL2I7 type=write size=3769164 2024-09-12T00:37:48.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.734+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=ZTK7QAC562HI type=del size=1321675 2024-09-12T00:37:48.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.735+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~G6PH56GT05GQ.0 size=1048576 2024-09-12T00:37:48.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.736+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~G6PH56GT05GQ.1 size=1048576 2024-09-12T00:37:48.736 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.737+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~G6PH56GT05GQ.2 size=217288 2024-09-12T00:37:48.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.740+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=G6PH56GT05GQ tag=5WLDTCRR1GSW type=write size=3363016 2024-09-12T00:37:48.740 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.741+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=4D37WW4REMSV type=write size=435214 2024-09-12T00:37:48.741 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.743+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~GF5R8Z4C3PZY.0 size=1048576 2024-09-12T00:37:48.743 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.744+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~GF5R8Z4C3PZY.1 size=842292 2024-09-12T00:37:48.745 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.746+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=GF5R8Z4C3PZY tag=BJWX0WQD2FS3 type=write size=2939444 2024-09-12T00:37:48.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.747+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=G4ZDWQWGEYE9 type=del size=681130 2024-09-12T00:37:48.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.748+0000 7fcd44281780 1 < canceled part key=_multipart_UWS056JN3IXO.2~81QY0FIOQKJI.0 size=1048576 2024-09-12T00:37:48.747 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.749+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~81QY0FIOQKJI.1 size=1048576 2024-09-12T00:37:48.748 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.750+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~81QY0FIOQKJI.2 size=862485 2024-09-12T00:37:48.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.752+0000 7fcd44281780 1 < canceled multipart upload key=UWS056JN3IXO upload=81QY0FIOQKJI tag=KIBHA2U2W029 type=write size=4008213 2024-09-12T00:37:48.752 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.753+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=79SC3SG5NCAE type=del size=2291057 2024-09-12T00:37:48.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.755+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=FMY6Q5WALZ1P type=del 2024-09-12T00:37:48.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.757+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~61O4V4YHRY2U.0 size=1048576 2024-09-12T00:37:48.757 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.759+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~61O4V4YHRY2U.1 size=1048576 2024-09-12T00:37:48.760 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.761+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~61O4V4YHRY2U.2 size=511469 2024-09-12T00:37:48.760 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.761+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=61O4V4YHRY2U tag=QSFS886B32XF type=write size=3657197 2024-09-12T00:37:48.762 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.763+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~YI2AE63APVMD.0 size=1048576 2024-09-12T00:37:48.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.764+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~YI2AE63APVMD.1 size=1048576 2024-09-12T00:37:48.764 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.765+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~YI2AE63APVMD.2 size=518859 2024-09-12T00:37:48.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.768+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=YI2AE63APVMD tag=R19M3QQ65GNS type=write size=3664587 2024-09-12T00:37:48.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.769+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=MPBF2Q9I2ZD2 type=del size=1783357 2024-09-12T00:37:48.770 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.771+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~YDQOA9CYD25Z.0 size=1048576 2024-09-12T00:37:48.771 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.772+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~YDQOA9CYD25Z.1 size=1048576 2024-09-12T00:37:48.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.773+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~YDQOA9CYD25Z.2 size=961717 2024-09-12T00:37:48.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.775+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=YDQOA9CYD25Z tag=2EWBYB5LA7JR type=write size=4107445 2024-09-12T00:37:48.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.778+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~YDINJ6JCS566.0 size=1048576 2024-09-12T00:37:48.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.779+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~YDINJ6JCS566.1 size=1048576 2024-09-12T00:37:48.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.780+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~YDINJ6JCS566.2 size=69626 2024-09-12T00:37:48.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.780+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=YDINJ6JCS566 tag=1S2R0WO1AEWK type=write size=3215354 2024-09-12T00:37:48.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.780+0000 7fcd44281780 1 < canceled part key=_multipart_UWS056JN3IXO.2~6WYHQAHR8ZPF.0 size=49520 2024-09-12T00:37:48.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.782+0000 7fcd44281780 1 < canceled multipart upload key=UWS056JN3IXO upload=6WYHQAHR8ZPF tag=HC77R49MWSPP type=write size=1098096 2024-09-12T00:37:48.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.784+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=P3ODTB29F96O type=del size=3353397 2024-09-12T00:37:48.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.787+0000 7fcd44281780 1 < suggested update operation key=U4EPPPA4QGGD tag=JU3AHT2CO796 type=write size=266732 2024-09-12T00:37:48.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.789+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~SQ31WA6DW46T.0 size=716021 2024-09-12T00:37:48.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.789+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=SQ31WA6DW46T tag=6DVA1ML9SAX1 type=write size=1764597 2024-09-12T00:37:48.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.790+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~0JJW3O03RTBA.0 size=1048576 2024-09-12T00:37:48.790 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.791+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~0JJW3O03RTBA.1 size=1048576 2024-09-12T00:37:48.791 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.792+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~0JJW3O03RTBA.2 size=909800 2024-09-12T00:37:48.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.795+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=0JJW3O03RTBA tag=GY704YL56V33 type=write size=4055528 2024-09-12T00:37:48.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.796+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=63IYB4AGWDG6 type=del size=378401 2024-09-12T00:37:48.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.797+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~5V9RIQI9A2T9.0 size=1048576 2024-09-12T00:37:48.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.798+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~5V9RIQI9A2T9.1 size=1036371 2024-09-12T00:37:48.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.801+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=5V9RIQI9A2T9 tag=YZAW3AIKC9TY type=write size=3133523 2024-09-12T00:37:48.801 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.802+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=5MUHIUT8N9GB type=write size=765171 2024-09-12T00:37:48.804 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.805+0000 7fcd44281780 1 < suggested update operation key=NIDHAXQF55WX tag=KWF1B3Z812AC type=del size=1748756 2024-09-12T00:37:48.806 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.808+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~W2K0F87EC0GX.0 size=1048576 2024-09-12T00:37:48.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.809+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~W2K0F87EC0GX.1 size=883816 2024-09-12T00:37:48.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.809+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=W2K0F87EC0GX tag=6LAJW9S7LZP9 type=write size=2980968 2024-09-12T00:37:48.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.810+0000 7fcd44281780 1 < completed write operation key=Z6I6598B6J5I tag=M1SYHI0JPDZ4 type=write size=108097 2024-09-12T00:37:48.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.813+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~42BKAYBQ71A4.0 size=832688 2024-09-12T00:37:48.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.813+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=42BKAYBQ71A4 tag=7CBS0BMON9LH type=write size=1881264 2024-09-12T00:37:48.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.814+0000 7fcd44281780 1 < completed delete operation key=8U004LC8IYLQ tag=AK2BWESVMHPK type=del 2024-09-12T00:37:48.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.816+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=TZU1YG208TKT type=del size=3878864 2024-09-12T00:37:48.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.817+0000 7fcd44281780 1 < completed write operation key=VXDTFEG8P23H tag=TQ4MCJXR1Q4H type=write size=312427 2024-09-12T00:37:48.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.819+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~QIYZZM8ZTBNE.0 size=634242 2024-09-12T00:37:48.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.819+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=QIYZZM8ZTBNE tag=3IIX031V0IQL type=write size=1682818 2024-09-12T00:37:48.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.821+0000 7fcd44281780 1 < canceled operation key=EXP8U6QNSMQ0 tag=Y6R262M4Z6FB type=del size=969855 2024-09-12T00:37:48.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.822+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=QGRILX8NC9B4 type=del size=913575 2024-09-12T00:37:48.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.823+0000 7fcd44281780 1 < completed delete operation key=XTNXNF3D0HFK tag=ZTK7QAC562HI type=del 2024-09-12T00:37:48.824 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.825+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=2IAO1Y49MKDC type=del size=2953686 2024-09-12T00:37:48.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.826+0000 7fcd44281780 -1 < failed to complete operation key=U4EPPPA4QGGD tag=4D37WW4REMSV type=write size=435214: (22) Invalid argument 2024-09-12T00:37:48.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.828+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=74H7HMYKMSZP type=write size=77316 2024-09-12T00:37:48.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.830+0000 7fcd44281780 1 < suggested remove operation key=CF7B7J3V1YFG tag=G4ZDWQWGEYE9 type=del 2024-09-12T00:37:48.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.833+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~UWD5OZGLZPPF.0 size=1048576 2024-09-12T00:37:48.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.834+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~UWD5OZGLZPPF.1 size=714903 2024-09-12T00:37:48.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.834+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=UWD5OZGLZPPF tag=0GIEAAYWGJEJ type=write size=2812055 2024-09-12T00:37:48.836 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.838+0000 7fcd44281780 1 < suggested update operation key=KNBCXZF3JGNL tag=79SC3SG5NCAE type=del size=2291057 2024-09-12T00:37:48.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.840+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~3U09BR8RN9XR.0 size=298836 2024-09-12T00:37:48.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.840+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=3U09BR8RN9XR tag=06RN3W997VMC type=write size=1347412 2024-09-12T00:37:48.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.841+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~61O4V4YHRY2U.0 size=1048576 2024-09-12T00:37:48.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.842+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~61O4V4YHRY2U.1 size=1048576 2024-09-12T00:37:48.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.844+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~61O4V4YHRY2U.2 size=511469 2024-09-12T00:37:48.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.846+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=61O4V4YHRY2U tag=QSFS886B32XF type=write size=3657197 2024-09-12T00:37:48.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.849+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~6TJY3JXDTDXS.0 size=461341 2024-09-12T00:37:48.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.849+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=6TJY3JXDTDXS tag=TPL57K4XQKJT type=write size=1509917 2024-09-12T00:37:48.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.850+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=MPBF2Q9I2ZD2 type=del 2024-09-12T00:37:48.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.851+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=138JH5A96JLO type=del size=634469 2024-09-12T00:37:48.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.853+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~YDINJ6JCS566.0 size=1048576 2024-09-12T00:37:48.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.854+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~YDINJ6JCS566.1 size=1048576 2024-09-12T00:37:48.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.855+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~YDINJ6JCS566.2 size=69626 2024-09-12T00:37:48.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.857+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=YDINJ6JCS566 tag=1S2R0WO1AEWK type=write size=3215354 2024-09-12T00:37:48.857 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.858+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=NT6DTCYUUVGY type=del size=108111 2024-09-12T00:37:48.858 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.859+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=P3ODTB29F96O type=del 2024-09-12T00:37:48.859 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.861+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=D6IZ4X8TICK5 type=write size=196302 2024-09-12T00:37:48.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.861+0000 7fcd44281780 1 < canceled part key=_multipart_WXBMIJ4FC0VX.2~SQ31WA6DW46T.0 size=716021 2024-09-12T00:37:48.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.863+0000 7fcd44281780 1 < canceled multipart upload key=WXBMIJ4FC0VX upload=SQ31WA6DW46T tag=6DVA1ML9SAX1 type=write size=1764597 2024-09-12T00:37:48.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.865+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=R3A26WKSSUXG type=del size=4154083 2024-09-12T00:37:48.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.866+0000 7fcd44281780 -1 < failed to complete operation key=KNBCXZF3JGNL tag=63IYB4AGWDG6 type=del size=378401: (22) Invalid argument 2024-09-12T00:37:48.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.869+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~PE1RHLBZLWR7.0 size=1048576 2024-09-12T00:37:48.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.870+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~PE1RHLBZLWR7.1 size=758954 2024-09-12T00:37:48.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.870+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=PE1RHLBZLWR7 tag=9EUX0751A719 type=write size=2856106 2024-09-12T00:37:48.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.871+0000 7fcd44281780 1 < completed write operation key=WXBMIJ4FC0VX tag=5MUHIUT8N9GB type=write size=765171 2024-09-12T00:37:48.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.874+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~D7JOEUFMHMZS.0 size=1048576 2024-09-12T00:37:48.874 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.875+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~D7JOEUFMHMZS.1 size=211094 2024-09-12T00:37:48.874 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.875+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=D7JOEUFMHMZS tag=3S2MOIS8CS1Y type=write size=2308246 2024-09-12T00:37:48.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.877+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~W2K0F87EC0GX.0 size=1048576 2024-09-12T00:37:48.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.878+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~W2K0F87EC0GX.1 size=883816 2024-09-12T00:37:48.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.880+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=W2K0F87EC0GX tag=6LAJW9S7LZP9 type=write size=2980968 2024-09-12T00:37:48.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.882+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~Y6TJVTJ17DS4.0 size=1048576 2024-09-12T00:37:48.882 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.884+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~Y6TJVTJ17DS4.1 size=149549 2024-09-12T00:37:48.883 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.884+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=Y6TJVTJ17DS4 tag=V65Z3TLBT6B7 type=write size=2246701 2024-09-12T00:37:48.884 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.885+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~42BKAYBQ71A4.0 size=832688 2024-09-12T00:37:48.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.887+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=42BKAYBQ71A4 tag=7CBS0BMON9LH type=write size=1881264 2024-09-12T00:37:48.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.890+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=SIAL26ZB9XWJ type=write size=365516 2024-09-12T00:37:48.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.892+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=TZU1YG208TKT type=del 2024-09-12T00:37:48.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.893+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=1MN5HEU4GDAQ type=del size=2007635 2024-09-12T00:37:48.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.893+0000 7fcd44281780 1 < canceled part key=_multipart_UXY6K0AVI4EK.2~QIYZZM8ZTBNE.0 size=634242 2024-09-12T00:37:48.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.896+0000 7fcd44281780 1 < canceled multipart upload key=UXY6K0AVI4EK upload=QIYZZM8ZTBNE tag=3IIX031V0IQL type=write size=1682818 2024-09-12T00:37:48.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.897+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=2QLI9U1ROE7M type=del size=2713966 2024-09-12T00:37:48.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.899+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=QGRILX8NC9B4 type=del 2024-09-12T00:37:48.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.900+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=U8C78T0ODAY8 type=del size=2573445 2024-09-12T00:37:48.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.901+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=2IAO1Y49MKDC type=del 2024-09-12T00:37:48.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.904+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~65TIPXPMIB4B.0 size=1048576 2024-09-12T00:37:48.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.905+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~65TIPXPMIB4B.1 size=1048576 2024-09-12T00:37:48.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.906+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~65TIPXPMIB4B.2 size=1020493 2024-09-12T00:37:48.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.906+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=65TIPXPMIB4B tag=58F70G7G73OM type=write size=4166221 2024-09-12T00:37:48.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.908+0000 7fcd44281780 1 < completed write operation key=8U004LC8IYLQ tag=74H7HMYKMSZP type=write size=77316 2024-09-12T00:37:48.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.909+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=7L4EM1KEUHLL type=write size=861961 2024-09-12T00:37:48.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.911+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~UWD5OZGLZPPF.0 size=1048576 2024-09-12T00:37:48.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.912+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~UWD5OZGLZPPF.1 size=714903 2024-09-12T00:37:48.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.914+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=UWD5OZGLZPPF tag=0GIEAAYWGJEJ type=write size=2812055 2024-09-12T00:37:48.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.917+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~0TWSTJZW4MX1.0 size=1048576 2024-09-12T00:37:48.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.918+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~0TWSTJZW4MX1.1 size=255009 2024-09-12T00:37:48.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.918+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=0TWSTJZW4MX1 tag=2S399KQNGQWU type=write size=2352161 2024-09-12T00:37:48.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.920+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~3U09BR8RN9XR.0 size=298836 2024-09-12T00:37:48.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.922+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=3U09BR8RN9XR tag=06RN3W997VMC type=write size=1347412 2024-09-12T00:37:48.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.925+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~5GVPKYX5U576.0 size=1048576 2024-09-12T00:37:48.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.926+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~5GVPKYX5U576.1 size=1048576 2024-09-12T00:37:48.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.927+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~5GVPKYX5U576.2 size=693474 2024-09-12T00:37:48.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.927+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=5GVPKYX5U576 tag=TSYXNCGG4G1N type=write size=3839202 2024-09-12T00:37:48.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.928+0000 7fcd44281780 1 < canceled part key=_multipart_G8O8VXTUPQVP.2~6TJY3JXDTDXS.0 size=461341 2024-09-12T00:37:48.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.930+0000 7fcd44281780 1 < canceled multipart upload key=G8O8VXTUPQVP upload=6TJY3JXDTDXS tag=TPL57K4XQKJT type=write size=1509917 2024-09-12T00:37:48.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.933+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~DZE819YV42CE.0 size=1048576 2024-09-12T00:37:48.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.934+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~DZE819YV42CE.1 size=157697 2024-09-12T00:37:48.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.934+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=DZE819YV42CE tag=9GIXHT5AMOWQ type=write size=2254849 2024-09-12T00:37:48.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.935+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=138JH5A96JLO type=del 2024-09-12T00:37:48.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.937+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=NR8A33XQMC7M type=del size=3671696 2024-09-12T00:37:48.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.939+0000 7fcd44281780 1 < suggested update operation key=CF7B7J3V1YFG tag=NT6DTCYUUVGY type=del size=108111 2024-09-12T00:37:48.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.941+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=2THRRWSOSF05 type=del size=2318296 2024-09-12T00:37:48.941 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.942+0000 7fcd44281780 1 < completed write operation key=AJ5AUTM2J9MT tag=D6IZ4X8TICK5 type=write size=196302 2024-09-12T00:37:48.942 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.944+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=LSS21X5YFL02 type=del size=1947082 2024-09-12T00:37:48.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.945+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=R3A26WKSSUXG type=del 2024-09-12T00:37:48.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.947+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=H0A2DQBIL6O9 type=del size=1064968 2024-09-12T00:37:48.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.947+0000 7fcd44281780 1 < canceled part key=_multipart_Z6I6598B6J5I.2~PE1RHLBZLWR7.0 size=1048576 2024-09-12T00:37:48.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.948+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~PE1RHLBZLWR7.1 size=758954 2024-09-12T00:37:48.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.951+0000 7fcd44281780 1 < canceled multipart upload key=Z6I6598B6J5I upload=PE1RHLBZLWR7 tag=9EUX0751A719 type=write size=2856106 2024-09-12T00:37:48.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.952+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=E951PULCGI9W type=del size=590680 2024-09-12T00:37:48.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.953+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~D7JOEUFMHMZS.0 size=1048576 2024-09-12T00:37:48.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.955+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~D7JOEUFMHMZS.1 size=211094 2024-09-12T00:37:48.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.957+0000 7fcd44281780 1 < completed multipart upload key=B5OH55MQGSGJ upload=D7JOEUFMHMZS tag=3S2MOIS8CS1Y type=write size=2308246 2024-09-12T00:37:48.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.960+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~J4VDMVF90LIG.0 size=1048576 2024-09-12T00:37:48.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.961+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~J4VDMVF90LIG.1 size=52036 2024-09-12T00:37:48.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.961+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=J4VDMVF90LIG tag=KB8NJLRDO53A type=write size=2149188 2024-09-12T00:37:48.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.962+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~Y6TJVTJ17DS4.0 size=1048576 2024-09-12T00:37:48.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.964+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~Y6TJVTJ17DS4.1 size=149549 2024-09-12T00:37:48.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.966+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=Y6TJVTJ17DS4 tag=V65Z3TLBT6B7 type=write size=2246701 2024-09-12T00:37:48.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.968+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~YMP2DS1WZG9H.0 size=1048576 2024-09-12T00:37:48.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.969+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~YMP2DS1WZG9H.1 size=1048576 2024-09-12T00:37:48.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.971+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~YMP2DS1WZG9H.2 size=796200 2024-09-12T00:37:48.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.971+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=YMP2DS1WZG9H tag=MCPUEB5AFHXW type=write size=3941928 2024-09-12T00:37:48.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.972+0000 7fcd44281780 1 < completed write operation key=KNBCXZF3JGNL tag=SIAL26ZB9XWJ type=write size=365516 2024-09-12T00:37:48.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.975+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~FMF7KHGTSURC.0 size=1048576 2024-09-12T00:37:48.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.976+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~FMF7KHGTSURC.1 size=1048576 2024-09-12T00:37:48.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.977+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~FMF7KHGTSURC.2 size=653353 2024-09-12T00:37:48.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.977+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=FMF7KHGTSURC tag=K2E452PYQ16B type=write size=3799081 2024-09-12T00:37:48.977 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.978+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=1MN5HEU4GDAQ type=del 2024-09-12T00:37:48.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.980+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=1D75OGLXJGYV type=del size=687136 2024-09-12T00:37:48.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.981+0000 7fcd44281780 1 < canceled operation key=G8O8VXTUPQVP tag=2QLI9U1ROE7M type=del size=2713966 2024-09-12T00:37:48.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.984+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~HYCY497JW61Z.0 size=1048576 2024-09-12T00:37:48.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.985+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~HYCY497JW61Z.1 size=864003 2024-09-12T00:37:48.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.985+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=HYCY497JW61Z tag=2HF0J0LKE9WD type=write size=2961155 2024-09-12T00:37:48.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.987+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=U8C78T0ODAY8 type=del 2024-09-12T00:37:48.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.990+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~4UZ5QK2Y6RLF.0 size=731986 2024-09-12T00:37:48.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.990+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=4UZ5QK2Y6RLF tag=B2X2BL7CJYG3 type=write size=1780562 2024-09-12T00:37:48.990 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.991+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~65TIPXPMIB4B.0 size=1048576 2024-09-12T00:37:48.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.992+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~65TIPXPMIB4B.1 size=1048576 2024-09-12T00:37:48.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.994+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~65TIPXPMIB4B.2 size=1020493 2024-09-12T00:37:48.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.996+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=65TIPXPMIB4B tag=58F70G7G73OM type=write size=4166221 2024-09-12T00:37:48.998 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.999+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~HY5QEWK104NH.0 size=214429 2024-09-12T00:37:48.998 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:48.999+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=HY5QEWK104NH tag=1P31VTV9XK3I type=write size=1263005 2024-09-12T00:37:49.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.002+0000 7fcd44281780 1 < suggested update operation key=4RU6HTH4J0U1 tag=7L4EM1KEUHLL type=write size=861961 2024-09-12T00:37:49.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.003+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=3Q5049TG7TFI type=del size=3190339 2024-09-12T00:37:49.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.003+0000 7fcd44281780 1 < canceled part key=_multipart_4RU6HTH4J0U1.2~0TWSTJZW4MX1.0 size=1048576 2024-09-12T00:37:49.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.004+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~0TWSTJZW4MX1.1 size=255009 2024-09-12T00:37:49.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.007+0000 7fcd44281780 1 < canceled multipart upload key=4RU6HTH4J0U1 upload=0TWSTJZW4MX1 tag=2S399KQNGQWU type=write size=2352161 2024-09-12T00:37:49.007 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.008+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=KZ7CMHAJUQRS type=del size=3420118 2024-09-12T00:37:49.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.010+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~5GVPKYX5U576.0 size=1048576 2024-09-12T00:37:49.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.011+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~5GVPKYX5U576.1 size=1048576 2024-09-12T00:37:49.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.012+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~5GVPKYX5U576.2 size=693474 2024-09-12T00:37:49.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.015+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=5GVPKYX5U576 tag=TSYXNCGG4G1N type=write size=3839202 2024-09-12T00:37:49.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.016+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=JQ42IW6HY243 type=del size=2634628 2024-09-12T00:37:49.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.018+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~DZE819YV42CE.0 size=1048576 2024-09-12T00:37:49.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.019+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~DZE819YV42CE.1 size=157697 2024-09-12T00:37:49.020 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.021+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=DZE819YV42CE tag=9GIXHT5AMOWQ type=write size=2254849 2024-09-12T00:37:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.024+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=Y4BATN8YFOC5 type=write size=998384 2024-09-12T00:37:49.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.025+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=NR8A33XQMC7M type=del 2024-09-12T00:37:49.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.028+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~5KGPO1EUB0CT.0 size=1048576 2024-09-12T00:37:49.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.029+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~5KGPO1EUB0CT.1 size=1048576 2024-09-12T00:37:49.028 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.030+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~5KGPO1EUB0CT.2 size=227518 2024-09-12T00:37:49.028 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.030+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=5KGPO1EUB0CT tag=AHOEFOAPXEDH type=write size=3373246 2024-09-12T00:37:49.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.031+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=2THRRWSOSF05 type=del 2024-09-12T00:37:49.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.033+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=Q3NVKZD4GSAW type=del size=4111871 2024-09-12T00:37:49.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.034+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=LSS21X5YFL02 type=del 2024-09-12T00:37:49.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.036+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=ETT6H6XHCWPT type=del size=670825 2024-09-12T00:37:49.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.037+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=H0A2DQBIL6O9 type=del 2024-09-12T00:37:49.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.039+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=EYA3B4UQDMJJ type=write size=681176 2024-09-12T00:37:49.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.042+0000 7fcd44281780 1 < suggested remove operation key=7UCICX0GHHQ1 tag=E951PULCGI9W type=del 2024-09-12T00:37:49.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.043+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=8VBZJLXSKS3M type=del size=2928993 2024-09-12T00:37:49.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.045+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~J4VDMVF90LIG.0 size=1048576 2024-09-12T00:37:49.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.046+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~J4VDMVF90LIG.1 size=52036 2024-09-12T00:37:49.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.048+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=J4VDMVF90LIG tag=KB8NJLRDO53A type=write size=2149188 2024-09-12T00:37:49.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.051+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~L5X92TRPYOJX.0 size=1048576 2024-09-12T00:37:49.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.052+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~L5X92TRPYOJX.1 size=680026 2024-09-12T00:37:49.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.052+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=L5X92TRPYOJX tag=OCF2P71J9RNK type=write size=2777178 2024-09-12T00:37:49.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.054+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~YMP2DS1WZG9H.0 size=1048576 2024-09-12T00:37:49.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.054+0000 7fcd44281780 1 < canceled part key=_multipart_UWS056JN3IXO.2~YMP2DS1WZG9H.1 size=1048576 2024-09-12T00:37:49.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.055+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~YMP2DS1WZG9H.2 size=796200 2024-09-12T00:37:49.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.057+0000 7fcd44281780 1 < canceled multipart upload key=UWS056JN3IXO upload=YMP2DS1WZG9H tag=MCPUEB5AFHXW type=write size=3941928 2024-09-12T00:37:49.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.058+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=IUE2AN3XYZIX type=del size=2724460 2024-09-12T00:37:49.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.060+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~FMF7KHGTSURC.0 size=1048576 2024-09-12T00:37:49.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.061+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~FMF7KHGTSURC.1 size=1048576 2024-09-12T00:37:49.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.062+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~FMF7KHGTSURC.2 size=653353 2024-09-12T00:37:49.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.065+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=FMF7KHGTSURC tag=K2E452PYQ16B type=write size=3799081 2024-09-12T00:37:49.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.066+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=10BREL4BBTO4 type=del size=762136 2024-09-12T00:37:49.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.068+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=1D75OGLXJGYV type=del 2024-09-12T00:37:49.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.070+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~89299ZFROFCF.0 size=1048576 2024-09-12T00:37:49.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.071+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~89299ZFROFCF.1 size=1048576 2024-09-12T00:37:49.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.072+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~89299ZFROFCF.2 size=847599 2024-09-12T00:37:49.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.072+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=89299ZFROFCF tag=NCGHDA8X24KV type=write size=3993327 2024-09-12T00:37:49.073 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.074+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~HYCY497JW61Z.0 size=1048576 2024-09-12T00:37:49.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.076+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~HYCY497JW61Z.1 size=864003 2024-09-12T00:37:49.076 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.078+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=HYCY497JW61Z tag=2HF0J0LKE9WD type=write size=2961155 2024-09-12T00:37:49.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.079+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=T0K25QZXIXJM type=write size=415587 2024-09-12T00:37:49.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.080+0000 7fcd44281780 1 < canceled part key=_multipart_G8O8VXTUPQVP.2~4UZ5QK2Y6RLF.0 size=731986 2024-09-12T00:37:49.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.082+0000 7fcd44281780 1 < canceled multipart upload key=G8O8VXTUPQVP upload=4UZ5QK2Y6RLF tag=B2X2BL7CJYG3 type=write size=1780562 2024-09-12T00:37:49.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.083+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=61C7Y04LUM4R type=write size=829975 2024-09-12T00:37:49.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.085+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~HY5QEWK104NH.0 size=214429 2024-09-12T00:37:49.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.087+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=HY5QEWK104NH tag=1P31VTV9XK3I type=write size=1263005 2024-09-12T00:37:49.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.089+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=FTEX9DQCCRJV type=del size=4046859 2024-09-12T00:37:49.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.090+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=3Q5049TG7TFI type=del 2024-09-12T00:37:49.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.092+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=5LDFPEJB5FQK type=del size=2774813 2024-09-12T00:37:49.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.094+0000 7fcd44281780 1 < suggested remove operation key=0OEDZ5O2LN8H tag=KZ7CMHAJUQRS type=del 2024-09-12T00:37:49.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.096+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=DXL63F6OFKJQ type=del size=598354 2024-09-12T00:37:49.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.097+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=JQ42IW6HY243 type=del 2024-09-12T00:37:49.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.099+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=JVP9DB8Z5CJJ type=del size=1398201 2024-09-12T00:37:49.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.100+0000 7fcd44281780 1 < completed write operation key=U4EPPPA4QGGD tag=Y4BATN8YFOC5 type=write size=998384 2024-09-12T00:37:49.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.102+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=HZAW47R6O467 type=del size=960657 2024-09-12T00:37:49.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.103+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~5KGPO1EUB0CT.0 size=1048576 2024-09-12T00:37:49.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.103+0000 7fcd44281780 1 < canceled part key=_multipart_WXBMIJ4FC0VX.2~5KGPO1EUB0CT.1 size=1048576 2024-09-12T00:37:49.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.104+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~5KGPO1EUB0CT.2 size=227518 2024-09-12T00:37:49.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.106+0000 7fcd44281780 1 < canceled multipart upload key=WXBMIJ4FC0VX upload=5KGPO1EUB0CT tag=AHOEFOAPXEDH type=write size=3373246 2024-09-12T00:37:49.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.108+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=3R5SPO1ACZM2 type=del size=554986 2024-09-12T00:37:49.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.109+0000 7fcd44281780 1 < completed delete operation key=8U004LC8IYLQ tag=Q3NVKZD4GSAW type=del 2024-09-12T00:37:49.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.111+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=3ZPDENB6S4HZ type=write size=845510 2024-09-12T00:37:49.111 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.112+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=ETT6H6XHCWPT type=del 2024-09-12T00:37:49.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.113+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=NWK18D080EN8 type=del size=1951683 2024-09-12T00:37:49.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.115+0000 7fcd44281780 -1 < failed to complete operation key=7UCICX0GHHQ1 tag=EYA3B4UQDMJJ type=write size=681176: (22) Invalid argument 2024-09-12T00:37:49.115 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.116+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=4K37KJSKL3ZD type=del size=1264959 2024-09-12T00:37:49.117 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.118+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=8VBZJLXSKS3M type=del 2024-09-12T00:37:49.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.121+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~C33JZSGOFD06.0 size=1048576 2024-09-12T00:37:49.120 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.122+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~C33JZSGOFD06.1 size=1048576 2024-09-12T00:37:49.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.123+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~C33JZSGOFD06.2 size=351776 2024-09-12T00:37:49.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.123+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=C33JZSGOFD06 tag=VDY2OP998GN8 type=write size=3497504 2024-09-12T00:37:49.123 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.124+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~L5X92TRPYOJX.0 size=1048576 2024-09-12T00:37:49.124 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.125+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~L5X92TRPYOJX.1 size=680026 2024-09-12T00:37:49.126 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.127+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=L5X92TRPYOJX tag=OCF2P71J9RNK type=write size=2777178 2024-09-12T00:37:49.128 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.129+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=8HQWHBGTLHK3 type=del size=3953739 2024-09-12T00:37:49.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.131+0000 7fcd44281780 1 < canceled operation key=QVULC3H9QGXE tag=IUE2AN3XYZIX type=del size=2724460 2024-09-12T00:37:49.131 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.132+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=9SZNCX3S28H3 type=del size=3064219 2024-09-12T00:37:49.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.134+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=10BREL4BBTO4 type=del 2024-09-12T00:37:49.134 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.135+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=X7HMUTTIOLHB type=write size=490174 2024-09-12T00:37:49.136 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.137+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~89299ZFROFCF.0 size=1048576 2024-09-12T00:37:49.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.138+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~89299ZFROFCF.1 size=1048576 2024-09-12T00:37:49.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.139+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~89299ZFROFCF.2 size=847599 2024-09-12T00:37:49.141 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.142+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=89299ZFROFCF tag=NCGHDA8X24KV type=write size=3993327 2024-09-12T00:37:49.142 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.143+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=D38VM97TXCO3 type=del size=16755 2024-09-12T00:37:49.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.145+0000 7fcd44281780 1 < canceled operation key=ZQSZDU87GAMV tag=T0K25QZXIXJM type=write size=415587 2024-09-12T00:37:49.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.146+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=2EBKJG3G0DTV type=del size=948279 2024-09-12T00:37:49.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.148+0000 7fcd44281780 1 < completed write operation key=XRW0CRE12S5B tag=61C7Y04LUM4R type=write size=829975 2024-09-12T00:37:49.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.150+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~1ZVHJTV0XGTA.0 size=1048576 2024-09-12T00:37:49.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.151+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~1ZVHJTV0XGTA.1 size=712278 2024-09-12T00:37:49.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.151+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=1ZVHJTV0XGTA tag=47RQJ2X6QC08 type=write size=2809430 2024-09-12T00:37:49.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.153+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=FTEX9DQCCRJV type=del 2024-09-12T00:37:49.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.156+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~R0Q28H0M516G.0 size=1048576 2024-09-12T00:37:49.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.157+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~R0Q28H0M516G.1 size=604934 2024-09-12T00:37:49.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.157+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=R0Q28H0M516G tag=XI31EABPOZV9 type=write size=2702086 2024-09-12T00:37:49.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.159+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=5LDFPEJB5FQK type=del 2024-09-12T00:37:49.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.161+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=ZBI0FCJVY2NC type=write size=672350 2024-09-12T00:37:49.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.162+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=DXL63F6OFKJQ type=del 2024-09-12T00:37:49.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.165+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~PVUI1ALUQMZX.0 size=1048576 2024-09-12T00:37:49.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.167+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~PVUI1ALUQMZX.1 size=398791 2024-09-12T00:37:49.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.167+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=PVUI1ALUQMZX tag=QFVX2PKSTEPL type=write size=2495943 2024-09-12T00:37:49.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.168+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=JVP9DB8Z5CJJ type=del 2024-09-12T00:37:49.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.171+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~O8EFABFSBD1R.0 size=1048576 2024-09-12T00:37:49.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.172+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~O8EFABFSBD1R.1 size=378853 2024-09-12T00:37:49.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.172+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=O8EFABFSBD1R tag=97WIP00LWEW8 type=write size=2476005 2024-09-12T00:37:49.174 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.175+0000 7fcd44281780 1 < suggested remove operation key=CF7B7J3V1YFG tag=HZAW47R6O467 type=del 2024-09-12T00:37:49.176 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.177+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~C6T0E6P03P25.0 size=335653 2024-09-12T00:37:49.176 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.177+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=C6T0E6P03P25 tag=CWAEPWUDCP5S type=write size=1384229 2024-09-12T00:37:49.178 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.179+0000 7fcd44281780 1 < completed delete operation key=4RU6HTH4J0U1 tag=3R5SPO1ACZM2 type=del 2024-09-12T00:37:49.180 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.182+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~0D2J88KP7S4F.0 size=1048576 2024-09-12T00:37:49.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.183+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~0D2J88KP7S4F.1 size=1048576 2024-09-12T00:37:49.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.184+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~0D2J88KP7S4F.2 size=335949 2024-09-12T00:37:49.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.184+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=0D2J88KP7S4F tag=Z7817M6D6E45 type=write size=3481677 2024-09-12T00:37:49.186 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.187+0000 7fcd44281780 1 < suggested update operation key=QVULC3H9QGXE tag=3ZPDENB6S4HZ type=write size=845510 2024-09-12T00:37:49.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.189+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=TDG1QIEBC5D6 type=del size=2999767 2024-09-12T00:37:49.189 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.190+0000 7fcd44281780 1 < completed delete operation key=0OEDZ5O2LN8H tag=NWK18D080EN8 type=del 2024-09-12T00:37:49.192 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.193+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~BHASTKHHNCIT.0 size=1048576 2024-09-12T00:37:49.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.194+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~BHASTKHHNCIT.1 size=968261 2024-09-12T00:37:49.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.194+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=BHASTKHHNCIT tag=A1X5KS8VONCX type=write size=3065413 2024-09-12T00:37:49.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.196+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=4K37KJSKL3ZD type=del 2024-09-12T00:37:49.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.198+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=66X1PDHLS6Y3 type=write size=309009 2024-09-12T00:37:49.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.200+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~C33JZSGOFD06.0 size=1048576 2024-09-12T00:37:49.200 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.201+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~C33JZSGOFD06.1 size=1048576 2024-09-12T00:37:49.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.202+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~C33JZSGOFD06.2 size=351776 2024-09-12T00:37:49.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.204+0000 7fcd44281780 1 < completed multipart upload key=4RU6HTH4J0U1 upload=C33JZSGOFD06 tag=VDY2OP998GN8 type=write size=3497504 2024-09-12T00:37:49.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.206+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=XP36O5WNOLGA type=del size=3314709 2024-09-12T00:37:49.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.207+0000 7fcd44281780 1 < completed delete operation key=4RU6HTH4J0U1 tag=8HQWHBGTLHK3 type=del 2024-09-12T00:37:49.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.210+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~R49DQUM8QMAK.0 size=1048576 2024-09-12T00:37:49.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.211+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~R49DQUM8QMAK.1 size=1048576 2024-09-12T00:37:49.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.212+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~R49DQUM8QMAK.2 size=699044 2024-09-12T00:37:49.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.212+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=R49DQUM8QMAK tag=Q8IX70ZDES6K type=write size=3844772 2024-09-12T00:37:49.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.215+0000 7fcd44281780 1 < suggested remove operation key=NIDHAXQF55WX tag=9SZNCX3S28H3 type=del 2024-09-12T00:37:49.215 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.216+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=J53BGI904ZAT type=del size=2559558 2024-09-12T00:37:49.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.217+0000 7fcd44281780 1 < completed write operation key=XRW0CRE12S5B tag=X7HMUTTIOLHB type=write size=490174 2024-09-12T00:37:49.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.218+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=XI4NIWZZJMBR type=del size=1675113 2024-09-12T00:37:49.220 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.221+0000 7fcd44281780 1 < suggested remove operation key=RYSE2CKE5IRT tag=D38VM97TXCO3 type=del 2024-09-12T00:37:49.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.224+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~MY6V3IJJMN4V.0 size=534212 2024-09-12T00:37:49.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.224+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=MY6V3IJJMN4V tag=XSV0W03W334G type=write size=1582788 2024-09-12T00:37:49.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.226+0000 7fcd44281780 1 < canceled operation key=Z6I6598B6J5I tag=2EBKJG3G0DTV type=del size=948279 2024-09-12T00:37:49.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.227+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=56D8CIZFJ1DM type=del size=918034 2024-09-12T00:37:49.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.229+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~1ZVHJTV0XGTA.0 size=1048576 2024-09-12T00:37:49.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.230+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~1ZVHJTV0XGTA.1 size=712278 2024-09-12T00:37:49.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.232+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=1ZVHJTV0XGTA tag=47RQJ2X6QC08 type=write size=2809430 2024-09-12T00:37:49.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.236+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~7EL7MY2WAE7L.0 size=118513 2024-09-12T00:37:49.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.236+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=7EL7MY2WAE7L tag=GM22BLSLGRO2 type=write size=1167089 2024-09-12T00:37:49.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.237+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~R0Q28H0M516G.0 size=1048576 2024-09-12T00:37:49.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.237+0000 7fcd44281780 1 < canceled part key=_multipart_KNBCXZF3JGNL.2~R0Q28H0M516G.1 size=604934 2024-09-12T00:37:49.238 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.239+0000 7fcd44281780 1 < canceled multipart upload key=KNBCXZF3JGNL upload=R0Q28H0M516G tag=XI31EABPOZV9 type=write size=2702086 2024-09-12T00:37:49.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.242+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~SC6WCO7CVC32.0 size=1048576 2024-09-12T00:37:49.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.243+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~SC6WCO7CVC32.1 size=207416 2024-09-12T00:37:49.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.243+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=SC6WCO7CVC32 tag=RX13YCT2QT8G type=write size=2304568 2024-09-12T00:37:49.243 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.244+0000 7fcd44281780 1 < completed write operation key=Z6I6598B6J5I tag=ZBI0FCJVY2NC type=write size=672350 2024-09-12T00:37:49.245 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.247+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~8WAJNEUEPTY7.0 size=1048576 2024-09-12T00:37:49.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.248+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~8WAJNEUEPTY7.1 size=1048576 2024-09-12T00:37:49.248 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.249+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~8WAJNEUEPTY7.2 size=482868 2024-09-12T00:37:49.248 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.249+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=8WAJNEUEPTY7 tag=7HH1G0X9V6YH type=write size=3628596 2024-09-12T00:37:49.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.250+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~PVUI1ALUQMZX.0 size=1048576 2024-09-12T00:37:49.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.251+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~PVUI1ALUQMZX.1 size=398791 2024-09-12T00:37:49.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.253+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=PVUI1ALUQMZX tag=QFVX2PKSTEPL type=write size=2495943 2024-09-12T00:37:49.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.255+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=902EWV9AM01U type=del size=2079887 2024-09-12T00:37:49.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.255+0000 7fcd44281780 1 < canceled part key=_multipart_XRW0CRE12S5B.2~O8EFABFSBD1R.0 size=1048576 2024-09-12T00:37:49.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.256+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~O8EFABFSBD1R.1 size=378853 2024-09-12T00:37:49.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.259+0000 7fcd44281780 1 < canceled multipart upload key=XRW0CRE12S5B upload=O8EFABFSBD1R tag=97WIP00LWEW8 type=write size=2476005 2024-09-12T00:37:49.260 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.261+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~6W64QXR2FASJ.0 size=1048576 2024-09-12T00:37:49.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.262+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~6W64QXR2FASJ.1 size=564908 2024-09-12T00:37:49.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.262+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=6W64QXR2FASJ tag=CJYUC77PT1JG type=write size=2662060 2024-09-12T00:37:49.262 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.264+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~C6T0E6P03P25.0 size=335653 2024-09-12T00:37:49.264 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.266+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=C6T0E6P03P25 tag=CWAEPWUDCP5S type=write size=1384229 2024-09-12T00:37:49.266 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.267+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=SS64KLU3KLVV type=del size=2348533 2024-09-12T00:37:49.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.268+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~0D2J88KP7S4F.0 size=1048576 2024-09-12T00:37:49.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.270+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~0D2J88KP7S4F.1 size=1048576 2024-09-12T00:37:49.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.271+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~0D2J88KP7S4F.2 size=335949 2024-09-12T00:37:49.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.273+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=0D2J88KP7S4F tag=Z7817M6D6E45 type=write size=3481677 2024-09-12T00:37:49.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.274+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=4VF451ILWDTC type=del size=1670345 2024-09-12T00:37:49.275 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.277+0000 7fcd44281780 1 < suggested update operation key=8U004LC8IYLQ tag=TDG1QIEBC5D6 type=del size=2999767 2024-09-12T00:37:49.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.278+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=4YF0AVXLR2H5 type=write size=61377 2024-09-12T00:37:49.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.279+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~BHASTKHHNCIT.0 size=1048576 2024-09-12T00:37:49.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.280+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~BHASTKHHNCIT.1 size=968261 2024-09-12T00:37:49.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.283+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=BHASTKHHNCIT tag=A1X5KS8VONCX type=write size=3065413 2024-09-12T00:37:49.284 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.285+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~IN8O4MXPJC41.0 size=1048576 2024-09-12T00:37:49.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.287+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~IN8O4MXPJC41.1 size=1048576 2024-09-12T00:37:49.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.287+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~IN8O4MXPJC41.2 size=289026 2024-09-12T00:37:49.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.287+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=IN8O4MXPJC41 tag=AG0CQIH3NNXB type=write size=3434754 2024-09-12T00:37:49.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.289+0000 7fcd44281780 1 < completed write operation key=B5OH55MQGSGJ tag=66X1PDHLS6Y3 type=write size=309009 2024-09-12T00:37:49.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.292+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~8W5QJOH2WXFR.0 size=1048576 2024-09-12T00:37:49.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.293+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~8W5QJOH2WXFR.1 size=1037791 2024-09-12T00:37:49.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.293+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=8W5QJOH2WXFR tag=BROHI5VS7H7I type=write size=3134943 2024-09-12T00:37:49.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.295+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=XP36O5WNOLGA type=del 2024-09-12T00:37:49.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.296+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=QWDF2GEFRZIB type=del size=2546049 2024-09-12T00:37:49.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.297+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~R49DQUM8QMAK.0 size=1048576 2024-09-12T00:37:49.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.299+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~R49DQUM8QMAK.1 size=1048576 2024-09-12T00:37:49.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.300+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~R49DQUM8QMAK.2 size=699044 2024-09-12T00:37:49.301 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.303+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=R49DQUM8QMAK tag=Q8IX70ZDES6K type=write size=3844772 2024-09-12T00:37:49.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.304+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=2P69J1IY2MZA type=del size=592251 2024-09-12T00:37:49.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.306+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=J53BGI904ZAT type=del 2024-09-12T00:37:49.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.308+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=SO9ZICYNQZOF type=write size=792671 2024-09-12T00:37:49.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.311+0000 7fcd44281780 1 < suggested update operation key=CF7B7J3V1YFG tag=XI4NIWZZJMBR type=del size=1675113 2024-09-12T00:37:49.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.312+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=VMSU94THBTU5 type=del size=1787523 2024-09-12T00:37:49.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.314+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~MY6V3IJJMN4V.0 size=534212 2024-09-12T00:37:49.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.316+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=MY6V3IJJMN4V tag=XSV0W03W334G type=write size=1582788 2024-09-12T00:37:49.316 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.318+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=66JB43VIOT6B type=del size=2765814 2024-09-12T00:37:49.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.321+0000 7fcd44281780 1 < suggested remove operation key=0O62FO4WVZG6 tag=56D8CIZFJ1DM type=del 2024-09-12T00:37:49.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.323+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~0RXXY1NIM5P8.0 size=1048576 2024-09-12T00:37:49.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.324+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~0RXXY1NIM5P8.1 size=1048576 2024-09-12T00:37:49.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.325+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~0RXXY1NIM5P8.2 size=41297 2024-09-12T00:37:49.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.325+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=0RXXY1NIM5P8 tag=A5JLCBZT1ZCB type=write size=3187025 2024-09-12T00:37:49.326 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.327+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~7EL7MY2WAE7L.0 size=118513 2024-09-12T00:37:49.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.329+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=7EL7MY2WAE7L tag=GM22BLSLGRO2 type=write size=1167089 2024-09-12T00:37:49.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.330+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=M6HHR8R47PYN type=del size=2395396 2024-09-12T00:37:49.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.332+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~SC6WCO7CVC32.0 size=1048576 2024-09-12T00:37:49.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.333+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~SC6WCO7CVC32.1 size=207416 2024-09-12T00:37:49.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.335+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=SC6WCO7CVC32 tag=RX13YCT2QT8G type=write size=2304568 2024-09-12T00:37:49.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.337+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=TDPPMZJ3WNSI type=del size=1187311 2024-09-12T00:37:49.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.338+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~8WAJNEUEPTY7.0 size=1048576 2024-09-12T00:37:49.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.339+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~8WAJNEUEPTY7.1 size=1048576 2024-09-12T00:37:49.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.341+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~8WAJNEUEPTY7.2 size=482868 2024-09-12T00:37:49.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.343+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=8WAJNEUEPTY7 tag=7HH1G0X9V6YH type=write size=3628596 2024-09-12T00:37:49.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.345+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=U5BKJPEA32RV type=del size=1566970 2024-09-12T00:37:49.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.347+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=902EWV9AM01U type=del 2024-09-12T00:37:49.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.349+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~MRYD6QV9AF98.0 size=911275 2024-09-12T00:37:49.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.349+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=MRYD6QV9AF98 tag=KJIUZR31NDUI type=write size=1959851 2024-09-12T00:37:49.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.351+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~6W64QXR2FASJ.0 size=1048576 2024-09-12T00:37:49.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.352+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~6W64QXR2FASJ.1 size=564908 2024-09-12T00:37:49.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.354+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=6W64QXR2FASJ tag=CJYUC77PT1JG type=write size=2662060 2024-09-12T00:37:49.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.356+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=LSZ7HF2MCQNE type=del size=2742676 2024-09-12T00:37:49.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.357+0000 7fcd44281780 -1 < failed to complete operation key=0O62FO4WVZG6 tag=SS64KLU3KLVV type=del size=2348533: (22) Invalid argument 2024-09-12T00:37:49.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.360+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~2MW0X8KJ50WA.0 size=1048576 2024-09-12T00:37:49.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.361+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~2MW0X8KJ50WA.1 size=174217 2024-09-12T00:37:49.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.361+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=2MW0X8KJ50WA tag=XNI9GZ4ZL6ZI type=write size=2271369 2024-09-12T00:37:49.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.363+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=4VF451ILWDTC type=del 2024-09-12T00:37:49.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.364+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=CIVF8DXTU7V1 type=del size=2310368 2024-09-12T00:37:49.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.366+0000 7fcd44281780 1 < completed write operation key=KJ0C43WLAFLI tag=4YF0AVXLR2H5 type=write size=61377 2024-09-12T00:37:49.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.368+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=KGKU0ALYIJBD type=del size=1789224 2024-09-12T00:37:49.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.369+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~IN8O4MXPJC41.0 size=1048576 2024-09-12T00:37:49.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.370+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~IN8O4MXPJC41.1 size=1048576 2024-09-12T00:37:49.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.371+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~IN8O4MXPJC41.2 size=289026 2024-09-12T00:37:49.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.374+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=IN8O4MXPJC41 tag=AG0CQIH3NNXB type=write size=3434754 2024-09-12T00:37:49.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.376+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~8E0SRBIG8C95.0 size=61143 2024-09-12T00:37:49.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.376+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=8E0SRBIG8C95 tag=G7Q4REC0P8GP type=write size=1109719 2024-09-12T00:37:49.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.377+0000 7fcd44281780 1 < canceled part key=_multipart_VXDTFEG8P23H.2~8W5QJOH2WXFR.0 size=1048576 2024-09-12T00:37:49.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.378+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~8W5QJOH2WXFR.1 size=1037791 2024-09-12T00:37:49.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.380+0000 7fcd44281780 1 < canceled multipart upload key=VXDTFEG8P23H upload=8W5QJOH2WXFR tag=BROHI5VS7H7I type=write size=3134943 2024-09-12T00:37:49.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.383+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~KQKL6OJGYK6A.0 size=1048576 2024-09-12T00:37:49.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.384+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~KQKL6OJGYK6A.1 size=260704 2024-09-12T00:37:49.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.384+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=KQKL6OJGYK6A tag=NDA4PX49A8U5 type=write size=2357856 2024-09-12T00:37:49.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.385+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=QWDF2GEFRZIB type=del 2024-09-12T00:37:49.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.387+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=ODAQO8KVH2IB type=del size=3546923 2024-09-12T00:37:49.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.390+0000 7fcd44281780 1 < suggested update operation key=IK8POOY7ZWNF tag=2P69J1IY2MZA type=del size=592251 2024-09-12T00:37:49.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.391+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=N23KRUQS2W1N type=write size=828604 2024-09-12T00:37:49.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.393+0000 7fcd44281780 1 < completed write operation key=U4EPPPA4QGGD tag=SO9ZICYNQZOF type=write size=792671 2024-09-12T00:37:49.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.395+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~YU4GJHSZ64C7.0 size=956531 2024-09-12T00:37:49.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.395+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=YU4GJHSZ64C7 tag=1OA0JRCHU5BJ type=write size=2005107 2024-09-12T00:37:49.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.397+0000 7fcd44281780 1 < completed delete operation key=8U004LC8IYLQ tag=VMSU94THBTU5 type=del 2024-09-12T00:37:49.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.398+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=9RM539CMMCMP type=del size=1224317 2024-09-12T00:37:49.399 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.400+0000 7fcd44281780 1 < completed delete operation key=UWS056JN3IXO tag=66JB43VIOT6B type=del 2024-09-12T00:37:49.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.401+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=4JRLIV3J9UMP type=del size=3277162 2024-09-12T00:37:49.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.403+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~0RXXY1NIM5P8.0 size=1048576 2024-09-12T00:37:49.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.404+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~0RXXY1NIM5P8.1 size=1048576 2024-09-12T00:37:49.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.405+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~0RXXY1NIM5P8.2 size=41297 2024-09-12T00:37:49.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.407+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=0RXXY1NIM5P8 tag=A5JLCBZT1ZCB type=write size=3187025 2024-09-12T00:37:49.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.408+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=80Q8VCBX2N62 type=del size=1997378 2024-09-12T00:37:49.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.410+0000 7fcd44281780 1 < canceled operation key=WXBMIJ4FC0VX tag=M6HHR8R47PYN type=del size=2395396 2024-09-12T00:37:49.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.411+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=XL96WLHEUAPW type=del size=1712762 2024-09-12T00:37:49.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.412+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=TDPPMZJ3WNSI type=del 2024-09-12T00:37:49.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.414+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=PITMD3SIUPJQ type=del size=2970106 2024-09-12T00:37:49.416 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.417+0000 7fcd44281780 1 < suggested remove operation key=KNBCXZF3JGNL tag=U5BKJPEA32RV type=del 2024-09-12T00:37:49.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.418+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=JRDY2STO0588 type=del size=3078823 2024-09-12T00:37:49.418 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.419+0000 7fcd44281780 1 < canceled part key=_multipart_AN6GRGZ22INA.2~MRYD6QV9AF98.0 size=911275 2024-09-12T00:37:49.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.421+0000 7fcd44281780 1 < canceled multipart upload key=AN6GRGZ22INA upload=MRYD6QV9AF98 tag=KJIUZR31NDUI type=write size=1959851 2024-09-12T00:37:49.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.422+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=LGKS2O3VXZOD type=del size=1345735 2024-09-12T00:37:49.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.424+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=LSZ7HF2MCQNE type=del 2024-09-12T00:37:49.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.425+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=R8J23JGL96FD type=del size=1558824 2024-09-12T00:37:49.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.427+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~2MW0X8KJ50WA.0 size=1048576 2024-09-12T00:37:49.427 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.428+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~2MW0X8KJ50WA.1 size=174217 2024-09-12T00:37:49.430 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.431+0000 7fcd44281780 1 < completed multipart upload key=B5OH55MQGSGJ upload=2MW0X8KJ50WA tag=XNI9GZ4ZL6ZI type=write size=2271369 2024-09-12T00:37:49.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.433+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~6RJVP22H3MJ8.0 size=1048576 2024-09-12T00:37:49.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.434+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~6RJVP22H3MJ8.1 size=1048576 2024-09-12T00:37:49.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.435+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~6RJVP22H3MJ8.2 size=94804 2024-09-12T00:37:49.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.436+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=6RJVP22H3MJ8 tag=IDGZICG2OYGV type=write size=3240532 2024-09-12T00:37:49.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.437+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=CIVF8DXTU7V1 type=del 2024-09-12T00:37:49.437 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.438+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=D86760QDQGEW type=del size=1629207 2024-09-12T00:37:49.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.439+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=KGKU0ALYIJBD type=del 2024-09-12T00:37:49.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.442+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~R7TX8THRH0YL.0 size=1048576 2024-09-12T00:37:49.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.443+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~R7TX8THRH0YL.1 size=316626 2024-09-12T00:37:49.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.443+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=R7TX8THRH0YL tag=0V86R3GG6KZZ type=write size=2413778 2024-09-12T00:37:49.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.445+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~8E0SRBIG8C95.0 size=61143 2024-09-12T00:37:49.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.447+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=8E0SRBIG8C95 tag=G7Q4REC0P8GP type=write size=1109719 2024-09-12T00:37:49.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.448+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=79HB7T0NUT71 type=del size=1670073 2024-09-12T00:37:49.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.449+0000 7fcd44281780 1 < canceled part key=_multipart_AJ5AUTM2J9MT.2~KQKL6OJGYK6A.0 size=1048576 2024-09-12T00:37:49.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.449+0000 7fcd44281780 1 < canceled part key=_multipart_AJ5AUTM2J9MT.2~KQKL6OJGYK6A.1 size=260704 2024-09-12T00:37:49.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.451+0000 7fcd44281780 1 < canceled multipart upload key=AJ5AUTM2J9MT upload=KQKL6OJGYK6A tag=NDA4PX49A8U5 type=write size=2357856 2024-09-12T00:37:49.451 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.452+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=KVII4NLK8P7Q type=del size=1031464 2024-09-12T00:37:49.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.455+0000 7fcd44281780 1 < suggested update operation key=NIDHAXQF55WX tag=ODAQO8KVH2IB type=del size=3546923 2024-09-12T00:37:49.455 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.456+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=N82KN2WTM5EB type=del size=573682 2024-09-12T00:37:49.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.458+0000 7fcd44281780 1 < completed write operation key=0ELZXPZCRPGP tag=N23KRUQS2W1N type=write size=828604 2024-09-12T00:37:49.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.461+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~JL1OVFEFZY8A.0 size=206926 2024-09-12T00:37:49.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.461+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=JL1OVFEFZY8A tag=ZFO9EUM3CNES type=write size=1255502 2024-09-12T00:37:49.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.461+0000 7fcd44281780 1 < canceled part key=_multipart_UXY6K0AVI4EK.2~YU4GJHSZ64C7.0 size=956531 2024-09-12T00:37:49.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.463+0000 7fcd44281780 1 < canceled multipart upload key=UXY6K0AVI4EK upload=YU4GJHSZ64C7 tag=1OA0JRCHU5BJ type=write size=2005107 2024-09-12T00:37:49.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.465+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~1NEEKT3U34YH.0 size=1048576 2024-09-12T00:37:49.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.466+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~1NEEKT3U34YH.1 size=1038165 2024-09-12T00:37:49.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.466+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=1NEEKT3U34YH tag=VHZKS21MFZXC type=write size=3135317 2024-09-12T00:37:49.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.468+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=9RM539CMMCMP type=del 2024-09-12T00:37:49.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.470+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~B05LDRUPEX3T.0 size=1048576 2024-09-12T00:37:49.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.471+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~B05LDRUPEX3T.1 size=368158 2024-09-12T00:37:49.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.471+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=B05LDRUPEX3T tag=RB2OE8S5NN8T type=write size=2465310 2024-09-12T00:37:49.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.473+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=4JRLIV3J9UMP type=del 2024-09-12T00:37:49.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.474+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=UJBRCMZBST5R type=del size=2866462 2024-09-12T00:37:49.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.476+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=80Q8VCBX2N62 type=del 2024-09-12T00:37:49.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.478+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~109AXTBI4G9E.0 size=1048576 2024-09-12T00:37:49.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.479+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~109AXTBI4G9E.1 size=912377 2024-09-12T00:37:49.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.479+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=109AXTBI4G9E tag=J2FZXC49EMR8 type=write size=3009529 2024-09-12T00:37:49.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.481+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=XL96WLHEUAPW type=del 2024-09-12T00:37:49.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.483+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=3R5GZ3C8LH1D type=del size=2948086 2024-09-12T00:37:49.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.485+0000 7fcd44281780 1 < suggested remove operation key=0O62FO4WVZG6 tag=PITMD3SIUPJQ type=del 2024-09-12T00:37:49.485 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.487+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=KRX8NSPL67X2 type=del size=2826470 2024-09-12T00:37:49.487 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.488+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=JRDY2STO0588 type=del 2024-09-12T00:37:49.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.490+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=GJ53OT2KOL7C type=del size=4188041 2024-09-12T00:37:49.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.493+0000 7fcd44281780 1 < suggested update operation key=4RU6HTH4J0U1 tag=LGKS2O3VXZOD type=del size=1345735 2024-09-12T00:37:49.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.495+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~TPZWKZPY7703.0 size=1048576 2024-09-12T00:37:49.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.496+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~TPZWKZPY7703.1 size=731921 2024-09-12T00:37:49.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.496+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=TPZWKZPY7703 tag=T579PEXVTGO0 type=write size=2829073 2024-09-12T00:37:49.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.499+0000 7fcd44281780 1 < suggested remove operation key=EXP8U6QNSMQ0 tag=R8J23JGL96FD type=del 2024-09-12T00:37:49.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.500+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=APXHWUHGWN4N type=del size=1402011 2024-09-12T00:37:49.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.501+0000 7fcd44281780 1 < canceled part key=_multipart_UWS056JN3IXO.2~6RJVP22H3MJ8.0 size=1048576 2024-09-12T00:37:49.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.502+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~6RJVP22H3MJ8.1 size=1048576 2024-09-12T00:37:49.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.503+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~6RJVP22H3MJ8.2 size=94804 2024-09-12T00:37:49.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.506+0000 7fcd44281780 1 < canceled multipart upload key=UWS056JN3IXO upload=6RJVP22H3MJ8 tag=IDGZICG2OYGV type=write size=3240532 2024-09-12T00:37:49.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.507+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=PWQ87LDRIQHE type=del size=3511442 2024-09-12T00:37:49.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.510+0000 7fcd44281780 1 < suggested remove operation key=CF7B7J3V1YFG tag=D86760QDQGEW type=del 2024-09-12T00:37:49.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.512+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=PZT1CDUJQU22 type=del size=2060629 2024-09-12T00:37:49.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.513+0000 7fcd44281780 1 < canceled part key=_multipart_AN6GRGZ22INA.2~R7TX8THRH0YL.0 size=1048576 2024-09-12T00:37:49.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.514+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~R7TX8THRH0YL.1 size=316626 2024-09-12T00:37:49.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.516+0000 7fcd44281780 1 < canceled multipart upload key=AN6GRGZ22INA upload=R7TX8THRH0YL tag=0V86R3GG6KZZ type=write size=2413778 2024-09-12T00:37:49.518 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.519+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~0B052EPKV6AX.0 size=1048576 2024-09-12T00:37:49.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.520+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~0B052EPKV6AX.1 size=1048576 2024-09-12T00:37:49.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.521+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~0B052EPKV6AX.2 size=633684 2024-09-12T00:37:49.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.521+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=0B052EPKV6AX tag=J482JNN45XQ1 type=write size=3779412 2024-09-12T00:37:49.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.523+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=79HB7T0NUT71 type=del 2024-09-12T00:37:49.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.526+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~5LEQL8CC97OG.0 size=1048576 2024-09-12T00:37:49.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.527+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~5LEQL8CC97OG.1 size=131082 2024-09-12T00:37:49.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.527+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=5LEQL8CC97OG tag=MR8RNCMZD922 type=write size=2228234 2024-09-12T00:37:49.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.528+0000 7fcd44281780 -1 < failed to complete operation key=0O62FO4WVZG6 tag=KVII4NLK8P7Q type=del size=1031464: (22) Invalid argument 2024-09-12T00:37:49.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.531+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~8EWIVX8OXURW.0 size=1048576 2024-09-12T00:37:49.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.532+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~8EWIVX8OXURW.1 size=981572 2024-09-12T00:37:49.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.532+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=8EWIVX8OXURW tag=G8PX6OMAMRVN type=write size=3078724 2024-09-12T00:37:49.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.533+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=N82KN2WTM5EB type=del 2024-09-12T00:37:49.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.536+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~SVKPRXOVC783.0 size=1048576 2024-09-12T00:37:49.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.537+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~SVKPRXOVC783.1 size=716988 2024-09-12T00:37:49.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.537+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=SVKPRXOVC783 tag=4Y233N44ZK4F type=write size=2814140 2024-09-12T00:37:49.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.538+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~JL1OVFEFZY8A.0 size=206926 2024-09-12T00:37:49.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.540+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=JL1OVFEFZY8A tag=ZFO9EUM3CNES type=write size=1255502 2024-09-12T00:37:49.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.543+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~VRF3WC00O0WF.0 size=1048576 2024-09-12T00:37:49.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.544+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~VRF3WC00O0WF.1 size=1048576 2024-09-12T00:37:49.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.545+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~VRF3WC00O0WF.2 size=475912 2024-09-12T00:37:49.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.545+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=VRF3WC00O0WF tag=RA6SQMGZBLCZ type=write size=3621640 2024-09-12T00:37:49.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.546+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~1NEEKT3U34YH.0 size=1048576 2024-09-12T00:37:49.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.547+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~1NEEKT3U34YH.1 size=1038165 2024-09-12T00:37:49.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.550+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=1NEEKT3U34YH tag=VHZKS21MFZXC type=write size=3135317 2024-09-12T00:37:49.550 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.551+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=Q8HQ9DFUQ2U5 type=del size=428579 2024-09-12T00:37:49.550 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.551+0000 7fcd44281780 1 < canceled part key=_multipart_B5OH55MQGSGJ.2~B05LDRUPEX3T.0 size=1048576 2024-09-12T00:37:49.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.552+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~B05LDRUPEX3T.1 size=368158 2024-09-12T00:37:49.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.554+0000 7fcd44281780 1 < canceled multipart upload key=B5OH55MQGSGJ upload=B05LDRUPEX3T tag=RB2OE8S5NN8T type=write size=2465310 2024-09-12T00:37:49.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.556+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=FA50QY3D5RS6 type=write size=1046537 2024-09-12T00:37:49.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.558+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=UJBRCMZBST5R type=del 2024-09-12T00:37:49.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.561+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~GFRZ796STXDL.0 size=1048576 2024-09-12T00:37:49.561 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.562+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~GFRZ796STXDL.1 size=1048576 2024-09-12T00:37:49.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.563+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~GFRZ796STXDL.2 size=619839 2024-09-12T00:37:49.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.563+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=GFRZ796STXDL tag=2LK3ORR4SNHF type=write size=3765567 2024-09-12T00:37:49.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.564+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~109AXTBI4G9E.0 size=1048576 2024-09-12T00:37:49.564 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.566+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~109AXTBI4G9E.1 size=912377 2024-09-12T00:37:49.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.567+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=109AXTBI4G9E tag=J2FZXC49EMR8 type=write size=3009529 2024-09-12T00:37:49.568 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.569+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=B6Q45HYDFXUA type=write size=357885 2024-09-12T00:37:49.570 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.571+0000 7fcd44281780 1 < suggested remove operation key=QVULC3H9QGXE tag=3R5GZ3C8LH1D type=del 2024-09-12T00:37:49.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.573+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=SLQ501H5WUM6 type=write size=136938 2024-09-12T00:37:49.573 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.574+0000 7fcd44281780 1 < completed delete operation key=KJ0C43WLAFLI tag=KRX8NSPL67X2 type=del 2024-09-12T00:37:49.574 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.576+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=S3TYCN9N5R1D type=del size=1944936 2024-09-12T00:37:49.576 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.577+0000 7fcd44281780 -1 < failed to complete operation key=QVULC3H9QGXE tag=GJ53OT2KOL7C type=del size=4188041: (22) Invalid argument 2024-09-12T00:37:49.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.578+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=GDB3MD2PXXPY type=write size=504239 2024-09-12T00:37:49.578 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.580+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~TPZWKZPY7703.0 size=1048576 2024-09-12T00:37:49.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.581+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~TPZWKZPY7703.1 size=731921 2024-09-12T00:37:49.581 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.583+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=TPZWKZPY7703 tag=T579PEXVTGO0 type=write size=2829073 2024-09-12T00:37:49.583 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.584+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=Y6ENGSV1DSFL type=del size=3171565 2024-09-12T00:37:49.584 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.585+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=APXHWUHGWN4N type=del 2024-09-12T00:37:49.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.587+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=NGDO7XBQ1OJT type=del size=608146 2024-09-12T00:37:49.590 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.591+0000 7fcd44281780 1 < suggested update operation key=B5OH55MQGSGJ tag=PWQ87LDRIQHE type=del size=3511442 2024-09-12T00:37:49.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.593+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~2CNM8HQTCF8S.0 size=1048576 2024-09-12T00:37:49.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.594+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~2CNM8HQTCF8S.1 size=168680 2024-09-12T00:37:49.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.594+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=2CNM8HQTCF8S tag=RY84ICXO3UV3 type=write size=2265832 2024-09-12T00:37:49.595 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.596+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=PZT1CDUJQU22 type=del 2024-09-12T00:37:49.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.597+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=JM7CUICQRKM1 type=del size=3923131 2024-09-12T00:37:49.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.599+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~0B052EPKV6AX.0 size=1048576 2024-09-12T00:37:49.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.600+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~0B052EPKV6AX.1 size=1048576 2024-09-12T00:37:49.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.601+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~0B052EPKV6AX.2 size=633684 2024-09-12T00:37:49.604 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.603+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=0B052EPKV6AX tag=J482JNN45XQ1 type=write size=3779412 2024-09-12T00:37:49.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.606+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~OCJ83BMT9F2N.0 size=1048576 2024-09-12T00:37:49.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.607+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~OCJ83BMT9F2N.1 size=285397 2024-09-12T00:37:49.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.607+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=OCJ83BMT9F2N tag=4PAJ3P0PM9W7 type=write size=2382549 2024-09-12T00:37:49.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.608+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~5LEQL8CC97OG.0 size=1048576 2024-09-12T00:37:49.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.609+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~5LEQL8CC97OG.1 size=131082 2024-09-12T00:37:49.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.611+0000 7fcd44281780 1 < completed multipart upload key=UWS056JN3IXO upload=5LEQL8CC97OG tag=MR8RNCMZD922 type=write size=2228234 2024-09-12T00:37:49.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.613+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=G5P9LRJ4NIDQ type=del size=3927455 2024-09-12T00:37:49.613 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.614+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~8EWIVX8OXURW.0 size=1048576 2024-09-12T00:37:49.614 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.615+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~8EWIVX8OXURW.1 size=981572 2024-09-12T00:37:49.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.617+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=8EWIVX8OXURW tag=G8PX6OMAMRVN type=write size=3078724 2024-09-12T00:37:49.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.619+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=V8VMG7FJVWCC type=write size=225792 2024-09-12T00:37:49.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.619+0000 7fcd44281780 1 < canceled part key=_multipart_Z6I6598B6J5I.2~SVKPRXOVC783.0 size=1048576 2024-09-12T00:37:49.619 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.620+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~SVKPRXOVC783.1 size=716988 2024-09-12T00:37:49.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.622+0000 7fcd44281780 1 < canceled multipart upload key=Z6I6598B6J5I upload=SVKPRXOVC783 tag=4Y233N44ZK4F type=write size=2814140 2024-09-12T00:37:49.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.624+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=O2JTFP9A114L type=del size=4057113 2024-09-12T00:37:49.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.626+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~VRF3WC00O0WF.0 size=1048576 2024-09-12T00:37:49.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.627+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~VRF3WC00O0WF.1 size=1048576 2024-09-12T00:37:49.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.628+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~VRF3WC00O0WF.2 size=475912 2024-09-12T00:37:49.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.630+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=VRF3WC00O0WF tag=RA6SQMGZBLCZ type=write size=3621640 2024-09-12T00:37:49.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.632+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=W9CASPODR8OD type=write size=548939 2024-09-12T00:37:49.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.633+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=Q8HQ9DFUQ2U5 type=del 2024-09-12T00:37:49.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.636+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~EV4MG6YZ1NWW.0 size=1048576 2024-09-12T00:37:49.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.637+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~EV4MG6YZ1NWW.1 size=21331 2024-09-12T00:37:49.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.637+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=EV4MG6YZ1NWW tag=IOYZUD14BV2I type=write size=2118483 2024-09-12T00:37:49.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.638+0000 7fcd44281780 1 < completed write operation key=VOO70F2NBKL0 tag=FA50QY3D5RS6 type=write size=1046537 2024-09-12T00:37:49.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.639+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=EYYYDC7MH8SY type=write size=1014228 2024-09-12T00:37:49.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.641+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~GFRZ796STXDL.0 size=1048576 2024-09-12T00:37:49.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.642+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~GFRZ796STXDL.1 size=1048576 2024-09-12T00:37:49.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.643+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~GFRZ796STXDL.2 size=619839 2024-09-12T00:37:49.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.645+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=GFRZ796STXDL tag=2LK3ORR4SNHF type=write size=3765567 2024-09-12T00:37:49.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.647+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=Q5OM8TV65XUQ type=del size=2487782 2024-09-12T00:37:49.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.649+0000 7fcd44281780 1 < completed write operation key=U4EPPPA4QGGD tag=B6Q45HYDFXUA type=write size=357885 2024-09-12T00:37:49.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.650+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=CBJG8FTNV5Q0 type=del size=3873330 2024-09-12T00:37:49.650 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.652+0000 7fcd44281780 1 < completed write operation key=RYSE2CKE5IRT tag=SLQ501H5WUM6 type=write size=136938 2024-09-12T00:37:49.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.653+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=LYGGDTBO1P5E type=write size=888298 2024-09-12T00:37:49.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.654+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=S3TYCN9N5R1D type=del 2024-09-12T00:37:49.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.656+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=HKH8F3BDH6W9 type=del size=1750090 2024-09-12T00:37:49.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.657+0000 7fcd44281780 1 < canceled operation key=VXDTFEG8P23H tag=GDB3MD2PXXPY type=write size=504239 2024-09-12T00:37:49.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.660+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~OTSXS9CIXNU8.0 size=251049 2024-09-12T00:37:49.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.660+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=OTSXS9CIXNU8 tag=R5DEO7WYKJ08 type=write size=1299625 2024-09-12T00:37:49.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.661+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=Y6ENGSV1DSFL type=del 2024-09-12T00:37:49.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.664+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~EDAAXSAFIV3Y.0 size=1048576 2024-09-12T00:37:49.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.665+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~EDAAXSAFIV3Y.1 size=523857 2024-09-12T00:37:49.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.665+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=EDAAXSAFIV3Y tag=WND59AWMLB3H type=write size=2621009 2024-09-12T00:37:49.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.667+0000 7fcd44281780 1 < suggested update operation key=KNBCXZF3JGNL tag=NGDO7XBQ1OJT type=del size=608146 2024-09-12T00:37:49.669 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.670+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~5CH96VA0MG34.0 size=1048576 2024-09-12T00:37:49.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.671+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~5CH96VA0MG34.1 size=72152 2024-09-12T00:37:49.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.671+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=5CH96VA0MG34 tag=N9ECCCDB5UHA type=write size=2169304 2024-09-12T00:37:49.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.673+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~2CNM8HQTCF8S.0 size=1048576 2024-09-12T00:37:49.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.673+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~2CNM8HQTCF8S.1 size=168680 2024-09-12T00:37:49.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.676+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=2CNM8HQTCF8S tag=RY84ICXO3UV3 type=write size=2265832 2024-09-12T00:37:49.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.677+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=ZLT29K4580IB type=del size=372924 2024-09-12T00:37:49.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.679+0000 7fcd44281780 1 < completed delete operation key=526O814C10YW tag=JM7CUICQRKM1 type=del 2024-09-12T00:37:49.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.681+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~Y57WDIGITGDJ.0 size=1048576 2024-09-12T00:37:49.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.683+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~Y57WDIGITGDJ.1 size=1048576 2024-09-12T00:37:49.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.684+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~Y57WDIGITGDJ.2 size=155258 2024-09-12T00:37:49.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.684+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=Y57WDIGITGDJ tag=45LY687CT3NZ type=write size=3300986 2024-09-12T00:37:49.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.685+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~OCJ83BMT9F2N.0 size=1048576 2024-09-12T00:37:49.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.688+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~OCJ83BMT9F2N.1 size=285397 2024-09-12T00:37:49.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.690+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=OCJ83BMT9F2N tag=4PAJ3P0PM9W7 type=write size=2382549 2024-09-12T00:37:49.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.691+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=JTAEN9ZKISFO type=del size=422482 2024-09-12T00:37:49.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.693+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=G5P9LRJ4NIDQ type=del 2024-09-12T00:37:49.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.696+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~WHZAVBJHQ3FH.0 size=1048576 2024-09-12T00:37:49.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.697+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~WHZAVBJHQ3FH.1 size=1048576 2024-09-12T00:37:49.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.698+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~WHZAVBJHQ3FH.2 size=533852 2024-09-12T00:37:49.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.698+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=WHZAVBJHQ3FH tag=A6WT95HCP9T6 type=write size=3679580 2024-09-12T00:37:49.698 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.699+0000 7fcd44281780 1 < completed write operation key=WXBMIJ4FC0VX tag=V8VMG7FJVWCC type=write size=225792 2024-09-12T00:37:49.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.700+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=RTBJQI4J2321 type=del size=3667982 2024-09-12T00:37:49.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.703+0000 7fcd44281780 1 < suggested remove operation key=0OEDZ5O2LN8H tag=O2JTFP9A114L type=del 2024-09-12T00:37:49.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.704+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=R9NWHCZHQ7TC type=del size=1490034 2024-09-12T00:37:49.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.705+0000 7fcd44281780 1 < canceled operation key=XRW0CRE12S5B tag=W9CASPODR8OD type=write size=548939 2024-09-12T00:37:49.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.706+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=AEZ9FHGQOEFZ type=write size=718243 2024-09-12T00:37:49.707 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.708+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~EV4MG6YZ1NWW.0 size=1048576 2024-09-12T00:37:49.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.709+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~EV4MG6YZ1NWW.1 size=21331 2024-09-12T00:37:49.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.711+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=EV4MG6YZ1NWW tag=IOYZUD14BV2I type=write size=2118483 2024-09-12T00:37:49.712 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.714+0000 7fcd44281780 1 > prepared part key=_multipart_UWS056JN3IXO.2~ALQ4672OHY8D.0 size=679445 2024-09-12T00:37:49.713 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.714+0000 7fcd44281780 1 > prepared multipart upload key=UWS056JN3IXO upload=ALQ4672OHY8D tag=01BPJDGTDROT type=write size=1728021 2024-09-12T00:37:49.714 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.715+0000 7fcd44281780 1 < completed write operation key=4RU6HTH4J0U1 tag=EYYYDC7MH8SY type=write size=1014228 2024-09-12T00:37:49.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.718+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~71O3QR5D20MB.0 size=737811 2024-09-12T00:37:49.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.718+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=71O3QR5D20MB tag=FNZ2K2H20HRL type=write size=1786387 2024-09-12T00:37:49.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.720+0000 7fcd44281780 1 < suggested remove operation key=8U004LC8IYLQ tag=Q5OM8TV65XUQ type=del 2024-09-12T00:37:49.722 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.723+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~UTB3746RVL8C.0 size=1048576 2024-09-12T00:37:49.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.724+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~UTB3746RVL8C.1 size=1048576 2024-09-12T00:37:49.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.725+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~UTB3746RVL8C.2 size=81619 2024-09-12T00:37:49.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.725+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=UTB3746RVL8C tag=TGO3X88Y3ELS type=write size=3227347 2024-09-12T00:37:49.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.727+0000 7fcd44281780 1 < canceled operation key=XRW0CRE12S5B tag=CBJG8FTNV5Q0 type=del size=3873330 2024-09-12T00:37:49.726 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.728+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=U3ICIKQM1B1K type=del size=963844 2024-09-12T00:37:49.728 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.729+0000 7fcd44281780 1 < completed write operation key=AJ5AUTM2J9MT tag=LYGGDTBO1P5E type=write size=888298 2024-09-12T00:37:49.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.730+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=XA1WS3S9D7NM type=write size=273144 2024-09-12T00:37:49.731 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.732+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=HKH8F3BDH6W9 type=del 2024-09-12T00:37:49.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.734+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~UZISJ4CEQVJ3.0 size=1048576 2024-09-12T00:37:49.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.735+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~UZISJ4CEQVJ3.1 size=1048576 2024-09-12T00:37:49.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.736+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~UZISJ4CEQVJ3.2 size=845553 2024-09-12T00:37:49.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.736+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=UZISJ4CEQVJ3 tag=3AR8D2EJJBSN type=write size=3991281 2024-09-12T00:37:49.736 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.738+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~OTSXS9CIXNU8.0 size=251049 2024-09-12T00:37:49.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.740+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=OTSXS9CIXNU8 tag=R5DEO7WYKJ08 type=write size=1299625 2024-09-12T00:37:49.741 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.742+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~JENLUZYFE75M.0 size=1048576 2024-09-12T00:37:49.742 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.743+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~JENLUZYFE75M.1 size=853696 2024-09-12T00:37:49.742 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.743+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=JENLUZYFE75M tag=XQ1WHD3FKNJK type=write size=2950848 2024-09-12T00:37:49.744 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.745+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~EDAAXSAFIV3Y.0 size=1048576 2024-09-12T00:37:49.745 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.746+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~EDAAXSAFIV3Y.1 size=523857 2024-09-12T00:37:49.747 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.748+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=EDAAXSAFIV3Y tag=WND59AWMLB3H type=write size=2621009 2024-09-12T00:37:49.748 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.750+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=ZGSLSW2XPLZB type=del size=2553523 2024-09-12T00:37:49.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.751+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~5CH96VA0MG34.0 size=1048576 2024-09-12T00:37:49.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.752+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~5CH96VA0MG34.1 size=72152 2024-09-12T00:37:49.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.755+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=5CH96VA0MG34 tag=N9ECCCDB5UHA type=write size=2169304 2024-09-12T00:37:49.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.758+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~TRGW951ETBP7.0 size=381812 2024-09-12T00:37:49.757 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.758+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=TRGW951ETBP7 tag=BSE87SQ9NKS5 type=write size=1430388 2024-09-12T00:37:49.758 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.759+0000 7fcd44281780 1 < completed delete operation key=G8O8VXTUPQVP tag=ZLT29K4580IB type=del 2024-09-12T00:37:49.761 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.762+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~HX9VNKZSL8XG.0 size=823516 2024-09-12T00:37:49.761 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.762+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=HX9VNKZSL8XG tag=9NESNFSDB4TM type=write size=1872092 2024-09-12T00:37:49.761 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.762+0000 7fcd44281780 1 < canceled part key=_multipart_AN6GRGZ22INA.2~Y57WDIGITGDJ.0 size=1048576 2024-09-12T00:37:49.762 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.763+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~Y57WDIGITGDJ.1 size=1048576 2024-09-12T00:37:49.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.765+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~Y57WDIGITGDJ.2 size=155258 2024-09-12T00:37:49.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.767+0000 7fcd44281780 1 < canceled multipart upload key=AN6GRGZ22INA upload=Y57WDIGITGDJ tag=45LY687CT3NZ type=write size=3300986 2024-09-12T00:37:49.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.769+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~HOWNPRBXC5KI.0 size=1048576 2024-09-12T00:37:49.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.770+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~HOWNPRBXC5KI.1 size=439462 2024-09-12T00:37:49.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.770+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=HOWNPRBXC5KI tag=EMVCQL7CKTET type=write size=2536614 2024-09-12T00:37:49.770 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.772+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=JTAEN9ZKISFO type=del 2024-09-12T00:37:49.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.774+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~3TZK5QCHT530.0 size=986923 2024-09-12T00:37:49.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.774+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=3TZK5QCHT530 tag=70W5LYFWPEO8 type=write size=2035499 2024-09-12T00:37:49.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.776+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~WHZAVBJHQ3FH.0 size=1048576 2024-09-12T00:37:49.776 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.777+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~WHZAVBJHQ3FH.1 size=1048576 2024-09-12T00:37:49.776 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.778+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~WHZAVBJHQ3FH.2 size=533852 2024-09-12T00:37:49.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.780+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=WHZAVBJHQ3FH tag=A6WT95HCP9T6 type=write size=3679580 2024-09-12T00:37:49.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.781+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=17TFRGHWFAKC type=del size=646729 2024-09-12T00:37:49.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.783+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=RTBJQI4J2321 type=del 2024-09-12T00:37:49.784 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.785+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~X5JU2D36QJ3Q.0 size=1048576 2024-09-12T00:37:49.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.786+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~X5JU2D36QJ3Q.1 size=135047 2024-09-12T00:37:49.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.786+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=X5JU2D36QJ3Q tag=Y0ODV4IP6V4K type=write size=2232199 2024-09-12T00:37:49.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.789+0000 7fcd44281780 1 < suggested update operation key=UWS056JN3IXO tag=R9NWHCZHQ7TC type=del size=1490034 2024-09-12T00:37:49.791 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.792+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~Z1130DVBWZNJ.0 size=1048576 2024-09-12T00:37:49.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.793+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~Z1130DVBWZNJ.1 size=136572 2024-09-12T00:37:49.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.793+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=Z1130DVBWZNJ tag=0OLAI2LA1QCH type=write size=2233724 2024-09-12T00:37:49.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.796+0000 7fcd44281780 1 < suggested remove operation key=Z6I6598B6J5I tag=AEZ9FHGQOEFZ type=write 2024-09-12T00:37:49.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.797+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=KG6J35D7FYMH type=del size=3539217 2024-09-12T00:37:49.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.799+0000 7fcd44281780 1 < completed part key=_multipart_UWS056JN3IXO.2~ALQ4672OHY8D.0 size=679445 2024-09-12T00:37:49.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.801+0000 7fcd44281780 1 < completed multipart upload key=UWS056JN3IXO upload=ALQ4672OHY8D tag=01BPJDGTDROT type=write size=1728021 2024-09-12T00:37:49.802 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.803+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~LA15KUC27OGO.0 size=377476 2024-09-12T00:37:49.802 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.803+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=LA15KUC27OGO tag=52JWYJFFYBB4 type=write size=1426052 2024-09-12T00:37:49.803 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.805+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~71O3QR5D20MB.0 size=737811 2024-09-12T00:37:49.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.807+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=71O3QR5D20MB tag=FNZ2K2H20HRL type=write size=1786387 2024-09-12T00:37:49.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.809+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=4R45GZXVSTXX type=del size=1055654 2024-09-12T00:37:49.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.810+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~UTB3746RVL8C.0 size=1048576 2024-09-12T00:37:49.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.811+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~UTB3746RVL8C.1 size=1048576 2024-09-12T00:37:49.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.813+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~UTB3746RVL8C.2 size=81619 2024-09-12T00:37:49.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.816+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=UTB3746RVL8C tag=TGO3X88Y3ELS type=write size=3227347 2024-09-12T00:37:49.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.817+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=AY0QQQ94Q1U9 type=write size=783751 2024-09-12T00:37:49.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.819+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=U3ICIKQM1B1K type=del 2024-09-12T00:37:49.820 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.822+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~0VB0RYBJSUZ9.0 size=1048576 2024-09-12T00:37:49.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.823+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~0VB0RYBJSUZ9.1 size=697189 2024-09-12T00:37:49.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.823+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=0VB0RYBJSUZ9 tag=I9G35OLQLMIU type=write size=2794341 2024-09-12T00:37:49.823 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.824+0000 7fcd44281780 1 < completed write operation key=KNBCXZF3JGNL tag=XA1WS3S9D7NM type=write size=273144 2024-09-12T00:37:49.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.827+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~9QKCTY11IT54.0 size=257462 2024-09-12T00:37:49.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.827+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=9QKCTY11IT54 tag=FOFH9W5T7WXF type=write size=1306038 2024-09-12T00:37:49.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.828+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~UZISJ4CEQVJ3.0 size=1048576 2024-09-12T00:37:49.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.829+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~UZISJ4CEQVJ3.1 size=1048576 2024-09-12T00:37:49.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.830+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~UZISJ4CEQVJ3.2 size=845553 2024-09-12T00:37:49.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.832+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=UZISJ4CEQVJ3 tag=3AR8D2EJJBSN type=write size=3991281 2024-09-12T00:37:49.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.834+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=MPMFYKTW0AV3 type=write size=360654 2024-09-12T00:37:49.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.835+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~JENLUZYFE75M.0 size=1048576 2024-09-12T00:37:49.835 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.836+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~JENLUZYFE75M.1 size=853696 2024-09-12T00:37:49.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.838+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=JENLUZYFE75M tag=XQ1WHD3FKNJK type=write size=2950848 2024-09-12T00:37:49.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.840+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=OPSIXDSYXK7W type=write size=73006 2024-09-12T00:37:49.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.841+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=ZGSLSW2XPLZB type=del 2024-09-12T00:37:49.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.844+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~QKQ3BVBP6CMT.0 size=1048576 2024-09-12T00:37:49.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.845+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~QKQ3BVBP6CMT.1 size=1048576 2024-09-12T00:37:49.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.846+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~QKQ3BVBP6CMT.2 size=806237 2024-09-12T00:37:49.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.846+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=QKQ3BVBP6CMT tag=UR1MBAUVTP20 type=write size=3951965 2024-09-12T00:37:49.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.848+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~TRGW951ETBP7.0 size=381812 2024-09-12T00:37:49.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.850+0000 7fcd44281780 1 < completed multipart upload key=526O814C10YW upload=TRGW951ETBP7 tag=BSE87SQ9NKS5 type=write size=1430388 2024-09-12T00:37:49.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.851+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=KMS3KHNLVIOB type=del size=325681 2024-09-12T00:37:49.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.853+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~HX9VNKZSL8XG.0 size=823516 2024-09-12T00:37:49.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.855+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=HX9VNKZSL8XG tag=9NESNFSDB4TM type=write size=1872092 2024-09-12T00:37:49.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.856+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=OWUQ855EBQ45 type=del size=579901 2024-09-12T00:37:49.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.858+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~HOWNPRBXC5KI.0 size=1048576 2024-09-12T00:37:49.857 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.859+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~HOWNPRBXC5KI.1 size=439462 2024-09-12T00:37:49.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.861+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=HOWNPRBXC5KI tag=EMVCQL7CKTET type=write size=2536614 2024-09-12T00:37:49.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.862+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=GNVMJ96ZHCQT type=write size=279638 2024-09-12T00:37:49.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.864+0000 7fcd44281780 1 < completed part key=_multipart_QVULC3H9QGXE.2~3TZK5QCHT530.0 size=986923 2024-09-12T00:37:49.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.866+0000 7fcd44281780 1 < completed multipart upload key=QVULC3H9QGXE upload=3TZK5QCHT530 tag=70W5LYFWPEO8 type=write size=2035499 2024-09-12T00:37:49.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.867+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=NF2A62IS8AP6 type=del size=3882825 2024-09-12T00:37:49.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.868+0000 7fcd44281780 1 < completed delete operation key=XTNXNF3D0HFK tag=17TFRGHWFAKC type=del 2024-09-12T00:37:49.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.870+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=8L102F0YTBVI type=del size=2959494 2024-09-12T00:37:49.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.871+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~X5JU2D36QJ3Q.0 size=1048576 2024-09-12T00:37:49.871 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.872+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~X5JU2D36QJ3Q.1 size=135047 2024-09-12T00:37:49.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.875+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=X5JU2D36QJ3Q tag=Y0ODV4IP6V4K type=write size=2232199 2024-09-12T00:37:49.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.876+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=J8CV3NMLO63C type=del size=98526 2024-09-12T00:37:49.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.876+0000 7fcd44281780 1 < canceled part key=_multipart_ZQSZDU87GAMV.2~Z1130DVBWZNJ.0 size=1048576 2024-09-12T00:37:49.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.877+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~Z1130DVBWZNJ.1 size=136572 2024-09-12T00:37:49.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.879+0000 7fcd44281780 1 < canceled multipart upload key=ZQSZDU87GAMV upload=Z1130DVBWZNJ tag=0OLAI2LA1QCH type=write size=2233724 2024-09-12T00:37:49.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.881+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=ITQ32OM78TT2 type=write size=203575 2024-09-12T00:37:49.883 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.883+0000 7fcd44281780 1 < suggested update operation key=CF7B7J3V1YFG tag=KG6J35D7FYMH type=del size=3539217 2024-09-12T00:37:49.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.886+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~BVIOLKTOPYKC.0 size=696541 2024-09-12T00:37:49.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.886+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=BVIOLKTOPYKC tag=TT9ODRSZZ7FJ type=write size=1745117 2024-09-12T00:37:49.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.887+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~LA15KUC27OGO.0 size=377476 2024-09-12T00:37:49.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.889+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=LA15KUC27OGO tag=52JWYJFFYBB4 type=write size=1426052 2024-09-12T00:37:49.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.892+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~K40HX6JKQ8I5.0 size=1048576 2024-09-12T00:37:49.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.893+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~K40HX6JKQ8I5.1 size=970377 2024-09-12T00:37:49.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.893+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=K40HX6JKQ8I5 tag=SDV23NEC946K type=write size=3067529 2024-09-12T00:37:49.893 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.894+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=4R45GZXVSTXX type=del 2024-09-12T00:37:49.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.896+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~B6BHSWC33DHP.0 size=198368 2024-09-12T00:37:49.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.896+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=B6BHSWC33DHP tag=8FWA3EX9DA5I type=write size=1246944 2024-09-12T00:37:49.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.898+0000 7fcd44281780 1 < completed write operation key=0ELZXPZCRPGP tag=AY0QQQ94Q1U9 type=write size=783751 2024-09-12T00:37:49.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.900+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~BR6YLG797WAF.0 size=1048576 2024-09-12T00:37:49.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.901+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~BR6YLG797WAF.1 size=1048576 2024-09-12T00:37:49.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.902+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~BR6YLG797WAF.2 size=445785 2024-09-12T00:37:49.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.902+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=BR6YLG797WAF tag=ZXXCVJWCE12V type=write size=3591513 2024-09-12T00:37:49.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.904+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~0VB0RYBJSUZ9.0 size=1048576 2024-09-12T00:37:49.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.905+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~0VB0RYBJSUZ9.1 size=697189 2024-09-12T00:37:49.906 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.907+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=0VB0RYBJSUZ9 tag=I9G35OLQLMIU type=write size=2794341 2024-09-12T00:37:49.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.909+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=JG5L4YLRSVWY type=del size=2877540 2024-09-12T00:37:49.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.909+0000 7fcd44281780 1 < canceled part key=_multipart_DKJ44Z9COIIK.2~9QKCTY11IT54.0 size=257462 2024-09-12T00:37:49.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.911+0000 7fcd44281780 1 < canceled multipart upload key=DKJ44Z9COIIK upload=9QKCTY11IT54 tag=FOFH9W5T7WXF type=write size=1306038 2024-09-12T00:37:49.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.914+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~9PRVY0JJYSY9.0 size=1048576 2024-09-12T00:37:49.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.915+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~9PRVY0JJYSY9.1 size=970089 2024-09-12T00:37:49.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.915+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=9PRVY0JJYSY9 tag=2DJ411CG9063 type=write size=3067241 2024-09-12T00:37:49.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.917+0000 7fcd44281780 1 < completed write operation key=RYSE2CKE5IRT tag=MPMFYKTW0AV3 type=write size=360654 2024-09-12T00:37:49.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.919+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~ICG8918CRW6F.0 size=1048576 2024-09-12T00:37:49.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.920+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~ICG8918CRW6F.1 size=1048576 2024-09-12T00:37:49.920 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.921+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~ICG8918CRW6F.2 size=314440 2024-09-12T00:37:49.920 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.921+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=ICG8918CRW6F tag=X7VM33XHSLFR type=write size=3460168 2024-09-12T00:37:49.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.924+0000 7fcd44281780 1 < suggested update operation key=AN6GRGZ22INA tag=OPSIXDSYXK7W type=write size=73006 2024-09-12T00:37:49.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.925+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=UH1N6PSK5KUS type=del size=3416554 2024-09-12T00:37:49.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.927+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~QKQ3BVBP6CMT.0 size=1048576 2024-09-12T00:37:49.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.928+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~QKQ3BVBP6CMT.1 size=1048576 2024-09-12T00:37:49.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.929+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~QKQ3BVBP6CMT.2 size=806237 2024-09-12T00:37:49.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.932+0000 7fcd44281780 1 < completed multipart upload key=ZQSZDU87GAMV upload=QKQ3BVBP6CMT tag=UR1MBAUVTP20 type=write size=3951965 2024-09-12T00:37:49.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.934+0000 7fcd44281780 1 > prepared operation key=XRW0CRE12S5B tag=RRO7WY31DGOG type=del size=715119 2024-09-12T00:37:49.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.935+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=KMS3KHNLVIOB type=del 2024-09-12T00:37:49.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.937+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=WNH3KMDDT5IG type=del size=1519726 2024-09-12T00:37:49.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.938+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=OWUQ855EBQ45 type=del 2024-09-12T00:37:49.941 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.942+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~QV2KFOIZVW7K.0 size=1048576 2024-09-12T00:37:49.942 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.944+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~QV2KFOIZVW7K.1 size=1048576 2024-09-12T00:37:49.943 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.944+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~QV2KFOIZVW7K.2 size=219856 2024-09-12T00:37:49.943 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.944+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=QV2KFOIZVW7K tag=5JB0T7002ZDB type=write size=3365584 2024-09-12T00:37:49.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.946+0000 7fcd44281780 1 < completed write operation key=G8O8VXTUPQVP tag=GNVMJ96ZHCQT type=write size=279638 2024-09-12T00:37:49.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.947+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=6IT3GRJNAKGB type=write size=491323 2024-09-12T00:37:49.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.949+0000 7fcd44281780 1 < completed delete operation key=0OEDZ5O2LN8H tag=NF2A62IS8AP6 type=del 2024-09-12T00:37:49.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.950+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=EEUOW1GPYP3A type=del size=561750 2024-09-12T00:37:49.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.952+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=8L102F0YTBVI type=del 2024-09-12T00:37:49.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.953+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=A6HQXY73S7NF type=del size=1010831 2024-09-12T00:37:49.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.955+0000 7fcd44281780 1 < completed delete operation key=QVULC3H9QGXE tag=J8CV3NMLO63C type=del 2024-09-12T00:37:49.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.956+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=OD0KB98QVUMW type=del size=2227320 2024-09-12T00:37:49.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.958+0000 7fcd44281780 1 < completed write operation key=U4EPPPA4QGGD tag=ITQ32OM78TT2 type=write size=203575 2024-09-12T00:37:49.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.959+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=EE7Z11L1IAOB type=del size=2653688 2024-09-12T00:37:49.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.961+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~BVIOLKTOPYKC.0 size=696541 2024-09-12T00:37:49.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.963+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=BVIOLKTOPYKC tag=TT9ODRSZZ7FJ type=write size=1745117 2024-09-12T00:37:49.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.965+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=AEOD555V2HDA type=del size=2975254 2024-09-12T00:37:49.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.966+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~K40HX6JKQ8I5.0 size=1048576 2024-09-12T00:37:49.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.967+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~K40HX6JKQ8I5.1 size=970377 2024-09-12T00:37:49.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.969+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=K40HX6JKQ8I5 tag=SDV23NEC946K type=write size=3067529 2024-09-12T00:37:49.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.971+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=F8H1HI5JRIXE type=del size=4167717 2024-09-12T00:37:49.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.972+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~B6BHSWC33DHP.0 size=198368 2024-09-12T00:37:49.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.974+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=B6BHSWC33DHP tag=8FWA3EX9DA5I type=write size=1246944 2024-09-12T00:37:49.974 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.976+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=6EKU992ING40 type=del size=4098539 2024-09-12T00:37:49.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.977+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~BR6YLG797WAF.0 size=1048576 2024-09-12T00:37:49.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.977+0000 7fcd44281780 1 < canceled part key=_multipart_IK8POOY7ZWNF.2~BR6YLG797WAF.1 size=1048576 2024-09-12T00:37:49.977 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.978+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~BR6YLG797WAF.2 size=445785 2024-09-12T00:37:49.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.981+0000 7fcd44281780 1 < canceled multipart upload key=IK8POOY7ZWNF upload=BR6YLG797WAF tag=ZXXCVJWCE12V type=write size=3591513 2024-09-12T00:37:49.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.983+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~D46G12TLZW0Q.0 size=1048576 2024-09-12T00:37:49.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.984+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~D46G12TLZW0Q.1 size=1048576 2024-09-12T00:37:49.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.985+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~D46G12TLZW0Q.2 size=339095 2024-09-12T00:37:49.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.985+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=D46G12TLZW0Q tag=4N4CS7SJRY7E type=write size=3484823 2024-09-12T00:37:49.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.987+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=JG5L4YLRSVWY type=del 2024-09-12T00:37:49.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.988+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=VX07WXE6B1GU type=del size=3269810 2024-09-12T00:37:49.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.990+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~9PRVY0JJYSY9.0 size=1048576 2024-09-12T00:37:49.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.991+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~9PRVY0JJYSY9.1 size=970089 2024-09-12T00:37:49.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.993+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=9PRVY0JJYSY9 tag=2DJ411CG9063 type=write size=3067241 2024-09-12T00:37:49.993 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.994+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=9J7VRACYQ20O type=del size=2054480 2024-09-12T00:37:49.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.996+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~ICG8918CRW6F.0 size=1048576 2024-09-12T00:37:49.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.997+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~ICG8918CRW6F.1 size=1048576 2024-09-12T00:37:49.997 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:49.998+0000 7fcd44281780 1 < completed part key=_multipart_NIDHAXQF55WX.2~ICG8918CRW6F.2 size=314440 2024-09-12T00:37:49.999 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.000+0000 7fcd44281780 1 < completed multipart upload key=NIDHAXQF55WX upload=ICG8918CRW6F tag=X7VM33XHSLFR type=write size=3460168 2024-09-12T00:37:50.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.001+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=YRTDUCNA3E2W type=del size=3817709 2024-09-12T00:37:50.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.003+0000 7fcd44281780 1 < canceled operation key=CF7B7J3V1YFG tag=UH1N6PSK5KUS type=del size=3416554 2024-09-12T00:37:50.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.005+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~0ZO9TZVB8RNL.0 size=983918 2024-09-12T00:37:50.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.005+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=0ZO9TZVB8RNL tag=RR3BE9819GVQ type=write size=2032494 2024-09-12T00:37:50.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.007+0000 7fcd44281780 1 < completed delete operation key=XRW0CRE12S5B tag=RRO7WY31DGOG type=del 2024-09-12T00:37:50.007 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.009+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=MOW327KJ4JZP type=del size=3542359 2024-09-12T00:37:50.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.010+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=WNH3KMDDT5IG type=del 2024-09-12T00:37:50.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.011+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=GIV3TSIXJ34H type=del size=1319075 2024-09-12T00:37:50.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.013+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~QV2KFOIZVW7K.0 size=1048576 2024-09-12T00:37:50.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.014+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~QV2KFOIZVW7K.1 size=1048576 2024-09-12T00:37:50.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.015+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~QV2KFOIZVW7K.2 size=219856 2024-09-12T00:37:50.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.018+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=QV2KFOIZVW7K tag=5JB0T7002ZDB type=write size=3365584 2024-09-12T00:37:50.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.020+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~A2STYCO4CNG7.0 size=548005 2024-09-12T00:37:50.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.020+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=A2STYCO4CNG7 tag=ACCYGJ7G9ZXD type=write size=1596581 2024-09-12T00:37:50.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.023+0000 7fcd44281780 1 < suggested update operation key=0O62FO4WVZG6 tag=6IT3GRJNAKGB type=write size=491323 2024-09-12T00:37:50.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.026+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~IYO6KJMJF31X.0 size=896180 2024-09-12T00:37:50.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.026+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=IYO6KJMJF31X tag=WP4BQQRYOWY3 type=write size=1944756 2024-09-12T00:37:50.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.027+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=EEUOW1GPYP3A type=del 2024-09-12T00:37:50.029 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.030+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~5GEWIHKSEA4J.0 size=1048576 2024-09-12T00:37:50.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.031+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~5GEWIHKSEA4J.1 size=434867 2024-09-12T00:37:50.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.031+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=5GEWIHKSEA4J tag=I1ST3FP27VUT type=write size=2532019 2024-09-12T00:37:50.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.034+0000 7fcd44281780 1 < suggested remove operation key=0ELZXPZCRPGP tag=A6HQXY73S7NF type=del 2024-09-12T00:37:50.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.035+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=ARXU9NV7KKAF type=del size=1093679 2024-09-12T00:37:50.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.037+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=OD0KB98QVUMW type=del 2024-09-12T00:37:50.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.038+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=QK0QK50XQHOR type=del size=986440 2024-09-12T00:37:50.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.040+0000 7fcd44281780 1 < canceled operation key=0OEDZ5O2LN8H tag=EE7Z11L1IAOB type=del size=2653688 2024-09-12T00:37:50.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.041+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=ELCTGP86PZ9D type=write size=130009 2024-09-12T00:37:50.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.043+0000 7fcd44281780 1 < completed delete operation key=XTNXNF3D0HFK tag=AEOD555V2HDA type=del 2024-09-12T00:37:50.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.044+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=9BPX52HQMIVC type=write size=667594 2024-09-12T00:37:50.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.046+0000 7fcd44281780 1 < completed delete operation key=7UCICX0GHHQ1 tag=F8H1HI5JRIXE type=del 2024-09-12T00:37:50.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.049+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~36TH7KV5JGZS.0 size=1048576 2024-09-12T00:37:50.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.050+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~36TH7KV5JGZS.1 size=1048576 2024-09-12T00:37:50.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.051+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~36TH7KV5JGZS.2 size=475894 2024-09-12T00:37:50.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.051+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=36TH7KV5JGZS tag=8HWIEI288N5C type=write size=3621622 2024-09-12T00:37:50.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.052+0000 7fcd44281780 -1 < failed to complete operation key=0O62FO4WVZG6 tag=6EKU992ING40 type=del size=4098539: (22) Invalid argument 2024-09-12T00:37:50.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.054+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=V8L9I9HL1G2Z type=del size=446210 2024-09-12T00:37:50.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.056+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~D46G12TLZW0Q.0 size=1048576 2024-09-12T00:37:50.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.057+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~D46G12TLZW0Q.1 size=1048576 2024-09-12T00:37:50.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.058+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~D46G12TLZW0Q.2 size=339095 2024-09-12T00:37:50.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.061+0000 7fcd44281780 1 < completed multipart upload key=4RU6HTH4J0U1 upload=D46G12TLZW0Q tag=4N4CS7SJRY7E type=write size=3484823 2024-09-12T00:37:50.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.063+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~WW9MBE778RFM.0 size=686300 2024-09-12T00:37:50.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.063+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=WW9MBE778RFM tag=HHR5UTFV13FP type=write size=1734876 2024-09-12T00:37:50.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.066+0000 7fcd44281780 1 < suggested remove operation key=AJ5AUTM2J9MT tag=VX07WXE6B1GU type=del 2024-09-12T00:37:50.066 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.067+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=RK39DDAOBEXJ type=del size=3484442 2024-09-12T00:37:50.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.070+0000 7fcd44281780 1 < suggested remove operation key=4RU6HTH4J0U1 tag=9J7VRACYQ20O type=del 2024-09-12T00:37:50.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.073+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~RFFHTQEZMKEI.0 size=167572 2024-09-12T00:37:50.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.073+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=RFFHTQEZMKEI tag=XELLEW2ZQD23 type=write size=1216148 2024-09-12T00:37:50.073 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.075+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=YRTDUCNA3E2W type=del 2024-09-12T00:37:50.076 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.077+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=R651EETVUIYZ type=write size=976383 2024-09-12T00:37:50.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.079+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~0ZO9TZVB8RNL.0 size=983918 2024-09-12T00:37:50.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.083+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=0ZO9TZVB8RNL tag=RR3BE9819GVQ type=write size=2032494 2024-09-12T00:37:50.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.085+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~E3U3IN1K30KH.0 size=1048576 2024-09-12T00:37:50.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.086+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~E3U3IN1K30KH.1 size=757691 2024-09-12T00:37:50.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.086+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=E3U3IN1K30KH tag=PL11M1CLOG1V type=write size=2854843 2024-09-12T00:37:50.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.089+0000 7fcd44281780 1 < suggested remove operation key=KJ0C43WLAFLI tag=MOW327KJ4JZP type=del 2024-09-12T00:37:50.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.092+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~LJNPI4LFB7FO.0 size=1048576 2024-09-12T00:37:50.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.092+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~LJNPI4LFB7FO.1 size=1048576 2024-09-12T00:37:50.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.094+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~LJNPI4LFB7FO.2 size=273155 2024-09-12T00:37:50.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.094+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=LJNPI4LFB7FO tag=BJ7BXWTKVYRA type=write size=3418883 2024-09-12T00:37:50.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.095+0000 7fcd44281780 1 < canceled operation key=VXDTFEG8P23H tag=GIV3TSIXJ34H type=del size=1319075 2024-09-12T00:37:50.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.098+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~XDD13D9UITNN.0 size=1048576 2024-09-12T00:37:50.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.099+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~XDD13D9UITNN.1 size=696110 2024-09-12T00:37:50.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.099+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=XDD13D9UITNN tag=D81MM1GUDGRJ type=write size=2793262 2024-09-12T00:37:50.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.099+0000 7fcd44281780 1 < canceled part key=_multipart_0ELZXPZCRPGP.2~A2STYCO4CNG7.0 size=548005 2024-09-12T00:37:50.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.102+0000 7fcd44281780 1 < canceled multipart upload key=0ELZXPZCRPGP upload=A2STYCO4CNG7 tag=ACCYGJ7G9ZXD type=write size=1596581 2024-09-12T00:37:50.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.104+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~R39YR8JNUH2T.0 size=266424 2024-09-12T00:37:50.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.104+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=R39YR8JNUH2T tag=JEUKKEDWBN9U type=write size=1315000 2024-09-12T00:37:50.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.105+0000 7fcd44281780 1 < canceled part key=_multipart_VOO70F2NBKL0.2~IYO6KJMJF31X.0 size=896180 2024-09-12T00:37:50.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.107+0000 7fcd44281780 1 < canceled multipart upload key=VOO70F2NBKL0 upload=IYO6KJMJF31X tag=WP4BQQRYOWY3 type=write size=1944756 2024-09-12T00:37:50.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.109+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~2E4LVD9Z20I2.0 size=1048576 2024-09-12T00:37:50.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.110+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~2E4LVD9Z20I2.1 size=564015 2024-09-12T00:37:50.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.110+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=2E4LVD9Z20I2 tag=3FZUDIJEPQPG type=write size=2661167 2024-09-12T00:37:50.111 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.112+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~5GEWIHKSEA4J.0 size=1048576 2024-09-12T00:37:50.111 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.112+0000 7fcd44281780 1 < canceled part key=_multipart_CF7B7J3V1YFG.2~5GEWIHKSEA4J.1 size=434867 2024-09-12T00:37:50.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.114+0000 7fcd44281780 1 < canceled multipart upload key=CF7B7J3V1YFG upload=5GEWIHKSEA4J tag=I1ST3FP27VUT type=write size=2532019 2024-09-12T00:37:50.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.117+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~Y123H2H5FA3X.0 size=1048576 2024-09-12T00:37:50.117 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.118+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~Y123H2H5FA3X.1 size=1048576 2024-09-12T00:37:50.118 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.119+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~Y123H2H5FA3X.2 size=125021 2024-09-12T00:37:50.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.119+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=Y123H2H5FA3X tag=B43T3XCR1DBU type=write size=3270749 2024-09-12T00:37:50.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.120+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=ARXU9NV7KKAF type=del 2024-09-12T00:37:50.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.123+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~7NVDQ0UUEPO4.0 size=399938 2024-09-12T00:37:50.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.123+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=7NVDQ0UUEPO4 tag=5FH5J1873R2J type=write size=1448514 2024-09-12T00:37:50.123 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.124+0000 7fcd44281780 1 < canceled operation key=KNBCXZF3JGNL tag=QK0QK50XQHOR type=del size=986440 2024-09-12T00:37:50.125 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.126+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=UPMUJB3ISDH1 type=del size=3759508 2024-09-12T00:37:50.126 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.127+0000 7fcd44281780 1 < completed write operation key=XTNXNF3D0HFK tag=ELCTGP86PZ9D type=write size=130009 2024-09-12T00:37:50.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.129+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=R5TUOGYD2CCL type=del size=3005744 2024-09-12T00:37:50.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.130+0000 7fcd44281780 1 < completed write operation key=0OEDZ5O2LN8H tag=9BPX52HQMIVC type=write size=667594 2024-09-12T00:37:50.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.131+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=CUY6NXR9V09G type=del size=1769235 2024-09-12T00:37:50.132 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.133+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~36TH7KV5JGZS.0 size=1048576 2024-09-12T00:37:50.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.134+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~36TH7KV5JGZS.1 size=1048576 2024-09-12T00:37:50.134 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.135+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~36TH7KV5JGZS.2 size=475894 2024-09-12T00:37:50.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.138+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=36TH7KV5JGZS tag=8HWIEI288N5C type=write size=3621622 2024-09-12T00:37:50.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.139+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=MJHTBV0NDK9A type=del size=1716714 2024-09-12T00:37:50.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.141+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=V8L9I9HL1G2Z type=del 2024-09-12T00:37:50.142 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.143+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~N00Q6XJF5FOD.0 size=1048576 2024-09-12T00:37:50.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.144+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~N00Q6XJF5FOD.1 size=1048576 2024-09-12T00:37:50.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.145+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~N00Q6XJF5FOD.2 size=902509 2024-09-12T00:37:50.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.145+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=N00Q6XJF5FOD tag=ZW8L5EAYSQ0N type=write size=4048237 2024-09-12T00:37:50.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.145+0000 7fcd44281780 1 < canceled part key=_multipart_VOO70F2NBKL0.2~WW9MBE778RFM.0 size=686300 2024-09-12T00:37:50.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.148+0000 7fcd44281780 1 < canceled multipart upload key=VOO70F2NBKL0 upload=WW9MBE778RFM tag=HHR5UTFV13FP type=write size=1734876 2024-09-12T00:37:50.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.149+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=YW1MJ57IZ8BY type=del size=3037991 2024-09-12T00:37:50.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.150+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=RK39DDAOBEXJ type=del 2024-09-12T00:37:50.151 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.152+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=UVFKR0T7WOLD type=del size=2159748 2024-09-12T00:37:50.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.153+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~RFFHTQEZMKEI.0 size=167572 2024-09-12T00:37:50.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.155+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=RFFHTQEZMKEI tag=XELLEW2ZQD23 type=write size=1216148 2024-09-12T00:37:50.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.158+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~VPNV6EB4VUNT.0 size=1048576 2024-09-12T00:37:50.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.159+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~VPNV6EB4VUNT.1 size=1048576 2024-09-12T00:37:50.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.160+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~VPNV6EB4VUNT.2 size=208005 2024-09-12T00:37:50.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.160+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=VPNV6EB4VUNT tag=1UY5CFGCANXT type=write size=3353733 2024-09-12T00:37:50.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.161+0000 7fcd44281780 1 < completed write operation key=7UCICX0GHHQ1 tag=R651EETVUIYZ type=write size=976383 2024-09-12T00:37:50.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.163+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=Z13CRMBWAUQU type=del size=1644747 2024-09-12T00:37:50.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.164+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~E3U3IN1K30KH.0 size=1048576 2024-09-12T00:37:50.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.165+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~E3U3IN1K30KH.1 size=757691 2024-09-12T00:37:50.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.167+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=E3U3IN1K30KH tag=PL11M1CLOG1V type=write size=2854843 2024-09-12T00:37:50.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.170+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~WRP0NR8TR821.0 size=1042234 2024-09-12T00:37:50.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.170+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=WRP0NR8TR821 tag=ERL73EOQQXW4 type=write size=2090810 2024-09-12T00:37:50.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.171+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~LJNPI4LFB7FO.0 size=1048576 2024-09-12T00:37:50.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.172+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~LJNPI4LFB7FO.1 size=1048576 2024-09-12T00:37:50.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.172+0000 7fcd44281780 1 < canceled part key=_multipart_4RU6HTH4J0U1.2~LJNPI4LFB7FO.2 size=273155 2024-09-12T00:37:50.173 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.174+0000 7fcd44281780 1 < canceled multipart upload key=4RU6HTH4J0U1 upload=LJNPI4LFB7FO tag=BJ7BXWTKVYRA type=write size=3418883 2024-09-12T00:37:50.175 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.177+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~3EIMVR83X1OR.0 size=935450 2024-09-12T00:37:50.176 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.177+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=3EIMVR83X1OR tag=3KGSZXB9HUR0 type=write size=1984026 2024-09-12T00:37:50.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.178+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~XDD13D9UITNN.0 size=1048576 2024-09-12T00:37:50.178 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.179+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~XDD13D9UITNN.1 size=696110 2024-09-12T00:37:50.180 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.182+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=XDD13D9UITNN tag=D81MM1GUDGRJ type=write size=2793262 2024-09-12T00:37:50.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.184+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~O7SORY60D2JE.0 size=742923 2024-09-12T00:37:50.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.184+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=O7SORY60D2JE tag=TE34L083V1Y6 type=write size=1791499 2024-09-12T00:37:50.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.185+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~R39YR8JNUH2T.0 size=266424 2024-09-12T00:37:50.186 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.187+0000 7fcd44281780 1 < completed multipart upload key=B5OH55MQGSGJ upload=R39YR8JNUH2T tag=JEUKKEDWBN9U type=write size=1315000 2024-09-12T00:37:50.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.189+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=HB3WFRLSY1U3 type=del size=585129 2024-09-12T00:37:50.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.189+0000 7fcd44281780 1 < canceled part key=_multipart_Z6I6598B6J5I.2~2E4LVD9Z20I2.0 size=1048576 2024-09-12T00:37:50.189 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.190+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~2E4LVD9Z20I2.1 size=564015 2024-09-12T00:37:50.191 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.192+0000 7fcd44281780 1 < canceled multipart upload key=Z6I6598B6J5I upload=2E4LVD9Z20I2 tag=3FZUDIJEPQPG type=write size=2661167 2024-09-12T00:37:50.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.194+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=1HEKR7X47IR1 type=del size=3961644 2024-09-12T00:37:50.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.196+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~Y123H2H5FA3X.0 size=1048576 2024-09-12T00:37:50.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.196+0000 7fcd44281780 1 < canceled part key=_multipart_Z6I6598B6J5I.2~Y123H2H5FA3X.1 size=1048576 2024-09-12T00:37:50.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.197+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~Y123H2H5FA3X.2 size=125021 2024-09-12T00:37:50.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.199+0000 7fcd44281780 1 < canceled multipart upload key=Z6I6598B6J5I upload=Y123H2H5FA3X tag=B43T3XCR1DBU type=write size=3270749 2024-09-12T00:37:50.200 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.201+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~SY22EAW5DEY6.0 size=332397 2024-09-12T00:37:50.200 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.201+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=SY22EAW5DEY6 tag=Y9T7RSIEX0V7 type=write size=1380973 2024-09-12T00:37:50.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.203+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~7NVDQ0UUEPO4.0 size=399938 2024-09-12T00:37:50.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.206+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=7NVDQ0UUEPO4 tag=5FH5J1873R2J type=write size=1448514 2024-09-12T00:37:50.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.209+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=8QEV2FD1K05A type=del size=736655 2024-09-12T00:37:50.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.210+0000 7fcd44281780 1 < canceled operation key=AN6GRGZ22INA tag=UPMUJB3ISDH1 type=del size=3759508 2024-09-12T00:37:50.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.212+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=SNPQ6QKAK0LB type=del size=2889186 2024-09-12T00:37:50.212 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.213+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=R5TUOGYD2CCL type=del 2024-09-12T00:37:50.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.216+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~YA9W0SWSJZK2.0 size=1048576 2024-09-12T00:37:50.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.217+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~YA9W0SWSJZK2.1 size=1048576 2024-09-12T00:37:50.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.219+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~YA9W0SWSJZK2.2 size=944965 2024-09-12T00:37:50.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.219+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=YA9W0SWSJZK2 tag=TI5ZM8PH0FI5 type=write size=4090693 2024-09-12T00:37:50.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.221+0000 7fcd44281780 1 < completed delete operation key=QVULC3H9QGXE tag=CUY6NXR9V09G type=del 2024-09-12T00:37:50.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.224+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~NXXZA1OFGC78.0 size=1048576 2024-09-12T00:37:50.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.225+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~NXXZA1OFGC78.1 size=984426 2024-09-12T00:37:50.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.225+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=NXXZA1OFGC78 tag=AW7K80SW6QMM type=write size=3081578 2024-09-12T00:37:50.225 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.226+0000 7fcd44281780 1 < canceled operation key=8U004LC8IYLQ tag=MJHTBV0NDK9A type=del size=1716714 2024-09-12T00:37:50.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.228+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=BAE5YQEW0J1Y type=del size=723769 2024-09-12T00:37:50.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.229+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~N00Q6XJF5FOD.0 size=1048576 2024-09-12T00:37:50.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.230+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~N00Q6XJF5FOD.1 size=1048576 2024-09-12T00:37:50.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.231+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~N00Q6XJF5FOD.2 size=902509 2024-09-12T00:37:50.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.234+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=N00Q6XJF5FOD tag=ZW8L5EAYSQ0N type=write size=4048237 2024-09-12T00:37:50.235 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.236+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~SPVNNVYMRM1R.0 size=986747 2024-09-12T00:37:50.235 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.236+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=SPVNNVYMRM1R tag=CLPU7LQVZJ4L type=write size=2035323 2024-09-12T00:37:50.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.238+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=YW1MJ57IZ8BY type=del 2024-09-12T00:37:50.238 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.239+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=E9MW83775X7P type=del size=722135 2024-09-12T00:37:50.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.240+0000 7fcd44281780 1 < canceled operation key=KNBCXZF3JGNL tag=UVFKR0T7WOLD type=del size=2159748 2024-09-12T00:37:50.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.243+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~94XDTA7IFNXN.0 size=1048576 2024-09-12T00:37:50.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.244+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~94XDTA7IFNXN.1 size=1048576 2024-09-12T00:37:50.243 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.245+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~94XDTA7IFNXN.2 size=567154 2024-09-12T00:37:50.244 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.245+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=94XDTA7IFNXN tag=RTTZZRJJKP5R type=write size=3712882 2024-09-12T00:37:50.245 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.246+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~VPNV6EB4VUNT.0 size=1048576 2024-09-12T00:37:50.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.247+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~VPNV6EB4VUNT.1 size=1048576 2024-09-12T00:37:50.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.248+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~VPNV6EB4VUNT.2 size=208005 2024-09-12T00:37:50.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.251+0000 7fcd44281780 1 < completed multipart upload key=0AVE0W4OV1AU upload=VPNV6EB4VUNT tag=1UY5CFGCANXT type=write size=3353733 2024-09-12T00:37:50.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.253+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~CEZG86KD4B8S.0 size=1048576 2024-09-12T00:37:50.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.254+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~CEZG86KD4B8S.1 size=525707 2024-09-12T00:37:50.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.254+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=CEZG86KD4B8S tag=JQ9VY08C7S0Y type=write size=2622859 2024-09-12T00:37:50.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.256+0000 7fcd44281780 1 < completed delete operation key=0OEDZ5O2LN8H tag=Z13CRMBWAUQU type=del 2024-09-12T00:37:50.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.257+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=QD5V1J4K4ZRA type=del size=2898819 2024-09-12T00:37:50.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.258+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~WRP0NR8TR821.0 size=1042234 2024-09-12T00:37:50.259 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.261+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=WRP0NR8TR821 tag=ERL73EOQQXW4 type=write size=2090810 2024-09-12T00:37:50.260 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.262+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=LUOQ5Z5FSUPN type=del size=2679268 2024-09-12T00:37:50.262 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.263+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~3EIMVR83X1OR.0 size=935450 2024-09-12T00:37:50.264 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.265+0000 7fcd44281780 1 < completed multipart upload key=VOO70F2NBKL0 upload=3EIMVR83X1OR tag=3KGSZXB9HUR0 type=write size=1984026 2024-09-12T00:37:50.265 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.267+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=A1C4NXG9BC2S type=write size=240103 2024-09-12T00:37:50.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.268+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~O7SORY60D2JE.0 size=742923 2024-09-12T00:37:50.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.270+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=O7SORY60D2JE tag=TE34L083V1Y6 type=write size=1791499 2024-09-12T00:37:50.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.271+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=2BQ43HP5ZOJX type=del size=2129959 2024-09-12T00:37:50.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.274+0000 7fcd44281780 1 < suggested remove operation key=ZQSZDU87GAMV tag=HB3WFRLSY1U3 type=del 2024-09-12T00:37:50.274 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.275+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=7OKZ3QGPVTKL type=del size=3067499 2024-09-12T00:37:50.275 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.277+0000 7fcd44281780 1 < completed delete operation key=0ELZXPZCRPGP tag=1HEKR7X47IR1 type=del 2024-09-12T00:37:50.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.278+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=6RMYI2CAA7NJ type=del size=68307 2024-09-12T00:37:50.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.280+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~SY22EAW5DEY6.0 size=332397 2024-09-12T00:37:50.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.282+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=SY22EAW5DEY6 tag=Y9T7RSIEX0V7 type=write size=1380973 2024-09-12T00:37:50.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.283+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=FCHAF2M2C10P type=del size=2955174 2024-09-12T00:37:50.283 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.285+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=8QEV2FD1K05A type=del 2024-09-12T00:37:50.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.287+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~EPVVDVETNRPL.0 size=532544 2024-09-12T00:37:50.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.287+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=EPVVDVETNRPL tag=0DDRJGT3GO36 type=write size=1581120 2024-09-12T00:37:50.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.288+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=SNPQ6QKAK0LB type=del 2024-09-12T00:37:50.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.290+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=C8PDQ4SJNP1G type=del size=964691 2024-09-12T00:37:50.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.290+0000 7fcd44281780 1 < canceled part key=_multipart_KJ0C43WLAFLI.2~YA9W0SWSJZK2.0 size=1048576 2024-09-12T00:37:50.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.291+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~YA9W0SWSJZK2.1 size=1048576 2024-09-12T00:37:50.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.292+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~YA9W0SWSJZK2.2 size=944965 2024-09-12T00:37:50.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.295+0000 7fcd44281780 1 < canceled multipart upload key=KJ0C43WLAFLI upload=YA9W0SWSJZK2 tag=TI5ZM8PH0FI5 type=write size=4090693 2024-09-12T00:37:50.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.297+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~Z7J0BX76BDIB.0 size=1048576 2024-09-12T00:37:50.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.298+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~Z7J0BX76BDIB.1 size=81555 2024-09-12T00:37:50.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.298+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=Z7J0BX76BDIB tag=HLUM59JISZWW type=write size=2178707 2024-09-12T00:37:50.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.300+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~NXXZA1OFGC78.0 size=1048576 2024-09-12T00:37:50.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.301+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~NXXZA1OFGC78.1 size=984426 2024-09-12T00:37:50.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.303+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=NXXZA1OFGC78 tag=AW7K80SW6QMM type=write size=3081578 2024-09-12T00:37:50.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.306+0000 7fcd44281780 1 > prepared part key=_multipart_QVULC3H9QGXE.2~KESZ5TNA6KG1.0 size=397183 2024-09-12T00:37:50.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.306+0000 7fcd44281780 1 > prepared multipart upload key=QVULC3H9QGXE upload=KESZ5TNA6KG1 tag=3T12JMZIPLA8 type=write size=1445759 2024-09-12T00:37:50.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.307+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=BAE5YQEW0J1Y type=del 2024-09-12T00:37:50.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.310+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~SB3PZVZDGK8C.0 size=1048576 2024-09-12T00:37:50.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.311+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~SB3PZVZDGK8C.1 size=424673 2024-09-12T00:37:50.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.311+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=SB3PZVZDGK8C tag=DLCJUEPGUAD7 type=write size=2521825 2024-09-12T00:37:50.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.313+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~SPVNNVYMRM1R.0 size=986747 2024-09-12T00:37:50.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.315+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=SPVNNVYMRM1R tag=CLPU7LQVZJ4L type=write size=2035323 2024-09-12T00:37:50.316 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.317+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~K2MJN4S1JV01.0 size=1048576 2024-09-12T00:37:50.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.318+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~K2MJN4S1JV01.1 size=873660 2024-09-12T00:37:50.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.318+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=K2MJN4S1JV01 tag=1GGD8VUIKJL8 type=write size=2970812 2024-09-12T00:37:50.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.320+0000 7fcd44281780 1 < canceled operation key=8U004LC8IYLQ tag=E9MW83775X7P type=del size=722135 2024-09-12T00:37:50.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.323+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~4KJMFZTNA676.0 size=1048576 2024-09-12T00:37:50.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.323+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~4KJMFZTNA676.1 size=1048576 2024-09-12T00:37:50.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.324+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~4KJMFZTNA676.2 size=52544 2024-09-12T00:37:50.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.324+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=4KJMFZTNA676 tag=IRDERNI64WK6 type=write size=3198272 2024-09-12T00:37:50.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.326+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~94XDTA7IFNXN.0 size=1048576 2024-09-12T00:37:50.326 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.327+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~94XDTA7IFNXN.1 size=1048576 2024-09-12T00:37:50.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.328+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~94XDTA7IFNXN.2 size=567154 2024-09-12T00:37:50.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.331+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=94XDTA7IFNXN tag=RTTZZRJJKP5R type=write size=3712882 2024-09-12T00:37:50.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.332+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=V0EU91ZHEEQY type=del size=2434891 2024-09-12T00:37:50.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.336+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~CEZG86KD4B8S.0 size=1048576 2024-09-12T00:37:50.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.337+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~CEZG86KD4B8S.1 size=525707 2024-09-12T00:37:50.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.340+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=CEZG86KD4B8S tag=JQ9VY08C7S0Y type=write size=2622859 2024-09-12T00:37:50.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.341+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=9ZB70DJ40INX type=del size=2195063 2024-09-12T00:37:50.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.343+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=QD5V1J4K4ZRA type=del 2024-09-12T00:37:50.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.344+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=YIB5CWGQFJDA type=del size=2855580 2024-09-12T00:37:50.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.347+0000 7fcd44281780 1 < suggested remove operation key=KJ0C43WLAFLI tag=LUOQ5Z5FSUPN type=del 2024-09-12T00:37:50.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.350+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~NBODGHSY1F52.0 size=1048576 2024-09-12T00:37:50.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.351+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~NBODGHSY1F52.1 size=1048576 2024-09-12T00:37:50.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.352+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~NBODGHSY1F52.2 size=502543 2024-09-12T00:37:50.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.352+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=NBODGHSY1F52 tag=2MDS9UT83U71 type=write size=3648271 2024-09-12T00:37:50.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.354+0000 7fcd44281780 1 < completed write operation key=8U004LC8IYLQ tag=A1C4NXG9BC2S type=write size=240103 2024-09-12T00:37:50.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.355+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=TM5N73LSO5KH type=write size=821223 2024-09-12T00:37:50.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.358+0000 7fcd44281780 1 < suggested remove operation key=4RU6HTH4J0U1 tag=2BQ43HP5ZOJX type=del 2024-09-12T00:37:50.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.361+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~JQW90O9M6FJQ.0 size=1048576 2024-09-12T00:37:50.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.362+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~JQW90O9M6FJQ.1 size=304993 2024-09-12T00:37:50.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.362+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=JQW90O9M6FJQ tag=BJSX3FPLN0GF type=write size=2402145 2024-09-12T00:37:50.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.363+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=7OKZ3QGPVTKL type=del 2024-09-12T00:37:50.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.365+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=MUREEAPSF5DL type=del size=3275513 2024-09-12T00:37:50.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.366+0000 7fcd44281780 -1 < failed to complete operation key=KJ0C43WLAFLI tag=6RMYI2CAA7NJ type=del size=68307: (22) Invalid argument 2024-09-12T00:37:50.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.369+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~E526K1S2T9PF.0 size=1048576 2024-09-12T00:37:50.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.370+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~E526K1S2T9PF.1 size=1048576 2024-09-12T00:37:50.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.371+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~E526K1S2T9PF.2 size=549792 2024-09-12T00:37:50.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.371+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=E526K1S2T9PF tag=C8YMXESPJ19D type=write size=3695520 2024-09-12T00:37:50.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.372+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=FCHAF2M2C10P type=del 2024-09-12T00:37:50.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.375+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~CIF0KV5Y4PF4.0 size=1048576 2024-09-12T00:37:50.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.376+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~CIF0KV5Y4PF4.1 size=919134 2024-09-12T00:37:50.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.376+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=CIF0KV5Y4PF4 tag=OR6X1AO3G17I type=write size=3016286 2024-09-12T00:37:50.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.377+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~EPVVDVETNRPL.0 size=532544 2024-09-12T00:37:50.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.379+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=EPVVDVETNRPL tag=0DDRJGT3GO36 type=write size=1581120 2024-09-12T00:37:50.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.381+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=UB9JSZ5FIC1D type=del size=304075 2024-09-12T00:37:50.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.382+0000 7fcd44281780 1 < canceled operation key=O12Z8THB62AJ tag=C8PDQ4SJNP1G type=del size=964691 2024-09-12T00:37:50.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.384+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=1TH8GHKRIRZY type=del size=3923114 2024-09-12T00:37:50.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.385+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~Z7J0BX76BDIB.0 size=1048576 2024-09-12T00:37:50.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.386+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~Z7J0BX76BDIB.1 size=81555 2024-09-12T00:37:50.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.389+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=Z7J0BX76BDIB tag=HLUM59JISZWW type=write size=2178707 2024-09-12T00:37:50.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.390+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=24AYO4HGSUX0 type=del size=849176 2024-09-12T00:37:50.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.390+0000 7fcd44281780 1 < canceled part key=_multipart_QVULC3H9QGXE.2~KESZ5TNA6KG1.0 size=397183 2024-09-12T00:37:50.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.393+0000 7fcd44281780 1 < canceled multipart upload key=QVULC3H9QGXE upload=KESZ5TNA6KG1 tag=3T12JMZIPLA8 type=write size=1445759 2024-09-12T00:37:50.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.394+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=HZVHJSJWIVRK type=del size=1315794 2024-09-12T00:37:50.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.396+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~SB3PZVZDGK8C.0 size=1048576 2024-09-12T00:37:50.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.397+0000 7fcd44281780 1 < completed part key=_multipart_CF7B7J3V1YFG.2~SB3PZVZDGK8C.1 size=424673 2024-09-12T00:37:50.399 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.399+0000 7fcd44281780 1 < completed multipart upload key=CF7B7J3V1YFG upload=SB3PZVZDGK8C tag=DLCJUEPGUAD7 type=write size=2521825 2024-09-12T00:37:50.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.401+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~Z9CQLVADNG08.0 size=1048576 2024-09-12T00:37:50.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.402+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~Z9CQLVADNG08.1 size=1048576 2024-09-12T00:37:50.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.404+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~Z9CQLVADNG08.2 size=216458 2024-09-12T00:37:50.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.404+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=Z9CQLVADNG08 tag=58XVNERCAT3Z type=write size=3362186 2024-09-12T00:37:50.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.405+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~K2MJN4S1JV01.0 size=1048576 2024-09-12T00:37:50.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.406+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~K2MJN4S1JV01.1 size=873660 2024-09-12T00:37:50.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.408+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=K2MJN4S1JV01 tag=1GGD8VUIKJL8 type=write size=2970812 2024-09-12T00:37:50.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.410+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=9GE9Y0341N54 type=del size=3457472 2024-09-12T00:37:50.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.412+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~4KJMFZTNA676.0 size=1048576 2024-09-12T00:37:50.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.413+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~4KJMFZTNA676.1 size=1048576 2024-09-12T00:37:50.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.414+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~4KJMFZTNA676.2 size=52544 2024-09-12T00:37:50.415 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.416+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=4KJMFZTNA676 tag=IRDERNI64WK6 type=write size=3198272 2024-09-12T00:37:50.416 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.418+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=8NG9XJP7OD1C type=del size=1959563 2024-09-12T00:37:50.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.419+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=V0EU91ZHEEQY type=del 2024-09-12T00:37:50.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.420+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=ZTJDC1D2GJZC type=del size=3430203 2024-09-12T00:37:50.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.422+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=9ZB70DJ40INX type=del 2024-09-12T00:37:50.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.424+0000 7fcd44281780 1 > prepared operation key=Z6I6598B6J5I tag=I0Z4LU3GC4YJ type=del size=2906649 2024-09-12T00:37:50.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.425+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=YIB5CWGQFJDA type=del 2024-09-12T00:37:50.427 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.428+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=O9B40XHYIBUB type=del size=1758649 2024-09-12T00:37:50.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.429+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~NBODGHSY1F52.0 size=1048576 2024-09-12T00:37:50.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.431+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~NBODGHSY1F52.1 size=1048576 2024-09-12T00:37:50.430 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.431+0000 7fcd44281780 1 < canceled part key=_multipart_XTNXNF3D0HFK.2~NBODGHSY1F52.2 size=502543 2024-09-12T00:37:50.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.433+0000 7fcd44281780 1 < canceled multipart upload key=XTNXNF3D0HFK upload=NBODGHSY1F52 tag=2MDS9UT83U71 type=write size=3648271 2024-09-12T00:37:50.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.435+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=3SU39ND1ZOJ7 type=del size=2540607 2024-09-12T00:37:50.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.436+0000 7fcd44281780 1 < completed write operation key=VXDTFEG8P23H tag=TM5N73LSO5KH type=write size=821223 2024-09-12T00:37:50.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.439+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~DSAGIKR9YJ7T.0 size=1048576 2024-09-12T00:37:50.439 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.440+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~DSAGIKR9YJ7T.1 size=1048576 2024-09-12T00:37:50.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.441+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~DSAGIKR9YJ7T.2 size=747813 2024-09-12T00:37:50.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.441+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=DSAGIKR9YJ7T tag=SL6IS5IT3F5W type=write size=3893541 2024-09-12T00:37:50.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.443+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~JQW90O9M6FJQ.0 size=1048576 2024-09-12T00:37:50.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.444+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~JQW90O9M6FJQ.1 size=304993 2024-09-12T00:37:50.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.447+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=JQW90O9M6FJQ tag=BJSX3FPLN0GF type=write size=2402145 2024-09-12T00:37:50.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.448+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=PT8R2U9LSRNO type=write size=690215 2024-09-12T00:37:50.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.450+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=MUREEAPSF5DL type=del 2024-09-12T00:37:50.451 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.453+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~89BK660D5W7I.0 size=155725 2024-09-12T00:37:50.451 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.453+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=89BK660D5W7I tag=HTUWX2HY4FSV type=write size=1204301 2024-09-12T00:37:50.453 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.454+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~E526K1S2T9PF.0 size=1048576 2024-09-12T00:37:50.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.455+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~E526K1S2T9PF.1 size=1048576 2024-09-12T00:37:50.455 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.456+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~E526K1S2T9PF.2 size=549792 2024-09-12T00:37:50.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.459+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=E526K1S2T9PF tag=C8YMXESPJ19D type=write size=3695520 2024-09-12T00:37:50.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.461+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=6Q0RONV9IHCE type=del size=3649214 2024-09-12T00:37:50.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.462+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~CIF0KV5Y4PF4.0 size=1048576 2024-09-12T00:37:50.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.463+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~CIF0KV5Y4PF4.1 size=919134 2024-09-12T00:37:50.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.466+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=CIF0KV5Y4PF4 tag=OR6X1AO3G17I type=write size=3016286 2024-09-12T00:37:50.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.468+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~8162U23C8VZ3.0 size=1048576 2024-09-12T00:37:50.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.471+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~8162U23C8VZ3.1 size=979364 2024-09-12T00:37:50.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.471+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=8162U23C8VZ3 tag=WBYOJT1GYTAP type=write size=3076516 2024-09-12T00:37:50.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.472+0000 7fcd44281780 1 < completed delete operation key=8U004LC8IYLQ tag=UB9JSZ5FIC1D type=del 2024-09-12T00:37:50.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.475+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~GR10JX1PPPKI.0 size=1048576 2024-09-12T00:37:50.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.476+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~GR10JX1PPPKI.1 size=223951 2024-09-12T00:37:50.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.476+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=GR10JX1PPPKI tag=QST6ILSWQSDI type=write size=2321103 2024-09-12T00:37:50.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.477+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=1TH8GHKRIRZY type=del 2024-09-12T00:37:50.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.479+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=09EL8PI3Z9GW type=del size=3931179 2024-09-12T00:37:50.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.480+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=24AYO4HGSUX0 type=del 2024-09-12T00:37:50.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.482+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~PKT55L3H901M.0 size=1048576 2024-09-12T00:37:50.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.484+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~PKT55L3H901M.1 size=308726 2024-09-12T00:37:50.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.484+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=PKT55L3H901M tag=ZC9BIWHTB8YN type=write size=2405878 2024-09-12T00:37:50.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.485+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=HZVHJSJWIVRK type=del 2024-09-12T00:37:50.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.487+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~1G1M60TU8PXH.0 size=1048576 2024-09-12T00:37:50.487 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.488+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~1G1M60TU8PXH.1 size=1048576 2024-09-12T00:37:50.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.489+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~1G1M60TU8PXH.2 size=468328 2024-09-12T00:37:50.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.489+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=1G1M60TU8PXH tag=H1V3EB3YYIYD type=write size=3614056 2024-09-12T00:37:50.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.491+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~Z9CQLVADNG08.0 size=1048576 2024-09-12T00:37:50.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.492+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~Z9CQLVADNG08.1 size=1048576 2024-09-12T00:37:50.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.493+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~Z9CQLVADNG08.2 size=216458 2024-09-12T00:37:50.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.495+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=Z9CQLVADNG08 tag=58XVNERCAT3Z type=write size=3362186 2024-09-12T00:37:50.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.497+0000 7fcd44281780 1 > prepared operation key=UWS056JN3IXO tag=Y2KIDT2BIZJD type=write size=707897 2024-09-12T00:37:50.497 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.498+0000 7fcd44281780 1 < canceled operation key=EXP8U6QNSMQ0 tag=9GE9Y0341N54 type=del size=3457472 2024-09-12T00:37:50.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.500+0000 7fcd44281780 1 > prepared operation key=526O814C10YW tag=7NTF9WFBTMWH type=write size=342820 2024-09-12T00:37:50.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.501+0000 7fcd44281780 1 < canceled operation key=0O62FO4WVZG6 tag=8NG9XJP7OD1C type=del size=1959563 2024-09-12T00:37:50.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.502+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=CVSLHSD522NL type=del size=2526899 2024-09-12T00:37:50.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.504+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=ZTJDC1D2GJZC type=del 2024-09-12T00:37:50.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.505+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=P98P3CA1TS1F type=write size=449245 2024-09-12T00:37:50.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.507+0000 7fcd44281780 1 < completed delete operation key=Z6I6598B6J5I tag=I0Z4LU3GC4YJ type=del 2024-09-12T00:37:50.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.509+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~K5BACTTHXUQW.0 size=1048576 2024-09-12T00:37:50.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.511+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~K5BACTTHXUQW.1 size=1048576 2024-09-12T00:37:50.510 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.512+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~K5BACTTHXUQW.2 size=97613 2024-09-12T00:37:50.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.512+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=K5BACTTHXUQW tag=B52T0G11RPU5 type=write size=3243341 2024-09-12T00:37:50.512 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.513+0000 7fcd44281780 1 < canceled operation key=EXP8U6QNSMQ0 tag=O9B40XHYIBUB type=del size=1758649 2024-09-12T00:37:50.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.514+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=D9H2W8JLTIDD type=del size=209602 2024-09-12T00:37:50.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.518+0000 7fcd44281780 1 < suggested remove operation key=AN6GRGZ22INA tag=3SU39ND1ZOJ7 type=del 2024-09-12T00:37:50.518 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.519+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=PC2R6G3FGLFW type=del size=892063 2024-09-12T00:37:50.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.521+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~DSAGIKR9YJ7T.0 size=1048576 2024-09-12T00:37:50.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.522+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~DSAGIKR9YJ7T.1 size=1048576 2024-09-12T00:37:50.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.523+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~DSAGIKR9YJ7T.2 size=747813 2024-09-12T00:37:50.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.526+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=DSAGIKR9YJ7T tag=SL6IS5IT3F5W type=write size=3893541 2024-09-12T00:37:50.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.528+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~MDRKEXMXTW66.0 size=1048576 2024-09-12T00:37:50.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.529+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~MDRKEXMXTW66.1 size=826731 2024-09-12T00:37:50.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.529+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=MDRKEXMXTW66 tag=H6JG30WCONRM type=write size=2923883 2024-09-12T00:37:50.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.531+0000 7fcd44281780 1 < completed write operation key=4RU6HTH4J0U1 tag=PT8R2U9LSRNO type=write size=690215 2024-09-12T00:37:50.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.532+0000 7fcd44281780 1 > prepared operation key=KJ0C43WLAFLI tag=UHC164L88U73 type=del size=1612462 2024-09-12T00:37:50.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.534+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~89BK660D5W7I.0 size=155725 2024-09-12T00:37:50.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.536+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=89BK660D5W7I tag=HTUWX2HY4FSV type=write size=1204301 2024-09-12T00:37:50.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.537+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=K1QE5X25B4EV type=del size=1540164 2024-09-12T00:37:50.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.539+0000 7fcd44281780 1 < completed delete operation key=0OEDZ5O2LN8H tag=6Q0RONV9IHCE type=del 2024-09-12T00:37:50.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.542+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~0RUB5LRARH1A.0 size=1048576 2024-09-12T00:37:50.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.543+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~0RUB5LRARH1A.1 size=891531 2024-09-12T00:37:50.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.543+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=0RUB5LRARH1A tag=PD6RTLRPC74F type=write size=2988683 2024-09-12T00:37:50.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.544+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~8162U23C8VZ3.0 size=1048576 2024-09-12T00:37:50.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.545+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~8162U23C8VZ3.1 size=979364 2024-09-12T00:37:50.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.548+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=8162U23C8VZ3 tag=WBYOJT1GYTAP type=write size=3076516 2024-09-12T00:37:50.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.550+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~PK9VGW8RUGB8.0 size=1048576 2024-09-12T00:37:50.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.551+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~PK9VGW8RUGB8.1 size=261535 2024-09-12T00:37:50.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.551+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=PK9VGW8RUGB8 tag=DIA36U1JGAFD type=write size=2358687 2024-09-12T00:37:50.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.552+0000 7fcd44281780 1 < canceled part key=_multipart_526O814C10YW.2~GR10JX1PPPKI.0 size=1048576 2024-09-12T00:37:50.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.553+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~GR10JX1PPPKI.1 size=223951 2024-09-12T00:37:50.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.555+0000 7fcd44281780 1 < canceled multipart upload key=526O814C10YW upload=GR10JX1PPPKI tag=QST6ILSWQSDI type=write size=2321103 2024-09-12T00:37:50.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.558+0000 7fcd44281780 1 > prepared part key=_multipart_CF7B7J3V1YFG.2~ANY4QJBG15ZR.0 size=63504 2024-09-12T00:37:50.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.558+0000 7fcd44281780 1 > prepared multipart upload key=CF7B7J3V1YFG upload=ANY4QJBG15ZR tag=JU0A4WN96VPF type=write size=1112080 2024-09-12T00:37:50.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.560+0000 7fcd44281780 1 < completed delete operation key=QVULC3H9QGXE tag=09EL8PI3Z9GW type=del 2024-09-12T00:37:50.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.562+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=OXEXF4B4TNBG type=write size=364780 2024-09-12T00:37:50.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.563+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~PKT55L3H901M.0 size=1048576 2024-09-12T00:37:50.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.564+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~PKT55L3H901M.1 size=308726 2024-09-12T00:37:50.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.567+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=PKT55L3H901M tag=ZC9BIWHTB8YN type=write size=2405878 2024-09-12T00:37:50.567 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.568+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=TXGL2J34BZTF type=write size=737610 2024-09-12T00:37:50.568 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.569+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~1G1M60TU8PXH.0 size=1048576 2024-09-12T00:37:50.569 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.570+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~1G1M60TU8PXH.1 size=1048576 2024-09-12T00:37:50.570 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.572+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~1G1M60TU8PXH.2 size=468328 2024-09-12T00:37:50.573 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.574+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=1G1M60TU8PXH tag=H1V3EB3YYIYD type=write size=3614056 2024-09-12T00:37:50.575 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.576+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~S34PCYKIL3FE.0 size=1048576 2024-09-12T00:37:50.576 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.578+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~S34PCYKIL3FE.1 size=1048576 2024-09-12T00:37:50.578 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.579+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~S34PCYKIL3FE.2 size=798564 2024-09-12T00:37:50.578 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.579+0000 7fcd44281780 1 > prepared multipart upload key=U4EPPPA4QGGD upload=S34PCYKIL3FE tag=HOPAVZ5O51X7 type=write size=3944292 2024-09-12T00:37:50.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.580+0000 7fcd44281780 1 < completed write operation key=UWS056JN3IXO tag=Y2KIDT2BIZJD type=write size=707897 2024-09-12T00:37:50.581 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.582+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=QVGP8K50FC9K type=write size=757287 2024-09-12T00:37:50.582 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.583+0000 7fcd44281780 1 < completed write operation key=526O814C10YW tag=7NTF9WFBTMWH type=write size=342820 2024-09-12T00:37:50.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.586+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~BQB2JI3KPNB0.0 size=1048576 2024-09-12T00:37:50.586 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.587+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~BQB2JI3KPNB0.1 size=1048576 2024-09-12T00:37:50.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.588+0000 7fcd44281780 1 > prepared part key=_multipart_0O62FO4WVZG6.2~BQB2JI3KPNB0.2 size=259169 2024-09-12T00:37:50.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.588+0000 7fcd44281780 1 > prepared multipart upload key=0O62FO4WVZG6 upload=BQB2JI3KPNB0 tag=90Y3JYEXM4EF type=write size=3404897 2024-09-12T00:37:50.590 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.591+0000 7fcd44281780 1 < suggested update operation key=0O62FO4WVZG6 tag=CVSLHSD522NL type=del size=2526899 2024-09-12T00:37:50.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.594+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~NXSSENNF9ZVC.0 size=1048576 2024-09-12T00:37:50.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.596+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~NXSSENNF9ZVC.1 size=586273 2024-09-12T00:37:50.595 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.596+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=NXSSENNF9ZVC tag=LVXYF8C1JZEZ type=write size=2683425 2024-09-12T00:37:50.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.597+0000 7fcd44281780 1 < completed write operation key=DKJ44Z9COIIK tag=P98P3CA1TS1F type=write size=449245 2024-09-12T00:37:50.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.599+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=JSRWKEWQSPH3 type=del size=1857827 2024-09-12T00:37:50.599 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.600+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~K5BACTTHXUQW.0 size=1048576 2024-09-12T00:37:50.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.601+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~K5BACTTHXUQW.1 size=1048576 2024-09-12T00:37:50.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.679+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~K5BACTTHXUQW.2 size=97613 2024-09-12T00:37:50.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.682+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=K5BACTTHXUQW tag=B52T0G11RPU5 type=write size=3243341 2024-09-12T00:37:50.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.683+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=AQMEI2PYY6BR type=del size=2808992 2024-09-12T00:37:50.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.685+0000 7fcd44281780 1 < completed delete operation key=QVULC3H9QGXE tag=D9H2W8JLTIDD type=del 2024-09-12T00:37:50.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.688+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~608TEE2EZNCU.0 size=1048576 2024-09-12T00:37:50.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.689+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~608TEE2EZNCU.1 size=1048576 2024-09-12T00:37:50.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.690+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~608TEE2EZNCU.2 size=639784 2024-09-12T00:37:50.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.690+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=608TEE2EZNCU tag=T09SOX74T1BU type=write size=3785512 2024-09-12T00:37:50.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.693+0000 7fcd44281780 1 < suggested remove operation key=IK8POOY7ZWNF tag=PC2R6G3FGLFW type=del 2024-09-12T00:37:50.694 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.695+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~H4AYBA0MBW5T.0 size=1048576 2024-09-12T00:37:50.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.696+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~H4AYBA0MBW5T.1 size=1048576 2024-09-12T00:37:50.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.698+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~H4AYBA0MBW5T.2 size=800990 2024-09-12T00:37:50.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.698+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=H4AYBA0MBW5T tag=CNA50V6J3ZB0 type=write size=3946718 2024-09-12T00:37:50.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.698+0000 7fcd44281780 1 < canceled part key=_multipart_WXBMIJ4FC0VX.2~MDRKEXMXTW66.0 size=1048576 2024-09-12T00:37:50.698 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.699+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~MDRKEXMXTW66.1 size=826731 2024-09-12T00:37:50.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.701+0000 7fcd44281780 1 < canceled multipart upload key=WXBMIJ4FC0VX upload=MDRKEXMXTW66 tag=H6JG30WCONRM type=write size=2923883 2024-09-12T00:37:50.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.703+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=54SUR74HLB7M type=del size=543887 2024-09-12T00:37:50.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.705+0000 7fcd44281780 1 < suggested update operation key=KJ0C43WLAFLI tag=UHC164L88U73 type=del size=1612462 2024-09-12T00:37:50.707 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.708+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~1SP6X2LTNJNQ.0 size=1048576 2024-09-12T00:37:50.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.709+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~1SP6X2LTNJNQ.1 size=1048576 2024-09-12T00:37:50.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.710+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~1SP6X2LTNJNQ.2 size=778458 2024-09-12T00:37:50.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.710+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=1SP6X2LTNJNQ tag=HYZ20TIBQ7F2 type=write size=3924186 2024-09-12T00:37:50.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.712+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=K1QE5X25B4EV type=del 2024-09-12T00:37:50.713 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.715+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~R9UAI90E1BX0.0 size=351671 2024-09-12T00:37:50.713 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.715+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=R9UAI90E1BX0 tag=SMW4Z28Q3FST type=write size=1400247 2024-09-12T00:37:50.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.716+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~0RUB5LRARH1A.0 size=1048576 2024-09-12T00:37:50.716 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.717+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~0RUB5LRARH1A.1 size=891531 2024-09-12T00:37:50.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.719+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=0RUB5LRARH1A tag=PD6RTLRPC74F type=write size=2988683 2024-09-12T00:37:50.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.721+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=P09OA9XIDJNS type=del size=3579465 2024-09-12T00:37:50.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.722+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~PK9VGW8RUGB8.0 size=1048576 2024-09-12T00:37:50.722 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.723+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~PK9VGW8RUGB8.1 size=261535 2024-09-12T00:37:50.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.726+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=PK9VGW8RUGB8 tag=DIA36U1JGAFD type=write size=2358687 2024-09-12T00:37:50.726 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.727+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=N58DWXH99EX0 type=del size=4047508 2024-09-12T00:37:50.726 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.727+0000 7fcd44281780 1 < canceled part key=_multipart_CF7B7J3V1YFG.2~ANY4QJBG15ZR.0 size=63504 2024-09-12T00:37:50.728 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.730+0000 7fcd44281780 1 < canceled multipart upload key=CF7B7J3V1YFG upload=ANY4QJBG15ZR tag=JU0A4WN96VPF type=write size=1112080 2024-09-12T00:37:50.730 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.731+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=0VEHBF73VZYJ type=del size=3252942 2024-09-12T00:37:50.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.733+0000 7fcd44281780 1 < completed write operation key=0OEDZ5O2LN8H tag=OXEXF4B4TNBG type=write size=364780 2024-09-12T00:37:50.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.734+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=X8KFRD184POX type=del size=1913980 2024-09-12T00:37:50.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.736+0000 7fcd44281780 1 < completed write operation key=VXDTFEG8P23H tag=TXGL2J34BZTF type=write size=737610 2024-09-12T00:37:50.736 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.737+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=HGKKVSQGQI14 type=del size=2878545 2024-09-12T00:37:50.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.738+0000 7fcd44281780 1 < canceled part key=_multipart_U4EPPPA4QGGD.2~S34PCYKIL3FE.0 size=1048576 2024-09-12T00:37:50.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.739+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~S34PCYKIL3FE.1 size=1048576 2024-09-12T00:37:50.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.740+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~S34PCYKIL3FE.2 size=798564 2024-09-12T00:37:50.741 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.742+0000 7fcd44281780 1 < canceled multipart upload key=U4EPPPA4QGGD upload=S34PCYKIL3FE tag=HOPAVZ5O51X7 type=write size=3944292 2024-09-12T00:37:50.744 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.745+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~OB2VVVNJVY36.0 size=185517 2024-09-12T00:37:50.744 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.745+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=OB2VVVNJVY36 tag=N4N15ARQWW0D type=write size=1234093 2024-09-12T00:37:50.745 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.747+0000 7fcd44281780 1 < completed write operation key=0AVE0W4OV1AU tag=QVGP8K50FC9K type=write size=757287 2024-09-12T00:37:50.748 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.749+0000 7fcd44281780 1 > prepared part key=_multipart_0ELZXPZCRPGP.2~N2ZN9H342KCY.0 size=287914 2024-09-12T00:37:50.748 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.749+0000 7fcd44281780 1 > prepared multipart upload key=0ELZXPZCRPGP upload=N2ZN9H342KCY tag=E74BAW1263OS type=write size=1336490 2024-09-12T00:37:50.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.751+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~BQB2JI3KPNB0.0 size=1048576 2024-09-12T00:37:50.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.752+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~BQB2JI3KPNB0.1 size=1048576 2024-09-12T00:37:50.752 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.753+0000 7fcd44281780 1 < completed part key=_multipart_0O62FO4WVZG6.2~BQB2JI3KPNB0.2 size=259169 2024-09-12T00:37:50.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.756+0000 7fcd44281780 1 < completed multipart upload key=0O62FO4WVZG6 upload=BQB2JI3KPNB0 tag=90Y3JYEXM4EF type=write size=3404897 2024-09-12T00:37:50.757 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.759+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~KGBXQQEUWK6O.0 size=1048576 2024-09-12T00:37:50.759 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.760+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~KGBXQQEUWK6O.1 size=1048576 2024-09-12T00:37:50.760 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.761+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~KGBXQQEUWK6O.2 size=406268 2024-09-12T00:37:50.760 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.761+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=KGBXQQEUWK6O tag=E68CGDCTF72M type=write size=3551996 2024-09-12T00:37:50.761 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.762+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~NXSSENNF9ZVC.0 size=1048576 2024-09-12T00:37:50.762 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.763+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~NXSSENNF9ZVC.1 size=586273 2024-09-12T00:37:50.764 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.766+0000 7fcd44281780 1 < completed multipart upload key=VXDTFEG8P23H upload=NXSSENNF9ZVC tag=LVXYF8C1JZEZ type=write size=2683425 2024-09-12T00:37:50.767 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.768+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~TFLMGWC8ND2L.0 size=983050 2024-09-12T00:37:50.767 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.768+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=TFLMGWC8ND2L tag=UGXWEAA77NU0 type=write size=2031626 2024-09-12T00:37:50.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.770+0000 7fcd44281780 1 < canceled operation key=O12Z8THB62AJ tag=JSRWKEWQSPH3 type=del size=1857827 2024-09-12T00:37:50.771 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.773+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~6SLJED74A5NG.0 size=1048576 2024-09-12T00:37:50.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.774+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~6SLJED74A5NG.1 size=1048576 2024-09-12T00:37:50.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.775+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~6SLJED74A5NG.2 size=537148 2024-09-12T00:37:50.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.775+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=6SLJED74A5NG tag=9VN0TYZAY0I2 type=write size=3682876 2024-09-12T00:37:50.776 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.777+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=AQMEI2PYY6BR type=del 2024-09-12T00:37:50.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.779+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=YCP7S6QWK1BT type=del size=2894546 2024-09-12T00:37:50.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.779+0000 7fcd44281780 1 < canceled part key=_multipart_7UCICX0GHHQ1.2~608TEE2EZNCU.0 size=1048576 2024-09-12T00:37:50.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.780+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~608TEE2EZNCU.1 size=1048576 2024-09-12T00:37:50.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.781+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~608TEE2EZNCU.2 size=639784 2024-09-12T00:37:50.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.783+0000 7fcd44281780 1 < canceled multipart upload key=7UCICX0GHHQ1 upload=608TEE2EZNCU tag=T09SOX74T1BU type=write size=3785512 2024-09-12T00:37:50.784 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.785+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=GNX4FFAXDNZA type=del size=540467 2024-09-12T00:37:50.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.786+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~H4AYBA0MBW5T.0 size=1048576 2024-09-12T00:37:50.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.788+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~H4AYBA0MBW5T.1 size=1048576 2024-09-12T00:37:50.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.789+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~H4AYBA0MBW5T.2 size=800990 2024-09-12T00:37:50.790 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.792+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=H4AYBA0MBW5T tag=CNA50V6J3ZB0 type=write size=3946718 2024-09-12T00:37:50.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.793+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=HTU0T7ARVOXZ type=del size=445495 2024-09-12T00:37:50.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.794+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=54SUR74HLB7M type=del 2024-09-12T00:37:50.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.796+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=ZWWSZNML7BW0 type=del size=1982201 2024-09-12T00:37:50.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.797+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~1SP6X2LTNJNQ.0 size=1048576 2024-09-12T00:37:50.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.797+0000 7fcd44281780 1 < canceled part key=_multipart_VXDTFEG8P23H.2~1SP6X2LTNJNQ.1 size=1048576 2024-09-12T00:37:50.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.798+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~1SP6X2LTNJNQ.2 size=778458 2024-09-12T00:37:50.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.801+0000 7fcd44281780 1 < canceled multipart upload key=VXDTFEG8P23H upload=1SP6X2LTNJNQ tag=HYZ20TIBQ7F2 type=write size=3924186 2024-09-12T00:37:50.802 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.803+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~X0LDXEZ3JKPA.0 size=1048576 2024-09-12T00:37:50.803 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.804+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~X0LDXEZ3JKPA.1 size=869991 2024-09-12T00:37:50.803 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.804+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=X0LDXEZ3JKPA tag=WBA2BO8LVXOP type=write size=2967143 2024-09-12T00:37:50.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.806+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~R9UAI90E1BX0.0 size=351671 2024-09-12T00:37:50.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.808+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=R9UAI90E1BX0 tag=SMW4Z28Q3FST type=write size=1400247 2024-09-12T00:37:50.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.811+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~59X5IJX0CQO1.0 size=1048576 2024-09-12T00:37:50.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.812+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~59X5IJX0CQO1.1 size=357161 2024-09-12T00:37:50.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.812+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=59X5IJX0CQO1 tag=3XLQO5CN3G0S type=write size=2454313 2024-09-12T00:37:50.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.814+0000 7fcd44281780 1 < completed delete operation key=RYSE2CKE5IRT tag=P09OA9XIDJNS type=del 2024-09-12T00:37:50.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.816+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~1N3Z6J1CYHRV.0 size=699384 2024-09-12T00:37:50.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.816+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=1N3Z6J1CYHRV tag=ESEKIR8YLSID type=write size=1747960 2024-09-12T00:37:50.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.818+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=N58DWXH99EX0 type=del 2024-09-12T00:37:50.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.819+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=2R3UP83IQ7WX type=del size=582970 2024-09-12T00:37:50.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.820+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=0VEHBF73VZYJ type=del 2024-09-12T00:37:50.820 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.821+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=F31BH2XTYXPQ type=del size=1634854 2024-09-12T00:37:50.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.824+0000 7fcd44281780 1 < suggested remove operation key=0O62FO4WVZG6 tag=X8KFRD184POX type=del 2024-09-12T00:37:50.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.826+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~B4VXJEGGGT6U.0 size=1048576 2024-09-12T00:37:50.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.827+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~B4VXJEGGGT6U.1 size=1048576 2024-09-12T00:37:50.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.828+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~B4VXJEGGGT6U.2 size=601693 2024-09-12T00:37:50.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.828+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=B4VXJEGGGT6U tag=ACO0B576S3BO type=write size=3747421 2024-09-12T00:37:50.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.829+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=HGKKVSQGQI14 type=del 2024-09-12T00:37:50.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.832+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~Y2DIBIG2IJL4.0 size=1048576 2024-09-12T00:37:50.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.833+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~Y2DIBIG2IJL4.1 size=285776 2024-09-12T00:37:50.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.833+0000 7fcd44281780 1 > prepared multipart upload key=U4EPPPA4QGGD upload=Y2DIBIG2IJL4 tag=53AATDIUQBLB type=write size=2382928 2024-09-12T00:37:50.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.834+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~OB2VVVNJVY36.0 size=185517 2024-09-12T00:37:50.835 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.836+0000 7fcd44281780 1 < completed multipart upload key=0AVE0W4OV1AU upload=OB2VVVNJVY36 tag=N4N15ARQWW0D type=write size=1234093 2024-09-12T00:37:50.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.839+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~TML0PFRZMBA9.0 size=667584 2024-09-12T00:37:50.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.839+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=TML0PFRZMBA9 tag=29A4X5OAHX8H type=write size=1716160 2024-09-12T00:37:50.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.841+0000 7fcd44281780 1 < completed part key=_multipart_0ELZXPZCRPGP.2~N2ZN9H342KCY.0 size=287914 2024-09-12T00:37:50.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.844+0000 7fcd44281780 1 < completed multipart upload key=0ELZXPZCRPGP upload=N2ZN9H342KCY tag=E74BAW1263OS type=write size=1336490 2024-09-12T00:37:50.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.846+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~3FG8IGGAB0Z3.0 size=1048576 2024-09-12T00:37:50.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.847+0000 7fcd44281780 1 > prepared part key=_multipart_526O814C10YW.2~3FG8IGGAB0Z3.1 size=933650 2024-09-12T00:37:50.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.847+0000 7fcd44281780 1 > prepared multipart upload key=526O814C10YW upload=3FG8IGGAB0Z3 tag=B9BAXSY36EBA type=write size=3030802 2024-09-12T00:37:50.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.847+0000 7fcd44281780 1 < canceled part key=_multipart_4RU6HTH4J0U1.2~KGBXQQEUWK6O.0 size=1048576 2024-09-12T00:37:50.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.848+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~KGBXQQEUWK6O.1 size=1048576 2024-09-12T00:37:50.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.849+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~KGBXQQEUWK6O.2 size=406268 2024-09-12T00:37:50.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.852+0000 7fcd44281780 1 < canceled multipart upload key=4RU6HTH4J0U1 upload=KGBXQQEUWK6O tag=E68CGDCTF72M type=write size=3551996 2024-09-12T00:37:50.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.854+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~DQ3QJGHL8SO2.0 size=1048576 2024-09-12T00:37:50.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.855+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~DQ3QJGHL8SO2.1 size=141202 2024-09-12T00:37:50.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.856+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=DQ3QJGHL8SO2 tag=VW5H14925XSY type=write size=2238354 2024-09-12T00:37:50.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.857+0000 7fcd44281780 1 < completed part key=_multipart_0AVE0W4OV1AU.2~TFLMGWC8ND2L.0 size=983050 2024-09-12T00:37:50.858 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.859+0000 7fcd44281780 1 < completed multipart upload key=0AVE0W4OV1AU upload=TFLMGWC8ND2L tag=UGXWEAA77NU0 type=write size=2031626 2024-09-12T00:37:50.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.862+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~000TI7T3K82J.0 size=763477 2024-09-12T00:37:50.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.862+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=000TI7T3K82J tag=988XMHHJLS2B type=write size=1812053 2024-09-12T00:37:50.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.863+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~6SLJED74A5NG.0 size=1048576 2024-09-12T00:37:50.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.863+0000 7fcd44281780 1 < canceled part key=_multipart_B5OH55MQGSGJ.2~6SLJED74A5NG.1 size=1048576 2024-09-12T00:37:50.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.864+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~6SLJED74A5NG.2 size=537148 2024-09-12T00:37:50.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.867+0000 7fcd44281780 1 < canceled multipart upload key=B5OH55MQGSGJ upload=6SLJED74A5NG tag=9VN0TYZAY0I2 type=write size=3682876 2024-09-12T00:37:50.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.869+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~29YUAWEOHTKA.0 size=1048576 2024-09-12T00:37:50.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.870+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~29YUAWEOHTKA.1 size=487517 2024-09-12T00:37:50.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.870+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=29YUAWEOHTKA tag=8I5ZR73020ZG type=write size=2584669 2024-09-12T00:37:50.871 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.872+0000 7fcd44281780 1 < completed delete operation key=UXY6K0AVI4EK tag=YCP7S6QWK1BT type=del 2024-09-12T00:37:50.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.874+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~N0RH6XYJUEYP.0 size=1048576 2024-09-12T00:37:50.874 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.876+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~N0RH6XYJUEYP.1 size=440838 2024-09-12T00:37:50.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.876+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=N0RH6XYJUEYP tag=2EY2JIVFY2K2 type=write size=2537990 2024-09-12T00:37:50.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.879+0000 7fcd44281780 1 < suggested update operation key=IK8POOY7ZWNF tag=GNX4FFAXDNZA type=del size=540467 2024-09-12T00:37:50.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.880+0000 7fcd44281780 1 > prepared operation key=0OEDZ5O2LN8H tag=1B8Z6HRDW9UY type=write size=697127 2024-09-12T00:37:50.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.882+0000 7fcd44281780 1 < canceled operation key=QVULC3H9QGXE tag=HTU0T7ARVOXZ type=del size=445495 2024-09-12T00:37:50.883 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.885+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~MBGR4SVJK681.0 size=1048576 2024-09-12T00:37:50.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.886+0000 7fcd44281780 1 > prepared part key=_multipart_O12Z8THB62AJ.2~MBGR4SVJK681.1 size=610216 2024-09-12T00:37:50.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.886+0000 7fcd44281780 1 > prepared multipart upload key=O12Z8THB62AJ upload=MBGR4SVJK681 tag=XPYZUOLCJ3V9 type=write size=2707368 2024-09-12T00:37:50.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.888+0000 7fcd44281780 -1 < failed to complete operation key=0O62FO4WVZG6 tag=ZWWSZNML7BW0 type=del size=1982201: (22) Invalid argument 2024-09-12T00:37:50.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.889+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=BVHRUXDDT62I type=del size=2279382 2024-09-12T00:37:50.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.892+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~X0LDXEZ3JKPA.0 size=1048576 2024-09-12T00:37:50.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.893+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~X0LDXEZ3JKPA.1 size=869991 2024-09-12T00:37:50.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.896+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=X0LDXEZ3JKPA tag=WBA2BO8LVXOP type=write size=2967143 2024-09-12T00:37:50.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.897+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=4OHI11K1WW8D type=del size=1469687 2024-09-12T00:37:50.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.899+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~59X5IJX0CQO1.0 size=1048576 2024-09-12T00:37:50.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.900+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~59X5IJX0CQO1.1 size=357161 2024-09-12T00:37:50.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.902+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=59X5IJX0CQO1 tag=3XLQO5CN3G0S type=write size=2454313 2024-09-12T00:37:50.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.904+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=I2JHQ9QVMYAC type=del size=2617987 2024-09-12T00:37:50.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.904+0000 7fcd44281780 1 < canceled part key=_multipart_KNBCXZF3JGNL.2~1N3Z6J1CYHRV.0 size=699384 2024-09-12T00:37:50.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.907+0000 7fcd44281780 1 < canceled multipart upload key=KNBCXZF3JGNL upload=1N3Z6J1CYHRV tag=ESEKIR8YLSID type=write size=1747960 2024-09-12T00:37:50.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.910+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~VOD05ZKK73ZM.0 size=1048576 2024-09-12T00:37:50.909 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.911+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~VOD05ZKK73ZM.1 size=1048576 2024-09-12T00:37:50.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.912+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~VOD05ZKK73ZM.2 size=637558 2024-09-12T00:37:50.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.912+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=VOD05ZKK73ZM tag=E64DN8WIY0WL type=write size=3783286 2024-09-12T00:37:50.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.913+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=2R3UP83IQ7WX type=del 2024-09-12T00:37:50.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.915+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=H5YV03C3ATX1 type=del size=2245479 2024-09-12T00:37:50.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.918+0000 7fcd44281780 1 < suggested remove operation key=U4EPPPA4QGGD tag=F31BH2XTYXPQ type=del 2024-09-12T00:37:50.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.919+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=2GC3717WE84F type=del size=3300669 2024-09-12T00:37:50.920 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.921+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~B4VXJEGGGT6U.0 size=1048576 2024-09-12T00:37:50.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.923+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~B4VXJEGGGT6U.1 size=1048576 2024-09-12T00:37:50.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.924+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~B4VXJEGGGT6U.2 size=601693 2024-09-12T00:37:50.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.926+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=B4VXJEGGGT6U tag=ACO0B576S3BO type=write size=3747421 2024-09-12T00:37:50.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.929+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~VVO3Y5TP3D5I.0 size=1048576 2024-09-12T00:37:50.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.930+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~VVO3Y5TP3D5I.1 size=427039 2024-09-12T00:37:50.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.930+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=VVO3Y5TP3D5I tag=OXJX5G0QR8I3 type=write size=2524191 2024-09-12T00:37:50.930 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.931+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~Y2DIBIG2IJL4.0 size=1048576 2024-09-12T00:37:50.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.932+0000 7fcd44281780 1 < completed part key=_multipart_U4EPPPA4QGGD.2~Y2DIBIG2IJL4.1 size=285776 2024-09-12T00:37:50.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.935+0000 7fcd44281780 1 < completed multipart upload key=U4EPPPA4QGGD upload=Y2DIBIG2IJL4 tag=53AATDIUQBLB type=write size=2382928 2024-09-12T00:37:50.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.937+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~D3YULDU81ETP.0 size=753825 2024-09-12T00:37:50.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.937+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=D3YULDU81ETP tag=9ACK13RZUFKN type=write size=1802401 2024-09-12T00:37:50.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.939+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~TML0PFRZMBA9.0 size=667584 2024-09-12T00:37:50.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.941+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=TML0PFRZMBA9 tag=29A4X5OAHX8H type=write size=1716160 2024-09-12T00:37:50.942 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.943+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=R7UN3Y55IUFJ type=del size=2087104 2024-09-12T00:37:50.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.945+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~3FG8IGGAB0Z3.0 size=1048576 2024-09-12T00:37:50.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.946+0000 7fcd44281780 1 < completed part key=_multipart_526O814C10YW.2~3FG8IGGAB0Z3.1 size=933650 2024-09-12T00:37:50.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.948+0000 7fcd44281780 1 < completed multipart upload key=526O814C10YW upload=3FG8IGGAB0Z3 tag=B9BAXSY36EBA type=write size=3030802 2024-09-12T00:37:50.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.949+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=B6ZCGG32PATR type=del size=1957776 2024-09-12T00:37:50.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.951+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~DQ3QJGHL8SO2.0 size=1048576 2024-09-12T00:37:50.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.952+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~DQ3QJGHL8SO2.1 size=141202 2024-09-12T00:37:50.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.954+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=DQ3QJGHL8SO2 tag=VW5H14925XSY type=write size=2238354 2024-09-12T00:37:50.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.955+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=DX7ICO3KWX91 type=del size=947769 2024-09-12T00:37:50.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.957+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~000TI7T3K82J.0 size=763477 2024-09-12T00:37:50.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.959+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=000TI7T3K82J tag=988XMHHJLS2B type=write size=1812053 2024-09-12T00:37:50.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.962+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~GOKZW1Q987FX.0 size=1048576 2024-09-12T00:37:50.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.963+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~GOKZW1Q987FX.1 size=1048576 2024-09-12T00:37:50.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.964+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~GOKZW1Q987FX.2 size=612346 2024-09-12T00:37:50.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.964+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=GOKZW1Q987FX tag=UBPV9L0R2EFF type=write size=3758074 2024-09-12T00:37:50.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.965+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~29YUAWEOHTKA.0 size=1048576 2024-09-12T00:37:50.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.967+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~29YUAWEOHTKA.1 size=487517 2024-09-12T00:37:50.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.969+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=29YUAWEOHTKA tag=8I5ZR73020ZG type=write size=2584669 2024-09-12T00:37:50.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.971+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~EM5OZ6VDU4BD.0 size=729174 2024-09-12T00:37:50.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.971+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=EM5OZ6VDU4BD tag=42NO6W486K5Z type=write size=1777750 2024-09-12T00:37:50.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.973+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~N0RH6XYJUEYP.0 size=1048576 2024-09-12T00:37:50.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.974+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~N0RH6XYJUEYP.1 size=440838 2024-09-12T00:37:50.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.976+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=N0RH6XYJUEYP tag=2EY2JIVFY2K2 type=write size=2537990 2024-09-12T00:37:50.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.979+0000 7fcd44281780 1 > prepared part key=_multipart_KJ0C43WLAFLI.2~PW0B7IX3ED09.0 size=927227 2024-09-12T00:37:50.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.979+0000 7fcd44281780 1 > prepared multipart upload key=KJ0C43WLAFLI upload=PW0B7IX3ED09 tag=OUBWTPJQ2FCV type=write size=1975803 2024-09-12T00:37:50.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.981+0000 7fcd44281780 1 < completed write operation key=0OEDZ5O2LN8H tag=1B8Z6HRDW9UY type=write size=697127 2024-09-12T00:37:50.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.983+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~A9U1NOS2DFRA.0 size=1048576 2024-09-12T00:37:50.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.985+0000 7fcd44281780 1 > prepared part key=_multipart_VOO70F2NBKL0.2~A9U1NOS2DFRA.1 size=360153 2024-09-12T00:37:50.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.985+0000 7fcd44281780 1 > prepared multipart upload key=VOO70F2NBKL0 upload=A9U1NOS2DFRA tag=SDKUC1WDNCTH type=write size=2457305 2024-09-12T00:37:50.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.986+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~MBGR4SVJK681.0 size=1048576 2024-09-12T00:37:50.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.987+0000 7fcd44281780 1 < completed part key=_multipart_O12Z8THB62AJ.2~MBGR4SVJK681.1 size=610216 2024-09-12T00:37:50.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.990+0000 7fcd44281780 1 < completed multipart upload key=O12Z8THB62AJ upload=MBGR4SVJK681 tag=XPYZUOLCJ3V9 type=write size=2707368 2024-09-12T00:37:50.990 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.991+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=1CM9WNOY4WJ5 type=del size=4068159 2024-09-12T00:37:50.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.993+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=BVHRUXDDT62I type=del 2024-09-12T00:37:50.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.995+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~7WOAOARA5V2G.0 size=1048576 2024-09-12T00:37:50.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.997+0000 7fcd44281780 1 > prepared part key=_multipart_ZQSZDU87GAMV.2~7WOAOARA5V2G.1 size=644487 2024-09-12T00:37:50.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.997+0000 7fcd44281780 1 > prepared multipart upload key=ZQSZDU87GAMV upload=7WOAOARA5V2G tag=7S2PN5KCV51A type=write size=2741639 2024-09-12T00:37:50.997 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:50.998+0000 7fcd44281780 1 < completed delete operation key=DKJ44Z9COIIK tag=4OHI11K1WW8D type=del 2024-09-12T00:37:50.998 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.000+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=3JDCOEPI5297 type=write size=505500 2024-09-12T00:37:51.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.001+0000 7fcd44281780 1 < completed delete operation key=EXP8U6QNSMQ0 tag=I2JHQ9QVMYAC type=del 2024-09-12T00:37:51.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.004+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~RV2SDLJIFOIA.0 size=1048576 2024-09-12T00:37:51.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.005+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~RV2SDLJIFOIA.1 size=675859 2024-09-12T00:37:51.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.005+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=RV2SDLJIFOIA tag=FQCRY69DPACV type=write size=2773011 2024-09-12T00:37:51.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.005+0000 7fcd44281780 1 < canceled part key=_multipart_VOO70F2NBKL0.2~VOD05ZKK73ZM.0 size=1048576 2024-09-12T00:37:51.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.006+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~VOD05ZKK73ZM.1 size=1048576 2024-09-12T00:37:51.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.008+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~VOD05ZKK73ZM.2 size=637558 2024-09-12T00:37:51.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.010+0000 7fcd44281780 1 < canceled multipart upload key=VOO70F2NBKL0 upload=VOD05ZKK73ZM tag=E64DN8WIY0WL type=write size=3783286 2024-09-12T00:37:51.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.012+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=SOLBRUR2RSVM type=write size=340780 2024-09-12T00:37:51.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.014+0000 7fcd44281780 1 < completed delete operation key=ZQSZDU87GAMV tag=H5YV03C3ATX1 type=del 2024-09-12T00:37:51.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.015+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=EPXDCFFG7J2S type=del size=3367071 2024-09-12T00:37:51.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.017+0000 7fcd44281780 1 < completed delete operation key=KNBCXZF3JGNL tag=2GC3717WE84F type=del 2024-09-12T00:37:51.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.019+0000 7fcd44281780 1 > prepared part key=_multipart_B5OH55MQGSGJ.2~17M5ZGDQXU03.0 size=904774 2024-09-12T00:37:51.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.019+0000 7fcd44281780 1 > prepared multipart upload key=B5OH55MQGSGJ upload=17M5ZGDQXU03 tag=T09WUXEV56M9 type=write size=1953350 2024-09-12T00:37:51.020 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.021+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~VVO3Y5TP3D5I.0 size=1048576 2024-09-12T00:37:51.021 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.022+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~VVO3Y5TP3D5I.1 size=427039 2024-09-12T00:37:51.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.025+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=VVO3Y5TP3D5I tag=OXJX5G0QR8I3 type=write size=2524191 2024-09-12T00:37:51.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.026+0000 7fcd44281780 1 > prepared operation key=NIDHAXQF55WX tag=V3RXNVSMGX6Q type=del size=1842358 2024-09-12T00:37:51.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.027+0000 7fcd44281780 1 < canceled part key=_multipart_KNBCXZF3JGNL.2~D3YULDU81ETP.0 size=753825 2024-09-12T00:37:51.028 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.029+0000 7fcd44281780 1 < canceled multipart upload key=KNBCXZF3JGNL upload=D3YULDU81ETP tag=9ACK13RZUFKN type=write size=1802401 2024-09-12T00:37:51.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.032+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~Q832PI14QWL9.0 size=1048576 2024-09-12T00:37:51.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.033+0000 7fcd44281780 1 > prepared part key=_multipart_Z6I6598B6J5I.2~Q832PI14QWL9.1 size=1044879 2024-09-12T00:37:51.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.033+0000 7fcd44281780 1 > prepared multipart upload key=Z6I6598B6J5I upload=Q832PI14QWL9 tag=2HR69S3NJWQ5 type=write size=3142031 2024-09-12T00:37:51.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.035+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=R7UN3Y55IUFJ type=del 2024-09-12T00:37:51.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.037+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~NMTTJKAA7JD7.0 size=1048576 2024-09-12T00:37:51.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.039+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~NMTTJKAA7JD7.1 size=1048576 2024-09-12T00:37:51.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.039+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~NMTTJKAA7JD7.2 size=649737 2024-09-12T00:37:51.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.039+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=NMTTJKAA7JD7 tag=U40V2WQA1HNP type=write size=3795465 2024-09-12T00:37:51.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.043+0000 7fcd44281780 1 < suggested update operation key=XTNXNF3D0HFK tag=B6ZCGG32PATR type=del size=1957776 2024-09-12T00:37:51.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.044+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=3CC6E36IY2PC type=write size=567677 2024-09-12T00:37:51.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.047+0000 7fcd44281780 1 < suggested remove operation key=4RU6HTH4J0U1 tag=DX7ICO3KWX91 type=del 2024-09-12T00:37:51.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.048+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=U2K9W706QJGJ type=write size=316134 2024-09-12T00:37:51.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.050+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~GOKZW1Q987FX.0 size=1048576 2024-09-12T00:37:51.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.050+0000 7fcd44281780 1 < canceled part key=_multipart_ZQSZDU87GAMV.2~GOKZW1Q987FX.1 size=1048576 2024-09-12T00:37:51.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.052+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~GOKZW1Q987FX.2 size=612346 2024-09-12T00:37:51.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.055+0000 7fcd44281780 1 < canceled multipart upload key=ZQSZDU87GAMV upload=GOKZW1Q987FX tag=UBPV9L0R2EFF type=write size=3758074 2024-09-12T00:37:51.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.057+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~WW20432AWFYT.0 size=1048576 2024-09-12T00:37:51.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.059+0000 7fcd44281780 1 > prepared part key=_multipart_UXY6K0AVI4EK.2~WW20432AWFYT.1 size=1019233 2024-09-12T00:37:51.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.059+0000 7fcd44281780 1 > prepared multipart upload key=UXY6K0AVI4EK upload=WW20432AWFYT tag=V8GMH1YON5IS type=write size=3116385 2024-09-12T00:37:51.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.060+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~EM5OZ6VDU4BD.0 size=729174 2024-09-12T00:37:51.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.063+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=EM5OZ6VDU4BD tag=42NO6W486K5Z type=write size=1777750 2024-09-12T00:37:51.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.064+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=WS2BUDKL8L0M type=del size=4074069 2024-09-12T00:37:51.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.066+0000 7fcd44281780 1 < completed part key=_multipart_KJ0C43WLAFLI.2~PW0B7IX3ED09.0 size=927227 2024-09-12T00:37:51.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.069+0000 7fcd44281780 1 < completed multipart upload key=KJ0C43WLAFLI upload=PW0B7IX3ED09 tag=OUBWTPJQ2FCV type=write size=1975803 2024-09-12T00:37:51.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.071+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~UYVMS7W3S52J.0 size=1002389 2024-09-12T00:37:51.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.071+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=UYVMS7W3S52J tag=3QG5J7WTHQEH type=write size=2050965 2024-09-12T00:37:51.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.073+0000 7fcd44281780 1 < completed part key=_multipart_VOO70F2NBKL0.2~A9U1NOS2DFRA.0 size=1048576 2024-09-12T00:37:51.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.073+0000 7fcd44281780 1 < canceled part key=_multipart_VOO70F2NBKL0.2~A9U1NOS2DFRA.1 size=360153 2024-09-12T00:37:51.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.076+0000 7fcd44281780 1 < canceled multipart upload key=VOO70F2NBKL0 upload=A9U1NOS2DFRA tag=SDKUC1WDNCTH type=write size=2457305 2024-09-12T00:37:51.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.079+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~VNXMNRNIYN0O.0 size=1048576 2024-09-12T00:37:51.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.080+0000 7fcd44281780 1 > prepared part key=_multipart_G8O8VXTUPQVP.2~VNXMNRNIYN0O.1 size=358273 2024-09-12T00:37:51.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.080+0000 7fcd44281780 1 > prepared multipart upload key=G8O8VXTUPQVP upload=VNXMNRNIYN0O tag=EMPY0GYMB9YF type=write size=2455425 2024-09-12T00:37:51.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.082+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=1CM9WNOY4WJ5 type=del 2024-09-12T00:37:51.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.085+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~0EMKXXJQXSGB.0 size=1048576 2024-09-12T00:37:51.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.086+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~0EMKXXJQXSGB.1 size=1048576 2024-09-12T00:37:51.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.087+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~0EMKXXJQXSGB.2 size=772257 2024-09-12T00:37:51.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.087+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=0EMKXXJQXSGB tag=FI2G992MREUB type=write size=3917985 2024-09-12T00:37:51.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.087+0000 7fcd44281780 1 < canceled part key=_multipart_ZQSZDU87GAMV.2~7WOAOARA5V2G.0 size=1048576 2024-09-12T00:37:51.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.088+0000 7fcd44281780 1 < completed part key=_multipart_ZQSZDU87GAMV.2~7WOAOARA5V2G.1 size=644487 2024-09-12T00:37:51.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.091+0000 7fcd44281780 1 < canceled multipart upload key=ZQSZDU87GAMV upload=7WOAOARA5V2G tag=7S2PN5KCV51A type=write size=2741639 2024-09-12T00:37:51.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.092+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=B33XI3WLSEWD type=del size=539822 2024-09-12T00:37:51.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.093+0000 7fcd44281780 1 < completed write operation key=7UCICX0GHHQ1 tag=3JDCOEPI5297 type=write size=505500 2024-09-12T00:37:51.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.096+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~Y3OVQIMXPX6N.0 size=1048576 2024-09-12T00:37:51.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.096+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~Y3OVQIMXPX6N.1 size=651219 2024-09-12T00:37:51.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.096+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=Y3OVQIMXPX6N tag=00F830RWZCC3 type=write size=2748371 2024-09-12T00:37:51.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.098+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~RV2SDLJIFOIA.0 size=1048576 2024-09-12T00:37:51.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.099+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~RV2SDLJIFOIA.1 size=675859 2024-09-12T00:37:51.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.101+0000 7fcd44281780 1 < completed multipart upload key=Z6I6598B6J5I upload=RV2SDLJIFOIA tag=FQCRY69DPACV type=write size=2773011 2024-09-12T00:37:51.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.103+0000 7fcd44281780 1 > prepared operation key=G8O8VXTUPQVP tag=XFVCB5GN0C6I type=write size=480085 2024-09-12T00:37:51.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.104+0000 7fcd44281780 1 < completed write operation key=UXY6K0AVI4EK tag=SOLBRUR2RSVM type=write size=340780 2024-09-12T00:37:51.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.105+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=WGG3GK4XXY2A type=del size=3915504 2024-09-12T00:37:51.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.108+0000 7fcd44281780 1 < suggested update operation key=AN6GRGZ22INA tag=EPXDCFFG7J2S type=del size=3367071 2024-09-12T00:37:51.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.109+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=63CCAR1F8MXK type=del size=1991829 2024-09-12T00:37:51.110 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.111+0000 7fcd44281780 1 < completed part key=_multipart_B5OH55MQGSGJ.2~17M5ZGDQXU03.0 size=904774 2024-09-12T00:37:51.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.113+0000 7fcd44281780 1 < completed multipart upload key=B5OH55MQGSGJ upload=17M5ZGDQXU03 tag=T09WUXEV56M9 type=write size=1953350 2024-09-12T00:37:51.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.115+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=DTSYFJXY4X4S type=del size=3646593 2024-09-12T00:37:51.115 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.116+0000 7fcd44281780 1 < completed delete operation key=NIDHAXQF55WX tag=V3RXNVSMGX6Q type=del 2024-09-12T00:37:51.117 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.118+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=Y8421QGOUO38 type=del size=2429195 2024-09-12T00:37:51.117 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.118+0000 7fcd44281780 1 < canceled part key=_multipart_Z6I6598B6J5I.2~Q832PI14QWL9.0 size=1048576 2024-09-12T00:37:51.118 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.119+0000 7fcd44281780 1 < completed part key=_multipart_Z6I6598B6J5I.2~Q832PI14QWL9.1 size=1044879 2024-09-12T00:37:51.120 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.121+0000 7fcd44281780 1 < canceled multipart upload key=Z6I6598B6J5I upload=Q832PI14QWL9 tag=2HR69S3NJWQ5 type=write size=3142031 2024-09-12T00:37:51.121 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.123+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=839ETM1LO8MF type=write size=70162 2024-09-12T00:37:51.123 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.124+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~NMTTJKAA7JD7.0 size=1048576 2024-09-12T00:37:51.123 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.124+0000 7fcd44281780 1 < canceled part key=_multipart_VXDTFEG8P23H.2~NMTTJKAA7JD7.1 size=1048576 2024-09-12T00:37:51.124 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.125+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~NMTTJKAA7JD7.2 size=649737 2024-09-12T00:37:51.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.129+0000 7fcd44281780 1 < canceled multipart upload key=VXDTFEG8P23H upload=NMTTJKAA7JD7 tag=U40V2WQA1HNP type=write size=3795465 2024-09-12T00:37:51.128 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.130+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=7X09F8XYF5NT type=del size=446543 2024-09-12T00:37:51.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.131+0000 7fcd44281780 1 < completed write operation key=ZQSZDU87GAMV tag=3CC6E36IY2PC type=write size=567677 2024-09-12T00:37:51.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.134+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~FQ1JIXO88XIU.0 size=1048576 2024-09-12T00:37:51.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.135+0000 7fcd44281780 1 > prepared part key=_multipart_DKJ44Z9COIIK.2~FQ1JIXO88XIU.1 size=1002467 2024-09-12T00:37:51.134 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.135+0000 7fcd44281780 1 > prepared multipart upload key=DKJ44Z9COIIK upload=FQ1JIXO88XIU tag=29JARXHC53CA type=write size=3099619 2024-09-12T00:37:51.136 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.137+0000 7fcd44281780 1 < suggested remove operation key=O12Z8THB62AJ tag=U2K9W706QJGJ type=write 2024-09-12T00:37:51.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.139+0000 7fcd44281780 1 > prepared operation key=WXBMIJ4FC0VX tag=16TH0WQFBAJS type=del size=4179798 2024-09-12T00:37:51.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.140+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~WW20432AWFYT.0 size=1048576 2024-09-12T00:37:51.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.141+0000 7fcd44281780 1 < completed part key=_multipart_UXY6K0AVI4EK.2~WW20432AWFYT.1 size=1019233 2024-09-12T00:37:51.142 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.144+0000 7fcd44281780 1 < completed multipart upload key=UXY6K0AVI4EK upload=WW20432AWFYT tag=V8GMH1YON5IS type=write size=3116385 2024-09-12T00:37:51.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.146+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~0I2D2VC5S18U.0 size=1048576 2024-09-12T00:37:51.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.147+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~0I2D2VC5S18U.1 size=526932 2024-09-12T00:37:51.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.147+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=0I2D2VC5S18U tag=SEGI90HL7ALB type=write size=2624084 2024-09-12T00:37:51.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.148+0000 7fcd44281780 1 < completed delete operation key=0AVE0W4OV1AU tag=WS2BUDKL8L0M type=del 2024-09-12T00:37:51.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.151+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~2IIPI16LS4Y6.0 size=1048576 2024-09-12T00:37:51.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.152+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~2IIPI16LS4Y6.1 size=1048576 2024-09-12T00:37:51.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.153+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~2IIPI16LS4Y6.2 size=23517 2024-09-12T00:37:51.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.153+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=2IIPI16LS4Y6 tag=2D99R2VY9YEP type=write size=3169245 2024-09-12T00:37:51.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.154+0000 7fcd44281780 1 < completed part key=_multipart_0OEDZ5O2LN8H.2~UYVMS7W3S52J.0 size=1002389 2024-09-12T00:37:51.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.157+0000 7fcd44281780 1 < completed multipart upload key=0OEDZ5O2LN8H upload=UYVMS7W3S52J tag=3QG5J7WTHQEH type=write size=2050965 2024-09-12T00:37:51.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.158+0000 7fcd44281780 1 > prepared operation key=B5OH55MQGSGJ tag=HHNT26PILLR1 type=del size=61168 2024-09-12T00:37:51.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.159+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~VNXMNRNIYN0O.0 size=1048576 2024-09-12T00:37:51.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.160+0000 7fcd44281780 1 < completed part key=_multipart_G8O8VXTUPQVP.2~VNXMNRNIYN0O.1 size=358273 2024-09-12T00:37:51.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.162+0000 7fcd44281780 1 < completed multipart upload key=G8O8VXTUPQVP upload=VNXMNRNIYN0O tag=EMPY0GYMB9YF type=write size=2455425 2024-09-12T00:37:51.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.163+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=XMXSZP3XXUX1 type=del size=3553157 2024-09-12T00:37:51.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.164+0000 7fcd44281780 1 < canceled part key=_multipart_RYSE2CKE5IRT.2~0EMKXXJQXSGB.0 size=1048576 2024-09-12T00:37:51.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.165+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~0EMKXXJQXSGB.1 size=1048576 2024-09-12T00:37:51.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.166+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~0EMKXXJQXSGB.2 size=772257 2024-09-12T00:37:51.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.168+0000 7fcd44281780 1 < canceled multipart upload key=RYSE2CKE5IRT upload=0EMKXXJQXSGB tag=FI2G992MREUB type=write size=3917985 2024-09-12T00:37:51.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.171+0000 7fcd44281780 1 > prepared part key=_multipart_EXP8U6QNSMQ0.2~PPI2BKKTOCEB.0 size=401202 2024-09-12T00:37:51.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.171+0000 7fcd44281780 1 > prepared multipart upload key=EXP8U6QNSMQ0 upload=PPI2BKKTOCEB tag=VYQ7S78ZJIY7 type=write size=1449778 2024-09-12T00:37:51.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.173+0000 7fcd44281780 1 < canceled operation key=DKJ44Z9COIIK tag=B33XI3WLSEWD type=del size=539822 2024-09-12T00:37:51.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.174+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=ZG9HYZ01UX3F type=del size=1921825 2024-09-12T00:37:51.174 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.175+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~Y3OVQIMXPX6N.0 size=1048576 2024-09-12T00:37:51.175 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.176+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~Y3OVQIMXPX6N.1 size=651219 2024-09-12T00:37:51.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.179+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=Y3OVQIMXPX6N tag=00F830RWZCC3 type=write size=2748371 2024-09-12T00:37:51.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.180+0000 7fcd44281780 1 > prepared operation key=VXDTFEG8P23H tag=JEMNRAZAA591 type=del size=3039717 2024-09-12T00:37:51.180 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.181+0000 7fcd44281780 1 < completed write operation key=G8O8VXTUPQVP tag=XFVCB5GN0C6I type=write size=480085 2024-09-12T00:37:51.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.183+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=C3X5E22VHTSB type=del size=336203 2024-09-12T00:37:51.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.184+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=WGG3GK4XXY2A type=del 2024-09-12T00:37:51.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.186+0000 7fcd44281780 1 > prepared operation key=ZQSZDU87GAMV tag=F6IIIIASOC97 type=del size=3733242 2024-09-12T00:37:51.187 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.188+0000 7fcd44281780 1 < suggested remove operation key=EXP8U6QNSMQ0 tag=63CCAR1F8MXK type=del 2024-09-12T00:37:51.189 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.190+0000 7fcd44281780 1 > prepared operation key=0AVE0W4OV1AU tag=HFXTK9GYHRJB type=del size=2267286 2024-09-12T00:37:51.190 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.191+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=DTSYFJXY4X4S type=del 2024-09-12T00:37:51.191 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.193+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=0GAFTUFPV0AG type=del size=4033005 2024-09-12T00:37:51.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.194+0000 7fcd44281780 1 < canceled operation key=U4EPPPA4QGGD tag=Y8421QGOUO38 type=del size=2429195 2024-09-12T00:37:51.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.197+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~L9LS8G1J4SW7.0 size=1048576 2024-09-12T00:37:51.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.198+0000 7fcd44281780 1 > prepared part key=_multipart_IK8POOY7ZWNF.2~L9LS8G1J4SW7.1 size=205778 2024-09-12T00:37:51.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.198+0000 7fcd44281780 1 > prepared multipart upload key=IK8POOY7ZWNF upload=L9LS8G1J4SW7 tag=O008EBRT01YR type=write size=2302930 2024-09-12T00:37:51.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.199+0000 7fcd44281780 1 < canceled operation key=RYSE2CKE5IRT tag=839ETM1LO8MF type=write size=70162 2024-09-12T00:37:51.199 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.201+0000 7fcd44281780 1 > prepared operation key=U4EPPPA4QGGD tag=AJWFVPW6BGYO type=del size=2193466 2024-09-12T00:37:51.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.203+0000 7fcd44281780 1 < suggested remove operation key=AJ5AUTM2J9MT tag=7X09F8XYF5NT type=del 2024-09-12T00:37:51.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.206+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~6W4M4XXT71FA.0 size=1048576 2024-09-12T00:37:51.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.209+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~6W4M4XXT71FA.1 size=1048576 2024-09-12T00:37:51.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.209+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~6W4M4XXT71FA.2 size=956058 2024-09-12T00:37:51.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.209+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=6W4M4XXT71FA tag=V05A7ET0C2L8 type=write size=4101786 2024-09-12T00:37:51.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.211+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~FQ1JIXO88XIU.0 size=1048576 2024-09-12T00:37:51.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.212+0000 7fcd44281780 1 < completed part key=_multipart_DKJ44Z9COIIK.2~FQ1JIXO88XIU.1 size=1002467 2024-09-12T00:37:51.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.214+0000 7fcd44281780 1 < completed multipart upload key=DKJ44Z9COIIK upload=FQ1JIXO88XIU tag=29JARXHC53CA type=write size=3099619 2024-09-12T00:37:51.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.216+0000 7fcd44281780 1 > prepared operation key=8U004LC8IYLQ tag=X5Y7Q0A7K080 type=del size=316472 2024-09-12T00:37:51.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.217+0000 7fcd44281780 1 < completed delete operation key=WXBMIJ4FC0VX tag=16TH0WQFBAJS type=del 2024-09-12T00:37:51.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.219+0000 7fcd44281780 1 > prepared operation key=0O62FO4WVZG6 tag=Z7HI7KX9MUT6 type=del size=510297 2024-09-12T00:37:51.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.220+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~0I2D2VC5S18U.0 size=1048576 2024-09-12T00:37:51.220 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.221+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~0I2D2VC5S18U.1 size=526932 2024-09-12T00:37:51.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.224+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=0I2D2VC5S18U tag=SEGI90HL7ALB type=write size=2624084 2024-09-12T00:37:51.225 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.226+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~8VS4OZZLA1V8.0 size=1048576 2024-09-12T00:37:51.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.227+0000 7fcd44281780 1 > prepared part key=_multipart_XTNXNF3D0HFK.2~8VS4OZZLA1V8.1 size=754893 2024-09-12T00:37:51.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.227+0000 7fcd44281780 1 > prepared multipart upload key=XTNXNF3D0HFK upload=8VS4OZZLA1V8 tag=VHHLCFWCETO0 type=write size=2852045 2024-09-12T00:37:51.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.229+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~2IIPI16LS4Y6.0 size=1048576 2024-09-12T00:37:51.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.230+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~2IIPI16LS4Y6.1 size=1048576 2024-09-12T00:37:51.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.231+0000 7fcd44281780 1 < completed part key=_multipart_8U004LC8IYLQ.2~2IIPI16LS4Y6.2 size=23517 2024-09-12T00:37:51.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.234+0000 7fcd44281780 1 < completed multipart upload key=8U004LC8IYLQ upload=2IIPI16LS4Y6 tag=2D99R2VY9YEP type=write size=3169245 2024-09-12T00:37:51.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.235+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=5ARNN5UVUFZ2 type=write size=418168 2024-09-12T00:37:51.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.237+0000 7fcd44281780 1 < completed delete operation key=B5OH55MQGSGJ tag=HHNT26PILLR1 type=del 2024-09-12T00:37:51.238 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.239+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~RFEVJJL6HATO.0 size=1048576 2024-09-12T00:37:51.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.240+0000 7fcd44281780 1 > prepared part key=_multipart_AN6GRGZ22INA.2~RFEVJJL6HATO.1 size=777172 2024-09-12T00:37:51.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.240+0000 7fcd44281780 1 > prepared multipart upload key=AN6GRGZ22INA upload=RFEVJJL6HATO tag=NSO9NLHFKV0W type=write size=2874324 2024-09-12T00:37:51.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.244+0000 7fcd44281780 1 < suggested remove operation key=7UCICX0GHHQ1 tag=XMXSZP3XXUX1 type=del 2024-09-12T00:37:51.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.247+0000 7fcd44281780 1 > prepared part key=_multipart_RYSE2CKE5IRT.2~WULBVXS3SD1H.0 size=421263 2024-09-12T00:37:51.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.247+0000 7fcd44281780 1 > prepared multipart upload key=RYSE2CKE5IRT upload=WULBVXS3SD1H tag=MCTVHHGDTWTC type=write size=1469839 2024-09-12T00:37:51.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.248+0000 7fcd44281780 1 < completed part key=_multipart_EXP8U6QNSMQ0.2~PPI2BKKTOCEB.0 size=401202 2024-09-12T00:37:51.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.251+0000 7fcd44281780 1 < completed multipart upload key=EXP8U6QNSMQ0 upload=PPI2BKKTOCEB tag=VYQ7S78ZJIY7 type=write size=1449778 2024-09-12T00:37:51.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.255+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~PCV49GFUSEUC.0 size=1048576 2024-09-12T00:37:51.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.256+0000 7fcd44281780 1 > prepared part key=_multipart_VXDTFEG8P23H.2~PCV49GFUSEUC.1 size=455645 2024-09-12T00:37:51.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.256+0000 7fcd44281780 1 > prepared multipart upload key=VXDTFEG8P23H upload=PCV49GFUSEUC tag=3GSUEDRVNXYS type=write size=2552797 2024-09-12T00:37:51.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.257+0000 7fcd44281780 1 < completed delete operation key=IK8POOY7ZWNF tag=ZG9HYZ01UX3F type=del 2024-09-12T00:37:51.258 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.260+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~6I2WG5AJQ9BH.0 size=1048576 2024-09-12T00:37:51.259 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.261+0000 7fcd44281780 1 > prepared part key=_multipart_AJ5AUTM2J9MT.2~6I2WG5AJQ9BH.1 size=354979 2024-09-12T00:37:51.260 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.261+0000 7fcd44281780 1 > prepared multipart upload key=AJ5AUTM2J9MT upload=6I2WG5AJQ9BH tag=KWEBS8YQHB4A type=write size=2452131 2024-09-12T00:37:51.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.262+0000 7fcd44281780 1 < completed delete operation key=VXDTFEG8P23H tag=JEMNRAZAA591 type=del 2024-09-12T00:37:51.262 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.263+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=F6Q80PE61OLM type=write size=474641 2024-09-12T00:37:51.265 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.266+0000 7fcd44281780 1 < suggested remove operation key=KNBCXZF3JGNL tag=C3X5E22VHTSB type=del 2024-09-12T00:37:51.266 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.267+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=4GAVMFB94S2F type=write size=255562 2024-09-12T00:37:51.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.269+0000 7fcd44281780 1 < canceled operation key=ZQSZDU87GAMV tag=F6IIIIASOC97 type=del size=3733242 2024-09-12T00:37:51.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.271+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~HAK95UQWGJ66.0 size=1048576 2024-09-12T00:37:51.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.272+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~HAK95UQWGJ66.1 size=1048576 2024-09-12T00:37:51.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.273+0000 7fcd44281780 1 > prepared part key=_multipart_XRW0CRE12S5B.2~HAK95UQWGJ66.2 size=192408 2024-09-12T00:37:51.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.273+0000 7fcd44281780 1 > prepared multipart upload key=XRW0CRE12S5B upload=HAK95UQWGJ66 tag=LQSAZJSH9HUN type=write size=3338136 2024-09-12T00:37:51.275 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.276+0000 7fcd44281780 1 < suggested update operation key=0AVE0W4OV1AU tag=HFXTK9GYHRJB type=del size=2267286 2024-09-12T00:37:51.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.278+0000 7fcd44281780 1 > prepared operation key=VOO70F2NBKL0 tag=0PPD4HEB2WDO type=del size=781447 2024-09-12T00:37:51.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.281+0000 7fcd44281780 1 < suggested remove operation key=UXY6K0AVI4EK tag=0GAFTUFPV0AG type=del 2024-09-12T00:37:51.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.283+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~R0WVIJ1MMHL1.0 size=1048576 2024-09-12T00:37:51.283 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.284+0000 7fcd44281780 1 > prepared part key=_multipart_7UCICX0GHHQ1.2~R0WVIJ1MMHL1.1 size=1032995 2024-09-12T00:37:51.283 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.284+0000 7fcd44281780 1 > prepared multipart upload key=7UCICX0GHHQ1 upload=R0WVIJ1MMHL1 tag=7ZCBPDODODFK type=write size=3130147 2024-09-12T00:37:51.284 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.286+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~L9LS8G1J4SW7.0 size=1048576 2024-09-12T00:37:51.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.287+0000 7fcd44281780 1 < completed part key=_multipart_IK8POOY7ZWNF.2~L9LS8G1J4SW7.1 size=205778 2024-09-12T00:37:51.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.290+0000 7fcd44281780 1 < completed multipart upload key=IK8POOY7ZWNF upload=L9LS8G1J4SW7 tag=O008EBRT01YR type=write size=2302930 2024-09-12T00:37:51.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.291+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=SIZL1TKMCAXB type=write size=343538 2024-09-12T00:37:51.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.292+0000 7fcd44281780 1 < completed delete operation key=U4EPPPA4QGGD tag=AJWFVPW6BGYO type=del 2024-09-12T00:37:51.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.295+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~R8T733P9RSO2.0 size=1048576 2024-09-12T00:37:51.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.296+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~R8T733P9RSO2.1 size=1048576 2024-09-12T00:37:51.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.297+0000 7fcd44281780 1 > prepared part key=_multipart_WXBMIJ4FC0VX.2~R8T733P9RSO2.2 size=507799 2024-09-12T00:37:51.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.297+0000 7fcd44281780 1 > prepared multipart upload key=WXBMIJ4FC0VX upload=R8T733P9RSO2 tag=281TZHSLC95J type=write size=3653527 2024-09-12T00:37:51.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.298+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~6W4M4XXT71FA.0 size=1048576 2024-09-12T00:37:51.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.299+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~6W4M4XXT71FA.1 size=1048576 2024-09-12T00:37:51.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.300+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~6W4M4XXT71FA.2 size=956058 2024-09-12T00:37:51.301 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.302+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=6W4M4XXT71FA tag=V05A7ET0C2L8 type=write size=4101786 2024-09-12T00:37:51.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.305+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~PXGD4T0O9XX5.0 size=1048576 2024-09-12T00:37:51.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.307+0000 7fcd44281780 1 > prepared part key=_multipart_4RU6HTH4J0U1.2~PXGD4T0O9XX5.1 size=76616 2024-09-12T00:37:51.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.307+0000 7fcd44281780 1 > prepared multipart upload key=4RU6HTH4J0U1 upload=PXGD4T0O9XX5 tag=K6XOASQNEWFF type=write size=2173768 2024-09-12T00:37:51.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.308+0000 7fcd44281780 1 < completed delete operation key=8U004LC8IYLQ tag=X5Y7Q0A7K080 type=del 2024-09-12T00:37:51.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.311+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~XH0UEA8AH1JK.0 size=1048576 2024-09-12T00:37:51.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.312+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~XH0UEA8AH1JK.1 size=1048576 2024-09-12T00:37:51.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.313+0000 7fcd44281780 1 > prepared part key=_multipart_KNBCXZF3JGNL.2~XH0UEA8AH1JK.2 size=667167 2024-09-12T00:37:51.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.313+0000 7fcd44281780 1 > prepared multipart upload key=KNBCXZF3JGNL upload=XH0UEA8AH1JK tag=3EC3GJ65E5KA type=write size=3812895 2024-09-12T00:37:51.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.315+0000 7fcd44281780 1 < completed delete operation key=0O62FO4WVZG6 tag=Z7HI7KX9MUT6 type=del 2024-09-12T00:37:51.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.316+0000 7fcd44281780 1 > prepared operation key=CF7B7J3V1YFG tag=GTA8WO8I7RXI type=del size=1775191 2024-09-12T00:37:51.316 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.318+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~8VS4OZZLA1V8.0 size=1048576 2024-09-12T00:37:51.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.319+0000 7fcd44281780 1 < completed part key=_multipart_XTNXNF3D0HFK.2~8VS4OZZLA1V8.1 size=754893 2024-09-12T00:37:51.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.321+0000 7fcd44281780 1 < completed multipart upload key=XTNXNF3D0HFK upload=8VS4OZZLA1V8 tag=VHHLCFWCETO0 type=write size=2852045 2024-09-12T00:37:51.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.322+0000 7fcd44281780 1 > prepared operation key=KNBCXZF3JGNL tag=EJTDKDBNENO3 type=write size=990124 2024-09-12T00:37:51.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.324+0000 7fcd44281780 1 < completed write operation key=XTNXNF3D0HFK tag=5ARNN5UVUFZ2 type=write size=418168 2024-09-12T00:37:51.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.326+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=BW5JMDNQ7E6M type=del size=2062523 2024-09-12T00:37:51.326 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.327+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~RFEVJJL6HATO.0 size=1048576 2024-09-12T00:37:51.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.328+0000 7fcd44281780 1 < completed part key=_multipart_AN6GRGZ22INA.2~RFEVJJL6HATO.1 size=777172 2024-09-12T00:37:51.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.331+0000 7fcd44281780 1 < completed multipart upload key=AN6GRGZ22INA upload=RFEVJJL6HATO tag=NSO9NLHFKV0W type=write size=2874324 2024-09-12T00:37:51.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.332+0000 7fcd44281780 1 > prepared operation key=O12Z8THB62AJ tag=MTTKXRG8GGT0 type=del size=694068 2024-09-12T00:37:51.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.334+0000 7fcd44281780 1 < completed part key=_multipart_RYSE2CKE5IRT.2~WULBVXS3SD1H.0 size=421263 2024-09-12T00:37:51.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.336+0000 7fcd44281780 1 < completed multipart upload key=RYSE2CKE5IRT upload=WULBVXS3SD1H tag=MCTVHHGDTWTC type=write size=1469839 2024-09-12T00:37:51.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.338+0000 7fcd44281780 1 > prepared part key=_multipart_0OEDZ5O2LN8H.2~4GCG1M1JIVXK.0 size=778708 2024-09-12T00:37:51.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.338+0000 7fcd44281780 1 > prepared multipart upload key=0OEDZ5O2LN8H upload=4GCG1M1JIVXK tag=XVK7DLKHFEAU type=write size=1827284 2024-09-12T00:37:51.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.341+0000 7fcd44281780 1 < completed part key=_multipart_VXDTFEG8P23H.2~PCV49GFUSEUC.0 size=1048576 2024-09-12T00:37:51.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.341+0000 7fcd44281780 1 < canceled part key=_multipart_VXDTFEG8P23H.2~PCV49GFUSEUC.1 size=455645 2024-09-12T00:37:51.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.343+0000 7fcd44281780 1 < canceled multipart upload key=VXDTFEG8P23H upload=PCV49GFUSEUC tag=3GSUEDRVNXYS type=write size=2552797 2024-09-12T00:37:51.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.345+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=I5EUAGWP8W0J type=del size=1977023 2024-09-12T00:37:51.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.346+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~6I2WG5AJQ9BH.0 size=1048576 2024-09-12T00:37:51.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.347+0000 7fcd44281780 1 < completed part key=_multipart_AJ5AUTM2J9MT.2~6I2WG5AJQ9BH.1 size=354979 2024-09-12T00:37:51.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.350+0000 7fcd44281780 1 < completed multipart upload key=AJ5AUTM2J9MT upload=6I2WG5AJQ9BH tag=KWEBS8YQHB4A type=write size=2452131 2024-09-12T00:37:51.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.351+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=XAV6V1OZME8X type=del size=2782559 2024-09-12T00:37:51.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.353+0000 7fcd44281780 1 < suggested remove operation key=UXY6K0AVI4EK tag=F6Q80PE61OLM type=write 2024-09-12T00:37:51.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.355+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=3HG0FGZUF78B type=del size=271543 2024-09-12T00:37:51.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.357+0000 7fcd44281780 1 < completed write operation key=AJ5AUTM2J9MT tag=4GAVMFB94S2F type=write size=255562 2024-09-12T00:37:51.357 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.358+0000 7fcd44281780 1 > prepared operation key=AN6GRGZ22INA tag=WFXTPCZ773GO type=del size=3248579 2024-09-12T00:37:51.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.359+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~HAK95UQWGJ66.0 size=1048576 2024-09-12T00:37:51.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.360+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~HAK95UQWGJ66.1 size=1048576 2024-09-12T00:37:51.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.361+0000 7fcd44281780 1 < completed part key=_multipart_XRW0CRE12S5B.2~HAK95UQWGJ66.2 size=192408 2024-09-12T00:37:51.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.364+0000 7fcd44281780 1 < completed multipart upload key=XRW0CRE12S5B upload=HAK95UQWGJ66 tag=LQSAZJSH9HUN type=write size=3338136 2024-09-12T00:37:51.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.365+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=N143C200OYB1 type=del size=2700236 2024-09-12T00:37:51.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.367+0000 7fcd44281780 1 < completed delete operation key=VOO70F2NBKL0 tag=0PPD4HEB2WDO type=del 2024-09-12T00:37:51.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.368+0000 7fcd44281780 1 > prepared operation key=QVULC3H9QGXE tag=NT3XYBW0Q6NT type=del size=1586676 2024-09-12T00:37:51.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.369+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~R0WVIJ1MMHL1.0 size=1048576 2024-09-12T00:37:51.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.372+0000 7fcd44281780 1 < completed part key=_multipart_7UCICX0GHHQ1.2~R0WVIJ1MMHL1.1 size=1032995 2024-09-12T00:37:51.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.374+0000 7fcd44281780 1 < completed multipart upload key=7UCICX0GHHQ1 upload=R0WVIJ1MMHL1 tag=7ZCBPDODODFK type=write size=3130147 2024-09-12T00:37:51.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.377+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~0I7EXE1SAC9A.0 size=1048576 2024-09-12T00:37:51.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.378+0000 7fcd44281780 1 > prepared part key=_multipart_U4EPPPA4QGGD.2~0I7EXE1SAC9A.1 size=282203 2024-09-12T00:37:51.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.378+0000 7fcd44281780 1 > prepared multipart upload key=U4EPPPA4QGGD upload=0I7EXE1SAC9A tag=LVQ4CO31337J type=write size=2379355 2024-09-12T00:37:51.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.379+0000 7fcd44281780 1 < completed write operation key=7UCICX0GHHQ1 tag=SIZL1TKMCAXB type=write size=343538 2024-09-12T00:37:51.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.381+0000 7fcd44281780 1 > prepared operation key=EXP8U6QNSMQ0 tag=56OE31U5ZYNK type=write size=622645 2024-09-12T00:37:51.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.382+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~R8T733P9RSO2.0 size=1048576 2024-09-12T00:37:51.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.384+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~R8T733P9RSO2.1 size=1048576 2024-09-12T00:37:51.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.385+0000 7fcd44281780 1 < completed part key=_multipart_WXBMIJ4FC0VX.2~R8T733P9RSO2.2 size=507799 2024-09-12T00:37:51.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.387+0000 7fcd44281780 1 < completed multipart upload key=WXBMIJ4FC0VX upload=R8T733P9RSO2 tag=281TZHSLC95J type=write size=3653527 2024-09-12T00:37:51.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.388+0000 7fcd44281780 1 > prepared operation key=7UCICX0GHHQ1 tag=BVRRZTRHF2JO type=del size=2310576 2024-09-12T00:37:51.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.390+0000 7fcd44281780 1 < completed part key=_multipart_4RU6HTH4J0U1.2~PXGD4T0O9XX5.0 size=1048576 2024-09-12T00:37:51.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.390+0000 7fcd44281780 1 < canceled part key=_multipart_4RU6HTH4J0U1.2~PXGD4T0O9XX5.1 size=76616 2024-09-12T00:37:51.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.392+0000 7fcd44281780 1 < canceled multipart upload key=4RU6HTH4J0U1 upload=PXGD4T0O9XX5 tag=K6XOASQNEWFF type=write size=2173768 2024-09-12T00:37:51.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.395+0000 7fcd44281780 1 > prepared operation key=IK8POOY7ZWNF tag=3B2ON3OX2UTY type=del size=3651610 2024-09-12T00:37:51.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.396+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~XH0UEA8AH1JK.0 size=1048576 2024-09-12T00:37:51.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.398+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~XH0UEA8AH1JK.1 size=1048576 2024-09-12T00:37:51.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.399+0000 7fcd44281780 1 < completed part key=_multipart_KNBCXZF3JGNL.2~XH0UEA8AH1JK.2 size=667167 2024-09-12T00:37:51.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.401+0000 7fcd44281780 1 < completed multipart upload key=KNBCXZF3JGNL upload=XH0UEA8AH1JK tag=3EC3GJ65E5KA type=write size=3812895 2024-09-12T00:37:51.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.403+0000 7fcd44281780 1 > prepared operation key=UXY6K0AVI4EK tag=40AS5H3NZ1AK type=del size=2483172 2024-09-12T00:37:51.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.404+0000 7fcd44281780 1 < completed delete operation key=CF7B7J3V1YFG tag=GTA8WO8I7RXI type=del 2024-09-12T00:37:51.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.407+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~BNBGOUYF37BP.0 size=1048576 2024-09-12T00:37:51.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.408+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~BNBGOUYF37BP.1 size=1048576 2024-09-12T00:37:51.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.409+0000 7fcd44281780 1 > prepared part key=_multipart_8U004LC8IYLQ.2~BNBGOUYF37BP.2 size=334961 2024-09-12T00:37:51.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.409+0000 7fcd44281780 1 > prepared multipart upload key=8U004LC8IYLQ upload=BNBGOUYF37BP tag=HWOH13180OUM type=write size=3480689 2024-09-12T00:37:51.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.412+0000 7fcd44281780 1 < suggested remove operation key=KNBCXZF3JGNL tag=EJTDKDBNENO3 type=write 2024-09-12T00:37:51.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.414+0000 7fcd44281780 1 > prepared operation key=RYSE2CKE5IRT tag=DKOM0NXKK1UN type=write size=786284 2024-09-12T00:37:51.415 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.416+0000 7fcd44281780 -1 < failed to complete operation key=UXY6K0AVI4EK tag=BW5JMDNQ7E6M type=del size=2062523: (22) Invalid argument 2024-09-12T00:37:51.416 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.417+0000 7fcd44281780 1 > prepared operation key=0ELZXPZCRPGP tag=VWKBF1R619FN type=del size=2455779 2024-09-12T00:37:51.418 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.419+0000 7fcd44281780 1 < completed delete operation key=O12Z8THB62AJ tag=MTTKXRG8GGT0 type=del 2024-09-12T00:37:51.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.422+0000 7fcd44281780 1 > prepared part key=_multipart_0AVE0W4OV1AU.2~U31PU0YRPFTX.0 size=10869 2024-09-12T00:37:51.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.422+0000 7fcd44281780 1 > prepared multipart upload key=0AVE0W4OV1AU upload=U31PU0YRPFTX tag=M3EGOA4ETUWR type=write size=1059445 2024-09-12T00:37:51.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.422+0000 7fcd44281780 1 < canceled part key=_multipart_0OEDZ5O2LN8H.2~4GCG1M1JIVXK.0 size=778708 2024-09-12T00:37:51.423 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.424+0000 7fcd44281780 1 < canceled multipart upload key=0OEDZ5O2LN8H upload=4GCG1M1JIVXK tag=XVK7DLKHFEAU type=write size=1827284 2024-09-12T00:37:51.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.425+0000 7fcd44281780 1 > prepared operation key=AJ5AUTM2J9MT tag=ETC4ESGIAVFC type=del size=1207709 2024-09-12T00:37:51.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.427+0000 7fcd44281780 1 < completed delete operation key=AN6GRGZ22INA tag=I5EUAGWP8W0J type=del 2024-09-12T00:37:51.427 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.428+0000 7fcd44281780 1 > prepared operation key=4RU6HTH4J0U1 tag=EN55717VWLH8 type=del size=2138809 2024-09-12T00:37:51.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.430+0000 7fcd44281780 1 < completed delete operation key=AJ5AUTM2J9MT tag=XAV6V1OZME8X type=del 2024-09-12T00:37:51.431 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.432+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~3P626YL9N2W1.0 size=1048576 2024-09-12T00:37:51.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.433+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~3P626YL9N2W1.1 size=1048576 2024-09-12T00:37:51.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.434+0000 7fcd44281780 1 > prepared part key=_multipart_NIDHAXQF55WX.2~3P626YL9N2W1.2 size=1035038 2024-09-12T00:37:51.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.434+0000 7fcd44281780 1 > prepared multipart upload key=NIDHAXQF55WX upload=3P626YL9N2W1 tag=VZJGG11VVY6L type=write size=4180766 2024-09-12T00:37:51.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.436+0000 7fcd44281780 1 < canceled operation key=7UCICX0GHHQ1 tag=3HG0FGZUF78B type=del size=271543 2024-09-12T00:37:51.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.438+0000 7fcd44281780 1 > prepared operation key=DKJ44Z9COIIK tag=NKAYPJC0QTKB type=del size=41073 2024-09-12T00:37:51.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.441+0000 7fcd44281780 1 < suggested remove operation key=AN6GRGZ22INA tag=WFXTPCZ773GO type=del 2024-09-12T00:37:51.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:37:51.442+0000 7fcd44281780 1 > prepared operation key=XTNXNF3D0HFK tag=RDZT4V8C16EG type=del size=2647330 2024-09-12T00:37:51.441 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] cls_rgw_stats.simulate (10821 ms) 2024-09-12T00:37:51.442 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 1 test from cls_rgw_stats (10822 ms total) 2024-09-12T00:37:51.442 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:37:51.442 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:37:51.712 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 1 test from 1 test suite ran. (12985 ms total) 2024-09-12T00:37:51.712 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 1 test. 2024-09-12T00:37:51.716 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:37:51.716 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:37:51.800 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T00:37:51.801 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T00:37:51.802 DEBUG:teuthology.orchestra.run.smithi062:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T00:37:51.890 INFO:tasks.workunit.client.0.smithi062.stdout:Running main() from gmock_main.cc 2024-09-12T00:37:51.890 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T00:37:51.890 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:37:53.734 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 31 tests from CmpOmap 2024-09-12T00:37:53.735 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T00:37:53.746 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (12 ms) 2024-09-12T00:37:53.746 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T00:37:53.752 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (6 ms) 2024-09-12T00:37:53.752 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T00:37:53.755 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-12T00:37:53.755 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T00:37:53.758 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (4 ms) 2024-09-12T00:37:53.758 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T00:37:53.765 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_vals_str (6 ms) 2024-09-12T00:37:53.765 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T00:37:53.771 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_vals_u64 (6 ms) 2024-09-12T00:37:53.771 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T00:37:53.774 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-12T00:37:53.774 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T00:37:53.776 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (2 ms) 2024-09-12T00:37:53.776 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T00:37:53.780 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-12T00:37:53.780 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T00:37:53.784 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2024-09-12T00:37:53.784 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T00:37:53.784 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T00:37:53.785 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T00:37:53.785 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2024-09-12T00:37:53.785 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T00:37:53.792 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (7 ms) 2024-09-12T00:37:53.792 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T00:37:53.798 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2024-09-12T00:37:53.798 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T00:37:53.804 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2024-09-12T00:37:53.804 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T00:37:53.811 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (6 ms) 2024-09-12T00:37:53.811 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T00:37:53.820 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_set_vals_str (9 ms) 2024-09-12T00:37:53.820 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T00:37:53.828 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-12T00:37:53.828 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T00:37:53.830 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (2 ms) 2024-09-12T00:37:53.830 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T00:37:53.833 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-12T00:37:53.833 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T00:37:53.834 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-12T00:37:53.834 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T00:37:53.834 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2024-09-12T00:37:53.834 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T00:37:53.841 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-09-12T00:37:53.841 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T00:37:53.847 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2024-09-12T00:37:53.847 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T00:37:53.855 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (8 ms) 2024-09-12T00:37:53.855 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T00:37:53.862 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (7 ms) 2024-09-12T00:37:53.862 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T00:37:53.864 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-12T00:37:53.864 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T00:37:53.867 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-12T00:37:53.867 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T00:37:53.868 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-12T00:37:53.868 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T00:37:53.868 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-09-12T00:37:53.869 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T00:37:53.876 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-09-12T00:37:53.876 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 31 tests from CmpOmap (142 ms total) 2024-09-12T00:37:53.876 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:37:53.876 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:37:54.740 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 31 tests from 1 test suite ran. (2850 ms total) 2024-09-12T00:37:54.740 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 31 tests. 2024-09-12T00:37:54.743 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:37:54.743 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:37:54.789 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T00:37:54.790 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T00:37:54.791 DEBUG:teuthology.orchestra.run.smithi062:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T00:37:54.839 INFO:tasks.workunit.client.0.smithi062.stdout:Running main() from gmock_main.cc 2024-09-12T00:37:54.839 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:37:54.839 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:37:54.839 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T00:37:54.839 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T00:37:57.758 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2919 ms) 2024-09-12T00:37:57.758 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T00:38:00.769 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3010 ms) 2024-09-12T00:38:00.769 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T00:38:03.797 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.Reserve (3029 ms) 2024-09-12T00:38:03.798 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T00:38:06.823 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3026 ms) 2024-09-12T00:38:06.824 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T00:38:09.831 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.Commit (3008 ms) 2024-09-12T00:38:09.831 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T00:38:12.857 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.Stats (3026 ms) 2024-09-12T00:38:12.857 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T00:38:16.892 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4035 ms) 2024-09-12T00:38:16.892 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T00:38:19.897 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.Abort (3005 ms) 2024-09-12T00:38:19.897 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T00:38:22.932 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.ReserveError (3035 ms) 2024-09-12T00:38:22.932 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T00:38:25.948 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.CommitError (3016 ms) 2024-09-12T00:38:25.948 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T00:38:28.967 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.AbortError (3019 ms) 2024-09-12T00:38:28.967 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T00:38:31.975 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3008 ms) 2024-09-12T00:38:31.975 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T00:38:34.995 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3020 ms) 2024-09-12T00:38:34.995 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T00:38:38.002 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3007 ms) 2024-09-12T00:38:38.002 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T00:38:41.035 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3033 ms) 2024-09-12T00:38:41.035 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T00:38:44.056 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3020 ms) 2024-09-12T00:38:44.056 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T00:38:47.073 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3018 ms) 2024-09-12T00:38:47.074 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T00:38:50.082 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.Cleanup (3008 ms) 2024-09-12T00:38:50.082 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T00:39:01.131 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.MultiProducer (11050 ms) 2024-09-12T00:39:01.131 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T00:39:04.145 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3013 ms) 2024-09-12T00:39:04.145 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T00:39:18.189 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (14044 ms) 2024-09-12T00:39:18.189 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T00:39:22.221 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4032 ms) 2024-09-12T00:39:22.221 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T00:39:27.259 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (5038 ms) 2024-09-12T00:39:27.259 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T00:39:32.289 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5030 ms) 2024-09-12T00:39:32.289 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 24 tests from TestCls2PCQueue (97450 ms total) 2024-09-12T00:39:32.289 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:39:32.289 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:39:32.289 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 24 tests from 1 test suite ran. (97450 ms total) 2024-09-12T00:39:32.289 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 24 tests. 2024-09-12T00:39:32.292 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:39:32.293 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:39:32.336 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T00:39:32.337 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T00:39:32.338 DEBUG:teuthology.orchestra.run.smithi062:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T00:39:32.430 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:32.430 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:32.431 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:39:32.431 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:39:34.300 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 4 tests from ClsAccount 2024-09-12T00:39:34.301 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsAccount.add 2024-09-12T00:39:34.327 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsAccount.add (27 ms) 2024-09-12T00:39:34.327 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsAccount.get 2024-09-12T00:39:34.332 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-12T00:39:34.332 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsAccount.rm 2024-09-12T00:39:34.340 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsAccount.rm (7 ms) 2024-09-12T00:39:34.340 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] ClsAccount.list 2024-09-12T00:39:34.354 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] ClsAccount.list (14 ms) 2024-09-12T00:39:34.355 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 4 tests from ClsAccount (54 ms total) 2024-09-12T00:39:34.355 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:39:34.355 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:39:35.316 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 4 tests from 1 test suite ran. (2885 ms total) 2024-09-12T00:39:35.316 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 4 tests. 2024-09-12T00:39:35.319 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:39:35.319 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:39:35.364 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T00:39:35.366 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T00:39:35.366 DEBUG:teuthology.orchestra.run.smithi062:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T00:39:35.421 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:35.421 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:35.421 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T00:39:35.422 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:39:37.326 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T00:39:37.327 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T00:39:37.340 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] rgw_gc_log.init_existing_queue (14 ms) 2024-09-12T00:39:37.340 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T00:39:37.343 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2024-09-12T00:39:37.343 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T00:39:37.538 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (194 ms) 2024-09-12T00:39:37.538 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T00:39:37.539 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (2 ms) 2024-09-12T00:39:37.539 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T00:39:37.542 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] rgw_gc_log.defer1_after_init (2 ms) 2024-09-12T00:39:37.543 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T00:39:37.545 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-12T00:39:37.545 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 6 tests from rgw_gc_log (219 ms total) 2024-09-12T00:39:37.545 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:39:37.545 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:39:38.325 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 6 tests from 1 test suite ran. (2903 ms total) 2024-09-12T00:39:38.325 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 6 tests. 2024-09-12T00:39:38.328 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:39:38.328 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:39:38.372 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T00:39:38.373 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T00:39:38.374 DEBUG:teuthology.orchestra.run.smithi062:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T00:39:38.432 INFO:tasks.workunit.client.0.smithi062.stdout:Running main() from gmock_main.cc 2024-09-12T00:39:38.432 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:39:38.433 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:39:38.433 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T00:39:38.433 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T00:39:38.433 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj 2024-09-12T00:39:38.433 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj 2024-09-12T00:39:38.433 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: _obj ns= i= 2024-09-12T00:39:38.433 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj 2024-09-12T00:39:38.433 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj 2024-09-12T00:39:38.433 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: _obj ns= i= 2024-09-12T00:39:38.433 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj 2024-09-12T00:39:38.433 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj 2024-09-12T00:39:38.433 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: _obj ns= i= 2024-09-12T00:39:38.434 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.434 INFO:tasks.workunit.client.0.smithi062.stdout: "obj1": { 2024-09-12T00:39:38.434 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.434 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.434 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.434 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.434 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.434 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.434 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.434 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.434 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.434 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.434 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.434 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.435 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.435 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.435 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.435 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.435 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.435 INFO:tasks.workunit.client.0.smithi062.stdout: "obj2": { 2024-09-12T00:39:38.435 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.435 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.435 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.435 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.435 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.435 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.436 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.436 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.436 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.436 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.436 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.436 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.436 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.436 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.436 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.436 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.436 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.436 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3": { 2024-09-12T00:39:38.437 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.437 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.437 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.437 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.437 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.437 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.437 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.437 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.437 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.437 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.438 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.438 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.438 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.438 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.438 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.438 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.438 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.438 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3-2": { 2024-09-12T00:39:38.438 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.438 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.438 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.438 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.438 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.439 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.439 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.439 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.439 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.439 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.439 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.439 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.439 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.439 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.439 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.439 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.439 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.439 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.440 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj 2024-09-12T00:39:38.440 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj 2024-09-12T00:39:38.440 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: _obj ns=ns i= 2024-09-12T00:39:38.440 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj 2024-09-12T00:39:38.440 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj 2024-09-12T00:39:38.440 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: _obj ns=ns i= 2024-09-12T00:39:38.440 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj 2024-09-12T00:39:38.440 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj 2024-09-12T00:39:38.440 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: _obj ns=ns i= 2024-09-12T00:39:38.441 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.441 INFO:tasks.workunit.client.0.smithi062.stdout: "obj1": { 2024-09-12T00:39:38.441 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.441 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.441 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.441 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.441 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.441 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.441 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.441 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.441 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.441 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.441 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.441 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.442 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.442 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.442 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.442 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.442 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.442 INFO:tasks.workunit.client.0.smithi062.stdout: "obj2": { 2024-09-12T00:39:38.442 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.442 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.442 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.442 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.442 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.442 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.442 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.443 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.443 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.443 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.443 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.443 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.443 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.443 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.443 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.443 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.443 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.443 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3": { 2024-09-12T00:39:38.444 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.444 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.444 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.444 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.444 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.444 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.444 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.444 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.444 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.444 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.444 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.444 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.445 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.445 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.445 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.445 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.445 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.445 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3-2": { 2024-09-12T00:39:38.445 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.445 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.445 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.445 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.445 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.445 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.445 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.446 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.446 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.446 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.446 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.446 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.446 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.446 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.446 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.446 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.446 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.447 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.447 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj[v1] 2024-09-12T00:39:38.447 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj[v1] 2024-09-12T00:39:38.447 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: _obj ns= i=v1 2024-09-12T00:39:38.447 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj[v1] 2024-09-12T00:39:38.447 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj[v1] 2024-09-12T00:39:38.447 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: _obj ns= i=v1 2024-09-12T00:39:38.447 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj[v1] 2024-09-12T00:39:38.447 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj[v1] 2024-09-12T00:39:38.447 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: _obj ns= i=v1 2024-09-12T00:39:38.448 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.448 INFO:tasks.workunit.client.0.smithi062.stdout: "obj1": { 2024-09-12T00:39:38.448 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.448 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.448 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.448 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.448 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.448 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.448 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.448 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.448 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.448 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.448 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.449 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.449 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.449 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "v1", 2024-09-12T00:39:38.449 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.449 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.449 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.449 INFO:tasks.workunit.client.0.smithi062.stdout: "obj2": { 2024-09-12T00:39:38.449 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.449 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.449 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.449 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.449 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.449 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.450 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.450 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.450 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.450 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.450 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.450 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.450 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.450 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "v1", 2024-09-12T00:39:38.450 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.450 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.451 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.451 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3": { 2024-09-12T00:39:38.451 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.451 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.451 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.451 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.451 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.451 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.451 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.451 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.451 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.451 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.451 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.451 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.452 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.452 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.452 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.452 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.452 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.452 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3-2": { 2024-09-12T00:39:38.452 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.452 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.452 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.452 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.452 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.452 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.452 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.453 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.453 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.453 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.453 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.453 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.453 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.453 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "v1", 2024-09-12T00:39:38.453 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.453 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.453 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.453 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.453 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj[v1] 2024-09-12T00:39:38.453 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj[v1] 2024-09-12T00:39:38.454 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:39:38.454 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj[v1] 2024-09-12T00:39:38.454 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj[v1] 2024-09-12T00:39:38.454 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:39:38.454 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj[v1] 2024-09-12T00:39:38.454 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: _obj[v1] 2024-09-12T00:39:38.454 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:39:38.454 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.454 INFO:tasks.workunit.client.0.smithi062.stdout: "obj1": { 2024-09-12T00:39:38.454 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.454 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.454 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.455 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.455 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.455 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.455 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.455 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.455 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.455 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.455 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.455 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.455 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.455 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "v1", 2024-09-12T00:39:38.455 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.455 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.456 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.456 INFO:tasks.workunit.client.0.smithi062.stdout: "obj2": { 2024-09-12T00:39:38.456 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.456 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.456 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.456 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.456 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.456 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.456 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.456 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.456 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.456 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.456 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.457 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.457 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.457 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "v1", 2024-09-12T00:39:38.457 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.457 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.457 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.457 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3": { 2024-09-12T00:39:38.457 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.457 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.457 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.457 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.457 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.457 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.457 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.458 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.458 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.458 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.458 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.458 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.458 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.458 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.458 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.458 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.458 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.458 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3-2": { 2024-09-12T00:39:38.458 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.458 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.459 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.459 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.459 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.459 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.459 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.459 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.459 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.459 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.459 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.459 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.459 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_obj", 2024-09-12T00:39:38.460 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "v1", 2024-09-12T00:39:38.460 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.460 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.460 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.460 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.460 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T00:39:38.460 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T00:39:38.460 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj 2024-09-12T00:39:38.461 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj 2024-09-12T00:39:38.461 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: obj ns= i= 2024-09-12T00:39:38.461 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj 2024-09-12T00:39:38.461 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj 2024-09-12T00:39:38.461 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: obj ns= i= 2024-09-12T00:39:38.461 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj 2024-09-12T00:39:38.461 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj 2024-09-12T00:39:38.461 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: obj ns= i= 2024-09-12T00:39:38.461 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.461 INFO:tasks.workunit.client.0.smithi062.stdout: "obj1": { 2024-09-12T00:39:38.462 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.462 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.462 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.462 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.462 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.462 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.462 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.462 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.462 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.462 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.462 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.463 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.463 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.463 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.463 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.463 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.463 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.463 INFO:tasks.workunit.client.0.smithi062.stdout: "obj2": { 2024-09-12T00:39:38.463 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.463 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.463 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.463 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.463 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.463 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.464 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.464 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.464 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.464 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.464 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.464 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.464 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.464 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.464 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.464 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.464 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.465 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3": { 2024-09-12T00:39:38.465 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.465 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.465 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.465 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.465 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.465 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.465 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.465 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.465 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.465 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.465 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.465 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.466 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.466 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.466 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.466 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.466 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.466 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3-2": { 2024-09-12T00:39:38.466 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.466 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.466 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.466 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.466 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.466 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.466 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.467 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.467 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.467 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.467 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.467 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.467 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.467 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.467 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.467 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.467 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.467 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.467 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj 2024-09-12T00:39:38.467 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj 2024-09-12T00:39:38.468 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: obj ns=ns i= 2024-09-12T00:39:38.468 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj 2024-09-12T00:39:38.468 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj 2024-09-12T00:39:38.468 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: obj ns=ns i= 2024-09-12T00:39:38.468 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj 2024-09-12T00:39:38.468 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj 2024-09-12T00:39:38.468 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: obj ns=ns i= 2024-09-12T00:39:38.468 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.468 INFO:tasks.workunit.client.0.smithi062.stdout: "obj1": { 2024-09-12T00:39:38.468 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.468 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.468 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.469 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.469 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.469 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.469 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.469 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.469 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.469 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.469 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.469 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.470 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.470 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.470 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.470 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.470 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.470 INFO:tasks.workunit.client.0.smithi062.stdout: "obj2": { 2024-09-12T00:39:38.470 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.470 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.470 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.470 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.470 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.470 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.470 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.470 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.471 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.471 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.471 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.471 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.471 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.471 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.471 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.471 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.471 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.471 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3": { 2024-09-12T00:39:38.471 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.471 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.472 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.472 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.472 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.472 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.472 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.472 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.472 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.472 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.472 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.472 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.472 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.472 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.472 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.473 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.473 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.473 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3-2": { 2024-09-12T00:39:38.473 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.473 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.473 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.473 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.473 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.473 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.473 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.473 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.474 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.474 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.474 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.474 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.474 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.474 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.474 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.475 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.475 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.475 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.475 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj[v1] 2024-09-12T00:39:38.475 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj[v1] 2024-09-12T00:39:38.475 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: obj ns= i=v1 2024-09-12T00:39:38.475 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj[v1] 2024-09-12T00:39:38.475 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj[v1] 2024-09-12T00:39:38.475 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: obj ns= i=v1 2024-09-12T00:39:38.475 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj[v1] 2024-09-12T00:39:38.475 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj[v1] 2024-09-12T00:39:38.475 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: obj ns= i=v1 2024-09-12T00:39:38.476 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.476 INFO:tasks.workunit.client.0.smithi062.stdout: "obj1": { 2024-09-12T00:39:38.476 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.476 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.476 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.476 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.476 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.476 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.476 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.476 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.476 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.477 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.477 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.477 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.477 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.477 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "v1", 2024-09-12T00:39:38.477 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.477 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.477 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.477 INFO:tasks.workunit.client.0.smithi062.stdout: "obj2": { 2024-09-12T00:39:38.477 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.477 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.477 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.477 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.477 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.478 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.478 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.478 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.478 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.478 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.478 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.478 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.478 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.478 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "v1", 2024-09-12T00:39:38.478 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.478 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.478 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.479 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3": { 2024-09-12T00:39:38.479 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.479 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.479 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.479 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.479 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.480 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3-2": { 2024-09-12T00:39:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.481 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "v1", 2024-09-12T00:39:38.482 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.482 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.482 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.482 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.482 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj[v1] 2024-09-12T00:39:38.482 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj[v1] 2024-09-12T00:39:38.482 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:39:38.482 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj[v1] 2024-09-12T00:39:38.482 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj[v1] 2024-09-12T00:39:38.482 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:39:38.482 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj[v1] 2024-09-12T00:39:38.482 INFO:tasks.workunit.client.0.smithi062.stdout:parsed: obj[v1] 2024-09-12T00:39:38.482 INFO:tasks.workunit.client.0.smithi062.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:39:38.482 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.483 INFO:tasks.workunit.client.0.smithi062.stdout: "obj1": { 2024-09-12T00:39:38.483 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.483 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.483 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.483 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.483 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.483 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.483 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.483 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.483 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.483 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.483 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.483 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.483 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.484 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "v1", 2024-09-12T00:39:38.484 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.484 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.484 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.484 INFO:tasks.workunit.client.0.smithi062.stdout: "obj2": { 2024-09-12T00:39:38.484 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.484 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.484 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.484 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.484 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.485 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.485 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.485 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.485 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.485 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.485 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.485 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.485 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.485 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "v1", 2024-09-12T00:39:38.485 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.486 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.486 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.486 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3": { 2024-09-12T00:39:38.486 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.486 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.486 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.486 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.486 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.486 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.486 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.486 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.486 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.486 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.486 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.487 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.487 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.487 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.487 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.487 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.487 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.487 INFO:tasks.workunit.client.0.smithi062.stdout: "obj3-2": { 2024-09-12T00:39:38.487 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.487 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.487 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.487 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.487 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.487 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.488 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.488 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.488 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.488 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.488 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.488 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.488 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "obj", 2024-09-12T00:39:38.488 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "v1", 2024-09-12T00:39:38.488 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.488 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.488 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.488 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.488 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T00:39:38.488 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T00:39:38.489 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.489 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.489 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.489 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.489 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.489 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.489 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.489 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.489 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.489 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.489 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.489 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.489 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.489 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.490 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.490 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.490 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.490 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.490 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.490 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.490 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.490 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.490 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.490 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.490 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.490 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.490 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.490 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.491 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.491 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.491 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.491 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.491 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.491 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.491 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.491 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": "default-placement.data", 2024-09-12T00:39:38.491 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker_myobj", 2024-09-12T00:39:38.491 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.491 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.491 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.491 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.492 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.492 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.492 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.492 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.492 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.492 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.492 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.492 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.492 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.492 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.492 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.492 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.492 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.492 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.493 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.493 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.493 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.493 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.493 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.493 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.493 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.493 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.493 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.493 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.493 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.493 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.494 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.494 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.494 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.494 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.494 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.494 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.494 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.494 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.494 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.494 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.494 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.495 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.495 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.495 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.495 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.495 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.495 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.495 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.495 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.495 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.495 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.495 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.495 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.495 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.495 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.496 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.496 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.496 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.496 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.496 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker_myobj", 2024-09-12T00:39:38.496 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.496 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.496 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.496 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.496 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.496 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.496 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.496 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.496 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.497 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.497 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.497 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.497 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.497 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.497 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.497 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.497 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.497 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.497 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.497 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.498 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.498 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.498 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.498 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.499 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.499 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.499 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.499 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.499 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.499 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.500 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.500 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.500 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.500 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.500 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.500 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.500 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.501 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.501 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.501 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.501 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.501 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.502 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.502 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.502 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.502 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.502 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.502 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.502 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.503 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.503 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.503 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.503 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.503 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.503 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.503 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.504 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.504 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.504 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": "default-placement.data", 2024-09-12T00:39:38.504 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:39:38.504 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.504 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.505 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.505 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.505 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.505 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.505 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.505 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.506 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.506 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.506 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.506 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.506 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.506 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.507 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.507 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.507 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.507 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.507 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.508 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.508 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.508 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.508 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.508 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.508 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.508 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.508 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.508 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.508 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.508 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.508 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.508 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.509 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.509 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.509 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.509 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.509 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.509 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.509 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.509 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.509 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.509 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.509 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.509 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.509 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.510 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.510 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.510 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.510 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.510 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.510 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.510 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.510 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.510 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.510 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.510 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.511 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.511 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.511 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.511 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:39:38.511 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.511 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.511 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.511 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.511 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.511 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.511 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.511 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.511 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.512 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.512 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.512 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.512 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.512 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.512 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.512 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.512 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.512 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.512 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.512 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.512 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.512 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.513 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.513 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.513 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.513 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.513 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.513 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.513 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.513 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.513 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.514 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.514 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.514 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.514 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.514 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.514 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.514 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.514 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.514 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.514 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.514 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.514 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.515 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.515 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.515 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.515 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.515 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.515 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.515 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.515 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.515 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.515 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.515 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.515 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.515 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.516 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.516 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.516 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": "default-placement.data", 2024-09-12T00:39:38.516 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:39:38.516 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.516 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.516 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.516 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.516 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.516 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.516 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.516 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.517 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.517 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.517 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.517 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.517 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.517 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.517 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.517 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.517 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.517 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.517 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.517 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.518 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.518 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.518 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.518 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.518 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.518 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.518 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.518 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.518 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.518 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.518 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.519 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.519 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.519 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.519 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.519 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.519 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.519 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.519 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.519 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.519 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.520 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.520 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.520 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.520 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.520 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.520 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.520 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.520 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.520 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.520 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.520 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.520 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.520 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.520 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.521 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.521 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.521 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.521 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.521 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:39:38.521 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.521 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.521 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.521 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.521 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.522 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.522 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.522 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.522 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.522 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.522 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.522 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.522 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.522 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.523 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.523 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.523 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.523 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.523 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.523 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.523 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.523 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.523 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.523 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.523 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.523 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.524 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.524 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.524 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.524 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.524 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.524 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.524 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.524 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.524 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.524 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.524 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.524 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.524 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.525 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.525 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.525 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.525 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.525 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.525 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.525 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.525 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.525 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.525 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.525 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.525 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.525 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.526 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.526 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.526 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.526 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.526 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.526 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.526 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": "default-placement.data", 2024-09-12T00:39:38.526 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:39:38.526 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.526 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.526 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.526 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.527 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.527 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.527 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.527 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.527 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.527 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.527 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.527 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.527 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.527 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.527 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.527 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.527 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.528 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.528 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.528 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.528 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.528 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.528 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.528 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.528 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.528 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.528 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.529 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.529 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.529 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.529 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.529 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.529 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.530 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.530 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.530 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.530 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.530 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.530 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.531 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.531 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.531 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.531 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.531 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.531 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.531 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.531 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.531 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.531 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.532 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.532 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.532 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.532 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.532 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.532 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.532 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.532 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.532 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.532 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.532 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:39:38.533 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.533 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.533 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.533 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.533 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.533 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.533 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.533 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.533 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.533 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.533 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.533 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.533 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.534 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.534 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.534 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.534 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.534 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.534 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.534 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.534 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.534 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.534 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.534 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.534 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.534 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.535 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.535 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.535 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.535 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.535 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.535 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.535 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.535 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.535 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.535 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.535 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.535 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.535 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.535 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.536 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.536 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.536 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.536 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.536 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.536 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.536 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.536 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.536 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.536 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.536 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.536 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.536 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.537 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.537 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.537 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.537 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.537 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.537 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": "default-placement.data", 2024-09-12T00:39:38.537 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker___myobj", 2024-09-12T00:39:38.537 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj" 2024-09-12T00:39:38.537 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.538 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.538 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.538 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.538 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.538 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.538 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.538 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.538 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.538 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.538 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.538 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.538 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.538 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.538 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.539 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.539 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.539 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.539 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.539 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.539 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.539 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.539 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.539 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.539 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.539 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.539 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.539 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.539 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.540 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.540 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.540 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.540 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.540 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.540 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.540 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.540 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.540 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.541 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.541 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.541 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.541 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.541 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.541 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.541 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.541 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.541 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.541 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.541 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.541 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.541 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.542 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.542 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.542 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.542 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.542 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.542 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.542 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.542 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker___myobj", 2024-09-12T00:39:38.542 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj" 2024-09-12T00:39:38.542 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.542 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.542 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.542 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.542 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.543 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.543 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.543 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.543 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.543 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.543 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.543 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.543 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.543 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.543 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.543 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.543 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.543 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.544 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.544 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.544 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.544 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.544 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.544 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.545 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.545 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.545 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.545 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.545 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.545 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.545 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.545 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.545 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.545 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.545 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.545 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.546 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.546 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.546 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.546 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.546 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.546 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.546 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.546 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.546 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.546 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.546 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.546 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.546 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.547 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.547 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.547 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.547 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.547 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.547 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.547 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.547 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.547 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": "default-placement.data", 2024-09-12T00:39:38.547 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:39:38.547 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.547 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.547 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.548 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.548 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.548 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.548 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.548 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.548 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.548 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.548 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.548 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.548 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.548 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.548 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.548 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.549 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.549 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.549 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.549 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.549 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.549 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.549 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.549 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.549 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.549 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.549 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.549 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.549 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.549 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.550 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.550 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.550 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.550 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.550 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.550 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.550 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.550 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.550 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.550 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.550 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.550 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.550 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.551 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.551 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.551 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.551 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.551 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.551 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.551 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.551 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.551 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.551 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.552 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.552 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.552 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.552 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.552 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.552 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.552 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:39:38.552 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.552 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.552 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.552 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.552 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.552 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.553 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.553 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.553 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.553 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.553 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.553 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.553 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.553 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.553 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.553 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.553 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.553 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.553 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.553 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.554 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.554 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.554 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.554 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.554 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.554 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.554 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.554 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.554 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.554 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.554 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.554 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.554 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.554 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.555 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.555 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.555 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.555 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.555 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.555 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.555 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.555 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.555 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.555 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.555 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.555 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.555 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.556 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.556 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.556 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.556 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.556 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.556 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.556 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.556 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.556 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.556 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.556 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.556 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": "default-placement.data", 2024-09-12T00:39:38.556 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:39:38.557 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj" 2024-09-12T00:39:38.557 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.557 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.557 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.557 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.557 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.557 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.557 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.557 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.557 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.557 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.557 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.557 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.557 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.558 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.558 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.558 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.558 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.558 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.558 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.558 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.558 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.558 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.558 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.558 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.558 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.558 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.558 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.559 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.559 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.559 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.559 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.559 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.559 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.559 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.559 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.559 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.559 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.559 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.559 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.559 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.560 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.560 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.560 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.560 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.560 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.560 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.560 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.560 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.560 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.560 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.560 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.560 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.561 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.561 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.561 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.561 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.561 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.561 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.561 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:39:38.561 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj" 2024-09-12T00:39:38.561 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.561 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.561 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.561 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.561 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.562 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.562 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.562 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.562 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.562 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.562 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.562 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.562 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.562 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.562 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.562 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.562 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.562 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.562 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.563 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.563 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.563 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.563 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.563 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.563 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.563 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.563 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.563 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.563 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.563 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.563 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.564 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.564 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.564 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.564 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.564 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.564 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.564 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.564 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.564 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.564 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.565 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.565 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.565 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.565 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.565 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.565 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.565 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.565 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.565 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.565 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.565 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.565 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.565 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.566 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.566 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.566 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.566 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": "default-placement.data", 2024-09-12T00:39:38.566 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:39:38.566 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.566 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.566 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.566 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.566 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.566 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.566 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.566 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.566 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.567 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.567 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.567 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.567 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.567 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.567 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.567 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.567 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.567 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.567 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.567 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.567 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.567 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.567 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.568 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.568 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.568 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.568 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.568 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.568 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.568 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.568 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.568 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.568 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.569 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.569 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.569 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.569 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.569 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.569 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.569 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.569 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.569 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.569 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.569 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.569 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.570 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.570 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.570 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.570 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.570 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.570 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.570 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.570 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.570 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.570 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.570 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.571 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.571 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.571 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.571 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:39:38.571 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.571 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.571 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.571 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.571 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.571 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.571 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.571 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.572 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.572 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.572 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.572 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.572 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.572 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.572 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.572 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.572 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.572 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.572 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.572 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.572 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.573 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.573 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.573 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.573 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.573 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.573 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.573 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.573 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.573 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.573 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.573 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.573 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.573 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.574 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.574 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.574 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.574 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.574 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.574 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.574 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.574 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.574 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.574 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.575 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.575 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.575 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.575 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.575 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.575 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.575 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.575 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.575 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.575 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.576 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.576 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.576 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.576 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.576 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": "default-placement.data", 2024-09-12T00:39:38.576 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker___myobj_", 2024-09-12T00:39:38.576 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj_" 2024-09-12T00:39:38.576 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.576 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.576 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.576 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.576 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.577 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.577 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.577 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.577 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.577 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.577 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.577 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.577 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.577 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.577 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.577 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.577 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.577 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.578 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.578 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.578 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.578 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.578 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.578 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.578 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.578 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.578 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.578 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.578 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.578 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.578 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.578 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.579 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.579 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.579 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.579 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.579 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.579 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.579 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.579 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.579 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.579 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.579 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.580 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.580 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.580 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.580 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.580 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.580 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.580 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.580 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.580 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.580 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.580 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.580 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.581 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.581 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.581 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.581 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker___myobj_", 2024-09-12T00:39:38.581 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj_" 2024-09-12T00:39:38.581 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.581 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.581 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.581 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.581 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.581 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.581 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.581 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.582 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.582 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.582 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.582 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.582 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.582 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.582 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.582 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.582 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.582 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.582 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.582 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.582 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.582 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.583 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.583 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.583 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.583 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.583 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.583 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.583 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.583 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.583 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.583 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.583 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.584 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.584 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.584 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.584 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.584 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.584 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.584 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.584 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.584 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.584 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.584 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.584 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.584 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.585 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.585 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.585 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.585 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.585 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.585 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.585 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.585 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.585 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.585 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.586 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.586 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": "default-placement.data", 2024-09-12T00:39:38.586 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:39:38.586 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.586 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.586 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.586 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.586 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.586 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.586 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.586 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.587 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.587 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.587 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.587 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.587 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.587 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.587 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.587 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.587 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.587 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.587 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.587 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.588 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.588 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.588 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.588 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.588 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.588 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.588 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.588 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.589 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.589 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.589 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.589 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.589 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.589 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.589 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.589 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.589 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.589 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.589 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.589 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.589 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.590 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.590 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.590 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.590 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.590 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.590 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.590 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.590 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.590 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.590 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.590 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.591 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.591 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.591 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.591 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.591 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.591 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.591 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.591 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:39:38.591 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.591 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.591 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.591 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.591 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.591 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.592 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.592 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.592 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.592 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.592 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.592 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.592 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.592 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.592 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.592 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.592 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.592 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.592 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.593 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.593 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.593 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.593 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.593 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.593 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.593 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.593 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.593 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.593 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.593 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.593 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.593 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.594 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.594 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.594 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.594 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.594 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.594 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.594 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.594 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.595 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.595 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.595 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.595 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.595 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.595 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.595 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.595 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.595 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.595 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.595 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.595 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.596 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.596 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.596 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.596 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.596 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.596 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.596 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": "default-placement.data", 2024-09-12T00:39:38.596 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:39:38.596 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj_" 2024-09-12T00:39:38.596 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.597 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.597 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.597 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.597 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.597 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.597 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.597 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.597 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.597 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.597 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.597 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.597 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.598 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.598 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.598 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.598 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.598 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.598 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.598 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.598 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.598 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.598 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.598 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.598 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.598 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.598 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.599 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.599 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.599 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.599 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.599 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.599 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.599 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.599 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.599 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.599 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.599 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.599 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.599 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.600 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.600 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.600 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.600 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.600 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.600 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.600 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.600 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.600 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.600 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.600 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.600 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.600 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.601 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.601 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.601 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.601 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.601 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.601 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:39:38.601 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj_" 2024-09-12T00:39:38.601 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.601 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.601 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.601 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.601 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.601 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.602 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.602 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.602 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.602 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.602 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.602 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.602 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.602 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.602 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.602 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.602 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.603 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.603 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.603 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.603 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.603 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.603 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.603 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.604 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.604 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.604 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.604 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.604 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.604 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.604 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.604 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.604 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.605 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.605 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.605 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.605 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.605 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.605 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.605 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.605 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.606 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.606 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.606 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.606 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.606 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.606 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.606 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.606 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.606 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.606 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.607 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.607 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.607 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.607 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.607 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.607 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.607 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": "default-placement.data", 2024-09-12T00:39:38.607 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:39:38.607 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.607 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.608 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.608 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.608 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.608 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.608 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "test", 2024-09-12T00:39:38.608 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.608 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.608 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.608 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.608 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": "", 2024-09-12T00:39:38.608 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.609 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": "" 2024-09-12T00:39:38.609 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.609 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.609 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.609 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.609 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.609 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.609 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.609 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.609 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.609 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.609 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.609 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.610 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.610 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.610 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.610 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.610 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.610 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.610 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.610 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.610 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.610 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.610 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.610 INFO:tasks.workunit.client.0.smithi062.stdout: "obj": { 2024-09-12T00:39:38.610 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.611 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.611 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.611 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.611 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.611 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.611 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.611 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.611 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.611 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.611 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.611 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.611 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.612 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.612 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.612 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.612 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.612 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.612 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.612 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.612 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.612 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:39:38.612 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.612 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.612 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.612 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.613 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.613 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.613 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.613 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.613 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.613 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.613 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.613 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.613 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.613 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.613 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.613 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.613 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.613 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.614 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.614 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.614 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.614 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.614 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.614 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-12T00:39:38.614 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T00:39:38.614 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.614 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.614 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.614 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker_myobj", 2024-09-12T00:39:38.615 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.615 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.615 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.615 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.615 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.615 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.615 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.615 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.615 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.615 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.615 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.616 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.616 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.616 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.616 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.616 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.616 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.616 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.616 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.616 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.616 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.616 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.616 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.616 INFO:tasks.workunit.client.0.smithi062.stdout:raw=.data-pool:marker_myobj 2024-09-12T00:39:38.617 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.617 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj2": { 2024-09-12T00:39:38.617 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.617 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker_myobj", 2024-09-12T00:39:38.617 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.617 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.617 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.617 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.617 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj2": { 2024-09-12T00:39:38.617 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.617 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.618 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.618 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.618 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.618 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.618 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.618 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.618 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.618 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.618 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.618 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.618 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.618 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.619 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.619 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.619 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.619 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.619 INFO:tasks.workunit.client.0.smithi062.stdout:raw2=.data-pool:marker_myobj 2024-09-12T00:39:38.619 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.619 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.619 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.619 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:39:38.619 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.619 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.619 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.619 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.620 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.620 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.620 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.620 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.620 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.620 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.620 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.620 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.620 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.620 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.620 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.620 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.620 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.621 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.621 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.621 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.621 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.624 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.624 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.624 INFO:tasks.workunit.client.0.smithi062.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T00:39:38.624 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.624 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj2": { 2024-09-12T00:39:38.624 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.625 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:39:38.625 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.625 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.625 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.625 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.625 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj2": { 2024-09-12T00:39:38.625 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.625 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.625 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.625 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.625 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.625 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.626 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.626 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.626 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.626 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.626 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.626 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.626 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.626 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.626 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.626 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.626 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.626 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.626 INFO:tasks.workunit.client.0.smithi062.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T00:39:38.626 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.627 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.627 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.627 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:39:38.627 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.627 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.627 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.627 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.627 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.627 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.627 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.628 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.628 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.628 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.628 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.628 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.628 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.628 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.628 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.628 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.628 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.628 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.628 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.628 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.629 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.629 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.629 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.629 INFO:tasks.workunit.client.0.smithi062.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T00:39:38.629 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.629 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj2": { 2024-09-12T00:39:38.629 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.629 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:39:38.629 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.629 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.629 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.629 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.629 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj2": { 2024-09-12T00:39:38.630 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.630 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.630 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.630 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.630 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.630 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.630 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.630 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.630 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.630 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.630 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.630 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.630 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.630 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.631 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.631 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.631 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.631 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.631 INFO:tasks.workunit.client.0.smithi062.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T00:39:38.631 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.631 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.631 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.631 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:39:38.631 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.631 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.631 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.631 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.631 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.632 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.632 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.632 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.632 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.632 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.632 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.632 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.632 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.632 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.632 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.632 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.633 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.633 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.633 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.633 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.633 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.633 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.633 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.633 INFO:tasks.workunit.client.0.smithi062.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T00:39:38.633 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.633 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj2": { 2024-09-12T00:39:38.633 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.634 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:39:38.634 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.634 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.634 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.634 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.634 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj2": { 2024-09-12T00:39:38.634 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.634 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.634 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.634 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.634 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.634 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.634 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.634 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.635 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.635 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.635 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.635 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.635 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "myobj", 2024-09-12T00:39:38.635 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.635 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.635 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.635 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.635 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.635 INFO:tasks.workunit.client.0.smithi062.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T00:39:38.635 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.635 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.635 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.636 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker___myobj", 2024-09-12T00:39:38.636 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj" 2024-09-12T00:39:38.636 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.636 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.636 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.636 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.636 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.636 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.636 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.636 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.636 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.636 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.636 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.637 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.637 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.637 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.637 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.637 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.637 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.637 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.637 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.637 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.637 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.637 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.638 INFO:tasks.workunit.client.0.smithi062.stdout:raw=.data-pool:marker___myobj 2024-09-12T00:39:38.638 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.638 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj2": { 2024-09-12T00:39:38.638 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.638 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker___myobj", 2024-09-12T00:39:38.638 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj" 2024-09-12T00:39:38.638 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.638 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.638 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.638 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj2": { 2024-09-12T00:39:38.638 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.639 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.639 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.639 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.639 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.639 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.639 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.639 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.639 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.639 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.639 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.639 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.639 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.639 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.639 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.640 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.640 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.640 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.640 INFO:tasks.workunit.client.0.smithi062.stdout:raw2=.data-pool:marker___myobj 2024-09-12T00:39:38.640 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.640 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.640 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.640 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:39:38.640 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.640 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.640 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.640 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.640 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.641 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.641 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.641 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.641 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.641 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.641 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.641 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.641 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.641 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.642 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.642 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.642 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.642 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.642 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.642 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.642 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.642 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.642 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.642 INFO:tasks.workunit.client.0.smithi062.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T00:39:38.642 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.642 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj2": { 2024-09-12T00:39:38.642 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.643 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:39:38.643 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.643 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.643 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.643 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.643 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj2": { 2024-09-12T00:39:38.643 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.643 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.643 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.643 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.643 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.643 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.643 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.643 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.644 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.644 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.644 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.644 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.644 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.644 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.644 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.644 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.644 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.645 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.645 INFO:tasks.workunit.client.0.smithi062.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T00:39:38.645 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.645 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.645 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.645 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:39:38.645 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj" 2024-09-12T00:39:38.645 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.645 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.645 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.645 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.645 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.645 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.646 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.646 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.646 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.646 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.646 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.646 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.646 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.646 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.646 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.646 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.646 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.647 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.647 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.647 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.647 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.647 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.647 INFO:tasks.workunit.client.0.smithi062.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T00:39:38.647 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.647 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj2": { 2024-09-12T00:39:38.647 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.647 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:39:38.647 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj" 2024-09-12T00:39:38.647 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.647 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.647 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.648 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj2": { 2024-09-12T00:39:38.648 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.648 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.648 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.648 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.648 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.648 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.648 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.648 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.649 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.649 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.649 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.649 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.649 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.649 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.649 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.649 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.649 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.649 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.649 INFO:tasks.workunit.client.0.smithi062.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T00:39:38.649 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.649 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.650 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.650 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:39:38.650 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.650 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.650 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.650 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.650 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.650 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.650 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.650 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.650 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.650 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.650 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.650 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.651 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.651 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.651 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.651 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.651 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.651 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.651 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.651 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.651 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.651 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.651 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.651 INFO:tasks.workunit.client.0.smithi062.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T00:39:38.651 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.651 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj2": { 2024-09-12T00:39:38.652 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.652 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:39:38.652 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.652 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.652 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.652 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.652 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj2": { 2024-09-12T00:39:38.652 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.652 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.652 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.652 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.652 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.652 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.653 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.653 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.653 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.653 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.653 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.653 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.653 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj", 2024-09-12T00:39:38.653 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.653 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.653 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.653 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.653 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.653 INFO:tasks.workunit.client.0.smithi062.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T00:39:38.654 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.654 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.654 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.654 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker___myobj_", 2024-09-12T00:39:38.654 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj_" 2024-09-12T00:39:38.654 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.654 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.654 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.654 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.654 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.655 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.655 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.655 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.655 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.655 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.655 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.655 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.655 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.655 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.655 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.655 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.655 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.655 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.656 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.656 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.656 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.656 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.656 INFO:tasks.workunit.client.0.smithi062.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T00:39:38.656 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.656 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj2": { 2024-09-12T00:39:38.656 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.656 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker___myobj_", 2024-09-12T00:39:38.656 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj_" 2024-09-12T00:39:38.656 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.656 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.657 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.657 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj2": { 2024-09-12T00:39:38.657 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.657 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.657 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.657 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.657 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.657 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.657 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.657 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.657 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.657 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.657 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.658 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.658 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.658 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.658 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.658 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.658 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.658 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.658 INFO:tasks.workunit.client.0.smithi062.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T00:39:38.658 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.658 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.658 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.658 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:39:38.658 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.659 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.659 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.659 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.659 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.659 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.659 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.659 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.659 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.659 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.659 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.659 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.660 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.660 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.660 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.660 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.660 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.660 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.660 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.660 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.660 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.660 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.660 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.660 INFO:tasks.workunit.client.0.smithi062.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T00:39:38.661 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.661 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj2": { 2024-09-12T00:39:38.661 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.661 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:39:38.661 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.661 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.661 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.661 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.661 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj2": { 2024-09-12T00:39:38.661 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.661 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.661 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.661 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.662 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.662 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.662 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.662 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.662 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.662 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.662 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.662 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.662 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.662 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "", 2024-09-12T00:39:38.662 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.662 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.662 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.663 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.663 INFO:tasks.workunit.client.0.smithi062.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T00:39:38.663 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.663 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.663 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.663 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:39:38.663 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj_" 2024-09-12T00:39:38.663 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.663 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.663 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.663 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.663 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.663 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.663 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.664 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.664 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.664 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.664 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.664 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.664 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.664 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.664 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.664 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.664 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.664 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.664 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.664 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.665 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.665 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.665 INFO:tasks.workunit.client.0.smithi062.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T00:39:38.665 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.665 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj2": { 2024-09-12T00:39:38.665 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.665 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:39:38.665 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "marker__myobj_" 2024-09-12T00:39:38.665 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.665 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.665 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.665 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj2": { 2024-09-12T00:39:38.665 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.665 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.666 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.666 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.666 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.666 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.666 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.666 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.666 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.666 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.666 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.666 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.666 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.666 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.666 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "" 2024-09-12T00:39:38.667 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.667 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.667 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.667 INFO:tasks.workunit.client.0.smithi062.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T00:39:38.667 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.667 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj": { 2024-09-12T00:39:38.667 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.667 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:39:38.667 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.667 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.667 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.667 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.667 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj": { 2024-09-12T00:39:38.667 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.668 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.668 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.668 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.668 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.668 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.668 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.668 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.668 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.668 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.668 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.668 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.668 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.668 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.669 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.669 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.669 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.669 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.669 INFO:tasks.workunit.client.0.smithi062.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:39:38.669 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.669 INFO:tasks.workunit.client.0.smithi062.stdout: "raw_obj2": { 2024-09-12T00:39:38.669 INFO:tasks.workunit.client.0.smithi062.stdout: "pool": ".data-pool", 2024-09-12T00:39:38.669 INFO:tasks.workunit.client.0.smithi062.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:39:38.670 INFO:tasks.workunit.client.0.smithi062.stdout: "loc": "" 2024-09-12T00:39:38.670 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.670 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.670 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.670 INFO:tasks.workunit.client.0.smithi062.stdout: "new_obj2": { 2024-09-12T00:39:38.670 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket": { 2024-09-12T00:39:38.670 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "ebtest", 2024-09-12T00:39:38.670 INFO:tasks.workunit.client.0.smithi062.stdout: "marker": "marker", 2024-09-12T00:39:38.670 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_id": "bucket-id", 2024-09-12T00:39:38.670 INFO:tasks.workunit.client.0.smithi062.stdout: "tenant": "", 2024-09-12T00:39:38.670 INFO:tasks.workunit.client.0.smithi062.stdout: "explicit_placement": { 2024-09-12T00:39:38.670 INFO:tasks.workunit.client.0.smithi062.stdout: "data_pool": ".data-pool", 2024-09-12T00:39:38.670 INFO:tasks.workunit.client.0.smithi062.stdout: "data_extra_pool": "", 2024-09-12T00:39:38.670 INFO:tasks.workunit.client.0.smithi062.stdout: "index_pool": ".index-pool" 2024-09-12T00:39:38.671 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.671 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.671 INFO:tasks.workunit.client.0.smithi062.stdout: "key": { 2024-09-12T00:39:38.671 INFO:tasks.workunit.client.0.smithi062.stdout: "name": "_myobj_", 2024-09-12T00:39:38.671 INFO:tasks.workunit.client.0.smithi062.stdout: "instance": "inst", 2024-09-12T00:39:38.671 INFO:tasks.workunit.client.0.smithi062.stdout: "ns": "ns" 2024-09-12T00:39:38.671 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.671 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.671 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.671 INFO:tasks.workunit.client.0.smithi062.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:39:38.672 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] TestRGWObj.old_to_raw (1 ms) 2024-09-12T00:39:38.672 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T00:39:38.672 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:39:38.672 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:39:38.672 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T00:39:38.672 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 4 tests. 2024-09-12T00:39:38.672 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:39:38.672 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:39:38.715 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T00:39:38.716 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T00:39:38.717 DEBUG:teuthology.orchestra.run.smithi062:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T00:39:38.859 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:38.859 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:38.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.906+0000 7f0eb74b7800 20 rados->read ofs=0 len=0 2024-09-12T00:39:38.906 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.907+0000 7f0eb74b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:38.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.907+0000 7f0eb74b7800 20 realm 2024-09-12T00:39:38.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.907+0000 7f0eb74b7800 20 rados->read ofs=0 len=0 2024-09-12T00:39:38.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.908+0000 7f0eb74b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:38.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.908+0000 7f0eb74b7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:38.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.908+0000 7f0eb74b7800 20 rados->read ofs=0 len=0 2024-09-12T00:39:38.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.908+0000 7f0eb74b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:38.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.908+0000 7f0eb74b7800 20 rados->read ofs=0 len=0 2024-09-12T00:39:38.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.909+0000 7f0eb74b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:38.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.909+0000 7f0eb74b7800 20 rados->read ofs=0 len=0 2024-09-12T00:39:38.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.909+0000 7f0eb74b7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:38.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.909+0000 7f0eb74b7800 20 searching for the correct realm 2024-09-12T00:39:38.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.916+0000 7f0eaffff640 0 -- 172.21.15.62:0/3193630585 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f0eb00c2500 msgr2=0x7f0eb00c39b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:38.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.930+0000 7f0eaffff640 0 -- 172.21.15.62:0/3193630585 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55ebea999030 msgr2=0x55ebea99b4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:38.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.935+0000 7f0eb74b7800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:39:38.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.935+0000 7f0eb74b7800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:39:38.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.935+0000 7f0eb74b7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:38.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.935+0000 7f0eb74b7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:38.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.935+0000 7f0eb74b7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:38.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.935+0000 7f0eb74b7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:38.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.935+0000 7f0eb74b7800 20 rados->read ofs=0 len=0 2024-09-12T00:39:38.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.935+0000 7f0eb74b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:38.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.935+0000 7f0eb74b7800 20 rados->read ofs=0 len=0 2024-09-12T00:39:38.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.935+0000 7f0eb74b7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:38.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.935+0000 7f0eb74b7800 20 rados->read ofs=0 len=0 2024-09-12T00:39:38.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.936+0000 7f0eb74b7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:38.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.936+0000 7f0eb74b7800 20 zone default found 2024-09-12T00:39:38.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.936+0000 7f0eb74b7800 4 Realm: () 2024-09-12T00:39:38.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.936+0000 7f0eb74b7800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:39:38.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.936+0000 7f0eb74b7800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:39:38.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.936+0000 7f0eb74b7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:38.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.936+0000 7f0eb74b7800 20 zonegroup default 2024-09-12T00:39:38.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.936+0000 7f0eb74b7800 20 rados->read ofs=0 len=0 2024-09-12T00:39:38.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.936+0000 7f0eb74b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:38.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.936+0000 7f0eb74b7800 20 rados->read ofs=0 len=0 2024-09-12T00:39:38.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.936+0000 7f0eb74b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:38.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.936+0000 7f0eb74b7800 20 rados->read ofs=0 len=0 2024-09-12T00:39:38.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.936+0000 7f0eb74b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:38.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.936+0000 7f0eb74b7800 20 started sync module instance, tier type = 2024-09-12T00:39:38.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.936+0000 7f0eb74b7800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:39:38.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.946+0000 7f0eb74b7800 20 add_watcher() i=0 2024-09-12T00:39:38.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.946+0000 7f0eb74b7800 20 add_watcher() i=1 2024-09-12T00:39:38.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.946+0000 7f0eb74b7800 20 add_watcher() i=2 2024-09-12T00:39:38.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.946+0000 7f0eb74b7800 20 add_watcher() i=3 2024-09-12T00:39:38.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.946+0000 7f0eb74b7800 20 add_watcher() i=4 2024-09-12T00:39:38.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.946+0000 7f0eb74b7800 20 add_watcher() i=5 2024-09-12T00:39:38.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.946+0000 7f0eb74b7800 20 add_watcher() i=6 2024-09-12T00:39:38.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.947+0000 7f0eb74b7800 20 add_watcher() i=7 2024-09-12T00:39:38.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.947+0000 7f0eb74b7800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:38.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.949+0000 7f0d6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:38.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.949+0000 7f0eb74b7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:38.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.949+0000 7f0eb74b7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:38.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.949+0000 7f0eb74b7800 5 note: GC not initialized 2024-09-12T00:39:38.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.949+0000 7f0d69fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:38.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.949+0000 7f0eb74b7800 20 init_complete bucket index max shards: 1 2024-09-12T00:39:38.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.950+0000 7f0eb74b7800 20 Filter name: none 2024-09-12T00:39:38.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.950+0000 7f0cdb7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:38.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.950+0000 7f0eb74b7800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T00:39:38.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.950+0000 7f0eb74b7800 20 rados->read ofs=0 len=0 2024-09-12T00:39:38.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.950+0000 7f0eb74b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:38.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.950+0000 7f0eb74b7800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T00:39:38.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.950+0000 7f0eb74b7800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:39:38.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.950+0000 7f0eb74b7800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T00:39:38.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.950+0000 7f0eb74b7800 20 rados->read ofs=0 len=0 2024-09-12T00:39:38.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.950+0000 7f0eb74b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:38.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.950+0000 7f0eb74b7800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T00:39:38.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.950+0000 7f0eb74b7800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:39:38.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.950+0000 7f0eb74b7800 10 cache get: name=default.rgw.meta+users.keys+5ZRyDiQXHATJ7SGRLvVYF47YknM= : miss 2024-09-12T00:39:38.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.950+0000 7f0eb74b7800 20 rados->read ofs=0 len=0 2024-09-12T00:39:38.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.951+0000 7f0eb74b7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:38.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.951+0000 7f0eb74b7800 10 cache put: name=default.rgw.meta+users.keys+5ZRyDiQXHATJ7SGRLvVYF47YknM= info.flags=0x0 2024-09-12T00:39:38.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.951+0000 7f0eb74b7800 10 adding default.rgw.meta+users.keys+5ZRyDiQXHATJ7SGRLvVYF47YknM= to cache LRU end 2024-09-12T00:39:38.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.951+0000 7f0eb74b7800 10 cache get: name=default.rgw.meta+users.keys+5ZRyDiQXHATJ7SGRLvVYF47YknM= : hit (negative entry) 2024-09-12T00:39:38.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.951+0000 7f0eb74b7800 10 cache get: name=default.rgw.meta+users.keys+5ZRyDiQXHATJ7SGRLvVYF47YknM= : hit (negative entry) 2024-09-12T00:39:38.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.952+0000 7f0eb74b7800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:39:38.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.952+0000 7f0eb74b7800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:39:38.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.952+0000 7f0eb74b7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T00:39:38.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.952+0000 7f0d8bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725889 cookie 94471741672560 notifier 5309 bl.length()=697 2024-09-12T00:39:38.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.952+0000 7f0d8bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:39:38.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.952+0000 7f0d8bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:39:38.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.956+0000 7f0eb74b7800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:39:38.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.956+0000 7f0eb74b7800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:39:38.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.956+0000 7f0eb74b7800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T00:39:38.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.956+0000 7f0d8bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725888 cookie 94471741612816 notifier 5309 bl.length()=194 2024-09-12T00:39:38.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.956+0000 7f0d8bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:39:38.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.956+0000 7f0d8bfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:39:38.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.959+0000 7f0eb74b7800 10 cache put: name=default.rgw.meta+users.keys+5ZRyDiQXHATJ7SGRLvVYF47YknM= info.flags=0x7 2024-09-12T00:39:38.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.959+0000 7f0eb74b7800 10 moving default.rgw.meta+users.keys+5ZRyDiQXHATJ7SGRLvVYF47YknM= to cache LRU end 2024-09-12T00:39:38.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.959+0000 7f0eb74b7800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:5ZRyDiQXHATJ7SGRLvVYF47YknM=, ofs0, ns] 2024-09-12T00:39:38.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.959+0000 7f0d8b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725890 cookie 94471741672560 notifier 5309 bl.length()=203 2024-09-12T00:39:38.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.959+0000 7f0d8b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+5ZRyDiQXHATJ7SGRLvVYF47YknM= info.flags=0x7 2024-09-12T00:39:38.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.959+0000 7f0d8b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+5ZRyDiQXHATJ7SGRLvVYF47YknM= to cache LRU end 2024-09-12T00:39:38.959 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:39:38.959 INFO:tasks.workunit.client.0.smithi062.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T00:39:38.959 INFO:tasks.workunit.client.0.smithi062.stdout: "display_name": "librgw test user", 2024-09-12T00:39:38.960 INFO:tasks.workunit.client.0.smithi062.stdout: "email": "librgw@example.com", 2024-09-12T00:39:38.960 INFO:tasks.workunit.client.0.smithi062.stdout: "suspended": 0, 2024-09-12T00:39:38.960 INFO:tasks.workunit.client.0.smithi062.stdout: "max_buckets": 1000, 2024-09-12T00:39:38.960 INFO:tasks.workunit.client.0.smithi062.stdout: "subusers": [], 2024-09-12T00:39:38.960 INFO:tasks.workunit.client.0.smithi062.stdout: "keys": [ 2024-09-12T00:39:38.960 INFO:tasks.workunit.client.0.smithi062.stdout: { 2024-09-12T00:39:38.960 INFO:tasks.workunit.client.0.smithi062.stdout: "user": "ceph-test-librgw-file", 2024-09-12T00:39:38.960 INFO:tasks.workunit.client.0.smithi062.stdout: "access_key": "5ZRyDiQXHATJ7SGRLvVYF47YknM=", 2024-09-12T00:39:38.960 INFO:tasks.workunit.client.0.smithi062.stdout: "secret_key": "7DXoIxSUSWoPFJGF17BocGnHLDP2Ub6K3xiN3Ir7lO9NrIgyB3EQGA==", 2024-09-12T00:39:38.960 INFO:tasks.workunit.client.0.smithi062.stdout: "active": true, 2024-09-12T00:39:38.960 INFO:tasks.workunit.client.0.smithi062.stdout: "create_date": "2024-09-12T00:39:38.951975Z" 2024-09-12T00:39:38.960 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:39:38.961 INFO:tasks.workunit.client.0.smithi062.stdout: ], 2024-09-12T00:39:38.961 INFO:tasks.workunit.client.0.smithi062.stdout: "swift_keys": [], 2024-09-12T00:39:38.961 INFO:tasks.workunit.client.0.smithi062.stdout: "caps": [], 2024-09-12T00:39:38.961 INFO:tasks.workunit.client.0.smithi062.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:38.961 INFO:tasks.workunit.client.0.smithi062.stdout: "default_placement": "", 2024-09-12T00:39:38.961 INFO:tasks.workunit.client.0.smithi062.stdout: "default_storage_class": "", 2024-09-12T00:39:38.961 INFO:tasks.workunit.client.0.smithi062.stdout: "placement_tags": [], 2024-09-12T00:39:38.961 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_quota": { 2024-09-12T00:39:38.961 INFO:tasks.workunit.client.0.smithi062.stdout: "enabled": false, 2024-09-12T00:39:38.961 INFO:tasks.workunit.client.0.smithi062.stdout: "check_on_raw": false, 2024-09-12T00:39:38.961 INFO:tasks.workunit.client.0.smithi062.stdout: "max_size": -1, 2024-09-12T00:39:38.961 INFO:tasks.workunit.client.0.smithi062.stdout: "max_size_kb": 0, 2024-09-12T00:39:38.961 INFO:tasks.workunit.client.0.smithi062.stdout: "max_objects": -1 2024-09-12T00:39:38.961 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.962 INFO:tasks.workunit.client.0.smithi062.stdout: "user_quota": { 2024-09-12T00:39:38.962 INFO:tasks.workunit.client.0.smithi062.stdout: "enabled": false, 2024-09-12T00:39:38.962 INFO:tasks.workunit.client.0.smithi062.stdout: "check_on_raw": false, 2024-09-12T00:39:38.962 INFO:tasks.workunit.client.0.smithi062.stdout: "max_size": -1, 2024-09-12T00:39:38.962 INFO:tasks.workunit.client.0.smithi062.stdout: "max_size_kb": 0, 2024-09-12T00:39:38.962 INFO:tasks.workunit.client.0.smithi062.stdout: "max_objects": -1 2024-09-12T00:39:38.962 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:39:38.962 INFO:tasks.workunit.client.0.smithi062.stdout: "temp_url_keys": [], 2024-09-12T00:39:38.962 INFO:tasks.workunit.client.0.smithi062.stdout: "type": "rgw", 2024-09-12T00:39:38.962 INFO:tasks.workunit.client.0.smithi062.stdout: "mfa_ids": [], 2024-09-12T00:39:38.962 INFO:tasks.workunit.client.0.smithi062.stdout: "account_id": "", 2024-09-12T00:39:38.962 INFO:tasks.workunit.client.0.smithi062.stdout: "path": "/", 2024-09-12T00:39:38.963 INFO:tasks.workunit.client.0.smithi062.stdout: "create_date": "2024-09-12T00:39:38.951963Z", 2024-09-12T00:39:38.963 INFO:tasks.workunit.client.0.smithi062.stdout: "tags": [], 2024-09-12T00:39:38.963 INFO:tasks.workunit.client.0.smithi062.stdout: "group_ids": [] 2024-09-12T00:39:38.963 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:39:38.963 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:39:38.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.962+0000 7f0d6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:38.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.964+0000 7f0eb74b7800 20 remove_watcher() i=0 2024-09-12T00:39:38.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.964+0000 7f0eb74b7800 2 removed watcher, disabling cache 2024-09-12T00:39:38.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.965+0000 7f0eb74b7800 20 remove_watcher() i=1 2024-09-12T00:39:38.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.966+0000 7f0eb74b7800 20 remove_watcher() i=2 2024-09-12T00:39:38.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.967+0000 7f0eb74b7800 20 remove_watcher() i=3 2024-09-12T00:39:38.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.968+0000 7f0eb74b7800 20 remove_watcher() i=4 2024-09-12T00:39:38.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.969+0000 7f0eb74b7800 20 remove_watcher() i=5 2024-09-12T00:39:38.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.970+0000 7f0eb74b7800 20 remove_watcher() i=6 2024-09-12T00:39:38.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:38.971+0000 7f0eb74b7800 20 remove_watcher() i=7 2024-09-12T00:39:38.981 INFO:tasks.workunit.client.0.smithi062.stdout:phase 1.1 2024-09-12T00:39:39.003 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:39:39.003 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:39:39.003 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:39:39.003 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:39:39.014 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:39.014 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:39.392 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.INIT (389 ms) 2024-09-12T00:39:39.392 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:39:39.393 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:39:39.393 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:39:39.393 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:39:39.394 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:39:39.404 INFO:tasks.workunit.client.0.smithi062.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T00:39:39.409 INFO:tasks.workunit.client.0.smithi062.stdout:creating: nfsroot:foo/f1 2024-09-12T00:39:39.412 INFO:tasks.workunit.client.0.smithi062.stdout:creating: nfsroot:foo/f2 2024-09-12T00:39:39.415 INFO:tasks.workunit.client.0.smithi062.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T00:39:39.418 INFO:tasks.workunit.client.0.smithi062.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T00:39:39.421 INFO:tasks.workunit.client.0.smithi062.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T00:39:39.424 INFO:tasks.workunit.client.0.smithi062.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T00:39:39.427 INFO:tasks.workunit.client.0.smithi062.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T00:39:39.430 INFO:tasks.workunit.client.0.smithi062.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T00:39:39.432 INFO:tasks.workunit.client.0.smithi062.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T00:39:39.435 INFO:tasks.workunit.client.0.smithi062.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T00:39:39.440 INFO:tasks.workunit.client.0.smithi062.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T00:39:39.441 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SETUP_HIER1 (48 ms) 2024-09-12T00:39:39.441 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:39:39.542 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SETUP_DIRS1 (101 ms) 2024-09-12T00:39:39.542 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:39:39.542 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:39:39.542 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:39:39.557 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (15 ms) 2024-09-12T00:39:39.557 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:39:39.599 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (41 ms) 2024-09-12T00:39:39.599 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:39:39.599 INFO:tasks.workunit.client.0.smithi062.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T00:39:39.605 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-09-12T00:39:39.606 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:39:39.606 INFO:tasks.workunit.client.0.smithi062.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T00:39:39.612 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (7 ms) 2024-09-12T00:39:39.612 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:39:39.612 INFO:tasks.workunit.client.0.smithi062.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:39:39.612 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:39:39.612 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:39:39.612 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:39:39.612 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:39:39.613 INFO:tasks.workunit.client.0.smithi062.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:39:39.613 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:39:39.613 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:39:39.613 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:39:39.613 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:39:39.613 INFO:tasks.workunit.client.0.smithi062.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:39:39.613 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:39:39.613 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:39:39.613 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:39:39.613 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:39:39.613 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:39:39.613 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:39:39.613 INFO:tasks.workunit.client.0.smithi062.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:39:39.614 INFO:tasks.workunit.client.0.smithi062.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:39:39.614 INFO:tasks.workunit.client.0.smithi062.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:39:39.614 INFO:tasks.workunit.client.0.smithi062.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:39:39.615 INFO:tasks.workunit.client.0.smithi062.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:39:39.615 INFO:tasks.workunit.client.0.smithi062.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:39:39.615 INFO:tasks.workunit.client.0.smithi062.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:39:39.616 INFO:tasks.workunit.client.0.smithi062.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:39:39.616 INFO:tasks.workunit.client.0.smithi062.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:39:39.619 INFO:tasks.workunit.client.0.smithi062.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:39:39.619 INFO:tasks.workunit.client.0.smithi062.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:39:39.619 INFO:tasks.workunit.client.0.smithi062.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:39:39.620 INFO:tasks.workunit.client.0.smithi062.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:39:39.620 INFO:tasks.workunit.client.0.smithi062.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:39:39.622 INFO:tasks.workunit.client.0.smithi062.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:39:39.622 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2024-09-12T00:39:39.622 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:39:39.802 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.READF_SETUP1 (180 ms) 2024-09-12T00:39:39.802 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:39:39.802 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:39:39.802 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:39:39.803 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:39:39.803 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:39:39.803 INFO:tasks.workunit.client.0.smithi062.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:39:39.803 INFO:tasks.workunit.client.0.smithi062.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:39:39.803 INFO:tasks.workunit.client.0.smithi062.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:39:39.803 INFO:tasks.workunit.client.0.smithi062.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:39:39.803 INFO:tasks.workunit.client.0.smithi062.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:39:39.803 INFO:tasks.workunit.client.0.smithi062.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:39:39.803 INFO:tasks.workunit.client.0.smithi062.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:39:39.803 INFO:tasks.workunit.client.0.smithi062.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:39:39.803 INFO:tasks.workunit.client.0.smithi062.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:39:39.804 INFO:tasks.workunit.client.0.smithi062.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:39:39.804 INFO:tasks.workunit.client.0.smithi062.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:39:39.804 INFO:tasks.workunit.client.0.smithi062.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:39:39.804 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:39:39.804 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:39:39.810 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:39:39.811 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:39:39.814 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:39:39.815 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:39:39.818 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:39:39.819 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:39:39.819 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:39:39.820 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:39:39.820 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:39:39.821 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:39:39.822 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:39:39.824 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:39:39.824 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:39:39.824 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:39:39.824 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:39:39.824 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:39:39.824 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-09-12T00:39:39.824 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:39:39.824 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:39:39.824 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:39:39.824 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:39:39.824 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:39:39.824 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:39:39.825 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:39:39.825 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:39:39.825 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:39:39.825 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:39:39.825 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:39:39.825 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:39:39.825 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:39:39.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:39.824+0000 7ff424f208c0 -1 shutting down 2024-09-12T00:39:39.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:39:39.826+0000 7ff2fce04640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64192, si_uid : 1000, si_addr0x3e80000fac0, si_status0 2024-09-12T00:40:09.818 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SHUTDOWN (29994 ms) 2024-09-12T00:40:09.818 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 24 tests from LibRGW (30814 ms total) 2024-09-12T00:40:09.818 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:40:09.818 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:40:09.818 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 24 tests from 1 test suite ran. (30814 ms total) 2024-09-12T00:40:09.819 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 24 tests. 2024-09-12T00:40:09.824 INFO:tasks.workunit.client.0.smithi062.stdout:phase 1.2 2024-09-12T00:40:09.849 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:40:09.849 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:40:09.850 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:40:09.850 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:40:09.858 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:09.858 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:10.247 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.INIT (398 ms) 2024-09-12T00:40:10.247 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:40:10.249 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:40:10.249 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:40:10.249 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:40:10.249 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:40:10.249 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T00:40:10.249 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:40:10.249 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T00:40:10.249 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:40:10.249 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:40:10.249 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:40:10.249 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:40:10.249 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:40:10.249 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:40:10.250 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:40:10.250 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:40:10.250 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:40:10.250 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:40:10.250 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:40:10.250 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:40:10.250 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:40:10.250 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T00:40:10.250 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:40:10.250 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:40:10.250 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:40:10.250 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:40:10.250 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:40:10.250 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:40:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:40:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:40:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:40:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T00:40:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:40:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:40:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:40:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:40:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:40:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:40:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:40:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:40:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:40:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:40:10.251 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:40:10.252 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:40:10.252 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:40:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:40:10.249+0000 7f0bc3b1f8c0 -1 shutting down 2024-09-12T00:40:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:40:10.250+0000 7f0a9b9cf640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64811, si_uid : 1000, si_addr0x3e80000fd2b, si_status0 2024-09-12T00:40:40.414 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SHUTDOWN (30165 ms) 2024-09-12T00:40:40.415 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 24 tests from LibRGW (30564 ms total) 2024-09-12T00:40:40.415 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:40:40.415 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:40:40.415 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 24 tests from 1 test suite ran. (30564 ms total) 2024-09-12T00:40:40.415 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 24 tests. 2024-09-12T00:40:40.420 INFO:tasks.workunit.client.0.smithi062.stdout:phase 1.3 2024-09-12T00:40:40.445 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:40:40.445 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:40:40.446 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:40:40.446 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:40:40.456 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:40:40.456 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:40:40.845 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.INIT (400 ms) 2024-09-12T00:40:40.846 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:40:40.846 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:40:40.846 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:40:40.846 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:40:40.847 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:40:40.852 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-09-12T00:40:40.852 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:40:40.913 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SETUP_DIRS1 (61 ms) 2024-09-12T00:40:40.913 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:40:40.913 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:40:40.914 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:40:40.914 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:40:40.914 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:40:40.914 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:40:40.914 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:40:40.914 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:40:40.914 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:40:40.914 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:40:40.914 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:40:40.914 INFO:tasks.workunit.client.0.smithi062.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:40:40.914 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:40:40.914 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:40:40.914 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:40:40.914 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:40:40.915 INFO:tasks.workunit.client.0.smithi062.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:40:40.915 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:40:40.915 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:40:40.915 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:40:40.915 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:40:40.915 INFO:tasks.workunit.client.0.smithi062.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:40:40.915 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:40:40.915 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:40:40.915 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:40:40.915 INFO:tasks.workunit.client.0.smithi062.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:40:40.915 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:40:40.915 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:40:40.916 INFO:tasks.workunit.client.0.smithi062.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:40:40.916 INFO:tasks.workunit.client.0.smithi062.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:40:40.916 INFO:tasks.workunit.client.0.smithi062.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:40:40.916 INFO:tasks.workunit.client.0.smithi062.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:40:40.917 INFO:tasks.workunit.client.0.smithi062.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:40:40.917 INFO:tasks.workunit.client.0.smithi062.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:40:40.917 INFO:tasks.workunit.client.0.smithi062.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:40:40.918 INFO:tasks.workunit.client.0.smithi062.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:40:40.918 INFO:tasks.workunit.client.0.smithi062.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:40:40.919 INFO:tasks.workunit.client.0.smithi062.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:40:40.919 INFO:tasks.workunit.client.0.smithi062.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:40:40.919 INFO:tasks.workunit.client.0.smithi062.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:40:40.921 INFO:tasks.workunit.client.0.smithi062.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:40:40.921 INFO:tasks.workunit.client.0.smithi062.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:40:40.922 INFO:tasks.workunit.client.0.smithi062.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:40:40.922 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-09-12T00:40:40.922 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:40:40.922 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:40:40.923 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:40:40.923 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:40:40.923 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:40:40.923 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:40:40.923 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:40:40.923 INFO:tasks.workunit.client.0.smithi062.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:40:40.923 INFO:tasks.workunit.client.0.smithi062.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:40:40.923 INFO:tasks.workunit.client.0.smithi062.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:40:40.923 INFO:tasks.workunit.client.0.smithi062.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:40:40.923 INFO:tasks.workunit.client.0.smithi062.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:40:40.923 INFO:tasks.workunit.client.0.smithi062.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:40:40.923 INFO:tasks.workunit.client.0.smithi062.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:40:40.924 INFO:tasks.workunit.client.0.smithi062.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:40:40.924 INFO:tasks.workunit.client.0.smithi062.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:40:40.924 INFO:tasks.workunit.client.0.smithi062.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:40:40.924 INFO:tasks.workunit.client.0.smithi062.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:40:40.924 INFO:tasks.workunit.client.0.smithi062.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:40:40.924 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:40:40.924 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:40:40.929 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:40:40.929 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:40:40.932 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:40:40.933 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:40:40.936 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:40:40.936 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:40:40.936 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:40:40.937 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:40:40.938 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:40:40.938 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:40:40.939 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:40:40.940 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:40:40.941 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:40:40.941 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:40:40.941 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:40:40.941 INFO:tasks.workunit.client.0.smithi062.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:40:40.941 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.HIER1 (18 ms) 2024-09-12T00:40:40.941 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:40:40.941 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:40:40.941 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:40:40.941 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:40:40.941 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:40:40.941 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:40:40.941 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:40:40.942 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:40:40.942 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:40:40.942 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:40:40.942 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:40:40.942 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:40:40.942 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:40:40.942 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:40:40.941+0000 7fd9349398c0 -1 shutting down 2024-09-12T00:40:40.942 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:40:40.943+0000 7fd80c8d5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65432, si_uid : 1000, si_addr0x3e80000ff98, si_status0 2024-09-12T00:41:10.964 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SHUTDOWN (30023 ms) 2024-09-12T00:41:10.964 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 24 tests from LibRGW (30518 ms total) 2024-09-12T00:41:10.964 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:41:10.964 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:41:10.965 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 24 tests from 1 test suite ran. (30518 ms total) 2024-09-12T00:41:10.965 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 24 tests. 2024-09-12T00:41:10.970 INFO:tasks.workunit.client.0.smithi062.stdout:phase 2.1 2024-09-12T00:41:10.996 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:41:10.996 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:41:10.996 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:41:10.997 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:41:11.006 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:11.006 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:11.605 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.INIT (609 ms) 2024-09-12T00:41:11.605 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:41:11.605 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:41:11.605 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:41:11.616 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-09-12T00:41:11.616 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:41:11.616 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:41:11.616 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:41:11.625 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave0 2024-09-12T00:41:11.634 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave1 2024-09-12T00:41:11.644 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave2 2024-09-12T00:41:11.662 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave3 2024-09-12T00:41:11.670 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave4 2024-09-12T00:41:11.679 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave5 2024-09-12T00:41:11.689 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave6 2024-09-12T00:41:11.699 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave7 2024-09-12T00:41:11.709 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave8 2024-09-12T00:41:11.718 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave9 2024-09-12T00:41:11.719 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (102 ms) 2024-09-12T00:41:11.719 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:41:11.894 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (176 ms) 2024-09-12T00:41:11.894 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:41:11.894 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:41:11.894 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:41:11.894 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:41:11.894 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:41:11.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:41:11.895+0000 7f921073d8c0 -1 shutting down 2024-09-12T00:41:11.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:41:11.896+0000 7f90e873c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66052, si_uid : 1000, si_addr0x3e800010204, si_status0 2024-09-12T00:41:41.913 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SHUTDOWN (30018 ms) 2024-09-12T00:41:41.913 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 9 tests from LibRGW (30916 ms total) 2024-09-12T00:41:41.913 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:41:41.913 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:41:41.913 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 9 tests from 1 test suite ran. (30916 ms total) 2024-09-12T00:41:41.913 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 9 tests. 2024-09-12T00:41:41.918 INFO:tasks.workunit.client.0.smithi062.stdout:phase 2.2 2024-09-12T00:41:41.943 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:41:41.943 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:41:41.944 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:41:41.944 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:41:41.953 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:41:41.953 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:41:42.340 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.INIT (397 ms) 2024-09-12T00:41:42.352 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:41:42.352 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:41:42.352 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:41:42.352 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:41:42.352 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:41:42.362 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.DELETE_BUCKET (21 ms) 2024-09-12T00:41:42.362 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:41:42.372 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave0 2024-09-12T00:41:42.381 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave1 2024-09-12T00:41:42.390 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave2 2024-09-12T00:41:42.399 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave3 2024-09-12T00:41:42.408 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave4 2024-09-12T00:41:42.417 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave5 2024-09-12T00:41:42.425 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave6 2024-09-12T00:41:42.435 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave7 2024-09-12T00:41:42.444 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave8 2024-09-12T00:41:42.453 INFO:tasks.workunit.client.0.smithi062.stdout:created: sorrydave9 2024-09-12T00:41:42.453 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (91 ms) 2024-09-12T00:41:42.454 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:41:42.629 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (176 ms) 2024-09-12T00:41:42.629 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:41:42.629 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:41:42.630 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:41:42.630 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:41:42.630 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:41:42.630 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:41:42.630+0000 7f60047688c0 -1 shutting down 2024-09-12T00:41:42.630 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:41:42.631+0000 7f5edc765640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66671, si_uid : 1000, si_addr0x3e80001046f, si_status0 2024-09-12T00:42:12.469 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SHUTDOWN (29839 ms) 2024-09-12T00:42:12.469 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 9 tests from LibRGW (30525 ms total) 2024-09-12T00:42:12.469 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:42:12.469 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:42:12.469 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 9 tests from 1 test suite ran. (30525 ms total) 2024-09-12T00:42:12.470 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 9 tests. 2024-09-12T00:42:12.475 INFO:tasks.workunit.client.0.smithi062.stdout:phase 3.1 2024-09-12T00:42:12.806 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:42:12.806 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:42:12.806 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:42:12.806 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:42:12.815 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:12.815 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:12.993 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.INIT (187 ms) 2024-09-12T00:42:12.993 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:42:12.994 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:42:12.995 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:42:13.004 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-09-12T00:42:13.004 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:42:13.008 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T00:42:13.008 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:42:13.009 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-09-12T00:42:13.009 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:42:13.066 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.LARGE1 (57 ms) 2024-09-12T00:42:13.066 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:42:13.110 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.LARGE2 (44 ms) 2024-09-12T00:42:13.110 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:42:13.110 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:42:13.110 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:42:13.110 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:42:13.111 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:42:13.111 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:42:13.111 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:42:13.111 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:42:13.111 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:42:13.111 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:42:13.111 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:42:13.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:42:13.111+0000 7fe559f448c0 -1 shutting down 2024-09-12T00:42:13.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:42:13.112+0000 7fe431f47640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67290, si_uid : 1000, si_addr0x3e8000106da, si_status0 2024-09-12T00:42:43.140 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SHUTDOWN (30030 ms) 2024-09-12T00:42:43.141 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 13 tests from LibRGW (30334 ms total) 2024-09-12T00:42:43.141 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:42:43.141 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:42:43.141 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 13 tests from 1 test suite ran. (30334 ms total) 2024-09-12T00:42:43.141 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 13 tests. 2024-09-12T00:42:43.148 INFO:tasks.workunit.client.0.smithi062.stdout:phase 3.2 2024-09-12T00:42:43.479 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:42:43.479 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:42:43.479 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:42:43.479 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:42:43.487 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:43.487 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:43.871 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.INIT (392 ms) 2024-09-12T00:42:43.871 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:42:43.871 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:42:43.871 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:42:43.872 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:42:43.872 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:42:43.878 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T00:42:43.878 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:42:43.882 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T00:42:43.882 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:42:43.940 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.LARGE1 (58 ms) 2024-09-12T00:42:43.940 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:42:43.940 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T00:42:43.940 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:42:43.941 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:42:43.941 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:42:43.946 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.DELETE_OBJECT (6 ms) 2024-09-12T00:42:43.946 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:42:43.964 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.DELETE_BUCKET (18 ms) 2024-09-12T00:42:43.964 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:42:43.964 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:42:43.964 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:42:43.964 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:42:43.964 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:42:43.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:42:43.965+0000 7f83d66318c0 -1 shutting down 2024-09-12T00:42:43.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:42:43.966+0000 7f82abb9b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67910, si_uid : 1000, si_addr0x3e800010946, si_status0 2024-09-12T00:43:14.276 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SHUTDOWN (30311 ms) 2024-09-12T00:43:14.276 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 13 tests from LibRGW (30796 ms total) 2024-09-12T00:43:14.276 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:43:14.276 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:43:14.276 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 13 tests from 1 test suite ran. (30796 ms total) 2024-09-12T00:43:14.276 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 13 tests. 2024-09-12T00:43:14.283 INFO:tasks.workunit.client.0.smithi062.stdout:phase 4.1 2024-09-12T00:43:14.309 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:43:14.309 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:43:14.310 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:43:14.310 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:43:14.310 INFO:tasks.workunit.client.0.smithi062.stdout:read i1: 64001 2024-09-12T00:43:14.310 INFO:tasks.workunit.client.0.smithi062.stdout:read s1: blunderbuss 2024-09-12T00:43:14.310 INFO:tasks.workunit.client.0.smithi062.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:43:14.310 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:43:14.321 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:14.321 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:14.710 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.INIT (401 ms) 2024-09-12T00:43:14.710 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:43:14.711 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:43:14.711 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:43:14.730 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (18 ms) 2024-09-12T00:43:14.730 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:43:15.288 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_0 2024-09-12T00:43:15.288 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_1 2024-09-12T00:43:15.288 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_2 2024-09-12T00:43:15.289 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_3 2024-09-12T00:43:15.289 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_4 2024-09-12T00:43:15.289 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_5 2024-09-12T00:43:15.289 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_6 2024-09-12T00:43:15.289 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_7 2024-09-12T00:43:15.289 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_8 2024-09-12T00:43:15.289 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_9 2024-09-12T00:43:15.289 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_10 2024-09-12T00:43:15.289 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_11 2024-09-12T00:43:15.289 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_12 2024-09-12T00:43:15.289 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_13 2024-09-12T00:43:15.289 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_14 2024-09-12T00:43:15.290 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_15 2024-09-12T00:43:15.290 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_16 2024-09-12T00:43:15.290 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_17 2024-09-12T00:43:15.290 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_18 2024-09-12T00:43:15.290 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_19 2024-09-12T00:43:15.290 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_20 2024-09-12T00:43:15.290 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_21 2024-09-12T00:43:15.290 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_22 2024-09-12T00:43:15.290 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_23 2024-09-12T00:43:15.290 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_24 2024-09-12T00:43:15.290 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_25 2024-09-12T00:43:15.290 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_26 2024-09-12T00:43:15.291 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_27 2024-09-12T00:43:15.291 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_28 2024-09-12T00:43:15.291 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_29 2024-09-12T00:43:15.291 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_30 2024-09-12T00:43:15.291 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_31 2024-09-12T00:43:15.291 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_32 2024-09-12T00:43:15.291 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_33 2024-09-12T00:43:15.291 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_34 2024-09-12T00:43:15.291 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_35 2024-09-12T00:43:15.291 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_36 2024-09-12T00:43:15.291 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_37 2024-09-12T00:43:15.291 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_38 2024-09-12T00:43:15.292 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_39 2024-09-12T00:43:15.292 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_40 2024-09-12T00:43:15.292 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_41 2024-09-12T00:43:15.292 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_42 2024-09-12T00:43:15.292 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_43 2024-09-12T00:43:15.292 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_44 2024-09-12T00:43:15.292 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_45 2024-09-12T00:43:15.292 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_46 2024-09-12T00:43:15.292 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_47 2024-09-12T00:43:15.292 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_48 2024-09-12T00:43:15.292 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_49 2024-09-12T00:43:15.293 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_50 2024-09-12T00:43:15.293 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_51 2024-09-12T00:43:15.293 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_52 2024-09-12T00:43:15.293 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_53 2024-09-12T00:43:15.293 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_54 2024-09-12T00:43:15.293 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_55 2024-09-12T00:43:15.293 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_56 2024-09-12T00:43:15.293 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_57 2024-09-12T00:43:15.293 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_58 2024-09-12T00:43:15.293 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_59 2024-09-12T00:43:15.294 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_60 2024-09-12T00:43:15.294 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_61 2024-09-12T00:43:15.294 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_62 2024-09-12T00:43:15.294 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_63 2024-09-12T00:43:15.294 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_64 2024-09-12T00:43:15.294 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_65 2024-09-12T00:43:15.294 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_66 2024-09-12T00:43:15.294 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_67 2024-09-12T00:43:15.294 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_68 2024-09-12T00:43:15.294 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_69 2024-09-12T00:43:15.294 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_70 2024-09-12T00:43:15.295 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_71 2024-09-12T00:43:15.295 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_72 2024-09-12T00:43:15.295 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_73 2024-09-12T00:43:15.295 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_74 2024-09-12T00:43:15.295 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_75 2024-09-12T00:43:15.295 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_76 2024-09-12T00:43:15.295 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_77 2024-09-12T00:43:15.295 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_78 2024-09-12T00:43:15.295 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_79 2024-09-12T00:43:15.295 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_80 2024-09-12T00:43:15.295 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_81 2024-09-12T00:43:15.295 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_82 2024-09-12T00:43:15.295 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_83 2024-09-12T00:43:15.296 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_84 2024-09-12T00:43:15.296 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_85 2024-09-12T00:43:15.296 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_86 2024-09-12T00:43:15.296 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_87 2024-09-12T00:43:15.296 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_88 2024-09-12T00:43:15.296 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_89 2024-09-12T00:43:15.296 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_90 2024-09-12T00:43:15.296 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_91 2024-09-12T00:43:15.296 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_92 2024-09-12T00:43:15.296 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_93 2024-09-12T00:43:15.296 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_94 2024-09-12T00:43:15.296 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_95 2024-09-12T00:43:15.297 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_96 2024-09-12T00:43:15.297 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_97 2024-09-12T00:43:15.297 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_98 2024-09-12T00:43:15.297 INFO:tasks.workunit.client.0.smithi062.stdout:created: dmarker:f_99 2024-09-12T00:43:15.297 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (559 ms) 2024-09-12T00:43:15.297 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:43:15.298 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T00:43:15.298 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T00:43:15.298 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:43:15.299 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:43:15.299 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:43:15.299 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:43:15.299 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:43:15.299 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:43:15.299 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:43:15.299 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:43:15.299 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:43:15.299 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:43:15.299 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:43:15.299 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:43:15.299 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:43:15.299 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:43:15.300 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:43:15.300 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:43:15.300 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:43:15.300 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:43:15.300 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:43:15.300 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:43:15.300 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:43:15.300 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:43:15.300 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:43:15.300 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:43:15.300 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:43:15.300 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:43:15.301 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:43:15.301 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:43:15.301 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:43:15.301 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:43:15.301 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:43:15.301 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:43:15.301 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:43:15.301 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:43:15.301 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:43:15.301 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:43:15.301 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:43:15.301 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:43:15.302 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:43:15.302 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:43:15.302 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:43:15.302 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:43:15.302 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:43:15.302 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:43:15.302 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:43:15.302 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:43:15.302 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:43:15.302 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:43:15.302 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:43:15.302 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:43:15.302 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:43:15.303 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:43:15.303 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:43:15.303 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:43:15.303 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:43:15.303 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:43:15.303 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:43:15.303 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:43:15.303 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:43:15.303 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:43:15.303 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:43:15.303 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:43:15.303 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:43:15.303 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:43:15.304 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:43:15.304 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:43:15.304 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:43:15.304 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:43:15.304 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:43:15.304 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:43:15.304 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:43:15.304 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:43:15.304 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:43:15.304 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:43:15.304 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:43:15.304 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:43:15.304 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:43:15.304 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:43:15.305 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:43:15.305 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:43:15.305 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:43:15.305 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:43:15.305 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:43:15.305 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:43:15.305 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:43:15.305 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:43:15.305 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:43:15.305 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:43:15.305 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:43:15.305 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:43:15.305 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:43:15.306 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:43:15.306 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:43:15.306 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:43:15.306 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:43:15.306 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:43:15.306 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:43:15.306 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:43:15.306 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:43:15.306 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:43:15.306 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_READDIR (4 ms) 2024-09-12T00:43:15.306 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:43:15.306 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:43:15.306 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:43:15.306 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:43:15.307 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:43:15.307 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:43:15.307 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:43:15.307 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:43:15.307 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:43:15.307 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:43:15.307 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:43:15.307 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:43:15.307 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:43:15.307 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:43:15.307 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:43:15.307 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:43:15.307 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:43:15.308 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:43:15.308 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:43:15.308 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:43:15.308 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:43:15.308 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:43:15.308 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:43:15.308 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:43:15.308 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:43:15.308 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:43:15.308 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:43:15.308 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:43:15.308 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:43:15.309 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:43:15.309 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:43:15.309 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:43:15.309 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:43:15.309 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:43:15.309 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:43:15.309 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:43:15.309 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:43:15.309 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:43:15.309 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:43:15.309 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:43:15.309 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:43:15.309 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:43:15.309 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:43:15.310 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:43:15.310 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:43:15.310 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:43:15.310 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:43:15.310 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:43:15.310 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:43:15.310 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:43:15.310 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:43:15.310 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:43:15.310 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:43:15.310 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:43:15.310 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:43:15.310 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:43:15.310 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:43:15.311 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:43:15.311 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:43:15.311 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:43:15.311 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:43:15.311 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:43:15.311 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:43:15.311 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:43:15.311 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:43:15.311 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:43:15.311 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:43:15.311 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:43:15.311 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:43:15.311 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:43:15.312 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:43:15.312 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:43:15.312 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:43:15.312 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:43:15.312 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:43:15.312 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:43:15.312 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:43:15.312 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:43:15.312 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:43:15.312 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:43:15.312 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:43:15.312 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:43:15.312 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:43:15.312 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:43:15.313 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:43:15.313 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:43:15.313 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:43:15.313 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:43:15.313 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:43:15.313 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:43:15.313 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:43:15.313 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:43:15.313 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:43:15.313 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:43:15.313 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:43:15.313 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:43:15.313 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:43:15.314 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:43:15.314 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:43:15.314 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:43:15.314 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:43:15.314 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-12T00:43:15.314 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:43:15.314 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:43:15.314 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:43:15.314 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:43:15.314 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:43:15.314 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:43:15.314 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:43:15.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:43:15.296+0000 7f3392c878c0 -1 shutting down 2024-09-12T00:43:15.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:43:15.297+0000 7f326c9c6640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68529, si_uid : 1000, si_addr0x3e800010bb1, si_status0 2024-09-12T00:43:45.019 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SHUTDOWN (29724 ms) 2024-09-12T00:43:45.020 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 11 tests from LibRGW (30709 ms total) 2024-09-12T00:43:45.020 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:43:45.020 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:43:45.021 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 11 tests from 1 test suite ran. (30709 ms total) 2024-09-12T00:43:45.021 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 11 tests. 2024-09-12T00:43:45.025 INFO:tasks.workunit.client.0.smithi062.stdout:phase 4.2 2024-09-12T00:43:45.055 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:43:45.055 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:43:45.055 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:43:45.056 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:43:45.056 INFO:tasks.workunit.client.0.smithi062.stdout:read i1: 64001 2024-09-12T00:43:45.056 INFO:tasks.workunit.client.0.smithi062.stdout:read s1: blunderbuss 2024-09-12T00:43:45.056 INFO:tasks.workunit.client.0.smithi062.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:43:45.056 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:43:45.064 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:43:45.064 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:43:45.454 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.INIT (399 ms) 2024-09-12T00:43:45.454 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:43:45.455 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:43:45.455 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:43:45.465 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (10 ms) 2024-09-12T00:43:45.465 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:43:45.465 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:43:45.465 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:43:45.465 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:43:45.466 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:43:45.469 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:43:45.469 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:43:45.470 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:43:45.470 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:43:45.470 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:43:45.470 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:43:45.470 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:43:45.470 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:43:45.470 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:43:45.471 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:43:45.471 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:43:45.471 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:43:45.471 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:43:45.471 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:43:45.471 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:43:45.471 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:43:45.472 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:43:45.472 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:43:45.472 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:43:45.472 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:43:45.472 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:43:45.472 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:43:45.472 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:43:45.472 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:43:45.473 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:43:45.473 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:43:45.473 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:43:45.473 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:43:45.473 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:43:45.473 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:43:45.473 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:43:45.473 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:43:45.474 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:43:45.474 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:43:45.474 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:43:45.474 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:43:45.474 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:43:45.474 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:43:45.474 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:43:45.475 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:43:45.475 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:43:45.475 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:43:45.475 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:43:45.475 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:43:45.475 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:43:45.475 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:43:45.476 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:43:45.476 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:43:45.476 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:43:45.476 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:43:45.476 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:43:45.476 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:43:45.476 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:43:45.477 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:43:45.477 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:43:45.477 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:43:45.477 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:43:45.479 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:43:45.480 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:43:45.480 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:43:45.480 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:43:45.480 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:43:45.480 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:43:45.480 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:43:45.480 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:43:45.480 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:43:45.481 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:43:45.481 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:43:45.481 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:43:45.481 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:43:45.481 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:43:45.481 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:43:45.481 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:43:45.481 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:43:45.481 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:43:45.481 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:43:45.482 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:43:45.482 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:43:45.482 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:43:45.482 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:43:45.482 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:43:45.482 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:43:45.482 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:43:45.482 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:43:45.482 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:43:45.482 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:43:45.482 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:43:45.482 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:43:45.482 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:43:45.483 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:43:45.483 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:43:45.483 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:43:45.483 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:43:45.483 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:43:45.483 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:43:45.483 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:43:45.483 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:43:45.483 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:43:45.484 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:43:45.484 INFO:tasks.workunit.client.0.smithi062.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:43:45.484 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-09-12T00:43:45.484 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:43:45.484 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:43:45.484 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:43:45.484 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:43:45.484 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:43:45.484 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:43:45.484 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:43:45.485 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:43:45.470+0000 7fc35cf448c0 -1 shutting down 2024-09-12T00:43:45.485 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:43:45.471+0000 7fc234f47640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69149, si_uid : 1000, si_addr0x3e800010e1d, si_status0 2024-09-12T00:44:15.746 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SHUTDOWN (30277 ms) 2024-09-12T00:44:15.746 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 11 tests from LibRGW (30691 ms total) 2024-09-12T00:44:15.747 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:44:15.747 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:44:15.747 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 11 tests from 1 test suite ran. (30691 ms total) 2024-09-12T00:44:15.747 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 11 tests. 2024-09-12T00:44:15.752 INFO:tasks.workunit.client.0.smithi062.stdout:phase 5.1 2024-09-12T00:44:15.787 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:44:15.787 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:44:15.787 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:44:15.787 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:44:15.797 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:15.798 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:16.187 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.INIT (400 ms) 2024-09-12T00:44:16.187 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:44:16.188 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:44:16.188 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:44:16.198 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CREATE_BUCKET (10 ms) 2024-09-12T00:44:16.198 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:44:16.201 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T00:44:16.201 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:44:16.201 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:44:16.202 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:44:16.203 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-09-12T00:44:16.203 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:44:16.203 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:44:16.203 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:44:16.208 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.PUT_OBJECT (5 ms) 2024-09-12T00:44:16.208 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:44:16.210 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-12T00:44:16.211 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:44:16.211 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:44:16.211 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:44:16.211 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:44:16.211 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:44:16.211 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:44:16.211 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:44:16.212 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:44:16.212 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:44:16.212 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:44:16.212 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:44:16.212 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:44:16.212 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:44:16.212 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:44:16.212 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:44:16.212 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:44:16.212 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:44:16.212 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:44:16.212 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:44:16.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:44:16.211+0000 7f30a4d418c0 -1 shutting down 2024-09-12T00:44:16.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:44:16.212+0000 7f2f7ea80640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69768, si_uid : 1000, si_addr0x3e800011088, si_status0 2024-09-12T00:44:46.531 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SHUTDOWN (30320 ms) 2024-09-12T00:44:46.532 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 19 tests from LibRGW (30743 ms total) 2024-09-12T00:44:46.532 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:44:46.532 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:44:46.532 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 19 tests from 1 test suite ran. (30743 ms total) 2024-09-12T00:44:46.532 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 19 tests. 2024-09-12T00:44:46.536 INFO:tasks.workunit.client.0.smithi062.stdout:phase 5.2 2024-09-12T00:44:46.571 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:44:46.571 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:44:46.571 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:44:46.572 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:44:46.579 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:46.579 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:47.176 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.INIT (605 ms) 2024-09-12T00:44:47.177 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:44:47.177 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:44:47.177 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:44:47.177 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:44:47.177 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:44:47.183 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T00:44:47.183 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:44:47.183 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:44:47.183 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:44:47.183 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T00:44:47.183 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:44:47.183 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:44:47.183 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:44:47.183 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T00:44:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:44:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T00:44:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:44:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:44:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:44:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:44:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:44:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:44:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:44:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:44:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:44:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:44:47.184 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:44:47.188 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-12T00:44:47.188 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:44:47.206 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.DELETE_BUCKET (18 ms) 2024-09-12T00:44:47.206 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:44:47.207 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:44:47.207 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:44:47.207 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:44:47.207 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:44:47.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:44:47.207+0000 7fbcd2d228c0 -1 shutting down 2024-09-12T00:44:47.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:44:47.208+0000 7fbbaab9b640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70387, si_uid : 1000, si_addr0x3e8000112f3, si_status0 2024-09-12T00:45:17.579 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SHUTDOWN (30372 ms) 2024-09-12T00:45:17.579 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 19 tests from LibRGW (31007 ms total) 2024-09-12T00:45:17.579 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:45:17.579 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:45:17.579 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 19 tests from 1 test suite ran. (31007 ms total) 2024-09-12T00:45:17.579 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 19 tests. 2024-09-12T00:45:17.584 INFO:tasks.workunit.client.0.smithi062.stdout:phase 6.1 2024-09-12T00:45:17.610 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:45:17.610 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment set-up. 2024-09-12T00:45:17.610 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 10 tests from LibRGW 2024-09-12T00:45:17.611 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:45:17.618 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:17.618 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:17.804 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.INIT (194 ms) 2024-09-12T00:45:17.805 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:45:17.805 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:45:17.805 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T00:45:17.825 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CREATE_BUCKETS (20 ms) 2024-09-12T00:45:17.825 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T00:45:17.833 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (8 ms) 2024-09-12T00:45:17.833 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T00:45:17.851 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.TOPDIR_RENAME (18 ms) 2024-09-12T00:45:17.851 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T00:45:17.874 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SUBDIR_RENAME (22 ms) 2024-09-12T00:45:17.874 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T00:45:17.897 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (24 ms) 2024-09-12T00:45:17.897 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:45:17.897 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:45:17.897 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:45:17.897 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:45:17.897 INFO:tasks.workunit.client.0.smithi062.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:45:17.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:17.898+0000 7fc819ec58c0 -1 shutting down 2024-09-12T00:45:17.898 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:17.899+0000 7fc6f0df3640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 71007, si_uid : 1000, si_addr0x3e80001155f, si_status0 2024-09-12T00:45:48.031 INFO:tasks.workunit.client.0.smithi062.stdout:[ OK ] LibRGW.SHUTDOWN (30133 ms) 2024-09-12T00:45:48.031 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] 10 tests from LibRGW (30420 ms total) 2024-09-12T00:45:48.031 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:45:48.031 INFO:tasks.workunit.client.0.smithi062.stdout:[----------] Global test environment tear-down 2024-09-12T00:45:48.031 INFO:tasks.workunit.client.0.smithi062.stdout:[==========] 10 tests from 1 test suite ran. (30420 ms total) 2024-09-12T00:45:48.031 INFO:tasks.workunit.client.0.smithi062.stdout:[ PASSED ] 10 tests. 2024-09-12T00:45:48.038 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:45:48.038 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:45:48.084 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T00:45:48.085 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T00:45:48.085 DEBUG:teuthology.orchestra.run.smithi062:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T00:45:48.121 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z ']' 2024-09-12T00:45:48.122 INFO:tasks.workunit.client.0.smithi062.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:45:48.122 INFO:tasks.workunit.client.0.smithi062.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:45:48.122 INFO:tasks.workunit.client.0.smithi062.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:45:48.122 INFO:tasks.workunit.client.0.smithi062.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:45:48.122 INFO:tasks.workunit.client.0.smithi062.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-12T00:45:48.159 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:48.160 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:48.200 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.201+0000 7f9fe132e800 20 rados->read ofs=0 len=0 2024-09-12T00:45:48.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.203+0000 7f9fe132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:48.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.203+0000 7f9fe132e800 20 realm 2024-09-12T00:45:48.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.203+0000 7f9fe132e800 20 rados->read ofs=0 len=0 2024-09-12T00:45:48.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.203+0000 7f9fe132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:48.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.203+0000 7f9fe132e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:48.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.203+0000 7f9fe132e800 20 rados->read ofs=0 len=0 2024-09-12T00:45:48.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.203+0000 7f9fe132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:48.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.203+0000 7f9fe132e800 20 rados->read ofs=0 len=0 2024-09-12T00:45:48.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.204+0000 7f9fe132e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:48.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.204+0000 7f9fe132e800 20 rados->read ofs=0 len=0 2024-09-12T00:45:48.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.205+0000 7f9fe132e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:48.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.205+0000 7f9fe132e800 20 searching for the correct realm 2024-09-12T00:45:48.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.208+0000 7f9fdc8dc640 0 -- 172.21.15.62:0/3268867831 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f9fd8019b70 msgr2=0x7f9fd8039930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:48.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.413+0000 7f9fdd8de640 0 -- 172.21.15.62:0/3268867831 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55ecded524c0 msgr2=0x55ecded548b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:48.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.418+0000 7f9fe132e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:45:48.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.418+0000 7f9fe132e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:45:48.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.418+0000 7f9fe132e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:48.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.418+0000 7f9fe132e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:48.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.418+0000 7f9fe132e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:48.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.418+0000 7f9fe132e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:48.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.418+0000 7f9fe132e800 20 rados->read ofs=0 len=0 2024-09-12T00:45:48.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.418+0000 7f9fe132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:48.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.418+0000 7f9fe132e800 20 rados->read ofs=0 len=0 2024-09-12T00:45:48.418 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.418+0000 7f9fe132e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:48.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.418+0000 7f9fe132e800 20 rados->read ofs=0 len=0 2024-09-12T00:45:48.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.419+0000 7f9fe132e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:48.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.419+0000 7f9fe132e800 20 zone default found 2024-09-12T00:45:48.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.419+0000 7f9fe132e800 4 Realm: () 2024-09-12T00:45:48.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.419+0000 7f9fe132e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:45:48.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.419+0000 7f9fe132e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:45:48.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.419+0000 7f9fe132e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:48.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.419+0000 7f9fe132e800 20 zonegroup default 2024-09-12T00:45:48.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.419+0000 7f9fe132e800 20 rados->read ofs=0 len=0 2024-09-12T00:45:48.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.419+0000 7f9fe132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:48.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.419+0000 7f9fe132e800 20 rados->read ofs=0 len=0 2024-09-12T00:45:48.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.419+0000 7f9fe132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:48.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.419+0000 7f9fe132e800 20 rados->read ofs=0 len=0 2024-09-12T00:45:48.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.419+0000 7f9fe132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:48.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.419+0000 7f9fe132e800 20 started sync module instance, tier type = 2024-09-12T00:45:48.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.419+0000 7f9fe132e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:45:48.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.429+0000 7f9fe132e800 20 add_watcher() i=0 2024-09-12T00:45:48.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.429+0000 7f9fe132e800 20 add_watcher() i=1 2024-09-12T00:45:48.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.429+0000 7f9fe132e800 20 add_watcher() i=2 2024-09-12T00:45:48.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.429+0000 7f9fe132e800 20 add_watcher() i=3 2024-09-12T00:45:48.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.429+0000 7f9fe132e800 20 add_watcher() i=4 2024-09-12T00:45:48.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.429+0000 7f9fe132e800 20 add_watcher() i=5 2024-09-12T00:45:48.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.429+0000 7f9fe132e800 20 add_watcher() i=6 2024-09-12T00:45:48.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.430+0000 7f9fe132e800 20 add_watcher() i=7 2024-09-12T00:45:48.429 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.430+0000 7f9fe132e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:48.431 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.432+0000 7f9e937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:48.431 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.432+0000 7f9fe132e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:48.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.432+0000 7f9fe132e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:48.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.432+0000 7f9fe132e800 5 note: GC not initialized 2024-09-12T00:45:48.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.432+0000 7f9e927e4640 20 reqs_thread_entry: start 2024-09-12T00:45:48.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.433+0000 7f9fe132e800 20 init_complete bucket index max shards: 1 2024-09-12T00:45:48.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.433+0000 7f9fe132e800 20 Filter name: none 2024-09-12T00:45:48.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.433+0000 7f9e03fff640 20 reqs_thread_entry: start 2024-09-12T00:45:48.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.433+0000 7f9fe132e800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T00:45:48.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.433+0000 7f9fe132e800 20 rados->read ofs=0 len=0 2024-09-12T00:45:48.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.433+0000 7f9fe132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:48.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.433+0000 7f9fe132e800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T00:45:48.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.433+0000 7f9fe132e800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:45:48.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.433+0000 7f9fe132e800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T00:45:48.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.433+0000 7f9fe132e800 20 rados->read ofs=0 len=0 2024-09-12T00:45:48.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.434+0000 7f9fe132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:48.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.434+0000 7f9fe132e800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T00:45:48.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.434+0000 7f9fe132e800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:45:48.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.434+0000 7f9fe132e800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T00:45:48.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.434+0000 7f9fe132e800 20 rados->read ofs=0 len=0 2024-09-12T00:45:48.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.434+0000 7f9fe132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:48.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.434+0000 7f9fe132e800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T00:45:48.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.434+0000 7f9fe132e800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:45:48.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.434+0000 7f9fe132e800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:45:48.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.434+0000 7f9fe132e800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:45:48.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.435+0000 7f9fe132e800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:45:48.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.435+0000 7f9fe132e800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:45:48.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.435+0000 7f9fe132e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T00:45:48.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.436+0000 7f9ec0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725950 cookie 94475839231104 notifier 5528 bl.length()=677 2024-09-12T00:45:48.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.436+0000 7f9ec0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:45:48.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.436+0000 7f9ec0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:45:48.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.439+0000 7f9fe132e800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:45:48.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.439+0000 7f9fe132e800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:45:48.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.439+0000 7f9fe132e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T00:45:48.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.439+0000 7f9eaffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725897 cookie 94475839224480 notifier 5528 bl.length()=187 2024-09-12T00:45:48.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.439+0000 7f9eaffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:45:48.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.439+0000 7f9eaffff640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:45:48.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.442+0000 7f9fe132e800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:45:48.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.442+0000 7f9fe132e800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:45:48.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.442+0000 7f9fe132e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T00:45:48.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.442+0000 7f9eaffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725898 cookie 94475839224480 notifier 5528 bl.length()=197 2024-09-12T00:45:48.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.442+0000 7f9eaffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:45:48.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.442+0000 7f9eaffff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:45:48.442 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:45:48.442 INFO:tasks.workunit.client.0.smithi062.stdout: "user_id": "ceph-test-maven", 2024-09-12T00:45:48.442 INFO:tasks.workunit.client.0.smithi062.stdout: "display_name": "maven test user", 2024-09-12T00:45:48.442 INFO:tasks.workunit.client.0.smithi062.stdout: "email": "sigv4@example.com", 2024-09-12T00:45:48.442 INFO:tasks.workunit.client.0.smithi062.stdout: "suspended": 0, 2024-09-12T00:45:48.442 INFO:tasks.workunit.client.0.smithi062.stdout: "max_buckets": 1000, 2024-09-12T00:45:48.442 INFO:tasks.workunit.client.0.smithi062.stdout: "subusers": [], 2024-09-12T00:45:48.442 INFO:tasks.workunit.client.0.smithi062.stdout: "keys": [ 2024-09-12T00:45:48.442 INFO:tasks.workunit.client.0.smithi062.stdout: { 2024-09-12T00:45:48.443 INFO:tasks.workunit.client.0.smithi062.stdout: "user": "ceph-test-maven", 2024-09-12T00:45:48.443 INFO:tasks.workunit.client.0.smithi062.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T00:45:48.443 INFO:tasks.workunit.client.0.smithi062.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T00:45:48.443 INFO:tasks.workunit.client.0.smithi062.stdout: "active": true, 2024-09-12T00:45:48.443 INFO:tasks.workunit.client.0.smithi062.stdout: "create_date": "2024-09-12T00:45:48.435479Z" 2024-09-12T00:45:48.443 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:45:48.443 INFO:tasks.workunit.client.0.smithi062.stdout: ], 2024-09-12T00:45:48.443 INFO:tasks.workunit.client.0.smithi062.stdout: "swift_keys": [], 2024-09-12T00:45:48.443 INFO:tasks.workunit.client.0.smithi062.stdout: "caps": [], 2024-09-12T00:45:48.443 INFO:tasks.workunit.client.0.smithi062.stdout: "op_mask": "read, write, delete", 2024-09-12T00:45:48.443 INFO:tasks.workunit.client.0.smithi062.stdout: "default_placement": "", 2024-09-12T00:45:48.443 INFO:tasks.workunit.client.0.smithi062.stdout: "default_storage_class": "", 2024-09-12T00:45:48.443 INFO:tasks.workunit.client.0.smithi062.stdout: "placement_tags": [], 2024-09-12T00:45:48.443 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_quota": { 2024-09-12T00:45:48.444 INFO:tasks.workunit.client.0.smithi062.stdout: "enabled": false, 2024-09-12T00:45:48.444 INFO:tasks.workunit.client.0.smithi062.stdout: "check_on_raw": false, 2024-09-12T00:45:48.444 INFO:tasks.workunit.client.0.smithi062.stdout: "max_size": -1, 2024-09-12T00:45:48.444 INFO:tasks.workunit.client.0.smithi062.stdout: "max_size_kb": 0, 2024-09-12T00:45:48.444 INFO:tasks.workunit.client.0.smithi062.stdout: "max_objects": -1 2024-09-12T00:45:48.444 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:45:48.444 INFO:tasks.workunit.client.0.smithi062.stdout: "user_quota": { 2024-09-12T00:45:48.444 INFO:tasks.workunit.client.0.smithi062.stdout: "enabled": false, 2024-09-12T00:45:48.444 INFO:tasks.workunit.client.0.smithi062.stdout: "check_on_raw": false, 2024-09-12T00:45:48.444 INFO:tasks.workunit.client.0.smithi062.stdout: "max_size": -1, 2024-09-12T00:45:48.444 INFO:tasks.workunit.client.0.smithi062.stdout: "max_size_kb": 0, 2024-09-12T00:45:48.444 INFO:tasks.workunit.client.0.smithi062.stdout: "max_objects": -1 2024-09-12T00:45:48.445 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:45:48.445 INFO:tasks.workunit.client.0.smithi062.stdout: "temp_url_keys": [], 2024-09-12T00:45:48.445 INFO:tasks.workunit.client.0.smithi062.stdout: "type": "rgw", 2024-09-12T00:45:48.445 INFO:tasks.workunit.client.0.smithi062.stdout: "mfa_ids": [], 2024-09-12T00:45:48.445 INFO:tasks.workunit.client.0.smithi062.stdout: "account_id": "", 2024-09-12T00:45:48.445 INFO:tasks.workunit.client.0.smithi062.stdout: "path": "/", 2024-09-12T00:45:48.445 INFO:tasks.workunit.client.0.smithi062.stdout: "create_date": "2024-09-12T00:45:48.435468Z", 2024-09-12T00:45:48.445 INFO:tasks.workunit.client.0.smithi062.stdout: "tags": [], 2024-09-12T00:45:48.445 INFO:tasks.workunit.client.0.smithi062.stdout: "group_ids": [] 2024-09-12T00:45:48.445 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:45:48.445 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:45:48.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.444+0000 7f9e937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:48.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.447+0000 7f9fe132e800 20 remove_watcher() i=0 2024-09-12T00:45:48.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.447+0000 7f9fe132e800 2 removed watcher, disabling cache 2024-09-12T00:45:48.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.448+0000 7f9fe132e800 20 remove_watcher() i=1 2024-09-12T00:45:48.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.449+0000 7f9fe132e800 20 remove_watcher() i=2 2024-09-12T00:45:48.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.450+0000 7f9fe132e800 20 remove_watcher() i=3 2024-09-12T00:45:48.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.451+0000 7f9fe132e800 20 remove_watcher() i=4 2024-09-12T00:45:48.451 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.452+0000 7f9fe132e800 20 remove_watcher() i=5 2024-09-12T00:45:48.452 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.453+0000 7f9fe132e800 20 remove_watcher() i=6 2024-09-12T00:45:48.453 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:45:48.454+0000 7f9fe132e800 20 remove_watcher() i=7 2024-09-12T00:45:48.464 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z ']' 2024-09-12T00:45:48.464 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-12T00:45:48.465 INFO:tasks.workunit.client.0.smithi062.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-12T00:45:48.466 INFO:tasks.workunit.client.0.smithi062.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi062.front.sepia.ceph.com:80 2024-09-12T00:45:48.466 INFO:tasks.workunit.client.0.smithi062.stderr:+ RGW_HTTP_ENDPOINT_URL=http://smithi062.front.sepia.ceph.com:80 2024-09-12T00:45:48.466 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-12T00:45:48.466 INFO:tasks.workunit.client.0.smithi062.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T00:45:48.466 INFO:tasks.workunit.client.0.smithi062.stderr:+ ./mvnw clean package 2024-09-12T00:45:48.488 INFO:tasks.workunit.client.0.smithi062.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:45:50.072 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Scanning for projects... 2024-09-12T00:45:50.193 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T00:45:50.275 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 66 kB/s) 2024-09-12T00:45:50.286 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T00:45:50.328 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 63/83 kB Progress (1): 79/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.0 MB/s) 2024-09-12T00:45:50.336 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T00:45:50.356 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 62/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.8 MB/s) 2024-09-12T00:45:50.385 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:45:50.385 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:45:50.385 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:45:50.385 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] from pom.xml 2024-09-12T00:45:50.385 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:45:50.388 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T00:45:50.404 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-12T00:45:50.411 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T00:45:50.428 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-12T00:45:50.431 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T00:45:50.448 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-09-12T00:45:50.453 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T00:45:50.470 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.2 MB/s) 2024-09-12T00:45:50.481 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T00:45:50.498 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.1 MB/s) 2024-09-12T00:45:50.505 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T00:45:50.520 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 544 kB/s) 2024-09-12T00:45:50.523 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T00:45:50.538 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-12T00:45:50.540 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T00:45:50.557 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.8 MB/s) 2024-09-12T00:45:50.561 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T00:45:50.576 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.3 MB/s) 2024-09-12T00:45:50.582 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T00:45:50.597 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 2.1 MB/s) 2024-09-12T00:45:50.602 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T00:45:50.618 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 613 kB/s) 2024-09-12T00:45:50.623 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T00:45:50.640 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/66 kB Progress (1): 32/66 kB Progress (1): 49/66 kB Progress (1): 65/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 4.1 MB/s) 2024-09-12T00:45:50.649 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T00:45:50.666 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 313 kB/s) 2024-09-12T00:45:50.669 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T00:45:50.688 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.4 MB/s) 2024-09-12T00:45:50.690 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T00:45:50.707 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/50 kB Progress (1): 32/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.9 MB/s) 2024-09-12T00:45:50.713 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T00:45:50.729 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-09-12T00:45:50.737 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T00:45:50.753 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-12T00:45:50.758 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T00:45:50.774 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.6 MB/s) 2024-09-12T00:45:50.788 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T00:45:50.803 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 398 kB/s) 2024-09-12T00:45:50.807 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T00:45:50.822 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 660 kB/s) 2024-09-12T00:45:50.825 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T00:45:50.841 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-09-12T00:45:50.846 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T00:45:50.861 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.3 MB/s) 2024-09-12T00:45:50.868 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T00:45:50.885 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.5 MB/s) 2024-09-12T00:45:50.904 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T00:45:50.920 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 380 kB/s) 2024-09-12T00:45:50.922 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T00:45:50.938 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.3 MB/s) 2024-09-12T00:45:50.944 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T00:45:50.961 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-12T00:45:50.972 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T00:45:50.988 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 250 kB/s) 2024-09-12T00:45:50.991 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T00:45:51.007 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 97 kB/s) 2024-09-12T00:45:51.009 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T00:45:51.026 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 131 kB/s) 2024-09-12T00:45:51.032 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T00:45:51.048 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 227 kB/s) 2024-09-12T00:45:51.055 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T00:45:51.072 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 190 kB/s) 2024-09-12T00:45:51.078 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T00:45:51.094 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 685 kB/s) 2024-09-12T00:45:51.099 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T00:45:51.115 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 105 kB/s) 2024-09-12T00:45:51.120 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T00:45:51.136 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 239 kB/s) 2024-09-12T00:45:51.140 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T00:45:51.156 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 289 kB/s) 2024-09-12T00:45:51.161 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T00:45:51.176 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 77 kB/s) 2024-09-12T00:45:51.180 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T00:45:51.195 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 256 kB/s) 2024-09-12T00:45:51.197 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T00:45:51.212 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 863 kB/s) 2024-09-12T00:45:51.217 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T00:45:51.231 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 245 kB/s) 2024-09-12T00:45:51.236 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T00:45:51.252 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 153 kB/s) 2024-09-12T00:45:51.257 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T00:45:51.273 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 182 kB/s) 2024-09-12T00:45:51.278 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T00:45:51.293 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-12T00:45:51.297 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T00:45:51.313 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 341 kB/s) 2024-09-12T00:45:51.318 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T00:45:51.334 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 218 kB/s) 2024-09-12T00:45:51.338 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T00:45:51.354 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 275 kB/s) 2024-09-12T00:45:51.356 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T00:45:51.372 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 150 kB/s) 2024-09-12T00:45:51.375 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T00:45:51.391 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 402 kB/s) 2024-09-12T00:45:51.395 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T00:45:51.410 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 404 kB/s) 2024-09-12T00:45:51.413 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T00:45:51.432 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 157 kB/s) 2024-09-12T00:45:51.436 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T00:45:51.451 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 232 kB/s) 2024-09-12T00:45:51.455 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T00:45:51.471 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 255 kB/s) 2024-09-12T00:45:51.472 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T00:45:51.487 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 118 kB/s) 2024-09-12T00:45:51.491 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T00:45:51.506 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 441 kB/s) 2024-09-12T00:45:51.508 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T00:45:51.523 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.1 MB/s) 2024-09-12T00:45:51.525 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T00:45:51.540 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.3 MB/s) 2024-09-12T00:45:51.543 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T00:45:51.557 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-12T00:45:51.561 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T00:45:51.576 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 331 kB/s) 2024-09-12T00:45:51.578 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T00:45:51.593 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 878 kB/s) 2024-09-12T00:45:51.597 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T00:45:51.612 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 873 kB/s) 2024-09-12T00:45:51.615 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T00:45:51.632 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/68 kB Progress (1): 32/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.8 MB/s) 2024-09-12T00:45:51.638 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T00:45:51.653 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 979 kB/s) 2024-09-12T00:45:51.658 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T00:45:51.673 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.0 MB/s) 2024-09-12T00:45:51.675 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T00:45:51.691 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 37/79 kB Progress (1): 53/79 kB Progress (1): 69/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-12T00:45:51.696 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T00:45:51.711 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.2 MB/s) 2024-09-12T00:45:51.715 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T00:45:51.731 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.2 MB/s) 2024-09-12T00:45:51.733 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T00:45:51.750 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.6 MB/s) 2024-09-12T00:45:51.757 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T00:45:51.772 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 240 kB/s) 2024-09-12T00:45:51.774 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T00:45:51.789 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 920 kB/s) 2024-09-12T00:45:51.792 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T00:45:51.807 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 200 kB/s) 2024-09-12T00:45:51.810 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T00:45:51.824 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 212 kB/s) 2024-09-12T00:45:51.826 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T00:45:51.841 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 145 kB/s) 2024-09-12T00:45:51.843 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T00:45:51.857 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 202 kB/s) 2024-09-12T00:45:51.859 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T00:45:51.874 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 102 kB/s) 2024-09-12T00:45:51.876 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T00:45:51.891 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 188 kB/s) 2024-09-12T00:45:51.894 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T00:45:51.909 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T00:45:51.910 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T00:45:51.925 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-12T00:45:51.927 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T00:45:51.943 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 68 kB/s) 2024-09-12T00:45:51.946 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T00:45:51.960 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 64 kB/s) 2024-09-12T00:45:51.963 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T00:45:51.978 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 203 kB/s) 2024-09-12T00:45:51.980 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T00:45:51.996 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 178 kB/s) 2024-09-12T00:45:51.999 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T00:45:52.015 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 215 kB/s) 2024-09-12T00:45:52.017 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T00:45:52.031 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 245 kB/s) 2024-09-12T00:45:52.033 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T00:45:52.049 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 189 kB/s) 2024-09-12T00:45:52.066 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T00:45:52.151 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 39 MB/s) 2024-09-12T00:45:52.152 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T00:45:52.152 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T00:45:52.153 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T00:45:52.153 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T00:45:52.153 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T00:45:52.172 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/98 kB Progress (1): 33/98 kB Progress (1): 49/98 kB Progress (1): 62/98 kB Progress (1): 78/98 kB Progress (1): 95/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 4.7 MB/s) 2024-09-12T00:45:52.172 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T00:45:52.188 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 458 kB/s) 2024-09-12T00:45:52.188 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T00:45:52.207 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.4/16 kB Progress (2): 1.4/16 kB | 1.4/71 kB Progress (2): 2.8/16 kB | 1.4/71 kB Progress (2): 2.8/16 kB | 2.8/71 kB Progress (3): 2.8/16 kB | 2.8/71 kB | 1.4/35 kB Progress (3): 2.8/16 kB | 4.1/71 kB | 1.4/35 kB Progress (3): 4.1/16 kB | 4.1/71 kB | 1.4/35 kB Progress (3): 4.1/16 kB | 4.1/71 kB | 2.8/35 kB Progress (3): 4.1/16 kB | 5.5/71 kB | 2.8/35 kB Progress (3): 4.1/16 kB | 5.5/71 kB | 4.1/35 kB Progress (4): 4.1/16 kB | 5.5/71 kB | 4.1/35 kB | 1.4/49 kB Progress (4): 5.5/16 kB | 5.5/71 kB | 4.1/35 kB | 1.4/49 kB Progress (4): 5.5/16 kB | 5.5/71 kB | 5.5/35 kB | 1.4/49 kB Progress (4): 5.5/16 kB | 6.9/71 kB | 5.5/35 kB | 1.4/49 kB Progress (4): 6.9/16 kB | 6.9/71 kB | 5.5/35 kB | 1.4/49 kB Progress (4): 6.9/16 kB | 6.9/71 kB | 5.5/35 kB | 2.8/49 kB Progress (4): 8.3/16 kB | 6.9/71 kB | 5.5/35 kB | 2.8/49 kB Progress (4): 8.3/16 kB | 8.3/71 kB | 5.5/35 kB | 2.8/49 kB Progress (4): 8.3/16 kB | 8.3/71 kB | 6.9/35 kB | 2.8/49 kB Progress (4): 8.3/16 kB | 9.7/71 kB | 6.9/35 kB | 2.8/49 kB Progress (4): 8.3/16 kB | 9.7/71 kB | 8.3/35 kB | 2.8/49 kB Progress (4): 8.3/16 kB | 9.7/71 kB | 8.3/35 kB | 4.1/49 kB Progress (4): 9.7/16 kB | 9.7/71 kB | 8.3/35 kB | 4.1/49 kB Progress (4): 9.7/16 kB | 9.7/71 kB | 8.3/35 kB | 5.5/49 kB Progress (4): 11/16 kB | 9.7/71 kB | 8.3/35 kB | 5.5/49 kB Progress (4): 11/16 kB | 9.7/71 kB | 9.7/35 kB | 5.5/49 kB Progress (4): 11/16 kB | 11/71 kB | 9.7/35 kB | 5.5/49 kB Progress (4): 11/16 kB | 11/71 kB | 11/35 kB | 5.5/49 kB Progress (4): 12/16 kB | 11/71 kB | 11/35 kB | 5.5/49 kB Progress (4): 12/16 kB | 11/71 kB | 11/35 kB | 6.9/49 kB Progress (4): 14/16 kB | 11/71 kB | 11/35 kB | 6.9/49 kB Progress (4): 14/16 kB | 11/71 kB | 12/35 kB | 6.9/49 kB Progress (4): 15/16 kB | 11/71 kB | 12/35 kB | 6.9/49 kB Progress (4): 15/16 kB | 12/71 kB | 12/35 kB | 6.9/49 kB Progress (4): 16 kB | 12/71 kB | 12/35 kB | 6.9/49 kB Progress (4): 16 kB | 12/71 kB | 14/35 kB | 6.9/49 kB Progress (4): 16 kB | 12/71 kB | 14/35 kB | 8.3/49 kB Progress (4): 16 kB | 12/71 kB | 15/35 kB | 8.3/49 kB Progress (4): 16 kB | 14/71 kB | 15/35 kB | 8.3/49 kB Progress (4): 16 kB | 14/71 kB | 17/35 kB | 8.3/49 kB Progress (4): 16 kB | 15/71 kB | 17/35 kB | 8.3/49 kB Progress (4): 16 kB | 15/71 kB | 17/35 kB | 9.7/49 kB Progress (4): 16 kB | 16/71 kB | 17/35 kB | 9.7/49 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 316 kB/s) 2024-09-12T00:45:52.207 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (3): 16/71 kB | 18/35 kB | 9.7/49 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T00:45:52.217 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (3): 18/71 kB | 18/35 kB | 9.7/49 kB Progress (3): 18/71 kB | 18/35 kB | 11/49 kB Progress (3): 19/71 kB | 18/35 kB | 11/49 kB Progress (4): 19/71 kB | 18/35 kB | 11/49 kB | 16/782 kB Progress (4): 19/71 kB | 18/35 kB | 12/49 kB | 16/782 kB Progress (4): 19/71 kB | 19/35 kB | 12/49 kB | 16/782 kB Progress (4): 19/71 kB | 19/35 kB | 14/49 kB | 16/782 kB Progress (4): 21/71 kB | 19/35 kB | 14/49 kB | 16/782 kB Progress (4): 21/71 kB | 19/35 kB | 15/49 kB | 16/782 kB Progress (4): 21/71 kB | 19/35 kB | 15/49 kB | 33/782 kB Progress (4): 21/71 kB | 21/35 kB | 15/49 kB | 33/782 kB Progress (4): 21/71 kB | 21/35 kB | 17/49 kB | 33/782 kB Progress (4): 21/71 kB | 22/35 kB | 17/49 kB | 33/782 kB Progress (4): 22/71 kB | 22/35 kB | 17/49 kB | 33/782 kB Progress (4): 22/71 kB | 22/35 kB | 18/49 kB | 33/782 kB Progress (4): 23/71 kB | 22/35 kB | 18/49 kB | 33/782 kB Progress (4): 23/71 kB | 23/35 kB | 18/49 kB | 33/782 kB Progress (4): 23/71 kB | 23/35 kB | 18/49 kB | 49/782 kB Progress (4): 23/71 kB | 25/35 kB | 18/49 kB | 49/782 kB Progress (4): 25/71 kB | 25/35 kB | 18/49 kB | 49/782 kB Progress (4): 25/71 kB | 25/35 kB | 19/49 kB | 49/782 kB Progress (4): 26/71 kB | 25/35 kB | 19/49 kB | 49/782 kB Progress (4): 26/71 kB | 26/35 kB | 19/49 kB | 49/782 kB Progress (4): 26/71 kB | 26/35 kB | 19/49 kB | 65/782 kB Progress (4): 27/71 kB | 26/35 kB | 19/49 kB | 65/782 kB Progress (4): 27/71 kB | 26/35 kB | 21/49 kB | 65/782 kB Progress (4): 29/71 kB | 26/35 kB | 21/49 kB | 65/782 kB Progress (4): 29/71 kB | 28/35 kB | 21/49 kB | 65/782 kB Progress (4): 30/71 kB | 28/35 kB | 21/49 kB | 65/782 kB Progress (4): 30/71 kB | 28/35 kB | 22/49 kB | 65/782 kB Progress (4): 30/71 kB | 29/35 kB | 22/49 kB | 65/782 kB Progress (4): 30/71 kB | 29/35 kB | 23/49 kB | 65/782 kB Progress (4): 30/71 kB | 29/35 kB | 23/49 kB | 81/782 kB Progress (4): 30/71 kB | 29/35 kB | 25/49 kB | 81/782 kB Progress (4): 30/71 kB | 30/35 kB | 25/49 kB | 81/782 kB Progress (4): 30/71 kB | 30/35 kB | 26/49 kB | 81/782 kB Progress (4): 30/71 kB | 30/35 kB | 28/49 kB | 81/782 kB Progress (4): 30/71 kB | 30/35 kB | 29/49 kB | 81/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 81/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 98/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 114/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 130/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 147/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 163/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 180/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 196/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 212/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 229/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 245/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 262/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 278/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 294/782 kB Progress (4): 30/71 kB | 30/35 kB | 30/49 kB | 311/782 kB Progress (4): 32/71 kB | 30/35 kB | 30/49 kB | 311/782 kB Progress (4): 33/71 kB | 30/35 kB | 30/49 kB | 311/782 kB Progress (4): 33/71 kB | 32/35 kB | 30/49 kB | 311/782 kB Progress (4): 34/71 kB | 32/35 kB | 30/49 kB | 311/782 kB Progress (4): 34/71 kB | 33/35 kB | 30/49 kB | 311/782 kB Progress (4): 34/71 kB | 33/35 kB | 30/49 kB | 327/782 kB Progress (4): 36/71 kB | 33/35 kB | 30/49 kB | 327/782 kB Progress (4): 36/71 kB | 34/35 kB | 30/49 kB | 327/782 kB Progress (4): 37/71 kB | 34/35 kB | 30/49 kB | 327/782 kB Progress (4): 37/71 kB | 34/35 kB | 32/49 kB | 327/782 kB Progress (4): 38/71 kB | 34/35 kB | 32/49 kB | 327/782 kB Progress (4): 38/71 kB | 34/35 kB | 33/49 kB | 327/782 kB Progress (4): 38/71 kB | 35 kB | 33/49 kB | 327/782 kB Progress (4): 38/71 kB | 35 kB | 34/49 kB | 327/782 kB Progress (4): 40/71 kB | 35 kB | 34/49 kB | 327/782 kB Progress (4): 40/71 kB | 35 kB | 34/49 kB | 343/782 kB Progress (4): 41/71 kB | 35 kB | 34/49 kB | 343/782 kB Progress (4): 41/71 kB | 35 kB | 36/49 kB | 343/782 kB Progress (4): 43/71 kB | 35 kB | 36/49 kB | 343/782 kB Progress (4): 43/71 kB | 35 kB | 37/49 kB | 343/782 kB Progress (4): 43/71 kB | 35 kB | 39/49 kB | 343/782 kB Progress (4): 43/71 kB | 35 kB | 39/49 kB | 360/782 kB Progress (4): 43/71 kB | 35 kB | 40/49 kB | 360/782 kB Progress (4): 43/71 kB | 35 kB | 41/49 kB | 360/782 kB Progress (4): 43/71 kB | 35 kB | 43/49 kB | 360/782 kB Progress (4): 43/71 kB | 35 kB | 44/49 kB | 360/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 567 kB/s) 2024-09-12T00:45:52.217 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (3): 43/71 kB | 44/49 kB | 376/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T00:45:52.217 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (3): 44/71 kB | 44/49 kB | 376/782 kB Progress (3): 45/71 kB | 44/49 kB | 376/782 kB Progress (3): 47/71 kB | 44/49 kB | 376/782 kB Progress (3): 47/71 kB | 46/49 kB | 376/782 kB Progress (3): 48/71 kB | 46/49 kB | 376/782 kB Progress (3): 48/71 kB | 46/49 kB | 393/782 kB Progress (3): 48/71 kB | 47/49 kB | 393/782 kB Progress (3): 49/71 kB | 47/49 kB | 393/782 kB Progress (3): 49/71 kB | 48/49 kB | 393/782 kB Progress (3): 51/71 kB | 48/49 kB | 393/782 kB Progress (3): 51/71 kB | 49 kB | 393/782 kB Progress (3): 51/71 kB | 49 kB | 409/782 kB Progress (3): 52/71 kB | 49 kB | 409/782 kB Progress (3): 54/71 kB | 49 kB | 409/782 kB Progress (3): 55/71 kB | 49 kB | 409/782 kB Progress (3): 55/71 kB | 49 kB | 425/782 kB Progress (3): 56/71 kB | 49 kB | 425/782 kB Progress (3): 58/71 kB | 49 kB | 425/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 794 kB/s) 2024-09-12T00:45:52.217 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T00:45:52.220 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 58/71 kB | 442/782 kB Progress (2): 59/71 kB | 442/782 kB Progress (2): 61/71 kB | 442/782 kB Progress (2): 62/71 kB | 442/782 kB Progress (2): 62/71 kB | 458/782 kB Progress (2): 62/71 kB | 458/782 kB Progress (2): 62/71 kB | 475/782 kB Progress (2): 62/71 kB | 491/782 kB Progress (2): 62/71 kB | 507/782 kB Progress (3): 62/71 kB | 507/782 kB | 1.4/11 kB Progress (3): 62/71 kB | 524/782 kB | 1.4/11 kB Progress (3): 62/71 kB | 524/782 kB | 2.8/11 kB Progress (3): 62/71 kB | 524/782 kB | 4.1/11 kB Progress (3): 62/71 kB | 540/782 kB | 4.1/11 kB Progress (3): 62/71 kB | 540/782 kB | 5.5/11 kB Progress (3): 62/71 kB | 540/782 kB | 6.9/11 kB Progress (3): 62/71 kB | 556/782 kB | 6.9/11 kB Progress (3): 62/71 kB | 556/782 kB | 8.3/11 kB Progress (3): 62/71 kB | 556/782 kB | 9.7/11 kB Progress (3): 62/71 kB | 573/782 kB | 9.7/11 kB Progress (3): 62/71 kB | 589/782 kB | 9.7/11 kB Progress (3): 62/71 kB | 589/782 kB | 11/11 kB Progress (3): 62/71 kB | 589/782 kB | 11 kB Progress (3): 62/71 kB | 606/782 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 170 kB/s) 2024-09-12T00:45:52.220 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 62/71 kB | 622/782 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T00:45:52.224 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 62/71 kB | 638/782 kB Progress (2): 62/71 kB | 655/782 kB Progress (2): 62/71 kB | 671/782 kB Progress (2): 62/71 kB | 688/782 kB Progress (2): 62/71 kB | 704/782 kB Progress (2): 62/71 kB | 720/782 kB Progress (2): 62/71 kB | 737/782 kB Progress (2): 62/71 kB | 753/782 kB Progress (2): 62/71 kB | 769/782 kB Progress (2): 62/71 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 11 MB/s) 2024-09-12T00:45:52.225 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T00:45:52.226 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 953 kB/s) 2024-09-12T00:45:52.226 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T00:45:52.233 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.4/205 kB Progress (1): 2.8/205 kB Progress (1): 4.1/205 kB Progress (1): 5.5/205 kB Progress (1): 6.9/205 kB Progress (1): 8.3/205 kB Progress (1): 9.7/205 kB Progress (1): 11/205 kB Progress (1): 12/205 kB Progress (1): 14/205 kB Progress (1): 15/205 kB Progress (1): 16/205 kB Progress (2): 16/205 kB | 16/30 kB Progress (2): 33/205 kB | 16/30 kB Progress (2): 33/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 377 kB/s) 2024-09-12T00:45:52.233 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T00:45:52.241 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 33/205 kB | 1.4/81 kB Progress (2): 33/205 kB | 2.8/81 kB Progress (2): 33/205 kB | 4.1/81 kB Progress (2): 33/205 kB | 5.5/81 kB Progress (2): 33/205 kB | 6.9/81 kB Progress (2): 33/205 kB | 8.3/81 kB Progress (2): 33/205 kB | 9.7/81 kB Progress (2): 33/205 kB | 11/81 kB Progress (2): 33/205 kB | 12/81 kB Progress (2): 33/205 kB | 14/81 kB Progress (2): 33/205 kB | 15/81 kB Progress (2): 33/205 kB | 17/81 kB Progress (2): 33/205 kB | 18/81 kB Progress (2): 33/205 kB | 19/81 kB Progress (2): 33/205 kB | 21/81 kB Progress (2): 33/205 kB | 22/81 kB Progress (2): 33/205 kB | 23/81 kB Progress (2): 33/205 kB | 25/81 kB Progress (2): 33/205 kB | 26/81 kB Progress (2): 33/205 kB | 28/81 kB Progress (2): 33/205 kB | 29/81 kB Progress (2): 33/205 kB | 30/81 kB Progress (3): 33/205 kB | 30/81 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 154 kB/s) 2024-09-12T00:45:52.241 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (3): 33/205 kB | 30/81 kB | 16/798 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T00:45:52.253 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (3): 49/205 kB | 30/81 kB | 16/798 kB Progress (3): 49/205 kB | 30/81 kB | 33/798 kB Progress (3): 64/205 kB | 30/81 kB | 33/798 kB Progress (3): 64/205 kB | 30/81 kB | 49/798 kB Progress (3): 80/205 kB | 30/81 kB | 49/798 kB Progress (3): 80/205 kB | 30/81 kB | 66/798 kB Progress (3): 97/205 kB | 30/81 kB | 66/798 kB Progress (3): 113/205 kB | 30/81 kB | 66/798 kB Progress (3): 130/205 kB | 30/81 kB | 66/798 kB Progress (3): 130/205 kB | 32/81 kB | 66/798 kB Progress (3): 130/205 kB | 33/81 kB | 66/798 kB Progress (3): 146/205 kB | 33/81 kB | 66/798 kB Progress (3): 146/205 kB | 49/81 kB | 66/798 kB Progress (4): 146/205 kB | 49/81 kB | 66/798 kB | 16/182 kB Progress (4): 146/205 kB | 66/81 kB | 66/798 kB | 16/182 kB Progress (4): 146/205 kB | 66/81 kB | 66/798 kB | 33/182 kB Progress (4): 146/205 kB | 66/81 kB | 82/798 kB | 33/182 kB Progress (4): 146/205 kB | 81/81 kB | 82/798 kB | 33/182 kB Progress (4): 146/205 kB | 81 kB | 82/798 kB | 33/182 kB Progress (4): 146/205 kB | 81 kB | 97/798 kB | 33/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 821 kB/s) 2024-09-12T00:45:52.253 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T00:45:52.256 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (3): 146/205 kB | 97/798 kB | 49/182 kB Progress (3): 146/205 kB | 114/798 kB | 49/182 kB Progress (3): 162/205 kB | 114/798 kB | 49/182 kB Progress (3): 162/205 kB | 114/798 kB | 62/182 kB Progress (3): 162/205 kB | 130/798 kB | 62/182 kB Progress (3): 179/205 kB | 130/798 kB | 62/182 kB Progress (3): 195/205 kB | 130/798 kB | 62/182 kB Progress (4): 195/205 kB | 130/798 kB | 62/182 kB | 16/151 kB Progress (4): 205 kB | 130/798 kB | 62/182 kB | 16/151 kB Progress (4): 205 kB | 146/798 kB | 62/182 kB | 16/151 kB Progress (4): 205 kB | 146/798 kB | 62/182 kB | 33/151 kB Progress (4): 205 kB | 146/798 kB | 62/182 kB | 49/151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.0 MB/s) 2024-09-12T00:45:52.257 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T00:45:52.258 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (3): 146/798 kB | 62/182 kB | 63/151 kB Progress (3): 146/798 kB | 62/182 kB | 79/151 kB Progress (3): 163/798 kB | 62/182 kB | 79/151 kB Progress (3): 163/798 kB | 62/182 kB | 96/151 kB Progress (3): 163/798 kB | 62/182 kB | 112/151 kB Progress (3): 163/798 kB | 62/182 kB | 128/151 kB Progress (3): 163/798 kB | 62/182 kB | 145/151 kB Progress (3): 179/798 kB | 62/182 kB | 145/151 kB Progress (3): 179/798 kB | 62/182 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.5 MB/s) 2024-09-12T00:45:52.258 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T00:45:52.269 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 195/798 kB | 62/182 kB Progress (2): 195/798 kB | 78/182 kB Progress (2): 195/798 kB | 95/182 kB Progress (2): 195/798 kB | 111/182 kB Progress (2): 212/798 kB | 111/182 kB Progress (2): 228/798 kB | 111/182 kB Progress (2): 228/798 kB | 128/182 kB Progress (2): 245/798 kB | 128/182 kB Progress (2): 261/798 kB | 128/182 kB Progress (2): 261/798 kB | 144/182 kB Progress (2): 261/798 kB | 160/182 kB Progress (2): 277/798 kB | 160/182 kB Progress (2): 294/798 kB | 160/182 kB Progress (2): 294/798 kB | 177/182 kB Progress (2): 294/798 kB | 182 kB Progress (2): 310/798 kB | 182 kB Progress (3): 310/798 kB | 182 kB | 16/27 kB Progress (3): 327/798 kB | 182 kB | 16/27 kB Progress (3): 327/798 kB | 182 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.6 MB/s) 2024-09-12T00:45:52.269 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T00:45:52.269 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 343/798 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 239 kB/s) 2024-09-12T00:45:52.269 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T00:45:52.272 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 359/798 kB Progress (1): 376/798 kB Progress (1): 392/798 kB Progress (1): 408/798 kB Progress (1): 425/798 kB Progress (2): 425/798 kB | 16/30 kB Progress (2): 441/798 kB | 16/30 kB Progress (2): 441/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 257 kB/s) 2024-09-12T00:45:52.272 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T00:45:52.279 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 441/798 kB | 16/385 kB Progress (2): 441/798 kB | 33/385 kB Progress (2): 441/798 kB | 49/385 kB Progress (2): 441/798 kB | 66/385 kB Progress (2): 441/798 kB | 82/385 kB Progress (2): 441/798 kB | 96/385 kB Progress (2): 441/798 kB | 113/385 kB Progress (2): 441/798 kB | 129/385 kB Progress (2): 441/798 kB | 145/385 kB Progress (2): 441/798 kB | 162/385 kB Progress (2): 441/798 kB | 178/385 kB Progress (2): 441/798 kB | 195/385 kB Progress (2): 458/798 kB | 195/385 kB Progress (2): 458/798 kB | 211/385 kB Progress (2): 474/798 kB | 211/385 kB Progress (2): 474/798 kB | 227/385 kB Progress (2): 490/798 kB | 227/385 kB Progress (2): 490/798 kB | 244/385 kB Progress (2): 507/798 kB | 244/385 kB Progress (2): 507/798 kB | 260/385 kB Progress (2): 507/798 kB | 277/385 kB Progress (2): 523/798 kB | 277/385 kB Progress (2): 523/798 kB | 293/385 kB Progress (2): 540/798 kB | 293/385 kB Progress (2): 540/798 kB | 309/385 kB Progress (2): 556/798 kB | 309/385 kB Progress (2): 556/798 kB | 326/385 kB Progress (2): 572/798 kB | 326/385 kB Progress (2): 572/798 kB | 342/385 kB Progress (2): 572/798 kB | 358/385 kB Progress (2): 572/798 kB | 375/385 kB Progress (2): 572/798 kB | 385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.1 MB/s) 2024-09-12T00:45:52.280 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 589/798 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T00:45:52.285 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 605/798 kB Progress (1): 621/798 kB Progress (1): 638/798 kB Progress (1): 654/798 kB Progress (1): 671/798 kB Progress (1): 687/798 kB Progress (1): 703/798 kB Progress (1): 720/798 kB Progress (1): 736/798 kB Progress (1): 753/798 kB Progress (1): 769/798 kB Progress (1): 785/798 kB Progress (1): 798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.1 MB/s) 2024-09-12T00:45:52.285 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T00:45:52.286 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/75 kB Progress (2): 16/75 kB | 13 kB Progress (2): 33/75 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 101 kB/s) 2024-09-12T00:45:52.286 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T00:45:52.286 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 49/75 kB Progress (1): 66/75 kB Progress (1): 75 kB Progress (2): 75 kB | 16/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 569 kB/s) 2024-09-12T00:45:52.287 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T00:45:52.319 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 33/780 kB Progress (1): 49/780 kB Progress (1): 63/780 kB Progress (1): 79/780 kB Progress (1): 96/780 kB Progress (1): 112/780 kB Progress (1): 128/780 kB Progress (1): 145/780 kB Progress (1): 161/780 kB Progress (1): 178/780 kB Progress (1): 194/780 kB Progress (1): 210/780 kB Progress (1): 227/780 kB Progress (1): 243/780 kB Progress (1): 260/780 kB Progress (2): 260/780 kB | 16/329 kB Progress (2): 260/780 kB | 32/329 kB Progress (2): 260/780 kB | 49/329 kB Progress (2): 260/780 kB | 65/329 kB Progress (2): 260/780 kB | 81/329 kB Progress (2): 260/780 kB | 98/329 kB Progress (2): 276/780 kB | 98/329 kB Progress (2): 276/780 kB | 114/329 kB Progress (2): 292/780 kB | 114/329 kB Progress (3): 292/780 kB | 114/329 kB | 16/501 kB Progress (4): 292/780 kB | 114/329 kB | 16/501 kB | 16/41 kB Progress (5): 292/780 kB | 114/329 kB | 16/501 kB | 16/41 kB | 16/354 kB Progress (5): 292/780 kB | 130/329 kB | 16/501 kB | 16/41 kB | 16/354 kB Progress (5): 309/780 kB | 130/329 kB | 16/501 kB | 16/41 kB | 16/354 kB Progress (5): 309/780 kB | 130/329 kB | 32/501 kB | 16/41 kB | 16/354 kB Progress (5): 309/780 kB | 130/329 kB | 32/501 kB | 33/41 kB | 16/354 kB Progress (5): 309/780 kB | 130/329 kB | 32/501 kB | 33/41 kB | 33/354 kB Progress (5): 309/780 kB | 147/329 kB | 32/501 kB | 33/41 kB | 33/354 kB Progress (5): 325/780 kB | 147/329 kB | 32/501 kB | 33/41 kB | 33/354 kB Progress (5): 325/780 kB | 147/329 kB | 32/501 kB | 41 kB | 33/354 kB Progress (5): 325/780 kB | 147/329 kB | 49/501 kB | 41 kB | 33/354 kB Progress (5): 325/780 kB | 147/329 kB | 49/501 kB | 41 kB | 49/354 kB Progress (5): 325/780 kB | 163/329 kB | 49/501 kB | 41 kB | 49/354 kB Progress (5): 341/780 kB | 163/329 kB | 49/501 kB | 41 kB | 49/354 kB Progress (5): 341/780 kB | 163/329 kB | 65/501 kB | 41 kB | 49/354 kB Progress (5): 341/780 kB | 163/329 kB | 65/501 kB | 41 kB | 66/354 kB Progress (5): 341/780 kB | 180/329 kB | 65/501 kB | 41 kB | 66/354 kB Progress (5): 358/780 kB | 180/329 kB | 65/501 kB | 41 kB | 66/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 259 kB/s) 2024-09-12T00:45:52.319 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (4): 358/780 kB | 180/329 kB | 81/501 kB | 66/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T00:45:52.319 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (4): 358/780 kB | 180/329 kB | 81/501 kB | 82/354 kB Progress (4): 358/780 kB | 196/329 kB | 81/501 kB | 82/354 kB Progress (4): 374/780 kB | 196/329 kB | 81/501 kB | 82/354 kB Progress (4): 374/780 kB | 196/329 kB | 97/501 kB | 82/354 kB Progress (4): 374/780 kB | 196/329 kB | 97/501 kB | 98/354 kB Progress (4): 374/780 kB | 212/329 kB | 97/501 kB | 98/354 kB Progress (4): 391/780 kB | 212/329 kB | 97/501 kB | 98/354 kB Progress (4): 391/780 kB | 212/329 kB | 113/501 kB | 98/354 kB Progress (4): 391/780 kB | 212/329 kB | 113/501 kB | 115/354 kB Progress (4): 391/780 kB | 229/329 kB | 113/501 kB | 115/354 kB Progress (4): 407/780 kB | 229/329 kB | 113/501 kB | 115/354 kB Progress (4): 407/780 kB | 245/329 kB | 113/501 kB | 115/354 kB Progress (4): 407/780 kB | 245/329 kB | 113/501 kB | 131/354 kB Progress (4): 407/780 kB | 262/329 kB | 113/501 kB | 131/354 kB Progress (4): 423/780 kB | 262/329 kB | 113/501 kB | 131/354 kB Progress (4): 423/780 kB | 262/329 kB | 113/501 kB | 147/354 kB Progress (4): 423/780 kB | 278/329 kB | 113/501 kB | 147/354 kB Progress (4): 440/780 kB | 278/329 kB | 113/501 kB | 147/354 kB Progress (4): 440/780 kB | 294/329 kB | 113/501 kB | 147/354 kB Progress (4): 440/780 kB | 294/329 kB | 113/501 kB | 164/354 kB Progress (4): 440/780 kB | 311/329 kB | 113/501 kB | 164/354 kB Progress (4): 456/780 kB | 311/329 kB | 113/501 kB | 164/354 kB Progress (4): 456/780 kB | 311/329 kB | 113/501 kB | 180/354 kB Progress (4): 456/780 kB | 327/329 kB | 113/501 kB | 180/354 kB Progress (4): 456/780 kB | 329 kB | 113/501 kB | 180/354 kB Progress (4): 473/780 kB | 329 kB | 113/501 kB | 180/354 kB Progress (4): 473/780 kB | 329 kB | 113/501 kB | 197/354 kB Progress (4): 489/780 kB | 329 kB | 113/501 kB | 197/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.0 MB/s) 2024-09-12T00:45:52.319 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T00:45:52.322 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (3): 489/780 kB | 113/501 kB | 213/354 kB Progress (3): 505/780 kB | 113/501 kB | 213/354 kB Progress (3): 505/780 kB | 113/501 kB | 229/354 kB Progress (3): 522/780 kB | 113/501 kB | 229/354 kB Progress (3): 522/780 kB | 113/501 kB | 246/354 kB Progress (3): 538/780 kB | 113/501 kB | 246/354 kB Progress (3): 538/780 kB | 113/501 kB | 262/354 kB Progress (3): 554/780 kB | 113/501 kB | 262/354 kB Progress (3): 554/780 kB | 113/501 kB | 279/354 kB Progress (3): 571/780 kB | 113/501 kB | 279/354 kB Progress (3): 571/780 kB | 113/501 kB | 295/354 kB Progress (3): 587/780 kB | 113/501 kB | 295/354 kB Progress (3): 587/780 kB | 113/501 kB | 311/354 kB Progress (3): 604/780 kB | 113/501 kB | 311/354 kB Progress (3): 604/780 kB | 113/501 kB | 328/354 kB Progress (3): 620/780 kB | 113/501 kB | 328/354 kB Progress (3): 620/780 kB | 113/501 kB | 344/354 kB Progress (3): 636/780 kB | 113/501 kB | 344/354 kB Progress (3): 636/780 kB | 113/501 kB | 354 kB Progress (3): 653/780 kB | 113/501 kB | 354 kB Progress (3): 669/780 kB | 113/501 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.1 MB/s) 2024-09-12T00:45:52.322 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T00:45:52.323 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 685/780 kB | 113/501 kB Progress (2): 702/780 kB | 113/501 kB Progress (2): 718/780 kB | 113/501 kB Progress (2): 735/780 kB | 113/501 kB Progress (2): 751/780 kB | 113/501 kB Progress (2): 751/780 kB | 130/501 kB Progress (2): 767/780 kB | 130/501 kB Progress (2): 767/780 kB | 146/501 kB Progress (2): 780 kB | 146/501 kB Progress (2): 780 kB | 163/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.6 MB/s) 2024-09-12T00:45:52.324 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T00:45:52.330 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 179/501 kB Progress (1): 195/501 kB Progress (1): 212/501 kB Progress (1): 228/501 kB Progress (1): 244/501 kB Progress (2): 244/501 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 36 kB/s) 2024-09-12T00:45:52.330 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T00:45:52.340 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 244/501 kB | 16/586 kB Progress (2): 244/501 kB | 33/586 kB Progress (2): 244/501 kB | 49/586 kB Progress (2): 244/501 kB | 66/586 kB Progress (2): 244/501 kB | 82/586 kB Progress (2): 244/501 kB | 98/586 kB Progress (2): 244/501 kB | 115/586 kB Progress (2): 244/501 kB | 131/586 kB Progress (2): 244/501 kB | 147/586 kB Progress (2): 244/501 kB | 164/586 kB Progress (2): 244/501 kB | 180/586 kB Progress (2): 244/501 kB | 197/586 kB Progress (2): 244/501 kB | 213/586 kB Progress (2): 261/501 kB | 213/586 kB Progress (2): 261/501 kB | 229/586 kB Progress (2): 277/501 kB | 229/586 kB Progress (2): 277/501 kB | 246/586 kB Progress (2): 294/501 kB | 246/586 kB Progress (2): 294/501 kB | 262/586 kB Progress (2): 310/501 kB | 262/586 kB Progress (2): 310/501 kB | 279/586 kB Progress (2): 326/501 kB | 279/586 kB Progress (2): 326/501 kB | 295/586 kB Progress (2): 326/501 kB | 311/586 kB Progress (2): 343/501 kB | 311/586 kB Progress (2): 343/501 kB | 328/586 kB Progress (2): 359/501 kB | 328/586 kB Progress (3): 359/501 kB | 328/586 kB | 16/211 kB Progress (3): 359/501 kB | 344/586 kB | 16/211 kB Progress (4): 359/501 kB | 344/586 kB | 16/211 kB | 14 kB Progress (4): 376/501 kB | 344/586 kB | 16/211 kB | 14 kB Progress (4): 376/501 kB | 344/586 kB | 33/211 kB | 14 kB Progress (4): 376/501 kB | 360/586 kB | 33/211 kB | 14 kB Progress (4): 392/501 kB | 360/586 kB | 33/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 78 kB/s) 2024-09-12T00:45:52.340 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (3): 392/501 kB | 377/586 kB | 33/211 kB Progress (3): 392/501 kB | 377/586 kB | 49/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T00:45:52.342 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (3): 408/501 kB | 377/586 kB | 49/211 kB Progress (3): 408/501 kB | 393/586 kB | 49/211 kB Progress (3): 408/501 kB | 393/586 kB | 66/211 kB Progress (3): 425/501 kB | 393/586 kB | 66/211 kB Progress (3): 425/501 kB | 410/586 kB | 66/211 kB Progress (3): 425/501 kB | 410/586 kB | 82/211 kB Progress (3): 441/501 kB | 410/586 kB | 82/211 kB Progress (3): 441/501 kB | 426/586 kB | 82/211 kB Progress (3): 441/501 kB | 426/586 kB | 98/211 kB Progress (3): 457/501 kB | 426/586 kB | 98/211 kB Progress (3): 457/501 kB | 442/586 kB | 98/211 kB Progress (3): 457/501 kB | 442/586 kB | 114/211 kB Progress (3): 474/501 kB | 442/586 kB | 114/211 kB Progress (3): 474/501 kB | 459/586 kB | 114/211 kB Progress (3): 474/501 kB | 459/586 kB | 131/211 kB Progress (3): 490/501 kB | 459/586 kB | 131/211 kB Progress (3): 490/501 kB | 475/586 kB | 131/211 kB Progress (3): 490/501 kB | 475/586 kB | 147/211 kB Progress (3): 501 kB | 475/586 kB | 147/211 kB Progress (3): 501 kB | 492/586 kB | 147/211 kB Progress (3): 501 kB | 492/586 kB | 164/211 kB Progress (3): 501 kB | 508/586 kB | 164/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.7 MB/s) 2024-09-12T00:45:52.342 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 508/586 kB | 180/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T00:45:52.343 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 524/586 kB | 180/211 kB Progress (2): 524/586 kB | 196/211 kB Progress (2): 541/586 kB | 196/211 kB Progress (2): 541/586 kB | 211 kB Progress (2): 557/586 kB | 211 kB Progress (2): 573/586 kB | 211 kB Progress (2): 586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.1 MB/s) 2024-09-12T00:45:52.343 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T00:45:52.343 INFO:tasks.workunit.client.0.smithi062.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.1 MB/s) 2024-09-12T00:45:52.343 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T00:45:52.346 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/106 kB Progress (1): 33/106 kB Progress (1): 49/106 kB Progress (1): 66/106 kB Progress (1): 82/106 kB Progress (1): 98/106 kB Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 559 kB/s) 2024-09-12T00:45:52.346 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:45:52.353 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 35 kB/s) 2024-09-12T00:45:52.353 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T00:45:52.360 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/245 kB Progress (1): 32/245 kB Progress (1): 49/245 kB Progress (2): 49/245 kB | 16/205 kB Progress (2): 65/245 kB | 16/205 kB Progress (2): 65/245 kB | 33/205 kB Progress (3): 65/245 kB | 33/205 kB | 15 kB Progress (3): 81/245 kB | 33/205 kB | 15 kB Progress (3): 81/245 kB | 49/205 kB | 15 kB Progress (3): 98/245 kB | 49/205 kB | 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 75 kB/s) 2024-09-12T00:45:52.360 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 98/245 kB | 65/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T00:45:52.364 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 114/245 kB | 65/205 kB Progress (2): 114/245 kB | 81/205 kB Progress (2): 130/245 kB | 81/205 kB Progress (2): 130/245 kB | 98/205 kB Progress (2): 147/245 kB | 98/205 kB Progress (2): 147/245 kB | 114/205 kB Progress (2): 163/245 kB | 114/205 kB Progress (2): 180/245 kB | 114/205 kB Progress (2): 180/245 kB | 130/205 kB Progress (2): 196/245 kB | 130/205 kB Progress (2): 196/245 kB | 147/205 kB Progress (2): 212/245 kB | 147/205 kB Progress (2): 229/245 kB | 147/205 kB Progress (2): 229/245 kB | 163/205 kB Progress (2): 245 kB | 163/205 kB Progress (2): 245 kB | 180/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.2 MB/s) 2024-09-12T00:45:52.364 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T00:45:52.364 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 180/205 kB | 16/16 kB Progress (2): 196/205 kB | 16/16 kB Progress (2): 196/205 kB | 16 kB Progress (2): 205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 80 kB/s) 2024-09-12T00:45:52.364 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T00:45:52.364 INFO:tasks.workunit.client.0.smithi062.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 989 kB/s) 2024-09-12T00:45:52.364 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T00:45:52.368 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 30 kB/s) 2024-09-12T00:45:52.375 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 15/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 103 kB/s) 2024-09-12T00:45:52.378 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Progress (2): 17 kB | 16/184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 78 kB/s) 2024-09-12T00:45:52.382 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 61/184 kB Progress (1): 78/184 kB Progress (1): 94/184 kB Progress (1): 111/184 kB Progress (1): 127/184 kB Progress (1): 143/184 kB Progress (1): 160/184 kB Progress (1): 176/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 810 kB/s) 2024-09-12T00:45:52.385 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 105 kB/s) 2024-09-12T00:45:52.404 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:45:52.404 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T00:45:52.410 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T00:45:52.426 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 364 kB/s) 2024-09-12T00:45:52.428 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T00:45:52.444 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 318 kB/s) 2024-09-12T00:45:52.446 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T00:45:52.461 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.7 MB/s) 2024-09-12T00:45:52.465 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T00:45:52.480 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 950 kB/s) 2024-09-12T00:45:52.485 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T00:45:52.503 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 62/153 kB Progress (1): 78/153 kB Progress (1): 95/153 kB Progress (1): 111/153 kB Progress (1): 128/153 kB Progress (1): 144/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 8.5 MB/s) 2024-09-12T00:45:52.503 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T00:45:52.521 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/215 kB Progress (1): 32/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 78/215 kB Progress (1): 95/215 kB Progress (1): 111/215 kB Progress (1): 127/215 kB Progress (1): 144/215 kB Progress (1): 160/215 kB Progress (1): 177/215 kB Progress (1): 193/215 kB Progress (1): 209/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 12 MB/s) 2024-09-12T00:45:52.559 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:45:52.559 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:45:52.563 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T00:45:52.578 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 177 kB/s) 2024-09-12T00:45:52.579 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T00:45:52.594 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.5 MB/s) 2024-09-12T00:45:52.598 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T00:45:52.612 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 585 kB/s) 2024-09-12T00:45:52.615 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T00:45:52.630 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.7 MB/s) 2024-09-12T00:45:52.633 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T00:45:52.648 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-12T00:45:52.649 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T00:45:52.663 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-12T00:45:52.666 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T00:45:52.681 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-12T00:45:52.682 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T00:45:52.696 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-12T00:45:52.698 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T00:45:52.712 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-12T00:45:52.714 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T00:45:52.728 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-12T00:45:52.730 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T00:45:52.744 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 597 kB/s) 2024-09-12T00:45:52.747 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T00:45:52.761 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 523 kB/s) 2024-09-12T00:45:52.765 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T00:45:52.780 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-09-12T00:45:52.782 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T00:45:52.797 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.3 MB/s) 2024-09-12T00:45:52.801 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T00:45:52.816 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-12T00:45:52.819 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T00:45:52.834 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.0 MB/s) 2024-09-12T00:45:52.839 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T00:45:52.854 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 340 kB/s) 2024-09-12T00:45:52.857 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T00:45:52.873 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.7 MB/s) 2024-09-12T00:45:52.874 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T00:45:52.874 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T00:45:52.874 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T00:45:52.874 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T00:45:52.874 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T00:45:52.890 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.5 kB Progress (2): 2.5 kB | 16/269 kB Progress (3): 2.5 kB | 16/269 kB | 16/55 kB Progress (4): 2.5 kB | 16/269 kB | 16/55 kB | 16/41 kB Progress (4): 2.5 kB | 32/269 kB | 16/55 kB | 16/41 kB Progress (4): 2.5 kB | 32/269 kB | 33/55 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 166 kB/s) 2024-09-12T00:45:52.891 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (4): 32/269 kB | 33/55 kB | 16/41 kB | 8.5 kB Progress (4): 32/269 kB | 33/55 kB | 33/41 kB | 8.5 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T00:45:52.891 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (4): 49/269 kB | 33/55 kB | 33/41 kB | 8.5 kB Progress (4): 49/269 kB | 49/55 kB | 33/41 kB | 8.5 kB Progress (4): 49/269 kB | 49/55 kB | 41 kB | 8.5 kB Progress (4): 49/269 kB | 55 kB | 41 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-12T00:45:52.891 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (3): 65/269 kB | 55 kB | 41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T00:45:52.891 INFO:tasks.workunit.client.0.smithi062.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.6 MB/s) 2024-09-12T00:45:52.891 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 79/269 kB | 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.4 MB/s) 2024-09-12T00:45:52.892 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 96/269 kB Progress (1): 112/269 kB Progress (1): 128/269 kB Progress (1): 145/269 kB Progress (1): 161/269 kB Progress (1): 177/269 kB Progress (1): 194/269 kB Progress (1): 210/269 kB Progress (1): 227/269 kB Progress (1): 243/269 kB Progress (1): 259/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 14 MB/s) 2024-09-12T00:45:52.911 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/587 kB Progress (1): 33/587 kB Progress (1): 49/587 kB Progress (1): 64/587 kB Progress (1): 80/587 kB Progress (1): 96/587 kB Progress (1): 113/587 kB Progress (1): 129/587 kB Progress (1): 146/587 kB Progress (1): 162/587 kB Progress (1): 178/587 kB Progress (1): 195/587 kB Progress (1): 211/587 kB Progress (1): 227/587 kB Progress (1): 244/587 kB Progress (1): 260/587 kB Progress (2): 260/587 kB | 16/327 kB Progress (2): 277/587 kB | 16/327 kB Progress (2): 277/587 kB | 33/327 kB Progress (2): 293/587 kB | 33/327 kB Progress (2): 293/587 kB | 49/327 kB Progress (2): 309/587 kB | 49/327 kB Progress (2): 309/587 kB | 66/327 kB Progress (2): 326/587 kB | 66/327 kB Progress (2): 326/587 kB | 82/327 kB Progress (2): 342/587 kB | 82/327 kB Progress (2): 359/587 kB | 82/327 kB Progress (2): 359/587 kB | 98/327 kB Progress (2): 375/587 kB | 98/327 kB Progress (2): 375/587 kB | 115/327 kB Progress (2): 391/587 kB | 115/327 kB Progress (2): 391/587 kB | 131/327 kB Progress (2): 408/587 kB | 131/327 kB Progress (2): 408/587 kB | 147/327 kB Progress (2): 424/587 kB | 147/327 kB Progress (2): 424/587 kB | 164/327 kB Progress (2): 440/587 kB | 164/327 kB Progress (2): 440/587 kB | 180/327 kB Progress (2): 457/587 kB | 180/327 kB Progress (2): 473/587 kB | 180/327 kB Progress (2): 473/587 kB | 197/327 kB Progress (2): 490/587 kB | 197/327 kB Progress (2): 490/587 kB | 213/327 kB Progress (2): 506/587 kB | 213/327 kB Progress (2): 506/587 kB | 229/327 kB Progress (2): 522/587 kB | 229/327 kB Progress (2): 522/587 kB | 246/327 kB Progress (2): 539/587 kB | 246/327 kB Progress (2): 539/587 kB | 256/327 kB Progress (2): 555/587 kB | 256/327 kB Progress (2): 555/587 kB | 272/327 kB Progress (2): 572/587 kB | 272/327 kB Progress (2): 572/587 kB | 289/327 kB Progress (2): 587 kB | 289/327 kB Progress (2): 587 kB | 305/327 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 16 MB/s) 2024-09-12T00:45:52.911 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 321/327 kB Progress (1): 327 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 8.8 MB/s) 2024-09-12T00:45:52.942 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:45:52.943 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:45:52.943 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:45:52.947 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T00:45:52.961 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 339 kB/s) 2024-09-12T00:45:52.963 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T00:45:52.977 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-12T00:45:52.979 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T00:45:52.994 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.2 MB/s) 2024-09-12T00:45:52.996 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T00:45:53.011 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 932 kB/s) 2024-09-12T00:45:53.015 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T00:45:53.030 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-12T00:45:53.033 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T00:45:53.048 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 283 kB/s) 2024-09-12T00:45:53.050 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T00:45:53.065 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-12T00:45:53.069 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T00:45:53.084 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 331 kB/s) 2024-09-12T00:45:53.085 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T00:45:53.100 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 296 kB/s) 2024-09-12T00:45:53.104 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T00:45:53.119 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-12T00:45:53.120 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T00:45:53.135 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 806 kB/s) 2024-09-12T00:45:53.138 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T00:45:53.152 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.2 MB/s) 2024-09-12T00:45:53.154 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T00:45:53.169 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-12T00:45:53.171 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T00:45:53.186 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-12T00:45:53.188 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T00:45:53.202 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 599 kB/s) 2024-09-12T00:45:53.205 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T00:45:53.220 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 179 kB/s) 2024-09-12T00:45:53.222 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T00:45:53.237 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-09-12T00:45:53.240 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T00:45:53.254 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 81 kB/s) 2024-09-12T00:45:53.257 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T00:45:53.275 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 43 kB/s) 2024-09-12T00:45:53.277 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T00:45:53.291 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 431 kB/s) 2024-09-12T00:45:53.293 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T00:45:53.307 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.8 MB/s) 2024-09-12T00:45:53.310 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T00:45:53.324 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-12T00:45:53.325 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T00:45:53.339 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 94 kB/s) 2024-09-12T00:45:53.344 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T00:45:53.359 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-12T00:45:53.359 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T00:45:53.360 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T00:45:53.360 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T00:45:53.360 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T00:45:53.360 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T00:45:53.376 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/55 kB Progress (2): 4.2 kB | 33/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-12T00:45:53.376 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T00:45:53.377 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 49/55 kB Progress (1): 55 kB Progress (2): 55 kB | 16/27 kB Progress (2): 55 kB | 27 kB Progress (3): 55 kB | 27 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.6 MB/s) 2024-09-12T00:45:53.377 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T00:45:53.377 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (3): 27 kB | 16/122 kB | 16/334 kB Progress (3): 27 kB | 33/122 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.8 MB/s) 2024-09-12T00:45:53.377 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T00:45:53.377 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 33/122 kB | 33/334 kB Progress (2): 49/122 kB | 33/334 kB Progress (2): 49/122 kB | 49/334 kB Progress (2): 66/122 kB | 49/334 kB Progress (2): 66/122 kB | 66/334 kB Progress (2): 82/122 kB | 66/334 kB Progress (2): 82/122 kB | 82/334 kB Progress (2): 98/122 kB | 82/334 kB Progress (2): 98/122 kB | 98/334 kB Progress (2): 114/122 kB | 98/334 kB Progress (2): 122 kB | 98/334 kB Progress (2): 122 kB | 115/334 kB Progress (2): 122 kB | 131/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.2 MB/s) 2024-09-12T00:45:53.379 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 147/334 kB Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (1): 197/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 246/334 kB Progress (1): 256/334 kB Progress (1): 272/334 kB Progress (1): 289/334 kB Progress (1): 305/334 kB Progress (1): 321/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 17 MB/s) 2024-09-12T00:45:53.389 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/267 kB Progress (2): 16/267 kB | 4.7 kB Progress (2): 32/267 kB | 4.7 kB Progress (3): 32/267 kB | 4.7 kB | 16/23 kB Progress (3): 32/267 kB | 4.7 kB | 23 kB Progress (3): 49/267 kB | 4.7 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 161 kB/s) 2024-09-12T00:45:53.389 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 65/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 786 kB/s) 2024-09-12T00:45:53.392 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (1): 147/267 kB Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 229/267 kB Progress (1): 245/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.4 MB/s) 2024-09-12T00:45:53.457 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T00:45:53.458 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T00:45:54.139 INFO:tasks.workunit.client.0.smithi062.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:45:54.140 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:45:54.140 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:45:54.142 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:45:54.142 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:45:54.142 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:45:54.147 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T00:45:54.147 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T00:45:54.293 INFO:tasks.workunit.client.0.smithi062.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:45:54.293 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:45:54.293 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:45:54.297 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T00:45:54.313 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 390 kB/s) 2024-09-12T00:45:54.316 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T00:45:54.334 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 196 kB/s) 2024-09-12T00:45:54.337 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T00:45:54.353 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 204 kB/s) 2024-09-12T00:45:54.356 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T00:45:54.372 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 271 kB/s) 2024-09-12T00:45:54.375 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T00:45:54.390 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 220 kB/s) 2024-09-12T00:45:54.394 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T00:45:54.409 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 297 kB/s) 2024-09-12T00:45:54.413 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T00:45:54.429 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 110 kB/s) 2024-09-12T00:45:54.432 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T00:45:54.446 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 146 kB/s) 2024-09-12T00:45:54.448 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T00:45:54.462 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-12T00:45:54.465 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T00:45:54.479 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-12T00:45:54.482 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T00:45:54.497 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 387 kB/s) 2024-09-12T00:45:54.501 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T00:45:54.514 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 168 kB/s) 2024-09-12T00:45:54.516 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T00:45:54.530 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.6 MB/s) 2024-09-12T00:45:54.533 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T00:45:54.548 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.3 MB/s) 2024-09-12T00:45:54.551 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T00:45:54.565 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-12T00:45:54.569 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T00:45:54.584 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 577 kB/s) 2024-09-12T00:45:54.586 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T00:45:54.600 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.0 MB/s) 2024-09-12T00:45:54.603 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T00:45:54.618 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 538 kB/s) 2024-09-12T00:45:54.621 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T00:45:54.636 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 145 kB/s) 2024-09-12T00:45:54.640 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T00:45:54.655 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 173 kB/s) 2024-09-12T00:45:54.658 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T00:45:54.672 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-12T00:45:54.674 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T00:45:54.688 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-12T00:45:54.689 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T00:45:54.703 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-12T00:45:54.705 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T00:45:54.719 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 451 kB/s) 2024-09-12T00:45:54.721 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T00:45:54.736 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 904 kB/s) 2024-09-12T00:45:54.739 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T00:45:54.753 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 197 kB/s) 2024-09-12T00:45:54.755 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T00:45:54.769 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-12T00:45:54.770 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T00:45:54.784 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-12T00:45:54.786 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T00:45:54.800 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 138 kB/s) 2024-09-12T00:45:54.803 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T00:45:54.816 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-12T00:45:54.820 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T00:45:54.834 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 202 kB/s) 2024-09-12T00:45:54.838 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T00:45:54.852 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 998 kB/s) 2024-09-12T00:45:54.854 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T00:45:54.870 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 967 kB/s) 2024-09-12T00:45:54.872 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T00:45:54.887 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 895 kB/s) 2024-09-12T00:45:54.888 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T00:45:54.903 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 342 kB/s) 2024-09-12T00:45:54.905 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T00:45:54.920 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 418 kB/s) 2024-09-12T00:45:54.922 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T00:45:54.936 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/32 kB Progress (1): 32/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.2 MB/s) 2024-09-12T00:45:54.939 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T00:45:54.954 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-12T00:45:54.956 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T00:45:54.971 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 1.1 MB/s) 2024-09-12T00:45:54.973 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T00:45:54.994 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 36 kB/s) 2024-09-12T00:45:54.995 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T00:45:55.010 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-12T00:45:55.012 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T00:45:55.026 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-12T00:45:55.028 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T00:45:55.042 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 214 kB/s) 2024-09-12T00:45:55.045 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T00:45:55.059 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-12T00:45:55.061 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T00:45:55.076 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 147 kB/s) 2024-09-12T00:45:55.078 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T00:45:55.092 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 248 kB/s) 2024-09-12T00:45:55.095 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T00:45:55.109 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-12T00:45:55.110 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T00:45:55.124 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-12T00:45:55.126 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T00:45:55.140 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-12T00:45:55.143 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T00:45:55.157 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 26 kB/s) 2024-09-12T00:45:55.159 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T00:45:55.173 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 436 kB/s) 2024-09-12T00:45:55.174 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T00:45:55.188 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 524 kB/s) 2024-09-12T00:45:55.189 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T00:45:55.204 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 322 kB/s) 2024-09-12T00:45:55.206 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T00:45:55.220 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 522 kB/s) 2024-09-12T00:45:55.223 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T00:45:55.237 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-12T00:45:55.239 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T00:45:55.254 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 5.2 MB/s) 2024-09-12T00:45:55.257 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T00:45:55.271 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-12T00:45:55.274 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T00:45:55.288 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 404 kB/s) 2024-09-12T00:45:55.290 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T00:45:55.304 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-12T00:45:55.306 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T00:45:55.320 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 228 kB/s) 2024-09-12T00:45:55.321 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T00:45:55.335 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-12T00:45:55.338 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T00:45:55.351 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 169 kB/s) 2024-09-12T00:45:55.356 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T00:45:55.376 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 50/308 kB Progress (1): 67/308 kB Progress (1): 83/308 kB Progress (1): 99/308 kB Progress (1): 116/308 kB Progress (1): 132/308 kB Progress (1): 148/308 kB Progress (1): 165/308 kB Progress (1): 181/308 kB Progress (1): 198/308 kB Progress (1): 214/308 kB Progress (1): 230/308 kB Progress (1): 247/308 kB Progress (1): 263/308 kB Progress (1): 280/308 kB Progress (1): 296/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 17 MB/s) 2024-09-12T00:45:55.376 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T00:45:55.376 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T00:45:55.376 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T00:45:55.377 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T00:45:55.377 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T00:45:55.392 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/171 kB Progress (2): 16/171 kB | 14 kB Progress (2): 33/171 kB | 14 kB Progress (2): 49/171 kB | 14 kB Progress (3): 49/171 kB | 14 kB | 16/26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 906 kB/s) 2024-09-12T00:45:55.392 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T00:45:55.395 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 49/171 kB | 26 kB Progress (2): 66/171 kB | 26 kB Progress (3): 66/171 kB | 26 kB | 16/118 kB Progress (3): 82/171 kB | 26 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.6 MB/s) 2024-09-12T00:45:55.395 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T00:45:55.395 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 82/171 kB | 32/118 kB Progress (2): 98/171 kB | 32/118 kB Progress (2): 98/171 kB | 49/118 kB Progress (3): 98/171 kB | 49/118 kB | 8.2 kB Progress (3): 115/171 kB | 49/118 kB | 8.2 kB Progress (3): 115/171 kB | 65/118 kB | 8.2 kB Progress (3): 115/171 kB | 81/118 kB | 8.2 kB Progress (3): 131/171 kB | 81/118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 481 kB/s) 2024-09-12T00:45:55.395 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 131/171 kB | 98/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T00:45:55.395 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 147/171 kB | 98/118 kB Progress (2): 147/171 kB | 114/118 kB Progress (2): 147/171 kB | 118 kB Progress (2): 164/171 kB | 118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.5 MB/s) 2024-09-12T00:45:55.395 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T00:45:55.396 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.5 MB/s) 2024-09-12T00:45:55.396 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T00:45:55.408 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/136 kB Progress (1): 33/136 kB Progress (2): 33/136 kB | 16/146 kB Progress (2): 49/136 kB | 16/146 kB Progress (2): 66/136 kB | 16/146 kB Progress (2): 66/136 kB | 32/146 kB Progress (2): 82/136 kB | 32/146 kB Progress (2): 82/136 kB | 49/146 kB Progress (2): 98/136 kB | 49/146 kB Progress (2): 98/136 kB | 65/146 kB Progress (2): 115/136 kB | 65/146 kB Progress (2): 115/136 kB | 81/146 kB Progress (2): 131/136 kB | 81/146 kB Progress (2): 131/136 kB | 98/146 kB Progress (2): 136 kB | 98/146 kB Progress (2): 136 kB | 114/146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.3 MB/s) 2024-09-12T00:45:55.408 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 130/146 kB Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T00:45:55.410 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 130/146 kB | 16/58 kB Progress (2): 146 kB | 16/58 kB Progress (2): 146 kB | 33/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 4.4 MB/s) 2024-09-12T00:45:55.411 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 49/58 kB Progress (2): 49/58 kB | 16/61 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T00:45:55.411 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (3): 49/58 kB | 16/61 kB | 16/501 kB Progress (3): 58 kB | 16/61 kB | 16/501 kB Progress (3): 58 kB | 32/61 kB | 16/501 kB Progress (3): 58 kB | 32/61 kB | 33/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.7 MB/s) 2024-09-12T00:45:55.411 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 49/61 kB | 33/501 kB Progress (2): 49/61 kB | 49/501 kB Progress (2): 61 kB | 49/501 kB Progress (2): 61 kB | 66/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.8 MB/s) 2024-09-12T00:45:55.420 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 82/501 kB Progress (1): 98/501 kB Progress (1): 115/501 kB Progress (1): 131/501 kB Progress (1): 147/501 kB Progress (1): 164/501 kB Progress (1): 180/501 kB Progress (1): 197/501 kB Progress (1): 213/501 kB Progress (1): 229/501 kB Progress (1): 246/501 kB Progress (1): 256/501 kB Progress (1): 272/501 kB Progress (1): 289/501 kB Progress (1): 305/501 kB Progress (1): 321/501 kB Progress (1): 338/501 kB Progress (1): 354/501 kB Progress (1): 370/501 kB Progress (1): 387/501 kB Progress (1): 403/501 kB Progress (1): 420/501 kB Progress (1): 436/501 kB Progress (1): 452/501 kB Progress (1): 469/501 kB Progress (1): 485/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 11 MB/s) 2024-09-12T00:45:55.424 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 66/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 115/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.6 MB/s) 2024-09-12T00:45:55.469 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 26 MB/s) 2024-09-12T00:45:55.563 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:45:55.563 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T00:45:55.567 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T00:45:55.583 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 280 kB/s) 2024-09-12T00:45:55.585 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T00:45:55.600 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 326 kB/s) 2024-09-12T00:45:55.602 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T00:45:55.618 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.8 MB/s) 2024-09-12T00:45:55.621 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T00:45:55.636 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-12T00:45:55.638 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T00:45:55.652 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 370 kB/s) 2024-09-12T00:45:55.655 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T00:45:55.669 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 280 kB/s) 2024-09-12T00:45:55.672 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T00:45:55.689 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 354 kB/s) 2024-09-12T00:45:55.692 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T00:45:55.707 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 391 kB/s) 2024-09-12T00:45:55.710 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T00:45:55.724 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-12T00:45:55.728 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T00:45:55.744 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 855 kB/s) 2024-09-12T00:45:55.747 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T00:45:55.765 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 120 kB/s) 2024-09-12T00:45:55.767 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T00:45:55.789 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 391 kB/s) 2024-09-12T00:45:55.791 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T00:45:55.807 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.6 MB/s) 2024-09-12T00:45:55.814 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T00:45:55.832 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.0 MB/s) 2024-09-12T00:45:55.833 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T00:45:55.833 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T00:45:55.833 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T00:45:55.833 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T00:45:55.833 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T00:45:55.850 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/79 kB Progress (2): 16/79 kB | 0/1.0 MB Progress (3): 16/79 kB | 0/1.0 MB | 16/26 kB Progress (4): 16/79 kB | 0/1.0 MB | 16/26 kB | 16/58 kB Progress (4): 33/79 kB | 0/1.0 MB | 16/26 kB | 16/58 kB Progress (4): 33/79 kB | 0/1.0 MB | 26 kB | 16/58 kB Progress (4): 33/79 kB | 0/1.0 MB | 26 kB | 16/58 kB Progress (4): 33/79 kB | 0/1.0 MB | 26 kB | 32/58 kB Progress (5): 33/79 kB | 0/1.0 MB | 26 kB | 32/58 kB | 16/211 kB Progress (5): 49/79 kB | 0/1.0 MB | 26 kB | 32/58 kB | 16/211 kB Progress (5): 49/79 kB | 0/1.0 MB | 26 kB | 32/58 kB | 16/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.6 MB/s) 2024-09-12T00:45:55.850 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T00:45:55.850 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (4): 49/79 kB | 0/1.0 MB | 32/58 kB | 32/211 kB Progress (4): 66/79 kB | 0/1.0 MB | 32/58 kB | 32/211 kB Progress (4): 66/79 kB | 0/1.0 MB | 49/58 kB | 32/211 kB Progress (4): 66/79 kB | 0.1/1.0 MB | 49/58 kB | 32/211 kB Progress (4): 79 kB | 0.1/1.0 MB | 49/58 kB | 32/211 kB Progress (4): 79 kB | 0.1/1.0 MB | 49/58 kB | 49/211 kB Progress (4): 79 kB | 0.1/1.0 MB | 58 kB | 49/211 kB Progress (4): 79 kB | 0.1/1.0 MB | 58 kB | 49/211 kB Progress (4): 79 kB | 0.1/1.0 MB | 58 kB | 65/211 kB Progress (4): 79 kB | 0.1/1.0 MB | 58 kB | 81/211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.7 MB/s) 2024-09-12T00:45:55.850 INFO:tasks.workunit.client.0.smithi062.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-12T00:45:55.851 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T00:45:55.852 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 0.1/1.0 MB | 81/211 kB Progress (2): 0.1/1.0 MB | 98/211 kB Progress (2): 0.1/1.0 MB | 98/211 kB Progress (2): 0.1/1.0 MB | 114/211 kB Progress (2): 0.1/1.0 MB | 114/211 kB Progress (2): 0.1/1.0 MB | 130/211 kB Progress (2): 0.1/1.0 MB | 130/211 kB Progress (2): 0.1/1.0 MB | 147/211 kB Progress (2): 0.2/1.0 MB | 147/211 kB Progress (2): 0.2/1.0 MB | 163/211 kB Progress (2): 0.2/1.0 MB | 180/211 kB Progress (2): 0.2/1.0 MB | 180/211 kB Progress (2): 0.2/1.0 MB | 196/211 kB Progress (2): 0.2/1.0 MB | 196/211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.2/1.0 MB | 211 kB Progress (2): 0.2/1.0 MB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-12T00:45:55.864 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (2): 0.7/1.0 MB | 16/116 kB Progress (2): 0.7/1.0 MB | 16/116 kB Progress (2): 0.7/1.0 MB | 33/116 kB Progress (2): 0.7/1.0 MB | 49/116 kB Progress (2): 0.7/1.0 MB | 49/116 kB Progress (2): 0.7/1.0 MB | 66/116 kB Progress (2): 0.7/1.0 MB | 82/116 kB Progress (2): 0.7/1.0 MB | 82/116 kB Progress (3): 0.7/1.0 MB | 82/116 kB | 16/267 kB Progress (3): 0.7/1.0 MB | 98/116 kB | 16/267 kB Progress (3): 0.8/1.0 MB | 98/116 kB | 16/267 kB Progress (3): 0.8/1.0 MB | 115/116 kB | 16/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 16/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 33/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 33/267 kB Progress (3): 0.8/1.0 MB | 116 kB | 49/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.7 MB/s) 2024-09-12T00:45:55.869 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 0.8/1.0 MB | 49/267 kB Progress (2): 0.8/1.0 MB | 64/267 kB Progress (2): 0.8/1.0 MB | 64/267 kB Progress (2): 0.8/1.0 MB | 81/267 kB Progress (2): 0.8/1.0 MB | 81/267 kB Progress (2): 0.8/1.0 MB | 97/267 kB Progress (2): 0.8/1.0 MB | 97/267 kB Progress (2): 0.8/1.0 MB | 114/267 kB Progress (2): 0.8/1.0 MB | 114/267 kB Progress (2): 0.8/1.0 MB | 130/267 kB Progress (2): 0.9/1.0 MB | 130/267 kB Progress (2): 0.9/1.0 MB | 146/267 kB Progress (2): 0.9/1.0 MB | 146/267 kB Progress (2): 0.9/1.0 MB | 163/267 kB Progress (2): 0.9/1.0 MB | 163/267 kB Progress (2): 0.9/1.0 MB | 179/267 kB Progress (2): 0.9/1.0 MB | 179/267 kB Progress (2): 0.9/1.0 MB | 196/267 kB Progress (2): 0.9/1.0 MB | 196/267 kB Progress (2): 0.9/1.0 MB | 212/267 kB Progress (2): 0.9/1.0 MB | 212/267 kB Progress (2): 0.9/1.0 MB | 228/267 kB Progress (2): 1.0/1.0 MB | 228/267 kB Progress (2): 1.0/1.0 MB | 245/267 kB Progress (2): 1.0/1.0 MB | 245/267 kB Progress (2): 1.0/1.0 MB | 261/267 kB Progress (2): 1.0/1.0 MB | 261/267 kB Progress (2): 1.0/1.0 MB | 267 kB Progress (2): 1.0/1.0 MB | 267 kB Progress (2): 1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 7.4 MB/s) 2024-09-12T00:45:55.870 INFO:tasks.workunit.client.0.smithi062.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 27 MB/s) 2024-09-12T00:45:56.035 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T00:45:56.068 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:45:56.069 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:45:56.069 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:45:56.070 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Total time: 6.031 s 2024-09-12T00:45:56.070 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Finished at: 2024-09-12T00:45:56Z 2024-09-12T00:45:56.070 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:45:56.094 INFO:tasks.workunit.client.0.smithi062.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T00:45:56.103 INFO:tasks.workunit.client.0.smithi062.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:45:57.140 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Scanning for projects... 2024-09-12T00:45:57.216 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:45:57.216 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:45:57.216 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:45:57.216 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] from pom.xml 2024-09-12T00:45:57.216 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:45:57.462 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:45:57.462 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:45:57.566 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:45:57.567 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:45:57.567 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:45:57.676 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:45:57.677 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:45:57.677 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:45:57.678 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:45:57.679 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:45:57.679 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:45:57.683 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:45:57.683 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:45:57.683 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:45:57.865 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T00:45:58.063 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T00:45:58.260 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-09-12T00:45:58.269 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T00:45:58.310 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 62 kB/s) 2024-09-12T00:45:58.316 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T00:45:58.340 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 113 kB/s) 2024-09-12T00:45:58.345 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T00:45:58.364 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 159 kB/s) 2024-09-12T00:45:58.366 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T00:45:58.383 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-12T00:45:58.386 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T00:45:58.402 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-12T00:45:58.404 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T00:45:58.420 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-12T00:45:58.426 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T00:45:58.450 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.1 MB/s) 2024-09-12T00:45:58.451 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T00:45:58.452 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T00:45:58.452 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T00:45:58.453 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T00:45:58.453 INFO:tasks.workunit.client.0.smithi062.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T00:45:58.491 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 66/169 kB Progress (1): 82/169 kB Progress (1): 98/169 kB Progress (1): 115/169 kB Progress (1): 131/169 kB Progress (1): 147/169 kB Progress (1): 164/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 4.2 MB/s) 2024-09-12T00:45:58.507 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 1.4/7.7 kB Progress (2): 1.4/7.7 kB | 1.4/103 kB Progress (2): 2.8/7.7 kB | 1.4/103 kB Progress (2): 2.8/7.7 kB | 2.8/103 kB Progress (3): 2.8/7.7 kB | 2.8/103 kB | 1.4/18 kB Progress (3): 2.8/7.7 kB | 4.1/103 kB | 1.4/18 kB Progress (3): 4.1/7.7 kB | 4.1/103 kB | 1.4/18 kB Progress (3): 5.5/7.7 kB | 4.1/103 kB | 1.4/18 kB Progress (3): 5.5/7.7 kB | 5.5/103 kB | 1.4/18 kB Progress (3): 5.5/7.7 kB | 5.5/103 kB | 2.8/18 kB Progress (3): 5.5/7.7 kB | 6.9/103 kB | 2.8/18 kB Progress (3): 6.9/7.7 kB | 6.9/103 kB | 2.8/18 kB Progress (4): 6.9/7.7 kB | 6.9/103 kB | 2.8/18 kB | 1.4/189 kB Progress (4): 7.7 kB | 6.9/103 kB | 2.8/18 kB | 1.4/189 kB Progress (4): 7.7 kB | 8.3/103 kB | 2.8/18 kB | 1.4/189 kB Progress (4): 7.7 kB | 8.3/103 kB | 4.1/18 kB | 1.4/189 kB Progress (4): 7.7 kB | 9.7/103 kB | 4.1/18 kB | 1.4/189 kB Progress (4): 7.7 kB | 9.7/103 kB | 4.1/18 kB | 2.8/189 kB Progress (4): 7.7 kB | 11/103 kB | 4.1/18 kB | 2.8/189 kB Progress (4): 7.7 kB | 11/103 kB | 4.1/18 kB | 4.1/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 139 kB/s) 2024-09-12T00:45:58.513 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (3): 11/103 kB | 5.5/18 kB | 4.1/189 kB Progress (3): 11/103 kB | 5.5/18 kB | 5.5/189 kB Progress (3): 12/103 kB | 5.5/18 kB | 5.5/189 kB Progress (3): 12/103 kB | 6.9/18 kB | 5.5/189 kB Progress (3): 14/103 kB | 6.9/18 kB | 5.5/189 kB Progress (3): 14/103 kB | 6.9/18 kB | 6.9/189 kB Progress (3): 15/103 kB | 6.9/18 kB | 6.9/189 kB Progress (3): 15/103 kB | 8.3/18 kB | 6.9/189 kB Progress (3): 16/103 kB | 8.3/18 kB | 6.9/189 kB Progress (3): 16/103 kB | 9.7/18 kB | 6.9/189 kB Progress (3): 16/103 kB | 9.7/18 kB | 8.3/189 kB Progress (3): 16/103 kB | 11/18 kB | 8.3/189 kB Progress (3): 16/103 kB | 11/18 kB | 9.7/189 kB Progress (3): 16/103 kB | 12/18 kB | 9.7/189 kB Progress (3): 16/103 kB | 12/18 kB | 11/189 kB Progress (3): 16/103 kB | 14/18 kB | 11/189 kB Progress (3): 16/103 kB | 14/18 kB | 12/189 kB Progress (3): 16/103 kB | 15/18 kB | 12/189 kB Progress (3): 16/103 kB | 15/18 kB | 14/189 kB Progress (3): 16/103 kB | 17/18 kB | 14/189 kB Progress (3): 16/103 kB | 17/18 kB | 15/189 kB Progress (3): 16/103 kB | 18 kB | 15/189 kB Progress (3): 16/103 kB | 18 kB | 17/189 kB Progress (3): 16/103 kB | 18 kB | 18/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 274 kB/s) 2024-09-12T00:45:58.534 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (2): 16/103 kB | 19/189 kB Progress (2): 16/103 kB | 21/189 kB Progress (2): 16/103 kB | 22/189 kB Progress (2): 16/103 kB | 23/189 kB Progress (2): 32/103 kB | 23/189 kB Progress (2): 32/103 kB | 25/189 kB Progress (2): 32/103 kB | 26/189 kB Progress (2): 32/103 kB | 28/189 kB Progress (2): 32/103 kB | 29/189 kB Progress (2): 32/103 kB | 30/189 kB Progress (2): 49/103 kB | 30/189 kB Progress (2): 49/103 kB | 32/189 kB Progress (2): 49/103 kB | 33/189 kB Progress (2): 49/103 kB | 34/189 kB Progress (2): 49/103 kB | 36/189 kB Progress (2): 49/103 kB | 37/189 kB Progress (2): 49/103 kB | 39/189 kB Progress (2): 49/103 kB | 40/189 kB Progress (2): 49/103 kB | 41/189 kB Progress (2): 49/103 kB | 43/189 kB Progress (2): 49/103 kB | 44/189 kB Progress (2): 49/103 kB | 46/189 kB Progress (2): 49/103 kB | 47/189 kB Progress (2): 49/103 kB | 48/189 kB Progress (2): 49/103 kB | 50/189 kB Progress (2): 49/103 kB | 51/189 kB Progress (2): 49/103 kB | 52/189 kB Progress (2): 49/103 kB | 54/189 kB Progress (2): 49/103 kB | 55/189 kB Progress (2): 49/103 kB | 57/189 kB Progress (2): 49/103 kB | 58/189 kB Progress (2): 49/103 kB | 59/189 kB Progress (2): 49/103 kB | 61/189 kB Progress (2): 65/103 kB | 61/189 kB Progress (2): 65/103 kB | 62/189 kB Progress (2): 65/103 kB | 62/189 kB Progress (2): 81/103 kB | 62/189 kB Progress (2): 81/103 kB | 79/189 kB Progress (2): 98/103 kB | 79/189 kB Progress (2): 103 kB | 79/189 kB Progress (2): 103 kB | 95/189 kB Progress (2): 103 kB | 111/189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-12T00:45:58.544 INFO:tasks.workunit.client.0.smithi062.stdout:Progress (1): 128/189 kB Progress (1): 144/189 kB Progress (1): 161/189 kB Progress (1): 177/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.1 MB/s) 2024-09-12T00:45:58.565 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:45:58.565 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:45:58.565 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] T E S T S 2024-09-12T00:45:58.566 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:45:59.022 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T00:45:59.144 INFO:tasks.workunit.client.0.smithi062.stdout:PutObjects.java: starting test run: 2024-09-12T00:45:59.144 INFO:tasks.workunit.client.0.smithi062.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:45:59.145 INFO:tasks.workunit.client.0.smithi062.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:45:59.145 INFO:tasks.workunit.client.0.smithi062.stdout: EndpointUrl=http://smithi062.front.sepia.ceph.com:80 2024-09-12T00:45:59.145 INFO:tasks.workunit.client.0.smithi062.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T00:45:59.242 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: Environment Variables Read 2024-09-12T00:45:59.644 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: S3 Client Initialized 2024-09-12T00:45:59.644 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: Generating File 2024-09-12T00:45:59.644 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: File Generated 2024-09-12T00:45:59.644 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: Generating File 2024-09-12T00:45:59.644 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: File Generated 2024-09-12T00:45:59.644 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: Generating File 2024-09-12T00:45:59.644 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: File Generated 2024-09-12T00:45:59.644 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: Generating File 2024-09-12T00:45:59.644 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: File Generated 2024-09-12T00:45:59.645 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: Generating File 2024-09-12T00:45:59.645 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: File Generated 2024-09-12T00:45:59.645 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: Generating File 2024-09-12T00:45:59.645 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: File Generated 2024-09-12T00:45:59.645 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: Generated Big Files 2024-09-12T00:45:59.932 INFO:tasks.workunit.client.0.smithi062.stdout:HeadBucketResponse() 2024-09-12T00:45:59.932 INFO:tasks.workunit.client.0.smithi062.stdout:sheik is ready 2024-09-12T00:45:59.932 INFO:tasks.workunit.client.0.smithi062.stdout:DEBUG: Test Bucket Created 2024-09-12T00:46:00.043 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T00:46:00.143 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T00:46:00.344 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T00:46:00.544 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T00:46:00.745 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T00:46:00.845 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T00:46:01.045 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T00:46:01.145 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T00:46:01.545 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T00:46:02.146 INFO:tasks.workunit.client.0.smithi062.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T00:46:05.552 INFO:tasks.workunit.client.0.smithi062.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T00:46:08.356 INFO:tasks.workunit.client.0.smithi062.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T00:46:31.164 INFO:tasks.workunit.client.0.smithi062.stdout:arg: file-0b 2024-09-12T00:46:31.164 INFO:tasks.workunit.client.0.smithi062.stdout:arg: file-8b 2024-09-12T00:46:31.165 INFO:tasks.workunit.client.0.smithi062.stdout:arg: file-200b 2024-09-12T00:46:31.166 INFO:tasks.workunit.client.0.smithi062.stdout:arg: file-21983b 2024-09-12T00:46:31.168 INFO:tasks.workunit.client.0.smithi062.stdout:arg: file-5519b 2024-09-12T00:46:31.169 INFO:tasks.workunit.client.0.smithi062.stdout:arg: file-204329b 2024-09-12T00:46:31.170 INFO:tasks.workunit.client.0.smithi062.stdout:arg: file-256k 2024-09-12T00:46:31.171 INFO:tasks.workunit.client.0.smithi062.stdout:arg: file-1m 2024-09-12T00:46:31.172 INFO:tasks.workunit.client.0.smithi062.stdout:arg: file-1038757b 2024-09-12T00:46:31.184 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T00:46:31.284 INFO:tasks.workunit.client.0.smithi062.stdout:PutObjectResponse 2024-09-12T00:46:31.385 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T00:46:31.385 INFO:tasks.workunit.client.0.smithi062.stdout:PutObjectResponse 2024-09-12T00:46:31.485 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T00:46:31.585 INFO:tasks.workunit.client.0.smithi062.stdout:PutObjectResponse 2024-09-12T00:46:31.685 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T00:46:31.685 INFO:tasks.workunit.client.0.smithi062.stdout:PutObjectResponse 2024-09-12T00:46:31.785 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T00:46:31.885 INFO:tasks.workunit.client.0.smithi062.stdout:PutObjectResponse 2024-09-12T00:46:31.985 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T00:46:32.032 INFO:tasks.workunit.client.0.smithi062.stdout:PutObjectResponse 2024-09-12T00:46:32.085 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T00:46:32.185 INFO:tasks.workunit.client.0.smithi062.stdout:PutObjectResponse 2024-09-12T00:46:32.286 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T00:46:32.586 INFO:tasks.workunit.client.0.smithi062.stdout:PutObjectResponse 2024-09-12T00:46:32.686 INFO:tasks.workunit.client.0.smithi062.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T00:46:32.886 INFO:tasks.workunit.client.0.smithi062.stdout:PutObjectResponse 2024-09-12T00:46:32.987 INFO:tasks.workunit.client.0.smithi062.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T00:46:34.689 INFO:tasks.workunit.client.0.smithi062.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T00:46:37.992 INFO:tasks.workunit.client.0.smithi062.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T00:47:09.529 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 70.50 s -- in io.ceph.jcksum.PutObjects 2024-09-12T00:47:09.540 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:47:09.540 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Results: 2024-09-12T00:47:09.540 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:47:09.540 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T00:47:09.540 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] 2024-09-12T00:47:09.542 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:47:09.543 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:47:09.543 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:47:09.543 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Total time: 01:12 min 2024-09-12T00:47:09.543 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] Finished at: 2024-09-12T00:47:09Z 2024-09-12T00:47:09.544 INFO:tasks.workunit.client.0.smithi062.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:47:09.566 INFO:tasks.workunit.client.0.smithi062.stderr:+ exit 2024-09-12T00:47:09.567 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:47:09.567 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:47:09.647 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T00:47:09.647 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:47:10.038 DEBUG:teuthology.parallel:result is None 2024-09-12T00:47:10.038 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:47:10.078 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:47:10.078 DEBUG:teuthology.orchestra.run.smithi062:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:47:10.149 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:47:10.149 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:47:10.159 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:47:10.160 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:47:10.160 DEBUG:teuthology.orchestra.run.smithi062:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:47:10.219 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:47:10.219 INFO:teuthology.orchestra.run.smithi062.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:47:10.219 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:47:10.289 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:47:10.289 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:47:10.360 INFO:tasks.workunit:timeout=3h 2024-09-12T00:47:10.360 INFO:tasks.workunit:cleanup=True 2024-09-12T00:47:10.361 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:47:10.431 INFO:tasks.workunit.client.0.smithi062.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:47:56.176 INFO:tasks.workunit.client.0.smithi062.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:47:56.176 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:47:56.177 INFO:tasks.workunit.client.0.smithi062.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:47:56.177 INFO:tasks.workunit.client.0.smithi062.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:47:56.177 INFO:tasks.workunit.client.0.smithi062.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:47:56.177 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:47:56.177 INFO:tasks.workunit.client.0.smithi062.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:47:56.177 INFO:tasks.workunit.client.0.smithi062.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:47:56.177 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:47:56.177 INFO:tasks.workunit.client.0.smithi062.stderr: git switch -c 2024-09-12T00:47:56.177 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:47:56.177 INFO:tasks.workunit.client.0.smithi062.stderr:Or undo this operation with: 2024-09-12T00:47:56.177 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:47:56.177 INFO:tasks.workunit.client.0.smithi062.stderr: git switch - 2024-09-12T00:47:56.178 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:47:56.178 INFO:tasks.workunit.client.0.smithi062.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:47:56.178 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:47:56.178 INFO:tasks.workunit.client.0.smithi062.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:47:56.181 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:47:56.252 INFO:tasks.workunit.client.0.smithi062.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:47:56.255 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:47:56.255 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:47:56.305 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:47:56.356 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:47:56.396 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:47:56.397 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:47:56.398 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:47:56.437 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:47:56.441 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:47:56.441 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:47:56.511 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T00:47:56.512 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T00:47:56.512 DEBUG:teuthology.orchestra.run.smithi062:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T00:47:56.587 INFO:tasks.workunit.client.0.smithi062.stdout:INFO: fully qualified domain name: smithi062.front.sepia.ceph.com 2024-09-12T00:47:56.588 INFO:tasks.workunit.client.0.smithi062.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T00:47:56.588 INFO:tasks.workunit.client.0.smithi062.stdout:== TESTING VERSIONED BUCKET == 2024-09-12T00:47:59.197 INFO:tasks.workunit.client.0.smithi062.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:47:59.399 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting pip 2024-09-12T00:47:59.405 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:47:59.451 INFO:tasks.workunit.client.0.smithi062.stdout:Installing collected packages: pip 2024-09-12T00:47:59.451 INFO:tasks.workunit.client.0.smithi062.stdout: Attempting uninstall: pip 2024-09-12T00:47:59.451 INFO:tasks.workunit.client.0.smithi062.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:47:59.619 INFO:tasks.workunit.client.0.smithi062.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:47:59.624 INFO:tasks.workunit.client.0.smithi062.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:48:00.404 INFO:tasks.workunit.client.0.smithi062.stdout:Successfully installed pip-24.2 2024-09-12T00:48:01.312 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting boto3 2024-09-12T00:48:01.313 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:48:01.879 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:48:01.880 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:48:01.929 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:48:01.931 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:48:01.993 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:48:01.994 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:48:02.044 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:48:02.045 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:48:02.139 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:48:02.140 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:48:02.291 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:48:02.292 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:48:02.297 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:48:02.298 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:48:02.308 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:48:02.309 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:48:02.310 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:48:02.312 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:48:02.313 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:48:02.390 INFO:tasks.workunit.client.0.smithi062.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:48:03.469 INFO:tasks.workunit.client.0.smithi062.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:48:03.915 INFO:tasks.workunit.client.0.smithi062.stdout:INFO: creating user 2024-09-12T00:48:04.035 INFO:tasks.workunit.client.0.smithi062.stdout:{ 2024-09-12T00:48:04.035 INFO:tasks.workunit.client.0.smithi062.stdout: "user_id": "testid", 2024-09-12T00:48:04.035 INFO:tasks.workunit.client.0.smithi062.stdout: "display_name": "M. Tester", 2024-09-12T00:48:04.035 INFO:tasks.workunit.client.0.smithi062.stdout: "email": "tester@ceph.com", 2024-09-12T00:48:04.035 INFO:tasks.workunit.client.0.smithi062.stdout: "suspended": 0, 2024-09-12T00:48:04.035 INFO:tasks.workunit.client.0.smithi062.stdout: "max_buckets": 1000, 2024-09-12T00:48:04.035 INFO:tasks.workunit.client.0.smithi062.stdout: "subusers": [], 2024-09-12T00:48:04.035 INFO:tasks.workunit.client.0.smithi062.stdout: "keys": [ 2024-09-12T00:48:04.035 INFO:tasks.workunit.client.0.smithi062.stdout: { 2024-09-12T00:48:04.036 INFO:tasks.workunit.client.0.smithi062.stdout: "user": "testid", 2024-09-12T00:48:04.036 INFO:tasks.workunit.client.0.smithi062.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T00:48:04.036 INFO:tasks.workunit.client.0.smithi062.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T00:48:04.036 INFO:tasks.workunit.client.0.smithi062.stdout: "active": true, 2024-09-12T00:48:04.036 INFO:tasks.workunit.client.0.smithi062.stdout: "create_date": "2024-09-12T00:48:04.023940Z" 2024-09-12T00:48:04.036 INFO:tasks.workunit.client.0.smithi062.stdout: } 2024-09-12T00:48:04.036 INFO:tasks.workunit.client.0.smithi062.stdout: ], 2024-09-12T00:48:04.036 INFO:tasks.workunit.client.0.smithi062.stdout: "swift_keys": [], 2024-09-12T00:48:04.036 INFO:tasks.workunit.client.0.smithi062.stdout: "caps": [], 2024-09-12T00:48:04.036 INFO:tasks.workunit.client.0.smithi062.stdout: "op_mask": "read, write, delete", 2024-09-12T00:48:04.036 INFO:tasks.workunit.client.0.smithi062.stdout: "default_placement": "", 2024-09-12T00:48:04.036 INFO:tasks.workunit.client.0.smithi062.stdout: "default_storage_class": "", 2024-09-12T00:48:04.037 INFO:tasks.workunit.client.0.smithi062.stdout: "placement_tags": [], 2024-09-12T00:48:04.037 INFO:tasks.workunit.client.0.smithi062.stdout: "bucket_quota": { 2024-09-12T00:48:04.037 INFO:tasks.workunit.client.0.smithi062.stdout: "enabled": false, 2024-09-12T00:48:04.037 INFO:tasks.workunit.client.0.smithi062.stdout: "check_on_raw": false, 2024-09-12T00:48:04.037 INFO:tasks.workunit.client.0.smithi062.stdout: "max_size": -1, 2024-09-12T00:48:04.037 INFO:tasks.workunit.client.0.smithi062.stdout: "max_size_kb": 0, 2024-09-12T00:48:04.037 INFO:tasks.workunit.client.0.smithi062.stdout: "max_objects": -1 2024-09-12T00:48:04.037 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:48:04.037 INFO:tasks.workunit.client.0.smithi062.stdout: "user_quota": { 2024-09-12T00:48:04.037 INFO:tasks.workunit.client.0.smithi062.stdout: "enabled": false, 2024-09-12T00:48:04.037 INFO:tasks.workunit.client.0.smithi062.stdout: "check_on_raw": false, 2024-09-12T00:48:04.037 INFO:tasks.workunit.client.0.smithi062.stdout: "max_size": -1, 2024-09-12T00:48:04.037 INFO:tasks.workunit.client.0.smithi062.stdout: "max_size_kb": 0, 2024-09-12T00:48:04.038 INFO:tasks.workunit.client.0.smithi062.stdout: "max_objects": -1 2024-09-12T00:48:04.038 INFO:tasks.workunit.client.0.smithi062.stdout: }, 2024-09-12T00:48:04.038 INFO:tasks.workunit.client.0.smithi062.stdout: "temp_url_keys": [], 2024-09-12T00:48:04.038 INFO:tasks.workunit.client.0.smithi062.stdout: "type": "rgw", 2024-09-12T00:48:04.038 INFO:tasks.workunit.client.0.smithi062.stdout: "mfa_ids": [], 2024-09-12T00:48:04.038 INFO:tasks.workunit.client.0.smithi062.stdout: "account_id": "", 2024-09-12T00:48:04.038 INFO:tasks.workunit.client.0.smithi062.stdout: "path": "/", 2024-09-12T00:48:04.038 INFO:tasks.workunit.client.0.smithi062.stdout: "create_date": "2024-09-12T00:48:04.023926Z", 2024-09-12T00:48:04.038 INFO:tasks.workunit.client.0.smithi062.stdout: "tags": [], 2024-09-12T00:48:04.038 INFO:tasks.workunit.client.0.smithi062.stdout: "group_ids": [] 2024-09-12T00:48:04.038 INFO:tasks.workunit.client.0.smithi062.stdout:} 2024-09-12T00:48:04.038 INFO:tasks.workunit.client.0.smithi062.stdout: 2024-09-12T00:48:04.361 INFO:tasks.workunit.client.0.smithi062.stderr:5+0 records in 2024-09-12T00:48:04.362 INFO:tasks.workunit.client.0.smithi062.stderr:5+0 records out 2024-09-12T00:48:04.362 INFO:tasks.workunit.client.0.smithi062.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0142025 s, 369 MB/s 2024-09-12T00:48:13.744 INFO:tasks.workunit.client.0.smithi062.stdout:bucket nams is reupload-bkt-103077 2024-09-12T00:48:13.744 INFO:tasks.workunit.client.0.smithi062.stdout:endpoint is http://smithi062.front.sepia.ceph.com:80 2024-09-12T00:48:13.744 INFO:tasks.workunit.client.0.smithi062.stdout:start UploadId=2~t1uNTW-87Chhk89m32Tz-X7rfQr7iNX 2024-09-12T00:48:13.744 INFO:tasks.workunit.client.0.smithi062.stdout:phase 1 uploaded part {'ETag': '"d1ae218c04f3bda4a0b37924e5f9e9d0"', 'PartNumber': 1} 2024-09-12T00:48:13.744 INFO:tasks.workunit.client.0.smithi062.stdout:phase 1 uploaded part {'ETag': '"d1ae218c04f3bda4a0b37924e5f9e9d0"', 'PartNumber': 2} 2024-09-12T00:48:13.744 INFO:tasks.workunit.client.0.smithi062.stdout:phase 2 uploaded part {'ETag': '"d1ae218c04f3bda4a0b37924e5f9e9d0"', 'PartNumber': 1} 2024-09-12T00:48:13.745 INFO:tasks.workunit.client.0.smithi062.stdout:phase 2 uploaded part {'ETag': '"d1ae218c04f3bda4a0b37924e5f9e9d0"', 'PartNumber': 1} 2024-09-12T00:48:13.745 INFO:tasks.workunit.client.0.smithi062.stdout:phase 2 uploaded part {'ETag': '"d1ae218c04f3bda4a0b37924e5f9e9d0"', 'PartNumber': 1} 2024-09-12T00:48:13.745 INFO:tasks.workunit.client.0.smithi062.stdout:phase 2 uploaded part {'ETag': '"d1ae218c04f3bda4a0b37924e5f9e9d0"', 'PartNumber': 1} 2024-09-12T00:48:13.745 INFO:tasks.workunit.client.0.smithi062.stdout:phase 2 uploaded part {'ETag': '"d1ae218c04f3bda4a0b37924e5f9e9d0"', 'PartNumber': 1} 2024-09-12T00:48:13.745 INFO:tasks.workunit.client.0.smithi062.stdout:phase 2 uploaded part {'ETag': '"d1ae218c04f3bda4a0b37924e5f9e9d0"', 'PartNumber': 1} 2024-09-12T00:48:13.745 INFO:tasks.workunit.client.0.smithi062.stdout:phase 2 uploaded part {'ETag': '"d1ae218c04f3bda4a0b37924e5f9e9d0"', 'PartNumber': 1} 2024-09-12T00:48:13.745 INFO:tasks.workunit.client.0.smithi062.stdout:phase 2 uploaded part {'ETag': '"d1ae218c04f3bda4a0b37924e5f9e9d0"', 'PartNumber': 1} 2024-09-12T00:48:13.745 INFO:tasks.workunit.client.0.smithi062.stdout:phase 2 uploaded part {'ETag': '"d1ae218c04f3bda4a0b37924e5f9e9d0"', 'PartNumber': 1} 2024-09-12T00:48:13.745 INFO:tasks.workunit.client.0.smithi062.stdout:phase 2 uploaded part {'ETag': '"d1ae218c04f3bda4a0b37924e5f9e9d0"', 'PartNumber': 1} 2024-09-12T00:48:13.745 INFO:tasks.workunit.client.0.smithi062.stdout:phase 2 uploaded part {'ETag': '"d1ae218c04f3bda4a0b37924e5f9e9d0"', 'PartNumber': 1} 2024-09-12T00:48:13.745 INFO:tasks.workunit.client.0.smithi062.stdout:completing multipart upload, parts=[{'ETag': '"d1ae218c04f3bda4a0b37924e5f9e9d0"', 'PartNumber': 1}, {'ETag': '"d1ae218c04f3bda4a0b37924e5f9e9d0"', 'PartNumber': 2}] 2024-09-12T00:48:14.995 INFO:tasks.workunit.client.0.smithi062.stdout:radosgw-admin bucket radoslist: 2024-09-12T00:48:14.995 INFO:tasks.workunit.client.0.smithi062.stdout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3_mpu_test4 2024-09-12T00:48:14.995 INFO:tasks.workunit.client.0.smithi062.stdout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3__multipart_mpu_test4.2~t1uNTW-87Chhk89m32Tz-X7rfQr7iNX.2 2024-09-12T00:48:14.995 INFO:tasks.workunit.client.0.smithi062.stdout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3__multipart_mpu_test4.aTmpsW1XSMEZAgA7Cs__Sb6g8n30i6md.1 2024-09-12T00:48:14.995 INFO:tasks.workunit.client.0.smithi062.stdout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3__:zSM1S6p4ctGCqPdXp3cQF.2Ff8rCuBM_mpu_test4 2024-09-12T00:48:15.056 INFO:tasks.workunit.client.0.smithi062.stdout:rados ls: 2024-09-12T00:48:15.056 INFO:tasks.workunit.client.0.smithi062.stdout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3_mpu_test4 2024-09-12T00:48:15.056 INFO:tasks.workunit.client.0.smithi062.stdout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3__multipart_mpu_test4.2~t1uNTW-87Chhk89m32Tz-X7rfQr7iNX.2 2024-09-12T00:48:15.057 INFO:tasks.workunit.client.0.smithi062.stdout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3__multipart_mpu_test4.aTmpsW1XSMEZAgA7Cs__Sb6g8n30i6md.1 2024-09-12T00:48:15.057 INFO:tasks.workunit.client.0.smithi062.stdout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3__:zSM1S6p4ctGCqPdXp3cQF.2Ff8rCuBM_mpu_test4 2024-09-12T00:48:15.070 INFO:tasks.workunit.client.0.smithi062.stdout:== PASSED == 2024-09-12T00:48:15.070 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:48:15.070 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:48:15.151 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T00:48:15.151 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:48:15.550 DEBUG:teuthology.parallel:result is None 2024-09-12T00:48:15.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:48:15.589 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:48:15.590 DEBUG:teuthology.orchestra.run.smithi062:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:48:15.659 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:48:15.659 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T00:48:15.678 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T00:48:15.678 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T00:48:15.678 INFO:tasks.ragweed:Using branch 'wip-67986' for ragweed 2024-09-12T00:48:15.678 DEBUG:teuthology.orchestra.run.smithi062:> git clone -b wip-67986 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:48:15.729 INFO:teuthology.orchestra.run.smithi062.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T00:48:15.903 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T00:48:15.904 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T00:48:15.904 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key RVMNESKDPBGZHWNZKPNO --secret K3K6YTHBLjfOpXpDj9yqqm2RxJg1Zi0UryAfXzl4qGQAEaDIuoKi8Q== --email ragweed.client.0+test@test.test --system false 2024-09-12T00:48:16.013 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:16.013 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:16.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.050+0000 7f5349137800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.052+0000 7f5349137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.052+0000 7f5349137800 20 realm 2024-09-12T00:48:16.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.052+0000 7f5349137800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.052+0000 7f5349137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.052+0000 7f5349137800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:16.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.052+0000 7f5349137800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.052+0000 7f5349137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.052+0000 7f5349137800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.053+0000 7f5349137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:16.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.053+0000 7f5349137800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.054+0000 7f5349137800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:16.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.054+0000 7f5349137800 20 searching for the correct realm 2024-09-12T00:48:16.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.057+0000 7f5344620640 0 -- 172.21.15.62:0/1685651228 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f533c0c53b0 msgr2=0x7f533c0b5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:16.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.263+0000 7f5345622640 0 -- 172.21.15.62:0/1685651228 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55f555560070 msgr2=0x55f5555624e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:16.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.267+0000 7f5349137800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:48:16.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.267+0000 7f5349137800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:48:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.267+0000 7f5349137800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.267+0000 7f5349137800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.267+0000 7f5349137800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.267+0000 7f5349137800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.267+0000 7f5349137800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.267+0000 7f5349137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.267+0000 7f5349137800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.268+0000 7f5349137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.268+0000 7f5349137800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.268+0000 7f5349137800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.268+0000 7f5349137800 20 zone default found 2024-09-12T00:48:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.268+0000 7f5349137800 4 Realm: () 2024-09-12T00:48:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.268+0000 7f5349137800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:48:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.268+0000 7f5349137800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:48:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.268+0000 7f5349137800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.268+0000 7f5349137800 20 zonegroup default 2024-09-12T00:48:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.268+0000 7f5349137800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.268+0000 7f5349137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.268+0000 7f5349137800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.269+0000 7f5349137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.269+0000 7f5349137800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.269+0000 7f5349137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.269+0000 7f5349137800 20 started sync module instance, tier type = 2024-09-12T00:48:16.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.269+0000 7f5349137800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:48:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.279+0000 7f5349137800 20 add_watcher() i=0 2024-09-12T00:48:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.279+0000 7f5349137800 20 add_watcher() i=1 2024-09-12T00:48:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.279+0000 7f5349137800 20 add_watcher() i=2 2024-09-12T00:48:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.279+0000 7f5349137800 20 add_watcher() i=3 2024-09-12T00:48:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.279+0000 7f5349137800 20 add_watcher() i=4 2024-09-12T00:48:16.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.279+0000 7f5349137800 20 add_watcher() i=5 2024-09-12T00:48:16.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.279+0000 7f5349137800 20 add_watcher() i=6 2024-09-12T00:48:16.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.280+0000 7f5349137800 20 add_watcher() i=7 2024-09-12T00:48:16.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.280+0000 7f5349137800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.282+0000 7f51fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.282+0000 7f5349137800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.282+0000 7f5349137800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.283+0000 7f5349137800 5 note: GC not initialized 2024-09-12T00:48:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.283+0000 7f51f9fe3640 20 reqs_thread_entry: start 2024-09-12T00:48:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.283+0000 7f5349137800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.283+0000 7f5349137800 20 Filter name: none 2024-09-12T00:48:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.283+0000 7f516b7fe640 20 reqs_thread_entry: start 2024-09-12T00:48:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.283+0000 7f5349137800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:48:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.283+0000 7f5349137800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.284+0000 7f5349137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.284+0000 7f5349137800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T00:48:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.284+0000 7f5349137800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:48:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.284+0000 7f5349137800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T00:48:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.284+0000 7f5349137800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.284+0000 7f5349137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.284+0000 7f5349137800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T00:48:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.284+0000 7f5349137800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:48:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.284+0000 7f5349137800 10 cache get: name=default.rgw.meta+users.keys+RVMNESKDPBGZHWNZKPNO : miss 2024-09-12T00:48:16.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.284+0000 7f5349137800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.284+0000 7f5349137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.284+0000 7f5349137800 10 cache put: name=default.rgw.meta+users.keys+RVMNESKDPBGZHWNZKPNO info.flags=0x0 2024-09-12T00:48:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.284+0000 7f5349137800 10 adding default.rgw.meta+users.keys+RVMNESKDPBGZHWNZKPNO to cache LRU end 2024-09-12T00:48:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.284+0000 7f5349137800 10 cache get: name=default.rgw.meta+users.keys+RVMNESKDPBGZHWNZKPNO : hit (negative entry) 2024-09-12T00:48:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.284+0000 7f5349137800 10 cache get: name=default.rgw.meta+users.keys+RVMNESKDPBGZHWNZKPNO : hit (negative entry) 2024-09-12T00:48:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.286+0000 7f5349137800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:48:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.286+0000 7f5349137800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:48:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.286+0000 7f5349137800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:48:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.286+0000 7f521bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627827 cookie 94512187123088 notifier 5642 bl.length()=675 2024-09-12T00:48:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.286+0000 7f521bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:48:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.286+0000 7f521bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:48:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.289+0000 7f5349137800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:48:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.289+0000 7f5349137800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:48:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.289+0000 7f5349137800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:48:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.289+0000 7f521b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627787 cookie 94512187118624 notifier 5642 bl.length()=202 2024-09-12T00:48:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.289+0000 7f521b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:48:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.289+0000 7f521b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:48:16.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.292+0000 7f5349137800 10 cache put: name=default.rgw.meta+users.keys+RVMNESKDPBGZHWNZKPNO info.flags=0x7 2024-09-12T00:48:16.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.292+0000 7f5349137800 10 moving default.rgw.meta+users.keys+RVMNESKDPBGZHWNZKPNO to cache LRU end 2024-09-12T00:48:16.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.292+0000 7f5349137800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:RVMNESKDPBGZHWNZKPNO, ofs0, ns] 2024-09-12T00:48:16.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.292+0000 7f521b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627828 cookie 94512187113776 notifier 5642 bl.length()=190 2024-09-12T00:48:16.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.292+0000 7f521b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RVMNESKDPBGZHWNZKPNO info.flags=0x7 2024-09-12T00:48:16.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.292+0000 7f521b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RVMNESKDPBGZHWNZKPNO to cache LRU end 2024-09-12T00:48:16.292 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T00:48:16.292 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "ragweed.client.0", 2024-09-12T00:48:16.293 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T00:48:16.293 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T00:48:16.293 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2024-09-12T00:48:16.293 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2024-09-12T00:48:16.293 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2024-09-12T00:48:16.293 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2024-09-12T00:48:16.293 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T00:48:16.293 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "ragweed.client.0", 2024-09-12T00:48:16.293 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "RVMNESKDPBGZHWNZKPNO", 2024-09-12T00:48:16.293 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "K3K6YTHBLjfOpXpDj9yqqm2RxJg1Zi0UryAfXzl4qGQAEaDIuoKi8Q==", 2024-09-12T00:48:16.293 INFO:teuthology.orchestra.run.smithi062.stdout: "active": true, 2024-09-12T00:48:16.294 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T00:48:16.285791Z" 2024-09-12T00:48:16.294 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T00:48:16.294 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T00:48:16.294 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2024-09-12T00:48:16.294 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2024-09-12T00:48:16.294 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2024-09-12T00:48:16.294 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2024-09-12T00:48:16.294 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2024-09-12T00:48:16.294 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2024-09-12T00:48:16.294 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2024-09-12T00:48:16.294 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T00:48:16.294 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T00:48:16.294 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T00:48:16.295 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T00:48:16.295 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T00:48:16.295 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T00:48:16.295 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2024-09-12T00:48:16.295 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T00:48:16.295 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T00:48:16.295 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T00:48:16.295 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T00:48:16.295 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T00:48:16.295 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T00:48:16.295 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2024-09-12T00:48:16.295 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "rgw", 2024-09-12T00:48:16.295 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [], 2024-09-12T00:48:16.296 INFO:teuthology.orchestra.run.smithi062.stdout: "account_id": "", 2024-09-12T00:48:16.296 INFO:teuthology.orchestra.run.smithi062.stdout: "path": "/", 2024-09-12T00:48:16.296 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T00:48:16.285773Z", 2024-09-12T00:48:16.296 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T00:48:16.296 INFO:teuthology.orchestra.run.smithi062.stdout: "group_ids": [] 2024-09-12T00:48:16.296 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T00:48:16.296 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:48:16.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.294+0000 7f51fafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:16.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.297+0000 7f5349137800 20 remove_watcher() i=0 2024-09-12T00:48:16.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.297+0000 7f5349137800 2 removed watcher, disabling cache 2024-09-12T00:48:16.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.298+0000 7f5349137800 20 remove_watcher() i=1 2024-09-12T00:48:16.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.299+0000 7f5349137800 20 remove_watcher() i=2 2024-09-12T00:48:16.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.300+0000 7f5349137800 20 remove_watcher() i=3 2024-09-12T00:48:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.301+0000 7f5349137800 20 remove_watcher() i=4 2024-09-12T00:48:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.302+0000 7f5349137800 20 remove_watcher() i=5 2024-09-12T00:48:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.303+0000 7f5349137800 20 remove_watcher() i=6 2024-09-12T00:48:16.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.305+0000 7f5349137800 20 remove_watcher() i=7 2024-09-12T00:48:16.315 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T00:48:16.315 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key PIZXCQXGRRHSHRJFLKNN --secret 7RXu6Crb7jPdiwAjYAjt+peBBXtgPjGice8EtTyUZ0ChBlKGOviEHA== --email sysuser.client.0+test@test.test --system true 2024-09-12T00:48:16.383 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:16.383 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:16.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.419+0000 7f567ba87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.421+0000 7f567ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.421+0000 7f567ba87800 20 realm 2024-09-12T00:48:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.421+0000 7f567ba87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.421+0000 7f567ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.421+0000 7f567ba87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.421+0000 7f567ba87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.422+0000 7f567ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.422+0000 7f567ba87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.422+0000 7f567ba87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:16.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.422+0000 7f567ba87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.423+0000 7f567ba87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:16.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.423+0000 7f567ba87800 20 searching for the correct realm 2024-09-12T00:48:16.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.426+0000 7f5678d70640 0 -- 172.21.15.62:0/566855097 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f567401f420 msgr2=0x7f567401f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:16.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.631+0000 7f5679d72640 0 -- 172.21.15.62:0/566855097 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55c0a3a1fc90 msgr2=0x55c0a3a22150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.636+0000 7f567ba87800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:48:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.636+0000 7f567ba87800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:48:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.636+0000 7f567ba87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.636+0000 7f567ba87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.636+0000 7f567ba87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.636+0000 7f567ba87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.636+0000 7f567ba87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.636+0000 7f567ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.636+0000 7f567ba87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.636+0000 7f567ba87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.636+0000 7f567ba87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.637+0000 7f567ba87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.637+0000 7f567ba87800 20 zone default found 2024-09-12T00:48:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.637+0000 7f567ba87800 4 Realm: () 2024-09-12T00:48:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.637+0000 7f567ba87800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:48:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.637+0000 7f567ba87800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:48:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.637+0000 7f567ba87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.637+0000 7f567ba87800 20 zonegroup default 2024-09-12T00:48:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.637+0000 7f567ba87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.637+0000 7f567ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.637+0000 7f567ba87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.637+0000 7f567ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.637+0000 7f567ba87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.638+0000 7f567ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.638+0000 7f567ba87800 20 started sync module instance, tier type = 2024-09-12T00:48:16.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.638+0000 7f567ba87800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:48:16.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.647+0000 7f567ba87800 20 add_watcher() i=0 2024-09-12T00:48:16.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.647+0000 7f567ba87800 20 add_watcher() i=1 2024-09-12T00:48:16.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.647+0000 7f567ba87800 20 add_watcher() i=2 2024-09-12T00:48:16.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.647+0000 7f567ba87800 20 add_watcher() i=3 2024-09-12T00:48:16.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.647+0000 7f567ba87800 20 add_watcher() i=4 2024-09-12T00:48:16.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.647+0000 7f567ba87800 20 add_watcher() i=5 2024-09-12T00:48:16.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.647+0000 7f567ba87800 20 add_watcher() i=6 2024-09-12T00:48:16.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.649+0000 7f567ba87800 20 add_watcher() i=7 2024-09-12T00:48:16.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.649+0000 7f567ba87800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:16.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.650+0000 7f552ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:16.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.650+0000 7f567ba87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:16.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.650+0000 7f567ba87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:16.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.650+0000 7f567ba87800 5 note: GC not initialized 2024-09-12T00:48:16.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.651+0000 7f552efe5640 20 reqs_thread_entry: start 2024-09-12T00:48:16.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.651+0000 7f567ba87800 20 init_complete bucket index max shards: 1 2024-09-12T00:48:16.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.651+0000 7f567ba87800 20 Filter name: none 2024-09-12T00:48:16.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.651+0000 7f552cfe1640 20 reqs_thread_entry: start 2024-09-12T00:48:16.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.651+0000 7f567ba87800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:48:16.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.651+0000 7f567ba87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.651+0000 7f567ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.651+0000 7f567ba87800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T00:48:16.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.651+0000 7f567ba87800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:48:16.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.651+0000 7f567ba87800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T00:48:16.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.651+0000 7f567ba87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.652+0000 7f567ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.652+0000 7f567ba87800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T00:48:16.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.652+0000 7f567ba87800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:48:16.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.652+0000 7f567ba87800 10 cache get: name=default.rgw.meta+users.keys+PIZXCQXGRRHSHRJFLKNN : miss 2024-09-12T00:48:16.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.652+0000 7f567ba87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.652+0000 7f567ba87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.652+0000 7f567ba87800 10 cache put: name=default.rgw.meta+users.keys+PIZXCQXGRRHSHRJFLKNN info.flags=0x0 2024-09-12T00:48:16.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.652+0000 7f567ba87800 10 adding default.rgw.meta+users.keys+PIZXCQXGRRHSHRJFLKNN to cache LRU end 2024-09-12T00:48:16.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.652+0000 7f567ba87800 10 cache get: name=default.rgw.meta+users.keys+PIZXCQXGRRHSHRJFLKNN : hit (negative entry) 2024-09-12T00:48:16.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.652+0000 7f567ba87800 10 cache get: name=default.rgw.meta+users.keys+PIZXCQXGRRHSHRJFLKNN : hit (negative entry) 2024-09-12T00:48:16.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.654+0000 7f567ba87800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:48:16.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.654+0000 7f567ba87800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:48:16.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.654+0000 7f567ba87800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:48:16.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.654+0000 7f555cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627788 cookie 94285867455008 notifier 5660 bl.length()=675 2024-09-12T00:48:16.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.654+0000 7f555cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:48:16.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.654+0000 7f555cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:48:16.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.658+0000 7f567ba87800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:48:16.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.658+0000 7f567ba87800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:48:16.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.658+0000 7f567ba87800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:48:16.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.658+0000 7f554bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627829 cookie 94285867460448 notifier 5660 bl.length()=202 2024-09-12T00:48:16.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.658+0000 7f554bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:48:16.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.658+0000 7f554bfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:48:16.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.661+0000 7f567ba87800 10 cache put: name=default.rgw.meta+users.keys+PIZXCQXGRRHSHRJFLKNN info.flags=0x7 2024-09-12T00:48:16.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.661+0000 7f567ba87800 10 moving default.rgw.meta+users.keys+PIZXCQXGRRHSHRJFLKNN to cache LRU end 2024-09-12T00:48:16.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.661+0000 7f567ba87800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:PIZXCQXGRRHSHRJFLKNN, ofs0, ns] 2024-09-12T00:48:16.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.661+0000 7f554bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1099511627792 cookie 94285867390032 notifier 5660 bl.length()=190 2024-09-12T00:48:16.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.661+0000 7f554bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+PIZXCQXGRRHSHRJFLKNN info.flags=0x7 2024-09-12T00:48:16.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.661+0000 7f554bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+PIZXCQXGRRHSHRJFLKNN to cache LRU end 2024-09-12T00:48:16.661 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T00:48:16.661 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "sysuser.client.0", 2024-09-12T00:48:16.661 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T00:48:16.662 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T00:48:16.662 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2024-09-12T00:48:16.662 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2024-09-12T00:48:16.662 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2024-09-12T00:48:16.662 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2024-09-12T00:48:16.662 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T00:48:16.662 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "sysuser.client.0", 2024-09-12T00:48:16.662 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "PIZXCQXGRRHSHRJFLKNN", 2024-09-12T00:48:16.662 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "7RXu6Crb7jPdiwAjYAjt+peBBXtgPjGice8EtTyUZ0ChBlKGOviEHA==", 2024-09-12T00:48:16.662 INFO:teuthology.orchestra.run.smithi062.stdout: "active": true, 2024-09-12T00:48:16.662 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T00:48:16.653416Z" 2024-09-12T00:48:16.662 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T00:48:16.662 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T00:48:16.662 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2024-09-12T00:48:16.663 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2024-09-12T00:48:16.663 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2024-09-12T00:48:16.663 INFO:teuthology.orchestra.run.smithi062.stdout: "system": true, 2024-09-12T00:48:16.663 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2024-09-12T00:48:16.663 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2024-09-12T00:48:16.663 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2024-09-12T00:48:16.663 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2024-09-12T00:48:16.663 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T00:48:16.663 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T00:48:16.663 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T00:48:16.663 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T00:48:16.663 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T00:48:16.663 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T00:48:16.663 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2024-09-12T00:48:16.664 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T00:48:16.664 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T00:48:16.664 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T00:48:16.664 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T00:48:16.664 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T00:48:16.664 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T00:48:16.664 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2024-09-12T00:48:16.664 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "rgw", 2024-09-12T00:48:16.664 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [], 2024-09-12T00:48:16.664 INFO:teuthology.orchestra.run.smithi062.stdout: "account_id": "", 2024-09-12T00:48:16.664 INFO:teuthology.orchestra.run.smithi062.stdout: "path": "/", 2024-09-12T00:48:16.664 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T00:48:16.653390Z", 2024-09-12T00:48:16.664 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T00:48:16.665 INFO:teuthology.orchestra.run.smithi062.stdout: "group_ids": [] 2024-09-12T00:48:16.665 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T00:48:16.665 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:48:16.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.663+0000 7f552ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:16.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.666+0000 7f567ba87800 20 remove_watcher() i=0 2024-09-12T00:48:16.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.666+0000 7f567ba87800 2 removed watcher, disabling cache 2024-09-12T00:48:16.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.667+0000 7f567ba87800 20 remove_watcher() i=1 2024-09-12T00:48:16.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.668+0000 7f567ba87800 20 remove_watcher() i=2 2024-09-12T00:48:16.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.669+0000 7f567ba87800 20 remove_watcher() i=3 2024-09-12T00:48:16.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.670+0000 7f567ba87800 20 remove_watcher() i=4 2024-09-12T00:48:16.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.671+0000 7f567ba87800 20 remove_watcher() i=5 2024-09-12T00:48:16.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.672+0000 7f567ba87800 20 remove_watcher() i=6 2024-09-12T00:48:16.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:48:16.674+0000 7f567ba87800 20 remove_watcher() i=7 2024-09-12T00:48:16.684 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T00:48:16.684 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:48:16.685 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T00:48:16.715 INFO:tasks.ragweed:Configuring boto... 2024-09-12T00:48:16.715 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:48:16.715 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T00:48:16.784 DEBUG:teuthology.orchestra.run.smithi062:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T00:48:16.979 INFO:teuthology.orchestra.run.smithi062.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T00:48:17.146 INFO:teuthology.orchestra.run.smithi062.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T00:48:17.751 INFO:teuthology.orchestra.run.smithi062.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:48:24.026 INFO:teuthology.orchestra.run.smithi062.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T00:48:27.572 INFO:teuthology.orchestra.run.smithi062.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=fdddddafeae8192ac692f9744c4d58666975cb8ad2834ec51f724febaf8ed8e9,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-12T00:48:27.573 INFO:teuthology.orchestra.run.smithi062.stdout:py run-test-pre: PYTHONHASHSEED='1650991557' 2024-09-12T00:48:27.573 INFO:teuthology.orchestra.run.smithi062.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T00:48:27.776 INFO:teuthology.orchestra.run.smithi062.stdout:============================= test session starts ============================== 2024-09-12T00:48:27.776 INFO:teuthology.orchestra.run.smithi062.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T00:48:27.777 INFO:teuthology.orchestra.run.smithi062.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:48:27.777 INFO:teuthology.orchestra.run.smithi062.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:48:27.777 INFO:teuthology.orchestra.run.smithi062.stdout:configfile: pytest.ini 2024-09-12T00:48:27.877 INFO:teuthology.orchestra.run.smithi062.stdout:collecting ... collected 9 items 2024-09-12T00:48:27.877 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:48:30.030 INFO:teuthology.orchestra.run.smithi062.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T00:48:32.261 INFO:teuthology.orchestra.run.smithi062.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T00:48:34.197 INFO:teuthology.orchestra.run.smithi062.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T00:48:36.707 INFO:teuthology.orchestra.run.smithi062.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T00:48:40.518 INFO:teuthology.orchestra.run.smithi062.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T00:48:48.689 INFO:teuthology.orchestra.run.smithi062.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T00:48:53.363 INFO:teuthology.orchestra.run.smithi062.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T00:48:58.147 INFO:teuthology.orchestra.run.smithi062.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T00:49:06.836 INFO:teuthology.orchestra.run.smithi062.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T00:49:06.836 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:49:06.836 INFO:teuthology.orchestra.run.smithi062.stdout:=============================== warnings summary =============================== 2024-09-12T00:49:06.836 INFO:teuthology.orchestra.run.smithi062.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T00:49:06.836 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T00:49:06.836 INFO:teuthology.orchestra.run.smithi062.stdout: import imp 2024-09-12T00:49:06.836 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:49:06.837 INFO:teuthology.orchestra.run.smithi062.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T00:49:06.837 INFO:teuthology.orchestra.run.smithi062.stdout:======================== 9 passed, 1 warning in 39.06s ========================= 2024-09-12T00:49:06.867 INFO:teuthology.orchestra.run.smithi062.stdout:___________________________________ summary ____________________________________ 2024-09-12T00:49:06.867 INFO:teuthology.orchestra.run.smithi062.stdout: py: commands succeeded 2024-09-12T00:49:06.867 INFO:teuthology.orchestra.run.smithi062.stdout: congratulations :) 2024-09-12T00:49:06.885 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T00:49:06.885 DEBUG:teuthology.orchestra.run.smithi062:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T00:49:06.915 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T00:49:07.014 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:07.014 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:07.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.051+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.053+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.053+0000 7fb46c126800 20 realm 2024-09-12T00:49:07.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.053+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.053+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.053+0000 7fb46c126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:07.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.053+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.053+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.053+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.054+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:07.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.054+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.054+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:07.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.054+0000 7fb46c126800 20 searching for the correct realm 2024-09-12T00:49:07.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.057+0000 7fb46755c640 0 -- 172.21.15.62:0/3114797780 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fb460065b20 msgr2=0x7fb460064110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:07.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.262+0000 7fb46855e640 0 -- 172.21.15.62:0/3114797780 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x556ba9208300 msgr2=0x556ba920a790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:07.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.267+0000 7fb46c126800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:49:07.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.267+0000 7fb46c126800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:49:07.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.267+0000 7fb46c126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:07.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.267+0000 7fb46c126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:07.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.267+0000 7fb46c126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:07.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.267+0000 7fb46c126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:07.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.267+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.267+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.267+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.267+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:07.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.267+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.268+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:07.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.268+0000 7fb46c126800 20 zone default found 2024-09-12T00:49:07.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.268+0000 7fb46c126800 4 Realm: () 2024-09-12T00:49:07.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.268+0000 7fb46c126800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:49:07.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.268+0000 7fb46c126800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:49:07.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.268+0000 7fb46c126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:07.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.268+0000 7fb46c126800 20 zonegroup default 2024-09-12T00:49:07.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.268+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.268+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.268+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.269+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.269+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.269+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.269+0000 7fb46c126800 20 started sync module instance, tier type = 2024-09-12T00:49:07.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.269+0000 7fb46c126800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:49:07.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.279+0000 7fb46c126800 20 add_watcher() i=0 2024-09-12T00:49:07.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.279+0000 7fb46c126800 20 add_watcher() i=1 2024-09-12T00:49:07.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.279+0000 7fb46c126800 20 add_watcher() i=2 2024-09-12T00:49:07.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.279+0000 7fb46c126800 20 add_watcher() i=3 2024-09-12T00:49:07.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.279+0000 7fb46c126800 20 add_watcher() i=4 2024-09-12T00:49:07.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.279+0000 7fb46c126800 20 add_watcher() i=5 2024-09-12T00:49:07.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.279+0000 7fb46c126800 20 add_watcher() i=6 2024-09-12T00:49:07.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.280+0000 7fb46c126800 20 add_watcher() i=7 2024-09-12T00:49:07.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.280+0000 7fb46c126800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:07.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.282+0000 7fb31dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:07.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.282+0000 7fb46c126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:07.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.282+0000 7fb46c126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:07.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.320+0000 7fb31cfe1640 20 reqs_thread_entry: start 2024-09-12T00:49:07.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.321+0000 7fb46c126800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:07.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.321+0000 7fb46c126800 20 Filter name: none 2024-09-12T00:49:07.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.321+0000 7fb2967fc640 20 reqs_thread_entry: start 2024-09-12T00:49:07.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.321+0000 7fb46c126800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:49:07.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.321+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.321+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:49:07.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.321+0000 7fb46c126800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T00:49:07.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.321+0000 7fb46c126800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:49:07.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.321+0000 7fb46c126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:07.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.322+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4 : miss 2024-09-12T00:49:07.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.322+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.323+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T00:49:07.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.323+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4 info.flags=0x17 2024-09-12T00:49:07.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.323+0000 7fb46c126800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4 to cache LRU end 2024-09-12T00:49:07.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.323+0000 7fb46c126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:07.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.323+0000 7fb46c126800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:49:07.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.323+0000 7fb46c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4 2024-09-12T00:49:07.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.323+0000 7fb46c126800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T00:49:07.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.323+0000 7fb46c126800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T00:49:07.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.323+0000 7fb46c126800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T00:49:07.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.323+0000 7fb46c126800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T00:49:07.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.323+0000 7fb46c126800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T00:49:07.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.323+0000 7fb46c126800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T00:49:07.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.323+0000 7fb46c126800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T00:49:07.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.323+0000 7fb46c126800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:49:07.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.323+0000 7fb46c126800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T00:49:07.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.324+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x556ba92d5098 s->prefetch_data=0 2024-09-12T00:49:07.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.324+0000 7fb46c126800 10 manifest: total_size = 7546 2024-09-12T00:49:07.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.324+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13078076143638528540 2024-09-12T00:49:07.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.324+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x556ba92d5098 s->prefetch_data=0 2024-09-12T00:49:07.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.324+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba92d5098 2024-09-12T00:49:07.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.324+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4.0 2024-09-12T00:49:07.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.326+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.326+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=7546 stripe_ofs=7546 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.326+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13078076143638528540 2024-09-12T00:49:07.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.326+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.326+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.aWsiq6TgTNd59Jx8-eAP2mXLwfbMXVa_0 2024-09-12T00:49:07.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.326+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:49:07.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.326+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.326+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13078076143638528540 2024-09-12T00:49:07.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.328+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T00:49:07.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.328+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.328+0000 7fb46c126800 10 manifest: total_size = 5227 2024-09-12T00:49:07.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.328+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5700943695807861787 2024-09-12T00:49:07.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.328+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.328+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba925d5a8 2024-09-12T00:49:07.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.329+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4.0 2024-09-12T00:49:07.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.331+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.331+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5227 stripe_ofs=5227 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.331+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5700943695807861787 2024-09-12T00:49:07.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.331+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.331+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.2mAwp8GjCMQ95j9_bTwsO4QVVsgf-8V_0 2024-09-12T00:49:07.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.331+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:49:07.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.331+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.331+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5700943695807861787 2024-09-12T00:49:07.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.332+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T00:49:07.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.332+0000 7fb46c126800 20 get_obj_state: octx=0x556ba925ebf0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.333+0000 7fb46c126800 10 manifest: total_size = 5096 2024-09-12T00:49:07.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.333+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.244920165361680749 2024-09-12T00:49:07.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.333+0000 7fb46c126800 20 get_obj_state: octx=0x556ba925ebf0 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.333+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba925d5a8 2024-09-12T00:49:07.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.333+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4.0 2024-09-12T00:49:07.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.335+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.335+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5096 stripe_ofs=5096 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.335+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.244920165361680749 2024-09-12T00:49:07.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.335+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.335+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.LXtGQ4DgVGNuPGSm3kTbL_2FzU_1DwH_0 2024-09-12T00:49:07.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.335+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-12T00:49:07.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.335+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.335+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.244920165361680749 2024-09-12T00:49:07.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.336+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T00:49:07.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.337+0000 7fb46c126800 20 get_obj_state: octx=0x7fb458096ff0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.337+0000 7fb46c126800 10 manifest: total_size = 7512 2024-09-12T00:49:07.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.337+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6847261160313121772 2024-09-12T00:49:07.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.337+0000 7fb46c126800 20 get_obj_state: octx=0x7fb458096ff0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.337+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba925d5a8 2024-09-12T00:49:07.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.337+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4.0 2024-09-12T00:49:07.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.339+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.339+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=7512 stripe_ofs=7512 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.339+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6847261160313121772 2024-09-12T00:49:07.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.339+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.339+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.RZj5Qty7BObAOpAq0hrDCFLSgwmszud_0 2024-09-12T00:49:07.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.339+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:49:07.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.339+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.339+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6847261160313121772 2024-09-12T00:49:07.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.341+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T00:49:07.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.341+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.341+0000 7fb46c126800 10 manifest: total_size = 7539 2024-09-12T00:49:07.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.341+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2464166650111924541 2024-09-12T00:49:07.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.341+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.341+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba925d5a8 2024-09-12T00:49:07.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.341+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4.0 2024-09-12T00:49:07.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.344+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.344+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=7539 stripe_ofs=7539 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.344+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2464166650111924541 2024-09-12T00:49:07.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.344+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.344+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.JT0_XY812qqaQNjc9st_deu9eUJc-S__0 2024-09-12T00:49:07.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.344+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:49:07.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.344+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.344+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2464166650111924541 2024-09-12T00:49:07.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.345+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T00:49:07.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.345+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.346+0000 7fb46c126800 10 manifest: total_size = 5010 2024-09-12T00:49:07.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.346+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15370542712908517411 2024-09-12T00:49:07.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.346+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.346+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba925d5a8 2024-09-12T00:49:07.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.346+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4.0 2024-09-12T00:49:07.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.348+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.348+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5010 stripe_ofs=5010 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.348+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15370542712908517411 2024-09-12T00:49:07.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.348+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.348+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.n4Y2BoW11WBv_m5xN32QK7aUrSS1nti_0 2024-09-12T00:49:07.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.348+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:49:07.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.348+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.348+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15370542712908517411 2024-09-12T00:49:07.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.349+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T00:49:07.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.350+0000 7fb46c126800 20 get_obj_state: octx=0x556ba925e350 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.350+0000 7fb46c126800 10 manifest: total_size = 5396 2024-09-12T00:49:07.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.350+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12889769836932602055 2024-09-12T00:49:07.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.350+0000 7fb46c126800 20 get_obj_state: octx=0x556ba925e350 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.350+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba925d5a8 2024-09-12T00:49:07.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.350+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4.0 2024-09-12T00:49:07.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.352+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.352+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5396 stripe_ofs=5396 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.352+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12889769836932602055 2024-09-12T00:49:07.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.352+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.352+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.sPjFBf8EWitz_dZflrvzlPNJrfKceHa_0 2024-09-12T00:49:07.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.352+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:49:07.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.352+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.352+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12889769836932602055 2024-09-12T00:49:07.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.353+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T00:49:07.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.354+0000 7fb46c126800 20 get_obj_state: octx=0x556ba925e350 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.354+0000 7fb46c126800 10 manifest: total_size = 5301 2024-09-12T00:49:07.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.354+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10116059046243094617 2024-09-12T00:49:07.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.354+0000 7fb46c126800 20 get_obj_state: octx=0x556ba925e350 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.354+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba925d5a8 2024-09-12T00:49:07.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.354+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4.0 2024-09-12T00:49:07.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.357+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.357+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5301 stripe_ofs=5301 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.357+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10116059046243094617 2024-09-12T00:49:07.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.357+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.357+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.bqWlL06xN0HwJ3lKR2KGibcAOKAOz9g_0 2024-09-12T00:49:07.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.357+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:49:07.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.357+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.357+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10116059046243094617 2024-09-12T00:49:07.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.358+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:49:07.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.358+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c090410 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.359+0000 7fb46c126800 10 manifest: total_size = 5363 2024-09-12T00:49:07.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.359+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2527009589384545750 2024-09-12T00:49:07.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.359+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c090410 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.359+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba925d5a8 2024-09-12T00:49:07.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.359+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4.0 2024-09-12T00:49:07.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.361+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.361+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5363 stripe_ofs=5363 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.361+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2527009589384545750 2024-09-12T00:49:07.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.361+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.361+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.HB3mu3Da1xl7hDzRvZjyljdBA4k06Md_0 2024-09-12T00:49:07.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.361+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:49:07.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.361+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.361+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2527009589384545750 2024-09-12T00:49:07.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.362+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T00:49:07.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.362+0000 7fb46c126800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:49:07.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.362+0000 7fb46c126800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:49:07.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.363+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:49:07.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.363+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:49:07.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.363+0000 7fb46c126800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:49:07.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.363+0000 7fb46c126800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:49:07.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.363+0000 7fb46c126800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4])"; uploads.size()=0; is_truncated=0 2024-09-12T00:49:07.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.364+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T00:49:07.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.364+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.365+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T00:49:07.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.365+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T00:49:07.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.365+0000 7fb46c126800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T00:49:07.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.366+0000 7fb46c126800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T00:49:07.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.366+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T00:49:07.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.366+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431573 cookie 93920887349968 notifier 5687 bl.length()=162 2024-09-12T00:49:07.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.369+0000 7fb46c126800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4 from cache 2024-09-12T00:49:07.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.369+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4, ofs0, ns] 2024-09-12T00:49:07.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.369+0000 7fb346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431625 cookie 93920887420208 notifier 5687 bl.length()=219 2024-09-12T00:49:07.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.371+0000 7fb46c126800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4 : miss 2024-09-12T00:49:07.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.371+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.371+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.371+0000 7fb46c126800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4 info.flags=0x0 2024-09-12T00:49:07.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.371+0000 7fb46c126800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4 to cache LRU end 2024-09-12T00:49:07.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.373+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11 : miss 2024-09-12T00:49:07.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.373+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.374+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T00:49:07.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.374+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11 info.flags=0x17 2024-09-12T00:49:07.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.374+0000 7fb46c126800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11 to cache LRU end 2024-09-12T00:49:07.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.374+0000 7fb46c126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:07.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.374+0000 7fb46c126800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:49:07.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.374+0000 7fb46c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11 2024-09-12T00:49:07.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.375+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:49:07.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.375+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c090410 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.375+0000 7fb46c126800 10 manifest: total_size = 18874368 2024-09-12T00:49:07.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.375+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2103710606034193721 2024-09-12T00:49:07.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.375+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c090410 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x556ba925d5a8 s->prefetch_data=0 2024-09-12T00:49:07.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.375+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba925d5a8 2024-09-12T00:49:07.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.375+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11.0 2024-09-12T00:49:07.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:49:07.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:49:07.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:49:07.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:49:07.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:49:07.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:49:07.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:49:07.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:49:07.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:49:07.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T00:49:07.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=22020096 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:49:07.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T00:49:07.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2103710606034193721 2024-09-12T00:49:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11__multipart_foo.2~PgvCP2onVJlEsMH6yjEXH8I7q4ZWBV1.1 2024-09-12T00:49:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:49:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11__multipart_foo.2~PgvCP2onVJlEsMH6yjEXH8I7q4ZWBV1.2 2024-09-12T00:49:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:49:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11__multipart_foo.2~PgvCP2onVJlEsMH6yjEXH8I7q4ZWBV1.3 2024-09-12T00:49:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:49:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11__multipart_foo.2~PgvCP2onVJlEsMH6yjEXH8I7q4ZWBV1.4 2024-09-12T00:49:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:49:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.377+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2103710606034193721 2024-09-12T00:49:07.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.378+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:49:07.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.379+0000 7fb46c126800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:49:07.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.379+0000 7fb46c126800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:49:07.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.379+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:49:07.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.379+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:49:07.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.379+0000 7fb46c126800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:49:07.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.379+0000 7fb46c126800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:49:07.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.379+0000 7fb46c126800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11])"; uploads.size()=0; is_truncated=0 2024-09-12T00:49:07.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.381+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T00:49:07.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.381+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.381+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T00:49:07.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.381+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T00:49:07.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.381+0000 7fb46c126800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T00:49:07.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.382+0000 7fb46c126800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T00:49:07.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.382+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T00:49:07.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.382+0000 7fb346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431615 cookie 93920887409040 notifier 5687 bl.length()=191 2024-09-12T00:49:07.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.385+0000 7fb46c126800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11 from cache 2024-09-12T00:49:07.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.385+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11, ofs0, ns] 2024-09-12T00:49:07.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.385+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431616 cookie 93920887409040 notifier 5687 bl.length()=249 2024-09-12T00:49:07.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.388+0000 7fb46c126800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11 : miss 2024-09-12T00:49:07.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.388+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.388+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.388+0000 7fb46c126800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11 info.flags=0x0 2024-09-12T00:49:07.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.388+0000 7fb46c126800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11 to cache LRU end 2024-09-12T00:49:07.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.390+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12 : miss 2024-09-12T00:49:07.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.390+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.391+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T00:49:07.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.391+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12 info.flags=0x17 2024-09-12T00:49:07.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.391+0000 7fb46c126800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12 to cache LRU end 2024-09-12T00:49:07.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.391+0000 7fb46c126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:07.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.391+0000 7fb46c126800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:49:07.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.391+0000 7fb46c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12 2024-09-12T00:49:07.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.391+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:49:07.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.391+0000 7fb46c126800 20 get_obj_state: octx=0x556ba92567b0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.392+0000 7fb46c126800 10 manifest: total_size = 26081 2024-09-12T00:49:07.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.392+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18136700819666902748 2024-09-12T00:49:07.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.392+0000 7fb46c126800 20 get_obj_state: octx=0x556ba92567b0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.392+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.392+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12.0 2024-09-12T00:49:07.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-09-12T00:49:07.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2024-09-12T00:49:07.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7672 2024-09-12T00:49:07.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-12T00:49:07.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6299127 part_ofs=7671 rule->part_size=7672 2024-09-12T00:49:07.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=7671 2024-09-12T00:49:07.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-09-12T00:49:07.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6306799 part_ofs=15343 rule->part_size=7671 2024-09-12T00:49:07.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=23014 stripe_ofs=23014 part_ofs=23014 rule->part_size=3067 2024-09-12T00:49:07.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-12T00:49:07.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6314470 part_ofs=23014 rule->part_size=3067 2024-09-12T00:49:07.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=26081 stripe_ofs=26081 part_ofs=26081 rule->part_size=3067 2024-09-12T00:49:07.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18136700819666902748 2024-09-12T00:49:07.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12__multipart_foo.2~R1LdMZ7aqSMeT4ujNiYPiJt1y5zgfNT.1 2024-09-12T00:49:07.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:49:07.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12__multipart_foo.2~R1LdMZ7aqSMeT4ujNiYPiJt1y5zgfNT.2 2024-09-12T00:49:07.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T00:49:07.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12__multipart_foo.2~R1LdMZ7aqSMeT4ujNiYPiJt1y5zgfNT.3 2024-09-12T00:49:07.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T00:49:07.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12__multipart_foo.2~R1LdMZ7aqSMeT4ujNiYPiJt1y5zgfNT.4 2024-09-12T00:49:07.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T00:49:07.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.394+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18136700819666902748 2024-09-12T00:49:07.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.396+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:49:07.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.396+0000 7fb46c126800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:49:07.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.396+0000 7fb46c126800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:49:07.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.396+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:49:07.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.396+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:49:07.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.396+0000 7fb46c126800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:49:07.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.396+0000 7fb46c126800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:49:07.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.396+0000 7fb46c126800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12])"; uploads.size()=0; is_truncated=0 2024-09-12T00:49:07.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.398+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T00:49:07.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.398+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.398+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T00:49:07.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.398+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T00:49:07.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.398+0000 7fb46c126800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T00:49:07.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.399+0000 7fb46c126800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T00:49:07.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.399+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T00:49:07.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.399+0000 7fb346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431569 cookie 93920887410096 notifier 5687 bl.length()=198 2024-09-12T00:49:07.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.402+0000 7fb46c126800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12 from cache 2024-09-12T00:49:07.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.402+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12, ofs0, ns] 2024-09-12T00:49:07.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.402+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431626 cookie 93920887422848 notifier 5687 bl.length()=256 2024-09-12T00:49:07.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.404+0000 7fb46c126800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12 : miss 2024-09-12T00:49:07.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.404+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.404+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.404+0000 7fb46c126800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12 info.flags=0x0 2024-09-12T00:49:07.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.404+0000 7fb46c126800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12 to cache LRU end 2024-09-12T00:49:07.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.407+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10 : miss 2024-09-12T00:49:07.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.407+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.407+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T00:49:07.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.407+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10 info.flags=0x17 2024-09-12T00:49:07.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.407+0000 7fb46c126800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10 to cache LRU end 2024-09-12T00:49:07.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.407+0000 7fb46c126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:07.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.407+0000 7fb46c126800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:49:07.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.407+0000 7fb46c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10 2024-09-12T00:49:07.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.408+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo[LrQdEb2LjdeiSmXGCVRzp6RC5qJ2g0E] 2024-09-12T00:49:07.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.408+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10.0 2024-09-12T00:49:07.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.408+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.409+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 291fuhqgcx1t8o1pjlu8qlo7rk9whtrm 2024-09-12T00:49:07.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.409+0000 7fb46c126800 20 get_obj_state_impl: setting s->olh_tag to byxmka5brra4cdn8gbaiaomaskazcpxr 2024-09-12T00:49:07.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.409+0000 7fb46c126800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=byxmka5brra4cdn8gbaiaomaskazcpxr 2024-09-12T00:49:07.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.410+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10.0 2024-09-12T00:49:07.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.411+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10.0 2024-09-12T00:49:07.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.411+0000 7fb46c126800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T00:49:07.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.411+0000 7fb46c126800 20 olh_log_entry: epoch=3 op=3 key=foo[LrQdEb2LjdeiSmXGCVRzp6RC5qJ2g0E] 2024-09-12T00:49:07.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.411+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-r-test-multipart-index-versioning.1:_:LrQdEb2LjdeiSmXGCVRzp6RC5qJ2g0E_foo state=0x556ba926a7b8 s->prefetch_data=0 2024-09-12T00:49:07.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.412+0000 7fb46c126800 10 manifest: total_size = 1667 2024-09-12T00:49:07.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.412+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5366260902040912020 2024-09-12T00:49:07.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.412+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-r-test-multipart-index-versioning.1:_:LrQdEb2LjdeiSmXGCVRzp6RC5qJ2g0E_foo state=0x556ba926a7b8 s->prefetch_data=0 2024-09-12T00:49:07.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.412+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba926a7b8 2024-09-12T00:49:07.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.412+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10.0 2024-09-12T00:49:07.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:49:07.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T00:49:07.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:49:07.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:49:07.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T00:49:07.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T00:49:07.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:49:07.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-12T00:49:07.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T00:49:07.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T00:49:07.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-12T00:49:07.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T00:49:07.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5366260902040912020 2024-09-12T00:49:07.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10__multipart_foo.2~euoSQOmOx70Qhx_U5DP6Ip-oNvkG2xe.1 2024-09-12T00:49:07.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:49:07.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10__multipart_foo.2~euoSQOmOx70Qhx_U5DP6Ip-oNvkG2xe.2 2024-09-12T00:49:07.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:49:07.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10__multipart_foo.2~euoSQOmOx70Qhx_U5DP6Ip-oNvkG2xe.3 2024-09-12T00:49:07.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:49:07.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10__multipart_foo.2~euoSQOmOx70Qhx_U5DP6Ip-oNvkG2xe.4 2024-09-12T00:49:07.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:49:07.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.414+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5366260902040912020 2024-09-12T00:49:07.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.415+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo[LrQdEb2LjdeiSmXGCVRzp6RC5qJ2g0E] 2024-09-12T00:49:07.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.417+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.418+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10.0 2024-09-12T00:49:07.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.419+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10.0 2024-09-12T00:49:07.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.419+0000 7fb46c126800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:49:07.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.419+0000 7fb46c126800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:49:07.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.419+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:49:07.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.419+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:49:07.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.419+0000 7fb46c126800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:49:07.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.419+0000 7fb46c126800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:49:07.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.419+0000 7fb46c126800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10])"; uploads.size()=0; is_truncated=0 2024-09-12T00:49:07.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.421+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T00:49:07.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.421+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.421+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T00:49:07.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.421+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T00:49:07.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.421+0000 7fb46c126800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T00:49:07.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.423+0000 7fb46c126800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T00:49:07.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.423+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T00:49:07.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.423+0000 7fb346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431570 cookie 93920887410096 notifier 5687 bl.length()=193 2024-09-12T00:49:07.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.425+0000 7fb46c126800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10 from cache 2024-09-12T00:49:07.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.425+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10, ofs0, ns] 2024-09-12T00:49:07.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.426+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431617 cookie 93920887417504 notifier 5687 bl.length()=251 2024-09-12T00:49:07.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.428+0000 7fb46c126800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10 : miss 2024-09-12T00:49:07.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.428+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.428+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.428+0000 7fb46c126800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10 info.flags=0x0 2024-09-12T00:49:07.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.428+0000 7fb46c126800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10 to cache LRU end 2024-09-12T00:49:07.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.431+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9 : miss 2024-09-12T00:49:07.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.431+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.431+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:49:07.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.431+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9 info.flags=0x17 2024-09-12T00:49:07.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.431+0000 7fb46c126800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9 to cache LRU end 2024-09-12T00:49:07.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.431+0000 7fb46c126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:07.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.431+0000 7fb46c126800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:49:07.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.431+0000 7fb46c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9 2024-09-12T00:49:07.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.432+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:49:07.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.432+0000 7fb46c126800 20 get_obj_state: octx=0x556ba92d5ea0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.432+0000 7fb46c126800 10 manifest: total_size = 1667 2024-09-12T00:49:07.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.432+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6999453304088803157 2024-09-12T00:49:07.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.432+0000 7fb46c126800 20 get_obj_state: octx=0x556ba92d5ea0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.432+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.432+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9.0 2024-09-12T00:49:07.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:49:07.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T00:49:07.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:49:07.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:49:07.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T00:49:07.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T00:49:07.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:49:07.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-12T00:49:07.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T00:49:07.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T00:49:07.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-12T00:49:07.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T00:49:07.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6999453304088803157 2024-09-12T00:49:07.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9__multipart_foo.2~U0m_TTboebyLRkB_xzjHbyl5oT7tuB-.1 2024-09-12T00:49:07.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2024-09-12T00:49:07.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9__multipart_foo.2~U0m_TTboebyLRkB_xzjHbyl5oT7tuB-.2 2024-09-12T00:49:07.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 588 2024-09-12T00:49:07.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9__multipart_foo.2~U0m_TTboebyLRkB_xzjHbyl5oT7tuB-.3 2024-09-12T00:49:07.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 832 2024-09-12T00:49:07.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9__multipart_foo.2~U0m_TTboebyLRkB_xzjHbyl5oT7tuB-.4 2024-09-12T00:49:07.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1076 2024-09-12T00:49:07.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.435+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6999453304088803157 2024-09-12T00:49:07.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.436+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:49:07.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.436+0000 7fb46c126800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:49:07.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.436+0000 7fb46c126800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:49:07.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.437+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:49:07.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.437+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:49:07.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.437+0000 7fb46c126800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:49:07.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.437+0000 7fb46c126800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:49:07.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.437+0000 7fb46c126800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9])"; uploads.size()=0; is_truncated=0 2024-09-12T00:49:07.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.438+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T00:49:07.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.438+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.438+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:49:07.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.438+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T00:49:07.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.438+0000 7fb46c126800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T00:49:07.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.439+0000 7fb46c126800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T00:49:07.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.439+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T00:49:07.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.440+0000 7fb346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431618 cookie 93920887417504 notifier 5687 bl.length()=183 2024-09-12T00:49:07.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.442+0000 7fb46c126800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9 from cache 2024-09-12T00:49:07.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.442+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9, ofs0, ns] 2024-09-12T00:49:07.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.443+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431572 cookie 93920887414864 notifier 5687 bl.length()=240 2024-09-12T00:49:07.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.445+0000 7fb46c126800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9 : miss 2024-09-12T00:49:07.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.445+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.445+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.445+0000 7fb46c126800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9 info.flags=0x0 2024-09-12T00:49:07.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.445+0000 7fb46c126800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9 to cache LRU end 2024-09-12T00:49:07.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.447+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15 : miss 2024-09-12T00:49:07.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.447+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:49:07.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15 info.flags=0x17 2024-09-12T00:49:07.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15 to cache LRU end 2024-09-12T00:49:07.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:07.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:49:07.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15 2024-09-12T00:49:07.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:49:07.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:49:07.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:49:07.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:49:07.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:49:07.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:49:07.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:49:07.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:49:07.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:49:07.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:49:07.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:49:07.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:49:07.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.448+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.449+0000 7fb46c126800 10 manifest: total_size = 5242880 2024-09-12T00:49:07.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.449+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3536156622096272355 2024-09-12T00:49:07.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.449+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.449+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.449+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15.0 2024-09-12T00:49:07.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.451+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.451+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.451+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3536156622096272355 2024-09-12T00:49:07.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.451+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.451+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.yhhJEn-Q1yAgiSmbem8pdjRuex-ago__0 2024-09-12T00:49:07.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.451+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:49:07.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.451+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.451+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3536156622096272355 2024-09-12T00:49:07.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.452+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:49:07.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.453+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.453+0000 7fb46c126800 10 manifest: total_size = 5242880 2024-09-12T00:49:07.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.453+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17734208575214362076 2024-09-12T00:49:07.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.453+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.453+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.453+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15.0 2024-09-12T00:49:07.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.456+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.456+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.456+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17734208575214362076 2024-09-12T00:49:07.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.456+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.456+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.yhhJEn-Q1yAgiSmbem8pdjRuex-ago__0 2024-09-12T00:49:07.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.456+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:49:07.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.456+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.456+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17734208575214362076 2024-09-12T00:49:07.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.457+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:49:07.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.457+0000 7fb46c126800 20 get_obj_state: octx=0x7fb458065070 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.457+0000 7fb46c126800 10 manifest: total_size = 5242880 2024-09-12T00:49:07.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.457+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to _-dqO5XVzGyrHodrbdQga0Rk6jLxGaWm 2024-09-12T00:49:07.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.457+0000 7fb46c126800 20 get_obj_state: octx=0x7fb458065070 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.457+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.457+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15.0 2024-09-12T00:49:07.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.460+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.460+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.460+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: _-dqO5XVzGyrHodrbdQga0Rk6jLxGaWm 2024-09-12T00:49:07.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.460+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.460+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.IzxRlxgpS_vSAlHbYBy8LywQK7OhdAn_0 2024-09-12T00:49:07.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.460+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:49:07.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.460+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.460+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _-dqO5XVzGyrHodrbdQga0Rk6jLxGaWm 2024-09-12T00:49:07.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.461+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:49:07.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.462+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45804dba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.462+0000 7fb46c126800 10 manifest: total_size = 5242880 2024-09-12T00:49:07.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.462+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to _pyzrXbyp8dd2TIAZEPx0U1o9gzVBSpl 2024-09-12T00:49:07.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.462+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45804dba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.462+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.462+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15.0 2024-09-12T00:49:07.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.464+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.464+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.464+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: _pyzrXbyp8dd2TIAZEPx0U1o9gzVBSpl 2024-09-12T00:49:07.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.464+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.464+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.9oXkdxjIaWodtqrm3fi5grNd4dIh6Gk_0 2024-09-12T00:49:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.464+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:49:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.464+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.464+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _pyzrXbyp8dd2TIAZEPx0U1o9gzVBSpl 2024-09-12T00:49:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.465+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:49:07.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.466+0000 7fb46c126800 20 get_obj_state: octx=0x7fb458065070 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.466+0000 7fb46c126800 10 manifest: total_size = 5242880 2024-09-12T00:49:07.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.466+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3479441248946587522 2024-09-12T00:49:07.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.466+0000 7fb46c126800 20 get_obj_state: octx=0x7fb458065070 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.466+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.466+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15.0 2024-09-12T00:49:07.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.468+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.468+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.468+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3479441248946587522 2024-09-12T00:49:07.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.468+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.468+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.8EyjqqUeTiv9Banl1MxllmsT8C2Ujkd_0 2024-09-12T00:49:07.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.468+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:49:07.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.468+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.468+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3479441248946587522 2024-09-12T00:49:07.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.469+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:49:07.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.471+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45804dba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.472+0000 7fb46c126800 10 manifest: total_size = 5242880 2024-09-12T00:49:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.472+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to _VjHYNoitpObpChx0ev8j_dXn5E00VVH 2024-09-12T00:49:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.472+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45804dba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.472+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.472+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15.0 2024-09-12T00:49:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.474+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.474+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.474+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: _VjHYNoitpObpChx0ev8j_dXn5E00VVH 2024-09-12T00:49:07.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.474+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.474+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.6IXEtS1Ed_BYPuPivzGqy3cVgYgSfEA_0 2024-09-12T00:49:07.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.474+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:49:07.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.474+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.474+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _VjHYNoitpObpChx0ev8j_dXn5E00VVH 2024-09-12T00:49:07.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.475+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:49:07.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.476+0000 7fb46c126800 20 get_obj_state: octx=0x7fb458065070 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.476+0000 7fb46c126800 10 manifest: total_size = 5242880 2024-09-12T00:49:07.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.476+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1380286588746223986 2024-09-12T00:49:07.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.476+0000 7fb46c126800 20 get_obj_state: octx=0x7fb458065070 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.476+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.476+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15.0 2024-09-12T00:49:07.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.479+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.479+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.479+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1380286588746223986 2024-09-12T00:49:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.479+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.479+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.8EyjqqUeTiv9Banl1MxllmsT8C2Ujkd_0 2024-09-12T00:49:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.479+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:49:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.479+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.479+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1380286588746223986 2024-09-12T00:49:07.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.481+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:49:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.481+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.481+0000 7fb46c126800 10 manifest: total_size = 5242880 2024-09-12T00:49:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.481+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to _9BZ04eS7qA_fslWWoOfHE6qHnpYvr5z 2024-09-12T00:49:07.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.481+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a06e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.481+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.481+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15.0 2024-09-12T00:49:07.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.484+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.484+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.484+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: _9BZ04eS7qA_fslWWoOfHE6qHnpYvr5z 2024-09-12T00:49:07.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.484+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.484+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.nS7h-1bH5kpb7knIt5M7b-Nerrgx-ut_0 2024-09-12T00:49:07.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.484+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:49:07.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.484+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.484+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _9BZ04eS7qA_fslWWoOfHE6qHnpYvr5z 2024-09-12T00:49:07.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.485+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:49:07.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.485+0000 7fb46c126800 20 get_obj_state: octx=0x7fb460064ab0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.486+0000 7fb46c126800 10 manifest: total_size = 324647 2024-09-12T00:49:07.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.486+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5326918768902047811 2024-09-12T00:49:07.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.486+0000 7fb46c126800 20 get_obj_state: octx=0x7fb460064ab0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.486+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.486+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15.0 2024-09-12T00:49:07.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.489+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.489+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.489+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5326918768902047811 2024-09-12T00:49:07.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.489+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.489+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.xjSTDEET_FrVac4NNWNCnWCrZeNEZdk_0 2024-09-12T00:49:07.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.489+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T00:49:07.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.489+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.489+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5326918768902047811 2024-09-12T00:49:07.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.490+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:49:07.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.490+0000 7fb46c126800 20 get_obj_state: octx=0x7fb460064ab0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.491+0000 7fb46c126800 10 manifest: total_size = 324647 2024-09-12T00:49:07.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.491+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to _82Wesn3Ak7hx5UK8oeEe5V8Lp8ckmlr 2024-09-12T00:49:07.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.491+0000 7fb46c126800 20 get_obj_state: octx=0x7fb460064ab0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.491+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.491+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15.0 2024-09-12T00:49:07.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.493+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.493+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.493+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: _82Wesn3Ak7hx5UK8oeEe5V8Lp8ckmlr 2024-09-12T00:49:07.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.493+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.493+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.PizaVXjemrnb4OqwhucByL7GXM9hCgQ_0 2024-09-12T00:49:07.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.493+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:49:07.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.493+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.493+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _82Wesn3Ak7hx5UK8oeEe5V8Lp8ckmlr 2024-09-12T00:49:07.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.494+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:49:07.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.494+0000 7fb46c126800 20 get_obj_state: octx=0x7fb460064ab0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.495+0000 7fb46c126800 10 manifest: total_size = 324647 2024-09-12T00:49:07.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.495+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to _BV8IQ8c9GYeLlNqRVBw3bTrVUkMmAlz 2024-09-12T00:49:07.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.495+0000 7fb46c126800 20 get_obj_state: octx=0x7fb460064ab0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.495+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.495+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15.0 2024-09-12T00:49:07.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.497+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.497+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.497+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: _BV8IQ8c9GYeLlNqRVBw3bTrVUkMmAlz 2024-09-12T00:49:07.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.497+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.497+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.eZBltDgB2i0PMlH6VFcNHuIpKFIaiw3_0 2024-09-12T00:49:07.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.497+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:49:07.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.497+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.497+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _BV8IQ8c9GYeLlNqRVBw3bTrVUkMmAlz 2024-09-12T00:49:07.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.498+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:49:07.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.498+0000 7fb46c126800 20 get_obj_state: octx=0x7fb4580b4bd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.499+0000 7fb46c126800 10 manifest: total_size = 324647 2024-09-12T00:49:07.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.499+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9572802845818773631 2024-09-12T00:49:07.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.499+0000 7fb46c126800 20 get_obj_state: octx=0x7fb4580b4bd0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.499+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.499+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15.0 2024-09-12T00:49:07.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.501+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.501+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=324647 stripe_ofs=324647 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.501+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9572802845818773631 2024-09-12T00:49:07.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.501+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.501+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.xjSTDEET_FrVac4NNWNCnWCrZeNEZdk_0 2024-09-12T00:49:07.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.501+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 330 2024-09-12T00:49:07.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.501+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.501+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9572802845818773631 2024-09-12T00:49:07.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.502+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:49:07.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.503+0000 7fb46c126800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:49:07.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.503+0000 7fb46c126800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:49:07.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.503+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:49:07.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.503+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:49:07.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.503+0000 7fb46c126800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:49:07.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.503+0000 7fb46c126800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:49:07.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.503+0000 7fb46c126800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15])"; uploads.size()=0; is_truncated=0 2024-09-12T00:49:07.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.504+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T00:49:07.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.504+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.505+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T00:49:07.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.505+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T00:49:07.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.505+0000 7fb46c126800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T00:49:07.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.506+0000 7fb46c126800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T00:49:07.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.506+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T00:49:07.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.507+0000 7fb346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431571 cookie 93920887410096 notifier 5687 bl.length()=189 2024-09-12T00:49:07.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.509+0000 7fb46c126800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15 from cache 2024-09-12T00:49:07.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.509+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15, ofs0, ns] 2024-09-12T00:49:07.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.510+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431619 cookie 93920887417504 notifier 5687 bl.length()=247 2024-09-12T00:49:07.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.512+0000 7fb46c126800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15 : miss 2024-09-12T00:49:07.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.512+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.513+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.513+0000 7fb46c126800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15 info.flags=0x0 2024-09-12T00:49:07.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.513+0000 7fb46c126800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15 to cache LRU end 2024-09-12T00:49:07.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.514+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16 : miss 2024-09-12T00:49:07.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.514+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.515+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:49:07.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.515+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16 info.flags=0x17 2024-09-12T00:49:07.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.515+0000 7fb46c126800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16 to cache LRU end 2024-09-12T00:49:07.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.515+0000 7fb46c126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:07.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.515+0000 7fb46c126800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:49:07.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.515+0000 7fb46c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16 2024-09-12T00:49:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:49:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:49:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:49:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:49:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:49:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:49:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:49:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:49:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:49:07.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:49:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:49:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:49:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 20 get_obj_state: octx=0x556ba9270a60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 10 manifest: total_size = 11534336 2024-09-12T00:49:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9751639566739069901 2024-09-12T00:49:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 20 get_obj_state: octx=0x556ba9270a60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.516+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16.0 2024-09-12T00:49:07.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:49:07.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:49:07.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:49:07.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:49:07.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:49:07.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:49:07.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:49:07.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:49:07.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:49:07.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9751639566739069901 2024-09-12T00:49:07.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-FROZEN.2~2VA8l241ZaNoMEuwZkhnw2YOTkFxAQM.1 2024-09-12T00:49:07.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:49:07.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-FROZEN.2~2VA8l241ZaNoMEuwZkhnw2YOTkFxAQM.2 2024-09-12T00:49:07.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-12T00:49:07.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-FROZEN.2~2VA8l241ZaNoMEuwZkhnw2YOTkFxAQM.3 2024-09-12T00:49:07.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-12T00:49:07.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.518+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9751639566739069901 2024-09-12T00:49:07.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.520+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:49:07.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.520+0000 7fb46c126800 20 get_obj_state: octx=0x556ba9270a60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.520+0000 7fb46c126800 10 manifest: total_size = 11534336 2024-09-12T00:49:07.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.520+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12505822953270716608 2024-09-12T00:49:07.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.520+0000 7fb46c126800 20 get_obj_state: octx=0x556ba9270a60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.520+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.520+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16.0 2024-09-12T00:49:07.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:49:07.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:49:07.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:49:07.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:49:07.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:49:07.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:49:07.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:49:07.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:49:07.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:49:07.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12505822953270716608 2024-09-12T00:49:07.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-FROZEN.2~2VA8l241ZaNoMEuwZkhnw2YOTkFxAQM.1 2024-09-12T00:49:07.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:49:07.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-FROZEN.2~2VA8l241ZaNoMEuwZkhnw2YOTkFxAQM.2 2024-09-12T00:49:07.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-12T00:49:07.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-FROZEN.2~2VA8l241ZaNoMEuwZkhnw2YOTkFxAQM.3 2024-09-12T00:49:07.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-12T00:49:07.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.523+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12505822953270716608 2024-09-12T00:49:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.524+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:49:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.524+0000 7fb46c126800 20 get_obj_state: octx=0x556ba9270d20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.525+0000 7fb46c126800 10 manifest: total_size = 11534336 2024-09-12T00:49:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.525+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to _dYQfqViMYWYqWzepjl_onlhAx950JKa 2024-09-12T00:49:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.525+0000 7fb46c126800 20 get_obj_state: octx=0x556ba9270d20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.525+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.525+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16.0 2024-09-12T00:49:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.527+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.527+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.527+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.527+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.527+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: _dYQfqViMYWYqWzepjl_onlhAx950JKa 2024-09-12T00:49:07.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.527+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.527+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.MoiTzWsOI_jpMKAaLDEJewYv4gJGX2h_0 2024-09-12T00:49:07.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.527+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:49:07.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.527+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.MoiTzWsOI_jpMKAaLDEJewYv4gJGX2h_1 2024-09-12T00:49:07.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.527+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:49:07.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.527+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.527+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _dYQfqViMYWYqWzepjl_onlhAx950JKa 2024-09-12T00:49:07.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.528+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:49:07.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.529+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c016730 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.529+0000 7fb46c126800 10 manifest: total_size = 11534336 2024-09-12T00:49:07.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.529+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to _Lqnr1nAx9Kkim0En_e-28LShik2GDpD 2024-09-12T00:49:07.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.529+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c016730 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.529+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.529+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16.0 2024-09-12T00:49:07.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.531+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.531+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.531+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.531+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.531+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: _Lqnr1nAx9Kkim0En_e-28LShik2GDpD 2024-09-12T00:49:07.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.531+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.531+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.XwlJJHqb8evpLaTRluOuPBWAyJ2JJ5q_0 2024-09-12T00:49:07.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.531+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:49:07.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.531+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.XwlJJHqb8evpLaTRluOuPBWAyJ2JJ5q_1 2024-09-12T00:49:07.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.531+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:49:07.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.531+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.531+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _Lqnr1nAx9Kkim0En_e-28LShik2GDpD 2024-09-12T00:49:07.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.532+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:49:07.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.533+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.533+0000 7fb46c126800 10 manifest: total_size = 11534336 2024-09-12T00:49:07.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.533+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8554692150510671333 2024-09-12T00:49:07.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.533+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.533+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.533+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16.0 2024-09-12T00:49:07.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:49:07.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:49:07.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:49:07.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:49:07.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:49:07.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:49:07.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:49:07.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:49:07.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:49:07.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8554692150510671333 2024-09-12T00:49:07.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-LUKEWARM.2~Mk4_zA6Aa-1MYXyOhg0WFYg_jDOeN1V.1 2024-09-12T00:49:07.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:49:07.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-LUKEWARM.2~Mk4_zA6Aa-1MYXyOhg0WFYg_jDOeN1V.2 2024-09-12T00:49:07.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-12T00:49:07.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-LUKEWARM.2~Mk4_zA6Aa-1MYXyOhg0WFYg_jDOeN1V.3 2024-09-12T00:49:07.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-12T00:49:07.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.536+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8554692150510671333 2024-09-12T00:49:07.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.537+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:49:07.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.537+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a3080 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.538+0000 7fb46c126800 10 manifest: total_size = 11534336 2024-09-12T00:49:07.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.538+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to _kAgdZGJY3_smvrFW1147MA2nFVqHoCL 2024-09-12T00:49:07.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.538+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c0a3080 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.538+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.538+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16.0 2024-09-12T00:49:07.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.540+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.540+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.540+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.540+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.540+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: _kAgdZGJY3_smvrFW1147MA2nFVqHoCL 2024-09-12T00:49:07.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.540+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.540+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.JBqCoEfzWyBt9a3U-5vdNAoIq90ngVO_0 2024-09-12T00:49:07.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.540+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:49:07.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.540+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.JBqCoEfzWyBt9a3U-5vdNAoIq90ngVO_1 2024-09-12T00:49:07.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.540+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:49:07.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.540+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.540+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _kAgdZGJY3_smvrFW1147MA2nFVqHoCL 2024-09-12T00:49:07.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.541+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:49:07.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.541+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.542+0000 7fb46c126800 10 manifest: total_size = 11534336 2024-09-12T00:49:07.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.542+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.259414573640064163 2024-09-12T00:49:07.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.542+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.542+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.542+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16.0 2024-09-12T00:49:07.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:49:07.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:49:07.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:49:07.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:49:07.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:49:07.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:49:07.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:49:07.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:49:07.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:49:07.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.259414573640064163 2024-09-12T00:49:07.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-LUKEWARM.2~Mk4_zA6Aa-1MYXyOhg0WFYg_jDOeN1V.1 2024-09-12T00:49:07.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 372 2024-09-12T00:49:07.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-LUKEWARM.2~Mk4_zA6Aa-1MYXyOhg0WFYg_jDOeN1V.2 2024-09-12T00:49:07.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T00:49:07.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-LUKEWARM.2~Mk4_zA6Aa-1MYXyOhg0WFYg_jDOeN1V.3 2024-09-12T00:49:07.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T00:49:07.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.544+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.259414573640064163 2024-09-12T00:49:07.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.545+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:49:07.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.546+0000 7fb46c126800 20 get_obj_state: octx=0x7fb458095eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.546+0000 7fb46c126800 10 manifest: total_size = 11534336 2024-09-12T00:49:07.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.546+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to _OtLEv9v6bjEPBcB-r4bew8KqbPrtlRb 2024-09-12T00:49:07.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.546+0000 7fb46c126800 20 get_obj_state: octx=0x7fb458095eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.546+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.546+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16.0 2024-09-12T00:49:07.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.548+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.548+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.548+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.548+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.548+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: _OtLEv9v6bjEPBcB-r4bew8KqbPrtlRb 2024-09-12T00:49:07.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.548+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.548+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.7H6P2o-h9ojjDclpvhIZF335bsj2T92_0 2024-09-12T00:49:07.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.548+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:49:07.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.548+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.7H6P2o-h9ojjDclpvhIZF335bsj2T92_1 2024-09-12T00:49:07.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.548+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:49:07.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.548+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.548+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: _OtLEv9v6bjEPBcB-r4bew8KqbPrtlRb 2024-09-12T00:49:07.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.549+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:49:07.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.550+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.550+0000 7fb46c126800 10 manifest: total_size = 45360 2024-09-12T00:49:07.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.550+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13401983192451755849 2024-09-12T00:49:07.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.550+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.550+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.550+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16.0 2024-09-12T00:49:07.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:49:07.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T00:49:07.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:49:07.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:49:07.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T00:49:07.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-12T00:49:07.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-12T00:49:07.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2024-09-12T00:49:07.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-12T00:49:07.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13401983192451755849 2024-09-12T00:49:07.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-STANDARD.2~4f3D88pjn0OItXXOzbP8IC28Pin2_ea.1 2024-09-12T00:49:07.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:49:07.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-STANDARD.2~4f3D88pjn0OItXXOzbP8IC28Pin2_ea.2 2024-09-12T00:49:07.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:49:07.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-STANDARD.2~4f3D88pjn0OItXXOzbP8IC28Pin2_ea.3 2024-09-12T00:49:07.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:49:07.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.552+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13401983192451755849 2024-09-12T00:49:07.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.553+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:49:07.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.554+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c016730 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.554+0000 7fb46c126800 10 manifest: total_size = 45360 2024-09-12T00:49:07.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.554+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to _RD8AIJ1rjMPVTyAubA_mOoaJYYjhE2x 2024-09-12T00:49:07.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.554+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c016730 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.554+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.554+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16.0 2024-09-12T00:49:07.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.556+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.556+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.556+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: _RD8AIJ1rjMPVTyAubA_mOoaJYYjhE2x 2024-09-12T00:49:07.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.556+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.556+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.NSQYFrWl4tmQm3I5Ffz0fUjAvhaKbN1_0 2024-09-12T00:49:07.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.556+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:49:07.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.556+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.556+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _RD8AIJ1rjMPVTyAubA_mOoaJYYjhE2x 2024-09-12T00:49:07.556 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.557+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:49:07.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.558+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.558+0000 7fb46c126800 10 manifest: total_size = 45360 2024-09-12T00:49:07.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.558+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to _r5h1lrhQhfAdIpAWSKN36ut4LI8zZMo 2024-09-12T00:49:07.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.558+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.558+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.558+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16.0 2024-09-12T00:49:07.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.560+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.560+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.560+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: _r5h1lrhQhfAdIpAWSKN36ut4LI8zZMo 2024-09-12T00:49:07.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.560+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.560+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.cPsDBTkQsjhDOQSq16nV1wcFYOkh6vC_0 2024-09-12T00:49:07.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.560+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:49:07.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.560+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.560+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _r5h1lrhQhfAdIpAWSKN36ut4LI8zZMo 2024-09-12T00:49:07.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.562+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:49:07.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.562+0000 7fb46c126800 20 get_obj_state: octx=0x7fb458095eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.562+0000 7fb46c126800 10 manifest: total_size = 45360 2024-09-12T00:49:07.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.562+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1908380241961171968 2024-09-12T00:49:07.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.562+0000 7fb46c126800 20 get_obj_state: octx=0x7fb458095eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x556ba9258958 s->prefetch_data=0 2024-09-12T00:49:07.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.562+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9258958 2024-09-12T00:49:07.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.562+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16.0 2024-09-12T00:49:07.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:49:07.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=20613 2024-09-12T00:49:07.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:49:07.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:49:07.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6312069 part_ofs=20613 rule->part_size=20613 2024-09-12T00:49:07.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-12T00:49:07.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-12T00:49:07.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6332682 part_ofs=41226 rule->part_size=4134 2024-09-12T00:49:07.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-12T00:49:07.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1908380241961171968 2024-09-12T00:49:07.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-STANDARD.2~4f3D88pjn0OItXXOzbP8IC28Pin2_ea.1 2024-09-12T00:49:07.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T00:49:07.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-STANDARD.2~4f3D88pjn0OItXXOzbP8IC28Pin2_ea.2 2024-09-12T00:49:07.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T00:49:07.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-STANDARD.2~4f3D88pjn0OItXXOzbP8IC28Pin2_ea.3 2024-09-12T00:49:07.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T00:49:07.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.564+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1908380241961171968 2024-09-12T00:49:07.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.566+0000 7fb46c126800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:49:07.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.566+0000 7fb46c126800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:49:07.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.566+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:49:07.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.566+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:49:07.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.566+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:49:07.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.566+0000 7fb46c126800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:49:07.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.566+0000 7fb46c126800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:49:07.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.566+0000 7fb46c126800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16])"; uploads.size()=0; is_truncated=0 2024-09-12T00:49:07.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.567+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T00:49:07.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.567+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.568+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T00:49:07.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.568+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T00:49:07.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.568+0000 7fb46c126800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T00:49:07.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.569+0000 7fb46c126800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T00:49:07.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.569+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T00:49:07.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.569+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431573 cookie 93920887414864 notifier 5687 bl.length()=199 2024-09-12T00:49:07.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.572+0000 7fb46c126800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16 from cache 2024-09-12T00:49:07.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.572+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16, ofs0, ns] 2024-09-12T00:49:07.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.573+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431627 cookie 93920887411152 notifier 5687 bl.length()=257 2024-09-12T00:49:07.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.576+0000 7fb46c126800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16 : miss 2024-09-12T00:49:07.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.576+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.576+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.576+0000 7fb46c126800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16 info.flags=0x0 2024-09-12T00:49:07.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.576+0000 7fb46c126800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16 to cache LRU end 2024-09-12T00:49:07.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.578+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14 : miss 2024-09-12T00:49:07.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.578+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.578+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:49:07.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.578+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14 info.flags=0x17 2024-09-12T00:49:07.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.578+0000 7fb46c126800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14 to cache LRU end 2024-09-12T00:49:07.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.578+0000 7fb46c126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:07.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.578+0000 7fb46c126800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:49:07.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.578+0000 7fb46c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14 2024-09-12T00:49:07.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.579+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:49:07.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.579+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:49:07.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.579+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:49:07.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.579+0000 7fb46c126800 20 get_obj_state: octx=0x556ba9270d50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.579+0000 7fb46c126800 10 manifest: total_size = 11534336 2024-09-12T00:49:07.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.579+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12822806943810653692 2024-09-12T00:49:07.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.579+0000 7fb46c126800 20 get_obj_state: octx=0x556ba9270d50 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.579+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9271748 2024-09-12T00:49:07.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.579+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14.0 2024-09-12T00:49:07.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:49:07.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:49:07.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:49:07.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:49:07.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:49:07.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:49:07.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:49:07.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:49:07.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:49:07.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12822806943810653692 2024-09-12T00:49:07.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-FROZEN.2~hCtEj_gQoD6ef81Q3LzvVPUPZ5xeBXx.1 2024-09-12T00:49:07.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:49:07.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-FROZEN.2~hCtEj_gQoD6ef81Q3LzvVPUPZ5xeBXx.2 2024-09-12T00:49:07.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-12T00:49:07.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-FROZEN.2~hCtEj_gQoD6ef81Q3LzvVPUPZ5xeBXx.3 2024-09-12T00:49:07.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-12T00:49:07.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.582+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12822806943810653692 2024-09-12T00:49:07.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.583+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:49:07.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.583+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.584+0000 7fb46c126800 10 manifest: total_size = 11534336 2024-09-12T00:49:07.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.584+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14268535235142857650 2024-09-12T00:49:07.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.584+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.584+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9271748 2024-09-12T00:49:07.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.584+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14.0 2024-09-12T00:49:07.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:49:07.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-12T00:49:07.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:49:07.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:49:07.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:49:07.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:49:07.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:49:07.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:49:07.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:49:07.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14268535235142857650 2024-09-12T00:49:07.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-LUKEWARM.2~A2nT8XLuBvIajTphgGTvC0TUzWnk50c.1 2024-09-12T00:49:07.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:49:07.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-LUKEWARM.2~A2nT8XLuBvIajTphgGTvC0TUzWnk50c.2 2024-09-12T00:49:07.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-12T00:49:07.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-LUKEWARM.2~A2nT8XLuBvIajTphgGTvC0TUzWnk50c.3 2024-09-12T00:49:07.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-12T00:49:07.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.586+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14268535235142857650 2024-09-12T00:49:07.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.587+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:49:07.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.587+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46004b510 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.588+0000 7fb46c126800 10 manifest: total_size = 1087 2024-09-12T00:49:07.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.588+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13786521059648355502 2024-09-12T00:49:07.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.588+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46004b510 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.588+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9271748 2024-09-12T00:49:07.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.588+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14.0 2024-09-12T00:49:07.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.590+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:49:07.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.590+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-12T00:49:07.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.590+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:49:07.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.590+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:49:07.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.590+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-12T00:49:07.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.590+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T00:49:07.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.591+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T00:49:07.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.591+0000 7fb46c126800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-09-12T00:49:07.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.591+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T00:49:07.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.591+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13786521059648355502 2024-09-12T00:49:07.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.591+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.591+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-STANDARD.2~JjWsQBuNjLr89QMMmnhGsUZJ5aUzRsh.1 2024-09-12T00:49:07.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.591+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-12T00:49:07.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.591+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-STANDARD.2~JjWsQBuNjLr89QMMmnhGsUZJ5aUzRsh.2 2024-09-12T00:49:07.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.591+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-12T00:49:07.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.591+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-STANDARD.2~JjWsQBuNjLr89QMMmnhGsUZJ5aUzRsh.3 2024-09-12T00:49:07.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.591+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-12T00:49:07.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.591+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.591+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13786521059648355502 2024-09-12T00:49:07.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.592+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:49:07.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.592+0000 7fb46c126800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:49:07.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.592+0000 7fb46c126800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:49:07.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.592+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:49:07.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.592+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:49:07.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.592+0000 7fb46c126800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:49:07.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.592+0000 7fb46c126800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:49:07.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.592+0000 7fb46c126800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14])"; uploads.size()=0; is_truncated=0 2024-09-12T00:49:07.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.594+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T00:49:07.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.594+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.594+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T00:49:07.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.594+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T00:49:07.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.594+0000 7fb46c126800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T00:49:07.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.595+0000 7fb46c126800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T00:49:07.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.595+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T00:49:07.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.595+0000 7fb346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431628 cookie 93920887420208 notifier 5687 bl.length()=194 2024-09-12T00:49:07.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.598+0000 7fb46c126800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14 from cache 2024-09-12T00:49:07.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.598+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14, ofs0, ns] 2024-09-12T00:49:07.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.598+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431629 cookie 93920887411152 notifier 5687 bl.length()=252 2024-09-12T00:49:07.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.600+0000 7fb46c126800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14 : miss 2024-09-12T00:49:07.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.600+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.600+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.600+0000 7fb46c126800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14 info.flags=0x0 2024-09-12T00:49:07.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.600+0000 7fb46c126800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14 to cache LRU end 2024-09-12T00:49:07.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.603+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13 : miss 2024-09-12T00:49:07.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.603+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.603+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T00:49:07.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.603+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13 info.flags=0x17 2024-09-12T00:49:07.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.603+0000 7fb46c126800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13 to cache LRU end 2024-09-12T00:49:07.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.603+0000 7fb46c126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:07.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.603+0000 7fb46c126800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:49:07.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.603+0000 7fb46c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13 2024-09-12T00:49:07.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.604+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:49:07.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.604+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:49:07.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.604+0000 7fb46c126800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:49:07.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.604+0000 7fb46c126800 20 get_obj_state: octx=0x556ba92d5af0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.604+0000 7fb46c126800 10 manifest: total_size = 10485760 2024-09-12T00:49:07.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.604+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13104328969455472647 2024-09-12T00:49:07.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.604+0000 7fb46c126800 20 get_obj_state: octx=0x556ba92d5af0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.604+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9271748 2024-09-12T00:49:07.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.604+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13.0 2024-09-12T00:49:07.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.606+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.606+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.606+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.606+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.606+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13104328969455472647 2024-09-12T00:49:07.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.606+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.606+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13__shadow_.4zb_TR6t0zjWXy_eUT8i3r17e5DI5W__0 2024-09-12T00:49:07.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.606+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:49:07.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.606+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13__shadow_.4zb_TR6t0zjWXy_eUT8i3r17e5DI5W__1 2024-09-12T00:49:07.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.606+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T00:49:07.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.606+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.606+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13104328969455472647 2024-09-12T00:49:07.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.608+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:49:07.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.608+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c016730 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x556ba925a3e8 s->prefetch_data=0 2024-09-12T00:49:07.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.608+0000 7fb46c126800 10 manifest: total_size = 10485760 2024-09-12T00:49:07.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.608+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1415521386748406063 2024-09-12T00:49:07.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.608+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c016730 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x556ba925a3e8 s->prefetch_data=0 2024-09-12T00:49:07.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.608+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba925a3e8 2024-09-12T00:49:07.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.608+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13.0 2024-09-12T00:49:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.610+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.610+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.610+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.610+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.610+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1415521386748406063 2024-09-12T00:49:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.610+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.610+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13__shadow_.oRup_dPLHghGNyR4w_DZhBjK_98NwW1_0 2024-09-12T00:49:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.610+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:49:07.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.610+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13__shadow_.oRup_dPLHghGNyR4w_DZhBjK_98NwW1_1 2024-09-12T00:49:07.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.610+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:49:07.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.610+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.610+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1415521386748406063 2024-09-12T00:49:07.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.612+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:49:07.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.612+0000 7fb46c126800 20 get_obj_state: octx=0x556ba925c500 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.612+0000 7fb46c126800 10 manifest: total_size = 44258 2024-09-12T00:49:07.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.612+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10193902527438398157 2024-09-12T00:49:07.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.612+0000 7fb46c126800 20 get_obj_state: octx=0x556ba925c500 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.612+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9271748 2024-09-12T00:49:07.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.612+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13.0 2024-09-12T00:49:07.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.614+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.614+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=44258 stripe_ofs=44258 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.614+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10193902527438398157 2024-09-12T00:49:07.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.614+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.614+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13__shadow_.ARuxeCy9MxM17bLf0xxEPKc9_dFFqzt_0 2024-09-12T00:49:07.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.614+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:49:07.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.614+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.614+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10193902527438398157 2024-09-12T00:49:07.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.615+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:49:07.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.616+0000 7fb46c126800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:49:07.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.616+0000 7fb46c126800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:49:07.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.616+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:49:07.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.616+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:49:07.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.616+0000 7fb46c126800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:49:07.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.616+0000 7fb46c126800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:49:07.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.616+0000 7fb46c126800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13])"; uploads.size()=0; is_truncated=0 2024-09-12T00:49:07.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.617+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T00:49:07.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.617+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.618+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T00:49:07.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.618+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T00:49:07.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.618+0000 7fb46c126800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T00:49:07.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.619+0000 7fb46c126800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T00:49:07.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.619+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T00:49:07.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.619+0000 7fb346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431572 cookie 93920887410096 notifier 5687 bl.length()=184 2024-09-12T00:49:07.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.621+0000 7fb46c126800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13 from cache 2024-09-12T00:49:07.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.621+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13, ofs0, ns] 2024-09-12T00:49:07.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.621+0000 7fb346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431630 cookie 93920887422848 notifier 5687 bl.length()=242 2024-09-12T00:49:07.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.624+0000 7fb46c126800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13 : miss 2024-09-12T00:49:07.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.624+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.624+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.624+0000 7fb46c126800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13 info.flags=0x0 2024-09-12T00:49:07.623 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.624+0000 7fb46c126800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13 to cache LRU end 2024-09-12T00:49:07.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.626+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6 : miss 2024-09-12T00:49:07.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.626+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.626+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:49:07.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.626+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6 info.flags=0x17 2024-09-12T00:49:07.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.626+0000 7fb46c126800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6 to cache LRU end 2024-09-12T00:49:07.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.626+0000 7fb46c126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:07.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.626+0000 7fb46c126800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:49:07.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.626+0000 7fb46c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6 2024-09-12T00:49:07.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.627+0000 7fb46c126800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:49:07.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.627+0000 7fb46c126800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:49:07.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.627+0000 7fb46c126800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:49:07.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.627+0000 7fb46c126800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:49:07.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.627+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c016730 obj=test-client.0-r-test-small-obj-data.1:__ state=0x556ba925a3e8 s->prefetch_data=0 2024-09-12T00:49:07.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.627+0000 7fb46c126800 10 manifest: total_size = 0 2024-09-12T00:49:07.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.627+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9953442005400216455 2024-09-12T00:49:07.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.627+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c016730 obj=test-client.0-r-test-small-obj-data.1:__ state=0x556ba925a3e8 s->prefetch_data=0 2024-09-12T00:49:07.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.627+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba925a3e8 2024-09-12T00:49:07.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.627+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6.0 2024-09-12T00:49:07.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.630+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c016730 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x556ba925a3e8 s->prefetch_data=0 2024-09-12T00:49:07.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.631+0000 7fb46c126800 10 manifest: total_size = 0 2024-09-12T00:49:07.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.631+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18399698248702946535 2024-09-12T00:49:07.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.631+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c016730 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x556ba925a3e8 s->prefetch_data=0 2024-09-12T00:49:07.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.631+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba925a3e8 2024-09-12T00:49:07.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.631+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6.0 2024-09-12T00:49:07.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.631+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:49:07.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.633+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c016730 obj=test-client.0-r-test-small-obj-data.1:___ state=0x556ba925a3e8 s->prefetch_data=0 2024-09-12T00:49:07.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.633+0000 7fb46c126800 10 manifest: total_size = 0 2024-09-12T00:49:07.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.633+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1036911363837612880 2024-09-12T00:49:07.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.633+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c016730 obj=test-client.0-r-test-small-obj-data.1:___ state=0x556ba925a3e8 s->prefetch_data=0 2024-09-12T00:49:07.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.633+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba925a3e8 2024-09-12T00:49:07.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.633+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6.0 2024-09-12T00:49:07.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.634+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:49:07.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.636+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c016730 obj=test-client.0-r-test-small-obj-data.1:obj state=0x556ba925a3e8 s->prefetch_data=0 2024-09-12T00:49:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.636+0000 7fb46c126800 10 manifest: total_size = 0 2024-09-12T00:49:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.636+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14652046635777864233 2024-09-12T00:49:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.636+0000 7fb46c126800 20 get_obj_state: octx=0x7fb45c016730 obj=test-client.0-r-test-small-obj-data.1:obj state=0x556ba925a3e8 s->prefetch_data=0 2024-09-12T00:49:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.636+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba925a3e8 2024-09-12T00:49:07.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.636+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6.0 2024-09-12T00:49:07.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.637+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:49:07.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.638+0000 7fb46c126800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:49:07.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.638+0000 7fb46c126800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:49:07.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.639+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:49:07.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.640+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:49:07.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.640+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:49:07.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.640+0000 7fb46c126800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:49:07.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.640+0000 7fb46c126800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:49:07.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.640+0000 7fb46c126800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6])"; uploads.size()=0; is_truncated=0 2024-09-12T00:49:07.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.641+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T00:49:07.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.641+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.642+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:49:07.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.642+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T00:49:07.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.642+0000 7fb46c126800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T00:49:07.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.643+0000 7fb46c126800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T00:49:07.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.643+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T00:49:07.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.643+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431620 cookie 93920887409040 notifier 5687 bl.length()=181 2024-09-12T00:49:07.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.646+0000 7fb46c126800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6 from cache 2024-09-12T00:49:07.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.646+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6, ofs0, ns] 2024-09-12T00:49:07.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.646+0000 7fb346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431574 cookie 93920887349968 notifier 5687 bl.length()=238 2024-09-12T00:49:07.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.648+0000 7fb46c126800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6 : miss 2024-09-12T00:49:07.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.648+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.648+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.648+0000 7fb46c126800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6 info.flags=0x0 2024-09-12T00:49:07.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.648+0000 7fb46c126800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6 to cache LRU end 2024-09-12T00:49:07.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.650+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7 : miss 2024-09-12T00:49:07.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.650+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.651+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:49:07.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.651+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7 info.flags=0x17 2024-09-12T00:49:07.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.651+0000 7fb46c126800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7 to cache LRU end 2024-09-12T00:49:07.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.651+0000 7fb46c126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:07.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.651+0000 7fb46c126800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:49:07.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.651+0000 7fb46c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7 2024-09-12T00:49:07.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.651+0000 7fb46c126800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:49:07.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.651+0000 7fb46c126800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:49:07.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.651+0000 7fb46c126800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:49:07.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.651+0000 7fb46c126800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:49:07.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.651+0000 7fb46c126800 20 get_obj_state: octx=0x556ba921c6b0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.652+0000 7fb46c126800 10 manifest: total_size = 2078 2024-09-12T00:49:07.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.652+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17173448491589145405 2024-09-12T00:49:07.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.652+0000 7fb46c126800 20 get_obj_state: octx=0x556ba921c6b0 obj=test-client.0-r-test-small-obj-data.2:__ state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.652+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9271748 2024-09-12T00:49:07.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.652+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7.0 2024-09-12T00:49:07.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.654+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.654+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.654+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17173448491589145405 2024-09-12T00:49:07.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.654+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.654+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7__shadow_.NLFLh9SdSDKklBlh_rKJ3kzWOvq-y8h_0 2024-09-12T00:49:07.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.654+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:49:07.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.654+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.654+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17173448491589145405 2024-09-12T00:49:07.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.655+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:49:07.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.655+0000 7fb46c126800 20 get_obj_state: octx=0x556ba921c6b0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.656+0000 7fb46c126800 10 manifest: total_size = 24595 2024-09-12T00:49:07.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.656+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11421859553854936482 2024-09-12T00:49:07.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.656+0000 7fb46c126800 20 get_obj_state: octx=0x556ba921c6b0 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.656+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9271748 2024-09-12T00:49:07.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.656+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7.0 2024-09-12T00:49:07.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.659+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.659+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.659+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11421859553854936482 2024-09-12T00:49:07.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.659+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.659+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7__shadow_.t6kDp09bK6AYxdhgVLuiqCQDZTyqkj1_0 2024-09-12T00:49:07.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.659+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:49:07.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.659+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.659+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11421859553854936482 2024-09-12T00:49:07.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.660+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:49:07.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.661+0000 7fb46c126800 20 get_obj_state: octx=0x556ba921c6b0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.661+0000 7fb46c126800 10 manifest: total_size = 524288 2024-09-12T00:49:07.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.661+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12668308116110759234 2024-09-12T00:49:07.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.661+0000 7fb46c126800 20 get_obj_state: octx=0x556ba921c6b0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.661+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9271748 2024-09-12T00:49:07.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.661+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7.0 2024-09-12T00:49:07.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.663+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.663+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=524288 stripe_ofs=524288 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.663+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12668308116110759234 2024-09-12T00:49:07.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.663+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.663+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7__shadow_.XH2grpHFTtgDccjeBl_rXSZnRv-GvQL_0 2024-09-12T00:49:07.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.663+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:49:07.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.663+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.663+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12668308116110759234 2024-09-12T00:49:07.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.665+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:49:07.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.665+0000 7fb46c126800 20 get_obj_state: octx=0x556ba921c6b0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.665+0000 7fb46c126800 10 manifest: total_size = 527 2024-09-12T00:49:07.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.665+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7669579381663189899 2024-09-12T00:49:07.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.665+0000 7fb46c126800 20 get_obj_state: octx=0x556ba921c6b0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.665+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9271748 2024-09-12T00:49:07.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.665+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7.0 2024-09-12T00:49:07.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.667+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.667+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.667+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7669579381663189899 2024-09-12T00:49:07.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.667+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.667+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7__shadow_.Trd-OwUTnX5BjIhznqIRy4rKtExOK3n_0 2024-09-12T00:49:07.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.667+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:49:07.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.667+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.667+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7669579381663189899 2024-09-12T00:49:07.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.669+0000 7fb46c126800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:49:07.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.669+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:49:07.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.669+0000 7fb46c126800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:49:07.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.669+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:49:07.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.669+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:49:07.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.669+0000 7fb46c126800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:49:07.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.669+0000 7fb46c126800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:49:07.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.669+0000 7fb46c126800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7])"; uploads.size()=0; is_truncated=0 2024-09-12T00:49:07.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.671+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T00:49:07.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.671+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.671+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:49:07.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.671+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T00:49:07.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.671+0000 7fb46c126800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T00:49:07.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.672+0000 7fb46c126800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T00:49:07.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.672+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T00:49:07.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.673+0000 7fb346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431621 cookie 93920887409040 notifier 5687 bl.length()=181 2024-09-12T00:49:07.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.675+0000 7fb46c126800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7 from cache 2024-09-12T00:49:07.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.675+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7, ofs0, ns] 2024-09-12T00:49:07.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.675+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431575 cookie 93920887349968 notifier 5687 bl.length()=238 2024-09-12T00:49:07.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.678+0000 7fb46c126800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7 : miss 2024-09-12T00:49:07.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.678+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.679+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.679+0000 7fb46c126800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7 info.flags=0x0 2024-09-12T00:49:07.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.679+0000 7fb46c126800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7 to cache LRU end 2024-09-12T00:49:07.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.680+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8 : miss 2024-09-12T00:49:07.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.680+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.681+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:49:07.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.681+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8 info.flags=0x17 2024-09-12T00:49:07.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.681+0000 7fb46c126800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8 to cache LRU end 2024-09-12T00:49:07.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.681+0000 7fb46c126800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:07.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.681+0000 7fb46c126800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:49:07.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.681+0000 7fb46c126800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8 2024-09-12T00:49:07.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.681+0000 7fb46c126800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:49:07.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.681+0000 7fb46c126800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:49:07.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.681+0000 7fb46c126800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:49:07.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.681+0000 7fb46c126800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:49:07.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.681+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-small-obj-data.3:__ state=0x556ba91b8758 s->prefetch_data=0 2024-09-12T00:49:07.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.682+0000 7fb46c126800 10 manifest: total_size = 49187 2024-09-12T00:49:07.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.682+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14228236543024663686 2024-09-12T00:49:07.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.682+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-small-obj-data.3:__ state=0x556ba91b8758 s->prefetch_data=0 2024-09-12T00:49:07.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.682+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba91b8758 2024-09-12T00:49:07.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.682+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8.0 2024-09-12T00:49:07.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.685+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.685+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=49187 stripe_ofs=49187 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.685+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14228236543024663686 2024-09-12T00:49:07.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.685+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.685+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8__shadow_.MsocIzsSjR1Gr8qNBkcYF5zrCrPYVUG_0 2024-09-12T00:49:07.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.685+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:49:07.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.685+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.685+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14228236543024663686 2024-09-12T00:49:07.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.686+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:49:07.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.686+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.686+0000 7fb46c126800 10 manifest: total_size = 1048576 2024-09-12T00:49:07.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.686+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8019701876900493203 2024-09-12T00:49:07.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.686+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.686+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9271748 2024-09-12T00:49:07.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.686+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8.0 2024-09-12T00:49:07.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.689+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.689+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.689+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8019701876900493203 2024-09-12T00:49:07.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.689+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.689+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8__shadow_.XoXPoxuDWP5PF5fW7pGyR6klAxzSrzk_0 2024-09-12T00:49:07.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.689+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:49:07.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.689+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.689+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8019701876900493203 2024-09-12T00:49:07.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.690+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:49:07.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.690+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-small-obj-data.3:___ state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.690+0000 7fb46c126800 10 manifest: total_size = 1048576 2024-09-12T00:49:07.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.690+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9348083246549502770 2024-09-12T00:49:07.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.690+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-small-obj-data.3:___ state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.690+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9271748 2024-09-12T00:49:07.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.690+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8.0 2024-09-12T00:49:07.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.693+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.693+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.693+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9348083246549502770 2024-09-12T00:49:07.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.693+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.693+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8__shadow_.X3ldoPsKPtRiVnff8CXrwE63h3sI3Gg_0 2024-09-12T00:49:07.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.693+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-12T00:49:07.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.693+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.693+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9348083246549502770 2024-09-12T00:49:07.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.694+0000 7fb3467fc640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:49:07.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.694+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-small-obj-data.3:obj state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.695+0000 7fb46c126800 10 manifest: total_size = 55 2024-09-12T00:49:07.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.695+0000 7fb46c126800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17062549092121413472 2024-09-12T00:49:07.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.695+0000 7fb46c126800 20 get_obj_state: octx=0x7fb46005fe30 obj=test-client.0-r-test-small-obj-data.3:obj state=0x556ba9271748 s->prefetch_data=0 2024-09-12T00:49:07.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.695+0000 7fb46c126800 20 prepare_atomic_modification: state is not atomic. state=0x556ba9271748 2024-09-12T00:49:07.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.695+0000 7fb46c126800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8.0 2024-09-12T00:49:07.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.697+0000 7fb46c126800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:49:07.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.697+0000 7fb46c126800 20 RGWObjManifest::operator++(): result: ofs=55 stripe_ofs=55 part_ofs=0 rule->part_size=0 2024-09-12T00:49:07.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.697+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17062549092121413472 2024-09-12T00:49:07.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.697+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:49:07.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.697+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8__shadow_.KQZ1gmmVqznjD41ido411qajjES33ya_0 2024-09-12T00:49:07.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.697+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-12T00:49:07.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.697+0000 7fb46c126800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:49:07.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.697+0000 7fb46c126800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17062549092121413472 2024-09-12T00:49:07.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.698+0000 7fb346ffd640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:49:07.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.699+0000 7fb46c126800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:49:07.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.699+0000 7fb46c126800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-12T00:49:07.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.699+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:49:07.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.699+0000 7fb46c126800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:49:07.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.699+0000 7fb46c126800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:49:07.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.699+0000 7fb46c126800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:49:07.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.699+0000 7fb46c126800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8])"; uploads.size()=0; is_truncated=0 2024-09-12T00:49:07.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.700+0000 7fb46c126800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T00:49:07.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.700+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.701+0000 7fb46c126800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:49:07.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.701+0000 7fb46c126800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T00:49:07.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.701+0000 7fb46c126800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T00:49:07.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.702+0000 7fb46c126800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T00:49:07.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.702+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T00:49:07.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.703+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431622 cookie 93920887409040 notifier 5687 bl.length()=181 2024-09-12T00:49:07.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.705+0000 7fb46c126800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8 from cache 2024-09-12T00:49:07.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.705+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8, ofs0, ns] 2024-09-12T00:49:07.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.705+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431576 cookie 93920887349968 notifier 5687 bl.length()=238 2024-09-12T00:49:07.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.708+0000 7fb46c126800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8 : miss 2024-09-12T00:49:07.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.708+0000 7fb46c126800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.708+0000 7fb46c126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.708+0000 7fb46c126800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8 info.flags=0x0 2024-09-12T00:49:07.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.708+0000 7fb46c126800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8 to cache LRU end 2024-09-12T00:49:07.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.711+0000 7fb46c126800 10 removing key index: RVMNESKDPBGZHWNZKPNO 2024-09-12T00:49:07.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.712+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:RVMNESKDPBGZHWNZKPNO, ofs0, ns] 2024-09-12T00:49:07.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.712+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431623 cookie 93920887409040 notifier 5687 bl.length()=170 2024-09-12T00:49:07.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.713+0000 7fb46c126800 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T00:49:07.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.714+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:49:07.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.715+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431573 cookie 93920887410096 notifier 5687 bl.length()=182 2024-09-12T00:49:07.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.716+0000 7fb46c126800 10 removing user buckets index 2024-09-12T00:49:07.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.717+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T00:49:07.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.717+0000 7fb346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431631 cookie 93920887420208 notifier 5687 bl.length()=173 2024-09-12T00:49:07.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.718+0000 7fb46c126800 10 removing user index: ragweed.client.0 2024-09-12T00:49:07.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.719+0000 7fb46c126800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T00:49:07.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.719+0000 7fb46c126800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:49:07.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.720+0000 7fb3467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431624 cookie 93920887417504 notifier 5687 bl.length()=165 2024-09-12T00:49:07.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.721+0000 7fb346ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431625 cookie 93920887417504 notifier 5687 bl.length()=165 2024-09-12T00:49:07.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.725+0000 7fb31dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:07.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.727+0000 7fb46c126800 20 remove_watcher() i=0 2024-09-12T00:49:07.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.727+0000 7fb46c126800 2 removed watcher, disabling cache 2024-09-12T00:49:07.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.728+0000 7fb46c126800 20 remove_watcher() i=1 2024-09-12T00:49:07.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.729+0000 7fb46c126800 20 remove_watcher() i=2 2024-09-12T00:49:07.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.730+0000 7fb46c126800 20 remove_watcher() i=3 2024-09-12T00:49:07.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.731+0000 7fb46c126800 20 remove_watcher() i=4 2024-09-12T00:49:07.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.732+0000 7fb46c126800 20 remove_watcher() i=5 2024-09-12T00:49:07.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.733+0000 7fb46c126800 20 remove_watcher() i=6 2024-09-12T00:49:07.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.734+0000 7fb46c126800 20 remove_watcher() i=7 2024-09-12T00:49:07.744 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T00:49:07.802 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:07.802 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:07.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.838+0000 7f7ef912c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.840+0000 7f7ef912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.840+0000 7f7ef912c800 20 realm 2024-09-12T00:49:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.840+0000 7f7ef912c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.840+0000 7f7ef912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.840+0000 7f7ef912c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.840+0000 7f7ef912c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.840+0000 7f7ef912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:07.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.840+0000 7f7ef912c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.841+0000 7f7ef912c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:07.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.841+0000 7f7ef912c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:07.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.842+0000 7f7ef912c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:07.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.842+0000 7f7ef912c800 20 searching for the correct realm 2024-09-12T00:49:07.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:07.845+0000 7f7ef4560640 0 -- 172.21.15.62:0/851155141 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f7eec069170 msgr2=0x7f7eec06c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:08.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.050+0000 7f7ef5562640 0 -- 172.21.15.62:0/851155141 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x562bdc4da1c0 msgr2=0x562bdc4dc630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:08.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.054+0000 7f7ef912c800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:49:08.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.054+0000 7f7ef912c800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:49:08.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.054+0000 7f7ef912c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:08.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.054+0000 7f7ef912c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:08.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.054+0000 7f7ef912c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:08.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.054+0000 7f7ef912c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:08.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.054+0000 7f7ef912c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.055+0000 7f7ef912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:08.054 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.055+0000 7f7ef912c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.055+0000 7f7ef912c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:08.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.055+0000 7f7ef912c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.055+0000 7f7ef912c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:08.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.055+0000 7f7ef912c800 20 zone default found 2024-09-12T00:49:08.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.055+0000 7f7ef912c800 4 Realm: () 2024-09-12T00:49:08.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.055+0000 7f7ef912c800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:49:08.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.055+0000 7f7ef912c800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:49:08.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.055+0000 7f7ef912c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:08.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.055+0000 7f7ef912c800 20 zonegroup default 2024-09-12T00:49:08.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.055+0000 7f7ef912c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.055+0000 7f7ef912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:08.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.055+0000 7f7ef912c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.056+0000 7f7ef912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:08.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.056+0000 7f7ef912c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.056+0000 7f7ef912c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:08.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.056+0000 7f7ef912c800 20 started sync module instance, tier type = 2024-09-12T00:49:08.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.056+0000 7f7ef912c800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:49:08.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.064+0000 7f7ef912c800 20 add_watcher() i=0 2024-09-12T00:49:08.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.064+0000 7f7ef912c800 20 add_watcher() i=1 2024-09-12T00:49:08.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.064+0000 7f7ef912c800 20 add_watcher() i=2 2024-09-12T00:49:08.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.064+0000 7f7ef912c800 20 add_watcher() i=3 2024-09-12T00:49:08.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.064+0000 7f7ef912c800 20 add_watcher() i=4 2024-09-12T00:49:08.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.064+0000 7f7ef912c800 20 add_watcher() i=5 2024-09-12T00:49:08.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.064+0000 7f7ef912c800 20 add_watcher() i=6 2024-09-12T00:49:08.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.065+0000 7f7ef912c800 20 add_watcher() i=7 2024-09-12T00:49:08.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.065+0000 7f7ef912c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:08.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.067+0000 7f7daafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:08.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.067+0000 7f7ef912c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:08.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.067+0000 7f7ef912c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:08.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.102+0000 7f7da9fe3640 20 reqs_thread_entry: start 2024-09-12T00:49:08.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.102+0000 7f7ef912c800 20 init_complete bucket index max shards: 1 2024-09-12T00:49:08.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.102+0000 7f7ef912c800 20 Filter name: none 2024-09-12T00:49:08.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.102+0000 7f7d1b7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:08.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.102+0000 7f7ef912c800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:49:08.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.102+0000 7f7ef912c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:08.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.103+0000 7f7ef912c800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:49:08.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.103+0000 7f7ef912c800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T00:49:08.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.103+0000 7f7ef912c800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:49:08.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.103+0000 7f7ef912c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:08.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.103+0000 7f7ef912c800 10 removing key index: PIZXCQXGRRHSHRJFLKNN 2024-09-12T00:49:08.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.104+0000 7f7ef912c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:PIZXCQXGRRHSHRJFLKNN, ofs0, ns] 2024-09-12T00:49:08.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.104+0000 7f7dcbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431577 cookie 94746379722592 notifier 5705 bl.length()=170 2024-09-12T00:49:08.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.106+0000 7f7ef912c800 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T00:49:08.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.107+0000 7f7ef912c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:49:08.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.107+0000 7f7dcb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431626 cookie 94746379734544 notifier 5705 bl.length()=182 2024-09-12T00:49:08.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.108+0000 7f7ef912c800 10 removing user buckets index 2024-09-12T00:49:08.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.110+0000 7f7ef912c800 10 removing user index: sysuser.client.0 2024-09-12T00:49:08.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.111+0000 7f7ef912c800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T00:49:08.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.111+0000 7f7ef912c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:49:08.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.111+0000 7f7dcbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431574 cookie 94746379729808 notifier 5705 bl.length()=165 2024-09-12T00:49:08.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.113+0000 7f7daafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:08.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.115+0000 7f7ef912c800 20 remove_watcher() i=0 2024-09-12T00:49:08.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.115+0000 7f7ef912c800 2 removed watcher, disabling cache 2024-09-12T00:49:08.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.116+0000 7f7ef912c800 20 remove_watcher() i=1 2024-09-12T00:49:08.116 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.117+0000 7f7ef912c800 20 remove_watcher() i=2 2024-09-12T00:49:08.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.118+0000 7f7ef912c800 20 remove_watcher() i=3 2024-09-12T00:49:08.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.119+0000 7f7ef912c800 20 remove_watcher() i=4 2024-09-12T00:49:08.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.120+0000 7f7ef912c800 20 remove_watcher() i=5 2024-09-12T00:49:08.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.121+0000 7f7ef912c800 20 remove_watcher() i=6 2024-09-12T00:49:08.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:49:08.121+0000 7f7ef912c800 20 remove_watcher() i=7 2024-09-12T00:49:08.131 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T00:49:08.132 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:49:08.217 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:49:08.267 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:49:08.267 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:49:08.267 DEBUG:teuthology.orchestra.run.smithi062:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:49:08.297 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:49:08.297 INFO:teuthology.orchestra.run.smithi062.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:49:08.297 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:49:08.368 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:49:08.368 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:49:08.438 INFO:tasks.workunit:timeout=3h 2024-09-12T00:49:08.438 INFO:tasks.workunit:cleanup=True 2024-09-12T00:49:08.439 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:49:08.509 INFO:tasks.workunit.client.0.smithi062.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:49:54.062 INFO:tasks.workunit.client.0.smithi062.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:49:54.063 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:49:54.063 INFO:tasks.workunit.client.0.smithi062.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:49:54.063 INFO:tasks.workunit.client.0.smithi062.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:49:54.063 INFO:tasks.workunit.client.0.smithi062.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:49:54.063 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:49:54.063 INFO:tasks.workunit.client.0.smithi062.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:49:54.063 INFO:tasks.workunit.client.0.smithi062.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:49:54.064 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:49:54.064 INFO:tasks.workunit.client.0.smithi062.stderr: git switch -c 2024-09-12T00:49:54.064 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:49:54.064 INFO:tasks.workunit.client.0.smithi062.stderr:Or undo this operation with: 2024-09-12T00:49:54.064 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:49:54.064 INFO:tasks.workunit.client.0.smithi062.stderr: git switch - 2024-09-12T00:49:54.064 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:49:54.064 INFO:tasks.workunit.client.0.smithi062.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:49:54.064 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:49:54.064 INFO:tasks.workunit.client.0.smithi062.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:49:54.067 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:49:54.137 INFO:tasks.workunit.client.0.smithi062.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:49:54.139 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:49:54.139 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:49:54.188 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:49:54.238 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:49:54.278 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:49:54.280 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:49:54.280 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:49:54.320 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:49:54.323 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:49:54.323 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:49:54.393 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T00:49:54.394 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T00:49:54.395 DEBUG:teuthology.orchestra.run.smithi062:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:49:54.467 INFO:tasks.workunit.client.0.smithi062.stderr:+ ulimit -c 0 2024-09-12T00:49:54.468 INFO:tasks.workunit.client.0.smithi062.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:49:54.468 INFO:tasks.workunit.client.0.smithi062.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:49:54.468 INFO:tasks.workunit.client.0.smithi062.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:49:56.870 INFO:tasks.workunit.client.0.smithi062.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:49:56.871 INFO:tasks.workunit.client.0.smithi062.stderr:++ deactivate nondestructive 2024-09-12T00:49:56.871 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n '' ']' 2024-09-12T00:49:56.871 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n '' ']' 2024-09-12T00:49:56.871 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:49:56.871 INFO:tasks.workunit.client.0.smithi062.stderr:++ hash -r 2024-09-12T00:49:56.871 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n '' ']' 2024-09-12T00:49:56.871 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:49:56.871 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:49:56.872 INFO:tasks.workunit.client.0.smithi062.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:49:56.872 INFO:tasks.workunit.client.0.smithi062.stderr:++ export VIRTUAL_ENV 2024-09-12T00:49:56.872 INFO:tasks.workunit.client.0.smithi062.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:49:56.873 INFO:tasks.workunit.client.0.smithi062.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:49:56.873 INFO:tasks.workunit.client.0.smithi062.stderr:++ export PATH 2024-09-12T00:49:56.873 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n '' ']' 2024-09-12T00:49:56.873 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-09-12T00:49:56.873 INFO:tasks.workunit.client.0.smithi062.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:49:56.874 INFO:tasks.workunit.client.0.smithi062.stderr:++ PS1='(rgw) ' 2024-09-12T00:49:56.874 INFO:tasks.workunit.client.0.smithi062.stderr:++ export PS1 2024-09-12T00:49:56.874 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:49:56.874 INFO:tasks.workunit.client.0.smithi062.stderr:++ hash -r 2024-09-12T00:49:56.874 INFO:tasks.workunit.client.0.smithi062.stderr:+ pip install pip --upgrade 2024-09-12T00:49:57.110 INFO:tasks.workunit.client.0.smithi062.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:49:57.308 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting pip 2024-09-12T00:49:57.314 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:49:57.361 INFO:tasks.workunit.client.0.smithi062.stdout:Installing collected packages: pip 2024-09-12T00:49:57.361 INFO:tasks.workunit.client.0.smithi062.stdout: Attempting uninstall: pip 2024-09-12T00:49:57.361 INFO:tasks.workunit.client.0.smithi062.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:49:57.523 INFO:tasks.workunit.client.0.smithi062.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:49:57.529 INFO:tasks.workunit.client.0.smithi062.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:49:58.303 INFO:tasks.workunit.client.0.smithi062.stdout:Successfully installed pip-24.2 2024-09-12T00:49:58.353 INFO:tasks.workunit.client.0.smithi062.stderr:+ pip install boto3 2024-09-12T00:49:59.182 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting boto3 2024-09-12T00:49:59.184 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:49:59.804 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:49:59.806 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:49:59.857 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:49:59.858 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:49:59.913 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:49:59.914 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:49:59.963 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:49:59.965 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:50:00.067 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:50:00.068 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:50:00.243 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:50:00.245 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:50:00.249 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:50:00.250 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:50:00.260 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:50:00.261 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:50:00.262 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:50:00.264 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:50:00.265 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:50:00.341 INFO:tasks.workunit.client.0.smithi062.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:50:01.407 INFO:tasks.workunit.client.0.smithi062.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:50:01.526 INFO:tasks.workunit.client.0.smithi062.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T00:50:01.654 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T00:50:01.690 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:01.690 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:01.731 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:01.732+0000 7fb5ffa20800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:01.733+0000 7fb5ffa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:01.733+0000 7fb5ffa20800 20 realm 2024-09-12T00:50:01.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:01.733+0000 7fb5ffa20800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:01.733+0000 7fb5ffa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:01.733+0000 7fb5ffa20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:01.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:01.733+0000 7fb5ffa20800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:01.733+0000 7fb5ffa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:01.733+0000 7fb5ffa20800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:01.734+0000 7fb5ffa20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:01.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:01.734+0000 7fb5ffa20800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:01.734+0000 7fb5ffa20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:01.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:01.734+0000 7fb5ffa20800 20 searching for the correct realm 2024-09-12T00:50:01.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:01.938+0000 7fb5fcd10640 0 -- 172.21.15.62:0/2199905983 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fb5f8066a90 msgr2=0x7fb5f8077920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:02.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.344+0000 7fb5fdd12640 0 -- 172.21.15.62:0/2199905983 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55b752ae6ae0 msgr2=0x55b752ae8fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:02.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.348+0000 7fb5ffa20800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:02.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.348+0000 7fb5ffa20800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:02.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.348+0000 7fb5ffa20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:02.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.348+0000 7fb5ffa20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:02.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.348+0000 7fb5ffa20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:02.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.348+0000 7fb5ffa20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:02.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.348+0000 7fb5ffa20800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.349+0000 7fb5ffa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.349+0000 7fb5ffa20800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.349+0000 7fb5ffa20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:02.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.349+0000 7fb5ffa20800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.349+0000 7fb5ffa20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:02.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.349+0000 7fb5ffa20800 20 zone default found 2024-09-12T00:50:02.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.349+0000 7fb5ffa20800 4 Realm: () 2024-09-12T00:50:02.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.349+0000 7fb5ffa20800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:02.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.349+0000 7fb5ffa20800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:02.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.349+0000 7fb5ffa20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:02.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.349+0000 7fb5ffa20800 20 zonegroup default 2024-09-12T00:50:02.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.349+0000 7fb5ffa20800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.350+0000 7fb5ffa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.350+0000 7fb5ffa20800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.350+0000 7fb5ffa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.350+0000 7fb5ffa20800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.350+0000 7fb5ffa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.350+0000 7fb5ffa20800 20 started sync module instance, tier type = 2024-09-12T00:50:02.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.350+0000 7fb5ffa20800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:02.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.360+0000 7fb5ffa20800 20 add_watcher() i=0 2024-09-12T00:50:02.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.360+0000 7fb5ffa20800 20 add_watcher() i=1 2024-09-12T00:50:02.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.360+0000 7fb5ffa20800 20 add_watcher() i=2 2024-09-12T00:50:02.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.360+0000 7fb5ffa20800 20 add_watcher() i=3 2024-09-12T00:50:02.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.360+0000 7fb5ffa20800 20 add_watcher() i=4 2024-09-12T00:50:02.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.360+0000 7fb5ffa20800 20 add_watcher() i=5 2024-09-12T00:50:02.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.360+0000 7fb5ffa20800 20 add_watcher() i=6 2024-09-12T00:50:02.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.362+0000 7fb5ffa20800 20 add_watcher() i=7 2024-09-12T00:50:02.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.362+0000 7fb5ffa20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:02.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.365+0000 7fb4b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:02.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.365+0000 7fb5ffa20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:02.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.365+0000 7fb5ffa20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:02.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.365+0000 7fb5ffa20800 5 note: GC not initialized 2024-09-12T00:50:02.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.365+0000 7fb4b27e4640 20 reqs_thread_entry: start 2024-09-12T00:50:02.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.365+0000 7fb5ffa20800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:02.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.365+0000 7fb5ffa20800 20 Filter name: none 2024-09-12T00:50:02.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.366+0000 7fb423fff640 20 reqs_thread_entry: start 2024-09-12T00:50:02.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.366+0000 7fb5ffa20800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T00:50:02.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.366+0000 7fb5ffa20800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.366+0000 7fb5ffa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.366+0000 7fb5ffa20800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T00:50:02.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.366+0000 7fb5ffa20800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:50:02.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.366+0000 7fb5ffa20800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T00:50:02.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.366+0000 7fb5ffa20800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.366+0000 7fb5ffa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.367+0000 7fb5ffa20800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T00:50:02.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.367+0000 7fb5ffa20800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:50:02.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.367+0000 7fb5ffa20800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:50:02.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.367+0000 7fb5ffa20800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:50:02.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.368+0000 7fb5ffa20800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:50:02.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.368+0000 7fb5ffa20800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:50:02.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.368+0000 7fb5ffa20800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-12T00:50:02.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.368+0000 7fb4e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431632 cookie 94245854601984 notifier 6033 bl.length()=569 2024-09-12T00:50:02.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.368+0000 7fb4e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:50:02.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.368+0000 7fb4e0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:50:02.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.372+0000 7fb5ffa20800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:50:02.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.372+0000 7fb5ffa20800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:50:02.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.372+0000 7fb5ffa20800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T00:50:02.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.372+0000 7fb4e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431633 cookie 94245854616064 notifier 6033 bl.length()=180 2024-09-12T00:50:02.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.372+0000 7fb4e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:50:02.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.372+0000 7fb4e0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:50:02.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.374+0000 7fb4b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:02.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.377+0000 7fb5ffa20800 20 remove_watcher() i=0 2024-09-12T00:50:02.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.377+0000 7fb5ffa20800 2 removed watcher, disabling cache 2024-09-12T00:50:02.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.378+0000 7fb5ffa20800 20 remove_watcher() i=1 2024-09-12T00:50:02.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.379+0000 7fb5ffa20800 20 remove_watcher() i=2 2024-09-12T00:50:02.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.380+0000 7fb5ffa20800 20 remove_watcher() i=3 2024-09-12T00:50:02.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.381+0000 7fb5ffa20800 20 remove_watcher() i=4 2024-09-12T00:50:02.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.382+0000 7fb5ffa20800 20 remove_watcher() i=5 2024-09-12T00:50:02.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.383+0000 7fb5ffa20800 20 remove_watcher() i=6 2024-09-12T00:50:02.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.385+0000 7fb5ffa20800 20 remove_watcher() i=7 2024-09-12T00:50:02.758 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard add 2024-09-12T00:50:02.758 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:02.759 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:50:02.789 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:02.789 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:02.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.830+0000 7f9143010800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.832+0000 7f9143010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.832+0000 7f9143010800 20 realm 2024-09-12T00:50:02.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.832+0000 7f9143010800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.832+0000 7f9143010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.832+0000 7f9143010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:02.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.832+0000 7f9143010800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.832+0000 7f9143010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.832+0000 7f9143010800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.833+0000 7f9143010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:02.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.833+0000 7f9143010800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.834+0000 7f9143010800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:02.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.834+0000 7f9143010800 20 searching for the correct realm 2024-09-12T00:50:02.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.835+0000 7f913e7bc640 0 -- 172.21.15.62:0/2313496682 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x5649f9265c10 msgr2=0x7f9138075ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:02.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:02.840+0000 7f913efbd640 0 -- 172.21.15.62:0/2313496682 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7f91300a0020 msgr2=0x7f91300a1a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:03.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.048+0000 7f9143010800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:03.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.048+0000 7f9143010800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:03.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.048+0000 7f9143010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:03.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.048+0000 7f9143010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:03.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.048+0000 7f9143010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:03.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.048+0000 7f9143010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:03.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.048+0000 7f9143010800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.049+0000 7f9143010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.049+0000 7f9143010800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.049+0000 7f9143010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:03.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.049+0000 7f9143010800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.049+0000 7f9143010800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:03.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.049+0000 7f9143010800 20 zone default found 2024-09-12T00:50:03.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.049+0000 7f9143010800 4 Realm: () 2024-09-12T00:50:03.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.049+0000 7f9143010800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:03.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.049+0000 7f9143010800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:03.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.049+0000 7f9143010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:03.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.049+0000 7f9143010800 20 zonegroup default 2024-09-12T00:50:03.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.049+0000 7f9143010800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.050+0000 7f9143010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.050+0000 7f9143010800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.050+0000 7f9143010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.050+0000 7f9143010800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.050+0000 7f9143010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.050+0000 7f9143010800 20 started sync module instance, tier type = 2024-09-12T00:50:03.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.050+0000 7f9143010800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:03.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.060+0000 7f9143010800 20 add_watcher() i=0 2024-09-12T00:50:03.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.060+0000 7f9143010800 20 add_watcher() i=1 2024-09-12T00:50:03.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.060+0000 7f9143010800 20 add_watcher() i=2 2024-09-12T00:50:03.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.060+0000 7f9143010800 20 add_watcher() i=3 2024-09-12T00:50:03.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.060+0000 7f9143010800 20 add_watcher() i=4 2024-09-12T00:50:03.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.060+0000 7f9143010800 20 add_watcher() i=5 2024-09-12T00:50:03.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.060+0000 7f9143010800 20 add_watcher() i=6 2024-09-12T00:50:03.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.062+0000 7f9143010800 20 add_watcher() i=7 2024-09-12T00:50:03.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.062+0000 7f9143010800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:03.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.064+0000 7f8ff4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:03.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.064+0000 7f9143010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:03.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.064+0000 7f9143010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:03.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.064+0000 7f9143010800 5 note: GC not initialized 2024-09-12T00:50:03.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.064+0000 7f8f6f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:03.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.064+0000 7f9143010800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:03.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.064+0000 7f9143010800 20 Filter name: none 2024-09-12T00:50:03.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.064+0000 7f8f6d7fa640 20 reqs_thread_entry: start 2024-09-12T00:50:03.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.065+0000 7f9143010800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.065+0000 7f9143010800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:50:03.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.065+0000 7f9143010800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.065+0000 7f9143010800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:50:03.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.066+0000 7f9143010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:03.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.066+0000 7f9143010800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.066+0000 7f9143010800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:50:03.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.066+0000 7f9143010800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.066+0000 7f9143010800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:50:03.066 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.066+0000 7f9143010800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:03.066 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.067+0000 7f8ff4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:03.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.070+0000 7f9143010800 20 remove_watcher() i=0 2024-09-12T00:50:03.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.070+0000 7f9143010800 2 removed watcher, disabling cache 2024-09-12T00:50:03.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.071+0000 7f9143010800 20 remove_watcher() i=1 2024-09-12T00:50:03.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.072+0000 7f9143010800 20 remove_watcher() i=2 2024-09-12T00:50:03.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.073+0000 7f9143010800 20 remove_watcher() i=3 2024-09-12T00:50:03.073 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.074+0000 7f9143010800 20 remove_watcher() i=4 2024-09-12T00:50:03.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.075+0000 7f9143010800 20 remove_watcher() i=5 2024-09-12T00:50:03.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.076+0000 7f9143010800 20 remove_watcher() i=6 2024-09-12T00:50:03.077 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.078+0000 7f9143010800 20 remove_watcher() i=7 2024-09-12T00:50:03.088 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:03.088 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:03.088 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: a-bucket id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T00:50:03.088 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:03.089 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-09-12T00:50:03.121 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:03.121 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:03.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.163+0000 7f1260213800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.164+0000 7f1260213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.164+0000 7f1260213800 20 realm 2024-09-12T00:50:03.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.164+0000 7f1260213800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.165+0000 7f1260213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.165+0000 7f1260213800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:03.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.165+0000 7f1260213800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.165+0000 7f1260213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.165+0000 7f1260213800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.166+0000 7f1260213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:03.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.166+0000 7f1260213800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.166+0000 7f1260213800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:03.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.166+0000 7f1260213800 20 searching for the correct realm 2024-09-12T00:50:03.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.169+0000 7f125b147640 0 -- 172.21.15.62:0/1771682401 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f1254060bc0 msgr2=0x7f12540860c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:03.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.374+0000 7f125c149640 0 -- 172.21.15.62:0/1771682401 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55bbfbfcddd0 msgr2=0x55bbfbfd0240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:03.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.379+0000 7f1260213800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:03.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.379+0000 7f1260213800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:03.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.379+0000 7f1260213800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:03.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.379+0000 7f1260213800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:03.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.379+0000 7f1260213800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:03.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.379+0000 7f1260213800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:03.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.379+0000 7f1260213800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.379+0000 7f1260213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.379+0000 7f1260213800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.380+0000 7f1260213800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:03.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.380+0000 7f1260213800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.380+0000 7f1260213800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:03.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.380+0000 7f1260213800 20 zone default found 2024-09-12T00:50:03.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.380+0000 7f1260213800 4 Realm: () 2024-09-12T00:50:03.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.380+0000 7f1260213800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:03.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.380+0000 7f1260213800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:03.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.380+0000 7f1260213800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:03.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.380+0000 7f1260213800 20 zonegroup default 2024-09-12T00:50:03.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.380+0000 7f1260213800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.381+0000 7f1260213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.381+0000 7f1260213800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.381+0000 7f1260213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.381+0000 7f1260213800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.381+0000 7f1260213800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.381+0000 7f1260213800 20 started sync module instance, tier type = 2024-09-12T00:50:03.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.381+0000 7f1260213800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:03.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.392+0000 7f1260213800 20 add_watcher() i=0 2024-09-12T00:50:03.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.392+0000 7f1260213800 20 add_watcher() i=1 2024-09-12T00:50:03.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.392+0000 7f1260213800 20 add_watcher() i=2 2024-09-12T00:50:03.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.392+0000 7f1260213800 20 add_watcher() i=3 2024-09-12T00:50:03.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.392+0000 7f1260213800 20 add_watcher() i=4 2024-09-12T00:50:03.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.392+0000 7f1260213800 20 add_watcher() i=5 2024-09-12T00:50:03.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.392+0000 7f1260213800 20 add_watcher() i=6 2024-09-12T00:50:03.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.393+0000 7f1260213800 20 add_watcher() i=7 2024-09-12T00:50:03.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.393+0000 7f1260213800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:03.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.395+0000 7f1111fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:03.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.395+0000 7f1260213800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:03.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.395+0000 7f1260213800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:03.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.395+0000 7f1260213800 5 note: GC not initialized 2024-09-12T00:50:03.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.396+0000 7f1110fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:03.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.396+0000 7f1260213800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:03.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.396+0000 7f1260213800 20 Filter name: none 2024-09-12T00:50:03.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.396+0000 7f108a7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:03.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.396+0000 7f1260213800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:50:03.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.396+0000 7f1260213800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.396+0000 7f1260213800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:50:03.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.396+0000 7f1260213800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:50:03.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.396+0000 7f1260213800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:50:03.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.396+0000 7f1260213800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:50:03.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.396+0000 7f1260213800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.397+0000 7f1260213800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:50:03.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.397+0000 7f1260213800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:03.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.397+0000 7f1260213800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:03.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.397+0000 7f1260213800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:03.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.397+0000 7f1260213800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:03.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.397+0000 7f1260213800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:50:03.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.399+0000 7f1111fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:03.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.402+0000 7f1260213800 20 remove_watcher() i=0 2024-09-12T00:50:03.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.402+0000 7f1260213800 2 removed watcher, disabling cache 2024-09-12T00:50:03.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.403+0000 7f1260213800 20 remove_watcher() i=1 2024-09-12T00:50:03.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.404+0000 7f1260213800 20 remove_watcher() i=2 2024-09-12T00:50:03.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.405+0000 7f1260213800 20 remove_watcher() i=3 2024-09-12T00:50:03.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.406+0000 7f1260213800 20 remove_watcher() i=4 2024-09-12T00:50:03.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.407+0000 7f1260213800 20 remove_watcher() i=5 2024-09-12T00:50:03.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.408+0000 7f1260213800 20 remove_watcher() i=6 2024-09-12T00:50:03.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.409+0000 7f1260213800 20 remove_watcher() i=7 2024-09-12T00:50:03.421 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin reshard list 2024-09-12T00:50:03.449 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:03.449 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:03.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.489+0000 7f26fbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.491+0000 7f26fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.491+0000 7f26fbb26800 20 realm 2024-09-12T00:50:03.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.491+0000 7f26fbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.491+0000 7f26fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.491+0000 7f26fbb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:03.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.491+0000 7f26fbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.491+0000 7f26fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.491+0000 7f26fbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.492+0000 7f26fbb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:03.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.492+0000 7f26fbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.493+0000 7f26fbb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:03.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.493+0000 7f26fbb26800 20 searching for the correct realm 2024-09-12T00:50:03.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.496+0000 7f26f6fb4640 0 -- 172.21.15.62:0/3505497201 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f26f0085900 msgr2=0x7f26f0063400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:03.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.499+0000 7f26f77b5640 0 -- 172.21.15.62:0/3505497201 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f26f0084380 msgr2=0x7f26f0084800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:03.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.503+0000 7f26fbb26800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:03.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.503+0000 7f26fbb26800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:03.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.503+0000 7f26fbb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:03.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.503+0000 7f26fbb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:03.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.503+0000 7f26fbb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:03.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.503+0000 7f26fbb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:03.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.503+0000 7f26fbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.503+0000 7f26fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.503+0000 7f26fbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.504+0000 7f26fbb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:03.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.504+0000 7f26fbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.504+0000 7f26fbb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:03.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.504+0000 7f26fbb26800 20 zone default found 2024-09-12T00:50:03.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.504+0000 7f26fbb26800 4 Realm: () 2024-09-12T00:50:03.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.504+0000 7f26fbb26800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:03.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.504+0000 7f26fbb26800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:03.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.504+0000 7f26fbb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:03.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.504+0000 7f26fbb26800 20 zonegroup default 2024-09-12T00:50:03.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.504+0000 7f26fbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.504+0000 7f26fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.504+0000 7f26fbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.505+0000 7f26fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.505+0000 7f26fbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.505+0000 7f26fbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.505+0000 7f26fbb26800 20 started sync module instance, tier type = 2024-09-12T00:50:03.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.505+0000 7f26fbb26800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:03.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.514+0000 7f26fbb26800 20 add_watcher() i=0 2024-09-12T00:50:03.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.514+0000 7f26fbb26800 20 add_watcher() i=1 2024-09-12T00:50:03.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.514+0000 7f26fbb26800 20 add_watcher() i=2 2024-09-12T00:50:03.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.514+0000 7f26fbb26800 20 add_watcher() i=3 2024-09-12T00:50:03.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.514+0000 7f26fbb26800 20 add_watcher() i=4 2024-09-12T00:50:03.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.514+0000 7f26fbb26800 20 add_watcher() i=5 2024-09-12T00:50:03.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.514+0000 7f26fbb26800 20 add_watcher() i=6 2024-09-12T00:50:03.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.515+0000 7f26fbb26800 20 add_watcher() i=7 2024-09-12T00:50:03.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.515+0000 7f26fbb26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:03.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.516+0000 7f25adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:03.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.517+0000 7f26fbb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:03.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.517+0000 7f26fbb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:03.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.517+0000 7f26fbb26800 5 note: GC not initialized 2024-09-12T00:50:03.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.517+0000 7f25acfe1640 20 reqs_thread_entry: start 2024-09-12T00:50:03.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.517+0000 7f26fbb26800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:03.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.517+0000 7f26fbb26800 20 Filter name: none 2024-09-12T00:50:03.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.517+0000 7f25267fc640 20 reqs_thread_entry: start 2024-09-12T00:50:03.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.523+0000 7f25adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:03.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.525+0000 7f26fbb26800 20 remove_watcher() i=0 2024-09-12T00:50:03.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.526+0000 7f26fbb26800 2 removed watcher, disabling cache 2024-09-12T00:50:03.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.527+0000 7f26fbb26800 20 remove_watcher() i=1 2024-09-12T00:50:03.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.528+0000 7f26fbb26800 20 remove_watcher() i=2 2024-09-12T00:50:03.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.529+0000 7f26fbb26800 20 remove_watcher() i=3 2024-09-12T00:50:03.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.530+0000 7f26fbb26800 20 remove_watcher() i=4 2024-09-12T00:50:03.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.531+0000 7f26fbb26800 20 remove_watcher() i=5 2024-09-12T00:50:03.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.532+0000 7f26fbb26800 20 remove_watcher() i=6 2024-09-12T00:50:03.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.533+0000 7f26fbb26800 20 remove_watcher() i=7 2024-09-12T00:50:03.543 INFO:tasks.workunit.client.0.smithi062.stderr:bucket name a-bucket 2024-09-12T00:50:03.543 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard process 2024-09-12T00:50:03.543 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:03.545 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin reshard process 2024-09-12T00:50:03.572 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:03.572 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:03.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.796+0000 7f4ffe421640 0 --2- 172.21.15.62:0/1438007280 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55a2dce72a70 0x55a2dcfed240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:50:03.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.815+0000 7f5002737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.817+0000 7f5002737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.817+0000 7f5002737800 20 realm 2024-09-12T00:50:03.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.817+0000 7f5002737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.817+0000 7f5002737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.817+0000 7f5002737800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:03.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.817+0000 7f5002737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.817+0000 7f5002737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.817+0000 7f5002737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.818+0000 7f5002737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:03.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.818+0000 7f5002737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.818+0000 7f5002737800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:03.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.818+0000 7f5002737800 20 searching for the correct realm 2024-09-12T00:50:03.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.821+0000 7f4ffdc20640 0 -- 172.21.15.62:0/670670330 >> [v2:172.21.15.62:6808/741930476,v1:172.21.15.62:6809/741930476] conn(0x55a2dd0ad270 msgr2=0x55a2dd0af660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:03.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:03.824+0000 7f4ffe421640 0 -- 172.21.15.62:0/670670330 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f4ff806a5d0 msgr2=0x7f4ff805fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:04.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.030+0000 7f5002737800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:04.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.030+0000 7f5002737800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:04.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.030+0000 7f5002737800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:04.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.030+0000 7f5002737800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:04.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.030+0000 7f5002737800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:04.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.030+0000 7f5002737800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:04.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.030+0000 7f5002737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.030+0000 7f5002737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.030+0000 7f5002737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.031+0000 7f5002737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:04.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.031+0000 7f5002737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.031+0000 7f5002737800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:04.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.031+0000 7f5002737800 20 zone default found 2024-09-12T00:50:04.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.031+0000 7f5002737800 4 Realm: () 2024-09-12T00:50:04.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.031+0000 7f5002737800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:04.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.031+0000 7f5002737800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:04.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.031+0000 7f5002737800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:04.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.031+0000 7f5002737800 20 zonegroup default 2024-09-12T00:50:04.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.031+0000 7f5002737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.031+0000 7f5002737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.031+0000 7f5002737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.032+0000 7f5002737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.032+0000 7f5002737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.032+0000 7f5002737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.032+0000 7f5002737800 20 started sync module instance, tier type = 2024-09-12T00:50:04.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.032+0000 7f5002737800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:04.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.041+0000 7f5002737800 20 add_watcher() i=0 2024-09-12T00:50:04.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.041+0000 7f5002737800 20 add_watcher() i=1 2024-09-12T00:50:04.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.041+0000 7f5002737800 20 add_watcher() i=2 2024-09-12T00:50:04.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.041+0000 7f5002737800 20 add_watcher() i=3 2024-09-12T00:50:04.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.041+0000 7f5002737800 20 add_watcher() i=4 2024-09-12T00:50:04.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.041+0000 7f5002737800 20 add_watcher() i=5 2024-09-12T00:50:04.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.041+0000 7f5002737800 20 add_watcher() i=6 2024-09-12T00:50:04.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.042+0000 7f5002737800 20 add_watcher() i=7 2024-09-12T00:50:04.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.042+0000 7f5002737800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:04.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.044+0000 7f4eb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:04.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.044+0000 7f5002737800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:04.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.044+0000 7f5002737800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:04.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.044+0000 7f5002737800 5 note: GC not initialized 2024-09-12T00:50:04.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.044+0000 7f4e2f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:04.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.044+0000 7f5002737800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:04.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.044+0000 7f5002737800 20 Filter name: none 2024-09-12T00:50:04.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.045+0000 7f4e2d7fa640 20 reqs_thread_entry: start 2024-09-12T00:50:04.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.045+0000 7f5002737800 20 processing logshard = reshard.0000000000 2024-09-12T00:50:04.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.047+0000 7f5002737800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:50:04.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.047+0000 7f5002737800 20 processing logshard = reshard.0000000001 2024-09-12T00:50:04.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.049+0000 7f5002737800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:50:04.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.049+0000 7f5002737800 20 processing logshard = reshard.0000000002 2024-09-12T00:50:04.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.052+0000 7f5002737800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:50:04.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.052+0000 7f5002737800 20 processing logshard = reshard.0000000003 2024-09-12T00:50:04.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.054+0000 7f5002737800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:50:04.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.054+0000 7f5002737800 20 processing logshard = reshard.0000000004 2024-09-12T00:50:04.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.056+0000 7f5002737800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:50:04.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.056+0000 7f5002737800 20 processing logshard = reshard.0000000005 2024-09-12T00:50:04.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.059+0000 7f5002737800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:50:04.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.059+0000 7f5002737800 20 processing logshard = reshard.0000000006 2024-09-12T00:50:04.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.060+0000 7f5002737800 20 process_entry resharding a-bucket 2024-09-12T00:50:04.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.060+0000 7f5002737800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:50:04.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.060+0000 7f5002737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.060+0000 7f5002737800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:50:04.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.060+0000 7f5002737800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:50:04.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.060+0000 7f5002737800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:50:04.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.060+0000 7f5002737800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:50:04.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.060+0000 7f5002737800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.061+0000 7f5002737800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:50:04.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.061+0000 7f5002737800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:04.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.061+0000 7f5002737800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:04.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.061+0000 7f5002737800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:04.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.061+0000 7f5002737800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:04.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.061+0000 7f5002737800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:50:04.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.066+0000 7f5002737800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:04.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.066+0000 7f5002737800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:04.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.066+0000 7f5002737800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:04.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.066+0000 7f5002737800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:50:04.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.066+0000 7f4ee1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431629 cookie 94157981568880 notifier 6099 bl.length()=827 2024-09-12T00:50:04.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.066+0000 7f4ee1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:04.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.066+0000 7f4ee1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:04.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.066+0000 7f4ee1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:04.066 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.068+0000 7f5002737800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:50:04.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.068+0000 7f5002737800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:50:04.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.068+0000 7f5002737800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:50:04.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.068+0000 7f5002737800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:50:04.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.070+0000 7f5002737800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.1.0 2024-09-12T00:50:04.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.070+0000 7f5002737800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.1.0 2024-09-12T00:50:04.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.070+0000 7f5002737800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.1.1 2024-09-12T00:50:04.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.070+0000 7f5002737800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.1.1 2024-09-12T00:50:04.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.070+0000 7f5002737800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.0 2024-09-12T00:50:04.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.070+0000 7f5002737800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:04.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.070+0000 7f5002737800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:50:04.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.071+0000 7f5002737800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:04.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.071+0000 7f5002737800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:04.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.071+0000 7f5002737800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:04.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.071+0000 7f5002737800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:50:04.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.072+0000 7f4ee1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431630 cookie 94157981568880 notifier 6099 bl.length()=827 2024-09-12T00:50:04.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.072+0000 7f4ee1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:04.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.072+0000 7f4ee1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:04.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.072+0000 7f4ee1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:04.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.073+0000 7f5002737800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:50:04.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.073+0000 7f5002737800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:50:04.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.073+0000 7f5002737800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:50:04.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.073+0000 7f5002737800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:50:04.073 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.074+0000 7f5002737800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.0 2024-09-12T00:50:04.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.075+0000 7f5002737800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:04.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.075+0000 7f5002737800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:50:04.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.076+0000 7f5002737800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:04.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.076+0000 7f5002737800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:04.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.076+0000 7f5002737800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:04.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.076+0000 7f5002737800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:50:04.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.076+0000 7f4ee1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431631 cookie 94157981568880 notifier 6099 bl.length()=795 2024-09-12T00:50:04.076 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.076+0000 7f4ee1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:04.076 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.076+0000 7f4ee1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:04.076 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.076+0000 7f4ee1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:04.076 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.078+0000 7f5002737800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:50:04.077 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.078+0000 7f5002737800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:50:04.077 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.078+0000 7f5002737800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:50:04.077 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.078+0000 7f5002737800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:50:04.077 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.079+0000 7f5002737800 1 execute INFO: reshard of bucket "a-bucket" from 1 shards to 2 shards completed successfully 2024-09-12T00:50:04.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.080+0000 7f5002737800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:50:04.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.082+0000 7f5002737800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:50:04.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.082+0000 7f5002737800 20 processing logshard = reshard.0000000007 2024-09-12T00:50:04.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.085+0000 7f5002737800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:50:04.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.085+0000 7f5002737800 20 processing logshard = reshard.0000000008 2024-09-12T00:50:04.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.087+0000 7f5002737800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:50:04.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.087+0000 7f5002737800 20 processing logshard = reshard.0000000009 2024-09-12T00:50:04.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.089+0000 7f5002737800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:50:04.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.089+0000 7f5002737800 20 processing logshard = reshard.0000000010 2024-09-12T00:50:04.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.092+0000 7f5002737800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:50:04.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.092+0000 7f5002737800 20 processing logshard = reshard.0000000011 2024-09-12T00:50:04.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.095+0000 7f5002737800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:50:04.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.095+0000 7f5002737800 20 processing logshard = reshard.0000000012 2024-09-12T00:50:04.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.097+0000 7f5002737800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:50:04.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.097+0000 7f5002737800 20 processing logshard = reshard.0000000013 2024-09-12T00:50:04.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.099+0000 7f5002737800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:50:04.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.099+0000 7f5002737800 20 processing logshard = reshard.0000000014 2024-09-12T00:50:04.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.102+0000 7f5002737800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:50:04.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.102+0000 7f5002737800 20 processing logshard = reshard.0000000015 2024-09-12T00:50:04.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.104+0000 7f5002737800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:50:04.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.105+0000 7f4eb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:04.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.107+0000 7f5002737800 20 remove_watcher() i=0 2024-09-12T00:50:04.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.107+0000 7f5002737800 2 removed watcher, disabling cache 2024-09-12T00:50:04.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.108+0000 7f5002737800 20 remove_watcher() i=1 2024-09-12T00:50:04.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.109+0000 7f5002737800 20 remove_watcher() i=2 2024-09-12T00:50:04.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.111+0000 7f5002737800 20 remove_watcher() i=3 2024-09-12T00:50:04.111 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.112+0000 7f5002737800 20 remove_watcher() i=4 2024-09-12T00:50:04.111 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.113+0000 7f5002737800 20 remove_watcher() i=5 2024-09-12T00:50:04.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.113+0000 7f5002737800 20 remove_watcher() i=6 2024-09-12T00:50:04.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:04.114+0000 7f5002737800 20 remove_watcher() i=7 2024-09-12T00:50:09.132 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:50:09.167 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:09.167 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:09.414 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.415+0000 7fd75ef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:09.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.417+0000 7fd75ef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:09.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.417+0000 7fd75ef1f800 20 realm 2024-09-12T00:50:09.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.417+0000 7fd75ef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:09.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.417+0000 7fd75ef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:09.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.417+0000 7fd75ef1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:09.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.417+0000 7fd75ef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:09.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.418+0000 7fd75ef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:09.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.418+0000 7fd75ef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:09.418 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.419+0000 7fd75ef1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:09.418 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.419+0000 7fd75ef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:09.418 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.419+0000 7fd75ef1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:09.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.420+0000 7fd75ef1f800 20 searching for the correct realm 2024-09-12T00:50:09.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.423+0000 7fd75b4a3640 0 -- 172.21.15.62:0/3107887638 >> [v2:172.21.15.77:6816/3177889521,v1:172.21.15.77:6817/3177889521] conn(0x55e93497b140 msgr2=0x55e93497d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:09.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.426+0000 7fd75aca2640 0 -- 172.21.15.62:0/3107887638 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7fd7540a35b0 msgr2=0x7fd7540b0620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:09.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.634+0000 7fd75ef1f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:09.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.634+0000 7fd75ef1f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:09.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.634+0000 7fd75ef1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:09.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.634+0000 7fd75ef1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:09.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.634+0000 7fd75ef1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:09.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.634+0000 7fd75ef1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:09.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.634+0000 7fd75ef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:09.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.634+0000 7fd75ef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:09.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.634+0000 7fd75ef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.635+0000 7fd75ef1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.635+0000 7fd75ef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.635+0000 7fd75ef1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.635+0000 7fd75ef1f800 20 zone default found 2024-09-12T00:50:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.635+0000 7fd75ef1f800 4 Realm: () 2024-09-12T00:50:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.635+0000 7fd75ef1f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.635+0000 7fd75ef1f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.635+0000 7fd75ef1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.635+0000 7fd75ef1f800 20 zonegroup default 2024-09-12T00:50:09.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.635+0000 7fd75ef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.636+0000 7fd75ef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.636+0000 7fd75ef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.636+0000 7fd75ef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.636+0000 7fd75ef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.637+0000 7fd75ef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:09.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.637+0000 7fd75ef1f800 20 started sync module instance, tier type = 2024-09-12T00:50:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.637+0000 7fd75ef1f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:09.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.648+0000 7fd75ef1f800 20 add_watcher() i=0 2024-09-12T00:50:09.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.648+0000 7fd75ef1f800 20 add_watcher() i=1 2024-09-12T00:50:09.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.648+0000 7fd75ef1f800 20 add_watcher() i=2 2024-09-12T00:50:09.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.648+0000 7fd75ef1f800 20 add_watcher() i=3 2024-09-12T00:50:09.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.648+0000 7fd75ef1f800 20 add_watcher() i=4 2024-09-12T00:50:09.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.648+0000 7fd75ef1f800 20 add_watcher() i=5 2024-09-12T00:50:09.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.648+0000 7fd75ef1f800 20 add_watcher() i=6 2024-09-12T00:50:09.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.649+0000 7fd75ef1f800 20 add_watcher() i=7 2024-09-12T00:50:09.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.649+0000 7fd75ef1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:09.650 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.651+0000 7fd6117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.652+0000 7fd75ef1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.652+0000 7fd75ef1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.652+0000 7fd75ef1f800 5 note: GC not initialized 2024-09-12T00:50:09.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.652+0000 7fd58bfff640 20 reqs_thread_entry: start 2024-09-12T00:50:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.652+0000 7fd75ef1f800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.652+0000 7fd75ef1f800 20 Filter name: none 2024-09-12T00:50:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.652+0000 7fd589ffb640 20 reqs_thread_entry: start 2024-09-12T00:50:09.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.652+0000 7fd75ef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.653+0000 7fd75ef1f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:50:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.653+0000 7fd75ef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.653+0000 7fd75ef1f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:50:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.654+0000 7fd75ef1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.654+0000 7fd75ef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.654+0000 7fd75ef1f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:50:09.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.654+0000 7fd75ef1f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.654+0000 7fd75ef1f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:50:09.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.654+0000 7fd75ef1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:09.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.656+0000 7fd6117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:09.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.659+0000 7fd75ef1f800 20 remove_watcher() i=0 2024-09-12T00:50:09.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.659+0000 7fd75ef1f800 2 removed watcher, disabling cache 2024-09-12T00:50:09.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.660+0000 7fd75ef1f800 20 remove_watcher() i=1 2024-09-12T00:50:09.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.662+0000 7fd75ef1f800 20 remove_watcher() i=2 2024-09-12T00:50:09.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.663+0000 7fd75ef1f800 20 remove_watcher() i=3 2024-09-12T00:50:09.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.664+0000 7fd75ef1f800 20 remove_watcher() i=4 2024-09-12T00:50:09.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.665+0000 7fd75ef1f800 20 remove_watcher() i=5 2024-09-12T00:50:09.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.667+0000 7fd75ef1f800 20 remove_watcher() i=6 2024-09-12T00:50:09.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:09.668+0000 7fd75ef1f800 20 remove_watcher() i=7 2024-09-12T00:50:09.681 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:09.681 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:09.681 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: a-bucket id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:50:09.682 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:09.682 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard add non empty bucket 2024-09-12T00:50:09.682 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:10.009 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:50:10.038 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:10.038 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:10.077 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.078+0000 7f8bccc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.080+0000 7f8bccc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.080+0000 7f8bccc0e800 20 realm 2024-09-12T00:50:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.080+0000 7f8bccc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.081+0000 7f8bccc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.081+0000 7f8bccc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.081+0000 7f8bccc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.081+0000 7f8bccc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.081+0000 7f8bccc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.082+0000 7f8bccc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.082+0000 7f8bccc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.082+0000 7f8bccc0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:10.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.082+0000 7f8bccc0e800 20 searching for the correct realm 2024-09-12T00:50:10.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.085+0000 7f8bbffff640 0 -- 172.21.15.62:0/3491156757 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f8bc0035420 msgr2=0x7f8bc00358a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:10.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.291+0000 7f8bc8b6c640 0 -- 172.21.15.62:0/3491156757 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x558bfce41170 msgr2=0x558bfce43600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:10.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.295+0000 7f8bccc0e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:10.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.295+0000 7f8bccc0e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:10.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.295+0000 7f8bccc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:10.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.295+0000 7f8bccc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:10.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.295+0000 7f8bccc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:10.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.295+0000 7f8bccc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:10.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.295+0000 7f8bccc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.295+0000 7f8bccc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.295+0000 7f8bccc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.296+0000 7f8bccc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:10.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.296+0000 7f8bccc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.296+0000 7f8bccc0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.296+0000 7f8bccc0e800 20 zone default found 2024-09-12T00:50:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.296+0000 7f8bccc0e800 4 Realm: () 2024-09-12T00:50:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.296+0000 7f8bccc0e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.296+0000 7f8bccc0e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.296+0000 7f8bccc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.296+0000 7f8bccc0e800 20 zonegroup default 2024-09-12T00:50:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.296+0000 7f8bccc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.296+0000 7f8bccc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.296+0000 7f8bccc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.297+0000 7f8bccc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.297+0000 7f8bccc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.297+0000 7f8bccc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.297+0000 7f8bccc0e800 20 started sync module instance, tier type = 2024-09-12T00:50:10.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.297+0000 7f8bccc0e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.307+0000 7f8bccc0e800 20 add_watcher() i=0 2024-09-12T00:50:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.307+0000 7f8bccc0e800 20 add_watcher() i=1 2024-09-12T00:50:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.307+0000 7f8bccc0e800 20 add_watcher() i=2 2024-09-12T00:50:10.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.307+0000 7f8bccc0e800 20 add_watcher() i=3 2024-09-12T00:50:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.307+0000 7f8bccc0e800 20 add_watcher() i=4 2024-09-12T00:50:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.307+0000 7f8bccc0e800 20 add_watcher() i=5 2024-09-12T00:50:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.307+0000 7f8bccc0e800 20 add_watcher() i=6 2024-09-12T00:50:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.308+0000 7f8bccc0e800 20 add_watcher() i=7 2024-09-12T00:50:10.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.308+0000 7f8bccc0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:10.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.309+0000 7f8a7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:10.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.310+0000 7f8bccc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:10.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.310+0000 7f8bccc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:10.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.310+0000 7f8bccc0e800 5 note: GC not initialized 2024-09-12T00:50:10.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.310+0000 7f8a7dfdb640 20 reqs_thread_entry: start 2024-09-12T00:50:10.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.310+0000 7f8bccc0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:10.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.310+0000 7f8bccc0e800 20 Filter name: none 2024-09-12T00:50:10.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.310+0000 7f89ef7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:10.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.310+0000 7f8bccc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.311+0000 7f8bccc0e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:50:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.311+0000 7f8bccc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.311+0000 7f8bccc0e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:50:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.311+0000 7f8bccc0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.311+0000 7f8bccc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.311+0000 7f8bccc0e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:50:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.311+0000 7f8bccc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.312+0000 7f8bccc0e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:50:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.312+0000 7f8bccc0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:10.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.313+0000 7f8a7efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:10.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.316+0000 7f8bccc0e800 20 remove_watcher() i=0 2024-09-12T00:50:10.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.316+0000 7f8bccc0e800 2 removed watcher, disabling cache 2024-09-12T00:50:10.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.317+0000 7f8bccc0e800 20 remove_watcher() i=1 2024-09-12T00:50:10.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.318+0000 7f8bccc0e800 20 remove_watcher() i=2 2024-09-12T00:50:10.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.319+0000 7f8bccc0e800 20 remove_watcher() i=3 2024-09-12T00:50:10.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.320+0000 7f8bccc0e800 20 remove_watcher() i=4 2024-09-12T00:50:10.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.321+0000 7f8bccc0e800 20 remove_watcher() i=5 2024-09-12T00:50:10.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.322+0000 7f8bccc0e800 20 remove_watcher() i=6 2024-09-12T00:50:10.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.323+0000 7f8bccc0e800 20 remove_watcher() i=7 2024-09-12T00:50:10.334 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:10.334 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:10.334 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: a-bucket id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 num_objects: 8 size_kb: 1 num_shards: 2 2024-09-12T00:50:10.334 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:10.335 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-09-12T00:50:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:10.367 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:10.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.408+0000 7f738f687800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.409+0000 7f738f687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.409+0000 7f738f687800 20 realm 2024-09-12T00:50:10.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.409+0000 7f738f687800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.409+0000 7f738f687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.409+0000 7f738f687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:10.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.409+0000 7f738f687800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.410+0000 7f738f687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.410+0000 7f738f687800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.410+0000 7f738f687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:10.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.410+0000 7f738f687800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.411+0000 7f738f687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:10.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.411+0000 7f738f687800 20 searching for the correct realm 2024-09-12T00:50:10.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.414+0000 7f738c970640 0 -- 172.21.15.62:0/1367728913 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f738802d900 msgr2=0x7f738800e3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:10.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.619+0000 7f738d972640 0 -- 172.21.15.62:0/1367728913 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5621385a91f0 msgr2=0x5621385ab660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:10.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.624+0000 7f738f687800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:10.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.624+0000 7f738f687800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:10.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.624+0000 7f738f687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:10.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.624+0000 7f738f687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:10.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.624+0000 7f738f687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:10.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.624+0000 7f738f687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:10.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.624+0000 7f738f687800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.624+0000 7f738f687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.624+0000 7f738f687800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.625+0000 7f738f687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:10.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.625+0000 7f738f687800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.625+0000 7f738f687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:10.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.625+0000 7f738f687800 20 zone default found 2024-09-12T00:50:10.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.625+0000 7f738f687800 4 Realm: () 2024-09-12T00:50:10.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.625+0000 7f738f687800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:10.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.625+0000 7f738f687800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:10.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.625+0000 7f738f687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:10.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.625+0000 7f738f687800 20 zonegroup default 2024-09-12T00:50:10.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.625+0000 7f738f687800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.625+0000 7f738f687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.625+0000 7f738f687800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.625+0000 7f738f687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.626+0000 7f738f687800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.626+0000 7f738f687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.626+0000 7f738f687800 20 started sync module instance, tier type = 2024-09-12T00:50:10.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.626+0000 7f738f687800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:10.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.635+0000 7f738f687800 20 add_watcher() i=0 2024-09-12T00:50:10.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.635+0000 7f738f687800 20 add_watcher() i=1 2024-09-12T00:50:10.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.635+0000 7f738f687800 20 add_watcher() i=2 2024-09-12T00:50:10.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.635+0000 7f738f687800 20 add_watcher() i=3 2024-09-12T00:50:10.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.635+0000 7f738f687800 20 add_watcher() i=4 2024-09-12T00:50:10.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.635+0000 7f738f687800 20 add_watcher() i=5 2024-09-12T00:50:10.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.635+0000 7f738f687800 20 add_watcher() i=6 2024-09-12T00:50:10.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.636+0000 7f738f687800 20 add_watcher() i=7 2024-09-12T00:50:10.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.636+0000 7f738f687800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:10.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.638+0000 7f7243fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:10.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.639+0000 7f738f687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:10.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.639+0000 7f738f687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:10.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.639+0000 7f738f687800 5 note: GC not initialized 2024-09-12T00:50:10.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.639+0000 7f7242fe5640 20 reqs_thread_entry: start 2024-09-12T00:50:10.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.639+0000 7f738f687800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:10.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.639+0000 7f738f687800 20 Filter name: none 2024-09-12T00:50:10.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.639+0000 7f7240fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:10.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.639+0000 7f738f687800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:50:10.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.639+0000 7f738f687800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.640+0000 7f738f687800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:50:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.640+0000 7f738f687800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:50:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.640+0000 7f738f687800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:50:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.640+0000 7f738f687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:50:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.640+0000 7f738f687800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.640+0000 7f738f687800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:50:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.640+0000 7f738f687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.640+0000 7f738f687800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.640+0000 7f738f687800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.640+0000 7f738f687800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.640+0000 7f738f687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:50:10.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.642+0000 7f7243fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:10.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.645+0000 7f738f687800 20 remove_watcher() i=0 2024-09-12T00:50:10.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.645+0000 7f738f687800 2 removed watcher, disabling cache 2024-09-12T00:50:10.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.646+0000 7f738f687800 20 remove_watcher() i=1 2024-09-12T00:50:10.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.647+0000 7f738f687800 20 remove_watcher() i=2 2024-09-12T00:50:10.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.648+0000 7f738f687800 20 remove_watcher() i=3 2024-09-12T00:50:10.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.649+0000 7f738f687800 20 remove_watcher() i=4 2024-09-12T00:50:10.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.650+0000 7f738f687800 20 remove_watcher() i=5 2024-09-12T00:50:10.650 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.651+0000 7f738f687800 20 remove_watcher() i=6 2024-09-12T00:50:10.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.652+0000 7f738f687800 20 remove_watcher() i=7 2024-09-12T00:50:10.664 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin reshard list 2024-09-12T00:50:10.691 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:10.691 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:10.730 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.731+0000 7fa9a9f3a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.733+0000 7fa9a9f3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.733+0000 7fa9a9f3a800 20 realm 2024-09-12T00:50:10.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.733+0000 7fa9a9f3a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.734+0000 7fa9a9f3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.734+0000 7fa9a9f3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:10.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.734+0000 7fa9a9f3a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.734+0000 7fa9a9f3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.734+0000 7fa9a9f3a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.734+0000 7fa9a9f3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:10.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.734+0000 7fa9a9f3a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.735+0000 7fa9a9f3a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:10.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.735+0000 7fa9a9f3a800 20 searching for the correct realm 2024-09-12T00:50:10.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.738+0000 7fa9a5480640 0 -- 172.21.15.62:0/3649762021 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fa9a006ea70 msgr2=0x7fa9a006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:10.943 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.944+0000 7fa9a5480640 0 -- 172.21.15.62:0/3649762021 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55bb1c92ab60 msgr2=0x55bb1c92cf50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:10.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.949+0000 7fa9a9f3a800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:10.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.949+0000 7fa9a9f3a800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:10.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.949+0000 7fa9a9f3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:10.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.949+0000 7fa9a9f3a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:10.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.949+0000 7fa9a9f3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:10.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.949+0000 7fa9a9f3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:10.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.949+0000 7fa9a9f3a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.949+0000 7fa9a9f3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.949+0000 7fa9a9f3a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.949+0000 7fa9a9f3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:10.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.949+0000 7fa9a9f3a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.950+0000 7fa9a9f3a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:10.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.950+0000 7fa9a9f3a800 20 zone default found 2024-09-12T00:50:10.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.950+0000 7fa9a9f3a800 4 Realm: () 2024-09-12T00:50:10.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.950+0000 7fa9a9f3a800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:10.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.950+0000 7fa9a9f3a800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:10.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.950+0000 7fa9a9f3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:10.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.950+0000 7fa9a9f3a800 20 zonegroup default 2024-09-12T00:50:10.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.950+0000 7fa9a9f3a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.950+0000 7fa9a9f3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.950+0000 7fa9a9f3a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.950+0000 7fa9a9f3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.950+0000 7fa9a9f3a800 20 rados->read ofs=0 len=0 2024-09-12T00:50:10.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.950+0000 7fa9a9f3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:10.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.950+0000 7fa9a9f3a800 20 started sync module instance, tier type = 2024-09-12T00:50:10.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.950+0000 7fa9a9f3a800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:10.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.960+0000 7fa9a9f3a800 20 add_watcher() i=0 2024-09-12T00:50:10.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.960+0000 7fa9a9f3a800 20 add_watcher() i=1 2024-09-12T00:50:10.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.960+0000 7fa9a9f3a800 20 add_watcher() i=2 2024-09-12T00:50:10.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.960+0000 7fa9a9f3a800 20 add_watcher() i=3 2024-09-12T00:50:10.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.960+0000 7fa9a9f3a800 20 add_watcher() i=4 2024-09-12T00:50:10.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.960+0000 7fa9a9f3a800 20 add_watcher() i=5 2024-09-12T00:50:10.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.960+0000 7fa9a9f3a800 20 add_watcher() i=6 2024-09-12T00:50:10.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.961+0000 7fa9a9f3a800 20 add_watcher() i=7 2024-09-12T00:50:10.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.961+0000 7fa9a9f3a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:10.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.963+0000 7fa8577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:10.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.963+0000 7fa9a9f3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:10.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.963+0000 7fa9a9f3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:10.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.963+0000 7fa9a9f3a800 5 note: GC not initialized 2024-09-12T00:50:10.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.964+0000 7fa8567fc640 20 reqs_thread_entry: start 2024-09-12T00:50:10.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.964+0000 7fa9a9f3a800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:10.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.964+0000 7fa9a9f3a800 20 Filter name: none 2024-09-12T00:50:10.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.964+0000 7fa7c7fff640 20 reqs_thread_entry: start 2024-09-12T00:50:10.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.970+0000 7fa8577fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:10.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.973+0000 7fa9a9f3a800 20 remove_watcher() i=0 2024-09-12T00:50:10.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.973+0000 7fa9a9f3a800 2 removed watcher, disabling cache 2024-09-12T00:50:10.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.974+0000 7fa9a9f3a800 20 remove_watcher() i=1 2024-09-12T00:50:10.974 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.975+0000 7fa9a9f3a800 20 remove_watcher() i=2 2024-09-12T00:50:10.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.976+0000 7fa9a9f3a800 20 remove_watcher() i=3 2024-09-12T00:50:10.977 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.978+0000 7fa9a9f3a800 20 remove_watcher() i=4 2024-09-12T00:50:10.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.979+0000 7fa9a9f3a800 20 remove_watcher() i=5 2024-09-12T00:50:10.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.980+0000 7fa9a9f3a800 20 remove_watcher() i=6 2024-09-12T00:50:10.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:10.981+0000 7fa9a9f3a800 20 remove_watcher() i=7 2024-09-12T00:50:10.991 INFO:tasks.workunit.client.0.smithi062.stderr:bucket name a-bucket 2024-09-12T00:50:10.991 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard process non empty bucket 2024-09-12T00:50:10.991 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:10.992 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin reshard process 2024-09-12T00:50:11.020 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:11.020 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:11.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.060+0000 7fbefba0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.062+0000 7fbefba0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.062+0000 7fbefba0e800 20 realm 2024-09-12T00:50:11.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.062+0000 7fbefba0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.062+0000 7fbefba0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.062+0000 7fbefba0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:11.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.062+0000 7fbefba0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.062+0000 7fbefba0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.062+0000 7fbefba0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.063+0000 7fbefba0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:11.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.063+0000 7fbefba0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.064+0000 7fbefba0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:11.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.064+0000 7fbefba0e800 20 searching for the correct realm 2024-09-12T00:50:11.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.065+0000 7fbef716b640 0 -- 172.21.15.62:0/2162321568 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7fbef0020040 msgr2=0x7fbef0020420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:11.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.069+0000 7fbef796c640 0 -- 172.21.15.62:0/2162321568 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7fbee8058040 msgr2=0x7fbee8066920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:11.275 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.276+0000 7fbefba0e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:11.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.276+0000 7fbefba0e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:11.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.276+0000 7fbefba0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:11.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.276+0000 7fbefba0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:11.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.276+0000 7fbefba0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:11.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.276+0000 7fbefba0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:11.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.276+0000 7fbefba0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.277+0000 7fbefba0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.277+0000 7fbefba0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.277+0000 7fbefba0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:11.276 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.277+0000 7fbefba0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.277+0000 7fbefba0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:11.277 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.277+0000 7fbefba0e800 20 zone default found 2024-09-12T00:50:11.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.277+0000 7fbefba0e800 4 Realm: () 2024-09-12T00:50:11.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.277+0000 7fbefba0e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:11.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.277+0000 7fbefba0e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:11.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.277+0000 7fbefba0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:11.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.277+0000 7fbefba0e800 20 zonegroup default 2024-09-12T00:50:11.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.277+0000 7fbefba0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.277+0000 7fbefba0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.278+0000 7fbefba0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.278+0000 7fbefba0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.278+0000 7fbefba0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.278+0000 7fbefba0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.278+0000 7fbefba0e800 20 started sync module instance, tier type = 2024-09-12T00:50:11.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.278+0000 7fbefba0e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:11.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.289+0000 7fbefba0e800 20 add_watcher() i=0 2024-09-12T00:50:11.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.289+0000 7fbefba0e800 20 add_watcher() i=1 2024-09-12T00:50:11.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.289+0000 7fbefba0e800 20 add_watcher() i=2 2024-09-12T00:50:11.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.289+0000 7fbefba0e800 20 add_watcher() i=3 2024-09-12T00:50:11.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.289+0000 7fbefba0e800 20 add_watcher() i=4 2024-09-12T00:50:11.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.289+0000 7fbefba0e800 20 add_watcher() i=5 2024-09-12T00:50:11.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.289+0000 7fbefba0e800 20 add_watcher() i=6 2024-09-12T00:50:11.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.291+0000 7fbefba0e800 20 add_watcher() i=7 2024-09-12T00:50:11.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.291+0000 7fbefba0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:11.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.292+0000 7fbdadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:11.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.293+0000 7fbefba0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:11.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.293+0000 7fbefba0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:11.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.293+0000 7fbefba0e800 5 note: GC not initialized 2024-09-12T00:50:11.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.293+0000 7fbdacfe1640 20 reqs_thread_entry: start 2024-09-12T00:50:11.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.293+0000 7fbefba0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:11.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.293+0000 7fbefba0e800 20 Filter name: none 2024-09-12T00:50:11.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.293+0000 7fbd267fc640 20 reqs_thread_entry: start 2024-09-12T00:50:11.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.293+0000 7fbefba0e800 20 processing logshard = reshard.0000000000 2024-09-12T00:50:11.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.296+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:50:11.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.296+0000 7fbefba0e800 20 processing logshard = reshard.0000000001 2024-09-12T00:50:11.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.299+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:50:11.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.299+0000 7fbefba0e800 20 processing logshard = reshard.0000000002 2024-09-12T00:50:11.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.301+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:50:11.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.301+0000 7fbefba0e800 20 processing logshard = reshard.0000000003 2024-09-12T00:50:11.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.303+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:50:11.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.303+0000 7fbefba0e800 20 processing logshard = reshard.0000000004 2024-09-12T00:50:11.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.306+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:50:11.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.306+0000 7fbefba0e800 20 processing logshard = reshard.0000000005 2024-09-12T00:50:11.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.308+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:50:11.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.308+0000 7fbefba0e800 20 processing logshard = reshard.0000000006 2024-09-12T00:50:11.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.310+0000 7fbefba0e800 20 process_entry resharding a-bucket 2024-09-12T00:50:11.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.310+0000 7fbefba0e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:50:11.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.310+0000 7fbefba0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.310+0000 7fbefba0e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:50:11.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.310+0000 7fbefba0e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:50:11.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.310+0000 7fbefba0e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:50:11.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.310+0000 7fbefba0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:50:11.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.310+0000 7fbefba0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.310+0000 7fbefba0e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:50:11.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.310+0000 7fbefba0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:11.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.310+0000 7fbefba0e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:11.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.310+0000 7fbefba0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:11.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.310+0000 7fbefba0e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:11.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.310+0000 7fbefba0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:50:11.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.316+0000 7fbefba0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:11.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.316+0000 7fbefba0e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:11.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.316+0000 7fbefba0e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:11.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.316+0000 7fbefba0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:50:11.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.316+0000 7fbdda7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431632 cookie 93954176428544 notifier 5876 bl.length()=827 2024-09-12T00:50:11.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.316+0000 7fbdda7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:11.316 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.316+0000 7fbdda7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:11.316 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.316+0000 7fbdda7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:11.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.318+0000 7fbefba0e800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:50:11.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.318+0000 7fbefba0e800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:50:11.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.318+0000 7fbefba0e800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:50:11.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.318+0000 7fbefba0e800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:50:11.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.320+0000 7fbefba0e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:50:11.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.320+0000 7fbefba0e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:50:11.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.320+0000 7fbefba0e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:50:11.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.320+0000 7fbefba0e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:50:11.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.320+0000 7fbefba0e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:50:11.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.320+0000 7fbefba0e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:50:11.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.320+0000 7fbefba0e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.1.0 2024-09-12T00:50:11.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.320+0000 7fbefba0e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.1.0 2024-09-12T00:50:11.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.321+0000 7fbefba0e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.1.1 2024-09-12T00:50:11.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.321+0000 7fbefba0e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.1.1 2024-09-12T00:50:11.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.323+0000 7fbefba0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:11.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.323+0000 7fbefba0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:50:11.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.325+0000 7fbefba0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:11.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.325+0000 7fbefba0e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:11.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.325+0000 7fbefba0e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:11.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.325+0000 7fbefba0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:50:11.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.325+0000 7fbddaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431633 cookie 93954176428544 notifier 5876 bl.length()=827 2024-09-12T00:50:11.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.325+0000 7fbddaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:11.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.325+0000 7fbddaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:11.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.325+0000 7fbddaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:11.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.326+0000 7fbefba0e800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:50:11.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.326+0000 7fbefba0e800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:50:11.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.326+0000 7fbefba0e800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:50:11.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.326+0000 7fbefba0e800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:50:11.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.328+0000 7fbefba0e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.1.0 2024-09-12T00:50:11.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.328+0000 7fbefba0e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.1.0 2024-09-12T00:50:11.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.328+0000 7fbefba0e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.1.1 2024-09-12T00:50:11.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.328+0000 7fbefba0e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.1.1 2024-09-12T00:50:11.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.329+0000 7fbefba0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:11.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.329+0000 7fbefba0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:50:11.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.330+0000 7fbefba0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:11.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.330+0000 7fbefba0e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:11.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.330+0000 7fbefba0e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:11.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.330+0000 7fbefba0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:50:11.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.330+0000 7fbdda7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431634 cookie 93954176428544 notifier 5876 bl.length()=795 2024-09-12T00:50:11.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.330+0000 7fbdda7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:50:11.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.330+0000 7fbdda7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:50:11.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.330+0000 7fbdda7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:50:11.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.332+0000 7fbefba0e800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:50:11.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.332+0000 7fbefba0e800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:50:11.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.332+0000 7fbefba0e800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:50:11.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.332+0000 7fbefba0e800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:50:11.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.333+0000 7fbefba0e800 1 execute INFO: reshard of bucket "a-bucket" from 2 shards to 3 shards completed successfully 2024-09-12T00:50:11.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.334+0000 7fbefba0e800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:50:11.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.337+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:50:11.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.337+0000 7fbefba0e800 20 processing logshard = reshard.0000000007 2024-09-12T00:50:11.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.339+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:50:11.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.339+0000 7fbefba0e800 20 processing logshard = reshard.0000000008 2024-09-12T00:50:11.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.342+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:50:11.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.342+0000 7fbefba0e800 20 processing logshard = reshard.0000000009 2024-09-12T00:50:11.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.344+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:50:11.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.344+0000 7fbefba0e800 20 processing logshard = reshard.0000000010 2024-09-12T00:50:11.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.347+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:50:11.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.347+0000 7fbefba0e800 20 processing logshard = reshard.0000000011 2024-09-12T00:50:11.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.350+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:50:11.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.350+0000 7fbefba0e800 20 processing logshard = reshard.0000000012 2024-09-12T00:50:11.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.352+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:50:11.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.352+0000 7fbefba0e800 20 processing logshard = reshard.0000000013 2024-09-12T00:50:11.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.355+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:50:11.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.355+0000 7fbefba0e800 20 processing logshard = reshard.0000000014 2024-09-12T00:50:11.357 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.358+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:50:11.357 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.358+0000 7fbefba0e800 20 processing logshard = reshard.0000000015 2024-09-12T00:50:11.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.360+0000 7fbefba0e800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:50:11.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.361+0000 7fbdadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:11.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.363+0000 7fbefba0e800 20 remove_watcher() i=0 2024-09-12T00:50:11.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.363+0000 7fbefba0e800 2 removed watcher, disabling cache 2024-09-12T00:50:11.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.364+0000 7fbefba0e800 20 remove_watcher() i=1 2024-09-12T00:50:11.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.365+0000 7fbefba0e800 20 remove_watcher() i=2 2024-09-12T00:50:11.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.366+0000 7fbefba0e800 20 remove_watcher() i=3 2024-09-12T00:50:11.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.368+0000 7fbefba0e800 20 remove_watcher() i=4 2024-09-12T00:50:11.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.369+0000 7fbefba0e800 20 remove_watcher() i=5 2024-09-12T00:50:11.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.370+0000 7fbefba0e800 20 remove_watcher() i=6 2024-09-12T00:50:11.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.371+0000 7fbefba0e800 20 remove_watcher() i=7 2024-09-12T00:50:11.382 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:50:11.411 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:11.411 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:11.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.451+0000 7f8cfe335800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.452 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.453+0000 7f8cfe335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.452 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.453+0000 7f8cfe335800 20 realm 2024-09-12T00:50:11.452 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.453+0000 7f8cfe335800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.452 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.453+0000 7f8cfe335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.452 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.453+0000 7f8cfe335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:11.453 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.453+0000 7f8cfe335800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.453 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.453+0000 7f8cfe335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.453 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.453+0000 7f8cfe335800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.453 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.454+0000 7f8cfe335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:11.453 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.454+0000 7f8cfe335800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.455+0000 7f8cfe335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:11.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.455+0000 7f8cfe335800 20 searching for the correct realm 2024-09-12T00:50:11.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.458+0000 7f8cf98e3640 0 -- 172.21.15.62:0/3383636044 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f8cf4017410 msgr2=0x7f8cf4017890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:11.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.462+0000 7f8cfa8e5640 0 -- 172.21.15.62:0/3383636044 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x556d57f2bdd0 msgr2=0x556d57f2e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:11.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.465+0000 7f8cfe335800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:11.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.465+0000 7f8cfe335800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:11.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.465+0000 7f8cfe335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:11.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.465+0000 7f8cfe335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:11.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.465+0000 7f8cfe335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:11.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.465+0000 7f8cfe335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:11.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.465+0000 7f8cfe335800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.466+0000 7f8cfe335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.466+0000 7f8cfe335800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.466+0000 7f8cfe335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:11.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.466+0000 7f8cfe335800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.466+0000 7f8cfe335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:11.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.466+0000 7f8cfe335800 20 zone default found 2024-09-12T00:50:11.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.466+0000 7f8cfe335800 4 Realm: () 2024-09-12T00:50:11.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.466+0000 7f8cfe335800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:11.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.466+0000 7f8cfe335800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:11.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.466+0000 7f8cfe335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:11.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.466+0000 7f8cfe335800 20 zonegroup default 2024-09-12T00:50:11.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.466+0000 7f8cfe335800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.466+0000 7f8cfe335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.466+0000 7f8cfe335800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.467+0000 7f8cfe335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.467+0000 7f8cfe335800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.467+0000 7f8cfe335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:11.468 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.467+0000 7f8cfe335800 20 started sync module instance, tier type = 2024-09-12T00:50:11.468 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.467+0000 7f8cfe335800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:11.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.476+0000 7f8cfe335800 20 add_watcher() i=0 2024-09-12T00:50:11.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.476+0000 7f8cfe335800 20 add_watcher() i=1 2024-09-12T00:50:11.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.476+0000 7f8cfe335800 20 add_watcher() i=2 2024-09-12T00:50:11.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.476+0000 7f8cfe335800 20 add_watcher() i=3 2024-09-12T00:50:11.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.476+0000 7f8cfe335800 20 add_watcher() i=4 2024-09-12T00:50:11.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.476+0000 7f8cfe335800 20 add_watcher() i=5 2024-09-12T00:50:11.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.476+0000 7f8cfe335800 20 add_watcher() i=6 2024-09-12T00:50:11.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.476+0000 7f8cfe335800 20 add_watcher() i=7 2024-09-12T00:50:11.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.476+0000 7f8cfe335800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:11.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.478+0000 7f8bb0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.479+0000 7f8cfe335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.479+0000 7f8cfe335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.479+0000 7f8cfe335800 5 note: GC not initialized 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.479+0000 7f8b2b7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:11.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.479+0000 7f8cfe335800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:11.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.479+0000 7f8cfe335800 20 Filter name: none 2024-09-12T00:50:11.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.479+0000 7f8b297fa640 20 reqs_thread_entry: start 2024-09-12T00:50:11.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.479+0000 7f8cfe335800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.480+0000 7f8cfe335800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:50:11.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.480+0000 7f8cfe335800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.480+0000 7f8cfe335800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:50:11.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.480+0000 7f8cfe335800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:11.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.480+0000 7f8cfe335800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.481+0000 7f8cfe335800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:50:11.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.481+0000 7f8cfe335800 20 rados->read ofs=0 len=0 2024-09-12T00:50:11.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.481+0000 7f8cfe335800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:50:11.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.481+0000 7f8cfe335800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:11.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.482+0000 7f8bb0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:11.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.485+0000 7f8cfe335800 20 remove_watcher() i=0 2024-09-12T00:50:11.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.485+0000 7f8cfe335800 2 removed watcher, disabling cache 2024-09-12T00:50:11.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.486+0000 7f8cfe335800 20 remove_watcher() i=1 2024-09-12T00:50:11.485 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.486+0000 7f8cfe335800 20 remove_watcher() i=2 2024-09-12T00:50:11.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.488+0000 7f8cfe335800 20 remove_watcher() i=3 2024-09-12T00:50:11.487 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.489+0000 7f8cfe335800 20 remove_watcher() i=4 2024-09-12T00:50:11.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.490+0000 7f8cfe335800 20 remove_watcher() i=5 2024-09-12T00:50:11.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.491+0000 7f8cfe335800 20 remove_watcher() i=6 2024-09-12T00:50:11.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:11.491+0000 7f8cfe335800 20 remove_watcher() i=7 2024-09-12T00:50:11.502 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:11.502 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:11.502 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: a-bucket id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T00:50:11.502 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:11.502 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T00:50:11.502 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:12.364 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:50:12.393 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:12.393 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:12.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.433+0000 7f1a07175800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.435+0000 7f1a07175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.435+0000 7f1a07175800 20 realm 2024-09-12T00:50:12.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.435+0000 7f1a07175800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.435+0000 7f1a07175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.435+0000 7f1a07175800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:12.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.435+0000 7f1a07175800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.435+0000 7f1a07175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.435+0000 7f1a07175800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.436+0000 7f1a07175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:12.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.436+0000 7f1a07175800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.437+0000 7f1a07175800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:12.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.437+0000 7f1a07175800 20 searching for the correct realm 2024-09-12T00:50:12.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.440+0000 7f19fffff640 0 -- 172.21.15.62:0/3888042406 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f1a00066b30 msgr2=0x7f1a0008a700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:12.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.443+0000 7f19fffff640 0 -- 172.21.15.62:0/3888042406 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55c9eb2fce20 msgr2=0x55c9eb2ff250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:12.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.448+0000 7f1a07175800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:12.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.448+0000 7f1a07175800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:12.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.448+0000 7f1a07175800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:12.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.448+0000 7f1a07175800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:12.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.448+0000 7f1a07175800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:12.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.448+0000 7f1a07175800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:12.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.448+0000 7f1a07175800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.448+0000 7f1a07175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.448+0000 7f1a07175800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.448+0000 7f1a07175800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:12.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.448+0000 7f1a07175800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.449+0000 7f1a07175800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:12.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.449+0000 7f1a07175800 20 zone default found 2024-09-12T00:50:12.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.449+0000 7f1a07175800 4 Realm: () 2024-09-12T00:50:12.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.449+0000 7f1a07175800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:12.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.449+0000 7f1a07175800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:12.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.449+0000 7f1a07175800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:12.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.449+0000 7f1a07175800 20 zonegroup default 2024-09-12T00:50:12.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.449+0000 7f1a07175800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.449+0000 7f1a07175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.449+0000 7f1a07175800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.449+0000 7f1a07175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.449+0000 7f1a07175800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.450+0000 7f1a07175800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.450+0000 7f1a07175800 20 started sync module instance, tier type = 2024-09-12T00:50:12.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.450+0000 7f1a07175800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:12.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.458+0000 7f1a07175800 20 add_watcher() i=0 2024-09-12T00:50:12.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.458+0000 7f1a07175800 20 add_watcher() i=1 2024-09-12T00:50:12.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.458+0000 7f1a07175800 20 add_watcher() i=2 2024-09-12T00:50:12.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.458+0000 7f1a07175800 20 add_watcher() i=3 2024-09-12T00:50:12.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.458+0000 7f1a07175800 20 add_watcher() i=4 2024-09-12T00:50:12.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.458+0000 7f1a07175800 20 add_watcher() i=5 2024-09-12T00:50:12.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.458+0000 7f1a07175800 20 add_watcher() i=6 2024-09-12T00:50:12.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.459+0000 7f1a07175800 20 add_watcher() i=7 2024-09-12T00:50:12.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.459+0000 7f1a07175800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:12.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.461+0000 7f18bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:12.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.462+0000 7f1a07175800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:12.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.462+0000 7f1a07175800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:12.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.462+0000 7f1a07175800 5 note: GC not initialized 2024-09-12T00:50:12.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.462+0000 7f18b9fe3640 20 reqs_thread_entry: start 2024-09-12T00:50:12.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.462+0000 7f1a07175800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:12.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.462+0000 7f1a07175800 20 Filter name: none 2024-09-12T00:50:12.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.462+0000 7f182b7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:12.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.462+0000 7f1a07175800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.463+0000 7f1a07175800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:12.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.463+0000 7f1a07175800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.463+0000 7f1a07175800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:50:12.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.463+0000 7f1a07175800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:12.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.463+0000 7f1a07175800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.464+0000 7f1a07175800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:12.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.464+0000 7f1a07175800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.464+0000 7f1a07175800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:50:12.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.464+0000 7f1a07175800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:12.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.465+0000 7f18bafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:12.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.468+0000 7f1a07175800 20 remove_watcher() i=0 2024-09-12T00:50:12.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.468+0000 7f1a07175800 2 removed watcher, disabling cache 2024-09-12T00:50:12.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.469+0000 7f1a07175800 20 remove_watcher() i=1 2024-09-12T00:50:12.468 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.470+0000 7f1a07175800 20 remove_watcher() i=2 2024-09-12T00:50:12.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.471+0000 7f1a07175800 20 remove_watcher() i=3 2024-09-12T00:50:12.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.472+0000 7f1a07175800 20 remove_watcher() i=4 2024-09-12T00:50:12.472 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.473+0000 7f1a07175800 20 remove_watcher() i=5 2024-09-12T00:50:12.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.474+0000 7f1a07175800 20 remove_watcher() i=6 2024-09-12T00:50:12.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.475+0000 7f1a07175800 20 remove_watcher() i=7 2024-09-12T00:50:12.485 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:12.485 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:12.485 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-init-index id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:12.485 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:12.487 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T00:50:12.522 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:12.522 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:12.561 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.562+0000 7f224c135800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.564+0000 7f224c135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.564+0000 7f224c135800 20 realm 2024-09-12T00:50:12.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.564+0000 7f224c135800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.564+0000 7f224c135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.564+0000 7f224c135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:12.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.564+0000 7f224c135800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.564 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.564+0000 7f224c135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.564 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.564+0000 7f224c135800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.564 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.565+0000 7f224c135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:12.564 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.565+0000 7f224c135800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.566+0000 7f224c135800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:12.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.566+0000 7f224c135800 20 searching for the correct realm 2024-09-12T00:50:12.567 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.569+0000 7f22476e3640 0 -- 172.21.15.62:0/4136459263 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f224001f070 msgr2=0x7f22400353f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:12.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.774+0000 7f22486e5640 0 -- 172.21.15.62:0/4136459263 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x558aeda33b90 msgr2=0x558aeda36050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:12.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.779+0000 7f224c135800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:12.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.779+0000 7f224c135800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:12.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.779+0000 7f224c135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:12.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.779+0000 7f224c135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:12.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.779+0000 7f224c135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:12.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.779+0000 7f224c135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:12.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.779+0000 7f224c135800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.779+0000 7f224c135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.779+0000 7f224c135800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.779+0000 7f224c135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:12.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.779+0000 7f224c135800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.780+0000 7f224c135800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:12.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.780+0000 7f224c135800 20 zone default found 2024-09-12T00:50:12.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.780+0000 7f224c135800 4 Realm: () 2024-09-12T00:50:12.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.780+0000 7f224c135800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:12.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.780+0000 7f224c135800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:12.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.780+0000 7f224c135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:12.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.780+0000 7f224c135800 20 zonegroup default 2024-09-12T00:50:12.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.780+0000 7f224c135800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.780+0000 7f224c135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.780+0000 7f224c135800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.781+0000 7f224c135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.781+0000 7f224c135800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.781+0000 7f224c135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.781+0000 7f224c135800 20 started sync module instance, tier type = 2024-09-12T00:50:12.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.781+0000 7f224c135800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:12.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.790+0000 7f224c135800 20 add_watcher() i=0 2024-09-12T00:50:12.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.790+0000 7f224c135800 20 add_watcher() i=1 2024-09-12T00:50:12.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.790+0000 7f224c135800 20 add_watcher() i=2 2024-09-12T00:50:12.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.790+0000 7f224c135800 20 add_watcher() i=3 2024-09-12T00:50:12.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.790+0000 7f224c135800 20 add_watcher() i=4 2024-09-12T00:50:12.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.790+0000 7f224c135800 20 add_watcher() i=5 2024-09-12T00:50:12.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.790+0000 7f224c135800 20 add_watcher() i=6 2024-09-12T00:50:12.790 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.791+0000 7f224c135800 20 add_watcher() i=7 2024-09-12T00:50:12.790 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.791+0000 7f224c135800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:12.791 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.792+0000 7f20fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:12.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.793+0000 7f224c135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:12.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.793+0000 7f224c135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:12.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.793+0000 7f224c135800 5 note: GC not initialized 2024-09-12T00:50:12.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.793+0000 7f20fcfe1640 20 reqs_thread_entry: start 2024-09-12T00:50:12.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.793+0000 7f224c135800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:12.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.793+0000 7f224c135800 20 Filter name: none 2024-09-12T00:50:12.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.793+0000 7f20767fc640 20 reqs_thread_entry: start 2024-09-12T00:50:12.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.793+0000 7f224c135800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:50:12.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.794+0000 7f224c135800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.794+0000 7f224c135800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:12.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.794+0000 7f224c135800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:50:12.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.794+0000 7f224c135800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:50:12.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.794+0000 7f224c135800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 : miss 2024-09-12T00:50:12.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.794+0000 7f224c135800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.794+0000 7f224c135800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:50:12.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.794+0000 7f224c135800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 info.flags=0x17 2024-09-12T00:50:12.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.794+0000 7f224c135800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 to cache LRU end 2024-09-12T00:50:12.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.794+0000 7f224c135800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:12.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.794+0000 7f224c135800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:12.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.794+0000 7f224c135800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 2024-09-12T00:50:12.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.795+0000 7f224c135800 -1 Injecting error=-5 at location=init_index 2024-09-12T00:50:12.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.795+0000 7f224c135800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T00:50:12.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.798+0000 7f20fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:12.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.801+0000 7f224c135800 20 remove_watcher() i=0 2024-09-12T00:50:12.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.801+0000 7f224c135800 2 removed watcher, disabling cache 2024-09-12T00:50:12.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.802+0000 7f224c135800 20 remove_watcher() i=1 2024-09-12T00:50:12.801 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.803+0000 7f224c135800 20 remove_watcher() i=2 2024-09-12T00:50:12.802 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.804+0000 7f224c135800 20 remove_watcher() i=3 2024-09-12T00:50:12.803 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.805+0000 7f224c135800 20 remove_watcher() i=4 2024-09-12T00:50:12.804 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.806+0000 7f224c135800 20 remove_watcher() i=5 2024-09-12T00:50:12.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.806+0000 7f224c135800 20 remove_watcher() i=6 2024-09-12T00:50:12.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.807+0000 7f224c135800 20 remove_watcher() i=7 2024-09-12T00:50:12.819 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:50:12.848 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:12.848 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:12.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.888+0000 7fe468b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.890+0000 7fe468b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.890+0000 7fe468b2c800 20 realm 2024-09-12T00:50:12.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.890+0000 7fe468b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.890+0000 7fe468b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.890+0000 7fe468b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:12.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.890+0000 7fe468b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.890+0000 7fe468b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.890+0000 7fe468b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.891+0000 7fe468b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:12.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.891+0000 7fe468b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.892+0000 7fe468b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:12.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.892+0000 7fe468b2c800 20 searching for the correct realm 2024-09-12T00:50:12.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.895+0000 7fe463f3d640 0 -- 172.21.15.62:0/3155868864 >> [v2:172.21.15.62:6808/741930476,v1:172.21.15.62:6809/741930476] conn(0x55e9b1bafed0 msgr2=0x55e9b1bb22c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:12.898 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.899+0000 7fe46473e640 0 -- 172.21.15.62:0/3155868864 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7fe45c004040 msgr2=0x7fe45c0c9820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:12.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.902+0000 7fe468b2c800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:12.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.902+0000 7fe468b2c800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:12.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.902+0000 7fe468b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:12.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.902+0000 7fe468b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:12.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.902+0000 7fe468b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:12.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.902+0000 7fe468b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:12.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.903+0000 7fe468b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.903+0000 7fe468b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.903+0000 7fe468b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.903+0000 7fe468b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:12.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.903+0000 7fe468b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.903+0000 7fe468b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:12.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.903+0000 7fe468b2c800 20 zone default found 2024-09-12T00:50:12.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.903+0000 7fe468b2c800 4 Realm: () 2024-09-12T00:50:12.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.903+0000 7fe468b2c800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:12.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.903+0000 7fe468b2c800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:12.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.903+0000 7fe468b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:12.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.903+0000 7fe468b2c800 20 zonegroup default 2024-09-12T00:50:12.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.903+0000 7fe468b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.904+0000 7fe468b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.904+0000 7fe468b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.904+0000 7fe468b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.904+0000 7fe468b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.904+0000 7fe468b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:12.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.904+0000 7fe468b2c800 20 started sync module instance, tier type = 2024-09-12T00:50:12.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.904+0000 7fe468b2c800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:12.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.912+0000 7fe468b2c800 20 add_watcher() i=0 2024-09-12T00:50:12.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.912+0000 7fe468b2c800 20 add_watcher() i=1 2024-09-12T00:50:12.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.912+0000 7fe468b2c800 20 add_watcher() i=2 2024-09-12T00:50:12.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.912+0000 7fe468b2c800 20 add_watcher() i=3 2024-09-12T00:50:12.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.912+0000 7fe468b2c800 20 add_watcher() i=4 2024-09-12T00:50:12.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.912+0000 7fe468b2c800 20 add_watcher() i=5 2024-09-12T00:50:12.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.913+0000 7fe468b2c800 20 add_watcher() i=6 2024-09-12T00:50:12.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.913+0000 7fe468b2c800 20 add_watcher() i=7 2024-09-12T00:50:12.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.913+0000 7fe468b2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:12.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.915+0000 7fe31afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:12.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.915+0000 7fe468b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:12.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.915+0000 7fe468b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:12.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.915+0000 7fe468b2c800 5 note: GC not initialized 2024-09-12T00:50:12.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.915+0000 7fe319fe3640 20 reqs_thread_entry: start 2024-09-12T00:50:12.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.915+0000 7fe468b2c800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:12.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.915+0000 7fe468b2c800 20 Filter name: none 2024-09-12T00:50:12.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.915+0000 7fe312ffd640 20 reqs_thread_entry: start 2024-09-12T00:50:12.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.916+0000 7fe468b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.916+0000 7fe468b2c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:12.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.916+0000 7fe468b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.916+0000 7fe468b2c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:50:12.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.916+0000 7fe468b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:12.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.916+0000 7fe468b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.917+0000 7fe468b2c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:12.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.917+0000 7fe468b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:50:12.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.917+0000 7fe468b2c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:50:12.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.917+0000 7fe468b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:12.920 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.918+0000 7fe31afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:12.920 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.920+0000 7fe468b2c800 20 remove_watcher() i=0 2024-09-12T00:50:12.920 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.920+0000 7fe468b2c800 2 removed watcher, disabling cache 2024-09-12T00:50:12.920 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.921+0000 7fe468b2c800 20 remove_watcher() i=1 2024-09-12T00:50:12.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.922+0000 7fe468b2c800 20 remove_watcher() i=2 2024-09-12T00:50:12.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.923+0000 7fe468b2c800 20 remove_watcher() i=3 2024-09-12T00:50:12.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.924+0000 7fe468b2c800 20 remove_watcher() i=4 2024-09-12T00:50:12.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.925+0000 7fe468b2c800 20 remove_watcher() i=5 2024-09-12T00:50:12.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.926+0000 7fe468b2c800 20 remove_watcher() i=6 2024-09-12T00:50:12.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:12.927+0000 7fe468b2c800 20 remove_watcher() i=7 2024-09-12T00:50:12.939 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:12.939 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:12.939 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-init-index id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:12.939 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:13.033 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:13.066 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:13.066 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:13.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.107+0000 7fa7dfb28800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.108+0000 7fa7dfb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.108+0000 7fa7dfb28800 20 realm 2024-09-12T00:50:13.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.108+0000 7fa7dfb28800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.108+0000 7fa7dfb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.108+0000 7fa7dfb28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:13.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.108+0000 7fa7dfb28800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.108+0000 7fa7dfb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.108+0000 7fa7dfb28800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.109+0000 7fa7dfb28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:13.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.109+0000 7fa7dfb28800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.110+0000 7fa7dfb28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:13.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.110+0000 7fa7dfb28800 20 searching for the correct realm 2024-09-12T00:50:13.111 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.112+0000 7fa7db06e640 0 -- 172.21.15.62:0/3609539581 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fa7d4069980 msgr2=0x7fa7d406a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:13.316 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.317+0000 7fa7dc070640 0 -- 172.21.15.62:0/3609539581 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55f1bfe3b4c0 msgr2=0x55f1bfe3d930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:13.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.321+0000 7fa7dfb28800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:13.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.321+0000 7fa7dfb28800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:13.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.321+0000 7fa7dfb28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:13.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.321+0000 7fa7dfb28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:13.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.321+0000 7fa7dfb28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:13.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.321+0000 7fa7dfb28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:13.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.321+0000 7fa7dfb28800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.321+0000 7fa7dfb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.321+0000 7fa7dfb28800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.322+0000 7fa7dfb28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:13.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.322+0000 7fa7dfb28800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.322+0000 7fa7dfb28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:13.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.322+0000 7fa7dfb28800 20 zone default found 2024-09-12T00:50:13.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.322+0000 7fa7dfb28800 4 Realm: () 2024-09-12T00:50:13.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.322+0000 7fa7dfb28800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:13.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.322+0000 7fa7dfb28800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:13.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.322+0000 7fa7dfb28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:13.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.322+0000 7fa7dfb28800 20 zonegroup default 2024-09-12T00:50:13.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.322+0000 7fa7dfb28800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.322+0000 7fa7dfb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.322+0000 7fa7dfb28800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.323+0000 7fa7dfb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.323+0000 7fa7dfb28800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.323+0000 7fa7dfb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.323+0000 7fa7dfb28800 20 started sync module instance, tier type = 2024-09-12T00:50:13.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.323+0000 7fa7dfb28800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:13.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.332+0000 7fa7dfb28800 20 add_watcher() i=0 2024-09-12T00:50:13.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.332+0000 7fa7dfb28800 20 add_watcher() i=1 2024-09-12T00:50:13.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.332+0000 7fa7dfb28800 20 add_watcher() i=2 2024-09-12T00:50:13.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.332+0000 7fa7dfb28800 20 add_watcher() i=3 2024-09-12T00:50:13.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.332+0000 7fa7dfb28800 20 add_watcher() i=4 2024-09-12T00:50:13.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.332+0000 7fa7dfb28800 20 add_watcher() i=5 2024-09-12T00:50:13.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.332+0000 7fa7dfb28800 20 add_watcher() i=6 2024-09-12T00:50:13.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.333+0000 7fa7dfb28800 20 add_watcher() i=7 2024-09-12T00:50:13.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.333+0000 7fa7dfb28800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:13.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.334+0000 7fa691fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:13.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.334+0000 7fa7dfb28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:13.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.334+0000 7fa7dfb28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:13.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.334+0000 7fa7dfb28800 5 note: GC not initialized 2024-09-12T00:50:13.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.335+0000 7fa690fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:13.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.335+0000 7fa7dfb28800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:13.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.335+0000 7fa7dfb28800 20 Filter name: none 2024-09-12T00:50:13.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.335+0000 7fa60a7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:13.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.335+0000 7fa7dfb28800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:50:13.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.335+0000 7fa7dfb28800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.335+0000 7fa7dfb28800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:13.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.335+0000 7fa7dfb28800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:50:13.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.335+0000 7fa7dfb28800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:50:13.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.335+0000 7fa7dfb28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 : miss 2024-09-12T00:50:13.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.335+0000 7fa7dfb28800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.336+0000 7fa7dfb28800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:50:13.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.336+0000 7fa7dfb28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 info.flags=0x17 2024-09-12T00:50:13.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.336+0000 7fa7dfb28800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 to cache LRU end 2024-09-12T00:50:13.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.336+0000 7fa7dfb28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:13.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.336+0000 7fa7dfb28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:13.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.336+0000 7fa7dfb28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 2024-09-12T00:50:13.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.339+0000 7fa7dfb28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 info.flags=0x17 2024-09-12T00:50:13.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.339+0000 7fa7dfb28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 to cache LRU end 2024-09-12T00:50:13.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.339+0000 7fa7dfb28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:13.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.339+0000 7fa7dfb28800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19, ofs0, ns] 2024-09-12T00:50:13.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.340+0000 7fa6baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431576 cookie 94496794923056 notifier 6282 bl.length()=911 2024-09-12T00:50:13.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.340+0000 7fa6baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 info.flags=0x17 2024-09-12T00:50:13.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.340+0000 7fa6baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 to cache LRU end 2024-09-12T00:50:13.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.340+0000 7fa6baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:13.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.342+0000 7fa7dfb28800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19]): orig_sources= new_sources= 2024-09-12T00:50:13.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.342+0000 7fa7dfb28800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19]): potential sources added=[] removed=[] 2024-09-12T00:50:13.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.342+0000 7fa7dfb28800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19]): orig_dests= new_dests= 2024-09-12T00:50:13.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.342+0000 7fa7dfb28800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19]): potential dests added=[] removed=[] 2024-09-12T00:50:13.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.344+0000 7fa7dfb28800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19.1.0 2024-09-12T00:50:13.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.344+0000 7fa7dfb28800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19.1.0 2024-09-12T00:50:13.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.344+0000 7fa7dfb28800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19.1.1 2024-09-12T00:50:13.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.344+0000 7fa7dfb28800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19.1.1 2024-09-12T00:50:13.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.344+0000 7fa7dfb28800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19.0 2024-09-12T00:50:13.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.346+0000 7fa7dfb28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:13.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.346+0000 7fa7dfb28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 2024-09-12T00:50:13.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.347+0000 7fa7dfb28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 info.flags=0x17 2024-09-12T00:50:13.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.347+0000 7fa7dfb28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 to cache LRU end 2024-09-12T00:50:13.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.347+0000 7fa7dfb28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:13.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.347+0000 7fa7dfb28800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19, ofs0, ns] 2024-09-12T00:50:13.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.348+0000 7fa6baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431577 cookie 94496794923056 notifier 6282 bl.length()=911 2024-09-12T00:50:13.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.348+0000 7fa6baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 info.flags=0x17 2024-09-12T00:50:13.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.348+0000 7fa6baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 to cache LRU end 2024-09-12T00:50:13.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.348+0000 7fa6baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:13.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.349+0000 7fa7dfb28800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19]): orig_sources= new_sources= 2024-09-12T00:50:13.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.349+0000 7fa7dfb28800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19]): potential sources added=[] removed=[] 2024-09-12T00:50:13.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.349+0000 7fa7dfb28800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19]): orig_dests= new_dests= 2024-09-12T00:50:13.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.349+0000 7fa7dfb28800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19]): potential dests added=[] removed=[] 2024-09-12T00:50:13.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.351+0000 7fa7dfb28800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19.0 2024-09-12T00:50:13.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.351+0000 7fa7dfb28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:13.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.351+0000 7fa7dfb28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 2024-09-12T00:50:13.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.352+0000 7fa7dfb28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 info.flags=0x17 2024-09-12T00:50:13.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.352+0000 7fa7dfb28800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 to cache LRU end 2024-09-12T00:50:13.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.352+0000 7fa7dfb28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:13.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.352+0000 7fa7dfb28800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19, ofs0, ns] 2024-09-12T00:50:13.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.353+0000 7fa6baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431578 cookie 94496794923056 notifier 6282 bl.length()=879 2024-09-12T00:50:13.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.353+0000 7fa6baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 info.flags=0x17 2024-09-12T00:50:13.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.353+0000 7fa6baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 to cache LRU end 2024-09-12T00:50:13.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.353+0000 7fa6baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:13.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.354+0000 7fa7dfb28800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19]): orig_sources= new_sources= 2024-09-12T00:50:13.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.354+0000 7fa7dfb28800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19]): potential sources added=[] removed=[] 2024-09-12T00:50:13.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.354+0000 7fa7dfb28800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19]): orig_dests= new_dests= 2024-09-12T00:50:13.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.354+0000 7fa7dfb28800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19]): potential dests added=[] removed=[] 2024-09-12T00:50:13.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.355+0000 7fa7dfb28800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T00:50:13.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.357+0000 7fa691fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:13.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.359+0000 7fa7dfb28800 20 remove_watcher() i=0 2024-09-12T00:50:13.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.359+0000 7fa7dfb28800 2 removed watcher, disabling cache 2024-09-12T00:50:13.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.360+0000 7fa7dfb28800 20 remove_watcher() i=1 2024-09-12T00:50:13.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.361+0000 7fa7dfb28800 20 remove_watcher() i=2 2024-09-12T00:50:13.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.363+0000 7fa7dfb28800 20 remove_watcher() i=3 2024-09-12T00:50:13.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.364+0000 7fa7dfb28800 20 remove_watcher() i=4 2024-09-12T00:50:13.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.365+0000 7fa7dfb28800 20 remove_watcher() i=5 2024-09-12T00:50:13.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.366+0000 7fa7dfb28800 20 remove_watcher() i=6 2024-09-12T00:50:13.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.367+0000 7fa7dfb28800 20 remove_watcher() i=7 2024-09-12T00:50:13.378 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:50:13.408 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:13.408 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:13.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.447+0000 7ffa22b26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.449+0000 7ffa22b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.449+0000 7ffa22b26800 20 realm 2024-09-12T00:50:13.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.449+0000 7ffa22b26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.449+0000 7ffa22b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.449+0000 7ffa22b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:13.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.449+0000 7ffa22b26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.449+0000 7ffa22b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.449+0000 7ffa22b26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.450+0000 7ffa22b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:13.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.450+0000 7ffa22b26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.451+0000 7ffa22b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:13.451 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.451+0000 7ffa22b26800 20 searching for the correct realm 2024-09-12T00:50:13.452 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.453+0000 7ffa1df5c640 0 -- 172.21.15.62:0/1866984434 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7ffa1806f000 msgr2=0x7ffa180625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:13.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.658+0000 7ffa1df5c640 0 -- 172.21.15.62:0/1866984434 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5583cf57f600 msgr2=0x5583cf581ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:13.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.662+0000 7ffa22b26800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:13.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.662+0000 7ffa22b26800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:13.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.662+0000 7ffa22b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:13.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.662+0000 7ffa22b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:13.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.662+0000 7ffa22b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:13.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.662+0000 7ffa22b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:13.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.662+0000 7ffa22b26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.662+0000 7ffa22b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.662+0000 7ffa22b26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.662+0000 7ffa22b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:13.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.662+0000 7ffa22b26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.663+0000 7ffa22b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:13.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.663+0000 7ffa22b26800 20 zone default found 2024-09-12T00:50:13.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.663+0000 7ffa22b26800 4 Realm: () 2024-09-12T00:50:13.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.663+0000 7ffa22b26800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:13.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.663+0000 7ffa22b26800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:13.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.663+0000 7ffa22b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:13.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.663+0000 7ffa22b26800 20 zonegroup default 2024-09-12T00:50:13.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.663+0000 7ffa22b26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.663+0000 7ffa22b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.663+0000 7ffa22b26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.663+0000 7ffa22b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.663+0000 7ffa22b26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.664+0000 7ffa22b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:13.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.664+0000 7ffa22b26800 20 started sync module instance, tier type = 2024-09-12T00:50:13.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.664+0000 7ffa22b26800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:13.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.672+0000 7ffa22b26800 20 add_watcher() i=0 2024-09-12T00:50:13.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.672+0000 7ffa22b26800 20 add_watcher() i=1 2024-09-12T00:50:13.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.672+0000 7ffa22b26800 20 add_watcher() i=2 2024-09-12T00:50:13.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.672+0000 7ffa22b26800 20 add_watcher() i=3 2024-09-12T00:50:13.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.672+0000 7ffa22b26800 20 add_watcher() i=4 2024-09-12T00:50:13.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.672+0000 7ffa22b26800 20 add_watcher() i=5 2024-09-12T00:50:13.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.672+0000 7ffa22b26800 20 add_watcher() i=6 2024-09-12T00:50:13.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.673+0000 7ffa22b26800 20 add_watcher() i=7 2024-09-12T00:50:13.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.673+0000 7ffa22b26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:13.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.675+0000 7ff8d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:13.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.675+0000 7ffa22b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:13.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.675+0000 7ffa22b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:13.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.675+0000 7ffa22b26800 5 note: GC not initialized 2024-09-12T00:50:13.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.675+0000 7ff84f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:13.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.675+0000 7ffa22b26800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:13.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.675+0000 7ffa22b26800 20 Filter name: none 2024-09-12T00:50:13.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.676+0000 7ff84d7fa640 20 reqs_thread_entry: start 2024-09-12T00:50:13.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.676+0000 7ffa22b26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.676+0000 7ffa22b26800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:13.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.676+0000 7ffa22b26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.676+0000 7ffa22b26800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:50:13.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.676+0000 7ffa22b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:13.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.677+0000 7ffa22b26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.677+0000 7ffa22b26800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:13.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.677+0000 7ffa22b26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:13.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.677+0000 7ffa22b26800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:50:13.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.677+0000 7ffa22b26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:13.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.678+0000 7ff8d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:13.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.681+0000 7ffa22b26800 20 remove_watcher() i=0 2024-09-12T00:50:13.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.681+0000 7ffa22b26800 2 removed watcher, disabling cache 2024-09-12T00:50:13.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.682+0000 7ffa22b26800 20 remove_watcher() i=1 2024-09-12T00:50:13.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.683+0000 7ffa22b26800 20 remove_watcher() i=2 2024-09-12T00:50:13.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.685+0000 7ffa22b26800 20 remove_watcher() i=3 2024-09-12T00:50:13.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.686+0000 7ffa22b26800 20 remove_watcher() i=4 2024-09-12T00:50:13.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.687+0000 7ffa22b26800 20 remove_watcher() i=5 2024-09-12T00:50:13.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.688+0000 7ffa22b26800 20 remove_watcher() i=6 2024-09-12T00:50:13.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:13.690+0000 7ffa22b26800 20 remove_watcher() i=7 2024-09-12T00:50:13.699 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:13.700 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:13.700 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-init-index id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:50:13.700 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:14.035 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T00:50:14.036 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:14.886 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:50:14.916 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:14.916 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:14.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.956+0000 7f394f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.957+0000 7f394f12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.957+0000 7f394f12e800 20 realm 2024-09-12T00:50:14.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.957+0000 7f394f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.957+0000 7f394f12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.957+0000 7f394f12e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:14.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.957+0000 7f394f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.958+0000 7f394f12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.958+0000 7f394f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.958+0000 7f394f12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:14.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.958+0000 7f394f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.959+0000 7f394f12e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:14.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.959+0000 7f394f12e800 20 searching for the correct realm 2024-09-12T00:50:14.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.962+0000 7f394a6dc640 0 -- 172.21.15.62:0/4088631439 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f39440671f0 msgr2=0x7f3944096a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:14.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.966+0000 7f394aedd640 0 -- 172.21.15.62:0/4088631439 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f394407c040 msgr2=0x7f394408f7e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:14.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.969+0000 7f394f12e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:14.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.969+0000 7f394f12e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:14.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.969+0000 7f394f12e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:14.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.969+0000 7f394f12e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:14.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.969+0000 7f394f12e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:14.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.969+0000 7f394f12e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:14.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.969+0000 7f394f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.970+0000 7f394f12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.970+0000 7f394f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.970+0000 7f394f12e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:14.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.970+0000 7f394f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.970+0000 7f394f12e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:14.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.970+0000 7f394f12e800 20 zone default found 2024-09-12T00:50:14.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.970+0000 7f394f12e800 4 Realm: () 2024-09-12T00:50:14.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.970+0000 7f394f12e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:14.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.970+0000 7f394f12e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:14.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.970+0000 7f394f12e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:14.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.970+0000 7f394f12e800 20 zonegroup default 2024-09-12T00:50:14.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.970+0000 7f394f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.971+0000 7f394f12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.971+0000 7f394f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.971+0000 7f394f12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.971+0000 7f394f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.971+0000 7f394f12e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:14.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.971+0000 7f394f12e800 20 started sync module instance, tier type = 2024-09-12T00:50:14.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.971+0000 7f394f12e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:14.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.979+0000 7f394f12e800 20 add_watcher() i=0 2024-09-12T00:50:14.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.980+0000 7f394f12e800 20 add_watcher() i=1 2024-09-12T00:50:14.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.980+0000 7f394f12e800 20 add_watcher() i=2 2024-09-12T00:50:14.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.980+0000 7f394f12e800 20 add_watcher() i=3 2024-09-12T00:50:14.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.980+0000 7f394f12e800 20 add_watcher() i=4 2024-09-12T00:50:14.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.980+0000 7f394f12e800 20 add_watcher() i=5 2024-09-12T00:50:14.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.980+0000 7f394f12e800 20 add_watcher() i=6 2024-09-12T00:50:14.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.980+0000 7f394f12e800 20 add_watcher() i=7 2024-09-12T00:50:14.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.980+0000 7f394f12e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:14.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.982+0000 7f38017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:14.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.982+0000 7f394f12e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:14.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.982+0000 7f394f12e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:14.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.982+0000 7f394f12e800 5 note: GC not initialized 2024-09-12T00:50:14.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.982+0000 7f377bfff640 20 reqs_thread_entry: start 2024-09-12T00:50:14.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.983+0000 7f394f12e800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:14.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.983+0000 7f394f12e800 20 Filter name: none 2024-09-12T00:50:14.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.983+0000 7f3779ffb640 20 reqs_thread_entry: start 2024-09-12T00:50:14.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.983+0000 7f394f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.983+0000 7f394f12e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:14.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.983+0000 7f394f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.984+0000 7f394f12e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:50:14.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.984+0000 7f394f12e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:14.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.984+0000 7f394f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.984+0000 7f394f12e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:14.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.984+0000 7f394f12e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:14.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.985+0000 7f394f12e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:50:14.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.985+0000 7f394f12e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:14.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.986+0000 7f38017e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:14.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.989+0000 7f394f12e800 20 remove_watcher() i=0 2024-09-12T00:50:14.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.989+0000 7f394f12e800 2 removed watcher, disabling cache 2024-09-12T00:50:14.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.990+0000 7f394f12e800 20 remove_watcher() i=1 2024-09-12T00:50:14.990 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.991+0000 7f394f12e800 20 remove_watcher() i=2 2024-09-12T00:50:14.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.992+0000 7f394f12e800 20 remove_watcher() i=3 2024-09-12T00:50:14.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.993+0000 7f394f12e800 20 remove_watcher() i=4 2024-09-12T00:50:14.993 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.994+0000 7f394f12e800 20 remove_watcher() i=5 2024-09-12T00:50:14.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.995+0000 7f394f12e800 20 remove_watcher() i=6 2024-09-12T00:50:14.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:14.996+0000 7f394f12e800 20 remove_watcher() i=7 2024-09-12T00:50:15.006 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:15.006 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:15.007 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-init-index id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:15.007 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:15.008 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T00:50:15.045 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:15.045 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:15.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.084+0000 7f8879930800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.086+0000 7f8879930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.086+0000 7f8879930800 20 realm 2024-09-12T00:50:15.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.086+0000 7f8879930800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.087+0000 7f8879930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.087+0000 7f8879930800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:15.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.087+0000 7f8879930800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.087+0000 7f8879930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.087+0000 7f8879930800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.088+0000 7f8879930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:15.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.088+0000 7f8879930800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.088+0000 7f8879930800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:15.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.088+0000 7f8879930800 20 searching for the correct realm 2024-09-12T00:50:15.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.091+0000 7f8874eaf640 0 -- 172.21.15.62:0/1462754095 >> [v2:172.21.15.62:6808/741930476,v1:172.21.15.62:6809/741930476] conn(0x561f8fb48520 msgr2=0x561f8fb4a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:15.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.094+0000 7f88756b0640 0 -- 172.21.15.62:0/1462754095 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f88700980e0 msgr2=0x7f8870061510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:15.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.300+0000 7f8879930800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:15.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.300+0000 7f8879930800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:15.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.300+0000 7f8879930800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:15.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.300+0000 7f8879930800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:15.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.300+0000 7f8879930800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:15.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.300+0000 7f8879930800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:15.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.300+0000 7f8879930800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.301+0000 7f8879930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.301+0000 7f8879930800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.301+0000 7f8879930800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:15.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.301+0000 7f8879930800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.301+0000 7f8879930800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:15.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.301+0000 7f8879930800 20 zone default found 2024-09-12T00:50:15.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.301+0000 7f8879930800 4 Realm: () 2024-09-12T00:50:15.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.301+0000 7f8879930800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:15.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.301+0000 7f8879930800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:15.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.301+0000 7f8879930800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:15.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.301+0000 7f8879930800 20 zonegroup default 2024-09-12T00:50:15.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.301+0000 7f8879930800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.302+0000 7f8879930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.302+0000 7f8879930800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.302+0000 7f8879930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.302+0000 7f8879930800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.302+0000 7f8879930800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.303+0000 7f8879930800 20 started sync module instance, tier type = 2024-09-12T00:50:15.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.303+0000 7f8879930800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:15.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.314+0000 7f8879930800 20 add_watcher() i=0 2024-09-12T00:50:15.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.314+0000 7f8879930800 20 add_watcher() i=1 2024-09-12T00:50:15.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.314+0000 7f8879930800 20 add_watcher() i=2 2024-09-12T00:50:15.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.314+0000 7f8879930800 20 add_watcher() i=3 2024-09-12T00:50:15.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.314+0000 7f8879930800 20 add_watcher() i=4 2024-09-12T00:50:15.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.314+0000 7f8879930800 20 add_watcher() i=5 2024-09-12T00:50:15.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.314+0000 7f8879930800 20 add_watcher() i=6 2024-09-12T00:50:15.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.315+0000 7f8879930800 20 add_watcher() i=7 2024-09-12T00:50:15.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.315+0000 7f8879930800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:15.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.316+0000 7f872b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:15.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.317+0000 7f8879930800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:15.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.317+0000 7f8879930800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:15.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.317+0000 7f8879930800 5 note: GC not initialized 2024-09-12T00:50:15.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.317+0000 7f872a7e4640 20 reqs_thread_entry: start 2024-09-12T00:50:15.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.317+0000 7f8879930800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:15.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.317+0000 7f8879930800 20 Filter name: none 2024-09-12T00:50:15.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.317+0000 7f869bfff640 20 reqs_thread_entry: start 2024-09-12T00:50:15.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.317+0000 7f8879930800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:50:15.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.317+0000 7f8879930800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.318+0000 7f8879930800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:15.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.318+0000 7f8879930800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:50:15.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.318+0000 7f8879930800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:50:15.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.318+0000 7f8879930800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 : miss 2024-09-12T00:50:15.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.318+0000 7f8879930800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.318+0000 7f8879930800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:50:15.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.318+0000 7f8879930800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 info.flags=0x17 2024-09-12T00:50:15.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.318+0000 7f8879930800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 to cache LRU end 2024-09-12T00:50:15.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.318+0000 7f8879930800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:15.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.318+0000 7f8879930800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:15.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.318+0000 7f8879930800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 2024-09-12T00:50:15.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.319+0000 7f8879930800 -1 Injecting error=-95 at location=init_index 2024-09-12T00:50:15.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.319+0000 7f8879930800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:50:15.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.322+0000 7f8879930800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 info.flags=0x17 2024-09-12T00:50:15.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.322+0000 7f8879930800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 to cache LRU end 2024-09-12T00:50:15.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.322+0000 7f8879930800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:15.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.322+0000 7f8879930800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20, ofs0, ns] 2024-09-12T00:50:15.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.322+0000 7f8758ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431581 cookie 94693554984176 notifier 6336 bl.length()=911 2024-09-12T00:50:15.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.322+0000 7f8758ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 info.flags=0x17 2024-09-12T00:50:15.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.322+0000 7f8758ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 to cache LRU end 2024-09-12T00:50:15.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.322+0000 7f8758ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:15.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.324+0000 7f8879930800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20]): orig_sources= new_sources= 2024-09-12T00:50:15.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.324+0000 7f8879930800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20]): potential sources added=[] removed=[] 2024-09-12T00:50:15.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.324+0000 7f8879930800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20]): orig_dests= new_dests= 2024-09-12T00:50:15.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.324+0000 7f8879930800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20]): potential dests added=[] removed=[] 2024-09-12T00:50:15.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.325+0000 7f8879930800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20.1.0 2024-09-12T00:50:15.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.325+0000 7f8879930800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20.1.0 2024-09-12T00:50:15.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.325+0000 7f8879930800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20.1.1 2024-09-12T00:50:15.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.325+0000 7f8879930800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20.1.1 2024-09-12T00:50:15.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.325+0000 7f8879930800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20.0 2024-09-12T00:50:15.326 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.327+0000 7f8879930800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:15.326 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.327+0000 7f8879930800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 2024-09-12T00:50:15.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.328+0000 7f8879930800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 info.flags=0x17 2024-09-12T00:50:15.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.328+0000 7f8879930800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 to cache LRU end 2024-09-12T00:50:15.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.328+0000 7f8879930800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:15.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.328+0000 7f8879930800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20, ofs0, ns] 2024-09-12T00:50:15.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.328+0000 7f8747fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431582 cookie 94693554984176 notifier 6336 bl.length()=879 2024-09-12T00:50:15.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.328+0000 7f8747fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 info.flags=0x17 2024-09-12T00:50:15.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.328+0000 7f8747fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 to cache LRU end 2024-09-12T00:50:15.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.328+0000 7f8747fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:15.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.330+0000 7f8879930800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20]): orig_sources= new_sources= 2024-09-12T00:50:15.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.330+0000 7f8879930800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20]): potential sources added=[] removed=[] 2024-09-12T00:50:15.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.330+0000 7f8879930800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20]): orig_dests= new_dests= 2024-09-12T00:50:15.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.330+0000 7f8879930800 20 handle_bi_update(): bucket=:error-at-init-index[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20]): potential dests added=[] removed=[] 2024-09-12T00:50:15.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.331+0000 7f8879930800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-12T00:50:15.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.333+0000 7f872b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:15.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.335+0000 7f8879930800 20 remove_watcher() i=0 2024-09-12T00:50:15.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.335+0000 7f8879930800 2 removed watcher, disabling cache 2024-09-12T00:50:15.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.337+0000 7f8879930800 20 remove_watcher() i=1 2024-09-12T00:50:15.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.338+0000 7f8879930800 20 remove_watcher() i=2 2024-09-12T00:50:15.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.339+0000 7f8879930800 20 remove_watcher() i=3 2024-09-12T00:50:15.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.339+0000 7f8879930800 20 remove_watcher() i=4 2024-09-12T00:50:15.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.340+0000 7f8879930800 20 remove_watcher() i=5 2024-09-12T00:50:15.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.341+0000 7f8879930800 20 remove_watcher() i=6 2024-09-12T00:50:15.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.342+0000 7f8879930800 20 remove_watcher() i=7 2024-09-12T00:50:15.354 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:50:15.383 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:15.383 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:15.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.422+0000 7fb30fb46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.424+0000 7fb30fb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.424+0000 7fb30fb46800 20 realm 2024-09-12T00:50:15.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.424+0000 7fb30fb46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.425+0000 7fb30fb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.425+0000 7fb30fb46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:15.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.425+0000 7fb30fb46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.425+0000 7fb30fb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.425+0000 7fb30fb46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.426+0000 7fb30fb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:15.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.426+0000 7fb30fb46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.426+0000 7fb30fb46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:15.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.426+0000 7fb30fb46800 20 searching for the correct realm 2024-09-12T00:50:15.427 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.429+0000 7fb30ce36640 0 -- 172.21.15.62:0/1370984644 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fb30809a360 msgr2=0x7fb308063750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:15.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.634+0000 7fb30d637640 0 -- 172.21.15.62:0/1370984644 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7fb30808f3a0 msgr2=0x7fb308093a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:15.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.639+0000 7fb30fb46800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:15.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.639+0000 7fb30fb46800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:15.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.639+0000 7fb30fb46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:15.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.639+0000 7fb30fb46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:15.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.639+0000 7fb30fb46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:15.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.639+0000 7fb30fb46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:15.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.639+0000 7fb30fb46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.639+0000 7fb30fb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.639+0000 7fb30fb46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.639+0000 7fb30fb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:15.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.639+0000 7fb30fb46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.640+0000 7fb30fb46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:15.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.640+0000 7fb30fb46800 20 zone default found 2024-09-12T00:50:15.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.640+0000 7fb30fb46800 4 Realm: () 2024-09-12T00:50:15.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.640+0000 7fb30fb46800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:15.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.640+0000 7fb30fb46800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:15.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.640+0000 7fb30fb46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:15.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.640+0000 7fb30fb46800 20 zonegroup default 2024-09-12T00:50:15.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.640+0000 7fb30fb46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.640+0000 7fb30fb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.640+0000 7fb30fb46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.640+0000 7fb30fb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.640+0000 7fb30fb46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.641+0000 7fb30fb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:15.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.641+0000 7fb30fb46800 20 started sync module instance, tier type = 2024-09-12T00:50:15.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.641+0000 7fb30fb46800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:15.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.649+0000 7fb30fb46800 20 add_watcher() i=0 2024-09-12T00:50:15.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.649+0000 7fb30fb46800 20 add_watcher() i=1 2024-09-12T00:50:15.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.649+0000 7fb30fb46800 20 add_watcher() i=2 2024-09-12T00:50:15.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.649+0000 7fb30fb46800 20 add_watcher() i=3 2024-09-12T00:50:15.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.649+0000 7fb30fb46800 20 add_watcher() i=4 2024-09-12T00:50:15.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.649+0000 7fb30fb46800 20 add_watcher() i=5 2024-09-12T00:50:15.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.649+0000 7fb30fb46800 20 add_watcher() i=6 2024-09-12T00:50:15.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.650+0000 7fb30fb46800 20 add_watcher() i=7 2024-09-12T00:50:15.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.650+0000 7fb30fb46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:15.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.652+0000 7fb1c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:15.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.652+0000 7fb30fb46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:15.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.652+0000 7fb30fb46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:15.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.652+0000 7fb30fb46800 5 note: GC not initialized 2024-09-12T00:50:15.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.652+0000 7fb1c27e4640 20 reqs_thread_entry: start 2024-09-12T00:50:15.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.652+0000 7fb30fb46800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:15.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.652+0000 7fb30fb46800 20 Filter name: none 2024-09-12T00:50:15.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.653+0000 7fb133fff640 20 reqs_thread_entry: start 2024-09-12T00:50:15.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.653+0000 7fb30fb46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.653+0000 7fb30fb46800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:15.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.653+0000 7fb30fb46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.654+0000 7fb30fb46800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:50:15.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.654+0000 7fb30fb46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:15.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.654+0000 7fb30fb46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.654+0000 7fb30fb46800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:15.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.654+0000 7fb30fb46800 20 rados->read ofs=0 len=0 2024-09-12T00:50:15.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.654+0000 7fb30fb46800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:50:15.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.654+0000 7fb30fb46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:15.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.656+0000 7fb1c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:15.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.658+0000 7fb30fb46800 20 remove_watcher() i=0 2024-09-12T00:50:15.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.658+0000 7fb30fb46800 2 removed watcher, disabling cache 2024-09-12T00:50:15.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.659+0000 7fb30fb46800 20 remove_watcher() i=1 2024-09-12T00:50:15.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.660+0000 7fb30fb46800 20 remove_watcher() i=2 2024-09-12T00:50:15.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.661+0000 7fb30fb46800 20 remove_watcher() i=3 2024-09-12T00:50:15.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.662+0000 7fb30fb46800 20 remove_watcher() i=4 2024-09-12T00:50:15.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.662+0000 7fb30fb46800 20 remove_watcher() i=5 2024-09-12T00:50:15.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.663+0000 7fb30fb46800 20 remove_watcher() i=6 2024-09-12T00:50:15.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:15.664+0000 7fb30fb46800 20 remove_watcher() i=7 2024-09-12T00:50:15.674 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:15.675 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:15.675 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-init-index id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:50:15.675 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:15.998 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T00:50:15.998 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:16.855 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:50:16.884 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:16.884 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:16.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:16.924+0000 7f4364c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:16.926+0000 7f4364c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:16.926+0000 7f4364c98800 20 realm 2024-09-12T00:50:16.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:16.926+0000 7f4364c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:16.926+0000 7f4364c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:16.926+0000 7f4364c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:16.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:16.926+0000 7f4364c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:16.926+0000 7f4364c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:16.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:16.926+0000 7f4364c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:16.927+0000 7f4364c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:16.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:16.927+0000 7f4364c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:16.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:16.928+0000 7f4364c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:16.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:16.928+0000 7f4364c98800 20 searching for the correct realm 2024-09-12T00:50:17.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.132+0000 7f4359f81640 0 -- 172.21.15.62:0/2270582865 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f435c033930 msgr2=0x7f435c023400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:17.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.538+0000 7f4362f83640 0 -- 172.21.15.62:0/2270582865 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55d579ab5bc0 msgr2=0x55d579ab7fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:17.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.543+0000 7f4364c98800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:17.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.543+0000 7f4364c98800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:17.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.543+0000 7f4364c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:17.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.543+0000 7f4364c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:17.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.543+0000 7f4364c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:17.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.543+0000 7f4364c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:17.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.543+0000 7f4364c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:17.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.543+0000 7f4364c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:17.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.543+0000 7f4364c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:17.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.543+0000 7f4364c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:17.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.543+0000 7f4364c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:17.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.544+0000 7f4364c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:17.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.544+0000 7f4364c98800 20 zone default found 2024-09-12T00:50:17.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.544+0000 7f4364c98800 4 Realm: () 2024-09-12T00:50:17.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.544+0000 7f4364c98800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:17.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.544+0000 7f4364c98800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:17.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.544+0000 7f4364c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:17.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.544+0000 7f4364c98800 20 zonegroup default 2024-09-12T00:50:17.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.544+0000 7f4364c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:17.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.544+0000 7f4364c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:17.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.544+0000 7f4364c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:17.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.545+0000 7f4364c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:17.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.545+0000 7f4364c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:17.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.545+0000 7f4364c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:17.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.545+0000 7f4364c98800 20 started sync module instance, tier type = 2024-09-12T00:50:17.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.545+0000 7f4364c98800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:17.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.555+0000 7f4364c98800 20 add_watcher() i=0 2024-09-12T00:50:17.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.555+0000 7f4364c98800 20 add_watcher() i=1 2024-09-12T00:50:17.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.555+0000 7f4364c98800 20 add_watcher() i=2 2024-09-12T00:50:17.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.555+0000 7f4364c98800 20 add_watcher() i=3 2024-09-12T00:50:17.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.555+0000 7f4364c98800 20 add_watcher() i=4 2024-09-12T00:50:17.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.555+0000 7f4364c98800 20 add_watcher() i=5 2024-09-12T00:50:17.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.555+0000 7f4364c98800 20 add_watcher() i=6 2024-09-12T00:50:17.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.556+0000 7f4364c98800 20 add_watcher() i=7 2024-09-12T00:50:17.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.556+0000 7f4364c98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:17.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.558+0000 7f4218fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:17.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.559+0000 7f4364c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:17.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.559+0000 7f4364c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:17.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.559+0000 7f4364c98800 5 note: GC not initialized 2024-09-12T00:50:17.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.559+0000 7f41937fe640 20 reqs_thread_entry: start 2024-09-12T00:50:17.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.559+0000 7f4364c98800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:17.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.559+0000 7f4364c98800 20 Filter name: none 2024-09-12T00:50:17.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.559+0000 7f41917fa640 20 reqs_thread_entry: start 2024-09-12T00:50:17.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.559+0000 7f4364c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:17.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.560+0000 7f4364c98800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:50:17.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.560+0000 7f4364c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:17.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.561+0000 7f4364c98800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:50:17.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.561+0000 7f4364c98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:17.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.561+0000 7f4364c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:17.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.561+0000 7f4364c98800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:50:17.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.561+0000 7f4364c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:17.561 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.562+0000 7f4364c98800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:50:17.561 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.562+0000 7f4364c98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:17.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.563+0000 7f4218fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:17.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.566+0000 7f4364c98800 20 remove_watcher() i=0 2024-09-12T00:50:17.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.566+0000 7f4364c98800 2 removed watcher, disabling cache 2024-09-12T00:50:17.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.567+0000 7f4364c98800 20 remove_watcher() i=1 2024-09-12T00:50:17.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.568+0000 7f4364c98800 20 remove_watcher() i=2 2024-09-12T00:50:17.568 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.569+0000 7f4364c98800 20 remove_watcher() i=3 2024-09-12T00:50:17.569 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.570+0000 7f4364c98800 20 remove_watcher() i=4 2024-09-12T00:50:17.570 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.572+0000 7f4364c98800 20 remove_watcher() i=5 2024-09-12T00:50:17.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.573+0000 7f4364c98800 20 remove_watcher() i=6 2024-09-12T00:50:17.573 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.574+0000 7f4364c98800 20 remove_watcher() i=7 2024-09-12T00:50:17.585 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:17.585 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:17.585 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-init-indext id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:17.585 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:17.587 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T00:50:17.622 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:17.623 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:17.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.664+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:17.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.665+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:17.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.665+0000 7f2cf2b25800 20 realm 2024-09-12T00:50:17.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.665+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:17.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.665+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:17.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.665+0000 7f2cf2b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:17.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.665+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:17.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.666+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:17.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.666+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:17.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.666+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:17.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.666+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:17.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.667+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:17.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.667+0000 7f2cf2b25800 20 searching for the correct realm 2024-09-12T00:50:17.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.668+0000 7f2cee733640 0 -- 172.21.15.62:0/371980417 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7f2ce8064040 msgr2=0x7f2ce8055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:17.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:17.873+0000 7f2ceef34640 0 -- 172.21.15.62:0/371980417 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7f2ce0052020 msgr2=0x7f2ce00a4a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:18.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:18.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:18.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:18.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:18.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:18.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:18.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:18.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:18.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 zone default found 2024-09-12T00:50:18.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.083+0000 7f2cf2b25800 4 Realm: () 2024-09-12T00:50:18.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.083+0000 7f2cf2b25800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:18.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.083+0000 7f2cf2b25800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:18.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.083+0000 7f2cf2b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:18.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 zonegroup default 2024-09-12T00:50:18.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.084+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.084+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.084+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.084+0000 7f2cf2b25800 20 started sync module instance, tier type = 2024-09-12T00:50:18.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.084+0000 7f2cf2b25800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:18.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=0 2024-09-12T00:50:18.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=1 2024-09-12T00:50:18.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=2 2024-09-12T00:50:18.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=3 2024-09-12T00:50:18.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=4 2024-09-12T00:50:18.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=5 2024-09-12T00:50:18.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=6 2024-09-12T00:50:18.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.095+0000 7f2cf2b25800 20 add_watcher() i=7 2024-09-12T00:50:18.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.095+0000 7f2cf2b25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:18.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.097+0000 7f2ba4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:18.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.098+0000 7f2cf2b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:18.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.098+0000 7f2cf2b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:18.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 note: GC not initialized 2024-09-12T00:50:18.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.098+0000 7f2b1f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:18.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.098+0000 7f2cf2b25800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:18.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.098+0000 7f2cf2b25800 20 Filter name: none 2024-09-12T00:50:18.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.098+0000 7f2b1d7fa640 20 reqs_thread_entry: start 2024-09-12T00:50:18.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.098+0000 7f2cf2b25800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:50:18.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.098+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.115 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.099+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:50:18.115 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.099+0000 7f2cf2b25800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:50:18.115 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.099+0000 7f2cf2b25800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:50:18.115 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.099+0000 7f2cf2b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 : miss 2024-09-12T00:50:18.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.099+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.100+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:50:18.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.100+0000 7f2cf2b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 info.flags=0x17 2024-09-12T00:50:18.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.100+0000 7f2cf2b25800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 to cache LRU end 2024-09-12T00:50:18.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.100+0000 7f2cf2b25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:18.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.100+0000 7f2cf2b25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:18.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.100+0000 7f2cf2b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 2024-09-12T00:50:18.116 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2cf2b25800 time 2024-09-12T00:50:18.102728+0000 2024-09-12T00:50:18.116 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:18.116 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:18.117 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2cf418c71a] 2024-09-12T00:50:18.117 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2cf418c8d8] 2024-09-12T00:50:18.117 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9a2b3a641] 2024-09-12T00:50:18.117 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd877a4) [0x55b9a304c7a4] 2024-09-12T00:50:18.117 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b9a2b4a31d] 2024-09-12T00:50:18.117 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:50:18.117 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2cf2e29590] 2024-09-12T00:50:18.117 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:50:18.117 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:50:18.117 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.102+0000 7f2cf2b25800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2cf2b25800 time 2024-09-12T00:50:18.102728+0000 2024-09-12T00:50:18.117 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:18.118 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.118 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:18.118 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2cf418c71a] 2024-09-12T00:50:18.118 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2cf418c8d8] 2024-09-12T00:50:18.118 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9a2b3a641] 2024-09-12T00:50:18.118 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd877a4) [0x55b9a304c7a4] 2024-09-12T00:50:18.118 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b9a2b4a31d] 2024-09-12T00:50:18.118 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:50:18.118 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2cf2e29590] 2024-09-12T00:50:18.118 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:50:18.118 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:50:18.118 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.118 INFO:tasks.workunit.client.0.smithi062.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:50:18.119 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f2cf2b25800 thread_name:radosgw-admin 2024-09-12T00:50:18.119 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:18.119 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2cf2e3e6f0] 2024-09-12T00:50:18.119 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2cf2e8b99c] 2024-09-12T00:50:18.119 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:50:18.119 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:50:18.119 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2cf418c774] 2024-09-12T00:50:18.119 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2cf418c8d8] 2024-09-12T00:50:18.119 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9a2b3a641] 2024-09-12T00:50:18.119 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd877a4) [0x55b9a304c7a4] 2024-09-12T00:50:18.119 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b9a2b4a31d] 2024-09-12T00:50:18.119 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:50:18.119 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2cf2e29590] 2024-09-12T00:50:18.119 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:50:18.119 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:50:18.120 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.103+0000 7f2cf2b25800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:18.120 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f2cf2b25800 thread_name:radosgw-admin 2024-09-12T00:50:18.120 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.120 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:18.120 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2cf2e3e6f0] 2024-09-12T00:50:18.120 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2cf2e8b99c] 2024-09-12T00:50:18.120 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:50:18.120 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:50:18.120 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2cf418c774] 2024-09-12T00:50:18.120 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2cf418c8d8] 2024-09-12T00:50:18.120 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9a2b3a641] 2024-09-12T00:50:18.120 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd877a4) [0x55b9a304c7a4] 2024-09-12T00:50:18.120 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b9a2b4a31d] 2024-09-12T00:50:18.121 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:50:18.121 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2cf2e29590] 2024-09-12T00:50:18.121 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:50:18.121 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:50:18.121 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:18.121 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.121 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:50:18.121 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:50:17.646+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.121 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:50:17.646+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_done global_id 6050 payload 274 2024-09-12T00:50:18.121 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:50:17.646+0000 7f2ce7fff640 10 monclient: _finish_hunting 0 2024-09-12T00:50:18.121 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:50:17.646+0000 7f2ce7fff640 1 monclient: found mon.noname-c 2024-09-12T00:50:18.121 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:50:17.646+0000 7f2ce7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:50:18.122 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.122 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:18.122 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: dump: 2024-09-12T00:50:18.122 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.122 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.122 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.122 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.122 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.122 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.122 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.122 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.122 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.123 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.123 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: _finish_auth 0 2024-09-12T00:50:18.123 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: _check_auth_tickets 2024-09-12T00:50:18.123 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:18.123 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:50:17.646+0000 7f2cf2b25800 5 monclient: authenticate success, global_id 6050 2024-09-12T00:50:18.123 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:50:17.646+0000 7f2cf2b25800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:18.123 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:50:17.646+0000 7f2cf2b25800 4 set_mon_vals no callback set 2024-09-12T00:50:18.123 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.123 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:18.123 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: dump: 2024-09-12T00:50:18.123 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.124 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.124 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.124 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.124 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.124 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.124 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.124 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.124 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.124 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.124 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 10 monclient: shutdown 2024-09-12T00:50:18.124 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 asok(0x55b9a372c630) unregister_commands rotate-key 2024-09-12T00:50:18.125 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 10 monclient: build_initial_monmap 2024-09-12T00:50:18.125 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 1 build_initial for_mkfs: 0 2024-09-12T00:50:18.125 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 10 monclient: monmap: 2024-09-12T00:50:18.125 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:18.125 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:18.125 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:18.125 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:18.125 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:18.125 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.125 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:18.125 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:18.125 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:18.125 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.126 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding auth protocol: cephx 2024-09-12T00:50:18.126 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding auth protocol: cephx 2024-09-12T00:50:18.126 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding auth protocol: cephx 2024-09-12T00:50:18.126 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: secure 2024-09-12T00:50:18.126 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: crc 2024-09-12T00:50:18.126 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: secure 2024-09-12T00:50:18.126 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: crc 2024-09-12T00:50:18.126 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: secure 2024-09-12T00:50:18.126 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: crc 2024-09-12T00:50:18.126 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: crc 2024-09-12T00:50:18.126 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: secure 2024-09-12T00:50:18.126 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: crc 2024-09-12T00:50:18.127 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: secure 2024-09-12T00:50:18.127 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: crc 2024-09-12T00:50:18.127 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: secure 2024-09-12T00:50:18.127 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.127 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 1 librados: starting msgr at 2024-09-12T00:50:18.127 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 1 librados: starting objecter 2024-09-12T00:50:18.127 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command objecter_requests hook 0x55b9a3976d40 2024-09-12T00:50:18.127 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 1 librados: setting wanted keys 2024-09-12T00:50:18.127 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 1 librados: calling monclient init 2024-09-12T00:50:18.127 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 10 monclient: init 2024-09-12T00:50:18.127 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding auth protocol: cephx 2024-09-12T00:50:18.127 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding auth protocol: cephx 2024-09-12T00:50:18.127 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding auth protocol: cephx 2024-09-12T00:50:18.128 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: secure 2024-09-12T00:50:18.128 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: crc 2024-09-12T00:50:18.128 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: secure 2024-09-12T00:50:18.128 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: crc 2024-09-12T00:50:18.128 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: secure 2024-09-12T00:50:18.128 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: crc 2024-09-12T00:50:18.128 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: crc 2024-09-12T00:50:18.128 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: secure 2024-09-12T00:50:18.128 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: crc 2024-09-12T00:50:18.128 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: secure 2024-09-12T00:50:18.128 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: crc 2024-09-12T00:50:18.128 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: secure 2024-09-12T00:50:18.128 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.129 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.129 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command rotate-key hook 0x55b9a394c588 2024-09-12T00:50:18.129 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:18.129 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:50:18.129 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-c con 0x55b9a3952d90 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:18.129 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-a con 0x55b9a3976740 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:18.129 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-b con 0x7f2cdc003ab0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:18.129 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.129 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.129 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.130 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:18.130 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): authenticate will time out at 1904.141497s 2024-09-12T00:50:18.130 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:50:17.648+0000 7f2cee733640 10 monclient(hunting): get_auth_request con 0x55b9a3952d90 auth_method 0 2024-09-12T00:50:18.130 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:50:17.648+0000 7f2cee733640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.130 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:50:17.648+0000 7f2cee733640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.130 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:50:17.648+0000 7f2cee733640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.130 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request con 0x55b9a3976740 auth_method 0 2024-09-12T00:50:18.130 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.130 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.130 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.130 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:50:17.648+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.130 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:50:17.648+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.130 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:50:17.648+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.130 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.131 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.131 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.131 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:50:17.648+0000 7f2ceef34640 10 monclient(hunting): get_auth_request con 0x7f2cdc003ab0 auth_method 0 2024-09-12T00:50:18.131 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:50:17.648+0000 7f2ceef34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.131 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:50:17.648+0000 7f2ceef34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.131 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:50:17.648+0000 7f2ceef34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.131 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_done global_id 6384 payload 824 2024-09-12T00:50:18.131 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient: _finish_hunting 0 2024-09-12T00:50:18.131 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 1 monclient: found mon.noname-a 2024-09-12T00:50:18.131 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:50:18.131 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.131 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:18.131 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: dump: 2024-09-12T00:50:18.132 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.132 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.132 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.132 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.132 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.132 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.132 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.132 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.132 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.132 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.132 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: _finish_auth 0 2024-09-12T00:50:18.132 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: _check_auth_tickets 2024-09-12T00:50:18.133 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:18.133 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.133 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:18.133 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: dump: 2024-09-12T00:50:18.133 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.133 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.133 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.133 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.133 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.133 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.133 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.133 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.134 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.134 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.134 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:50:17.649+0000 7f2cf2b25800 5 monclient: authenticate success, global_id 6384 2024-09-12T00:50:18.134 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:50:17.649+0000 7f2cf2b25800 10 monclient: _renew_subs 2024-09-12T00:50:18.134 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:50:17.649+0000 7f2bdc608640 4 set_mon_vals no callback set 2024-09-12T00:50:18.134 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:50:17.649+0000 7f2cf2b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:50:18.134 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:50:17.649+0000 7f2cf2b25800 10 monclient: _renew_subs 2024-09-12T00:50:18.134 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:50:17.649+0000 7f2cf2b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:50:18.134 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:50:17.649+0000 7f2cf2b25800 1 librados: init done 2024-09-12T00:50:18.134 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:50:17.651+0000 7f2bdae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:18.134 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:50:17.651+0000 7f2bdae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:18.134 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:50:17.651+0000 7f2bdae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:18.135 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:50:17.651+0000 7f2cee733640 10 monclient: get_auth_request con 0x7f2bd4076470 auth_method 0 2024-09-12T00:50:18.135 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:50:17.651+0000 7f2ceef34640 10 monclient: get_auth_request con 0x55b9a3995a40 auth_method 0 2024-09-12T00:50:18.135 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:50:17.652+0000 7f2cee733640 10 monclient: get_auth_request con 0x55b9a3998880 auth_method 0 2024-09-12T00:50:18.135 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:50:17.653+0000 7f2ce7fff640 10 monclient: get_auth_request con 0x55b9a399cc70 auth_method 0 2024-09-12T00:50:18.135 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 10 monclient: build_initial_monmap 2024-09-12T00:50:18.135 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 1 build_initial for_mkfs: 0 2024-09-12T00:50:18.135 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 10 monclient: monmap: 2024-09-12T00:50:18.135 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:18.135 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:18.135 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:18.135 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:18.135 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:18.135 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.135 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:18.136 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:18.136 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:18.136 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.136 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding auth protocol: cephx 2024-09-12T00:50:18.136 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding auth protocol: cephx 2024-09-12T00:50:18.136 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding auth protocol: cephx 2024-09-12T00:50:18.136 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: secure 2024-09-12T00:50:18.136 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: crc 2024-09-12T00:50:18.136 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: secure 2024-09-12T00:50:18.136 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: crc 2024-09-12T00:50:18.136 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: secure 2024-09-12T00:50:18.136 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: crc 2024-09-12T00:50:18.137 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: crc 2024-09-12T00:50:18.137 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: secure 2024-09-12T00:50:18.137 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: crc 2024-09-12T00:50:18.137 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: secure 2024-09-12T00:50:18.137 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: crc 2024-09-12T00:50:18.137 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: secure 2024-09-12T00:50:18.137 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.137 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command objecter_requests cmddesc objecter_requests hook 0x55b9a39a5550 EEXIST 2024-09-12T00:50:18.137 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient: init 2024-09-12T00:50:18.137 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding auth protocol: cephx 2024-09-12T00:50:18.137 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding auth protocol: cephx 2024-09-12T00:50:18.137 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding auth protocol: cephx 2024-09-12T00:50:18.138 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: secure 2024-09-12T00:50:18.138 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: crc 2024-09-12T00:50:18.138 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: secure 2024-09-12T00:50:18.138 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: crc 2024-09-12T00:50:18.138 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: secure 2024-09-12T00:50:18.138 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: crc 2024-09-12T00:50:18.138 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: crc 2024-09-12T00:50:18.138 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: secure 2024-09-12T00:50:18.138 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: crc 2024-09-12T00:50:18.138 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: secure 2024-09-12T00:50:18.138 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: crc 2024-09-12T00:50:18.138 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: secure 2024-09-12T00:50:18.139 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.139 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.139 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command rotate-key cmddesc rotate-key hook 0x55b9a39a0330 EEXIST 2024-09-12T00:50:18.139 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:18.139 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:50:18.139 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-b con 0x55b9a39c9240 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:18.139 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-a con 0x55b9a39cb510 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:18.139 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-c con 0x55b9a39c7a10 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:18.139 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.139 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.139 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.139 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:18.139 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): authenticate will time out at 1904.148675s 2024-09-12T00:50:18.140 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request con 0x55b9a39cb510 auth_method 0 2024-09-12T00:50:18.140 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.140 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.140 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.140 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:50:17.655+0000 7f2ceef34640 10 monclient(hunting): get_auth_request con 0x55b9a39c7a10 auth_method 0 2024-09-12T00:50:18.140 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:50:17.655+0000 7f2ceef34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.140 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:50:17.655+0000 7f2ceef34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.140 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:50:17.655+0000 7f2ceef34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.140 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.140 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.140 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.140 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:50:17.655+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.141 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:50:17.655+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.141 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:50:17.655+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.141 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:50:17.655+0000 7f2cee733640 10 monclient(hunting): get_auth_request con 0x55b9a39c9240 auth_method 0 2024-09-12T00:50:18.141 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:50:17.655+0000 7f2cee733640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.141 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:50:17.655+0000 7f2cee733640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.141 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:50:17.655+0000 7f2cee733640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.141 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_done global_id 6387 payload 824 2024-09-12T00:50:18.141 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:50:17.656+0000 7f2ce7fff640 10 monclient: _finish_hunting 0 2024-09-12T00:50:18.141 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:50:17.656+0000 7f2ce7fff640 1 monclient: found mon.noname-a 2024-09-12T00:50:18.141 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:50:17.656+0000 7f2ce7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:50:18.141 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.141 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:18.141 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: dump: 2024-09-12T00:50:18.142 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.142 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.142 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.142 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.142 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.142 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.142 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.142 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.142 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.142 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.142 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: _finish_auth 0 2024-09-12T00:50:18.142 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: _check_auth_tickets 2024-09-12T00:50:18.142 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:18.143 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.143 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:18.143 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: dump: 2024-09-12T00:50:18.143 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.143 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.143 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.143 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.143 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.143 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.143 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.143 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.143 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.143 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.144 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:50:17.656+0000 7f2cf2b25800 5 monclient: authenticate success, global_id 6387 2024-09-12T00:50:18.144 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:50:17.656+0000 7f2cf2b25800 10 monclient: _renew_subs 2024-09-12T00:50:18.144 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:50:17.656+0000 7f2cf2b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:50:18.144 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:50:17.656+0000 7f2cef735640 4 set_mon_vals no callback set 2024-09-12T00:50:18.144 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:50:17.656+0000 7f2cf2b25800 10 monclient: _renew_subs 2024-09-12T00:50:18.144 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:50:17.656+0000 7f2cf2b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:50:18.144 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:50:17.658+0000 7f2bd3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:18.144 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:50:17.658+0000 7f2bd3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:18.144 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:50:17.658+0000 7f2bd3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:18.144 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:50:17.658+0000 7f2cee733640 10 monclient: get_auth_request con 0x7f2bc8076380 auth_method 0 2024-09-12T00:50:18.144 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 10 monclient: get_monmap_and_config 2024-09-12T00:50:18.144 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 10 monclient: build_initial_monmap 2024-09-12T00:50:18.145 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 1 build_initial for_mkfs: 0 2024-09-12T00:50:18.145 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 10 monclient: monmap: 2024-09-12T00:50:18.145 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:18.145 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:18.145 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:18.145 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:18.145 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:18.145 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.145 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:18.145 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:18.145 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:18.145 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.145 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding auth protocol: cephx 2024-09-12T00:50:18.146 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding auth protocol: cephx 2024-09-12T00:50:18.146 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding auth protocol: cephx 2024-09-12T00:50:18.146 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: secure 2024-09-12T00:50:18.146 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: crc 2024-09-12T00:50:18.146 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: secure 2024-09-12T00:50:18.146 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: crc 2024-09-12T00:50:18.146 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: secure 2024-09-12T00:50:18.146 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: crc 2024-09-12T00:50:18.146 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: crc 2024-09-12T00:50:18.146 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: secure 2024-09-12T00:50:18.146 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: crc 2024-09-12T00:50:18.146 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: secure 2024-09-12T00:50:18.147 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: crc 2024-09-12T00:50:18.147 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: secure 2024-09-12T00:50:18.147 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.147 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 10 monclient: init 2024-09-12T00:50:18.147 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding auth protocol: cephx 2024-09-12T00:50:18.147 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding auth protocol: cephx 2024-09-12T00:50:18.147 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding auth protocol: cephx 2024-09-12T00:50:18.147 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: secure 2024-09-12T00:50:18.147 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: crc 2024-09-12T00:50:18.147 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: secure 2024-09-12T00:50:18.147 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: crc 2024-09-12T00:50:18.147 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: secure 2024-09-12T00:50:18.147 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: crc 2024-09-12T00:50:18.148 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: crc 2024-09-12T00:50:18.148 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: secure 2024-09-12T00:50:18.148 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: crc 2024-09-12T00:50:18.148 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: secure 2024-09-12T00:50:18.148 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: crc 2024-09-12T00:50:18.148 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: secure 2024-09-12T00:50:18.148 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.148 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.148 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command rotate-key cmddesc rotate-key hook 0x7ffd6847a5f8 EEXIST 2024-09-12T00:50:18.148 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:18.148 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:50:18.148 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-c con 0x55b9a3a1d0f0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:18.148 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-b con 0x55b9a3a17690 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:18.149 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-a con 0x55b9a39ecf30 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:18.149 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.149 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.149 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.149 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:18.149 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): authenticate will time out at 1904.152447s 2024-09-12T00:50:18.149 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): get_auth_request con 0x55b9a3a1d0f0 auth_method 0 2024-09-12T00:50:18.149 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.149 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.149 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.149 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:50:17.659+0000 7f2ceef34640 10 monclient(hunting): get_auth_request con 0x55b9a39ecf30 auth_method 0 2024-09-12T00:50:18.149 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:50:17.659+0000 7f2ceef34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.150 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:50:17.659+0000 7f2ceef34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.150 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:50:17.659+0000 7f2ceef34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.150 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:50:17.659+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request con 0x55b9a3a17690 auth_method 0 2024-09-12T00:50:18.150 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:50:17.659+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.150 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:50:17.659+0000 7f2ce7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.150 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:50:17.659+0000 7f2ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.150 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.150 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.151 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.151 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:50:17.659+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.151 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:50:17.659+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.151 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:50:17.659+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.151 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:50:17.659+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.151 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:50:17.659+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.151 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:50:17.659+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.151 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): handle_auth_done global_id 6059 payload 274 2024-09-12T00:50:18.151 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient: _finish_hunting 0 2024-09-12T00:50:18.151 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:50:17.659+0000 7f2cee733640 1 monclient: found mon.noname-c 2024-09-12T00:50:18.151 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:50:18.151 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.151 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:18.152 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: dump: 2024-09-12T00:50:18.152 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.152 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.152 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.152 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.152 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.152 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.152 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.152 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.152 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.152 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.152 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: _finish_auth 0 2024-09-12T00:50:18.152 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:50:18.153 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:18.153 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.153 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:18.153 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: dump: 2024-09-12T00:50:18.153 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.153 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.153 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.153 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.153 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.153 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.153 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.153 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.154 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.154 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.154 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 monclient: authenticate success, global_id 6059 2024-09-12T00:50:18.154 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:18.154 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 4 set_mon_vals no callback set 2024-09-12T00:50:18.154 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 10 monclient: shutdown 2024-09-12T00:50:18.154 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 10 monclient: build_initial_monmap 2024-09-12T00:50:18.154 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 1 build_initial for_mkfs: 0 2024-09-12T00:50:18.154 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 10 monclient: monmap: 2024-09-12T00:50:18.154 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:18.154 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:18.154 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:18.154 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:18.155 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:18.155 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.155 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:18.155 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:18.155 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:18.155 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.155 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding auth protocol: cephx 2024-09-12T00:50:18.155 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding auth protocol: cephx 2024-09-12T00:50:18.155 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding auth protocol: cephx 2024-09-12T00:50:18.155 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: secure 2024-09-12T00:50:18.155 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: crc 2024-09-12T00:50:18.155 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: secure 2024-09-12T00:50:18.155 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: crc 2024-09-12T00:50:18.156 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: secure 2024-09-12T00:50:18.156 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: crc 2024-09-12T00:50:18.156 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: crc 2024-09-12T00:50:18.156 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: secure 2024-09-12T00:50:18.156 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: crc 2024-09-12T00:50:18.156 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: secure 2024-09-12T00:50:18.156 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: crc 2024-09-12T00:50:18.156 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: secure 2024-09-12T00:50:18.157 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.157 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 1 librados: starting msgr at 2024-09-12T00:50:18.157 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 1 librados: starting objecter 2024-09-12T00:50:18.157 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command objecter_requests cmddesc objecter_requests hook 0x55b9a39ee530 EEXIST 2024-09-12T00:50:18.157 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 1 librados: setting wanted keys 2024-09-12T00:50:18.157 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 1 librados: calling monclient init 2024-09-12T00:50:18.157 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient: init 2024-09-12T00:50:18.157 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding auth protocol: cephx 2024-09-12T00:50:18.157 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding auth protocol: cephx 2024-09-12T00:50:18.157 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding auth protocol: cephx 2024-09-12T00:50:18.157 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: secure 2024-09-12T00:50:18.157 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: crc 2024-09-12T00:50:18.157 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: secure 2024-09-12T00:50:18.158 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: crc 2024-09-12T00:50:18.158 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: secure 2024-09-12T00:50:18.158 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: crc 2024-09-12T00:50:18.158 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: crc 2024-09-12T00:50:18.158 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: secure 2024-09-12T00:50:18.158 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: crc 2024-09-12T00:50:18.158 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: secure 2024-09-12T00:50:18.158 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: crc 2024-09-12T00:50:18.158 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: secure 2024-09-12T00:50:18.158 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.158 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.158 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command rotate-key cmddesc rotate-key hook 0x55b9a39e1138 EEXIST 2024-09-12T00:50:18.158 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:18.158 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:50:18.159 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-c con 0x55b9a39ecf30 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:18.159 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-a con 0x55b9a3a17690 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:18.159 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-b con 0x55b9a3a1d0f0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:18.159 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.159 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.159 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.159 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:18.159 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): authenticate will time out at 1904.154768s 2024-09-12T00:50:18.159 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:50:17.661+0000 7f2cee733640 10 monclient(hunting): get_auth_request con 0x55b9a39ecf30 auth_method 0 2024-09-12T00:50:18.159 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:50:17.661+0000 7f2cee733640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.159 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:50:17.661+0000 7f2cee733640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.160 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:50:17.661+0000 7f2cee733640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.160 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:50:17.661+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request con 0x55b9a3a17690 auth_method 0 2024-09-12T00:50:18.160 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:50:17.661+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.160 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:50:17.661+0000 7f2ce7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.160 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:50:17.661+0000 7f2ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.160 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:50:17.661+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.160 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:50:17.661+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.160 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:50:17.661+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.160 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:50:17.661+0000 7f2ceef34640 10 monclient(hunting): get_auth_request con 0x55b9a3a1d0f0 auth_method 0 2024-09-12T00:50:18.160 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:50:17.661+0000 7f2ceef34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.160 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:50:17.661+0000 7f2ceef34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.160 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:50:17.661+0000 7f2ceef34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.160 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:50:17.661+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.161 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:50:17.661+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.161 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:50:17.661+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.161 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:50:17.662+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.161 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:50:17.662+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.161 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:50:17.662+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.161 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:50:17.662+0000 7f2cee733640 10 monclient(hunting): handle_auth_done global_id 6062 payload 824 2024-09-12T00:50:18.161 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:50:17.662+0000 7f2cee733640 10 monclient: _finish_hunting 0 2024-09-12T00:50:18.161 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:50:17.662+0000 7f2cee733640 1 monclient: found mon.noname-c 2024-09-12T00:50:18.161 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:50:17.662+0000 7f2cee733640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:50:18.161 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.161 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:18.161 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: dump: 2024-09-12T00:50:18.162 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.162 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.162 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.162 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.162 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.162 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.162 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.162 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.162 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.162 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.162 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: _finish_auth 0 2024-09-12T00:50:18.162 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: _check_auth_tickets 2024-09-12T00:50:18.162 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:18.163 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.163 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:18.163 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: dump: 2024-09-12T00:50:18.163 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.163 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.163 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.163 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.163 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.163 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.163 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.163 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.163 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.163 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.164 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:50:17.662+0000 7f2cf2b25800 5 monclient: authenticate success, global_id 6062 2024-09-12T00:50:18.164 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:50:17.662+0000 7f2cf2b25800 10 monclient: _renew_subs 2024-09-12T00:50:18.164 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:50:17.662+0000 7f2bd1ffb640 4 set_mon_vals no callback set 2024-09-12T00:50:18.164 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:50:17.662+0000 7f2cf2b25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:50:18.164 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:50:17.662+0000 7f2cf2b25800 10 monclient: _renew_subs 2024-09-12T00:50:18.164 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:50:17.662+0000 7f2cf2b25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:50:18.164 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:50:17.662+0000 7f2cf2b25800 1 librados: init done 2024-09-12T00:50:18.164 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:50:17.662+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command cr dump hook 0x55b9a3a27478 2024-09-12T00:50:18.164 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:50:17.664+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.164 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:50:17.664+0000 7f2bbffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:18.164 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:50:17.664+0000 7f2bbffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:18.164 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:50:17.664+0000 7f2bbffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:18.164 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:50:17.664+0000 7f2ce7fff640 10 monclient: get_auth_request con 0x7f2bb8076470 auth_method 0 2024-09-12T00:50:18.165 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:50:17.664+0000 7f2ceef34640 10 monclient: get_auth_request con 0x55b9a3a378f0 auth_method 0 2024-09-12T00:50:18.165 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:50:17.665+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.165 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:50:17.665+0000 7f2cf2b25800 20 realm 2024-09-12T00:50:18.165 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:50:17.665+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.165 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:50:17.665+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.165 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:50:17.665+0000 7f2cf2b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:18.165 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:50:17.665+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.165 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:50:17.666+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.165 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:50:17.666+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.165 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:50:17.666+0000 7f2cee733640 10 monclient: get_auth_request con 0x55b9a3a3bc40 auth_method 0 2024-09-12T00:50:18.165 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:50:17.666+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:18.165 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:50:17.666+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.166 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:50:17.666+0000 7f2ce7fff640 10 monclient: get_auth_request con 0x55b9a3a3f340 auth_method 0 2024-09-12T00:50:18.166 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:50:17.667+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:18.166 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:50:17.667+0000 7f2cf2b25800 20 searching for the correct realm 2024-09-12T00:50:18.166 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:50:17.667+0000 7f2ceef34640 10 monclient: get_auth_request con 0x55b9a3a44100 auth_method 0 2024-09-12T00:50:18.166 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:50:17.668+0000 7f2cee733640 10 monclient: get_auth_request con 0x7f2ce8064040 auth_method 0 2024-09-12T00:50:18.166 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:50:17.668+0000 7f2cee733640 0 -- 172.21.15.62:0/371980417 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7f2ce8064040 msgr2=0x7f2ce8055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:18.166 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:50:17.869+0000 7f2cee733640 10 monclient: get_auth_request con 0x7f2ce8064040 auth_method 0 2024-09-12T00:50:18.166 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:50:17.871+0000 7f2ce7fff640 10 monclient: get_auth_request con 0x7f2ce8074040 auth_method 0 2024-09-12T00:50:18.166 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:50:17.873+0000 7f2ceef34640 10 monclient: get_auth_request con 0x7f2ce0052020 auth_method 0 2024-09-12T00:50:18.166 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:50:17.873+0000 7f2ceef34640 0 -- 172.21.15.62:0/371980417 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7f2ce0052020 msgr2=0x7f2ce00a4a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:18.166 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:50:18.075+0000 7f2ceef34640 10 monclient: get_auth_request con 0x7f2ce0052020 auth_method 0 2024-09-12T00:50:18.166 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:50:18.075+0000 7f2cee733640 10 monclient: get_auth_request con 0x55b9a37f92d0 auth_method 0 2024-09-12T00:50:18.166 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:18.167 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:18.167 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:18.167 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:18.167 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:18.167 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:18.167 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.167 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.167 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.167 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:18.167 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.167 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:18.167 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 zone default found 2024-09-12T00:50:18.167 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 4 Realm: () 2024-09-12T00:50:18.168 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:18.168 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:18.168 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:18.168 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 zonegroup default 2024-09-12T00:50:18.168 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.168 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.168 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.168 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:50:18.084+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.168 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:50:18.084+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.168 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:50:18.084+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.168 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:50:18.084+0000 7f2cf2b25800 20 started sync module instance, tier type = 2024-09-12T00:50:18.168 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:50:18.084+0000 7f2cf2b25800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:18.169 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=0 2024-09-12T00:50:18.169 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=1 2024-09-12T00:50:18.169 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=2 2024-09-12T00:50:18.169 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=3 2024-09-12T00:50:18.169 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=4 2024-09-12T00:50:18.169 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=5 2024-09-12T00:50:18.169 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=6 2024-09-12T00:50:18.169 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:50:18.095+0000 7f2cf2b25800 20 add_watcher() i=7 2024-09-12T00:50:18.169 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:50:18.095+0000 7f2cf2b25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:18.169 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding auth protocol: cephx 2024-09-12T00:50:18.169 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding auth protocol: cephx 2024-09-12T00:50:18.169 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding auth protocol: cephx 2024-09-12T00:50:18.169 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: secure 2024-09-12T00:50:18.170 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: crc 2024-09-12T00:50:18.170 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: secure 2024-09-12T00:50:18.170 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: crc 2024-09-12T00:50:18.170 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: secure 2024-09-12T00:50:18.170 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: crc 2024-09-12T00:50:18.170 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: crc 2024-09-12T00:50:18.170 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:50:18.097+0000 7f2ba4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:18.170 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: secure 2024-09-12T00:50:18.170 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: crc 2024-09-12T00:50:18.170 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: secure 2024-09-12T00:50:18.170 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: crc 2024-09-12T00:50:18.170 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: secure 2024-09-12T00:50:18.170 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.171 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:18.171 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:18.171 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command cache list hook 0x55b9a39ea330 2024-09-12T00:50:18.171 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command cache inspect hook 0x55b9a39ea330 2024-09-12T00:50:18.171 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command cache erase hook 0x55b9a39ea330 2024-09-12T00:50:18.171 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command cache zap hook 0x55b9a39ea330 2024-09-12T00:50:18.171 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 note: GC not initialized 2024-09-12T00:50:18.171 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:50:18.098+0000 7f2b1f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:18.171 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command sync trace show hook 0x7f2ce000cba0 2024-09-12T00:50:18.171 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command sync trace history hook 0x7f2ce000cba0 2024-09-12T00:50:18.171 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command sync trace active hook 0x7f2ce000cba0 2024-09-12T00:50:18.171 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command sync trace active_short hook 0x7f2ce000cba0 2024-09-12T00:50:18.172 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:18.172 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 20 Filter name: none 2024-09-12T00:50:18.172 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:50:18.098+0000 7f2b1d7fa640 20 reqs_thread_entry: start 2024-09-12T00:50:18.172 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:50:18.172 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.172 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:50:18.099+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:50:18.172 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:50:18.099+0000 7f2cf2b25800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:50:18.172 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:50:18.099+0000 7f2cf2b25800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:50:18.172 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:50:18.099+0000 7f2cf2b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 : miss 2024-09-12T00:50:18.172 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:50:18.099+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.172 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:50:18.100+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:50:18.172 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:50:18.100+0000 7f2cf2b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 info.flags=0x17 2024-09-12T00:50:18.172 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:50:18.100+0000 7f2cf2b25800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 to cache LRU end 2024-09-12T00:50:18.173 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:50:18.100+0000 7f2cf2b25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:18.173 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:50:18.100+0000 7f2cf2b25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:18.173 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:50:18.100+0000 7f2cf2b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 2024-09-12T00:50:18.173 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:50:18.102+0000 7f2cf2b25800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2cf2b25800 time 2024-09-12T00:50:18.102728+0000 2024-09-12T00:50:18.173 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:18.173 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.173 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:18.173 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2cf418c71a] 2024-09-12T00:50:18.173 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2cf418c8d8] 2024-09-12T00:50:18.173 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9a2b3a641] 2024-09-12T00:50:18.173 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd877a4) [0x55b9a304c7a4] 2024-09-12T00:50:18.173 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b9a2b4a31d] 2024-09-12T00:50:18.174 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:50:18.174 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2cf2e29590] 2024-09-12T00:50:18.174 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:50:18.174 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:50:18.174 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.174 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:50:18.103+0000 7f2cf2b25800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:18.174 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f2cf2b25800 thread_name:radosgw-admin 2024-09-12T00:50:18.174 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.174 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:18.174 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2cf2e3e6f0] 2024-09-12T00:50:18.174 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2cf2e8b99c] 2024-09-12T00:50:18.174 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:50:18.174 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:50:18.175 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2cf418c774] 2024-09-12T00:50:18.175 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2cf418c8d8] 2024-09-12T00:50:18.175 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9a2b3a641] 2024-09-12T00:50:18.175 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd877a4) [0x55b9a304c7a4] 2024-09-12T00:50:18.175 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b9a2b4a31d] 2024-09-12T00:50:18.175 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:50:18.175 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2cf2e29590] 2024-09-12T00:50:18.175 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:50:18.175 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:50:18.175 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:18.175 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.175 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:50:18.176 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:50:18.176 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:50:18.176 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:50:18.176 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:50:18.176 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:50:18.176 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:18.176 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:50:18.176 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:50:18.176 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:18.176 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:18.176 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:18.176 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:50:18.176 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:50:18.177 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:50:18.177 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:50:18.177 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:50:18.177 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:50:18.177 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:50:18.177 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:18.177 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:18.177 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:18.177 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:50:18.177 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:50:18.177 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:18.177 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:50:18.177 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:50:18.178 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:50:18.178 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:50:18.178 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:50:18.178 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:50:18.178 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:50:18.178 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:50:18.178 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:50:18.178 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:50:18.178 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:50:18.178 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:50:18.178 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:50:18.178 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:50:18.178 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:50:18.178 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:18.179 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:50:18.179 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:50:18.179 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:18.179 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:18.179 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:50:18.179 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:18.179 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:18.179 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:18.179 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:50:18.179 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:50:18.179 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:50:18.179 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:50:18.179 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:50:18.180 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:50:18.180 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:50:18.180 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:50:18.180 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:50:18.180 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:50:18.180 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:50:18.180 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:50:18.180 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:50:18.180 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:50:18.180 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:50:18.180 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:50:18.180 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:50:18.180 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:50:18.180 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:18.181 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:18.181 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:18.181 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:50:18.181 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:18.181 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:18.181 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:18.181 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:18.181 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:50:18.181 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:18.181 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:18.181 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:18.181 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:18.181 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:18.181 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:18.182 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:50:18.182 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:18.182 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:50:18.182 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:50:18.182 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:50:18.182 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:18.182 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:50:18.182 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:50:18.182 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:18.182 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:18.182 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:18.182 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:18.182 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2b1d7fa640 / http_manager 2024-09-12T00:50:18.182 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2b1f7fe640 / http_manager 2024-09-12T00:50:18.183 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2ba4fe1640 / rgw_dt_lg_renew 2024-09-12T00:50:18.183 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2bbffff640 / ms_dispatch 2024-09-12T00:50:18.183 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2bd1ffb640 / io_context_pool 2024-09-12T00:50:18.183 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2bd3fff640 / ms_dispatch 2024-09-12T00:50:18.183 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2bdae05640 / ms_dispatch 2024-09-12T00:50:18.183 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2bdc608640 / io_context_pool 2024-09-12T00:50:18.183 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2ce7fff640 / msgr-worker-2 2024-09-12T00:50:18.183 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2cee733640 / msgr-worker-1 2024-09-12T00:50:18.183 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2ceef34640 / msgr-worker-0 2024-09-12T00:50:18.183 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2cef735640 / io_context_pool 2024-09-12T00:50:18.183 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2cf2b25800 / radosgw-admin 2024-09-12T00:50:18.183 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:50:18.183 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:50:18.183 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/log/ceph/ceph-client.admin.90426.log 2024-09-12T00:50:18.184 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:50:18.184 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:50:18.184 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:50:17.646+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.184 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:50:17.646+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_done global_id 6050 payload 274 2024-09-12T00:50:18.184 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:50:17.646+0000 7f2ce7fff640 10 monclient: _finish_hunting 0 2024-09-12T00:50:18.184 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:50:17.646+0000 7f2ce7fff640 1 monclient: found mon.noname-c 2024-09-12T00:50:18.184 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:50:17.646+0000 7f2ce7fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:50:18.184 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.184 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:18.184 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: dump: 2024-09-12T00:50:18.184 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.184 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.184 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.184 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.185 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.185 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.185 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.185 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.185 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.185 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.185 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: _finish_auth 0 2024-09-12T00:50:18.185 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: _check_auth_tickets 2024-09-12T00:50:18.185 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:18.185 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:50:17.646+0000 7f2cf2b25800 5 monclient: authenticate success, global_id 6050 2024-09-12T00:50:18.185 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:50:17.646+0000 7f2cf2b25800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:18.185 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:50:17.646+0000 7f2cf2b25800 4 set_mon_vals no callback set 2024-09-12T00:50:18.186 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.186 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:18.186 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:50:17.646+0000 7f2bdc608640 10 monclient: dump: 2024-09-12T00:50:18.186 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.186 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.186 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.186 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.186 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.186 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.186 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.186 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.186 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.187 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.187 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 10 monclient: shutdown 2024-09-12T00:50:18.187 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 asok(0x55b9a372c630) unregister_commands rotate-key 2024-09-12T00:50:18.187 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 10 monclient: build_initial_monmap 2024-09-12T00:50:18.187 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 1 build_initial for_mkfs: 0 2024-09-12T00:50:18.187 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 10 monclient: monmap: 2024-09-12T00:50:18.187 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:18.187 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:18.187 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:18.187 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:18.187 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:18.187 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.187 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:18.188 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:18.188 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:18.188 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.188 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding auth protocol: cephx 2024-09-12T00:50:18.188 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding auth protocol: cephx 2024-09-12T00:50:18.188 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding auth protocol: cephx 2024-09-12T00:50:18.188 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: secure 2024-09-12T00:50:18.188 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: crc 2024-09-12T00:50:18.188 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: secure 2024-09-12T00:50:18.188 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: crc 2024-09-12T00:50:18.188 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: secure 2024-09-12T00:50:18.188 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: crc 2024-09-12T00:50:18.188 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: crc 2024-09-12T00:50:18.189 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: secure 2024-09-12T00:50:18.189 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: crc 2024-09-12T00:50:18.189 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: secure 2024-09-12T00:50:18.189 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: crc 2024-09-12T00:50:18.189 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3952100) adding con mode: secure 2024-09-12T00:50:18.189 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.189 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 1 librados: starting msgr at 2024-09-12T00:50:18.189 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 1 librados: starting objecter 2024-09-12T00:50:18.189 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command objecter_requests hook 0x55b9a3976d40 2024-09-12T00:50:18.189 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 1 librados: setting wanted keys 2024-09-12T00:50:18.189 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 1 librados: calling monclient init 2024-09-12T00:50:18.189 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 10 monclient: init 2024-09-12T00:50:18.189 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding auth protocol: cephx 2024-09-12T00:50:18.190 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding auth protocol: cephx 2024-09-12T00:50:18.190 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding auth protocol: cephx 2024-09-12T00:50:18.190 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: secure 2024-09-12T00:50:18.190 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: crc 2024-09-12T00:50:18.190 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: secure 2024-09-12T00:50:18.190 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: crc 2024-09-12T00:50:18.190 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: secure 2024-09-12T00:50:18.190 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: crc 2024-09-12T00:50:18.190 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: crc 2024-09-12T00:50:18.190 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: secure 2024-09-12T00:50:18.190 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: crc 2024-09-12T00:50:18.190 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: secure 2024-09-12T00:50:18.190 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: crc 2024-09-12T00:50:18.191 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:50:17.647+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a394c440) adding con mode: secure 2024-09-12T00:50:18.191 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.191 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.191 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command rotate-key hook 0x55b9a394c588 2024-09-12T00:50:18.191 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:18.191 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:50:18.191 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-c con 0x55b9a3952d90 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:18.191 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-a con 0x55b9a3976740 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:18.191 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-b con 0x7f2cdc003ab0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:18.191 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.191 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.191 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.191 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:18.192 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:50:17.648+0000 7f2cf2b25800 10 monclient(hunting): authenticate will time out at 1904.141497s 2024-09-12T00:50:18.192 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:50:17.648+0000 7f2cee733640 10 monclient(hunting): get_auth_request con 0x55b9a3952d90 auth_method 0 2024-09-12T00:50:18.192 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:50:17.648+0000 7f2cee733640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.192 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:50:17.648+0000 7f2cee733640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.192 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:50:17.648+0000 7f2cee733640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.192 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request con 0x55b9a3976740 auth_method 0 2024-09-12T00:50:18.192 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.192 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.192 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.192 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:50:17.648+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.192 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:50:17.648+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.192 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:50:17.648+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.193 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.193 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.193 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.193 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:50:17.648+0000 7f2ceef34640 10 monclient(hunting): get_auth_request con 0x7f2cdc003ab0 auth_method 0 2024-09-12T00:50:18.193 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:50:17.648+0000 7f2ceef34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.193 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:50:17.648+0000 7f2ceef34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.193 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:50:17.648+0000 7f2ceef34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.193 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_done global_id 6384 payload 824 2024-09-12T00:50:18.193 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient: _finish_hunting 0 2024-09-12T00:50:18.193 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 1 monclient: found mon.noname-a 2024-09-12T00:50:18.193 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:50:17.648+0000 7f2ce7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:50:18.193 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.193 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:18.194 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: dump: 2024-09-12T00:50:18.194 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.194 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.194 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.194 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.194 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.194 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.194 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.194 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.194 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.194 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.194 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: _finish_auth 0 2024-09-12T00:50:18.195 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: _check_auth_tickets 2024-09-12T00:50:18.195 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:18.195 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.195 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:18.195 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:50:17.649+0000 7f2bdae05640 10 monclient: dump: 2024-09-12T00:50:18.195 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.195 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.195 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.195 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.195 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.195 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.195 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.195 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.196 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.196 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.196 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:50:17.649+0000 7f2cf2b25800 5 monclient: authenticate success, global_id 6384 2024-09-12T00:50:18.196 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:50:17.649+0000 7f2cf2b25800 10 monclient: _renew_subs 2024-09-12T00:50:18.196 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:50:17.649+0000 7f2bdc608640 4 set_mon_vals no callback set 2024-09-12T00:50:18.196 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:50:17.649+0000 7f2cf2b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:50:18.196 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:50:17.649+0000 7f2cf2b25800 10 monclient: _renew_subs 2024-09-12T00:50:18.196 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:50:17.649+0000 7f2cf2b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:50:18.196 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:50:17.649+0000 7f2cf2b25800 1 librados: init done 2024-09-12T00:50:18.196 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:50:17.651+0000 7f2bdae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:18.196 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:50:17.651+0000 7f2bdae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:18.196 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:50:17.651+0000 7f2bdae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:18.196 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:50:17.651+0000 7f2cee733640 10 monclient: get_auth_request con 0x7f2bd4076470 auth_method 0 2024-09-12T00:50:18.197 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:50:17.651+0000 7f2ceef34640 10 monclient: get_auth_request con 0x55b9a3995a40 auth_method 0 2024-09-12T00:50:18.197 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:50:17.652+0000 7f2cee733640 10 monclient: get_auth_request con 0x55b9a3998880 auth_method 0 2024-09-12T00:50:18.197 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:50:17.653+0000 7f2ce7fff640 10 monclient: get_auth_request con 0x55b9a399cc70 auth_method 0 2024-09-12T00:50:18.197 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 10 monclient: build_initial_monmap 2024-09-12T00:50:18.197 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 1 build_initial for_mkfs: 0 2024-09-12T00:50:18.197 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 10 monclient: monmap: 2024-09-12T00:50:18.197 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:18.197 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:18.197 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:18.197 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:18.197 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:18.197 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.198 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:18.198 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:18.198 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:18.198 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.198 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding auth protocol: cephx 2024-09-12T00:50:18.198 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding auth protocol: cephx 2024-09-12T00:50:18.198 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding auth protocol: cephx 2024-09-12T00:50:18.198 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: secure 2024-09-12T00:50:18.198 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: crc 2024-09-12T00:50:18.198 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: secure 2024-09-12T00:50:18.198 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: crc 2024-09-12T00:50:18.198 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: secure 2024-09-12T00:50:18.198 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: crc 2024-09-12T00:50:18.199 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: crc 2024-09-12T00:50:18.199 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: secure 2024-09-12T00:50:18.199 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: crc 2024-09-12T00:50:18.199 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: secure 2024-09-12T00:50:18.199 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: crc 2024-09-12T00:50:18.199 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a1b70) adding con mode: secure 2024-09-12T00:50:18.199 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:50:17.654+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.199 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command objecter_requests cmddesc objecter_requests hook 0x55b9a39a5550 EEXIST 2024-09-12T00:50:18.199 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient: init 2024-09-12T00:50:18.199 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding auth protocol: cephx 2024-09-12T00:50:18.199 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding auth protocol: cephx 2024-09-12T00:50:18.199 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding auth protocol: cephx 2024-09-12T00:50:18.200 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: secure 2024-09-12T00:50:18.200 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: crc 2024-09-12T00:50:18.200 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: secure 2024-09-12T00:50:18.200 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: crc 2024-09-12T00:50:18.200 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: secure 2024-09-12T00:50:18.200 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: crc 2024-09-12T00:50:18.200 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: crc 2024-09-12T00:50:18.200 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: secure 2024-09-12T00:50:18.200 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: crc 2024-09-12T00:50:18.200 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: secure 2024-09-12T00:50:18.200 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: crc 2024-09-12T00:50:18.200 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39a01e8) adding con mode: secure 2024-09-12T00:50:18.201 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.201 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.201 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command rotate-key cmddesc rotate-key hook 0x55b9a39a0330 EEXIST 2024-09-12T00:50:18.201 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:18.201 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:50:18.201 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-b con 0x55b9a39c9240 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:18.201 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-a con 0x55b9a39cb510 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:18.201 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-c con 0x55b9a39c7a10 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:18.201 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.201 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.201 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.201 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:18.201 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:50:17.655+0000 7f2cf2b25800 10 monclient(hunting): authenticate will time out at 1904.148675s 2024-09-12T00:50:18.202 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request con 0x55b9a39cb510 auth_method 0 2024-09-12T00:50:18.202 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.202 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.202 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.202 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:50:17.655+0000 7f2ceef34640 10 monclient(hunting): get_auth_request con 0x55b9a39c7a10 auth_method 0 2024-09-12T00:50:18.202 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:50:17.655+0000 7f2ceef34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.202 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:50:17.655+0000 7f2ceef34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.202 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:50:17.655+0000 7f2ceef34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.202 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.202 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.202 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.202 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:50:17.655+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.203 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:50:17.655+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.203 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:50:17.655+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.203 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:50:17.655+0000 7f2cee733640 10 monclient(hunting): get_auth_request con 0x55b9a39c9240 auth_method 0 2024-09-12T00:50:18.203 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:50:17.655+0000 7f2cee733640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.203 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:50:17.655+0000 7f2cee733640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.203 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:50:17.655+0000 7f2cee733640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.203 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:50:17.655+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_done global_id 6387 payload 824 2024-09-12T00:50:18.203 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:50:17.656+0000 7f2ce7fff640 10 monclient: _finish_hunting 0 2024-09-12T00:50:18.203 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:50:17.656+0000 7f2ce7fff640 1 monclient: found mon.noname-a 2024-09-12T00:50:18.203 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:50:17.656+0000 7f2ce7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:50:18.203 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.203 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:18.204 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: dump: 2024-09-12T00:50:18.204 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.204 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.204 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.204 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.204 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.204 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.204 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.204 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.204 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.204 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.204 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: _finish_auth 0 2024-09-12T00:50:18.205 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: _check_auth_tickets 2024-09-12T00:50:18.205 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:18.205 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.205 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:18.205 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:50:17.656+0000 7f2bd3fff640 10 monclient: dump: 2024-09-12T00:50:18.205 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.205 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.205 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.205 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.205 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.205 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.205 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.206 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.206 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.206 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.206 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:50:17.656+0000 7f2cf2b25800 5 monclient: authenticate success, global_id 6387 2024-09-12T00:50:18.206 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:50:17.656+0000 7f2cf2b25800 10 monclient: _renew_subs 2024-09-12T00:50:18.206 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:50:17.656+0000 7f2cf2b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:50:18.206 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:50:17.656+0000 7f2cef735640 4 set_mon_vals no callback set 2024-09-12T00:50:18.206 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:50:17.656+0000 7f2cf2b25800 10 monclient: _renew_subs 2024-09-12T00:50:18.206 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:50:17.656+0000 7f2cf2b25800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:50:18.206 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:50:17.658+0000 7f2bd3fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:18.206 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:50:17.658+0000 7f2bd3fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:18.206 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:50:17.658+0000 7f2bd3fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:18.206 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:50:17.658+0000 7f2cee733640 10 monclient: get_auth_request con 0x7f2bc8076380 auth_method 0 2024-09-12T00:50:18.207 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 10 monclient: get_monmap_and_config 2024-09-12T00:50:18.207 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 10 monclient: build_initial_monmap 2024-09-12T00:50:18.207 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 1 build_initial for_mkfs: 0 2024-09-12T00:50:18.207 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 10 monclient: monmap: 2024-09-12T00:50:18.207 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:18.207 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:18.207 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:18.207 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:18.207 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:18.207 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.207 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:18.207 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:18.207 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:18.208 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.208 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding auth protocol: cephx 2024-09-12T00:50:18.208 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding auth protocol: cephx 2024-09-12T00:50:18.208 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding auth protocol: cephx 2024-09-12T00:50:18.208 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: secure 2024-09-12T00:50:18.208 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: crc 2024-09-12T00:50:18.208 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: secure 2024-09-12T00:50:18.208 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: crc 2024-09-12T00:50:18.208 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: secure 2024-09-12T00:50:18.208 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: crc 2024-09-12T00:50:18.208 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: crc 2024-09-12T00:50:18.208 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: secure 2024-09-12T00:50:18.208 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: crc 2024-09-12T00:50:18.209 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: secure 2024-09-12T00:50:18.209 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: crc 2024-09-12T00:50:18.209 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e8bd0) adding con mode: secure 2024-09-12T00:50:18.209 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.209 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 10 monclient: init 2024-09-12T00:50:18.209 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding auth protocol: cephx 2024-09-12T00:50:18.209 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding auth protocol: cephx 2024-09-12T00:50:18.209 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding auth protocol: cephx 2024-09-12T00:50:18.209 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: secure 2024-09-12T00:50:18.209 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: crc 2024-09-12T00:50:18.209 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: secure 2024-09-12T00:50:18.209 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: crc 2024-09-12T00:50:18.210 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: secure 2024-09-12T00:50:18.210 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: crc 2024-09-12T00:50:18.210 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: crc 2024-09-12T00:50:18.210 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: secure 2024-09-12T00:50:18.210 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: crc 2024-09-12T00:50:18.210 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: secure 2024-09-12T00:50:18.210 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: crc 2024-09-12T00:50:18.210 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:50:17.658+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a4b0) adding con mode: secure 2024-09-12T00:50:18.210 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.210 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.210 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command rotate-key cmddesc rotate-key hook 0x7ffd6847a5f8 EEXIST 2024-09-12T00:50:18.210 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:18.210 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:50:18.211 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-c con 0x55b9a3a1d0f0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:18.211 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-b con 0x55b9a3a17690 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:18.211 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-a con 0x55b9a39ecf30 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:18.211 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.211 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.211 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.211 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:18.211 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:50:17.659+0000 7f2cf2b25800 10 monclient(hunting): authenticate will time out at 1904.152447s 2024-09-12T00:50:18.211 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): get_auth_request con 0x55b9a3a1d0f0 auth_method 0 2024-09-12T00:50:18.211 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.211 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.211 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.211 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:50:17.659+0000 7f2ceef34640 10 monclient(hunting): get_auth_request con 0x55b9a39ecf30 auth_method 0 2024-09-12T00:50:18.212 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:50:17.659+0000 7f2ceef34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.212 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:50:17.659+0000 7f2ceef34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.212 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:50:17.659+0000 7f2ceef34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.212 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:50:17.659+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request con 0x55b9a3a17690 auth_method 0 2024-09-12T00:50:18.212 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:50:17.659+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.212 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:50:17.659+0000 7f2ce7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.212 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:50:17.659+0000 7f2ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.212 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.212 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.212 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.212 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:50:17.659+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.212 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:50:17.659+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.213 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:50:17.659+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.213 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:50:17.659+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.213 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:50:17.659+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.213 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:50:17.659+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.213 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient(hunting): handle_auth_done global_id 6059 payload 274 2024-09-12T00:50:18.213 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient: _finish_hunting 0 2024-09-12T00:50:18.213 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:50:17.659+0000 7f2cee733640 1 monclient: found mon.noname-c 2024-09-12T00:50:18.213 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:50:17.659+0000 7f2cee733640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:50:18.213 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.213 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:18.213 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: dump: 2024-09-12T00:50:18.213 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.213 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.214 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.214 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.214 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.214 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.214 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.214 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.214 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.214 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.214 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: _finish_auth 0 2024-09-12T00:50:18.214 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:50:18.214 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:18.214 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.214 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:18.215 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:50:17.660+0000 7f2bd1ffb640 10 monclient: dump: 2024-09-12T00:50:18.215 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.215 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.215 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.215 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.215 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.215 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.215 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.215 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.215 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.215 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.215 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 monclient: authenticate success, global_id 6059 2024-09-12T00:50:18.215 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:18.216 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 4 set_mon_vals no callback set 2024-09-12T00:50:18.216 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 10 monclient: shutdown 2024-09-12T00:50:18.216 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 10 monclient: build_initial_monmap 2024-09-12T00:50:18.216 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 1 build_initial for_mkfs: 0 2024-09-12T00:50:18.216 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 10 monclient: monmap: 2024-09-12T00:50:18.216 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:18.216 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:18.216 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:18.216 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:18.216 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:18.216 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.216 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:18.216 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:18.217 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:18.217 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.217 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding auth protocol: cephx 2024-09-12T00:50:18.217 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding auth protocol: cephx 2024-09-12T00:50:18.217 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding auth protocol: cephx 2024-09-12T00:50:18.217 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: secure 2024-09-12T00:50:18.217 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: crc 2024-09-12T00:50:18.217 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: secure 2024-09-12T00:50:18.217 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: crc 2024-09-12T00:50:18.217 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: secure 2024-09-12T00:50:18.217 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: crc 2024-09-12T00:50:18.217 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: crc 2024-09-12T00:50:18.218 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: secure 2024-09-12T00:50:18.218 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: crc 2024-09-12T00:50:18.218 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: secure 2024-09-12T00:50:18.218 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: crc 2024-09-12T00:50:18.218 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:50:17.660+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a3a18650) adding con mode: secure 2024-09-12T00:50:18.218 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.218 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 1 librados: starting msgr at 2024-09-12T00:50:18.218 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 1 librados: starting objecter 2024-09-12T00:50:18.218 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command objecter_requests cmddesc objecter_requests hook 0x55b9a39ee530 EEXIST 2024-09-12T00:50:18.218 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 1 librados: setting wanted keys 2024-09-12T00:50:18.218 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 1 librados: calling monclient init 2024-09-12T00:50:18.218 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient: init 2024-09-12T00:50:18.218 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding auth protocol: cephx 2024-09-12T00:50:18.218 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding auth protocol: cephx 2024-09-12T00:50:18.219 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding auth protocol: cephx 2024-09-12T00:50:18.219 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: secure 2024-09-12T00:50:18.219 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: crc 2024-09-12T00:50:18.219 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: secure 2024-09-12T00:50:18.219 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: crc 2024-09-12T00:50:18.219 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: secure 2024-09-12T00:50:18.219 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: crc 2024-09-12T00:50:18.219 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: crc 2024-09-12T00:50:18.219 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: secure 2024-09-12T00:50:18.219 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: crc 2024-09-12T00:50:18.219 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: secure 2024-09-12T00:50:18.219 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: crc 2024-09-12T00:50:18.220 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 AuthRegistry(0x55b9a39e0ff0) adding con mode: secure 2024-09-12T00:50:18.220 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.220 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.220 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command rotate-key cmddesc rotate-key hook 0x55b9a39e1138 EEXIST 2024-09-12T00:50:18.220 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:18.220 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:50:18.220 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-c con 0x55b9a39ecf30 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:18.220 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-a con 0x55b9a3a17690 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:18.220 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): picked mon.noname-b con 0x55b9a3a1d0f0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:18.220 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.220 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.220 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:18.220 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:18.220 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:50:17.661+0000 7f2cf2b25800 10 monclient(hunting): authenticate will time out at 1904.154768s 2024-09-12T00:50:18.221 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:50:17.661+0000 7f2cee733640 10 monclient(hunting): get_auth_request con 0x55b9a39ecf30 auth_method 0 2024-09-12T00:50:18.221 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:50:17.661+0000 7f2cee733640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.221 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:50:17.661+0000 7f2cee733640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.221 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:50:17.661+0000 7f2cee733640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.221 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:50:17.661+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request con 0x55b9a3a17690 auth_method 0 2024-09-12T00:50:18.221 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:50:17.661+0000 7f2ce7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.221 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:50:17.661+0000 7f2ce7fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.221 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:50:17.661+0000 7f2ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.221 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:50:17.661+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.221 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:50:17.661+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.221 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:50:17.661+0000 7f2cee733640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.221 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:50:17.661+0000 7f2ceef34640 10 monclient(hunting): get_auth_request con 0x55b9a3a1d0f0 auth_method 0 2024-09-12T00:50:18.222 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:50:17.661+0000 7f2ceef34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:18.222 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:50:17.661+0000 7f2ceef34640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:18.222 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:50:17.661+0000 7f2ceef34640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:18.222 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:50:17.661+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.222 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:50:17.661+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.222 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:50:17.661+0000 7f2ce7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.222 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:50:17.662+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:18.222 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:50:17.662+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:18.222 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:50:17.662+0000 7f2ceef34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:18.222 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:50:17.662+0000 7f2cee733640 10 monclient(hunting): handle_auth_done global_id 6062 payload 824 2024-09-12T00:50:18.222 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:50:17.662+0000 7f2cee733640 10 monclient: _finish_hunting 0 2024-09-12T00:50:18.223 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:50:17.662+0000 7f2cee733640 1 monclient: found mon.noname-c 2024-09-12T00:50:18.223 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:50:17.662+0000 7f2cee733640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:50:18.223 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.223 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:18.223 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: dump: 2024-09-12T00:50:18.223 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.223 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.223 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.223 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.223 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.223 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.223 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.224 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.224 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.224 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.224 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: _finish_auth 0 2024-09-12T00:50:18.224 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: _check_auth_tickets 2024-09-12T00:50:18.224 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:18.224 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:18.224 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:18.224 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:50:17.662+0000 7f2bbffff640 10 monclient: dump: 2024-09-12T00:50:18.224 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:18.224 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:18.224 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.224 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:18.225 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:18.225 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:18.225 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:18.225 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:18.225 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:18.225 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.225 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:50:17.662+0000 7f2cf2b25800 5 monclient: authenticate success, global_id 6062 2024-09-12T00:50:18.225 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:50:17.662+0000 7f2cf2b25800 10 monclient: _renew_subs 2024-09-12T00:50:18.225 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:50:17.662+0000 7f2bd1ffb640 4 set_mon_vals no callback set 2024-09-12T00:50:18.225 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:50:17.662+0000 7f2cf2b25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:50:18.225 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:50:17.662+0000 7f2cf2b25800 10 monclient: _renew_subs 2024-09-12T00:50:18.226 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:50:17.662+0000 7f2cf2b25800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:50:18.226 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:50:17.662+0000 7f2cf2b25800 1 librados: init done 2024-09-12T00:50:18.226 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:50:17.662+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command cr dump hook 0x55b9a3a27478 2024-09-12T00:50:18.226 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:50:17.664+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.226 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:50:17.664+0000 7f2bbffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:18.226 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:50:17.664+0000 7f2bbffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:18.226 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:50:17.664+0000 7f2bbffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:18.226 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:50:17.664+0000 7f2ce7fff640 10 monclient: get_auth_request con 0x7f2bb8076470 auth_method 0 2024-09-12T00:50:18.226 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:50:17.664+0000 7f2ceef34640 10 monclient: get_auth_request con 0x55b9a3a378f0 auth_method 0 2024-09-12T00:50:18.226 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:50:17.665+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.226 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:50:17.665+0000 7f2cf2b25800 20 realm 2024-09-12T00:50:18.226 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:50:17.665+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.226 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:50:17.665+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.227 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:50:17.665+0000 7f2cf2b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:18.227 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:50:17.665+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.227 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:50:17.666+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.227 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:50:17.666+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.227 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:50:17.666+0000 7f2cee733640 10 monclient: get_auth_request con 0x55b9a3a3bc40 auth_method 0 2024-09-12T00:50:18.227 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:50:17.666+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:18.227 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:50:17.666+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.227 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:50:17.666+0000 7f2ce7fff640 10 monclient: get_auth_request con 0x55b9a3a3f340 auth_method 0 2024-09-12T00:50:18.227 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:50:17.667+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:18.227 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:50:17.667+0000 7f2cf2b25800 20 searching for the correct realm 2024-09-12T00:50:18.227 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:50:17.667+0000 7f2ceef34640 10 monclient: get_auth_request con 0x55b9a3a44100 auth_method 0 2024-09-12T00:50:18.227 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:50:17.668+0000 7f2cee733640 10 monclient: get_auth_request con 0x7f2ce8064040 auth_method 0 2024-09-12T00:50:18.228 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:50:17.668+0000 7f2cee733640 0 -- 172.21.15.62:0/371980417 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7f2ce8064040 msgr2=0x7f2ce8055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:18.228 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:50:17.869+0000 7f2cee733640 10 monclient: get_auth_request con 0x7f2ce8064040 auth_method 0 2024-09-12T00:50:18.228 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:50:17.871+0000 7f2ce7fff640 10 monclient: get_auth_request con 0x7f2ce8074040 auth_method 0 2024-09-12T00:50:18.228 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:50:17.873+0000 7f2ceef34640 10 monclient: get_auth_request con 0x7f2ce0052020 auth_method 0 2024-09-12T00:50:18.228 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:50:17.873+0000 7f2ceef34640 0 -- 172.21.15.62:0/371980417 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7f2ce0052020 msgr2=0x7f2ce00a4a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:18.228 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:50:18.075+0000 7f2ceef34640 10 monclient: get_auth_request con 0x7f2ce0052020 auth_method 0 2024-09-12T00:50:18.228 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:50:18.075+0000 7f2cee733640 10 monclient: get_auth_request con 0x55b9a37f92d0 auth_method 0 2024-09-12T00:50:18.228 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:18.228 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:18.228 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:18.228 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:18.228 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:18.228 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:18.229 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.229 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.229 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.229 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:18.229 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:50:18.082+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.229 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:18.229 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 zone default found 2024-09-12T00:50:18.229 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 4 Realm: () 2024-09-12T00:50:18.229 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:18.229 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:18.229 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:18.229 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 zonegroup default 2024-09-12T00:50:18.229 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.230 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.230 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:50:18.083+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.230 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:50:18.084+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.230 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:50:18.084+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.230 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:50:18.084+0000 7f2cf2b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.230 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:50:18.084+0000 7f2cf2b25800 20 started sync module instance, tier type = 2024-09-12T00:50:18.230 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:50:18.084+0000 7f2cf2b25800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:18.230 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=0 2024-09-12T00:50:18.230 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=1 2024-09-12T00:50:18.230 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=2 2024-09-12T00:50:18.230 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=3 2024-09-12T00:50:18.230 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=4 2024-09-12T00:50:18.230 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=5 2024-09-12T00:50:18.231 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:50:18.094+0000 7f2cf2b25800 20 add_watcher() i=6 2024-09-12T00:50:18.231 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:50:18.095+0000 7f2cf2b25800 20 add_watcher() i=7 2024-09-12T00:50:18.231 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:50:18.095+0000 7f2cf2b25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:18.231 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding auth protocol: cephx 2024-09-12T00:50:18.231 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding auth protocol: cephx 2024-09-12T00:50:18.231 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding auth protocol: cephx 2024-09-12T00:50:18.231 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: secure 2024-09-12T00:50:18.231 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: crc 2024-09-12T00:50:18.231 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: secure 2024-09-12T00:50:18.231 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: crc 2024-09-12T00:50:18.231 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: secure 2024-09-12T00:50:18.231 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: crc 2024-09-12T00:50:18.231 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: crc 2024-09-12T00:50:18.232 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:50:18.097+0000 7f2ba4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:18.232 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: secure 2024-09-12T00:50:18.232 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: crc 2024-09-12T00:50:18.232 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: secure 2024-09-12T00:50:18.232 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: crc 2024-09-12T00:50:18.232 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:50:18.097+0000 7f2cf2b25800 5 AuthRegistry(0x7ffd6847a990) adding con mode: secure 2024-09-12T00:50:18.232 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:18.232 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:18.232 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:18.232 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command cache list hook 0x55b9a39ea330 2024-09-12T00:50:18.232 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command cache inspect hook 0x55b9a39ea330 2024-09-12T00:50:18.232 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command cache erase hook 0x55b9a39ea330 2024-09-12T00:50:18.233 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command cache zap hook 0x55b9a39ea330 2024-09-12T00:50:18.233 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 note: GC not initialized 2024-09-12T00:50:18.233 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:50:18.098+0000 7f2b1f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:18.233 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command sync trace show hook 0x7f2ce000cba0 2024-09-12T00:50:18.233 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command sync trace history hook 0x7f2ce000cba0 2024-09-12T00:50:18.233 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command sync trace active hook 0x7f2ce000cba0 2024-09-12T00:50:18.233 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 5 asok(0x55b9a372c630) register_command sync trace active_short hook 0x7f2ce000cba0 2024-09-12T00:50:18.233 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:18.233 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 20 Filter name: none 2024-09-12T00:50:18.233 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:50:18.098+0000 7f2b1d7fa640 20 reqs_thread_entry: start 2024-09-12T00:50:18.233 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:50:18.233 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:50:18.098+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.233 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:50:18.099+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:50:18.234 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:50:18.099+0000 7f2cf2b25800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:50:18.234 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:50:18.099+0000 7f2cf2b25800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:50:18.234 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:50:18.099+0000 7f2cf2b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 : miss 2024-09-12T00:50:18.234 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:50:18.099+0000 7f2cf2b25800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.234 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:50:18.100+0000 7f2cf2b25800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:50:18.234 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:50:18.100+0000 7f2cf2b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 info.flags=0x17 2024-09-12T00:50:18.234 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:50:18.100+0000 7f2cf2b25800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 to cache LRU end 2024-09-12T00:50:18.234 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:50:18.100+0000 7f2cf2b25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:18.234 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:50:18.100+0000 7f2cf2b25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:18.234 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:50:18.100+0000 7f2cf2b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 2024-09-12T00:50:18.234 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:50:18.102+0000 7f2cf2b25800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2cf2b25800 time 2024-09-12T00:50:18.102728+0000 2024-09-12T00:50:18.234 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:18.234 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.235 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:18.235 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f2cf418c71a] 2024-09-12T00:50:18.235 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2cf418c8d8] 2024-09-12T00:50:18.235 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9a2b3a641] 2024-09-12T00:50:18.235 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd877a4) [0x55b9a304c7a4] 2024-09-12T00:50:18.235 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b9a2b4a31d] 2024-09-12T00:50:18.235 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:50:18.235 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f2cf2e29590] 2024-09-12T00:50:18.235 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:50:18.235 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:50:18.235 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.235 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:50:18.103+0000 7f2cf2b25800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:18.236 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f2cf2b25800 thread_name:radosgw-admin 2024-09-12T00:50:18.236 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.236 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:18.236 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f2cf2e3e6f0] 2024-09-12T00:50:18.236 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f2cf2e8b99c] 2024-09-12T00:50:18.236 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:50:18.236 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:50:18.236 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f2cf418c774] 2024-09-12T00:50:18.236 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f2cf418c8d8] 2024-09-12T00:50:18.236 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b9a2b3a641] 2024-09-12T00:50:18.236 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd877a4) [0x55b9a304c7a4] 2024-09-12T00:50:18.236 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b9a2b4a31d] 2024-09-12T00:50:18.236 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:50:18.237 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f2cf2e29590] 2024-09-12T00:50:18.237 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:50:18.237 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:50:18.237 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:18.237 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.237 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:50:18.237 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:50:18.237 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:50:18.237 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:50:18.237 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:50:18.237 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:50:18.237 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:18.237 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:50:18.238 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:50:18.238 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:18.238 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:18.238 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:18.238 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:50:18.238 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:50:18.238 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:50:18.238 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:50:18.238 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:50:18.238 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:50:18.238 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:50:18.238 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:18.238 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:18.238 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:18.239 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:50:18.239 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:50:18.239 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:18.239 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:50:18.239 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:50:18.239 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:50:18.239 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:50:18.239 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:50:18.239 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:50:18.239 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:50:18.239 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:50:18.239 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:50:18.239 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:50:18.240 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:50:18.240 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:50:18.240 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:50:18.240 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:50:18.240 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:50:18.240 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:18.240 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:50:18.240 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:50:18.240 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:18.240 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:18.240 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:50:18.240 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:18.240 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:18.241 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:18.241 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:50:18.241 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:50:18.241 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:50:18.241 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:50:18.241 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:50:18.241 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:50:18.241 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:50:18.241 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:50:18.241 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:50:18.241 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:50:18.241 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:50:18.241 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:50:18.242 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:50:18.242 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:50:18.242 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:50:18.242 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:50:18.242 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:50:18.242 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:50:18.242 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:18.242 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:18.242 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:18.242 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:50:18.242 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:18.242 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:18.242 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:18.242 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:18.243 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:50:18.243 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:18.243 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:18.243 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:18.243 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:18.243 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:18.243 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:18.243 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:50:18.243 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:18.243 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:50:18.243 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:50:18.243 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:50:18.243 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:18.244 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:50:18.244 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:50:18.244 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:18.244 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:18.244 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:18.244 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:18.244 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2b1d7fa640 / http_manager 2024-09-12T00:50:18.244 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2b1f7fe640 / http_manager 2024-09-12T00:50:18.244 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2ba4fe1640 / rgw_dt_lg_renew 2024-09-12T00:50:18.244 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2bbffff640 / ms_dispatch 2024-09-12T00:50:18.244 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2bd1ffb640 / io_context_pool 2024-09-12T00:50:18.244 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2bd3fff640 / ms_dispatch 2024-09-12T00:50:18.244 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2bdae05640 / ms_dispatch 2024-09-12T00:50:18.245 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2bdc608640 / io_context_pool 2024-09-12T00:50:18.245 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2ce7fff640 / msgr-worker-2 2024-09-12T00:50:18.245 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2cee733640 / msgr-worker-1 2024-09-12T00:50:18.245 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2ceef34640 / msgr-worker-0 2024-09-12T00:50:18.245 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2cef735640 / io_context_pool 2024-09-12T00:50:18.245 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2cf2b25800 / radosgw-admin 2024-09-12T00:50:18.245 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:50:18.245 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:50:18.245 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:50:18.104419Z_443a1b85-220d-4787-bc70-7af169eae40e/log 2024-09-12T00:50:18.245 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:50:18.245 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:50:18.250 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:18.250 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:18.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.185+0000 7fa3e300f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.187+0000 7fa3e300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.187+0000 7fa3e300f800 20 realm 2024-09-12T00:50:18.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.187+0000 7fa3e300f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.187+0000 7fa3e300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.187+0000 7fa3e300f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:18.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.187+0000 7fa3e300f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.187+0000 7fa3e300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.187+0000 7fa3e300f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.188+0000 7fa3e300f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:18.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.188+0000 7fa3e300f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.188+0000 7fa3e300f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:18.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.189+0000 7fa3e300f800 20 searching for the correct realm 2024-09-12T00:50:18.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.192+0000 7fa3ddf47640 0 -- 172.21.15.62:0/3050397618 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fa3d808aa70 msgr2=0x7fa3d8063510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:18.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.195+0000 7fa3ddf47640 0 -- 172.21.15.62:0/3050397618 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55a8e5b554c0 msgr2=0x55a8e5b57960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:18.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.200+0000 7fa3e300f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:18.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.200+0000 7fa3e300f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:18.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.200+0000 7fa3e300f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:18.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.200+0000 7fa3e300f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:18.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.200+0000 7fa3e300f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:18.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.200+0000 7fa3e300f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:18.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.200+0000 7fa3e300f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.200+0000 7fa3e300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.200+0000 7fa3e300f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.200+0000 7fa3e300f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:18.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.200+0000 7fa3e300f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.201+0000 7fa3e300f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:18.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.201+0000 7fa3e300f800 20 zone default found 2024-09-12T00:50:18.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.201+0000 7fa3e300f800 4 Realm: () 2024-09-12T00:50:18.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.201+0000 7fa3e300f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:18.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.201+0000 7fa3e300f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:18.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.201+0000 7fa3e300f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:18.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.201+0000 7fa3e300f800 20 zonegroup default 2024-09-12T00:50:18.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.201+0000 7fa3e300f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.201+0000 7fa3e300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.201+0000 7fa3e300f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.201+0000 7fa3e300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.201+0000 7fa3e300f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.202+0000 7fa3e300f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.202+0000 7fa3e300f800 20 started sync module instance, tier type = 2024-09-12T00:50:18.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.202+0000 7fa3e300f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:18.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.211+0000 7fa3e300f800 20 add_watcher() i=0 2024-09-12T00:50:18.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.211+0000 7fa3e300f800 20 add_watcher() i=1 2024-09-12T00:50:18.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.211+0000 7fa3e300f800 20 add_watcher() i=2 2024-09-12T00:50:18.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.211+0000 7fa3e300f800 20 add_watcher() i=3 2024-09-12T00:50:18.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.211+0000 7fa3e300f800 20 add_watcher() i=4 2024-09-12T00:50:18.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.211+0000 7fa3e300f800 20 add_watcher() i=5 2024-09-12T00:50:18.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.211+0000 7fa3e300f800 20 add_watcher() i=6 2024-09-12T00:50:18.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.213+0000 7fa3e300f800 20 add_watcher() i=7 2024-09-12T00:50:18.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.213+0000 7fa3e300f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:18.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.214+0000 7fa294fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:18.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.215+0000 7fa3e300f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:18.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.215+0000 7fa3e300f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:18.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.215+0000 7fa3e300f800 5 note: GC not initialized 2024-09-12T00:50:18.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.215+0000 7fa20f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:18.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.215+0000 7fa3e300f800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:18.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.215+0000 7fa3e300f800 20 Filter name: none 2024-09-12T00:50:18.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.215+0000 7fa20d7fa640 20 reqs_thread_entry: start 2024-09-12T00:50:18.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.215+0000 7fa3e300f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.216+0000 7fa3e300f800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:50:18.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.216+0000 7fa3e300f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.216+0000 7fa3e300f800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:50:18.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.216+0000 7fa3e300f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:18.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.216+0000 7fa3e300f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.216+0000 7fa3e300f800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:50:18.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.217+0000 7fa3e300f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.217+0000 7fa3e300f800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:50:18.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.217+0000 7fa3e300f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:18.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.218+0000 7fa294fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:18.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.220+0000 7fa3e300f800 20 remove_watcher() i=0 2024-09-12T00:50:18.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.220+0000 7fa3e300f800 2 removed watcher, disabling cache 2024-09-12T00:50:18.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.221+0000 7fa3e300f800 20 remove_watcher() i=1 2024-09-12T00:50:18.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.223+0000 7fa3e300f800 20 remove_watcher() i=2 2024-09-12T00:50:18.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.224+0000 7fa3e300f800 20 remove_watcher() i=3 2024-09-12T00:50:18.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.225+0000 7fa3e300f800 20 remove_watcher() i=4 2024-09-12T00:50:18.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.226+0000 7fa3e300f800 20 remove_watcher() i=5 2024-09-12T00:50:18.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.227+0000 7fa3e300f800 20 remove_watcher() i=6 2024-09-12T00:50:18.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.228+0000 7fa3e300f800 20 remove_watcher() i=7 2024-09-12T00:50:18.257 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.257 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:18.257 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-init-indext id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:18.257 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:18.331 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:18.363 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:18.363 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:18.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.403+0000 7fa63d325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.404+0000 7fa63d325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.404+0000 7fa63d325800 20 realm 2024-09-12T00:50:18.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.404+0000 7fa63d325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.405+0000 7fa63d325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.405+0000 7fa63d325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:18.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.405+0000 7fa63d325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.405+0000 7fa63d325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.405+0000 7fa63d325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.405+0000 7fa63d325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:18.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.405+0000 7fa63d325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.406+0000 7fa63d325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:18.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.406+0000 7fa63d325800 20 searching for the correct realm 2024-09-12T00:50:18.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.409+0000 7fa6387ad640 0 -- 172.21.15.62:0/2982615275 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fa630035950 msgr2=0x7fa630020440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:18.613 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.614+0000 7fa6397af640 0 -- 172.21.15.62:0/2982615275 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55f1b03e8700 msgr2=0x55f1b03eab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:18.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.619+0000 7fa63d325800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:18.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.619+0000 7fa63d325800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:18.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.619+0000 7fa63d325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:18.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.619+0000 7fa63d325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:18.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.619+0000 7fa63d325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:18.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.619+0000 7fa63d325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:18.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.619+0000 7fa63d325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.619+0000 7fa63d325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.619 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.619+0000 7fa63d325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.619+0000 7fa63d325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:18.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.619+0000 7fa63d325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.620+0000 7fa63d325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:18.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.620+0000 7fa63d325800 20 zone default found 2024-09-12T00:50:18.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.620+0000 7fa63d325800 4 Realm: () 2024-09-12T00:50:18.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.620+0000 7fa63d325800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:18.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.620+0000 7fa63d325800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:18.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.620+0000 7fa63d325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:18.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.620+0000 7fa63d325800 20 zonegroup default 2024-09-12T00:50:18.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.620+0000 7fa63d325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.620+0000 7fa63d325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.620+0000 7fa63d325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.620+0000 7fa63d325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.620+0000 7fa63d325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.620+0000 7fa63d325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:18.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.621+0000 7fa63d325800 20 started sync module instance, tier type = 2024-09-12T00:50:18.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.621+0000 7fa63d325800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:18.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.630+0000 7fa63d325800 20 add_watcher() i=0 2024-09-12T00:50:18.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.630+0000 7fa63d325800 20 add_watcher() i=1 2024-09-12T00:50:18.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.630+0000 7fa63d325800 20 add_watcher() i=2 2024-09-12T00:50:18.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.630+0000 7fa63d325800 20 add_watcher() i=3 2024-09-12T00:50:18.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.630+0000 7fa63d325800 20 add_watcher() i=4 2024-09-12T00:50:18.630 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.630+0000 7fa63d325800 20 add_watcher() i=5 2024-09-12T00:50:18.630 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.630+0000 7fa63d325800 20 add_watcher() i=6 2024-09-12T00:50:18.630 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.631+0000 7fa63d325800 20 add_watcher() i=7 2024-09-12T00:50:18.630 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.631+0000 7fa63d325800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:18.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.634+0000 7fa4eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:18.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.634+0000 7fa63d325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:18.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.634+0000 7fa63d325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:18.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.634+0000 7fa63d325800 5 note: GC not initialized 2024-09-12T00:50:18.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.634+0000 7fa4edfe3640 20 reqs_thread_entry: start 2024-09-12T00:50:18.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.634+0000 7fa63d325800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:18.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.634+0000 7fa63d325800 20 Filter name: none 2024-09-12T00:50:18.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.635+0000 7fa45f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:18.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.635+0000 7fa63d325800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:50:18.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.635+0000 7fa63d325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.635+0000 7fa63d325800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:50:18.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.635+0000 7fa63d325800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:50:18.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.635+0000 7fa63d325800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:50:18.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.635+0000 7fa63d325800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 : miss 2024-09-12T00:50:18.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.635+0000 7fa63d325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:18.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.635+0000 7fa63d325800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:50:18.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.635+0000 7fa63d325800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 info.flags=0x17 2024-09-12T00:50:18.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.635+0000 7fa63d325800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 to cache LRU end 2024-09-12T00:50:18.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.635+0000 7fa63d325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:18.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.635+0000 7fa63d325800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:18.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.636+0000 7fa63d325800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 2024-09-12T00:50:18.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.637+0000 7fa63d325800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 to be held by another RGW process; skipping for now 2024-09-12T00:50:18.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.638+0000 7fa4eefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:18.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.640+0000 7fa63d325800 20 remove_watcher() i=0 2024-09-12T00:50:18.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.640+0000 7fa63d325800 2 removed watcher, disabling cache 2024-09-12T00:50:18.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.641+0000 7fa63d325800 20 remove_watcher() i=1 2024-09-12T00:50:18.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.642+0000 7fa63d325800 20 remove_watcher() i=2 2024-09-12T00:50:18.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.643+0000 7fa63d325800 20 remove_watcher() i=3 2024-09-12T00:50:18.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.645+0000 7fa63d325800 20 remove_watcher() i=4 2024-09-12T00:50:18.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.646+0000 7fa63d325800 20 remove_watcher() i=5 2024-09-12T00:50:18.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.647+0000 7fa63d325800 20 remove_watcher() i=6 2024-09-12T00:50:18.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:18.648+0000 7fa63d325800 20 remove_watcher() i=7 2024-09-12T00:50:18.658 INFO:tasks.workunit.client.0.smithi062.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:50:48.666 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:48.705 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:48.706 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:48.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.752+0000 7f5e76210800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.754+0000 7f5e76210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.754+0000 7f5e76210800 20 realm 2024-09-12T00:50:48.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.754+0000 7f5e76210800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.754+0000 7f5e76210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.754+0000 7f5e76210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:48.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.754+0000 7f5e76210800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.754+0000 7f5e76210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.754+0000 7f5e76210800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.755+0000 7f5e76210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:48.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.755+0000 7f5e76210800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.756+0000 7f5e76210800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:48.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.756+0000 7f5e76210800 20 searching for the correct realm 2024-09-12T00:50:48.758 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.759+0000 7f5e691bb640 0 -- 172.21.15.62:0/3141859402 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f5e6c031930 msgr2=0x7f5e6c020430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:48.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.965+0000 7f5e721bd640 0 -- 172.21.15.62:0/3141859402 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5641b8c990f0 msgr2=0x5641b8c9b560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:48.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.970+0000 7f5e76210800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:48.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.970+0000 7f5e76210800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:48.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.970+0000 7f5e76210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:48.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.970+0000 7f5e76210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:48.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.970+0000 7f5e76210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:48.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.970+0000 7f5e76210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:48.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.970+0000 7f5e76210800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.971+0000 7f5e76210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.971+0000 7f5e76210800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.971+0000 7f5e76210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:48.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.971+0000 7f5e76210800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.972+0000 7f5e76210800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:48.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.972+0000 7f5e76210800 20 zone default found 2024-09-12T00:50:48.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.972+0000 7f5e76210800 4 Realm: () 2024-09-12T00:50:48.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.972+0000 7f5e76210800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:48.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.972+0000 7f5e76210800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:48.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.972+0000 7f5e76210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:48.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.972+0000 7f5e76210800 20 zonegroup default 2024-09-12T00:50:48.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.972+0000 7f5e76210800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.972+0000 7f5e76210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.972+0000 7f5e76210800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.972+0000 7f5e76210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.972+0000 7f5e76210800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.973+0000 7f5e76210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:48.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.973+0000 7f5e76210800 20 started sync module instance, tier type = 2024-09-12T00:50:48.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.973+0000 7f5e76210800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:48.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.983+0000 7f5e76210800 20 add_watcher() i=0 2024-09-12T00:50:48.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.983+0000 7f5e76210800 20 add_watcher() i=1 2024-09-12T00:50:48.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.983+0000 7f5e76210800 20 add_watcher() i=2 2024-09-12T00:50:48.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.983+0000 7f5e76210800 20 add_watcher() i=3 2024-09-12T00:50:48.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.983+0000 7f5e76210800 20 add_watcher() i=4 2024-09-12T00:50:48.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.983+0000 7f5e76210800 20 add_watcher() i=5 2024-09-12T00:50:48.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.983+0000 7f5e76210800 20 add_watcher() i=6 2024-09-12T00:50:48.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.984+0000 7f5e76210800 20 add_watcher() i=7 2024-09-12T00:50:48.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.984+0000 7f5e76210800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:48.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.986+0000 7f5d237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:48.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.986+0000 7f5e76210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:48.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.986+0000 7f5e76210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:48.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.986+0000 7f5e76210800 5 note: GC not initialized 2024-09-12T00:50:48.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.986+0000 7f5d227fc640 20 reqs_thread_entry: start 2024-09-12T00:50:48.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.987+0000 7f5e76210800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:48.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.987+0000 7f5e76210800 20 Filter name: none 2024-09-12T00:50:48.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.987+0000 7f5c93fff640 20 reqs_thread_entry: start 2024-09-12T00:50:48.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.987+0000 7f5e76210800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:50:48.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.987+0000 7f5e76210800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.987+0000 7f5e76210800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:50:48.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.987+0000 7f5e76210800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:50:48.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.987+0000 7f5e76210800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:50:48.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.987+0000 7f5e76210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 : miss 2024-09-12T00:50:48.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.987+0000 7f5e76210800 20 rados->read ofs=0 len=0 2024-09-12T00:50:48.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.988+0000 7f5e76210800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:50:48.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.988+0000 7f5e76210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 info.flags=0x17 2024-09-12T00:50:48.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.988+0000 7f5e76210800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 to cache LRU end 2024-09-12T00:50:48.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.988+0000 7f5e76210800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:48.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.988+0000 7f5e76210800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:48.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.988+0000 7f5e76210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 2024-09-12T00:50:48.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.992+0000 7f5e76210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 info.flags=0x17 2024-09-12T00:50:48.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.992+0000 7f5e76210800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 to cache LRU end 2024-09-12T00:50:48.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.992+0000 7f5e76210800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:48.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.992+0000 7f5e76210800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21, ofs0, ns] 2024-09-12T00:50:48.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.993+0000 7f5d557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431585 cookie 94840273151424 notifier 6113 bl.length()=913 2024-09-12T00:50:48.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.993+0000 7f5d557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 info.flags=0x17 2024-09-12T00:50:48.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.993+0000 7f5d557fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 to cache LRU end 2024-09-12T00:50:48.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.993+0000 7f5d557fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:48.993 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.995+0000 7f5e76210800 20 handle_bi_update(): bucket=:abort-at-init-indext[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21]): orig_sources= new_sources= 2024-09-12T00:50:48.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.995+0000 7f5e76210800 20 handle_bi_update(): bucket=:abort-at-init-indext[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21]): potential sources added=[] removed=[] 2024-09-12T00:50:48.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.995+0000 7f5e76210800 20 handle_bi_update(): bucket=:abort-at-init-indext[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21]): orig_dests= new_dests= 2024-09-12T00:50:48.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.995+0000 7f5e76210800 20 handle_bi_update(): bucket=:abort-at-init-indext[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21]): potential dests added=[] removed=[] 2024-09-12T00:50:48.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.997+0000 7f5e76210800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21.1.0 2024-09-12T00:50:48.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.997+0000 7f5e76210800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21.1.0 2024-09-12T00:50:48.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.997+0000 7f5e76210800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21.1.1 2024-09-12T00:50:48.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.997+0000 7f5e76210800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21.1.1 2024-09-12T00:50:48.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:48.997+0000 7f5e76210800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21.0 2024-09-12T00:50:48.998 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.000+0000 7f5e76210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:48.999 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.000+0000 7f5e76210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 2024-09-12T00:50:49.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.001+0000 7f5e76210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 info.flags=0x17 2024-09-12T00:50:49.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.001+0000 7f5e76210800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 to cache LRU end 2024-09-12T00:50:49.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.001+0000 7f5e76210800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:49.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.001+0000 7f5e76210800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21, ofs0, ns] 2024-09-12T00:50:49.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.001+0000 7f5d557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431586 cookie 94840273151424 notifier 6113 bl.length()=913 2024-09-12T00:50:49.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.001+0000 7f5d557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 info.flags=0x17 2024-09-12T00:50:49.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.001+0000 7f5d557fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 to cache LRU end 2024-09-12T00:50:49.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.001+0000 7f5d557fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:49.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.003+0000 7f5e76210800 20 handle_bi_update(): bucket=:abort-at-init-indext[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21]): orig_sources= new_sources= 2024-09-12T00:50:49.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.003+0000 7f5e76210800 20 handle_bi_update(): bucket=:abort-at-init-indext[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21]): potential sources added=[] removed=[] 2024-09-12T00:50:49.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.003+0000 7f5e76210800 20 handle_bi_update(): bucket=:abort-at-init-indext[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21]): orig_dests= new_dests= 2024-09-12T00:50:49.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.003+0000 7f5e76210800 20 handle_bi_update(): bucket=:abort-at-init-indext[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21]): potential dests added=[] removed=[] 2024-09-12T00:50:49.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.005+0000 7f5e76210800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21.0 2024-09-12T00:50:49.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.005+0000 7f5e76210800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:49.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.005+0000 7f5e76210800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 2024-09-12T00:50:49.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.007+0000 7f5e76210800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 info.flags=0x17 2024-09-12T00:50:49.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.007+0000 7f5e76210800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 to cache LRU end 2024-09-12T00:50:49.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.007+0000 7f5e76210800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:49.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.007+0000 7f5e76210800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21, ofs0, ns] 2024-09-12T00:50:49.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.007+0000 7f5d557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431587 cookie 94840273151424 notifier 6113 bl.length()=881 2024-09-12T00:50:49.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.007+0000 7f5d557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 info.flags=0x17 2024-09-12T00:50:49.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.007+0000 7f5d557fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 to cache LRU end 2024-09-12T00:50:49.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.007+0000 7f5d557fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:49.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.009+0000 7f5e76210800 20 handle_bi_update(): bucket=:abort-at-init-indext[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21]): orig_sources= new_sources= 2024-09-12T00:50:49.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.009+0000 7f5e76210800 20 handle_bi_update(): bucket=:abort-at-init-indext[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21]): potential sources added=[] removed=[] 2024-09-12T00:50:49.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.009+0000 7f5e76210800 20 handle_bi_update(): bucket=:abort-at-init-indext[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21]): orig_dests= new_dests= 2024-09-12T00:50:49.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.009+0000 7f5e76210800 20 handle_bi_update(): bucket=:abort-at-init-indext[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21]): potential dests added=[] removed=[] 2024-09-12T00:50:49.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.010+0000 7f5e76210800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 1 shards to 2 shards completed successfully 2024-09-12T00:50:49.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.012+0000 7f5d237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:49.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.014+0000 7f5e76210800 20 remove_watcher() i=0 2024-09-12T00:50:49.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.014+0000 7f5e76210800 2 removed watcher, disabling cache 2024-09-12T00:50:49.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.016+0000 7f5e76210800 20 remove_watcher() i=1 2024-09-12T00:50:49.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.017+0000 7f5e76210800 20 remove_watcher() i=2 2024-09-12T00:50:49.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.018+0000 7f5e76210800 20 remove_watcher() i=3 2024-09-12T00:50:49.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.019+0000 7f5e76210800 20 remove_watcher() i=4 2024-09-12T00:50:49.020 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.020+0000 7f5e76210800 20 remove_watcher() i=5 2024-09-12T00:50:49.021 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.021+0000 7f5e76210800 20 remove_watcher() i=6 2024-09-12T00:50:49.021 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.022+0000 7f5e76210800 20 remove_watcher() i=7 2024-09-12T00:50:49.034 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:50:49.064 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:49.065 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:49.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.105+0000 7f09b6814800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.107+0000 7f09b6814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.107+0000 7f09b6814800 20 realm 2024-09-12T00:50:49.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.107+0000 7f09b6814800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.107+0000 7f09b6814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.107+0000 7f09b6814800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:49.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.107+0000 7f09b6814800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.107+0000 7f09b6814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.107+0000 7f09b6814800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.108+0000 7f09b6814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:49.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.108+0000 7f09b6814800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.109+0000 7f09b6814800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:49.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.109+0000 7f09b6814800 20 searching for the correct realm 2024-09-12T00:50:49.110 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.112+0000 7f09b17df640 0 -- 172.21.15.62:0/681260692 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f09ac0be180 msgr2=0x7f09ac0c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:49.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.316+0000 7f09b1fe0640 0 -- 172.21.15.62:0/681260692 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f09ac0be7b0 msgr2=0x7f09ac0ad040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.523+0000 7f09b6814800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.523+0000 7f09b6814800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.523+0000 7f09b6814800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.523+0000 7f09b6814800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.523+0000 7f09b6814800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.523+0000 7f09b6814800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:49.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.523+0000 7f09b6814800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.523+0000 7f09b6814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.523+0000 7f09b6814800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.523+0000 7f09b6814800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.523+0000 7f09b6814800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.524+0000 7f09b6814800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.524+0000 7f09b6814800 20 zone default found 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.524+0000 7f09b6814800 4 Realm: () 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.524+0000 7f09b6814800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:49.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.524+0000 7f09b6814800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.524+0000 7f09b6814800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.524+0000 7f09b6814800 20 zonegroup default 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.524+0000 7f09b6814800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.524+0000 7f09b6814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.524+0000 7f09b6814800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.524+0000 7f09b6814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.524+0000 7f09b6814800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.525+0000 7f09b6814800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.525+0000 7f09b6814800 20 started sync module instance, tier type = 2024-09-12T00:50:49.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.525+0000 7f09b6814800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:49.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.535+0000 7f09b6814800 20 add_watcher() i=0 2024-09-12T00:50:49.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.535+0000 7f09b6814800 20 add_watcher() i=1 2024-09-12T00:50:49.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.535+0000 7f09b6814800 20 add_watcher() i=2 2024-09-12T00:50:49.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.535+0000 7f09b6814800 20 add_watcher() i=3 2024-09-12T00:50:49.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.535+0000 7f09b6814800 20 add_watcher() i=4 2024-09-12T00:50:49.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.535+0000 7f09b6814800 20 add_watcher() i=5 2024-09-12T00:50:49.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.535+0000 7f09b6814800 20 add_watcher() i=6 2024-09-12T00:50:49.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.536+0000 7f09b6814800 20 add_watcher() i=7 2024-09-12T00:50:49.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.536+0000 7f09b6814800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:49.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.539+0000 7f08637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:49.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.539+0000 7f09b6814800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:49.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.539+0000 7f09b6814800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:49.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.539+0000 7f09b6814800 5 note: GC not initialized 2024-09-12T00:50:49.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.539+0000 7f08627fc640 20 reqs_thread_entry: start 2024-09-12T00:50:49.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.539+0000 7f09b6814800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:49.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.539+0000 7f09b6814800 20 Filter name: none 2024-09-12T00:50:49.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.540+0000 7f07d7fff640 20 reqs_thread_entry: start 2024-09-12T00:50:49.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.540+0000 7f09b6814800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.540+0000 7f09b6814800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:50:49.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.540+0000 7f09b6814800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.541+0000 7f09b6814800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:50:49.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.541+0000 7f09b6814800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:49.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.541+0000 7f09b6814800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.542+0000 7f09b6814800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:50:49.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.542+0000 7f09b6814800 20 rados->read ofs=0 len=0 2024-09-12T00:50:49.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.542+0000 7f09b6814800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:50:49.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.542+0000 7f09b6814800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:49.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.544+0000 7f08637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:49.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.546+0000 7f09b6814800 20 remove_watcher() i=0 2024-09-12T00:50:49.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.546+0000 7f09b6814800 2 removed watcher, disabling cache 2024-09-12T00:50:49.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.547+0000 7f09b6814800 20 remove_watcher() i=1 2024-09-12T00:50:49.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.548+0000 7f09b6814800 20 remove_watcher() i=2 2024-09-12T00:50:49.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.549+0000 7f09b6814800 20 remove_watcher() i=3 2024-09-12T00:50:49.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.550+0000 7f09b6814800 20 remove_watcher() i=4 2024-09-12T00:50:49.550 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.552+0000 7f09b6814800 20 remove_watcher() i=5 2024-09-12T00:50:49.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.553+0000 7f09b6814800 20 remove_watcher() i=6 2024-09-12T00:50:49.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:49.554+0000 7f09b6814800 20 remove_watcher() i=7 2024-09-12T00:50:49.564 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:49.564 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:49.564 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-init-indext id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:50:49.564 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:49.867 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T00:50:49.867 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:50.717 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:50:50.746 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:50.746 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:50.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:50.786+0000 7efc1091f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:50.788+0000 7efc1091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:50.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:50.788+0000 7efc1091f800 20 realm 2024-09-12T00:50:50.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:50.788+0000 7efc1091f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:50.788+0000 7efc1091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:50.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:50.788+0000 7efc1091f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:50.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:50.788+0000 7efc1091f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:50.788+0000 7efc1091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:50.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:50.788+0000 7efc1091f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:50.789+0000 7efc1091f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:50.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:50.789+0000 7efc1091f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:50.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:50.789+0000 7efc1091f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:50.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:50.789+0000 7efc1091f800 20 searching for the correct realm 2024-09-12T00:50:50.791 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:50.792+0000 7efc03e0b640 0 -- 172.21.15.62:0/258987693 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7efc040b1cc0 msgr2=0x7efc0406e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:50.997 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:50.998+0000 7efc0ce0d640 0 -- 172.21.15.62:0/258987693 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55ad88f9e5a0 msgr2=0x55ad88fa0a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:51.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.002+0000 7efc1091f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:51.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.002+0000 7efc1091f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:51.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.002+0000 7efc1091f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:51.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.002+0000 7efc1091f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:51.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.002+0000 7efc1091f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:51.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.002+0000 7efc1091f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:51.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.002+0000 7efc1091f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.002+0000 7efc1091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.002+0000 7efc1091f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.002+0000 7efc1091f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:51.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.002+0000 7efc1091f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.003+0000 7efc1091f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:51.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.003+0000 7efc1091f800 20 zone default found 2024-09-12T00:50:51.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.003+0000 7efc1091f800 4 Realm: () 2024-09-12T00:50:51.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.003+0000 7efc1091f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:51.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.003+0000 7efc1091f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:51.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.003+0000 7efc1091f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:51.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.003+0000 7efc1091f800 20 zonegroup default 2024-09-12T00:50:51.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.003+0000 7efc1091f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.003+0000 7efc1091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.003+0000 7efc1091f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.003+0000 7efc1091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.003+0000 7efc1091f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.004+0000 7efc1091f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.004+0000 7efc1091f800 20 started sync module instance, tier type = 2024-09-12T00:50:51.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.004+0000 7efc1091f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:51.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.012+0000 7efc1091f800 20 add_watcher() i=0 2024-09-12T00:50:51.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.012+0000 7efc1091f800 20 add_watcher() i=1 2024-09-12T00:50:51.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.012+0000 7efc1091f800 20 add_watcher() i=2 2024-09-12T00:50:51.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.012+0000 7efc1091f800 20 add_watcher() i=3 2024-09-12T00:50:51.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.012+0000 7efc1091f800 20 add_watcher() i=4 2024-09-12T00:50:51.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.012+0000 7efc1091f800 20 add_watcher() i=5 2024-09-12T00:50:51.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.012+0000 7efc1091f800 20 add_watcher() i=6 2024-09-12T00:50:51.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.013+0000 7efc1091f800 20 add_watcher() i=7 2024-09-12T00:50:51.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.013+0000 7efc1091f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:51.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.015+0000 7efac2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:51.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.015+0000 7efc1091f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:51.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.015+0000 7efc1091f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:51.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.015+0000 7efc1091f800 5 note: GC not initialized 2024-09-12T00:50:51.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.015+0000 7efac1fdb640 20 reqs_thread_entry: start 2024-09-12T00:50:51.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.015+0000 7efc1091f800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:51.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.015+0000 7efc1091f800 20 Filter name: none 2024-09-12T00:50:51.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.015+0000 7efa337fe640 20 reqs_thread_entry: start 2024-09-12T00:50:51.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.015+0000 7efc1091f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.016+0000 7efc1091f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:51.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.016+0000 7efc1091f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.017+0000 7efc1091f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:51.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.017+0000 7efc1091f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:51.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.017+0000 7efc1091f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.017+0000 7efc1091f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:51.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.017+0000 7efc1091f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.017+0000 7efc1091f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:51.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.017+0000 7efc1091f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:51.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.019+0000 7efac2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:51.020 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.021+0000 7efc1091f800 20 remove_watcher() i=0 2024-09-12T00:50:51.020 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.021+0000 7efc1091f800 2 removed watcher, disabling cache 2024-09-12T00:50:51.021 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.022+0000 7efc1091f800 20 remove_watcher() i=1 2024-09-12T00:50:51.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.023+0000 7efc1091f800 20 remove_watcher() i=2 2024-09-12T00:50:51.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.024+0000 7efc1091f800 20 remove_watcher() i=3 2024-09-12T00:50:51.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.025+0000 7efc1091f800 20 remove_watcher() i=4 2024-09-12T00:50:51.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.026+0000 7efc1091f800 20 remove_watcher() i=5 2024-09-12T00:50:51.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.027+0000 7efc1091f800 20 remove_watcher() i=6 2024-09-12T00:50:51.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.027+0000 7efc1091f800 20 remove_watcher() i=7 2024-09-12T00:50:51.038 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:51.038 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:51.038 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-set-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:51.038 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:51.039 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T00:50:51.076 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:51.077 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:51.114 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.115+0000 7fe6eea0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.117+0000 7fe6eea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.117+0000 7fe6eea0e800 20 realm 2024-09-12T00:50:51.117 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.117+0000 7fe6eea0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.117 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.117+0000 7fe6eea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.118 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.117+0000 7fe6eea0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:51.118 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.117+0000 7fe6eea0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.118 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.117+0000 7fe6eea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.118 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.117+0000 7fe6eea0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.118+0000 7fe6eea0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:51.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.118+0000 7fe6eea0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.118+0000 7fe6eea0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:51.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.118+0000 7fe6eea0e800 20 searching for the correct realm 2024-09-12T00:50:51.120 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.121+0000 7fe6e9979640 0 -- 172.21.15.62:0/3382393518 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fe6e4061040 msgr2=0x7fe6e4055920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:51.326 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.327+0000 7fe6ea97b640 0 -- 172.21.15.62:0/3382393518 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55f2d74bce90 msgr2=0x55f2d74bf320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:51.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.331+0000 7fe6eea0e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:51.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.331+0000 7fe6eea0e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:51.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.331+0000 7fe6eea0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:51.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.331+0000 7fe6eea0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:51.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.331+0000 7fe6eea0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:51.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.331+0000 7fe6eea0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:51.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.331+0000 7fe6eea0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.331+0000 7fe6eea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.331+0000 7fe6eea0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.332+0000 7fe6eea0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:51.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.332+0000 7fe6eea0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.332+0000 7fe6eea0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:51.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.332+0000 7fe6eea0e800 20 zone default found 2024-09-12T00:50:51.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.332+0000 7fe6eea0e800 4 Realm: () 2024-09-12T00:50:51.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.332+0000 7fe6eea0e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:51.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.332+0000 7fe6eea0e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:51.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.332+0000 7fe6eea0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:51.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.332+0000 7fe6eea0e800 20 zonegroup default 2024-09-12T00:50:51.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.332+0000 7fe6eea0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.332+0000 7fe6eea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.332+0000 7fe6eea0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.333+0000 7fe6eea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.333+0000 7fe6eea0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.333+0000 7fe6eea0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.333+0000 7fe6eea0e800 20 started sync module instance, tier type = 2024-09-12T00:50:51.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.333+0000 7fe6eea0e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:51.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.341+0000 7fe6eea0e800 20 add_watcher() i=0 2024-09-12T00:50:51.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.341+0000 7fe6eea0e800 20 add_watcher() i=1 2024-09-12T00:50:51.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.341+0000 7fe6eea0e800 20 add_watcher() i=2 2024-09-12T00:50:51.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.341+0000 7fe6eea0e800 20 add_watcher() i=3 2024-09-12T00:50:51.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.341+0000 7fe6eea0e800 20 add_watcher() i=4 2024-09-12T00:50:51.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.341+0000 7fe6eea0e800 20 add_watcher() i=5 2024-09-12T00:50:51.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.341+0000 7fe6eea0e800 20 add_watcher() i=6 2024-09-12T00:50:51.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.342+0000 7fe6eea0e800 20 add_watcher() i=7 2024-09-12T00:50:51.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.342+0000 7fe6eea0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:51.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.344+0000 7fe5a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:51.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.345+0000 7fe6eea0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:51.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.345+0000 7fe6eea0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:51.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.345+0000 7fe6eea0e800 5 note: GC not initialized 2024-09-12T00:50:51.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.345+0000 7fe51b7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:51.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.345+0000 7fe6eea0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:51.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.345+0000 7fe6eea0e800 20 Filter name: none 2024-09-12T00:50:51.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.345+0000 7fe5197fa640 20 reqs_thread_entry: start 2024-09-12T00:50:51.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.345+0000 7fe6eea0e800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:50:51.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.345+0000 7fe6eea0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.346+0000 7fe6eea0e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:51.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.346+0000 7fe6eea0e800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:50:51.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.346+0000 7fe6eea0e800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:50:51.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.346+0000 7fe6eea0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 : miss 2024-09-12T00:50:51.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.346+0000 7fe6eea0e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.346+0000 7fe6eea0e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:51.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.346+0000 7fe6eea0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 info.flags=0x17 2024-09-12T00:50:51.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.346+0000 7fe6eea0e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 to cache LRU end 2024-09-12T00:50:51.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.346+0000 7fe6eea0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:51.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.346+0000 7fe6eea0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:51.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.346+0000 7fe6eea0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 2024-09-12T00:50:51.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.348+0000 7fe6eea0e800 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T00:50:51.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.348+0000 7fe6eea0e800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T00:50:51.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.351+0000 7fe5a0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:51.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.353+0000 7fe6eea0e800 20 remove_watcher() i=0 2024-09-12T00:50:51.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.353+0000 7fe6eea0e800 2 removed watcher, disabling cache 2024-09-12T00:50:51.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.354+0000 7fe6eea0e800 20 remove_watcher() i=1 2024-09-12T00:50:51.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.355+0000 7fe6eea0e800 20 remove_watcher() i=2 2024-09-12T00:50:51.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.356+0000 7fe6eea0e800 20 remove_watcher() i=3 2024-09-12T00:50:51.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.358+0000 7fe6eea0e800 20 remove_watcher() i=4 2024-09-12T00:50:51.357 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.359+0000 7fe6eea0e800 20 remove_watcher() i=5 2024-09-12T00:50:51.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.359+0000 7fe6eea0e800 20 remove_watcher() i=6 2024-09-12T00:50:51.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.360+0000 7fe6eea0e800 20 remove_watcher() i=7 2024-09-12T00:50:51.372 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:50:51.401 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:51.401 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:51.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.441+0000 7f793220f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.443+0000 7f793220f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.443+0000 7f793220f800 20 realm 2024-09-12T00:50:51.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.443+0000 7f793220f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.443+0000 7f793220f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.443+0000 7f793220f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:51.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.443+0000 7f793220f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.443+0000 7f793220f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.443+0000 7f793220f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.444+0000 7f793220f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:51.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.444+0000 7f793220f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.444 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.445+0000 7f793220f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:51.444 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.445+0000 7f793220f800 20 searching for the correct realm 2024-09-12T00:50:51.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.448+0000 7f792f4f8640 0 -- 172.21.15.62:0/1262140421 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f79280afbf0 msgr2=0x7f792807f5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:51.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.653+0000 7f792f4f8640 0 -- 172.21.15.62:0/1262140421 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55a6b8a2c840 msgr2=0x55a6b8a2ec90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:51.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.657+0000 7f793220f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:51.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.657+0000 7f793220f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:51.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.657+0000 7f793220f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:51.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.657+0000 7f793220f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:51.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.657+0000 7f793220f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:51.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.657+0000 7f793220f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:51.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.657+0000 7f793220f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.657+0000 7f793220f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.657+0000 7f793220f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.658+0000 7f793220f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:51.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.658+0000 7f793220f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.658+0000 7f793220f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:51.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.658+0000 7f793220f800 20 zone default found 2024-09-12T00:50:51.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.658+0000 7f793220f800 4 Realm: () 2024-09-12T00:50:51.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.658+0000 7f793220f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:51.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.658+0000 7f793220f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:51.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.658+0000 7f793220f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:51.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.658+0000 7f793220f800 20 zonegroup default 2024-09-12T00:50:51.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.658+0000 7f793220f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.659+0000 7f793220f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.659+0000 7f793220f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.659+0000 7f793220f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.659+0000 7f793220f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.659+0000 7f793220f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.659+0000 7f793220f800 20 started sync module instance, tier type = 2024-09-12T00:50:51.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.659+0000 7f793220f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:51.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.668+0000 7f793220f800 20 add_watcher() i=0 2024-09-12T00:50:51.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.668+0000 7f793220f800 20 add_watcher() i=1 2024-09-12T00:50:51.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.668+0000 7f793220f800 20 add_watcher() i=2 2024-09-12T00:50:51.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.668+0000 7f793220f800 20 add_watcher() i=3 2024-09-12T00:50:51.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.668+0000 7f793220f800 20 add_watcher() i=4 2024-09-12T00:50:51.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.668+0000 7f793220f800 20 add_watcher() i=5 2024-09-12T00:50:51.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.668+0000 7f793220f800 20 add_watcher() i=6 2024-09-12T00:50:51.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.669+0000 7f793220f800 20 add_watcher() i=7 2024-09-12T00:50:51.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.669+0000 7f793220f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:51.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.671+0000 7f77e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:51.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.671+0000 7f793220f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:51.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.671+0000 7f793220f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:51.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.671+0000 7f793220f800 5 note: GC not initialized 2024-09-12T00:50:51.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.671+0000 7f77e4fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:51.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.671+0000 7f793220f800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:51.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.671+0000 7f793220f800 20 Filter name: none 2024-09-12T00:50:51.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.672+0000 7f775e7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:51.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.672+0000 7f793220f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.672+0000 7f793220f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:51.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.672+0000 7f793220f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.672+0000 7f793220f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:51.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.672+0000 7f793220f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:51.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.672+0000 7f793220f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.673+0000 7f793220f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:51.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.673+0000 7f793220f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.673+0000 7f793220f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:51.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.673+0000 7f793220f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:51.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.675+0000 7f77e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:51.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.677+0000 7f793220f800 20 remove_watcher() i=0 2024-09-12T00:50:51.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.677+0000 7f793220f800 2 removed watcher, disabling cache 2024-09-12T00:50:51.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.678+0000 7f793220f800 20 remove_watcher() i=1 2024-09-12T00:50:51.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.678+0000 7f793220f800 20 remove_watcher() i=2 2024-09-12T00:50:51.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.679+0000 7f793220f800 20 remove_watcher() i=3 2024-09-12T00:50:51.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.680+0000 7f793220f800 20 remove_watcher() i=4 2024-09-12T00:50:51.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.682+0000 7f793220f800 20 remove_watcher() i=5 2024-09-12T00:50:51.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.683+0000 7f793220f800 20 remove_watcher() i=6 2024-09-12T00:50:51.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.684+0000 7f793220f800 20 remove_watcher() i=7 2024-09-12T00:50:51.694 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:51.694 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:51.694 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-set-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:51.694 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:51.787 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:51.821 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:51.821 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:51.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.861+0000 7f02ccd39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.863+0000 7f02ccd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.863+0000 7f02ccd39800 20 realm 2024-09-12T00:50:51.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.863+0000 7f02ccd39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.863+0000 7f02ccd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.863+0000 7f02ccd39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:51.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.863+0000 7f02ccd39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.863+0000 7f02ccd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:51.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.863+0000 7f02ccd39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.864+0000 7f02ccd39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:51.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.864+0000 7f02ccd39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:51.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.864+0000 7f02ccd39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:51.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.864+0000 7f02ccd39800 20 searching for the correct realm 2024-09-12T00:50:51.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.867+0000 7f02c81c6640 0 -- 172.21.15.62:0/2556852962 >> [v2:172.21.15.62:6808/741930476,v1:172.21.15.62:6809/741930476] conn(0x5641e72fe380 msgr2=0x5641e73007b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:51.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:51.870+0000 7f02c89c7640 0 -- 172.21.15.62:0/2556852962 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f02c008f910 msgr2=0x7f02c00723b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:52.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.077+0000 7f02ccd39800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:52.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.077+0000 7f02ccd39800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:52.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.077+0000 7f02ccd39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:52.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.077+0000 7f02ccd39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:52.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.077+0000 7f02ccd39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:52.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.077+0000 7f02ccd39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:52.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.077+0000 7f02ccd39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.077+0000 7f02ccd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:52.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.077+0000 7f02ccd39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.077+0000 7f02ccd39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:52.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.077+0000 7f02ccd39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.078+0000 7f02ccd39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:52.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.078+0000 7f02ccd39800 20 zone default found 2024-09-12T00:50:52.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.078+0000 7f02ccd39800 4 Realm: () 2024-09-12T00:50:52.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.078+0000 7f02ccd39800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:52.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.078+0000 7f02ccd39800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:52.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.078+0000 7f02ccd39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:52.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.078+0000 7f02ccd39800 20 zonegroup default 2024-09-12T00:50:52.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.078+0000 7f02ccd39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.078+0000 7f02ccd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:52.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.078+0000 7f02ccd39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.078+0000 7f02ccd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:52.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.078+0000 7f02ccd39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.079+0000 7f02ccd39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:52.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.079+0000 7f02ccd39800 20 started sync module instance, tier type = 2024-09-12T00:50:52.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.079+0000 7f02ccd39800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:52.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.087+0000 7f02ccd39800 20 add_watcher() i=0 2024-09-12T00:50:52.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.087+0000 7f02ccd39800 20 add_watcher() i=1 2024-09-12T00:50:52.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.087+0000 7f02ccd39800 20 add_watcher() i=2 2024-09-12T00:50:52.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.087+0000 7f02ccd39800 20 add_watcher() i=3 2024-09-12T00:50:52.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.087+0000 7f02ccd39800 20 add_watcher() i=4 2024-09-12T00:50:52.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.087+0000 7f02ccd39800 20 add_watcher() i=5 2024-09-12T00:50:52.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.087+0000 7f02ccd39800 20 add_watcher() i=6 2024-09-12T00:50:52.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.088+0000 7f02ccd39800 20 add_watcher() i=7 2024-09-12T00:50:52.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.088+0000 7f02ccd39800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:52.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.090+0000 7f017f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:52.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.090+0000 7f02ccd39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:52.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.090+0000 7f02ccd39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:52.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.090+0000 7f02ccd39800 5 note: GC not initialized 2024-09-12T00:50:52.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.090+0000 7f017e7e4640 20 reqs_thread_entry: start 2024-09-12T00:50:52.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.090+0000 7f02ccd39800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:52.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.090+0000 7f02ccd39800 20 Filter name: none 2024-09-12T00:50:52.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.091+0000 7f0177fff640 20 reqs_thread_entry: start 2024-09-12T00:50:52.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.091+0000 7f02ccd39800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:50:52.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.091+0000 7f02ccd39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.091+0000 7f02ccd39800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:52.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.091+0000 7f02ccd39800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:50:52.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.091+0000 7f02ccd39800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:50:52.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.091+0000 7f02ccd39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 : miss 2024-09-12T00:50:52.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.091+0000 7f02ccd39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.092+0000 7f02ccd39800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:52.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.092+0000 7f02ccd39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 info.flags=0x17 2024-09-12T00:50:52.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.092+0000 7f02ccd39800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 to cache LRU end 2024-09-12T00:50:52.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.092+0000 7f02ccd39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:52.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.092+0000 7f02ccd39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:52.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.092+0000 7f02ccd39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 2024-09-12T00:50:52.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.095+0000 7f02ccd39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 info.flags=0x17 2024-09-12T00:50:52.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.095+0000 7f02ccd39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 to cache LRU end 2024-09-12T00:50:52.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.095+0000 7f02ccd39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:52.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.095+0000 7f02ccd39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22, ofs0, ns] 2024-09-12T00:50:52.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.095+0000 7f019f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431638 cookie 94841051546256 notifier 6531 bl.length()=925 2024-09-12T00:50:52.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.095+0000 7f019f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 info.flags=0x17 2024-09-12T00:50:52.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.095+0000 7f019f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 to cache LRU end 2024-09-12T00:50:52.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.095+0000 7f019f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:52.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.097+0000 7f02ccd39800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22]): orig_sources= new_sources= 2024-09-12T00:50:52.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.097+0000 7f02ccd39800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22]): potential sources added=[] removed=[] 2024-09-12T00:50:52.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.097+0000 7f02ccd39800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22]): orig_dests= new_dests= 2024-09-12T00:50:52.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.097+0000 7f02ccd39800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22]): potential dests added=[] removed=[] 2024-09-12T00:50:52.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.099+0000 7f02ccd39800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22.1.0 2024-09-12T00:50:52.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.099+0000 7f02ccd39800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22.1.0 2024-09-12T00:50:52.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.099+0000 7f02ccd39800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22.1.1 2024-09-12T00:50:52.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.099+0000 7f02ccd39800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22.1.1 2024-09-12T00:50:52.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.099+0000 7f02ccd39800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22.0 2024-09-12T00:50:52.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.101+0000 7f02ccd39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:52.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.101+0000 7f02ccd39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 2024-09-12T00:50:52.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.102+0000 7f02ccd39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 info.flags=0x17 2024-09-12T00:50:52.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.102+0000 7f02ccd39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 to cache LRU end 2024-09-12T00:50:52.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.102+0000 7f02ccd39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:52.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.102+0000 7f02ccd39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22, ofs0, ns] 2024-09-12T00:50:52.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.103+0000 7f019f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431639 cookie 94841051546256 notifier 6531 bl.length()=925 2024-09-12T00:50:52.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.103+0000 7f019f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 info.flags=0x17 2024-09-12T00:50:52.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.103+0000 7f019f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 to cache LRU end 2024-09-12T00:50:52.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.103+0000 7f019f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:52.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.104+0000 7f02ccd39800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22]): orig_sources= new_sources= 2024-09-12T00:50:52.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.104+0000 7f02ccd39800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22]): potential sources added=[] removed=[] 2024-09-12T00:50:52.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.104+0000 7f02ccd39800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22]): orig_dests= new_dests= 2024-09-12T00:50:52.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.104+0000 7f02ccd39800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22]): potential dests added=[] removed=[] 2024-09-12T00:50:52.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.105+0000 7f02ccd39800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22.0 2024-09-12T00:50:52.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.105+0000 7f02ccd39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:52.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.105+0000 7f02ccd39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 2024-09-12T00:50:52.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.107+0000 7f02ccd39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 info.flags=0x17 2024-09-12T00:50:52.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.107+0000 7f02ccd39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 to cache LRU end 2024-09-12T00:50:52.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.107+0000 7f02ccd39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:52.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.107+0000 7f02ccd39800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22, ofs0, ns] 2024-09-12T00:50:52.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.107+0000 7f019ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431640 cookie 94841051546256 notifier 6531 bl.length()=893 2024-09-12T00:50:52.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.107+0000 7f019ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 info.flags=0x17 2024-09-12T00:50:52.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.107+0000 7f019ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 to cache LRU end 2024-09-12T00:50:52.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.107+0000 7f019ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:52.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.108+0000 7f02ccd39800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22]): orig_sources= new_sources= 2024-09-12T00:50:52.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.108+0000 7f02ccd39800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22]): potential sources added=[] removed=[] 2024-09-12T00:50:52.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.108+0000 7f02ccd39800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22]): orig_dests= new_dests= 2024-09-12T00:50:52.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.108+0000 7f02ccd39800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22]): potential dests added=[] removed=[] 2024-09-12T00:50:52.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.109+0000 7f02ccd39800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:50:52.110 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.111+0000 7f017f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:52.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.113+0000 7f02ccd39800 20 remove_watcher() i=0 2024-09-12T00:50:52.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.113+0000 7f02ccd39800 2 removed watcher, disabling cache 2024-09-12T00:50:52.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.114+0000 7f02ccd39800 20 remove_watcher() i=1 2024-09-12T00:50:52.114 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.115+0000 7f02ccd39800 20 remove_watcher() i=2 2024-09-12T00:50:52.115 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.116+0000 7f02ccd39800 20 remove_watcher() i=3 2024-09-12T00:50:52.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.117+0000 7f02ccd39800 20 remove_watcher() i=4 2024-09-12T00:50:52.117 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.118+0000 7f02ccd39800 20 remove_watcher() i=5 2024-09-12T00:50:52.118 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.119+0000 7f02ccd39800 20 remove_watcher() i=6 2024-09-12T00:50:52.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.120+0000 7f02ccd39800 20 remove_watcher() i=7 2024-09-12T00:50:52.132 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:50:52.161 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:52.161 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:52.200 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.201+0000 7f04c6325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.203+0000 7f04c6325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:52.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.203+0000 7f04c6325800 20 realm 2024-09-12T00:50:52.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.203+0000 7f04c6325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.203+0000 7f04c6325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:52.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.203+0000 7f04c6325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:52.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.203+0000 7f04c6325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.203+0000 7f04c6325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:52.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.203+0000 7f04c6325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.204+0000 7f04c6325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:52.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.204+0000 7f04c6325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.205+0000 7f04c6325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:52.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.205+0000 7f04c6325800 20 searching for the correct realm 2024-09-12T00:50:52.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.208+0000 7f04c1f33640 0 -- 172.21.15.62:0/1406205364 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7f04bc024950 msgr2=0x7f04bc017400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:52.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.211+0000 7f04c1f33640 0 -- 172.21.15.62:0/1406205364 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f04bc04e910 msgr2=0x7f04bc032400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:52.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.214+0000 7f04c6325800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:52.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.214+0000 7f04c6325800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:52.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.214+0000 7f04c6325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:52.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.214+0000 7f04c6325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:52.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.214+0000 7f04c6325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:52.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.214+0000 7f04c6325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:52.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.214+0000 7f04c6325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.215+0000 7f04c6325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:52.215 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.215+0000 7f04c6325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.215 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.215+0000 7f04c6325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:52.215 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.215+0000 7f04c6325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.215+0000 7f04c6325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:52.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.215+0000 7f04c6325800 20 zone default found 2024-09-12T00:50:52.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.215+0000 7f04c6325800 4 Realm: () 2024-09-12T00:50:52.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.215+0000 7f04c6325800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:52.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.215+0000 7f04c6325800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:52.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.215+0000 7f04c6325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:52.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.215+0000 7f04c6325800 20 zonegroup default 2024-09-12T00:50:52.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.215+0000 7f04c6325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.215+0000 7f04c6325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:52.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.215+0000 7f04c6325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.216+0000 7f04c6325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:52.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.216+0000 7f04c6325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.216+0000 7f04c6325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:52.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.216+0000 7f04c6325800 20 started sync module instance, tier type = 2024-09-12T00:50:52.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.216+0000 7f04c6325800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:52.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.224+0000 7f04c6325800 20 add_watcher() i=0 2024-09-12T00:50:52.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.224+0000 7f04c6325800 20 add_watcher() i=1 2024-09-12T00:50:52.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.224+0000 7f04c6325800 20 add_watcher() i=2 2024-09-12T00:50:52.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.224+0000 7f04c6325800 20 add_watcher() i=3 2024-09-12T00:50:52.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.224+0000 7f04c6325800 20 add_watcher() i=4 2024-09-12T00:50:52.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.224+0000 7f04c6325800 20 add_watcher() i=5 2024-09-12T00:50:52.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.224+0000 7f04c6325800 20 add_watcher() i=6 2024-09-12T00:50:52.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.225+0000 7f04c6325800 20 add_watcher() i=7 2024-09-12T00:50:52.225 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.225+0000 7f04c6325800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:52.225 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.227+0000 7f03737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:52.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.227+0000 7f04c6325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:52.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.227+0000 7f04c6325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:52.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.227+0000 7f04c6325800 5 note: GC not initialized 2024-09-12T00:50:52.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.227+0000 7f03727fc640 20 reqs_thread_entry: start 2024-09-12T00:50:52.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.227+0000 7f04c6325800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:52.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.227+0000 7f04c6325800 20 Filter name: none 2024-09-12T00:50:52.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.228+0000 7f02e3fff640 20 reqs_thread_entry: start 2024-09-12T00:50:52.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.228+0000 7f04c6325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.228+0000 7f04c6325800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:52.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.228+0000 7f04c6325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.229+0000 7f04c6325800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:52.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.229+0000 7f04c6325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:52.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.229+0000 7f04c6325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.229+0000 7f04c6325800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:52.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.229+0000 7f04c6325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:52.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.230+0000 7f04c6325800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:52.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.230+0000 7f04c6325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:52.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.231+0000 7f03737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:52.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.233+0000 7f04c6325800 20 remove_watcher() i=0 2024-09-12T00:50:52.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.233+0000 7f04c6325800 2 removed watcher, disabling cache 2024-09-12T00:50:52.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.234+0000 7f04c6325800 20 remove_watcher() i=1 2024-09-12T00:50:52.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.235+0000 7f04c6325800 20 remove_watcher() i=2 2024-09-12T00:50:52.235 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.236+0000 7f04c6325800 20 remove_watcher() i=3 2024-09-12T00:50:52.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.237+0000 7f04c6325800 20 remove_watcher() i=4 2024-09-12T00:50:52.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.238+0000 7f04c6325800 20 remove_watcher() i=5 2024-09-12T00:50:52.238 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.239+0000 7f04c6325800 20 remove_watcher() i=6 2024-09-12T00:50:52.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:52.240+0000 7f04c6325800 20 remove_watcher() i=7 2024-09-12T00:50:52.250 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:52.250 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:52.250 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-set-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:50:52.250 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:52.561 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T00:50:52.562 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:53.411 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:50:53.441 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:53.441 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:53.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.480+0000 7f1d6142f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.482+0000 7f1d6142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:53.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.482+0000 7f1d6142f800 20 realm 2024-09-12T00:50:53.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.482+0000 7f1d6142f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.482+0000 7f1d6142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:53.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.482+0000 7f1d6142f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:53.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.482+0000 7f1d6142f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.483+0000 7f1d6142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:53.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.483+0000 7f1d6142f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.483+0000 7f1d6142f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:53.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.483+0000 7f1d6142f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.484+0000 7f1d6142f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:53.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.484+0000 7f1d6142f800 20 searching for the correct realm 2024-09-12T00:50:53.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.487+0000 7f1d5e71f640 0 -- 172.21.15.62:0/2461091047 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f1d580a9280 msgr2=0x7f1d580ac9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:53.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.692+0000 7f1d5ef20640 0 -- 172.21.15.62:0/2461091047 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f1d580ba230 msgr2=0x7f1d580a32e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:53.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.696+0000 7f1d6142f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:53.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.696+0000 7f1d6142f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:53.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.696+0000 7f1d6142f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:53.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.696+0000 7f1d6142f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:53.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.696+0000 7f1d6142f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:53.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.696+0000 7f1d6142f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:53.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.696+0000 7f1d6142f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.696+0000 7f1d6142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:53.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.696+0000 7f1d6142f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.697+0000 7f1d6142f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:53.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.697+0000 7f1d6142f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.697+0000 7f1d6142f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:53.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.697+0000 7f1d6142f800 20 zone default found 2024-09-12T00:50:53.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.697+0000 7f1d6142f800 4 Realm: () 2024-09-12T00:50:53.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.697+0000 7f1d6142f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:53.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.697+0000 7f1d6142f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:53.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.697+0000 7f1d6142f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:53.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.697+0000 7f1d6142f800 20 zonegroup default 2024-09-12T00:50:53.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.697+0000 7f1d6142f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.698 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.697+0000 7f1d6142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:53.698 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.697+0000 7f1d6142f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.698 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.698+0000 7f1d6142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:53.698 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.698+0000 7f1d6142f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.698 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.698+0000 7f1d6142f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:53.699 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.698+0000 7f1d6142f800 20 started sync module instance, tier type = 2024-09-12T00:50:53.699 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.698+0000 7f1d6142f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:53.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.706+0000 7f1d6142f800 20 add_watcher() i=0 2024-09-12T00:50:53.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.706+0000 7f1d6142f800 20 add_watcher() i=1 2024-09-12T00:50:53.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.706+0000 7f1d6142f800 20 add_watcher() i=2 2024-09-12T00:50:53.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.706+0000 7f1d6142f800 20 add_watcher() i=3 2024-09-12T00:50:53.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.706+0000 7f1d6142f800 20 add_watcher() i=4 2024-09-12T00:50:53.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.706+0000 7f1d6142f800 20 add_watcher() i=5 2024-09-12T00:50:53.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.706+0000 7f1d6142f800 20 add_watcher() i=6 2024-09-12T00:50:53.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.707+0000 7f1d6142f800 20 add_watcher() i=7 2024-09-12T00:50:53.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.707+0000 7f1d6142f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:53.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.709+0000 7f1c157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:53.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.709+0000 7f1d6142f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:53.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.709+0000 7f1d6142f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:53.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.709+0000 7f1d6142f800 5 note: GC not initialized 2024-09-12T00:50:53.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.709+0000 7f1b8ffff640 20 reqs_thread_entry: start 2024-09-12T00:50:53.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.709+0000 7f1d6142f800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:53.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.709+0000 7f1d6142f800 20 Filter name: none 2024-09-12T00:50:53.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.710+0000 7f1b8dffb640 20 reqs_thread_entry: start 2024-09-12T00:50:53.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.710+0000 7f1d6142f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.710+0000 7f1d6142f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:53.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.710+0000 7f1d6142f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.711+0000 7f1d6142f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:53.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.711+0000 7f1d6142f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:53.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.711+0000 7f1d6142f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.711+0000 7f1d6142f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:53.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.711+0000 7f1d6142f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.711+0000 7f1d6142f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:53.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.711+0000 7f1d6142f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:53.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.713+0000 7f1c157e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:53.714 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.715+0000 7f1d6142f800 20 remove_watcher() i=0 2024-09-12T00:50:53.714 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.715+0000 7f1d6142f800 2 removed watcher, disabling cache 2024-09-12T00:50:53.714 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.716+0000 7f1d6142f800 20 remove_watcher() i=1 2024-09-12T00:50:53.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.717+0000 7f1d6142f800 20 remove_watcher() i=2 2024-09-12T00:50:53.716 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.717+0000 7f1d6142f800 20 remove_watcher() i=3 2024-09-12T00:50:53.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.718+0000 7f1d6142f800 20 remove_watcher() i=4 2024-09-12T00:50:53.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.719+0000 7f1d6142f800 20 remove_watcher() i=5 2024-09-12T00:50:53.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.720+0000 7f1d6142f800 20 remove_watcher() i=6 2024-09-12T00:50:53.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.721+0000 7f1d6142f800 20 remove_watcher() i=7 2024-09-12T00:50:53.732 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:53.732 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:53.732 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-set-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:53.732 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:53.733 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T00:50:53.770 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:53.771 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:53.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.810+0000 7fb5fc020800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.812+0000 7fb5fc020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:53.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.812+0000 7fb5fc020800 20 realm 2024-09-12T00:50:53.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.812+0000 7fb5fc020800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.812+0000 7fb5fc020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:53.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.812+0000 7fb5fc020800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:53.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.812+0000 7fb5fc020800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.812+0000 7fb5fc020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:53.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.812+0000 7fb5fc020800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.813+0000 7fb5fc020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:53.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.813+0000 7fb5fc020800 20 rados->read ofs=0 len=0 2024-09-12T00:50:53.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.814+0000 7fb5fc020800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:53.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.814+0000 7fb5fc020800 20 searching for the correct realm 2024-09-12T00:50:53.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:53.816+0000 7fb5f9309640 0 -- 172.21.15.62:0/3417544341 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fb5f40aa180 msgr2=0x7fb5f40ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:54.021 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.021+0000 7fb5fa30b640 0 -- 172.21.15.62:0/3417544341 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x555e121a2bb0 msgr2=0x555e121a5030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:54.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.025+0000 7fb5fc020800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:54.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.025+0000 7fb5fc020800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:54.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.025+0000 7fb5fc020800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:54.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.025+0000 7fb5fc020800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:54.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.025+0000 7fb5fc020800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:54.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.025+0000 7fb5fc020800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:54.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.025+0000 7fb5fc020800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.026+0000 7fb5fc020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:54.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.026+0000 7fb5fc020800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.026+0000 7fb5fc020800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:54.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.026+0000 7fb5fc020800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.027+0000 7fb5fc020800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:54.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.027+0000 7fb5fc020800 20 zone default found 2024-09-12T00:50:54.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.027+0000 7fb5fc020800 4 Realm: () 2024-09-12T00:50:54.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.027+0000 7fb5fc020800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:54.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.027+0000 7fb5fc020800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:54.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.027+0000 7fb5fc020800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:54.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.027+0000 7fb5fc020800 20 zonegroup default 2024-09-12T00:50:54.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.027+0000 7fb5fc020800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.027+0000 7fb5fc020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:54.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.027+0000 7fb5fc020800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.027+0000 7fb5fc020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:54.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.027+0000 7fb5fc020800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.028 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.028+0000 7fb5fc020800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:54.028 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.028+0000 7fb5fc020800 20 started sync module instance, tier type = 2024-09-12T00:50:54.028 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.028+0000 7fb5fc020800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:54.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.036+0000 7fb5fc020800 20 add_watcher() i=0 2024-09-12T00:50:54.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.036+0000 7fb5fc020800 20 add_watcher() i=1 2024-09-12T00:50:54.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.036+0000 7fb5fc020800 20 add_watcher() i=2 2024-09-12T00:50:54.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.036+0000 7fb5fc020800 20 add_watcher() i=3 2024-09-12T00:50:54.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.036+0000 7fb5fc020800 20 add_watcher() i=4 2024-09-12T00:50:54.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.036+0000 7fb5fc020800 20 add_watcher() i=5 2024-09-12T00:50:54.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.036+0000 7fb5fc020800 20 add_watcher() i=6 2024-09-12T00:50:54.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.037+0000 7fb5fc020800 20 add_watcher() i=7 2024-09-12T00:50:54.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.037+0000 7fb5fc020800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:54.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.039+0000 7fb4ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:54.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.040+0000 7fb5fc020800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:54.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.040+0000 7fb5fc020800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:54.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.040+0000 7fb5fc020800 5 note: GC not initialized 2024-09-12T00:50:54.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.040+0000 7fb4aa7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:54.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.040+0000 7fb5fc020800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:54.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.040+0000 7fb5fc020800 20 Filter name: none 2024-09-12T00:50:54.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.040+0000 7fb41bfff640 20 reqs_thread_entry: start 2024-09-12T00:50:54.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.040+0000 7fb5fc020800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:50:54.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.040+0000 7fb5fc020800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.041+0000 7fb5fc020800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:54.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.041+0000 7fb5fc020800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:50:54.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.041+0000 7fb5fc020800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:50:54.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.041+0000 7fb5fc020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 : miss 2024-09-12T00:50:54.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.041+0000 7fb5fc020800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.041+0000 7fb5fc020800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:54.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.041+0000 7fb5fc020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 info.flags=0x17 2024-09-12T00:50:54.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.041+0000 7fb5fc020800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 to cache LRU end 2024-09-12T00:50:54.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.041+0000 7fb5fc020800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:54.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.041+0000 7fb5fc020800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:54.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.041+0000 7fb5fc020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 2024-09-12T00:50:54.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.043+0000 7fb5fc020800 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T00:50:54.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.045+0000 7fb5fc020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 info.flags=0x17 2024-09-12T00:50:54.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.045+0000 7fb5fc020800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 to cache LRU end 2024-09-12T00:50:54.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.045+0000 7fb5fc020800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:54.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.045+0000 7fb5fc020800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23, ofs0, ns] 2024-09-12T00:50:54.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.045+0000 7fb4dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431643 cookie 93862519058768 notifier 6251 bl.length()=925 2024-09-12T00:50:54.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.045+0000 7fb4dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 info.flags=0x17 2024-09-12T00:50:54.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.045+0000 7fb4dd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 to cache LRU end 2024-09-12T00:50:54.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.045+0000 7fb4dd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:54.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.047+0000 7fb5fc020800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23]): orig_sources= new_sources= 2024-09-12T00:50:54.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.047+0000 7fb5fc020800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23]): potential sources added=[] removed=[] 2024-09-12T00:50:54.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.047+0000 7fb5fc020800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23]): orig_dests= new_dests= 2024-09-12T00:50:54.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.047+0000 7fb5fc020800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23]): potential dests added=[] removed=[] 2024-09-12T00:50:54.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.049+0000 7fb5fc020800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23.1.0 2024-09-12T00:50:54.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.049+0000 7fb5fc020800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23.1.0 2024-09-12T00:50:54.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.049+0000 7fb5fc020800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23.1.1 2024-09-12T00:50:54.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.049+0000 7fb5fc020800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23.1.1 2024-09-12T00:50:54.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.049+0000 7fb5fc020800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23.0 2024-09-12T00:50:54.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.052+0000 7fb5fc020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:54.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.052+0000 7fb5fc020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 2024-09-12T00:50:54.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.053+0000 7fb5fc020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 info.flags=0x17 2024-09-12T00:50:54.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.053+0000 7fb5fc020800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 to cache LRU end 2024-09-12T00:50:54.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.053+0000 7fb5fc020800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:54.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.053+0000 7fb5fc020800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23, ofs0, ns] 2024-09-12T00:50:54.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.053+0000 7fb4dd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431644 cookie 93862519058768 notifier 6251 bl.length()=925 2024-09-12T00:50:54.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.053+0000 7fb4dd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 info.flags=0x17 2024-09-12T00:50:54.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.053+0000 7fb4dd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 to cache LRU end 2024-09-12T00:50:54.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.053+0000 7fb4dd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:54.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.055+0000 7fb5fc020800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23]): orig_sources= new_sources= 2024-09-12T00:50:54.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.055+0000 7fb5fc020800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23]): potential sources added=[] removed=[] 2024-09-12T00:50:54.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.055+0000 7fb5fc020800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23]): orig_dests= new_dests= 2024-09-12T00:50:54.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.055+0000 7fb5fc020800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23]): potential dests added=[] removed=[] 2024-09-12T00:50:54.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.056+0000 7fb5fc020800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23.0 2024-09-12T00:50:54.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.056+0000 7fb5fc020800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:54.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.056+0000 7fb5fc020800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 2024-09-12T00:50:54.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.058+0000 7fb5fc020800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 info.flags=0x17 2024-09-12T00:50:54.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.058+0000 7fb5fc020800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 to cache LRU end 2024-09-12T00:50:54.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.058+0000 7fb5fc020800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:54.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.058+0000 7fb5fc020800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23, ofs0, ns] 2024-09-12T00:50:54.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.058+0000 7fb4dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431645 cookie 93862519058768 notifier 6251 bl.length()=893 2024-09-12T00:50:54.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.058+0000 7fb4dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 info.flags=0x17 2024-09-12T00:50:54.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.058+0000 7fb4dcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 to cache LRU end 2024-09-12T00:50:54.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.058+0000 7fb4dcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:54.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.060+0000 7fb5fc020800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23]): orig_sources= new_sources= 2024-09-12T00:50:54.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.060+0000 7fb5fc020800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23]): potential sources added=[] removed=[] 2024-09-12T00:50:54.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.060+0000 7fb5fc020800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23]): orig_dests= new_dests= 2024-09-12T00:50:54.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.060+0000 7fb5fc020800 20 handle_bi_update(): bucket=:error-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23]): potential dests added=[] removed=[] 2024-09-12T00:50:54.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.061+0000 7fb5fc020800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:50:54.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.063+0000 7fb4ab7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:54.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.066+0000 7fb5fc020800 20 remove_watcher() i=0 2024-09-12T00:50:54.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.066+0000 7fb5fc020800 2 removed watcher, disabling cache 2024-09-12T00:50:54.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.067+0000 7fb5fc020800 20 remove_watcher() i=1 2024-09-12T00:50:54.066 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.068+0000 7fb5fc020800 20 remove_watcher() i=2 2024-09-12T00:50:54.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.069+0000 7fb5fc020800 20 remove_watcher() i=3 2024-09-12T00:50:54.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.069+0000 7fb5fc020800 20 remove_watcher() i=4 2024-09-12T00:50:54.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.070+0000 7fb5fc020800 20 remove_watcher() i=5 2024-09-12T00:50:54.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.071+0000 7fb5fc020800 20 remove_watcher() i=6 2024-09-12T00:50:54.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.072+0000 7fb5fc020800 20 remove_watcher() i=7 2024-09-12T00:50:54.084 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:50:54.113 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:54.114 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:54.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.154+0000 7fd44c013800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.156+0000 7fd44c013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:54.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.156+0000 7fd44c013800 20 realm 2024-09-12T00:50:54.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.156+0000 7fd44c013800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.156+0000 7fd44c013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:54.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.156+0000 7fd44c013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:54.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.156+0000 7fd44c013800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.156+0000 7fd44c013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:54.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.156+0000 7fd44c013800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.157+0000 7fd44c013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:54.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.157+0000 7fd44c013800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.157+0000 7fd44c013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:54.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.157+0000 7fd44c013800 20 searching for the correct realm 2024-09-12T00:50:54.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.161+0000 7fd446f47640 0 -- 172.21.15.62:0/1038398074 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fd440061040 msgr2=0x7fd440080910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:54.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.367+0000 7fd447f49640 0 -- 172.21.15.62:0/1038398074 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5600f0b59d90 msgr2=0x5600f0b5c180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:54.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.370+0000 7fd44c013800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:54.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.370+0000 7fd44c013800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:54.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.370+0000 7fd44c013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:54.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.370+0000 7fd44c013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:54.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.370+0000 7fd44c013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:54.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.370+0000 7fd44c013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:54.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.370+0000 7fd44c013800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.371+0000 7fd44c013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:54.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.371+0000 7fd44c013800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.371+0000 7fd44c013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:54.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.371+0000 7fd44c013800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.371+0000 7fd44c013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:54.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.371+0000 7fd44c013800 20 zone default found 2024-09-12T00:50:54.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.371+0000 7fd44c013800 4 Realm: () 2024-09-12T00:50:54.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.371+0000 7fd44c013800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:54.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.371+0000 7fd44c013800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:54.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.371+0000 7fd44c013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:54.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.371+0000 7fd44c013800 20 zonegroup default 2024-09-12T00:50:54.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.371+0000 7fd44c013800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.372+0000 7fd44c013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:54.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.372+0000 7fd44c013800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.372+0000 7fd44c013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:54.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.372+0000 7fd44c013800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.373+0000 7fd44c013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:54.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.373+0000 7fd44c013800 20 started sync module instance, tier type = 2024-09-12T00:50:54.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.373+0000 7fd44c013800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:54.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.381+0000 7fd44c013800 20 add_watcher() i=0 2024-09-12T00:50:54.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.381+0000 7fd44c013800 20 add_watcher() i=1 2024-09-12T00:50:54.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.381+0000 7fd44c013800 20 add_watcher() i=2 2024-09-12T00:50:54.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.381+0000 7fd44c013800 20 add_watcher() i=3 2024-09-12T00:50:54.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.381+0000 7fd44c013800 20 add_watcher() i=4 2024-09-12T00:50:54.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.381+0000 7fd44c013800 20 add_watcher() i=5 2024-09-12T00:50:54.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.381+0000 7fd44c013800 20 add_watcher() i=6 2024-09-12T00:50:54.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.382+0000 7fd44c013800 20 add_watcher() i=7 2024-09-12T00:50:54.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.382+0000 7fd44c013800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:54.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.384+0000 7fd2fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:54.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.385+0000 7fd44c013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:54.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.385+0000 7fd44c013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:54.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.385+0000 7fd44c013800 5 note: GC not initialized 2024-09-12T00:50:54.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.385+0000 7fd2fcfe1640 20 reqs_thread_entry: start 2024-09-12T00:50:54.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.385+0000 7fd44c013800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:54.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.385+0000 7fd44c013800 20 Filter name: none 2024-09-12T00:50:54.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.385+0000 7fd2767fc640 20 reqs_thread_entry: start 2024-09-12T00:50:54.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.385+0000 7fd44c013800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.386+0000 7fd44c013800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:54.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.386+0000 7fd44c013800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.386+0000 7fd44c013800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:54.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.386+0000 7fd44c013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:54.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.386+0000 7fd44c013800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.387+0000 7fd44c013800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:54.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.387+0000 7fd44c013800 20 rados->read ofs=0 len=0 2024-09-12T00:50:54.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.387+0000 7fd44c013800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:54.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.387+0000 7fd44c013800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:54.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.388+0000 7fd2fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:54.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.390+0000 7fd44c013800 20 remove_watcher() i=0 2024-09-12T00:50:54.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.390+0000 7fd44c013800 2 removed watcher, disabling cache 2024-09-12T00:50:54.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.392+0000 7fd44c013800 20 remove_watcher() i=1 2024-09-12T00:50:54.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.393+0000 7fd44c013800 20 remove_watcher() i=2 2024-09-12T00:50:54.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.394+0000 7fd44c013800 20 remove_watcher() i=3 2024-09-12T00:50:54.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.395+0000 7fd44c013800 20 remove_watcher() i=4 2024-09-12T00:50:54.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.396+0000 7fd44c013800 20 remove_watcher() i=5 2024-09-12T00:50:54.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.396+0000 7fd44c013800 20 remove_watcher() i=6 2024-09-12T00:50:54.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:54.397+0000 7fd44c013800 20 remove_watcher() i=7 2024-09-12T00:50:54.407 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:54.408 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:54.408 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-set-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:50:54.408 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:54.746 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T00:50:54.746 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:55.600 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:50:55.630 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:55.631 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:55.669 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:55.670+0000 7f5e9de98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:55.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:55.672+0000 7f5e9de98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:55.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:55.672+0000 7f5e9de98800 20 realm 2024-09-12T00:50:55.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:55.672+0000 7f5e9de98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:55.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:55.672+0000 7f5e9de98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:55.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:55.672+0000 7f5e9de98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:55.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:55.672+0000 7f5e9de98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:55.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:55.672+0000 7f5e9de98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:55.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:55.672+0000 7f5e9de98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:55.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:55.673+0000 7f5e9de98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:55.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:55.673+0000 7f5e9de98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:55.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:55.674+0000 7f5e9de98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:55.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:55.674+0000 7f5e9de98800 20 searching for the correct realm 2024-09-12T00:50:55.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:55.877+0000 7f5e9c183640 0 -- 172.21.15.62:0/3540497304 >> [v2:172.21.15.77:6816/3177889521,v1:172.21.15.77:6817/3177889521] conn(0x5598c43b96a0 msgr2=0x5598c43bbb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:55.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:55.880+0000 7f5e9b982640 0 -- 172.21.15.62:0/3540497304 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f5e94073420 msgr2=0x7f5e94073880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:56.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.086+0000 7f5e9de98800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:56.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.086+0000 7f5e9de98800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:56.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.086+0000 7f5e9de98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:56.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.086+0000 7f5e9de98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:56.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.086+0000 7f5e9de98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:56.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.086+0000 7f5e9de98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:56.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.086+0000 7f5e9de98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.087+0000 7f5e9de98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.087+0000 7f5e9de98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.087+0000 7f5e9de98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:56.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.087+0000 7f5e9de98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.087+0000 7f5e9de98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:56.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.087+0000 7f5e9de98800 20 zone default found 2024-09-12T00:50:56.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.087+0000 7f5e9de98800 4 Realm: () 2024-09-12T00:50:56.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.087+0000 7f5e9de98800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:56.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.087+0000 7f5e9de98800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:56.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.087+0000 7f5e9de98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:56.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.087+0000 7f5e9de98800 20 zonegroup default 2024-09-12T00:50:56.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.087+0000 7f5e9de98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.088+0000 7f5e9de98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.088+0000 7f5e9de98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.088+0000 7f5e9de98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.088+0000 7f5e9de98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.088+0000 7f5e9de98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.088+0000 7f5e9de98800 20 started sync module instance, tier type = 2024-09-12T00:50:56.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.088+0000 7f5e9de98800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:56.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.097+0000 7f5e9de98800 20 add_watcher() i=0 2024-09-12T00:50:56.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.097+0000 7f5e9de98800 20 add_watcher() i=1 2024-09-12T00:50:56.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.097+0000 7f5e9de98800 20 add_watcher() i=2 2024-09-12T00:50:56.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.097+0000 7f5e9de98800 20 add_watcher() i=3 2024-09-12T00:50:56.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.097+0000 7f5e9de98800 20 add_watcher() i=4 2024-09-12T00:50:56.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.097+0000 7f5e9de98800 20 add_watcher() i=5 2024-09-12T00:50:56.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.097+0000 7f5e9de98800 20 add_watcher() i=6 2024-09-12T00:50:56.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.099+0000 7f5e9de98800 20 add_watcher() i=7 2024-09-12T00:50:56.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.099+0000 7f5e9de98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:56.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.100+0000 7f5d51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:56.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.101+0000 7f5e9de98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:56.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.101+0000 7f5e9de98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:56.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.101+0000 7f5e9de98800 5 note: GC not initialized 2024-09-12T00:50:56.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.101+0000 7f5d50fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:56.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.101+0000 7f5e9de98800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:56.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.101+0000 7f5e9de98800 20 Filter name: none 2024-09-12T00:50:56.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.101+0000 7f5cca7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:56.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.102+0000 7f5e9de98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.102+0000 7f5e9de98800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:56.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.102+0000 7f5e9de98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.103+0000 7f5e9de98800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:56.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.103+0000 7f5e9de98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:56.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.103+0000 7f5e9de98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.103+0000 7f5e9de98800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:56.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.103+0000 7f5e9de98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.103+0000 7f5e9de98800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:56.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.103+0000 7f5e9de98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:56.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.105+0000 7f5d51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:56.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.108+0000 7f5e9de98800 20 remove_watcher() i=0 2024-09-12T00:50:56.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.108+0000 7f5e9de98800 2 removed watcher, disabling cache 2024-09-12T00:50:56.108 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.109+0000 7f5e9de98800 20 remove_watcher() i=1 2024-09-12T00:50:56.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.110+0000 7f5e9de98800 20 remove_watcher() i=2 2024-09-12T00:50:56.110 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.111+0000 7f5e9de98800 20 remove_watcher() i=3 2024-09-12T00:50:56.111 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.112+0000 7f5e9de98800 20 remove_watcher() i=4 2024-09-12T00:50:56.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.113+0000 7f5e9de98800 20 remove_watcher() i=5 2024-09-12T00:50:56.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.114+0000 7f5e9de98800 20 remove_watcher() i=6 2024-09-12T00:50:56.114 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.115+0000 7f5e9de98800 20 remove_watcher() i=7 2024-09-12T00:50:56.126 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.126 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:56.126 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-set-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:56.126 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.128 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T00:50:56.163 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:56.163 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:56.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.204+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.205+0000 7f3c1501d800 20 realm 2024-09-12T00:50:56.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.205+0000 7f3c1501d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:56.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.206+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:56.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.206+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.207+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:56.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.207+0000 7f3c1501d800 20 searching for the correct realm 2024-09-12T00:50:56.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.210+0000 7f3c0ffea640 0 -- 172.21.15.62:0/2687896629 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f3c0804c1d0 msgr2=0x7f3c08048980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:56.212 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.213+0000 7f3c10fec640 0 -- 172.21.15.62:0/2687896629 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x559c3a499300 msgr2=0x559c3a49b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:56.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:56.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:56.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:56.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:56.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:56.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:56.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.217+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.217+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.217+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.217+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:56.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.217+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:56.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.218+0000 7f3c1501d800 20 zone default found 2024-09-12T00:50:56.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.218+0000 7f3c1501d800 4 Realm: () 2024-09-12T00:50:56.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.218+0000 7f3c1501d800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:56.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.218+0000 7f3c1501d800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:56.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.218+0000 7f3c1501d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:56.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.218+0000 7f3c1501d800 20 zonegroup default 2024-09-12T00:50:56.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.219+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.219+0000 7f3c1501d800 20 started sync module instance, tier type = 2024-09-12T00:50:56.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.219+0000 7f3c1501d800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:56.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=0 2024-09-12T00:50:56.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=1 2024-09-12T00:50:56.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=2 2024-09-12T00:50:56.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=3 2024-09-12T00:50:56.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=4 2024-09-12T00:50:56.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=5 2024-09-12T00:50:56.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=6 2024-09-12T00:50:56.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.228+0000 7f3c1501d800 20 add_watcher() i=7 2024-09-12T00:50:56.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.228+0000 7f3c1501d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:56.229 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.230+0000 7f3ac6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:56.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.230+0000 7f3c1501d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:56.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.230+0000 7f3c1501d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:56.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.231+0000 7f3c1501d800 5 note: GC not initialized 2024-09-12T00:50:56.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.231+0000 7f3ac5fe3640 20 reqs_thread_entry: start 2024-09-12T00:50:56.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.231+0000 7f3c1501d800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:56.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.231+0000 7f3c1501d800 20 Filter name: none 2024-09-12T00:50:56.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.231+0000 7f3abeffd640 20 reqs_thread_entry: start 2024-09-12T00:50:56.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.231+0000 7f3c1501d800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:50:56.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.231+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.231+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:56.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.231+0000 7f3c1501d800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:50:56.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.231+0000 7f3c1501d800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:50:56.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.231+0000 7f3c1501d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 : miss 2024-09-12T00:50:56.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.231+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.232+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:56.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.232+0000 7f3c1501d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 info.flags=0x17 2024-09-12T00:50:56.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.232+0000 7f3c1501d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 to cache LRU end 2024-09-12T00:50:56.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.232+0000 7f3c1501d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:56.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.232+0000 7f3c1501d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:56.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.232+0000 7f3c1501d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 2024-09-12T00:50:56.233 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3c1501d800 time 2024-09-12T00:50:56.235803+0000 2024-09-12T00:50:56.233 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:56.234 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:56.234 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3c1618c71a] 2024-09-12T00:50:56.234 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c1618c8d8] 2024-09-12T00:50:56.234 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c392c0641] 2024-09-12T00:50:56.235 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd878e8) [0x559c397d28e8] 2024-09-12T00:50:56.235 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c392d031d] 2024-09-12T00:50:56.235 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:50:56.235 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3c14e29590] 2024-09-12T00:50:56.235 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:50:56.235 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:50:56.235 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.235+0000 7f3c1501d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3c1501d800 time 2024-09-12T00:50:56.235803+0000 2024-09-12T00:50:56.235 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:56.235 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.235 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:56.235 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3c1618c71a] 2024-09-12T00:50:56.235 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c1618c8d8] 2024-09-12T00:50:56.236 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c392c0641] 2024-09-12T00:50:56.236 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd878e8) [0x559c397d28e8] 2024-09-12T00:50:56.236 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c392d031d] 2024-09-12T00:50:56.236 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:50:56.236 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3c14e29590] 2024-09-12T00:50:56.236 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:50:56.236 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:50:56.236 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.236 INFO:tasks.workunit.client.0.smithi062.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:50:56.236 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f3c1501d800 thread_name:radosgw-admin 2024-09-12T00:50:56.250 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:56.250 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3c14e3e6f0] 2024-09-12T00:50:56.250 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3c14e8b99c] 2024-09-12T00:50:56.250 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:50:56.250 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:50:56.250 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3c1618c774] 2024-09-12T00:50:56.250 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c1618c8d8] 2024-09-12T00:50:56.250 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c392c0641] 2024-09-12T00:50:56.250 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd878e8) [0x559c397d28e8] 2024-09-12T00:50:56.250 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c392d031d] 2024-09-12T00:50:56.251 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:50:56.251 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3c14e29590] 2024-09-12T00:50:56.251 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:50:56.251 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:50:56.251 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.236+0000 7f3c1501d800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:56.251 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f3c1501d800 thread_name:radosgw-admin 2024-09-12T00:50:56.251 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.251 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:56.251 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3c14e3e6f0] 2024-09-12T00:50:56.251 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3c14e8b99c] 2024-09-12T00:50:56.251 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:50:56.251 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:50:56.252 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3c1618c774] 2024-09-12T00:50:56.252 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c1618c8d8] 2024-09-12T00:50:56.252 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c392c0641] 2024-09-12T00:50:56.252 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd878e8) [0x559c397d28e8] 2024-09-12T00:50:56.252 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c392d031d] 2024-09-12T00:50:56.252 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:50:56.252 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3c14e29590] 2024-09-12T00:50:56.252 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:50:56.252 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:50:56.252 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:56.252 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.252 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:50:56.252 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:50:56.186+0000 7f3c107eb640 10 monclient(hunting): handle_auth_done global_id 6293 payload 274 2024-09-12T00:50:56.253 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:50:56.186+0000 7f3c107eb640 10 monclient: _finish_hunting 0 2024-09-12T00:50:56.253 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:50:56.186+0000 7f3c107eb640 1 monclient: found mon.noname-c 2024-09-12T00:50:56.253 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:50:56.186+0000 7f3c107eb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.253 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:50:56.186+0000 7f3c10fec640 10 monclient: get_auth_request con 0x559c3a3dfa60 auth_method 0 2024-09-12T00:50:56.253 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.253 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:56.253 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: dump: 2024-09-12T00:50:56.253 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.253 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.253 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.253 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.253 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.253 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.254 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.254 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.254 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.254 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.254 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: _finish_auth 0 2024-09-12T00:50:56.254 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: _check_auth_tickets 2024-09-12T00:50:56.254 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:56.254 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:50:56.186+0000 7f3c1501d800 5 monclient: authenticate success, global_id 6293 2024-09-12T00:50:56.254 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:50:56.186+0000 7f3c1501d800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:56.254 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:50:56.186+0000 7f3c1501d800 4 set_mon_vals no callback set 2024-09-12T00:50:56.254 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.254 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:56.254 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: dump: 2024-09-12T00:50:56.255 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.255 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.255 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.255 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.255 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.255 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.255 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.255 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.255 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.255 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.255 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:50:56.187+0000 7f3c1501d800 10 monclient: shutdown 2024-09-12T00:50:56.255 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 asok(0x559c3a18e630) unregister_commands rotate-key 2024-09-12T00:50:56.255 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:50:56.187+0000 7f3c1501d800 10 monclient: build_initial_monmap 2024-09-12T00:50:56.256 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:50:56.187+0000 7f3c1501d800 1 build_initial for_mkfs: 0 2024-09-12T00:50:56.256 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:50:56.187+0000 7f3c1501d800 10 monclient: monmap: 2024-09-12T00:50:56.256 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:56.256 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:56.256 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:56.256 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:56.256 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:56.256 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.256 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:56.256 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:56.256 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:56.256 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.256 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding auth protocol: cephx 2024-09-12T00:50:56.257 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding auth protocol: cephx 2024-09-12T00:50:56.257 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding auth protocol: cephx 2024-09-12T00:50:56.257 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: secure 2024-09-12T00:50:56.257 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: crc 2024-09-12T00:50:56.257 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: secure 2024-09-12T00:50:56.257 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: crc 2024-09-12T00:50:56.257 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: secure 2024-09-12T00:50:56.257 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: crc 2024-09-12T00:50:56.257 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: crc 2024-09-12T00:50:56.257 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: secure 2024-09-12T00:50:56.257 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: crc 2024-09-12T00:50:56.257 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: secure 2024-09-12T00:50:56.257 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: crc 2024-09-12T00:50:56.258 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: secure 2024-09-12T00:50:56.258 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:50:56.187+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.258 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:50:56.187+0000 7f3c1501d800 1 librados: starting msgr at 2024-09-12T00:50:56.258 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:50:56.187+0000 7f3c1501d800 1 librados: starting objecter 2024-09-12T00:50:56.258 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command objecter_requests hook 0x559c3a3d8730 2024-09-12T00:50:56.258 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:50:56.187+0000 7f3c1501d800 1 librados: setting wanted keys 2024-09-12T00:50:56.258 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:50:56.187+0000 7f3c1501d800 1 librados: calling monclient init 2024-09-12T00:50:56.258 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:50:56.187+0000 7f3c1501d800 10 monclient: init 2024-09-12T00:50:56.258 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding auth protocol: cephx 2024-09-12T00:50:56.258 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding auth protocol: cephx 2024-09-12T00:50:56.258 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding auth protocol: cephx 2024-09-12T00:50:56.258 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: secure 2024-09-12T00:50:56.258 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: crc 2024-09-12T00:50:56.259 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: secure 2024-09-12T00:50:56.259 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: crc 2024-09-12T00:50:56.259 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: secure 2024-09-12T00:50:56.259 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: crc 2024-09-12T00:50:56.259 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: crc 2024-09-12T00:50:56.259 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: secure 2024-09-12T00:50:56.259 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: crc 2024-09-12T00:50:56.259 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: secure 2024-09-12T00:50:56.259 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: crc 2024-09-12T00:50:56.259 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: secure 2024-09-12T00:50:56.259 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:50:56.188+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.259 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:50:56.188+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.259 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:50:56.188+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command rotate-key hook 0x559c3a3adcd8 2024-09-12T00:50:56.260 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:56.260 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:50:56.260 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-a con 0x559c3a2638b0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:56.260 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-b con 0x559c3a266b00 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:56.260 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-c con 0x559c3a3dfa60 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:56.260 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.260 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.260 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.260 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:56.260 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): authenticate will time out at 1942.681426s 2024-09-12T00:50:56.260 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): get_auth_request con 0x559c3a3dfa60 auth_method 0 2024-09-12T00:50:56.260 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.260 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.261 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.261 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:50:56.188+0000 7f3c107eb640 10 monclient(hunting): get_auth_request con 0x559c3a2638b0 auth_method 0 2024-09-12T00:50:56.261 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:50:56.188+0000 7f3c107eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.261 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:50:56.188+0000 7f3c107eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.261 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:50:56.188+0000 7f3c107eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.261 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.261 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.261 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.261 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:50:56.188+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.261 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:50:56.188+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.261 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:50:56.188+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.261 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): handle_auth_done global_id 6296 payload 824 2024-09-12T00:50:56.261 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient: _finish_hunting 0 2024-09-12T00:50:56.262 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:50:56.188+0000 7f3c10fec640 1 monclient: found mon.noname-c 2024-09-12T00:50:56.262 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.262 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:50:56.188+0000 7f3afce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.262 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:56.262 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: dump: 2024-09-12T00:50:56.262 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.262 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.262 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.262 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.262 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.262 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.262 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.262 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.263 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.263 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.263 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: _finish_auth 0 2024-09-12T00:50:56.263 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: _check_auth_tickets 2024-09-12T00:50:56.263 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:56.263 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.263 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:56.263 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: dump: 2024-09-12T00:50:56.263 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.263 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.263 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.263 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.263 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.264 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.264 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.264 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.264 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.264 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.264 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:50:56.189+0000 7f3c1501d800 5 monclient: authenticate success, global_id 6296 2024-09-12T00:50:56.264 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:50:56.189+0000 7f3c1501d800 10 monclient: _renew_subs 2024-09-12T00:50:56.264 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:50:56.189+0000 7f3c1501d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.264 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:50:56.189+0000 7f3afe60c640 4 set_mon_vals no callback set 2024-09-12T00:50:56.264 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:50:56.189+0000 7f3c1501d800 10 monclient: _renew_subs 2024-09-12T00:50:56.264 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:50:56.189+0000 7f3c1501d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.264 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:50:56.189+0000 7f3c1501d800 1 librados: init done 2024-09-12T00:50:56.265 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:50:56.190+0000 7f3afce09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:56.265 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:50:56.190+0000 7f3afce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:56.265 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:50:56.190+0000 7f3afce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:56.265 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:50:56.191+0000 7f3c107eb640 10 monclient: get_auth_request con 0x7f3af8076470 auth_method 0 2024-09-12T00:50:56.265 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:50:56.191+0000 7f3c0ffea640 10 monclient: get_auth_request con 0x559c3a3d6620 auth_method 0 2024-09-12T00:50:56.265 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:50:56.192+0000 7f3c107eb640 10 monclient: get_auth_request con 0x559c3a3f90c0 auth_method 0 2024-09-12T00:50:56.265 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:50:56.192+0000 7f3c0ffea640 10 monclient: get_auth_request con 0x559c3a3fd790 auth_method 0 2024-09-12T00:50:56.265 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:50:56.194+0000 7f3c1501d800 10 monclient: build_initial_monmap 2024-09-12T00:50:56.265 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:50:56.194+0000 7f3c1501d800 1 build_initial for_mkfs: 0 2024-09-12T00:50:56.265 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:50:56.194+0000 7f3c1501d800 10 monclient: monmap: 2024-09-12T00:50:56.265 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:56.265 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:56.265 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:56.266 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:56.266 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:56.266 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.266 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:56.266 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:56.266 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:56.266 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.266 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding auth protocol: cephx 2024-09-12T00:50:56.266 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding auth protocol: cephx 2024-09-12T00:50:56.266 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding auth protocol: cephx 2024-09-12T00:50:56.266 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: secure 2024-09-12T00:50:56.266 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: crc 2024-09-12T00:50:56.267 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: secure 2024-09-12T00:50:56.267 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: crc 2024-09-12T00:50:56.267 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: secure 2024-09-12T00:50:56.267 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: crc 2024-09-12T00:50:56.267 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: crc 2024-09-12T00:50:56.267 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: secure 2024-09-12T00:50:56.267 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: crc 2024-09-12T00:50:56.267 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: secure 2024-09-12T00:50:56.267 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: crc 2024-09-12T00:50:56.267 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: secure 2024-09-12T00:50:56.267 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:50:56.194+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.267 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command objecter_requests cmddesc objecter_requests hook 0x559c3a405e30 EEXIST 2024-09-12T00:50:56.267 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:50:56.194+0000 7f3c1501d800 10 monclient: init 2024-09-12T00:50:56.267 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding auth protocol: cephx 2024-09-12T00:50:56.268 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding auth protocol: cephx 2024-09-12T00:50:56.268 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding auth protocol: cephx 2024-09-12T00:50:56.268 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: secure 2024-09-12T00:50:56.268 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: crc 2024-09-12T00:50:56.268 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: secure 2024-09-12T00:50:56.268 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: crc 2024-09-12T00:50:56.268 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: secure 2024-09-12T00:50:56.268 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: crc 2024-09-12T00:50:56.268 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: crc 2024-09-12T00:50:56.268 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: secure 2024-09-12T00:50:56.268 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: crc 2024-09-12T00:50:56.268 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: secure 2024-09-12T00:50:56.268 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: crc 2024-09-12T00:50:56.269 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: secure 2024-09-12T00:50:56.269 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:50:56.195+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.269 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:50:56.195+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.269 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:50:56.195+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command rotate-key cmddesc rotate-key hook 0x559c3a400ce0 EEXIST 2024-09-12T00:50:56.269 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:56.269 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:50:56.269 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-b con 0x559c3a429b20 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:56.269 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-a con 0x559c3a42bdf0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:56.269 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-c con 0x559c3a4282f0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:56.269 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.269 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.269 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.269 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:56.270 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): authenticate will time out at 1942.688348s 2024-09-12T00:50:56.270 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): get_auth_request con 0x559c3a42bdf0 auth_method 0 2024-09-12T00:50:56.270 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.270 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.270 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.270 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:50:56.195+0000 7f3c10fec640 10 monclient(hunting): get_auth_request con 0x559c3a4282f0 auth_method 0 2024-09-12T00:50:56.270 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:50:56.195+0000 7f3c10fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.270 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:50:56.195+0000 7f3c10fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.270 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:50:56.195+0000 7f3c10fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.270 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.270 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.270 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.270 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:50:56.195+0000 7f3c107eb640 10 monclient(hunting): get_auth_request con 0x559c3a429b20 auth_method 0 2024-09-12T00:50:56.271 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:50:56.195+0000 7f3c107eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.271 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:50:56.195+0000 7f3c107eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.271 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:50:56.195+0000 7f3c107eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.271 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:50:56.195+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.271 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:50:56.195+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.271 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:50:56.195+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.271 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:50:56.195+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.271 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:50:56.195+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.271 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:50:56.195+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.271 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_done global_id 6636 payload 824 2024-09-12T00:50:56.271 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient: _finish_hunting 0 2024-09-12T00:50:56.271 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 1 monclient: found mon.noname-a 2024-09-12T00:50:56.271 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:50:56.272 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.272 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:56.272 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: dump: 2024-09-12T00:50:56.272 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.272 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.272 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.272 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.272 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.272 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.272 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.272 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.272 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.272 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.273 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: _finish_auth 0 2024-09-12T00:50:56.273 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:50:56.273 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:50:56.196+0000 7f3c1501d800 5 monclient: authenticate success, global_id 6636 2024-09-12T00:50:56.273 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:50:56.196+0000 7f3c1501d800 10 monclient: _renew_subs 2024-09-12T00:50:56.273 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:50:56.196+0000 7f3c1501d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:50:56.273 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:56.273 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.273 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:56.273 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: dump: 2024-09-12T00:50:56.273 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.273 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.274 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.274 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.274 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.274 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.274 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.274 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.274 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.274 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.274 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:50:56.196+0000 7f3c117ed640 4 set_mon_vals no callback set 2024-09-12T00:50:56.274 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:50:56.196+0000 7f3c1501d800 10 monclient: _renew_subs 2024-09-12T00:50:56.274 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:50:56.196+0000 7f3c1501d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:50:56.274 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:50:56.197+0000 7f3af5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:50:56.197+0000 7f3af5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:50:56.197+0000 7f3af5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:50:56.198+0000 7f3c107eb640 10 monclient: get_auth_request con 0x7f3ae8076370 auth_method 0 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:50:56.198+0000 7f3c1501d800 10 monclient: get_monmap_and_config 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:50:56.198+0000 7f3c1501d800 10 monclient: build_initial_monmap 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:50:56.198+0000 7f3c1501d800 1 build_initial for_mkfs: 0 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:50:56.198+0000 7f3c1501d800 10 monclient: monmap: 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:56.275 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.276 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:56.276 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:56.276 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:56.276 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.276 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding auth protocol: cephx 2024-09-12T00:50:56.276 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding auth protocol: cephx 2024-09-12T00:50:56.276 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding auth protocol: cephx 2024-09-12T00:50:56.276 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: secure 2024-09-12T00:50:56.276 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: crc 2024-09-12T00:50:56.276 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: secure 2024-09-12T00:50:56.276 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: crc 2024-09-12T00:50:56.276 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: secure 2024-09-12T00:50:56.276 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: crc 2024-09-12T00:50:56.276 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: crc 2024-09-12T00:50:56.277 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: secure 2024-09-12T00:50:56.277 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: crc 2024-09-12T00:50:56.277 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: secure 2024-09-12T00:50:56.277 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: crc 2024-09-12T00:50:56.277 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: secure 2024-09-12T00:50:56.277 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:50:56.198+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.277 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:50:56.198+0000 7f3c1501d800 10 monclient: init 2024-09-12T00:50:56.277 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding auth protocol: cephx 2024-09-12T00:50:56.277 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding auth protocol: cephx 2024-09-12T00:50:56.277 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding auth protocol: cephx 2024-09-12T00:50:56.277 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: secure 2024-09-12T00:50:56.278 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: crc 2024-09-12T00:50:56.278 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: secure 2024-09-12T00:50:56.278 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: crc 2024-09-12T00:50:56.278 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: secure 2024-09-12T00:50:56.278 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: crc 2024-09-12T00:50:56.278 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: crc 2024-09-12T00:50:56.278 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: secure 2024-09-12T00:50:56.278 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: crc 2024-09-12T00:50:56.278 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: secure 2024-09-12T00:50:56.278 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: crc 2024-09-12T00:50:56.278 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: secure 2024-09-12T00:50:56.278 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:50:56.199+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.279 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:50:56.199+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.279 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:50:56.199+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command rotate-key cmddesc rotate-key hook 0x7ffc6f61b198 EEXIST 2024-09-12T00:50:56.279 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:56.279 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:50:56.279 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-a con 0x559c3a4775b0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:56.279 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-b con 0x559c3a44de80 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:56.279 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-c con 0x559c3a44b2d0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:56.279 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.279 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.279 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.279 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:56.279 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): authenticate will time out at 1942.692422s 2024-09-12T00:50:56.279 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:50:56.199+0000 7f3c107eb640 10 monclient(hunting): get_auth_request con 0x559c3a4775b0 auth_method 0 2024-09-12T00:50:56.280 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:50:56.199+0000 7f3c107eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.280 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:50:56.199+0000 7f3c107eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.280 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:50:56.199+0000 7f3c107eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.280 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): get_auth_request con 0x559c3a44b2d0 auth_method 0 2024-09-12T00:50:56.280 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.280 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.280 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.280 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:50:56.199+0000 7f3c0ffea640 10 monclient(hunting): get_auth_request con 0x559c3a44de80 auth_method 0 2024-09-12T00:50:56.280 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:50:56.199+0000 7f3c0ffea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.280 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:50:56.199+0000 7f3c0ffea640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.280 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:50:56.199+0000 7f3c0ffea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.280 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.280 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.281 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.281 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:50:56.199+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.281 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:50:56.199+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.281 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:50:56.199+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.281 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:50:56.199+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.281 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:50:56.199+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.281 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:50:56.199+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.281 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): handle_auth_done global_id 6302 payload 274 2024-09-12T00:50:56.281 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient: _finish_hunting 0 2024-09-12T00:50:56.281 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:50:56.199+0000 7f3c10fec640 1 monclient: found mon.noname-c 2024-09-12T00:50:56.281 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.281 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.282 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:56.282 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: dump: 2024-09-12T00:50:56.282 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.282 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.282 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.282 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.282 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.282 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.282 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.282 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.282 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.282 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.282 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: _finish_auth 0 2024-09-12T00:50:56.282 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:50:56.283 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 monclient: authenticate success, global_id 6302 2024-09-12T00:50:56.283 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:56.283 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:50:56.200+0000 7f3c1501d800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:56.283 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:50:56.200+0000 7f3c1501d800 4 set_mon_vals no callback set 2024-09-12T00:50:56.283 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.283 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:56.283 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: dump: 2024-09-12T00:50:56.283 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.283 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.283 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.283 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.283 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.283 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.284 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.284 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.284 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.284 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.284 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:50:56.200+0000 7f3c1501d800 10 monclient: shutdown 2024-09-12T00:50:56.284 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:50:56.200+0000 7f3c1501d800 10 monclient: build_initial_monmap 2024-09-12T00:50:56.284 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:50:56.200+0000 7f3c1501d800 1 build_initial for_mkfs: 0 2024-09-12T00:50:56.284 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:50:56.200+0000 7f3c1501d800 10 monclient: monmap: 2024-09-12T00:50:56.284 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:56.284 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:56.284 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:56.284 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:56.284 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:56.285 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.285 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:56.285 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:56.285 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:56.285 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.285 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding auth protocol: cephx 2024-09-12T00:50:56.285 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding auth protocol: cephx 2024-09-12T00:50:56.285 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding auth protocol: cephx 2024-09-12T00:50:56.285 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: secure 2024-09-12T00:50:56.285 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: crc 2024-09-12T00:50:56.285 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: secure 2024-09-12T00:50:56.285 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: crc 2024-09-12T00:50:56.285 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: secure 2024-09-12T00:50:56.286 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: crc 2024-09-12T00:50:56.286 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: crc 2024-09-12T00:50:56.286 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: secure 2024-09-12T00:50:56.286 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: crc 2024-09-12T00:50:56.286 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: secure 2024-09-12T00:50:56.286 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: crc 2024-09-12T00:50:56.286 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: secure 2024-09-12T00:50:56.286 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:50:56.200+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.286 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:50:56.200+0000 7f3c1501d800 1 librados: starting msgr at 2024-09-12T00:50:56.286 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:50:56.200+0000 7f3c1501d800 1 librados: starting objecter 2024-09-12T00:50:56.286 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command objecter_requests cmddesc objecter_requests hook 0x559c3a46d560 EEXIST 2024-09-12T00:50:56.286 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:50:56.201+0000 7f3c1501d800 1 librados: setting wanted keys 2024-09-12T00:50:56.286 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:50:56.201+0000 7f3c1501d800 1 librados: calling monclient init 2024-09-12T00:50:56.286 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient: init 2024-09-12T00:50:56.287 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding auth protocol: cephx 2024-09-12T00:50:56.287 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding auth protocol: cephx 2024-09-12T00:50:56.287 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding auth protocol: cephx 2024-09-12T00:50:56.287 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: secure 2024-09-12T00:50:56.287 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: crc 2024-09-12T00:50:56.287 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: secure 2024-09-12T00:50:56.287 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: crc 2024-09-12T00:50:56.287 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: secure 2024-09-12T00:50:56.287 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: crc 2024-09-12T00:50:56.287 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: crc 2024-09-12T00:50:56.287 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: secure 2024-09-12T00:50:56.287 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: crc 2024-09-12T00:50:56.287 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: secure 2024-09-12T00:50:56.288 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: crc 2024-09-12T00:50:56.288 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: secure 2024-09-12T00:50:56.288 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:50:56.201+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.288 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:50:56.201+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.288 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command rotate-key cmddesc rotate-key hook 0x559c3a441a18 EEXIST 2024-09-12T00:50:56.288 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:56.288 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:50:56.288 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-a con 0x559c3a44b2d0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:56.288 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-c con 0x559c3a44de80 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:56.288 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-b con 0x559c3a4775b0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:56.288 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.288 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.288 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.288 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:56.289 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): authenticate will time out at 1942.694702s 2024-09-12T00:50:56.289 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): get_auth_request con 0x559c3a44de80 auth_method 0 2024-09-12T00:50:56.289 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.289 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.289 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.289 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:50:56.201+0000 7f3c107eb640 10 monclient(hunting): get_auth_request con 0x559c3a44b2d0 auth_method 0 2024-09-12T00:50:56.289 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:50:56.201+0000 7f3c107eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.289 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:50:56.201+0000 7f3c107eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.289 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:50:56.201+0000 7f3c107eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.289 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.289 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.289 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.289 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:50:56.201+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.290 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:50:56.201+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.290 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:50:56.201+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.290 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:50:56.201+0000 7f3c10fec640 10 monclient(hunting): get_auth_request con 0x559c3a4775b0 auth_method 0 2024-09-12T00:50:56.290 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:50:56.201+0000 7f3c10fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.290 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:50:56.201+0000 7f3c10fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.290 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:50:56.201+0000 7f3c10fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.290 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_done global_id 6305 payload 824 2024-09-12T00:50:56.290 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:50:56.202+0000 7f3c0ffea640 10 monclient: _finish_hunting 0 2024-09-12T00:50:56.290 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:50:56.202+0000 7f3c0ffea640 1 monclient: found mon.noname-c 2024-09-12T00:50:56.290 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:50:56.202+0000 7f3c0ffea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.290 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.290 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:56.290 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: dump: 2024-09-12T00:50:56.290 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.291 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.291 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.291 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.291 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.291 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.291 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.291 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.291 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.291 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.291 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: _finish_auth 0 2024-09-12T00:50:56.291 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: _check_auth_tickets 2024-09-12T00:50:56.291 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:56.291 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.292 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:56.292 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: dump: 2024-09-12T00:50:56.292 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.292 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.292 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.292 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.292 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.292 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.292 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.292 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.292 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.292 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.293 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:50:56.202+0000 7f3c1501d800 5 monclient: authenticate success, global_id 6305 2024-09-12T00:50:56.293 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:50:56.202+0000 7f3aef7fe640 4 set_mon_vals no callback set 2024-09-12T00:50:56.293 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:50:56.202+0000 7f3c1501d800 10 monclient: _renew_subs 2024-09-12T00:50:56.293 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:50:56.202+0000 7f3c1501d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.293 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:50:56.202+0000 7f3c1501d800 10 monclient: _renew_subs 2024-09-12T00:50:56.293 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:50:56.202+0000 7f3c1501d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.293 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:50:56.202+0000 7f3c1501d800 1 librados: init done 2024-09-12T00:50:56.293 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:50:56.202+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command cr dump hook 0x559c3a47c908 2024-09-12T00:50:56.293 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:50:56.204+0000 7f3aedffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:56.293 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:50:56.204+0000 7f3aedffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:56.293 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:50:56.204+0000 7f3aedffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:56.293 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:50:56.204+0000 7f3c107eb640 10 monclient: get_auth_request con 0x7f3ae0076470 auth_method 0 2024-09-12T00:50:56.293 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:50:56.204+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.294 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:50:56.204+0000 7f3c10fec640 10 monclient: get_auth_request con 0x559c3a499300 auth_method 0 2024-09-12T00:50:56.294 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.294 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:50:56.205+0000 7f3c1501d800 20 realm 2024-09-12T00:50:56.294 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.294 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.294 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:50:56.205+0000 7f3c1501d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:56.294 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.294 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.294 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.294 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:50:56.206+0000 7f3c107eb640 10 monclient: get_auth_request con 0x559c3a49d5b0 auth_method 0 2024-09-12T00:50:56.294 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:50:56.206+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:56.294 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:50:56.206+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.294 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:50:56.206+0000 7f3c0ffea640 10 monclient: get_auth_request con 0x559c3a4a0e60 auth_method 0 2024-09-12T00:50:56.295 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:50:56.207+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:56.295 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:50:56.207+0000 7f3c1501d800 20 searching for the correct realm 2024-09-12T00:50:56.295 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:50:56.207+0000 7f3c10fec640 10 monclient: get_auth_request con 0x559c3a4a5be0 auth_method 0 2024-09-12T00:50:56.295 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:50:56.208+0000 7f3c107eb640 10 monclient: get_auth_request con 0x7f3c08060230 auth_method 0 2024-09-12T00:50:56.295 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:50:56.210+0000 7f3c0ffea640 10 monclient: get_auth_request con 0x7f3c0804c1d0 auth_method 0 2024-09-12T00:50:56.295 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:50:56.210+0000 7f3c0ffea640 0 -- 172.21.15.62:0/2687896629 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f3c0804c1d0 msgr2=0x7f3c08048980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:56.295 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:50:56.210+0000 7f3aedffb640 1 client.6305.objecter ms_handle_reset 0x7f3c0804c1d0 session 0x7f3c0805d240 osd.5 2024-09-12T00:50:56.295 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:50:56.210+0000 7f3aedffb640 10 monclient: _renew_subs 2024-09-12T00:50:56.295 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:50:56.210+0000 7f3aedffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.295 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:50:56.210+0000 7f3c0ffea640 10 monclient: get_auth_request con 0x7f3ae0086720 auth_method 0 2024-09-12T00:50:56.295 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:50:56.211+0000 7f3c10fec640 10 monclient: get_auth_request con 0x7f3c00038030 auth_method 0 2024-09-12T00:50:56.295 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:50:56.212+0000 7f3c107eb640 10 monclient: get_auth_request con 0x7f3c08066920 auth_method 0 2024-09-12T00:50:56.296 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:50:56.213+0000 7f3c10fec640 0 -- 172.21.15.62:0/2687896629 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x559c3a499300 msgr2=0x559c3a49b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:56.296 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:50:56.213+0000 7f3aedffb640 1 client.6305.objecter ms_handle_reset 0x559c3a499300 session 0x559c3a498bf0 osd.6 2024-09-12T00:50:56.296 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:50:56.213+0000 7f3c10fec640 10 monclient: get_auth_request con 0x7f3c0804c1d0 auth_method 0 2024-09-12T00:50:56.296 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:56.296 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:56.296 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:56.296 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:56.296 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:56.296 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:56.296 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.296 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.296 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.296 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:56.297 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.297 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:56.297 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 zone default found 2024-09-12T00:50:56.297 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:50:56.218+0000 7f3c1501d800 4 Realm: () 2024-09-12T00:50:56.297 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:50:56.218+0000 7f3c1501d800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:56.297 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:50:56.218+0000 7f3c1501d800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:56.297 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:50:56.218+0000 7f3c1501d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:56.297 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 zonegroup default 2024-09-12T00:50:56.297 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.297 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.297 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.297 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.298 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.298 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:50:56.219+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.298 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:50:56.219+0000 7f3c1501d800 20 started sync module instance, tier type = 2024-09-12T00:50:56.298 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:50:56.219+0000 7f3c1501d800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:56.298 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=0 2024-09-12T00:50:56.298 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=1 2024-09-12T00:50:56.298 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=2 2024-09-12T00:50:56.298 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=3 2024-09-12T00:50:56.298 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=4 2024-09-12T00:50:56.298 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=5 2024-09-12T00:50:56.298 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=6 2024-09-12T00:50:56.298 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:50:56.228+0000 7f3c1501d800 20 add_watcher() i=7 2024-09-12T00:50:56.298 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:50:56.228+0000 7f3c1501d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:56.299 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding auth protocol: cephx 2024-09-12T00:50:56.299 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding auth protocol: cephx 2024-09-12T00:50:56.299 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding auth protocol: cephx 2024-09-12T00:50:56.299 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: secure 2024-09-12T00:50:56.299 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: crc 2024-09-12T00:50:56.299 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: secure 2024-09-12T00:50:56.299 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: crc 2024-09-12T00:50:56.299 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: secure 2024-09-12T00:50:56.299 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:50:56.230+0000 7f3ac6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:56.299 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: crc 2024-09-12T00:50:56.299 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: crc 2024-09-12T00:50:56.299 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: secure 2024-09-12T00:50:56.299 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: crc 2024-09-12T00:50:56.300 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: secure 2024-09-12T00:50:56.300 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: crc 2024-09-12T00:50:56.300 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: secure 2024-09-12T00:50:56.300 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:50:56.230+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.300 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:50:56.230+0000 7f3c1501d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:56.300 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:50:56.230+0000 7f3c1501d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:56.300 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command cache list hook 0x559c3a4743f0 2024-09-12T00:50:56.300 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command cache inspect hook 0x559c3a4743f0 2024-09-12T00:50:56.300 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command cache erase hook 0x559c3a4743f0 2024-09-12T00:50:56.300 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command cache zap hook 0x559c3a4743f0 2024-09-12T00:50:56.300 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:50:56.231+0000 7f3c1501d800 5 note: GC not initialized 2024-09-12T00:50:56.300 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:50:56.231+0000 7f3ac5fe3640 20 reqs_thread_entry: start 2024-09-12T00:50:56.301 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:50:56.231+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command sync trace show hook 0x7f3c08060e00 2024-09-12T00:50:56.301 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:50:56.231+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command sync trace history hook 0x7f3c08060e00 2024-09-12T00:50:56.301 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:50:56.231+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command sync trace active hook 0x7f3c08060e00 2024-09-12T00:50:56.301 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:50:56.231+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command sync trace active_short hook 0x7f3c08060e00 2024-09-12T00:50:56.301 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:50:56.231+0000 7f3c1501d800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:56.301 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:50:56.231+0000 7f3c1501d800 20 Filter name: none 2024-09-12T00:50:56.301 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:50:56.231+0000 7f3abeffd640 20 reqs_thread_entry: start 2024-09-12T00:50:56.301 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:50:56.231+0000 7f3c1501d800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:50:56.301 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:50:56.231+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.301 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:50:56.231+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:56.301 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:50:56.231+0000 7f3c1501d800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:50:56.301 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:50:56.231+0000 7f3c1501d800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:50:56.302 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:50:56.231+0000 7f3c1501d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 : miss 2024-09-12T00:50:56.302 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:50:56.231+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.302 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:50:56.232+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:56.302 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:50:56.232+0000 7f3c1501d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 info.flags=0x17 2024-09-12T00:50:56.302 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:50:56.232+0000 7f3c1501d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 to cache LRU end 2024-09-12T00:50:56.302 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:50:56.232+0000 7f3c1501d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:56.302 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:50:56.232+0000 7f3c1501d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:56.302 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:50:56.232+0000 7f3c1501d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 2024-09-12T00:50:56.302 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:50:56.235+0000 7f3c1501d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3c1501d800 time 2024-09-12T00:50:56.235803+0000 2024-09-12T00:50:56.302 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:56.302 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.302 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:56.302 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3c1618c71a] 2024-09-12T00:50:56.303 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c1618c8d8] 2024-09-12T00:50:56.303 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c392c0641] 2024-09-12T00:50:56.303 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd878e8) [0x559c397d28e8] 2024-09-12T00:50:56.303 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c392d031d] 2024-09-12T00:50:56.303 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:50:56.303 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3c14e29590] 2024-09-12T00:50:56.303 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:50:56.303 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:50:56.303 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.303 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:50:56.236+0000 7f3c1501d800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:56.303 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f3c1501d800 thread_name:radosgw-admin 2024-09-12T00:50:56.303 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.303 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:56.304 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3c14e3e6f0] 2024-09-12T00:50:56.304 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3c14e8b99c] 2024-09-12T00:50:56.304 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:50:56.304 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:50:56.304 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3c1618c774] 2024-09-12T00:50:56.304 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c1618c8d8] 2024-09-12T00:50:56.304 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c392c0641] 2024-09-12T00:50:56.304 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd878e8) [0x559c397d28e8] 2024-09-12T00:50:56.304 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c392d031d] 2024-09-12T00:50:56.304 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:50:56.304 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3c14e29590] 2024-09-12T00:50:56.304 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:50:56.304 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:50:56.305 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:56.305 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.305 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:50:56.305 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:50:56.305 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:50:56.305 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:50:56.305 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:50:56.305 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:50:56.305 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:56.305 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:50:56.305 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:50:56.305 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:56.305 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:56.306 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:56.306 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:50:56.306 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:50:56.306 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:50:56.306 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:50:56.306 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:50:56.306 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:50:56.306 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:50:56.306 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:56.306 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:56.306 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:56.306 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:50:56.306 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:50:56.307 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:56.307 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:50:56.307 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:50:56.307 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:50:56.307 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:50:56.307 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:50:56.307 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:50:56.307 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:50:56.307 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:50:56.307 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:50:56.307 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:50:56.307 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:50:56.307 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:50:56.307 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:50:56.308 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:50:56.308 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:50:56.308 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:56.308 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:50:56.308 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:50:56.308 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:56.308 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:56.308 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:50:56.308 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:56.308 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:56.308 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:56.308 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:50:56.308 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:50:56.308 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:50:56.309 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:50:56.309 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:50:56.309 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:50:56.309 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:50:56.309 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:50:56.309 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:50:56.309 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:50:56.309 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:50:56.309 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:50:56.309 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:50:56.309 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:50:56.309 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:50:56.309 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:50:56.310 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:50:56.310 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:50:56.310 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:56.310 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:56.310 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:56.310 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:50:56.310 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:56.310 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:56.310 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:56.310 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:56.310 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:50:56.310 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:56.310 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:56.311 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:56.311 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:56.311 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:56.311 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:56.311 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:50:56.311 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:56.311 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:50:56.311 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:50:56.311 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:50:56.311 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:56.311 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:50:56.311 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:50:56.312 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:56.312 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:56.312 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:56.312 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:56.312 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3abeffd640 / http_manager 2024-09-12T00:50:56.312 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3ac5fe3640 / http_manager 2024-09-12T00:50:56.312 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3ac6fe5640 / rgw_dt_lg_renew 2024-09-12T00:50:56.312 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3aedffb640 / ms_dispatch 2024-09-12T00:50:56.312 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3aef7fe640 / io_context_pool 2024-09-12T00:50:56.312 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3af5ffb640 / ms_dispatch 2024-09-12T00:50:56.312 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3afce09640 / ms_dispatch 2024-09-12T00:50:56.312 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3afe60c640 / io_context_pool 2024-09-12T00:50:56.312 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3c0ffea640 / msgr-worker-2 2024-09-12T00:50:56.313 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3c107eb640 / msgr-worker-1 2024-09-12T00:50:56.313 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3c10fec640 / msgr-worker-0 2024-09-12T00:50:56.313 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3c117ed640 / io_context_pool 2024-09-12T00:50:56.313 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3c1501d800 / radosgw-admin 2024-09-12T00:50:56.313 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:50:56.313 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:50:56.313 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/log/ceph/ceph-client.admin.98673.log 2024-09-12T00:50:56.313 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:50:56.313 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:50:56.313 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:50:56.186+0000 7f3c107eb640 10 monclient(hunting): handle_auth_done global_id 6293 payload 274 2024-09-12T00:50:56.313 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:50:56.186+0000 7f3c107eb640 10 monclient: _finish_hunting 0 2024-09-12T00:50:56.313 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:50:56.186+0000 7f3c107eb640 1 monclient: found mon.noname-c 2024-09-12T00:50:56.314 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:50:56.186+0000 7f3c107eb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.314 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:50:56.186+0000 7f3c10fec640 10 monclient: get_auth_request con 0x559c3a3dfa60 auth_method 0 2024-09-12T00:50:56.314 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.314 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:56.314 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: dump: 2024-09-12T00:50:56.314 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.314 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.314 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.314 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.314 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.314 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.314 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.315 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.315 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.315 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.315 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: _finish_auth 0 2024-09-12T00:50:56.315 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: _check_auth_tickets 2024-09-12T00:50:56.315 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:56.315 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:50:56.186+0000 7f3c1501d800 5 monclient: authenticate success, global_id 6293 2024-09-12T00:50:56.315 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:50:56.186+0000 7f3c1501d800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:56.315 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:50:56.186+0000 7f3c1501d800 4 set_mon_vals no callback set 2024-09-12T00:50:56.315 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.315 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:56.315 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:50:56.186+0000 7f3afe60c640 10 monclient: dump: 2024-09-12T00:50:56.315 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.316 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.316 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.316 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.316 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.316 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.316 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.316 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.316 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.316 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.316 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:50:56.187+0000 7f3c1501d800 10 monclient: shutdown 2024-09-12T00:50:56.316 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 asok(0x559c3a18e630) unregister_commands rotate-key 2024-09-12T00:50:56.316 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:50:56.187+0000 7f3c1501d800 10 monclient: build_initial_monmap 2024-09-12T00:50:56.317 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:50:56.187+0000 7f3c1501d800 1 build_initial for_mkfs: 0 2024-09-12T00:50:56.317 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:50:56.187+0000 7f3c1501d800 10 monclient: monmap: 2024-09-12T00:50:56.317 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:56.317 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:56.317 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:56.317 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:56.317 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:56.317 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.317 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:56.317 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:56.317 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:56.317 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.318 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding auth protocol: cephx 2024-09-12T00:50:56.318 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding auth protocol: cephx 2024-09-12T00:50:56.318 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding auth protocol: cephx 2024-09-12T00:50:56.318 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: secure 2024-09-12T00:50:56.318 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: crc 2024-09-12T00:50:56.318 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: secure 2024-09-12T00:50:56.318 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: crc 2024-09-12T00:50:56.318 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: secure 2024-09-12T00:50:56.318 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: crc 2024-09-12T00:50:56.318 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: crc 2024-09-12T00:50:56.318 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: secure 2024-09-12T00:50:56.318 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: crc 2024-09-12T00:50:56.318 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: secure 2024-09-12T00:50:56.319 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: crc 2024-09-12T00:50:56.319 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3b36e0) adding con mode: secure 2024-09-12T00:50:56.319 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:50:56.187+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.319 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:50:56.187+0000 7f3c1501d800 1 librados: starting msgr at 2024-09-12T00:50:56.319 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:50:56.187+0000 7f3c1501d800 1 librados: starting objecter 2024-09-12T00:50:56.319 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command objecter_requests hook 0x559c3a3d8730 2024-09-12T00:50:56.319 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:50:56.187+0000 7f3c1501d800 1 librados: setting wanted keys 2024-09-12T00:50:56.319 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:50:56.187+0000 7f3c1501d800 1 librados: calling monclient init 2024-09-12T00:50:56.319 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:50:56.187+0000 7f3c1501d800 10 monclient: init 2024-09-12T00:50:56.319 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding auth protocol: cephx 2024-09-12T00:50:56.319 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding auth protocol: cephx 2024-09-12T00:50:56.319 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding auth protocol: cephx 2024-09-12T00:50:56.319 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: secure 2024-09-12T00:50:56.319 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: crc 2024-09-12T00:50:56.320 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: secure 2024-09-12T00:50:56.320 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: crc 2024-09-12T00:50:56.320 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: secure 2024-09-12T00:50:56.320 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: crc 2024-09-12T00:50:56.320 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: crc 2024-09-12T00:50:56.320 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: secure 2024-09-12T00:50:56.320 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: crc 2024-09-12T00:50:56.320 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: secure 2024-09-12T00:50:56.320 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: crc 2024-09-12T00:50:56.320 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:50:56.187+0000 7f3c1501d800 5 AuthRegistry(0x559c3a3adb90) adding con mode: secure 2024-09-12T00:50:56.320 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:50:56.188+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.320 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:50:56.188+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.320 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:50:56.188+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command rotate-key hook 0x559c3a3adcd8 2024-09-12T00:50:56.321 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:56.321 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:50:56.321 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-a con 0x559c3a2638b0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:56.321 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-b con 0x559c3a266b00 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:56.321 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-c con 0x559c3a3dfa60 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:56.321 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.321 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.321 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.321 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:56.321 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:50:56.188+0000 7f3c1501d800 10 monclient(hunting): authenticate will time out at 1942.681426s 2024-09-12T00:50:56.321 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): get_auth_request con 0x559c3a3dfa60 auth_method 0 2024-09-12T00:50:56.321 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.322 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.322 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.322 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:50:56.188+0000 7f3c107eb640 10 monclient(hunting): get_auth_request con 0x559c3a2638b0 auth_method 0 2024-09-12T00:50:56.322 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:50:56.188+0000 7f3c107eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.322 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:50:56.188+0000 7f3c107eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.322 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:50:56.188+0000 7f3c107eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.322 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.322 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.322 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.322 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:50:56.188+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.322 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:50:56.188+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.322 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:50:56.188+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.322 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient(hunting): handle_auth_done global_id 6296 payload 824 2024-09-12T00:50:56.322 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient: _finish_hunting 0 2024-09-12T00:50:56.323 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:50:56.188+0000 7f3c10fec640 1 monclient: found mon.noname-c 2024-09-12T00:50:56.323 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:50:56.188+0000 7f3c10fec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.323 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:50:56.188+0000 7f3afce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.323 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:56.323 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: dump: 2024-09-12T00:50:56.323 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.323 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.323 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.323 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.323 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.323 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.323 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.323 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.323 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.324 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.324 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: _finish_auth 0 2024-09-12T00:50:56.324 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: _check_auth_tickets 2024-09-12T00:50:56.324 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:56.324 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.324 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:56.324 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:50:56.189+0000 7f3afce09640 10 monclient: dump: 2024-09-12T00:50:56.324 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.324 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.324 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.324 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.324 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.324 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.325 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.325 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.325 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.325 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.325 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:50:56.189+0000 7f3c1501d800 5 monclient: authenticate success, global_id 6296 2024-09-12T00:50:56.325 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:50:56.189+0000 7f3c1501d800 10 monclient: _renew_subs 2024-09-12T00:50:56.325 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:50:56.189+0000 7f3c1501d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.325 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:50:56.189+0000 7f3afe60c640 4 set_mon_vals no callback set 2024-09-12T00:50:56.325 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:50:56.189+0000 7f3c1501d800 10 monclient: _renew_subs 2024-09-12T00:50:56.325 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:50:56.189+0000 7f3c1501d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.325 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:50:56.189+0000 7f3c1501d800 1 librados: init done 2024-09-12T00:50:56.325 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:50:56.190+0000 7f3afce09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:56.325 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:50:56.190+0000 7f3afce09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:56.325 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:50:56.190+0000 7f3afce09640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:56.326 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:50:56.191+0000 7f3c107eb640 10 monclient: get_auth_request con 0x7f3af8076470 auth_method 0 2024-09-12T00:50:56.326 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:50:56.191+0000 7f3c0ffea640 10 monclient: get_auth_request con 0x559c3a3d6620 auth_method 0 2024-09-12T00:50:56.326 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:50:56.192+0000 7f3c107eb640 10 monclient: get_auth_request con 0x559c3a3f90c0 auth_method 0 2024-09-12T00:50:56.326 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:50:56.192+0000 7f3c0ffea640 10 monclient: get_auth_request con 0x559c3a3fd790 auth_method 0 2024-09-12T00:50:56.326 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:50:56.194+0000 7f3c1501d800 10 monclient: build_initial_monmap 2024-09-12T00:50:56.326 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:50:56.194+0000 7f3c1501d800 1 build_initial for_mkfs: 0 2024-09-12T00:50:56.326 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:50:56.194+0000 7f3c1501d800 10 monclient: monmap: 2024-09-12T00:50:56.326 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:56.326 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:56.326 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:56.326 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:56.326 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:56.326 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.326 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:56.327 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:56.327 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:56.327 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.327 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding auth protocol: cephx 2024-09-12T00:50:56.327 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding auth protocol: cephx 2024-09-12T00:50:56.327 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding auth protocol: cephx 2024-09-12T00:50:56.327 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: secure 2024-09-12T00:50:56.327 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: crc 2024-09-12T00:50:56.327 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: secure 2024-09-12T00:50:56.327 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: crc 2024-09-12T00:50:56.327 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: secure 2024-09-12T00:50:56.327 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: crc 2024-09-12T00:50:56.327 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: crc 2024-09-12T00:50:56.328 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: secure 2024-09-12T00:50:56.328 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: crc 2024-09-12T00:50:56.328 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: secure 2024-09-12T00:50:56.328 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: crc 2024-09-12T00:50:56.328 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a402420) adding con mode: secure 2024-09-12T00:50:56.328 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:50:56.194+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.328 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command objecter_requests cmddesc objecter_requests hook 0x559c3a405e30 EEXIST 2024-09-12T00:50:56.328 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:50:56.194+0000 7f3c1501d800 10 monclient: init 2024-09-12T00:50:56.328 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding auth protocol: cephx 2024-09-12T00:50:56.328 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding auth protocol: cephx 2024-09-12T00:50:56.328 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding auth protocol: cephx 2024-09-12T00:50:56.328 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: secure 2024-09-12T00:50:56.328 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: crc 2024-09-12T00:50:56.329 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: secure 2024-09-12T00:50:56.329 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: crc 2024-09-12T00:50:56.329 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: secure 2024-09-12T00:50:56.329 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: crc 2024-09-12T00:50:56.329 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: crc 2024-09-12T00:50:56.329 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: secure 2024-09-12T00:50:56.329 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: crc 2024-09-12T00:50:56.329 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: secure 2024-09-12T00:50:56.329 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: crc 2024-09-12T00:50:56.329 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:50:56.194+0000 7f3c1501d800 5 AuthRegistry(0x559c3a400b98) adding con mode: secure 2024-09-12T00:50:56.329 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:50:56.195+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.329 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:50:56.195+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.330 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:50:56.195+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command rotate-key cmddesc rotate-key hook 0x559c3a400ce0 EEXIST 2024-09-12T00:50:56.330 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:56.330 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:50:56.330 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-b con 0x559c3a429b20 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:56.330 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-a con 0x559c3a42bdf0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:56.330 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-c con 0x559c3a4282f0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:56.330 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.330 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.330 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.330 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:56.330 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:50:56.195+0000 7f3c1501d800 10 monclient(hunting): authenticate will time out at 1942.688348s 2024-09-12T00:50:56.330 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): get_auth_request con 0x559c3a42bdf0 auth_method 0 2024-09-12T00:50:56.331 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.331 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.331 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.331 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:50:56.195+0000 7f3c10fec640 10 monclient(hunting): get_auth_request con 0x559c3a4282f0 auth_method 0 2024-09-12T00:50:56.331 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:50:56.195+0000 7f3c10fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.331 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:50:56.195+0000 7f3c10fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.331 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:50:56.195+0000 7f3c10fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.331 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.331 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.331 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.331 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:50:56.195+0000 7f3c107eb640 10 monclient(hunting): get_auth_request con 0x559c3a429b20 auth_method 0 2024-09-12T00:50:56.331 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:50:56.195+0000 7f3c107eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.331 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:50:56.195+0000 7f3c107eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.332 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:50:56.195+0000 7f3c107eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.332 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:50:56.195+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.332 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:50:56.195+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.332 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:50:56.195+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.332 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:50:56.195+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.332 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:50:56.195+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.332 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:50:56.195+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.332 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_done global_id 6636 payload 824 2024-09-12T00:50:56.332 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient: _finish_hunting 0 2024-09-12T00:50:56.332 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 1 monclient: found mon.noname-a 2024-09-12T00:50:56.332 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:50:56.195+0000 7f3c0ffea640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:50:56.332 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.332 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:56.333 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: dump: 2024-09-12T00:50:56.333 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.333 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.333 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.333 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.333 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.333 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.333 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.333 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.333 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.333 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.333 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: _finish_auth 0 2024-09-12T00:50:56.334 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:50:56.334 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:50:56.196+0000 7f3c1501d800 5 monclient: authenticate success, global_id 6636 2024-09-12T00:50:56.334 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:50:56.196+0000 7f3c1501d800 10 monclient: _renew_subs 2024-09-12T00:50:56.334 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:50:56.196+0000 7f3c1501d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:50:56.334 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:56.334 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.334 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:56.334 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:50:56.196+0000 7f3af5ffb640 10 monclient: dump: 2024-09-12T00:50:56.334 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.334 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.334 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.334 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.334 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.335 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.335 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.335 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.335 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.335 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.335 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:50:56.196+0000 7f3c117ed640 4 set_mon_vals no callback set 2024-09-12T00:50:56.335 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:50:56.196+0000 7f3c1501d800 10 monclient: _renew_subs 2024-09-12T00:50:56.335 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:50:56.196+0000 7f3c1501d800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:50:56.335 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:50:56.197+0000 7f3af5ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:56.335 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:50:56.197+0000 7f3af5ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:56.335 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:50:56.197+0000 7f3af5ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:56.335 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:50:56.198+0000 7f3c107eb640 10 monclient: get_auth_request con 0x7f3ae8076370 auth_method 0 2024-09-12T00:50:56.336 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:50:56.198+0000 7f3c1501d800 10 monclient: get_monmap_and_config 2024-09-12T00:50:56.336 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:50:56.198+0000 7f3c1501d800 10 monclient: build_initial_monmap 2024-09-12T00:50:56.336 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:50:56.198+0000 7f3c1501d800 1 build_initial for_mkfs: 0 2024-09-12T00:50:56.336 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:50:56.198+0000 7f3c1501d800 10 monclient: monmap: 2024-09-12T00:50:56.336 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:56.336 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:56.336 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:56.336 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:56.336 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:56.336 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.336 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:56.336 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:56.336 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:56.337 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.337 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding auth protocol: cephx 2024-09-12T00:50:56.337 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding auth protocol: cephx 2024-09-12T00:50:56.337 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding auth protocol: cephx 2024-09-12T00:50:56.337 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: secure 2024-09-12T00:50:56.337 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: crc 2024-09-12T00:50:56.337 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: secure 2024-09-12T00:50:56.337 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: crc 2024-09-12T00:50:56.337 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: secure 2024-09-12T00:50:56.337 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: crc 2024-09-12T00:50:56.337 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: crc 2024-09-12T00:50:56.337 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: secure 2024-09-12T00:50:56.338 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: crc 2024-09-12T00:50:56.338 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: secure 2024-09-12T00:50:56.338 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: crc 2024-09-12T00:50:56.338 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x559c3a449a70) adding con mode: secure 2024-09-12T00:50:56.338 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:50:56.198+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.338 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:50:56.198+0000 7f3c1501d800 10 monclient: init 2024-09-12T00:50:56.338 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding auth protocol: cephx 2024-09-12T00:50:56.338 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding auth protocol: cephx 2024-09-12T00:50:56.338 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding auth protocol: cephx 2024-09-12T00:50:56.338 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: secure 2024-09-12T00:50:56.338 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: crc 2024-09-12T00:50:56.338 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: secure 2024-09-12T00:50:56.338 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: crc 2024-09-12T00:50:56.338 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: secure 2024-09-12T00:50:56.339 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: crc 2024-09-12T00:50:56.339 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: crc 2024-09-12T00:50:56.339 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: secure 2024-09-12T00:50:56.339 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: crc 2024-09-12T00:50:56.339 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: secure 2024-09-12T00:50:56.339 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: crc 2024-09-12T00:50:56.339 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:50:56.198+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b050) adding con mode: secure 2024-09-12T00:50:56.339 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:50:56.199+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.339 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:50:56.199+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.339 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:50:56.199+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command rotate-key cmddesc rotate-key hook 0x7ffc6f61b198 EEXIST 2024-09-12T00:50:56.339 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:56.339 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:50:56.340 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-a con 0x559c3a4775b0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:56.340 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-b con 0x559c3a44de80 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:56.340 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-c con 0x559c3a44b2d0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:56.340 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.340 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.340 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.340 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:56.340 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:50:56.199+0000 7f3c1501d800 10 monclient(hunting): authenticate will time out at 1942.692422s 2024-09-12T00:50:56.340 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:50:56.199+0000 7f3c107eb640 10 monclient(hunting): get_auth_request con 0x559c3a4775b0 auth_method 0 2024-09-12T00:50:56.340 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:50:56.199+0000 7f3c107eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.340 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:50:56.199+0000 7f3c107eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.340 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:50:56.199+0000 7f3c107eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.340 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): get_auth_request con 0x559c3a44b2d0 auth_method 0 2024-09-12T00:50:56.341 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.341 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.341 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.341 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:50:56.199+0000 7f3c0ffea640 10 monclient(hunting): get_auth_request con 0x559c3a44de80 auth_method 0 2024-09-12T00:50:56.341 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:50:56.199+0000 7f3c0ffea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.341 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:50:56.199+0000 7f3c0ffea640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.341 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:50:56.199+0000 7f3c0ffea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.341 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.341 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.341 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.341 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:50:56.199+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.341 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:50:56.199+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.342 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:50:56.199+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.342 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:50:56.199+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.342 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:50:56.199+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.342 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:50:56.199+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.342 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient(hunting): handle_auth_done global_id 6302 payload 274 2024-09-12T00:50:56.342 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient: _finish_hunting 0 2024-09-12T00:50:56.342 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:50:56.199+0000 7f3c10fec640 1 monclient: found mon.noname-c 2024-09-12T00:50:56.342 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:50:56.199+0000 7f3c10fec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.342 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.342 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:56.342 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: dump: 2024-09-12T00:50:56.342 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.342 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.343 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.343 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.343 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.343 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.343 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.343 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.343 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.343 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.343 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: _finish_auth 0 2024-09-12T00:50:56.343 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:50:56.343 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 monclient: authenticate success, global_id 6302 2024-09-12T00:50:56.343 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:56.343 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:50:56.200+0000 7f3c1501d800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:56.343 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:50:56.200+0000 7f3c1501d800 4 set_mon_vals no callback set 2024-09-12T00:50:56.344 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.344 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:56.344 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:50:56.200+0000 7f3aef7fe640 10 monclient: dump: 2024-09-12T00:50:56.344 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.344 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.344 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.344 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.344 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.344 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.344 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.344 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.344 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.344 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.345 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:50:56.200+0000 7f3c1501d800 10 monclient: shutdown 2024-09-12T00:50:56.345 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:50:56.200+0000 7f3c1501d800 10 monclient: build_initial_monmap 2024-09-12T00:50:56.345 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:50:56.200+0000 7f3c1501d800 1 build_initial for_mkfs: 0 2024-09-12T00:50:56.345 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:50:56.200+0000 7f3c1501d800 10 monclient: monmap: 2024-09-12T00:50:56.345 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:50:56.345 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:56.345 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:50:56.345 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:50:56.345 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:56.345 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.345 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:50:56.345 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:50:56.346 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:50:56.346 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.346 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding auth protocol: cephx 2024-09-12T00:50:56.346 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding auth protocol: cephx 2024-09-12T00:50:56.346 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding auth protocol: cephx 2024-09-12T00:50:56.346 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: secure 2024-09-12T00:50:56.346 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: crc 2024-09-12T00:50:56.346 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: secure 2024-09-12T00:50:56.346 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: crc 2024-09-12T00:50:56.346 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: secure 2024-09-12T00:50:56.346 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: crc 2024-09-12T00:50:56.346 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: crc 2024-09-12T00:50:56.346 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: secure 2024-09-12T00:50:56.347 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: crc 2024-09-12T00:50:56.347 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: secure 2024-09-12T00:50:56.347 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: crc 2024-09-12T00:50:56.347 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:50:56.200+0000 7f3c1501d800 5 AuthRegistry(0x559c3a47d880) adding con mode: secure 2024-09-12T00:50:56.347 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:50:56.200+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.347 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:50:56.200+0000 7f3c1501d800 1 librados: starting msgr at 2024-09-12T00:50:56.347 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:50:56.200+0000 7f3c1501d800 1 librados: starting objecter 2024-09-12T00:50:56.347 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command objecter_requests cmddesc objecter_requests hook 0x559c3a46d560 EEXIST 2024-09-12T00:50:56.347 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:50:56.201+0000 7f3c1501d800 1 librados: setting wanted keys 2024-09-12T00:50:56.347 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:50:56.201+0000 7f3c1501d800 1 librados: calling monclient init 2024-09-12T00:50:56.347 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient: init 2024-09-12T00:50:56.347 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding auth protocol: cephx 2024-09-12T00:50:56.347 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding auth protocol: cephx 2024-09-12T00:50:56.347 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding auth protocol: cephx 2024-09-12T00:50:56.348 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: secure 2024-09-12T00:50:56.348 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: crc 2024-09-12T00:50:56.348 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: secure 2024-09-12T00:50:56.348 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: crc 2024-09-12T00:50:56.348 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: secure 2024-09-12T00:50:56.348 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: crc 2024-09-12T00:50:56.348 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: crc 2024-09-12T00:50:56.348 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: secure 2024-09-12T00:50:56.348 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: crc 2024-09-12T00:50:56.348 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: secure 2024-09-12T00:50:56.348 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: crc 2024-09-12T00:50:56.348 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 AuthRegistry(0x559c3a4418d0) adding con mode: secure 2024-09-12T00:50:56.348 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:50:56.201+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.349 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:50:56.201+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.349 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:50:56.201+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command rotate-key cmddesc rotate-key hook 0x559c3a441a18 EEXIST 2024-09-12T00:50:56.349 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:56.349 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:50:56.349 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-a con 0x559c3a44b2d0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:50:56.349 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-c con 0x559c3a44de80 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:50:56.349 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): picked mon.noname-b con 0x559c3a4775b0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:50:56.349 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.349 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.349 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:56.349 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:56.349 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:50:56.201+0000 7f3c1501d800 10 monclient(hunting): authenticate will time out at 1942.694702s 2024-09-12T00:50:56.350 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): get_auth_request con 0x559c3a44de80 auth_method 0 2024-09-12T00:50:56.350 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.350 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.350 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.350 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:50:56.201+0000 7f3c107eb640 10 monclient(hunting): get_auth_request con 0x559c3a44b2d0 auth_method 0 2024-09-12T00:50:56.350 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:50:56.201+0000 7f3c107eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.350 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:50:56.201+0000 7f3c107eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.350 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:50:56.201+0000 7f3c107eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.350 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.350 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.350 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.350 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:50:56.201+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:56.350 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:50:56.201+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:56.351 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:50:56.201+0000 7f3c107eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:56.351 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:50:56.201+0000 7f3c10fec640 10 monclient(hunting): get_auth_request con 0x559c3a4775b0 auth_method 0 2024-09-12T00:50:56.351 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:50:56.201+0000 7f3c10fec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:56.351 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:50:56.201+0000 7f3c10fec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:56.351 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:50:56.201+0000 7f3c10fec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:56.351 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:50:56.201+0000 7f3c0ffea640 10 monclient(hunting): handle_auth_done global_id 6305 payload 824 2024-09-12T00:50:56.351 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:50:56.202+0000 7f3c0ffea640 10 monclient: _finish_hunting 0 2024-09-12T00:50:56.351 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:50:56.202+0000 7f3c0ffea640 1 monclient: found mon.noname-c 2024-09-12T00:50:56.351 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:50:56.202+0000 7f3c0ffea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.351 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.351 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:56.351 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: dump: 2024-09-12T00:50:56.352 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.352 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.352 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.352 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.352 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.352 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.352 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.352 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.352 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.352 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.352 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: _finish_auth 0 2024-09-12T00:50:56.352 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: _check_auth_tickets 2024-09-12T00:50:56.353 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:56.353 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:56.353 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:56.353 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:50:56.202+0000 7f3aedffb640 10 monclient: dump: 2024-09-12T00:50:56.353 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:50:56.353 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:50:56.353 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.353 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:50:56.353 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:56.353 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:50:56.353 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:50:56.353 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:50:56.353 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:50:56.354 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.354 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:50:56.202+0000 7f3c1501d800 5 monclient: authenticate success, global_id 6305 2024-09-12T00:50:56.354 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:50:56.202+0000 7f3aef7fe640 4 set_mon_vals no callback set 2024-09-12T00:50:56.354 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:50:56.202+0000 7f3c1501d800 10 monclient: _renew_subs 2024-09-12T00:50:56.354 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:50:56.202+0000 7f3c1501d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.354 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:50:56.202+0000 7f3c1501d800 10 monclient: _renew_subs 2024-09-12T00:50:56.354 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:50:56.202+0000 7f3c1501d800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.354 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:50:56.202+0000 7f3c1501d800 1 librados: init done 2024-09-12T00:50:56.354 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:50:56.202+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command cr dump hook 0x559c3a47c908 2024-09-12T00:50:56.354 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:50:56.204+0000 7f3aedffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:56.354 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:50:56.204+0000 7f3aedffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:56.354 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:50:56.204+0000 7f3aedffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:50:56.354 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:50:56.204+0000 7f3c107eb640 10 monclient: get_auth_request con 0x7f3ae0076470 auth_method 0 2024-09-12T00:50:56.355 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:50:56.204+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.355 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:50:56.204+0000 7f3c10fec640 10 monclient: get_auth_request con 0x559c3a499300 auth_method 0 2024-09-12T00:50:56.355 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.355 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:50:56.205+0000 7f3c1501d800 20 realm 2024-09-12T00:50:56.355 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.355 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.355 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:50:56.205+0000 7f3c1501d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:56.355 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.355 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.355 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:50:56.205+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.355 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:50:56.206+0000 7f3c107eb640 10 monclient: get_auth_request con 0x559c3a49d5b0 auth_method 0 2024-09-12T00:50:56.355 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:50:56.206+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:56.356 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:50:56.206+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.356 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:50:56.206+0000 7f3c0ffea640 10 monclient: get_auth_request con 0x559c3a4a0e60 auth_method 0 2024-09-12T00:50:56.356 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:50:56.207+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:56.356 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:50:56.207+0000 7f3c1501d800 20 searching for the correct realm 2024-09-12T00:50:56.356 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:50:56.207+0000 7f3c10fec640 10 monclient: get_auth_request con 0x559c3a4a5be0 auth_method 0 2024-09-12T00:50:56.356 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:50:56.208+0000 7f3c107eb640 10 monclient: get_auth_request con 0x7f3c08060230 auth_method 0 2024-09-12T00:50:56.356 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:50:56.210+0000 7f3c0ffea640 10 monclient: get_auth_request con 0x7f3c0804c1d0 auth_method 0 2024-09-12T00:50:56.356 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:50:56.210+0000 7f3c0ffea640 0 -- 172.21.15.62:0/2687896629 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f3c0804c1d0 msgr2=0x7f3c08048980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:56.356 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:50:56.210+0000 7f3aedffb640 1 client.6305.objecter ms_handle_reset 0x7f3c0804c1d0 session 0x7f3c0805d240 osd.5 2024-09-12T00:50:56.356 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:50:56.210+0000 7f3aedffb640 10 monclient: _renew_subs 2024-09-12T00:50:56.356 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:50:56.210+0000 7f3aedffb640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:50:56.356 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:50:56.210+0000 7f3c0ffea640 10 monclient: get_auth_request con 0x7f3ae0086720 auth_method 0 2024-09-12T00:50:56.357 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:50:56.211+0000 7f3c10fec640 10 monclient: get_auth_request con 0x7f3c00038030 auth_method 0 2024-09-12T00:50:56.357 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:50:56.212+0000 7f3c107eb640 10 monclient: get_auth_request con 0x7f3c08066920 auth_method 0 2024-09-12T00:50:56.357 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:50:56.213+0000 7f3c10fec640 0 -- 172.21.15.62:0/2687896629 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x559c3a499300 msgr2=0x559c3a49b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:56.357 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:50:56.213+0000 7f3aedffb640 1 client.6305.objecter ms_handle_reset 0x559c3a499300 session 0x559c3a498bf0 osd.6 2024-09-12T00:50:56.357 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:50:56.213+0000 7f3c10fec640 10 monclient: get_auth_request con 0x7f3c0804c1d0 auth_method 0 2024-09-12T00:50:56.357 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:56.357 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:56.357 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:56.357 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:56.357 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:56.357 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:56.357 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.357 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.358 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.358 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:56.358 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:50:56.217+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.358 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:56.358 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 zone default found 2024-09-12T00:50:56.358 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:50:56.218+0000 7f3c1501d800 4 Realm: () 2024-09-12T00:50:56.358 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:50:56.218+0000 7f3c1501d800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:56.358 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:50:56.218+0000 7f3c1501d800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:56.358 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:50:56.218+0000 7f3c1501d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:56.358 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 zonegroup default 2024-09-12T00:50:56.358 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.358 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.358 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.358 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.359 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:50:56.218+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.359 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:50:56.219+0000 7f3c1501d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.359 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:50:56.219+0000 7f3c1501d800 20 started sync module instance, tier type = 2024-09-12T00:50:56.359 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:50:56.219+0000 7f3c1501d800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:56.359 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=0 2024-09-12T00:50:56.359 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=1 2024-09-12T00:50:56.359 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=2 2024-09-12T00:50:56.359 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=3 2024-09-12T00:50:56.359 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=4 2024-09-12T00:50:56.359 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=5 2024-09-12T00:50:56.359 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:50:56.227+0000 7f3c1501d800 20 add_watcher() i=6 2024-09-12T00:50:56.359 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:50:56.228+0000 7f3c1501d800 20 add_watcher() i=7 2024-09-12T00:50:56.359 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:50:56.228+0000 7f3c1501d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:56.359 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding auth protocol: cephx 2024-09-12T00:50:56.360 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding auth protocol: cephx 2024-09-12T00:50:56.360 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding auth protocol: cephx 2024-09-12T00:50:56.360 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: secure 2024-09-12T00:50:56.360 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: crc 2024-09-12T00:50:56.360 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: secure 2024-09-12T00:50:56.360 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: crc 2024-09-12T00:50:56.360 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: secure 2024-09-12T00:50:56.360 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:50:56.230+0000 7f3ac6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:56.360 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: crc 2024-09-12T00:50:56.360 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: crc 2024-09-12T00:50:56.360 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: secure 2024-09-12T00:50:56.360 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: crc 2024-09-12T00:50:56.360 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: secure 2024-09-12T00:50:56.361 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: crc 2024-09-12T00:50:56.361 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 AuthRegistry(0x7ffc6f61b530) adding con mode: secure 2024-09-12T00:50:56.361 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:50:56.230+0000 7f3c1501d800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:56.361 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:50:56.230+0000 7f3c1501d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:56.361 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:50:56.230+0000 7f3c1501d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:56.361 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command cache list hook 0x559c3a4743f0 2024-09-12T00:50:56.361 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command cache inspect hook 0x559c3a4743f0 2024-09-12T00:50:56.361 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command cache erase hook 0x559c3a4743f0 2024-09-12T00:50:56.361 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:50:56.230+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command cache zap hook 0x559c3a4743f0 2024-09-12T00:50:56.361 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:50:56.231+0000 7f3c1501d800 5 note: GC not initialized 2024-09-12T00:50:56.361 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:50:56.231+0000 7f3ac5fe3640 20 reqs_thread_entry: start 2024-09-12T00:50:56.361 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:50:56.231+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command sync trace show hook 0x7f3c08060e00 2024-09-12T00:50:56.361 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:50:56.231+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command sync trace history hook 0x7f3c08060e00 2024-09-12T00:50:56.362 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:50:56.231+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command sync trace active hook 0x7f3c08060e00 2024-09-12T00:50:56.362 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:50:56.231+0000 7f3c1501d800 5 asok(0x559c3a18e630) register_command sync trace active_short hook 0x7f3c08060e00 2024-09-12T00:50:56.362 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:50:56.231+0000 7f3c1501d800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:56.362 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:50:56.231+0000 7f3c1501d800 20 Filter name: none 2024-09-12T00:50:56.362 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:50:56.231+0000 7f3abeffd640 20 reqs_thread_entry: start 2024-09-12T00:50:56.362 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:50:56.231+0000 7f3c1501d800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:50:56.362 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:50:56.231+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.362 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:50:56.231+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:56.362 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:50:56.231+0000 7f3c1501d800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:50:56.362 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:50:56.231+0000 7f3c1501d800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:50:56.362 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:50:56.231+0000 7f3c1501d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 : miss 2024-09-12T00:50:56.362 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:50:56.231+0000 7f3c1501d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.362 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:50:56.232+0000 7f3c1501d800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:56.363 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:50:56.232+0000 7f3c1501d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 info.flags=0x17 2024-09-12T00:50:56.363 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:50:56.232+0000 7f3c1501d800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 to cache LRU end 2024-09-12T00:50:56.363 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:50:56.232+0000 7f3c1501d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:56.363 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:50:56.232+0000 7f3c1501d800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:56.363 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:50:56.232+0000 7f3c1501d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 2024-09-12T00:50:56.363 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:50:56.235+0000 7f3c1501d800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3c1501d800 time 2024-09-12T00:50:56.235803+0000 2024-09-12T00:50:56.363 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:56.363 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.363 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:56.363 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3c1618c71a] 2024-09-12T00:50:56.363 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c1618c8d8] 2024-09-12T00:50:56.363 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c392c0641] 2024-09-12T00:50:56.363 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd878e8) [0x559c397d28e8] 2024-09-12T00:50:56.364 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c392d031d] 2024-09-12T00:50:56.364 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:50:56.364 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3c14e29590] 2024-09-12T00:50:56.364 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:50:56.364 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:50:56.364 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.364 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:50:56.236+0000 7f3c1501d800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:56.364 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f3c1501d800 thread_name:radosgw-admin 2024-09-12T00:50:56.364 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.364 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:56.364 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3c14e3e6f0] 2024-09-12T00:50:56.364 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3c14e8b99c] 2024-09-12T00:50:56.364 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:50:56.365 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:50:56.365 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3c1618c774] 2024-09-12T00:50:56.365 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3c1618c8d8] 2024-09-12T00:50:56.365 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c392c0641] 2024-09-12T00:50:56.365 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd878e8) [0x559c397d28e8] 2024-09-12T00:50:56.365 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x559c392d031d] 2024-09-12T00:50:56.365 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:50:56.365 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3c14e29590] 2024-09-12T00:50:56.365 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:50:56.365 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:50:56.365 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:56.365 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.365 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:50:56.366 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:50:56.366 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:50:56.366 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:50:56.366 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:50:56.366 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:50:56.366 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:56.366 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:50:56.366 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:50:56.366 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:56.366 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:56.366 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:56.366 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:50:56.366 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:50:56.366 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:50:56.367 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:50:56.367 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:50:56.367 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:50:56.367 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:50:56.367 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:56.367 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:56.367 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:56.367 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:50:56.367 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:50:56.367 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:56.367 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:50:56.367 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:50:56.367 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:50:56.367 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:50:56.368 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:50:56.368 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:50:56.368 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:50:56.368 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:50:56.368 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:50:56.368 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:50:56.368 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:50:56.368 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:50:56.368 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:50:56.368 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:50:56.368 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:50:56.368 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:56.368 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:50:56.368 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:50:56.369 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:56.369 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:56.369 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:50:56.369 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:56.369 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:56.369 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:56.369 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:50:56.369 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:50:56.369 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:50:56.369 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:50:56.369 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:50:56.369 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:50:56.369 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:50:56.370 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:50:56.370 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:50:56.370 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:50:56.370 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:50:56.370 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:50:56.370 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:50:56.370 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:50:56.370 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:50:56.370 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:50:56.370 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:50:56.370 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:50:56.370 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:56.371 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:56.371 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:56.371 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:50:56.371 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:56.371 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:56.371 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:56.371 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:56.371 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:50:56.371 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:56.371 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:56.371 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:56.371 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:56.372 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:56.372 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:56.372 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:50:56.372 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:56.372 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:50:56.372 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:50:56.372 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:50:56.372 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:56.372 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:50:56.372 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:50:56.372 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:56.372 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:56.372 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:56.373 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:56.373 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3abeffd640 / http_manager 2024-09-12T00:50:56.373 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3ac5fe3640 / http_manager 2024-09-12T00:50:56.373 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3ac6fe5640 / rgw_dt_lg_renew 2024-09-12T00:50:56.373 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3aedffb640 / ms_dispatch 2024-09-12T00:50:56.373 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3aef7fe640 / io_context_pool 2024-09-12T00:50:56.373 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3af5ffb640 / ms_dispatch 2024-09-12T00:50:56.373 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3afce09640 / ms_dispatch 2024-09-12T00:50:56.373 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3afe60c640 / io_context_pool 2024-09-12T00:50:56.373 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3c0ffea640 / msgr-worker-2 2024-09-12T00:50:56.373 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3c107eb640 / msgr-worker-1 2024-09-12T00:50:56.373 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3c10fec640 / msgr-worker-0 2024-09-12T00:50:56.374 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3c117ed640 / io_context_pool 2024-09-12T00:50:56.374 INFO:tasks.workunit.client.0.smithi062.stderr: 7f3c1501d800 / radosgw-admin 2024-09-12T00:50:56.374 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:50:56.374 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:50:56.374 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:50:56.237464Z_0adb19dc-182d-4a3b-ace8-37899cff6321/log 2024-09-12T00:50:56.374 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:50:56.374 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:50:56.376 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:56.376 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:56.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.313+0000 7fb397926800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.315+0000 7fb397926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.315+0000 7fb397926800 20 realm 2024-09-12T00:50:56.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.315+0000 7fb397926800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.315+0000 7fb397926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.315+0000 7fb397926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:56.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.315+0000 7fb397926800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.315+0000 7fb397926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.315+0000 7fb397926800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.316+0000 7fb397926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:56.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.316+0000 7fb397926800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.317+0000 7fb397926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:56.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.317+0000 7fb397926800 20 searching for the correct realm 2024-09-12T00:50:56.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.319+0000 7fb392dd8640 0 -- 172.21.15.62:0/1760945343 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fb38c067440 msgr2=0x7fb38c0678c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:56.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.525+0000 7fb393dda640 0 -- 172.21.15.62:0/1760945343 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x561fc2e2c170 msgr2=0x561fc2e2e590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:56.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.528+0000 7fb397926800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:56.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.528+0000 7fb397926800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:56.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.528+0000 7fb397926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:56.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.528+0000 7fb397926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:56.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.528+0000 7fb397926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:56.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.528+0000 7fb397926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:56.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.529+0000 7fb397926800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.529+0000 7fb397926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.529+0000 7fb397926800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.529+0000 7fb397926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:56.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.529+0000 7fb397926800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.529+0000 7fb397926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:56.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.529+0000 7fb397926800 20 zone default found 2024-09-12T00:50:56.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.529+0000 7fb397926800 4 Realm: () 2024-09-12T00:50:56.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.529+0000 7fb397926800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:56.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.529+0000 7fb397926800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:56.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.529+0000 7fb397926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:56.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.529+0000 7fb397926800 20 zonegroup default 2024-09-12T00:50:56.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.529+0000 7fb397926800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.530+0000 7fb397926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.530+0000 7fb397926800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.530+0000 7fb397926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.530+0000 7fb397926800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.530+0000 7fb397926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.530+0000 7fb397926800 20 started sync module instance, tier type = 2024-09-12T00:50:56.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.530+0000 7fb397926800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:56.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.539+0000 7fb397926800 20 add_watcher() i=0 2024-09-12T00:50:56.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.539+0000 7fb397926800 20 add_watcher() i=1 2024-09-12T00:50:56.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.539+0000 7fb397926800 20 add_watcher() i=2 2024-09-12T00:50:56.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.539+0000 7fb397926800 20 add_watcher() i=3 2024-09-12T00:50:56.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.539+0000 7fb397926800 20 add_watcher() i=4 2024-09-12T00:50:56.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.539+0000 7fb397926800 20 add_watcher() i=5 2024-09-12T00:50:56.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.539+0000 7fb397926800 20 add_watcher() i=6 2024-09-12T00:50:56.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.540+0000 7fb397926800 20 add_watcher() i=7 2024-09-12T00:50:56.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.540+0000 7fb397926800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:56.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.541+0000 7fb249fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:56.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.542+0000 7fb397926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:56.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.542+0000 7fb397926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:56.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.542+0000 7fb397926800 5 note: GC not initialized 2024-09-12T00:50:56.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.542+0000 7fb248fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:56.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.542+0000 7fb397926800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:56.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.542+0000 7fb397926800 20 Filter name: none 2024-09-12T00:50:56.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.542+0000 7fb1c27fc640 20 reqs_thread_entry: start 2024-09-12T00:50:56.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.542+0000 7fb397926800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.543+0000 7fb397926800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:56.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.543+0000 7fb397926800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.543+0000 7fb397926800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:56.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.543+0000 7fb397926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:56.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.543+0000 7fb397926800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.543+0000 7fb397926800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:56.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.543+0000 7fb397926800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.544+0000 7fb397926800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:56.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.544+0000 7fb397926800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:56.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.545+0000 7fb249fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:56.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.547+0000 7fb397926800 20 remove_watcher() i=0 2024-09-12T00:50:56.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.547+0000 7fb397926800 2 removed watcher, disabling cache 2024-09-12T00:50:56.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.549+0000 7fb397926800 20 remove_watcher() i=1 2024-09-12T00:50:56.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.550+0000 7fb397926800 20 remove_watcher() i=2 2024-09-12T00:50:56.550 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.551+0000 7fb397926800 20 remove_watcher() i=3 2024-09-12T00:50:56.550 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.552+0000 7fb397926800 20 remove_watcher() i=4 2024-09-12T00:50:56.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.553+0000 7fb397926800 20 remove_watcher() i=5 2024-09-12T00:50:56.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.553+0000 7fb397926800 20 remove_watcher() i=6 2024-09-12T00:50:56.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.554+0000 7fb397926800 20 remove_watcher() i=7 2024-09-12T00:50:56.565 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.565 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:50:56.565 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-set-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:50:56.565 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:50:56.657 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:56.689 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:56.689 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:56.728 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.729+0000 7f1643b34800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.731+0000 7f1643b34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.730 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.731+0000 7f1643b34800 20 realm 2024-09-12T00:50:56.730 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.731+0000 7f1643b34800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.730 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.731+0000 7f1643b34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.730 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.731+0000 7f1643b34800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:56.730 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.731+0000 7f1643b34800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.731 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.731+0000 7f1643b34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.731 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.731+0000 7f1643b34800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.731 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.732+0000 7f1643b34800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:56.731 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.732+0000 7f1643b34800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.732+0000 7f1643b34800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:56.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.732+0000 7f1643b34800 20 searching for the correct realm 2024-09-12T00:50:56.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.735+0000 7f16370b6640 0 -- 172.21.15.62:0/426747094 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f1638061040 msgr2=0x7f1638080400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:56.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.941+0000 7f16400b8640 0 -- 172.21.15.62:0/426747094 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5614c60c3880 msgr2=0x5614c60c5ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:56.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.945+0000 7f1643b34800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:50:56.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.945+0000 7f1643b34800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:50:56.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.945+0000 7f1643b34800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:56.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.945+0000 7f1643b34800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:56.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.945+0000 7f1643b34800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:56.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.945+0000 7f1643b34800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:56.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.945+0000 7f1643b34800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.945+0000 7f1643b34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.945+0000 7f1643b34800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.945+0000 7f1643b34800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:56.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.945+0000 7f1643b34800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.946+0000 7f1643b34800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:56.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.946+0000 7f1643b34800 20 zone default found 2024-09-12T00:50:56.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.946+0000 7f1643b34800 4 Realm: () 2024-09-12T00:50:56.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.946+0000 7f1643b34800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:50:56.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.946+0000 7f1643b34800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:50:56.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.946+0000 7f1643b34800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:56.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.946+0000 7f1643b34800 20 zonegroup default 2024-09-12T00:50:56.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.946+0000 7f1643b34800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.946+0000 7f1643b34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.946+0000 7f1643b34800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.946+0000 7f1643b34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.946+0000 7f1643b34800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.947+0000 7f1643b34800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:56.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.947+0000 7f1643b34800 20 started sync module instance, tier type = 2024-09-12T00:50:56.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.947+0000 7f1643b34800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:50:56.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.955+0000 7f1643b34800 20 add_watcher() i=0 2024-09-12T00:50:56.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.955+0000 7f1643b34800 20 add_watcher() i=1 2024-09-12T00:50:56.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.955+0000 7f1643b34800 20 add_watcher() i=2 2024-09-12T00:50:56.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.955+0000 7f1643b34800 20 add_watcher() i=3 2024-09-12T00:50:56.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.955+0000 7f1643b34800 20 add_watcher() i=4 2024-09-12T00:50:56.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.955+0000 7f1643b34800 20 add_watcher() i=5 2024-09-12T00:50:56.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.955+0000 7f1643b34800 20 add_watcher() i=6 2024-09-12T00:50:56.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.956+0000 7f1643b34800 20 add_watcher() i=7 2024-09-12T00:50:56.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.956+0000 7f1643b34800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:56.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.958+0000 7f14f67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:56.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.958+0000 7f1643b34800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:56.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.958+0000 7f1643b34800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:56.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.958+0000 7f1643b34800 5 note: GC not initialized 2024-09-12T00:50:56.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.958+0000 7f14f57e2640 20 reqs_thread_entry: start 2024-09-12T00:50:56.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.958+0000 7f1643b34800 20 init_complete bucket index max shards: 1 2024-09-12T00:50:56.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.958+0000 7f1643b34800 20 Filter name: none 2024-09-12T00:50:56.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.958+0000 7f14ee7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:56.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.958+0000 7f1643b34800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:50:56.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.958+0000 7f1643b34800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.959+0000 7f1643b34800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:50:56.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.959+0000 7f1643b34800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:50:56.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.959+0000 7f1643b34800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:50:56.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.959+0000 7f1643b34800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 : miss 2024-09-12T00:50:56.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.959+0000 7f1643b34800 20 rados->read ofs=0 len=0 2024-09-12T00:50:56.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.959+0000 7f1643b34800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:50:56.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.959+0000 7f1643b34800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 info.flags=0x17 2024-09-12T00:50:56.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.959+0000 7f1643b34800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 to cache LRU end 2024-09-12T00:50:56.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.959+0000 7f1643b34800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:56.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.959+0000 7f1643b34800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:56.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.959+0000 7f1643b34800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 2024-09-12T00:50:56.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.960+0000 7f1643b34800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 to be held by another RGW process; skipping for now 2024-09-12T00:50:56.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.961+0000 7f14f67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:56.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.963+0000 7f1643b34800 20 remove_watcher() i=0 2024-09-12T00:50:56.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.963+0000 7f1643b34800 2 removed watcher, disabling cache 2024-09-12T00:50:56.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.964+0000 7f1643b34800 20 remove_watcher() i=1 2024-09-12T00:50:56.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.966+0000 7f1643b34800 20 remove_watcher() i=2 2024-09-12T00:50:56.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.967+0000 7f1643b34800 20 remove_watcher() i=3 2024-09-12T00:50:56.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.968+0000 7f1643b34800 20 remove_watcher() i=4 2024-09-12T00:50:56.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.969+0000 7f1643b34800 20 remove_watcher() i=5 2024-09-12T00:50:56.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.970+0000 7f1643b34800 20 remove_watcher() i=6 2024-09-12T00:50:56.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:50:56.971+0000 7f1643b34800 20 remove_watcher() i=7 2024-09-12T00:50:56.980 INFO:tasks.workunit.client.0.smithi062.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:51:27.011 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:51:27.047 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:27.048 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:27.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.094+0000 7f8d8f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.096+0000 7f8d8f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:27.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.096+0000 7f8d8f80f800 20 realm 2024-09-12T00:51:27.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.096+0000 7f8d8f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.096+0000 7f8d8f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:27.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.096+0000 7f8d8f80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:27.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.096+0000 7f8d8f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.097+0000 7f8d8f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:27.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.097+0000 7f8d8f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.097+0000 7f8d8f80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:27.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.098+0000 7f8d8f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.098+0000 7f8d8f80f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:27.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.098+0000 7f8d8f80f800 20 searching for the correct realm 2024-09-12T00:51:27.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.101+0000 7f8d8caf8640 0 -- 172.21.15.62:0/2538477024 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f8d8806e880 msgr2=0x7f8d8808b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:27.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.307+0000 7f8d8caf8640 0 -- 172.21.15.62:0/2538477024 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x559fe8ee9610 msgr2=0x559fe8eeba20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:27.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.312+0000 7f8d8f80f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:27.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.312+0000 7f8d8f80f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:27.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.312+0000 7f8d8f80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:27.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.312+0000 7f8d8f80f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:27.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.312+0000 7f8d8f80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:27.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.312+0000 7f8d8f80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:27.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.312+0000 7f8d8f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.313+0000 7f8d8f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:27.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.313+0000 7f8d8f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.313+0000 7f8d8f80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:27.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.313+0000 7f8d8f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.313+0000 7f8d8f80f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:27.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.313+0000 7f8d8f80f800 20 zone default found 2024-09-12T00:51:27.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.313+0000 7f8d8f80f800 4 Realm: () 2024-09-12T00:51:27.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.313+0000 7f8d8f80f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:27.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.313+0000 7f8d8f80f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:27.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.313+0000 7f8d8f80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:27.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.313+0000 7f8d8f80f800 20 zonegroup default 2024-09-12T00:51:27.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.313+0000 7f8d8f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.314+0000 7f8d8f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:27.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.314+0000 7f8d8f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.314+0000 7f8d8f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:27.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.314+0000 7f8d8f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.314+0000 7f8d8f80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:27.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.314+0000 7f8d8f80f800 20 started sync module instance, tier type = 2024-09-12T00:51:27.316 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.314+0000 7f8d8f80f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:27.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.326+0000 7f8d8f80f800 20 add_watcher() i=0 2024-09-12T00:51:27.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.326+0000 7f8d8f80f800 20 add_watcher() i=1 2024-09-12T00:51:27.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.326+0000 7f8d8f80f800 20 add_watcher() i=2 2024-09-12T00:51:27.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.326+0000 7f8d8f80f800 20 add_watcher() i=3 2024-09-12T00:51:27.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.326+0000 7f8d8f80f800 20 add_watcher() i=4 2024-09-12T00:51:27.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.326+0000 7f8d8f80f800 20 add_watcher() i=5 2024-09-12T00:51:27.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.326+0000 7f8d8f80f800 20 add_watcher() i=6 2024-09-12T00:51:27.326 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.327+0000 7f8d8f80f800 20 add_watcher() i=7 2024-09-12T00:51:27.326 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.327+0000 7f8d8f80f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:27.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.329+0000 7f8c43fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:27.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.329+0000 7f8d8f80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:27.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.329+0000 7f8d8f80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:27.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.329+0000 7f8d8f80f800 5 note: GC not initialized 2024-09-12T00:51:27.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.329+0000 7f8c42fe5640 20 reqs_thread_entry: start 2024-09-12T00:51:27.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.329+0000 7f8d8f80f800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:27.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.329+0000 7f8d8f80f800 20 Filter name: none 2024-09-12T00:51:27.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.330+0000 7f8c40fe1640 20 reqs_thread_entry: start 2024-09-12T00:51:27.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.330+0000 7f8d8f80f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:51:27.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.330+0000 7f8d8f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.330+0000 7f8d8f80f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:51:27.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.330+0000 7f8d8f80f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:51:27.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.330+0000 7f8d8f80f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:51:27.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.330+0000 7f8d8f80f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 : miss 2024-09-12T00:51:27.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.330+0000 7f8d8f80f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.331+0000 7f8d8f80f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:51:27.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.331+0000 7f8d8f80f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 info.flags=0x17 2024-09-12T00:51:27.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.331+0000 7f8d8f80f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 to cache LRU end 2024-09-12T00:51:27.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.331+0000 7f8d8f80f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:27.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.331+0000 7f8d8f80f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:27.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.331+0000 7f8d8f80f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 2024-09-12T00:51:27.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.335+0000 7f8d8f80f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 info.flags=0x17 2024-09-12T00:51:27.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.335+0000 7f8d8f80f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 to cache LRU end 2024-09-12T00:51:27.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.335+0000 7f8d8f80f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:27.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.335+0000 7f8d8f80f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24, ofs0, ns] 2024-09-12T00:51:27.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.336+0000 7f8c70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431639 cookie 94145296186544 notifier 6693 bl.length()=925 2024-09-12T00:51:27.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.336+0000 7f8c70ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 info.flags=0x17 2024-09-12T00:51:27.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.336+0000 7f8c70ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 to cache LRU end 2024-09-12T00:51:27.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.336+0000 7f8c70ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:27.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.337+0000 7f8d8f80f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24]): orig_sources= new_sources= 2024-09-12T00:51:27.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.337+0000 7f8d8f80f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24]): potential sources added=[] removed=[] 2024-09-12T00:51:27.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.338+0000 7f8d8f80f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24]): orig_dests= new_dests= 2024-09-12T00:51:27.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.338+0000 7f8d8f80f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24]): potential dests added=[] removed=[] 2024-09-12T00:51:27.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.340+0000 7f8d8f80f800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24.1.0 2024-09-12T00:51:27.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.340+0000 7f8d8f80f800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24.1.0 2024-09-12T00:51:27.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.340+0000 7f8d8f80f800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24.1.1 2024-09-12T00:51:27.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.340+0000 7f8d8f80f800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24.1.1 2024-09-12T00:51:27.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.340+0000 7f8d8f80f800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24.0 2024-09-12T00:51:27.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.343+0000 7f8d8f80f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:27.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.343+0000 7f8d8f80f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 2024-09-12T00:51:27.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.344+0000 7f8d8f80f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 info.flags=0x17 2024-09-12T00:51:27.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.344+0000 7f8d8f80f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 to cache LRU end 2024-09-12T00:51:27.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.344+0000 7f8d8f80f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:27.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.344+0000 7f8d8f80f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24, ofs0, ns] 2024-09-12T00:51:27.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.345+0000 7f8c70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431640 cookie 94145296186544 notifier 6693 bl.length()=925 2024-09-12T00:51:27.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.345+0000 7f8c70ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 info.flags=0x17 2024-09-12T00:51:27.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.345+0000 7f8c70ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 to cache LRU end 2024-09-12T00:51:27.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.345+0000 7f8c70ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:27.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.346+0000 7f8d8f80f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24]): orig_sources= new_sources= 2024-09-12T00:51:27.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.346+0000 7f8d8f80f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24]): potential sources added=[] removed=[] 2024-09-12T00:51:27.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.346+0000 7f8d8f80f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24]): orig_dests= new_dests= 2024-09-12T00:51:27.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.346+0000 7f8d8f80f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24]): potential dests added=[] removed=[] 2024-09-12T00:51:27.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.347+0000 7f8d8f80f800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24.0 2024-09-12T00:51:27.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.348+0000 7f8d8f80f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:27.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.348+0000 7f8d8f80f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 2024-09-12T00:51:27.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.349+0000 7f8d8f80f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 info.flags=0x17 2024-09-12T00:51:27.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.349+0000 7f8d8f80f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 to cache LRU end 2024-09-12T00:51:27.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.349+0000 7f8d8f80f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:27.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.349+0000 7f8d8f80f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24, ofs0, ns] 2024-09-12T00:51:27.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.350+0000 7f8c5ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431641 cookie 94145296186544 notifier 6693 bl.length()=893 2024-09-12T00:51:27.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.350+0000 7f8c5ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 info.flags=0x17 2024-09-12T00:51:27.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.350+0000 7f8c5ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 to cache LRU end 2024-09-12T00:51:27.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.350+0000 7f8c5ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:27.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.351+0000 7f8d8f80f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24]): orig_sources= new_sources= 2024-09-12T00:51:27.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.351+0000 7f8d8f80f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24]): potential sources added=[] removed=[] 2024-09-12T00:51:27.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.351+0000 7f8d8f80f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24]): orig_dests= new_dests= 2024-09-12T00:51:27.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.351+0000 7f8d8f80f800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24]): potential dests added=[] removed=[] 2024-09-12T00:51:27.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.353+0000 7f8d8f80f800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:51:27.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.355+0000 7f8c43fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:27.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.357+0000 7f8d8f80f800 20 remove_watcher() i=0 2024-09-12T00:51:27.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.357+0000 7f8d8f80f800 2 removed watcher, disabling cache 2024-09-12T00:51:27.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.358+0000 7f8d8f80f800 20 remove_watcher() i=1 2024-09-12T00:51:27.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.360+0000 7f8d8f80f800 20 remove_watcher() i=2 2024-09-12T00:51:27.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.361+0000 7f8d8f80f800 20 remove_watcher() i=3 2024-09-12T00:51:27.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.362+0000 7f8d8f80f800 20 remove_watcher() i=4 2024-09-12T00:51:27.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.363+0000 7f8d8f80f800 20 remove_watcher() i=5 2024-09-12T00:51:27.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.364+0000 7f8d8f80f800 20 remove_watcher() i=6 2024-09-12T00:51:27.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.365+0000 7f8d8f80f800 20 remove_watcher() i=7 2024-09-12T00:51:27.377 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:51:27.408 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:27.408 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:27.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.449+0000 7f810e615800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.451+0000 7f810e615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:27.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.451+0000 7f810e615800 20 realm 2024-09-12T00:51:27.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.451+0000 7f810e615800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.451+0000 7f810e615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:27.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.451+0000 7f810e615800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:27.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.451+0000 7f810e615800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.451+0000 7f810e615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:27.451 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.451+0000 7f810e615800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.451 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.452+0000 7f810e615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:27.451 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.452+0000 7f810e615800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.451 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.452+0000 7f810e615800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:27.452 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.452+0000 7f810e615800 20 searching for the correct realm 2024-09-12T00:51:27.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.455+0000 7f8109591640 0 -- 172.21.15.62:0/1260960157 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f81040a9a70 msgr2=0x7f81040b0170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:27.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.660+0000 7f8109591640 0 -- 172.21.15.62:0/1260960157 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5630f76a9470 msgr2=0x5630f76ab8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:27.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.664+0000 7f810e615800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:27.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.664+0000 7f810e615800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:27.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.664+0000 7f810e615800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:27.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.664+0000 7f810e615800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:27.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.664+0000 7f810e615800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:27.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.664+0000 7f810e615800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:27.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.664+0000 7f810e615800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.665+0000 7f810e615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:27.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.665+0000 7f810e615800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.665+0000 7f810e615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:27.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.665+0000 7f810e615800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.665+0000 7f810e615800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:27.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.665+0000 7f810e615800 20 zone default found 2024-09-12T00:51:27.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.665+0000 7f810e615800 4 Realm: () 2024-09-12T00:51:27.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.665+0000 7f810e615800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:27.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.665+0000 7f810e615800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:27.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.665+0000 7f810e615800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:27.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.665+0000 7f810e615800 20 zonegroup default 2024-09-12T00:51:27.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.665+0000 7f810e615800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.665+0000 7f810e615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:27.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.665+0000 7f810e615800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.666+0000 7f810e615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:27.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.666+0000 7f810e615800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.666+0000 7f810e615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:27.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.666+0000 7f810e615800 20 started sync module instance, tier type = 2024-09-12T00:51:27.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.666+0000 7f810e615800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:27.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.675+0000 7f810e615800 20 add_watcher() i=0 2024-09-12T00:51:27.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.675+0000 7f810e615800 20 add_watcher() i=1 2024-09-12T00:51:27.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.675+0000 7f810e615800 20 add_watcher() i=2 2024-09-12T00:51:27.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.675+0000 7f810e615800 20 add_watcher() i=3 2024-09-12T00:51:27.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.675+0000 7f810e615800 20 add_watcher() i=4 2024-09-12T00:51:27.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.675+0000 7f810e615800 20 add_watcher() i=5 2024-09-12T00:51:27.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.675+0000 7f810e615800 20 add_watcher() i=6 2024-09-12T00:51:27.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.676+0000 7f810e615800 20 add_watcher() i=7 2024-09-12T00:51:27.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.676+0000 7f810e615800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:27.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.678+0000 7f7fbb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:27.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.679+0000 7f810e615800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:27.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.679+0000 7f810e615800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:27.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.679+0000 7f810e615800 5 note: GC not initialized 2024-09-12T00:51:27.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.679+0000 7f7fba7fc640 20 reqs_thread_entry: start 2024-09-12T00:51:27.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.679+0000 7f810e615800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:27.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.679+0000 7f810e615800 20 Filter name: none 2024-09-12T00:51:27.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.679+0000 7f7f2bfff640 20 reqs_thread_entry: start 2024-09-12T00:51:27.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.679+0000 7f810e615800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.680+0000 7f810e615800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:51:27.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.680+0000 7f810e615800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.680+0000 7f810e615800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:51:27.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.680+0000 7f810e615800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:27.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.680+0000 7f810e615800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.681+0000 7f810e615800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:51:27.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.681+0000 7f810e615800 20 rados->read ofs=0 len=0 2024-09-12T00:51:27.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.681+0000 7f810e615800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:51:27.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.681+0000 7f810e615800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:27.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.682+0000 7f7fbb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:27.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.685+0000 7f810e615800 20 remove_watcher() i=0 2024-09-12T00:51:27.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.685+0000 7f810e615800 2 removed watcher, disabling cache 2024-09-12T00:51:27.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.686+0000 7f810e615800 20 remove_watcher() i=1 2024-09-12T00:51:27.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.687+0000 7f810e615800 20 remove_watcher() i=2 2024-09-12T00:51:27.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.688+0000 7f810e615800 20 remove_watcher() i=3 2024-09-12T00:51:27.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.689+0000 7f810e615800 20 remove_watcher() i=4 2024-09-12T00:51:27.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.690+0000 7f810e615800 20 remove_watcher() i=5 2024-09-12T00:51:27.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.691+0000 7f810e615800 20 remove_watcher() i=6 2024-09-12T00:51:27.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:27.692+0000 7f810e615800 20 remove_watcher() i=7 2024-09-12T00:51:27.702 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:27.702 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:51:27.702 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-set-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:51:27.702 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:28.005 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T00:51:28.005 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:28.867 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:51:28.896 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:28.896 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:28.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:28.936+0000 7f0d18b23800 20 rados->read ofs=0 len=0 2024-09-12T00:51:28.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:28.937+0000 7f0d18b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:28.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:28.937+0000 7f0d18b23800 20 realm 2024-09-12T00:51:28.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:28.937+0000 7f0d18b23800 20 rados->read ofs=0 len=0 2024-09-12T00:51:28.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:28.937+0000 7f0d18b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:28.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:28.937+0000 7f0d18b23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:28.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:28.937+0000 7f0d18b23800 20 rados->read ofs=0 len=0 2024-09-12T00:51:28.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:28.938+0000 7f0d18b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:28.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:28.938+0000 7f0d18b23800 20 rados->read ofs=0 len=0 2024-09-12T00:51:28.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:28.938+0000 7f0d18b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:28.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:28.938+0000 7f0d18b23800 20 rados->read ofs=0 len=0 2024-09-12T00:51:28.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:28.939+0000 7f0d18b23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:28.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:28.939+0000 7f0d18b23800 20 searching for the correct realm 2024-09-12T00:51:28.941 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:28.942+0000 7f0d1400b640 0 -- 172.21.15.62:0/1829925800 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f0d0c04e810 msgr2=0x7f0d0c0a5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:29.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.147+0000 7f0d1400b640 0 -- 172.21.15.62:0/1829925800 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5621fc22d3d0 msgr2=0x5621fc22f850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:29.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.151+0000 7f0d18b23800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:29.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.151+0000 7f0d18b23800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:29.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.151+0000 7f0d18b23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:29.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.151+0000 7f0d18b23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:29.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.151+0000 7f0d18b23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:29.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.151+0000 7f0d18b23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:29.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.151+0000 7f0d18b23800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.151+0000 7f0d18b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.151+0000 7f0d18b23800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.152+0000 7f0d18b23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:29.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.152+0000 7f0d18b23800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.152+0000 7f0d18b23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:29.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.152+0000 7f0d18b23800 20 zone default found 2024-09-12T00:51:29.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.152+0000 7f0d18b23800 4 Realm: () 2024-09-12T00:51:29.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.152+0000 7f0d18b23800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:29.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.152+0000 7f0d18b23800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:29.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.152+0000 7f0d18b23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:29.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.152+0000 7f0d18b23800 20 zonegroup default 2024-09-12T00:51:29.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.152+0000 7f0d18b23800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.152+0000 7f0d18b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.152+0000 7f0d18b23800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.153+0000 7f0d18b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.153+0000 7f0d18b23800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.153+0000 7f0d18b23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.153+0000 7f0d18b23800 20 started sync module instance, tier type = 2024-09-12T00:51:29.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.153+0000 7f0d18b23800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:29.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.162+0000 7f0d18b23800 20 add_watcher() i=0 2024-09-12T00:51:29.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.162+0000 7f0d18b23800 20 add_watcher() i=1 2024-09-12T00:51:29.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.162+0000 7f0d18b23800 20 add_watcher() i=2 2024-09-12T00:51:29.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.162+0000 7f0d18b23800 20 add_watcher() i=3 2024-09-12T00:51:29.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.162+0000 7f0d18b23800 20 add_watcher() i=4 2024-09-12T00:51:29.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.162+0000 7f0d18b23800 20 add_watcher() i=5 2024-09-12T00:51:29.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.162+0000 7f0d18b23800 20 add_watcher() i=6 2024-09-12T00:51:29.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.163+0000 7f0d18b23800 20 add_watcher() i=7 2024-09-12T00:51:29.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.163+0000 7f0d18b23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:29.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.165+0000 7f0bcb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:29.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.165+0000 7f0d18b23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:29.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.165+0000 7f0d18b23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:29.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.165+0000 7f0d18b23800 5 note: GC not initialized 2024-09-12T00:51:29.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.166+0000 7f0bca7e4640 20 reqs_thread_entry: start 2024-09-12T00:51:29.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.166+0000 7f0d18b23800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:29.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.166+0000 7f0d18b23800 20 Filter name: none 2024-09-12T00:51:29.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.166+0000 7f0bc37fe640 20 reqs_thread_entry: start 2024-09-12T00:51:29.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.166+0000 7f0d18b23800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.167+0000 7f0d18b23800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:29.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.167+0000 7f0d18b23800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.167+0000 7f0d18b23800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:51:29.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.167+0000 7f0d18b23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:29.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.167+0000 7f0d18b23800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.168+0000 7f0d18b23800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:29.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.168+0000 7f0d18b23800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.168+0000 7f0d18b23800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:51:29.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.168+0000 7f0d18b23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:29.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.169+0000 7f0bcb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:29.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.171+0000 7f0d18b23800 20 remove_watcher() i=0 2024-09-12T00:51:29.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.171+0000 7f0d18b23800 2 removed watcher, disabling cache 2024-09-12T00:51:29.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.172+0000 7f0d18b23800 20 remove_watcher() i=1 2024-09-12T00:51:29.172 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.173+0000 7f0d18b23800 20 remove_watcher() i=2 2024-09-12T00:51:29.173 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.174+0000 7f0d18b23800 20 remove_watcher() i=3 2024-09-12T00:51:29.174 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.175+0000 7f0d18b23800 20 remove_watcher() i=4 2024-09-12T00:51:29.175 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.176+0000 7f0d18b23800 20 remove_watcher() i=5 2024-09-12T00:51:29.176 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.177+0000 7f0d18b23800 20 remove_watcher() i=6 2024-09-12T00:51:29.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.178+0000 7f0d18b23800 20 remove_watcher() i=7 2024-09-12T00:51:29.188 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:29.188 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:51:29.189 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-trim-reshard-log-entries id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:29.189 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:29.190 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T00:51:29.225 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:29.225 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:29.263 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.264+0000 7f8337d3b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.265 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.266+0000 7f8337d3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.265 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.266+0000 7f8337d3b800 20 realm 2024-09-12T00:51:29.265 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.266+0000 7f8337d3b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.265 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.266+0000 7f8337d3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.265 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.266+0000 7f8337d3b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:29.266 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.266+0000 7f8337d3b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.266 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.266+0000 7f8337d3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.266 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.266+0000 7f8337d3b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.267+0000 7f8337d3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:29.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.267+0000 7f8337d3b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.268+0000 7f8337d3b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:29.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.268+0000 7f8337d3b800 20 searching for the correct realm 2024-09-12T00:51:29.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.271+0000 7f83332ba640 0 -- 172.21.15.62:0/1481517779 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f832c07ca80 msgr2=0x7f832c06f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:29.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.274+0000 7f8333abb640 0 -- 172.21.15.62:0/1481517779 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f832c06f410 msgr2=0x7f832c06f890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:29.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:29.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:29.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:29.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:29.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:29.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:29.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.278 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:29.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:29.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 20 zone default found 2024-09-12T00:51:29.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 4 Realm: () 2024-09-12T00:51:29.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:29.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:29.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:29.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 20 zonegroup default 2024-09-12T00:51:29.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.278+0000 7f8337d3b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.279+0000 7f8337d3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.279+0000 7f8337d3b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.279+0000 7f8337d3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.279+0000 7f8337d3b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.279+0000 7f8337d3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.280 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.279+0000 7f8337d3b800 20 started sync module instance, tier type = 2024-09-12T00:51:29.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.279+0000 7f8337d3b800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:29.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.288+0000 7f8337d3b800 20 add_watcher() i=0 2024-09-12T00:51:29.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.288+0000 7f8337d3b800 20 add_watcher() i=1 2024-09-12T00:51:29.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.288+0000 7f8337d3b800 20 add_watcher() i=2 2024-09-12T00:51:29.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.288+0000 7f8337d3b800 20 add_watcher() i=3 2024-09-12T00:51:29.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.288+0000 7f8337d3b800 20 add_watcher() i=4 2024-09-12T00:51:29.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.288+0000 7f8337d3b800 20 add_watcher() i=5 2024-09-12T00:51:29.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.288+0000 7f8337d3b800 20 add_watcher() i=6 2024-09-12T00:51:29.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.289+0000 7f8337d3b800 20 add_watcher() i=7 2024-09-12T00:51:29.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.289+0000 7f8337d3b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:29.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.291+0000 7f81e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:29.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.291+0000 7f8337d3b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:29.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.291+0000 7f8337d3b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:29.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.291+0000 7f8337d3b800 5 note: GC not initialized 2024-09-12T00:51:29.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.292+0000 7f81e8fe1640 20 reqs_thread_entry: start 2024-09-12T00:51:29.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.292+0000 7f8337d3b800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:29.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.292+0000 7f8337d3b800 20 Filter name: none 2024-09-12T00:51:29.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.292+0000 7f81627fc640 20 reqs_thread_entry: start 2024-09-12T00:51:29.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.292+0000 7f8337d3b800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:51:29.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.292+0000 7f8337d3b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.292+0000 7f8337d3b800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:29.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.292+0000 7f8337d3b800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:51:29.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.292+0000 7f8337d3b800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:51:29.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.292+0000 7f8337d3b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 : miss 2024-09-12T00:51:29.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.292+0000 7f8337d3b800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.293+0000 7f8337d3b800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:51:29.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.293+0000 7f8337d3b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 info.flags=0x17 2024-09-12T00:51:29.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.293+0000 7f8337d3b800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 to cache LRU end 2024-09-12T00:51:29.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.293+0000 7f8337d3b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:29.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.293+0000 7f8337d3b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:29.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.293+0000 7f8337d3b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 2024-09-12T00:51:29.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.296+0000 7f8337d3b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 info.flags=0x17 2024-09-12T00:51:29.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.296+0000 7f8337d3b800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 to cache LRU end 2024-09-12T00:51:29.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.296+0000 7f8337d3b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:29.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.296+0000 7f8337d3b800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25, ofs0, ns] 2024-09-12T00:51:29.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.297+0000 7f8212ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431644 cookie 94883090957584 notifier 6744 bl.length()=939 2024-09-12T00:51:29.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.297+0000 7f8212ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 info.flags=0x17 2024-09-12T00:51:29.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.297+0000 7f8212ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 to cache LRU end 2024-09-12T00:51:29.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.297+0000 7f8212ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:29.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.298+0000 7f8337d3b800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): orig_sources= new_sources= 2024-09-12T00:51:29.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.298+0000 7f8337d3b800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): potential sources added=[] removed=[] 2024-09-12T00:51:29.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.298+0000 7f8337d3b800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): orig_dests= new_dests= 2024-09-12T00:51:29.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.298+0000 7f8337d3b800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): potential dests added=[] removed=[] 2024-09-12T00:51:29.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.298+0000 7f8337d3b800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T00:51:29.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.298+0000 7f8337d3b800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T00:51:29.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.301+0000 7f81e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:29.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.303+0000 7f8337d3b800 20 remove_watcher() i=0 2024-09-12T00:51:29.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.303+0000 7f8337d3b800 2 removed watcher, disabling cache 2024-09-12T00:51:29.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.304+0000 7f8337d3b800 20 remove_watcher() i=1 2024-09-12T00:51:29.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.305+0000 7f8337d3b800 20 remove_watcher() i=2 2024-09-12T00:51:29.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.306+0000 7f8337d3b800 20 remove_watcher() i=3 2024-09-12T00:51:29.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.307+0000 7f8337d3b800 20 remove_watcher() i=4 2024-09-12T00:51:29.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.308+0000 7f8337d3b800 20 remove_watcher() i=5 2024-09-12T00:51:29.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.309+0000 7f8337d3b800 20 remove_watcher() i=6 2024-09-12T00:51:29.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.310+0000 7f8337d3b800 20 remove_watcher() i=7 2024-09-12T00:51:29.321 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:51:29.351 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:29.351 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:29.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.390+0000 7fdb95544800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.393+0000 7fdb95544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.393+0000 7fdb95544800 20 realm 2024-09-12T00:51:29.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.393+0000 7fdb95544800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.393+0000 7fdb95544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.393+0000 7fdb95544800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:29.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.393+0000 7fdb95544800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.393+0000 7fdb95544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.393+0000 7fdb95544800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.394+0000 7fdb95544800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:29.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.394+0000 7fdb95544800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.394+0000 7fdb95544800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:29.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.394+0000 7fdb95544800 20 searching for the correct realm 2024-09-12T00:51:29.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.397+0000 7fdb90af3640 0 -- 172.21.15.62:0/1947622781 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fdb8c02a940 msgr2=0x7fdb8c016400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:29.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.603+0000 7fdb91af5640 0 -- 172.21.15.62:0/1947622781 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55fe4b582db0 msgr2=0x55fe4b585250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:29.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.607+0000 7fdb95544800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:29.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.607+0000 7fdb95544800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:29.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.607+0000 7fdb95544800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:29.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.607+0000 7fdb95544800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:29.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.607+0000 7fdb95544800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:29.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.607+0000 7fdb95544800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:29.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.607+0000 7fdb95544800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.607+0000 7fdb95544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.607+0000 7fdb95544800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.607+0000 7fdb95544800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:29.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.607+0000 7fdb95544800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.608+0000 7fdb95544800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:29.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.608+0000 7fdb95544800 20 zone default found 2024-09-12T00:51:29.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.608+0000 7fdb95544800 4 Realm: () 2024-09-12T00:51:29.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.608+0000 7fdb95544800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:29.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.608+0000 7fdb95544800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:29.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.608+0000 7fdb95544800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:29.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.608+0000 7fdb95544800 20 zonegroup default 2024-09-12T00:51:29.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.608+0000 7fdb95544800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.608+0000 7fdb95544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.608+0000 7fdb95544800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.608+0000 7fdb95544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.608+0000 7fdb95544800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.609+0000 7fdb95544800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.609+0000 7fdb95544800 20 started sync module instance, tier type = 2024-09-12T00:51:29.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.609+0000 7fdb95544800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:29.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.617+0000 7fdb95544800 20 add_watcher() i=0 2024-09-12T00:51:29.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.617+0000 7fdb95544800 20 add_watcher() i=1 2024-09-12T00:51:29.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.617+0000 7fdb95544800 20 add_watcher() i=2 2024-09-12T00:51:29.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.617+0000 7fdb95544800 20 add_watcher() i=3 2024-09-12T00:51:29.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.617+0000 7fdb95544800 20 add_watcher() i=4 2024-09-12T00:51:29.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.617+0000 7fdb95544800 20 add_watcher() i=5 2024-09-12T00:51:29.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.617+0000 7fdb95544800 20 add_watcher() i=6 2024-09-12T00:51:29.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.618+0000 7fdb95544800 20 add_watcher() i=7 2024-09-12T00:51:29.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.618+0000 7fdb95544800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:29.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.620+0000 7fda477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:29.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.620+0000 7fdb95544800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:29.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.620+0000 7fdb95544800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:29.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.620+0000 7fdb95544800 5 note: GC not initialized 2024-09-12T00:51:29.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.620+0000 7fda467e4640 20 reqs_thread_entry: start 2024-09-12T00:51:29.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.620+0000 7fdb95544800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:29.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.620+0000 7fdb95544800 20 Filter name: none 2024-09-12T00:51:29.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.621+0000 7fd9b7fff640 20 reqs_thread_entry: start 2024-09-12T00:51:29.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.621+0000 7fdb95544800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.621+0000 7fdb95544800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:29.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.621+0000 7fdb95544800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.622+0000 7fdb95544800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:51:29.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.622+0000 7fdb95544800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:29.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.622+0000 7fdb95544800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.622+0000 7fdb95544800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:29.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.622+0000 7fdb95544800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.622+0000 7fdb95544800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:51:29.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.622+0000 7fdb95544800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:29.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.624+0000 7fda477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:29.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.626+0000 7fdb95544800 20 remove_watcher() i=0 2024-09-12T00:51:29.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.626+0000 7fdb95544800 2 removed watcher, disabling cache 2024-09-12T00:51:29.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.627+0000 7fdb95544800 20 remove_watcher() i=1 2024-09-12T00:51:29.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.628+0000 7fdb95544800 20 remove_watcher() i=2 2024-09-12T00:51:29.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.629+0000 7fdb95544800 20 remove_watcher() i=3 2024-09-12T00:51:29.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.630+0000 7fdb95544800 20 remove_watcher() i=4 2024-09-12T00:51:29.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.631+0000 7fdb95544800 20 remove_watcher() i=5 2024-09-12T00:51:29.630 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.631+0000 7fdb95544800 20 remove_watcher() i=6 2024-09-12T00:51:29.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.633+0000 7fdb95544800 20 remove_watcher() i=7 2024-09-12T00:51:29.643 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:29.643 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:51:29.643 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-trim-reshard-log-entries id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:29.643 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:29.742 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:51:29.774 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:29.774 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:29.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.814+0000 7f3e4b410800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.816+0000 7f3e4b410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.816+0000 7f3e4b410800 20 realm 2024-09-12T00:51:29.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.816+0000 7f3e4b410800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.816+0000 7f3e4b410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.816+0000 7f3e4b410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:29.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.816+0000 7f3e4b410800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.816+0000 7f3e4b410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:29.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.816+0000 7f3e4b410800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.817+0000 7f3e4b410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:29.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.817+0000 7f3e4b410800 20 rados->read ofs=0 len=0 2024-09-12T00:51:29.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.818+0000 7f3e4b410800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:29.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.818+0000 7f3e4b410800 20 searching for the correct realm 2024-09-12T00:51:29.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.820+0000 7f3e472cc640 0 -- 172.21.15.62:0/1455687252 >> [v2:172.21.15.77:6816/3177889521,v1:172.21.15.77:6817/3177889521] conn(0x5615406470e0 msgr2=0x5615406495a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:29.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:29.823+0000 7f3e46acb640 0 -- 172.21.15.62:0/1455687252 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f3e4003c3d0 msgr2=0x7f3e4003c850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:30.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.031+0000 7f3e4b410800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:30.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.031+0000 7f3e4b410800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:30.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.031+0000 7f3e4b410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:30.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.031+0000 7f3e4b410800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:30.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.031+0000 7f3e4b410800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:30.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.031+0000 7f3e4b410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:30.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.031+0000 7f3e4b410800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.031+0000 7f3e4b410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:30.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.031+0000 7f3e4b410800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.031+0000 7f3e4b410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:30.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.031+0000 7f3e4b410800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.032+0000 7f3e4b410800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:30.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.032+0000 7f3e4b410800 20 zone default found 2024-09-12T00:51:30.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.032+0000 7f3e4b410800 4 Realm: () 2024-09-12T00:51:30.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.032+0000 7f3e4b410800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:30.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.032+0000 7f3e4b410800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:30.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.032+0000 7f3e4b410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:30.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.032+0000 7f3e4b410800 20 zonegroup default 2024-09-12T00:51:30.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.032+0000 7f3e4b410800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.032+0000 7f3e4b410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:30.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.032+0000 7f3e4b410800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.032+0000 7f3e4b410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:30.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.032+0000 7f3e4b410800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.033+0000 7f3e4b410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:30.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.033+0000 7f3e4b410800 20 started sync module instance, tier type = 2024-09-12T00:51:30.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.033+0000 7f3e4b410800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:30.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.042+0000 7f3e4b410800 20 add_watcher() i=0 2024-09-12T00:51:30.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.042+0000 7f3e4b410800 20 add_watcher() i=1 2024-09-12T00:51:30.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.042+0000 7f3e4b410800 20 add_watcher() i=2 2024-09-12T00:51:30.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.042+0000 7f3e4b410800 20 add_watcher() i=3 2024-09-12T00:51:30.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.042+0000 7f3e4b410800 20 add_watcher() i=4 2024-09-12T00:51:30.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.042+0000 7f3e4b410800 20 add_watcher() i=5 2024-09-12T00:51:30.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.042+0000 7f3e4b410800 20 add_watcher() i=6 2024-09-12T00:51:30.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.043+0000 7f3e4b410800 20 add_watcher() i=7 2024-09-12T00:51:30.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.043+0000 7f3e4b410800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:30.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.044+0000 7f3cfd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:30.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.045+0000 7f3e4b410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:30.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.045+0000 7f3e4b410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:30.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.045+0000 7f3e4b410800 5 note: GC not initialized 2024-09-12T00:51:30.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.045+0000 7f3c77fff640 20 reqs_thread_entry: start 2024-09-12T00:51:30.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.045+0000 7f3e4b410800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:30.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.045+0000 7f3e4b410800 20 Filter name: none 2024-09-12T00:51:30.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.045+0000 7f3c75ffb640 20 reqs_thread_entry: start 2024-09-12T00:51:30.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.045+0000 7f3e4b410800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:51:30.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.045+0000 7f3e4b410800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.046+0000 7f3e4b410800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:30.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.046+0000 7f3e4b410800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:51:30.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.046+0000 7f3e4b410800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:51:30.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.046+0000 7f3e4b410800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 : miss 2024-09-12T00:51:30.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.046+0000 7f3e4b410800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.046+0000 7f3e4b410800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:51:30.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.046+0000 7f3e4b410800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 info.flags=0x17 2024-09-12T00:51:30.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.046+0000 7f3e4b410800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 to cache LRU end 2024-09-12T00:51:30.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.046+0000 7f3e4b410800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:30.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.046+0000 7f3e4b410800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:30.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.046+0000 7f3e4b410800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 2024-09-12T00:51:30.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.047+0000 7f3e4b410800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:51:30.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.051+0000 7f3e4b410800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 info.flags=0x17 2024-09-12T00:51:30.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.051+0000 7f3e4b410800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 to cache LRU end 2024-09-12T00:51:30.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.051+0000 7f3e4b410800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:30.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.051+0000 7f3e4b410800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25, ofs0, ns] 2024-09-12T00:51:30.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.051+0000 7f3d2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431645 cookie 94649274658752 notifier 6446 bl.length()=939 2024-09-12T00:51:30.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.051+0000 7f3d2a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 info.flags=0x17 2024-09-12T00:51:30.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.051+0000 7f3d2a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 to cache LRU end 2024-09-12T00:51:30.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.051+0000 7f3d2a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:30.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.053+0000 7f3e4b410800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): orig_sources= new_sources= 2024-09-12T00:51:30.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.053+0000 7f3e4b410800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): potential sources added=[] removed=[] 2024-09-12T00:51:30.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.053+0000 7f3e4b410800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): orig_dests= new_dests= 2024-09-12T00:51:30.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.053+0000 7f3e4b410800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): potential dests added=[] removed=[] 2024-09-12T00:51:30.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.055+0000 7f3e4b410800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25.2.0 2024-09-12T00:51:30.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.055+0000 7f3e4b410800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25.2.0 2024-09-12T00:51:30.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.055+0000 7f3e4b410800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25.2.1 2024-09-12T00:51:30.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.055+0000 7f3e4b410800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25.2.1 2024-09-12T00:51:30.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.055+0000 7f3e4b410800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25.0 2024-09-12T00:51:30.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.057+0000 7f3e4b410800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:30.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.058+0000 7f3e4b410800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 2024-09-12T00:51:30.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.059+0000 7f3e4b410800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 info.flags=0x17 2024-09-12T00:51:30.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.059+0000 7f3e4b410800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 to cache LRU end 2024-09-12T00:51:30.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.059+0000 7f3e4b410800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:30.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.059+0000 7f3e4b410800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25, ofs0, ns] 2024-09-12T00:51:30.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.059+0000 7f3d2a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431646 cookie 94649274658752 notifier 6446 bl.length()=939 2024-09-12T00:51:30.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.059+0000 7f3d2a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 info.flags=0x17 2024-09-12T00:51:30.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.059+0000 7f3d2a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 to cache LRU end 2024-09-12T00:51:30.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.059+0000 7f3d2a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:30.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.060+0000 7f3e4b410800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): orig_sources= new_sources= 2024-09-12T00:51:30.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.060+0000 7f3e4b410800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): potential sources added=[] removed=[] 2024-09-12T00:51:30.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.060+0000 7f3e4b410800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): orig_dests= new_dests= 2024-09-12T00:51:30.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.060+0000 7f3e4b410800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): potential dests added=[] removed=[] 2024-09-12T00:51:30.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.062+0000 7f3e4b410800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25.0 2024-09-12T00:51:30.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.062+0000 7f3e4b410800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:30.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.062+0000 7f3e4b410800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 2024-09-12T00:51:30.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.064+0000 7f3e4b410800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 info.flags=0x17 2024-09-12T00:51:30.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.064+0000 7f3e4b410800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 to cache LRU end 2024-09-12T00:51:30.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.064+0000 7f3e4b410800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:30.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.064+0000 7f3e4b410800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25, ofs0, ns] 2024-09-12T00:51:30.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.064+0000 7f3d29ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431647 cookie 94649274658752 notifier 6446 bl.length()=907 2024-09-12T00:51:30.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.064+0000 7f3d29ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 info.flags=0x17 2024-09-12T00:51:30.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.064+0000 7f3d29ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 to cache LRU end 2024-09-12T00:51:30.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.064+0000 7f3d29ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:30.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.065+0000 7f3e4b410800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): orig_sources= new_sources= 2024-09-12T00:51:30.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.065+0000 7f3e4b410800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): potential sources added=[] removed=[] 2024-09-12T00:51:30.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.065+0000 7f3e4b410800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): orig_dests= new_dests= 2024-09-12T00:51:30.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.065+0000 7f3e4b410800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25]): potential dests added=[] removed=[] 2024-09-12T00:51:30.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.066+0000 7f3e4b410800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:51:30.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.068+0000 7f3cfd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:30.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.071+0000 7f3e4b410800 20 remove_watcher() i=0 2024-09-12T00:51:30.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.071+0000 7f3e4b410800 2 removed watcher, disabling cache 2024-09-12T00:51:30.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.072+0000 7f3e4b410800 20 remove_watcher() i=1 2024-09-12T00:51:30.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.073+0000 7f3e4b410800 20 remove_watcher() i=2 2024-09-12T00:51:30.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.074+0000 7f3e4b410800 20 remove_watcher() i=3 2024-09-12T00:51:30.073 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.075+0000 7f3e4b410800 20 remove_watcher() i=4 2024-09-12T00:51:30.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.076+0000 7f3e4b410800 20 remove_watcher() i=5 2024-09-12T00:51:30.076 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.077+0000 7f3e4b410800 20 remove_watcher() i=6 2024-09-12T00:51:30.077 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.078+0000 7f3e4b410800 20 remove_watcher() i=7 2024-09-12T00:51:30.090 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:51:30.119 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:30.119 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:30.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.159+0000 7f69ac214800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.161+0000 7f69ac214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:30.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.161+0000 7f69ac214800 20 realm 2024-09-12T00:51:30.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.161+0000 7f69ac214800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.161+0000 7f69ac214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:30.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.161+0000 7f69ac214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:30.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.161+0000 7f69ac214800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.161+0000 7f69ac214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:30.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.161+0000 7f69ac214800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.162+0000 7f69ac214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:30.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.162+0000 7f69ac214800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.162+0000 7f69ac214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:30.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.162+0000 7f69ac214800 20 searching for the correct realm 2024-09-12T00:51:30.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.165+0000 7f69a70ca640 0 -- 172.21.15.62:0/4257667381 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f69a00b2240 msgr2=0x7f69a00ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:30.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.370+0000 7f69a70ca640 0 -- 172.21.15.62:0/4257667381 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55ae277eb5d0 msgr2=0x55ae277eda40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:30.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.374+0000 7f69ac214800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:30.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.374+0000 7f69ac214800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:30.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.374+0000 7f69ac214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:30.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.374+0000 7f69ac214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:30.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.374+0000 7f69ac214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:30.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.374+0000 7f69ac214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:30.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.374+0000 7f69ac214800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.374+0000 7f69ac214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:30.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.374+0000 7f69ac214800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.375+0000 7f69ac214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:30.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.375+0000 7f69ac214800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.375+0000 7f69ac214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:30.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.375+0000 7f69ac214800 20 zone default found 2024-09-12T00:51:30.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.375+0000 7f69ac214800 4 Realm: () 2024-09-12T00:51:30.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.375+0000 7f69ac214800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:30.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.375+0000 7f69ac214800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:30.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.375+0000 7f69ac214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:30.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.375+0000 7f69ac214800 20 zonegroup default 2024-09-12T00:51:30.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.375+0000 7f69ac214800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.375+0000 7f69ac214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:30.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.375+0000 7f69ac214800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.376+0000 7f69ac214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:30.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.376+0000 7f69ac214800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.376+0000 7f69ac214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:30.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.376+0000 7f69ac214800 20 started sync module instance, tier type = 2024-09-12T00:51:30.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.376+0000 7f69ac214800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:30.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.385+0000 7f69ac214800 20 add_watcher() i=0 2024-09-12T00:51:30.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.385+0000 7f69ac214800 20 add_watcher() i=1 2024-09-12T00:51:30.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.385+0000 7f69ac214800 20 add_watcher() i=2 2024-09-12T00:51:30.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.385+0000 7f69ac214800 20 add_watcher() i=3 2024-09-12T00:51:30.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.385+0000 7f69ac214800 20 add_watcher() i=4 2024-09-12T00:51:30.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.385+0000 7f69ac214800 20 add_watcher() i=5 2024-09-12T00:51:30.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.385+0000 7f69ac214800 20 add_watcher() i=6 2024-09-12T00:51:30.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.385+0000 7f69ac214800 20 add_watcher() i=7 2024-09-12T00:51:30.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.385+0000 7f69ac214800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:30.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.388+0000 7f685dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:30.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.388+0000 7f69ac214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:30.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.388+0000 7f69ac214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:30.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.388+0000 7f69ac214800 5 note: GC not initialized 2024-09-12T00:51:30.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.389+0000 7f685cfe1640 20 reqs_thread_entry: start 2024-09-12T00:51:30.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.389+0000 7f69ac214800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:30.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.389+0000 7f69ac214800 20 Filter name: none 2024-09-12T00:51:30.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.389+0000 7f67d67fc640 20 reqs_thread_entry: start 2024-09-12T00:51:30.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.389+0000 7f69ac214800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.389+0000 7f69ac214800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:30.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.389+0000 7f69ac214800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.390+0000 7f69ac214800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:51:30.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.390+0000 7f69ac214800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:30.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.390+0000 7f69ac214800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.390+0000 7f69ac214800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:30.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.390+0000 7f69ac214800 20 rados->read ofs=0 len=0 2024-09-12T00:51:30.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.391+0000 7f69ac214800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:51:30.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.391+0000 7f69ac214800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:30.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.392+0000 7f685dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:30.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.394+0000 7f69ac214800 20 remove_watcher() i=0 2024-09-12T00:51:30.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.394+0000 7f69ac214800 2 removed watcher, disabling cache 2024-09-12T00:51:30.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.395+0000 7f69ac214800 20 remove_watcher() i=1 2024-09-12T00:51:30.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.396+0000 7f69ac214800 20 remove_watcher() i=2 2024-09-12T00:51:30.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.397+0000 7f69ac214800 20 remove_watcher() i=3 2024-09-12T00:51:30.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.398+0000 7f69ac214800 20 remove_watcher() i=4 2024-09-12T00:51:30.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.399+0000 7f69ac214800 20 remove_watcher() i=5 2024-09-12T00:51:30.399 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.400+0000 7f69ac214800 20 remove_watcher() i=6 2024-09-12T00:51:30.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:30.401+0000 7f69ac214800 20 remove_watcher() i=7 2024-09-12T00:51:30.411 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:30.411 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:51:30.411 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-trim-reshard-log-entries id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:51:30.411 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:30.720 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T00:51:30.720 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:31.605 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:51:31.634 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:31.634 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:31.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.673+0000 7f7152f39800 20 rados->read ofs=0 len=0 2024-09-12T00:51:31.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.675+0000 7f7152f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:31.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.675+0000 7f7152f39800 20 realm 2024-09-12T00:51:31.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.675+0000 7f7152f39800 20 rados->read ofs=0 len=0 2024-09-12T00:51:31.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.675+0000 7f7152f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:31.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.675+0000 7f7152f39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:31.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.675+0000 7f7152f39800 20 rados->read ofs=0 len=0 2024-09-12T00:51:31.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.675+0000 7f7152f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:31.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.675+0000 7f7152f39800 20 rados->read ofs=0 len=0 2024-09-12T00:51:31.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.676+0000 7f7152f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:31.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.676+0000 7f7152f39800 20 rados->read ofs=0 len=0 2024-09-12T00:51:31.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.677+0000 7f7152f39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:31.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.677+0000 7f7152f39800 20 searching for the correct realm 2024-09-12T00:51:31.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.680+0000 7f714e3c6640 0 -- 172.21.15.62:0/286150396 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f7148060b40 msgr2=0x7f7148086910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:31.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.886+0000 7f714ebc7640 0 -- 172.21.15.62:0/286150396 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f7148094400 msgr2=0x7f7148094880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:31.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.890+0000 7f7152f39800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:31.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.890+0000 7f7152f39800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:31.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.890+0000 7f7152f39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:31.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.890+0000 7f7152f39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:31.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.890+0000 7f7152f39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:31.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.890+0000 7f7152f39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:31.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.890+0000 7f7152f39800 20 rados->read ofs=0 len=0 2024-09-12T00:51:31.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.890+0000 7f7152f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:31.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.890+0000 7f7152f39800 20 rados->read ofs=0 len=0 2024-09-12T00:51:31.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.891+0000 7f7152f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:31.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.891+0000 7f7152f39800 20 rados->read ofs=0 len=0 2024-09-12T00:51:31.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.891+0000 7f7152f39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:31.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.891+0000 7f7152f39800 20 zone default found 2024-09-12T00:51:31.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.891+0000 7f7152f39800 4 Realm: () 2024-09-12T00:51:31.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.891+0000 7f7152f39800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:31.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.891+0000 7f7152f39800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:31.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.891+0000 7f7152f39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:31.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.891+0000 7f7152f39800 20 zonegroup default 2024-09-12T00:51:31.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.891+0000 7f7152f39800 20 rados->read ofs=0 len=0 2024-09-12T00:51:31.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.891+0000 7f7152f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:31.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.891+0000 7f7152f39800 20 rados->read ofs=0 len=0 2024-09-12T00:51:31.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.891+0000 7f7152f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:31.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.891+0000 7f7152f39800 20 rados->read ofs=0 len=0 2024-09-12T00:51:31.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.892+0000 7f7152f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:31.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.892+0000 7f7152f39800 20 started sync module instance, tier type = 2024-09-12T00:51:31.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.892+0000 7f7152f39800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:31.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.900+0000 7f7152f39800 20 add_watcher() i=0 2024-09-12T00:51:31.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.900+0000 7f7152f39800 20 add_watcher() i=1 2024-09-12T00:51:31.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.900+0000 7f7152f39800 20 add_watcher() i=2 2024-09-12T00:51:31.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.900+0000 7f7152f39800 20 add_watcher() i=3 2024-09-12T00:51:31.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.900+0000 7f7152f39800 20 add_watcher() i=4 2024-09-12T00:51:31.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.900+0000 7f7152f39800 20 add_watcher() i=5 2024-09-12T00:51:31.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.900+0000 7f7152f39800 20 add_watcher() i=6 2024-09-12T00:51:31.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.901+0000 7f7152f39800 20 add_watcher() i=7 2024-09-12T00:51:31.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.901+0000 7f7152f39800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:31.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.903+0000 7f70057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:31.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.903+0000 7f7152f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:31.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.903+0000 7f7152f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:31.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.903+0000 7f7152f39800 5 note: GC not initialized 2024-09-12T00:51:31.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.904+0000 7f6f7ffff640 20 reqs_thread_entry: start 2024-09-12T00:51:31.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.904+0000 7f7152f39800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:31.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.904+0000 7f7152f39800 20 Filter name: none 2024-09-12T00:51:31.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.904+0000 7f6f7dffb640 20 reqs_thread_entry: start 2024-09-12T00:51:31.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.904+0000 7f7152f39800 20 rados->read ofs=0 len=0 2024-09-12T00:51:31.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.904+0000 7f7152f39800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:31.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.904+0000 7f7152f39800 20 rados->read ofs=0 len=0 2024-09-12T00:51:31.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.905+0000 7f7152f39800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:51:31.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.905+0000 7f7152f39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:31.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.905+0000 7f7152f39800 20 rados->read ofs=0 len=0 2024-09-12T00:51:31.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.905+0000 7f7152f39800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:31.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.905+0000 7f7152f39800 20 rados->read ofs=0 len=0 2024-09-12T00:51:31.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.906+0000 7f7152f39800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:51:31.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.906+0000 7f7152f39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:31.906 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.907+0000 7f70057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:31.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.909+0000 7f7152f39800 20 remove_watcher() i=0 2024-09-12T00:51:31.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.909+0000 7f7152f39800 2 removed watcher, disabling cache 2024-09-12T00:51:31.909 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.910+0000 7f7152f39800 20 remove_watcher() i=1 2024-09-12T00:51:31.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.911+0000 7f7152f39800 20 remove_watcher() i=2 2024-09-12T00:51:31.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.912+0000 7f7152f39800 20 remove_watcher() i=3 2024-09-12T00:51:31.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.913+0000 7f7152f39800 20 remove_watcher() i=4 2024-09-12T00:51:31.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.914+0000 7f7152f39800 20 remove_watcher() i=5 2024-09-12T00:51:31.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.915+0000 7f7152f39800 20 remove_watcher() i=6 2024-09-12T00:51:31.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:31.916+0000 7f7152f39800 20 remove_watcher() i=7 2024-09-12T00:51:31.927 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:31.927 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:51:31.927 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-trim-reshard-log-entries id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:31.927 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:31.928 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T00:51:31.965 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:31.965 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:32.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.005+0000 7f37c4c40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.007+0000 7f37c4c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:32.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.007+0000 7f37c4c40800 20 realm 2024-09-12T00:51:32.006 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.007+0000 7f37c4c40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.007 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.007+0000 7f37c4c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:32.007 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.007+0000 7f37c4c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:32.007 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.007+0000 7f37c4c40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.007 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.007+0000 7f37c4c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:32.007 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.007+0000 7f37c4c40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.008+0000 7f37c4c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:32.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.008+0000 7f37c4c40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.009+0000 7f37c4c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:32.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.009+0000 7f37c4c40800 20 searching for the correct realm 2024-09-12T00:51:32.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.012+0000 7f37c1f29640 0 -- 172.21.15.62:0/275115338 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f37bc066980 msgr2=0x7f37bc09c960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:32.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.217+0000 7f37c1f29640 0 -- 172.21.15.62:0/275115338 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x565424a95350 msgr2=0x565424a977c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:32.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.221+0000 7f37c4c40800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:32.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.221+0000 7f37c4c40800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:32.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.221+0000 7f37c4c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:32.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.221+0000 7f37c4c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:32.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.221+0000 7f37c4c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:32.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.221+0000 7f37c4c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:32.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.221+0000 7f37c4c40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.221+0000 7f37c4c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:32.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.221+0000 7f37c4c40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.222+0000 7f37c4c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:32.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.222+0000 7f37c4c40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.222+0000 7f37c4c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:32.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.222+0000 7f37c4c40800 20 zone default found 2024-09-12T00:51:32.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.222+0000 7f37c4c40800 4 Realm: () 2024-09-12T00:51:32.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.222+0000 7f37c4c40800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:32.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.222+0000 7f37c4c40800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:32.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.222+0000 7f37c4c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:32.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.222+0000 7f37c4c40800 20 zonegroup default 2024-09-12T00:51:32.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.222+0000 7f37c4c40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.222+0000 7f37c4c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:32.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.222+0000 7f37c4c40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.222+0000 7f37c4c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:32.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.222+0000 7f37c4c40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.223+0000 7f37c4c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:32.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.223+0000 7f37c4c40800 20 started sync module instance, tier type = 2024-09-12T00:51:32.224 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.223+0000 7f37c4c40800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:32.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.231+0000 7f37c4c40800 20 add_watcher() i=0 2024-09-12T00:51:32.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.231+0000 7f37c4c40800 20 add_watcher() i=1 2024-09-12T00:51:32.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.231+0000 7f37c4c40800 20 add_watcher() i=2 2024-09-12T00:51:32.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.231+0000 7f37c4c40800 20 add_watcher() i=3 2024-09-12T00:51:32.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.231+0000 7f37c4c40800 20 add_watcher() i=4 2024-09-12T00:51:32.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.231+0000 7f37c4c40800 20 add_watcher() i=5 2024-09-12T00:51:32.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.231+0000 7f37c4c40800 20 add_watcher() i=6 2024-09-12T00:51:32.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.232+0000 7f37c4c40800 20 add_watcher() i=7 2024-09-12T00:51:32.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.232+0000 7f37c4c40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:32.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.234+0000 7f3678fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:32.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.234+0000 7f37c4c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:32.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.234+0000 7f37c4c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:32.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.234+0000 7f37c4c40800 5 note: GC not initialized 2024-09-12T00:51:32.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.235+0000 7f35f37fe640 20 reqs_thread_entry: start 2024-09-12T00:51:32.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.235+0000 7f37c4c40800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:32.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.235+0000 7f37c4c40800 20 Filter name: none 2024-09-12T00:51:32.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.235+0000 7f35f17fa640 20 reqs_thread_entry: start 2024-09-12T00:51:32.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.235+0000 7f37c4c40800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:51:32.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.235+0000 7f37c4c40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.235 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.235+0000 7f37c4c40800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:32.235 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.235+0000 7f37c4c40800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:51:32.235 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.235+0000 7f37c4c40800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:51:32.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.235+0000 7f37c4c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 : miss 2024-09-12T00:51:32.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.235+0000 7f37c4c40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.236+0000 7f37c4c40800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:51:32.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.236+0000 7f37c4c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 info.flags=0x17 2024-09-12T00:51:32.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.236+0000 7f37c4c40800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 to cache LRU end 2024-09-12T00:51:32.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.236+0000 7f37c4c40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:32.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.236+0000 7f37c4c40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:32.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.236+0000 7f37c4c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 2024-09-12T00:51:32.238 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.239+0000 7f37c4c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 info.flags=0x17 2024-09-12T00:51:32.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.239+0000 7f37c4c40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 to cache LRU end 2024-09-12T00:51:32.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.239+0000 7f37c4c40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:32.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.239+0000 7f37c4c40800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26, ofs0, ns] 2024-09-12T00:51:32.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.240+0000 7f36a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431650 cookie 94919392400896 notifier 6497 bl.length()=939 2024-09-12T00:51:32.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.240+0000 7f36a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 info.flags=0x17 2024-09-12T00:51:32.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.240+0000 7f36a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 to cache LRU end 2024-09-12T00:51:32.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.240+0000 7f36a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:32.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.241+0000 7f37c4c40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26]): orig_sources= new_sources= 2024-09-12T00:51:32.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.241+0000 7f37c4c40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26]): potential sources added=[] removed=[] 2024-09-12T00:51:32.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.241+0000 7f37c4c40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26]): orig_dests= new_dests= 2024-09-12T00:51:32.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.241+0000 7f37c4c40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26]): potential dests added=[] removed=[] 2024-09-12T00:51:32.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.241+0000 7f37c4c40800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T00:51:32.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.241+0000 7f37c4c40800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:51:32.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.243+0000 7f37c4c40800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26.1.0 2024-09-12T00:51:32.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.243+0000 7f37c4c40800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26.1.0 2024-09-12T00:51:32.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.243+0000 7f37c4c40800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26.1.1 2024-09-12T00:51:32.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.243+0000 7f37c4c40800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26.1.1 2024-09-12T00:51:32.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.243+0000 7f37c4c40800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26.0 2024-09-12T00:51:32.244 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.245+0000 7f37c4c40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:32.244 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.245+0000 7f37c4c40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 2024-09-12T00:51:32.245 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.246+0000 7f37c4c40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 info.flags=0x17 2024-09-12T00:51:32.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.246+0000 7f37c4c40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 to cache LRU end 2024-09-12T00:51:32.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.246+0000 7f37c4c40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:32.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.246+0000 7f37c4c40800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26, ofs0, ns] 2024-09-12T00:51:32.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.246+0000 7f36a57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431651 cookie 94919392400896 notifier 6497 bl.length()=907 2024-09-12T00:51:32.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.246+0000 7f36a57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 info.flags=0x17 2024-09-12T00:51:32.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.246+0000 7f36a57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 to cache LRU end 2024-09-12T00:51:32.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.246+0000 7f36a57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:32.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.248+0000 7f37c4c40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26]): orig_sources= new_sources= 2024-09-12T00:51:32.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.248+0000 7f37c4c40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26]): potential sources added=[] removed=[] 2024-09-12T00:51:32.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.248+0000 7f37c4c40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26]): orig_dests= new_dests= 2024-09-12T00:51:32.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.248+0000 7f37c4c40800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26]): potential dests added=[] removed=[] 2024-09-12T00:51:32.248 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.249+0000 7f37c4c40800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:51:32.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.251+0000 7f3678fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:32.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.253+0000 7f37c4c40800 20 remove_watcher() i=0 2024-09-12T00:51:32.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.253+0000 7f37c4c40800 2 removed watcher, disabling cache 2024-09-12T00:51:32.253 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.254+0000 7f37c4c40800 20 remove_watcher() i=1 2024-09-12T00:51:32.254 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.255+0000 7f37c4c40800 20 remove_watcher() i=2 2024-09-12T00:51:32.255 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.256+0000 7f37c4c40800 20 remove_watcher() i=3 2024-09-12T00:51:32.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.257+0000 7f37c4c40800 20 remove_watcher() i=4 2024-09-12T00:51:32.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.258+0000 7f37c4c40800 20 remove_watcher() i=5 2024-09-12T00:51:32.258 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.260+0000 7f37c4c40800 20 remove_watcher() i=6 2024-09-12T00:51:32.259 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.260+0000 7f37c4c40800 20 remove_watcher() i=7 2024-09-12T00:51:32.272 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:51:32.302 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:32.302 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:32.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.342+0000 7f9e8a933800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.344+0000 7f9e8a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:32.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.344+0000 7f9e8a933800 20 realm 2024-09-12T00:51:32.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.344+0000 7f9e8a933800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.344+0000 7f9e8a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:32.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.344+0000 7f9e8a933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:32.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.344+0000 7f9e8a933800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.344+0000 7f9e8a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:32.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.344+0000 7f9e8a933800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.345+0000 7f9e8a933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:32.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.345+0000 7f9e8a933800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.346+0000 7f9e8a933800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:32.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.346+0000 7f9e8a933800 20 searching for the correct realm 2024-09-12T00:51:32.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.349+0000 7f9e85e75640 0 -- 172.21.15.62:0/280535390 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f9e80072b90 msgr2=0x7f9e800763c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:32.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.352+0000 7f9e86e77640 0 -- 172.21.15.62:0/280535390 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55c6e2cdb3f0 msgr2=0x55c6e2cdd840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:32.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.356+0000 7f9e8a933800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:32.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.356+0000 7f9e8a933800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:32.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.356+0000 7f9e8a933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:32.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.356+0000 7f9e8a933800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:32.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.356+0000 7f9e8a933800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:32.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.356+0000 7f9e8a933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:32.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.356+0000 7f9e8a933800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.356+0000 7f9e8a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:32.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.356+0000 7f9e8a933800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.357 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.357+0000 7f9e8a933800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:32.357 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.357+0000 7f9e8a933800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.357+0000 7f9e8a933800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:32.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.357+0000 7f9e8a933800 20 zone default found 2024-09-12T00:51:32.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.357+0000 7f9e8a933800 4 Realm: () 2024-09-12T00:51:32.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.357+0000 7f9e8a933800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:32.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.357+0000 7f9e8a933800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:32.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.357+0000 7f9e8a933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:32.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.357+0000 7f9e8a933800 20 zonegroup default 2024-09-12T00:51:32.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.357+0000 7f9e8a933800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.357+0000 7f9e8a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:32.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.357+0000 7f9e8a933800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.357+0000 7f9e8a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:32.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.357+0000 7f9e8a933800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.358+0000 7f9e8a933800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:32.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.358+0000 7f9e8a933800 20 started sync module instance, tier type = 2024-09-12T00:51:32.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.358+0000 7f9e8a933800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:32.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.366+0000 7f9e8a933800 20 add_watcher() i=0 2024-09-12T00:51:32.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.366+0000 7f9e8a933800 20 add_watcher() i=1 2024-09-12T00:51:32.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.366+0000 7f9e8a933800 20 add_watcher() i=2 2024-09-12T00:51:32.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.366+0000 7f9e8a933800 20 add_watcher() i=3 2024-09-12T00:51:32.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.366+0000 7f9e8a933800 20 add_watcher() i=4 2024-09-12T00:51:32.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.366+0000 7f9e8a933800 20 add_watcher() i=5 2024-09-12T00:51:32.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.366+0000 7f9e8a933800 20 add_watcher() i=6 2024-09-12T00:51:32.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.367+0000 7f9e8a933800 20 add_watcher() i=7 2024-09-12T00:51:32.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.367+0000 7f9e8a933800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:32.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.369+0000 7f9d3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:32.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.370+0000 7f9e8a933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:32.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.370+0000 7f9e8a933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:32.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.370+0000 7f9e8a933800 5 note: GC not initialized 2024-09-12T00:51:32.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.370+0000 7f9cb77fe640 20 reqs_thread_entry: start 2024-09-12T00:51:32.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.370+0000 7f9e8a933800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:32.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.370+0000 7f9e8a933800 20 Filter name: none 2024-09-12T00:51:32.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.370+0000 7f9cb57fa640 20 reqs_thread_entry: start 2024-09-12T00:51:32.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.370+0000 7f9e8a933800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.371+0000 7f9e8a933800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:32.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.371+0000 7f9e8a933800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.371+0000 7f9e8a933800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:51:32.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.371+0000 7f9e8a933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:32.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.371+0000 7f9e8a933800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.371+0000 7f9e8a933800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:32.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.371+0000 7f9e8a933800 20 rados->read ofs=0 len=0 2024-09-12T00:51:32.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.372+0000 7f9e8a933800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:51:32.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.372+0000 7f9e8a933800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:32.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.373+0000 7f9d3cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:32.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.375+0000 7f9e8a933800 20 remove_watcher() i=0 2024-09-12T00:51:32.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.375+0000 7f9e8a933800 2 removed watcher, disabling cache 2024-09-12T00:51:32.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.376+0000 7f9e8a933800 20 remove_watcher() i=1 2024-09-12T00:51:32.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.377+0000 7f9e8a933800 20 remove_watcher() i=2 2024-09-12T00:51:32.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.378+0000 7f9e8a933800 20 remove_watcher() i=3 2024-09-12T00:51:32.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.380+0000 7f9e8a933800 20 remove_watcher() i=4 2024-09-12T00:51:32.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.381+0000 7f9e8a933800 20 remove_watcher() i=5 2024-09-12T00:51:32.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.382+0000 7f9e8a933800 20 remove_watcher() i=6 2024-09-12T00:51:32.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:32.383+0000 7f9e8a933800 20 remove_watcher() i=7 2024-09-12T00:51:32.392 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:32.393 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:51:32.393 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-trim-reshard-log-entries id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:51:32.393 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:32.706 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T00:51:32.706 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:33.562 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:51:33.591 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:33.591 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:33.630 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.631+0000 7f1ffbf35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.633+0000 7f1ffbf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:33.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.633+0000 7f1ffbf35800 20 realm 2024-09-12T00:51:33.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.633+0000 7f1ffbf35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.633+0000 7f1ffbf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:33.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.633+0000 7f1ffbf35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:33.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.633+0000 7f1ffbf35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.633+0000 7f1ffbf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:33.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.633+0000 7f1ffbf35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.634+0000 7f1ffbf35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:33.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.634+0000 7f1ffbf35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.635+0000 7f1ffbf35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:33.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.635+0000 7f1ffbf35800 20 searching for the correct realm 2024-09-12T00:51:33.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.638+0000 7f1ff74e3640 0 -- 172.21.15.62:0/1031791432 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f1ff0083b00 msgr2=0x7f1ff0087190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:33.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.843+0000 7f1ff84e5640 0 -- 172.21.15.62:0/1031791432 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x556c631f9740 msgr2=0x556c631fbbd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:33.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.846+0000 7f1ffbf35800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:33.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.846+0000 7f1ffbf35800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:33.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.846+0000 7f1ffbf35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:33.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.846+0000 7f1ffbf35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:33.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.846+0000 7f1ffbf35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:33.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.846+0000 7f1ffbf35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:33.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.846+0000 7f1ffbf35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.847+0000 7f1ffbf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:33.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.847+0000 7f1ffbf35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.847+0000 7f1ffbf35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:33.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.847+0000 7f1ffbf35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.847+0000 7f1ffbf35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:33.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.847+0000 7f1ffbf35800 20 zone default found 2024-09-12T00:51:33.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.847+0000 7f1ffbf35800 4 Realm: () 2024-09-12T00:51:33.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.847+0000 7f1ffbf35800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:33.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.847+0000 7f1ffbf35800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:33.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.847+0000 7f1ffbf35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:33.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.847+0000 7f1ffbf35800 20 zonegroup default 2024-09-12T00:51:33.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.847+0000 7f1ffbf35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.847+0000 7f1ffbf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:33.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.847+0000 7f1ffbf35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.848+0000 7f1ffbf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:33.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.848+0000 7f1ffbf35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.848+0000 7f1ffbf35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:33.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.848+0000 7f1ffbf35800 20 started sync module instance, tier type = 2024-09-12T00:51:33.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.848+0000 7f1ffbf35800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:33.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.857+0000 7f1ffbf35800 20 add_watcher() i=0 2024-09-12T00:51:33.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.857+0000 7f1ffbf35800 20 add_watcher() i=1 2024-09-12T00:51:33.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.857+0000 7f1ffbf35800 20 add_watcher() i=2 2024-09-12T00:51:33.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.857+0000 7f1ffbf35800 20 add_watcher() i=3 2024-09-12T00:51:33.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.857+0000 7f1ffbf35800 20 add_watcher() i=4 2024-09-12T00:51:33.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.857+0000 7f1ffbf35800 20 add_watcher() i=5 2024-09-12T00:51:33.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.857+0000 7f1ffbf35800 20 add_watcher() i=6 2024-09-12T00:51:33.857 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.858+0000 7f1ffbf35800 20 add_watcher() i=7 2024-09-12T00:51:33.857 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.858+0000 7f1ffbf35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:33.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.860+0000 7f1eadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:33.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.860+0000 7f1ffbf35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:33.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.860+0000 7f1ffbf35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:33.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.860+0000 7f1ffbf35800 5 note: GC not initialized 2024-09-12T00:51:33.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.860+0000 7f1eacfe1640 20 reqs_thread_entry: start 2024-09-12T00:51:33.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.860+0000 7f1ffbf35800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:33.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.861+0000 7f1ffbf35800 20 Filter name: none 2024-09-12T00:51:33.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.861+0000 7f1e267fc640 20 reqs_thread_entry: start 2024-09-12T00:51:33.860 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.861+0000 7f1ffbf35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.861+0000 7f1ffbf35800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:33.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.861+0000 7f1ffbf35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.862+0000 7f1ffbf35800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:51:33.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.862+0000 7f1ffbf35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:33.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.862+0000 7f1ffbf35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.862+0000 7f1ffbf35800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:33.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.862+0000 7f1ffbf35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.862+0000 7f1ffbf35800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:51:33.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.862+0000 7f1ffbf35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:33.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.864+0000 7f1eadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:33.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.867+0000 7f1ffbf35800 20 remove_watcher() i=0 2024-09-12T00:51:33.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.867+0000 7f1ffbf35800 2 removed watcher, disabling cache 2024-09-12T00:51:33.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.868+0000 7f1ffbf35800 20 remove_watcher() i=1 2024-09-12T00:51:33.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.869+0000 7f1ffbf35800 20 remove_watcher() i=2 2024-09-12T00:51:33.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.870+0000 7f1ffbf35800 20 remove_watcher() i=3 2024-09-12T00:51:33.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.871+0000 7f1ffbf35800 20 remove_watcher() i=4 2024-09-12T00:51:33.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.872+0000 7f1ffbf35800 20 remove_watcher() i=5 2024-09-12T00:51:33.871 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.873+0000 7f1ffbf35800 20 remove_watcher() i=6 2024-09-12T00:51:33.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.874+0000 7f1ffbf35800 20 remove_watcher() i=7 2024-09-12T00:51:33.884 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:33.884 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:51:33.884 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-trim-reshard-log-entries id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:33.884 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:33.886 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T00:51:33.920 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:33.920 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:33.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.960+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:33.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.962+0000 7fde99b40800 20 realm 2024-09-12T00:51:33.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:33.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.962+0000 7fde99b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:33.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:33.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.963+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:33.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.963+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.963+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:33.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.963+0000 7fde99b40800 20 searching for the correct realm 2024-09-12T00:51:33.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.966+0000 7fde8d0bf640 0 -- 172.21.15.62:0/79011188 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fde90048060 msgr2=0x7fde9008ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:33.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.970+0000 7fde958c0640 0 -- 172.21.15.62:0/79011188 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7fde9008ee10 msgr2=0x7fde9008ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:33.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:33.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:33.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:33.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:33.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:33.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:33.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.973+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:33.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:33.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:33.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.974+0000 7fde99b40800 20 zone default found 2024-09-12T00:51:33.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.974+0000 7fde99b40800 4 Realm: () 2024-09-12T00:51:33.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.974+0000 7fde99b40800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:33.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.974+0000 7fde99b40800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:33.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.974+0000 7fde99b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:33.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.974+0000 7fde99b40800 20 zonegroup default 2024-09-12T00:51:33.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:33.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.975+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:33.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.975+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.975+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:33.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.975+0000 7fde99b40800 20 started sync module instance, tier type = 2024-09-12T00:51:33.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.975+0000 7fde99b40800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:33.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=0 2024-09-12T00:51:33.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=1 2024-09-12T00:51:33.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=2 2024-09-12T00:51:33.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=3 2024-09-12T00:51:33.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=4 2024-09-12T00:51:33.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=5 2024-09-12T00:51:33.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=6 2024-09-12T00:51:33.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.985+0000 7fde99b40800 20 add_watcher() i=7 2024-09-12T00:51:33.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.985+0000 7fde99b40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:33.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.987+0000 7fdd477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:33.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.987+0000 7fde99b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:33.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.987+0000 7fde99b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:33.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.987+0000 7fde99b40800 5 note: GC not initialized 2024-09-12T00:51:33.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.987+0000 7fdd467fc640 20 reqs_thread_entry: start 2024-09-12T00:51:33.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.987+0000 7fde99b40800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:33.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.987+0000 7fde99b40800 20 Filter name: none 2024-09-12T00:51:33.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.987+0000 7fdcb7fff640 20 reqs_thread_entry: start 2024-09-12T00:51:33.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.988+0000 7fde99b40800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:51:33.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.988+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.988+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:33.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.988+0000 7fde99b40800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:51:33.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.988+0000 7fde99b40800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:51:33.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.988+0000 7fde99b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 : miss 2024-09-12T00:51:33.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.988+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:33.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.988+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:51:33.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.988+0000 7fde99b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:51:33.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.988+0000 7fde99b40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:51:33.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.988+0000 7fde99b40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:33.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.988+0000 7fde99b40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:33.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.988+0000 7fde99b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 2024-09-12T00:51:33.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.992+0000 7fde99b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:51:33.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.992+0000 7fde99b40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:51:33.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.992+0000 7fde99b40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:33.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.992+0000 7fde99b40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27, ofs0, ns] 2024-09-12T00:51:33.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.992+0000 7fdd797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431654 cookie 93895973222704 notifier 6548 bl.length()=939 2024-09-12T00:51:33.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.992+0000 7fdd797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:51:33.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.992+0000 7fdd797fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:51:33.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.992+0000 7fdd797fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:33.993 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.994+0000 7fde99b40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): orig_sources= new_sources= 2024-09-12T00:51:33.993 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.994+0000 7fde99b40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): potential sources added=[] removed=[] 2024-09-12T00:51:33.993 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.994+0000 7fde99b40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): orig_dests= new_dests= 2024-09-12T00:51:33.993 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde99b40800 time 2024-09-12T00:51:33.995464+0000 2024-09-12T00:51:33.993 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:33.993 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.994+0000 7fde99b40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): potential dests added=[] removed=[] 2024-09-12T00:51:33.994 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:33.994 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde9b38c71a] 2024-09-12T00:51:33.994 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde9b38c8d8] 2024-09-12T00:51:33.994 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565d9ef9641] 2024-09-12T00:51:33.995 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd884de) [0x5565da40c4de] 2024-09-12T00:51:33.995 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565d9f0931d] 2024-09-12T00:51:33.995 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:51:33.995 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fde9a029590] 2024-09-12T00:51:33.996 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:51:33.996 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:51:33.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.995+0000 7fde99b40800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde99b40800 time 2024-09-12T00:51:33.995464+0000 2024-09-12T00:51:33.997 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:33.997 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:33.997 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:33.997 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde9b38c71a] 2024-09-12T00:51:33.997 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde9b38c8d8] 2024-09-12T00:51:33.997 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565d9ef9641] 2024-09-12T00:51:33.997 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd884de) [0x5565da40c4de] 2024-09-12T00:51:33.997 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565d9f0931d] 2024-09-12T00:51:33.997 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:51:33.998 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fde9a029590] 2024-09-12T00:51:33.998 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:51:33.998 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:51:33.998 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:33.998 INFO:tasks.workunit.client.0.smithi062.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:51:33.998 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7fde99b40800 thread_name:radosgw-admin 2024-09-12T00:51:34.016 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:34.016 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde9a03e6f0] 2024-09-12T00:51:34.016 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde9a08b99c] 2024-09-12T00:51:34.016 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:51:34.016 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:51:34.017 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde9b38c774] 2024-09-12T00:51:34.017 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde9b38c8d8] 2024-09-12T00:51:34.017 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565d9ef9641] 2024-09-12T00:51:34.017 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd884de) [0x5565da40c4de] 2024-09-12T00:51:34.017 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565d9f0931d] 2024-09-12T00:51:34.017 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:51:34.017 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fde9a029590] 2024-09-12T00:51:34.017 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:51:34.017 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:51:34.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:33.996+0000 7fde99b40800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:34.017 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7fde99b40800 thread_name:radosgw-admin 2024-09-12T00:51:34.018 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.018 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:34.018 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde9a03e6f0] 2024-09-12T00:51:34.018 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde9a08b99c] 2024-09-12T00:51:34.018 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:51:34.018 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:51:34.018 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde9b38c774] 2024-09-12T00:51:34.018 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde9b38c8d8] 2024-09-12T00:51:34.018 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565d9ef9641] 2024-09-12T00:51:34.018 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd884de) [0x5565da40c4de] 2024-09-12T00:51:34.019 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565d9f0931d] 2024-09-12T00:51:34.019 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:51:34.019 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fde9a029590] 2024-09-12T00:51:34.019 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:51:34.019 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:51:34.019 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:34.019 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.019 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:51:34.019 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding auth protocol: cephx 2024-09-12T00:51:34.019 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding auth protocol: cephx 2024-09-12T00:51:34.020 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding auth protocol: cephx 2024-09-12T00:51:34.020 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: secure 2024-09-12T00:51:34.020 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: crc 2024-09-12T00:51:34.020 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: secure 2024-09-12T00:51:34.020 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: crc 2024-09-12T00:51:34.020 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: secure 2024-09-12T00:51:34.020 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: crc 2024-09-12T00:51:34.020 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: crc 2024-09-12T00:51:34.020 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: secure 2024-09-12T00:51:34.020 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: crc 2024-09-12T00:51:34.020 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: secure 2024-09-12T00:51:34.021 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: crc 2024-09-12T00:51:34.021 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: secure 2024-09-12T00:51:34.021 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:51:33.944+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.021 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:51:33.944+0000 7fde99b40800 1 librados: starting msgr at 2024-09-12T00:51:34.021 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:51:33.944+0000 7fde99b40800 1 librados: starting objecter 2024-09-12T00:51:34.021 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command objecter_requests hook 0x5565dc140570 2024-09-12T00:51:34.021 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:51:33.944+0000 7fde99b40800 1 librados: setting wanted keys 2024-09-12T00:51:34.021 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:51:33.944+0000 7fde99b40800 1 librados: calling monclient init 2024-09-12T00:51:34.021 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:51:33.944+0000 7fde99b40800 10 monclient: init 2024-09-12T00:51:34.021 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding auth protocol: cephx 2024-09-12T00:51:34.021 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding auth protocol: cephx 2024-09-12T00:51:34.021 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding auth protocol: cephx 2024-09-12T00:51:34.021 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: secure 2024-09-12T00:51:34.022 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: crc 2024-09-12T00:51:34.022 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: secure 2024-09-12T00:51:34.022 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: crc 2024-09-12T00:51:34.022 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: secure 2024-09-12T00:51:34.022 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: crc 2024-09-12T00:51:34.022 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: crc 2024-09-12T00:51:34.022 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: secure 2024-09-12T00:51:34.022 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: crc 2024-09-12T00:51:34.022 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: secure 2024-09-12T00:51:34.022 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: crc 2024-09-12T00:51:34.022 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: secure 2024-09-12T00:51:34.023 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:51:33.944+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.023 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:51:33.944+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.023 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command rotate-key hook 0x5565dc116ab8 2024-09-12T00:51:34.023 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:51:33.944+0000 7fde99b40800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:34.023 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:51:33.944+0000 7fde99b40800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:51:34.023 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:51:33.944+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-b con 0x5565dbfc32d0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:51:34.023 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:51:33.944+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-a con 0x5565dbfcfc20 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:51:34.023 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:51:33.944+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-c con 0x5565dc141190 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:51:34.023 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:51:33.944+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.023 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.023 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.023 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:34.024 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient(hunting): authenticate will time out at 1980.438013s 2024-09-12T00:51:34.024 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:51:33.945+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request con 0x5565dbfcfc20 auth_method 0 2024-09-12T00:51:34.024 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:51:33.945+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.024 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:51:33.945+0000 7fde8d0bf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.024 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:51:33.945+0000 7fde8d0bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.024 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): get_auth_request con 0x5565dc141190 auth_method 0 2024-09-12T00:51:34.024 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.024 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.024 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.024 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:51:33.945+0000 7fde958c0640 10 monclient(hunting): get_auth_request con 0x5565dbfc32d0 auth_method 0 2024-09-12T00:51:34.024 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:51:33.945+0000 7fde958c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.025 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:51:33.945+0000 7fde958c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.025 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:51:33.945+0000 7fde958c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.025 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.025 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.025 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.025 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:51:33.945+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.025 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:51:33.945+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.025 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:51:33.945+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.025 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:51:33.945+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.025 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:51:33.945+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.025 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:51:33.945+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.026 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): handle_auth_done global_id 6539 payload 824 2024-09-12T00:51:34.026 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient: _finish_hunting 0 2024-09-12T00:51:34.026 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:51:33.945+0000 7fde960c1640 1 monclient: found mon.noname-c 2024-09-12T00:51:34.026 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.026 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.026 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:34.026 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: dump: 2024-09-12T00:51:34.026 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.026 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.026 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.026 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.027 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.027 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.027 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.027 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.027 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.027 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.027 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: _finish_auth 0 2024-09-12T00:51:34.027 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: _check_auth_tickets 2024-09-12T00:51:34.027 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:34.027 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.027 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:34.027 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: dump: 2024-09-12T00:51:34.028 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.028 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.028 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.028 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.028 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.028 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.028 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.028 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.028 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.028 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.028 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:51:33.945+0000 7fde99b40800 5 monclient: authenticate success, global_id 6539 2024-09-12T00:51:34.029 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient: _renew_subs 2024-09-12T00:51:34.029 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:51:33.945+0000 7fdd83e07640 4 set_mon_vals no callback set 2024-09-12T00:51:34.029 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.029 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient: _renew_subs 2024-09-12T00:51:34.029 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.029 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:51:33.945+0000 7fde99b40800 1 librados: init done 2024-09-12T00:51:34.029 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:51:33.947+0000 7fdd82604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:34.029 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:51:33.947+0000 7fdd82604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:51:34.029 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:51:33.947+0000 7fdd82604640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:51:34.029 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:51:33.947+0000 7fde958c0640 10 monclient: get_auth_request con 0x7fdd7c076470 auth_method 0 2024-09-12T00:51:34.029 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:51:33.948+0000 7fde8d0bf640 10 monclient: get_auth_request con 0x5565dc13d8e0 auth_method 0 2024-09-12T00:51:34.029 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:51:33.948+0000 7fde958c0640 10 monclient: get_auth_request con 0x5565dc162400 auth_method 0 2024-09-12T00:51:34.030 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:51:33.949+0000 7fde8d0bf640 10 monclient: get_auth_request con 0x5565dc166760 auth_method 0 2024-09-12T00:51:34.030 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:51:33.950+0000 7fde99b40800 10 monclient: build_initial_monmap 2024-09-12T00:51:34.030 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:51:33.950+0000 7fde99b40800 1 build_initial for_mkfs: 0 2024-09-12T00:51:34.030 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:51:33.950+0000 7fde99b40800 10 monclient: monmap: 2024-09-12T00:51:34.030 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:51:34.030 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:34.030 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:51:34.030 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:51:34.030 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:34.031 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.031 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:51:34.031 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:51:34.031 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:51:34.031 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.031 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding auth protocol: cephx 2024-09-12T00:51:34.031 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding auth protocol: cephx 2024-09-12T00:51:34.031 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding auth protocol: cephx 2024-09-12T00:51:34.031 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: secure 2024-09-12T00:51:34.031 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: crc 2024-09-12T00:51:34.031 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: secure 2024-09-12T00:51:34.031 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: crc 2024-09-12T00:51:34.032 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: secure 2024-09-12T00:51:34.032 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: crc 2024-09-12T00:51:34.032 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: crc 2024-09-12T00:51:34.032 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: secure 2024-09-12T00:51:34.032 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: crc 2024-09-12T00:51:34.032 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: secure 2024-09-12T00:51:34.032 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: crc 2024-09-12T00:51:34.032 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: secure 2024-09-12T00:51:34.032 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:51:33.951+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.032 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command objecter_requests cmddesc objecter_requests hook 0x5565dc16e9f0 EEXIST 2024-09-12T00:51:34.032 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient: init 2024-09-12T00:51:34.033 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding auth protocol: cephx 2024-09-12T00:51:34.033 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding auth protocol: cephx 2024-09-12T00:51:34.033 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding auth protocol: cephx 2024-09-12T00:51:34.033 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: secure 2024-09-12T00:51:34.033 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: crc 2024-09-12T00:51:34.033 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: secure 2024-09-12T00:51:34.033 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: crc 2024-09-12T00:51:34.033 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: secure 2024-09-12T00:51:34.033 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: crc 2024-09-12T00:51:34.033 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: crc 2024-09-12T00:51:34.033 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: secure 2024-09-12T00:51:34.033 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: crc 2024-09-12T00:51:34.034 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: secure 2024-09-12T00:51:34.034 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: crc 2024-09-12T00:51:34.034 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: secure 2024-09-12T00:51:34.034 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:51:33.951+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.034 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:51:33.951+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.034 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command rotate-key cmddesc rotate-key hook 0x5565dc169d90 EEXIST 2024-09-12T00:51:34.034 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:34.034 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:51:34.034 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-a con 0x5565dc192d10 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:51:34.034 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-b con 0x5565dc1930f0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:51:34.034 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-c con 0x5565dc191a20 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:51:34.035 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.035 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.035 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.035 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:34.035 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): authenticate will time out at 1980.444982s 2024-09-12T00:51:34.035 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): get_auth_request con 0x5565dc192d10 auth_method 0 2024-09-12T00:51:34.035 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.035 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.035 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.035 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:51:33.952+0000 7fde960c1640 10 monclient(hunting): get_auth_request con 0x5565dc191a20 auth_method 0 2024-09-12T00:51:34.035 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:51:33.952+0000 7fde960c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.036 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:51:33.952+0000 7fde960c1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.036 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:51:33.952+0000 7fde960c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.036 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:51:33.952+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request con 0x5565dc1930f0 auth_method 0 2024-09-12T00:51:34.036 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:51:33.952+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.036 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:51:33.952+0000 7fde8d0bf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.036 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:51:33.952+0000 7fde8d0bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.036 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.036 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.036 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.036 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:51:33.952+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.036 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:51:33.952+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.036 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:51:33.952+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.037 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:51:33.952+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.037 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:51:33.952+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.037 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:51:33.952+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.037 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): handle_auth_done global_id 6879 payload 824 2024-09-12T00:51:34.037 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient: _finish_hunting 0 2024-09-12T00:51:34.037 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:51:33.952+0000 7fde958c0640 1 monclient: found mon.noname-a 2024-09-12T00:51:34.037 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:51:34.037 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.037 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:34.037 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: dump: 2024-09-12T00:51:34.037 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.038 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.038 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.038 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.038 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.038 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.038 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.038 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.038 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.039 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.039 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:51:34.039 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:51:34.039 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:51:33.952+0000 7fde99b40800 5 monclient: authenticate success, global_id 6879 2024-09-12T00:51:34.039 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:51:33.952+0000 7fde99b40800 10 monclient: _renew_subs 2024-09-12T00:51:34.039 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:51:33.952+0000 7fde99b40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:51:34.039 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:34.039 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.040 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:34.040 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: dump: 2024-09-12T00:51:34.040 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.040 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.040 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.040 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.040 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.040 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.040 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.040 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.040 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.041 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.041 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:51:33.952+0000 7fde968c2640 4 set_mon_vals no callback set 2024-09-12T00:51:34.041 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:51:33.952+0000 7fde99b40800 10 monclient: _renew_subs 2024-09-12T00:51:34.041 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:51:33.952+0000 7fde99b40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:51:34.041 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:51:33.954+0000 7fdd7b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:34.041 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:51:33.954+0000 7fdd7b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:51:34.041 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:51:33.954+0000 7fdd7b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:51:34.041 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:51:33.954+0000 7fde8d0bf640 10 monclient: get_auth_request con 0x7fdd70076380 auth_method 0 2024-09-12T00:51:34.041 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:51:33.955+0000 7fde99b40800 10 monclient: get_monmap_and_config 2024-09-12T00:51:34.041 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:51:33.955+0000 7fde99b40800 10 monclient: build_initial_monmap 2024-09-12T00:51:34.041 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:51:33.955+0000 7fde99b40800 1 build_initial for_mkfs: 0 2024-09-12T00:51:34.042 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:51:33.955+0000 7fde99b40800 10 monclient: monmap: 2024-09-12T00:51:34.042 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:51:34.042 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:34.042 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:51:34.042 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:51:34.042 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:34.042 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.042 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:51:34.042 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:51:34.042 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:51:34.042 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.042 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding auth protocol: cephx 2024-09-12T00:51:34.042 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding auth protocol: cephx 2024-09-12T00:51:34.043 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding auth protocol: cephx 2024-09-12T00:51:34.043 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: secure 2024-09-12T00:51:34.043 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: crc 2024-09-12T00:51:34.043 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: secure 2024-09-12T00:51:34.043 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: crc 2024-09-12T00:51:34.043 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: secure 2024-09-12T00:51:34.043 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: crc 2024-09-12T00:51:34.043 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: crc 2024-09-12T00:51:34.043 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: secure 2024-09-12T00:51:34.043 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: crc 2024-09-12T00:51:34.043 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: secure 2024-09-12T00:51:34.044 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: crc 2024-09-12T00:51:34.044 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: secure 2024-09-12T00:51:34.044 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:51:33.955+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.044 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:51:33.955+0000 7fde99b40800 10 monclient: init 2024-09-12T00:51:34.044 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding auth protocol: cephx 2024-09-12T00:51:34.044 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding auth protocol: cephx 2024-09-12T00:51:34.044 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding auth protocol: cephx 2024-09-12T00:51:34.044 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: secure 2024-09-12T00:51:34.044 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: crc 2024-09-12T00:51:34.044 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: secure 2024-09-12T00:51:34.044 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: crc 2024-09-12T00:51:34.044 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: secure 2024-09-12T00:51:34.044 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: crc 2024-09-12T00:51:34.045 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: crc 2024-09-12T00:51:34.045 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: secure 2024-09-12T00:51:34.045 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: crc 2024-09-12T00:51:34.045 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: secure 2024-09-12T00:51:34.045 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: crc 2024-09-12T00:51:34.045 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: secure 2024-09-12T00:51:34.045 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:51:33.955+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.045 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:51:33.955+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.045 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:51:33.956+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command rotate-key cmddesc rotate-key hook 0x7ffd98e69f08 EEXIST 2024-09-12T00:51:34.045 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:34.045 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:34.045 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-c con 0x5565dc1e72f0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:51:34.046 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-b con 0x5565dc1b8300 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:51:34.046 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-a con 0x5565dc1e27d0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:51:34.046 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.046 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.046 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.046 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:34.046 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): authenticate will time out at 1980.449122s 2024-09-12T00:51:34.046 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): get_auth_request con 0x5565dc1e72f0 auth_method 0 2024-09-12T00:51:34.046 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.046 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.046 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.046 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:51:33.956+0000 7fde960c1640 10 monclient(hunting): get_auth_request con 0x5565dc1e27d0 auth_method 0 2024-09-12T00:51:34.046 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:51:33.956+0000 7fde960c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.047 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:51:33.956+0000 7fde960c1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.047 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:51:33.956+0000 7fde960c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.047 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:51:33.956+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request con 0x5565dc1b8300 auth_method 0 2024-09-12T00:51:34.047 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:51:33.956+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.047 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:51:33.956+0000 7fde8d0bf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.047 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:51:33.956+0000 7fde8d0bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.047 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.047 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.047 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.047 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:51:33.956+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.047 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:51:33.956+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.047 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:51:33.956+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.048 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:51:33.956+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.048 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:51:33.956+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.048 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:51:33.956+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.048 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): handle_auth_done global_id 6545 payload 274 2024-09-12T00:51:34.048 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient: _finish_hunting 0 2024-09-12T00:51:34.048 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:51:33.956+0000 7fde958c0640 1 monclient: found mon.noname-c 2024-09-12T00:51:34.048 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.048 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.048 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:34.048 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: dump: 2024-09-12T00:51:34.048 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.048 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.048 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.048 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.049 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.049 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.049 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.049 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.049 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.049 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.049 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: _finish_auth 0 2024-09-12T00:51:34.049 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: _check_auth_tickets 2024-09-12T00:51:34.049 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:34.049 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:51:33.956+0000 7fde99b40800 5 monclient: authenticate success, global_id 6545 2024-09-12T00:51:34.049 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:34.049 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:51:33.956+0000 7fde99b40800 4 set_mon_vals no callback set 2024-09-12T00:51:34.049 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.050 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:34.050 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: dump: 2024-09-12T00:51:34.050 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.050 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.050 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.050 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.050 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.050 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.050 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.050 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.050 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.050 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.050 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:51:33.957+0000 7fde99b40800 10 monclient: shutdown 2024-09-12T00:51:34.050 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:51:33.957+0000 7fde99b40800 10 monclient: build_initial_monmap 2024-09-12T00:51:34.051 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:51:33.957+0000 7fde99b40800 1 build_initial for_mkfs: 0 2024-09-12T00:51:34.051 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:51:33.957+0000 7fde99b40800 10 monclient: monmap: 2024-09-12T00:51:34.051 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:51:34.051 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:34.051 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:51:34.051 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:51:34.051 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:34.051 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.051 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:51:34.051 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:51:34.051 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:51:34.051 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.051 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding auth protocol: cephx 2024-09-12T00:51:34.052 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding auth protocol: cephx 2024-09-12T00:51:34.052 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding auth protocol: cephx 2024-09-12T00:51:34.052 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: secure 2024-09-12T00:51:34.052 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: crc 2024-09-12T00:51:34.052 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: secure 2024-09-12T00:51:34.052 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: crc 2024-09-12T00:51:34.052 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: secure 2024-09-12T00:51:34.052 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: crc 2024-09-12T00:51:34.052 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: crc 2024-09-12T00:51:34.052 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: secure 2024-09-12T00:51:34.052 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: crc 2024-09-12T00:51:34.052 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: secure 2024-09-12T00:51:34.052 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: crc 2024-09-12T00:51:34.053 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: secure 2024-09-12T00:51:34.053 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:51:33.957+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.053 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:51:33.957+0000 7fde99b40800 1 librados: starting msgr at 2024-09-12T00:51:34.053 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:51:33.957+0000 7fde99b40800 1 librados: starting objecter 2024-09-12T00:51:34.053 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command objecter_requests cmddesc objecter_requests hook 0x5565dc194af0 EEXIST 2024-09-12T00:51:34.053 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:51:33.957+0000 7fde99b40800 1 librados: setting wanted keys 2024-09-12T00:51:34.053 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:51:33.957+0000 7fde99b40800 1 librados: calling monclient init 2024-09-12T00:51:34.053 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:51:33.957+0000 7fde99b40800 10 monclient: init 2024-09-12T00:51:34.053 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding auth protocol: cephx 2024-09-12T00:51:34.053 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding auth protocol: cephx 2024-09-12T00:51:34.053 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding auth protocol: cephx 2024-09-12T00:51:34.054 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: secure 2024-09-12T00:51:34.056 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: crc 2024-09-12T00:51:34.056 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: secure 2024-09-12T00:51:34.056 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: crc 2024-09-12T00:51:34.056 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: secure 2024-09-12T00:51:34.056 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: crc 2024-09-12T00:51:34.056 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: crc 2024-09-12T00:51:34.056 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: secure 2024-09-12T00:51:34.056 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: crc 2024-09-12T00:51:34.057 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: secure 2024-09-12T00:51:34.057 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: crc 2024-09-12T00:51:34.057 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: secure 2024-09-12T00:51:34.057 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:51:33.958+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.057 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:51:33.958+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.057 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:51:33.958+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command rotate-key cmddesc rotate-key hook 0x5565dc1a7718 EEXIST 2024-09-12T00:51:34.057 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:34.057 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:51:34.057 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-b con 0x5565dc1b8300 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:51:34.057 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-a con 0x5565dc1e27d0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:51:34.057 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-c con 0x5565dc1e72f0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:51:34.057 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.058 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.058 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.058 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:34.058 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): authenticate will time out at 1980.451357s 2024-09-12T00:51:34.058 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): get_auth_request con 0x5565dc1e72f0 auth_method 0 2024-09-12T00:51:34.058 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.058 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.058 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.058 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:51:33.958+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request con 0x5565dc1e27d0 auth_method 0 2024-09-12T00:51:34.058 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:51:33.958+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.058 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:51:33.958+0000 7fde8d0bf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.058 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:51:33.958+0000 7fde8d0bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.058 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:51:33.958+0000 7fde958c0640 10 monclient(hunting): get_auth_request con 0x5565dc1b8300 auth_method 0 2024-09-12T00:51:34.059 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:51:33.958+0000 7fde958c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.059 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:51:33.958+0000 7fde958c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.059 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:51:33.958+0000 7fde958c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.059 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.059 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.059 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.059 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:51:33.958+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.059 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:51:33.958+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.059 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:51:33.958+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.059 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:51:33.958+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.059 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:51:33.958+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.059 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:51:33.958+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.059 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): handle_auth_done global_id 6548 payload 824 2024-09-12T00:51:34.059 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient: _finish_hunting 0 2024-09-12T00:51:34.060 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:51:33.958+0000 7fde960c1640 1 monclient: found mon.noname-c 2024-09-12T00:51:34.060 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.060 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:51:33.958+0000 7fdd677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.060 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:51:33.958+0000 7fdd677fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:34.060 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:51:33.958+0000 7fdd677fe640 10 monclient: dump: 2024-09-12T00:51:34.060 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.060 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.060 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.060 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.060 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.060 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.060 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.061 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.061 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.061 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.061 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:51:33.958+0000 7fdd677fe640 10 monclient: _finish_auth 0 2024-09-12T00:51:34.061 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:51:33.958+0000 7fdd677fe640 10 monclient: _check_auth_tickets 2024-09-12T00:51:34.061 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:51:33.959+0000 7fdd677fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:34.061 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:51:33.959+0000 7fdd677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.061 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:51:33.959+0000 7fdd677fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:34.061 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:51:33.959+0000 7fdd677fe640 10 monclient: dump: 2024-09-12T00:51:34.061 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.061 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.061 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.061 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.062 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.062 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.062 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.062 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.062 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.062 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.062 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:51:33.959+0000 7fde99b40800 5 monclient: authenticate success, global_id 6548 2024-09-12T00:51:34.062 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:51:33.959+0000 7fde99b40800 10 monclient: _renew_subs 2024-09-12T00:51:34.062 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:51:33.959+0000 7fdd797fa640 4 set_mon_vals no callback set 2024-09-12T00:51:34.062 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:51:33.959+0000 7fde99b40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.062 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:51:33.959+0000 7fde99b40800 10 monclient: _renew_subs 2024-09-12T00:51:34.062 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:51:33.959+0000 7fde99b40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.062 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:51:33.959+0000 7fde99b40800 1 librados: init done 2024-09-12T00:51:34.063 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:51:33.959+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command cr dump hook 0x5565dc1dba98 2024-09-12T00:51:34.063 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:51:33.960+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.063 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:51:33.960+0000 7fdd677fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:34.063 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:51:33.960+0000 7fdd677fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:51:34.063 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:51:33.960+0000 7fdd677fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:51:34.063 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:51:33.961+0000 7fde958c0640 10 monclient: get_auth_request con 0x7fdd60076470 auth_method 0 2024-09-12T00:51:34.063 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:51:33.961+0000 7fde8d0bf640 10 monclient: get_auth_request con 0x5565dc201310 auth_method 0 2024-09-12T00:51:34.063 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.063 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:51:33.962+0000 7fde99b40800 20 realm 2024-09-12T00:51:34.063 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.063 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.063 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:51:33.962+0000 7fde99b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:34.064 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.064 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.064 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.064 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:51:33.962+0000 7fde958c0640 10 monclient: get_auth_request con 0x5565dc205580 auth_method 0 2024-09-12T00:51:34.064 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:51:33.963+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:34.064 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:51:33.963+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.064 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:51:33.963+0000 7fde8d0bf640 10 monclient: get_auth_request con 0x5565dc208de0 auth_method 0 2024-09-12T00:51:34.064 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:51:33.963+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:34.064 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:51:33.963+0000 7fde99b40800 20 searching for the correct realm 2024-09-12T00:51:34.064 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:51:33.964+0000 7fde960c1640 10 monclient: get_auth_request con 0x5565dc20da30 auth_method 0 2024-09-12T00:51:34.064 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:51:33.964+0000 7fde958c0640 10 monclient: get_auth_request con 0x7fde90017070 auth_method 0 2024-09-12T00:51:34.065 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:51:33.966+0000 7fde8d0bf640 10 monclient: get_auth_request con 0x7fde90048060 auth_method 0 2024-09-12T00:51:34.065 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:51:33.966+0000 7fde8d0bf640 0 -- 172.21.15.62:0/79011188 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fde90048060 msgr2=0x7fde9008ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:34.065 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:51:33.966+0000 7fdd677fe640 1 client.6548.objecter ms_handle_reset 0x7fde90048060 session 0x7fde90009250 osd.5 2024-09-12T00:51:34.065 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:51:33.966+0000 7fdd677fe640 10 monclient: _renew_subs 2024-09-12T00:51:34.065 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:51:33.966+0000 7fdd677fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.065 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:51:33.967+0000 7fde8d0bf640 10 monclient: get_auth_request con 0x7fdd60086720 auth_method 0 2024-09-12T00:51:34.065 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:51:33.968+0000 7fde960c1640 10 monclient: get_auth_request con 0x7fde880ac960 auth_method 0 2024-09-12T00:51:34.065 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:51:33.968+0000 7fde958c0640 10 monclient: get_auth_request con 0x7fde9008ee10 auth_method 0 2024-09-12T00:51:34.065 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:51:33.970+0000 7fde958c0640 0 -- 172.21.15.62:0/79011188 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7fde9008ee10 msgr2=0x7fde9008ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:34.065 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:51:33.970+0000 7fdd677fe640 1 client.6548.objecter ms_handle_reset 0x7fde9008ee10 session 0x7fde90050e90 osd.3 2024-09-12T00:51:34.065 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:51:33.970+0000 7fde958c0640 10 monclient: get_auth_request con 0x7fde90048060 auth_method 0 2024-09-12T00:51:34.066 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:34.066 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:34.066 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:34.066 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:34.066 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:34.066 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:34.066 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:51:33.973+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.066 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.066 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.066 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:34.066 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.066 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:34.067 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 zone default found 2024-09-12T00:51:34.067 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:51:33.974+0000 7fde99b40800 4 Realm: () 2024-09-12T00:51:34.067 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:51:33.974+0000 7fde99b40800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:34.067 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:51:33.974+0000 7fde99b40800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:34.067 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:51:33.974+0000 7fde99b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:34.067 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 zonegroup default 2024-09-12T00:51:34.067 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.067 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.067 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.067 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:51:33.975+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.067 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:51:33.975+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.068 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:51:33.975+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.068 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:51:33.975+0000 7fde99b40800 20 started sync module instance, tier type = 2024-09-12T00:51:34.068 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:51:33.975+0000 7fde99b40800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:34.068 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=0 2024-09-12T00:51:34.068 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=1 2024-09-12T00:51:34.068 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=2 2024-09-12T00:51:34.068 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=3 2024-09-12T00:51:34.068 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=4 2024-09-12T00:51:34.068 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=5 2024-09-12T00:51:34.068 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=6 2024-09-12T00:51:34.068 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:51:33.985+0000 7fde99b40800 20 add_watcher() i=7 2024-09-12T00:51:34.068 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:51:33.985+0000 7fde99b40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:34.068 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding auth protocol: cephx 2024-09-12T00:51:34.069 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding auth protocol: cephx 2024-09-12T00:51:34.069 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding auth protocol: cephx 2024-09-12T00:51:34.069 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: secure 2024-09-12T00:51:34.069 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: crc 2024-09-12T00:51:34.069 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: secure 2024-09-12T00:51:34.069 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: crc 2024-09-12T00:51:34.069 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: secure 2024-09-12T00:51:34.069 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: crc 2024-09-12T00:51:34.069 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: crc 2024-09-12T00:51:34.069 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: secure 2024-09-12T00:51:34.069 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: crc 2024-09-12T00:51:34.069 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: secure 2024-09-12T00:51:34.069 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:51:33.987+0000 7fdd477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:34.069 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: crc 2024-09-12T00:51:34.070 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: secure 2024-09-12T00:51:34.070 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:51:33.987+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.070 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:51:33.987+0000 7fde99b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:34.070 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:51:33.987+0000 7fde99b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:34.070 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command cache list hook 0x5565dc1dc830 2024-09-12T00:51:34.070 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command cache inspect hook 0x5565dc1dc830 2024-09-12T00:51:34.070 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command cache erase hook 0x5565dc1dc830 2024-09-12T00:51:34.070 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command cache zap hook 0x5565dc1dc830 2024-09-12T00:51:34.070 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 note: GC not initialized 2024-09-12T00:51:34.070 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:51:33.987+0000 7fdd467fc640 20 reqs_thread_entry: start 2024-09-12T00:51:34.070 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command sync trace show hook 0x7fde88004040 2024-09-12T00:51:34.070 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command sync trace history hook 0x7fde88004040 2024-09-12T00:51:34.071 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command sync trace active hook 0x7fde88004040 2024-09-12T00:51:34.071 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command sync trace active_short hook 0x7fde88004040 2024-09-12T00:51:34.071 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:51:33.987+0000 7fde99b40800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:34.071 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:51:33.987+0000 7fde99b40800 20 Filter name: none 2024-09-12T00:51:34.071 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:51:33.987+0000 7fdcb7fff640 20 reqs_thread_entry: start 2024-09-12T00:51:34.071 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:51:34.071 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:51:33.988+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.071 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:51:33.988+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:34.071 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:51:34.071 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:51:34.071 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 : miss 2024-09-12T00:51:34.072 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:51:33.988+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.072 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:51:33.988+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:51:34.072 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:51:34.072 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:51:34.072 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:34.072 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:34.072 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 2024-09-12T00:51:34.072 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:51:33.992+0000 7fde99b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:51:34.072 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:51:33.992+0000 7fde99b40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:51:34.072 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:51:33.992+0000 7fde99b40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:34.073 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:51:33.992+0000 7fde99b40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27, ofs0, ns] 2024-09-12T00:51:34.073 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:51:33.992+0000 7fdd797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431654 cookie 93895973222704 notifier 6548 bl.length()=939 2024-09-12T00:51:34.073 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:51:33.992+0000 7fdd797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:51:34.073 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:51:33.992+0000 7fdd797fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:51:34.073 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:51:33.992+0000 7fdd797fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:34.073 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:51:33.994+0000 7fde99b40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): orig_sources= new_sources= 2024-09-12T00:51:34.073 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:51:33.994+0000 7fde99b40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): potential sources added=[] removed=[] 2024-09-12T00:51:34.073 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:51:33.994+0000 7fde99b40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): orig_dests= new_dests= 2024-09-12T00:51:34.073 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:51:33.994+0000 7fde99b40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): potential dests added=[] removed=[] 2024-09-12T00:51:34.073 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:51:33.995+0000 7fde99b40800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde99b40800 time 2024-09-12T00:51:33.995464+0000 2024-09-12T00:51:34.074 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:34.074 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.074 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:34.074 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde9b38c71a] 2024-09-12T00:51:34.074 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde9b38c8d8] 2024-09-12T00:51:34.074 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565d9ef9641] 2024-09-12T00:51:34.074 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd884de) [0x5565da40c4de] 2024-09-12T00:51:34.074 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565d9f0931d] 2024-09-12T00:51:34.074 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:51:34.074 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fde9a029590] 2024-09-12T00:51:34.074 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:51:34.075 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:51:34.075 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.075 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:51:33.996+0000 7fde99b40800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:34.075 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7fde99b40800 thread_name:radosgw-admin 2024-09-12T00:51:34.075 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.075 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:34.075 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde9a03e6f0] 2024-09-12T00:51:34.075 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde9a08b99c] 2024-09-12T00:51:34.075 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:51:34.075 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:51:34.075 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde9b38c774] 2024-09-12T00:51:34.076 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde9b38c8d8] 2024-09-12T00:51:34.076 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565d9ef9641] 2024-09-12T00:51:34.076 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd884de) [0x5565da40c4de] 2024-09-12T00:51:34.076 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565d9f0931d] 2024-09-12T00:51:34.076 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:51:34.076 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fde9a029590] 2024-09-12T00:51:34.076 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:51:34.076 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:51:34.076 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:34.076 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.077 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:51:34.077 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:51:34.077 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:51:34.077 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:51:34.077 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:51:34.077 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:51:34.077 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:51:34.077 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:51:34.077 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:51:34.077 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:51:34.077 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:51:34.077 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:51:34.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:51:34.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:51:34.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:51:34.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:51:34.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:51:34.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:51:34.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:51:34.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:51:34.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:51:34.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:51:34.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:51:34.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:51:34.079 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:51:34.079 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:51:34.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:51:34.079 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:51:34.079 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:51:34.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:51:34.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:51:34.079 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:51:34.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:51:34.079 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:51:34.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:51:34.079 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:51:34.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:51:34.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:51:34.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:51:34.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:51:34.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:51:34.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:51:34.080 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:51:34.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:51:34.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:51:34.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:51:34.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:51:34.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:51:34.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:51:34.081 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:51:34.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:51:34.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:51:34.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:51:34.081 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:51:34.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:51:34.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:51:34.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:51:34.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:51:34.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:51:34.081 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:51:34.082 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:51:34.082 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:51:34.082 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:51:34.082 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:51:34.082 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:51:34.082 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:51:34.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:51:34.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:51:34.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:51:34.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:51:34.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:51:34.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:51:34.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:51:34.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:51:34.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:51:34.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:51:34.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:51:34.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:51:34.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:51:34.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:51:34.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:51:34.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:51:34.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:51:34.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:51:34.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:51:34.084 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:51:34.084 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:51:34.084 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:51:34.084 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:51:34.084 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:51:34.084 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:51:34.084 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:51:34.084 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:51:34.084 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:51:34.084 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdcb7fff640 / http_manager 2024-09-12T00:51:34.084 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdd467fc640 / http_manager 2024-09-12T00:51:34.084 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdd477fe640 / rgw_dt_lg_renew 2024-09-12T00:51:34.084 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdd677fe640 / ms_dispatch 2024-09-12T00:51:34.085 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdd797fa640 / io_context_pool 2024-09-12T00:51:34.085 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdd7b7fe640 / ms_dispatch 2024-09-12T00:51:34.085 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdd82604640 / ms_dispatch 2024-09-12T00:51:34.085 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdd83e07640 / io_context_pool 2024-09-12T00:51:34.085 INFO:tasks.workunit.client.0.smithi062.stderr: 7fde8d0bf640 / msgr-worker-2 2024-09-12T00:51:34.085 INFO:tasks.workunit.client.0.smithi062.stderr: 7fde958c0640 / msgr-worker-1 2024-09-12T00:51:34.085 INFO:tasks.workunit.client.0.smithi062.stderr: 7fde960c1640 / msgr-worker-0 2024-09-12T00:51:34.085 INFO:tasks.workunit.client.0.smithi062.stderr: 7fde968c2640 / io_context_pool 2024-09-12T00:51:34.085 INFO:tasks.workunit.client.0.smithi062.stderr: 7fde99b40800 / radosgw-admin 2024-09-12T00:51:34.085 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:51:34.085 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:51:34.085 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/log/ceph/ceph-client.admin.106919.log 2024-09-12T00:51:34.085 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:51:34.086 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:51:34.086 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding auth protocol: cephx 2024-09-12T00:51:34.086 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding auth protocol: cephx 2024-09-12T00:51:34.086 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding auth protocol: cephx 2024-09-12T00:51:34.086 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: secure 2024-09-12T00:51:34.086 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: crc 2024-09-12T00:51:34.086 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: secure 2024-09-12T00:51:34.086 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: crc 2024-09-12T00:51:34.086 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: secure 2024-09-12T00:51:34.086 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: crc 2024-09-12T00:51:34.086 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: crc 2024-09-12T00:51:34.086 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: secure 2024-09-12T00:51:34.087 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: crc 2024-09-12T00:51:34.087 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: secure 2024-09-12T00:51:34.087 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: crc 2024-09-12T00:51:34.087 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc11c610) adding con mode: secure 2024-09-12T00:51:34.087 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:51:33.944+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.087 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:51:33.944+0000 7fde99b40800 1 librados: starting msgr at 2024-09-12T00:51:34.087 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:51:33.944+0000 7fde99b40800 1 librados: starting objecter 2024-09-12T00:51:34.087 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command objecter_requests hook 0x5565dc140570 2024-09-12T00:51:34.087 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:51:33.944+0000 7fde99b40800 1 librados: setting wanted keys 2024-09-12T00:51:34.087 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:51:33.944+0000 7fde99b40800 1 librados: calling monclient init 2024-09-12T00:51:34.087 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:51:33.944+0000 7fde99b40800 10 monclient: init 2024-09-12T00:51:34.087 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding auth protocol: cephx 2024-09-12T00:51:34.088 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding auth protocol: cephx 2024-09-12T00:51:34.088 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding auth protocol: cephx 2024-09-12T00:51:34.088 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: secure 2024-09-12T00:51:34.088 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: crc 2024-09-12T00:51:34.088 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: secure 2024-09-12T00:51:34.088 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: crc 2024-09-12T00:51:34.088 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: secure 2024-09-12T00:51:34.088 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: crc 2024-09-12T00:51:34.088 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: crc 2024-09-12T00:51:34.088 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: secure 2024-09-12T00:51:34.088 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: crc 2024-09-12T00:51:34.088 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: secure 2024-09-12T00:51:34.089 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: crc 2024-09-12T00:51:34.089 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 AuthRegistry(0x5565dc116970) adding con mode: secure 2024-09-12T00:51:34.089 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:51:33.944+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.089 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:51:33.944+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.089 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:51:33.944+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command rotate-key hook 0x5565dc116ab8 2024-09-12T00:51:34.089 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:51:33.944+0000 7fde99b40800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:34.089 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:51:33.944+0000 7fde99b40800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:51:34.089 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:51:33.944+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-b con 0x5565dbfc32d0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:51:34.089 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:51:33.944+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-a con 0x5565dbfcfc20 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:51:34.089 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:51:33.944+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-c con 0x5565dc141190 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:51:34.089 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:51:33.944+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.089 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.090 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.090 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:34.090 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient(hunting): authenticate will time out at 1980.438013s 2024-09-12T00:51:34.090 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:51:33.945+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request con 0x5565dbfcfc20 auth_method 0 2024-09-12T00:51:34.090 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:51:33.945+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.090 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:51:33.945+0000 7fde8d0bf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.090 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:51:33.945+0000 7fde8d0bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.090 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): get_auth_request con 0x5565dc141190 auth_method 0 2024-09-12T00:51:34.090 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.090 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.091 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.091 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:51:33.945+0000 7fde958c0640 10 monclient(hunting): get_auth_request con 0x5565dbfc32d0 auth_method 0 2024-09-12T00:51:34.091 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:51:33.945+0000 7fde958c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.091 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:51:33.945+0000 7fde958c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.091 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:51:33.945+0000 7fde958c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.091 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.091 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.091 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.091 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:51:33.945+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.091 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:51:33.945+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.091 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:51:33.945+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.091 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:51:33.945+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.092 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:51:33.945+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.092 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:51:33.945+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.092 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient(hunting): handle_auth_done global_id 6539 payload 824 2024-09-12T00:51:34.092 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient: _finish_hunting 0 2024-09-12T00:51:34.092 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:51:33.945+0000 7fde960c1640 1 monclient: found mon.noname-c 2024-09-12T00:51:34.092 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:51:33.945+0000 7fde960c1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.092 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.092 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:34.092 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: dump: 2024-09-12T00:51:34.092 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.092 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.092 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.092 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.093 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.093 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.093 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.093 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.093 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.093 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.093 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: _finish_auth 0 2024-09-12T00:51:34.093 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: _check_auth_tickets 2024-09-12T00:51:34.093 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:34.093 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.093 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:34.093 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:51:33.945+0000 7fdd82604640 10 monclient: dump: 2024-09-12T00:51:34.094 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.094 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.094 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.094 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.094 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.094 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.094 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.094 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.094 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.094 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.094 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:51:33.945+0000 7fde99b40800 5 monclient: authenticate success, global_id 6539 2024-09-12T00:51:34.094 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient: _renew_subs 2024-09-12T00:51:34.094 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:51:33.945+0000 7fdd83e07640 4 set_mon_vals no callback set 2024-09-12T00:51:34.094 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.095 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient: _renew_subs 2024-09-12T00:51:34.095 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:51:33.945+0000 7fde99b40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.095 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:51:33.945+0000 7fde99b40800 1 librados: init done 2024-09-12T00:51:34.095 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:51:33.947+0000 7fdd82604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:34.095 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:51:33.947+0000 7fdd82604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:51:34.095 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:51:33.947+0000 7fdd82604640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:51:34.095 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:51:33.947+0000 7fde958c0640 10 monclient: get_auth_request con 0x7fdd7c076470 auth_method 0 2024-09-12T00:51:34.095 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:51:33.948+0000 7fde8d0bf640 10 monclient: get_auth_request con 0x5565dc13d8e0 auth_method 0 2024-09-12T00:51:34.095 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:51:33.948+0000 7fde958c0640 10 monclient: get_auth_request con 0x5565dc162400 auth_method 0 2024-09-12T00:51:34.095 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:51:33.949+0000 7fde8d0bf640 10 monclient: get_auth_request con 0x5565dc166760 auth_method 0 2024-09-12T00:51:34.095 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:51:33.950+0000 7fde99b40800 10 monclient: build_initial_monmap 2024-09-12T00:51:34.095 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:51:33.950+0000 7fde99b40800 1 build_initial for_mkfs: 0 2024-09-12T00:51:34.095 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:51:33.950+0000 7fde99b40800 10 monclient: monmap: 2024-09-12T00:51:34.096 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:51:34.096 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:34.096 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:51:34.096 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:51:34.096 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:34.096 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.096 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:51:34.096 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:51:34.096 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:51:34.096 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.096 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding auth protocol: cephx 2024-09-12T00:51:34.096 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding auth protocol: cephx 2024-09-12T00:51:34.096 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding auth protocol: cephx 2024-09-12T00:51:34.097 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: secure 2024-09-12T00:51:34.097 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: crc 2024-09-12T00:51:34.097 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: secure 2024-09-12T00:51:34.097 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: crc 2024-09-12T00:51:34.097 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: secure 2024-09-12T00:51:34.097 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: crc 2024-09-12T00:51:34.097 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: crc 2024-09-12T00:51:34.097 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: secure 2024-09-12T00:51:34.097 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: crc 2024-09-12T00:51:34.097 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: secure 2024-09-12T00:51:34.097 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: crc 2024-09-12T00:51:34.097 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:51:33.950+0000 7fde99b40800 5 AuthRegistry(0x5565dc16b570) adding con mode: secure 2024-09-12T00:51:34.097 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:51:33.951+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.097 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command objecter_requests cmddesc objecter_requests hook 0x5565dc16e9f0 EEXIST 2024-09-12T00:51:34.098 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient: init 2024-09-12T00:51:34.098 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding auth protocol: cephx 2024-09-12T00:51:34.098 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding auth protocol: cephx 2024-09-12T00:51:34.098 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding auth protocol: cephx 2024-09-12T00:51:34.098 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: secure 2024-09-12T00:51:34.098 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: crc 2024-09-12T00:51:34.098 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: secure 2024-09-12T00:51:34.098 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: crc 2024-09-12T00:51:34.098 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: secure 2024-09-12T00:51:34.098 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: crc 2024-09-12T00:51:34.098 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: crc 2024-09-12T00:51:34.098 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: secure 2024-09-12T00:51:34.098 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: crc 2024-09-12T00:51:34.099 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: secure 2024-09-12T00:51:34.099 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: crc 2024-09-12T00:51:34.099 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 AuthRegistry(0x5565dc169c48) adding con mode: secure 2024-09-12T00:51:34.099 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:51:33.951+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.099 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:51:33.951+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.099 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:51:33.951+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command rotate-key cmddesc rotate-key hook 0x5565dc169d90 EEXIST 2024-09-12T00:51:34.099 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:34.099 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:51:34.099 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-a con 0x5565dc192d10 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:51:34.099 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-b con 0x5565dc1930f0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:51:34.099 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-c con 0x5565dc191a20 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:51:34.099 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.099 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.100 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.100 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:34.100 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:51:33.951+0000 7fde99b40800 10 monclient(hunting): authenticate will time out at 1980.444982s 2024-09-12T00:51:34.100 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): get_auth_request con 0x5565dc192d10 auth_method 0 2024-09-12T00:51:34.100 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.100 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.100 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.100 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:51:33.952+0000 7fde960c1640 10 monclient(hunting): get_auth_request con 0x5565dc191a20 auth_method 0 2024-09-12T00:51:34.100 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:51:33.952+0000 7fde960c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.100 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:51:33.952+0000 7fde960c1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.101 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:51:33.952+0000 7fde960c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.101 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:51:33.952+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request con 0x5565dc1930f0 auth_method 0 2024-09-12T00:51:34.101 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:51:33.952+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.101 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:51:33.952+0000 7fde8d0bf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.101 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:51:33.952+0000 7fde8d0bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.101 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.101 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.101 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.101 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:51:33.952+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.101 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:51:33.952+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.101 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:51:33.952+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.101 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:51:33.952+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.102 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:51:33.952+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.102 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:51:33.952+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.102 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient(hunting): handle_auth_done global_id 6879 payload 824 2024-09-12T00:51:34.102 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient: _finish_hunting 0 2024-09-12T00:51:34.102 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:51:33.952+0000 7fde958c0640 1 monclient: found mon.noname-a 2024-09-12T00:51:34.102 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:51:33.952+0000 7fde958c0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:51:34.102 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.102 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:34.102 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: dump: 2024-09-12T00:51:34.102 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.102 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.102 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.102 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.103 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.103 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.103 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.103 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.103 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.103 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.103 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:51:34.103 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:51:34.103 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:51:33.952+0000 7fde99b40800 5 monclient: authenticate success, global_id 6879 2024-09-12T00:51:34.103 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:51:33.952+0000 7fde99b40800 10 monclient: _renew_subs 2024-09-12T00:51:34.103 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:51:33.952+0000 7fde99b40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:51:34.103 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:34.104 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.104 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:34.104 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:51:33.952+0000 7fdd7b7fe640 10 monclient: dump: 2024-09-12T00:51:34.104 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.104 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.104 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.104 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.104 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.104 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.104 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.104 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.105 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.105 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.105 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:51:33.952+0000 7fde968c2640 4 set_mon_vals no callback set 2024-09-12T00:51:34.105 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:51:33.952+0000 7fde99b40800 10 monclient: _renew_subs 2024-09-12T00:51:34.105 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:51:33.952+0000 7fde99b40800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:51:34.105 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:51:33.954+0000 7fdd7b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:34.105 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:51:33.954+0000 7fdd7b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:51:34.105 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:51:33.954+0000 7fdd7b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:51:34.105 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:51:33.954+0000 7fde8d0bf640 10 monclient: get_auth_request con 0x7fdd70076380 auth_method 0 2024-09-12T00:51:34.105 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:51:33.955+0000 7fde99b40800 10 monclient: get_monmap_and_config 2024-09-12T00:51:34.105 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:51:33.955+0000 7fde99b40800 10 monclient: build_initial_monmap 2024-09-12T00:51:34.105 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:51:33.955+0000 7fde99b40800 1 build_initial for_mkfs: 0 2024-09-12T00:51:34.106 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:51:33.955+0000 7fde99b40800 10 monclient: monmap: 2024-09-12T00:51:34.106 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:51:34.106 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:34.106 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:51:34.106 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:51:34.106 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:34.106 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.106 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:51:34.106 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:51:34.106 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:51:34.106 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.106 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding auth protocol: cephx 2024-09-12T00:51:34.107 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding auth protocol: cephx 2024-09-12T00:51:34.107 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding auth protocol: cephx 2024-09-12T00:51:34.107 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: secure 2024-09-12T00:51:34.107 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: crc 2024-09-12T00:51:34.107 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: secure 2024-09-12T00:51:34.107 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: crc 2024-09-12T00:51:34.107 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: secure 2024-09-12T00:51:34.107 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: crc 2024-09-12T00:51:34.107 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: crc 2024-09-12T00:51:34.107 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: secure 2024-09-12T00:51:34.107 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: crc 2024-09-12T00:51:34.107 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: secure 2024-09-12T00:51:34.108 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: crc 2024-09-12T00:51:34.108 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x5565dc1b2cc0) adding con mode: secure 2024-09-12T00:51:34.108 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:51:33.955+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.108 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:51:33.955+0000 7fde99b40800 10 monclient: init 2024-09-12T00:51:34.108 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding auth protocol: cephx 2024-09-12T00:51:34.108 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding auth protocol: cephx 2024-09-12T00:51:34.108 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding auth protocol: cephx 2024-09-12T00:51:34.108 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: secure 2024-09-12T00:51:34.108 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: crc 2024-09-12T00:51:34.108 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: secure 2024-09-12T00:51:34.108 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: crc 2024-09-12T00:51:34.108 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: secure 2024-09-12T00:51:34.108 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: crc 2024-09-12T00:51:34.109 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: crc 2024-09-12T00:51:34.109 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: secure 2024-09-12T00:51:34.109 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: crc 2024-09-12T00:51:34.109 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: secure 2024-09-12T00:51:34.109 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: crc 2024-09-12T00:51:34.109 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:51:33.955+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e69dc0) adding con mode: secure 2024-09-12T00:51:34.109 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:51:33.955+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.109 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:51:33.955+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.109 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:51:33.956+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command rotate-key cmddesc rotate-key hook 0x7ffd98e69f08 EEXIST 2024-09-12T00:51:34.109 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:34.109 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:34.110 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-c con 0x5565dc1e72f0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:51:34.110 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-b con 0x5565dc1b8300 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:51:34.110 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-a con 0x5565dc1e27d0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:51:34.110 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.110 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.110 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.110 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:34.110 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient(hunting): authenticate will time out at 1980.449122s 2024-09-12T00:51:34.110 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): get_auth_request con 0x5565dc1e72f0 auth_method 0 2024-09-12T00:51:34.110 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.110 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.110 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.111 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:51:33.956+0000 7fde960c1640 10 monclient(hunting): get_auth_request con 0x5565dc1e27d0 auth_method 0 2024-09-12T00:51:34.111 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:51:33.956+0000 7fde960c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.111 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:51:33.956+0000 7fde960c1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.111 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:51:33.956+0000 7fde960c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.111 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:51:33.956+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request con 0x5565dc1b8300 auth_method 0 2024-09-12T00:51:34.111 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:51:33.956+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.111 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:51:33.956+0000 7fde8d0bf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.111 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:51:33.956+0000 7fde8d0bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.111 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.111 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.111 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.111 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:51:33.956+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.112 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:51:33.956+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.112 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:51:33.956+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.112 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:51:33.956+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.112 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:51:33.956+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.112 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:51:33.956+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.112 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient(hunting): handle_auth_done global_id 6545 payload 274 2024-09-12T00:51:34.112 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient: _finish_hunting 0 2024-09-12T00:51:34.112 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:51:33.956+0000 7fde958c0640 1 monclient: found mon.noname-c 2024-09-12T00:51:34.112 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:51:33.956+0000 7fde958c0640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.112 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.112 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:34.113 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: dump: 2024-09-12T00:51:34.113 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.113 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.113 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.113 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.113 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.113 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.113 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.113 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.113 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.114 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.114 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: _finish_auth 0 2024-09-12T00:51:34.114 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: _check_auth_tickets 2024-09-12T00:51:34.114 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:34.114 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:51:33.956+0000 7fde99b40800 5 monclient: authenticate success, global_id 6545 2024-09-12T00:51:34.114 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:51:33.956+0000 7fde99b40800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:34.114 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:51:33.956+0000 7fde99b40800 4 set_mon_vals no callback set 2024-09-12T00:51:34.114 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.114 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:34.114 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:51:33.956+0000 7fdd797fa640 10 monclient: dump: 2024-09-12T00:51:34.114 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.114 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.114 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.115 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.115 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.115 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.115 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.115 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.115 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.115 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.115 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:51:33.957+0000 7fde99b40800 10 monclient: shutdown 2024-09-12T00:51:34.115 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:51:33.957+0000 7fde99b40800 10 monclient: build_initial_monmap 2024-09-12T00:51:34.115 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:51:33.957+0000 7fde99b40800 1 build_initial for_mkfs: 0 2024-09-12T00:51:34.115 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:51:33.957+0000 7fde99b40800 10 monclient: monmap: 2024-09-12T00:51:34.115 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:51:34.116 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:34.116 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:51:34.116 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:51:34.116 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:34.116 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.116 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:51:34.116 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:51:34.116 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:51:34.116 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.116 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding auth protocol: cephx 2024-09-12T00:51:34.116 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding auth protocol: cephx 2024-09-12T00:51:34.116 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding auth protocol: cephx 2024-09-12T00:51:34.116 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: secure 2024-09-12T00:51:34.117 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: crc 2024-09-12T00:51:34.117 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: secure 2024-09-12T00:51:34.117 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: crc 2024-09-12T00:51:34.117 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: secure 2024-09-12T00:51:34.117 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: crc 2024-09-12T00:51:34.117 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: crc 2024-09-12T00:51:34.117 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: secure 2024-09-12T00:51:34.117 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: crc 2024-09-12T00:51:34.117 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: secure 2024-09-12T00:51:34.117 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: crc 2024-09-12T00:51:34.117 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1d94f0) adding con mode: secure 2024-09-12T00:51:34.117 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:51:33.957+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.118 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:51:33.957+0000 7fde99b40800 1 librados: starting msgr at 2024-09-12T00:51:34.118 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:51:33.957+0000 7fde99b40800 1 librados: starting objecter 2024-09-12T00:51:34.118 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command objecter_requests cmddesc objecter_requests hook 0x5565dc194af0 EEXIST 2024-09-12T00:51:34.118 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:51:33.957+0000 7fde99b40800 1 librados: setting wanted keys 2024-09-12T00:51:34.118 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:51:33.957+0000 7fde99b40800 1 librados: calling monclient init 2024-09-12T00:51:34.118 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:51:33.957+0000 7fde99b40800 10 monclient: init 2024-09-12T00:51:34.118 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding auth protocol: cephx 2024-09-12T00:51:34.118 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding auth protocol: cephx 2024-09-12T00:51:34.118 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding auth protocol: cephx 2024-09-12T00:51:34.118 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: secure 2024-09-12T00:51:34.118 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: crc 2024-09-12T00:51:34.118 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: secure 2024-09-12T00:51:34.119 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: crc 2024-09-12T00:51:34.119 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: secure 2024-09-12T00:51:34.119 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: crc 2024-09-12T00:51:34.119 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: crc 2024-09-12T00:51:34.119 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: secure 2024-09-12T00:51:34.119 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: crc 2024-09-12T00:51:34.119 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: secure 2024-09-12T00:51:34.119 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: crc 2024-09-12T00:51:34.119 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:51:33.957+0000 7fde99b40800 5 AuthRegistry(0x5565dc1a75d0) adding con mode: secure 2024-09-12T00:51:34.119 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:51:33.958+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.119 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:51:33.958+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.119 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:51:33.958+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command rotate-key cmddesc rotate-key hook 0x5565dc1a7718 EEXIST 2024-09-12T00:51:34.119 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:34.120 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:51:34.120 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-b con 0x5565dc1b8300 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:51:34.120 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-a con 0x5565dc1e27d0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:51:34.120 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): picked mon.noname-c con 0x5565dc1e72f0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:51:34.120 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.120 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.120 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:34.120 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:34.120 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:51:33.958+0000 7fde99b40800 10 monclient(hunting): authenticate will time out at 1980.451357s 2024-09-12T00:51:34.120 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): get_auth_request con 0x5565dc1e72f0 auth_method 0 2024-09-12T00:51:34.120 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.121 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.121 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.121 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:51:33.958+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request con 0x5565dc1e27d0 auth_method 0 2024-09-12T00:51:34.121 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:51:33.958+0000 7fde8d0bf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.121 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:51:33.958+0000 7fde8d0bf640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.121 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:51:33.958+0000 7fde8d0bf640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.121 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:51:33.958+0000 7fde958c0640 10 monclient(hunting): get_auth_request con 0x5565dc1b8300 auth_method 0 2024-09-12T00:51:34.121 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:51:33.958+0000 7fde958c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:34.121 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:51:33.958+0000 7fde958c0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:34.121 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:51:33.958+0000 7fde958c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:34.121 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.121 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.121 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.122 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:51:33.958+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.122 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:51:33.958+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.122 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:51:33.958+0000 7fde8d0bf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.122 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:51:33.958+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:34.122 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:51:33.958+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:34.122 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:51:33.958+0000 7fde958c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:34.122 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient(hunting): handle_auth_done global_id 6548 payload 824 2024-09-12T00:51:34.122 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient: _finish_hunting 0 2024-09-12T00:51:34.122 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:51:33.958+0000 7fde960c1640 1 monclient: found mon.noname-c 2024-09-12T00:51:34.122 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:51:33.958+0000 7fde960c1640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.123 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:51:33.958+0000 7fdd677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.123 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:51:33.958+0000 7fdd677fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:34.123 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:51:33.958+0000 7fdd677fe640 10 monclient: dump: 2024-09-12T00:51:34.123 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.123 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.123 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.123 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.123 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.123 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.123 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.123 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.124 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.124 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.124 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:51:33.958+0000 7fdd677fe640 10 monclient: _finish_auth 0 2024-09-12T00:51:34.124 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:51:33.958+0000 7fdd677fe640 10 monclient: _check_auth_tickets 2024-09-12T00:51:34.124 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:51:33.959+0000 7fdd677fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:34.124 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:51:33.959+0000 7fdd677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:34.124 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:51:33.959+0000 7fdd677fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:34.124 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:51:33.959+0000 7fdd677fe640 10 monclient: dump: 2024-09-12T00:51:34.124 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:51:34.124 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:51:34.124 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.125 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:51:34.125 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:34.125 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:51:34.125 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:51:34.125 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:51:34.125 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:51:34.125 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.125 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:51:33.959+0000 7fde99b40800 5 monclient: authenticate success, global_id 6548 2024-09-12T00:51:34.125 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:51:33.959+0000 7fde99b40800 10 monclient: _renew_subs 2024-09-12T00:51:34.125 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:51:33.959+0000 7fdd797fa640 4 set_mon_vals no callback set 2024-09-12T00:51:34.125 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:51:33.959+0000 7fde99b40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.125 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:51:33.959+0000 7fde99b40800 10 monclient: _renew_subs 2024-09-12T00:51:34.126 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:51:33.959+0000 7fde99b40800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.126 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:51:33.959+0000 7fde99b40800 1 librados: init done 2024-09-12T00:51:34.126 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:51:33.959+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command cr dump hook 0x5565dc1dba98 2024-09-12T00:51:34.126 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:51:33.960+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.126 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:51:33.960+0000 7fdd677fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:34.126 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:51:33.960+0000 7fdd677fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:51:34.126 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:51:33.960+0000 7fdd677fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:51:34.126 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:51:33.961+0000 7fde958c0640 10 monclient: get_auth_request con 0x7fdd60076470 auth_method 0 2024-09-12T00:51:34.126 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:51:33.961+0000 7fde8d0bf640 10 monclient: get_auth_request con 0x5565dc201310 auth_method 0 2024-09-12T00:51:34.126 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.126 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:51:33.962+0000 7fde99b40800 20 realm 2024-09-12T00:51:34.126 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.126 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.127 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:51:33.962+0000 7fde99b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:34.127 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.127 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.127 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:51:33.962+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.127 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:51:33.962+0000 7fde958c0640 10 monclient: get_auth_request con 0x5565dc205580 auth_method 0 2024-09-12T00:51:34.127 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:51:33.963+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:34.127 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:51:33.963+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.127 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:51:33.963+0000 7fde8d0bf640 10 monclient: get_auth_request con 0x5565dc208de0 auth_method 0 2024-09-12T00:51:34.127 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:51:33.963+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:34.127 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:51:33.963+0000 7fde99b40800 20 searching for the correct realm 2024-09-12T00:51:34.127 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:51:33.964+0000 7fde960c1640 10 monclient: get_auth_request con 0x5565dc20da30 auth_method 0 2024-09-12T00:51:34.127 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:51:33.964+0000 7fde958c0640 10 monclient: get_auth_request con 0x7fde90017070 auth_method 0 2024-09-12T00:51:34.127 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:51:33.966+0000 7fde8d0bf640 10 monclient: get_auth_request con 0x7fde90048060 auth_method 0 2024-09-12T00:51:34.128 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:51:33.966+0000 7fde8d0bf640 0 -- 172.21.15.62:0/79011188 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fde90048060 msgr2=0x7fde9008ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:34.128 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:51:33.966+0000 7fdd677fe640 1 client.6548.objecter ms_handle_reset 0x7fde90048060 session 0x7fde90009250 osd.5 2024-09-12T00:51:34.128 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:51:33.966+0000 7fdd677fe640 10 monclient: _renew_subs 2024-09-12T00:51:34.128 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:51:33.966+0000 7fdd677fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:51:34.128 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:51:33.967+0000 7fde8d0bf640 10 monclient: get_auth_request con 0x7fdd60086720 auth_method 0 2024-09-12T00:51:34.128 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:51:33.968+0000 7fde960c1640 10 monclient: get_auth_request con 0x7fde880ac960 auth_method 0 2024-09-12T00:51:34.128 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:51:33.968+0000 7fde958c0640 10 monclient: get_auth_request con 0x7fde9008ee10 auth_method 0 2024-09-12T00:51:34.128 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:51:33.970+0000 7fde958c0640 0 -- 172.21.15.62:0/79011188 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7fde9008ee10 msgr2=0x7fde9008ba10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:34.128 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:51:33.970+0000 7fdd677fe640 1 client.6548.objecter ms_handle_reset 0x7fde9008ee10 session 0x7fde90050e90 osd.3 2024-09-12T00:51:34.128 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:51:33.970+0000 7fde958c0640 10 monclient: get_auth_request con 0x7fde90048060 auth_method 0 2024-09-12T00:51:34.128 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:34.128 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:34.129 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:34.129 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:34.129 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:34.129 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:51:33.973+0000 7fde99b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:34.129 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:51:33.973+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.129 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.129 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.129 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:34.129 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.129 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:34.129 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 zone default found 2024-09-12T00:51:34.129 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:51:33.974+0000 7fde99b40800 4 Realm: () 2024-09-12T00:51:34.130 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:51:33.974+0000 7fde99b40800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:34.130 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:51:33.974+0000 7fde99b40800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:34.130 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:51:33.974+0000 7fde99b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:34.130 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 zonegroup default 2024-09-12T00:51:34.130 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.130 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.130 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:51:33.974+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.130 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:51:33.975+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.130 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:51:33.975+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.130 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:51:33.975+0000 7fde99b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.130 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:51:33.975+0000 7fde99b40800 20 started sync module instance, tier type = 2024-09-12T00:51:34.130 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:51:33.975+0000 7fde99b40800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:34.131 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=0 2024-09-12T00:51:34.131 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=1 2024-09-12T00:51:34.131 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=2 2024-09-12T00:51:34.131 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=3 2024-09-12T00:51:34.131 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=4 2024-09-12T00:51:34.131 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=5 2024-09-12T00:51:34.131 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:51:33.984+0000 7fde99b40800 20 add_watcher() i=6 2024-09-12T00:51:34.131 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:51:33.985+0000 7fde99b40800 20 add_watcher() i=7 2024-09-12T00:51:34.131 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:51:33.985+0000 7fde99b40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:34.131 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding auth protocol: cephx 2024-09-12T00:51:34.131 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding auth protocol: cephx 2024-09-12T00:51:34.131 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding auth protocol: cephx 2024-09-12T00:51:34.131 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: secure 2024-09-12T00:51:34.131 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: crc 2024-09-12T00:51:34.132 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: secure 2024-09-12T00:51:34.132 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: crc 2024-09-12T00:51:34.132 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: secure 2024-09-12T00:51:34.132 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: crc 2024-09-12T00:51:34.132 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: crc 2024-09-12T00:51:34.132 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: secure 2024-09-12T00:51:34.132 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: crc 2024-09-12T00:51:34.132 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: secure 2024-09-12T00:51:34.132 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:51:33.987+0000 7fdd477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:34.132 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: crc 2024-09-12T00:51:34.132 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 AuthRegistry(0x7ffd98e6a2a0) adding con mode: secure 2024-09-12T00:51:34.132 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:51:33.987+0000 7fde99b40800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:34.132 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:51:33.987+0000 7fde99b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:34.132 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:51:33.987+0000 7fde99b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:34.133 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command cache list hook 0x5565dc1dc830 2024-09-12T00:51:34.133 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command cache inspect hook 0x5565dc1dc830 2024-09-12T00:51:34.133 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command cache erase hook 0x5565dc1dc830 2024-09-12T00:51:34.133 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command cache zap hook 0x5565dc1dc830 2024-09-12T00:51:34.133 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 note: GC not initialized 2024-09-12T00:51:34.133 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:51:33.987+0000 7fdd467fc640 20 reqs_thread_entry: start 2024-09-12T00:51:34.133 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command sync trace show hook 0x7fde88004040 2024-09-12T00:51:34.133 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command sync trace history hook 0x7fde88004040 2024-09-12T00:51:34.133 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command sync trace active hook 0x7fde88004040 2024-09-12T00:51:34.133 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:51:33.987+0000 7fde99b40800 5 asok(0x5565dbef6630) register_command sync trace active_short hook 0x7fde88004040 2024-09-12T00:51:34.134 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:51:33.987+0000 7fde99b40800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:34.134 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:51:33.987+0000 7fde99b40800 20 Filter name: none 2024-09-12T00:51:34.134 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:51:33.987+0000 7fdcb7fff640 20 reqs_thread_entry: start 2024-09-12T00:51:34.134 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:51:34.134 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:51:33.988+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.134 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:51:33.988+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:34.134 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:51:34.134 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:51:34.134 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 : miss 2024-09-12T00:51:34.134 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:51:33.988+0000 7fde99b40800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.134 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:51:33.988+0000 7fde99b40800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:51:34.134 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:51:34.135 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:51:34.135 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:34.135 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:34.135 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:51:33.988+0000 7fde99b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 2024-09-12T00:51:34.135 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:51:33.992+0000 7fde99b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:51:34.135 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:51:33.992+0000 7fde99b40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:51:34.135 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:51:33.992+0000 7fde99b40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:34.135 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:51:33.992+0000 7fde99b40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27, ofs0, ns] 2024-09-12T00:51:34.135 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:51:33.992+0000 7fdd797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431654 cookie 93895973222704 notifier 6548 bl.length()=939 2024-09-12T00:51:34.135 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:51:33.992+0000 7fdd797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:51:34.136 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:51:33.992+0000 7fdd797fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:51:34.136 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:51:33.992+0000 7fdd797fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:34.136 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:51:33.994+0000 7fde99b40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): orig_sources= new_sources= 2024-09-12T00:51:34.136 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:51:33.994+0000 7fde99b40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): potential sources added=[] removed=[] 2024-09-12T00:51:34.136 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:51:33.994+0000 7fde99b40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): orig_dests= new_dests= 2024-09-12T00:51:34.136 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:51:33.994+0000 7fde99b40800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): potential dests added=[] removed=[] 2024-09-12T00:51:34.136 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:51:33.995+0000 7fde99b40800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fde99b40800 time 2024-09-12T00:51:33.995464+0000 2024-09-12T00:51:34.136 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:34.136 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.136 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:34.136 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fde9b38c71a] 2024-09-12T00:51:34.136 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde9b38c8d8] 2024-09-12T00:51:34.137 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565d9ef9641] 2024-09-12T00:51:34.137 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd884de) [0x5565da40c4de] 2024-09-12T00:51:34.137 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565d9f0931d] 2024-09-12T00:51:34.137 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:51:34.137 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fde9a029590] 2024-09-12T00:51:34.137 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:51:34.137 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:51:34.137 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.137 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:51:33.996+0000 7fde99b40800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:34.137 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7fde99b40800 thread_name:radosgw-admin 2024-09-12T00:51:34.137 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.138 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:34.138 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fde9a03e6f0] 2024-09-12T00:51:34.138 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fde9a08b99c] 2024-09-12T00:51:34.138 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:51:34.138 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:51:34.138 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fde9b38c774] 2024-09-12T00:51:34.138 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fde9b38c8d8] 2024-09-12T00:51:34.138 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5565d9ef9641] 2024-09-12T00:51:34.138 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd884de) [0x5565da40c4de] 2024-09-12T00:51:34.138 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5565d9f0931d] 2024-09-12T00:51:34.138 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:51:34.138 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fde9a029590] 2024-09-12T00:51:34.138 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:51:34.138 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:51:34.139 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:34.139 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.139 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:51:34.139 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:51:34.139 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:51:34.139 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:51:34.139 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:51:34.139 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:51:34.139 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:51:34.139 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:51:34.139 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:51:34.139 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:51:34.139 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:51:34.140 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:51:34.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:51:34.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:51:34.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:51:34.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:51:34.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:51:34.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:51:34.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:51:34.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:51:34.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:51:34.141 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:51:34.141 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:51:34.141 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:51:34.141 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:51:34.141 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:51:34.141 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:51:34.141 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:51:34.141 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:51:34.141 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:51:34.141 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:51:34.141 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:51:34.141 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:51:34.142 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:51:34.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:51:34.142 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:51:34.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:51:34.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:51:34.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:51:34.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:51:34.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:51:34.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:51:34.142 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:51:34.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:51:34.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:51:34.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:51:34.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:51:34.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:51:34.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:51:34.143 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:51:34.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:51:34.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:51:34.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:51:34.143 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:51:34.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:51:34.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:51:34.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:51:34.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:51:34.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:51:34.144 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:51:34.144 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:51:34.144 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:51:34.144 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:51:34.144 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:51:34.144 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:51:34.144 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:51:34.144 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:51:34.144 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:51:34.144 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:51:34.144 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:51:34.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:51:34.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:51:34.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:51:34.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:51:34.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:51:34.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:51:34.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:51:34.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:51:34.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:51:34.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:51:34.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:51:34.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:51:34.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:51:34.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:51:34.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:51:34.146 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:51:34.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:51:34.146 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:51:34.146 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:51:34.146 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:51:34.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:51:34.146 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:51:34.146 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:51:34.147 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:51:34.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdcb7fff640 / http_manager 2024-09-12T00:51:34.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdd467fc640 / http_manager 2024-09-12T00:51:34.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdd477fe640 / rgw_dt_lg_renew 2024-09-12T00:51:34.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdd677fe640 / ms_dispatch 2024-09-12T00:51:34.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdd797fa640 / io_context_pool 2024-09-12T00:51:34.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdd7b7fe640 / ms_dispatch 2024-09-12T00:51:34.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdd82604640 / ms_dispatch 2024-09-12T00:51:34.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fdd83e07640 / io_context_pool 2024-09-12T00:51:34.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fde8d0bf640 / msgr-worker-2 2024-09-12T00:51:34.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fde958c0640 / msgr-worker-1 2024-09-12T00:51:34.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fde960c1640 / msgr-worker-0 2024-09-12T00:51:34.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fde968c2640 / io_context_pool 2024-09-12T00:51:34.148 INFO:tasks.workunit.client.0.smithi062.stderr: 7fde99b40800 / radosgw-admin 2024-09-12T00:51:34.148 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:51:34.148 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:51:34.148 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:51:33.997322Z_b7146523-0135-4d41-a936-4d7f5951b43d/log 2024-09-12T00:51:34.148 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:51:34.148 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:51:34.149 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:34.149 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:34.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.073+0000 7f27d920e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.075+0000 7f27d920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.075+0000 7f27d920e800 20 realm 2024-09-12T00:51:34.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.075+0000 7f27d920e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.075+0000 7f27d920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.075+0000 7f27d920e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:34.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.075+0000 7f27d920e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.075+0000 7f27d920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.075+0000 7f27d920e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.076+0000 7f27d920e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:34.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.076+0000 7f27d920e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.151 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.077+0000 7f27d920e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:34.151 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.077+0000 7f27d920e800 20 searching for the correct realm 2024-09-12T00:51:34.151 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.080+0000 7f27d4058640 0 -- 172.21.15.62:0/798782794 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f27cc07e400 msgr2=0x7f27cc07e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:34.284 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.285+0000 7f27d505a640 0 -- 172.21.15.62:0/798782794 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x562f1cb245f0 msgr2=0x562f1cb26a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:34.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.289+0000 7f27d920e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:34.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.289+0000 7f27d920e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:34.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.289+0000 7f27d920e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:34.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.289+0000 7f27d920e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:34.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.289+0000 7f27d920e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:34.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.289+0000 7f27d920e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:34.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.289+0000 7f27d920e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.289+0000 7f27d920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.289+0000 7f27d920e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.290+0000 7f27d920e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:34.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.290+0000 7f27d920e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.290+0000 7f27d920e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:34.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.290+0000 7f27d920e800 20 zone default found 2024-09-12T00:51:34.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.290+0000 7f27d920e800 4 Realm: () 2024-09-12T00:51:34.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.290+0000 7f27d920e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:34.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.290+0000 7f27d920e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:34.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.290+0000 7f27d920e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:34.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.290+0000 7f27d920e800 20 zonegroup default 2024-09-12T00:51:34.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.290+0000 7f27d920e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.290+0000 7f27d920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.290+0000 7f27d920e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.291+0000 7f27d920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.291+0000 7f27d920e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.291+0000 7f27d920e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.291+0000 7f27d920e800 20 started sync module instance, tier type = 2024-09-12T00:51:34.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.291+0000 7f27d920e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:34.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.301+0000 7f27d920e800 20 add_watcher() i=0 2024-09-12T00:51:34.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.301+0000 7f27d920e800 20 add_watcher() i=1 2024-09-12T00:51:34.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.301+0000 7f27d920e800 20 add_watcher() i=2 2024-09-12T00:51:34.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.301+0000 7f27d920e800 20 add_watcher() i=3 2024-09-12T00:51:34.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.301+0000 7f27d920e800 20 add_watcher() i=4 2024-09-12T00:51:34.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.301+0000 7f27d920e800 20 add_watcher() i=5 2024-09-12T00:51:34.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.301+0000 7f27d920e800 20 add_watcher() i=6 2024-09-12T00:51:34.301 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.302+0000 7f27d920e800 20 add_watcher() i=7 2024-09-12T00:51:34.301 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.302+0000 7f27d920e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:34.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.304+0000 7f268afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:34.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.304+0000 7f27d920e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:34.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.304+0000 7f27d920e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:34.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.304+0000 7f27d920e800 5 note: GC not initialized 2024-09-12T00:51:34.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.304+0000 7f2689fe3640 20 reqs_thread_entry: start 2024-09-12T00:51:34.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.304+0000 7f27d920e800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:34.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.305+0000 7f27d920e800 20 Filter name: none 2024-09-12T00:51:34.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.305+0000 7f25fb7fe640 20 reqs_thread_entry: start 2024-09-12T00:51:34.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.305+0000 7f27d920e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.305+0000 7f27d920e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:34.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.305+0000 7f27d920e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.306+0000 7f27d920e800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:51:34.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.306+0000 7f27d920e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:34.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.306+0000 7f27d920e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.306+0000 7f27d920e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:34.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.306+0000 7f27d920e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.306+0000 7f27d920e800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:51:34.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.306+0000 7f27d920e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:34.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.308+0000 7f268afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:34.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.310+0000 7f27d920e800 20 remove_watcher() i=0 2024-09-12T00:51:34.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.310+0000 7f27d920e800 2 removed watcher, disabling cache 2024-09-12T00:51:34.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.311+0000 7f27d920e800 20 remove_watcher() i=1 2024-09-12T00:51:34.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.312+0000 7f27d920e800 20 remove_watcher() i=2 2024-09-12T00:51:34.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.313+0000 7f27d920e800 20 remove_watcher() i=3 2024-09-12T00:51:34.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.313+0000 7f27d920e800 20 remove_watcher() i=4 2024-09-12T00:51:34.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.314+0000 7f27d920e800 20 remove_watcher() i=5 2024-09-12T00:51:34.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.315+0000 7f27d920e800 20 remove_watcher() i=6 2024-09-12T00:51:34.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.316+0000 7f27d920e800 20 remove_watcher() i=7 2024-09-12T00:51:34.326 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.326 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:51:34.326 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-trim-reshard-log-entries id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:51:34.326 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:51:34.420 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:51:34.453 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:34.453 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:34.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.492+0000 7f1174d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.494+0000 7f1174d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.494+0000 7f1174d2e800 20 realm 2024-09-12T00:51:34.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.494+0000 7f1174d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.494+0000 7f1174d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.494+0000 7f1174d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:34.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.494+0000 7f1174d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.494+0000 7f1174d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.494+0000 7f1174d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.495+0000 7f1174d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:34.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.495+0000 7f1174d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.496+0000 7f1174d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:34.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.496+0000 7f1174d2e800 20 searching for the correct realm 2024-09-12T00:51:34.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.499+0000 7f11702dc640 0 -- 172.21.15.62:0/1392971306 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f1168017410 msgr2=0x7f1168017890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:34.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.704+0000 7f11712de640 0 -- 172.21.15.62:0/1392971306 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x56399f270080 msgr2=0x56399f272470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:34.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.708+0000 7f1174d2e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:51:34.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.708+0000 7f1174d2e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:51:34.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.708+0000 7f1174d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:34.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.708+0000 7f1174d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:34.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.708+0000 7f1174d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:34.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.708+0000 7f1174d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:34.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.708+0000 7f1174d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.708+0000 7f1174d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.708+0000 7f1174d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.709+0000 7f1174d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:34.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.709+0000 7f1174d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.709+0000 7f1174d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:34.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.709+0000 7f1174d2e800 20 zone default found 2024-09-12T00:51:34.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.709+0000 7f1174d2e800 4 Realm: () 2024-09-12T00:51:34.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.709+0000 7f1174d2e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:51:34.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.709+0000 7f1174d2e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:51:34.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.709+0000 7f1174d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:34.712 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.709+0000 7f1174d2e800 20 zonegroup default 2024-09-12T00:51:34.712 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.709+0000 7f1174d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.712 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.709+0000 7f1174d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.712 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.709+0000 7f1174d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.713 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.710+0000 7f1174d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.713 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.710+0000 7f1174d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.713 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.710+0000 7f1174d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:34.713 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.710+0000 7f1174d2e800 20 started sync module instance, tier type = 2024-09-12T00:51:34.713 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.710+0000 7f1174d2e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:51:34.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.720+0000 7f1174d2e800 20 add_watcher() i=0 2024-09-12T00:51:34.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.720+0000 7f1174d2e800 20 add_watcher() i=1 2024-09-12T00:51:34.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.720+0000 7f1174d2e800 20 add_watcher() i=2 2024-09-12T00:51:34.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.720+0000 7f1174d2e800 20 add_watcher() i=3 2024-09-12T00:51:34.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.720+0000 7f1174d2e800 20 add_watcher() i=4 2024-09-12T00:51:34.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.720+0000 7f1174d2e800 20 add_watcher() i=5 2024-09-12T00:51:34.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.721+0000 7f1174d2e800 20 add_watcher() i=6 2024-09-12T00:51:34.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.721+0000 7f1174d2e800 20 add_watcher() i=7 2024-09-12T00:51:34.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.721+0000 7f1174d2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:34.722 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.723+0000 7f1026fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:34.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.723+0000 7f1174d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:34.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.723+0000 7f1174d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:34.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.723+0000 7f1174d2e800 5 note: GC not initialized 2024-09-12T00:51:34.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.723+0000 7f1025fe3640 20 reqs_thread_entry: start 2024-09-12T00:51:34.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.723+0000 7f1174d2e800 20 init_complete bucket index max shards: 1 2024-09-12T00:51:34.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.724+0000 7f1174d2e800 20 Filter name: none 2024-09-12T00:51:34.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.724+0000 7f0f977fe640 20 reqs_thread_entry: start 2024-09-12T00:51:34.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.724+0000 7f1174d2e800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:51:34.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.724+0000 7f1174d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.724+0000 7f1174d2e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:51:34.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.724+0000 7f1174d2e800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:51:34.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.724+0000 7f1174d2e800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:51:34.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.724+0000 7f1174d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 : miss 2024-09-12T00:51:34.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.724+0000 7f1174d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:51:34.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.724+0000 7f1174d2e800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:51:34.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.724+0000 7f1174d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:51:34.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.724+0000 7f1174d2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:51:34.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.724+0000 7f1174d2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:34.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.724+0000 7f1174d2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:34.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.724+0000 7f1174d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 2024-09-12T00:51:34.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.725+0000 7f1174d2e800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to be held by another RGW process; skipping for now 2024-09-12T00:51:34.726 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.726+0000 7f1026fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:34.727 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.728+0000 7f1174d2e800 20 remove_watcher() i=0 2024-09-12T00:51:34.727 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.728+0000 7f1174d2e800 2 removed watcher, disabling cache 2024-09-12T00:51:34.728 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.729+0000 7f1174d2e800 20 remove_watcher() i=1 2024-09-12T00:51:34.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.730+0000 7f1174d2e800 20 remove_watcher() i=2 2024-09-12T00:51:34.731 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.732+0000 7f1174d2e800 20 remove_watcher() i=3 2024-09-12T00:51:34.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.733+0000 7f1174d2e800 20 remove_watcher() i=4 2024-09-12T00:51:34.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.734+0000 7f1174d2e800 20 remove_watcher() i=5 2024-09-12T00:51:34.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.735+0000 7f1174d2e800 20 remove_watcher() i=6 2024-09-12T00:51:34.736 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:51:34.737+0000 7f1174d2e800 20 remove_watcher() i=7 2024-09-12T00:51:34.746 INFO:tasks.workunit.client.0.smithi062.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:52:04.762 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:52:04.799 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:04.800 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:04.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.846+0000 7f7c86735800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.847+0000 7f7c86735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:04.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.847+0000 7f7c86735800 20 realm 2024-09-12T00:52:04.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.847+0000 7f7c86735800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.848+0000 7f7c86735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:04.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.848+0000 7f7c86735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:04.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.848+0000 7f7c86735800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.848+0000 7f7c86735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:04.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.848+0000 7f7c86735800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.849+0000 7f7c86735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:04.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.849+0000 7f7c86735800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.850+0000 7f7c86735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:04.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.850+0000 7f7c86735800 20 searching for the correct realm 2024-09-12T00:52:04.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.854+0000 7f7c81ce3640 0 -- 172.21.15.62:0/3437687227 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f7c7c06fcd0 msgr2=0x7f7c7c06ea30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:04.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.857+0000 7f7c824e4640 0 -- 172.21.15.62:0/3437687227 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f7c7c097450 msgr2=0x7f7c7c0529a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:04.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:04.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:04.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:04.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:04.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:04.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:04.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:04.861 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:04.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:04.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 20 zone default found 2024-09-12T00:52:04.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 4 Realm: () 2024-09-12T00:52:04.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:04.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:04.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:04.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 20 zonegroup default 2024-09-12T00:52:04.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.862+0000 7f7c86735800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.863+0000 7f7c86735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:04.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.863+0000 7f7c86735800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.863+0000 7f7c86735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:04.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.863+0000 7f7c86735800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.863+0000 7f7c86735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:04.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.863+0000 7f7c86735800 20 started sync module instance, tier type = 2024-09-12T00:52:04.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.863+0000 7f7c86735800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:04.872 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.873+0000 7f7c86735800 20 add_watcher() i=0 2024-09-12T00:52:04.872 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.873+0000 7f7c86735800 20 add_watcher() i=1 2024-09-12T00:52:04.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.873+0000 7f7c86735800 20 add_watcher() i=2 2024-09-12T00:52:04.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.873+0000 7f7c86735800 20 add_watcher() i=3 2024-09-12T00:52:04.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.873+0000 7f7c86735800 20 add_watcher() i=4 2024-09-12T00:52:04.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.873+0000 7f7c86735800 20 add_watcher() i=5 2024-09-12T00:52:04.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.873+0000 7f7c86735800 20 add_watcher() i=6 2024-09-12T00:52:04.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.874+0000 7f7c86735800 20 add_watcher() i=7 2024-09-12T00:52:04.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.874+0000 7f7c86735800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:04.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.876+0000 7f7b38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:04.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.877+0000 7f7c86735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:04.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.877+0000 7f7c86735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:04.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.877+0000 7f7c86735800 5 note: GC not initialized 2024-09-12T00:52:04.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.877+0000 7f7ab37fe640 20 reqs_thread_entry: start 2024-09-12T00:52:04.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.877+0000 7f7c86735800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:04.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.877+0000 7f7c86735800 20 Filter name: none 2024-09-12T00:52:04.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.877+0000 7f7ab17fa640 20 reqs_thread_entry: start 2024-09-12T00:52:04.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.877+0000 7f7c86735800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:52:04.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.877+0000 7f7c86735800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.878+0000 7f7c86735800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:52:04.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.878+0000 7f7c86735800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:52:04.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.878+0000 7f7c86735800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:52:04.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.878+0000 7f7c86735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 : miss 2024-09-12T00:52:04.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.878+0000 7f7c86735800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.878+0000 7f7c86735800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:52:04.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.878+0000 7f7c86735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:52:04.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.878+0000 7f7c86735800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:52:04.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.878+0000 7f7c86735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:04.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.878+0000 7f7c86735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:04.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.878+0000 7f7c86735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 2024-09-12T00:52:04.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.879+0000 7f7c86735800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:52:04.882 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.883+0000 7f7c86735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:52:04.882 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.883+0000 7f7c86735800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:52:04.882 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.883+0000 7f7c86735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:04.882 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.883+0000 7f7c86735800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27, ofs0, ns] 2024-09-12T00:52:04.883 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.884+0000 7f7b65ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431655 cookie 94191338801936 notifier 6942 bl.length()=939 2024-09-12T00:52:04.883 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.884+0000 7f7b65ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:52:04.883 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.884+0000 7f7b65ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:52:04.883 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.884+0000 7f7b65ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:04.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.886+0000 7f7c86735800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): orig_sources= new_sources= 2024-09-12T00:52:04.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.886+0000 7f7c86735800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): potential sources added=[] removed=[] 2024-09-12T00:52:04.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.886+0000 7f7c86735800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): orig_dests= new_dests= 2024-09-12T00:52:04.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.886+0000 7f7c86735800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): potential dests added=[] removed=[] 2024-09-12T00:52:04.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.888+0000 7f7c86735800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27.2.0 2024-09-12T00:52:04.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.888+0000 7f7c86735800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27.2.0 2024-09-12T00:52:04.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.888+0000 7f7c86735800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27.2.1 2024-09-12T00:52:04.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.888+0000 7f7c86735800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27.2.1 2024-09-12T00:52:04.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.888+0000 7f7c86735800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27.0 2024-09-12T00:52:04.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.891+0000 7f7c86735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:04.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.891+0000 7f7c86735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 2024-09-12T00:52:04.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.892+0000 7f7c86735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:52:04.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.892+0000 7f7c86735800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:52:04.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.892+0000 7f7c86735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:04.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.892+0000 7f7c86735800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27, ofs0, ns] 2024-09-12T00:52:04.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.893+0000 7f7b657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431656 cookie 94191338801936 notifier 6942 bl.length()=939 2024-09-12T00:52:04.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.893+0000 7f7b657fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:52:04.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.893+0000 7f7b657fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:52:04.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.893+0000 7f7b657fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:04.893 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.894+0000 7f7c86735800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): orig_sources= new_sources= 2024-09-12T00:52:04.893 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.894+0000 7f7c86735800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): potential sources added=[] removed=[] 2024-09-12T00:52:04.893 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.894+0000 7f7c86735800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): orig_dests= new_dests= 2024-09-12T00:52:04.893 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.894+0000 7f7c86735800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): potential dests added=[] removed=[] 2024-09-12T00:52:04.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.895+0000 7f7c86735800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27.0 2024-09-12T00:52:04.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.896+0000 7f7c86735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:04.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.896+0000 7f7c86735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 2024-09-12T00:52:04.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.897+0000 7f7c86735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:52:04.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.897+0000 7f7c86735800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:52:04.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.897+0000 7f7c86735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:04.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.897+0000 7f7c86735800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27, ofs0, ns] 2024-09-12T00:52:04.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.897+0000 7f7b65ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431657 cookie 94191338801936 notifier 6942 bl.length()=907 2024-09-12T00:52:04.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.897+0000 7f7b65ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 info.flags=0x17 2024-09-12T00:52:04.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.897+0000 7f7b65ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 to cache LRU end 2024-09-12T00:52:04.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.897+0000 7f7b65ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:04.898 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.899+0000 7f7c86735800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): orig_sources= new_sources= 2024-09-12T00:52:04.898 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.899+0000 7f7c86735800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): potential sources added=[] removed=[] 2024-09-12T00:52:04.898 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.899+0000 7f7c86735800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): orig_dests= new_dests= 2024-09-12T00:52:04.898 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.899+0000 7f7c86735800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27]): potential dests added=[] removed=[] 2024-09-12T00:52:04.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.900+0000 7f7c86735800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-12T00:52:04.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.902+0000 7f7b38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:04.903 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.905+0000 7f7c86735800 20 remove_watcher() i=0 2024-09-12T00:52:04.904 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.905+0000 7f7c86735800 2 removed watcher, disabling cache 2024-09-12T00:52:04.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.906+0000 7f7c86735800 20 remove_watcher() i=1 2024-09-12T00:52:04.905 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.907+0000 7f7c86735800 20 remove_watcher() i=2 2024-09-12T00:52:04.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.908+0000 7f7c86735800 20 remove_watcher() i=3 2024-09-12T00:52:04.907 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.909+0000 7f7c86735800 20 remove_watcher() i=4 2024-09-12T00:52:04.909 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.910+0000 7f7c86735800 20 remove_watcher() i=5 2024-09-12T00:52:04.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.911+0000 7f7c86735800 20 remove_watcher() i=6 2024-09-12T00:52:04.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.912+0000 7f7c86735800 20 remove_watcher() i=7 2024-09-12T00:52:04.924 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:52:04.954 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:04.954 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:04.993 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.994+0000 7f33d3ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.996+0000 7f33d3ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:04.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.996+0000 7f33d3ebb800 20 realm 2024-09-12T00:52:04.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.996+0000 7f33d3ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.996+0000 7f33d3ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:04.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.996+0000 7f33d3ebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:04.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.996+0000 7f33d3ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.996+0000 7f33d3ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:04.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.996+0000 7f33d3ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.997+0000 7f33d3ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:04.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.997+0000 7f33d3ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:52:04.997 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.998+0000 7f33d3ebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:04.997 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:04.998+0000 7f33d3ebb800 20 searching for the correct realm 2024-09-12T00:52:04.999 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.001+0000 7f33d11a4640 0 -- 172.21.15.62:0/3915433490 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f33cc07b120 msgr2=0x7f33cc087130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:05.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.207+0000 7f33d21a6640 0 -- 172.21.15.62:0/3915433490 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x565249facd50 msgr2=0x565249faf140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:05.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.211+0000 7f33d3ebb800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:05.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.211+0000 7f33d3ebb800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:05.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.211+0000 7f33d3ebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:05.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.211+0000 7f33d3ebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:05.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.211+0000 7f33d3ebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:05.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.211+0000 7f33d3ebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:05.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.211+0000 7f33d3ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:52:05.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.211+0000 7f33d3ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:05.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.211+0000 7f33d3ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:52:05.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.212+0000 7f33d3ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:05.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.212+0000 7f33d3ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:52:05.212 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.212+0000 7f33d3ebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:05.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.212+0000 7f33d3ebb800 20 zone default found 2024-09-12T00:52:05.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.212+0000 7f33d3ebb800 4 Realm: () 2024-09-12T00:52:05.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.212+0000 7f33d3ebb800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:05.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.212+0000 7f33d3ebb800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:05.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.212+0000 7f33d3ebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:05.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.212+0000 7f33d3ebb800 20 zonegroup default 2024-09-12T00:52:05.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.212+0000 7f33d3ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:52:05.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.212+0000 7f33d3ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:05.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.212+0000 7f33d3ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:52:05.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.213+0000 7f33d3ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:05.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.213+0000 7f33d3ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:52:05.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.213+0000 7f33d3ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:05.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.213+0000 7f33d3ebb800 20 started sync module instance, tier type = 2024-09-12T00:52:05.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.213+0000 7f33d3ebb800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:05.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.223+0000 7f33d3ebb800 20 add_watcher() i=0 2024-09-12T00:52:05.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.223+0000 7f33d3ebb800 20 add_watcher() i=1 2024-09-12T00:52:05.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.223+0000 7f33d3ebb800 20 add_watcher() i=2 2024-09-12T00:52:05.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.223+0000 7f33d3ebb800 20 add_watcher() i=3 2024-09-12T00:52:05.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.223+0000 7f33d3ebb800 20 add_watcher() i=4 2024-09-12T00:52:05.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.223+0000 7f33d3ebb800 20 add_watcher() i=5 2024-09-12T00:52:05.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.223+0000 7f33d3ebb800 20 add_watcher() i=6 2024-09-12T00:52:05.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.224+0000 7f33d3ebb800 20 add_watcher() i=7 2024-09-12T00:52:05.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.224+0000 7f33d3ebb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:05.225 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.226+0000 7f32837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:05.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.226+0000 7f33d3ebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:05.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.226+0000 7f33d3ebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:05.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.226+0000 7f33d3ebb800 5 note: GC not initialized 2024-09-12T00:52:05.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.226+0000 7f32827fc640 20 reqs_thread_entry: start 2024-09-12T00:52:05.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.226+0000 7f33d3ebb800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:05.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.226+0000 7f33d3ebb800 20 Filter name: none 2024-09-12T00:52:05.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.226+0000 7f31f3fff640 20 reqs_thread_entry: start 2024-09-12T00:52:05.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.227+0000 7f33d3ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:52:05.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.227+0000 7f33d3ebb800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:52:05.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.227+0000 7f33d3ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:52:05.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.227+0000 7f33d3ebb800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:52:05.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.227+0000 7f33d3ebb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:05.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.227+0000 7f33d3ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:52:05.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.228+0000 7f33d3ebb800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:52:05.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.228+0000 7f33d3ebb800 20 rados->read ofs=0 len=0 2024-09-12T00:52:05.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.228+0000 7f33d3ebb800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:52:05.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.228+0000 7f33d3ebb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:05.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.229+0000 7f32837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:05.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.232+0000 7f33d3ebb800 20 remove_watcher() i=0 2024-09-12T00:52:05.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.232+0000 7f33d3ebb800 2 removed watcher, disabling cache 2024-09-12T00:52:05.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.233+0000 7f33d3ebb800 20 remove_watcher() i=1 2024-09-12T00:52:05.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.234+0000 7f33d3ebb800 20 remove_watcher() i=2 2024-09-12T00:52:05.234 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.235+0000 7f33d3ebb800 20 remove_watcher() i=3 2024-09-12T00:52:05.235 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.236+0000 7f33d3ebb800 20 remove_watcher() i=4 2024-09-12T00:52:05.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.237+0000 7f33d3ebb800 20 remove_watcher() i=5 2024-09-12T00:52:05.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.238+0000 7f33d3ebb800 20 remove_watcher() i=6 2024-09-12T00:52:05.238 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:05.239+0000 7f33d3ebb800 20 remove_watcher() i=7 2024-09-12T00:52:05.249 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:05.249 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:52:05.249 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-trim-reshard-log-entries id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:52:05.249 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:05.563 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T00:52:05.563 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:06.418 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:52:06.448 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:06.448 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:06.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.487+0000 7f04e3723800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.489+0000 7f04e3723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:06.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.489+0000 7f04e3723800 20 realm 2024-09-12T00:52:06.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.489+0000 7f04e3723800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.490+0000 7f04e3723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:06.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.490+0000 7f04e3723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:06.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.490+0000 7f04e3723800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.490+0000 7f04e3723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:06.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.490+0000 7f04e3723800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.490+0000 7f04e3723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:06.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.490+0000 7f04e3723800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.491+0000 7f04e3723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:06.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.491+0000 7f04e3723800 20 searching for the correct realm 2024-09-12T00:52:06.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.494+0000 7f04d6c12640 0 -- 172.21.15.62:0/265432684 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f04d805d040 msgr2=0x7f04d807b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:06.699 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.699+0000 7f04d6c12640 0 -- 172.21.15.62:0/265432684 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55c8b5400720 msgr2=0x55c8b5402be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:06.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.704+0000 7f04e3723800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:06.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.704+0000 7f04e3723800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:06.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.704+0000 7f04e3723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:06.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.704+0000 7f04e3723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:06.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.704+0000 7f04e3723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:06.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.704+0000 7f04e3723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:06.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.704+0000 7f04e3723800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.704+0000 7f04e3723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:06.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.704+0000 7f04e3723800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.704+0000 7f04e3723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:06.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.704+0000 7f04e3723800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.705+0000 7f04e3723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:06.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.705+0000 7f04e3723800 20 zone default found 2024-09-12T00:52:06.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.705+0000 7f04e3723800 4 Realm: () 2024-09-12T00:52:06.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.705+0000 7f04e3723800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:06.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.705+0000 7f04e3723800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:06.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.705+0000 7f04e3723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:06.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.705+0000 7f04e3723800 20 zonegroup default 2024-09-12T00:52:06.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.705+0000 7f04e3723800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.705+0000 7f04e3723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:06.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.705+0000 7f04e3723800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.705+0000 7f04e3723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:06.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.705+0000 7f04e3723800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.706+0000 7f04e3723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:06.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.706+0000 7f04e3723800 20 started sync module instance, tier type = 2024-09-12T00:52:06.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.706+0000 7f04e3723800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:06.714 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.716+0000 7f04e3723800 20 add_watcher() i=0 2024-09-12T00:52:06.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.716+0000 7f04e3723800 20 add_watcher() i=1 2024-09-12T00:52:06.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.716+0000 7f04e3723800 20 add_watcher() i=2 2024-09-12T00:52:06.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.716+0000 7f04e3723800 20 add_watcher() i=3 2024-09-12T00:52:06.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.716+0000 7f04e3723800 20 add_watcher() i=4 2024-09-12T00:52:06.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.716+0000 7f04e3723800 20 add_watcher() i=5 2024-09-12T00:52:06.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.716+0000 7f04e3723800 20 add_watcher() i=6 2024-09-12T00:52:06.716 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.717+0000 7f04e3723800 20 add_watcher() i=7 2024-09-12T00:52:06.716 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.717+0000 7f04e3723800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:06.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.718+0000 7f0395fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:06.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.719+0000 7f04e3723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:06.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.719+0000 7f04e3723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:06.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.719+0000 7f04e3723800 5 note: GC not initialized 2024-09-12T00:52:06.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.719+0000 7f0394fe1640 20 reqs_thread_entry: start 2024-09-12T00:52:06.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.719+0000 7f04e3723800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:06.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.719+0000 7f04e3723800 20 Filter name: none 2024-09-12T00:52:06.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.719+0000 7f030e7fc640 20 reqs_thread_entry: start 2024-09-12T00:52:06.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.719+0000 7f04e3723800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.720+0000 7f04e3723800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:06.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.720+0000 7f04e3723800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.720+0000 7f04e3723800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:52:06.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.720+0000 7f04e3723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:06.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.720+0000 7f04e3723800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.721+0000 7f04e3723800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:06.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.721+0000 7f04e3723800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.721+0000 7f04e3723800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:52:06.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.721+0000 7f04e3723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:06.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.722+0000 7f0395fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:06.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.725+0000 7f04e3723800 20 remove_watcher() i=0 2024-09-12T00:52:06.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.725+0000 7f04e3723800 2 removed watcher, disabling cache 2024-09-12T00:52:06.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.726+0000 7f04e3723800 20 remove_watcher() i=1 2024-09-12T00:52:06.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.727+0000 7f04e3723800 20 remove_watcher() i=2 2024-09-12T00:52:06.727 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.728+0000 7f04e3723800 20 remove_watcher() i=3 2024-09-12T00:52:06.728 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.729+0000 7f04e3723800 20 remove_watcher() i=4 2024-09-12T00:52:06.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.730+0000 7f04e3723800 20 remove_watcher() i=5 2024-09-12T00:52:06.730 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.731+0000 7f04e3723800 20 remove_watcher() i=6 2024-09-12T00:52:06.731 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.732+0000 7f04e3723800 20 remove_watcher() i=7 2024-09-12T00:52:06.742 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:06.742 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:52:06.742 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-block-writes id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:52:06.742 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:06.743 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T00:52:06.778 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:06.778 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:06.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.818+0000 7fa423726800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.819+0000 7fa423726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:06.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.819+0000 7fa423726800 20 realm 2024-09-12T00:52:06.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.819+0000 7fa423726800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.820+0000 7fa423726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:06.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.820+0000 7fa423726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:06.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.820+0000 7fa423726800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.820+0000 7fa423726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:06.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.820+0000 7fa423726800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.820 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.821+0000 7fa423726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:06.820 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.821+0000 7fa423726800 20 rados->read ofs=0 len=0 2024-09-12T00:52:06.820 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.821+0000 7fa423726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:06.820 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.821+0000 7fa423726800 20 searching for the correct realm 2024-09-12T00:52:06.823 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:06.824+0000 7fa41ebd8640 0 -- 172.21.15.62:0/3516296140 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fa41802a420 msgr2=0x7fa41802a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:07.028 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.029+0000 7fa41fbda640 0 -- 172.21.15.62:0/3516296140 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55a180df9e30 msgr2=0x55a180dfc2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:07.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.034+0000 7fa423726800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:07.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.034+0000 7fa423726800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:07.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.034+0000 7fa423726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:07.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.034+0000 7fa423726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:07.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.034+0000 7fa423726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:07.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.034+0000 7fa423726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:07.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.034+0000 7fa423726800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.034+0000 7fa423726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:07.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.034+0000 7fa423726800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.035+0000 7fa423726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:07.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.035+0000 7fa423726800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.035+0000 7fa423726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:07.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.035+0000 7fa423726800 20 zone default found 2024-09-12T00:52:07.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.035+0000 7fa423726800 4 Realm: () 2024-09-12T00:52:07.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.035+0000 7fa423726800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:07.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.035+0000 7fa423726800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:07.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.035+0000 7fa423726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:07.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.035+0000 7fa423726800 20 zonegroup default 2024-09-12T00:52:07.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.035+0000 7fa423726800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.036+0000 7fa423726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:07.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.036+0000 7fa423726800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.036+0000 7fa423726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:07.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.036+0000 7fa423726800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.036+0000 7fa423726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:07.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.036+0000 7fa423726800 20 started sync module instance, tier type = 2024-09-12T00:52:07.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.036+0000 7fa423726800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:07.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.046+0000 7fa423726800 20 add_watcher() i=0 2024-09-12T00:52:07.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.046+0000 7fa423726800 20 add_watcher() i=1 2024-09-12T00:52:07.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.046+0000 7fa423726800 20 add_watcher() i=2 2024-09-12T00:52:07.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.046+0000 7fa423726800 20 add_watcher() i=3 2024-09-12T00:52:07.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.046+0000 7fa423726800 20 add_watcher() i=4 2024-09-12T00:52:07.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.046+0000 7fa423726800 20 add_watcher() i=5 2024-09-12T00:52:07.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.046+0000 7fa423726800 20 add_watcher() i=6 2024-09-12T00:52:07.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.047+0000 7fa423726800 20 add_watcher() i=7 2024-09-12T00:52:07.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.047+0000 7fa423726800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:07.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.049+0000 7fa2d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:07.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.049+0000 7fa423726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:07.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.049+0000 7fa423726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:07.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.049+0000 7fa423726800 5 note: GC not initialized 2024-09-12T00:52:07.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.050+0000 7fa2d4fe1640 20 reqs_thread_entry: start 2024-09-12T00:52:07.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.050+0000 7fa423726800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:07.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.050+0000 7fa423726800 20 Filter name: none 2024-09-12T00:52:07.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.050+0000 7fa24e7fc640 20 reqs_thread_entry: start 2024-09-12T00:52:07.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.050+0000 7fa423726800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:52:07.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.050+0000 7fa423726800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.051+0000 7fa423726800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:07.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.051+0000 7fa423726800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:52:07.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.051+0000 7fa423726800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:52:07.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.051+0000 7fa423726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 : miss 2024-09-12T00:52:07.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.051+0000 7fa423726800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.051+0000 7fa423726800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:52:07.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.051+0000 7fa423726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 info.flags=0x17 2024-09-12T00:52:07.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.051+0000 7fa423726800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 to cache LRU end 2024-09-12T00:52:07.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.051+0000 7fa423726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:07.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.051+0000 7fa423726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:07.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.051+0000 7fa423726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 2024-09-12T00:52:07.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.055+0000 7fa423726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 info.flags=0x17 2024-09-12T00:52:07.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.055+0000 7fa423726800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 to cache LRU end 2024-09-12T00:52:07.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.055+0000 7fa423726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:07.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.055+0000 7fa423726800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28, ofs0, ns] 2024-09-12T00:52:07.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.056+0000 7fa302ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431660 cookie 94152140316944 notifier 6644 bl.length()=915 2024-09-12T00:52:07.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.056+0000 7fa302ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 info.flags=0x17 2024-09-12T00:52:07.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.056+0000 7fa302ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 to cache LRU end 2024-09-12T00:52:07.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.056+0000 7fa302ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:07.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.057+0000 7fa423726800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): orig_sources= new_sources= 2024-09-12T00:52:07.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.057+0000 7fa423726800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): potential sources added=[] removed=[] 2024-09-12T00:52:07.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.057+0000 7fa423726800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): orig_dests= new_dests= 2024-09-12T00:52:07.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.057+0000 7fa423726800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): potential dests added=[] removed=[] 2024-09-12T00:52:07.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.060+0000 7fa423726800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28.1.0 2024-09-12T00:52:07.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.060+0000 7fa423726800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28.1.0 2024-09-12T00:52:07.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.060+0000 7fa423726800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28.1.1 2024-09-12T00:52:07.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.060+0000 7fa423726800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28.1.1 2024-09-12T00:52:07.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.060+0000 7fa423726800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28.0 2024-09-12T00:52:07.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.062+0000 7fa423726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:07.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.062+0000 7fa423726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 2024-09-12T00:52:07.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.064+0000 7fa423726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 info.flags=0x17 2024-09-12T00:52:07.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.064+0000 7fa423726800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 to cache LRU end 2024-09-12T00:52:07.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.064+0000 7fa423726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:07.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.064+0000 7fa423726800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28, ofs0, ns] 2024-09-12T00:52:07.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.064+0000 7fa302ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431661 cookie 94152140316944 notifier 6644 bl.length()=915 2024-09-12T00:52:07.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.064+0000 7fa302ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 info.flags=0x17 2024-09-12T00:52:07.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.064+0000 7fa302ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 to cache LRU end 2024-09-12T00:52:07.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.064+0000 7fa302ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:07.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.066+0000 7fa423726800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): orig_sources= new_sources= 2024-09-12T00:52:07.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.066+0000 7fa423726800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): potential sources added=[] removed=[] 2024-09-12T00:52:07.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.066+0000 7fa423726800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): orig_dests= new_dests= 2024-09-12T00:52:07.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.066+0000 7fa423726800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): potential dests added=[] removed=[] 2024-09-12T00:52:07.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.066+0000 7fa423726800 -1 Injecting error=-5 at location=block_writes 2024-09-12T00:52:07.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.066+0000 7fa423726800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:52:07.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.068+0000 7fa423726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:07.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.068+0000 7fa423726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 2024-09-12T00:52:07.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.069+0000 7fa423726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 info.flags=0x17 2024-09-12T00:52:07.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.069+0000 7fa423726800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 to cache LRU end 2024-09-12T00:52:07.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.069+0000 7fa423726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:07.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.069+0000 7fa423726800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28, ofs0, ns] 2024-09-12T00:52:07.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.070+0000 7fa302ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431662 cookie 94152140316944 notifier 6644 bl.length()=883 2024-09-12T00:52:07.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.070+0000 7fa302ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 info.flags=0x17 2024-09-12T00:52:07.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.070+0000 7fa302ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 to cache LRU end 2024-09-12T00:52:07.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.070+0000 7fa302ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:07.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.072+0000 7fa423726800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): orig_sources= new_sources= 2024-09-12T00:52:07.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.072+0000 7fa423726800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): potential sources added=[] removed=[] 2024-09-12T00:52:07.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.072+0000 7fa423726800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): orig_dests= new_dests= 2024-09-12T00:52:07.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.072+0000 7fa423726800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): potential dests added=[] removed=[] 2024-09-12T00:52:07.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.073+0000 7fa423726800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T00:52:07.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.075+0000 7fa2d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:07.076 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.077+0000 7fa423726800 20 remove_watcher() i=0 2024-09-12T00:52:07.076 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.077+0000 7fa423726800 2 removed watcher, disabling cache 2024-09-12T00:52:07.077 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.079+0000 7fa423726800 20 remove_watcher() i=1 2024-09-12T00:52:07.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.080+0000 7fa423726800 20 remove_watcher() i=2 2024-09-12T00:52:07.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.081+0000 7fa423726800 20 remove_watcher() i=3 2024-09-12T00:52:07.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.082+0000 7fa423726800 20 remove_watcher() i=4 2024-09-12T00:52:07.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.083+0000 7fa423726800 20 remove_watcher() i=5 2024-09-12T00:52:07.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.084+0000 7fa423726800 20 remove_watcher() i=6 2024-09-12T00:52:07.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.085+0000 7fa423726800 20 remove_watcher() i=7 2024-09-12T00:52:07.096 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:52:07.125 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:07.126 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:07.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.166+0000 7f4220144800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.167+0000 7f4220144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:07.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.167+0000 7f4220144800 20 realm 2024-09-12T00:52:07.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.167+0000 7f4220144800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.168+0000 7f4220144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:07.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.168+0000 7f4220144800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:07.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.168+0000 7f4220144800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.168+0000 7f4220144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:07.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.168+0000 7f4220144800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.168+0000 7f4220144800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:07.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.169+0000 7f4220144800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.169+0000 7f4220144800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:07.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.169+0000 7f4220144800 20 searching for the correct realm 2024-09-12T00:52:07.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.172+0000 7f421b6f3640 0 -- 172.21.15.62:0/4139715059 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f421407ffe0 msgr2=0x7f421405c900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:07.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.377+0000 7f421bef4640 0 -- 172.21.15.62:0/4139715059 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f421409dbc0 msgr2=0x7f421404ced0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:07.584 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.584+0000 7f4220144800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:07.584 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.584+0000 7f4220144800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:07.584 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.584+0000 7f4220144800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:07.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.584+0000 7f4220144800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:07.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.584+0000 7f4220144800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:07.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.584+0000 7f4220144800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:07.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.584+0000 7f4220144800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.585+0000 7f4220144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:07.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.585+0000 7f4220144800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.585+0000 7f4220144800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:07.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.585+0000 7f4220144800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.585+0000 7f4220144800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:07.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.585+0000 7f4220144800 20 zone default found 2024-09-12T00:52:07.586 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.585+0000 7f4220144800 4 Realm: () 2024-09-12T00:52:07.586 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.585+0000 7f4220144800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:07.586 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.585+0000 7f4220144800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:07.586 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.585+0000 7f4220144800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:07.586 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.585+0000 7f4220144800 20 zonegroup default 2024-09-12T00:52:07.586 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.585+0000 7f4220144800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.585+0000 7f4220144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:07.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.586+0000 7f4220144800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.586+0000 7f4220144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:07.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.586+0000 7f4220144800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.588 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.586+0000 7f4220144800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:07.588 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.586+0000 7f4220144800 20 started sync module instance, tier type = 2024-09-12T00:52:07.588 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.586+0000 7f4220144800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:07.595 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.596+0000 7f4220144800 20 add_watcher() i=0 2024-09-12T00:52:07.595 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.596+0000 7f4220144800 20 add_watcher() i=1 2024-09-12T00:52:07.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.596+0000 7f4220144800 20 add_watcher() i=2 2024-09-12T00:52:07.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.596+0000 7f4220144800 20 add_watcher() i=3 2024-09-12T00:52:07.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.596+0000 7f4220144800 20 add_watcher() i=4 2024-09-12T00:52:07.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.596+0000 7f4220144800 20 add_watcher() i=5 2024-09-12T00:52:07.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.597+0000 7f4220144800 20 add_watcher() i=6 2024-09-12T00:52:07.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.598+0000 7f4220144800 20 add_watcher() i=7 2024-09-12T00:52:07.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.598+0000 7f4220144800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:07.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.600+0000 7f40d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:07.599 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.600+0000 7f4220144800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:07.599 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.600+0000 7f4220144800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:07.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.600+0000 7f4220144800 5 note: GC not initialized 2024-09-12T00:52:07.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.600+0000 7f40d0fe1640 20 reqs_thread_entry: start 2024-09-12T00:52:07.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.600+0000 7f4220144800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:07.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.600+0000 7f4220144800 20 Filter name: none 2024-09-12T00:52:07.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.601+0000 7f404a7fc640 20 reqs_thread_entry: start 2024-09-12T00:52:07.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.601+0000 7f4220144800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.601 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.601+0000 7f4220144800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:07.601 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.601+0000 7f4220144800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.601 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.601+0000 7f4220144800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:52:07.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.601+0000 7f4220144800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:07.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.601+0000 7f4220144800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.602+0000 7f4220144800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:07.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.602+0000 7f4220144800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.602+0000 7f4220144800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:52:07.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.602+0000 7f4220144800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:07.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.603+0000 7f40d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:07.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.606+0000 7f4220144800 20 remove_watcher() i=0 2024-09-12T00:52:07.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.606+0000 7f4220144800 2 removed watcher, disabling cache 2024-09-12T00:52:07.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.607+0000 7f4220144800 20 remove_watcher() i=1 2024-09-12T00:52:07.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.608+0000 7f4220144800 20 remove_watcher() i=2 2024-09-12T00:52:07.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.609+0000 7f4220144800 20 remove_watcher() i=3 2024-09-12T00:52:07.609 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.610+0000 7f4220144800 20 remove_watcher() i=4 2024-09-12T00:52:07.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.611+0000 7f4220144800 20 remove_watcher() i=5 2024-09-12T00:52:07.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.613+0000 7f4220144800 20 remove_watcher() i=6 2024-09-12T00:52:07.612 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.614+0000 7f4220144800 20 remove_watcher() i=7 2024-09-12T00:52:07.624 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:07.624 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:52:07.624 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-block-writes id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:52:07.624 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:07.720 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:52:07.752 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:07.752 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:07.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.793+0000 7f6487698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.794+0000 7f6487698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:07.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.794+0000 7f6487698800 20 realm 2024-09-12T00:52:07.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.794+0000 7f6487698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.794+0000 7f6487698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:07.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.794+0000 7f6487698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:07.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.794+0000 7f6487698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.794+0000 7f6487698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:07.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.794+0000 7f6487698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.795+0000 7f6487698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:07.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.795+0000 7f6487698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:07.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.796+0000 7f6487698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:07.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.796+0000 7f6487698800 20 searching for the correct realm 2024-09-12T00:52:07.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:07.800+0000 7f6484981640 0 -- 172.21.15.62:0/3810086362 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f6480030410 msgr2=0x7f6480030890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:08.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.006+0000 7f6485983640 0 -- 172.21.15.62:0/3810086362 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x56149d6f1e50 msgr2=0x56149d6f42c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:08.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.010+0000 7f6487698800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:08.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.010+0000 7f6487698800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:08.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.010+0000 7f6487698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:08.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.010+0000 7f6487698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:08.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.010+0000 7f6487698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:08.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.010+0000 7f6487698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:08.010 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.010+0000 7f6487698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.011+0000 7f6487698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:08.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.011+0000 7f6487698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.011+0000 7f6487698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:08.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.011+0000 7f6487698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.011+0000 7f6487698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:08.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.011+0000 7f6487698800 20 zone default found 2024-09-12T00:52:08.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.011+0000 7f6487698800 4 Realm: () 2024-09-12T00:52:08.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.011+0000 7f6487698800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:08.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.011+0000 7f6487698800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:08.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.011+0000 7f6487698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:08.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.011+0000 7f6487698800 20 zonegroup default 2024-09-12T00:52:08.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.011+0000 7f6487698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.012+0000 7f6487698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:08.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.012+0000 7f6487698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.012+0000 7f6487698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:08.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.012+0000 7f6487698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.012+0000 7f6487698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:08.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.012+0000 7f6487698800 20 started sync module instance, tier type = 2024-09-12T00:52:08.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.012+0000 7f6487698800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:08.021 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.022+0000 7f6487698800 20 add_watcher() i=0 2024-09-12T00:52:08.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.022+0000 7f6487698800 20 add_watcher() i=1 2024-09-12T00:52:08.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.022+0000 7f6487698800 20 add_watcher() i=2 2024-09-12T00:52:08.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.022+0000 7f6487698800 20 add_watcher() i=3 2024-09-12T00:52:08.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.022+0000 7f6487698800 20 add_watcher() i=4 2024-09-12T00:52:08.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.022+0000 7f6487698800 20 add_watcher() i=5 2024-09-12T00:52:08.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.022+0000 7f6487698800 20 add_watcher() i=6 2024-09-12T00:52:08.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.023+0000 7f6487698800 20 add_watcher() i=7 2024-09-12T00:52:08.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.023+0000 7f6487698800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:08.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.025+0000 7f633bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:08.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.025+0000 7f6487698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:08.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.025+0000 7f6487698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:08.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.025+0000 7f6487698800 5 note: GC not initialized 2024-09-12T00:52:08.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.026+0000 7f633afe5640 20 reqs_thread_entry: start 2024-09-12T00:52:08.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.026+0000 7f6487698800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:08.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.026+0000 7f6487698800 20 Filter name: none 2024-09-12T00:52:08.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.026+0000 7f6338fe1640 20 reqs_thread_entry: start 2024-09-12T00:52:08.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.026+0000 7f6487698800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:52:08.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.026+0000 7f6487698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.026+0000 7f6487698800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:08.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.026+0000 7f6487698800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:52:08.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.026+0000 7f6487698800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:52:08.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.026+0000 7f6487698800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 : miss 2024-09-12T00:52:08.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.026+0000 7f6487698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.027+0000 7f6487698800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:52:08.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.027+0000 7f6487698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 info.flags=0x17 2024-09-12T00:52:08.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.027+0000 7f6487698800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 to cache LRU end 2024-09-12T00:52:08.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.027+0000 7f6487698800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:08.028 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.027+0000 7f6487698800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:08.028 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.027+0000 7f6487698800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 2024-09-12T00:52:08.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.030+0000 7f6487698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 info.flags=0x17 2024-09-12T00:52:08.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.030+0000 7f6487698800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 to cache LRU end 2024-09-12T00:52:08.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.030+0000 7f6487698800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:08.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.030+0000 7f6487698800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28, ofs0, ns] 2024-09-12T00:52:08.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.031+0000 7f6368ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431663 cookie 94646540714768 notifier 7035 bl.length()=915 2024-09-12T00:52:08.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.031+0000 7f6368ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 info.flags=0x17 2024-09-12T00:52:08.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.031+0000 7f6368ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 to cache LRU end 2024-09-12T00:52:08.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.031+0000 7f6368ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:08.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.033+0000 7f6487698800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): orig_sources= new_sources= 2024-09-12T00:52:08.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.033+0000 7f6487698800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): potential sources added=[] removed=[] 2024-09-12T00:52:08.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.033+0000 7f6487698800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): orig_dests= new_dests= 2024-09-12T00:52:08.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.033+0000 7f6487698800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): potential dests added=[] removed=[] 2024-09-12T00:52:08.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.035+0000 7f6487698800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28.1.0 2024-09-12T00:52:08.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.035+0000 7f6487698800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28.1.0 2024-09-12T00:52:08.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.035+0000 7f6487698800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28.1.1 2024-09-12T00:52:08.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.035+0000 7f6487698800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28.1.1 2024-09-12T00:52:08.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.035+0000 7f6487698800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28.0 2024-09-12T00:52:08.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.037+0000 7f6487698800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:08.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.037+0000 7f6487698800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 2024-09-12T00:52:08.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.039+0000 7f6487698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 info.flags=0x17 2024-09-12T00:52:08.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.039+0000 7f6487698800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 to cache LRU end 2024-09-12T00:52:08.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.039+0000 7f6487698800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:08.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.039+0000 7f6487698800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28, ofs0, ns] 2024-09-12T00:52:08.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.039+0000 7f6368ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431664 cookie 94646540714768 notifier 7035 bl.length()=915 2024-09-12T00:52:08.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.039+0000 7f6368ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 info.flags=0x17 2024-09-12T00:52:08.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.039+0000 7f6368ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 to cache LRU end 2024-09-12T00:52:08.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.039+0000 7f6368ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:08.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.041+0000 7f6487698800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): orig_sources= new_sources= 2024-09-12T00:52:08.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.041+0000 7f6487698800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): potential sources added=[] removed=[] 2024-09-12T00:52:08.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.041+0000 7f6487698800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): orig_dests= new_dests= 2024-09-12T00:52:08.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.041+0000 7f6487698800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): potential dests added=[] removed=[] 2024-09-12T00:52:08.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.042+0000 7f6487698800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28.0 2024-09-12T00:52:08.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.042+0000 7f6487698800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:08.041 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.042+0000 7f6487698800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 2024-09-12T00:52:08.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.043+0000 7f6487698800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 info.flags=0x17 2024-09-12T00:52:08.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.043+0000 7f6487698800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 to cache LRU end 2024-09-12T00:52:08.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.043+0000 7f6487698800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:08.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.043+0000 7f6487698800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28, ofs0, ns] 2024-09-12T00:52:08.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.044+0000 7f6368ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431665 cookie 94646540714768 notifier 7035 bl.length()=883 2024-09-12T00:52:08.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.044+0000 7f6368ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 info.flags=0x17 2024-09-12T00:52:08.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.044+0000 7f6368ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 to cache LRU end 2024-09-12T00:52:08.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.044+0000 7f6368ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:08.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.046+0000 7f6487698800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): orig_sources= new_sources= 2024-09-12T00:52:08.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.046+0000 7f6487698800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): potential sources added=[] removed=[] 2024-09-12T00:52:08.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.046+0000 7f6487698800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): orig_dests= new_dests= 2024-09-12T00:52:08.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.046+0000 7f6487698800 20 handle_bi_update(): bucket=:error-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28]): potential dests added=[] removed=[] 2024-09-12T00:52:08.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.047+0000 7f6487698800 1 execute INFO: reshard of bucket "error-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:52:08.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.049+0000 7f633bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:08.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.051+0000 7f6487698800 20 remove_watcher() i=0 2024-09-12T00:52:08.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.051+0000 7f6487698800 2 removed watcher, disabling cache 2024-09-12T00:52:08.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.053+0000 7f6487698800 20 remove_watcher() i=1 2024-09-12T00:52:08.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.054+0000 7f6487698800 20 remove_watcher() i=2 2024-09-12T00:52:08.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.055+0000 7f6487698800 20 remove_watcher() i=3 2024-09-12T00:52:08.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.056+0000 7f6487698800 20 remove_watcher() i=4 2024-09-12T00:52:08.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.057+0000 7f6487698800 20 remove_watcher() i=5 2024-09-12T00:52:08.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.058+0000 7f6487698800 20 remove_watcher() i=6 2024-09-12T00:52:08.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.059+0000 7f6487698800 20 remove_watcher() i=7 2024-09-12T00:52:08.071 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:52:08.101 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:08.101 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:08.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.140+0000 7f7cc0b42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.142 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.143+0000 7f7cc0b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:08.142 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.143+0000 7f7cc0b42800 20 realm 2024-09-12T00:52:08.142 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.143+0000 7f7cc0b42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.142 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.143+0000 7f7cc0b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:08.142 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.143+0000 7f7cc0b42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:08.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.143+0000 7f7cc0b42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.143+0000 7f7cc0b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:08.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.143+0000 7f7cc0b42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.144+0000 7f7cc0b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:08.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.144+0000 7f7cc0b42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.144+0000 7f7cc0b42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:08.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.145+0000 7f7cc0b42800 20 searching for the correct realm 2024-09-12T00:52:08.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.148+0000 7f7cb7fff640 0 -- 172.21.15.62:0/11951127 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f7cb8017020 msgr2=0x7f7cb8026930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:08.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.353+0000 7f7cbd0ee640 0 -- 172.21.15.62:0/11951127 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5585777a8850 msgr2=0x5585777aacc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:08.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.357+0000 7f7cc0b42800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:08.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.357+0000 7f7cc0b42800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:08.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.357+0000 7f7cc0b42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:08.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.357+0000 7f7cc0b42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:08.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.357+0000 7f7cc0b42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:08.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.357+0000 7f7cc0b42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:08.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.357+0000 7f7cc0b42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.357+0000 7f7cc0b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:08.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.357+0000 7f7cc0b42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.357+0000 7f7cc0b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:08.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.357+0000 7f7cc0b42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.358+0000 7f7cc0b42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:08.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.358+0000 7f7cc0b42800 20 zone default found 2024-09-12T00:52:08.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.358+0000 7f7cc0b42800 4 Realm: () 2024-09-12T00:52:08.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.358+0000 7f7cc0b42800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:08.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.358+0000 7f7cc0b42800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:08.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.358+0000 7f7cc0b42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:08.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.358+0000 7f7cc0b42800 20 zonegroup default 2024-09-12T00:52:08.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.358+0000 7f7cc0b42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.358+0000 7f7cc0b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:08.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.358+0000 7f7cc0b42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.358+0000 7f7cc0b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:08.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.358+0000 7f7cc0b42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.359+0000 7f7cc0b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:08.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.359+0000 7f7cc0b42800 20 started sync module instance, tier type = 2024-09-12T00:52:08.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.359+0000 7f7cc0b42800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:08.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.368+0000 7f7cc0b42800 20 add_watcher() i=0 2024-09-12T00:52:08.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.368+0000 7f7cc0b42800 20 add_watcher() i=1 2024-09-12T00:52:08.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.368+0000 7f7cc0b42800 20 add_watcher() i=2 2024-09-12T00:52:08.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.368+0000 7f7cc0b42800 20 add_watcher() i=3 2024-09-12T00:52:08.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.368+0000 7f7cc0b42800 20 add_watcher() i=4 2024-09-12T00:52:08.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.368+0000 7f7cc0b42800 20 add_watcher() i=5 2024-09-12T00:52:08.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.368+0000 7f7cc0b42800 20 add_watcher() i=6 2024-09-12T00:52:08.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.369+0000 7f7cc0b42800 20 add_watcher() i=7 2024-09-12T00:52:08.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.369+0000 7f7cc0b42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:08.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.371+0000 7f7b72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:08.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.371+0000 7f7cc0b42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:08.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.371+0000 7f7cc0b42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:08.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.371+0000 7f7cc0b42800 5 note: GC not initialized 2024-09-12T00:52:08.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.372+0000 7f7b71fe3640 20 reqs_thread_entry: start 2024-09-12T00:52:08.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.372+0000 7f7cc0b42800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:08.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.372+0000 7f7cc0b42800 20 Filter name: none 2024-09-12T00:52:08.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.372+0000 7f7ae37fe640 20 reqs_thread_entry: start 2024-09-12T00:52:08.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.372+0000 7f7cc0b42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.372+0000 7f7cc0b42800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:08.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.372+0000 7f7cc0b42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.373+0000 7f7cc0b42800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:52:08.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.373+0000 7f7cc0b42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:08.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.373+0000 7f7cc0b42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.373+0000 7f7cc0b42800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:08.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.373+0000 7f7cc0b42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:08.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.374+0000 7f7cc0b42800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:52:08.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.374+0000 7f7cc0b42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:08.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.375+0000 7f7b72fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:08.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.378+0000 7f7cc0b42800 20 remove_watcher() i=0 2024-09-12T00:52:08.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.378+0000 7f7cc0b42800 2 removed watcher, disabling cache 2024-09-12T00:52:08.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.379+0000 7f7cc0b42800 20 remove_watcher() i=1 2024-09-12T00:52:08.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.380+0000 7f7cc0b42800 20 remove_watcher() i=2 2024-09-12T00:52:08.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.381+0000 7f7cc0b42800 20 remove_watcher() i=3 2024-09-12T00:52:08.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.382+0000 7f7cc0b42800 20 remove_watcher() i=4 2024-09-12T00:52:08.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.383+0000 7f7cc0b42800 20 remove_watcher() i=5 2024-09-12T00:52:08.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.384+0000 7f7cc0b42800 20 remove_watcher() i=6 2024-09-12T00:52:08.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:08.385+0000 7f7cc0b42800 20 remove_watcher() i=7 2024-09-12T00:52:08.395 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:08.395 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:52:08.395 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-block-writes id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:52:08.395 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:08.710 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T00:52:08.711 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:09.569 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:52:09.598 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:09.599 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:09.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.638+0000 7feeddb35800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.639+0000 7feeddb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.639+0000 7feeddb35800 20 realm 2024-09-12T00:52:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.639+0000 7feeddb35800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.639+0000 7feeddb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.639+0000 7feeddb35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.639+0000 7feeddb35800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.640+0000 7feeddb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.640+0000 7feeddb35800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.640+0000 7feeddb35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.640+0000 7feeddb35800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.641+0000 7feeddb35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:09.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.641+0000 7feeddb35800 20 searching for the correct realm 2024-09-12T00:52:09.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.644+0000 7feed90e3640 0 -- 172.21.15.62:0/3660030882 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7feed4036430 msgr2=0x7feed40368b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:09.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.848+0000 7feeda0e5640 0 -- 172.21.15.62:0/3660030882 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x56351f2ebed0 msgr2=0x56351f2ee390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:09.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.852+0000 7feeddb35800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:09.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.852+0000 7feeddb35800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:09.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.852+0000 7feeddb35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:09.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.852+0000 7feeddb35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:09.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.852+0000 7feeddb35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:09.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.852+0000 7feeddb35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:09.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.852+0000 7feeddb35800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.853+0000 7feeddb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:09.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.853+0000 7feeddb35800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.853+0000 7feeddb35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:09.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.853+0000 7feeddb35800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.853+0000 7feeddb35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:09.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.853+0000 7feeddb35800 20 zone default found 2024-09-12T00:52:09.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.853+0000 7feeddb35800 4 Realm: () 2024-09-12T00:52:09.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.853+0000 7feeddb35800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:09.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.853+0000 7feeddb35800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:09.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.853+0000 7feeddb35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:09.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.853+0000 7feeddb35800 20 zonegroup default 2024-09-12T00:52:09.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.853+0000 7feeddb35800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.853+0000 7feeddb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:09.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.853+0000 7feeddb35800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.854+0000 7feeddb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:09.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.854+0000 7feeddb35800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.854+0000 7feeddb35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:09.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.854+0000 7feeddb35800 20 started sync module instance, tier type = 2024-09-12T00:52:09.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.854+0000 7feeddb35800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.863+0000 7feeddb35800 20 add_watcher() i=0 2024-09-12T00:52:09.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.863+0000 7feeddb35800 20 add_watcher() i=1 2024-09-12T00:52:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.863+0000 7feeddb35800 20 add_watcher() i=2 2024-09-12T00:52:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.863+0000 7feeddb35800 20 add_watcher() i=3 2024-09-12T00:52:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.863+0000 7feeddb35800 20 add_watcher() i=4 2024-09-12T00:52:09.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.863+0000 7feeddb35800 20 add_watcher() i=5 2024-09-12T00:52:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.863+0000 7feeddb35800 20 add_watcher() i=6 2024-09-12T00:52:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.864+0000 7feeddb35800 20 add_watcher() i=7 2024-09-12T00:52:09.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.864+0000 7feeddb35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.866+0000 7fed8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.866+0000 7feeddb35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.866+0000 7feeddb35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.866+0000 7feeddb35800 5 note: GC not initialized 2024-09-12T00:52:09.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.866+0000 7fed8a7fc640 20 reqs_thread_entry: start 2024-09-12T00:52:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.867+0000 7feeddb35800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.867+0000 7feeddb35800 20 Filter name: none 2024-09-12T00:52:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.867+0000 7fecfbfff640 20 reqs_thread_entry: start 2024-09-12T00:52:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.867+0000 7feeddb35800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.867+0000 7feeddb35800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.867+0000 7feeddb35800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.868+0000 7feeddb35800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:52:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.868+0000 7feeddb35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.868+0000 7feeddb35800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.868+0000 7feeddb35800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:09.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.868+0000 7feeddb35800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.869+0000 7feeddb35800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:52:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.869+0000 7feeddb35800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:09.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.870+0000 7fed8b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:09.871 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.872+0000 7feeddb35800 20 remove_watcher() i=0 2024-09-12T00:52:09.871 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.872+0000 7feeddb35800 2 removed watcher, disabling cache 2024-09-12T00:52:09.872 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.873+0000 7feeddb35800 20 remove_watcher() i=1 2024-09-12T00:52:09.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.874+0000 7feeddb35800 20 remove_watcher() i=2 2024-09-12T00:52:09.874 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.875+0000 7feeddb35800 20 remove_watcher() i=3 2024-09-12T00:52:09.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.876+0000 7feeddb35800 20 remove_watcher() i=4 2024-09-12T00:52:09.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.877+0000 7feeddb35800 20 remove_watcher() i=5 2024-09-12T00:52:09.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.878+0000 7feeddb35800 20 remove_watcher() i=6 2024-09-12T00:52:09.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.879+0000 7feeddb35800 20 remove_watcher() i=7 2024-09-12T00:52:09.889 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:09.889 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:52:09.889 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-block-writes id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:52:09.890 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:09.890 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T00:52:09.925 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:09.925 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:09.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.965+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:09.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.967+0000 7f5edcd42800 20 realm 2024-09-12T00:52:09.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.967+0000 7f5edcd42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.968+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:09.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.968+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.969+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:09.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.969+0000 7f5edcd42800 20 searching for the correct realm 2024-09-12T00:52:09.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:09.971+0000 7f5ed8285640 0 -- 172.21.15.62:0/3692361991 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f5ed006e490 msgr2=0x7f5ed009b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:10.175 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.176+0000 7f5ed9287640 0 -- 172.21.15.62:0/3692361991 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55992ce65ec0 msgr2=0x55992ce68350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:10.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.180+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.180+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.180 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.180+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.180+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.181+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.181+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.181+0000 7f5edcd42800 20 zone default found 2024-09-12T00:52:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.181+0000 7f5edcd42800 4 Realm: () 2024-09-12T00:52:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.181+0000 7f5edcd42800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.181+0000 7f5edcd42800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.181+0000 7f5edcd42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.181+0000 7f5edcd42800 20 zonegroup default 2024-09-12T00:52:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.181+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.182+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.182+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.182+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.182+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.182+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.182+0000 7f5edcd42800 20 started sync module instance, tier type = 2024-09-12T00:52:10.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.182+0000 7f5edcd42800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=0 2024-09-12T00:52:10.189 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=1 2024-09-12T00:52:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=2 2024-09-12T00:52:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=3 2024-09-12T00:52:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=4 2024-09-12T00:52:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=5 2024-09-12T00:52:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=6 2024-09-12T00:52:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.191+0000 7f5edcd42800 20 add_watcher() i=7 2024-09-12T00:52:10.190 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.191+0000 7f5edcd42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:10.192 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.193+0000 7f5d8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:10.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.193+0000 7f5edcd42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:10.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.193+0000 7f5edcd42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:10.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.193+0000 7f5edcd42800 5 note: GC not initialized 2024-09-12T00:52:10.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.193+0000 7f5d8dfe3640 20 reqs_thread_entry: start 2024-09-12T00:52:10.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.194+0000 7f5edcd42800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:10.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.194+0000 7f5edcd42800 20 Filter name: none 2024-09-12T00:52:10.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.194+0000 7f5cff7fe640 20 reqs_thread_entry: start 2024-09-12T00:52:10.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.194+0000 7f5edcd42800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:52:10.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.194+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.194+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:10.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.194+0000 7f5edcd42800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:52:10.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.194+0000 7f5edcd42800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:52:10.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.194+0000 7f5edcd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 : miss 2024-09-12T00:52:10.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.194+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.195+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:52:10.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.195+0000 7f5edcd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.195+0000 7f5edcd42800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.195+0000 7f5edcd42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:10.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.195+0000 7f5edcd42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.195+0000 7f5edcd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 2024-09-12T00:52:10.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.198+0000 7f5edcd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.198+0000 7f5edcd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.198+0000 7f5edcd42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.198+0000 7f5edcd42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29, ofs0, ns] 2024-09-12T00:52:10.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.199+0000 7f5daffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431668 cookie 94116371732240 notifier 7089 bl.length()=915 2024-09-12T00:52:10.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.199+0000 7f5daffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.199+0000 7f5daffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.199+0000 7f5daffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.200 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.201+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_sources= new_sources= 2024-09-12T00:52:10.200 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.201+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential sources added=[] removed=[] 2024-09-12T00:52:10.200 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.201+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_dests= new_dests= 2024-09-12T00:52:10.200 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.201+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential dests added=[] removed=[] 2024-09-12T00:52:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.203+0000 7f5edcd42800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.1.0 2024-09-12T00:52:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.203+0000 7f5edcd42800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.1.0 2024-09-12T00:52:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.203+0000 7f5edcd42800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.1.1 2024-09-12T00:52:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.203+0000 7f5edcd42800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.1.1 2024-09-12T00:52:10.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.203+0000 7f5edcd42800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.0 2024-09-12T00:52:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.205+0000 7f5edcd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:10.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.205+0000 7f5edcd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 2024-09-12T00:52:10.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.206+0000 7f5edcd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.206+0000 7f5edcd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.206+0000 7f5edcd42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.206+0000 7f5edcd42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29, ofs0, ns] 2024-09-12T00:52:10.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.206+0000 7f5daffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431669 cookie 94116371732240 notifier 7089 bl.length()=915 2024-09-12T00:52:10.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.206+0000 7f5daffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.207+0000 7f5daffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.207+0000 7f5daffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.208+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_sources= new_sources= 2024-09-12T00:52:10.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.208+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential sources added=[] removed=[] 2024-09-12T00:52:10.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.208+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_dests= new_dests= 2024-09-12T00:52:10.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.208+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential dests added=[] removed=[] 2024-09-12T00:52:10.207 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5edcd42800 time 2024-09-12T00:52:10.209435+0000 2024-09-12T00:52:10.207 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:10.208 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:10.208 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5ede58c71a] 2024-09-12T00:52:10.208 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5ede58c8d8] 2024-09-12T00:52:10.208 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992aeb7641] 2024-09-12T00:52:10.208 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55992aec6582] 2024-09-12T00:52:10.208 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992aec73e4] 2024-09-12T00:52:10.208 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:52:10.208 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5edd229590] 2024-09-12T00:52:10.209 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:52:10.209 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:52:10.209 INFO:tasks.workunit.client.0.smithi062.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:52:10.209 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f5edcd42800 thread_name:radosgw-admin 2024-09-12T00:52:10.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.209+0000 7f5edcd42800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5edcd42800 time 2024-09-12T00:52:10.209435+0000 2024-09-12T00:52:10.209 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:10.209 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.210 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:10.210 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5ede58c71a] 2024-09-12T00:52:10.210 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5ede58c8d8] 2024-09-12T00:52:10.210 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992aeb7641] 2024-09-12T00:52:10.210 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55992aec6582] 2024-09-12T00:52:10.210 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992aec73e4] 2024-09-12T00:52:10.210 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:52:10.210 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5edd229590] 2024-09-12T00:52:10.210 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:52:10.210 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:52:10.210 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.231 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:10.231 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5edd23e6f0] 2024-09-12T00:52:10.231 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5edd28b99c] 2024-09-12T00:52:10.231 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:52:10.231 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:52:10.231 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5ede58c774] 2024-09-12T00:52:10.231 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5ede58c8d8] 2024-09-12T00:52:10.231 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992aeb7641] 2024-09-12T00:52:10.232 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55992aec6582] 2024-09-12T00:52:10.232 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992aec73e4] 2024-09-12T00:52:10.232 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:52:10.232 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5edd229590] 2024-09-12T00:52:10.232 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:52:10.232 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:52:10.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.210+0000 7f5edcd42800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:10.232 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f5edcd42800 thread_name:radosgw-admin 2024-09-12T00:52:10.232 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.232 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:10.232 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5edd23e6f0] 2024-09-12T00:52:10.232 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5edd28b99c] 2024-09-12T00:52:10.233 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:52:10.233 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:52:10.233 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5ede58c774] 2024-09-12T00:52:10.233 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5ede58c8d8] 2024-09-12T00:52:10.233 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992aeb7641] 2024-09-12T00:52:10.233 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55992aec6582] 2024-09-12T00:52:10.233 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992aec73e4] 2024-09-12T00:52:10.233 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:52:10.233 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5edd229590] 2024-09-12T00:52:10.233 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:52:10.233 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:52:10.233 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:10.233 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.234 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:52:10.234 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:52:09.948+0000 7f5edcd42800 5 AuthRegistry(0x55992cd806d0) adding con mode: crc 2024-09-12T00:52:10.234 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:52:09.948+0000 7f5edcd42800 5 AuthRegistry(0x55992cd806d0) adding con mode: secure 2024-09-12T00:52:10.234 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:52:09.948+0000 7f5edcd42800 5 AuthRegistry(0x55992cd806d0) adding con mode: crc 2024-09-12T00:52:10.234 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:52:09.948+0000 7f5edcd42800 5 AuthRegistry(0x55992cd806d0) adding con mode: secure 2024-09-12T00:52:10.234 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:52:09.949+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.234 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:52:09.949+0000 7f5edcd42800 1 librados: starting msgr at 2024-09-12T00:52:10.234 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:52:09.949+0000 7f5edcd42800 1 librados: starting objecter 2024-09-12T00:52:10.234 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command objecter_requests hook 0x55992cd7e340 2024-09-12T00:52:10.234 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:52:09.949+0000 7f5edcd42800 1 librados: setting wanted keys 2024-09-12T00:52:10.234 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:52:09.949+0000 7f5edcd42800 1 librados: calling monclient init 2024-09-12T00:52:10.234 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient: init 2024-09-12T00:52:10.234 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding auth protocol: cephx 2024-09-12T00:52:10.235 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding auth protocol: cephx 2024-09-12T00:52:10.235 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding auth protocol: cephx 2024-09-12T00:52:10.235 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: secure 2024-09-12T00:52:10.235 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: crc 2024-09-12T00:52:10.235 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: secure 2024-09-12T00:52:10.235 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: crc 2024-09-12T00:52:10.235 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: secure 2024-09-12T00:52:10.235 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: crc 2024-09-12T00:52:10.235 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: crc 2024-09-12T00:52:10.235 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: secure 2024-09-12T00:52:10.235 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: crc 2024-09-12T00:52:10.235 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: secure 2024-09-12T00:52:10.235 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: crc 2024-09-12T00:52:10.235 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: secure 2024-09-12T00:52:10.236 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:52:09.949+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.236 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:52:09.949+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.236 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command rotate-key hook 0x55992cd7ac08 2024-09-12T00:52:10.236 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:10.236 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:52:10.236 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-c con 0x55992cc28610 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:10.236 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-a con 0x55992cc2f9b0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:10.236 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-b con 0x55992cc32da0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:10.236 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.236 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.236 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.237 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:10.237 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): authenticate will time out at 2016.442880s 2024-09-12T00:52:10.237 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request con 0x55992cc28610 auth_method 0 2024-09-12T00:52:10.237 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.237 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.237 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.237 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:52:09.950+0000 7f5ed8285640 10 monclient(hunting): get_auth_request con 0x55992cc2f9b0 auth_method 0 2024-09-12T00:52:10.237 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:52:09.950+0000 7f5ed8285640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.237 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:52:09.950+0000 7f5ed8285640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.237 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:52:09.950+0000 7f5ed8285640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.237 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:52:09.950+0000 7f5ed9287640 10 monclient(hunting): get_auth_request con 0x55992cc32da0 auth_method 0 2024-09-12T00:52:10.237 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:52:09.950+0000 7f5ed9287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.238 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:52:09.950+0000 7f5ed9287640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.238 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:52:09.950+0000 7f5ed9287640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.238 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.238 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.238 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.238 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:52:09.950+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.238 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:52:09.950+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.238 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:52:09.950+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.238 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:52:09.950+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.238 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:52:09.950+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.238 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:52:09.950+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.238 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_done global_id 6722 payload 824 2024-09-12T00:52:10.238 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient: _finish_hunting 0 2024-09-12T00:52:10.239 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 1 monclient: found mon.noname-c 2024-09-12T00:52:10.239 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:52:10.239 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.239 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:52:10.239 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: dump: 2024-09-12T00:52:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.239 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.240 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.240 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: _finish_auth 0 2024-09-12T00:52:10.240 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: _check_auth_tickets 2024-09-12T00:52:10.240 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:10.240 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.240 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:52:10.240 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: dump: 2024-09-12T00:52:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.240 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.241 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.241 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.241 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:52:09.950+0000 7f5edcd42800 5 monclient: authenticate success, global_id 6722 2024-09-12T00:52:10.241 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:52:09.950+0000 7f5edcd42800 10 monclient: _renew_subs 2024-09-12T00:52:10.241 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:52:09.950+0000 7f5edcd42800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:52:10.241 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:52:09.950+0000 7f5dc6e0d640 4 set_mon_vals no callback set 2024-09-12T00:52:10.241 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:52:09.950+0000 7f5edcd42800 10 monclient: _renew_subs 2024-09-12T00:52:10.241 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:52:09.950+0000 7f5edcd42800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:52:10.241 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:52:09.950+0000 7f5edcd42800 1 librados: init done 2024-09-12T00:52:10.242 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:52:09.952+0000 7f5dc560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:10.242 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:52:09.952+0000 7f5dc560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:10.242 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:52:09.952+0000 7f5dc560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:10.242 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:52:09.952+0000 7f5ed8285640 10 monclient: get_auth_request con 0x7f5dc0076470 auth_method 0 2024-09-12T00:52:10.242 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:52:09.953+0000 7f5ed9287640 10 monclient: get_auth_request con 0x55992cda3210 auth_method 0 2024-09-12T00:52:10.242 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:52:09.953+0000 7f5ed8a86640 10 monclient: get_auth_request con 0x55992cdc6320 auth_method 0 2024-09-12T00:52:10.242 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:52:09.954+0000 7f5ed8285640 10 monclient: get_auth_request con 0x55992cdca6d0 auth_method 0 2024-09-12T00:52:10.242 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:52:09.955+0000 7f5edcd42800 10 monclient: build_initial_monmap 2024-09-12T00:52:10.242 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:52:09.955+0000 7f5edcd42800 1 build_initial for_mkfs: 0 2024-09-12T00:52:10.242 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:52:09.955+0000 7f5edcd42800 10 monclient: monmap: 2024-09-12T00:52:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:52:10.242 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:52:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:52:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:52:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:52:10.243 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:52:10.243 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.243 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding auth protocol: cephx 2024-09-12T00:52:10.243 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding auth protocol: cephx 2024-09-12T00:52:10.243 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding auth protocol: cephx 2024-09-12T00:52:10.243 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: secure 2024-09-12T00:52:10.243 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: crc 2024-09-12T00:52:10.244 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: secure 2024-09-12T00:52:10.244 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: crc 2024-09-12T00:52:10.244 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: secure 2024-09-12T00:52:10.244 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: crc 2024-09-12T00:52:10.244 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: crc 2024-09-12T00:52:10.244 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: secure 2024-09-12T00:52:10.244 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: crc 2024-09-12T00:52:10.244 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: secure 2024-09-12T00:52:10.244 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: crc 2024-09-12T00:52:10.244 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: secure 2024-09-12T00:52:10.244 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:52:09.956+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.244 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command objecter_requests cmddesc objecter_requests hook 0x55992cdd2f20 EEXIST 2024-09-12T00:52:10.245 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient: init 2024-09-12T00:52:10.245 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding auth protocol: cephx 2024-09-12T00:52:10.245 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding auth protocol: cephx 2024-09-12T00:52:10.245 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding auth protocol: cephx 2024-09-12T00:52:10.245 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: secure 2024-09-12T00:52:10.245 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: crc 2024-09-12T00:52:10.245 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: secure 2024-09-12T00:52:10.245 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: crc 2024-09-12T00:52:10.245 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: secure 2024-09-12T00:52:10.245 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: crc 2024-09-12T00:52:10.245 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: crc 2024-09-12T00:52:10.245 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: secure 2024-09-12T00:52:10.245 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: crc 2024-09-12T00:52:10.246 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: secure 2024-09-12T00:52:10.246 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: crc 2024-09-12T00:52:10.246 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: secure 2024-09-12T00:52:10.246 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:52:09.956+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.246 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:52:09.956+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.246 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command rotate-key cmddesc rotate-key hook 0x55992cdcdd90 EEXIST 2024-09-12T00:52:10.246 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:10.246 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:10.246 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-b con 0x55992cdf6c10 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:10.246 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-c con 0x55992cdf8ee0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:10.246 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-a con 0x55992cdf53e0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:10.246 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.246 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.246 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.246 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:10.247 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): authenticate will time out at 2016.449805s 2024-09-12T00:52:10.247 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:52:09.956+0000 7f5ed9287640 10 monclient(hunting): get_auth_request con 0x55992cdf53e0 auth_method 0 2024-09-12T00:52:10.247 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:52:09.956+0000 7f5ed9287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.247 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:52:09.956+0000 7f5ed9287640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.247 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:52:09.956+0000 7f5ed9287640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.247 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:52:09.956+0000 7f5ed8285640 10 monclient(hunting): get_auth_request con 0x55992cdf8ee0 auth_method 0 2024-09-12T00:52:10.247 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:52:09.956+0000 7f5ed8285640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.247 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:52:09.956+0000 7f5ed8285640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.247 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:52:09.956+0000 7f5ed8285640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.247 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:52:09.956+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request con 0x55992cdf6c10 auth_method 0 2024-09-12T00:52:10.247 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:52:09.956+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.247 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:52:09.956+0000 7f5ed8a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.247 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:52:09.956+0000 7f5ed8a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.248 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:52:09.957+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.248 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:52:09.957+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.248 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:52:09.957+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.248 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:52:09.957+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.248 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:52:09.957+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.248 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:52:09.957+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.248 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:52:09.957+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.248 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:52:09.957+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.248 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:52:09.957+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.248 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:52:09.957+0000 7f5ed9287640 10 monclient(hunting): handle_auth_done global_id 7083 payload 824 2024-09-12T00:52:10.248 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:52:09.957+0000 7f5ed9287640 10 monclient: _finish_hunting 0 2024-09-12T00:52:10.248 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:52:09.957+0000 7f5ed9287640 1 monclient: found mon.noname-a 2024-09-12T00:52:10.249 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:52:09.957+0000 7f5ed9287640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:52:10.249 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.249 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:10.249 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: dump: 2024-09-12T00:52:10.249 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.249 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.249 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.249 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.249 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.249 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.249 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.249 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.250 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.250 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.250 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: _finish_auth 0 2024-09-12T00:52:10.250 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:52:10.250 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:10.250 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.250 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:10.250 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: dump: 2024-09-12T00:52:10.250 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.250 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.250 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.250 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.250 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.251 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.251 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.251 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.251 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.251 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.251 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:52:09.957+0000 7f5edcd42800 5 monclient: authenticate success, global_id 7083 2024-09-12T00:52:10.251 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:52:09.957+0000 7f5edcd42800 10 monclient: _renew_subs 2024-09-12T00:52:10.251 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:52:09.957+0000 7f5ed9a88640 4 set_mon_vals no callback set 2024-09-12T00:52:10.251 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:52:09.957+0000 7f5edcd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:10.251 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:52:09.957+0000 7f5edcd42800 10 monclient: _renew_subs 2024-09-12T00:52:10.251 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:52:09.957+0000 7f5edcd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:10.251 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:52:09.959+0000 7f5dbe7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:10.251 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:52:09.959+0000 7f5dbe7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:10.251 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:52:09.959+0000 7f5dbe7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:10.252 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:52:09.959+0000 7f5ed8a86640 10 monclient: get_auth_request con 0x7f5db0076380 auth_method 0 2024-09-12T00:52:10.252 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:52:09.959+0000 7f5edcd42800 10 monclient: get_monmap_and_config 2024-09-12T00:52:10.252 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:52:09.959+0000 7f5edcd42800 10 monclient: build_initial_monmap 2024-09-12T00:52:10.252 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:52:09.959+0000 7f5edcd42800 1 build_initial for_mkfs: 0 2024-09-12T00:52:10.252 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:52:09.959+0000 7f5edcd42800 10 monclient: monmap: 2024-09-12T00:52:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:52:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:52:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:52:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:52:10.252 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:52:10.253 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:52:10.253 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.253 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding auth protocol: cephx 2024-09-12T00:52:10.253 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding auth protocol: cephx 2024-09-12T00:52:10.253 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding auth protocol: cephx 2024-09-12T00:52:10.253 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: secure 2024-09-12T00:52:10.253 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: crc 2024-09-12T00:52:10.253 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: secure 2024-09-12T00:52:10.253 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: crc 2024-09-12T00:52:10.253 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: secure 2024-09-12T00:52:10.253 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: crc 2024-09-12T00:52:10.253 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: crc 2024-09-12T00:52:10.253 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: secure 2024-09-12T00:52:10.254 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: crc 2024-09-12T00:52:10.254 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: secure 2024-09-12T00:52:10.254 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: crc 2024-09-12T00:52:10.254 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: secure 2024-09-12T00:52:10.254 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:52:09.960+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.254 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient: init 2024-09-12T00:52:10.254 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding auth protocol: cephx 2024-09-12T00:52:10.254 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding auth protocol: cephx 2024-09-12T00:52:10.254 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding auth protocol: cephx 2024-09-12T00:52:10.254 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: secure 2024-09-12T00:52:10.254 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: crc 2024-09-12T00:52:10.254 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: secure 2024-09-12T00:52:10.255 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: crc 2024-09-12T00:52:10.255 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: secure 2024-09-12T00:52:10.255 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: crc 2024-09-12T00:52:10.255 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: crc 2024-09-12T00:52:10.255 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: secure 2024-09-12T00:52:10.255 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: crc 2024-09-12T00:52:10.255 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: secure 2024-09-12T00:52:10.255 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: crc 2024-09-12T00:52:10.255 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: secure 2024-09-12T00:52:10.255 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:52:09.960+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.255 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:52:09.960+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.255 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command rotate-key cmddesc rotate-key hook 0x7ffe8d2e00e8 EEXIST 2024-09-12T00:52:10.255 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:10.255 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:10.255 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-b con 0x55992ce1a940 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:10.256 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-c con 0x55992ce45330 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:10.256 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-a con 0x55992ce1bcd0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:10.256 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.256 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.256 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.256 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:10.256 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): authenticate will time out at 2016.453976s 2024-09-12T00:52:10.256 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): get_auth_request con 0x55992ce45330 auth_method 0 2024-09-12T00:52:10.256 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.256 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.256 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.256 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:52:09.961+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request con 0x55992ce1a940 auth_method 0 2024-09-12T00:52:10.256 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:52:09.961+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.257 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:52:09.961+0000 7f5ed8a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.257 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:52:09.961+0000 7f5ed8a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.257 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:52:09.961+0000 7f5ed9287640 10 monclient(hunting): get_auth_request con 0x55992ce1bcd0 auth_method 0 2024-09-12T00:52:10.257 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:52:09.961+0000 7f5ed9287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.257 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:52:09.961+0000 7f5ed9287640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.257 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:52:09.961+0000 7f5ed9287640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.257 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.257 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.257 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.257 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:52:09.961+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.257 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:52:09.961+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.257 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:52:09.961+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.258 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:52:09.961+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.258 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:52:09.961+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.258 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:52:09.961+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.258 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): handle_auth_done global_id 6728 payload 274 2024-09-12T00:52:10.258 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient: _finish_hunting 0 2024-09-12T00:52:10.258 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:52:09.961+0000 7f5ed8285640 1 monclient: found mon.noname-c 2024-09-12T00:52:10.258 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:52:10.258 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.258 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:52:10.258 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: dump: 2024-09-12T00:52:10.258 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.258 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.258 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.258 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.259 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.259 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.259 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.259 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.259 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.259 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.259 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: _finish_auth 0 2024-09-12T00:52:10.259 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: _check_auth_tickets 2024-09-12T00:52:10.259 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:10.259 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.259 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:52:10.259 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: dump: 2024-09-12T00:52:10.259 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.259 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.259 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.260 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.260 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.260 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.260 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.260 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.260 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.260 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.260 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:52:09.961+0000 7f5edcd42800 5 monclient: authenticate success, global_id 6728 2024-09-12T00:52:10.260 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:52:09.961+0000 7f5edcd42800 10 monclient: get_monmap_and_config success 2024-09-12T00:52:10.260 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:52:09.961+0000 7f5edcd42800 4 set_mon_vals no callback set 2024-09-12T00:52:10.260 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:52:09.962+0000 7f5edcd42800 10 monclient: shutdown 2024-09-12T00:52:10.260 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:52:09.962+0000 7f5edcd42800 10 monclient: build_initial_monmap 2024-09-12T00:52:10.260 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:52:09.962+0000 7f5edcd42800 1 build_initial for_mkfs: 0 2024-09-12T00:52:10.261 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:52:09.962+0000 7f5edcd42800 10 monclient: monmap: 2024-09-12T00:52:10.261 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:52:10.261 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:10.261 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:52:10.261 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:52:10.261 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:10.261 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.261 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:52:10.261 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:52:10.261 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:52:10.261 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.261 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding auth protocol: cephx 2024-09-12T00:52:10.261 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding auth protocol: cephx 2024-09-12T00:52:10.261 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding auth protocol: cephx 2024-09-12T00:52:10.262 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: secure 2024-09-12T00:52:10.262 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: crc 2024-09-12T00:52:10.262 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: secure 2024-09-12T00:52:10.262 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: crc 2024-09-12T00:52:10.262 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: secure 2024-09-12T00:52:10.262 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: crc 2024-09-12T00:52:10.262 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: crc 2024-09-12T00:52:10.262 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: secure 2024-09-12T00:52:10.262 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: crc 2024-09-12T00:52:10.262 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: secure 2024-09-12T00:52:10.262 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: crc 2024-09-12T00:52:10.262 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: secure 2024-09-12T00:52:10.262 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:52:09.962+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.262 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:52:09.962+0000 7f5edcd42800 1 librados: starting msgr at 2024-09-12T00:52:10.263 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:52:09.962+0000 7f5edcd42800 1 librados: starting objecter 2024-09-12T00:52:10.263 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command objecter_requests cmddesc objecter_requests hook 0x55992ce3cea0 EEXIST 2024-09-12T00:52:10.263 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:52:09.962+0000 7f5edcd42800 1 librados: setting wanted keys 2024-09-12T00:52:10.263 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:52:09.962+0000 7f5edcd42800 1 librados: calling monclient init 2024-09-12T00:52:10.263 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:52:09.962+0000 7f5edcd42800 10 monclient: init 2024-09-12T00:52:10.263 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding auth protocol: cephx 2024-09-12T00:52:10.263 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding auth protocol: cephx 2024-09-12T00:52:10.263 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding auth protocol: cephx 2024-09-12T00:52:10.263 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: secure 2024-09-12T00:52:10.263 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: crc 2024-09-12T00:52:10.263 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: secure 2024-09-12T00:52:10.263 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: crc 2024-09-12T00:52:10.263 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: secure 2024-09-12T00:52:10.263 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: crc 2024-09-12T00:52:10.263 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: crc 2024-09-12T00:52:10.264 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: secure 2024-09-12T00:52:10.264 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: crc 2024-09-12T00:52:10.264 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: secure 2024-09-12T00:52:10.264 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: crc 2024-09-12T00:52:10.264 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: secure 2024-09-12T00:52:10.264 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:52:09.963+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.264 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:52:09.963+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.264 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:52:09.963+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command rotate-key cmddesc rotate-key hook 0x55992ce0eb08 EEXIST 2024-09-12T00:52:10.264 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:10.264 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:52:10.264 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-a con 0x55992ce1a940 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:10.264 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-c con 0x55992ce3b630 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:10.264 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-b con 0x55992ce375a0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:10.265 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.265 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.265 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.265 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:10.265 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): authenticate will time out at 2016.456348s 2024-09-12T00:52:10.265 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request con 0x55992ce1a940 auth_method 0 2024-09-12T00:52:10.265 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.265 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.265 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.265 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:52:09.963+0000 7f5ed8285640 10 monclient(hunting): get_auth_request con 0x55992ce3b630 auth_method 0 2024-09-12T00:52:10.265 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:52:09.963+0000 7f5ed8285640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.265 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:52:09.963+0000 7f5ed8285640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.266 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:52:09.963+0000 7f5ed8285640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.266 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.266 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.266 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.266 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:52:09.963+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.266 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:52:09.963+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.266 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:52:09.963+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.266 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_done global_id 7089 payload 824 2024-09-12T00:52:10.266 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient: _finish_hunting 0 2024-09-12T00:52:10.266 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 1 monclient: found mon.noname-a 2024-09-12T00:52:10.266 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:52:10.266 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.266 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:10.266 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: dump: 2024-09-12T00:52:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.267 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.267 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.267 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: _finish_auth 0 2024-09-12T00:52:10.267 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:52:10.267 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:10.267 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.268 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:10.268 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: dump: 2024-09-12T00:52:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.268 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.268 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.268 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:52:09.963+0000 7f5edcd42800 5 monclient: authenticate success, global_id 7089 2024-09-12T00:52:10.268 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:52:09.964+0000 7f5edcd42800 10 monclient: _renew_subs 2024-09-12T00:52:10.269 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:52:09.964+0000 7f5edcd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:10.269 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:52:09.963+0000 7f5daffff640 4 set_mon_vals no callback set 2024-09-12T00:52:10.269 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:52:09.964+0000 7f5edcd42800 10 monclient: _renew_subs 2024-09-12T00:52:10.269 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:52:09.964+0000 7f5edcd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:10.269 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:52:09.964+0000 7f5edcd42800 1 librados: init done 2024-09-12T00:52:10.269 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:52:09.964+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command cr dump hook 0x55992ce555b8 2024-09-12T00:52:10.269 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:52:09.965+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.269 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:52:09.966+0000 7f5dae7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:10.272 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:52:09.966+0000 7f5dae7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:10.272 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:52:09.966+0000 7f5dae7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:10.272 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:52:09.966+0000 7f5ed8285640 10 monclient: get_auth_request con 0x7f5da4076470 auth_method 0 2024-09-12T00:52:10.272 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:52:09.966+0000 7f5ed9287640 10 monclient: get_auth_request con 0x55992ce65ec0 auth_method 0 2024-09-12T00:52:10.272 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.273 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:52:09.967+0000 7f5edcd42800 20 realm 2024-09-12T00:52:10.273 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.273 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.273 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:52:09.967+0000 7f5edcd42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:10.273 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.273 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.273 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.273 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:52:09.967+0000 7f5ed8a86640 10 monclient: get_auth_request con 0x55992ce6a1f0 auth_method 0 2024-09-12T00:52:10.273 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:52:09.968+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:10.273 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:52:09.968+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.273 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:52:09.968+0000 7f5ed8285640 10 monclient: get_auth_request con 0x55992ce6d930 auth_method 0 2024-09-12T00:52:10.273 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:52:09.969+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:10.273 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:52:09.969+0000 7f5edcd42800 20 searching for the correct realm 2024-09-12T00:52:10.273 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:52:09.969+0000 7f5ed9287640 10 monclient: get_auth_request con 0x55992ce726f0 auth_method 0 2024-09-12T00:52:10.274 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:52:09.970+0000 7f5ed8a86640 10 monclient: get_auth_request con 0x7f5ed00659a0 auth_method 0 2024-09-12T00:52:10.274 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:52:09.971+0000 7f5ed8285640 10 monclient: get_auth_request con 0x7f5ed006e490 auth_method 0 2024-09-12T00:52:10.274 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:52:09.971+0000 7f5ed8285640 0 -- 172.21.15.62:0/3692361991 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f5ed006e490 msgr2=0x7f5ed009b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:10.274 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:52:10.172+0000 7f5ed8285640 10 monclient: get_auth_request con 0x7f5ed006e490 auth_method 0 2024-09-12T00:52:10.274 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:52:10.174+0000 7f5ed9287640 10 monclient: get_auth_request con 0x7f5ec804d180 auth_method 0 2024-09-12T00:52:10.274 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:52:10.175+0000 7f5ed8a86640 10 monclient: get_auth_request con 0x7f5ed0001b30 auth_method 0 2024-09-12T00:52:10.274 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:52:10.176+0000 7f5ed9287640 0 -- 172.21.15.62:0/3692361991 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55992ce65ec0 msgr2=0x55992ce68350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:10.274 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:52:10.176+0000 7f5dae7fc640 1 client.7089.objecter ms_handle_reset 0x55992ce65ec0 session 0x55992ce657b0 osd.6 2024-09-12T00:52:10.274 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:52:10.176+0000 7f5dae7fc640 10 monclient: _renew_subs 2024-09-12T00:52:10.274 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:52:10.176+0000 7f5dae7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:10.274 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:52:10.176+0000 7f5ed9287640 10 monclient: get_auth_request con 0x7f5da4086720 auth_method 0 2024-09-12T00:52:10.274 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:10.274 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:10.275 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:10.275 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:10.275 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:10.275 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:10.275 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.275 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.275 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.275 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:10.275 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:52:10.181+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.275 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:52:10.181+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:10.275 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:52:10.181+0000 7f5edcd42800 20 zone default found 2024-09-12T00:52:10.275 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:52:10.181+0000 7f5edcd42800 4 Realm: () 2024-09-12T00:52:10.275 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:52:10.181+0000 7f5edcd42800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:10.276 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:52:10.181+0000 7f5edcd42800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:10.276 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:52:10.181+0000 7f5edcd42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:10.276 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:52:10.181+0000 7f5edcd42800 20 zonegroup default 2024-09-12T00:52:10.276 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:52:10.181+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.276 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:52:10.182+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.276 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:52:10.182+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.276 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:52:10.182+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.276 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:52:10.182+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.276 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:52:10.182+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.276 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:52:10.182+0000 7f5edcd42800 20 started sync module instance, tier type = 2024-09-12T00:52:10.276 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:52:10.182+0000 7f5edcd42800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:10.276 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=0 2024-09-12T00:52:10.277 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=1 2024-09-12T00:52:10.277 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=2 2024-09-12T00:52:10.277 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=3 2024-09-12T00:52:10.277 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=4 2024-09-12T00:52:10.277 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=5 2024-09-12T00:52:10.277 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=6 2024-09-12T00:52:10.277 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:52:10.191+0000 7f5edcd42800 20 add_watcher() i=7 2024-09-12T00:52:10.277 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:52:10.191+0000 7f5edcd42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:10.277 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding auth protocol: cephx 2024-09-12T00:52:10.277 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding auth protocol: cephx 2024-09-12T00:52:10.277 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding auth protocol: cephx 2024-09-12T00:52:10.277 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: secure 2024-09-12T00:52:10.277 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: crc 2024-09-12T00:52:10.278 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: secure 2024-09-12T00:52:10.278 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: crc 2024-09-12T00:52:10.278 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: secure 2024-09-12T00:52:10.278 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: crc 2024-09-12T00:52:10.278 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: crc 2024-09-12T00:52:10.278 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: secure 2024-09-12T00:52:10.278 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: crc 2024-09-12T00:52:10.278 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: secure 2024-09-12T00:52:10.278 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: crc 2024-09-12T00:52:10.278 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: secure 2024-09-12T00:52:10.278 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:52:10.193+0000 7f5d8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:10.278 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:52:10.193+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.278 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:52:10.193+0000 7f5edcd42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:10.278 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:52:10.193+0000 7f5edcd42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:10.279 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command cache list hook 0x55992ce37980 2024-09-12T00:52:10.279 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command cache inspect hook 0x55992ce37980 2024-09-12T00:52:10.279 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command cache erase hook 0x55992ce37980 2024-09-12T00:52:10.279 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command cache zap hook 0x55992ce37980 2024-09-12T00:52:10.279 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 note: GC not initialized 2024-09-12T00:52:10.279 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:52:10.193+0000 7f5d8dfe3640 20 reqs_thread_entry: start 2024-09-12T00:52:10.279 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:52:10.194+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command sync trace show hook 0x7f5ecc0674d0 2024-09-12T00:52:10.279 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:52:10.194+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command sync trace history hook 0x7f5ecc0674d0 2024-09-12T00:52:10.279 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:52:10.194+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command sync trace active hook 0x7f5ecc0674d0 2024-09-12T00:52:10.279 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:52:10.194+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command sync trace active_short hook 0x7f5ecc0674d0 2024-09-12T00:52:10.279 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:52:10.194+0000 7f5edcd42800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:10.279 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:52:10.194+0000 7f5edcd42800 20 Filter name: none 2024-09-12T00:52:10.279 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:52:10.194+0000 7f5cff7fe640 20 reqs_thread_entry: start 2024-09-12T00:52:10.280 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:52:10.194+0000 7f5edcd42800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:52:10.280 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:52:10.194+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.280 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:52:10.194+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:10.280 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:52:10.194+0000 7f5edcd42800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:52:10.280 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:52:10.194+0000 7f5edcd42800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:52:10.280 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:52:10.194+0000 7f5edcd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 : miss 2024-09-12T00:52:10.280 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:52:10.194+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.280 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:52:10.195+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:52:10.280 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:52:10.195+0000 7f5edcd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.280 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:52:10.195+0000 7f5edcd42800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.280 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:52:10.195+0000 7f5edcd42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:10.280 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:52:10.195+0000 7f5edcd42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.280 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:52:10.195+0000 7f5edcd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 2024-09-12T00:52:10.280 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:52:10.198+0000 7f5edcd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.281 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:52:10.198+0000 7f5edcd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.281 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:52:10.198+0000 7f5edcd42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.281 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:52:10.198+0000 7f5edcd42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29, ofs0, ns] 2024-09-12T00:52:10.281 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:52:10.199+0000 7f5daffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431668 cookie 94116371732240 notifier 7089 bl.length()=915 2024-09-12T00:52:10.281 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:52:10.199+0000 7f5daffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.281 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:52:10.199+0000 7f5daffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.281 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:52:10.199+0000 7f5daffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.281 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:52:10.201+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_sources= new_sources= 2024-09-12T00:52:10.281 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:52:10.201+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential sources added=[] removed=[] 2024-09-12T00:52:10.281 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:52:10.201+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_dests= new_dests= 2024-09-12T00:52:10.281 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:52:10.201+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential dests added=[] removed=[] 2024-09-12T00:52:10.282 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:52:10.203+0000 7f5edcd42800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.1.0 2024-09-12T00:52:10.282 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:52:10.203+0000 7f5edcd42800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.1.0 2024-09-12T00:52:10.282 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:52:10.203+0000 7f5edcd42800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.1.1 2024-09-12T00:52:10.282 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:52:10.203+0000 7f5edcd42800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.1.1 2024-09-12T00:52:10.282 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:52:10.203+0000 7f5edcd42800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.0 2024-09-12T00:52:10.282 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:52:10.205+0000 7f5edcd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:10.282 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:52:10.205+0000 7f5edcd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 2024-09-12T00:52:10.282 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:52:10.206+0000 7f5edcd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.282 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:52:10.206+0000 7f5edcd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.282 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:52:10.206+0000 7f5edcd42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.282 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:52:10.206+0000 7f5edcd42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29, ofs0, ns] 2024-09-12T00:52:10.282 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:52:10.206+0000 7f5daffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431669 cookie 94116371732240 notifier 7089 bl.length()=915 2024-09-12T00:52:10.282 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:52:10.206+0000 7f5daffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.283 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:52:10.207+0000 7f5daffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.283 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:52:10.207+0000 7f5daffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.283 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:52:10.208+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_sources= new_sources= 2024-09-12T00:52:10.283 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:52:10.208+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential sources added=[] removed=[] 2024-09-12T00:52:10.283 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:52:10.208+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_dests= new_dests= 2024-09-12T00:52:10.283 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:52:10.208+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential dests added=[] removed=[] 2024-09-12T00:52:10.283 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:52:10.209+0000 7f5edcd42800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5edcd42800 time 2024-09-12T00:52:10.209435+0000 2024-09-12T00:52:10.283 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:10.283 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.283 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:10.283 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5ede58c71a] 2024-09-12T00:52:10.283 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5ede58c8d8] 2024-09-12T00:52:10.283 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992aeb7641] 2024-09-12T00:52:10.284 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55992aec6582] 2024-09-12T00:52:10.284 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992aec73e4] 2024-09-12T00:52:10.284 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:52:10.284 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5edd229590] 2024-09-12T00:52:10.284 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:52:10.284 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:52:10.284 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.284 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:52:10.210+0000 7f5edcd42800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:10.284 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f5edcd42800 thread_name:radosgw-admin 2024-09-12T00:52:10.284 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.284 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:10.284 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5edd23e6f0] 2024-09-12T00:52:10.284 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5edd28b99c] 2024-09-12T00:52:10.285 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:52:10.285 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:52:10.285 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5ede58c774] 2024-09-12T00:52:10.285 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5ede58c8d8] 2024-09-12T00:52:10.285 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992aeb7641] 2024-09-12T00:52:10.285 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55992aec6582] 2024-09-12T00:52:10.285 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992aec73e4] 2024-09-12T00:52:10.285 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:52:10.285 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5edd229590] 2024-09-12T00:52:10.285 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:52:10.285 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:52:10.286 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:10.286 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.286 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:52:10.286 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:52:10.286 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:52:10.286 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:52:10.286 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:52:10.286 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:52:10.286 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:52:10.286 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:52:10.286 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:52:10.286 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:52:10.286 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:52:10.287 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:52:10.287 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:52:10.287 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:52:10.287 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:52:10.287 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:52:10.287 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:52:10.287 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:52:10.287 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:52:10.287 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:52:10.287 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:52:10.287 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:52:10.287 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:52:10.287 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:52:10.288 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:52:10.288 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:52:10.288 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:52:10.288 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:52:10.288 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:52:10.288 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:52:10.288 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:52:10.288 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:52:10.288 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:52:10.288 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:52:10.288 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:52:10.288 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:52:10.288 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:52:10.289 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:52:10.289 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:52:10.289 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:52:10.289 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:52:10.289 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:52:10.289 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:52:10.289 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:52:10.289 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:52:10.289 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:52:10.289 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:52:10.289 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:52:10.289 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:52:10.289 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:52:10.290 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:52:10.290 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:52:10.290 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:52:10.290 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:52:10.290 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:52:10.290 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:52:10.290 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:52:10.290 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:52:10.290 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:52:10.290 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:52:10.290 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:52:10.290 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:52:10.290 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:52:10.290 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:52:10.290 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:52:10.291 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:52:10.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:52:10.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:52:10.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:52:10.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:52:10.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:52:10.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:52:10.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:52:10.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:52:10.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:52:10.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:52:10.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:52:10.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:52:10.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:52:10.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:52:10.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:52:10.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:52:10.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:52:10.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:52:10.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:52:10.292 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:52:10.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:52:10.292 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:52:10.292 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:52:10.292 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:52:10.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:52:10.292 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:52:10.293 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:52:10.293 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:52:10.293 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5cff7fe640 / http_manager 2024-09-12T00:52:10.293 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5d8dfe3640 / http_manager 2024-09-12T00:52:10.293 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5d8efe5640 / rgw_dt_lg_renew 2024-09-12T00:52:10.293 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5dae7fc640 / ms_dispatch 2024-09-12T00:52:10.293 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5daffff640 / io_context_pool 2024-09-12T00:52:10.293 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5dbe7fc640 / ms_dispatch 2024-09-12T00:52:10.293 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5dc560a640 / ms_dispatch 2024-09-12T00:52:10.293 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5dc6e0d640 / io_context_pool 2024-09-12T00:52:10.293 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5ed8285640 / msgr-worker-2 2024-09-12T00:52:10.293 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5ed8a86640 / msgr-worker-1 2024-09-12T00:52:10.293 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5ed9287640 / msgr-worker-0 2024-09-12T00:52:10.293 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5ed9a88640 / io_context_pool 2024-09-12T00:52:10.294 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5edcd42800 / radosgw-admin 2024-09-12T00:52:10.294 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:52:10.294 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:52:10.294 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/log/ceph/ceph-client.admin.113399.log 2024-09-12T00:52:10.294 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:52:10.294 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:52:10.294 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:52:09.948+0000 7f5edcd42800 5 AuthRegistry(0x55992cd806d0) adding con mode: crc 2024-09-12T00:52:10.294 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:52:09.948+0000 7f5edcd42800 5 AuthRegistry(0x55992cd806d0) adding con mode: secure 2024-09-12T00:52:10.294 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:52:09.948+0000 7f5edcd42800 5 AuthRegistry(0x55992cd806d0) adding con mode: crc 2024-09-12T00:52:10.294 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:52:09.948+0000 7f5edcd42800 5 AuthRegistry(0x55992cd806d0) adding con mode: secure 2024-09-12T00:52:10.294 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:52:09.949+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.294 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:52:09.949+0000 7f5edcd42800 1 librados: starting msgr at 2024-09-12T00:52:10.294 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:52:09.949+0000 7f5edcd42800 1 librados: starting objecter 2024-09-12T00:52:10.295 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command objecter_requests hook 0x55992cd7e340 2024-09-12T00:52:10.295 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:52:09.949+0000 7f5edcd42800 1 librados: setting wanted keys 2024-09-12T00:52:10.295 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:52:09.949+0000 7f5edcd42800 1 librados: calling monclient init 2024-09-12T00:52:10.295 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient: init 2024-09-12T00:52:10.295 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding auth protocol: cephx 2024-09-12T00:52:10.295 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding auth protocol: cephx 2024-09-12T00:52:10.295 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding auth protocol: cephx 2024-09-12T00:52:10.295 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: secure 2024-09-12T00:52:10.295 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: crc 2024-09-12T00:52:10.295 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: secure 2024-09-12T00:52:10.295 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: crc 2024-09-12T00:52:10.295 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: secure 2024-09-12T00:52:10.295 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: crc 2024-09-12T00:52:10.296 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: crc 2024-09-12T00:52:10.296 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: secure 2024-09-12T00:52:10.296 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: crc 2024-09-12T00:52:10.296 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: secure 2024-09-12T00:52:10.296 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: crc 2024-09-12T00:52:10.296 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 AuthRegistry(0x55992cd7aac0) adding con mode: secure 2024-09-12T00:52:10.296 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:52:09.949+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.296 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:52:09.949+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.296 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:52:09.949+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command rotate-key hook 0x55992cd7ac08 2024-09-12T00:52:10.296 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:10.296 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:52:10.296 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-c con 0x55992cc28610 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:10.297 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-a con 0x55992cc2f9b0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:10.297 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-b con 0x55992cc32da0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:10.297 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.297 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.297 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.297 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:10.297 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:52:09.949+0000 7f5edcd42800 10 monclient(hunting): authenticate will time out at 2016.442880s 2024-09-12T00:52:10.297 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request con 0x55992cc28610 auth_method 0 2024-09-12T00:52:10.297 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.297 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.297 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.297 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:52:09.950+0000 7f5ed8285640 10 monclient(hunting): get_auth_request con 0x55992cc2f9b0 auth_method 0 2024-09-12T00:52:10.297 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:52:09.950+0000 7f5ed8285640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.298 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:52:09.950+0000 7f5ed8285640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.298 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:52:09.950+0000 7f5ed8285640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.298 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:52:09.950+0000 7f5ed9287640 10 monclient(hunting): get_auth_request con 0x55992cc32da0 auth_method 0 2024-09-12T00:52:10.298 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:52:09.950+0000 7f5ed9287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.298 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:52:09.950+0000 7f5ed9287640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.298 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:52:09.950+0000 7f5ed9287640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.298 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.298 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.298 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.298 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:52:09.950+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.298 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:52:09.950+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.298 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:52:09.950+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.298 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:52:09.950+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.299 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:52:09.950+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.299 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:52:09.950+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.299 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_done global_id 6722 payload 824 2024-09-12T00:52:10.299 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient: _finish_hunting 0 2024-09-12T00:52:10.299 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 1 monclient: found mon.noname-c 2024-09-12T00:52:10.299 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:52:09.950+0000 7f5ed8a86640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:52:10.299 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.299 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:52:10.299 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: dump: 2024-09-12T00:52:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.299 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.300 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.300 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.300 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: _finish_auth 0 2024-09-12T00:52:10.300 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: _check_auth_tickets 2024-09-12T00:52:10.300 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:10.300 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.300 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:52:10.300 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:52:09.950+0000 7f5dc560a640 10 monclient: dump: 2024-09-12T00:52:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.301 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.301 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.301 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:52:09.950+0000 7f5edcd42800 5 monclient: authenticate success, global_id 6722 2024-09-12T00:52:10.301 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:52:09.950+0000 7f5edcd42800 10 monclient: _renew_subs 2024-09-12T00:52:10.301 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:52:09.950+0000 7f5edcd42800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:52:10.302 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:52:09.950+0000 7f5dc6e0d640 4 set_mon_vals no callback set 2024-09-12T00:52:10.302 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:52:09.950+0000 7f5edcd42800 10 monclient: _renew_subs 2024-09-12T00:52:10.302 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:52:09.950+0000 7f5edcd42800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:52:10.302 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:52:09.950+0000 7f5edcd42800 1 librados: init done 2024-09-12T00:52:10.302 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:52:09.952+0000 7f5dc560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:10.302 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:52:09.952+0000 7f5dc560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:10.302 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:52:09.952+0000 7f5dc560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:10.302 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:52:09.952+0000 7f5ed8285640 10 monclient: get_auth_request con 0x7f5dc0076470 auth_method 0 2024-09-12T00:52:10.302 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:52:09.953+0000 7f5ed9287640 10 monclient: get_auth_request con 0x55992cda3210 auth_method 0 2024-09-12T00:52:10.302 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:52:09.953+0000 7f5ed8a86640 10 monclient: get_auth_request con 0x55992cdc6320 auth_method 0 2024-09-12T00:52:10.302 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:52:09.954+0000 7f5ed8285640 10 monclient: get_auth_request con 0x55992cdca6d0 auth_method 0 2024-09-12T00:52:10.302 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:52:09.955+0000 7f5edcd42800 10 monclient: build_initial_monmap 2024-09-12T00:52:10.303 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:52:09.955+0000 7f5edcd42800 1 build_initial for_mkfs: 0 2024-09-12T00:52:10.303 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:52:09.955+0000 7f5edcd42800 10 monclient: monmap: 2024-09-12T00:52:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:52:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:52:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:52:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:52:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:52:10.303 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:52:10.303 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.303 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding auth protocol: cephx 2024-09-12T00:52:10.304 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding auth protocol: cephx 2024-09-12T00:52:10.304 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding auth protocol: cephx 2024-09-12T00:52:10.304 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: secure 2024-09-12T00:52:10.304 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: crc 2024-09-12T00:52:10.304 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: secure 2024-09-12T00:52:10.304 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: crc 2024-09-12T00:52:10.304 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: secure 2024-09-12T00:52:10.304 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: crc 2024-09-12T00:52:10.304 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: crc 2024-09-12T00:52:10.304 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: secure 2024-09-12T00:52:10.304 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: crc 2024-09-12T00:52:10.304 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: secure 2024-09-12T00:52:10.305 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: crc 2024-09-12T00:52:10.305 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:52:09.955+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcf4d0) adding con mode: secure 2024-09-12T00:52:10.305 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:52:09.956+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.305 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command objecter_requests cmddesc objecter_requests hook 0x55992cdd2f20 EEXIST 2024-09-12T00:52:10.305 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient: init 2024-09-12T00:52:10.305 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding auth protocol: cephx 2024-09-12T00:52:10.305 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding auth protocol: cephx 2024-09-12T00:52:10.305 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding auth protocol: cephx 2024-09-12T00:52:10.305 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: secure 2024-09-12T00:52:10.305 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: crc 2024-09-12T00:52:10.305 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: secure 2024-09-12T00:52:10.305 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: crc 2024-09-12T00:52:10.305 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: secure 2024-09-12T00:52:10.306 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: crc 2024-09-12T00:52:10.306 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: crc 2024-09-12T00:52:10.306 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: secure 2024-09-12T00:52:10.306 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: crc 2024-09-12T00:52:10.306 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: secure 2024-09-12T00:52:10.306 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: crc 2024-09-12T00:52:10.306 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 AuthRegistry(0x55992cdcdc48) adding con mode: secure 2024-09-12T00:52:10.306 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:52:09.956+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.306 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:52:09.956+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.306 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:52:09.956+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command rotate-key cmddesc rotate-key hook 0x55992cdcdd90 EEXIST 2024-09-12T00:52:10.306 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:10.306 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:10.307 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-b con 0x55992cdf6c10 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:10.307 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-c con 0x55992cdf8ee0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:10.307 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-a con 0x55992cdf53e0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:10.307 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.307 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.307 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.307 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:10.307 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:52:09.956+0000 7f5edcd42800 10 monclient(hunting): authenticate will time out at 2016.449805s 2024-09-12T00:52:10.307 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:52:09.956+0000 7f5ed9287640 10 monclient(hunting): get_auth_request con 0x55992cdf53e0 auth_method 0 2024-09-12T00:52:10.307 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:52:09.956+0000 7f5ed9287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.307 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:52:09.956+0000 7f5ed9287640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.307 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:52:09.956+0000 7f5ed9287640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.307 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:52:09.956+0000 7f5ed8285640 10 monclient(hunting): get_auth_request con 0x55992cdf8ee0 auth_method 0 2024-09-12T00:52:10.308 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:52:09.956+0000 7f5ed8285640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.308 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:52:09.956+0000 7f5ed8285640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.308 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:52:09.956+0000 7f5ed8285640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.308 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:52:09.956+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request con 0x55992cdf6c10 auth_method 0 2024-09-12T00:52:10.308 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:52:09.956+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.308 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:52:09.956+0000 7f5ed8a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.308 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:52:09.956+0000 7f5ed8a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.308 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:52:09.957+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.308 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:52:09.957+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.308 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:52:09.957+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.308 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:52:09.957+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.308 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:52:09.957+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.309 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:52:09.957+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.309 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:52:09.957+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.309 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:52:09.957+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.309 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:52:09.957+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.309 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:52:09.957+0000 7f5ed9287640 10 monclient(hunting): handle_auth_done global_id 7083 payload 824 2024-09-12T00:52:10.309 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:52:09.957+0000 7f5ed9287640 10 monclient: _finish_hunting 0 2024-09-12T00:52:10.309 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:52:09.957+0000 7f5ed9287640 1 monclient: found mon.noname-a 2024-09-12T00:52:10.309 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:52:09.957+0000 7f5ed9287640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:52:10.309 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.309 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:10.309 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: dump: 2024-09-12T00:52:10.309 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.309 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.310 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.310 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.310 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.310 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.310 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.310 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.310 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.310 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.310 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: _finish_auth 0 2024-09-12T00:52:10.310 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:52:10.310 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:10.310 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.310 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:10.311 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:52:09.957+0000 7f5dbe7fc640 10 monclient: dump: 2024-09-12T00:52:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.311 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.311 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.311 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:52:09.957+0000 7f5edcd42800 5 monclient: authenticate success, global_id 7083 2024-09-12T00:52:10.312 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:52:09.957+0000 7f5edcd42800 10 monclient: _renew_subs 2024-09-12T00:52:10.312 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:52:09.957+0000 7f5ed9a88640 4 set_mon_vals no callback set 2024-09-12T00:52:10.312 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:52:09.957+0000 7f5edcd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:10.312 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:52:09.957+0000 7f5edcd42800 10 monclient: _renew_subs 2024-09-12T00:52:10.312 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:52:09.957+0000 7f5edcd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:10.312 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:52:09.959+0000 7f5dbe7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:10.312 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:52:09.959+0000 7f5dbe7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:10.312 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:52:09.959+0000 7f5dbe7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:10.312 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:52:09.959+0000 7f5ed8a86640 10 monclient: get_auth_request con 0x7f5db0076380 auth_method 0 2024-09-12T00:52:10.312 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:52:09.959+0000 7f5edcd42800 10 monclient: get_monmap_and_config 2024-09-12T00:52:10.312 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:52:09.959+0000 7f5edcd42800 10 monclient: build_initial_monmap 2024-09-12T00:52:10.313 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:52:09.959+0000 7f5edcd42800 1 build_initial for_mkfs: 0 2024-09-12T00:52:10.313 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:52:09.959+0000 7f5edcd42800 10 monclient: monmap: 2024-09-12T00:52:10.313 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:52:10.313 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:10.313 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:52:10.313 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:52:10.313 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:10.313 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.313 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:52:10.313 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:52:10.313 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:52:10.313 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.314 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding auth protocol: cephx 2024-09-12T00:52:10.314 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding auth protocol: cephx 2024-09-12T00:52:10.314 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding auth protocol: cephx 2024-09-12T00:52:10.314 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: secure 2024-09-12T00:52:10.314 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: crc 2024-09-12T00:52:10.314 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: secure 2024-09-12T00:52:10.314 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: crc 2024-09-12T00:52:10.314 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: secure 2024-09-12T00:52:10.314 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: crc 2024-09-12T00:52:10.314 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: crc 2024-09-12T00:52:10.314 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: secure 2024-09-12T00:52:10.314 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: crc 2024-09-12T00:52:10.314 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: secure 2024-09-12T00:52:10.315 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: crc 2024-09-12T00:52:10.315 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:52:09.959+0000 7f5edcd42800 5 AuthRegistry(0x55992ce16810) adding con mode: secure 2024-09-12T00:52:10.315 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:52:09.960+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.315 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient: init 2024-09-12T00:52:10.315 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding auth protocol: cephx 2024-09-12T00:52:10.315 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding auth protocol: cephx 2024-09-12T00:52:10.315 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding auth protocol: cephx 2024-09-12T00:52:10.315 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: secure 2024-09-12T00:52:10.315 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: crc 2024-09-12T00:52:10.315 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: secure 2024-09-12T00:52:10.315 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: crc 2024-09-12T00:52:10.315 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: secure 2024-09-12T00:52:10.315 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: crc 2024-09-12T00:52:10.316 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: crc 2024-09-12T00:52:10.316 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: secure 2024-09-12T00:52:10.316 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: crc 2024-09-12T00:52:10.316 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: secure 2024-09-12T00:52:10.316 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: crc 2024-09-12T00:52:10.316 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2dffa0) adding con mode: secure 2024-09-12T00:52:10.316 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:52:09.960+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.316 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:52:09.960+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.316 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:52:09.960+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command rotate-key cmddesc rotate-key hook 0x7ffe8d2e00e8 EEXIST 2024-09-12T00:52:10.316 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:10.316 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:10.316 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-b con 0x55992ce1a940 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:10.316 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-c con 0x55992ce45330 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:10.317 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-a con 0x55992ce1bcd0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:10.317 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.317 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.317 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.317 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:10.317 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:52:09.960+0000 7f5edcd42800 10 monclient(hunting): authenticate will time out at 2016.453976s 2024-09-12T00:52:10.317 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): get_auth_request con 0x55992ce45330 auth_method 0 2024-09-12T00:52:10.317 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.317 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.317 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.317 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:52:09.961+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request con 0x55992ce1a940 auth_method 0 2024-09-12T00:52:10.317 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:52:09.961+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.317 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:52:09.961+0000 7f5ed8a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.318 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:52:09.961+0000 7f5ed8a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.318 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:52:09.961+0000 7f5ed9287640 10 monclient(hunting): get_auth_request con 0x55992ce1bcd0 auth_method 0 2024-09-12T00:52:10.318 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:52:09.961+0000 7f5ed9287640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.318 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:52:09.961+0000 7f5ed9287640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.318 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:52:09.961+0000 7f5ed9287640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.318 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.318 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.318 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.318 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:52:09.961+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.318 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:52:09.961+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.318 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:52:09.961+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.318 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:52:09.961+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.319 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:52:09.961+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.319 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:52:09.961+0000 7f5ed9287640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.319 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient(hunting): handle_auth_done global_id 6728 payload 274 2024-09-12T00:52:10.319 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient: _finish_hunting 0 2024-09-12T00:52:10.319 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:52:09.961+0000 7f5ed8285640 1 monclient: found mon.noname-c 2024-09-12T00:52:10.319 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:52:09.961+0000 7f5ed8285640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:52:10.319 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.319 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:52:10.319 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: dump: 2024-09-12T00:52:10.319 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.319 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.319 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.320 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.320 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.320 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.320 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.320 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.320 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.320 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.320 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: _finish_auth 0 2024-09-12T00:52:10.320 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: _check_auth_tickets 2024-09-12T00:52:10.320 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:10.320 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.320 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:52:10.320 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:52:09.961+0000 7f5daffff640 10 monclient: dump: 2024-09-12T00:52:10.321 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.321 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.321 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.321 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.321 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.321 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.321 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.321 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.321 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.321 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.321 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:52:09.961+0000 7f5edcd42800 5 monclient: authenticate success, global_id 6728 2024-09-12T00:52:10.321 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:52:09.961+0000 7f5edcd42800 10 monclient: get_monmap_and_config success 2024-09-12T00:52:10.321 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:52:09.961+0000 7f5edcd42800 4 set_mon_vals no callback set 2024-09-12T00:52:10.322 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:52:09.962+0000 7f5edcd42800 10 monclient: shutdown 2024-09-12T00:52:10.322 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:52:09.962+0000 7f5edcd42800 10 monclient: build_initial_monmap 2024-09-12T00:52:10.322 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:52:09.962+0000 7f5edcd42800 1 build_initial for_mkfs: 0 2024-09-12T00:52:10.322 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:52:09.962+0000 7f5edcd42800 10 monclient: monmap: 2024-09-12T00:52:10.322 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:52:10.322 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:10.322 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:52:10.322 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:52:10.322 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:10.322 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.322 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:52:10.322 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:52:10.322 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:52:10.323 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.323 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding auth protocol: cephx 2024-09-12T00:52:10.323 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding auth protocol: cephx 2024-09-12T00:52:10.323 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding auth protocol: cephx 2024-09-12T00:52:10.323 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: secure 2024-09-12T00:52:10.323 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: crc 2024-09-12T00:52:10.323 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: secure 2024-09-12T00:52:10.323 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: crc 2024-09-12T00:52:10.323 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: secure 2024-09-12T00:52:10.323 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: crc 2024-09-12T00:52:10.323 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: crc 2024-09-12T00:52:10.323 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: secure 2024-09-12T00:52:10.324 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: crc 2024-09-12T00:52:10.324 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: secure 2024-09-12T00:52:10.324 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: crc 2024-09-12T00:52:10.324 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce4a430) adding con mode: secure 2024-09-12T00:52:10.324 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:52:09.962+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.324 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:52:09.962+0000 7f5edcd42800 1 librados: starting msgr at 2024-09-12T00:52:10.324 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:52:09.962+0000 7f5edcd42800 1 librados: starting objecter 2024-09-12T00:52:10.324 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command objecter_requests cmddesc objecter_requests hook 0x55992ce3cea0 EEXIST 2024-09-12T00:52:10.324 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:52:09.962+0000 7f5edcd42800 1 librados: setting wanted keys 2024-09-12T00:52:10.324 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:52:09.962+0000 7f5edcd42800 1 librados: calling monclient init 2024-09-12T00:52:10.324 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:52:09.962+0000 7f5edcd42800 10 monclient: init 2024-09-12T00:52:10.324 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding auth protocol: cephx 2024-09-12T00:52:10.324 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding auth protocol: cephx 2024-09-12T00:52:10.325 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding auth protocol: cephx 2024-09-12T00:52:10.325 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: secure 2024-09-12T00:52:10.325 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: crc 2024-09-12T00:52:10.325 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: secure 2024-09-12T00:52:10.325 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: crc 2024-09-12T00:52:10.325 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: secure 2024-09-12T00:52:10.325 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: crc 2024-09-12T00:52:10.325 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: crc 2024-09-12T00:52:10.325 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: secure 2024-09-12T00:52:10.325 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: crc 2024-09-12T00:52:10.325 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: secure 2024-09-12T00:52:10.325 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: crc 2024-09-12T00:52:10.325 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:52:09.962+0000 7f5edcd42800 5 AuthRegistry(0x55992ce0e9c0) adding con mode: secure 2024-09-12T00:52:10.326 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:52:09.963+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.326 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:52:09.963+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.326 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:52:09.963+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command rotate-key cmddesc rotate-key hook 0x55992ce0eb08 EEXIST 2024-09-12T00:52:10.326 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:10.326 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:52:10.326 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-a con 0x55992ce1a940 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:10.326 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-c con 0x55992ce3b630 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:10.326 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): picked mon.noname-b con 0x55992ce375a0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:10.326 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.326 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.326 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:10.326 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:10.326 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:52:09.963+0000 7f5edcd42800 10 monclient(hunting): authenticate will time out at 2016.456348s 2024-09-12T00:52:10.327 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request con 0x55992ce1a940 auth_method 0 2024-09-12T00:52:10.327 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.327 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.327 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.327 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:52:09.963+0000 7f5ed8285640 10 monclient(hunting): get_auth_request con 0x55992ce3b630 auth_method 0 2024-09-12T00:52:10.327 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:52:09.963+0000 7f5ed8285640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:10.327 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:52:09.963+0000 7f5ed8285640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:10.327 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:52:09.963+0000 7f5ed8285640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:10.327 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.327 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.327 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.327 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:52:09.963+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:10.327 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:52:09.963+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:10.328 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:52:09.963+0000 7f5ed8285640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:10.328 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient(hunting): handle_auth_done global_id 7089 payload 824 2024-09-12T00:52:10.328 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient: _finish_hunting 0 2024-09-12T00:52:10.328 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 1 monclient: found mon.noname-a 2024-09-12T00:52:10.328 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:52:09.963+0000 7f5ed8a86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:52:10.328 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.328 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:10.328 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: dump: 2024-09-12T00:52:10.328 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.328 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.328 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.328 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.328 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.329 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.329 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.329 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.329 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.329 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.329 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: _finish_auth 0 2024-09-12T00:52:10.329 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:52:10.329 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:10.329 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:10.329 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:10.329 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:52:09.963+0000 7f5dae7fc640 10 monclient: dump: 2024-09-12T00:52:10.329 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:10.329 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:10.330 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.330 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:10.330 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:10.330 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:10.330 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:10.330 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:10.330 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:10.330 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.330 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:52:09.963+0000 7f5edcd42800 5 monclient: authenticate success, global_id 7089 2024-09-12T00:52:10.330 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:52:09.964+0000 7f5edcd42800 10 monclient: _renew_subs 2024-09-12T00:52:10.330 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:52:09.964+0000 7f5edcd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:10.330 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:52:09.963+0000 7f5daffff640 4 set_mon_vals no callback set 2024-09-12T00:52:10.330 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:52:09.964+0000 7f5edcd42800 10 monclient: _renew_subs 2024-09-12T00:52:10.331 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:52:09.964+0000 7f5edcd42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:10.331 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:52:09.964+0000 7f5edcd42800 1 librados: init done 2024-09-12T00:52:10.331 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:52:09.964+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command cr dump hook 0x55992ce555b8 2024-09-12T00:52:10.331 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:52:09.965+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.331 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:52:09.966+0000 7f5dae7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:10.331 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:52:09.966+0000 7f5dae7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:10.331 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:52:09.966+0000 7f5dae7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:10.331 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:52:09.966+0000 7f5ed8285640 10 monclient: get_auth_request con 0x7f5da4076470 auth_method 0 2024-09-12T00:52:10.331 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:52:09.966+0000 7f5ed9287640 10 monclient: get_auth_request con 0x55992ce65ec0 auth_method 0 2024-09-12T00:52:10.331 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.331 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:52:09.967+0000 7f5edcd42800 20 realm 2024-09-12T00:52:10.331 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.331 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.332 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:52:09.967+0000 7f5edcd42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:10.332 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.332 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.332 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:52:09.967+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.332 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:52:09.967+0000 7f5ed8a86640 10 monclient: get_auth_request con 0x55992ce6a1f0 auth_method 0 2024-09-12T00:52:10.332 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:52:09.968+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:10.332 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:52:09.968+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.332 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:52:09.968+0000 7f5ed8285640 10 monclient: get_auth_request con 0x55992ce6d930 auth_method 0 2024-09-12T00:52:10.332 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:52:09.969+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:10.332 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:52:09.969+0000 7f5edcd42800 20 searching for the correct realm 2024-09-12T00:52:10.332 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:52:09.969+0000 7f5ed9287640 10 monclient: get_auth_request con 0x55992ce726f0 auth_method 0 2024-09-12T00:52:10.332 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:52:09.970+0000 7f5ed8a86640 10 monclient: get_auth_request con 0x7f5ed00659a0 auth_method 0 2024-09-12T00:52:10.332 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:52:09.971+0000 7f5ed8285640 10 monclient: get_auth_request con 0x7f5ed006e490 auth_method 0 2024-09-12T00:52:10.333 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:52:09.971+0000 7f5ed8285640 0 -- 172.21.15.62:0/3692361991 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f5ed006e490 msgr2=0x7f5ed009b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:10.333 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:52:10.172+0000 7f5ed8285640 10 monclient: get_auth_request con 0x7f5ed006e490 auth_method 0 2024-09-12T00:52:10.333 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:52:10.174+0000 7f5ed9287640 10 monclient: get_auth_request con 0x7f5ec804d180 auth_method 0 2024-09-12T00:52:10.333 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:52:10.175+0000 7f5ed8a86640 10 monclient: get_auth_request con 0x7f5ed0001b30 auth_method 0 2024-09-12T00:52:10.333 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:52:10.176+0000 7f5ed9287640 0 -- 172.21.15.62:0/3692361991 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55992ce65ec0 msgr2=0x55992ce68350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:10.333 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:52:10.176+0000 7f5dae7fc640 1 client.7089.objecter ms_handle_reset 0x55992ce65ec0 session 0x55992ce657b0 osd.6 2024-09-12T00:52:10.333 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:52:10.176+0000 7f5dae7fc640 10 monclient: _renew_subs 2024-09-12T00:52:10.333 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:52:10.176+0000 7f5dae7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:10.333 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:52:10.176+0000 7f5ed9287640 10 monclient: get_auth_request con 0x7f5da4086720 auth_method 0 2024-09-12T00:52:10.333 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:10.333 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:10.333 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:10.333 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:10.334 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:10.334 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:10.334 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.334 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.334 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.334 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:52:10.180+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:10.334 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:52:10.181+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.334 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:52:10.181+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:10.334 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:52:10.181+0000 7f5edcd42800 20 zone default found 2024-09-12T00:52:10.334 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:52:10.181+0000 7f5edcd42800 4 Realm: () 2024-09-12T00:52:10.334 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:52:10.181+0000 7f5edcd42800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:10.334 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:52:10.181+0000 7f5edcd42800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:10.334 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:52:10.181+0000 7f5edcd42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:10.335 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:52:10.181+0000 7f5edcd42800 20 zonegroup default 2024-09-12T00:52:10.335 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:52:10.181+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.335 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:52:10.182+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.335 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:52:10.182+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.335 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:52:10.182+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.335 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:52:10.182+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.335 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:52:10.182+0000 7f5edcd42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.335 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:52:10.182+0000 7f5edcd42800 20 started sync module instance, tier type = 2024-09-12T00:52:10.335 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:52:10.182+0000 7f5edcd42800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:10.335 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=0 2024-09-12T00:52:10.335 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=1 2024-09-12T00:52:10.335 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=2 2024-09-12T00:52:10.335 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=3 2024-09-12T00:52:10.336 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=4 2024-09-12T00:52:10.336 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=5 2024-09-12T00:52:10.336 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:52:10.190+0000 7f5edcd42800 20 add_watcher() i=6 2024-09-12T00:52:10.336 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:52:10.191+0000 7f5edcd42800 20 add_watcher() i=7 2024-09-12T00:52:10.336 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:52:10.191+0000 7f5edcd42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:10.336 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding auth protocol: cephx 2024-09-12T00:52:10.336 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding auth protocol: cephx 2024-09-12T00:52:10.336 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding auth protocol: cephx 2024-09-12T00:52:10.336 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: secure 2024-09-12T00:52:10.336 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: crc 2024-09-12T00:52:10.336 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: secure 2024-09-12T00:52:10.336 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: crc 2024-09-12T00:52:10.336 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: secure 2024-09-12T00:52:10.337 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: crc 2024-09-12T00:52:10.337 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: crc 2024-09-12T00:52:10.337 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: secure 2024-09-12T00:52:10.337 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: crc 2024-09-12T00:52:10.337 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: secure 2024-09-12T00:52:10.337 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: crc 2024-09-12T00:52:10.337 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 AuthRegistry(0x7ffe8d2e0480) adding con mode: secure 2024-09-12T00:52:10.337 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:52:10.193+0000 7f5d8efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:10.337 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:52:10.193+0000 7f5edcd42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:10.337 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:52:10.193+0000 7f5edcd42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:10.337 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:52:10.193+0000 7f5edcd42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:10.337 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command cache list hook 0x55992ce37980 2024-09-12T00:52:10.337 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command cache inspect hook 0x55992ce37980 2024-09-12T00:52:10.338 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command cache erase hook 0x55992ce37980 2024-09-12T00:52:10.338 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command cache zap hook 0x55992ce37980 2024-09-12T00:52:10.338 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:52:10.193+0000 7f5edcd42800 5 note: GC not initialized 2024-09-12T00:52:10.338 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:52:10.193+0000 7f5d8dfe3640 20 reqs_thread_entry: start 2024-09-12T00:52:10.338 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:52:10.194+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command sync trace show hook 0x7f5ecc0674d0 2024-09-12T00:52:10.338 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:52:10.194+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command sync trace history hook 0x7f5ecc0674d0 2024-09-12T00:52:10.338 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:52:10.194+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command sync trace active hook 0x7f5ecc0674d0 2024-09-12T00:52:10.338 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:52:10.194+0000 7f5edcd42800 5 asok(0x55992cb5a630) register_command sync trace active_short hook 0x7f5ecc0674d0 2024-09-12T00:52:10.338 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:52:10.194+0000 7f5edcd42800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:10.338 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:52:10.194+0000 7f5edcd42800 20 Filter name: none 2024-09-12T00:52:10.338 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:52:10.194+0000 7f5cff7fe640 20 reqs_thread_entry: start 2024-09-12T00:52:10.338 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:52:10.194+0000 7f5edcd42800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:52:10.338 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:52:10.194+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.338 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:52:10.194+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:10.338 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:52:10.194+0000 7f5edcd42800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:52:10.339 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:52:10.194+0000 7f5edcd42800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:52:10.339 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:52:10.194+0000 7f5edcd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 : miss 2024-09-12T00:52:10.339 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:52:10.194+0000 7f5edcd42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.339 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:52:10.195+0000 7f5edcd42800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:52:10.339 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:52:10.195+0000 7f5edcd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.339 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:52:10.195+0000 7f5edcd42800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.339 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:52:10.195+0000 7f5edcd42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:10.339 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:52:10.195+0000 7f5edcd42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.339 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:52:10.195+0000 7f5edcd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 2024-09-12T00:52:10.339 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:52:10.198+0000 7f5edcd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.339 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:52:10.198+0000 7f5edcd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.339 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:52:10.198+0000 7f5edcd42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.339 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:52:10.198+0000 7f5edcd42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29, ofs0, ns] 2024-09-12T00:52:10.340 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:52:10.199+0000 7f5daffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431668 cookie 94116371732240 notifier 7089 bl.length()=915 2024-09-12T00:52:10.340 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:52:10.199+0000 7f5daffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.340 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:52:10.199+0000 7f5daffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.340 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:52:10.199+0000 7f5daffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.340 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:52:10.201+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_sources= new_sources= 2024-09-12T00:52:10.340 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:52:10.201+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential sources added=[] removed=[] 2024-09-12T00:52:10.340 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:52:10.201+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_dests= new_dests= 2024-09-12T00:52:10.340 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:52:10.201+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential dests added=[] removed=[] 2024-09-12T00:52:10.340 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:52:10.203+0000 7f5edcd42800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.1.0 2024-09-12T00:52:10.340 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:52:10.203+0000 7f5edcd42800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.1.0 2024-09-12T00:52:10.340 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:52:10.203+0000 7f5edcd42800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.1.1 2024-09-12T00:52:10.340 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:52:10.203+0000 7f5edcd42800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.1.1 2024-09-12T00:52:10.340 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:52:10.203+0000 7f5edcd42800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.0 2024-09-12T00:52:10.341 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:52:10.205+0000 7f5edcd42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:10.341 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:52:10.205+0000 7f5edcd42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 2024-09-12T00:52:10.341 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:52:10.206+0000 7f5edcd42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.341 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:52:10.206+0000 7f5edcd42800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.341 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:52:10.206+0000 7f5edcd42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.341 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:52:10.206+0000 7f5edcd42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29, ofs0, ns] 2024-09-12T00:52:10.341 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:52:10.206+0000 7f5daffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431669 cookie 94116371732240 notifier 7089 bl.length()=915 2024-09-12T00:52:10.341 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:52:10.206+0000 7f5daffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.341 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:52:10.207+0000 7f5daffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.341 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:52:10.207+0000 7f5daffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.341 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:52:10.208+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_sources= new_sources= 2024-09-12T00:52:10.341 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:52:10.208+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential sources added=[] removed=[] 2024-09-12T00:52:10.341 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:52:10.208+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_dests= new_dests= 2024-09-12T00:52:10.342 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:52:10.208+0000 7f5edcd42800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential dests added=[] removed=[] 2024-09-12T00:52:10.342 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:52:10.209+0000 7f5edcd42800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5edcd42800 time 2024-09-12T00:52:10.209435+0000 2024-09-12T00:52:10.342 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:10.342 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.342 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:10.342 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5ede58c71a] 2024-09-12T00:52:10.342 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5ede58c8d8] 2024-09-12T00:52:10.342 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992aeb7641] 2024-09-12T00:52:10.342 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55992aec6582] 2024-09-12T00:52:10.342 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992aec73e4] 2024-09-12T00:52:10.342 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:52:10.342 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5edd229590] 2024-09-12T00:52:10.343 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:52:10.343 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:52:10.343 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.343 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:52:10.210+0000 7f5edcd42800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:10.343 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f5edcd42800 thread_name:radosgw-admin 2024-09-12T00:52:10.343 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.343 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:10.343 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5edd23e6f0] 2024-09-12T00:52:10.343 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5edd28b99c] 2024-09-12T00:52:10.343 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:52:10.343 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:52:10.343 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5ede58c774] 2024-09-12T00:52:10.344 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5ede58c8d8] 2024-09-12T00:52:10.344 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992aeb7641] 2024-09-12T00:52:10.344 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x55992aec6582] 2024-09-12T00:52:10.344 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992aec73e4] 2024-09-12T00:52:10.344 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:52:10.344 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5edd229590] 2024-09-12T00:52:10.344 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:52:10.344 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:52:10.344 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:10.344 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.344 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:52:10.344 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:52:10.344 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:52:10.345 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:52:10.345 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:52:10.345 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:52:10.345 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:52:10.345 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:52:10.345 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:52:10.345 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:52:10.345 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:52:10.345 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:52:10.345 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:52:10.345 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:52:10.345 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:52:10.346 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:52:10.346 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:52:10.346 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:52:10.346 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:52:10.346 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:52:10.346 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:52:10.346 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:52:10.346 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:52:10.346 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:52:10.346 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:52:10.346 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:52:10.346 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:52:10.346 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:52:10.346 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:52:10.347 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:52:10.347 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:52:10.347 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:52:10.347 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:52:10.347 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:52:10.347 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:52:10.347 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:52:10.347 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:52:10.347 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:52:10.347 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:52:10.347 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:52:10.347 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:52:10.348 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:52:10.348 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:52:10.348 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:52:10.348 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:52:10.348 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:52:10.348 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:52:10.348 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:52:10.348 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:52:10.348 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:52:10.348 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:52:10.348 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:52:10.348 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:52:10.349 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:52:10.349 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:52:10.349 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:52:10.349 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:52:10.349 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:52:10.349 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:52:10.349 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:52:10.349 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:52:10.349 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:52:10.349 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:52:10.349 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:52:10.349 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:52:10.349 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:52:10.350 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:52:10.350 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:52:10.350 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:52:10.350 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:52:10.350 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:52:10.350 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:52:10.350 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:52:10.350 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:52:10.350 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:52:10.350 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:52:10.350 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:52:10.350 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:52:10.350 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:52:10.351 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:52:10.351 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:52:10.351 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:52:10.351 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:52:10.351 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:52:10.351 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:52:10.351 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:52:10.351 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:52:10.351 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:52:10.351 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:52:10.351 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:52:10.351 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:52:10.351 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:52:10.352 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:52:10.352 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:52:10.352 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5cff7fe640 / http_manager 2024-09-12T00:52:10.352 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5d8dfe3640 / http_manager 2024-09-12T00:52:10.352 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5d8efe5640 / rgw_dt_lg_renew 2024-09-12T00:52:10.352 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5dae7fc640 / ms_dispatch 2024-09-12T00:52:10.352 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5daffff640 / io_context_pool 2024-09-12T00:52:10.352 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5dbe7fc640 / ms_dispatch 2024-09-12T00:52:10.352 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5dc560a640 / ms_dispatch 2024-09-12T00:52:10.352 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5dc6e0d640 / io_context_pool 2024-09-12T00:52:10.352 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5ed8285640 / msgr-worker-2 2024-09-12T00:52:10.352 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5ed8a86640 / msgr-worker-1 2024-09-12T00:52:10.352 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5ed9287640 / msgr-worker-0 2024-09-12T00:52:10.353 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5ed9a88640 / io_context_pool 2024-09-12T00:52:10.353 INFO:tasks.workunit.client.0.smithi062.stderr: 7f5edcd42800 / radosgw-admin 2024-09-12T00:52:10.353 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:52:10.353 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:52:10.353 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:52:10.211138Z_521bd2f4-c042-4315-83ed-563584c1c5fa/log 2024-09-12T00:52:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:52:10.353 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:52:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.291+0000 7f610e52a800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.293+0000 7f610e52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.293+0000 7f610e52a800 20 realm 2024-09-12T00:52:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.293+0000 7f610e52a800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.293+0000 7f610e52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.293+0000 7f610e52a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.293+0000 7f610e52a800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.294+0000 7f610e52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.294+0000 7f610e52a800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.294+0000 7f610e52a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.294+0000 7f610e52a800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.295+0000 7f610e52a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.295+0000 7f610e52a800 20 searching for the correct realm 2024-09-12T00:52:10.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.298+0000 7f6109960640 0 -- 172.21.15.62:0/1394463105 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f6104069110 msgr2=0x7f61040980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:10.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.504+0000 7f610a962640 0 -- 172.21.15.62:0/1394463105 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5615037d2940 msgr2=0x5615037d4e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:10.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.507+0000 7f610e52a800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:10.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.507+0000 7f610e52a800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:10.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.507+0000 7f610e52a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:10.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.507+0000 7f610e52a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:10.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.507+0000 7f610e52a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:10.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.507+0000 7f610e52a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:10.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.507+0000 7f610e52a800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.508+0000 7f610e52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.508+0000 7f610e52a800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.508+0000 7f610e52a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:10.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.508+0000 7f610e52a800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.508+0000 7f610e52a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:10.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.508+0000 7f610e52a800 20 zone default found 2024-09-12T00:52:10.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.508+0000 7f610e52a800 4 Realm: () 2024-09-12T00:52:10.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.508+0000 7f610e52a800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:10.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.508+0000 7f610e52a800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:10.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.508+0000 7f610e52a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:10.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.508+0000 7f610e52a800 20 zonegroup default 2024-09-12T00:52:10.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.508+0000 7f610e52a800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.509+0000 7f610e52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.509+0000 7f610e52a800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.510 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.509+0000 7f610e52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.510 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.509+0000 7f610e52a800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.510 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.510+0000 7f610e52a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.510 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.510+0000 7f610e52a800 20 started sync module instance, tier type = 2024-09-12T00:52:10.510 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.510+0000 7f610e52a800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:10.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.518+0000 7f610e52a800 20 add_watcher() i=0 2024-09-12T00:52:10.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.518+0000 7f610e52a800 20 add_watcher() i=1 2024-09-12T00:52:10.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.518+0000 7f610e52a800 20 add_watcher() i=2 2024-09-12T00:52:10.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.518+0000 7f610e52a800 20 add_watcher() i=3 2024-09-12T00:52:10.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.518+0000 7f610e52a800 20 add_watcher() i=4 2024-09-12T00:52:10.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.518+0000 7f610e52a800 20 add_watcher() i=5 2024-09-12T00:52:10.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.518+0000 7f610e52a800 20 add_watcher() i=6 2024-09-12T00:52:10.518 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.518+0000 7f610e52a800 20 add_watcher() i=7 2024-09-12T00:52:10.518 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.518+0000 7f610e52a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:10.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.520+0000 7f5fc0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:10.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.520+0000 7f610e52a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:10.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.520+0000 7f610e52a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:10.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.520+0000 7f610e52a800 5 note: GC not initialized 2024-09-12T00:52:10.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.521+0000 7f5f3b7fe640 20 reqs_thread_entry: start 2024-09-12T00:52:10.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.521+0000 7f610e52a800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:10.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.521+0000 7f610e52a800 20 Filter name: none 2024-09-12T00:52:10.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.521+0000 7f5f397fa640 20 reqs_thread_entry: start 2024-09-12T00:52:10.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.521+0000 7f610e52a800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.521+0000 7f610e52a800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:10.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.521+0000 7f610e52a800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.522+0000 7f610e52a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:52:10.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.522+0000 7f610e52a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:10.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.522+0000 7f610e52a800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.522+0000 7f610e52a800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:10.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.522+0000 7f610e52a800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.523+0000 7f610e52a800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:52:10.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.523+0000 7f610e52a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:10.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.524+0000 7f5fc0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:10.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.526+0000 7f610e52a800 20 remove_watcher() i=0 2024-09-12T00:52:10.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.526+0000 7f610e52a800 2 removed watcher, disabling cache 2024-09-12T00:52:10.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.527+0000 7f610e52a800 20 remove_watcher() i=1 2024-09-12T00:52:10.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.528+0000 7f610e52a800 20 remove_watcher() i=2 2024-09-12T00:52:10.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.529+0000 7f610e52a800 20 remove_watcher() i=3 2024-09-12T00:52:10.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.530+0000 7f610e52a800 20 remove_watcher() i=4 2024-09-12T00:52:10.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.531+0000 7f610e52a800 20 remove_watcher() i=5 2024-09-12T00:52:10.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.532+0000 7f610e52a800 20 remove_watcher() i=6 2024-09-12T00:52:10.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.533+0000 7f610e52a800 20 remove_watcher() i=7 2024-09-12T00:52:10.543 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.543 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:52:10.543 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-block-writes id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:52:10.543 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:10.635 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:52:10.667 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:10.667 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:10.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.707+0000 7fa2b0940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.708+0000 7fa2b0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.708+0000 7fa2b0940800 20 realm 2024-09-12T00:52:10.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.708+0000 7fa2b0940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.709+0000 7fa2b0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.709+0000 7fa2b0940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:10.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.709+0000 7fa2b0940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.709+0000 7fa2b0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.709+0000 7fa2b0940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.710+0000 7fa2b0940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:10.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.710+0000 7fa2b0940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.710+0000 7fa2b0940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:10.709 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.710+0000 7fa2b0940800 20 searching for the correct realm 2024-09-12T00:52:10.712 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.713+0000 7fa2acec1640 0 -- 172.21.15.62:0/2694627517 >> [v2:172.21.15.77:6816/3177889521,v1:172.21.15.77:6817/3177889521] conn(0x55ac6d71b5b0 msgr2=0x55ac6d71da70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:10.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.716+0000 7fa2ac6c0640 0 -- 172.21.15.62:0/2694627517 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7fa2a40a0c60 msgr2=0x7fa2a4098110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:10.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.922+0000 7fa2b0940800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:10.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.922+0000 7fa2b0940800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:10.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.922+0000 7fa2b0940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:10.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.922+0000 7fa2b0940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:10.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.922+0000 7fa2b0940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:10.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.922+0000 7fa2b0940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:10.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.922+0000 7fa2b0940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.922+0000 7fa2b0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.922+0000 7fa2b0940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.922+0000 7fa2b0940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:10.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.922+0000 7fa2b0940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.923+0000 7fa2b0940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:10.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.923+0000 7fa2b0940800 20 zone default found 2024-09-12T00:52:10.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.923+0000 7fa2b0940800 4 Realm: () 2024-09-12T00:52:10.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.923+0000 7fa2b0940800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:10.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.923+0000 7fa2b0940800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:10.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.923+0000 7fa2b0940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:10.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.923+0000 7fa2b0940800 20 zonegroup default 2024-09-12T00:52:10.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.923+0000 7fa2b0940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.923+0000 7fa2b0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.923+0000 7fa2b0940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.923+0000 7fa2b0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.923+0000 7fa2b0940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.923+0000 7fa2b0940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:10.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.924+0000 7fa2b0940800 20 started sync module instance, tier type = 2024-09-12T00:52:10.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.924+0000 7fa2b0940800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:10.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.932+0000 7fa2b0940800 20 add_watcher() i=0 2024-09-12T00:52:10.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.932+0000 7fa2b0940800 20 add_watcher() i=1 2024-09-12T00:52:10.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.932+0000 7fa2b0940800 20 add_watcher() i=2 2024-09-12T00:52:10.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.932+0000 7fa2b0940800 20 add_watcher() i=3 2024-09-12T00:52:10.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.932+0000 7fa2b0940800 20 add_watcher() i=4 2024-09-12T00:52:10.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.932+0000 7fa2b0940800 20 add_watcher() i=5 2024-09-12T00:52:10.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.932+0000 7fa2b0940800 20 add_watcher() i=6 2024-09-12T00:52:10.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.933+0000 7fa2b0940800 20 add_watcher() i=7 2024-09-12T00:52:10.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.933+0000 7fa2b0940800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:10.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.935+0000 7fa162fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:10.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.935+0000 7fa2b0940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:10.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.935+0000 7fa2b0940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:10.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.935+0000 7fa2b0940800 5 note: GC not initialized 2024-09-12T00:52:10.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.935+0000 7fa161fdb640 20 reqs_thread_entry: start 2024-09-12T00:52:10.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.935+0000 7fa2b0940800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:10.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.936+0000 7fa2b0940800 20 Filter name: none 2024-09-12T00:52:10.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.936+0000 7fa0d37fe640 20 reqs_thread_entry: start 2024-09-12T00:52:10.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.936+0000 7fa2b0940800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:52:10.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.936+0000 7fa2b0940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.936+0000 7fa2b0940800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:10.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.936+0000 7fa2b0940800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:52:10.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.936+0000 7fa2b0940800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:52:10.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.936+0000 7fa2b0940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 : miss 2024-09-12T00:52:10.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.936+0000 7fa2b0940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:10.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.936+0000 7fa2b0940800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:52:10.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.936+0000 7fa2b0940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:10.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.936+0000 7fa2b0940800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:10.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.936+0000 7fa2b0940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:10.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.936+0000 7fa2b0940800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:10.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.937+0000 7fa2b0940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 2024-09-12T00:52:10.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.938+0000 7fa2b0940800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to be held by another RGW process; skipping for now 2024-09-12T00:52:10.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.939+0000 7fa162fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:10.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.942+0000 7fa2b0940800 20 remove_watcher() i=0 2024-09-12T00:52:10.941 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.942+0000 7fa2b0940800 2 removed watcher, disabling cache 2024-09-12T00:52:10.941 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.943+0000 7fa2b0940800 20 remove_watcher() i=1 2024-09-12T00:52:10.942 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.944+0000 7fa2b0940800 20 remove_watcher() i=2 2024-09-12T00:52:10.943 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.945+0000 7fa2b0940800 20 remove_watcher() i=3 2024-09-12T00:52:10.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.946+0000 7fa2b0940800 20 remove_watcher() i=4 2024-09-12T00:52:10.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.946+0000 7fa2b0940800 20 remove_watcher() i=5 2024-09-12T00:52:10.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.947+0000 7fa2b0940800 20 remove_watcher() i=6 2024-09-12T00:52:10.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:10.948+0000 7fa2b0940800 20 remove_watcher() i=7 2024-09-12T00:52:10.958 INFO:tasks.workunit.client.0.smithi062.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:52:40.968 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:52:41.005 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:41.005 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:41.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.050+0000 7f47cff19800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.052+0000 7f47cff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:41.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.052+0000 7f47cff19800 20 realm 2024-09-12T00:52:41.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.052+0000 7f47cff19800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.053+0000 7f47cff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:41.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.053+0000 7f47cff19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:41.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.053+0000 7f47cff19800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.053+0000 7f47cff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:41.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.053+0000 7f47cff19800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.054+0000 7f47cff19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:41.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.054+0000 7f47cff19800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.054+0000 7f47cff19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:41.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.054+0000 7f47cff19800 20 searching for the correct realm 2024-09-12T00:52:41.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.058+0000 7f47cd202640 0 -- 172.21.15.62:0/3584141546 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f47c801f070 msgr2=0x7f47c8035400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:41.263 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.264+0000 7f47ce204640 0 -- 172.21.15.62:0/3584141546 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5634832e1f40 msgr2=0x5634832e43b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:41.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.269+0000 7f47cff19800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:41.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.269+0000 7f47cff19800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:41.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.269+0000 7f47cff19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:41.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.269+0000 7f47cff19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:41.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.269+0000 7f47cff19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:41.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.269+0000 7f47cff19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:41.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.269+0000 7f47cff19800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.270+0000 7f47cff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:41.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.270+0000 7f47cff19800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.270+0000 7f47cff19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:41.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.270+0000 7f47cff19800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.270 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.271+0000 7f47cff19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:41.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.271+0000 7f47cff19800 20 zone default found 2024-09-12T00:52:41.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.271+0000 7f47cff19800 4 Realm: () 2024-09-12T00:52:41.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.271+0000 7f47cff19800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:41.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.271+0000 7f47cff19800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:41.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.271+0000 7f47cff19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:41.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.271+0000 7f47cff19800 20 zonegroup default 2024-09-12T00:52:41.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.271+0000 7f47cff19800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.271+0000 7f47cff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:41.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.271+0000 7f47cff19800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.271+0000 7f47cff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:41.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.271+0000 7f47cff19800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.272+0000 7f47cff19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:41.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.272+0000 7f47cff19800 20 started sync module instance, tier type = 2024-09-12T00:52:41.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.272+0000 7f47cff19800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:41.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.282+0000 7f47cff19800 20 add_watcher() i=0 2024-09-12T00:52:41.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.282+0000 7f47cff19800 20 add_watcher() i=1 2024-09-12T00:52:41.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.282+0000 7f47cff19800 20 add_watcher() i=2 2024-09-12T00:52:41.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.282+0000 7f47cff19800 20 add_watcher() i=3 2024-09-12T00:52:41.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.282+0000 7f47cff19800 20 add_watcher() i=4 2024-09-12T00:52:41.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.282+0000 7f47cff19800 20 add_watcher() i=5 2024-09-12T00:52:41.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.282+0000 7f47cff19800 20 add_watcher() i=6 2024-09-12T00:52:41.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.283+0000 7f47cff19800 20 add_watcher() i=7 2024-09-12T00:52:41.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.283+0000 7f47cff19800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:41.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.285+0000 7f467f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:41.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.285+0000 7f47cff19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:41.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.285+0000 7f47cff19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:41.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.285+0000 7f47cff19800 5 note: GC not initialized 2024-09-12T00:52:41.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.286+0000 7f467e7fc640 20 reqs_thread_entry: start 2024-09-12T00:52:41.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.286+0000 7f47cff19800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:41.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.286+0000 7f47cff19800 20 Filter name: none 2024-09-12T00:52:41.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.286+0000 7f45effff640 20 reqs_thread_entry: start 2024-09-12T00:52:41.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.286+0000 7f47cff19800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:52:41.285 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.286+0000 7f47cff19800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.286+0000 7f47cff19800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:41.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.286+0000 7f47cff19800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:52:41.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.286+0000 7f47cff19800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:52:41.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.286+0000 7f47cff19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 : miss 2024-09-12T00:52:41.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.286+0000 7f47cff19800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.287+0000 7f47cff19800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:52:41.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.287+0000 7f47cff19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:41.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.287+0000 7f47cff19800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:41.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.287+0000 7f47cff19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:41.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.287+0000 7f47cff19800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:41.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.287+0000 7f47cff19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 2024-09-12T00:52:41.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.289+0000 7f47cff19800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:52:41.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.293+0000 7f47cff19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:41.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.293+0000 7f47cff19800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:41.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.293+0000 7f47cff19800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:41.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.293+0000 7f47cff19800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29, ofs0, ns] 2024-09-12T00:52:41.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.293+0000 7f46b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431670 cookie 94783539203888 notifier 7146 bl.length()=915 2024-09-12T00:52:41.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.293+0000 7f46b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:41.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.293+0000 7f46b0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:41.292 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.293+0000 7f46b0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:41.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.295+0000 7f47cff19800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_sources= new_sources= 2024-09-12T00:52:41.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.295+0000 7f47cff19800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential sources added=[] removed=[] 2024-09-12T00:52:41.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.295+0000 7f47cff19800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_dests= new_dests= 2024-09-12T00:52:41.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.295+0000 7f47cff19800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential dests added=[] removed=[] 2024-09-12T00:52:41.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.299+0000 7f47cff19800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.2.0 2024-09-12T00:52:41.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.299+0000 7f47cff19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.2.0 2024-09-12T00:52:41.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.299+0000 7f47cff19800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.2.1 2024-09-12T00:52:41.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.299+0000 7f47cff19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.2.1 2024-09-12T00:52:41.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.299+0000 7f47cff19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.0 2024-09-12T00:52:41.301 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.302+0000 7f47cff19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:41.301 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.302+0000 7f47cff19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 2024-09-12T00:52:41.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.303+0000 7f47cff19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:41.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.303+0000 7f47cff19800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:41.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.303+0000 7f47cff19800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:41.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.303+0000 7f47cff19800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29, ofs0, ns] 2024-09-12T00:52:41.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.304+0000 7f46b17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431671 cookie 94783539203888 notifier 7146 bl.length()=915 2024-09-12T00:52:41.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.304+0000 7f46b17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:41.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.304+0000 7f46b17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:41.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.304+0000 7f46b17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:41.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.305+0000 7f47cff19800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_sources= new_sources= 2024-09-12T00:52:41.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.305+0000 7f47cff19800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential sources added=[] removed=[] 2024-09-12T00:52:41.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.305+0000 7f47cff19800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_dests= new_dests= 2024-09-12T00:52:41.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.305+0000 7f47cff19800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential dests added=[] removed=[] 2024-09-12T00:52:41.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.306+0000 7f47cff19800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29.0 2024-09-12T00:52:41.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.307+0000 7f47cff19800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:41.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.307+0000 7f47cff19800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 2024-09-12T00:52:41.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.308+0000 7f47cff19800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:41.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.308+0000 7f47cff19800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:41.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.308+0000 7f47cff19800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:41.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.308+0000 7f47cff19800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29, ofs0, ns] 2024-09-12T00:52:41.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.308+0000 7f46b0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431672 cookie 94783539203888 notifier 7146 bl.length()=883 2024-09-12T00:52:41.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.308+0000 7f46b0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 info.flags=0x17 2024-09-12T00:52:41.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.308+0000 7f46b0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 to cache LRU end 2024-09-12T00:52:41.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.308+0000 7f46b0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:41.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.310+0000 7f47cff19800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_sources= new_sources= 2024-09-12T00:52:41.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.310+0000 7f47cff19800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential sources added=[] removed=[] 2024-09-12T00:52:41.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.310+0000 7f47cff19800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): orig_dests= new_dests= 2024-09-12T00:52:41.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.310+0000 7f47cff19800 20 handle_bi_update(): bucket=:abort-at-block-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29]): potential dests added=[] removed=[] 2024-09-12T00:52:41.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.311+0000 7f47cff19800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:52:41.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.314+0000 7f467f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:41.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.317+0000 7f47cff19800 20 remove_watcher() i=0 2024-09-12T00:52:41.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.317+0000 7f47cff19800 2 removed watcher, disabling cache 2024-09-12T00:52:41.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.318+0000 7f47cff19800 20 remove_watcher() i=1 2024-09-12T00:52:41.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.319+0000 7f47cff19800 20 remove_watcher() i=2 2024-09-12T00:52:41.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.320+0000 7f47cff19800 20 remove_watcher() i=3 2024-09-12T00:52:41.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.321+0000 7f47cff19800 20 remove_watcher() i=4 2024-09-12T00:52:41.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.322+0000 7f47cff19800 20 remove_watcher() i=5 2024-09-12T00:52:41.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.323+0000 7f47cff19800 20 remove_watcher() i=6 2024-09-12T00:52:41.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.324+0000 7f47cff19800 20 remove_watcher() i=7 2024-09-12T00:52:41.338 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:52:41.368 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:41.368 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:41.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.409+0000 7fd0eb575800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.411+0000 7fd0eb575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:41.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.411+0000 7fd0eb575800 20 realm 2024-09-12T00:52:41.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.411+0000 7fd0eb575800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.411+0000 7fd0eb575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:41.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.411+0000 7fd0eb575800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:41.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.411+0000 7fd0eb575800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.412+0000 7fd0eb575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:41.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.412+0000 7fd0eb575800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.412+0000 7fd0eb575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:41.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.412+0000 7fd0eb575800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.413+0000 7fd0eb575800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:41.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.413+0000 7fd0eb575800 20 searching for the correct realm 2024-09-12T00:52:41.415 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.416+0000 7fd0e885e640 0 -- 172.21.15.62:0/1736166054 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fd0e4068180 msgr2=0x7fd0e4097a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:41.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.622+0000 7fd0e905f640 0 -- 172.21.15.62:0/1736166054 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7fcfb40866a0 msgr2=0x7fcfb4088ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:41.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.830+0000 7fd0eb575800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:41.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.830+0000 7fd0eb575800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:41.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.830+0000 7fd0eb575800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:41.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.830+0000 7fd0eb575800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:41.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.830+0000 7fd0eb575800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:41.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.830+0000 7fd0eb575800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:41.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.830+0000 7fd0eb575800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.830+0000 7fd0eb575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:41.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.830+0000 7fd0eb575800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.831+0000 7fd0eb575800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:41.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.831+0000 7fd0eb575800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.831+0000 7fd0eb575800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:41.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.831+0000 7fd0eb575800 20 zone default found 2024-09-12T00:52:41.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.831+0000 7fd0eb575800 4 Realm: () 2024-09-12T00:52:41.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.831+0000 7fd0eb575800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:41.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.831+0000 7fd0eb575800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:41.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.831+0000 7fd0eb575800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:41.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.831+0000 7fd0eb575800 20 zonegroup default 2024-09-12T00:52:41.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.831+0000 7fd0eb575800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.831+0000 7fd0eb575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:41.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.831+0000 7fd0eb575800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.832+0000 7fd0eb575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:41.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.832+0000 7fd0eb575800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.832+0000 7fd0eb575800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:41.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.832+0000 7fd0eb575800 20 started sync module instance, tier type = 2024-09-12T00:52:41.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.832+0000 7fd0eb575800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:41.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.843+0000 7fd0eb575800 20 add_watcher() i=0 2024-09-12T00:52:41.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.843+0000 7fd0eb575800 20 add_watcher() i=1 2024-09-12T00:52:41.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.843+0000 7fd0eb575800 20 add_watcher() i=2 2024-09-12T00:52:41.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.843+0000 7fd0eb575800 20 add_watcher() i=3 2024-09-12T00:52:41.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.843+0000 7fd0eb575800 20 add_watcher() i=4 2024-09-12T00:52:41.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.843+0000 7fd0eb575800 20 add_watcher() i=5 2024-09-12T00:52:41.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.843+0000 7fd0eb575800 20 add_watcher() i=6 2024-09-12T00:52:41.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.844+0000 7fd0eb575800 20 add_watcher() i=7 2024-09-12T00:52:41.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.844+0000 7fd0eb575800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:41.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.845+0000 7fcf9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:41.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.846+0000 7fd0eb575800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:41.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.846+0000 7fd0eb575800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:41.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.846+0000 7fd0eb575800 5 note: GC not initialized 2024-09-12T00:52:41.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.846+0000 7fcf9e7e4640 20 reqs_thread_entry: start 2024-09-12T00:52:41.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.846+0000 7fd0eb575800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:41.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.846+0000 7fd0eb575800 20 Filter name: none 2024-09-12T00:52:41.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.846+0000 7fcf0ffff640 20 reqs_thread_entry: start 2024-09-12T00:52:41.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.846+0000 7fd0eb575800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.847+0000 7fd0eb575800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:41.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.847+0000 7fd0eb575800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.847+0000 7fd0eb575800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:52:41.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.848+0000 7fd0eb575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:41.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.848+0000 7fd0eb575800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.848+0000 7fd0eb575800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:52:41.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.848+0000 7fd0eb575800 20 rados->read ofs=0 len=0 2024-09-12T00:52:41.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.848+0000 7fd0eb575800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:52:41.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.848+0000 7fd0eb575800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:41.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.850+0000 7fcf9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:41.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.852+0000 7fd0eb575800 20 remove_watcher() i=0 2024-09-12T00:52:41.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.852+0000 7fd0eb575800 2 removed watcher, disabling cache 2024-09-12T00:52:41.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.853+0000 7fd0eb575800 20 remove_watcher() i=1 2024-09-12T00:52:41.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.854+0000 7fd0eb575800 20 remove_watcher() i=2 2024-09-12T00:52:41.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.856+0000 7fd0eb575800 20 remove_watcher() i=3 2024-09-12T00:52:41.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.857+0000 7fd0eb575800 20 remove_watcher() i=4 2024-09-12T00:52:41.857 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.858+0000 7fd0eb575800 20 remove_watcher() i=5 2024-09-12T00:52:41.858 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.859+0000 7fd0eb575800 20 remove_watcher() i=6 2024-09-12T00:52:41.859 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:41.860+0000 7fd0eb575800 20 remove_watcher() i=7 2024-09-12T00:52:41.871 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:41.871 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:52:41.871 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-block-writes id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:52:41.871 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:42.178 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T00:52:42.178 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:43.041 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:52:43.070 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:43.070 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:43.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.110+0000 7f8e86521800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.111 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.112+0000 7f8e86521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.111 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.112+0000 7f8e86521800 20 realm 2024-09-12T00:52:43.111 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.112+0000 7f8e86521800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.111 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.112+0000 7f8e86521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.112+0000 7f8e86521800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:43.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.112+0000 7f8e86521800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.112+0000 7f8e86521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.112+0000 7f8e86521800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.113+0000 7f8e86521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:43.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.113+0000 7f8e86521800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.114+0000 7f8e86521800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:43.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.114+0000 7f8e86521800 20 searching for the correct realm 2024-09-12T00:52:43.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.117+0000 7f8e81a0b640 0 -- 172.21.15.62:0/2630933113 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f8e7c084440 msgr2=0x7f8e7c0848c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:43.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.323+0000 7f8e82a0d640 0 -- 172.21.15.62:0/2630933113 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x555613a87e20 msgr2=0x555613a8a270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:43.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.328+0000 7f8e86521800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:43.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.328+0000 7f8e86521800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:43.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.328+0000 7f8e86521800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:43.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.328+0000 7f8e86521800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:43.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.328+0000 7f8e86521800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:43.327 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.328+0000 7f8e86521800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:43.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.328+0000 7f8e86521800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.328+0000 7f8e86521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.328+0000 7f8e86521800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.328+0000 7f8e86521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:43.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.328+0000 7f8e86521800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.329+0000 7f8e86521800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:43.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.329+0000 7f8e86521800 20 zone default found 2024-09-12T00:52:43.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.329+0000 7f8e86521800 4 Realm: () 2024-09-12T00:52:43.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.329+0000 7f8e86521800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:43.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.329+0000 7f8e86521800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:43.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.329+0000 7f8e86521800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:43.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.329+0000 7f8e86521800 20 zonegroup default 2024-09-12T00:52:43.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.329+0000 7f8e86521800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.329+0000 7f8e86521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.329+0000 7f8e86521800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.329+0000 7f8e86521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.329+0000 7f8e86521800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.330+0000 7f8e86521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.330+0000 7f8e86521800 20 started sync module instance, tier type = 2024-09-12T00:52:43.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.330+0000 7f8e86521800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:43.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.339+0000 7f8e86521800 20 add_watcher() i=0 2024-09-12T00:52:43.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.339+0000 7f8e86521800 20 add_watcher() i=1 2024-09-12T00:52:43.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.339+0000 7f8e86521800 20 add_watcher() i=2 2024-09-12T00:52:43.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.339+0000 7f8e86521800 20 add_watcher() i=3 2024-09-12T00:52:43.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.339+0000 7f8e86521800 20 add_watcher() i=4 2024-09-12T00:52:43.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.339+0000 7f8e86521800 20 add_watcher() i=5 2024-09-12T00:52:43.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.339+0000 7f8e86521800 20 add_watcher() i=6 2024-09-12T00:52:43.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.340+0000 7f8e86521800 20 add_watcher() i=7 2024-09-12T00:52:43.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.340+0000 7f8e86521800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:43.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.342+0000 7f8d38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:43.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.342+0000 7f8e86521800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:43.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.342+0000 7f8e86521800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:43.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.342+0000 7f8e86521800 5 note: GC not initialized 2024-09-12T00:52:43.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.343+0000 7f8cb37fe640 20 reqs_thread_entry: start 2024-09-12T00:52:43.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.343+0000 7f8e86521800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:43.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.343+0000 7f8e86521800 20 Filter name: none 2024-09-12T00:52:43.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.343+0000 7f8cb17fa640 20 reqs_thread_entry: start 2024-09-12T00:52:43.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.343+0000 7f8e86521800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.343+0000 7f8e86521800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:43.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.343+0000 7f8e86521800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.344+0000 7f8e86521800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:52:43.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.344+0000 7f8e86521800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:43.343 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.344+0000 7f8e86521800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.344+0000 7f8e86521800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:43.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.344+0000 7f8e86521800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.345+0000 7f8e86521800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:52:43.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.345+0000 7f8e86521800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:43.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.346+0000 7f8d38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:43.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.349+0000 7f8e86521800 20 remove_watcher() i=0 2024-09-12T00:52:43.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.349+0000 7f8e86521800 2 removed watcher, disabling cache 2024-09-12T00:52:43.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.350+0000 7f8e86521800 20 remove_watcher() i=1 2024-09-12T00:52:43.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.351+0000 7f8e86521800 20 remove_watcher() i=2 2024-09-12T00:52:43.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.352+0000 7f8e86521800 20 remove_watcher() i=3 2024-09-12T00:52:43.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.353+0000 7f8e86521800 20 remove_watcher() i=4 2024-09-12T00:52:43.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.354+0000 7f8e86521800 20 remove_watcher() i=5 2024-09-12T00:52:43.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.355+0000 7f8e86521800 20 remove_watcher() i=6 2024-09-12T00:52:43.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.356+0000 7f8e86521800 20 remove_watcher() i=7 2024-09-12T00:52:43.367 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:43.367 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:52:43.367 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-commit-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:52:43.367 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:43.368 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T00:52:43.403 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:43.403 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:43.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.443+0000 7fc06a340800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.445+0000 7fc06a340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.445+0000 7fc06a340800 20 realm 2024-09-12T00:52:43.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.445+0000 7fc06a340800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.446+0000 7fc06a340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.446+0000 7fc06a340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:43.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.446+0000 7fc06a340800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.446+0000 7fc06a340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.445 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.446+0000 7fc06a340800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.447+0000 7fc06a340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:43.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.447+0000 7fc06a340800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.447+0000 7fc06a340800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:43.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.447+0000 7fc06a340800 20 searching for the correct realm 2024-09-12T00:52:43.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.450+0000 7fc0658bf640 0 -- 172.21.15.62:0/2987080885 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fc0600b0640 msgr2=0x7fc0600629d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:43.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.655+0000 7fc0668c1640 0 -- 172.21.15.62:0/2987080885 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55d251d479f0 msgr2=0x55d251d49e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:43.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.660+0000 7fc06a340800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:43.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.660+0000 7fc06a340800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:43.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.660+0000 7fc06a340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:43.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.660+0000 7fc06a340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:43.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.660+0000 7fc06a340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:43.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.660+0000 7fc06a340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:43.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.660+0000 7fc06a340800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.660+0000 7fc06a340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.660+0000 7fc06a340800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.661+0000 7fc06a340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:43.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.661+0000 7fc06a340800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.661+0000 7fc06a340800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:43.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.661+0000 7fc06a340800 20 zone default found 2024-09-12T00:52:43.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.661+0000 7fc06a340800 4 Realm: () 2024-09-12T00:52:43.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.661+0000 7fc06a340800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:43.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.661+0000 7fc06a340800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:43.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.661+0000 7fc06a340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:43.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.661+0000 7fc06a340800 20 zonegroup default 2024-09-12T00:52:43.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.661+0000 7fc06a340800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.661+0000 7fc06a340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.661+0000 7fc06a340800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.661+0000 7fc06a340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.661+0000 7fc06a340800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.662+0000 7fc06a340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.662+0000 7fc06a340800 20 started sync module instance, tier type = 2024-09-12T00:52:43.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.662+0000 7fc06a340800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:43.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.672+0000 7fc06a340800 20 add_watcher() i=0 2024-09-12T00:52:43.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.672+0000 7fc06a340800 20 add_watcher() i=1 2024-09-12T00:52:43.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.672+0000 7fc06a340800 20 add_watcher() i=2 2024-09-12T00:52:43.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.672+0000 7fc06a340800 20 add_watcher() i=3 2024-09-12T00:52:43.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.672+0000 7fc06a340800 20 add_watcher() i=4 2024-09-12T00:52:43.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.672+0000 7fc06a340800 20 add_watcher() i=5 2024-09-12T00:52:43.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.672+0000 7fc06a340800 20 add_watcher() i=6 2024-09-12T00:52:43.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.673+0000 7fc06a340800 20 add_watcher() i=7 2024-09-12T00:52:43.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.673+0000 7fc06a340800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:43.674 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.675+0000 7fbf1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:43.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.675+0000 7fc06a340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:43.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.675+0000 7fc06a340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:43.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.675+0000 7fc06a340800 5 note: GC not initialized 2024-09-12T00:52:43.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.675+0000 7fbe977fe640 20 reqs_thread_entry: start 2024-09-12T00:52:43.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.675+0000 7fc06a340800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:43.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.675+0000 7fc06a340800 20 Filter name: none 2024-09-12T00:52:43.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.676+0000 7fbe957fa640 20 reqs_thread_entry: start 2024-09-12T00:52:43.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.676+0000 7fc06a340800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:52:43.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.676+0000 7fc06a340800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.676+0000 7fc06a340800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:43.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.676+0000 7fc06a340800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:52:43.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.676+0000 7fc06a340800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:52:43.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.676+0000 7fc06a340800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 : miss 2024-09-12T00:52:43.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.676+0000 7fc06a340800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.676+0000 7fc06a340800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:52:43.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.676+0000 7fc06a340800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 info.flags=0x17 2024-09-12T00:52:43.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.676+0000 7fc06a340800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 to cache LRU end 2024-09-12T00:52:43.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.676+0000 7fc06a340800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:43.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.676+0000 7fc06a340800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:43.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.676+0000 7fc06a340800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 2024-09-12T00:52:43.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.680+0000 7fc06a340800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 info.flags=0x17 2024-09-12T00:52:43.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.680+0000 7fc06a340800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 to cache LRU end 2024-09-12T00:52:43.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.680+0000 7fc06a340800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:43.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.680+0000 7fc06a340800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30, ofs0, ns] 2024-09-12T00:52:43.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.680+0000 7fbf49ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431580 cookie 94361804439472 notifier 6836 bl.length()=931 2024-09-12T00:52:43.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.680+0000 7fbf49ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 info.flags=0x17 2024-09-12T00:52:43.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.680+0000 7fbf49ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 to cache LRU end 2024-09-12T00:52:43.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.680+0000 7fbf49ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:43.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.682+0000 7fc06a340800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): orig_sources= new_sources= 2024-09-12T00:52:43.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.682+0000 7fc06a340800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): potential sources added=[] removed=[] 2024-09-12T00:52:43.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.682+0000 7fc06a340800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): orig_dests= new_dests= 2024-09-12T00:52:43.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.682+0000 7fc06a340800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): potential dests added=[] removed=[] 2024-09-12T00:52:43.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.684+0000 7fc06a340800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30.1.0 2024-09-12T00:52:43.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.684+0000 7fc06a340800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30.1.0 2024-09-12T00:52:43.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.684+0000 7fc06a340800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30.1.1 2024-09-12T00:52:43.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.684+0000 7fc06a340800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30.1.1 2024-09-12T00:52:43.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.684+0000 7fc06a340800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30.0 2024-09-12T00:52:43.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.686+0000 7fc06a340800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:43.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.686+0000 7fc06a340800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 2024-09-12T00:52:43.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.688+0000 7fc06a340800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 info.flags=0x17 2024-09-12T00:52:43.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.688+0000 7fc06a340800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 to cache LRU end 2024-09-12T00:52:43.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.688+0000 7fc06a340800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:43.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.688+0000 7fc06a340800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30, ofs0, ns] 2024-09-12T00:52:43.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.688+0000 7fbf49ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431581 cookie 94361804439472 notifier 6836 bl.length()=931 2024-09-12T00:52:43.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.688+0000 7fbf49ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 info.flags=0x17 2024-09-12T00:52:43.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.688+0000 7fbf49ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 to cache LRU end 2024-09-12T00:52:43.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.688+0000 7fbf49ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:43.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.690+0000 7fc06a340800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): orig_sources= new_sources= 2024-09-12T00:52:43.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.690+0000 7fc06a340800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): potential sources added=[] removed=[] 2024-09-12T00:52:43.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.690+0000 7fc06a340800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): orig_dests= new_dests= 2024-09-12T00:52:43.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.690+0000 7fc06a340800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): potential dests added=[] removed=[] 2024-09-12T00:52:43.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.691+0000 7fc06a340800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30.0 2024-09-12T00:52:43.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.691+0000 7fc06a340800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T00:52:43.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.691+0000 7fc06a340800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T00:52:43.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.694+0000 7fbf1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:43.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.696+0000 7fc06a340800 20 remove_watcher() i=0 2024-09-12T00:52:43.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.696+0000 7fc06a340800 2 removed watcher, disabling cache 2024-09-12T00:52:43.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.697+0000 7fc06a340800 20 remove_watcher() i=1 2024-09-12T00:52:43.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.698+0000 7fc06a340800 20 remove_watcher() i=2 2024-09-12T00:52:43.698 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.699+0000 7fc06a340800 20 remove_watcher() i=3 2024-09-12T00:52:43.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.701+0000 7fc06a340800 20 remove_watcher() i=4 2024-09-12T00:52:43.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.702+0000 7fc06a340800 20 remove_watcher() i=5 2024-09-12T00:52:43.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.703+0000 7fc06a340800 20 remove_watcher() i=6 2024-09-12T00:52:43.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.704+0000 7fc06a340800 20 remove_watcher() i=7 2024-09-12T00:52:43.715 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:52:43.745 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:43.745 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:43.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.786+0000 7f027c698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.787+0000 7f027c698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.787+0000 7f027c698800 20 realm 2024-09-12T00:52:43.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.787+0000 7f027c698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.788+0000 7f027c698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.788+0000 7f027c698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:43.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.788+0000 7f027c698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.788+0000 7f027c698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:43.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.788+0000 7f027c698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.789+0000 7f027c698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:43.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.789+0000 7f027c698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:43.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.789+0000 7f027c698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:43.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.789+0000 7f027c698800 20 searching for the correct realm 2024-09-12T00:52:43.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.791+0000 7f027a182640 0 -- 172.21.15.62:0/3020149723 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7f027401f040 msgr2=0x7f027402d920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:43.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:43.795+0000 7f027a983640 0 -- 172.21.15.62:0/3020149723 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7f026c04a070 msgr2=0x7f026c064440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:44.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.003+0000 7f027c698800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:44.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.003+0000 7f027c698800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:44.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.003+0000 7f027c698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:44.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.003+0000 7f027c698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:44.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.003+0000 7f027c698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:44.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.003+0000 7f027c698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:44.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.003+0000 7f027c698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.003+0000 7f027c698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.003+0000 7f027c698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.003+0000 7f027c698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:44.003 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.004+0000 7f027c698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.004+0000 7f027c698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:44.004 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.004+0000 7f027c698800 20 zone default found 2024-09-12T00:52:44.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.004+0000 7f027c698800 4 Realm: () 2024-09-12T00:52:44.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.004+0000 7f027c698800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:44.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.004+0000 7f027c698800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:44.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.004+0000 7f027c698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:44.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.004+0000 7f027c698800 20 zonegroup default 2024-09-12T00:52:44.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.004+0000 7f027c698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.004+0000 7f027c698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.004+0000 7f027c698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.004+0000 7f027c698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.004+0000 7f027c698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.005+0000 7f027c698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.005+0000 7f027c698800 20 started sync module instance, tier type = 2024-09-12T00:52:44.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.005+0000 7f027c698800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:44.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.014+0000 7f027c698800 20 add_watcher() i=0 2024-09-12T00:52:44.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.014+0000 7f027c698800 20 add_watcher() i=1 2024-09-12T00:52:44.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.014+0000 7f027c698800 20 add_watcher() i=2 2024-09-12T00:52:44.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.014+0000 7f027c698800 20 add_watcher() i=3 2024-09-12T00:52:44.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.014+0000 7f027c698800 20 add_watcher() i=4 2024-09-12T00:52:44.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.014+0000 7f027c698800 20 add_watcher() i=5 2024-09-12T00:52:44.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.014+0000 7f027c698800 20 add_watcher() i=6 2024-09-12T00:52:44.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.016+0000 7f027c698800 20 add_watcher() i=7 2024-09-12T00:52:44.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.016+0000 7f027c698800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:44.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.018+0000 7f0130fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:44.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.018+0000 7f027c698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:44.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.018+0000 7f027c698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:44.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.018+0000 7f027c698800 5 note: GC not initialized 2024-09-12T00:52:44.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.018+0000 7f00ab7fe640 20 reqs_thread_entry: start 2024-09-12T00:52:44.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.018+0000 7f027c698800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:44.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.018+0000 7f027c698800 20 Filter name: none 2024-09-12T00:52:44.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.019+0000 7f00a97fa640 20 reqs_thread_entry: start 2024-09-12T00:52:44.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.019+0000 7f027c698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.019+0000 7f027c698800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.019+0000 7f027c698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.019+0000 7f027c698800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:52:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.019+0000 7f027c698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.019+0000 7f027c698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.020+0000 7f027c698800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.020+0000 7f027c698800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.020 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.020+0000 7f027c698800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:52:44.020 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.020+0000 7f027c698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:44.020 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.021+0000 7f0130fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:44.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.024+0000 7f027c698800 20 remove_watcher() i=0 2024-09-12T00:52:44.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.024+0000 7f027c698800 2 removed watcher, disabling cache 2024-09-12T00:52:44.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.025+0000 7f027c698800 20 remove_watcher() i=1 2024-09-12T00:52:44.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.026+0000 7f027c698800 20 remove_watcher() i=2 2024-09-12T00:52:44.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.027+0000 7f027c698800 20 remove_watcher() i=3 2024-09-12T00:52:44.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.028+0000 7f027c698800 20 remove_watcher() i=4 2024-09-12T00:52:44.028 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.029+0000 7f027c698800 20 remove_watcher() i=5 2024-09-12T00:52:44.029 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.030+0000 7f027c698800 20 remove_watcher() i=6 2024-09-12T00:52:44.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.031+0000 7f027c698800 20 remove_watcher() i=7 2024-09-12T00:52:44.041 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:44.041 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:52:44.042 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-commit-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:52:44.042 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:44.135 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:52:44.167 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:44.167 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:44.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.208+0000 7f30cfd0c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.209+0000 7f30cfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.209+0000 7f30cfd0c800 20 realm 2024-09-12T00:52:44.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.209+0000 7f30cfd0c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.209+0000 7f30cfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.209+0000 7f30cfd0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:44.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.209+0000 7f30cfd0c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.210+0000 7f30cfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.210+0000 7f30cfd0c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.210+0000 7f30cfd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:44.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.210+0000 7f30cfd0c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.211+0000 7f30cfd0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:44.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.211+0000 7f30cfd0c800 20 searching for the correct realm 2024-09-12T00:52:44.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.214+0000 7f30ccff5640 0 -- 172.21.15.62:0/512814489 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f30c8022440 msgr2=0x7f30c80228c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:44.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.419+0000 7f30cdff7640 0 -- 172.21.15.62:0/512814489 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55f4c2873360 msgr2=0x55f4c2875750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:44.423 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.424+0000 7f30cfd0c800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:44.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.424+0000 7f30cfd0c800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:44.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.424+0000 7f30cfd0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:44.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.424+0000 7f30cfd0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:44.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.424+0000 7f30cfd0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:44.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.424+0000 7f30cfd0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:44.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.424+0000 7f30cfd0c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.425+0000 7f30cfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.425+0000 7f30cfd0c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.425+0000 7f30cfd0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:44.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.425+0000 7f30cfd0c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.425+0000 7f30cfd0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:44.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.425+0000 7f30cfd0c800 20 zone default found 2024-09-12T00:52:44.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.425+0000 7f30cfd0c800 4 Realm: () 2024-09-12T00:52:44.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.425+0000 7f30cfd0c800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:44.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.425+0000 7f30cfd0c800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:44.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.425+0000 7f30cfd0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:44.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.425+0000 7f30cfd0c800 20 zonegroup default 2024-09-12T00:52:44.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.425+0000 7f30cfd0c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.426+0000 7f30cfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.426+0000 7f30cfd0c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.426+0000 7f30cfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.426+0000 7f30cfd0c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.426+0000 7f30cfd0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.427 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.426+0000 7f30cfd0c800 20 started sync module instance, tier type = 2024-09-12T00:52:44.427 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.426+0000 7f30cfd0c800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:44.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.436+0000 7f30cfd0c800 20 add_watcher() i=0 2024-09-12T00:52:44.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.436+0000 7f30cfd0c800 20 add_watcher() i=1 2024-09-12T00:52:44.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.436+0000 7f30cfd0c800 20 add_watcher() i=2 2024-09-12T00:52:44.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.436+0000 7f30cfd0c800 20 add_watcher() i=3 2024-09-12T00:52:44.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.436+0000 7f30cfd0c800 20 add_watcher() i=4 2024-09-12T00:52:44.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.436+0000 7f30cfd0c800 20 add_watcher() i=5 2024-09-12T00:52:44.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.437+0000 7f30cfd0c800 20 add_watcher() i=6 2024-09-12T00:52:44.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.438+0000 7f30cfd0c800 20 add_watcher() i=7 2024-09-12T00:52:44.437 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.438+0000 7f30cfd0c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:44.439 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.439+0000 7f2f837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:44.439 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.440+0000 7f30cfd0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:44.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.440+0000 7f30cfd0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:44.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.440+0000 7f30cfd0c800 5 note: GC not initialized 2024-09-12T00:52:44.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.440+0000 7f2f827e4640 20 reqs_thread_entry: start 2024-09-12T00:52:44.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.440+0000 7f30cfd0c800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:44.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.440+0000 7f30cfd0c800 20 Filter name: none 2024-09-12T00:52:44.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.440+0000 7f2ef3fff640 20 reqs_thread_entry: start 2024-09-12T00:52:44.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.440+0000 7f30cfd0c800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:52:44.440 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.440+0000 7f30cfd0c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.441+0000 7f30cfd0c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:44.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.441+0000 7f30cfd0c800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:52:44.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.441+0000 7f30cfd0c800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:52:44.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.441+0000 7f30cfd0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 : miss 2024-09-12T00:52:44.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.441+0000 7f30cfd0c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.441 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.441+0000 7f30cfd0c800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:52:44.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.441+0000 7f30cfd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 info.flags=0x17 2024-09-12T00:52:44.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.441+0000 7f30cfd0c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 to cache LRU end 2024-09-12T00:52:44.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.441+0000 7f30cfd0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:44.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.441+0000 7f30cfd0c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:44.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.441+0000 7f30cfd0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 2024-09-12T00:52:44.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.442+0000 7f30cfd0c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:52:44.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.447+0000 7f30cfd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 info.flags=0x17 2024-09-12T00:52:44.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.447+0000 7f30cfd0c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 to cache LRU end 2024-09-12T00:52:44.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.447+0000 7f30cfd0c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:44.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.447+0000 7f30cfd0c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30, ofs0, ns] 2024-09-12T00:52:44.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.447+0000 7f2fb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431582 cookie 94509724093664 notifier 6872 bl.length()=931 2024-09-12T00:52:44.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.447+0000 7f2fb0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 info.flags=0x17 2024-09-12T00:52:44.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.447+0000 7f2fb0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 to cache LRU end 2024-09-12T00:52:44.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.447+0000 7f2fb0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:44.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.449+0000 7f30cfd0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): orig_sources= new_sources= 2024-09-12T00:52:44.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.449+0000 7f30cfd0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): potential sources added=[] removed=[] 2024-09-12T00:52:44.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.449+0000 7f30cfd0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): orig_dests= new_dests= 2024-09-12T00:52:44.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.449+0000 7f30cfd0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): potential dests added=[] removed=[] 2024-09-12T00:52:44.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.451+0000 7f30cfd0c800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30.2.0 2024-09-12T00:52:44.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.451+0000 7f30cfd0c800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30.2.0 2024-09-12T00:52:44.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.451+0000 7f30cfd0c800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30.2.1 2024-09-12T00:52:44.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.451+0000 7f30cfd0c800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30.2.1 2024-09-12T00:52:44.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.451+0000 7f30cfd0c800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30.0 2024-09-12T00:52:44.452 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.453+0000 7f30cfd0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:44.453 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.453+0000 7f30cfd0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 2024-09-12T00:52:44.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.455+0000 7f30cfd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 info.flags=0x17 2024-09-12T00:52:44.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.455+0000 7f30cfd0c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 to cache LRU end 2024-09-12T00:52:44.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.455+0000 7f30cfd0c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:44.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.455+0000 7f30cfd0c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30, ofs0, ns] 2024-09-12T00:52:44.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.455+0000 7f2fb0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431583 cookie 94509724093664 notifier 6872 bl.length()=931 2024-09-12T00:52:44.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.455+0000 7f2fb0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 info.flags=0x17 2024-09-12T00:52:44.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.455+0000 7f2fb0ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 to cache LRU end 2024-09-12T00:52:44.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.455+0000 7f2fb0ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:44.455 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.456+0000 7f30cfd0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): orig_sources= new_sources= 2024-09-12T00:52:44.455 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.456+0000 7f30cfd0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): potential sources added=[] removed=[] 2024-09-12T00:52:44.455 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.456+0000 7f30cfd0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): orig_dests= new_dests= 2024-09-12T00:52:44.455 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.456+0000 7f30cfd0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): potential dests added=[] removed=[] 2024-09-12T00:52:44.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.457+0000 7f30cfd0c800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30.0 2024-09-12T00:52:44.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.458+0000 7f30cfd0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:44.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.458+0000 7f30cfd0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 2024-09-12T00:52:44.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.459+0000 7f30cfd0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 info.flags=0x17 2024-09-12T00:52:44.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.459+0000 7f30cfd0c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 to cache LRU end 2024-09-12T00:52:44.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.459+0000 7f30cfd0c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:44.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.459+0000 7f30cfd0c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30, ofs0, ns] 2024-09-12T00:52:44.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.459+0000 7f2f9ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431584 cookie 94509724093664 notifier 6872 bl.length()=899 2024-09-12T00:52:44.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.459+0000 7f2f9ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 info.flags=0x17 2024-09-12T00:52:44.458 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.459+0000 7f2f9ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 to cache LRU end 2024-09-12T00:52:44.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.459+0000 7f2f9ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:44.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.461+0000 7f30cfd0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): orig_sources= new_sources= 2024-09-12T00:52:44.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.461+0000 7f30cfd0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): potential sources added=[] removed=[] 2024-09-12T00:52:44.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.461+0000 7f30cfd0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): orig_dests= new_dests= 2024-09-12T00:52:44.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.461+0000 7f30cfd0c800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30]): potential dests added=[] removed=[] 2024-09-12T00:52:44.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.462+0000 7f30cfd0c800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:52:44.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.463+0000 7f2f837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:44.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.466+0000 7f30cfd0c800 20 remove_watcher() i=0 2024-09-12T00:52:44.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.466+0000 7f30cfd0c800 2 removed watcher, disabling cache 2024-09-12T00:52:44.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.467+0000 7f30cfd0c800 20 remove_watcher() i=1 2024-09-12T00:52:44.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.468+0000 7f30cfd0c800 20 remove_watcher() i=2 2024-09-12T00:52:44.468 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.469+0000 7f30cfd0c800 20 remove_watcher() i=3 2024-09-12T00:52:44.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.470+0000 7f30cfd0c800 20 remove_watcher() i=4 2024-09-12T00:52:44.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.471+0000 7f30cfd0c800 20 remove_watcher() i=5 2024-09-12T00:52:44.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.472+0000 7f30cfd0c800 20 remove_watcher() i=6 2024-09-12T00:52:44.472 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.474+0000 7f30cfd0c800 20 remove_watcher() i=7 2024-09-12T00:52:44.485 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:52:44.515 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:44.515 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:44.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.554+0000 7ffbed33b800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.556+0000 7ffbed33b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.556+0000 7ffbed33b800 20 realm 2024-09-12T00:52:44.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.556+0000 7ffbed33b800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.556+0000 7ffbed33b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.556+0000 7ffbed33b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:44.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.556+0000 7ffbed33b800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.557+0000 7ffbed33b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.557+0000 7ffbed33b800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.557+0000 7ffbed33b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:44.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.557+0000 7ffbed33b800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.558+0000 7ffbed33b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:44.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.558+0000 7ffbed33b800 20 searching for the correct realm 2024-09-12T00:52:44.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.561+0000 7ffbe88ba640 0 -- 172.21.15.62:0/1373664324 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7ffbe406a990 msgr2=0x7ffbe4087130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:44.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.767+0000 7ffbe98bc640 0 -- 172.21.15.62:0/1373664324 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x564a8aa5ab80 msgr2=0x564a8aa5d020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:44.770 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.771+0000 7ffbed33b800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:44.770 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.771+0000 7ffbed33b800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:44.770 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.771+0000 7ffbed33b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:44.771 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.771+0000 7ffbed33b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:44.771 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.771+0000 7ffbed33b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:44.771 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.771+0000 7ffbed33b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:44.771 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.771+0000 7ffbed33b800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.772+0000 7ffbed33b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.772+0000 7ffbed33b800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.772+0000 7ffbed33b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:44.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.772+0000 7ffbed33b800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.772+0000 7ffbed33b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:44.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.772+0000 7ffbed33b800 20 zone default found 2024-09-12T00:52:44.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.772+0000 7ffbed33b800 4 Realm: () 2024-09-12T00:52:44.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.772+0000 7ffbed33b800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:44.772 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.772+0000 7ffbed33b800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:44.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.772+0000 7ffbed33b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:44.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.772+0000 7ffbed33b800 20 zonegroup default 2024-09-12T00:52:44.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.772+0000 7ffbed33b800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.773+0000 7ffbed33b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.773+0000 7ffbed33b800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.773+0000 7ffbed33b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.773+0000 7ffbed33b800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.773+0000 7ffbed33b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:44.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.773+0000 7ffbed33b800 20 started sync module instance, tier type = 2024-09-12T00:52:44.773 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.773+0000 7ffbed33b800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:44.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.783+0000 7ffbed33b800 20 add_watcher() i=0 2024-09-12T00:52:44.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.783+0000 7ffbed33b800 20 add_watcher() i=1 2024-09-12T00:52:44.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.783+0000 7ffbed33b800 20 add_watcher() i=2 2024-09-12T00:52:44.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.783+0000 7ffbed33b800 20 add_watcher() i=3 2024-09-12T00:52:44.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.783+0000 7ffbed33b800 20 add_watcher() i=4 2024-09-12T00:52:44.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.783+0000 7ffbed33b800 20 add_watcher() i=5 2024-09-12T00:52:44.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.783+0000 7ffbed33b800 20 add_watcher() i=6 2024-09-12T00:52:44.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.784+0000 7ffbed33b800 20 add_watcher() i=7 2024-09-12T00:52:44.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.784+0000 7ffbed33b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:44.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.786+0000 7ffa9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:44.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.786+0000 7ffbed33b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:44.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.786+0000 7ffbed33b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:44.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.786+0000 7ffbed33b800 5 note: GC not initialized 2024-09-12T00:52:44.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.787+0000 7ffa9e7e4640 20 reqs_thread_entry: start 2024-09-12T00:52:44.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.787+0000 7ffbed33b800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:44.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.787+0000 7ffbed33b800 20 Filter name: none 2024-09-12T00:52:44.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.787+0000 7ffa0ffff640 20 reqs_thread_entry: start 2024-09-12T00:52:44.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.787+0000 7ffbed33b800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.787+0000 7ffbed33b800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:44.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.787+0000 7ffbed33b800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.788+0000 7ffbed33b800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:52:44.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.788+0000 7ffbed33b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:44.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.788+0000 7ffbed33b800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.788+0000 7ffbed33b800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:44.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.788+0000 7ffbed33b800 20 rados->read ofs=0 len=0 2024-09-12T00:52:44.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.788+0000 7ffbed33b800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:52:44.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.788+0000 7ffbed33b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:44.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.790+0000 7ffa9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:44.791 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.792+0000 7ffbed33b800 20 remove_watcher() i=0 2024-09-12T00:52:44.791 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.792+0000 7ffbed33b800 2 removed watcher, disabling cache 2024-09-12T00:52:44.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.793+0000 7ffbed33b800 20 remove_watcher() i=1 2024-09-12T00:52:44.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.794+0000 7ffbed33b800 20 remove_watcher() i=2 2024-09-12T00:52:44.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.795+0000 7ffbed33b800 20 remove_watcher() i=3 2024-09-12T00:52:44.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.796+0000 7ffbed33b800 20 remove_watcher() i=4 2024-09-12T00:52:44.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.797+0000 7ffbed33b800 20 remove_watcher() i=5 2024-09-12T00:52:44.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.798+0000 7ffbed33b800 20 remove_watcher() i=6 2024-09-12T00:52:44.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:44.799+0000 7ffbed33b800 20 remove_watcher() i=7 2024-09-12T00:52:44.809 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:44.809 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:52:44.810 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-commit-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:52:44.810 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:45.124 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T00:52:45.125 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:45.977 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:52:46.006 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:46.006 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:46.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.046+0000 7f7a74542800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.048+0000 7f7a74542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.048+0000 7f7a74542800 20 realm 2024-09-12T00:52:46.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.048+0000 7f7a74542800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.048+0000 7f7a74542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.048+0000 7f7a74542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:46.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.048+0000 7f7a74542800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.048+0000 7f7a74542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.048+0000 7f7a74542800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.049+0000 7f7a74542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:46.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.049+0000 7f7a74542800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.050+0000 7f7a74542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:46.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.050+0000 7f7a74542800 20 searching for the correct realm 2024-09-12T00:52:46.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.052+0000 7f7a6fa8c640 0 -- 172.21.15.62:0/2469693950 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f7a68016910 msgr2=0x7f7a680153f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:46.256 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.257+0000 7f7a7028d640 0 -- 172.21.15.62:0/2469693950 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f7a68033900 msgr2=0x7f7a68032380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:46.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.463+0000 7f7a74542800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:46.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:46.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:46.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:46.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:46.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:46.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:46.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:46.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 20 zone default found 2024-09-12T00:52:46.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 4 Realm: () 2024-09-12T00:52:46.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:46.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:46.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:46.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 20 zonegroup default 2024-09-12T00:52:46.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.464+0000 7f7a74542800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.465+0000 7f7a74542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.465+0000 7f7a74542800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.465+0000 7f7a74542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.465+0000 7f7a74542800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.466+0000 7f7a74542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.466+0000 7f7a74542800 20 started sync module instance, tier type = 2024-09-12T00:52:46.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.466+0000 7f7a74542800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:46.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.475+0000 7f7a74542800 20 add_watcher() i=0 2024-09-12T00:52:46.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.475+0000 7f7a74542800 20 add_watcher() i=1 2024-09-12T00:52:46.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.475+0000 7f7a74542800 20 add_watcher() i=2 2024-09-12T00:52:46.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.475+0000 7f7a74542800 20 add_watcher() i=3 2024-09-12T00:52:46.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.475+0000 7f7a74542800 20 add_watcher() i=4 2024-09-12T00:52:46.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.475+0000 7f7a74542800 20 add_watcher() i=5 2024-09-12T00:52:46.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.475+0000 7f7a74542800 20 add_watcher() i=6 2024-09-12T00:52:46.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.476+0000 7f7a74542800 20 add_watcher() i=7 2024-09-12T00:52:46.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.476+0000 7f7a74542800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:46.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.479+0000 7f7926fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:46.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.479+0000 7f7a74542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:46.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.479+0000 7f7a74542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:46.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.479+0000 7f7a74542800 5 note: GC not initialized 2024-09-12T00:52:46.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.479+0000 7f7925fdb640 20 reqs_thread_entry: start 2024-09-12T00:52:46.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.479+0000 7f7a74542800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:46.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.480+0000 7f7a74542800 20 Filter name: none 2024-09-12T00:52:46.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.480+0000 7f78977fe640 20 reqs_thread_entry: start 2024-09-12T00:52:46.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.480+0000 7f7a74542800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.480+0000 7f7a74542800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:46.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.480+0000 7f7a74542800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.481+0000 7f7a74542800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:52:46.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.481+0000 7f7a74542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:46.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.481+0000 7f7a74542800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.481+0000 7f7a74542800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:46.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.481+0000 7f7a74542800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.481+0000 7f7a74542800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:52:46.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.481+0000 7f7a74542800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:46.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.483+0000 7f7926fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:46.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.485+0000 7f7a74542800 20 remove_watcher() i=0 2024-09-12T00:52:46.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.485+0000 7f7a74542800 2 removed watcher, disabling cache 2024-09-12T00:52:46.485 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.486+0000 7f7a74542800 20 remove_watcher() i=1 2024-09-12T00:52:46.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.487+0000 7f7a74542800 20 remove_watcher() i=2 2024-09-12T00:52:46.487 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.489+0000 7f7a74542800 20 remove_watcher() i=3 2024-09-12T00:52:46.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.490+0000 7f7a74542800 20 remove_watcher() i=4 2024-09-12T00:52:46.490 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.491+0000 7f7a74542800 20 remove_watcher() i=5 2024-09-12T00:52:46.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.492+0000 7f7a74542800 20 remove_watcher() i=6 2024-09-12T00:52:46.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.493+0000 7f7a74542800 20 remove_watcher() i=7 2024-09-12T00:52:46.504 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:46.504 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:52:46.504 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-commit-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:52:46.504 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:46.505 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T00:52:46.542 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:46.542 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:46.581 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.582+0000 7f1fa4940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.583 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.584+0000 7f1fa4940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.583 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.584+0000 7f1fa4940800 20 realm 2024-09-12T00:52:46.583 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.584+0000 7f1fa4940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.583 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.584+0000 7f1fa4940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.583 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.584+0000 7f1fa4940800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:46.583 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.584+0000 7f1fa4940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.583 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.584+0000 7f1fa4940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.583 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.584+0000 7f1fa4940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.584 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.585+0000 7f1fa4940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:46.584 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.585+0000 7f1fa4940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.584 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.585+0000 7f1fa4940800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:46.585 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.585+0000 7f1fa4940800 20 searching for the correct realm 2024-09-12T00:52:46.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.588+0000 7f1f97e85640 0 -- 172.21.15.62:0/186251567 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f1f980af090 msgr2=0x7f1f980de0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:46.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.793+0000 7f1fa0e87640 0 -- 172.21.15.62:0/186251567 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x555a5b7e4cc0 msgr2=0x555a5b7e7120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:46.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:46.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:46.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:46.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:46.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:46.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:46.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:46.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:46.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 20 zone default found 2024-09-12T00:52:46.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 4 Realm: () 2024-09-12T00:52:46.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:46.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:46.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:46.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 20 zonegroup default 2024-09-12T00:52:46.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.798+0000 7f1fa4940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.799+0000 7f1fa4940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.799+0000 7f1fa4940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.799+0000 7f1fa4940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.799+0000 7f1fa4940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.799+0000 7f1fa4940800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.799+0000 7f1fa4940800 20 started sync module instance, tier type = 2024-09-12T00:52:46.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.799+0000 7f1fa4940800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:46.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.809+0000 7f1fa4940800 20 add_watcher() i=0 2024-09-12T00:52:46.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.809+0000 7f1fa4940800 20 add_watcher() i=1 2024-09-12T00:52:46.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.809+0000 7f1fa4940800 20 add_watcher() i=2 2024-09-12T00:52:46.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.809+0000 7f1fa4940800 20 add_watcher() i=3 2024-09-12T00:52:46.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.809+0000 7f1fa4940800 20 add_watcher() i=4 2024-09-12T00:52:46.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.809+0000 7f1fa4940800 20 add_watcher() i=5 2024-09-12T00:52:46.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.809+0000 7f1fa4940800 20 add_watcher() i=6 2024-09-12T00:52:46.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.810+0000 7f1fa4940800 20 add_watcher() i=7 2024-09-12T00:52:46.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.810+0000 7f1fa4940800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:46.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.812+0000 7f1e56fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:46.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.813+0000 7f1fa4940800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:46.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.813+0000 7f1fa4940800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:46.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.813+0000 7f1fa4940800 5 note: GC not initialized 2024-09-12T00:52:46.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.813+0000 7f1e55fdb640 20 reqs_thread_entry: start 2024-09-12T00:52:46.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.813+0000 7f1fa4940800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:46.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.813+0000 7f1fa4940800 20 Filter name: none 2024-09-12T00:52:46.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.813+0000 7f1dc77fe640 20 reqs_thread_entry: start 2024-09-12T00:52:46.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.813+0000 7f1fa4940800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:52:46.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.813+0000 7f1fa4940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.814+0000 7f1fa4940800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:46.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.814+0000 7f1fa4940800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:52:46.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.814+0000 7f1fa4940800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:52:46.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.814+0000 7f1fa4940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 : miss 2024-09-12T00:52:46.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.814+0000 7f1fa4940800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.814+0000 7f1fa4940800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:52:46.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.814+0000 7f1fa4940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 info.flags=0x17 2024-09-12T00:52:46.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.814+0000 7f1fa4940800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 to cache LRU end 2024-09-12T00:52:46.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.814+0000 7f1fa4940800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:46.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.814+0000 7f1fa4940800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:46.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.814+0000 7f1fa4940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 2024-09-12T00:52:46.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.818+0000 7f1fa4940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 info.flags=0x17 2024-09-12T00:52:46.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.818+0000 7f1fa4940800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 to cache LRU end 2024-09-12T00:52:46.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.818+0000 7f1fa4940800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:46.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.818+0000 7f1fa4940800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31, ofs0, ns] 2024-09-12T00:52:46.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.819+0000 7f1e777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431587 cookie 93846570492688 notifier 7293 bl.length()=931 2024-09-12T00:52:46.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.819+0000 7f1e777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 info.flags=0x17 2024-09-12T00:52:46.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.819+0000 7f1e777fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 to cache LRU end 2024-09-12T00:52:46.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.819+0000 7f1e777fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:46.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.820+0000 7f1fa4940800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31]): orig_sources= new_sources= 2024-09-12T00:52:46.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.820+0000 7f1fa4940800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31]): potential sources added=[] removed=[] 2024-09-12T00:52:46.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.820+0000 7f1fa4940800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31]): orig_dests= new_dests= 2024-09-12T00:52:46.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.820+0000 7f1fa4940800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31]): potential dests added=[] removed=[] 2024-09-12T00:52:46.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.823+0000 7f1fa4940800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31.1.0 2024-09-12T00:52:46.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.823+0000 7f1fa4940800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31.1.0 2024-09-12T00:52:46.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.823+0000 7f1fa4940800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31.1.1 2024-09-12T00:52:46.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.823+0000 7f1fa4940800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31.1.1 2024-09-12T00:52:46.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.823+0000 7f1fa4940800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31.0 2024-09-12T00:52:46.824 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.825+0000 7f1fa4940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:46.824 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.825+0000 7f1fa4940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 2024-09-12T00:52:46.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.826+0000 7f1fa4940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 info.flags=0x17 2024-09-12T00:52:46.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.826+0000 7f1fa4940800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 to cache LRU end 2024-09-12T00:52:46.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.826+0000 7f1fa4940800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:46.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.826+0000 7f1fa4940800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31, ofs0, ns] 2024-09-12T00:52:46.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.827+0000 7f1e777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431588 cookie 93846570492688 notifier 7293 bl.length()=931 2024-09-12T00:52:46.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.827+0000 7f1e777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 info.flags=0x17 2024-09-12T00:52:46.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.827+0000 7f1e777fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 to cache LRU end 2024-09-12T00:52:46.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.827+0000 7f1e777fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:46.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.828+0000 7f1fa4940800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31]): orig_sources= new_sources= 2024-09-12T00:52:46.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.828+0000 7f1fa4940800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31]): potential sources added=[] removed=[] 2024-09-12T00:52:46.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.828+0000 7f1fa4940800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31]): orig_dests= new_dests= 2024-09-12T00:52:46.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.828+0000 7f1fa4940800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31]): potential dests added=[] removed=[] 2024-09-12T00:52:46.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.829+0000 7f1fa4940800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31.0 2024-09-12T00:52:46.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.830+0000 7f1fa4940800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T00:52:46.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.830+0000 7f1fa4940800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:46.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.830+0000 7f1fa4940800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 2024-09-12T00:52:46.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.831+0000 7f1fa4940800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 info.flags=0x17 2024-09-12T00:52:46.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.831+0000 7f1fa4940800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 to cache LRU end 2024-09-12T00:52:46.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.831+0000 7f1fa4940800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:46.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.831+0000 7f1fa4940800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31, ofs0, ns] 2024-09-12T00:52:46.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.831+0000 7f1e76ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431589 cookie 93846570492688 notifier 7293 bl.length()=899 2024-09-12T00:52:46.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.831+0000 7f1e76ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 info.flags=0x17 2024-09-12T00:52:46.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.831+0000 7f1e76ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 to cache LRU end 2024-09-12T00:52:46.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.831+0000 7f1e76ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:46.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.832+0000 7f1fa4940800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31]): orig_sources= new_sources= 2024-09-12T00:52:46.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.832+0000 7f1fa4940800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31]): potential sources added=[] removed=[] 2024-09-12T00:52:46.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.832+0000 7f1fa4940800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31]): orig_dests= new_dests= 2024-09-12T00:52:46.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.832+0000 7f1fa4940800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31]): potential dests added=[] removed=[] 2024-09-12T00:52:46.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.833+0000 7f1fa4940800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:52:46.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.835+0000 7f1e56fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:46.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.838+0000 7f1fa4940800 20 remove_watcher() i=0 2024-09-12T00:52:46.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.838+0000 7f1fa4940800 2 removed watcher, disabling cache 2024-09-12T00:52:46.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.839+0000 7f1fa4940800 20 remove_watcher() i=1 2024-09-12T00:52:46.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.840+0000 7f1fa4940800 20 remove_watcher() i=2 2024-09-12T00:52:46.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.841+0000 7f1fa4940800 20 remove_watcher() i=3 2024-09-12T00:52:46.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.842+0000 7f1fa4940800 20 remove_watcher() i=4 2024-09-12T00:52:46.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.843+0000 7f1fa4940800 20 remove_watcher() i=5 2024-09-12T00:52:46.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.844+0000 7f1fa4940800 20 remove_watcher() i=6 2024-09-12T00:52:46.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.846+0000 7f1fa4940800 20 remove_watcher() i=7 2024-09-12T00:52:46.857 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:52:46.886 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:46.886 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:46.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.926+0000 7f6800e13800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.928+0000 7f6800e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.928+0000 7f6800e13800 20 realm 2024-09-12T00:52:46.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.928+0000 7f6800e13800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.929+0000 7f6800e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.929+0000 7f6800e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:46.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.929+0000 7f6800e13800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.929+0000 7f6800e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:46.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.929+0000 7f6800e13800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.929+0000 7f6800e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:46.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.929+0000 7f6800e13800 20 rados->read ofs=0 len=0 2024-09-12T00:52:46.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.930+0000 7f6800e13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:46.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.930+0000 7f6800e13800 20 searching for the correct realm 2024-09-12T00:52:46.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:46.933+0000 7f67fbd21640 0 -- 172.21.15.62:0/3284397065 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f67f406d2d0 msgr2=0x7f67f409b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:47.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.138+0000 7f67fcd23640 0 -- 172.21.15.62:0/3284397065 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x563d7cd5ef00 msgr2=0x563d7cd612f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:47.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.142+0000 7f6800e13800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:47.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.142+0000 7f6800e13800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:47.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.142+0000 7f6800e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:47.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.142+0000 7f6800e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:47.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.142+0000 7f6800e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:47.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.142+0000 7f6800e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:47.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.142+0000 7f6800e13800 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.142+0000 7f6800e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:47.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.142+0000 7f6800e13800 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.143+0000 7f6800e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:47.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.143+0000 7f6800e13800 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.143+0000 7f6800e13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:47.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.143+0000 7f6800e13800 20 zone default found 2024-09-12T00:52:47.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.143+0000 7f6800e13800 4 Realm: () 2024-09-12T00:52:47.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.143+0000 7f6800e13800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:47.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.143+0000 7f6800e13800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:47.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.143+0000 7f6800e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:47.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.143+0000 7f6800e13800 20 zonegroup default 2024-09-12T00:52:47.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.143+0000 7f6800e13800 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.143+0000 7f6800e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:47.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.143+0000 7f6800e13800 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.144+0000 7f6800e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:47.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.144+0000 7f6800e13800 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.144+0000 7f6800e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:47.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.144+0000 7f6800e13800 20 started sync module instance, tier type = 2024-09-12T00:52:47.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.144+0000 7f6800e13800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:47.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.153+0000 7f6800e13800 20 add_watcher() i=0 2024-09-12T00:52:47.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.153+0000 7f6800e13800 20 add_watcher() i=1 2024-09-12T00:52:47.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.153+0000 7f6800e13800 20 add_watcher() i=2 2024-09-12T00:52:47.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.153+0000 7f6800e13800 20 add_watcher() i=3 2024-09-12T00:52:47.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.153+0000 7f6800e13800 20 add_watcher() i=4 2024-09-12T00:52:47.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.153+0000 7f6800e13800 20 add_watcher() i=5 2024-09-12T00:52:47.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.153+0000 7f6800e13800 20 add_watcher() i=6 2024-09-12T00:52:47.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.154+0000 7f6800e13800 20 add_watcher() i=7 2024-09-12T00:52:47.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.154+0000 7f6800e13800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:47.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.156+0000 7f66b2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:47.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.156+0000 7f6800e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:47.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.156+0000 7f6800e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:47.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.156+0000 7f6800e13800 5 note: GC not initialized 2024-09-12T00:52:47.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.157+0000 7f66b1fdb640 20 reqs_thread_entry: start 2024-09-12T00:52:47.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.157+0000 7f6800e13800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:47.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.157+0000 7f6800e13800 20 Filter name: none 2024-09-12T00:52:47.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.157+0000 7f66237fe640 20 reqs_thread_entry: start 2024-09-12T00:52:47.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.157+0000 7f6800e13800 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.157+0000 7f6800e13800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:47.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.157+0000 7f6800e13800 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.158+0000 7f6800e13800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:52:47.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.158+0000 7f6800e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:47.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.158+0000 7f6800e13800 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.158+0000 7f6800e13800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:47.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.158+0000 7f6800e13800 20 rados->read ofs=0 len=0 2024-09-12T00:52:47.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.158+0000 7f6800e13800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:52:47.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.158+0000 7f6800e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:47.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.160+0000 7f66b2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:47.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.162+0000 7f6800e13800 20 remove_watcher() i=0 2024-09-12T00:52:47.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.162+0000 7f6800e13800 2 removed watcher, disabling cache 2024-09-12T00:52:47.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.163+0000 7f6800e13800 20 remove_watcher() i=1 2024-09-12T00:52:47.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.164+0000 7f6800e13800 20 remove_watcher() i=2 2024-09-12T00:52:47.164 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.165+0000 7f6800e13800 20 remove_watcher() i=3 2024-09-12T00:52:47.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.166+0000 7f6800e13800 20 remove_watcher() i=4 2024-09-12T00:52:47.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.167+0000 7f6800e13800 20 remove_watcher() i=5 2024-09-12T00:52:47.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.168+0000 7f6800e13800 20 remove_watcher() i=6 2024-09-12T00:52:47.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:47.169+0000 7f6800e13800 20 remove_watcher() i=7 2024-09-12T00:52:47.179 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:47.179 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:52:47.179 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-commit-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:52:47.180 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:47.494 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T00:52:47.494 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:48.354 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:52:48.383 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:48.383 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:48.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.423+0000 7fc8f6820800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.425+0000 7fc8f6820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:48.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.425+0000 7fc8f6820800 20 realm 2024-09-12T00:52:48.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.425+0000 7fc8f6820800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.425+0000 7fc8f6820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:48.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.425+0000 7fc8f6820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:48.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.425+0000 7fc8f6820800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.425+0000 7fc8f6820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:48.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.425+0000 7fc8f6820800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.426+0000 7fc8f6820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:48.425 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.426+0000 7fc8f6820800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.427+0000 7fc8f6820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:48.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.427+0000 7fc8f6820800 20 searching for the correct realm 2024-09-12T00:52:48.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.429+0000 7fc8f3b09640 0 -- 172.21.15.62:0/577789496 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fc8ec062910 msgr2=0x7fc8ec0077b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:48.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.634+0000 7fc8f4b0b640 0 -- 172.21.15.62:0/577789496 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x564d2ba46b90 msgr2=0x564d2ba49050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:48.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.638+0000 7fc8f6820800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:48.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.638+0000 7fc8f6820800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:48.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.638+0000 7fc8f6820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:48.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.638+0000 7fc8f6820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:48.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.638+0000 7fc8f6820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:48.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.638+0000 7fc8f6820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:48.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.638+0000 7fc8f6820800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.638+0000 7fc8f6820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:48.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.638+0000 7fc8f6820800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.638+0000 7fc8f6820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:48.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.638+0000 7fc8f6820800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.639+0000 7fc8f6820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:48.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.639+0000 7fc8f6820800 20 zone default found 2024-09-12T00:52:48.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.639+0000 7fc8f6820800 4 Realm: () 2024-09-12T00:52:48.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.639+0000 7fc8f6820800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:48.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.639+0000 7fc8f6820800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:48.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.639+0000 7fc8f6820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:48.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.639+0000 7fc8f6820800 20 zonegroup default 2024-09-12T00:52:48.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.639+0000 7fc8f6820800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.639+0000 7fc8f6820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:48.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.639+0000 7fc8f6820800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.639+0000 7fc8f6820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:48.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.639+0000 7fc8f6820800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.639+0000 7fc8f6820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:48.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.639+0000 7fc8f6820800 20 started sync module instance, tier type = 2024-09-12T00:52:48.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.640+0000 7fc8f6820800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:48.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.648+0000 7fc8f6820800 20 add_watcher() i=0 2024-09-12T00:52:48.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.648+0000 7fc8f6820800 20 add_watcher() i=1 2024-09-12T00:52:48.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.648+0000 7fc8f6820800 20 add_watcher() i=2 2024-09-12T00:52:48.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.648+0000 7fc8f6820800 20 add_watcher() i=3 2024-09-12T00:52:48.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.648+0000 7fc8f6820800 20 add_watcher() i=4 2024-09-12T00:52:48.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.648+0000 7fc8f6820800 20 add_watcher() i=5 2024-09-12T00:52:48.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.648+0000 7fc8f6820800 20 add_watcher() i=6 2024-09-12T00:52:48.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.649+0000 7fc8f6820800 20 add_watcher() i=7 2024-09-12T00:52:48.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.649+0000 7fc8f6820800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:48.650 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.651+0000 7fc7aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:48.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.651+0000 7fc8f6820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:48.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.651+0000 7fc8f6820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:48.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.652+0000 7fc8f6820800 5 note: GC not initialized 2024-09-12T00:52:48.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.652+0000 7fc7a9fdb640 20 reqs_thread_entry: start 2024-09-12T00:52:48.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.652+0000 7fc8f6820800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:48.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.652+0000 7fc8f6820800 20 Filter name: none 2024-09-12T00:52:48.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.652+0000 7fc71b7fe640 20 reqs_thread_entry: start 2024-09-12T00:52:48.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.652+0000 7fc8f6820800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.653+0000 7fc8f6820800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:48.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.653+0000 7fc8f6820800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.653+0000 7fc8f6820800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:52:48.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.653+0000 7fc8f6820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:48.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.653+0000 7fc8f6820800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.654+0000 7fc8f6820800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:48.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.654+0000 7fc8f6820800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.654+0000 7fc8f6820800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:52:48.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.654+0000 7fc8f6820800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:48.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.656+0000 7fc7aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:48.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.658+0000 7fc8f6820800 20 remove_watcher() i=0 2024-09-12T00:52:48.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.658+0000 7fc8f6820800 2 removed watcher, disabling cache 2024-09-12T00:52:48.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.659+0000 7fc8f6820800 20 remove_watcher() i=1 2024-09-12T00:52:48.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.660+0000 7fc8f6820800 20 remove_watcher() i=2 2024-09-12T00:52:48.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.661+0000 7fc8f6820800 20 remove_watcher() i=3 2024-09-12T00:52:48.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.662+0000 7fc8f6820800 20 remove_watcher() i=4 2024-09-12T00:52:48.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.663+0000 7fc8f6820800 20 remove_watcher() i=5 2024-09-12T00:52:48.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.664+0000 7fc8f6820800 20 remove_watcher() i=6 2024-09-12T00:52:48.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.665+0000 7fc8f6820800 20 remove_watcher() i=7 2024-09-12T00:52:48.675 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:48.675 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:52:48.675 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-commit-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:52:48.676 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:48.677 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T00:52:48.712 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:48.712 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:48.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.751+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.752 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:48.752 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 realm 2024-09-12T00:52:48.752 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.752 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:48.752 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.753+0000 7fa7a7f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:48.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:48.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.754+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:48.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.754+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.755+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:48.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.755+0000 7fa7a7f46800 20 searching for the correct realm 2024-09-12T00:52:48.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.757+0000 7fa7a5236640 0 -- 172.21.15.62:0/3224614348 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fa7a000e8d0 msgr2=0x7fa7a001e3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:48.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.962+0000 7fa7a6238640 0 -- 172.21.15.62:0/3224614348 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55a4608ca3a0 msgr2=0x55a4608cc7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:48.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:48.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:48.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:48.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:48.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:48.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:48.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:48.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:48.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:48.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 zone default found 2024-09-12T00:52:48.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.968+0000 7fa7a7f46800 4 Realm: () 2024-09-12T00:52:48.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.968+0000 7fa7a7f46800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:48.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.968+0000 7fa7a7f46800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:48.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.968+0000 7fa7a7f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:48.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 zonegroup default 2024-09-12T00:52:48.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:48.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:48.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:48.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 started sync module instance, tier type = 2024-09-12T00:52:48.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:48.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=0 2024-09-12T00:52:48.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=1 2024-09-12T00:52:48.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=2 2024-09-12T00:52:48.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=3 2024-09-12T00:52:48.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=4 2024-09-12T00:52:48.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=5 2024-09-12T00:52:48.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=6 2024-09-12T00:52:48.977 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.978+0000 7fa7a7f46800 20 add_watcher() i=7 2024-09-12T00:52:48.977 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.978+0000 7fa7a7f46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:48.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.980+0000 7fa657fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:48.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.980+0000 7fa7a7f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:48.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.980+0000 7fa7a7f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:48.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 note: GC not initialized 2024-09-12T00:52:48.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.980+0000 7fa656ffd640 20 reqs_thread_entry: start 2024-09-12T00:52:48.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.981+0000 7fa7a7f46800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:48.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.981+0000 7fa7a7f46800 20 Filter name: none 2024-09-12T00:52:48.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.981+0000 7fa654ff9640 20 reqs_thread_entry: start 2024-09-12T00:52:48.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.981+0000 7fa7a7f46800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:52:48.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.981+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.981+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:48.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.981+0000 7fa7a7f46800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:52:48.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.981+0000 7fa7a7f46800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:52:48.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.981+0000 7fa7a7f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 : miss 2024-09-12T00:52:48.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.981+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:48.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.982+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:52:48.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.982+0000 7fa7a7f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:52:48.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.982+0000 7fa7a7f46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:52:48.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.982+0000 7fa7a7f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:48.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.982+0000 7fa7a7f46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:48.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.982+0000 7fa7a7f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 2024-09-12T00:52:48.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.986+0000 7fa7a7f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:52:48.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.986+0000 7fa7a7f46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:52:48.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.986+0000 7fa7a7f46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:48.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.986+0000 7fa7a7f46800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32, ofs0, ns] 2024-09-12T00:52:48.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.986+0000 7fa6897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431653 cookie 94164482890688 notifier 7353 bl.length()=931 2024-09-12T00:52:48.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.986+0000 7fa6897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:52:48.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.986+0000 7fa6897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:52:48.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.986+0000 7fa6897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:48.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.988+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_sources= new_sources= 2024-09-12T00:52:48.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.988+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential sources added=[] removed=[] 2024-09-12T00:52:48.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.988+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_dests= new_dests= 2024-09-12T00:52:48.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.988+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential dests added=[] removed=[] 2024-09-12T00:52:48.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.990+0000 7fa7a7f46800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.0 2024-09-12T00:52:48.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.990+0000 7fa7a7f46800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.0 2024-09-12T00:52:48.990 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.990+0000 7fa7a7f46800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.1 2024-09-12T00:52:48.990 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.990+0000 7fa7a7f46800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.1 2024-09-12T00:52:48.990 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.990+0000 7fa7a7f46800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.0 2024-09-12T00:52:48.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.993+0000 7fa7a7f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:48.992 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.993+0000 7fa7a7f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 2024-09-12T00:52:48.993 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.994+0000 7fa7a7f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:52:48.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.994+0000 7fa7a7f46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:52:48.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.994+0000 7fa7a7f46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:48.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.994+0000 7fa7a7f46800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32, ofs0, ns] 2024-09-12T00:52:48.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.995+0000 7fa6897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431654 cookie 94164482890688 notifier 7353 bl.length()=931 2024-09-12T00:52:48.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.995+0000 7fa6897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:52:48.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.995+0000 7fa6897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:52:48.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.995+0000 7fa6897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:48.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.996+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_sources= new_sources= 2024-09-12T00:52:48.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.996+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential sources added=[] removed=[] 2024-09-12T00:52:48.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.996+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_dests= new_dests= 2024-09-12T00:52:48.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.996+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential dests added=[] removed=[] 2024-09-12T00:52:48.996 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.997+0000 7fa7a7f46800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.0 2024-09-12T00:52:48.997 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa7a7f46800 time 2024-09-12T00:52:48.999124+0000 2024-09-12T00:52:48.997 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:48.997 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:48.998 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa7ab58c71a] 2024-09-12T00:52:48.998 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa7ab58c8d8] 2024-09-12T00:52:48.998 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a45e88a641] 2024-09-12T00:52:48.998 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a45e89a637] 2024-09-12T00:52:48.998 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:52:48.998 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa7aa229590] 2024-09-12T00:52:48.998 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:52:48.998 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:52:48.998 INFO:tasks.workunit.client.0.smithi062.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:52:48.998 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7fa7a7f46800 thread_name:radosgw-admin 2024-09-12T00:52:48.998 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.998+0000 7fa7a7f46800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa7a7f46800 time 2024-09-12T00:52:48.999124+0000 2024-09-12T00:52:48.998 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:48.998 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:48.999 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:48.999 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa7ab58c71a] 2024-09-12T00:52:48.999 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa7ab58c8d8] 2024-09-12T00:52:48.999 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a45e88a641] 2024-09-12T00:52:48.999 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a45e89a637] 2024-09-12T00:52:48.999 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:52:48.999 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa7aa229590] 2024-09-12T00:52:48.999 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:52:48.999 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:52:48.999 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.013 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:49.013 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa7aa23e6f0] 2024-09-12T00:52:49.013 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa7aa28b99c] 2024-09-12T00:52:49.013 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:52:49.013 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:52:49.013 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa7ab58c774] 2024-09-12T00:52:49.013 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa7ab58c8d8] 2024-09-12T00:52:49.014 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a45e88a641] 2024-09-12T00:52:49.014 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a45e89a637] 2024-09-12T00:52:49.014 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:52:49.014 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa7aa229590] 2024-09-12T00:52:49.014 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:52:49.014 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:52:49.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:48.999+0000 7fa7a7f46800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:49.014 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7fa7a7f46800 thread_name:radosgw-admin 2024-09-12T00:52:49.014 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.014 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:49.014 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa7aa23e6f0] 2024-09-12T00:52:49.014 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa7aa28b99c] 2024-09-12T00:52:49.014 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:52:49.015 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:52:49.015 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa7ab58c774] 2024-09-12T00:52:49.015 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa7ab58c8d8] 2024-09-12T00:52:49.015 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a45e88a641] 2024-09-12T00:52:49.015 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a45e89a637] 2024-09-12T00:52:49.015 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:52:49.015 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa7aa229590] 2024-09-12T00:52:49.015 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:52:49.015 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:52:49.015 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:49.015 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.016 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:52:49.016 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607e5470) adding con mode: secure 2024-09-12T00:52:49.016 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607e5470) adding con mode: crc 2024-09-12T00:52:49.016 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607e5470) adding con mode: secure 2024-09-12T00:52:49.016 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.016 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 1 librados: starting msgr at 2024-09-12T00:52:49.016 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 1 librados: starting objecter 2024-09-12T00:52:49.016 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command objecter_requests hook 0x55a460810be0 2024-09-12T00:52:49.017 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 1 librados: setting wanted keys 2024-09-12T00:52:49.017 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 1 librados: calling monclient init 2024-09-12T00:52:49.017 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 10 monclient: init 2024-09-12T00:52:49.017 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding auth protocol: cephx 2024-09-12T00:52:49.017 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding auth protocol: cephx 2024-09-12T00:52:49.017 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding auth protocol: cephx 2024-09-12T00:52:49.017 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: secure 2024-09-12T00:52:49.017 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: crc 2024-09-12T00:52:49.017 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: secure 2024-09-12T00:52:49.017 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: crc 2024-09-12T00:52:49.017 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: secure 2024-09-12T00:52:49.017 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: crc 2024-09-12T00:52:49.017 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: crc 2024-09-12T00:52:49.018 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: secure 2024-09-12T00:52:49.018 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: crc 2024-09-12T00:52:49.018 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: secure 2024-09-12T00:52:49.018 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: crc 2024-09-12T00:52:49.018 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: secure 2024-09-12T00:52:49.018 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.018 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.018 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command rotate-key hook 0x55a4607df8d8 2024-09-12T00:52:49.018 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:49.018 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:49.018 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-b con 0x55a460657230 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:49.018 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-c con 0x55a460722c80 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:49.018 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-a con 0x55a460729550 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:49.019 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.019 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.019 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.019 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:49.019 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): authenticate will time out at 2055.229496s 2024-09-12T00:52:49.019 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): get_auth_request con 0x55a460722c80 auth_method 0 2024-09-12T00:52:49.019 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.019 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.019 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.019 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:52:48.736+0000 7fa7a6238640 10 monclient(hunting): get_auth_request con 0x55a460729550 auth_method 0 2024-09-12T00:52:49.019 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:52:48.736+0000 7fa7a6238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.019 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:52:48.736+0000 7fa7a6238640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.019 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:52:48.736+0000 7fa7a6238640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.020 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.020 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.020 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.020 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:52:48.736+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.020 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:52:48.736+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.020 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:52:48.736+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.020 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:52:48.736+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request con 0x55a460657230 auth_method 0 2024-09-12T00:52:49.020 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:52:48.736+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.020 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:52:48.736+0000 7fa7a5a37640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.021 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:52:48.736+0000 7fa7a5a37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.021 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:52:48.736+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.021 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:52:48.736+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.021 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:52:48.736+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.021 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): handle_auth_done global_id 6962 payload 824 2024-09-12T00:52:49.021 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient: _finish_hunting 0 2024-09-12T00:52:49.021 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:52:48.736+0000 7fa7a5236640 1 monclient: found mon.noname-c 2024-09-12T00:52:49.021 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:52:49.021 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.021 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:52:49.021 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: dump: 2024-09-12T00:52:49.021 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.022 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.022 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.022 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: _finish_auth 0 2024-09-12T00:52:49.022 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: _check_auth_tickets 2024-09-12T00:52:49.022 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:49.022 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.023 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:52:49.023 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: dump: 2024-09-12T00:52:49.023 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.023 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.023 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.023 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.023 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.023 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.023 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.023 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.023 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.023 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.023 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:52:48.737+0000 7fa7a7f46800 5 monclient: authenticate success, global_id 6962 2024-09-12T00:52:49.023 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:52:48.737+0000 7fa7a7f46800 10 monclient: _renew_subs 2024-09-12T00:52:49.024 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:52:48.737+0000 7fa7a7f46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:52:49.024 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:52:48.737+0000 7fa693e07640 4 set_mon_vals no callback set 2024-09-12T00:52:49.024 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:52:48.737+0000 7fa7a7f46800 10 monclient: _renew_subs 2024-09-12T00:52:49.024 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:52:48.737+0000 7fa7a7f46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:52:49.024 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:52:48.737+0000 7fa7a7f46800 1 librados: init done 2024-09-12T00:52:49.024 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:52:48.739+0000 7fa692604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:49.024 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:52:48.739+0000 7fa692604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:49.024 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:52:48.739+0000 7fa692604640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:49.024 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:52:48.739+0000 7fa7a5a37640 10 monclient: get_auth_request con 0x7fa68c0764a0 auth_method 0 2024-09-12T00:52:49.024 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:52:48.739+0000 7fa7a6238640 10 monclient: get_auth_request con 0x55a460827f00 auth_method 0 2024-09-12T00:52:49.024 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:52:48.740+0000 7fa7a5a37640 10 monclient: get_auth_request con 0x55a46082b0e0 auth_method 0 2024-09-12T00:52:49.024 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:52:48.741+0000 7fa7a5236640 10 monclient: get_auth_request con 0x55a46082f2d0 auth_method 0 2024-09-12T00:52:49.024 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 10 monclient: build_initial_monmap 2024-09-12T00:52:49.025 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 1 build_initial for_mkfs: 0 2024-09-12T00:52:49.025 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 10 monclient: monmap: 2024-09-12T00:52:49.025 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:52:49.025 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:49.025 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:52:49.025 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:52:49.025 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:49.025 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.025 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:52:49.025 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:52:49.025 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:52:49.025 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.026 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding auth protocol: cephx 2024-09-12T00:52:49.026 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding auth protocol: cephx 2024-09-12T00:52:49.026 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding auth protocol: cephx 2024-09-12T00:52:49.026 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: secure 2024-09-12T00:52:49.026 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: crc 2024-09-12T00:52:49.026 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: secure 2024-09-12T00:52:49.026 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: crc 2024-09-12T00:52:49.026 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: secure 2024-09-12T00:52:49.026 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: crc 2024-09-12T00:52:49.026 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: crc 2024-09-12T00:52:49.026 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: secure 2024-09-12T00:52:49.026 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: crc 2024-09-12T00:52:49.026 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: secure 2024-09-12T00:52:49.027 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: crc 2024-09-12T00:52:49.027 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: secure 2024-09-12T00:52:49.027 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.027 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command objecter_requests cmddesc objecter_requests hook 0x55a460837560 EEXIST 2024-09-12T00:52:49.027 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 10 monclient: init 2024-09-12T00:52:49.027 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding auth protocol: cephx 2024-09-12T00:52:49.027 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding auth protocol: cephx 2024-09-12T00:52:49.027 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding auth protocol: cephx 2024-09-12T00:52:49.027 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: secure 2024-09-12T00:52:49.027 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: crc 2024-09-12T00:52:49.027 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: secure 2024-09-12T00:52:49.027 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: crc 2024-09-12T00:52:49.027 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: secure 2024-09-12T00:52:49.027 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: crc 2024-09-12T00:52:49.028 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: crc 2024-09-12T00:52:49.028 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: secure 2024-09-12T00:52:49.028 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: crc 2024-09-12T00:52:49.028 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: secure 2024-09-12T00:52:49.028 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: crc 2024-09-12T00:52:49.028 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: secure 2024-09-12T00:52:49.028 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.028 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.028 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command rotate-key cmddesc rotate-key hook 0x55a460832900 EEXIST 2024-09-12T00:52:49.028 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:49.028 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:52:49.028 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-c con 0x55a46085b880 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:49.028 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-a con 0x55a46085bc60 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:49.029 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-b con 0x55a46085a590 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:49.029 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.029 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.029 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.029 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:49.029 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): authenticate will time out at 2055.236472s 2024-09-12T00:52:49.029 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): get_auth_request con 0x55a46085bc60 auth_method 0 2024-09-12T00:52:49.029 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.029 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.029 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.029 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:52:48.743+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request con 0x55a46085b880 auth_method 0 2024-09-12T00:52:49.029 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:52:48.743+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.029 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:52:48.743+0000 7fa7a5a37640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.030 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:52:48.743+0000 7fa7a5a37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.030 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.030 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.030 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.030 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:52:48.743+0000 7fa7a6238640 10 monclient(hunting): get_auth_request con 0x55a46085a590 auth_method 0 2024-09-12T00:52:49.030 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:52:48.743+0000 7fa7a6238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.030 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:52:48.743+0000 7fa7a6238640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.030 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:52:48.743+0000 7fa7a6238640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.030 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:52:48.743+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.030 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:52:48.743+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.030 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:52:48.743+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.030 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): handle_auth_done global_id 7347 payload 824 2024-09-12T00:52:49.030 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient: _finish_hunting 0 2024-09-12T00:52:49.031 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:52:48.743+0000 7fa7a5236640 1 monclient: found mon.noname-a 2024-09-12T00:52:49.031 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:52:49.031 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.031 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:49.031 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: dump: 2024-09-12T00:52:49.031 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.031 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.031 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.031 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.031 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.031 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.031 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.031 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.031 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.032 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.032 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:52:49.032 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:52:49.032 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:49.032 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:52:48.744+0000 7fa7a7f46800 5 monclient: authenticate success, global_id 7347 2024-09-12T00:52:49.032 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:52:48.744+0000 7fa7a7f46800 10 monclient: _renew_subs 2024-09-12T00:52:49.032 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:52:48.744+0000 7fa7a7f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:49.032 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.032 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:49.032 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: dump: 2024-09-12T00:52:49.032 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.032 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.032 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.033 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.033 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.033 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.033 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.033 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.033 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.033 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.033 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:52:48.744+0000 7fa7a6a39640 4 set_mon_vals no callback set 2024-09-12T00:52:49.033 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:52:48.744+0000 7fa7a7f46800 10 monclient: _renew_subs 2024-09-12T00:52:49.033 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:52:48.744+0000 7fa7a7f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:49.033 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:52:48.745+0000 7fa68b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:49.033 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:52:48.745+0000 7fa68b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:49.033 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:52:48.745+0000 7fa68b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:49.034 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:52:48.746+0000 7fa7a5a37640 10 monclient: get_auth_request con 0x7fa680076380 auth_method 0 2024-09-12T00:52:49.034 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 10 monclient: get_monmap_and_config 2024-09-12T00:52:49.034 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 10 monclient: build_initial_monmap 2024-09-12T00:52:49.034 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 1 build_initial for_mkfs: 0 2024-09-12T00:52:49.034 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 10 monclient: monmap: 2024-09-12T00:52:49.034 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:52:49.034 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:49.034 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:52:49.034 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:52:49.034 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:49.034 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.034 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:52:49.034 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:52:49.034 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:52:49.035 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.035 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding auth protocol: cephx 2024-09-12T00:52:49.035 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding auth protocol: cephx 2024-09-12T00:52:49.035 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding auth protocol: cephx 2024-09-12T00:52:49.035 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: secure 2024-09-12T00:52:49.035 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: crc 2024-09-12T00:52:49.035 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: secure 2024-09-12T00:52:49.035 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: crc 2024-09-12T00:52:49.035 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: secure 2024-09-12T00:52:49.035 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: crc 2024-09-12T00:52:49.035 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: crc 2024-09-12T00:52:49.035 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: secure 2024-09-12T00:52:49.036 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: crc 2024-09-12T00:52:49.036 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: secure 2024-09-12T00:52:49.036 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: crc 2024-09-12T00:52:49.036 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: secure 2024-09-12T00:52:49.036 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.036 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 10 monclient: init 2024-09-12T00:52:49.036 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding auth protocol: cephx 2024-09-12T00:52:49.036 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding auth protocol: cephx 2024-09-12T00:52:49.036 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding auth protocol: cephx 2024-09-12T00:52:49.036 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: secure 2024-09-12T00:52:49.036 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: crc 2024-09-12T00:52:49.036 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: secure 2024-09-12T00:52:49.036 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: crc 2024-09-12T00:52:49.037 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: secure 2024-09-12T00:52:49.037 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: crc 2024-09-12T00:52:49.037 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: crc 2024-09-12T00:52:49.037 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: secure 2024-09-12T00:52:49.037 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: crc 2024-09-12T00:52:49.037 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: secure 2024-09-12T00:52:49.037 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: crc 2024-09-12T00:52:49.037 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: secure 2024-09-12T00:52:49.037 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.037 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.037 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command rotate-key cmddesc rotate-key hook 0x7fff177deb58 EEXIST 2024-09-12T00:52:49.037 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:49.037 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:52:49.038 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-c con 0x55a46087f940 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:49.038 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-b con 0x55a4608aa3b0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:49.038 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-a con 0x55a4608ab760 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:49.038 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.038 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.038 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.038 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:49.038 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): authenticate will time out at 2055.240194s 2024-09-12T00:52:49.038 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request con 0x55a46087f940 auth_method 0 2024-09-12T00:52:49.038 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.038 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.038 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.038 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:52:48.747+0000 7fa7a6238640 10 monclient(hunting): get_auth_request con 0x55a4608ab760 auth_method 0 2024-09-12T00:52:49.038 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:52:48.747+0000 7fa7a6238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.039 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:52:48.747+0000 7fa7a6238640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.039 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:52:48.747+0000 7fa7a6238640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.039 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:52:48.747+0000 7fa7a5236640 10 monclient(hunting): get_auth_request con 0x55a4608aa3b0 auth_method 0 2024-09-12T00:52:49.039 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:52:48.747+0000 7fa7a5236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.039 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:52:48.747+0000 7fa7a5236640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.039 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:52:48.747+0000 7fa7a5236640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.039 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.039 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.039 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.039 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:52:48.747+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.039 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:52:48.747+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.039 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:52:48.747+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.040 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:52:48.747+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.040 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:52:48.747+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.040 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:52:48.747+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.040 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_done global_id 6968 payload 274 2024-09-12T00:52:49.040 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient: _finish_hunting 0 2024-09-12T00:52:49.040 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 1 monclient: found mon.noname-c 2024-09-12T00:52:49.040 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:52:49.040 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.040 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:52:49.040 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: dump: 2024-09-12T00:52:49.040 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.040 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.040 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.041 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.041 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.041 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.041 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.041 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.041 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.041 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.041 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: _finish_auth 0 2024-09-12T00:52:49.041 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: _check_auth_tickets 2024-09-12T00:52:49.041 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:49.042 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.042 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:52:49.042 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: dump: 2024-09-12T00:52:49.042 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.042 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.042 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.042 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.042 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.042 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.042 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.042 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.042 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.043 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.043 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 5 monclient: authenticate success, global_id 6968 2024-09-12T00:52:49.043 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient: get_monmap_and_config success 2024-09-12T00:52:49.043 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 4 set_mon_vals no callback set 2024-09-12T00:52:49.043 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 10 monclient: shutdown 2024-09-12T00:52:49.043 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 10 monclient: build_initial_monmap 2024-09-12T00:52:49.043 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 1 build_initial for_mkfs: 0 2024-09-12T00:52:49.043 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 10 monclient: monmap: 2024-09-12T00:52:49.043 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:52:49.043 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:49.043 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:52:49.043 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:52:49.043 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:49.044 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.044 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:52:49.044 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:52:49.044 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:52:49.044 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.044 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding auth protocol: cephx 2024-09-12T00:52:49.044 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding auth protocol: cephx 2024-09-12T00:52:49.044 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding auth protocol: cephx 2024-09-12T00:52:49.044 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: secure 2024-09-12T00:52:49.044 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: crc 2024-09-12T00:52:49.044 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: secure 2024-09-12T00:52:49.044 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: crc 2024-09-12T00:52:49.044 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: secure 2024-09-12T00:52:49.044 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: crc 2024-09-12T00:52:49.045 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: crc 2024-09-12T00:52:49.045 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: secure 2024-09-12T00:52:49.045 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: crc 2024-09-12T00:52:49.045 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: secure 2024-09-12T00:52:49.045 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: crc 2024-09-12T00:52:49.045 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: secure 2024-09-12T00:52:49.045 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.045 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 1 librados: starting msgr at 2024-09-12T00:52:49.045 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 1 librados: starting objecter 2024-09-12T00:52:49.045 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command objecter_requests cmddesc objecter_requests hook 0x55a4608a1710 EEXIST 2024-09-12T00:52:49.045 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 1 librados: setting wanted keys 2024-09-12T00:52:49.045 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 1 librados: calling monclient init 2024-09-12T00:52:49.045 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient: init 2024-09-12T00:52:49.046 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding auth protocol: cephx 2024-09-12T00:52:49.046 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding auth protocol: cephx 2024-09-12T00:52:49.046 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding auth protocol: cephx 2024-09-12T00:52:49.046 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: secure 2024-09-12T00:52:49.046 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: crc 2024-09-12T00:52:49.046 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: secure 2024-09-12T00:52:49.046 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: crc 2024-09-12T00:52:49.046 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: secure 2024-09-12T00:52:49.046 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: crc 2024-09-12T00:52:49.046 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: crc 2024-09-12T00:52:49.046 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: secure 2024-09-12T00:52:49.047 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: crc 2024-09-12T00:52:49.047 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: secure 2024-09-12T00:52:49.047 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: crc 2024-09-12T00:52:49.047 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: secure 2024-09-12T00:52:49.047 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.047 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.047 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command rotate-key cmddesc rotate-key hook 0x55a460870288 EEXIST 2024-09-12T00:52:49.047 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:49.047 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:52:49.047 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-a con 0x55a46087f940 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:49.047 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-b con 0x55a4608ab760 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:49.047 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-c con 0x55a4608a8690 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:49.048 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.048 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.048 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.048 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:49.048 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): authenticate will time out at 2055.242621s 2024-09-12T00:52:49.048 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request con 0x55a46087f940 auth_method 0 2024-09-12T00:52:49.048 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.048 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.048 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.049 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:52:48.749+0000 7fa7a6238640 10 monclient(hunting): get_auth_request con 0x55a4608a8690 auth_method 0 2024-09-12T00:52:49.049 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:52:48.749+0000 7fa7a6238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.049 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:52:48.749+0000 7fa7a6238640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.049 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:52:48.749+0000 7fa7a6238640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.049 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.049 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.049 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.050 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:52:48.749+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.050 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:52:48.749+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.050 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:52:48.749+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.050 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_done global_id 7353 payload 824 2024-09-12T00:52:49.050 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient: _finish_hunting 0 2024-09-12T00:52:49.050 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 1 monclient: found mon.noname-a 2024-09-12T00:52:49.051 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:52:49.051 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:52:48.750+0000 7fa7a5236640 10 monclient: get_auth_request con 0x55a4608ab760 auth_method 0 2024-09-12T00:52:49.051 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.051 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:49.051 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: dump: 2024-09-12T00:52:49.052 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.052 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.052 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.052 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.052 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.052 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.053 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.053 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.053 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.053 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.053 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: _finish_auth 0 2024-09-12T00:52:49.053 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: _check_auth_tickets 2024-09-12T00:52:49.054 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:49.054 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.054 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:49.054 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: dump: 2024-09-12T00:52:49.054 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.054 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.054 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.055 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.055 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.055 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.055 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.055 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.055 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.055 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.056 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:52:48.750+0000 7fa7a7f46800 5 monclient: authenticate success, global_id 7353 2024-09-12T00:52:49.056 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:52:48.750+0000 7fa6897fa640 4 set_mon_vals no callback set 2024-09-12T00:52:49.056 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:52:48.750+0000 7fa7a7f46800 10 monclient: _renew_subs 2024-09-12T00:52:49.056 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:52:48.750+0000 7fa7a7f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:49.056 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:52:48.750+0000 7fa7a7f46800 10 monclient: _renew_subs 2024-09-12T00:52:49.057 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:52:48.750+0000 7fa7a7f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:49.057 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:52:48.750+0000 7fa7a7f46800 1 librados: init done 2024-09-12T00:52:49.057 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:52:48.750+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command cr dump hook 0x55a4608ba518 2024-09-12T00:52:49.057 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:52:48.751+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.057 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:52:48.752+0000 7fa6777fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:49.057 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:52:48.752+0000 7fa6777fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:49.058 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:52:48.752+0000 7fa6777fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:49.058 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:52:48.752+0000 7fa7a5236640 10 monclient: get_auth_request con 0x7fa670076470 auth_method 0 2024-09-12T00:52:49.058 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:52:48.752+0000 7fa7a6238640 10 monclient: get_auth_request con 0x55a4608ca3a0 auth_method 0 2024-09-12T00:52:49.058 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.058 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 realm 2024-09-12T00:52:49.058 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.058 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.059 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:49.059 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.059 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.059 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.059 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:52:48.753+0000 7fa7a5a37640 10 monclient: get_auth_request con 0x55a4608ce770 auth_method 0 2024-09-12T00:52:49.059 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:52:48.754+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:49.059 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:52:48.754+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.060 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:52:48.754+0000 7fa7a5236640 10 monclient: get_auth_request con 0x55a4608d1ed0 auth_method 0 2024-09-12T00:52:49.060 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:52:48.755+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:49.060 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:52:48.755+0000 7fa7a7f46800 20 searching for the correct realm 2024-09-12T00:52:49.060 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:52:48.755+0000 7fa7a6238640 10 monclient: get_auth_request con 0x55a4608d6c90 auth_method 0 2024-09-12T00:52:49.060 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:52:48.756+0000 7fa7a5a37640 10 monclient: get_auth_request con 0x7fa7a001f040 auth_method 0 2024-09-12T00:52:49.060 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:52:48.757+0000 7fa7a5236640 10 monclient: get_auth_request con 0x7fa7a000e8d0 auth_method 0 2024-09-12T00:52:49.061 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:52:48.757+0000 7fa7a5236640 0 -- 172.21.15.62:0/3224614348 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fa7a000e8d0 msgr2=0x7fa7a001e3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:49.061 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:52:48.958+0000 7fa7a5236640 10 monclient: get_auth_request con 0x7fa7a000e8d0 auth_method 0 2024-09-12T00:52:49.061 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:52:48.960+0000 7fa7a6238640 10 monclient: get_auth_request con 0x7fa79807b040 auth_method 0 2024-09-12T00:52:49.061 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:52:48.961+0000 7fa7a5a37640 10 monclient: get_auth_request con 0x7fa7a003c900 auth_method 0 2024-09-12T00:52:49.061 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:52:48.962+0000 7fa7a6238640 0 -- 172.21.15.62:0/3224614348 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55a4608ca3a0 msgr2=0x55a4608cc7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:49.061 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:52:48.962+0000 7fa6777fe640 1 client.7353.objecter ms_handle_reset 0x55a4608ca3a0 session 0x55a4608c9d20 osd.6 2024-09-12T00:52:49.062 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:52:48.962+0000 7fa6777fe640 10 monclient: _renew_subs 2024-09-12T00:52:49.062 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:52:48.962+0000 7fa6777fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:49.062 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:52:48.962+0000 7fa7a6238640 10 monclient: get_auth_request con 0x7fa670086780 auth_method 0 2024-09-12T00:52:49.062 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:52:48.966+0000 7fa6777fe640 1 client.7353.objecter ms_handle_reset 0x7fa7a001f040 session 0x7fa7a0020b80 osd.2 2024-09-12T00:52:49.062 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:52:48.966+0000 7fa7a5a37640 10 monclient: get_auth_request con 0x55a4608ca3a0 auth_method 0 2024-09-12T00:52:49.062 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:49.062 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:49.063 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:49.063 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:49.063 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:49.063 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:49.063 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.063 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.064 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.064 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:49.064 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.064 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:49.064 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 zone default found 2024-09-12T00:52:49.064 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 4 Realm: () 2024-09-12T00:52:49.064 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:49.064 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:49.065 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:49.065 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 zonegroup default 2024-09-12T00:52:49.065 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.065 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.065 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.065 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.065 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.065 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.065 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 started sync module instance, tier type = 2024-09-12T00:52:49.065 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:49.065 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=0 2024-09-12T00:52:49.065 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=1 2024-09-12T00:52:49.065 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=2 2024-09-12T00:52:49.066 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=3 2024-09-12T00:52:49.066 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=4 2024-09-12T00:52:49.066 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=5 2024-09-12T00:52:49.066 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=6 2024-09-12T00:52:49.066 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:52:48.978+0000 7fa7a7f46800 20 add_watcher() i=7 2024-09-12T00:52:49.066 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:52:48.978+0000 7fa7a7f46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:49.066 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding auth protocol: cephx 2024-09-12T00:52:49.066 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding auth protocol: cephx 2024-09-12T00:52:49.066 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding auth protocol: cephx 2024-09-12T00:52:49.066 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: secure 2024-09-12T00:52:49.066 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: crc 2024-09-12T00:52:49.066 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: secure 2024-09-12T00:52:49.066 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: crc 2024-09-12T00:52:49.067 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:52:48.980+0000 7fa657fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:49.067 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: secure 2024-09-12T00:52:49.067 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: crc 2024-09-12T00:52:49.067 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: crc 2024-09-12T00:52:49.067 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: secure 2024-09-12T00:52:49.067 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: crc 2024-09-12T00:52:49.067 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: secure 2024-09-12T00:52:49.067 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: crc 2024-09-12T00:52:49.067 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: secure 2024-09-12T00:52:49.067 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.067 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:49.067 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:49.067 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command cache list hook 0x55a4608a8ab0 2024-09-12T00:52:49.068 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command cache inspect hook 0x55a4608a8ab0 2024-09-12T00:52:49.068 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command cache erase hook 0x55a4608a8ab0 2024-09-12T00:52:49.068 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command cache zap hook 0x55a4608a8ab0 2024-09-12T00:52:49.068 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 note: GC not initialized 2024-09-12T00:52:49.068 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:52:48.980+0000 7fa656ffd640 20 reqs_thread_entry: start 2024-09-12T00:52:49.068 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command sync trace show hook 0x7fa79806c6c0 2024-09-12T00:52:49.068 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command sync trace history hook 0x7fa79806c6c0 2024-09-12T00:52:49.068 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command sync trace active hook 0x7fa79806c6c0 2024-09-12T00:52:49.068 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command sync trace active_short hook 0x7fa79806c6c0 2024-09-12T00:52:49.068 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:49.068 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 20 Filter name: none 2024-09-12T00:52:49.069 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:52:48.981+0000 7fa654ff9640 20 reqs_thread_entry: start 2024-09-12T00:52:49.069 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:52:49.069 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.069 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:49.069 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:52:49.069 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:52:49.069 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 : miss 2024-09-12T00:52:49.069 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.069 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:52:48.982+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:52:49.069 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:52:48.982+0000 7fa7a7f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:52:49.069 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:52:48.982+0000 7fa7a7f46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:52:49.069 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:52:48.982+0000 7fa7a7f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:49.069 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:52:48.982+0000 7fa7a7f46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:49.070 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:52:48.982+0000 7fa7a7f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 2024-09-12T00:52:49.070 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:52:48.986+0000 7fa7a7f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:52:49.070 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:52:48.986+0000 7fa7a7f46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:52:49.070 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:52:48.986+0000 7fa7a7f46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:49.070 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:52:48.986+0000 7fa7a7f46800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32, ofs0, ns] 2024-09-12T00:52:49.070 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:52:48.986+0000 7fa6897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431653 cookie 94164482890688 notifier 7353 bl.length()=931 2024-09-12T00:52:49.070 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:52:48.986+0000 7fa6897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:52:49.070 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:52:48.986+0000 7fa6897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:52:49.070 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:52:48.986+0000 7fa6897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:49.070 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:52:48.988+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_sources= new_sources= 2024-09-12T00:52:49.071 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:52:48.988+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential sources added=[] removed=[] 2024-09-12T00:52:49.071 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:52:48.988+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_dests= new_dests= 2024-09-12T00:52:49.071 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:52:48.988+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential dests added=[] removed=[] 2024-09-12T00:52:49.071 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:52:48.990+0000 7fa7a7f46800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.0 2024-09-12T00:52:49.071 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:52:48.990+0000 7fa7a7f46800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.0 2024-09-12T00:52:49.071 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:52:48.990+0000 7fa7a7f46800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.1 2024-09-12T00:52:49.071 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:52:48.990+0000 7fa7a7f46800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.1 2024-09-12T00:52:49.071 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:52:48.990+0000 7fa7a7f46800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.0 2024-09-12T00:52:49.071 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:52:48.993+0000 7fa7a7f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:49.071 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:52:48.993+0000 7fa7a7f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 2024-09-12T00:52:49.071 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:52:48.994+0000 7fa7a7f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:52:49.072 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:52:48.994+0000 7fa7a7f46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:52:49.072 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:52:48.994+0000 7fa7a7f46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:49.072 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:52:48.994+0000 7fa7a7f46800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32, ofs0, ns] 2024-09-12T00:52:49.072 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:52:48.995+0000 7fa6897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431654 cookie 94164482890688 notifier 7353 bl.length()=931 2024-09-12T00:52:49.072 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:52:48.995+0000 7fa6897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:52:49.072 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:52:48.995+0000 7fa6897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:52:49.072 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:52:48.995+0000 7fa6897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:49.072 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:52:48.996+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_sources= new_sources= 2024-09-12T00:52:49.072 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:52:48.996+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential sources added=[] removed=[] 2024-09-12T00:52:49.072 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:52:48.996+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_dests= new_dests= 2024-09-12T00:52:49.072 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:52:48.996+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential dests added=[] removed=[] 2024-09-12T00:52:49.072 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:52:48.997+0000 7fa7a7f46800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.0 2024-09-12T00:52:49.072 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:52:48.998+0000 7fa7a7f46800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa7a7f46800 time 2024-09-12T00:52:48.999124+0000 2024-09-12T00:52:49.073 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:49.073 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.073 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:49.073 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa7ab58c71a] 2024-09-12T00:52:49.073 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa7ab58c8d8] 2024-09-12T00:52:49.073 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a45e88a641] 2024-09-12T00:52:49.073 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a45e89a637] 2024-09-12T00:52:49.073 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:52:49.073 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa7aa229590] 2024-09-12T00:52:49.074 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:52:49.074 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:52:49.074 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.074 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:52:48.999+0000 7fa7a7f46800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:49.074 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7fa7a7f46800 thread_name:radosgw-admin 2024-09-12T00:52:49.074 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.074 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:49.074 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa7aa23e6f0] 2024-09-12T00:52:49.074 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa7aa28b99c] 2024-09-12T00:52:49.074 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:52:49.074 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:52:49.074 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa7ab58c774] 2024-09-12T00:52:49.075 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa7ab58c8d8] 2024-09-12T00:52:49.075 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a45e88a641] 2024-09-12T00:52:49.075 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a45e89a637] 2024-09-12T00:52:49.075 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:52:49.075 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa7aa229590] 2024-09-12T00:52:49.075 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:52:49.075 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:52:49.075 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:49.075 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.076 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:52:49.076 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:52:49.076 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:52:49.076 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:52:49.076 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:52:49.076 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:52:49.076 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:52:49.076 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:52:49.077 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:52:49.077 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:52:49.077 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:52:49.077 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:52:49.077 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:52:49.077 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:52:49.077 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:52:49.077 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:52:49.077 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:52:49.077 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:52:49.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:52:49.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:52:49.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:52:49.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:52:49.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:52:49.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:52:49.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:52:49.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:52:49.078 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:52:49.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:52:49.078 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:52:49.078 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:52:49.078 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:52:49.079 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:52:49.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:52:49.079 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:52:49.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:52:49.079 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:52:49.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:52:49.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:52:49.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:52:49.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:52:49.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:52:49.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:52:49.079 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:52:49.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:52:49.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:52:49.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:52:49.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:52:49.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:52:49.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:52:49.080 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:52:49.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:52:49.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:52:49.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:52:49.080 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:52:49.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:52:49.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:52:49.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:52:49.080 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:52:49.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:52:49.081 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:52:49.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:52:49.081 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:52:49.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:52:49.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:52:49.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:52:49.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:52:49.081 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:52:49.081 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:52:49.081 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:52:49.081 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:52:49.081 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:52:49.081 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:52:49.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:52:49.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:52:49.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:52:49.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:52:49.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:52:49.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:52:49.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:52:49.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:52:49.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:52:49.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:52:49.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:52:49.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:52:49.082 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:52:49.083 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:52:49.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:52:49.083 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:52:49.083 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:52:49.083 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:52:49.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:52:49.083 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:52:49.083 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:52:49.083 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:52:49.083 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa654ff9640 / http_manager 2024-09-12T00:52:49.083 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa656ffd640 / http_manager 2024-09-12T00:52:49.083 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa657fff640 / rgw_dt_lg_renew 2024-09-12T00:52:49.083 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa6777fe640 / ms_dispatch 2024-09-12T00:52:49.084 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa6897fa640 / io_context_pool 2024-09-12T00:52:49.084 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa68b7fe640 / ms_dispatch 2024-09-12T00:52:49.084 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa692604640 / ms_dispatch 2024-09-12T00:52:49.084 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa693e07640 / io_context_pool 2024-09-12T00:52:49.084 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa7a5236640 / msgr-worker-2 2024-09-12T00:52:49.084 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa7a5a37640 / msgr-worker-1 2024-09-12T00:52:49.084 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa7a6238640 / msgr-worker-0 2024-09-12T00:52:49.084 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa7a6a39640 / io_context_pool 2024-09-12T00:52:49.084 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa7a7f46800 / radosgw-admin 2024-09-12T00:52:49.084 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:52:49.084 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:52:49.084 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/log/ceph/ceph-client.admin.121646.log 2024-09-12T00:52:49.084 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:52:49.085 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:52:49.085 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607e5470) adding con mode: secure 2024-09-12T00:52:49.085 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607e5470) adding con mode: crc 2024-09-12T00:52:49.085 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607e5470) adding con mode: secure 2024-09-12T00:52:49.085 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.085 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 1 librados: starting msgr at 2024-09-12T00:52:49.085 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 1 librados: starting objecter 2024-09-12T00:52:49.085 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command objecter_requests hook 0x55a460810be0 2024-09-12T00:52:49.085 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 1 librados: setting wanted keys 2024-09-12T00:52:49.085 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 1 librados: calling monclient init 2024-09-12T00:52:49.085 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 10 monclient: init 2024-09-12T00:52:49.085 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding auth protocol: cephx 2024-09-12T00:52:49.085 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding auth protocol: cephx 2024-09-12T00:52:49.086 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding auth protocol: cephx 2024-09-12T00:52:49.086 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: secure 2024-09-12T00:52:49.086 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: crc 2024-09-12T00:52:49.086 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: secure 2024-09-12T00:52:49.086 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: crc 2024-09-12T00:52:49.086 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: secure 2024-09-12T00:52:49.086 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: crc 2024-09-12T00:52:49.086 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: crc 2024-09-12T00:52:49.086 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: secure 2024-09-12T00:52:49.087 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: crc 2024-09-12T00:52:49.087 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: secure 2024-09-12T00:52:49.087 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: crc 2024-09-12T00:52:49.087 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:52:48.735+0000 7fa7a7f46800 5 AuthRegistry(0x55a4607df790) adding con mode: secure 2024-09-12T00:52:49.087 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.087 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.087 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command rotate-key hook 0x55a4607df8d8 2024-09-12T00:52:49.087 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:49.087 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:49.087 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-b con 0x55a460657230 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:49.087 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-c con 0x55a460722c80 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:49.087 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-a con 0x55a460729550 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:49.087 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.088 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.088 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.088 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:49.088 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:52:48.736+0000 7fa7a7f46800 10 monclient(hunting): authenticate will time out at 2055.229496s 2024-09-12T00:52:49.088 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): get_auth_request con 0x55a460722c80 auth_method 0 2024-09-12T00:52:49.088 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.088 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.088 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.088 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:52:48.736+0000 7fa7a6238640 10 monclient(hunting): get_auth_request con 0x55a460729550 auth_method 0 2024-09-12T00:52:49.088 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:52:48.736+0000 7fa7a6238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.088 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:52:48.736+0000 7fa7a6238640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.088 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:52:48.736+0000 7fa7a6238640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.088 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.089 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.089 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.089 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:52:48.736+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.089 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:52:48.736+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.089 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:52:48.736+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.089 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:52:48.736+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request con 0x55a460657230 auth_method 0 2024-09-12T00:52:49.089 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:52:48.736+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.089 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:52:48.736+0000 7fa7a5a37640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.089 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:52:48.736+0000 7fa7a5a37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.089 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:52:48.736+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.089 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:52:48.736+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.089 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:52:48.736+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.090 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient(hunting): handle_auth_done global_id 6962 payload 824 2024-09-12T00:52:49.090 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient: _finish_hunting 0 2024-09-12T00:52:49.090 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:52:48.736+0000 7fa7a5236640 1 monclient: found mon.noname-c 2024-09-12T00:52:49.090 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:52:48.736+0000 7fa7a5236640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:52:49.090 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.090 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:52:49.090 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: dump: 2024-09-12T00:52:49.090 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.090 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.090 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.090 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.090 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.091 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.091 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.091 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.091 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.091 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.091 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: _finish_auth 0 2024-09-12T00:52:49.091 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: _check_auth_tickets 2024-09-12T00:52:49.091 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:49.091 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.091 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:52:49.091 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:52:48.737+0000 7fa692604640 10 monclient: dump: 2024-09-12T00:52:49.091 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.091 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.091 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.092 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.092 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.092 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.092 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.092 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.092 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.092 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.092 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:52:48.737+0000 7fa7a7f46800 5 monclient: authenticate success, global_id 6962 2024-09-12T00:52:49.092 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:52:48.737+0000 7fa7a7f46800 10 monclient: _renew_subs 2024-09-12T00:52:49.092 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:52:48.737+0000 7fa7a7f46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:52:49.092 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:52:48.737+0000 7fa693e07640 4 set_mon_vals no callback set 2024-09-12T00:52:49.092 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:52:48.737+0000 7fa7a7f46800 10 monclient: _renew_subs 2024-09-12T00:52:49.092 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:52:48.737+0000 7fa7a7f46800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:52:49.093 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:52:48.737+0000 7fa7a7f46800 1 librados: init done 2024-09-12T00:52:49.093 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:52:48.739+0000 7fa692604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:49.093 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:52:48.739+0000 7fa692604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:49.093 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:52:48.739+0000 7fa692604640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:49.093 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:52:48.739+0000 7fa7a5a37640 10 monclient: get_auth_request con 0x7fa68c0764a0 auth_method 0 2024-09-12T00:52:49.093 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:52:48.739+0000 7fa7a6238640 10 monclient: get_auth_request con 0x55a460827f00 auth_method 0 2024-09-12T00:52:49.093 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:52:48.740+0000 7fa7a5a37640 10 monclient: get_auth_request con 0x55a46082b0e0 auth_method 0 2024-09-12T00:52:49.093 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:52:48.741+0000 7fa7a5236640 10 monclient: get_auth_request con 0x55a46082f2d0 auth_method 0 2024-09-12T00:52:49.093 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 10 monclient: build_initial_monmap 2024-09-12T00:52:49.093 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 1 build_initial for_mkfs: 0 2024-09-12T00:52:49.093 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 10 monclient: monmap: 2024-09-12T00:52:49.093 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:52:49.094 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:49.094 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:52:49.094 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:52:49.094 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:49.094 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.094 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:52:49.094 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:52:49.094 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:52:49.094 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.094 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding auth protocol: cephx 2024-09-12T00:52:49.094 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding auth protocol: cephx 2024-09-12T00:52:49.094 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding auth protocol: cephx 2024-09-12T00:52:49.094 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: secure 2024-09-12T00:52:49.095 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: crc 2024-09-12T00:52:49.095 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: secure 2024-09-12T00:52:49.095 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: crc 2024-09-12T00:52:49.095 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: secure 2024-09-12T00:52:49.095 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: crc 2024-09-12T00:52:49.095 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: crc 2024-09-12T00:52:49.095 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: secure 2024-09-12T00:52:49.095 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: crc 2024-09-12T00:52:49.095 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: secure 2024-09-12T00:52:49.095 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: crc 2024-09-12T00:52:49.095 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608340e0) adding con mode: secure 2024-09-12T00:52:49.095 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.095 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command objecter_requests cmddesc objecter_requests hook 0x55a460837560 EEXIST 2024-09-12T00:52:49.096 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 10 monclient: init 2024-09-12T00:52:49.096 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding auth protocol: cephx 2024-09-12T00:52:49.096 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding auth protocol: cephx 2024-09-12T00:52:49.096 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding auth protocol: cephx 2024-09-12T00:52:49.096 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: secure 2024-09-12T00:52:49.096 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: crc 2024-09-12T00:52:49.096 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: secure 2024-09-12T00:52:49.096 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: crc 2024-09-12T00:52:49.096 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: secure 2024-09-12T00:52:49.096 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: crc 2024-09-12T00:52:49.096 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: crc 2024-09-12T00:52:49.096 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: secure 2024-09-12T00:52:49.097 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: crc 2024-09-12T00:52:49.097 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: secure 2024-09-12T00:52:49.097 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: crc 2024-09-12T00:52:49.097 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:52:48.742+0000 7fa7a7f46800 5 AuthRegistry(0x55a4608327b8) adding con mode: secure 2024-09-12T00:52:49.097 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.097 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.097 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command rotate-key cmddesc rotate-key hook 0x55a460832900 EEXIST 2024-09-12T00:52:49.097 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:49.097 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:52:49.098 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-c con 0x55a46085b880 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:49.098 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-a con 0x55a46085bc60 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:49.098 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-b con 0x55a46085a590 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:49.098 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.098 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.098 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.098 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:49.098 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:52:48.743+0000 7fa7a7f46800 10 monclient(hunting): authenticate will time out at 2055.236472s 2024-09-12T00:52:49.098 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): get_auth_request con 0x55a46085bc60 auth_method 0 2024-09-12T00:52:49.098 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.098 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.098 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.099 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:52:48.743+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request con 0x55a46085b880 auth_method 0 2024-09-12T00:52:49.099 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:52:48.743+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.099 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:52:48.743+0000 7fa7a5a37640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.099 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:52:48.743+0000 7fa7a5a37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.099 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.099 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.099 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.099 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:52:48.743+0000 7fa7a6238640 10 monclient(hunting): get_auth_request con 0x55a46085a590 auth_method 0 2024-09-12T00:52:49.099 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:52:48.743+0000 7fa7a6238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.099 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:52:48.743+0000 7fa7a6238640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.099 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:52:48.743+0000 7fa7a6238640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.099 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:52:48.743+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.099 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:52:48.743+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.100 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:52:48.743+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.100 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient(hunting): handle_auth_done global_id 7347 payload 824 2024-09-12T00:52:49.100 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient: _finish_hunting 0 2024-09-12T00:52:49.100 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:52:48.743+0000 7fa7a5236640 1 monclient: found mon.noname-a 2024-09-12T00:52:49.100 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:52:48.743+0000 7fa7a5236640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:52:49.100 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.100 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:49.100 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: dump: 2024-09-12T00:52:49.100 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.100 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.100 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.100 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.100 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.101 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.101 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.101 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.101 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.101 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.101 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:52:49.101 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:52:49.101 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:49.101 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:52:48.744+0000 7fa7a7f46800 5 monclient: authenticate success, global_id 7347 2024-09-12T00:52:49.101 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:52:48.744+0000 7fa7a7f46800 10 monclient: _renew_subs 2024-09-12T00:52:49.101 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:52:48.744+0000 7fa7a7f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:49.101 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.102 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:49.102 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:52:48.744+0000 7fa68b7fe640 10 monclient: dump: 2024-09-12T00:52:49.102 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.102 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.102 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.102 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.102 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.102 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.102 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.102 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.102 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.102 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.102 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:52:48.744+0000 7fa7a6a39640 4 set_mon_vals no callback set 2024-09-12T00:52:49.103 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:52:48.744+0000 7fa7a7f46800 10 monclient: _renew_subs 2024-09-12T00:52:49.103 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:52:48.744+0000 7fa7a7f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:49.103 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:52:48.745+0000 7fa68b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:49.103 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:52:48.745+0000 7fa68b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:49.103 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:52:48.745+0000 7fa68b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:49.103 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:52:48.746+0000 7fa7a5a37640 10 monclient: get_auth_request con 0x7fa680076380 auth_method 0 2024-09-12T00:52:49.103 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 10 monclient: get_monmap_and_config 2024-09-12T00:52:49.103 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 10 monclient: build_initial_monmap 2024-09-12T00:52:49.103 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 1 build_initial for_mkfs: 0 2024-09-12T00:52:49.103 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 10 monclient: monmap: 2024-09-12T00:52:49.103 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:52:49.103 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:49.103 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:52:49.103 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:52:49.104 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:49.104 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.104 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:52:49.104 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:52:49.104 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:52:49.104 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.104 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding auth protocol: cephx 2024-09-12T00:52:49.104 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding auth protocol: cephx 2024-09-12T00:52:49.104 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding auth protocol: cephx 2024-09-12T00:52:49.104 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: secure 2024-09-12T00:52:49.104 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: crc 2024-09-12T00:52:49.104 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: secure 2024-09-12T00:52:49.105 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: crc 2024-09-12T00:52:49.105 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: secure 2024-09-12T00:52:49.105 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: crc 2024-09-12T00:52:49.105 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: crc 2024-09-12T00:52:49.105 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: secure 2024-09-12T00:52:49.105 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: crc 2024-09-12T00:52:49.105 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: secure 2024-09-12T00:52:49.105 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: crc 2024-09-12T00:52:49.105 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x55a46087b7b0) adding con mode: secure 2024-09-12T00:52:49.105 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.105 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 10 monclient: init 2024-09-12T00:52:49.106 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding auth protocol: cephx 2024-09-12T00:52:49.106 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding auth protocol: cephx 2024-09-12T00:52:49.106 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding auth protocol: cephx 2024-09-12T00:52:49.106 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: secure 2024-09-12T00:52:49.106 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: crc 2024-09-12T00:52:49.106 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: secure 2024-09-12T00:52:49.106 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: crc 2024-09-12T00:52:49.106 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: secure 2024-09-12T00:52:49.106 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: crc 2024-09-12T00:52:49.106 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: crc 2024-09-12T00:52:49.106 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: secure 2024-09-12T00:52:49.106 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: crc 2024-09-12T00:52:49.106 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: secure 2024-09-12T00:52:49.107 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: crc 2024-09-12T00:52:49.107 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177dea10) adding con mode: secure 2024-09-12T00:52:49.107 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:52:48.746+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.107 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.107 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command rotate-key cmddesc rotate-key hook 0x7fff177deb58 EEXIST 2024-09-12T00:52:49.107 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:49.107 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:52:49.107 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-c con 0x55a46087f940 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:49.107 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-b con 0x55a4608aa3b0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:49.108 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-a con 0x55a4608ab760 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:49.108 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.108 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.108 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.108 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:49.108 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient(hunting): authenticate will time out at 2055.240194s 2024-09-12T00:52:49.108 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request con 0x55a46087f940 auth_method 0 2024-09-12T00:52:49.108 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.108 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.108 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.108 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:52:48.747+0000 7fa7a6238640 10 monclient(hunting): get_auth_request con 0x55a4608ab760 auth_method 0 2024-09-12T00:52:49.108 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:52:48.747+0000 7fa7a6238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.109 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:52:48.747+0000 7fa7a6238640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.109 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:52:48.747+0000 7fa7a6238640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.109 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:52:48.747+0000 7fa7a5236640 10 monclient(hunting): get_auth_request con 0x55a4608aa3b0 auth_method 0 2024-09-12T00:52:49.109 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:52:48.747+0000 7fa7a5236640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.109 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:52:48.747+0000 7fa7a5236640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.109 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:52:48.747+0000 7fa7a5236640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.109 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.109 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.109 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.109 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:52:48.747+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.109 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:52:48.747+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.109 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:52:48.747+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.109 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:52:48.747+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.110 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:52:48.747+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.110 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:52:48.747+0000 7fa7a5236640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.110 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_done global_id 6968 payload 274 2024-09-12T00:52:49.110 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient: _finish_hunting 0 2024-09-12T00:52:49.110 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 1 monclient: found mon.noname-c 2024-09-12T00:52:49.110 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:52:48.747+0000 7fa7a5a37640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:52:49.110 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.110 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:52:49.110 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: dump: 2024-09-12T00:52:49.110 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.110 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.110 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.110 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.111 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.111 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.111 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.111 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.111 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.111 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.111 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: _finish_auth 0 2024-09-12T00:52:49.111 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: _check_auth_tickets 2024-09-12T00:52:49.111 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:49.111 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.111 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:52:49.111 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:52:48.747+0000 7fa6897fa640 10 monclient: dump: 2024-09-12T00:52:49.111 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.112 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.112 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.112 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.112 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.112 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.112 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.112 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.112 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.112 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.112 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 5 monclient: authenticate success, global_id 6968 2024-09-12T00:52:49.112 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 10 monclient: get_monmap_and_config success 2024-09-12T00:52:49.112 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:52:48.747+0000 7fa7a7f46800 4 set_mon_vals no callback set 2024-09-12T00:52:49.113 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 10 monclient: shutdown 2024-09-12T00:52:49.113 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 10 monclient: build_initial_monmap 2024-09-12T00:52:49.113 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 1 build_initial for_mkfs: 0 2024-09-12T00:52:49.114 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 10 monclient: monmap: 2024-09-12T00:52:49.114 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:52:49.114 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:49.114 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:52:49.114 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:52:49.114 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:49.114 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.114 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:52:49.114 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:52:49.114 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:52:49.114 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.114 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding auth protocol: cephx 2024-09-12T00:52:49.114 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding auth protocol: cephx 2024-09-12T00:52:49.115 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding auth protocol: cephx 2024-09-12T00:52:49.115 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: secure 2024-09-12T00:52:49.115 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: crc 2024-09-12T00:52:49.115 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: secure 2024-09-12T00:52:49.115 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: crc 2024-09-12T00:52:49.115 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: secure 2024-09-12T00:52:49.115 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: crc 2024-09-12T00:52:49.115 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: crc 2024-09-12T00:52:49.116 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: secure 2024-09-12T00:52:49.116 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: crc 2024-09-12T00:52:49.116 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: secure 2024-09-12T00:52:49.116 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: crc 2024-09-12T00:52:49.116 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 5 AuthRegistry(0x55a460880520) adding con mode: secure 2024-09-12T00:52:49.116 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.116 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 1 librados: starting msgr at 2024-09-12T00:52:49.116 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:52:48.748+0000 7fa7a7f46800 1 librados: starting objecter 2024-09-12T00:52:49.116 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command objecter_requests cmddesc objecter_requests hook 0x55a4608a1710 EEXIST 2024-09-12T00:52:49.117 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 1 librados: setting wanted keys 2024-09-12T00:52:49.117 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 1 librados: calling monclient init 2024-09-12T00:52:49.117 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient: init 2024-09-12T00:52:49.117 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding auth protocol: cephx 2024-09-12T00:52:49.117 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding auth protocol: cephx 2024-09-12T00:52:49.117 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding auth protocol: cephx 2024-09-12T00:52:49.117 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: secure 2024-09-12T00:52:49.117 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: crc 2024-09-12T00:52:49.117 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: secure 2024-09-12T00:52:49.117 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: crc 2024-09-12T00:52:49.117 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: secure 2024-09-12T00:52:49.117 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: crc 2024-09-12T00:52:49.117 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: crc 2024-09-12T00:52:49.118 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: secure 2024-09-12T00:52:49.118 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: crc 2024-09-12T00:52:49.118 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: secure 2024-09-12T00:52:49.118 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: crc 2024-09-12T00:52:49.118 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 AuthRegistry(0x55a460870140) adding con mode: secure 2024-09-12T00:52:49.118 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.118 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.118 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command rotate-key cmddesc rotate-key hook 0x55a460870288 EEXIST 2024-09-12T00:52:49.118 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:49.118 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:52:49.118 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-a con 0x55a46087f940 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:52:49.118 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-b con 0x55a4608ab760 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:52:49.118 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): picked mon.noname-c con 0x55a4608a8690 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:52:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:52:48.749+0000 7fa7a7f46800 10 monclient(hunting): authenticate will time out at 2055.242621s 2024-09-12T00:52:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request con 0x55a46087f940 auth_method 0 2024-09-12T00:52:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:52:48.749+0000 7fa7a6238640 10 monclient(hunting): get_auth_request con 0x55a4608a8690 auth_method 0 2024-09-12T00:52:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:52:48.749+0000 7fa7a6238640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:52:48.749+0000 7fa7a6238640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:52:48.749+0000 7fa7a6238640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:49.119 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.120 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.120 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.120 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:52:48.749+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:49.120 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:52:48.749+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:49.120 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:52:48.749+0000 7fa7a6238640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:49.120 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient(hunting): handle_auth_done global_id 7353 payload 824 2024-09-12T00:52:49.120 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient: _finish_hunting 0 2024-09-12T00:52:49.120 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 1 monclient: found mon.noname-a 2024-09-12T00:52:49.121 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:52:48.749+0000 7fa7a5a37640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:52:49.121 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:52:48.750+0000 7fa7a5236640 10 monclient: get_auth_request con 0x55a4608ab760 auth_method 0 2024-09-12T00:52:49.121 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.121 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:49.121 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: dump: 2024-09-12T00:52:49.121 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.121 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.121 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.121 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.121 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.121 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.121 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.121 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.121 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.122 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.122 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: _finish_auth 0 2024-09-12T00:52:49.122 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: _check_auth_tickets 2024-09-12T00:52:49.122 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:49.122 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:49.122 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:49.122 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:52:48.750+0000 7fa6777fe640 10 monclient: dump: 2024-09-12T00:52:49.122 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:52:49.122 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:52:49.122 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.122 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:52:49.123 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:49.123 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:52:49.123 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:52:49.123 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:52:49.123 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:52:49.123 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.123 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:52:48.750+0000 7fa7a7f46800 5 monclient: authenticate success, global_id 7353 2024-09-12T00:52:49.123 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:52:48.750+0000 7fa6897fa640 4 set_mon_vals no callback set 2024-09-12T00:52:49.123 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:52:48.750+0000 7fa7a7f46800 10 monclient: _renew_subs 2024-09-12T00:52:49.123 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:52:48.750+0000 7fa7a7f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:49.123 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:52:48.750+0000 7fa7a7f46800 10 monclient: _renew_subs 2024-09-12T00:52:49.123 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:52:48.750+0000 7fa7a7f46800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:49.123 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:52:48.750+0000 7fa7a7f46800 1 librados: init done 2024-09-12T00:52:49.123 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:52:48.750+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command cr dump hook 0x55a4608ba518 2024-09-12T00:52:49.124 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:52:48.751+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.124 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:52:48.752+0000 7fa6777fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:49.124 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:52:48.752+0000 7fa6777fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:49.124 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:52:48.752+0000 7fa6777fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:52:49.124 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:52:48.752+0000 7fa7a5236640 10 monclient: get_auth_request con 0x7fa670076470 auth_method 0 2024-09-12T00:52:49.124 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:52:48.752+0000 7fa7a6238640 10 monclient: get_auth_request con 0x55a4608ca3a0 auth_method 0 2024-09-12T00:52:49.124 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.124 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 realm 2024-09-12T00:52:49.124 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.124 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.125 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:49.125 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.125 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.125 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:52:48.753+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.125 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:52:48.753+0000 7fa7a5a37640 10 monclient: get_auth_request con 0x55a4608ce770 auth_method 0 2024-09-12T00:52:49.125 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:52:48.754+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:49.125 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:52:48.754+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.125 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:52:48.754+0000 7fa7a5236640 10 monclient: get_auth_request con 0x55a4608d1ed0 auth_method 0 2024-09-12T00:52:49.125 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:52:48.755+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:49.125 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:52:48.755+0000 7fa7a7f46800 20 searching for the correct realm 2024-09-12T00:52:49.125 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:52:48.755+0000 7fa7a6238640 10 monclient: get_auth_request con 0x55a4608d6c90 auth_method 0 2024-09-12T00:52:49.125 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:52:48.756+0000 7fa7a5a37640 10 monclient: get_auth_request con 0x7fa7a001f040 auth_method 0 2024-09-12T00:52:49.125 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:52:48.757+0000 7fa7a5236640 10 monclient: get_auth_request con 0x7fa7a000e8d0 auth_method 0 2024-09-12T00:52:49.126 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:52:48.757+0000 7fa7a5236640 0 -- 172.21.15.62:0/3224614348 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fa7a000e8d0 msgr2=0x7fa7a001e3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:49.126 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:52:48.958+0000 7fa7a5236640 10 monclient: get_auth_request con 0x7fa7a000e8d0 auth_method 0 2024-09-12T00:52:49.126 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:52:48.960+0000 7fa7a6238640 10 monclient: get_auth_request con 0x7fa79807b040 auth_method 0 2024-09-12T00:52:49.126 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:52:48.961+0000 7fa7a5a37640 10 monclient: get_auth_request con 0x7fa7a003c900 auth_method 0 2024-09-12T00:52:49.126 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:52:48.962+0000 7fa7a6238640 0 -- 172.21.15.62:0/3224614348 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55a4608ca3a0 msgr2=0x55a4608cc7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:49.126 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:52:48.962+0000 7fa6777fe640 1 client.7353.objecter ms_handle_reset 0x55a4608ca3a0 session 0x55a4608c9d20 osd.6 2024-09-12T00:52:49.126 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:52:48.962+0000 7fa6777fe640 10 monclient: _renew_subs 2024-09-12T00:52:49.126 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:52:48.962+0000 7fa6777fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:52:49.126 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:52:48.962+0000 7fa7a6238640 10 monclient: get_auth_request con 0x7fa670086780 auth_method 0 2024-09-12T00:52:49.127 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:52:48.966+0000 7fa6777fe640 1 client.7353.objecter ms_handle_reset 0x7fa7a001f040 session 0x7fa7a0020b80 osd.2 2024-09-12T00:52:49.127 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:52:48.966+0000 7fa7a5a37640 10 monclient: get_auth_request con 0x55a4608ca3a0 auth_method 0 2024-09-12T00:52:49.127 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:49.127 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:49.127 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:49.127 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:49.127 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:49.127 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:49.127 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.127 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.127 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.127 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:49.127 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:52:48.967+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.127 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:49.128 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 zone default found 2024-09-12T00:52:49.128 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 4 Realm: () 2024-09-12T00:52:49.128 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:49.128 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:49.128 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:49.128 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 zonegroup default 2024-09-12T00:52:49.128 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.128 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.128 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.129 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.129 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.129 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.129 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 started sync module instance, tier type = 2024-09-12T00:52:49.129 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:52:48.968+0000 7fa7a7f46800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:49.129 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=0 2024-09-12T00:52:49.130 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=1 2024-09-12T00:52:49.130 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=2 2024-09-12T00:52:49.130 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=3 2024-09-12T00:52:49.130 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=4 2024-09-12T00:52:49.130 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=5 2024-09-12T00:52:49.130 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:52:48.977+0000 7fa7a7f46800 20 add_watcher() i=6 2024-09-12T00:52:49.130 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:52:48.978+0000 7fa7a7f46800 20 add_watcher() i=7 2024-09-12T00:52:49.130 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:52:48.978+0000 7fa7a7f46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:49.130 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding auth protocol: cephx 2024-09-12T00:52:49.130 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding auth protocol: cephx 2024-09-12T00:52:49.131 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding auth protocol: cephx 2024-09-12T00:52:49.131 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: secure 2024-09-12T00:52:49.131 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: crc 2024-09-12T00:52:49.131 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: secure 2024-09-12T00:52:49.131 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: crc 2024-09-12T00:52:49.131 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:52:48.980+0000 7fa657fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:49.131 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: secure 2024-09-12T00:52:49.131 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: crc 2024-09-12T00:52:49.131 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: crc 2024-09-12T00:52:49.131 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: secure 2024-09-12T00:52:49.131 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: crc 2024-09-12T00:52:49.131 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: secure 2024-09-12T00:52:49.132 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: crc 2024-09-12T00:52:49.132 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 AuthRegistry(0x7fff177deef0) adding con mode: secure 2024-09-12T00:52:49.132 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:49.132 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:49.132 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:49.132 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command cache list hook 0x55a4608a8ab0 2024-09-12T00:52:49.132 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command cache inspect hook 0x55a4608a8ab0 2024-09-12T00:52:49.132 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command cache erase hook 0x55a4608a8ab0 2024-09-12T00:52:49.132 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command cache zap hook 0x55a4608a8ab0 2024-09-12T00:52:49.132 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:52:48.980+0000 7fa7a7f46800 5 note: GC not initialized 2024-09-12T00:52:49.132 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:52:48.980+0000 7fa656ffd640 20 reqs_thread_entry: start 2024-09-12T00:52:49.132 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command sync trace show hook 0x7fa79806c6c0 2024-09-12T00:52:49.132 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command sync trace history hook 0x7fa79806c6c0 2024-09-12T00:52:49.133 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command sync trace active hook 0x7fa79806c6c0 2024-09-12T00:52:49.133 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 5 asok(0x55a4605c0630) register_command sync trace active_short hook 0x7fa79806c6c0 2024-09-12T00:52:49.133 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:49.133 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 20 Filter name: none 2024-09-12T00:52:49.133 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:52:48.981+0000 7fa654ff9640 20 reqs_thread_entry: start 2024-09-12T00:52:49.133 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:52:49.133 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.133 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:49.133 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:52:49.133 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:52:49.133 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 : miss 2024-09-12T00:52:49.133 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:52:48.981+0000 7fa7a7f46800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.134 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:52:48.982+0000 7fa7a7f46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:52:49.134 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:52:48.982+0000 7fa7a7f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:52:49.134 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:52:48.982+0000 7fa7a7f46800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:52:49.134 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:52:48.982+0000 7fa7a7f46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:49.134 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:52:48.982+0000 7fa7a7f46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:49.134 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:52:48.982+0000 7fa7a7f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 2024-09-12T00:52:49.134 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:52:48.986+0000 7fa7a7f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:52:49.134 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:52:48.986+0000 7fa7a7f46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:52:49.134 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:52:48.986+0000 7fa7a7f46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:49.134 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:52:48.986+0000 7fa7a7f46800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32, ofs0, ns] 2024-09-12T00:52:49.134 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:52:48.986+0000 7fa6897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431653 cookie 94164482890688 notifier 7353 bl.length()=931 2024-09-12T00:52:49.134 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:52:48.986+0000 7fa6897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:52:49.134 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:52:48.986+0000 7fa6897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:52:49.135 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:52:48.986+0000 7fa6897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:49.135 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:52:48.988+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_sources= new_sources= 2024-09-12T00:52:49.135 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:52:48.988+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential sources added=[] removed=[] 2024-09-12T00:52:49.135 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:52:48.988+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_dests= new_dests= 2024-09-12T00:52:49.135 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:52:48.988+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential dests added=[] removed=[] 2024-09-12T00:52:49.135 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:52:48.990+0000 7fa7a7f46800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.0 2024-09-12T00:52:49.135 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:52:48.990+0000 7fa7a7f46800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.0 2024-09-12T00:52:49.135 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:52:48.990+0000 7fa7a7f46800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.1 2024-09-12T00:52:49.135 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:52:48.990+0000 7fa7a7f46800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.1 2024-09-12T00:52:49.135 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:52:48.990+0000 7fa7a7f46800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.0 2024-09-12T00:52:49.135 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:52:48.993+0000 7fa7a7f46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:52:49.135 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:52:48.993+0000 7fa7a7f46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 2024-09-12T00:52:49.135 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:52:48.994+0000 7fa7a7f46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:52:49.136 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:52:48.994+0000 7fa7a7f46800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:52:49.136 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:52:48.994+0000 7fa7a7f46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:49.136 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:52:48.994+0000 7fa7a7f46800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32, ofs0, ns] 2024-09-12T00:52:49.136 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:52:48.995+0000 7fa6897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431654 cookie 94164482890688 notifier 7353 bl.length()=931 2024-09-12T00:52:49.136 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:52:48.995+0000 7fa6897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:52:49.136 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:52:48.995+0000 7fa6897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:52:49.136 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:52:48.995+0000 7fa6897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:52:49.136 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:52:48.996+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_sources= new_sources= 2024-09-12T00:52:49.136 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:52:48.996+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential sources added=[] removed=[] 2024-09-12T00:52:49.136 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:52:48.996+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_dests= new_dests= 2024-09-12T00:52:49.136 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:52:48.996+0000 7fa7a7f46800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential dests added=[] removed=[] 2024-09-12T00:52:49.136 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:52:48.997+0000 7fa7a7f46800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.0 2024-09-12T00:52:49.136 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:52:48.998+0000 7fa7a7f46800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fa7a7f46800 time 2024-09-12T00:52:48.999124+0000 2024-09-12T00:52:49.137 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:49.137 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.137 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:49.137 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fa7ab58c71a] 2024-09-12T00:52:49.137 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa7ab58c8d8] 2024-09-12T00:52:49.137 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a45e88a641] 2024-09-12T00:52:49.137 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a45e89a637] 2024-09-12T00:52:49.137 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:52:49.137 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7fa7aa229590] 2024-09-12T00:52:49.137 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:52:49.137 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:52:49.137 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.137 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:52:48.999+0000 7fa7a7f46800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:49.138 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7fa7a7f46800 thread_name:radosgw-admin 2024-09-12T00:52:49.138 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.138 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:49.138 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fa7aa23e6f0] 2024-09-12T00:52:49.138 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fa7aa28b99c] 2024-09-12T00:52:49.138 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:52:49.138 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:52:49.138 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fa7ab58c774] 2024-09-12T00:52:49.138 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fa7ab58c8d8] 2024-09-12T00:52:49.138 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a45e88a641] 2024-09-12T00:52:49.138 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55a45e89a637] 2024-09-12T00:52:49.138 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:52:49.138 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7fa7aa229590] 2024-09-12T00:52:49.139 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:52:49.139 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:52:49.139 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:49.139 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.139 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:52:49.139 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:52:49.139 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:52:49.139 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:52:49.139 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:52:49.139 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:52:49.139 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:52:49.139 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:52:49.139 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:52:49.140 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:52:49.140 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:52:49.140 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:52:49.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:52:49.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:52:49.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:52:49.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:52:49.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:52:49.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:52:49.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:52:49.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:52:49.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:52:49.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:52:49.140 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:52:49.141 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:52:49.141 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:52:49.141 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:52:49.141 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:52:49.141 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:52:49.141 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:52:49.141 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:52:49.141 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:52:49.141 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:52:49.141 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:52:49.141 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:52:49.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:52:49.142 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:52:49.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:52:49.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:52:49.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:52:49.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:52:49.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:52:49.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:52:49.142 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:52:49.142 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:52:49.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:52:49.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:52:49.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:52:49.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:52:49.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:52:49.143 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:52:49.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:52:49.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:52:49.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:52:49.143 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:52:49.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:52:49.143 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:52:49.144 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:52:49.144 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:52:49.144 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:52:49.144 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:52:49.144 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:52:49.144 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:52:49.144 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:52:49.144 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:52:49.144 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:52:49.144 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:52:49.144 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:52:49.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:52:49.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:52:49.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:52:49.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:52:49.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:52:49.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:52:49.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:52:49.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:52:49.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:52:49.145 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:52:49.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:52:49.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:52:49.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:52:49.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:52:49.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:52:49.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:52:49.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:52:49.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:52:49.146 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:52:49.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:52:49.146 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:52:49.146 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:52:49.146 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:52:49.146 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:52:49.147 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:52:49.147 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:52:49.147 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:52:49.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa654ff9640 / http_manager 2024-09-12T00:52:49.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa656ffd640 / http_manager 2024-09-12T00:52:49.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa657fff640 / rgw_dt_lg_renew 2024-09-12T00:52:49.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa6777fe640 / ms_dispatch 2024-09-12T00:52:49.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa6897fa640 / io_context_pool 2024-09-12T00:52:49.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa68b7fe640 / ms_dispatch 2024-09-12T00:52:49.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa692604640 / ms_dispatch 2024-09-12T00:52:49.147 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa693e07640 / io_context_pool 2024-09-12T00:52:49.148 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa7a5236640 / msgr-worker-2 2024-09-12T00:52:49.148 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa7a5a37640 / msgr-worker-1 2024-09-12T00:52:49.148 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa7a6238640 / msgr-worker-0 2024-09-12T00:52:49.148 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa7a6a39640 / io_context_pool 2024-09-12T00:52:49.148 INFO:tasks.workunit.client.0.smithi062.stderr: 7fa7a7f46800 / radosgw-admin 2024-09-12T00:52:49.148 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:52:49.148 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:52:49.148 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:52:49.000586Z_2ea8d630-b588-4c18-b70a-c646fc448c81/log 2024-09-12T00:52:49.148 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:52:49.148 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:52:49.150 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:49.152 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:49.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.077+0000 7f613451f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.079+0000 7f613451f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.079+0000 7f613451f800 20 realm 2024-09-12T00:52:49.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.079+0000 7f613451f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.079+0000 7f613451f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.079+0000 7f613451f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:49.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.079+0000 7f613451f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.079+0000 7f613451f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.079+0000 7f613451f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.080+0000 7f613451f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:49.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.080+0000 7f613451f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.080+0000 7f613451f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:49.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.080+0000 7f613451f800 20 searching for the correct realm 2024-09-12T00:52:49.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.084+0000 7f612fa0b640 0 -- 172.21.15.62:0/4048837088 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f612806c230 msgr2=0x7f6128064530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:49.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.289+0000 7f6130a0d640 0 -- 172.21.15.62:0/4048837088 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x562656fc0170 msgr2=0x562656fc2610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:49.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.294+0000 7f613451f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:52:49.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.294+0000 7f613451f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:52:49.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.294+0000 7f613451f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:49.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.294+0000 7f613451f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:49.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.294+0000 7f613451f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:49.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.294+0000 7f613451f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:49.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.294+0000 7f613451f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.294+0000 7f613451f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.294+0000 7f613451f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.294+0000 7f613451f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:49.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.294+0000 7f613451f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.295+0000 7f613451f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:49.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.295+0000 7f613451f800 20 zone default found 2024-09-12T00:52:49.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.295+0000 7f613451f800 4 Realm: () 2024-09-12T00:52:49.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.295+0000 7f613451f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:52:49.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.295+0000 7f613451f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:52:49.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.295+0000 7f613451f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:49.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.295+0000 7f613451f800 20 zonegroup default 2024-09-12T00:52:49.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.295+0000 7f613451f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.295+0000 7f613451f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.295+0000 7f613451f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.296+0000 7f613451f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.296+0000 7f613451f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.296+0000 7f613451f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:49.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.296+0000 7f613451f800 20 started sync module instance, tier type = 2024-09-12T00:52:49.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.296+0000 7f613451f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:52:49.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.304+0000 7f613451f800 20 add_watcher() i=0 2024-09-12T00:52:49.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.304+0000 7f613451f800 20 add_watcher() i=1 2024-09-12T00:52:49.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.304+0000 7f613451f800 20 add_watcher() i=2 2024-09-12T00:52:49.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.304+0000 7f613451f800 20 add_watcher() i=3 2024-09-12T00:52:49.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.304+0000 7f613451f800 20 add_watcher() i=4 2024-09-12T00:52:49.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.304+0000 7f613451f800 20 add_watcher() i=5 2024-09-12T00:52:49.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.304+0000 7f613451f800 20 add_watcher() i=6 2024-09-12T00:52:49.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.306+0000 7f613451f800 20 add_watcher() i=7 2024-09-12T00:52:49.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.306+0000 7f613451f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:49.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.307+0000 7f5fe6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:49.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.308+0000 7f613451f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:49.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.308+0000 7f613451f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:49.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.308+0000 7f613451f800 5 note: GC not initialized 2024-09-12T00:52:49.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.308+0000 7f5fe5fe3640 20 reqs_thread_entry: start 2024-09-12T00:52:49.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.308+0000 7f613451f800 20 init_complete bucket index max shards: 1 2024-09-12T00:52:49.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.308+0000 7f613451f800 20 Filter name: none 2024-09-12T00:52:49.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.308+0000 7f5fdeffd640 20 reqs_thread_entry: start 2024-09-12T00:52:49.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.308+0000 7f613451f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.309+0000 7f613451f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:49.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.309+0000 7f613451f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.309+0000 7f613451f800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:52:49.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.309+0000 7f613451f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:49.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.309+0000 7f613451f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.310+0000 7f613451f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:52:49.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.310+0000 7f613451f800 20 rados->read ofs=0 len=0 2024-09-12T00:52:49.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.310+0000 7f613451f800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:52:49.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.310+0000 7f613451f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:49.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.311+0000 7f5fe6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:49.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.313+0000 7f613451f800 20 remove_watcher() i=0 2024-09-12T00:52:49.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.313+0000 7f613451f800 2 removed watcher, disabling cache 2024-09-12T00:52:49.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.315+0000 7f613451f800 20 remove_watcher() i=1 2024-09-12T00:52:49.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.316+0000 7f613451f800 20 remove_watcher() i=2 2024-09-12T00:52:49.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.316+0000 7f613451f800 20 remove_watcher() i=3 2024-09-12T00:52:49.316 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.318+0000 7f613451f800 20 remove_watcher() i=4 2024-09-12T00:52:49.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.319+0000 7f613451f800 20 remove_watcher() i=5 2024-09-12T00:52:49.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.320+0000 7f613451f800 20 remove_watcher() i=6 2024-09-12T00:52:49.321 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:52:49.323+0000 7f613451f800 20 remove_watcher() i=7 2024-09-12T00:52:49.332 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:52:49.332 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:52:49.333 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-commit-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:52:49.333 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:19.533 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:53:19.567 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:19.567 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:19.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.609+0000 7f993bc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.611+0000 7f993bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:19.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.611+0000 7f993bc0e800 20 realm 2024-09-12T00:53:19.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.611+0000 7f993bc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.611+0000 7f993bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:19.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.611+0000 7f993bc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:19.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.611+0000 7f993bc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.611+0000 7f993bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:19.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.611+0000 7f993bc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.612+0000 7f993bc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:19.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.612+0000 7f993bc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.612+0000 7f993bc0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:19.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.612+0000 7f993bc0e800 20 searching for the correct realm 2024-09-12T00:53:19.615 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.616+0000 7f992ffff640 0 -- 172.21.15.62:0/3397088640 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f9930089ea0 msgr2=0x7f9930088910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:19.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.619+0000 7f9937259640 0 -- 172.21.15.62:0/3397088640 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f993009abd0 msgr2=0x7f993005fdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:19.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.623+0000 7f993bc0e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:19.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.623+0000 7f993bc0e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:19.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.623+0000 7f993bc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:19.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.623+0000 7f993bc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:19.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.624+0000 7f993bc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:19.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.624+0000 7f993bc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:19.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.624+0000 7f993bc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.624+0000 7f993bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:19.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.624+0000 7f993bc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.624+0000 7f993bc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:19.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.624+0000 7f993bc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.624+0000 7f993bc0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:19.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.624+0000 7f993bc0e800 20 zone default found 2024-09-12T00:53:19.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.624+0000 7f993bc0e800 4 Realm: () 2024-09-12T00:53:19.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.624+0000 7f993bc0e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:19.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.624+0000 7f993bc0e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:19.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.624+0000 7f993bc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:19.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.624+0000 7f993bc0e800 20 zonegroup default 2024-09-12T00:53:19.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.624+0000 7f993bc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.625+0000 7f993bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:19.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.625+0000 7f993bc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.625+0000 7f993bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:19.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.625+0000 7f993bc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.625+0000 7f993bc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:19.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.625+0000 7f993bc0e800 20 started sync module instance, tier type = 2024-09-12T00:53:19.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.625+0000 7f993bc0e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:19.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.634+0000 7f993bc0e800 20 add_watcher() i=0 2024-09-12T00:53:19.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.634+0000 7f993bc0e800 20 add_watcher() i=1 2024-09-12T00:53:19.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.634+0000 7f993bc0e800 20 add_watcher() i=2 2024-09-12T00:53:19.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.634+0000 7f993bc0e800 20 add_watcher() i=3 2024-09-12T00:53:19.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.634+0000 7f993bc0e800 20 add_watcher() i=4 2024-09-12T00:53:19.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.634+0000 7f993bc0e800 20 add_watcher() i=5 2024-09-12T00:53:19.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.634+0000 7f993bc0e800 20 add_watcher() i=6 2024-09-12T00:53:19.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.635+0000 7f993bc0e800 20 add_watcher() i=7 2024-09-12T00:53:19.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.635+0000 7f993bc0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:19.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.637+0000 7f97ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:19.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.637+0000 7f993bc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:19.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.637+0000 7f993bc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:19.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.637+0000 7f993bc0e800 5 note: GC not initialized 2024-09-12T00:53:19.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.637+0000 7f97ed7e2640 20 reqs_thread_entry: start 2024-09-12T00:53:19.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.637+0000 7f993bc0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:19.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.637+0000 7f993bc0e800 20 Filter name: none 2024-09-12T00:53:19.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.637+0000 7f97e67fc640 20 reqs_thread_entry: start 2024-09-12T00:53:19.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.638+0000 7f993bc0e800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:53:19.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.638+0000 7f993bc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.638+0000 7f993bc0e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:19.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.638+0000 7f993bc0e800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:53:19.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.638+0000 7f993bc0e800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:53:19.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.638+0000 7f993bc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 : miss 2024-09-12T00:53:19.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.638+0000 7f993bc0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.639+0000 7f993bc0e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:19.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.639+0000 7f993bc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:53:19.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.639+0000 7f993bc0e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:53:19.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.639+0000 7f993bc0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:19.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.639+0000 7f993bc0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:19.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.639+0000 7f993bc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 2024-09-12T00:53:19.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.642+0000 7f993bc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:53:19.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.642+0000 7f993bc0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:53:19.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.642+0000 7f993bc0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:19.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.642+0000 7f993bc0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32, ofs0, ns] 2024-09-12T00:53:19.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.643+0000 7f981affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431656 cookie 94806333977824 notifier 7007 bl.length()=931 2024-09-12T00:53:19.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.643+0000 7f981affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:53:19.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.643+0000 7f981affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:53:19.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.643+0000 7f981affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:19.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.644+0000 7f993bc0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_sources= new_sources= 2024-09-12T00:53:19.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.644+0000 7f993bc0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential sources added=[] removed=[] 2024-09-12T00:53:19.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.644+0000 7f993bc0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_dests= new_dests= 2024-09-12T00:53:19.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.644+0000 7f993bc0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential dests added=[] removed=[] 2024-09-12T00:53:19.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.647+0000 7f993bc0e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.0 2024-09-12T00:53:19.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.647+0000 7f993bc0e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.0 2024-09-12T00:53:19.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.647+0000 7f993bc0e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.1 2024-09-12T00:53:19.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.647+0000 7f993bc0e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.1.1 2024-09-12T00:53:19.646 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.647+0000 7f993bc0e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.0 2024-09-12T00:53:19.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.649+0000 7f993bc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:19.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.649+0000 7f993bc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 2024-09-12T00:53:19.650 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.651+0000 7f993bc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:53:19.650 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.651+0000 7f993bc0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:53:19.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.651+0000 7f993bc0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:19.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.651+0000 7f993bc0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32, ofs0, ns] 2024-09-12T00:53:19.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.651+0000 7f981affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431657 cookie 94806333977824 notifier 7007 bl.length()=931 2024-09-12T00:53:19.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.651+0000 7f981affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:53:19.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.651+0000 7f981affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:53:19.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.651+0000 7f981affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:19.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.653+0000 7f993bc0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_sources= new_sources= 2024-09-12T00:53:19.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.653+0000 7f993bc0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential sources added=[] removed=[] 2024-09-12T00:53:19.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.653+0000 7f993bc0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_dests= new_dests= 2024-09-12T00:53:19.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.653+0000 7f993bc0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential dests added=[] removed=[] 2024-09-12T00:53:19.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.655+0000 7f993bc0e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32.0 2024-09-12T00:53:19.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.655+0000 7f993bc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:19.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.655+0000 7f993bc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 2024-09-12T00:53:19.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.656+0000 7f993bc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:53:19.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.656+0000 7f993bc0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:53:19.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.656+0000 7f993bc0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:19.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.656+0000 7f993bc0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32, ofs0, ns] 2024-09-12T00:53:19.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.656+0000 7f981a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431658 cookie 94806333977824 notifier 7007 bl.length()=899 2024-09-12T00:53:19.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.657+0000 7f981a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 info.flags=0x17 2024-09-12T00:53:19.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.657+0000 7f981a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 to cache LRU end 2024-09-12T00:53:19.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.657+0000 7f981a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:19.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.658+0000 7f993bc0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_sources= new_sources= 2024-09-12T00:53:19.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.658+0000 7f993bc0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential sources added=[] removed=[] 2024-09-12T00:53:19.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.658+0000 7f993bc0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): orig_dests= new_dests= 2024-09-12T00:53:19.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.658+0000 7f993bc0e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32]): potential dests added=[] removed=[] 2024-09-12T00:53:19.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.659+0000 7f993bc0e800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-12T00:53:19.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.661+0000 7f97ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:19.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.663+0000 7f993bc0e800 20 remove_watcher() i=0 2024-09-12T00:53:19.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.663+0000 7f993bc0e800 2 removed watcher, disabling cache 2024-09-12T00:53:19.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.664+0000 7f993bc0e800 20 remove_watcher() i=1 2024-09-12T00:53:19.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.666+0000 7f993bc0e800 20 remove_watcher() i=2 2024-09-12T00:53:19.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.667+0000 7f993bc0e800 20 remove_watcher() i=3 2024-09-12T00:53:19.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.668+0000 7f993bc0e800 20 remove_watcher() i=4 2024-09-12T00:53:19.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.669+0000 7f993bc0e800 20 remove_watcher() i=5 2024-09-12T00:53:19.668 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.670+0000 7f993bc0e800 20 remove_watcher() i=6 2024-09-12T00:53:19.669 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.671+0000 7f993bc0e800 20 remove_watcher() i=7 2024-09-12T00:53:19.682 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:53:19.711 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:19.712 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:19.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.752+0000 7f01ff72c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.754+0000 7f01ff72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:19.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.754+0000 7f01ff72c800 20 realm 2024-09-12T00:53:19.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.754+0000 7f01ff72c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.754+0000 7f01ff72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:19.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.754+0000 7f01ff72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:19.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.754+0000 7f01ff72c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.754+0000 7f01ff72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:19.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.754+0000 7f01ff72c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.755+0000 7f01ff72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:19.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.755+0000 7f01ff72c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.755+0000 7f01ff72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:19.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.755+0000 7f01ff72c800 20 searching for the correct realm 2024-09-12T00:53:19.756 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.757+0000 7f01fbb3f640 0 -- 172.21.15.62:0/567873962 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x561ee43b0300 msgr2=0x561ee43b2750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:19.760 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.761+0000 7f01fbb3f640 0 -- 172.21.15.62:0/567873962 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7f01ec071070 msgr2=0x7f01ec00a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:19.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.767+0000 7f01ff72c800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:19.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.767+0000 7f01ff72c800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:19.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.767+0000 7f01ff72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:19.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.767+0000 7f01ff72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:19.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.767+0000 7f01ff72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:19.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.767+0000 7f01ff72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:19.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.767+0000 7f01ff72c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.767+0000 7f01ff72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:19.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.767+0000 7f01ff72c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.767 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.767+0000 7f01ff72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:19.767 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.767+0000 7f01ff72c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.768+0000 7f01ff72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:19.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.768+0000 7f01ff72c800 20 zone default found 2024-09-12T00:53:19.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.768+0000 7f01ff72c800 4 Realm: () 2024-09-12T00:53:19.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.768+0000 7f01ff72c800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:19.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.768+0000 7f01ff72c800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:19.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.768+0000 7f01ff72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:19.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.768+0000 7f01ff72c800 20 zonegroup default 2024-09-12T00:53:19.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.768+0000 7f01ff72c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.768+0000 7f01ff72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:19.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.768+0000 7f01ff72c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.768+0000 7f01ff72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:19.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.768+0000 7f01ff72c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.769+0000 7f01ff72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:19.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.769+0000 7f01ff72c800 20 started sync module instance, tier type = 2024-09-12T00:53:19.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.769+0000 7f01ff72c800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:19.776 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.777+0000 7f01ff72c800 20 add_watcher() i=0 2024-09-12T00:53:19.776 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.777+0000 7f01ff72c800 20 add_watcher() i=1 2024-09-12T00:53:19.776 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.777+0000 7f01ff72c800 20 add_watcher() i=2 2024-09-12T00:53:19.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.777+0000 7f01ff72c800 20 add_watcher() i=3 2024-09-12T00:53:19.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.777+0000 7f01ff72c800 20 add_watcher() i=4 2024-09-12T00:53:19.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.777+0000 7f01ff72c800 20 add_watcher() i=5 2024-09-12T00:53:19.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.777+0000 7f01ff72c800 20 add_watcher() i=6 2024-09-12T00:53:19.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.778+0000 7f01ff72c800 20 add_watcher() i=7 2024-09-12T00:53:19.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.778+0000 7f01ff72c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:19.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.780+0000 7f00b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:19.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.780+0000 7f01ff72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:19.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.780+0000 7f01ff72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:19.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.781+0000 7f01ff72c800 5 note: GC not initialized 2024-09-12T00:53:19.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.781+0000 7f00b0fe1640 20 reqs_thread_entry: start 2024-09-12T00:53:19.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.781+0000 7f01ff72c800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:19.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.781+0000 7f01ff72c800 20 Filter name: none 2024-09-12T00:53:19.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.781+0000 7f002a7fc640 20 reqs_thread_entry: start 2024-09-12T00:53:19.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.781+0000 7f01ff72c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.782+0000 7f01ff72c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:19.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.782+0000 7f01ff72c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.782+0000 7f01ff72c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:19.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.782+0000 7f01ff72c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:19.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.782+0000 7f01ff72c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.783+0000 7f01ff72c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:53:19.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.783+0000 7f01ff72c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:19.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.783+0000 7f01ff72c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:53:19.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.783+0000 7f01ff72c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:19.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.784+0000 7f00b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:19.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.787+0000 7f01ff72c800 20 remove_watcher() i=0 2024-09-12T00:53:19.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.787+0000 7f01ff72c800 2 removed watcher, disabling cache 2024-09-12T00:53:19.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.788+0000 7f01ff72c800 20 remove_watcher() i=1 2024-09-12T00:53:19.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.789+0000 7f01ff72c800 20 remove_watcher() i=2 2024-09-12T00:53:19.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.790+0000 7f01ff72c800 20 remove_watcher() i=3 2024-09-12T00:53:19.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.791+0000 7f01ff72c800 20 remove_watcher() i=4 2024-09-12T00:53:19.791 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.792+0000 7f01ff72c800 20 remove_watcher() i=5 2024-09-12T00:53:19.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.793+0000 7f01ff72c800 20 remove_watcher() i=6 2024-09-12T00:53:19.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:19.794+0000 7f01ff72c800 20 remove_watcher() i=7 2024-09-12T00:53:19.804 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:19.804 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:53:19.804 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-commit-target-layout id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:53:19.804 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:20.114 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T00:53:20.114 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:20.965 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:53:20.994 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:20.994 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:21.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.033+0000 7f245c0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.035+0000 7f245c0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.035+0000 7f245c0bb800 20 realm 2024-09-12T00:53:21.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.035+0000 7f245c0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.035+0000 7f245c0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.035+0000 7f245c0bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:21.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.035+0000 7f245c0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.035+0000 7f245c0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.035+0000 7f245c0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.036+0000 7f245c0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:21.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.036+0000 7f245c0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.037+0000 7f245c0bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:21.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.037+0000 7f245c0bb800 20 searching for the correct realm 2024-09-12T00:53:21.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.040+0000 7f24593a4640 0 -- 172.21.15.62:0/2126258574 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f245406dd10 msgr2=0x7f245401d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:21.243 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.244+0000 7f245a3a6640 0 -- 172.21.15.62:0/2126258574 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55ba18755140 msgr2=0x55ba187575e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:21.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.248+0000 7f245c0bb800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:21.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.248+0000 7f245c0bb800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:21.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.248+0000 7f245c0bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:21.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.248+0000 7f245c0bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:21.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.248+0000 7f245c0bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:21.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.248+0000 7f245c0bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:21.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.248+0000 7f245c0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.248+0000 7f245c0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.248 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.248+0000 7f245c0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.248+0000 7f245c0bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:21.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.248+0000 7f245c0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.249+0000 7f245c0bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:21.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.249+0000 7f245c0bb800 20 zone default found 2024-09-12T00:53:21.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.249+0000 7f245c0bb800 4 Realm: () 2024-09-12T00:53:21.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.249+0000 7f245c0bb800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:21.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.249+0000 7f245c0bb800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:21.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.249+0000 7f245c0bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:21.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.249+0000 7f245c0bb800 20 zonegroup default 2024-09-12T00:53:21.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.249+0000 7f245c0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.249+0000 7f245c0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.249+0000 7f245c0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.249+0000 7f245c0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.249+0000 7f245c0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.250+0000 7f245c0bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.250+0000 7f245c0bb800 20 started sync module instance, tier type = 2024-09-12T00:53:21.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.250+0000 7f245c0bb800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:21.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.258+0000 7f245c0bb800 20 add_watcher() i=0 2024-09-12T00:53:21.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.258+0000 7f245c0bb800 20 add_watcher() i=1 2024-09-12T00:53:21.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.258+0000 7f245c0bb800 20 add_watcher() i=2 2024-09-12T00:53:21.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.258+0000 7f245c0bb800 20 add_watcher() i=3 2024-09-12T00:53:21.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.258+0000 7f245c0bb800 20 add_watcher() i=4 2024-09-12T00:53:21.257 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.258+0000 7f245c0bb800 20 add_watcher() i=5 2024-09-12T00:53:21.258 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.258+0000 7f245c0bb800 20 add_watcher() i=6 2024-09-12T00:53:21.258 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.259+0000 7f245c0bb800 20 add_watcher() i=7 2024-09-12T00:53:21.258 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.259+0000 7f245c0bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:21.259 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.260+0000 7f22fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:21.260 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.261+0000 7f245c0bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:21.260 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.261+0000 7f245c0bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:21.260 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.261+0000 7f245c0bb800 5 note: GC not initialized 2024-09-12T00:53:21.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.261+0000 7f22fa7fc640 20 reqs_thread_entry: start 2024-09-12T00:53:21.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.261+0000 7f245c0bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:21.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.261+0000 7f245c0bb800 20 Filter name: none 2024-09-12T00:53:21.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.261+0000 7f227ffff640 20 reqs_thread_entry: start 2024-09-12T00:53:21.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.261+0000 7f245c0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.261 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.262+0000 7f245c0bb800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:21.262 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.262+0000 7f245c0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.262 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.262+0000 7f245c0bb800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:53:21.262 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.263+0000 7f245c0bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:21.262 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.263+0000 7f245c0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.262 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.263+0000 7f245c0bb800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:21.262 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.263+0000 7f245c0bb800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.263 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.263+0000 7f245c0bb800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:53:21.263 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.263+0000 7f245c0bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:21.264 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.265+0000 7f22fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:21.266 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.267+0000 7f245c0bb800 20 remove_watcher() i=0 2024-09-12T00:53:21.266 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.267+0000 7f245c0bb800 2 removed watcher, disabling cache 2024-09-12T00:53:21.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.269+0000 7f245c0bb800 20 remove_watcher() i=1 2024-09-12T00:53:21.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.270+0000 7f245c0bb800 20 remove_watcher() i=2 2024-09-12T00:53:21.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.271+0000 7f245c0bb800 20 remove_watcher() i=3 2024-09-12T00:53:21.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.272+0000 7f245c0bb800 20 remove_watcher() i=4 2024-09-12T00:53:21.272 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.273+0000 7f245c0bb800 20 remove_watcher() i=5 2024-09-12T00:53:21.273 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.274+0000 7f245c0bb800 20 remove_watcher() i=6 2024-09-12T00:53:21.274 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.275+0000 7f245c0bb800 20 remove_watcher() i=7 2024-09-12T00:53:21.285 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:21.286 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:53:21.286 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-do-reshard id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:53:21.286 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:21.287 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T00:53:21.322 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:21.322 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:21.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.362+0000 7f6dc4b24800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.364+0000 7f6dc4b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.364+0000 7f6dc4b24800 20 realm 2024-09-12T00:53:21.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.364+0000 7f6dc4b24800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.364+0000 7f6dc4b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.364+0000 7f6dc4b24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:21.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.364+0000 7f6dc4b24800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.364+0000 7f6dc4b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.364+0000 7f6dc4b24800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.365+0000 7f6dc4b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:21.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.365+0000 7f6dc4b24800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.366+0000 7f6dc4b24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:21.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.366+0000 7f6dc4b24800 20 searching for the correct realm 2024-09-12T00:53:21.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.368+0000 7f6dc0067640 0 -- 172.21.15.62:0/2643292145 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f6db806e770 msgr2=0x7f6db806e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:21.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.573+0000 7f6dc1069640 0 -- 172.21.15.62:0/2643292145 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5574d28c6320 msgr2=0x5574d28c87e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:21.576 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.577+0000 7f6dc4b24800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:21.576 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.577+0000 7f6dc4b24800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:21.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.577+0000 7f6dc4b24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:21.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.577+0000 7f6dc4b24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:21.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.577+0000 7f6dc4b24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:21.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.577+0000 7f6dc4b24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:21.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.577+0000 7f6dc4b24800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.577+0000 7f6dc4b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.577+0000 7f6dc4b24800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.578 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.578+0000 7f6dc4b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:21.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.578+0000 7f6dc4b24800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.578+0000 7f6dc4b24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:21.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.578+0000 7f6dc4b24800 20 zone default found 2024-09-12T00:53:21.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.578+0000 7f6dc4b24800 4 Realm: () 2024-09-12T00:53:21.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.578+0000 7f6dc4b24800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:21.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.578+0000 7f6dc4b24800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:21.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.578+0000 7f6dc4b24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:21.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.578+0000 7f6dc4b24800 20 zonegroup default 2024-09-12T00:53:21.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.578+0000 7f6dc4b24800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.578+0000 7f6dc4b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.578+0000 7f6dc4b24800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.579 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.579+0000 7f6dc4b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.580 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.579+0000 7f6dc4b24800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.580 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.579+0000 7f6dc4b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.580 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.579+0000 7f6dc4b24800 20 started sync module instance, tier type = 2024-09-12T00:53:21.580 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.579+0000 7f6dc4b24800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:21.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.588+0000 7f6dc4b24800 20 add_watcher() i=0 2024-09-12T00:53:21.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.588+0000 7f6dc4b24800 20 add_watcher() i=1 2024-09-12T00:53:21.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.588+0000 7f6dc4b24800 20 add_watcher() i=2 2024-09-12T00:53:21.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.588+0000 7f6dc4b24800 20 add_watcher() i=3 2024-09-12T00:53:21.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.588+0000 7f6dc4b24800 20 add_watcher() i=4 2024-09-12T00:53:21.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.588+0000 7f6dc4b24800 20 add_watcher() i=5 2024-09-12T00:53:21.587 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.588+0000 7f6dc4b24800 20 add_watcher() i=6 2024-09-12T00:53:21.588 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.589+0000 7f6dc4b24800 20 add_watcher() i=7 2024-09-12T00:53:21.588 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.589+0000 7f6dc4b24800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:21.589 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.590+0000 7f6c777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:21.590 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.591+0000 7f6dc4b24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:21.590 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.591+0000 7f6dc4b24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:21.590 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.591+0000 7f6dc4b24800 5 note: GC not initialized 2024-09-12T00:53:21.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.591+0000 7f6c767e4640 20 reqs_thread_entry: start 2024-09-12T00:53:21.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.591+0000 7f6dc4b24800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:21.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.591+0000 7f6dc4b24800 20 Filter name: none 2024-09-12T00:53:21.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.591+0000 7f6c6ffff640 20 reqs_thread_entry: start 2024-09-12T00:53:21.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.591+0000 7f6dc4b24800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:53:21.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.591+0000 7f6dc4b24800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.592+0000 7f6dc4b24800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:21.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.592+0000 7f6dc4b24800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:53:21.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.592+0000 7f6dc4b24800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:53:21.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.592+0000 7f6dc4b24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 : miss 2024-09-12T00:53:21.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.592+0000 7f6dc4b24800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.592+0000 7f6dc4b24800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:53:21.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.592+0000 7f6dc4b24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 info.flags=0x17 2024-09-12T00:53:21.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.592+0000 7f6dc4b24800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 to cache LRU end 2024-09-12T00:53:21.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.592+0000 7f6dc4b24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:21.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.592+0000 7f6dc4b24800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:21.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.592+0000 7f6dc4b24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 2024-09-12T00:53:21.595 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.596+0000 7f6dc4b24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 info.flags=0x17 2024-09-12T00:53:21.595 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.596+0000 7f6dc4b24800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 to cache LRU end 2024-09-12T00:53:21.595 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.596+0000 7f6dc4b24800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:21.595 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.596+0000 7f6dc4b24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33, ofs0, ns] 2024-09-12T00:53:21.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.596+0000 7f6c97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431675 cookie 93960237053312 notifier 7443 bl.length()=911 2024-09-12T00:53:21.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.596+0000 7f6c97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 info.flags=0x17 2024-09-12T00:53:21.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.596+0000 7f6c97fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 to cache LRU end 2024-09-12T00:53:21.596 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.596+0000 7f6c97fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:21.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.598+0000 7f6dc4b24800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): orig_sources= new_sources= 2024-09-12T00:53:21.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.598+0000 7f6dc4b24800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): potential sources added=[] removed=[] 2024-09-12T00:53:21.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.598+0000 7f6dc4b24800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): orig_dests= new_dests= 2024-09-12T00:53:21.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.598+0000 7f6dc4b24800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): potential dests added=[] removed=[] 2024-09-12T00:53:21.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.601+0000 7f6dc4b24800 -1 Injecting error=-5 at location=do_reshard 2024-09-12T00:53:21.603 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.604+0000 7f6dc4b24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:21.604 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.604+0000 7f6dc4b24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 2024-09-12T00:53:21.604 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.605+0000 7f6dc4b24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 info.flags=0x17 2024-09-12T00:53:21.604 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.605+0000 7f6dc4b24800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 to cache LRU end 2024-09-12T00:53:21.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.605+0000 7f6dc4b24800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:21.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.605+0000 7f6dc4b24800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33, ofs0, ns] 2024-09-12T00:53:21.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.606+0000 7f6c97fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431676 cookie 93960237053312 notifier 7443 bl.length()=879 2024-09-12T00:53:21.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.606+0000 7f6c97fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 info.flags=0x17 2024-09-12T00:53:21.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.606+0000 7f6c97fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 to cache LRU end 2024-09-12T00:53:21.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.606+0000 7f6c97fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:21.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.607+0000 7f6dc4b24800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): orig_sources= new_sources= 2024-09-12T00:53:21.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.607+0000 7f6dc4b24800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): potential sources added=[] removed=[] 2024-09-12T00:53:21.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.607+0000 7f6dc4b24800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): orig_dests= new_dests= 2024-09-12T00:53:21.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.607+0000 7f6dc4b24800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): potential dests added=[] removed=[] 2024-09-12T00:53:21.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.607+0000 7f6dc4b24800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T00:53:21.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.609+0000 7f6c777e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:21.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.612+0000 7f6dc4b24800 20 remove_watcher() i=0 2024-09-12T00:53:21.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.612+0000 7f6dc4b24800 2 removed watcher, disabling cache 2024-09-12T00:53:21.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.613+0000 7f6dc4b24800 20 remove_watcher() i=1 2024-09-12T00:53:21.612 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.614+0000 7f6dc4b24800 20 remove_watcher() i=2 2024-09-12T00:53:21.613 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.615+0000 7f6dc4b24800 20 remove_watcher() i=3 2024-09-12T00:53:21.614 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.616+0000 7f6dc4b24800 20 remove_watcher() i=4 2024-09-12T00:53:21.615 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.617+0000 7f6dc4b24800 20 remove_watcher() i=5 2024-09-12T00:53:21.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.617+0000 7f6dc4b24800 20 remove_watcher() i=6 2024-09-12T00:53:21.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.619+0000 7f6dc4b24800 20 remove_watcher() i=7 2024-09-12T00:53:21.630 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:53:21.659 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:21.660 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:21.698 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.699+0000 7f275d440800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.701+0000 7f275d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.701+0000 7f275d440800 20 realm 2024-09-12T00:53:21.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.701+0000 7f275d440800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.701+0000 7f275d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.701+0000 7f275d440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:21.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.701+0000 7f275d440800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.702+0000 7f275d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.702+0000 7f275d440800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.702+0000 7f275d440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:21.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.702+0000 7f275d440800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.703+0000 7f275d440800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:21.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.703+0000 7f275d440800 20 searching for the correct realm 2024-09-12T00:53:21.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.706+0000 7f275a729640 0 -- 172.21.15.62:0/647809045 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f27540995f0 msgr2=0x7f2754062650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:21.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.911+0000 7f275b72b640 0 -- 172.21.15.62:0/647809045 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5636629110b0 msgr2=0x563662913540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:21.914 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.915+0000 7f275d440800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:21.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.915+0000 7f275d440800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:21.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.915+0000 7f275d440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:21.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.915+0000 7f275d440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:21.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.915+0000 7f275d440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:21.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.915+0000 7f275d440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:21.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.915+0000 7f275d440800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.916+0000 7f275d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.916+0000 7f275d440800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.916+0000 7f275d440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:21.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.916+0000 7f275d440800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.916+0000 7f275d440800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:21.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.916+0000 7f275d440800 20 zone default found 2024-09-12T00:53:21.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.916+0000 7f275d440800 4 Realm: () 2024-09-12T00:53:21.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.916+0000 7f275d440800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:21.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.916+0000 7f275d440800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:21.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.916+0000 7f275d440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:21.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.916+0000 7f275d440800 20 zonegroup default 2024-09-12T00:53:21.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.916+0000 7f275d440800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.916+0000 7f275d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.917+0000 7f275d440800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.917+0000 7f275d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.917+0000 7f275d440800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.917+0000 7f275d440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:21.917 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.917+0000 7f275d440800 20 started sync module instance, tier type = 2024-09-12T00:53:21.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.917+0000 7f275d440800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:21.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.926+0000 7f275d440800 20 add_watcher() i=0 2024-09-12T00:53:21.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.926+0000 7f275d440800 20 add_watcher() i=1 2024-09-12T00:53:21.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.926+0000 7f275d440800 20 add_watcher() i=2 2024-09-12T00:53:21.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.926+0000 7f275d440800 20 add_watcher() i=3 2024-09-12T00:53:21.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.926+0000 7f275d440800 20 add_watcher() i=4 2024-09-12T00:53:21.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.926+0000 7f275d440800 20 add_watcher() i=5 2024-09-12T00:53:21.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.926+0000 7f275d440800 20 add_watcher() i=6 2024-09-12T00:53:21.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.927+0000 7f275d440800 20 add_watcher() i=7 2024-09-12T00:53:21.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.927+0000 7f275d440800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:21.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.928+0000 7f26117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:21.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.929+0000 7f275d440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:21.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.929+0000 7f275d440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:21.928 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.929+0000 7f275d440800 5 note: GC not initialized 2024-09-12T00:53:21.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.929+0000 7f258bfff640 20 reqs_thread_entry: start 2024-09-12T00:53:21.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.929+0000 7f275d440800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:21.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.929+0000 7f275d440800 20 Filter name: none 2024-09-12T00:53:21.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.929+0000 7f2589ffb640 20 reqs_thread_entry: start 2024-09-12T00:53:21.929 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.929+0000 7f275d440800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.930 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.930+0000 7f275d440800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:21.930 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.930+0000 7f275d440800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.930 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.931+0000 7f275d440800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:53:21.930 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.931+0000 7f275d440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:21.930 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.931+0000 7f275d440800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.930 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.931+0000 7f275d440800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:21.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.931+0000 7f275d440800 20 rados->read ofs=0 len=0 2024-09-12T00:53:21.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.931+0000 7f275d440800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:53:21.931 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.931+0000 7f275d440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:21.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.933+0000 7f26117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:21.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.935+0000 7f275d440800 20 remove_watcher() i=0 2024-09-12T00:53:21.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.935+0000 7f275d440800 2 removed watcher, disabling cache 2024-09-12T00:53:21.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.936+0000 7f275d440800 20 remove_watcher() i=1 2024-09-12T00:53:21.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.937+0000 7f275d440800 20 remove_watcher() i=2 2024-09-12T00:53:21.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.938+0000 7f275d440800 20 remove_watcher() i=3 2024-09-12T00:53:21.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.939+0000 7f275d440800 20 remove_watcher() i=4 2024-09-12T00:53:21.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.940+0000 7f275d440800 20 remove_watcher() i=5 2024-09-12T00:53:21.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.941+0000 7f275d440800 20 remove_watcher() i=6 2024-09-12T00:53:21.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:21.941+0000 7f275d440800 20 remove_watcher() i=7 2024-09-12T00:53:21.953 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:21.953 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:53:21.953 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-do-reshard id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:53:21.953 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:22.046 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:53:22.080 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:22.080 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:22.120 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.121+0000 7f18a0735800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.125 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.123+0000 7f18a0735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.125 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.123+0000 7f18a0735800 20 realm 2024-09-12T00:53:22.125 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.123+0000 7f18a0735800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.125 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.123+0000 7f18a0735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.125 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.123+0000 7f18a0735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:22.126 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.123+0000 7f18a0735800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.126 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.123+0000 7f18a0735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.126 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.123+0000 7f18a0735800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.126 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.124+0000 7f18a0735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:22.126 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.124+0000 7f18a0735800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.126 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.124+0000 7f18a0735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:22.126 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.124+0000 7f18a0735800 20 searching for the correct realm 2024-09-12T00:53:22.126 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.127+0000 7f1893c7c640 0 -- 172.21.15.62:0/1823585577 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f18940666d0 msgr2=0x7f189409b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:22.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.332+0000 7f189cc7e640 0 -- 172.21.15.62:0/1823585577 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55ae88854640 msgr2=0x55ae88856ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:22.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.336+0000 7f18a0735800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:22.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.336+0000 7f18a0735800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:22.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.336+0000 7f18a0735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:22.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.336+0000 7f18a0735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:22.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.336+0000 7f18a0735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:22.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.336+0000 7f18a0735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:22.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.336+0000 7f18a0735800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.336+0000 7f18a0735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.336+0000 7f18a0735800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.336+0000 7f18a0735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:22.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.336+0000 7f18a0735800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.337+0000 7f18a0735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:22.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.337+0000 7f18a0735800 20 zone default found 2024-09-12T00:53:22.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.337+0000 7f18a0735800 4 Realm: () 2024-09-12T00:53:22.337 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.337+0000 7f18a0735800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:22.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.337+0000 7f18a0735800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:22.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.337+0000 7f18a0735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:22.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.337+0000 7f18a0735800 20 zonegroup default 2024-09-12T00:53:22.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.337+0000 7f18a0735800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.337+0000 7f18a0735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.337+0000 7f18a0735800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.337+0000 7f18a0735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.337+0000 7f18a0735800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.338+0000 7f18a0735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.338+0000 7f18a0735800 20 started sync module instance, tier type = 2024-09-12T00:53:22.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.338+0000 7f18a0735800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:22.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.346+0000 7f18a0735800 20 add_watcher() i=0 2024-09-12T00:53:22.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.346+0000 7f18a0735800 20 add_watcher() i=1 2024-09-12T00:53:22.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.346+0000 7f18a0735800 20 add_watcher() i=2 2024-09-12T00:53:22.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.346+0000 7f18a0735800 20 add_watcher() i=3 2024-09-12T00:53:22.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.346+0000 7f18a0735800 20 add_watcher() i=4 2024-09-12T00:53:22.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.346+0000 7f18a0735800 20 add_watcher() i=5 2024-09-12T00:53:22.345 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.346+0000 7f18a0735800 20 add_watcher() i=6 2024-09-12T00:53:22.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.347+0000 7f18a0735800 20 add_watcher() i=7 2024-09-12T00:53:22.346 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.347+0000 7f18a0735800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:22.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.349+0000 7f17527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:22.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.350+0000 7f18a0735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:22.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.350+0000 7f18a0735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:22.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.350+0000 7f18a0735800 5 note: GC not initialized 2024-09-12T00:53:22.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.350+0000 7f17517e2640 20 reqs_thread_entry: start 2024-09-12T00:53:22.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.350+0000 7f18a0735800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:22.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.350+0000 7f18a0735800 20 Filter name: none 2024-09-12T00:53:22.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.350+0000 7f16c2ffd640 20 reqs_thread_entry: start 2024-09-12T00:53:22.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.350+0000 7f18a0735800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:53:22.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.350+0000 7f18a0735800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.351+0000 7f18a0735800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:22.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.351+0000 7f18a0735800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:53:22.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.351+0000 7f18a0735800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:53:22.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.351+0000 7f18a0735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 : miss 2024-09-12T00:53:22.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.351+0000 7f18a0735800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.351+0000 7f18a0735800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:53:22.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.351+0000 7f18a0735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 info.flags=0x17 2024-09-12T00:53:22.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.351+0000 7f18a0735800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 to cache LRU end 2024-09-12T00:53:22.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.351+0000 7f18a0735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:22.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.351+0000 7f18a0735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:22.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.351+0000 7f18a0735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 2024-09-12T00:53:22.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.355+0000 7f18a0735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 info.flags=0x17 2024-09-12T00:53:22.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.355+0000 7f18a0735800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 to cache LRU end 2024-09-12T00:53:22.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.355+0000 7f18a0735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:22.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.355+0000 7f18a0735800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33, ofs0, ns] 2024-09-12T00:53:22.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.355+0000 7f1772ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431677 cookie 94208103186176 notifier 7091 bl.length()=911 2024-09-12T00:53:22.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.355+0000 7f1772ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 info.flags=0x17 2024-09-12T00:53:22.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.355+0000 7f1772ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 to cache LRU end 2024-09-12T00:53:22.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.355+0000 7f1772ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:22.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.357+0000 7f18a0735800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): orig_sources= new_sources= 2024-09-12T00:53:22.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.357+0000 7f18a0735800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): potential sources added=[] removed=[] 2024-09-12T00:53:22.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.357+0000 7f18a0735800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): orig_dests= new_dests= 2024-09-12T00:53:22.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.357+0000 7f18a0735800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): potential dests added=[] removed=[] 2024-09-12T00:53:22.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.359+0000 7f18a0735800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33.1.0 2024-09-12T00:53:22.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.359+0000 7f18a0735800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33.1.0 2024-09-12T00:53:22.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.359+0000 7f18a0735800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33.1.1 2024-09-12T00:53:22.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.359+0000 7f18a0735800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33.1.1 2024-09-12T00:53:22.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.359+0000 7f18a0735800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33.0 2024-09-12T00:53:22.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.361+0000 7f18a0735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:22.360 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.361+0000 7f18a0735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 2024-09-12T00:53:22.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.362+0000 7f18a0735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 info.flags=0x17 2024-09-12T00:53:22.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.362+0000 7f18a0735800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 to cache LRU end 2024-09-12T00:53:22.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.362+0000 7f18a0735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:22.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.362+0000 7f18a0735800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33, ofs0, ns] 2024-09-12T00:53:22.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.363+0000 7f1772ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431678 cookie 94208103186176 notifier 7091 bl.length()=911 2024-09-12T00:53:22.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.363+0000 7f1772ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 info.flags=0x17 2024-09-12T00:53:22.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.363+0000 7f1772ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 to cache LRU end 2024-09-12T00:53:22.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.363+0000 7f1772ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:22.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.364+0000 7f18a0735800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): orig_sources= new_sources= 2024-09-12T00:53:22.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.364+0000 7f18a0735800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): potential sources added=[] removed=[] 2024-09-12T00:53:22.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.364+0000 7f18a0735800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): orig_dests= new_dests= 2024-09-12T00:53:22.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.364+0000 7f18a0735800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): potential dests added=[] removed=[] 2024-09-12T00:53:22.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.365+0000 7f18a0735800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33.0 2024-09-12T00:53:22.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.365+0000 7f18a0735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:22.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.365+0000 7f18a0735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 2024-09-12T00:53:22.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.367+0000 7f18a0735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 info.flags=0x17 2024-09-12T00:53:22.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.367+0000 7f18a0735800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 to cache LRU end 2024-09-12T00:53:22.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.367+0000 7f18a0735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:22.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.367+0000 7f18a0735800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33, ofs0, ns] 2024-09-12T00:53:22.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.367+0000 7f17737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431679 cookie 94208103186176 notifier 7091 bl.length()=879 2024-09-12T00:53:22.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.367+0000 7f17737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 info.flags=0x17 2024-09-12T00:53:22.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.367+0000 7f17737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 to cache LRU end 2024-09-12T00:53:22.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.367+0000 7f17737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:22.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.368+0000 7f18a0735800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): orig_sources= new_sources= 2024-09-12T00:53:22.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.368+0000 7f18a0735800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): potential sources added=[] removed=[] 2024-09-12T00:53:22.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.368+0000 7f18a0735800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): orig_dests= new_dests= 2024-09-12T00:53:22.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.368+0000 7f18a0735800 20 handle_bi_update(): bucket=:error-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33]): potential dests added=[] removed=[] 2024-09-12T00:53:22.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.370+0000 7f18a0735800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T00:53:22.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.371+0000 7f17527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:22.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.374+0000 7f18a0735800 20 remove_watcher() i=0 2024-09-12T00:53:22.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.374+0000 7f18a0735800 2 removed watcher, disabling cache 2024-09-12T00:53:22.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.375+0000 7f18a0735800 20 remove_watcher() i=1 2024-09-12T00:53:22.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.376+0000 7f18a0735800 20 remove_watcher() i=2 2024-09-12T00:53:22.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.377+0000 7f18a0735800 20 remove_watcher() i=3 2024-09-12T00:53:22.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.377+0000 7f18a0735800 20 remove_watcher() i=4 2024-09-12T00:53:22.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.379+0000 7f18a0735800 20 remove_watcher() i=5 2024-09-12T00:53:22.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.379+0000 7f18a0735800 20 remove_watcher() i=6 2024-09-12T00:53:22.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.380+0000 7f18a0735800 20 remove_watcher() i=7 2024-09-12T00:53:22.392 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:53:22.421 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:22.422 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:22.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.461+0000 7f466ad37800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.463+0000 7f466ad37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.463+0000 7f466ad37800 20 realm 2024-09-12T00:53:22.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.463+0000 7f466ad37800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.463+0000 7f466ad37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.463+0000 7f466ad37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:22.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.463+0000 7f466ad37800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.463+0000 7f466ad37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.463+0000 7f466ad37800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.464+0000 7f466ad37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:22.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.464+0000 7f466ad37800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.465+0000 7f466ad37800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:22.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.465+0000 7f466ad37800 20 searching for the correct realm 2024-09-12T00:53:22.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.467+0000 7f4666220640 0 -- 172.21.15.62:0/1865817732 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f4660061040 msgr2=0x7f4660080910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:22.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.672+0000 7f4667222640 0 -- 172.21.15.62:0/1865817732 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55a0a92f1890 msgr2=0x55a0a92f3cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:22.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.676+0000 7f466ad37800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:22.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.676+0000 7f466ad37800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:22.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.676+0000 7f466ad37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:22.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.676+0000 7f466ad37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:22.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.676+0000 7f466ad37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:22.675 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.676+0000 7f466ad37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:22.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.676+0000 7f466ad37800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.676+0000 7f466ad37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.676 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.676+0000 7f466ad37800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.677+0000 7f466ad37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:22.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.677+0000 7f466ad37800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.677+0000 7f466ad37800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:22.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.677+0000 7f466ad37800 20 zone default found 2024-09-12T00:53:22.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.677+0000 7f466ad37800 4 Realm: () 2024-09-12T00:53:22.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.677+0000 7f466ad37800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:22.677 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.677+0000 7f466ad37800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:22.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.677+0000 7f466ad37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:22.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.677+0000 7f466ad37800 20 zonegroup default 2024-09-12T00:53:22.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.677+0000 7f466ad37800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.677+0000 7f466ad37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.677+0000 7f466ad37800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.677+0000 7f466ad37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.677+0000 7f466ad37800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.678+0000 7f466ad37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.678+0000 7f466ad37800 20 started sync module instance, tier type = 2024-09-12T00:53:22.678 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.678+0000 7f466ad37800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:22.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.686+0000 7f466ad37800 20 add_watcher() i=0 2024-09-12T00:53:22.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.686+0000 7f466ad37800 20 add_watcher() i=1 2024-09-12T00:53:22.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.686+0000 7f466ad37800 20 add_watcher() i=2 2024-09-12T00:53:22.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.686+0000 7f466ad37800 20 add_watcher() i=3 2024-09-12T00:53:22.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.686+0000 7f466ad37800 20 add_watcher() i=4 2024-09-12T00:53:22.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.686+0000 7f466ad37800 20 add_watcher() i=5 2024-09-12T00:53:22.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.686+0000 7f466ad37800 20 add_watcher() i=6 2024-09-12T00:53:22.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.687+0000 7f466ad37800 20 add_watcher() i=7 2024-09-12T00:53:22.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.687+0000 7f466ad37800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:22.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.689+0000 7f451d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:22.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.689+0000 7f466ad37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:22.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.689+0000 7f466ad37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:22.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.690+0000 7f466ad37800 5 note: GC not initialized 2024-09-12T00:53:22.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.690+0000 7f4497fff640 20 reqs_thread_entry: start 2024-09-12T00:53:22.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.690+0000 7f466ad37800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:22.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.690+0000 7f466ad37800 20 Filter name: none 2024-09-12T00:53:22.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.690+0000 7f4495ffb640 20 reqs_thread_entry: start 2024-09-12T00:53:22.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.690+0000 7f466ad37800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.691+0000 7f466ad37800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:22.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.691+0000 7f466ad37800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.691+0000 7f466ad37800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:53:22.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.691+0000 7f466ad37800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:22.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.691+0000 7f466ad37800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.691+0000 7f466ad37800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:22.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.691+0000 7f466ad37800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.692+0000 7f466ad37800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:53:22.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.692+0000 7f466ad37800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:22.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.693+0000 7f451d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:22.694 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.695+0000 7f466ad37800 20 remove_watcher() i=0 2024-09-12T00:53:22.694 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.695+0000 7f466ad37800 2 removed watcher, disabling cache 2024-09-12T00:53:22.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.696+0000 7f466ad37800 20 remove_watcher() i=1 2024-09-12T00:53:22.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.697+0000 7f466ad37800 20 remove_watcher() i=2 2024-09-12T00:53:22.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.698+0000 7f466ad37800 20 remove_watcher() i=3 2024-09-12T00:53:22.698 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.699+0000 7f466ad37800 20 remove_watcher() i=4 2024-09-12T00:53:22.699 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.700+0000 7f466ad37800 20 remove_watcher() i=5 2024-09-12T00:53:22.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.701+0000 7f466ad37800 20 remove_watcher() i=6 2024-09-12T00:53:22.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:22.702+0000 7f466ad37800 20 remove_watcher() i=7 2024-09-12T00:53:22.712 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:22.712 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:53:22.713 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-do-reshard id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:53:22.713 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:23.014 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T00:53:23.015 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:23.937 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:53:23.966 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:23.966 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:24.005 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.006+0000 7f49ecb25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.007 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.007+0000 7f49ecb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.007 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.007+0000 7f49ecb25800 20 realm 2024-09-12T00:53:24.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.007+0000 7f49ecb25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.008+0000 7f49ecb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.008+0000 7f49ecb25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:24.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.008+0000 7f49ecb25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.008+0000 7f49ecb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.008 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.008+0000 7f49ecb25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.009+0000 7f49ecb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:24.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.009+0000 7f49ecb25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.009+0000 7f49ecb25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:24.009 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.009+0000 7f49ecb25800 20 searching for the correct realm 2024-09-12T00:53:24.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.012+0000 7f49e7fb4640 0 -- 172.21.15.62:0/2162379387 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f49e0050520 msgr2=0x7f49e0093620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:24.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.217+0000 7f49e7fb4640 0 -- 172.21.15.62:0/2162379387 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x561457605ba0 msgr2=0x561457608020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:24.220 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.221+0000 7f49ecb25800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:24.220 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.221+0000 7f49ecb25800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:24.220 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.221+0000 7f49ecb25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:24.220 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.221+0000 7f49ecb25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:24.220 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.221+0000 7f49ecb25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:24.220 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.221+0000 7f49ecb25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:24.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.221+0000 7f49ecb25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.221+0000 7f49ecb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.221+0000 7f49ecb25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.221+0000 7f49ecb25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:24.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.221+0000 7f49ecb25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.222+0000 7f49ecb25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:24.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.222+0000 7f49ecb25800 20 zone default found 2024-09-12T00:53:24.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.222+0000 7f49ecb25800 4 Realm: () 2024-09-12T00:53:24.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.222+0000 7f49ecb25800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:24.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.222+0000 7f49ecb25800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:24.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.222+0000 7f49ecb25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:24.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.222+0000 7f49ecb25800 20 zonegroup default 2024-09-12T00:53:24.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.222+0000 7f49ecb25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.222+0000 7f49ecb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.222+0000 7f49ecb25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.223+0000 7f49ecb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.223+0000 7f49ecb25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.223+0000 7f49ecb25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.223+0000 7f49ecb25800 20 started sync module instance, tier type = 2024-09-12T00:53:24.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.223+0000 7f49ecb25800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:24.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.233+0000 7f49ecb25800 20 add_watcher() i=0 2024-09-12T00:53:24.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.233+0000 7f49ecb25800 20 add_watcher() i=1 2024-09-12T00:53:24.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.233+0000 7f49ecb25800 20 add_watcher() i=2 2024-09-12T00:53:24.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.233+0000 7f49ecb25800 20 add_watcher() i=3 2024-09-12T00:53:24.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.233+0000 7f49ecb25800 20 add_watcher() i=4 2024-09-12T00:53:24.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.233+0000 7f49ecb25800 20 add_watcher() i=5 2024-09-12T00:53:24.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.233+0000 7f49ecb25800 20 add_watcher() i=6 2024-09-12T00:53:24.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.234+0000 7f49ecb25800 20 add_watcher() i=7 2024-09-12T00:53:24.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.234+0000 7f49ecb25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:24.235 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.236+0000 7f489efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:24.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.237+0000 7f49ecb25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:24.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.237+0000 7f49ecb25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:24.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.237+0000 7f49ecb25800 5 note: GC not initialized 2024-09-12T00:53:24.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.237+0000 7f489dfdb640 20 reqs_thread_entry: start 2024-09-12T00:53:24.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.237+0000 7f49ecb25800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:24.236 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.237+0000 7f49ecb25800 20 Filter name: none 2024-09-12T00:53:24.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.237+0000 7f480f7fe640 20 reqs_thread_entry: start 2024-09-12T00:53:24.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.237+0000 7f49ecb25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.238+0000 7f49ecb25800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:24.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.238+0000 7f49ecb25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.238 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.238+0000 7f49ecb25800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:53:24.238 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.238+0000 7f49ecb25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:24.238 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.238+0000 7f49ecb25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.238 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.239+0000 7f49ecb25800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:24.238 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.239+0000 7f49ecb25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.239+0000 7f49ecb25800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:53:24.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.239+0000 7f49ecb25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:24.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.240+0000 7f489efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:24.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.243+0000 7f49ecb25800 20 remove_watcher() i=0 2024-09-12T00:53:24.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.243+0000 7f49ecb25800 2 removed watcher, disabling cache 2024-09-12T00:53:24.243 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.244+0000 7f49ecb25800 20 remove_watcher() i=1 2024-09-12T00:53:24.245 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.246+0000 7f49ecb25800 20 remove_watcher() i=2 2024-09-12T00:53:24.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.247+0000 7f49ecb25800 20 remove_watcher() i=3 2024-09-12T00:53:24.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.249+0000 7f49ecb25800 20 remove_watcher() i=4 2024-09-12T00:53:24.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.250+0000 7f49ecb25800 20 remove_watcher() i=5 2024-09-12T00:53:24.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.251+0000 7f49ecb25800 20 remove_watcher() i=6 2024-09-12T00:53:24.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.252+0000 7f49ecb25800 20 remove_watcher() i=7 2024-09-12T00:53:24.261 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.261 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:53:24.261 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-do-reshard id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:53:24.262 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.263 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:53:24.298 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:24.298 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:24.338 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.339+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.341+0000 7f796d72a800 20 realm 2024-09-12T00:53:24.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.341+0000 7f796d72a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:24.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.340 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.342+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:24.341 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.342+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.343+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:24.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.343+0000 7f796d72a800 20 searching for the correct realm 2024-09-12T00:53:24.344 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.346+0000 7f7963fff640 0 -- 172.21.15.62:0/379762881 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f7964078900 msgr2=0x7f79640853f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:24.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.550+0000 7f7969cae640 0 -- 172.21.15.62:0/379762881 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55ef49637c80 msgr2=0x55ef4963a140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:24.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.554+0000 7f796d72a800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:24.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:24.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:24.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:24.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:24.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:24.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:24.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:24.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 20 zone default found 2024-09-12T00:53:24.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 4 Realm: () 2024-09-12T00:53:24.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:24.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:24.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:24.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 20 zonegroup default 2024-09-12T00:53:24.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.556+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.556+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.556+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.556+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.556+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.556+0000 7f796d72a800 20 started sync module instance, tier type = 2024-09-12T00:53:24.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.556+0000 7f796d72a800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:24.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=0 2024-09-12T00:53:24.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=1 2024-09-12T00:53:24.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=2 2024-09-12T00:53:24.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=3 2024-09-12T00:53:24.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=4 2024-09-12T00:53:24.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=5 2024-09-12T00:53:24.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.567+0000 7f796d72a800 20 add_watcher() i=6 2024-09-12T00:53:24.567 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.568+0000 7f796d72a800 20 add_watcher() i=7 2024-09-12T00:53:24.567 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.568+0000 7f796d72a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:24.569 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.570+0000 7f781ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:24.570 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.571+0000 7f796d72a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:24.570 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.571+0000 7f796d72a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:24.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.571+0000 7f796d72a800 5 note: GC not initialized 2024-09-12T00:53:24.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.571+0000 7f781efe5640 20 reqs_thread_entry: start 2024-09-12T00:53:24.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.571+0000 7f796d72a800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:24.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.571+0000 7f796d72a800 20 Filter name: none 2024-09-12T00:53:24.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.571+0000 7f781cfe1640 20 reqs_thread_entry: start 2024-09-12T00:53:24.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.571+0000 7f796d72a800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:53:24.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.571+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.572+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:24.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.572+0000 7f796d72a800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:53:24.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.572+0000 7f796d72a800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:53:24.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.572+0000 7f796d72a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 : miss 2024-09-12T00:53:24.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.572+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.572+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:53:24.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.572+0000 7f796d72a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:24.573 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.572+0000 7f796d72a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:24.573 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.572+0000 7f796d72a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:24.573 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.572+0000 7f796d72a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:24.573 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.572+0000 7f796d72a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 2024-09-12T00:53:24.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.576+0000 7f796d72a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:24.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.576+0000 7f796d72a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:24.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.576+0000 7f796d72a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:24.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.576+0000 7f796d72a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34, ofs0, ns] 2024-09-12T00:53:24.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.577+0000 7f784cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431683 cookie 94486216870048 notifier 7142 bl.length()=911 2024-09-12T00:53:24.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.577+0000 7f784cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:24.577 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.577+0000 7f784cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:24.578 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.577+0000 7f784cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:24.578 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.579+0000 7f796d72a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): orig_sources= new_sources= 2024-09-12T00:53:24.578 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.579+0000 7f796d72a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): potential sources added=[] removed=[] 2024-09-12T00:53:24.578 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.579+0000 7f796d72a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): orig_dests= new_dests= 2024-09-12T00:53:24.578 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.579+0000 7f796d72a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): potential dests added=[] removed=[] 2024-09-12T00:53:24.580 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f796d72a800 time 2024-09-12T00:53:24.582416+0000 2024-09-12T00:53:24.580 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:24.581 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:24.581 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f796ef8c71a] 2024-09-12T00:53:24.581 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f796ef8c8d8] 2024-09-12T00:53:24.581 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef472ad641] 2024-09-12T00:53:24.581 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef472bd38a] 2024-09-12T00:53:24.581 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:53:24.581 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f796dc29590] 2024-09-12T00:53:24.581 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:53:24.581 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:53:24.581 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.582+0000 7f796d72a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f796d72a800 time 2024-09-12T00:53:24.582416+0000 2024-09-12T00:53:24.581 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:24.582 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.582 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:24.582 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f796ef8c71a] 2024-09-12T00:53:24.582 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f796ef8c8d8] 2024-09-12T00:53:24.582 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef472ad641] 2024-09-12T00:53:24.582 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef472bd38a] 2024-09-12T00:53:24.582 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:53:24.582 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f796dc29590] 2024-09-12T00:53:24.582 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:53:24.582 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:53:24.582 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.583 INFO:tasks.workunit.client.0.smithi062.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:53:24.583 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f796d72a800 thread_name:radosgw-admin 2024-09-12T00:53:24.596 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:24.596 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f796dc3e6f0] 2024-09-12T00:53:24.597 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f796dc8b99c] 2024-09-12T00:53:24.597 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:53:24.597 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:53:24.597 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f796ef8c774] 2024-09-12T00:53:24.597 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f796ef8c8d8] 2024-09-12T00:53:24.597 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef472ad641] 2024-09-12T00:53:24.597 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef472bd38a] 2024-09-12T00:53:24.597 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:53:24.597 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f796dc29590] 2024-09-12T00:53:24.597 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:53:24.597 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:53:24.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.582+0000 7f796d72a800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:53:24.598 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f796d72a800 thread_name:radosgw-admin 2024-09-12T00:53:24.598 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.598 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:24.598 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f796dc3e6f0] 2024-09-12T00:53:24.598 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f796dc8b99c] 2024-09-12T00:53:24.598 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:53:24.598 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:53:24.598 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f796ef8c774] 2024-09-12T00:53:24.598 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f796ef8c8d8] 2024-09-12T00:53:24.598 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef472ad641] 2024-09-12T00:53:24.598 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef472bd38a] 2024-09-12T00:53:24.598 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:53:24.599 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f796dc29590] 2024-09-12T00:53:24.599 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:53:24.599 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:53:24.599 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:53:24.599 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.599 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:53:24.599 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:53:24.322+0000 7f796d72a800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:24.599 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:53:24.322+0000 7f796d72a800 4 set_mon_vals no callback set 2024-09-12T00:53:24.599 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:53:24.322+0000 7f796d72a800 10 monclient: shutdown 2024-09-12T00:53:24.599 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 asok(0x55ef4932b630) unregister_commands rotate-key 2024-09-12T00:53:24.599 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:53:24.322+0000 7f796d72a800 10 monclient: build_initial_monmap 2024-09-12T00:53:24.599 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:53:24.322+0000 7f796d72a800 1 build_initial for_mkfs: 0 2024-09-12T00:53:24.599 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:53:24.322+0000 7f796d72a800 10 monclient: monmap: 2024-09-12T00:53:24.600 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:53:24.600 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:24.600 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:53:24.600 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:53:24.600 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:24.600 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.600 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:53:24.600 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:53:24.600 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:53:24.600 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.600 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding auth protocol: cephx 2024-09-12T00:53:24.600 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding auth protocol: cephx 2024-09-12T00:53:24.600 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding auth protocol: cephx 2024-09-12T00:53:24.600 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: secure 2024-09-12T00:53:24.601 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: crc 2024-09-12T00:53:24.601 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: secure 2024-09-12T00:53:24.601 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: crc 2024-09-12T00:53:24.601 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: secure 2024-09-12T00:53:24.601 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: crc 2024-09-12T00:53:24.601 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: crc 2024-09-12T00:53:24.601 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: secure 2024-09-12T00:53:24.601 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: crc 2024-09-12T00:53:24.601 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: secure 2024-09-12T00:53:24.601 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: crc 2024-09-12T00:53:24.601 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: secure 2024-09-12T00:53:24.601 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:53:24.323+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.601 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:53:24.323+0000 7f796d72a800 1 librados: starting msgr at 2024-09-12T00:53:24.601 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:53:24.323+0000 7f796d72a800 1 librados: starting objecter 2024-09-12T00:53:24.602 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command objecter_requests hook 0x55ef49551830 2024-09-12T00:53:24.602 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:53:24.323+0000 7f796d72a800 1 librados: setting wanted keys 2024-09-12T00:53:24.602 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:53:24.323+0000 7f796d72a800 1 librados: calling monclient init 2024-09-12T00:53:24.602 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient: init 2024-09-12T00:53:24.602 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding auth protocol: cephx 2024-09-12T00:53:24.602 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding auth protocol: cephx 2024-09-12T00:53:24.602 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding auth protocol: cephx 2024-09-12T00:53:24.602 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: secure 2024-09-12T00:53:24.602 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: crc 2024-09-12T00:53:24.602 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: secure 2024-09-12T00:53:24.602 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: crc 2024-09-12T00:53:24.602 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: secure 2024-09-12T00:53:24.603 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: crc 2024-09-12T00:53:24.603 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: crc 2024-09-12T00:53:24.603 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: secure 2024-09-12T00:53:24.603 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: crc 2024-09-12T00:53:24.603 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: secure 2024-09-12T00:53:24.603 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: crc 2024-09-12T00:53:24.603 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: secure 2024-09-12T00:53:24.603 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:53:24.323+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.603 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:53:24.323+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.603 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command rotate-key hook 0x55ef4954d9c8 2024-09-12T00:53:24.603 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:24.603 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:53:24.603 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-a con 0x55ef493c2230 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:53:24.604 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-c con 0x55ef49400380 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:53:24.604 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-b con 0x55ef494907c0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:53:24.604 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.604 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.604 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.604 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:24.604 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): authenticate will time out at 2090.816925s 2024-09-12T00:53:24.604 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): get_auth_request con 0x55ef493c2230 auth_method 0 2024-09-12T00:53:24.604 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.604 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.604 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.604 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:53:24.324+0000 7f7963fff640 10 monclient(hunting): get_auth_request con 0x55ef49400380 auth_method 0 2024-09-12T00:53:24.605 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:53:24.324+0000 7f7963fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.605 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:53:24.324+0000 7f7963fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.605 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:53:24.324+0000 7f7963fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.605 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.605 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.605 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.605 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:53:24.324+0000 7f7969cae640 10 monclient(hunting): get_auth_request con 0x55ef494907c0 auth_method 0 2024-09-12T00:53:24.605 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:53:24.324+0000 7f7969cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.605 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:53:24.324+0000 7f7969cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.605 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:53:24.324+0000 7f7969cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.605 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:53:24.324+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.605 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:53:24.324+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.605 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:53:24.324+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.606 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:53:24.324+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.606 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:53:24.324+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.606 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:53:24.324+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.606 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): handle_auth_done global_id 7530 payload 824 2024-09-12T00:53:24.606 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient: _finish_hunting 0 2024-09-12T00:53:24.606 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:53:24.324+0000 7f79694ad640 1 monclient: found mon.noname-a 2024-09-12T00:53:24.606 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:53:24.606 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.606 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:53:24.606 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: dump: 2024-09-12T00:53:24.606 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.606 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.607 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.607 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.607 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.607 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.607 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.607 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.607 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.607 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.607 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: _finish_auth 0 2024-09-12T00:53:24.607 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: _check_auth_tickets 2024-09-12T00:53:24.607 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:24.607 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.607 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:24.608 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: dump: 2024-09-12T00:53:24.608 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.608 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.608 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.608 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.608 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.608 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.608 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.608 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.608 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.608 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.609 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:53:24.324+0000 7f796d72a800 5 monclient: authenticate success, global_id 7530 2024-09-12T00:53:24.609 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:53:24.324+0000 7f796d72a800 10 monclient: _renew_subs 2024-09-12T00:53:24.609 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:53:24.324+0000 7f796d72a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:53:24.609 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:53:24.324+0000 7f7857606640 4 set_mon_vals no callback set 2024-09-12T00:53:24.609 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:53:24.324+0000 7f796d72a800 10 monclient: _renew_subs 2024-09-12T00:53:24.609 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:53:24.324+0000 7f796d72a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:53:24.609 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:53:24.324+0000 7f796d72a800 1 librados: init done 2024-09-12T00:53:24.609 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:53:24.326+0000 7f7855e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:24.609 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:53:24.326+0000 7f7855e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:53:24.609 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:53:24.326+0000 7f7855e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:53:24.609 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:53:24.326+0000 7f7963fff640 10 monclient: get_auth_request con 0x7f78500764a0 auth_method 0 2024-09-12T00:53:24.609 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:53:24.327+0000 7f7969cae640 10 monclient: get_auth_request con 0x55ef49575cb0 auth_method 0 2024-09-12T00:53:24.609 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:53:24.327+0000 7f79694ad640 10 monclient: get_auth_request con 0x55ef49598f10 auth_method 0 2024-09-12T00:53:24.610 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:53:24.328+0000 7f7963fff640 10 monclient: get_auth_request con 0x55ef4959d2c0 auth_method 0 2024-09-12T00:53:24.610 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:53:24.329+0000 7f796d72a800 10 monclient: build_initial_monmap 2024-09-12T00:53:24.610 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:53:24.329+0000 7f796d72a800 1 build_initial for_mkfs: 0 2024-09-12T00:53:24.610 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:53:24.329+0000 7f796d72a800 10 monclient: monmap: 2024-09-12T00:53:24.610 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:53:24.610 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:24.610 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:53:24.610 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:53:24.610 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:24.610 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.610 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:53:24.610 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:53:24.610 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:53:24.610 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.611 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding auth protocol: cephx 2024-09-12T00:53:24.611 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding auth protocol: cephx 2024-09-12T00:53:24.611 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding auth protocol: cephx 2024-09-12T00:53:24.611 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: secure 2024-09-12T00:53:24.611 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: crc 2024-09-12T00:53:24.611 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: secure 2024-09-12T00:53:24.611 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: crc 2024-09-12T00:53:24.611 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: secure 2024-09-12T00:53:24.611 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: crc 2024-09-12T00:53:24.611 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: crc 2024-09-12T00:53:24.611 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: secure 2024-09-12T00:53:24.612 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: crc 2024-09-12T00:53:24.612 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: secure 2024-09-12T00:53:24.612 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: crc 2024-09-12T00:53:24.612 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: secure 2024-09-12T00:53:24.612 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:53:24.330+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.612 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command objecter_requests cmddesc objecter_requests hook 0x55ef495a5640 EEXIST 2024-09-12T00:53:24.612 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient: init 2024-09-12T00:53:24.612 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding auth protocol: cephx 2024-09-12T00:53:24.612 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding auth protocol: cephx 2024-09-12T00:53:24.612 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding auth protocol: cephx 2024-09-12T00:53:24.612 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: secure 2024-09-12T00:53:24.613 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: crc 2024-09-12T00:53:24.613 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: secure 2024-09-12T00:53:24.613 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: crc 2024-09-12T00:53:24.613 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: secure 2024-09-12T00:53:24.613 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: crc 2024-09-12T00:53:24.613 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: crc 2024-09-12T00:53:24.613 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: secure 2024-09-12T00:53:24.613 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: crc 2024-09-12T00:53:24.613 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: secure 2024-09-12T00:53:24.613 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: crc 2024-09-12T00:53:24.613 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: secure 2024-09-12T00:53:24.613 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:53:24.330+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.614 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:53:24.330+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.614 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command rotate-key cmddesc rotate-key hook 0x55ef495a0970 EEXIST 2024-09-12T00:53:24.614 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:24.614 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:53:24.614 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-c con 0x55ef495c9960 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:53:24.614 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-b con 0x55ef495c9d40 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:53:24.614 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-a con 0x55ef495c8670 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:53:24.614 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.614 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.614 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.614 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:24.614 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): authenticate will time out at 2090.823868s 2024-09-12T00:53:24.614 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:53:24.330+0000 7f79694ad640 10 monclient(hunting): get_auth_request con 0x55ef495c9960 auth_method 0 2024-09-12T00:53:24.615 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:53:24.330+0000 7f79694ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.615 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:53:24.330+0000 7f79694ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.615 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:53:24.330+0000 7f79694ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.615 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:53:24.331+0000 7f7969cae640 10 monclient(hunting): get_auth_request con 0x55ef495c8670 auth_method 0 2024-09-12T00:53:24.615 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:53:24.331+0000 7f7969cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.615 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:53:24.331+0000 7f7969cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.615 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:53:24.331+0000 7f7969cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.615 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:53:24.331+0000 7f7963fff640 10 monclient(hunting): get_auth_request con 0x55ef495c9d40 auth_method 0 2024-09-12T00:53:24.615 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:53:24.331+0000 7f7963fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.615 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:53:24.331+0000 7f7963fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.615 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:53:24.331+0000 7f7963fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.615 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:53:24.331+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.615 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:53:24.331+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.616 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:53:24.331+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.616 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:53:24.331+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.616 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:53:24.331+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.616 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:53:24.331+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.616 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:53:24.331+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.616 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:53:24.331+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.616 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:53:24.331+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.616 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:53:24.331+0000 7f79694ad640 10 monclient(hunting): handle_auth_done global_id 7136 payload 824 2024-09-12T00:53:24.616 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:53:24.331+0000 7f79694ad640 10 monclient: _finish_hunting 0 2024-09-12T00:53:24.616 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:53:24.331+0000 7f79694ad640 1 monclient: found mon.noname-c 2024-09-12T00:53:24.616 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:53:24.331+0000 7f79694ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.616 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.617 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:24.617 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: dump: 2024-09-12T00:53:24.617 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.617 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.617 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.617 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.617 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.617 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.617 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.617 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.617 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.617 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.617 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: _finish_auth 0 2024-09-12T00:53:24.618 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: _check_auth_tickets 2024-09-12T00:53:24.618 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:24.618 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.618 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:24.618 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: dump: 2024-09-12T00:53:24.618 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.618 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.618 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.618 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.618 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.618 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.618 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.618 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.619 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.619 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.619 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:53:24.331+0000 7f796d72a800 5 monclient: authenticate success, global_id 7136 2024-09-12T00:53:24.619 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:53:24.331+0000 7f796d72a800 10 monclient: _renew_subs 2024-09-12T00:53:24.619 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:53:24.331+0000 7f796d72a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.619 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:53:24.331+0000 7f796a4af640 4 set_mon_vals no callback set 2024-09-12T00:53:24.619 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:53:24.331+0000 7f796d72a800 10 monclient: _renew_subs 2024-09-12T00:53:24.619 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:53:24.331+0000 7f796d72a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.619 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:53:24.333+0000 7f784effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:24.619 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:53:24.333+0000 7f784effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:53:24.619 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:53:24.333+0000 7f784effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:53:24.619 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:53:24.333+0000 7f7963fff640 10 monclient: get_auth_request con 0x7f7844076380 auth_method 0 2024-09-12T00:53:24.620 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:53:24.333+0000 7f796d72a800 10 monclient: get_monmap_and_config 2024-09-12T00:53:24.620 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:53:24.333+0000 7f796d72a800 10 monclient: build_initial_monmap 2024-09-12T00:53:24.620 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:53:24.333+0000 7f796d72a800 1 build_initial for_mkfs: 0 2024-09-12T00:53:24.620 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:53:24.333+0000 7f796d72a800 10 monclient: monmap: 2024-09-12T00:53:24.620 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:53:24.620 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:24.620 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:53:24.620 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:53:24.620 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:24.620 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.620 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:53:24.620 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:53:24.620 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:53:24.621 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.621 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding auth protocol: cephx 2024-09-12T00:53:24.621 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding auth protocol: cephx 2024-09-12T00:53:24.621 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding auth protocol: cephx 2024-09-12T00:53:24.621 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: secure 2024-09-12T00:53:24.621 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: crc 2024-09-12T00:53:24.621 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: secure 2024-09-12T00:53:24.621 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: crc 2024-09-12T00:53:24.621 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: secure 2024-09-12T00:53:24.621 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: crc 2024-09-12T00:53:24.621 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: crc 2024-09-12T00:53:24.621 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: secure 2024-09-12T00:53:24.621 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: crc 2024-09-12T00:53:24.622 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: secure 2024-09-12T00:53:24.622 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: crc 2024-09-12T00:53:24.622 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: secure 2024-09-12T00:53:24.622 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:53:24.334+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.622 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient: init 2024-09-12T00:53:24.622 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding auth protocol: cephx 2024-09-12T00:53:24.622 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding auth protocol: cephx 2024-09-12T00:53:24.622 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding auth protocol: cephx 2024-09-12T00:53:24.622 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: secure 2024-09-12T00:53:24.622 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: crc 2024-09-12T00:53:24.622 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: secure 2024-09-12T00:53:24.622 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: crc 2024-09-12T00:53:24.622 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: secure 2024-09-12T00:53:24.623 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: crc 2024-09-12T00:53:24.623 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: crc 2024-09-12T00:53:24.623 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: secure 2024-09-12T00:53:24.623 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: crc 2024-09-12T00:53:24.623 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: secure 2024-09-12T00:53:24.623 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: crc 2024-09-12T00:53:24.623 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: secure 2024-09-12T00:53:24.623 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:53:24.334+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.623 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:53:24.334+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.623 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command rotate-key cmddesc rotate-key hook 0x7fffd8c36ba8 EEXIST 2024-09-12T00:53:24.623 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:24.623 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:53:24.624 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-b con 0x55ef495ed770 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:53:24.624 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-a con 0x55ef496181e0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:53:24.624 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-c con 0x55ef49619590 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:53:24.624 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.624 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.624 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.624 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:24.624 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): authenticate will time out at 2090.827705s 2024-09-12T00:53:24.624 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:53:24.334+0000 7f7963fff640 10 monclient(hunting): get_auth_request con 0x55ef496181e0 auth_method 0 2024-09-12T00:53:24.624 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:53:24.334+0000 7f7963fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.624 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:53:24.334+0000 7f7963fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.624 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:53:24.334+0000 7f7963fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.624 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:53:24.334+0000 7f7969cae640 10 monclient(hunting): get_auth_request con 0x55ef49619590 auth_method 0 2024-09-12T00:53:24.625 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:53:24.334+0000 7f7969cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.625 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:53:24.334+0000 7f7969cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.625 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:53:24.334+0000 7f7969cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.625 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:53:24.334+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.625 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:53:24.334+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.625 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:53:24.334+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.625 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:53:24.334+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.625 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:53:24.334+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.625 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:53:24.334+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.626 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:53:24.334+0000 7f79694ad640 10 monclient(hunting): get_auth_request con 0x55ef495ed770 auth_method 0 2024-09-12T00:53:24.626 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:53:24.334+0000 7f79694ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.626 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:53:24.334+0000 7f79694ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.626 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:53:24.334+0000 7f79694ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.626 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:53:24.335+0000 7f7969cae640 10 monclient(hunting): handle_auth_done global_id 7139 payload 274 2024-09-12T00:53:24.626 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:53:24.335+0000 7f7969cae640 10 monclient: _finish_hunting 0 2024-09-12T00:53:24.626 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:53:24.335+0000 7f7969cae640 1 monclient: found mon.noname-c 2024-09-12T00:53:24.626 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:53:24.335+0000 7f7969cae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.626 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.626 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:24.626 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: dump: 2024-09-12T00:53:24.626 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.626 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.627 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.627 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.627 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.627 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.627 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.627 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.627 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.627 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.627 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: _finish_auth 0 2024-09-12T00:53:24.627 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: _check_auth_tickets 2024-09-12T00:53:24.627 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:24.627 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.627 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:24.628 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: dump: 2024-09-12T00:53:24.628 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.628 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.628 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.628 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.628 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.628 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.628 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.628 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.628 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.628 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.628 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:53:24.335+0000 7f796d72a800 5 monclient: authenticate success, global_id 7139 2024-09-12T00:53:24.629 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:53:24.335+0000 7f796d72a800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:24.629 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:53:24.335+0000 7f796d72a800 4 set_mon_vals no callback set 2024-09-12T00:53:24.629 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:53:24.335+0000 7f796d72a800 10 monclient: shutdown 2024-09-12T00:53:24.629 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:53:24.336+0000 7f796d72a800 10 monclient: build_initial_monmap 2024-09-12T00:53:24.629 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:53:24.336+0000 7f796d72a800 1 build_initial for_mkfs: 0 2024-09-12T00:53:24.629 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:53:24.336+0000 7f796d72a800 10 monclient: monmap: 2024-09-12T00:53:24.629 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:53:24.629 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:24.629 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:53:24.629 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:53:24.629 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:24.629 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.629 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:53:24.630 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:53:24.630 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:53:24.630 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.630 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding auth protocol: cephx 2024-09-12T00:53:24.630 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding auth protocol: cephx 2024-09-12T00:53:24.630 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding auth protocol: cephx 2024-09-12T00:53:24.630 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: secure 2024-09-12T00:53:24.630 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: crc 2024-09-12T00:53:24.630 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: secure 2024-09-12T00:53:24.630 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: crc 2024-09-12T00:53:24.630 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: secure 2024-09-12T00:53:24.630 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: crc 2024-09-12T00:53:24.630 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: crc 2024-09-12T00:53:24.631 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: secure 2024-09-12T00:53:24.631 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: crc 2024-09-12T00:53:24.631 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: secure 2024-09-12T00:53:24.631 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: crc 2024-09-12T00:53:24.631 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: secure 2024-09-12T00:53:24.631 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:53:24.336+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.631 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:53:24.336+0000 7f796d72a800 1 librados: starting msgr at 2024-09-12T00:53:24.631 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:53:24.336+0000 7f796d72a800 1 librados: starting objecter 2024-09-12T00:53:24.631 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command objecter_requests cmddesc objecter_requests hook 0x55ef495c8e20 EEXIST 2024-09-12T00:53:24.631 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:53:24.336+0000 7f796d72a800 1 librados: setting wanted keys 2024-09-12T00:53:24.631 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:53:24.336+0000 7f796d72a800 1 librados: calling monclient init 2024-09-12T00:53:24.631 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:53:24.336+0000 7f796d72a800 10 monclient: init 2024-09-12T00:53:24.631 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding auth protocol: cephx 2024-09-12T00:53:24.632 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding auth protocol: cephx 2024-09-12T00:53:24.632 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding auth protocol: cephx 2024-09-12T00:53:24.632 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: secure 2024-09-12T00:53:24.632 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: crc 2024-09-12T00:53:24.632 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: secure 2024-09-12T00:53:24.632 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: crc 2024-09-12T00:53:24.632 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: secure 2024-09-12T00:53:24.632 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: crc 2024-09-12T00:53:24.632 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: crc 2024-09-12T00:53:24.632 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: secure 2024-09-12T00:53:24.632 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: crc 2024-09-12T00:53:24.632 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: secure 2024-09-12T00:53:24.632 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: crc 2024-09-12T00:53:24.633 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: secure 2024-09-12T00:53:24.633 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:53:24.336+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.633 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:53:24.336+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.633 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command rotate-key cmddesc rotate-key hook 0x55ef495de368 EEXIST 2024-09-12T00:53:24.633 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:53:24.336+0000 7f796d72a800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:24.633 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:53:24.336+0000 7f796d72a800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:53:24.633 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-c con 0x55ef495ed770 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:53:24.633 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-a con 0x55ef49619590 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:53:24.633 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-b con 0x55ef4960d1d0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:53:24.633 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.633 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.633 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.634 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:24.634 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): authenticate will time out at 2090.830047s 2024-09-12T00:53:24.634 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): get_auth_request con 0x55ef495ed770 auth_method 0 2024-09-12T00:53:24.634 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.634 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.634 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.634 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:53:24.337+0000 7f7963fff640 10 monclient(hunting): get_auth_request con 0x55ef49619590 auth_method 0 2024-09-12T00:53:24.634 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:53:24.337+0000 7f7963fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.634 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:53:24.337+0000 7f7963fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.634 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:53:24.337+0000 7f7963fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.634 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.634 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.634 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.635 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:53:24.337+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.635 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:53:24.337+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.635 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:53:24.337+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.635 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:53:24.337+0000 7f7969cae640 10 monclient(hunting): get_auth_request con 0x55ef4960d1d0 auth_method 0 2024-09-12T00:53:24.635 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:53:24.337+0000 7f7969cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.635 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:53:24.337+0000 7f7969cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.635 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:53:24.337+0000 7f7969cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.635 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): handle_auth_done global_id 7142 payload 824 2024-09-12T00:53:24.635 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient: _finish_hunting 0 2024-09-12T00:53:24.635 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:53:24.337+0000 7f79694ad640 1 monclient: found mon.noname-c 2024-09-12T00:53:24.635 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.635 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.635 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:24.636 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: dump: 2024-09-12T00:53:24.636 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.636 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.636 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.636 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.636 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.636 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.636 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.636 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.636 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.636 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.636 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: _finish_auth 0 2024-09-12T00:53:24.637 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: _check_auth_tickets 2024-09-12T00:53:24.637 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:24.637 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.637 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:24.637 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: dump: 2024-09-12T00:53:24.637 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.637 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.637 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.637 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.637 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.637 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.637 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.637 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.638 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.638 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.638 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:53:24.337+0000 7f796d72a800 5 monclient: authenticate success, global_id 7142 2024-09-12T00:53:24.638 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient: _renew_subs 2024-09-12T00:53:24.638 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.638 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:53:24.337+0000 7f784cff9640 4 set_mon_vals no callback set 2024-09-12T00:53:24.638 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient: _renew_subs 2024-09-12T00:53:24.638 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.638 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:53:24.337+0000 7f796d72a800 1 librados: init done 2024-09-12T00:53:24.638 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:53:24.337+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command cr dump hook 0x55ef49621118 2024-09-12T00:53:24.638 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:53:24.339+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.638 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:53:24.340+0000 7f783affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:24.638 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:53:24.340+0000 7f783affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:53:24.639 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:53:24.340+0000 7f783affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:53:24.639 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:53:24.340+0000 7f7963fff640 10 monclient: get_auth_request con 0x7f78340764a0 auth_method 0 2024-09-12T00:53:24.639 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:53:24.340+0000 7f7969cae640 10 monclient: get_auth_request con 0x55ef49637c80 auth_method 0 2024-09-12T00:53:24.639 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.639 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:53:24.341+0000 7f796d72a800 20 realm 2024-09-12T00:53:24.639 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.639 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.639 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:53:24.341+0000 7f796d72a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:24.639 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.639 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.639 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.639 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:53:24.341+0000 7f79694ad640 10 monclient: get_auth_request con 0x55ef4963bef0 auth_method 0 2024-09-12T00:53:24.640 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:53:24.342+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:24.640 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:53:24.342+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.640 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:53:24.342+0000 7f7963fff640 10 monclient: get_auth_request con 0x55ef4963f750 auth_method 0 2024-09-12T00:53:24.640 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:53:24.343+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:24.640 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:53:24.343+0000 7f796d72a800 20 searching for the correct realm 2024-09-12T00:53:24.640 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:53:24.343+0000 7f7969cae640 10 monclient: get_auth_request con 0x55ef496444f0 auth_method 0 2024-09-12T00:53:24.640 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:53:24.344+0000 7f79694ad640 10 monclient: get_auth_request con 0x7f7964061040 auth_method 0 2024-09-12T00:53:24.640 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:53:24.346+0000 7f7963fff640 10 monclient: get_auth_request con 0x7f7964078900 auth_method 0 2024-09-12T00:53:24.640 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:53:24.346+0000 7f7963fff640 0 -- 172.21.15.62:0/379762881 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f7964078900 msgr2=0x7f79640853f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:24.640 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:53:24.547+0000 7f7963fff640 10 monclient: get_auth_request con 0x7f7964078900 auth_method 0 2024-09-12T00:53:24.640 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:53:24.549+0000 7f7969cae640 10 monclient: get_auth_request con 0x7f795c09dc40 auth_method 0 2024-09-12T00:53:24.640 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:53:24.549+0000 7f79694ad640 10 monclient: get_auth_request con 0x7f7964093910 auth_method 0 2024-09-12T00:53:24.641 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:53:24.550+0000 7f7969cae640 0 -- 172.21.15.62:0/379762881 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55ef49637c80 msgr2=0x55ef4963a140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:24.641 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:53:24.550+0000 7f783affd640 1 client.7142.objecter ms_handle_reset 0x55ef49637c80 session 0x55ef496375b0 osd.6 2024-09-12T00:53:24.641 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:53:24.550+0000 7f783affd640 10 monclient: _renew_subs 2024-09-12T00:53:24.641 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:53:24.550+0000 7f783affd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.641 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:53:24.551+0000 7f7969cae640 10 monclient: get_auth_request con 0x7f7834086750 auth_method 0 2024-09-12T00:53:24.641 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:53:24.554+0000 7f796d72a800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:24.641 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:24.641 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:24.641 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:24.641 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:24.641 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:24.641 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.641 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.642 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.642 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:24.642 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.642 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:24.642 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 zone default found 2024-09-12T00:53:24.642 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:53:24.555+0000 7f796d72a800 4 Realm: () 2024-09-12T00:53:24.642 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:53:24.555+0000 7f796d72a800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:24.642 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:53:24.555+0000 7f796d72a800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:24.642 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:53:24.555+0000 7f796d72a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:24.642 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 zonegroup default 2024-09-12T00:53:24.642 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.642 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:53:24.556+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.642 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:53:24.556+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.643 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:53:24.556+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.643 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:53:24.556+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.643 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:53:24.556+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.643 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:53:24.556+0000 7f796d72a800 20 started sync module instance, tier type = 2024-09-12T00:53:24.643 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:53:24.556+0000 7f796d72a800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:24.643 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=0 2024-09-12T00:53:24.643 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=1 2024-09-12T00:53:24.643 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=2 2024-09-12T00:53:24.643 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=3 2024-09-12T00:53:24.643 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=4 2024-09-12T00:53:24.643 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=5 2024-09-12T00:53:24.643 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:53:24.567+0000 7f796d72a800 20 add_watcher() i=6 2024-09-12T00:53:24.643 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:53:24.568+0000 7f796d72a800 20 add_watcher() i=7 2024-09-12T00:53:24.643 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:53:24.568+0000 7f796d72a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:24.644 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding auth protocol: cephx 2024-09-12T00:53:24.644 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding auth protocol: cephx 2024-09-12T00:53:24.644 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding auth protocol: cephx 2024-09-12T00:53:24.644 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: secure 2024-09-12T00:53:24.644 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: crc 2024-09-12T00:53:24.644 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: secure 2024-09-12T00:53:24.644 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: crc 2024-09-12T00:53:24.644 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: secure 2024-09-12T00:53:24.644 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: crc 2024-09-12T00:53:24.644 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:53:24.570+0000 7f781ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:24.644 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: crc 2024-09-12T00:53:24.644 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: secure 2024-09-12T00:53:24.645 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: crc 2024-09-12T00:53:24.645 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: secure 2024-09-12T00:53:24.645 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: crc 2024-09-12T00:53:24.645 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: secure 2024-09-12T00:53:24.645 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:53:24.571+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.645 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:53:24.571+0000 7f796d72a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:24.645 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:53:24.571+0000 7f796d72a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:24.645 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command cache list hook 0x55ef4960edf0 2024-09-12T00:53:24.645 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command cache inspect hook 0x55ef4960edf0 2024-09-12T00:53:24.646 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command cache erase hook 0x55ef4960edf0 2024-09-12T00:53:24.646 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command cache zap hook 0x55ef4960edf0 2024-09-12T00:53:24.646 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 note: GC not initialized 2024-09-12T00:53:24.646 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:53:24.571+0000 7f781efe5640 20 reqs_thread_entry: start 2024-09-12T00:53:24.646 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command sync trace show hook 0x7f796404d7c0 2024-09-12T00:53:24.646 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command sync trace history hook 0x7f796404d7c0 2024-09-12T00:53:24.646 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command sync trace active hook 0x7f796404d7c0 2024-09-12T00:53:24.646 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command sync trace active_short hook 0x7f796404d7c0 2024-09-12T00:53:24.647 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:53:24.571+0000 7f796d72a800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:24.647 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:53:24.571+0000 7f796d72a800 20 Filter name: none 2024-09-12T00:53:24.647 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:53:24.571+0000 7f781cfe1640 20 reqs_thread_entry: start 2024-09-12T00:53:24.647 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:53:24.571+0000 7f796d72a800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:53:24.647 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:53:24.571+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.647 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:53:24.572+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:24.647 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:53:24.647 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:53:24.647 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 : miss 2024-09-12T00:53:24.647 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:53:24.572+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.647 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:53:24.572+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:53:24.647 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:24.648 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:24.648 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:24.648 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:24.648 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 2024-09-12T00:53:24.648 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:53:24.576+0000 7f796d72a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:24.648 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:53:24.576+0000 7f796d72a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:24.648 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:53:24.576+0000 7f796d72a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:24.648 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:53:24.576+0000 7f796d72a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34, ofs0, ns] 2024-09-12T00:53:24.648 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:53:24.577+0000 7f784cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431683 cookie 94486216870048 notifier 7142 bl.length()=911 2024-09-12T00:53:24.648 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:53:24.577+0000 7f784cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:24.648 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:53:24.577+0000 7f784cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:24.649 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:53:24.577+0000 7f784cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:24.649 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:53:24.579+0000 7f796d72a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): orig_sources= new_sources= 2024-09-12T00:53:24.649 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:53:24.579+0000 7f796d72a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): potential sources added=[] removed=[] 2024-09-12T00:53:24.649 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:53:24.579+0000 7f796d72a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): orig_dests= new_dests= 2024-09-12T00:53:24.649 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:53:24.579+0000 7f796d72a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): potential dests added=[] removed=[] 2024-09-12T00:53:24.649 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:53:24.582+0000 7f796d72a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f796d72a800 time 2024-09-12T00:53:24.582416+0000 2024-09-12T00:53:24.649 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:24.649 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.649 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:24.650 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f796ef8c71a] 2024-09-12T00:53:24.650 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f796ef8c8d8] 2024-09-12T00:53:24.650 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef472ad641] 2024-09-12T00:53:24.650 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef472bd38a] 2024-09-12T00:53:24.650 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:53:24.650 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f796dc29590] 2024-09-12T00:53:24.650 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:53:24.650 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:53:24.650 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.650 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:53:24.582+0000 7f796d72a800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:53:24.650 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f796d72a800 thread_name:radosgw-admin 2024-09-12T00:53:24.650 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.650 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:24.651 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f796dc3e6f0] 2024-09-12T00:53:24.651 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f796dc8b99c] 2024-09-12T00:53:24.651 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:53:24.651 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:53:24.651 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f796ef8c774] 2024-09-12T00:53:24.651 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f796ef8c8d8] 2024-09-12T00:53:24.651 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef472ad641] 2024-09-12T00:53:24.651 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef472bd38a] 2024-09-12T00:53:24.651 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:53:24.651 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f796dc29590] 2024-09-12T00:53:24.651 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:53:24.651 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:53:24.652 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:53:24.652 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.652 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:53:24.652 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:53:24.652 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:53:24.652 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:53:24.652 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:53:24.652 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:53:24.652 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:53:24.652 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:53:24.652 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:53:24.652 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:53:24.652 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:53:24.652 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:53:24.653 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:53:24.653 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:53:24.653 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:53:24.653 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:53:24.653 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:53:24.653 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:53:24.653 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:53:24.653 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:53:24.653 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:53:24.653 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:53:24.653 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:53:24.653 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:53:24.653 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:53:24.654 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:53:24.654 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:53:24.654 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:53:24.654 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:53:24.654 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:53:24.654 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:53:24.654 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:53:24.654 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:53:24.654 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:53:24.654 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:53:24.654 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:53:24.654 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:53:24.654 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:53:24.655 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:53:24.655 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:53:24.655 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:53:24.655 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:53:24.655 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:53:24.655 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:53:24.655 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:53:24.655 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:53:24.655 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:53:24.655 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:53:24.655 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:53:24.655 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:53:24.655 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:53:24.656 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:53:24.656 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:53:24.656 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:53:24.656 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:53:24.656 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:53:24.656 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:53:24.656 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:53:24.656 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:53:24.656 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:53:24.656 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:53:24.656 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:53:24.656 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:53:24.656 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:53:24.657 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:53:24.657 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:53:24.657 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:53:24.657 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:53:24.657 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:53:24.657 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:53:24.657 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:53:24.657 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:53:24.657 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:53:24.657 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:53:24.657 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:53:24.657 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:53:24.658 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:53:24.658 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:53:24.658 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:53:24.658 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:53:24.658 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:53:24.658 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:53:24.658 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:53:24.658 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:53:24.658 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:53:24.658 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:53:24.658 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:53:24.658 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:53:24.658 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:53:24.659 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:53:24.659 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:53:24.659 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:53:24.659 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:53:24.659 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:53:24.659 INFO:tasks.workunit.client.0.smithi062.stderr: 7f781cfe1640 / http_manager 2024-09-12T00:53:24.659 INFO:tasks.workunit.client.0.smithi062.stderr: 7f781efe5640 / http_manager 2024-09-12T00:53:24.659 INFO:tasks.workunit.client.0.smithi062.stderr: 7f781ffe7640 / rgw_dt_lg_renew 2024-09-12T00:53:24.659 INFO:tasks.workunit.client.0.smithi062.stderr: 7f783affd640 / ms_dispatch 2024-09-12T00:53:24.659 INFO:tasks.workunit.client.0.smithi062.stderr: 7f784cff9640 / io_context_pool 2024-09-12T00:53:24.659 INFO:tasks.workunit.client.0.smithi062.stderr: 7f784effd640 / ms_dispatch 2024-09-12T00:53:24.659 INFO:tasks.workunit.client.0.smithi062.stderr: 7f7855e03640 / ms_dispatch 2024-09-12T00:53:24.660 INFO:tasks.workunit.client.0.smithi062.stderr: 7f7857606640 / io_context_pool 2024-09-12T00:53:24.660 INFO:tasks.workunit.client.0.smithi062.stderr: 7f7963fff640 / msgr-worker-2 2024-09-12T00:53:24.660 INFO:tasks.workunit.client.0.smithi062.stderr: 7f79694ad640 / msgr-worker-1 2024-09-12T00:53:24.660 INFO:tasks.workunit.client.0.smithi062.stderr: 7f7969cae640 / msgr-worker-0 2024-09-12T00:53:24.660 INFO:tasks.workunit.client.0.smithi062.stderr: 7f796a4af640 / io_context_pool 2024-09-12T00:53:24.660 INFO:tasks.workunit.client.0.smithi062.stderr: 7f796d72a800 / radosgw-admin 2024-09-12T00:53:24.660 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:53:24.660 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:53:24.660 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/log/ceph/ceph-client.admin.127536.log 2024-09-12T00:53:24.660 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:53:24.660 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:53:24.660 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:53:24.322+0000 7f796d72a800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:24.660 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:53:24.322+0000 7f796d72a800 4 set_mon_vals no callback set 2024-09-12T00:53:24.660 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:53:24.322+0000 7f796d72a800 10 monclient: shutdown 2024-09-12T00:53:24.661 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 asok(0x55ef4932b630) unregister_commands rotate-key 2024-09-12T00:53:24.661 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:53:24.322+0000 7f796d72a800 10 monclient: build_initial_monmap 2024-09-12T00:53:24.661 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:53:24.322+0000 7f796d72a800 1 build_initial for_mkfs: 0 2024-09-12T00:53:24.661 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:53:24.322+0000 7f796d72a800 10 monclient: monmap: 2024-09-12T00:53:24.661 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:53:24.661 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:24.661 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:53:24.661 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:53:24.661 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:24.661 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.661 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:53:24.661 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:53:24.661 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:53:24.662 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.662 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding auth protocol: cephx 2024-09-12T00:53:24.662 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding auth protocol: cephx 2024-09-12T00:53:24.662 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding auth protocol: cephx 2024-09-12T00:53:24.662 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: secure 2024-09-12T00:53:24.662 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: crc 2024-09-12T00:53:24.662 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: secure 2024-09-12T00:53:24.662 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: crc 2024-09-12T00:53:24.662 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: secure 2024-09-12T00:53:24.662 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: crc 2024-09-12T00:53:24.662 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: crc 2024-09-12T00:53:24.662 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: secure 2024-09-12T00:53:24.662 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: crc 2024-09-12T00:53:24.662 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: secure 2024-09-12T00:53:24.663 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: crc 2024-09-12T00:53:24.663 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:53:24.322+0000 7f796d72a800 5 AuthRegistry(0x55ef495535a0) adding con mode: secure 2024-09-12T00:53:24.663 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:53:24.323+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.663 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:53:24.323+0000 7f796d72a800 1 librados: starting msgr at 2024-09-12T00:53:24.663 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:53:24.323+0000 7f796d72a800 1 librados: starting objecter 2024-09-12T00:53:24.663 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command objecter_requests hook 0x55ef49551830 2024-09-12T00:53:24.663 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:53:24.323+0000 7f796d72a800 1 librados: setting wanted keys 2024-09-12T00:53:24.663 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:53:24.323+0000 7f796d72a800 1 librados: calling monclient init 2024-09-12T00:53:24.663 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient: init 2024-09-12T00:53:24.663 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding auth protocol: cephx 2024-09-12T00:53:24.663 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding auth protocol: cephx 2024-09-12T00:53:24.663 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding auth protocol: cephx 2024-09-12T00:53:24.663 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: secure 2024-09-12T00:53:24.664 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: crc 2024-09-12T00:53:24.664 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: secure 2024-09-12T00:53:24.664 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: crc 2024-09-12T00:53:24.664 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: secure 2024-09-12T00:53:24.664 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: crc 2024-09-12T00:53:24.664 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: crc 2024-09-12T00:53:24.664 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: secure 2024-09-12T00:53:24.664 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: crc 2024-09-12T00:53:24.664 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: secure 2024-09-12T00:53:24.664 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: crc 2024-09-12T00:53:24.664 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 AuthRegistry(0x55ef4954d880) adding con mode: secure 2024-09-12T00:53:24.664 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:53:24.323+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.664 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:53:24.323+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.665 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:53:24.323+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command rotate-key hook 0x55ef4954d9c8 2024-09-12T00:53:24.665 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:24.665 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:53:24.665 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-a con 0x55ef493c2230 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:53:24.665 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-c con 0x55ef49400380 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:53:24.665 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-b con 0x55ef494907c0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:53:24.665 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.665 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.665 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.665 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:24.665 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:53:24.323+0000 7f796d72a800 10 monclient(hunting): authenticate will time out at 2090.816925s 2024-09-12T00:53:24.665 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): get_auth_request con 0x55ef493c2230 auth_method 0 2024-09-12T00:53:24.665 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.666 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.666 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.666 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:53:24.324+0000 7f7963fff640 10 monclient(hunting): get_auth_request con 0x55ef49400380 auth_method 0 2024-09-12T00:53:24.666 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:53:24.324+0000 7f7963fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.666 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:53:24.324+0000 7f7963fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.666 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:53:24.324+0000 7f7963fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.666 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.666 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.666 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.666 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:53:24.324+0000 7f7969cae640 10 monclient(hunting): get_auth_request con 0x55ef494907c0 auth_method 0 2024-09-12T00:53:24.666 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:53:24.324+0000 7f7969cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.666 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:53:24.324+0000 7f7969cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.666 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:53:24.324+0000 7f7969cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.667 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:53:24.324+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.667 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:53:24.324+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.667 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:53:24.324+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.667 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:53:24.324+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.667 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:53:24.324+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.667 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:53:24.324+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.667 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient(hunting): handle_auth_done global_id 7530 payload 824 2024-09-12T00:53:24.667 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient: _finish_hunting 0 2024-09-12T00:53:24.667 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:53:24.324+0000 7f79694ad640 1 monclient: found mon.noname-a 2024-09-12T00:53:24.667 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:53:24.324+0000 7f79694ad640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:53:24.667 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.667 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:53:24.668 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: dump: 2024-09-12T00:53:24.668 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.668 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.668 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.668 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.668 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.668 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.668 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.668 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.668 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.668 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.668 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: _finish_auth 0 2024-09-12T00:53:24.668 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: _check_auth_tickets 2024-09-12T00:53:24.668 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:24.668 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.669 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:53:24.669 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:53:24.324+0000 7f7855e03640 10 monclient: dump: 2024-09-12T00:53:24.669 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.669 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.669 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.669 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.669 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.669 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.669 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.669 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.669 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.669 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.670 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:53:24.324+0000 7f796d72a800 5 monclient: authenticate success, global_id 7530 2024-09-12T00:53:24.670 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:53:24.324+0000 7f796d72a800 10 monclient: _renew_subs 2024-09-12T00:53:24.670 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:53:24.324+0000 7f796d72a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:53:24.670 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:53:24.324+0000 7f7857606640 4 set_mon_vals no callback set 2024-09-12T00:53:24.670 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:53:24.324+0000 7f796d72a800 10 monclient: _renew_subs 2024-09-12T00:53:24.670 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:53:24.324+0000 7f796d72a800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:53:24.670 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:53:24.324+0000 7f796d72a800 1 librados: init done 2024-09-12T00:53:24.670 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:53:24.326+0000 7f7855e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:24.670 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:53:24.326+0000 7f7855e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:53:24.670 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:53:24.326+0000 7f7855e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:53:24.670 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:53:24.326+0000 7f7963fff640 10 monclient: get_auth_request con 0x7f78500764a0 auth_method 0 2024-09-12T00:53:24.670 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:53:24.327+0000 7f7969cae640 10 monclient: get_auth_request con 0x55ef49575cb0 auth_method 0 2024-09-12T00:53:24.670 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:53:24.327+0000 7f79694ad640 10 monclient: get_auth_request con 0x55ef49598f10 auth_method 0 2024-09-12T00:53:24.671 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:53:24.328+0000 7f7963fff640 10 monclient: get_auth_request con 0x55ef4959d2c0 auth_method 0 2024-09-12T00:53:24.671 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:53:24.329+0000 7f796d72a800 10 monclient: build_initial_monmap 2024-09-12T00:53:24.671 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:53:24.329+0000 7f796d72a800 1 build_initial for_mkfs: 0 2024-09-12T00:53:24.671 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:53:24.329+0000 7f796d72a800 10 monclient: monmap: 2024-09-12T00:53:24.671 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:53:24.671 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:24.671 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:53:24.671 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:53:24.671 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:24.671 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.671 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:53:24.671 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:53:24.671 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:53:24.672 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.672 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding auth protocol: cephx 2024-09-12T00:53:24.672 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding auth protocol: cephx 2024-09-12T00:53:24.672 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding auth protocol: cephx 2024-09-12T00:53:24.672 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: secure 2024-09-12T00:53:24.672 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: crc 2024-09-12T00:53:24.672 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: secure 2024-09-12T00:53:24.672 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: crc 2024-09-12T00:53:24.672 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: secure 2024-09-12T00:53:24.672 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: crc 2024-09-12T00:53:24.672 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: crc 2024-09-12T00:53:24.672 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: secure 2024-09-12T00:53:24.672 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: crc 2024-09-12T00:53:24.673 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: secure 2024-09-12T00:53:24.673 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: crc 2024-09-12T00:53:24.673 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:53:24.329+0000 7f796d72a800 5 AuthRegistry(0x55ef495a2150) adding con mode: secure 2024-09-12T00:53:24.673 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:53:24.330+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.673 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command objecter_requests cmddesc objecter_requests hook 0x55ef495a5640 EEXIST 2024-09-12T00:53:24.673 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient: init 2024-09-12T00:53:24.673 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding auth protocol: cephx 2024-09-12T00:53:24.673 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding auth protocol: cephx 2024-09-12T00:53:24.673 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding auth protocol: cephx 2024-09-12T00:53:24.673 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: secure 2024-09-12T00:53:24.673 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: crc 2024-09-12T00:53:24.673 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: secure 2024-09-12T00:53:24.673 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: crc 2024-09-12T00:53:24.674 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: secure 2024-09-12T00:53:24.674 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: crc 2024-09-12T00:53:24.674 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: crc 2024-09-12T00:53:24.674 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: secure 2024-09-12T00:53:24.674 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: crc 2024-09-12T00:53:24.674 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: secure 2024-09-12T00:53:24.674 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: crc 2024-09-12T00:53:24.674 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 AuthRegistry(0x55ef495a0828) adding con mode: secure 2024-09-12T00:53:24.674 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:53:24.330+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.674 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:53:24.330+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.674 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:53:24.330+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command rotate-key cmddesc rotate-key hook 0x55ef495a0970 EEXIST 2024-09-12T00:53:24.674 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:24.674 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:53:24.675 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-c con 0x55ef495c9960 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:53:24.675 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-b con 0x55ef495c9d40 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:53:24.675 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-a con 0x55ef495c8670 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:53:24.675 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.675 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.675 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.675 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:24.675 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:53:24.330+0000 7f796d72a800 10 monclient(hunting): authenticate will time out at 2090.823868s 2024-09-12T00:53:24.675 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:53:24.330+0000 7f79694ad640 10 monclient(hunting): get_auth_request con 0x55ef495c9960 auth_method 0 2024-09-12T00:53:24.675 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:53:24.330+0000 7f79694ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.675 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:53:24.330+0000 7f79694ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.675 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:53:24.330+0000 7f79694ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.676 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:53:24.331+0000 7f7969cae640 10 monclient(hunting): get_auth_request con 0x55ef495c8670 auth_method 0 2024-09-12T00:53:24.676 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:53:24.331+0000 7f7969cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.676 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:53:24.331+0000 7f7969cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.676 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:53:24.331+0000 7f7969cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.676 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:53:24.331+0000 7f7963fff640 10 monclient(hunting): get_auth_request con 0x55ef495c9d40 auth_method 0 2024-09-12T00:53:24.676 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:53:24.331+0000 7f7963fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.676 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:53:24.331+0000 7f7963fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.676 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:53:24.331+0000 7f7963fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.676 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:53:24.331+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.676 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:53:24.331+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.677 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:53:24.331+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.677 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:53:24.331+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.677 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:53:24.331+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.677 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:53:24.331+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.677 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:53:24.331+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.677 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:53:24.331+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.677 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:53:24.331+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.677 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:53:24.331+0000 7f79694ad640 10 monclient(hunting): handle_auth_done global_id 7136 payload 824 2024-09-12T00:53:24.677 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:53:24.331+0000 7f79694ad640 10 monclient: _finish_hunting 0 2024-09-12T00:53:24.677 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:53:24.331+0000 7f79694ad640 1 monclient: found mon.noname-c 2024-09-12T00:53:24.677 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:53:24.331+0000 7f79694ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.678 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.678 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:24.678 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: dump: 2024-09-12T00:53:24.678 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.678 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.678 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.678 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.678 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.678 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.678 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.679 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.679 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.679 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.679 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: _finish_auth 0 2024-09-12T00:53:24.679 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: _check_auth_tickets 2024-09-12T00:53:24.679 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:24.679 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.679 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:24.679 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:53:24.331+0000 7f784effd640 10 monclient: dump: 2024-09-12T00:53:24.679 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.679 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.680 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.680 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.680 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.680 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.680 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.680 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.680 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.680 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.680 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:53:24.331+0000 7f796d72a800 5 monclient: authenticate success, global_id 7136 2024-09-12T00:53:24.680 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:53:24.331+0000 7f796d72a800 10 monclient: _renew_subs 2024-09-12T00:53:24.680 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:53:24.331+0000 7f796d72a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.680 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:53:24.331+0000 7f796a4af640 4 set_mon_vals no callback set 2024-09-12T00:53:24.680 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:53:24.331+0000 7f796d72a800 10 monclient: _renew_subs 2024-09-12T00:53:24.681 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:53:24.331+0000 7f796d72a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.681 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:53:24.333+0000 7f784effd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:24.681 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:53:24.333+0000 7f784effd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:53:24.681 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:53:24.333+0000 7f784effd640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:53:24.681 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:53:24.333+0000 7f7963fff640 10 monclient: get_auth_request con 0x7f7844076380 auth_method 0 2024-09-12T00:53:24.681 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:53:24.333+0000 7f796d72a800 10 monclient: get_monmap_and_config 2024-09-12T00:53:24.681 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:53:24.333+0000 7f796d72a800 10 monclient: build_initial_monmap 2024-09-12T00:53:24.681 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:53:24.333+0000 7f796d72a800 1 build_initial for_mkfs: 0 2024-09-12T00:53:24.681 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:53:24.333+0000 7f796d72a800 10 monclient: monmap: 2024-09-12T00:53:24.681 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:53:24.681 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:24.681 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:53:24.681 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:53:24.682 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:24.682 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.682 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:53:24.682 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:53:24.682 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:53:24.682 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.682 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding auth protocol: cephx 2024-09-12T00:53:24.682 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding auth protocol: cephx 2024-09-12T00:53:24.682 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding auth protocol: cephx 2024-09-12T00:53:24.682 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: secure 2024-09-12T00:53:24.682 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: crc 2024-09-12T00:53:24.682 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: secure 2024-09-12T00:53:24.682 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: crc 2024-09-12T00:53:24.683 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: secure 2024-09-12T00:53:24.683 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: crc 2024-09-12T00:53:24.683 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: crc 2024-09-12T00:53:24.683 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: secure 2024-09-12T00:53:24.683 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: crc 2024-09-12T00:53:24.683 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: secure 2024-09-12T00:53:24.683 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: crc 2024-09-12T00:53:24.683 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:53:24.333+0000 7f796d72a800 5 AuthRegistry(0x55ef495e95e0) adding con mode: secure 2024-09-12T00:53:24.683 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:53:24.334+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.683 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient: init 2024-09-12T00:53:24.683 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding auth protocol: cephx 2024-09-12T00:53:24.683 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding auth protocol: cephx 2024-09-12T00:53:24.683 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding auth protocol: cephx 2024-09-12T00:53:24.684 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: secure 2024-09-12T00:53:24.684 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: crc 2024-09-12T00:53:24.684 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: secure 2024-09-12T00:53:24.684 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: crc 2024-09-12T00:53:24.684 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: secure 2024-09-12T00:53:24.684 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: crc 2024-09-12T00:53:24.684 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: crc 2024-09-12T00:53:24.684 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: secure 2024-09-12T00:53:24.684 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: crc 2024-09-12T00:53:24.684 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: secure 2024-09-12T00:53:24.684 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: crc 2024-09-12T00:53:24.684 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36a60) adding con mode: secure 2024-09-12T00:53:24.684 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:53:24.334+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.684 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:53:24.334+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.685 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:53:24.334+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command rotate-key cmddesc rotate-key hook 0x7fffd8c36ba8 EEXIST 2024-09-12T00:53:24.685 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:24.685 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:53:24.685 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-b con 0x55ef495ed770 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:53:24.685 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-a con 0x55ef496181e0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:53:24.685 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-c con 0x55ef49619590 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:53:24.685 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.685 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.685 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.685 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:24.685 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:53:24.334+0000 7f796d72a800 10 monclient(hunting): authenticate will time out at 2090.827705s 2024-09-12T00:53:24.685 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:53:24.334+0000 7f7963fff640 10 monclient(hunting): get_auth_request con 0x55ef496181e0 auth_method 0 2024-09-12T00:53:24.685 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:53:24.334+0000 7f7963fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.686 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:53:24.334+0000 7f7963fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.686 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:53:24.334+0000 7f7963fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.686 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:53:24.334+0000 7f7969cae640 10 monclient(hunting): get_auth_request con 0x55ef49619590 auth_method 0 2024-09-12T00:53:24.686 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:53:24.334+0000 7f7969cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.686 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:53:24.334+0000 7f7969cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.686 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:53:24.334+0000 7f7969cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.686 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:53:24.334+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.686 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:53:24.334+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.686 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:53:24.334+0000 7f7969cae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.686 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:53:24.334+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.686 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:53:24.334+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.686 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:53:24.334+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.686 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:53:24.334+0000 7f79694ad640 10 monclient(hunting): get_auth_request con 0x55ef495ed770 auth_method 0 2024-09-12T00:53:24.686 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:53:24.334+0000 7f79694ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.687 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:53:24.334+0000 7f79694ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.687 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:53:24.334+0000 7f79694ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.687 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:53:24.335+0000 7f7969cae640 10 monclient(hunting): handle_auth_done global_id 7139 payload 274 2024-09-12T00:53:24.687 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:53:24.335+0000 7f7969cae640 10 monclient: _finish_hunting 0 2024-09-12T00:53:24.687 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:53:24.335+0000 7f7969cae640 1 monclient: found mon.noname-c 2024-09-12T00:53:24.687 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:53:24.335+0000 7f7969cae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.687 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.687 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:24.687 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: dump: 2024-09-12T00:53:24.687 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.687 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.687 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.687 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.688 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.688 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.688 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.688 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.688 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.688 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.688 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: _finish_auth 0 2024-09-12T00:53:24.688 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: _check_auth_tickets 2024-09-12T00:53:24.688 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:24.688 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.688 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:24.688 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:53:24.335+0000 7f784cff9640 10 monclient: dump: 2024-09-12T00:53:24.688 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.689 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.689 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.689 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.689 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.689 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.689 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.689 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.689 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.689 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.689 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:53:24.335+0000 7f796d72a800 5 monclient: authenticate success, global_id 7139 2024-09-12T00:53:24.689 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:53:24.335+0000 7f796d72a800 10 monclient: get_monmap_and_config success 2024-09-12T00:53:24.689 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:53:24.335+0000 7f796d72a800 4 set_mon_vals no callback set 2024-09-12T00:53:24.689 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:53:24.335+0000 7f796d72a800 10 monclient: shutdown 2024-09-12T00:53:24.690 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:53:24.336+0000 7f796d72a800 10 monclient: build_initial_monmap 2024-09-12T00:53:24.690 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:53:24.336+0000 7f796d72a800 1 build_initial for_mkfs: 0 2024-09-12T00:53:24.690 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:53:24.336+0000 7f796d72a800 10 monclient: monmap: 2024-09-12T00:53:24.690 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:53:24.690 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:53:24.690 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:53:24.690 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:53:24.690 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:53:24.690 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.690 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:53:24.690 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:53:24.690 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:53:24.690 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.691 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding auth protocol: cephx 2024-09-12T00:53:24.691 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding auth protocol: cephx 2024-09-12T00:53:24.691 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding auth protocol: cephx 2024-09-12T00:53:24.691 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: secure 2024-09-12T00:53:24.691 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: crc 2024-09-12T00:53:24.691 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: secure 2024-09-12T00:53:24.691 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: crc 2024-09-12T00:53:24.691 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: secure 2024-09-12T00:53:24.691 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: crc 2024-09-12T00:53:24.691 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: crc 2024-09-12T00:53:24.691 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: secure 2024-09-12T00:53:24.691 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: crc 2024-09-12T00:53:24.691 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: secure 2024-09-12T00:53:24.692 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: crc 2024-09-12T00:53:24.692 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495ee350) adding con mode: secure 2024-09-12T00:53:24.692 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:53:24.336+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.692 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:53:24.336+0000 7f796d72a800 1 librados: starting msgr at 2024-09-12T00:53:24.692 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:53:24.336+0000 7f796d72a800 1 librados: starting objecter 2024-09-12T00:53:24.692 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command objecter_requests cmddesc objecter_requests hook 0x55ef495c8e20 EEXIST 2024-09-12T00:53:24.692 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:53:24.336+0000 7f796d72a800 1 librados: setting wanted keys 2024-09-12T00:53:24.692 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:53:24.336+0000 7f796d72a800 1 librados: calling monclient init 2024-09-12T00:53:24.692 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:53:24.336+0000 7f796d72a800 10 monclient: init 2024-09-12T00:53:24.692 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding auth protocol: cephx 2024-09-12T00:53:24.692 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding auth protocol: cephx 2024-09-12T00:53:24.692 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding auth protocol: cephx 2024-09-12T00:53:24.692 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: secure 2024-09-12T00:53:24.693 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: crc 2024-09-12T00:53:24.693 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: secure 2024-09-12T00:53:24.693 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: crc 2024-09-12T00:53:24.693 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: secure 2024-09-12T00:53:24.693 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: crc 2024-09-12T00:53:24.693 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: crc 2024-09-12T00:53:24.693 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: secure 2024-09-12T00:53:24.693 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: crc 2024-09-12T00:53:24.693 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: secure 2024-09-12T00:53:24.693 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: crc 2024-09-12T00:53:24.693 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 AuthRegistry(0x55ef495de220) adding con mode: secure 2024-09-12T00:53:24.693 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:53:24.336+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.693 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:53:24.336+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.693 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:53:24.336+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command rotate-key cmddesc rotate-key hook 0x55ef495de368 EEXIST 2024-09-12T00:53:24.694 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:53:24.336+0000 7f796d72a800 10 monclient: _reopen_session rank -1 2024-09-12T00:53:24.694 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:53:24.336+0000 7f796d72a800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:53:24.694 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-c con 0x55ef495ed770 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:53:24.694 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-a con 0x55ef49619590 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:53:24.694 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): picked mon.noname-b con 0x55ef4960d1d0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:53:24.694 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.694 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.694 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): start opening mon connection 2024-09-12T00:53:24.694 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): _renew_subs 2024-09-12T00:53:24.694 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient(hunting): authenticate will time out at 2090.830047s 2024-09-12T00:53:24.694 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): get_auth_request con 0x55ef495ed770 auth_method 0 2024-09-12T00:53:24.694 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.694 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.695 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.695 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:53:24.337+0000 7f7963fff640 10 monclient(hunting): get_auth_request con 0x55ef49619590 auth_method 0 2024-09-12T00:53:24.695 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:53:24.337+0000 7f7963fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.695 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:53:24.337+0000 7f7963fff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.695 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:53:24.337+0000 7f7963fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.695 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.695 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.695 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.695 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:53:24.337+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:53:24.695 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:53:24.337+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:53:24.695 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:53:24.337+0000 7f7963fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:53:24.695 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:53:24.337+0000 7f7969cae640 10 monclient(hunting): get_auth_request con 0x55ef4960d1d0 auth_method 0 2024-09-12T00:53:24.695 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:53:24.337+0000 7f7969cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:53:24.695 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:53:24.337+0000 7f7969cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:53:24.696 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:53:24.337+0000 7f7969cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:53:24.696 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient(hunting): handle_auth_done global_id 7142 payload 824 2024-09-12T00:53:24.696 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient: _finish_hunting 0 2024-09-12T00:53:24.696 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:53:24.337+0000 7f79694ad640 1 monclient: found mon.noname-c 2024-09-12T00:53:24.696 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:53:24.337+0000 7f79694ad640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.696 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.696 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:53:24.696 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: dump: 2024-09-12T00:53:24.696 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.696 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.696 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.696 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.696 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.697 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.697 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.697 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.697 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.697 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.697 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: _finish_auth 0 2024-09-12T00:53:24.697 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: _check_auth_tickets 2024-09-12T00:53:24.697 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:53:24.697 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:53:24.697 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:53:24.697 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:53:24.337+0000 7f783affd640 10 monclient: dump: 2024-09-12T00:53:24.697 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:53:24.698 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:53:24.698 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.698 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:53:24.698 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:53:24.698 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:53:24.698 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:53:24.698 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:53:24.698 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:53:24.698 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.698 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:53:24.337+0000 7f796d72a800 5 monclient: authenticate success, global_id 7142 2024-09-12T00:53:24.698 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient: _renew_subs 2024-09-12T00:53:24.698 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.698 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:53:24.337+0000 7f784cff9640 4 set_mon_vals no callback set 2024-09-12T00:53:24.698 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient: _renew_subs 2024-09-12T00:53:24.698 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:53:24.337+0000 7f796d72a800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.699 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:53:24.337+0000 7f796d72a800 1 librados: init done 2024-09-12T00:53:24.699 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:53:24.337+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command cr dump hook 0x55ef49621118 2024-09-12T00:53:24.699 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:53:24.339+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.699 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:53:24.340+0000 7f783affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:53:24.699 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:53:24.340+0000 7f783affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:53:24.699 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:53:24.340+0000 7f783affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:53:24.699 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:53:24.340+0000 7f7963fff640 10 monclient: get_auth_request con 0x7f78340764a0 auth_method 0 2024-09-12T00:53:24.699 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:53:24.340+0000 7f7969cae640 10 monclient: get_auth_request con 0x55ef49637c80 auth_method 0 2024-09-12T00:53:24.699 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.699 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:53:24.341+0000 7f796d72a800 20 realm 2024-09-12T00:53:24.699 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.699 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.699 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:53:24.341+0000 7f796d72a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:24.700 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.700 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.700 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:53:24.341+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.700 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:53:24.341+0000 7f79694ad640 10 monclient: get_auth_request con 0x55ef4963bef0 auth_method 0 2024-09-12T00:53:24.700 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:53:24.342+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:24.700 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:53:24.342+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.700 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:53:24.342+0000 7f7963fff640 10 monclient: get_auth_request con 0x55ef4963f750 auth_method 0 2024-09-12T00:53:24.700 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:53:24.343+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:24.700 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:53:24.343+0000 7f796d72a800 20 searching for the correct realm 2024-09-12T00:53:24.700 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:53:24.343+0000 7f7969cae640 10 monclient: get_auth_request con 0x55ef496444f0 auth_method 0 2024-09-12T00:53:24.700 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:53:24.344+0000 7f79694ad640 10 monclient: get_auth_request con 0x7f7964061040 auth_method 0 2024-09-12T00:53:24.700 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:53:24.346+0000 7f7963fff640 10 monclient: get_auth_request con 0x7f7964078900 auth_method 0 2024-09-12T00:53:24.701 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:53:24.346+0000 7f7963fff640 0 -- 172.21.15.62:0/379762881 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f7964078900 msgr2=0x7f79640853f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:24.701 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:53:24.547+0000 7f7963fff640 10 monclient: get_auth_request con 0x7f7964078900 auth_method 0 2024-09-12T00:53:24.701 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:53:24.549+0000 7f7969cae640 10 monclient: get_auth_request con 0x7f795c09dc40 auth_method 0 2024-09-12T00:53:24.701 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:53:24.549+0000 7f79694ad640 10 monclient: get_auth_request con 0x7f7964093910 auth_method 0 2024-09-12T00:53:24.701 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:53:24.550+0000 7f7969cae640 0 -- 172.21.15.62:0/379762881 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55ef49637c80 msgr2=0x55ef4963a140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:24.701 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:53:24.550+0000 7f783affd640 1 client.7142.objecter ms_handle_reset 0x55ef49637c80 session 0x55ef496375b0 osd.6 2024-09-12T00:53:24.701 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:53:24.550+0000 7f783affd640 10 monclient: _renew_subs 2024-09-12T00:53:24.701 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:53:24.550+0000 7f783affd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:53:24.701 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:53:24.551+0000 7f7969cae640 10 monclient: get_auth_request con 0x7f7834086750 auth_method 0 2024-09-12T00:53:24.701 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:53:24.554+0000 7f796d72a800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:24.701 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:24.701 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:24.701 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:24.702 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:24.702 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:24.702 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.702 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.702 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.702 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:24.702 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.702 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:24.702 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 zone default found 2024-09-12T00:53:24.702 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:53:24.555+0000 7f796d72a800 4 Realm: () 2024-09-12T00:53:24.702 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:53:24.555+0000 7f796d72a800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:24.702 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:53:24.555+0000 7f796d72a800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:24.702 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:53:24.555+0000 7f796d72a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:24.703 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 zonegroup default 2024-09-12T00:53:24.703 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:53:24.555+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.703 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:53:24.556+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.703 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:53:24.556+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.703 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:53:24.556+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.703 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:53:24.556+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.703 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:53:24.556+0000 7f796d72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.703 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:53:24.556+0000 7f796d72a800 20 started sync module instance, tier type = 2024-09-12T00:53:24.703 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:53:24.556+0000 7f796d72a800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:24.703 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=0 2024-09-12T00:53:24.703 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=1 2024-09-12T00:53:24.703 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=2 2024-09-12T00:53:24.703 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=3 2024-09-12T00:53:24.703 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=4 2024-09-12T00:53:24.704 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:53:24.566+0000 7f796d72a800 20 add_watcher() i=5 2024-09-12T00:53:24.704 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:53:24.567+0000 7f796d72a800 20 add_watcher() i=6 2024-09-12T00:53:24.704 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:53:24.568+0000 7f796d72a800 20 add_watcher() i=7 2024-09-12T00:53:24.704 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:53:24.568+0000 7f796d72a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:24.704 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding auth protocol: cephx 2024-09-12T00:53:24.704 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding auth protocol: cephx 2024-09-12T00:53:24.704 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding auth protocol: cephx 2024-09-12T00:53:24.704 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: secure 2024-09-12T00:53:24.704 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: crc 2024-09-12T00:53:24.704 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: secure 2024-09-12T00:53:24.704 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: crc 2024-09-12T00:53:24.704 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: secure 2024-09-12T00:53:24.704 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: crc 2024-09-12T00:53:24.704 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:53:24.570+0000 7f781ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:24.704 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: crc 2024-09-12T00:53:24.705 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: secure 2024-09-12T00:53:24.705 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: crc 2024-09-12T00:53:24.705 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: secure 2024-09-12T00:53:24.705 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: crc 2024-09-12T00:53:24.705 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:53:24.570+0000 7f796d72a800 5 AuthRegistry(0x7fffd8c36f40) adding con mode: secure 2024-09-12T00:53:24.705 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:53:24.571+0000 7f796d72a800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:53:24.705 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:53:24.571+0000 7f796d72a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:24.705 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:53:24.571+0000 7f796d72a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:24.705 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command cache list hook 0x55ef4960edf0 2024-09-12T00:53:24.705 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command cache inspect hook 0x55ef4960edf0 2024-09-12T00:53:24.705 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command cache erase hook 0x55ef4960edf0 2024-09-12T00:53:24.705 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command cache zap hook 0x55ef4960edf0 2024-09-12T00:53:24.706 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 note: GC not initialized 2024-09-12T00:53:24.706 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:53:24.571+0000 7f781efe5640 20 reqs_thread_entry: start 2024-09-12T00:53:24.706 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command sync trace show hook 0x7f796404d7c0 2024-09-12T00:53:24.706 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command sync trace history hook 0x7f796404d7c0 2024-09-12T00:53:24.706 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command sync trace active hook 0x7f796404d7c0 2024-09-12T00:53:24.706 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:53:24.571+0000 7f796d72a800 5 asok(0x55ef4932b630) register_command sync trace active_short hook 0x7f796404d7c0 2024-09-12T00:53:24.706 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:53:24.571+0000 7f796d72a800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:24.706 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:53:24.571+0000 7f796d72a800 20 Filter name: none 2024-09-12T00:53:24.706 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:53:24.571+0000 7f781cfe1640 20 reqs_thread_entry: start 2024-09-12T00:53:24.706 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:53:24.571+0000 7f796d72a800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:53:24.706 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:53:24.571+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.706 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:53:24.572+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:24.706 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:53:24.706 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:53:24.707 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 : miss 2024-09-12T00:53:24.707 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:53:24.572+0000 7f796d72a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.707 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:53:24.572+0000 7f796d72a800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:53:24.707 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:24.707 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:24.707 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:24.707 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:24.707 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:53:24.572+0000 7f796d72a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 2024-09-12T00:53:24.707 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:53:24.576+0000 7f796d72a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:24.707 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:53:24.576+0000 7f796d72a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:24.707 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:53:24.576+0000 7f796d72a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:24.707 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:53:24.576+0000 7f796d72a800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34, ofs0, ns] 2024-09-12T00:53:24.707 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:53:24.577+0000 7f784cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431683 cookie 94486216870048 notifier 7142 bl.length()=911 2024-09-12T00:53:24.707 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:53:24.577+0000 7f784cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:24.707 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:53:24.577+0000 7f784cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:24.708 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:53:24.577+0000 7f784cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:24.708 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:53:24.579+0000 7f796d72a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): orig_sources= new_sources= 2024-09-12T00:53:24.708 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:53:24.579+0000 7f796d72a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): potential sources added=[] removed=[] 2024-09-12T00:53:24.708 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:53:24.579+0000 7f796d72a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): orig_dests= new_dests= 2024-09-12T00:53:24.708 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:53:24.579+0000 7f796d72a800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): potential dests added=[] removed=[] 2024-09-12T00:53:24.708 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:53:24.582+0000 7f796d72a800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f796d72a800 time 2024-09-12T00:53:24.582416+0000 2024-09-12T00:53:24.708 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:53:24.708 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.708 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:24.708 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f796ef8c71a] 2024-09-12T00:53:24.708 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f796ef8c8d8] 2024-09-12T00:53:24.708 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef472ad641] 2024-09-12T00:53:24.708 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef472bd38a] 2024-09-12T00:53:24.709 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:53:24.709 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f796dc29590] 2024-09-12T00:53:24.709 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:53:24.709 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:53:24.709 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.709 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:53:24.582+0000 7f796d72a800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:53:24.709 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f796d72a800 thread_name:radosgw-admin 2024-09-12T00:53:24.709 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.709 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:53:24.709 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f796dc3e6f0] 2024-09-12T00:53:24.709 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f796dc8b99c] 2024-09-12T00:53:24.709 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:53:24.709 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:53:24.710 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f796ef8c774] 2024-09-12T00:53:24.710 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f796ef8c8d8] 2024-09-12T00:53:24.710 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ef472ad641] 2024-09-12T00:53:24.710 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55ef472bd38a] 2024-09-12T00:53:24.710 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:53:24.710 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f796dc29590] 2024-09-12T00:53:24.710 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:53:24.710 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:53:24.710 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:53:24.710 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.710 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:53:24.710 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:53:24.710 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:53:24.711 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:53:24.711 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:53:24.711 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:53:24.711 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:53:24.711 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:53:24.711 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:53:24.711 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:53:24.711 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:53:24.711 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:53:24.711 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:53:24.711 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:53:24.711 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:53:24.711 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:53:24.712 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:53:24.712 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:53:24.712 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:53:24.712 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:53:24.712 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:53:24.712 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:53:24.712 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:53:24.712 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:53:24.712 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:53:24.712 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:53:24.712 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:53:24.712 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:53:24.712 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:53:24.713 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:53:24.713 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:53:24.713 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:53:24.713 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:53:24.713 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:53:24.713 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:53:24.713 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:53:24.713 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:53:24.713 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:53:24.713 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:53:24.713 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:53:24.713 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:53:24.713 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:53:24.713 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:53:24.714 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:53:24.714 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:53:24.714 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:53:24.714 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:53:24.714 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:53:24.714 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:53:24.714 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:53:24.714 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:53:24.714 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:53:24.714 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:53:24.714 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:53:24.714 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:53:24.714 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:53:24.715 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:53:24.715 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:53:24.715 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:53:24.715 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:53:24.715 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:53:24.715 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:53:24.715 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:53:24.715 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:53:24.715 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:53:24.715 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:53:24.715 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:53:24.715 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:53:24.715 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:53:24.716 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:53:24.716 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:53:24.716 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:53:24.716 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:53:24.716 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:53:24.716 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:53:24.716 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:53:24.716 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:53:24.716 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:53:24.716 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:53:24.716 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:53:24.716 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:53:24.716 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:53:24.716 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:53:24.717 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:53:24.717 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:53:24.717 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:53:24.717 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:53:24.717 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:53:24.717 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:53:24.717 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:53:24.717 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:53:24.717 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:53:24.717 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:53:24.717 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:53:24.717 INFO:tasks.workunit.client.0.smithi062.stderr: 7f781cfe1640 / http_manager 2024-09-12T00:53:24.717 INFO:tasks.workunit.client.0.smithi062.stderr: 7f781efe5640 / http_manager 2024-09-12T00:53:24.718 INFO:tasks.workunit.client.0.smithi062.stderr: 7f781ffe7640 / rgw_dt_lg_renew 2024-09-12T00:53:24.718 INFO:tasks.workunit.client.0.smithi062.stderr: 7f783affd640 / ms_dispatch 2024-09-12T00:53:24.718 INFO:tasks.workunit.client.0.smithi062.stderr: 7f784cff9640 / io_context_pool 2024-09-12T00:53:24.718 INFO:tasks.workunit.client.0.smithi062.stderr: 7f784effd640 / ms_dispatch 2024-09-12T00:53:24.718 INFO:tasks.workunit.client.0.smithi062.stderr: 7f7855e03640 / ms_dispatch 2024-09-12T00:53:24.718 INFO:tasks.workunit.client.0.smithi062.stderr: 7f7857606640 / io_context_pool 2024-09-12T00:53:24.718 INFO:tasks.workunit.client.0.smithi062.stderr: 7f7963fff640 / msgr-worker-2 2024-09-12T00:53:24.718 INFO:tasks.workunit.client.0.smithi062.stderr: 7f79694ad640 / msgr-worker-1 2024-09-12T00:53:24.718 INFO:tasks.workunit.client.0.smithi062.stderr: 7f7969cae640 / msgr-worker-0 2024-09-12T00:53:24.718 INFO:tasks.workunit.client.0.smithi062.stderr: 7f796a4af640 / io_context_pool 2024-09-12T00:53:24.718 INFO:tasks.workunit.client.0.smithi062.stderr: 7f796d72a800 / radosgw-admin 2024-09-12T00:53:24.718 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:53:24.718 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:53:24.718 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:53:24.583829Z_1e6ce000-4192-4636-88a0-b60933a21e39/log 2024-09-12T00:53:24.719 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:53:24.719 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:53:24.720 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:24.720 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:24.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.660+0000 7f2c12b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.662+0000 7f2c12b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.662+0000 7f2c12b2e800 20 realm 2024-09-12T00:53:24.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.662+0000 7f2c12b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.662+0000 7f2c12b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.662+0000 7f2c12b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:24.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.662+0000 7f2c12b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.662+0000 7f2c12b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.662+0000 7f2c12b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.663+0000 7f2c12b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:24.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.663+0000 7f2c12b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.664+0000 7f2c12b2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:24.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.664+0000 7f2c12b2e800 20 searching for the correct realm 2024-09-12T00:53:24.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.667+0000 7f2c0df6a640 0 -- 172.21.15.62:0/3618750337 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f2c08027910 msgr2=0x7f2c080183a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:24.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.871+0000 7f2c0ef6c640 0 -- 172.21.15.62:0/3618750337 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5600a3796520 msgr2=0x5600a37989a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:24.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.875+0000 7f2c12b2e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:24.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.875+0000 7f2c12b2e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:24.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.875+0000 7f2c12b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:24.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.875+0000 7f2c12b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:24.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.875+0000 7f2c12b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:24.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.875+0000 7f2c12b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:24.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.875+0000 7f2c12b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.876+0000 7f2c12b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.876+0000 7f2c12b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.876+0000 7f2c12b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:24.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.876+0000 7f2c12b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.876+0000 7f2c12b2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:24.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.876+0000 7f2c12b2e800 20 zone default found 2024-09-12T00:53:24.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.876+0000 7f2c12b2e800 4 Realm: () 2024-09-12T00:53:24.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.876+0000 7f2c12b2e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:24.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.876+0000 7f2c12b2e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:24.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.876+0000 7f2c12b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:24.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.876+0000 7f2c12b2e800 20 zonegroup default 2024-09-12T00:53:24.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.876+0000 7f2c12b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.877+0000 7f2c12b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.877+0000 7f2c12b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.877+0000 7f2c12b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.877+0000 7f2c12b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.877+0000 7f2c12b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.877+0000 7f2c12b2e800 20 started sync module instance, tier type = 2024-09-12T00:53:24.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.877+0000 7f2c12b2e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:24.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.887+0000 7f2c12b2e800 20 add_watcher() i=0 2024-09-12T00:53:24.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.887+0000 7f2c12b2e800 20 add_watcher() i=1 2024-09-12T00:53:24.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.887+0000 7f2c12b2e800 20 add_watcher() i=2 2024-09-12T00:53:24.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.887+0000 7f2c12b2e800 20 add_watcher() i=3 2024-09-12T00:53:24.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.887+0000 7f2c12b2e800 20 add_watcher() i=4 2024-09-12T00:53:24.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.887+0000 7f2c12b2e800 20 add_watcher() i=5 2024-09-12T00:53:24.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.887+0000 7f2c12b2e800 20 add_watcher() i=6 2024-09-12T00:53:24.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.888+0000 7f2c12b2e800 20 add_watcher() i=7 2024-09-12T00:53:24.887 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.888+0000 7f2c12b2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:24.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.889+0000 7f2ac4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:24.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.890+0000 7f2c12b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:24.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.890+0000 7f2c12b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:24.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.890+0000 7f2c12b2e800 5 note: GC not initialized 2024-09-12T00:53:24.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.890+0000 7f2a3f7fe640 20 reqs_thread_entry: start 2024-09-12T00:53:24.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.890+0000 7f2c12b2e800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:24.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.890+0000 7f2c12b2e800 20 Filter name: none 2024-09-12T00:53:24.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.890+0000 7f2a3d7fa640 20 reqs_thread_entry: start 2024-09-12T00:53:24.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.890+0000 7f2c12b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.891+0000 7f2c12b2e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:24.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.891+0000 7f2c12b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.892+0000 7f2c12b2e800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:53:24.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.892+0000 7f2c12b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:24.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.892+0000 7f2c12b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.892+0000 7f2c12b2e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:24.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.892+0000 7f2c12b2e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.892+0000 7f2c12b2e800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:53:24.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.892+0000 7f2c12b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:24.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.894+0000 7f2ac4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:24.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.896+0000 7f2c12b2e800 20 remove_watcher() i=0 2024-09-12T00:53:24.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.896+0000 7f2c12b2e800 2 removed watcher, disabling cache 2024-09-12T00:53:24.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.897+0000 7f2c12b2e800 20 remove_watcher() i=1 2024-09-12T00:53:24.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.898+0000 7f2c12b2e800 20 remove_watcher() i=2 2024-09-12T00:53:24.898 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.899+0000 7f2c12b2e800 20 remove_watcher() i=3 2024-09-12T00:53:24.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.900+0000 7f2c12b2e800 20 remove_watcher() i=4 2024-09-12T00:53:24.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.901+0000 7f2c12b2e800 20 remove_watcher() i=5 2024-09-12T00:53:24.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.902+0000 7f2c12b2e800 20 remove_watcher() i=6 2024-09-12T00:53:24.902 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:24.903+0000 7f2c12b2e800 20 remove_watcher() i=7 2024-09-12T00:53:24.914 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:24.914 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:53:24.914 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-do-reshard id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:53:24.914 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:25.007 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:53:25.040 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:25.040 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:25.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.080+0000 7f2a0a7af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.081+0000 7f2a0a7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.081+0000 7f2a0a7af800 20 realm 2024-09-12T00:53:25.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.081+0000 7f2a0a7af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.081+0000 7f2a0a7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.081+0000 7f2a0a7af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:25.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.081+0000 7f2a0a7af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.082+0000 7f2a0a7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.082+0000 7f2a0a7af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.082+0000 7f2a0a7af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:25.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.082+0000 7f2a0a7af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.083+0000 7f2a0a7af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:25.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.083+0000 7f2a0a7af800 20 searching for the correct realm 2024-09-12T00:53:25.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.086+0000 7f2a07a98640 0 -- 172.21.15.62:0/647310720 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f2a0006c0e0 msgr2=0x7f2a0005e7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:25.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.291+0000 7f2a08a9a640 0 -- 172.21.15.62:0/647310720 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55a6cdf61b40 msgr2=0x55a6cdf64000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:25.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.295+0000 7f2a0a7af800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:25.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.295+0000 7f2a0a7af800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:25.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.295+0000 7f2a0a7af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:25.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.295+0000 7f2a0a7af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:25.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.295+0000 7f2a0a7af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:25.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.295+0000 7f2a0a7af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:25.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.295+0000 7f2a0a7af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.295+0000 7f2a0a7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.295+0000 7f2a0a7af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.295+0000 7f2a0a7af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:25.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.295+0000 7f2a0a7af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.296+0000 7f2a0a7af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:25.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.296+0000 7f2a0a7af800 20 zone default found 2024-09-12T00:53:25.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.296+0000 7f2a0a7af800 4 Realm: () 2024-09-12T00:53:25.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.296+0000 7f2a0a7af800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:25.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.296+0000 7f2a0a7af800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:25.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.296+0000 7f2a0a7af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:25.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.296+0000 7f2a0a7af800 20 zonegroup default 2024-09-12T00:53:25.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.296+0000 7f2a0a7af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.296+0000 7f2a0a7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.296+0000 7f2a0a7af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.296+0000 7f2a0a7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.296+0000 7f2a0a7af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.296+0000 7f2a0a7af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.296+0000 7f2a0a7af800 20 started sync module instance, tier type = 2024-09-12T00:53:25.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.297+0000 7f2a0a7af800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:25.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.305+0000 7f2a0a7af800 20 add_watcher() i=0 2024-09-12T00:53:25.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.305+0000 7f2a0a7af800 20 add_watcher() i=1 2024-09-12T00:53:25.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.305+0000 7f2a0a7af800 20 add_watcher() i=2 2024-09-12T00:53:25.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.305+0000 7f2a0a7af800 20 add_watcher() i=3 2024-09-12T00:53:25.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.305+0000 7f2a0a7af800 20 add_watcher() i=4 2024-09-12T00:53:25.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.305+0000 7f2a0a7af800 20 add_watcher() i=5 2024-09-12T00:53:25.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.305+0000 7f2a0a7af800 20 add_watcher() i=6 2024-09-12T00:53:25.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.306+0000 7f2a0a7af800 20 add_watcher() i=7 2024-09-12T00:53:25.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.306+0000 7f2a0a7af800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:25.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.308+0000 7f28befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:25.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.308+0000 7f2a0a7af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:25.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.308+0000 7f2a0a7af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:25.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.308+0000 7f2a0a7af800 5 note: GC not initialized 2024-09-12T00:53:25.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.308+0000 7f28bdfdb640 20 reqs_thread_entry: start 2024-09-12T00:53:25.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.309+0000 7f2a0a7af800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:25.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.309+0000 7f2a0a7af800 20 Filter name: none 2024-09-12T00:53:25.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.309+0000 7f282f7fe640 20 reqs_thread_entry: start 2024-09-12T00:53:25.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.309+0000 7f2a0a7af800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:53:25.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.309+0000 7f2a0a7af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.309+0000 7f2a0a7af800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:25.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.309+0000 7f2a0a7af800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:53:25.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.309+0000 7f2a0a7af800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:53:25.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.309+0000 7f2a0a7af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 : miss 2024-09-12T00:53:25.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.309+0000 7f2a0a7af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.310+0000 7f2a0a7af800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:53:25.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.310+0000 7f2a0a7af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:25.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.310+0000 7f2a0a7af800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:25.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.310+0000 7f2a0a7af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:25.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.310+0000 7f2a0a7af800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:25.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.310+0000 7f2a0a7af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 2024-09-12T00:53:25.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.311+0000 7f2a0a7af800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to be held by another RGW process; skipping for now 2024-09-12T00:53:25.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.312+0000 7f28befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:25.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.314+0000 7f2a0a7af800 20 remove_watcher() i=0 2024-09-12T00:53:25.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.314+0000 7f2a0a7af800 2 removed watcher, disabling cache 2024-09-12T00:53:25.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.315+0000 7f2a0a7af800 20 remove_watcher() i=1 2024-09-12T00:53:25.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.316+0000 7f2a0a7af800 20 remove_watcher() i=2 2024-09-12T00:53:25.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.317+0000 7f2a0a7af800 20 remove_watcher() i=3 2024-09-12T00:53:25.316 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.317+0000 7f2a0a7af800 20 remove_watcher() i=4 2024-09-12T00:53:25.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.318+0000 7f2a0a7af800 20 remove_watcher() i=5 2024-09-12T00:53:25.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.319+0000 7f2a0a7af800 20 remove_watcher() i=6 2024-09-12T00:53:25.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:25.320+0000 7f2a0a7af800 20 remove_watcher() i=7 2024-09-12T00:53:25.330 INFO:tasks.workunit.client.0.smithi062.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:53:55.362 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:53:55.399 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:55.399 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:55.444 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.445+0000 7f23e330c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.447+0000 7f23e330c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:55.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.447+0000 7f23e330c800 20 realm 2024-09-12T00:53:55.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.447+0000 7f23e330c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.447+0000 7f23e330c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:55.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.447+0000 7f23e330c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:55.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.447+0000 7f23e330c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.448+0000 7f23e330c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:55.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.448+0000 7f23e330c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.448+0000 7f23e330c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:55.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.448+0000 7f23e330c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.449+0000 7f23e330c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:55.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.449+0000 7f23e330c800 20 searching for the correct realm 2024-09-12T00:53:55.451 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.452+0000 7f23e05f5640 0 -- 172.21.15.62:0/3315109016 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f23d807ca80 msgr2=0x7f23d806f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:55.455 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.457+0000 7f23e15f7640 0 -- 172.21.15.62:0/3315109016 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x560dc0352130 msgr2=0x560dc0354520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:55.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.461+0000 7f23e330c800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:55.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.461+0000 7f23e330c800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:55.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.461+0000 7f23e330c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:55.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.461+0000 7f23e330c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:55.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.461+0000 7f23e330c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:55.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.461+0000 7f23e330c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:55.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.461+0000 7f23e330c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.461+0000 7f23e330c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:55.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.461+0000 7f23e330c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.462+0000 7f23e330c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:55.462 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.462+0000 7f23e330c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.462+0000 7f23e330c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:55.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.462+0000 7f23e330c800 20 zone default found 2024-09-12T00:53:55.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.462+0000 7f23e330c800 4 Realm: () 2024-09-12T00:53:55.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.462+0000 7f23e330c800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:55.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.462+0000 7f23e330c800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:55.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.462+0000 7f23e330c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:55.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.462+0000 7f23e330c800 20 zonegroup default 2024-09-12T00:53:55.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.462+0000 7f23e330c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.462+0000 7f23e330c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:55.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.462+0000 7f23e330c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.463+0000 7f23e330c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:55.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.463+0000 7f23e330c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.463+0000 7f23e330c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:55.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.463+0000 7f23e330c800 20 started sync module instance, tier type = 2024-09-12T00:53:55.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.463+0000 7f23e330c800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:55.472 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.473+0000 7f23e330c800 20 add_watcher() i=0 2024-09-12T00:53:55.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.473+0000 7f23e330c800 20 add_watcher() i=1 2024-09-12T00:53:55.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.473+0000 7f23e330c800 20 add_watcher() i=2 2024-09-12T00:53:55.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.473+0000 7f23e330c800 20 add_watcher() i=3 2024-09-12T00:53:55.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.473+0000 7f23e330c800 20 add_watcher() i=4 2024-09-12T00:53:55.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.473+0000 7f23e330c800 20 add_watcher() i=5 2024-09-12T00:53:55.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.473+0000 7f23e330c800 20 add_watcher() i=6 2024-09-12T00:53:55.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.474+0000 7f23e330c800 20 add_watcher() i=7 2024-09-12T00:53:55.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.474+0000 7f23e330c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:55.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.476+0000 7f2296fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:55.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.476+0000 7f23e330c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:55.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.476+0000 7f23e330c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:55.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.476+0000 7f23e330c800 5 note: GC not initialized 2024-09-12T00:53:55.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.477+0000 7f2295fe3640 20 reqs_thread_entry: start 2024-09-12T00:53:55.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.477+0000 7f23e330c800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:55.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.477+0000 7f23e330c800 20 Filter name: none 2024-09-12T00:53:55.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.477+0000 7f22077fe640 20 reqs_thread_entry: start 2024-09-12T00:53:55.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.477+0000 7f23e330c800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:53:55.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.477+0000 7f23e330c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.477+0000 7f23e330c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:55.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.477+0000 7f23e330c800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:53:55.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.477+0000 7f23e330c800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:53:55.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.477+0000 7f23e330c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 : miss 2024-09-12T00:53:55.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.477+0000 7f23e330c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.478+0000 7f23e330c800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:53:55.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.478+0000 7f23e330c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:55.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.478+0000 7f23e330c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:55.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.478+0000 7f23e330c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:55.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.478+0000 7f23e330c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:55.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.478+0000 7f23e330c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 2024-09-12T00:53:55.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.479+0000 7f23e330c800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:53:55.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.484+0000 7f23e330c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:55.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.484+0000 7f23e330c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:55.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.484+0000 7f23e330c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:55.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.484+0000 7f23e330c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34, ofs0, ns] 2024-09-12T00:53:55.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.484+0000 7f22b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431684 cookie 94617059346192 notifier 7193 bl.length()=911 2024-09-12T00:53:55.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.484+0000 7f22b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:55.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.484+0000 7f22b7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:55.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.484+0000 7f22b7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:55.485 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.486+0000 7f23e330c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): orig_sources= new_sources= 2024-09-12T00:53:55.485 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.486+0000 7f23e330c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): potential sources added=[] removed=[] 2024-09-12T00:53:55.485 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.486+0000 7f23e330c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): orig_dests= new_dests= 2024-09-12T00:53:55.485 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.486+0000 7f23e330c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): potential dests added=[] removed=[] 2024-09-12T00:53:55.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.490+0000 7f23e330c800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34.2.0 2024-09-12T00:53:55.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.490+0000 7f23e330c800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34.2.0 2024-09-12T00:53:55.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.490+0000 7f23e330c800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34.2.1 2024-09-12T00:53:55.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.490+0000 7f23e330c800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34.2.1 2024-09-12T00:53:55.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.490+0000 7f23e330c800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34.0 2024-09-12T00:53:55.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.492+0000 7f23e330c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:55.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.492+0000 7f23e330c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 2024-09-12T00:53:55.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.493+0000 7f23e330c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:55.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.493+0000 7f23e330c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:55.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.493+0000 7f23e330c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:55.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.493+0000 7f23e330c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34, ofs0, ns] 2024-09-12T00:53:55.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.494+0000 7f22b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431685 cookie 94617059346192 notifier 7193 bl.length()=911 2024-09-12T00:53:55.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.494+0000 7f22b77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:55.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.494+0000 7f22b77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:55.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.494+0000 7f22b77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:55.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.495+0000 7f23e330c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): orig_sources= new_sources= 2024-09-12T00:53:55.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.495+0000 7f23e330c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): potential sources added=[] removed=[] 2024-09-12T00:53:55.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.495+0000 7f23e330c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): orig_dests= new_dests= 2024-09-12T00:53:55.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.495+0000 7f23e330c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): potential dests added=[] removed=[] 2024-09-12T00:53:55.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.497+0000 7f23e330c800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34.0 2024-09-12T00:53:55.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.497+0000 7f23e330c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:55.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.497+0000 7f23e330c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 2024-09-12T00:53:55.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.499+0000 7f23e330c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:55.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.499+0000 7f23e330c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:55.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.499+0000 7f23e330c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:55.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.499+0000 7f23e330c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34, ofs0, ns] 2024-09-12T00:53:55.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.499+0000 7f22b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431686 cookie 94617059346192 notifier 7193 bl.length()=879 2024-09-12T00:53:55.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.499+0000 7f22b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 info.flags=0x17 2024-09-12T00:53:55.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.499+0000 7f22b7fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 to cache LRU end 2024-09-12T00:53:55.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.499+0000 7f22b7fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:55.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.501+0000 7f23e330c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): orig_sources= new_sources= 2024-09-12T00:53:55.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.501+0000 7f23e330c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): potential sources added=[] removed=[] 2024-09-12T00:53:55.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.501+0000 7f23e330c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): orig_dests= new_dests= 2024-09-12T00:53:55.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.501+0000 7f23e330c800 20 handle_bi_update(): bucket=:abort-at-do-reshard[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34]): potential dests added=[] removed=[] 2024-09-12T00:53:55.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.502+0000 7f23e330c800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-12T00:53:55.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.504+0000 7f2296fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:55.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.506+0000 7f23e330c800 20 remove_watcher() i=0 2024-09-12T00:53:55.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.506+0000 7f23e330c800 2 removed watcher, disabling cache 2024-09-12T00:53:55.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.507+0000 7f23e330c800 20 remove_watcher() i=1 2024-09-12T00:53:55.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.508+0000 7f23e330c800 20 remove_watcher() i=2 2024-09-12T00:53:55.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.509+0000 7f23e330c800 20 remove_watcher() i=3 2024-09-12T00:53:55.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.510+0000 7f23e330c800 20 remove_watcher() i=4 2024-09-12T00:53:55.510 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.511+0000 7f23e330c800 20 remove_watcher() i=5 2024-09-12T00:53:55.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.513+0000 7f23e330c800 20 remove_watcher() i=6 2024-09-12T00:53:55.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.514+0000 7f23e330c800 20 remove_watcher() i=7 2024-09-12T00:53:55.526 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:53:55.555 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:55.555 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:55.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.595+0000 7ffbade0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.597+0000 7ffbade0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:55.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.597+0000 7ffbade0e800 20 realm 2024-09-12T00:53:55.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.597+0000 7ffbade0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.598+0000 7ffbade0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:55.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.598+0000 7ffbade0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:55.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.598+0000 7ffbade0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.598+0000 7ffbade0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:55.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.598+0000 7ffbade0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.599+0000 7ffbade0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:55.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.599+0000 7ffbade0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.599+0000 7ffbade0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:55.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.599+0000 7ffbade0e800 20 searching for the correct realm 2024-09-12T00:53:55.601 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.602+0000 7ffba8d79640 0 -- 172.21.15.62:0/212630345 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7ffba4066f00 msgr2=0x7ffba4065070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:55.806 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.807+0000 7ffba8d79640 0 -- 172.21.15.62:0/212630345 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55f5ca40a770 msgr2=0x55f5ca40cba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:55.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.811+0000 7ffbade0e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:55.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.811+0000 7ffbade0e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:55.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.811+0000 7ffbade0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:55.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.811+0000 7ffbade0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:55.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.811+0000 7ffbade0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:55.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.811+0000 7ffbade0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:55.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.811+0000 7ffbade0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.811+0000 7ffbade0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:55.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.811+0000 7ffbade0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.812+0000 7ffbade0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:55.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.812+0000 7ffbade0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.812+0000 7ffbade0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:55.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.812+0000 7ffbade0e800 20 zone default found 2024-09-12T00:53:55.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.812+0000 7ffbade0e800 4 Realm: () 2024-09-12T00:53:55.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.812+0000 7ffbade0e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:55.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.812+0000 7ffbade0e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:55.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.812+0000 7ffbade0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:55.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.812+0000 7ffbade0e800 20 zonegroup default 2024-09-12T00:53:55.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.812+0000 7ffbade0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.812+0000 7ffbade0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:55.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.812+0000 7ffbade0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.813+0000 7ffbade0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:55.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.813+0000 7ffbade0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.813+0000 7ffbade0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:55.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.813+0000 7ffbade0e800 20 started sync module instance, tier type = 2024-09-12T00:53:55.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.813+0000 7ffbade0e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:55.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.823+0000 7ffbade0e800 20 add_watcher() i=0 2024-09-12T00:53:55.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.823+0000 7ffbade0e800 20 add_watcher() i=1 2024-09-12T00:53:55.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.823+0000 7ffbade0e800 20 add_watcher() i=2 2024-09-12T00:53:55.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.823+0000 7ffbade0e800 20 add_watcher() i=3 2024-09-12T00:53:55.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.823+0000 7ffbade0e800 20 add_watcher() i=4 2024-09-12T00:53:55.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.823+0000 7ffbade0e800 20 add_watcher() i=5 2024-09-12T00:53:55.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.823+0000 7ffbade0e800 20 add_watcher() i=6 2024-09-12T00:53:55.823 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.824+0000 7ffbade0e800 20 add_watcher() i=7 2024-09-12T00:53:55.823 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.824+0000 7ffbade0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:55.824 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.825+0000 7ffa5f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:55.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.826+0000 7ffbade0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:55.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.826+0000 7ffbade0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:55.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.826+0000 7ffbade0e800 5 note: GC not initialized 2024-09-12T00:53:55.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.826+0000 7ffa5e7e4640 20 reqs_thread_entry: start 2024-09-12T00:53:55.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.826+0000 7ffbade0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:55.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.826+0000 7ffbade0e800 20 Filter name: none 2024-09-12T00:53:55.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.826+0000 7ff9cffff640 20 reqs_thread_entry: start 2024-09-12T00:53:55.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.826+0000 7ffbade0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.827+0000 7ffbade0e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:55.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.827+0000 7ffbade0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.828+0000 7ffbade0e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:53:55.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.828+0000 7ffbade0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:55.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.828+0000 7ffbade0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.828+0000 7ffbade0e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:53:55.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.828+0000 7ffbade0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:55.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.828+0000 7ffbade0e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:53:55.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.828+0000 7ffbade0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:55.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.830+0000 7ffa5f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:55.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.832+0000 7ffbade0e800 20 remove_watcher() i=0 2024-09-12T00:53:55.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.832+0000 7ffbade0e800 2 removed watcher, disabling cache 2024-09-12T00:53:55.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.833+0000 7ffbade0e800 20 remove_watcher() i=1 2024-09-12T00:53:55.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.834+0000 7ffbade0e800 20 remove_watcher() i=2 2024-09-12T00:53:55.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.835+0000 7ffbade0e800 20 remove_watcher() i=3 2024-09-12T00:53:55.835 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.836+0000 7ffbade0e800 20 remove_watcher() i=4 2024-09-12T00:53:55.836 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.837+0000 7ffbade0e800 20 remove_watcher() i=5 2024-09-12T00:53:55.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.838+0000 7ffbade0e800 20 remove_watcher() i=6 2024-09-12T00:53:55.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:55.839+0000 7ffbade0e800 20 remove_watcher() i=7 2024-09-12T00:53:55.849 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:55.849 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:53:55.849 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-do-reshard id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:53:55.849 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:56.160 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T00:53:56.160 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:57.008 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:53:57.037 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:57.037 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:57.076 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.077+0000 7f9e0d719800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.079+0000 7f9e0d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.079+0000 7f9e0d719800 20 realm 2024-09-12T00:53:57.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.079+0000 7f9e0d719800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.079+0000 7f9e0d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.079+0000 7f9e0d719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:57.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.079+0000 7f9e0d719800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.079+0000 7f9e0d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.079+0000 7f9e0d719800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.080+0000 7f9e0d719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:57.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.080+0000 7f9e0d719800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.080+0000 7f9e0d719800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:57.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.080+0000 7f9e0d719800 20 searching for the correct realm 2024-09-12T00:53:57.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.083+0000 7f9e0aa02640 0 -- 172.21.15.62:0/206521497 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f9e0402e400 msgr2=0x7f9e0402e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:57.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.287+0000 7f9e0ba04640 0 -- 172.21.15.62:0/206521497 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55fe8070ab80 msgr2=0x55fe8070cf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:57.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.291+0000 7f9e0d719800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:57.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.291+0000 7f9e0d719800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:57.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.291+0000 7f9e0d719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:57.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.291+0000 7f9e0d719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:57.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.291+0000 7f9e0d719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:57.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.292+0000 7f9e0d719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:57.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.292+0000 7f9e0d719800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.292+0000 7f9e0d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.291 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.292+0000 7f9e0d719800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.292+0000 7f9e0d719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:57.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.292+0000 7f9e0d719800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.292+0000 7f9e0d719800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:57.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.292+0000 7f9e0d719800 20 zone default found 2024-09-12T00:53:57.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.292+0000 7f9e0d719800 4 Realm: () 2024-09-12T00:53:57.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.292+0000 7f9e0d719800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:57.293 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.292+0000 7f9e0d719800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:57.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.292+0000 7f9e0d719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:57.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.292+0000 7f9e0d719800 20 zonegroup default 2024-09-12T00:53:57.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.292+0000 7f9e0d719800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.293+0000 7f9e0d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.293+0000 7f9e0d719800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.293+0000 7f9e0d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.293+0000 7f9e0d719800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.293+0000 7f9e0d719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.293+0000 7f9e0d719800 20 started sync module instance, tier type = 2024-09-12T00:53:57.294 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.293+0000 7f9e0d719800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:57.301 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.302+0000 7f9e0d719800 20 add_watcher() i=0 2024-09-12T00:53:57.301 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.302+0000 7f9e0d719800 20 add_watcher() i=1 2024-09-12T00:53:57.301 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.302+0000 7f9e0d719800 20 add_watcher() i=2 2024-09-12T00:53:57.301 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.302+0000 7f9e0d719800 20 add_watcher() i=3 2024-09-12T00:53:57.301 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.302+0000 7f9e0d719800 20 add_watcher() i=4 2024-09-12T00:53:57.301 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.302+0000 7f9e0d719800 20 add_watcher() i=5 2024-09-12T00:53:57.301 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.302+0000 7f9e0d719800 20 add_watcher() i=6 2024-09-12T00:53:57.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.302+0000 7f9e0d719800 20 add_watcher() i=7 2024-09-12T00:53:57.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.302+0000 7f9e0d719800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:57.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.304+0000 7f9cc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:57.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.305+0000 7f9e0d719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:57.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.305+0000 7f9e0d719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:57.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.305+0000 7f9e0d719800 5 note: GC not initialized 2024-09-12T00:53:57.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.305+0000 7f9cc0fe1640 20 reqs_thread_entry: start 2024-09-12T00:53:57.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.305+0000 7f9e0d719800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:57.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.305+0000 7f9e0d719800 20 Filter name: none 2024-09-12T00:53:57.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.305+0000 7f9c3a7fc640 20 reqs_thread_entry: start 2024-09-12T00:53:57.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.305+0000 7f9e0d719800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.306+0000 7f9e0d719800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:53:57.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.306+0000 7f9e0d719800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.307+0000 7f9e0d719800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:53:57.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.307+0000 7f9e0d719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:57.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.307+0000 7f9e0d719800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.307+0000 7f9e0d719800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:53:57.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.307+0000 7f9e0d719800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.307+0000 7f9e0d719800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:53:57.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.307+0000 7f9e0d719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:57.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.309+0000 7f9cc1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:57.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.311+0000 7f9e0d719800 20 remove_watcher() i=0 2024-09-12T00:53:57.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.311+0000 7f9e0d719800 2 removed watcher, disabling cache 2024-09-12T00:53:57.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.312+0000 7f9e0d719800 20 remove_watcher() i=1 2024-09-12T00:53:57.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.313+0000 7f9e0d719800 20 remove_watcher() i=2 2024-09-12T00:53:57.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.314+0000 7f9e0d719800 20 remove_watcher() i=3 2024-09-12T00:53:57.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.315+0000 7f9e0d719800 20 remove_watcher() i=4 2024-09-12T00:53:57.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.316+0000 7f9e0d719800 20 remove_watcher() i=5 2024-09-12T00:53:57.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.317+0000 7f9e0d719800 20 remove_watcher() i=6 2024-09-12T00:53:57.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.318+0000 7f9e0d719800 20 remove_watcher() i=7 2024-09-12T00:53:57.328 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:57.328 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:53:57.328 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-logrecord-writes id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:53:57.329 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:57.329 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T00:53:57.364 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:57.365 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:57.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.404+0000 7f919ab40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.406+0000 7f919ab40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.406+0000 7f919ab40800 20 realm 2024-09-12T00:53:57.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.406+0000 7f919ab40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.406+0000 7f919ab40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.406+0000 7f919ab40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:57.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.406+0000 7f919ab40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.406+0000 7f919ab40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.406+0000 7f919ab40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.407+0000 7f919ab40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:57.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.407+0000 7f919ab40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.408+0000 7f919ab40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:57.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.408+0000 7f919ab40800 20 searching for the correct realm 2024-09-12T00:53:57.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.410+0000 7f91960ec640 0 -- 172.21.15.62:0/1934536748 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f9190087130 msgr2=0x7f91900697d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:57.614 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.615+0000 7f91970ee640 0 -- 172.21.15.62:0/1934536748 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5567e9c2c3e0 msgr2=0x5567e9c2e850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:57.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:57.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:57.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:57.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:57.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:57.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:57.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:57.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.621 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:57.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 20 zone default found 2024-09-12T00:53:57.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 4 Realm: () 2024-09-12T00:53:57.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:57.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:57.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:57.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 20 zonegroup default 2024-09-12T00:53:57.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.619+0000 7f919ab40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.620+0000 7f919ab40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.620+0000 7f919ab40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.620+0000 7f919ab40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.620+0000 7f919ab40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.621+0000 7f919ab40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.621+0000 7f919ab40800 20 started sync module instance, tier type = 2024-09-12T00:53:57.622 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.621+0000 7f919ab40800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:57.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.629+0000 7f919ab40800 20 add_watcher() i=0 2024-09-12T00:53:57.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.629+0000 7f919ab40800 20 add_watcher() i=1 2024-09-12T00:53:57.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.629+0000 7f919ab40800 20 add_watcher() i=2 2024-09-12T00:53:57.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.629+0000 7f919ab40800 20 add_watcher() i=3 2024-09-12T00:53:57.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.629+0000 7f919ab40800 20 add_watcher() i=4 2024-09-12T00:53:57.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.629+0000 7f919ab40800 20 add_watcher() i=5 2024-09-12T00:53:57.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.629+0000 7f919ab40800 20 add_watcher() i=6 2024-09-12T00:53:57.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.630+0000 7f919ab40800 20 add_watcher() i=7 2024-09-12T00:53:57.629 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.630+0000 7f919ab40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:57.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.632+0000 7f904d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:57.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.632+0000 7f919ab40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:57.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.632+0000 7f919ab40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:57.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.632+0000 7f919ab40800 5 note: GC not initialized 2024-09-12T00:53:57.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.633+0000 7f8fc7fff640 20 reqs_thread_entry: start 2024-09-12T00:53:57.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.633+0000 7f919ab40800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:57.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.633+0000 7f919ab40800 20 Filter name: none 2024-09-12T00:53:57.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.633+0000 7f8fc5ffb640 20 reqs_thread_entry: start 2024-09-12T00:53:57.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.633+0000 7f919ab40800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:53:57.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.633+0000 7f919ab40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.633+0000 7f919ab40800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:53:57.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.633+0000 7f919ab40800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:53:57.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.633+0000 7f919ab40800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:53:57.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.633+0000 7f919ab40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 : miss 2024-09-12T00:53:57.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.633+0000 7f919ab40800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.634+0000 7f919ab40800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:53:57.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.634+0000 7f919ab40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 info.flags=0x17 2024-09-12T00:53:57.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.634+0000 7f919ab40800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 to cache LRU end 2024-09-12T00:53:57.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.634+0000 7f919ab40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:57.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.634+0000 7f919ab40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:57.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.634+0000 7f919ab40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 2024-09-12T00:53:57.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.638+0000 7f919ab40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 info.flags=0x17 2024-09-12T00:53:57.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.638+0000 7f919ab40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 to cache LRU end 2024-09-12T00:53:57.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.638+0000 7f919ab40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:57.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.638+0000 7f919ab40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35, ofs0, ns] 2024-09-12T00:53:57.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.638+0000 7f9079ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431663 cookie 93904791856112 notifier 7030 bl.length()=923 2024-09-12T00:53:57.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.638+0000 7f9079ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 info.flags=0x17 2024-09-12T00:53:57.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.638+0000 7f9079ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 to cache LRU end 2024-09-12T00:53:57.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.638+0000 7f9079ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:57.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.640+0000 7f919ab40800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): orig_sources= new_sources= 2024-09-12T00:53:57.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.640+0000 7f919ab40800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): potential sources added=[] removed=[] 2024-09-12T00:53:57.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.640+0000 7f919ab40800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): orig_dests= new_dests= 2024-09-12T00:53:57.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.640+0000 7f919ab40800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): potential dests added=[] removed=[] 2024-09-12T00:53:57.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.641+0000 7f919ab40800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T00:53:57.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.641+0000 7f919ab40800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:53:57.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.643+0000 7f919ab40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:57.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.643+0000 7f919ab40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 2024-09-12T00:53:57.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.645+0000 7f919ab40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 info.flags=0x17 2024-09-12T00:53:57.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.645+0000 7f919ab40800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 to cache LRU end 2024-09-12T00:53:57.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.645+0000 7f919ab40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:57.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.645+0000 7f919ab40800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35, ofs0, ns] 2024-09-12T00:53:57.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.645+0000 7f907a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431664 cookie 93904791856112 notifier 7030 bl.length()=891 2024-09-12T00:53:57.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.645+0000 7f907a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 info.flags=0x17 2024-09-12T00:53:57.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.645+0000 7f907a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 to cache LRU end 2024-09-12T00:53:57.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.645+0000 7f907a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:57.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.646+0000 7f919ab40800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): orig_sources= new_sources= 2024-09-12T00:53:57.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.646+0000 7f919ab40800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): potential sources added=[] removed=[] 2024-09-12T00:53:57.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.646+0000 7f919ab40800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): orig_dests= new_dests= 2024-09-12T00:53:57.645 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.646+0000 7f919ab40800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): potential dests added=[] removed=[] 2024-09-12T00:53:57.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.649+0000 7f904d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:57.650 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.651+0000 7f919ab40800 20 remove_watcher() i=0 2024-09-12T00:53:57.650 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.651+0000 7f919ab40800 2 removed watcher, disabling cache 2024-09-12T00:53:57.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.652+0000 7f919ab40800 20 remove_watcher() i=1 2024-09-12T00:53:57.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.653+0000 7f919ab40800 20 remove_watcher() i=2 2024-09-12T00:53:57.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.654+0000 7f919ab40800 20 remove_watcher() i=3 2024-09-12T00:53:57.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.655+0000 7f919ab40800 20 remove_watcher() i=4 2024-09-12T00:53:57.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.656+0000 7f919ab40800 20 remove_watcher() i=5 2024-09-12T00:53:57.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.657+0000 7f919ab40800 20 remove_watcher() i=6 2024-09-12T00:53:57.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.658+0000 7f919ab40800 20 remove_watcher() i=7 2024-09-12T00:53:57.670 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:53:57.699 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:57.699 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:57.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.739+0000 7fd78c815800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.740 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.741+0000 7fd78c815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.740 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.741+0000 7fd78c815800 20 realm 2024-09-12T00:53:57.740 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.741+0000 7fd78c815800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.740 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.741+0000 7fd78c815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.740 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.741+0000 7fd78c815800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:57.741 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.741+0000 7fd78c815800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.741 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.741+0000 7fd78c815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.741 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.741+0000 7fd78c815800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.741 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.742+0000 7fd78c815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:57.741 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.742+0000 7fd78c815800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.742 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.742+0000 7fd78c815800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:57.742 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.742+0000 7fd78c815800 20 searching for the correct realm 2024-09-12T00:53:57.744 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.745+0000 7fd787791640 0 -- 172.21.15.62:0/728696862 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fd78001f040 msgr2=0x7fd780037aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:57.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.952+0000 7fd788793640 0 -- 172.21.15.62:0/728696862 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x560a64568780 msgr2=0x560a6456ac40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:57.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.956+0000 7fd78c815800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:57.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.956+0000 7fd78c815800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:57.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.956+0000 7fd78c815800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:57.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.956+0000 7fd78c815800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:57.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.956+0000 7fd78c815800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:57.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.956+0000 7fd78c815800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:57.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.956+0000 7fd78c815800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.956+0000 7fd78c815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.956+0000 7fd78c815800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.956+0000 7fd78c815800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:57.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.956+0000 7fd78c815800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.957+0000 7fd78c815800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:57.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.957+0000 7fd78c815800 20 zone default found 2024-09-12T00:53:57.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.957+0000 7fd78c815800 4 Realm: () 2024-09-12T00:53:57.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.957+0000 7fd78c815800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:57.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.957+0000 7fd78c815800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:57.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.957+0000 7fd78c815800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:57.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.957+0000 7fd78c815800 20 zonegroup default 2024-09-12T00:53:57.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.957+0000 7fd78c815800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.957+0000 7fd78c815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.957+0000 7fd78c815800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.957+0000 7fd78c815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.957+0000 7fd78c815800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.958+0000 7fd78c815800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:57.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.958+0000 7fd78c815800 20 started sync module instance, tier type = 2024-09-12T00:53:57.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.958+0000 7fd78c815800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:57.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.966+0000 7fd78c815800 20 add_watcher() i=0 2024-09-12T00:53:57.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.966+0000 7fd78c815800 20 add_watcher() i=1 2024-09-12T00:53:57.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.966+0000 7fd78c815800 20 add_watcher() i=2 2024-09-12T00:53:57.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.966+0000 7fd78c815800 20 add_watcher() i=3 2024-09-12T00:53:57.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.966+0000 7fd78c815800 20 add_watcher() i=4 2024-09-12T00:53:57.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.966+0000 7fd78c815800 20 add_watcher() i=5 2024-09-12T00:53:57.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.966+0000 7fd78c815800 20 add_watcher() i=6 2024-09-12T00:53:57.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.967+0000 7fd78c815800 20 add_watcher() i=7 2024-09-12T00:53:57.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.967+0000 7fd78c815800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:57.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.968+0000 7fd63dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:57.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.969+0000 7fd78c815800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:57.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.969+0000 7fd78c815800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:57.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.969+0000 7fd78c815800 5 note: GC not initialized 2024-09-12T00:53:57.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.969+0000 7fd63cfe1640 20 reqs_thread_entry: start 2024-09-12T00:53:57.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.969+0000 7fd78c815800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:57.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.969+0000 7fd78c815800 20 Filter name: none 2024-09-12T00:53:57.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.969+0000 7fd5b67fc640 20 reqs_thread_entry: start 2024-09-12T00:53:57.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.969+0000 7fd78c815800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.970+0000 7fd78c815800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:53:57.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.970+0000 7fd78c815800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.971+0000 7fd78c815800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:53:57.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.971+0000 7fd78c815800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:57.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.971+0000 7fd78c815800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.971+0000 7fd78c815800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:53:57.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.971+0000 7fd78c815800 20 rados->read ofs=0 len=0 2024-09-12T00:53:57.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.971+0000 7fd78c815800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:53:57.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.971+0000 7fd78c815800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:57.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.973+0000 7fd63dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:57.974 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.975+0000 7fd78c815800 20 remove_watcher() i=0 2024-09-12T00:53:57.974 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.975+0000 7fd78c815800 2 removed watcher, disabling cache 2024-09-12T00:53:57.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.976+0000 7fd78c815800 20 remove_watcher() i=1 2024-09-12T00:53:57.977 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.978+0000 7fd78c815800 20 remove_watcher() i=2 2024-09-12T00:53:57.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.979+0000 7fd78c815800 20 remove_watcher() i=3 2024-09-12T00:53:57.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.980+0000 7fd78c815800 20 remove_watcher() i=4 2024-09-12T00:53:57.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.981+0000 7fd78c815800 20 remove_watcher() i=5 2024-09-12T00:53:57.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.982+0000 7fd78c815800 20 remove_watcher() i=6 2024-09-12T00:53:57.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:57.983+0000 7fd78c815800 20 remove_watcher() i=7 2024-09-12T00:53:57.993 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:57.993 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:53:57.993 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-logrecord-writes id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:53:57.993 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:58.086 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:53:58.119 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:58.119 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:58.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.160+0000 7fc75ee20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.162+0000 7fc75ee20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:58.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.162+0000 7fc75ee20800 20 realm 2024-09-12T00:53:58.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.162+0000 7fc75ee20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.163+0000 7fc75ee20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:58.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.163+0000 7fc75ee20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:58.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.163+0000 7fc75ee20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.163+0000 7fc75ee20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:58.162 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.163+0000 7fc75ee20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.164+0000 7fc75ee20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:58.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.164+0000 7fc75ee20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.164+0000 7fc75ee20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:58.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.164+0000 7fc75ee20800 20 searching for the correct realm 2024-09-12T00:53:58.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.167+0000 7fc75c110640 0 -- 172.21.15.62:0/3192972386 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fc75402f420 msgr2=0x7fc75402f880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:58.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.372+0000 7fc75d112640 0 -- 172.21.15.62:0/3192972386 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x563e98a4f7a0 msgr2=0x563e98a51bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:58.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.376+0000 7fc75ee20800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:58.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.376+0000 7fc75ee20800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:58.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.376+0000 7fc75ee20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:58.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.376+0000 7fc75ee20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:58.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.376+0000 7fc75ee20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:58.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.376+0000 7fc75ee20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:58.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.376+0000 7fc75ee20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.376+0000 7fc75ee20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:58.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.376+0000 7fc75ee20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.376+0000 7fc75ee20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:58.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.376+0000 7fc75ee20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.377+0000 7fc75ee20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:58.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.377+0000 7fc75ee20800 20 zone default found 2024-09-12T00:53:58.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.377+0000 7fc75ee20800 4 Realm: () 2024-09-12T00:53:58.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.377+0000 7fc75ee20800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:58.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.377+0000 7fc75ee20800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:58.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.377+0000 7fc75ee20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:58.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.377+0000 7fc75ee20800 20 zonegroup default 2024-09-12T00:53:58.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.377+0000 7fc75ee20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.377+0000 7fc75ee20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:58.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.377+0000 7fc75ee20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.377+0000 7fc75ee20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:58.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.377+0000 7fc75ee20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.378+0000 7fc75ee20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:58.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.378+0000 7fc75ee20800 20 started sync module instance, tier type = 2024-09-12T00:53:58.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.378+0000 7fc75ee20800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:58.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.386+0000 7fc75ee20800 20 add_watcher() i=0 2024-09-12T00:53:58.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.386+0000 7fc75ee20800 20 add_watcher() i=1 2024-09-12T00:53:58.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.386+0000 7fc75ee20800 20 add_watcher() i=2 2024-09-12T00:53:58.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.386+0000 7fc75ee20800 20 add_watcher() i=3 2024-09-12T00:53:58.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.387+0000 7fc75ee20800 20 add_watcher() i=4 2024-09-12T00:53:58.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.387+0000 7fc75ee20800 20 add_watcher() i=5 2024-09-12T00:53:58.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.387+0000 7fc75ee20800 20 add_watcher() i=6 2024-09-12T00:53:58.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.388+0000 7fc75ee20800 20 add_watcher() i=7 2024-09-12T00:53:58.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.388+0000 7fc75ee20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:58.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.389+0000 7fc6137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:58.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.390+0000 7fc75ee20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:58.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.390+0000 7fc75ee20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:58.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.390+0000 7fc75ee20800 5 note: GC not initialized 2024-09-12T00:53:58.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.390+0000 7fc6127e4640 20 reqs_thread_entry: start 2024-09-12T00:53:58.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.390+0000 7fc75ee20800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:58.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.390+0000 7fc75ee20800 20 Filter name: none 2024-09-12T00:53:58.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.390+0000 7fc60b7fe640 20 reqs_thread_entry: start 2024-09-12T00:53:58.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.390+0000 7fc75ee20800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:53:58.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.390+0000 7fc75ee20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.391+0000 7fc75ee20800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:53:58.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.391+0000 7fc75ee20800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:53:58.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.391+0000 7fc75ee20800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:53:58.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.391+0000 7fc75ee20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 : miss 2024-09-12T00:53:58.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.391+0000 7fc75ee20800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.391+0000 7fc75ee20800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:53:58.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.391+0000 7fc75ee20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 info.flags=0x17 2024-09-12T00:53:58.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.391+0000 7fc75ee20800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 to cache LRU end 2024-09-12T00:53:58.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.391+0000 7fc75ee20800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:58.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.391+0000 7fc75ee20800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:58.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.391+0000 7fc75ee20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 2024-09-12T00:53:58.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.395+0000 7fc75ee20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 info.flags=0x17 2024-09-12T00:53:58.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.395+0000 7fc75ee20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 to cache LRU end 2024-09-12T00:53:58.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.395+0000 7fc75ee20800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:58.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.395+0000 7fc75ee20800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35, ofs0, ns] 2024-09-12T00:53:58.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.395+0000 7fc6337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431665 cookie 94826848918160 notifier 7277 bl.length()=923 2024-09-12T00:53:58.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.395+0000 7fc6337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 info.flags=0x17 2024-09-12T00:53:58.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.395+0000 7fc6337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 to cache LRU end 2024-09-12T00:53:58.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.395+0000 7fc6337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:58.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.397+0000 7fc75ee20800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): orig_sources= new_sources= 2024-09-12T00:53:58.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.397+0000 7fc75ee20800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): potential sources added=[] removed=[] 2024-09-12T00:53:58.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.397+0000 7fc75ee20800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): orig_dests= new_dests= 2024-09-12T00:53:58.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.397+0000 7fc75ee20800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): potential dests added=[] removed=[] 2024-09-12T00:53:58.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.399+0000 7fc75ee20800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35.1.0 2024-09-12T00:53:58.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.399+0000 7fc75ee20800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35.1.0 2024-09-12T00:53:58.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.399+0000 7fc75ee20800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35.1.1 2024-09-12T00:53:58.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.399+0000 7fc75ee20800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35.1.1 2024-09-12T00:53:58.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.399+0000 7fc75ee20800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35.0 2024-09-12T00:53:58.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.401+0000 7fc75ee20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:58.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.401+0000 7fc75ee20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 2024-09-12T00:53:58.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.403+0000 7fc75ee20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 info.flags=0x17 2024-09-12T00:53:58.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.403+0000 7fc75ee20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 to cache LRU end 2024-09-12T00:53:58.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.403+0000 7fc75ee20800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:58.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.403+0000 7fc75ee20800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35, ofs0, ns] 2024-09-12T00:53:58.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.403+0000 7fc6337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431666 cookie 94826848918160 notifier 7277 bl.length()=923 2024-09-12T00:53:58.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.403+0000 7fc6337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 info.flags=0x17 2024-09-12T00:53:58.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.403+0000 7fc6337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 to cache LRU end 2024-09-12T00:53:58.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.403+0000 7fc6337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:58.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.404+0000 7fc75ee20800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): orig_sources= new_sources= 2024-09-12T00:53:58.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.404+0000 7fc75ee20800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): potential sources added=[] removed=[] 2024-09-12T00:53:58.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.404+0000 7fc75ee20800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): orig_dests= new_dests= 2024-09-12T00:53:58.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.404+0000 7fc75ee20800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): potential dests added=[] removed=[] 2024-09-12T00:53:58.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.405+0000 7fc75ee20800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35.0 2024-09-12T00:53:58.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.406+0000 7fc75ee20800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:58.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.406+0000 7fc75ee20800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 2024-09-12T00:53:58.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.407+0000 7fc75ee20800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 info.flags=0x17 2024-09-12T00:53:58.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.407+0000 7fc75ee20800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 to cache LRU end 2024-09-12T00:53:58.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.407+0000 7fc75ee20800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:58.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.407+0000 7fc75ee20800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35, ofs0, ns] 2024-09-12T00:53:58.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.408+0000 7fc633fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431667 cookie 94826848918160 notifier 7277 bl.length()=891 2024-09-12T00:53:58.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.408+0000 7fc633fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 info.flags=0x17 2024-09-12T00:53:58.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.408+0000 7fc633fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 to cache LRU end 2024-09-12T00:53:58.407 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.408+0000 7fc633fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:53:58.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.409+0000 7fc75ee20800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): orig_sources= new_sources= 2024-09-12T00:53:58.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.409+0000 7fc75ee20800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): potential sources added=[] removed=[] 2024-09-12T00:53:58.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.409+0000 7fc75ee20800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): orig_dests= new_dests= 2024-09-12T00:53:58.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.409+0000 7fc75ee20800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35]): potential dests added=[] removed=[] 2024-09-12T00:53:58.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.410+0000 7fc75ee20800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:53:58.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.412+0000 7fc6137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:58.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.414+0000 7fc75ee20800 20 remove_watcher() i=0 2024-09-12T00:53:58.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.414+0000 7fc75ee20800 2 removed watcher, disabling cache 2024-09-12T00:53:58.414 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.415+0000 7fc75ee20800 20 remove_watcher() i=1 2024-09-12T00:53:58.415 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.416+0000 7fc75ee20800 20 remove_watcher() i=2 2024-09-12T00:53:58.416 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.417+0000 7fc75ee20800 20 remove_watcher() i=3 2024-09-12T00:53:58.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.418+0000 7fc75ee20800 20 remove_watcher() i=4 2024-09-12T00:53:58.418 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.419+0000 7fc75ee20800 20 remove_watcher() i=5 2024-09-12T00:53:58.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.420+0000 7fc75ee20800 20 remove_watcher() i=6 2024-09-12T00:53:58.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.421+0000 7fc75ee20800 20 remove_watcher() i=7 2024-09-12T00:53:58.432 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:53:58.461 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:58.461 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:58.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.501+0000 7ff37932c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.503+0000 7ff37932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:58.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.503+0000 7ff37932c800 20 realm 2024-09-12T00:53:58.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.503+0000 7ff37932c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.503+0000 7ff37932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:58.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.503+0000 7ff37932c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:58.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.503+0000 7ff37932c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.503+0000 7ff37932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:58.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.503+0000 7ff37932c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.504+0000 7ff37932c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:58.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.504+0000 7ff37932c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.504+0000 7ff37932c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:58.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.504+0000 7ff37932c800 20 searching for the correct realm 2024-09-12T00:53:58.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.507+0000 7ff37484e640 0 -- 172.21.15.62:0/4188108927 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7ff370036420 msgr2=0x7ff370036880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:58.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.511+0000 7ff37504f640 0 -- 172.21.15.62:0/4188108927 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7ff3700138e0 msgr2=0x7ff3700243b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:58.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.514+0000 7ff37932c800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:58.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.514+0000 7ff37932c800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:58.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.514+0000 7ff37932c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:58.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.514+0000 7ff37932c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:58.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.514+0000 7ff37932c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:58.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.514+0000 7ff37932c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:58.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.514+0000 7ff37932c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.515+0000 7ff37932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:58.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.515+0000 7ff37932c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.515+0000 7ff37932c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:58.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.515+0000 7ff37932c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.515+0000 7ff37932c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:58.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.515+0000 7ff37932c800 20 zone default found 2024-09-12T00:53:58.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.515+0000 7ff37932c800 4 Realm: () 2024-09-12T00:53:58.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.515+0000 7ff37932c800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:58.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.515+0000 7ff37932c800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:58.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.515+0000 7ff37932c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:58.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.515+0000 7ff37932c800 20 zonegroup default 2024-09-12T00:53:58.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.515+0000 7ff37932c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.515+0000 7ff37932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:58.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.515+0000 7ff37932c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.516+0000 7ff37932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:58.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.516+0000 7ff37932c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.516+0000 7ff37932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:58.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.516+0000 7ff37932c800 20 started sync module instance, tier type = 2024-09-12T00:53:58.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.516+0000 7ff37932c800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:58.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.524+0000 7ff37932c800 20 add_watcher() i=0 2024-09-12T00:53:58.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.524+0000 7ff37932c800 20 add_watcher() i=1 2024-09-12T00:53:58.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.524+0000 7ff37932c800 20 add_watcher() i=2 2024-09-12T00:53:58.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.524+0000 7ff37932c800 20 add_watcher() i=3 2024-09-12T00:53:58.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.524+0000 7ff37932c800 20 add_watcher() i=4 2024-09-12T00:53:58.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.524+0000 7ff37932c800 20 add_watcher() i=5 2024-09-12T00:53:58.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.524+0000 7ff37932c800 20 add_watcher() i=6 2024-09-12T00:53:58.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.525+0000 7ff37932c800 20 add_watcher() i=7 2024-09-12T00:53:58.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.525+0000 7ff37932c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:58.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.527+0000 7ff22bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:58.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.528+0000 7ff37932c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:58.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.528+0000 7ff37932c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:58.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.528+0000 7ff37932c800 5 note: GC not initialized 2024-09-12T00:53:58.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.528+0000 7ff22afe5640 20 reqs_thread_entry: start 2024-09-12T00:53:58.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.528+0000 7ff37932c800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:58.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.528+0000 7ff37932c800 20 Filter name: none 2024-09-12T00:53:58.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.528+0000 7ff228fe1640 20 reqs_thread_entry: start 2024-09-12T00:53:58.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.528+0000 7ff37932c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.528+0000 7ff37932c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:53:58.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.528+0000 7ff37932c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.529+0000 7ff37932c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:53:58.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.529+0000 7ff37932c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:58.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.529+0000 7ff37932c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.530+0000 7ff37932c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:53:58.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.530+0000 7ff37932c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:58.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.530+0000 7ff37932c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:53:58.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.530+0000 7ff37932c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:58.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.531+0000 7ff22bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:58.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.533+0000 7ff37932c800 20 remove_watcher() i=0 2024-09-12T00:53:58.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.533+0000 7ff37932c800 2 removed watcher, disabling cache 2024-09-12T00:53:58.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.534+0000 7ff37932c800 20 remove_watcher() i=1 2024-09-12T00:53:58.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.535+0000 7ff37932c800 20 remove_watcher() i=2 2024-09-12T00:53:58.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.536+0000 7ff37932c800 20 remove_watcher() i=3 2024-09-12T00:53:58.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.537+0000 7ff37932c800 20 remove_watcher() i=4 2024-09-12T00:53:58.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.538+0000 7ff37932c800 20 remove_watcher() i=5 2024-09-12T00:53:58.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.538+0000 7ff37932c800 20 remove_watcher() i=6 2024-09-12T00:53:58.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:58.539+0000 7ff37932c800 20 remove_watcher() i=7 2024-09-12T00:53:58.549 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:58.549 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:53:58.549 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-logrecord-writes id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:53:58.550 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:58.881 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T00:53:58.882 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:59.726 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:53:59.755 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:59.755 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:59.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.795+0000 7fe385210800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.797+0000 7fe385210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:59.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.797+0000 7fe385210800 20 realm 2024-09-12T00:53:59.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.797+0000 7fe385210800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.797+0000 7fe385210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:59.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.797+0000 7fe385210800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:59.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.797+0000 7fe385210800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.797+0000 7fe385210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:59.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.797+0000 7fe385210800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.798+0000 7fe385210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:59.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.798+0000 7fe385210800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.799+0000 7fe385210800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:59.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.799+0000 7fe385210800 20 searching for the correct realm 2024-09-12T00:53:59.801 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.802+0000 7fe380179640 0 -- 172.21.15.62:0/388108721 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fe378064250 msgr2=0x7fe37807a880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:59.804 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.805+0000 7fe38117b640 0 -- 172.21.15.62:0/388108721 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x560315ea15e0 msgr2=0x560315ea3a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:59.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.809+0000 7fe385210800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:53:59.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.809+0000 7fe385210800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:53:59.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.809+0000 7fe385210800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:59.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.809+0000 7fe385210800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:59.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.809+0000 7fe385210800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:59.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.809+0000 7fe385210800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:59.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.809+0000 7fe385210800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.809+0000 7fe385210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:59.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.809+0000 7fe385210800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.809+0000 7fe385210800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:59.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.809+0000 7fe385210800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.810+0000 7fe385210800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:59.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.810+0000 7fe385210800 20 zone default found 2024-09-12T00:53:59.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.810+0000 7fe385210800 4 Realm: () 2024-09-12T00:53:59.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.810+0000 7fe385210800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:53:59.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.810+0000 7fe385210800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:53:59.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.810+0000 7fe385210800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:59.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.810+0000 7fe385210800 20 zonegroup default 2024-09-12T00:53:59.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.810+0000 7fe385210800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.810+0000 7fe385210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:59.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.810+0000 7fe385210800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.810+0000 7fe385210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:59.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.810+0000 7fe385210800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.810+0000 7fe385210800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:59.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.810+0000 7fe385210800 20 started sync module instance, tier type = 2024-09-12T00:53:59.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.810+0000 7fe385210800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:53:59.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.818+0000 7fe385210800 20 add_watcher() i=0 2024-09-12T00:53:59.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.818+0000 7fe385210800 20 add_watcher() i=1 2024-09-12T00:53:59.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.818+0000 7fe385210800 20 add_watcher() i=2 2024-09-12T00:53:59.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.818+0000 7fe385210800 20 add_watcher() i=3 2024-09-12T00:53:59.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.818+0000 7fe385210800 20 add_watcher() i=4 2024-09-12T00:53:59.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.818+0000 7fe385210800 20 add_watcher() i=5 2024-09-12T00:53:59.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.819+0000 7fe385210800 20 add_watcher() i=6 2024-09-12T00:53:59.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.819+0000 7fe385210800 20 add_watcher() i=7 2024-09-12T00:53:59.818 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.819+0000 7fe385210800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:59.820 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.821+0000 7fe236fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:59.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.821+0000 7fe385210800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:59.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.821+0000 7fe385210800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:59.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.821+0000 7fe385210800 5 note: GC not initialized 2024-09-12T00:53:59.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.822+0000 7fe235fe3640 20 reqs_thread_entry: start 2024-09-12T00:53:59.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.822+0000 7fe385210800 20 init_complete bucket index max shards: 1 2024-09-12T00:53:59.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.822+0000 7fe385210800 20 Filter name: none 2024-09-12T00:53:59.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.822+0000 7fe1a77fe640 20 reqs_thread_entry: start 2024-09-12T00:53:59.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.822+0000 7fe385210800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.822+0000 7fe385210800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:53:59.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.822+0000 7fe385210800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.823+0000 7fe385210800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:53:59.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.823+0000 7fe385210800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:59.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.823+0000 7fe385210800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.823 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.823+0000 7fe385210800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:53:59.823 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.823+0000 7fe385210800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.823 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.824+0000 7fe385210800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:53:59.823 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.824+0000 7fe385210800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:59.824 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.825+0000 7fe236fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:59.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.827+0000 7fe385210800 20 remove_watcher() i=0 2024-09-12T00:53:59.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.827+0000 7fe385210800 2 removed watcher, disabling cache 2024-09-12T00:53:59.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.828+0000 7fe385210800 20 remove_watcher() i=1 2024-09-12T00:53:59.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.829+0000 7fe385210800 20 remove_watcher() i=2 2024-09-12T00:53:59.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.830+0000 7fe385210800 20 remove_watcher() i=3 2024-09-12T00:53:59.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.831+0000 7fe385210800 20 remove_watcher() i=4 2024-09-12T00:53:59.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.832+0000 7fe385210800 20 remove_watcher() i=5 2024-09-12T00:53:59.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.833+0000 7fe385210800 20 remove_watcher() i=6 2024-09-12T00:53:59.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.834+0000 7fe385210800 20 remove_watcher() i=7 2024-09-12T00:53:59.843 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:59.844 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:53:59.844 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-logrecord-writes id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:53:59.844 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:53:59.845 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:53:59.880 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:59.880 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:59.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.920+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:59.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.922+0000 7f213d20f800 20 realm 2024-09-12T00:53:59.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:59.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.922+0000 7f213d20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:59.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:59.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.923+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:59.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.923+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:59.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.924+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:59.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.924+0000 7f213d20f800 20 searching for the correct realm 2024-09-12T00:53:59.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:53:59.927+0000 7f2138121640 0 -- 172.21.15.62:0/3859591846 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f2130036420 msgr2=0x7f21300368a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:00.131 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.132+0000 7f2139123640 0 -- 172.21.15.62:0/3859591846 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5613e3789b00 msgr2=0x5613e378bf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:00.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:00.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:00.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:00.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:00.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:00.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:00.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:00.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:00.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.137+0000 7f213d20f800 20 zone default found 2024-09-12T00:54:00.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.137+0000 7f213d20f800 4 Realm: () 2024-09-12T00:54:00.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.137+0000 7f213d20f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:00.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.137+0000 7f213d20f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:00.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.137+0000 7f213d20f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:00.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.137+0000 7f213d20f800 20 zonegroup default 2024-09-12T00:54:00.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.138+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.138+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.138+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.138+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.138+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.138+0000 7f213d20f800 20 started sync module instance, tier type = 2024-09-12T00:54:00.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.138+0000 7f213d20f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:00.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=0 2024-09-12T00:54:00.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=1 2024-09-12T00:54:00.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=2 2024-09-12T00:54:00.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=3 2024-09-12T00:54:00.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=4 2024-09-12T00:54:00.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=5 2024-09-12T00:54:00.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=6 2024-09-12T00:54:00.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.148+0000 7f213d20f800 20 add_watcher() i=7 2024-09-12T00:54:00.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.148+0000 7f213d20f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:00.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.150+0000 7f1fef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:00.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.150+0000 7f213d20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:00.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.150+0000 7f213d20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:00.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.150+0000 7f213d20f800 5 note: GC not initialized 2024-09-12T00:54:00.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.151+0000 7f1fee7e4640 20 reqs_thread_entry: start 2024-09-12T00:54:00.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.151+0000 7f213d20f800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:00.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.151+0000 7f213d20f800 20 Filter name: none 2024-09-12T00:54:00.151 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.151+0000 7f1fe7fff640 20 reqs_thread_entry: start 2024-09-12T00:54:00.151 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.151+0000 7f213d20f800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:54:00.151 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.151+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.151+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:54:00.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.151+0000 7f213d20f800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:54:00.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.151+0000 7f213d20f800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:54:00.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.151+0000 7f213d20f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 : miss 2024-09-12T00:54:00.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.151+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.152+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:54:00.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.152+0000 7f213d20f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:00.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.152+0000 7f213d20f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:00.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.152+0000 7f213d20f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:00.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.152+0000 7f213d20f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:00.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.152+0000 7f213d20f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 2024-09-12T00:54:00.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.156+0000 7f213d20f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:00.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.156+0000 7f213d20f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:00.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.156+0000 7f213d20f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:00.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.156+0000 7f213d20f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36, ofs0, ns] 2024-09-12T00:54:00.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.156+0000 7f200ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431585 cookie 94643420706128 notifier 7755 bl.length()=923 2024-09-12T00:54:00.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.156+0000 7f200ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:00.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.156+0000 7f200ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:00.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.156+0000 7f200ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:00.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.158+0000 7f213d20f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): orig_sources= new_sources= 2024-09-12T00:54:00.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.158+0000 7f213d20f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): potential sources added=[] removed=[] 2024-09-12T00:54:00.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.158+0000 7f213d20f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): orig_dests= new_dests= 2024-09-12T00:54:00.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.158+0000 7f213d20f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): potential dests added=[] removed=[] 2024-09-12T00:54:00.158 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f213d20f800 time 2024-09-12T00:54:00.160643+0000 2024-09-12T00:54:00.159 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:00.159 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:00.159 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f213e38c71a] 2024-09-12T00:54:00.159 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f213e38c8d8] 2024-09-12T00:54:00.159 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613e2171641] 2024-09-12T00:54:00.160 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd8854c) [0x5613e268454c] 2024-09-12T00:54:00.160 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5613e218131d] 2024-09-12T00:54:00.160 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:54:00.160 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f213d029590] 2024-09-12T00:54:00.160 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:54:00.160 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:54:00.160 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.160+0000 7f213d20f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f213d20f800 time 2024-09-12T00:54:00.160643+0000 2024-09-12T00:54:00.160 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:00.161 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.161 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:00.161 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f213e38c71a] 2024-09-12T00:54:00.161 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f213e38c8d8] 2024-09-12T00:54:00.161 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613e2171641] 2024-09-12T00:54:00.161 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd8854c) [0x5613e268454c] 2024-09-12T00:54:00.161 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5613e218131d] 2024-09-12T00:54:00.162 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:54:00.162 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f213d029590] 2024-09-12T00:54:00.162 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:54:00.162 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:54:00.162 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.162 INFO:tasks.workunit.client.0.smithi062.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:54:00.162 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f213d20f800 thread_name:radosgw-admin 2024-09-12T00:54:00.178 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:00.178 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f213d03e6f0] 2024-09-12T00:54:00.178 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f213d08b99c] 2024-09-12T00:54:00.178 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:54:00.178 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:54:00.178 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f213e38c774] 2024-09-12T00:54:00.178 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f213e38c8d8] 2024-09-12T00:54:00.179 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613e2171641] 2024-09-12T00:54:00.179 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd8854c) [0x5613e268454c] 2024-09-12T00:54:00.179 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5613e218131d] 2024-09-12T00:54:00.179 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:54:00.179 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f213d029590] 2024-09-12T00:54:00.179 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:54:00.179 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:54:00.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.161+0000 7f213d20f800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:00.179 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f213d20f800 thread_name:radosgw-admin 2024-09-12T00:54:00.179 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.179 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:00.180 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f213d03e6f0] 2024-09-12T00:54:00.180 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f213d08b99c] 2024-09-12T00:54:00.180 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:54:00.180 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:54:00.180 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f213e38c774] 2024-09-12T00:54:00.180 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f213e38c8d8] 2024-09-12T00:54:00.180 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613e2171641] 2024-09-12T00:54:00.180 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd8854c) [0x5613e268454c] 2024-09-12T00:54:00.180 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5613e218131d] 2024-09-12T00:54:00.180 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:54:00.180 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f213d029590] 2024-09-12T00:54:00.180 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:54:00.181 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:54:00.181 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:00.181 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.181 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:54:00.181 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:53:59.903+0000 7f213d20f800 10 monclient: monmap: 2024-09-12T00:54:00.181 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:00.181 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:00.181 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:00.181 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:00.181 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:00.181 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.181 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:00.182 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:00.182 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:00.182 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.182 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding auth protocol: cephx 2024-09-12T00:54:00.182 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding auth protocol: cephx 2024-09-12T00:54:00.182 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding auth protocol: cephx 2024-09-12T00:54:00.182 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: secure 2024-09-12T00:54:00.182 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: crc 2024-09-12T00:54:00.182 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: secure 2024-09-12T00:54:00.182 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: crc 2024-09-12T00:54:00.182 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: secure 2024-09-12T00:54:00.182 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: crc 2024-09-12T00:54:00.182 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: crc 2024-09-12T00:54:00.183 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: secure 2024-09-12T00:54:00.183 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: crc 2024-09-12T00:54:00.183 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: secure 2024-09-12T00:54:00.183 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: crc 2024-09-12T00:54:00.183 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: secure 2024-09-12T00:54:00.183 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:53:59.904+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.183 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:53:59.904+0000 7f213d20f800 1 librados: starting msgr at 2024-09-12T00:54:00.183 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:53:59.904+0000 7f213d20f800 1 librados: starting objecter 2024-09-12T00:54:00.183 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 asok(0x5613e347e630) register_command objecter_requests hook 0x5613e36c83e0 2024-09-12T00:54:00.183 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:53:59.904+0000 7f213d20f800 1 librados: setting wanted keys 2024-09-12T00:54:00.183 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:53:59.904+0000 7f213d20f800 1 librados: calling monclient init 2024-09-12T00:54:00.183 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient: init 2024-09-12T00:54:00.183 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding auth protocol: cephx 2024-09-12T00:54:00.184 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding auth protocol: cephx 2024-09-12T00:54:00.184 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding auth protocol: cephx 2024-09-12T00:54:00.184 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: secure 2024-09-12T00:54:00.184 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: crc 2024-09-12T00:54:00.184 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: secure 2024-09-12T00:54:00.184 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: crc 2024-09-12T00:54:00.184 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: secure 2024-09-12T00:54:00.184 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: crc 2024-09-12T00:54:00.184 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: crc 2024-09-12T00:54:00.184 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: secure 2024-09-12T00:54:00.184 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: crc 2024-09-12T00:54:00.184 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: secure 2024-09-12T00:54:00.184 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: crc 2024-09-12T00:54:00.185 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: secure 2024-09-12T00:54:00.185 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:53:59.904+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.185 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:53:59.904+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.185 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 asok(0x5613e347e630) register_command rotate-key hook 0x5613e369ea08 2024-09-12T00:54:00.185 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:00.185 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:00.185 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-b con 0x5613e354b2d0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:00.185 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-a con 0x5613e3557c20 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:00.185 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-c con 0x5613e36cdbe0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:00.185 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.185 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.185 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.186 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:00.186 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): authenticate will time out at 2126.397819s 2024-09-12T00:54:00.186 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:53:59.904+0000 7f2138121640 10 monclient(hunting): get_auth_request con 0x5613e3557c20 auth_method 0 2024-09-12T00:54:00.186 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:53:59.904+0000 7f2138121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.186 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:53:59.904+0000 7f2138121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.186 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:53:59.904+0000 7f2138121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.186 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:53:59.904+0000 7f2139123640 10 monclient(hunting): get_auth_request con 0x5613e36cdbe0 auth_method 0 2024-09-12T00:54:00.186 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:53:59.904+0000 7f2139123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.186 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:53:59.904+0000 7f2139123640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.186 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:53:59.904+0000 7f2139123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.186 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:53:59.905+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.186 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:53:59.905+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.186 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:53:59.905+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.187 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:53:59.905+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.187 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:53:59.905+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.187 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:53:59.905+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.187 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:53:59.905+0000 7f2138922640 10 monclient(hunting): get_auth_request con 0x5613e354b2d0 auth_method 0 2024-09-12T00:54:00.187 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:53:59.905+0000 7f2138922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.187 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:53:59.905+0000 7f2138922640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.187 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:53:59.905+0000 7f2138922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.187 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:53:59.905+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.187 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:53:59.905+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.187 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:53:59.905+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.187 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:53:59.905+0000 7f2138121640 10 monclient(hunting): handle_auth_done global_id 7746 payload 824 2024-09-12T00:54:00.187 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:53:59.905+0000 7f2138121640 10 monclient: _finish_hunting 0 2024-09-12T00:54:00.187 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:53:59.905+0000 7f2138121640 1 monclient: found mon.noname-a 2024-09-12T00:54:00.188 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:53:59.905+0000 7f2138121640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.188 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.188 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:00.188 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: dump: 2024-09-12T00:54:00.188 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.188 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.188 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.188 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.188 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.188 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.188 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.188 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.188 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.188 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.189 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: _finish_auth 0 2024-09-12T00:54:00.189 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: _check_auth_tickets 2024-09-12T00:54:00.189 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:00.189 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.189 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:00.189 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: dump: 2024-09-12T00:54:00.189 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.189 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.189 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.189 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.189 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.189 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.189 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.190 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.190 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.190 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.190 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:53:59.905+0000 7f213d20f800 5 monclient: authenticate success, global_id 7746 2024-09-12T00:54:00.190 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:53:59.905+0000 7f213d20f800 10 monclient: _renew_subs 2024-09-12T00:54:00.190 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:53:59.905+0000 7f213d20f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.190 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:53:59.905+0000 7f2026e0d640 4 set_mon_vals no callback set 2024-09-12T00:54:00.190 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:53:59.905+0000 7f213d20f800 10 monclient: _renew_subs 2024-09-12T00:54:00.190 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:53:59.905+0000 7f213d20f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.190 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:53:59.905+0000 7f213d20f800 1 librados: init done 2024-09-12T00:54:00.190 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:53:59.907+0000 7f202560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:00.190 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:53:59.907+0000 7f202560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:00.190 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:53:59.907+0000 7f202560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:00.190 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:53:59.907+0000 7f2138922640 10 monclient: get_auth_request con 0x7f2020076470 auth_method 0 2024-09-12T00:54:00.191 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:53:59.908+0000 7f2139123640 10 monclient: get_auth_request con 0x5613e36deee0 auth_method 0 2024-09-12T00:54:00.191 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:53:59.908+0000 7f2138922640 10 monclient: get_auth_request con 0x5613e36ea600 auth_method 0 2024-09-12T00:54:00.191 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:53:59.909+0000 7f2138121640 10 monclient: get_auth_request con 0x5613e36eea30 auth_method 0 2024-09-12T00:54:00.191 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:53:59.910+0000 7f213d20f800 10 monclient: build_initial_monmap 2024-09-12T00:54:00.191 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:53:59.910+0000 7f213d20f800 1 build_initial for_mkfs: 0 2024-09-12T00:54:00.191 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:53:59.910+0000 7f213d20f800 10 monclient: monmap: 2024-09-12T00:54:00.191 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:00.191 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:00.191 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:00.191 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:00.191 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:00.191 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.192 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:00.192 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:00.192 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:00.192 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.192 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding auth protocol: cephx 2024-09-12T00:54:00.192 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding auth protocol: cephx 2024-09-12T00:54:00.192 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding auth protocol: cephx 2024-09-12T00:54:00.192 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: secure 2024-09-12T00:54:00.192 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: crc 2024-09-12T00:54:00.192 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: secure 2024-09-12T00:54:00.192 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: crc 2024-09-12T00:54:00.192 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: secure 2024-09-12T00:54:00.193 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: crc 2024-09-12T00:54:00.193 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: crc 2024-09-12T00:54:00.193 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: secure 2024-09-12T00:54:00.193 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: crc 2024-09-12T00:54:00.193 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: secure 2024-09-12T00:54:00.193 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: crc 2024-09-12T00:54:00.193 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: secure 2024-09-12T00:54:00.193 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:53:59.910+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.193 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 asok(0x5613e347e630) register_command objecter_requests cmddesc objecter_requests hook 0x5613e36f6e80 EEXIST 2024-09-12T00:54:00.193 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient: init 2024-09-12T00:54:00.193 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding auth protocol: cephx 2024-09-12T00:54:00.193 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding auth protocol: cephx 2024-09-12T00:54:00.193 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding auth protocol: cephx 2024-09-12T00:54:00.194 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: secure 2024-09-12T00:54:00.194 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: crc 2024-09-12T00:54:00.194 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: secure 2024-09-12T00:54:00.194 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: crc 2024-09-12T00:54:00.194 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: secure 2024-09-12T00:54:00.194 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: crc 2024-09-12T00:54:00.194 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: crc 2024-09-12T00:54:00.194 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: secure 2024-09-12T00:54:00.194 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: crc 2024-09-12T00:54:00.194 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: secure 2024-09-12T00:54:00.194 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: crc 2024-09-12T00:54:00.194 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: secure 2024-09-12T00:54:00.194 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:53:59.911+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.195 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:53:59.911+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.195 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 asok(0x5613e347e630) register_command rotate-key cmddesc rotate-key hook 0x5613e36f2110 EEXIST 2024-09-12T00:54:00.195 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:00.195 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:54:00.195 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-c con 0x5613e371b1a0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:00.195 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-a con 0x5613e371b580 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:00.195 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-b con 0x5613e3719eb0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:00.195 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.195 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.195 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.195 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:00.195 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): authenticate will time out at 2126.404789s 2024-09-12T00:54:00.195 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:53:59.911+0000 7f2138121640 10 monclient(hunting): get_auth_request con 0x5613e371b580 auth_method 0 2024-09-12T00:54:00.196 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:53:59.911+0000 7f2138121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.196 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:53:59.911+0000 7f2138121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.196 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:53:59.911+0000 7f2138121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.196 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:53:59.911+0000 7f2138922640 10 monclient(hunting): get_auth_request con 0x5613e371b1a0 auth_method 0 2024-09-12T00:54:00.196 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:53:59.911+0000 7f2138922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.196 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:53:59.911+0000 7f2138922640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.196 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:53:59.911+0000 7f2138922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.196 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:53:59.911+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.196 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:53:59.911+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.196 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:53:59.912+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.196 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:53:59.912+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.196 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:53:59.912+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.197 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:53:59.912+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.197 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:53:59.912+0000 7f2139123640 10 monclient(hunting): get_auth_request con 0x5613e3719eb0 auth_method 0 2024-09-12T00:54:00.197 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:53:59.912+0000 7f2139123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.197 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:53:59.912+0000 7f2139123640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.197 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:53:59.912+0000 7f2139123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.197 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:53:59.912+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.197 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:53:59.912+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.197 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:53:59.912+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.197 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:53:59.912+0000 7f2138922640 10 monclient(hunting): handle_auth_done global_id 7316 payload 824 2024-09-12T00:54:00.197 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:53:59.912+0000 7f2138922640 10 monclient: _finish_hunting 0 2024-09-12T00:54:00.197 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:53:59.912+0000 7f2138922640 1 monclient: found mon.noname-c 2024-09-12T00:54:00.197 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:53:59.912+0000 7f2138922640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:54:00.197 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.197 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:00.198 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: dump: 2024-09-12T00:54:00.198 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.198 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.198 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.198 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.198 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.198 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.198 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.198 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.198 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.198 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.199 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:54:00.199 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:54:00.199 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:00.199 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.199 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:00.199 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: dump: 2024-09-12T00:54:00.199 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.199 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.199 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.199 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.199 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.199 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.199 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.200 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.200 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.200 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.200 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:53:59.912+0000 7f213d20f800 5 monclient: authenticate success, global_id 7316 2024-09-12T00:54:00.200 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:53:59.912+0000 7f213d20f800 10 monclient: _renew_subs 2024-09-12T00:54:00.200 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:53:59.912+0000 7f2139924640 4 set_mon_vals no callback set 2024-09-12T00:54:00.200 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:53:59.912+0000 7f213d20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:54:00.200 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:53:59.912+0000 7f213d20f800 10 monclient: _renew_subs 2024-09-12T00:54:00.200 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:53:59.912+0000 7f213d20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:54:00.200 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:53:59.914+0000 7f201e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:00.200 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:53:59.914+0000 7f201e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:00.200 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:53:59.914+0000 7f201e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:00.200 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:53:59.914+0000 7f2138121640 10 monclient: get_auth_request con 0x7f2010076380 auth_method 0 2024-09-12T00:54:00.201 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:53:59.914+0000 7f213d20f800 10 monclient: get_monmap_and_config 2024-09-12T00:54:00.201 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:53:59.914+0000 7f213d20f800 10 monclient: build_initial_monmap 2024-09-12T00:54:00.201 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:53:59.914+0000 7f213d20f800 1 build_initial for_mkfs: 0 2024-09-12T00:54:00.201 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:53:59.914+0000 7f213d20f800 10 monclient: monmap: 2024-09-12T00:54:00.201 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:00.201 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:00.201 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:00.201 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:00.201 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:00.201 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.201 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:00.201 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:00.201 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:00.202 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.202 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding auth protocol: cephx 2024-09-12T00:54:00.202 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding auth protocol: cephx 2024-09-12T00:54:00.202 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding auth protocol: cephx 2024-09-12T00:54:00.202 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: secure 2024-09-12T00:54:00.202 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: crc 2024-09-12T00:54:00.202 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: secure 2024-09-12T00:54:00.202 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: crc 2024-09-12T00:54:00.202 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: secure 2024-09-12T00:54:00.202 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: crc 2024-09-12T00:54:00.202 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: crc 2024-09-12T00:54:00.202 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: secure 2024-09-12T00:54:00.202 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: crc 2024-09-12T00:54:00.202 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: secure 2024-09-12T00:54:00.203 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: crc 2024-09-12T00:54:00.203 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: secure 2024-09-12T00:54:00.203 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:53:59.915+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.203 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient: init 2024-09-12T00:54:00.203 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding auth protocol: cephx 2024-09-12T00:54:00.203 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding auth protocol: cephx 2024-09-12T00:54:00.203 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding auth protocol: cephx 2024-09-12T00:54:00.203 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: secure 2024-09-12T00:54:00.203 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: crc 2024-09-12T00:54:00.203 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: secure 2024-09-12T00:54:00.203 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: crc 2024-09-12T00:54:00.203 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: secure 2024-09-12T00:54:00.203 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: crc 2024-09-12T00:54:00.203 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: crc 2024-09-12T00:54:00.204 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: secure 2024-09-12T00:54:00.204 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: crc 2024-09-12T00:54:00.204 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: secure 2024-09-12T00:54:00.204 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: crc 2024-09-12T00:54:00.204 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: secure 2024-09-12T00:54:00.204 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:53:59.915+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.204 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:53:59.915+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.204 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 asok(0x5613e347e630) register_command rotate-key cmddesc rotate-key hook 0x7ffd01469158 EEXIST 2024-09-12T00:54:00.204 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:00.204 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:00.204 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-b con 0x5613e376f570 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:00.204 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-a con 0x5613e373f3a0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:00.204 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-c con 0x5613e376aee0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:00.205 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.205 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.205 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.205 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:00.205 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): authenticate will time out at 2126.408919s 2024-09-12T00:54:00.205 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:53:59.916+0000 7f2139123640 10 monclient(hunting): get_auth_request con 0x5613e376aee0 auth_method 0 2024-09-12T00:54:00.205 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:53:59.916+0000 7f2139123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.205 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:53:59.916+0000 7f2139123640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.205 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:53:59.916+0000 7f2139123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.205 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): get_auth_request con 0x5613e373f3a0 auth_method 0 2024-09-12T00:54:00.205 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.205 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.205 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.206 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:53:59.916+0000 7f2138922640 10 monclient(hunting): get_auth_request con 0x5613e376f570 auth_method 0 2024-09-12T00:54:00.206 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:53:59.916+0000 7f2138922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.206 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:53:59.916+0000 7f2138922640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.206 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:53:59.916+0000 7f2138922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.206 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.206 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.206 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.206 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:53:59.916+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.206 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:53:59.916+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.206 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:53:59.916+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.206 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:53:59.916+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.206 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:53:59.916+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.206 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:53:59.916+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.207 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): handle_auth_done global_id 7752 payload 274 2024-09-12T00:54:00.207 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient: _finish_hunting 0 2024-09-12T00:54:00.207 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:53:59.916+0000 7f2138121640 1 monclient: found mon.noname-a 2024-09-12T00:54:00.207 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.207 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.207 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:00.207 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: dump: 2024-09-12T00:54:00.207 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.207 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.207 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.207 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.207 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.207 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.207 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.208 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.208 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.208 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.208 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: _finish_auth 0 2024-09-12T00:54:00.208 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:54:00.208 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:00.208 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:53:59.916+0000 7f213d20f800 5 monclient: authenticate success, global_id 7752 2024-09-12T00:54:00.208 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:53:59.916+0000 7f213d20f800 10 monclient: get_monmap_and_config success 2024-09-12T00:54:00.208 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:53:59.916+0000 7f213d20f800 4 set_mon_vals no callback set 2024-09-12T00:54:00.208 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.208 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:00.208 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: dump: 2024-09-12T00:54:00.209 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.209 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.209 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.209 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.209 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.209 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.209 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.209 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.209 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.209 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.209 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:53:59.917+0000 7f213d20f800 10 monclient: shutdown 2024-09-12T00:54:00.209 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:53:59.917+0000 7f213d20f800 10 monclient: build_initial_monmap 2024-09-12T00:54:00.209 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:53:59.917+0000 7f213d20f800 1 build_initial for_mkfs: 0 2024-09-12T00:54:00.210 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:53:59.917+0000 7f213d20f800 10 monclient: monmap: 2024-09-12T00:54:00.210 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:00.210 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:00.210 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:00.210 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:00.210 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:00.210 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.210 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:00.210 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:00.210 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:00.210 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.210 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding auth protocol: cephx 2024-09-12T00:54:00.210 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding auth protocol: cephx 2024-09-12T00:54:00.210 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding auth protocol: cephx 2024-09-12T00:54:00.211 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: secure 2024-09-12T00:54:00.211 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: crc 2024-09-12T00:54:00.211 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: secure 2024-09-12T00:54:00.211 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: crc 2024-09-12T00:54:00.211 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: secure 2024-09-12T00:54:00.211 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: crc 2024-09-12T00:54:00.211 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: crc 2024-09-12T00:54:00.211 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: secure 2024-09-12T00:54:00.211 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: crc 2024-09-12T00:54:00.211 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: secure 2024-09-12T00:54:00.211 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: crc 2024-09-12T00:54:00.211 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: secure 2024-09-12T00:54:00.211 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:53:59.917+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.211 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:53:59.917+0000 7f213d20f800 1 librados: starting msgr at 2024-09-12T00:54:00.212 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:53:59.917+0000 7f213d20f800 1 librados: starting objecter 2024-09-12T00:54:00.212 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 asok(0x5613e347e630) register_command objecter_requests cmddesc objecter_requests hook 0x5613e37195e0 EEXIST 2024-09-12T00:54:00.212 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:53:59.917+0000 7f213d20f800 1 librados: setting wanted keys 2024-09-12T00:54:00.212 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:53:59.917+0000 7f213d20f800 1 librados: calling monclient init 2024-09-12T00:54:00.212 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:53:59.917+0000 7f213d20f800 10 monclient: init 2024-09-12T00:54:00.212 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding auth protocol: cephx 2024-09-12T00:54:00.212 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding auth protocol: cephx 2024-09-12T00:54:00.212 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding auth protocol: cephx 2024-09-12T00:54:00.212 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: secure 2024-09-12T00:54:00.212 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: crc 2024-09-12T00:54:00.212 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: secure 2024-09-12T00:54:00.212 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: crc 2024-09-12T00:54:00.212 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: secure 2024-09-12T00:54:00.213 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: crc 2024-09-12T00:54:00.213 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: crc 2024-09-12T00:54:00.213 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: secure 2024-09-12T00:54:00.213 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: crc 2024-09-12T00:54:00.213 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: secure 2024-09-12T00:54:00.213 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: crc 2024-09-12T00:54:00.213 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: secure 2024-09-12T00:54:00.213 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:53:59.918+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.213 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:53:59.918+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.213 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:53:59.918+0000 7f213d20f800 5 asok(0x5613e347e630) register_command rotate-key cmddesc rotate-key hook 0x5613e372fba8 EEXIST 2024-09-12T00:54:00.213 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:00.213 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:54:00.214 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-a con 0x5613e373f3a0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:00.214 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-b con 0x5613e376aee0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:00.214 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-c con 0x5613e376f570 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:00.214 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.214 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.214 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.214 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:00.214 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): authenticate will time out at 2126.411339s 2024-09-12T00:54:00.214 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): get_auth_request con 0x5613e373f3a0 auth_method 0 2024-09-12T00:54:00.214 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.214 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.214 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.214 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:53:59.918+0000 7f2139123640 10 monclient(hunting): get_auth_request con 0x5613e376f570 auth_method 0 2024-09-12T00:54:00.215 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:53:59.918+0000 7f2139123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.215 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:53:59.918+0000 7f2139123640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.215 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:53:59.918+0000 7f2139123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.215 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.215 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.215 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.215 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:53:59.918+0000 7f2138121640 10 monclient(hunting): get_auth_request con 0x5613e376aee0 auth_method 0 2024-09-12T00:54:00.215 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:53:59.918+0000 7f2138121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.215 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:53:59.918+0000 7f2138121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.215 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:53:59.918+0000 7f2138121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.215 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:53:59.918+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.215 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:53:59.918+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.215 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:53:59.918+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.216 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:53:59.918+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.216 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:53:59.918+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.216 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:53:59.918+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.216 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): handle_auth_done global_id 7755 payload 824 2024-09-12T00:54:00.216 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient: _finish_hunting 0 2024-09-12T00:54:00.216 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:53:59.918+0000 7f2138922640 1 monclient: found mon.noname-a 2024-09-12T00:54:00.216 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.216 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.216 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:00.216 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: dump: 2024-09-12T00:54:00.216 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.216 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.216 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.216 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.217 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.217 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.217 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.217 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.217 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.217 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.217 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:54:00.217 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:54:00.217 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:00.217 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.217 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:00.217 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: dump: 2024-09-12T00:54:00.217 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.218 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.218 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.218 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.218 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.218 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.218 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.218 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.218 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.218 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.218 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:53:59.918+0000 7f213d20f800 5 monclient: authenticate success, global_id 7755 2024-09-12T00:54:00.218 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient: _renew_subs 2024-09-12T00:54:00.218 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:53:59.918+0000 7f200ffff640 4 set_mon_vals no callback set 2024-09-12T00:54:00.219 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:53:59.919+0000 7f213d20f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.219 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:53:59.919+0000 7f213d20f800 10 monclient: _renew_subs 2024-09-12T00:54:00.219 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:53:59.919+0000 7f213d20f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.219 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:53:59.919+0000 7f213d20f800 1 librados: init done 2024-09-12T00:54:00.219 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:53:59.919+0000 7f213d20f800 5 asok(0x5613e347e630) register_command cr dump hook 0x5613e375e4d8 2024-09-12T00:54:00.219 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:53:59.920+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.219 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:53:59.921+0000 7f200e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:00.219 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:53:59.921+0000 7f200e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:00.219 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:53:59.921+0000 7f200e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:00.219 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:53:59.921+0000 7f2138121640 10 monclient: get_auth_request con 0x7f20040764a0 auth_method 0 2024-09-12T00:54:00.219 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:53:59.922+0000 7f2139123640 10 monclient: get_auth_request con 0x5613e3789b00 auth_method 0 2024-09-12T00:54:00.219 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.219 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:53:59.922+0000 7f213d20f800 20 realm 2024-09-12T00:54:00.219 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.219 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.220 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:53:59.922+0000 7f213d20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:00.220 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.220 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.220 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.220 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:53:59.923+0000 7f2138922640 10 monclient: get_auth_request con 0x5613e378dd50 auth_method 0 2024-09-12T00:54:00.220 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:53:59.923+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:00.220 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:53:59.923+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.220 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:53:59.923+0000 7f2138121640 10 monclient: get_auth_request con 0x5613e37915b0 auth_method 0 2024-09-12T00:54:00.220 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:53:59.924+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:00.220 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:53:59.924+0000 7f213d20f800 20 searching for the correct realm 2024-09-12T00:54:00.220 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:53:59.924+0000 7f2139123640 10 monclient: get_auth_request con 0x5613e3796370 auth_method 0 2024-09-12T00:54:00.220 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:53:59.925+0000 7f2138922640 10 monclient: get_auth_request con 0x7f2130025040 auth_method 0 2024-09-12T00:54:00.221 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:53:59.927+0000 7f2138121640 10 monclient: get_auth_request con 0x7f2130036420 auth_method 0 2024-09-12T00:54:00.221 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:53:59.927+0000 7f2138121640 0 -- 172.21.15.62:0/3859591846 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f2130036420 msgr2=0x7f21300368a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:00.221 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:54:00.128+0000 7f2138121640 10 monclient: get_auth_request con 0x7f2130036420 auth_method 0 2024-09-12T00:54:00.221 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:54:00.130+0000 7f2139123640 10 monclient: get_auth_request con 0x7f2128023690 auth_method 0 2024-09-12T00:54:00.221 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:54:00.131+0000 7f2138922640 10 monclient: get_auth_request con 0x7f2130011380 auth_method 0 2024-09-12T00:54:00.221 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:54:00.132+0000 7f2139123640 0 -- 172.21.15.62:0/3859591846 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5613e3789b00 msgr2=0x5613e378bf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:00.221 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:54:00.132+0000 7f200e7fc640 1 client.7755.objecter ms_handle_reset 0x5613e3789b00 session 0x5613e37893f0 osd.6 2024-09-12T00:54:00.221 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:54:00.132+0000 7f200e7fc640 10 monclient: _renew_subs 2024-09-12T00:54:00.221 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:54:00.132+0000 7f200e7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.221 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:54:00.133+0000 7f2139123640 10 monclient: get_auth_request con 0x7f2004086750 auth_method 0 2024-09-12T00:54:00.221 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:00.221 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:00.221 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:00.221 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:00.222 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:00.222 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:00.222 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.222 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.222 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.222 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:00.222 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.222 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:00.222 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 zone default found 2024-09-12T00:54:00.222 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:54:00.137+0000 7f213d20f800 4 Realm: () 2024-09-12T00:54:00.222 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:54:00.137+0000 7f213d20f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:00.222 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:54:00.137+0000 7f213d20f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:00.222 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:54:00.137+0000 7f213d20f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 zonegroup default 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:54:00.138+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:54:00.138+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:54:00.138+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:54:00.138+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:54:00.138+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:54:00.138+0000 7f213d20f800 20 started sync module instance, tier type = 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:54:00.138+0000 7f213d20f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=0 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=1 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=2 2024-09-12T00:54:00.223 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=3 2024-09-12T00:54:00.224 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=4 2024-09-12T00:54:00.224 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=5 2024-09-12T00:54:00.224 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=6 2024-09-12T00:54:00.224 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:54:00.148+0000 7f213d20f800 20 add_watcher() i=7 2024-09-12T00:54:00.224 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:54:00.148+0000 7f213d20f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:00.224 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding auth protocol: cephx 2024-09-12T00:54:00.224 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding auth protocol: cephx 2024-09-12T00:54:00.224 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding auth protocol: cephx 2024-09-12T00:54:00.224 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: secure 2024-09-12T00:54:00.224 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: crc 2024-09-12T00:54:00.224 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: secure 2024-09-12T00:54:00.224 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: crc 2024-09-12T00:54:00.224 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: secure 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: crc 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: crc 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: secure 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: crc 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: secure 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: crc 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: secure 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:54:00.150+0000 7f1fef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:54:00.150+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:54:00.150+0000 7f213d20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:54:00.150+0000 7f213d20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 asok(0x5613e347e630) register_command cache list hook 0x5613e3760dc0 2024-09-12T00:54:00.225 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 asok(0x5613e347e630) register_command cache inspect hook 0x5613e3760dc0 2024-09-12T00:54:00.226 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 asok(0x5613e347e630) register_command cache erase hook 0x5613e3760dc0 2024-09-12T00:54:00.226 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 asok(0x5613e347e630) register_command cache zap hook 0x5613e3760dc0 2024-09-12T00:54:00.226 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 note: GC not initialized 2024-09-12T00:54:00.226 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:54:00.151+0000 7f1fee7e4640 20 reqs_thread_entry: start 2024-09-12T00:54:00.226 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:54:00.151+0000 7f213d20f800 5 asok(0x5613e347e630) register_command sync trace show hook 0x7f21280044f0 2024-09-12T00:54:00.226 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:54:00.151+0000 7f213d20f800 5 asok(0x5613e347e630) register_command sync trace history hook 0x7f21280044f0 2024-09-12T00:54:00.226 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:54:00.151+0000 7f213d20f800 5 asok(0x5613e347e630) register_command sync trace active hook 0x7f21280044f0 2024-09-12T00:54:00.226 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:54:00.151+0000 7f213d20f800 5 asok(0x5613e347e630) register_command sync trace active_short hook 0x7f21280044f0 2024-09-12T00:54:00.226 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:54:00.151+0000 7f213d20f800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:00.226 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:54:00.151+0000 7f213d20f800 20 Filter name: none 2024-09-12T00:54:00.226 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:54:00.151+0000 7f1fe7fff640 20 reqs_thread_entry: start 2024-09-12T00:54:00.226 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:54:00.151+0000 7f213d20f800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:54:00.226 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:54:00.151+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.227 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:54:00.151+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:54:00.227 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:54:00.151+0000 7f213d20f800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:54:00.227 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:54:00.151+0000 7f213d20f800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:54:00.227 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:54:00.151+0000 7f213d20f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 : miss 2024-09-12T00:54:00.227 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:54:00.151+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.227 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:54:00.152+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:54:00.227 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:54:00.152+0000 7f213d20f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:00.227 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:54:00.152+0000 7f213d20f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:00.227 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:54:00.152+0000 7f213d20f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:00.227 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:54:00.152+0000 7f213d20f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:00.227 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:54:00.152+0000 7f213d20f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 2024-09-12T00:54:00.227 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:54:00.156+0000 7f213d20f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:00.228 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:54:00.156+0000 7f213d20f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:00.228 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:54:00.156+0000 7f213d20f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:00.228 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:54:00.156+0000 7f213d20f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36, ofs0, ns] 2024-09-12T00:54:00.228 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:54:00.156+0000 7f200ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431585 cookie 94643420706128 notifier 7755 bl.length()=923 2024-09-12T00:54:00.228 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:54:00.156+0000 7f200ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:00.228 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:54:00.156+0000 7f200ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:00.228 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:54:00.156+0000 7f200ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:00.228 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:54:00.158+0000 7f213d20f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): orig_sources= new_sources= 2024-09-12T00:54:00.228 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:54:00.158+0000 7f213d20f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): potential sources added=[] removed=[] 2024-09-12T00:54:00.228 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:54:00.158+0000 7f213d20f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): orig_dests= new_dests= 2024-09-12T00:54:00.228 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:54:00.158+0000 7f213d20f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): potential dests added=[] removed=[] 2024-09-12T00:54:00.228 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:54:00.160+0000 7f213d20f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f213d20f800 time 2024-09-12T00:54:00.160643+0000 2024-09-12T00:54:00.228 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:00.229 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.229 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:00.229 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f213e38c71a] 2024-09-12T00:54:00.229 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f213e38c8d8] 2024-09-12T00:54:00.229 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613e2171641] 2024-09-12T00:54:00.229 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd8854c) [0x5613e268454c] 2024-09-12T00:54:00.229 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5613e218131d] 2024-09-12T00:54:00.229 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:54:00.229 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f213d029590] 2024-09-12T00:54:00.229 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:54:00.229 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:54:00.229 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.230 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:54:00.161+0000 7f213d20f800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:00.230 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f213d20f800 thread_name:radosgw-admin 2024-09-12T00:54:00.230 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.230 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:00.230 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f213d03e6f0] 2024-09-12T00:54:00.230 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f213d08b99c] 2024-09-12T00:54:00.230 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:54:00.230 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:54:00.230 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f213e38c774] 2024-09-12T00:54:00.230 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f213e38c8d8] 2024-09-12T00:54:00.230 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613e2171641] 2024-09-12T00:54:00.230 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd8854c) [0x5613e268454c] 2024-09-12T00:54:00.230 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5613e218131d] 2024-09-12T00:54:00.230 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:54:00.231 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f213d029590] 2024-09-12T00:54:00.231 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:54:00.231 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:54:00.231 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:00.231 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.231 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:54:00.231 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:54:00.231 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:54:00.231 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:54:00.231 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:54:00.231 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:54:00.231 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:54:00.231 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:54:00.232 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:54:00.232 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:54:00.232 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:54:00.232 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:54:00.232 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:54:00.232 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:54:00.232 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:54:00.232 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:54:00.232 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:54:00.232 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:54:00.232 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:54:00.232 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:54:00.232 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:54:00.232 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:54:00.233 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:54:00.233 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:54:00.233 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:54:00.233 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:54:00.233 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:54:00.233 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:54:00.233 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:54:00.233 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:54:00.233 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:54:00.233 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:54:00.233 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:54:00.233 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:54:00.233 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:54:00.234 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:54:00.234 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:54:00.234 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:54:00.234 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:54:00.234 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:54:00.234 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:54:00.234 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:54:00.234 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:54:00.234 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:54:00.234 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:54:00.234 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:54:00.234 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:54:00.234 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:54:00.235 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:54:00.235 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:54:00.235 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:54:00.235 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:54:00.235 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:54:00.235 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:54:00.235 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:54:00.235 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:54:00.235 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:54:00.235 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:54:00.235 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:54:00.235 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:54:00.235 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:54:00.236 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:54:00.236 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:54:00.236 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:54:00.236 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:54:00.236 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:54:00.236 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:54:00.236 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:54:00.236 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:54:00.236 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:54:00.236 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:54:00.236 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:54:00.236 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:54:00.236 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:54:00.237 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:54:00.237 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:54:00.237 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:54:00.237 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:54:00.237 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:54:00.237 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:54:00.237 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:54:00.237 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:54:00.237 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:54:00.237 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:54:00.237 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:54:00.237 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:54:00.237 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:54:00.237 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:54:00.238 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:54:00.238 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:54:00.238 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:54:00.238 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:54:00.238 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:54:00.238 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:54:00.238 INFO:tasks.workunit.client.0.smithi062.stderr: 7f1fe7fff640 / http_manager 2024-09-12T00:54:00.238 INFO:tasks.workunit.client.0.smithi062.stderr: 7f1fee7e4640 / http_manager 2024-09-12T00:54:00.238 INFO:tasks.workunit.client.0.smithi062.stderr: 7f1fef7e6640 / rgw_dt_lg_renew 2024-09-12T00:54:00.238 INFO:tasks.workunit.client.0.smithi062.stderr: 7f200e7fc640 / ms_dispatch 2024-09-12T00:54:00.238 INFO:tasks.workunit.client.0.smithi062.stderr: 7f200ffff640 / io_context_pool 2024-09-12T00:54:00.238 INFO:tasks.workunit.client.0.smithi062.stderr: 7f201e7fc640 / ms_dispatch 2024-09-12T00:54:00.238 INFO:tasks.workunit.client.0.smithi062.stderr: 7f202560a640 / ms_dispatch 2024-09-12T00:54:00.239 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2026e0d640 / io_context_pool 2024-09-12T00:54:00.239 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2138121640 / msgr-worker-2 2024-09-12T00:54:00.239 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2138922640 / msgr-worker-1 2024-09-12T00:54:00.239 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2139123640 / msgr-worker-0 2024-09-12T00:54:00.239 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2139924640 / io_context_pool 2024-09-12T00:54:00.239 INFO:tasks.workunit.client.0.smithi062.stderr: 7f213d20f800 / radosgw-admin 2024-09-12T00:54:00.239 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:54:00.239 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:54:00.239 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/log/ceph/ceph-client.admin.134015.log 2024-09-12T00:54:00.239 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:54:00.239 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:54:00.239 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:53:59.903+0000 7f213d20f800 10 monclient: monmap: 2024-09-12T00:54:00.239 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:00.240 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:00.240 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:00.240 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:00.240 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:00.240 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.240 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:00.240 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:00.240 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:00.240 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.240 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding auth protocol: cephx 2024-09-12T00:54:00.240 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding auth protocol: cephx 2024-09-12T00:54:00.240 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding auth protocol: cephx 2024-09-12T00:54:00.240 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: secure 2024-09-12T00:54:00.241 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: crc 2024-09-12T00:54:00.241 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: secure 2024-09-12T00:54:00.241 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: crc 2024-09-12T00:54:00.241 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: secure 2024-09-12T00:54:00.241 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: crc 2024-09-12T00:54:00.241 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: crc 2024-09-12T00:54:00.241 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: secure 2024-09-12T00:54:00.241 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: crc 2024-09-12T00:54:00.241 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: secure 2024-09-12T00:54:00.241 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: crc 2024-09-12T00:54:00.241 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:53:59.903+0000 7f213d20f800 5 AuthRegistry(0x5613e36a4540) adding con mode: secure 2024-09-12T00:54:00.241 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:53:59.904+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.241 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:53:59.904+0000 7f213d20f800 1 librados: starting msgr at 2024-09-12T00:54:00.242 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:53:59.904+0000 7f213d20f800 1 librados: starting objecter 2024-09-12T00:54:00.242 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 asok(0x5613e347e630) register_command objecter_requests hook 0x5613e36c83e0 2024-09-12T00:54:00.242 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:53:59.904+0000 7f213d20f800 1 librados: setting wanted keys 2024-09-12T00:54:00.242 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:53:59.904+0000 7f213d20f800 1 librados: calling monclient init 2024-09-12T00:54:00.242 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient: init 2024-09-12T00:54:00.242 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding auth protocol: cephx 2024-09-12T00:54:00.242 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding auth protocol: cephx 2024-09-12T00:54:00.242 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding auth protocol: cephx 2024-09-12T00:54:00.242 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: secure 2024-09-12T00:54:00.242 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: crc 2024-09-12T00:54:00.242 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: secure 2024-09-12T00:54:00.242 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: crc 2024-09-12T00:54:00.242 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: secure 2024-09-12T00:54:00.243 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: crc 2024-09-12T00:54:00.243 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: crc 2024-09-12T00:54:00.243 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: secure 2024-09-12T00:54:00.243 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: crc 2024-09-12T00:54:00.243 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: secure 2024-09-12T00:54:00.243 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: crc 2024-09-12T00:54:00.243 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 AuthRegistry(0x5613e369e8c0) adding con mode: secure 2024-09-12T00:54:00.243 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:53:59.904+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.243 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:53:59.904+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.243 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:53:59.904+0000 7f213d20f800 5 asok(0x5613e347e630) register_command rotate-key hook 0x5613e369ea08 2024-09-12T00:54:00.243 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:00.243 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:00.243 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-b con 0x5613e354b2d0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:00.244 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-a con 0x5613e3557c20 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:00.244 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-c con 0x5613e36cdbe0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:00.244 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.244 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.244 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.244 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:00.244 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:53:59.904+0000 7f213d20f800 10 monclient(hunting): authenticate will time out at 2126.397819s 2024-09-12T00:54:00.244 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:53:59.904+0000 7f2138121640 10 monclient(hunting): get_auth_request con 0x5613e3557c20 auth_method 0 2024-09-12T00:54:00.244 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:53:59.904+0000 7f2138121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.244 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:53:59.904+0000 7f2138121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.244 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:53:59.904+0000 7f2138121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.244 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:53:59.904+0000 7f2139123640 10 monclient(hunting): get_auth_request con 0x5613e36cdbe0 auth_method 0 2024-09-12T00:54:00.244 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:53:59.904+0000 7f2139123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.245 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:53:59.904+0000 7f2139123640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.245 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:53:59.904+0000 7f2139123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.245 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:53:59.905+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.245 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:53:59.905+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.245 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:53:59.905+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.245 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:53:59.905+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.245 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:53:59.905+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.245 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:53:59.905+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.245 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:53:59.905+0000 7f2138922640 10 monclient(hunting): get_auth_request con 0x5613e354b2d0 auth_method 0 2024-09-12T00:54:00.245 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:53:59.905+0000 7f2138922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.245 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:53:59.905+0000 7f2138922640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.245 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:53:59.905+0000 7f2138922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.245 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:53:59.905+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.246 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:53:59.905+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.246 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:53:59.905+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.246 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:53:59.905+0000 7f2138121640 10 monclient(hunting): handle_auth_done global_id 7746 payload 824 2024-09-12T00:54:00.246 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:53:59.905+0000 7f2138121640 10 monclient: _finish_hunting 0 2024-09-12T00:54:00.246 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:53:59.905+0000 7f2138121640 1 monclient: found mon.noname-a 2024-09-12T00:54:00.246 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:53:59.905+0000 7f2138121640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.246 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.246 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:00.246 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: dump: 2024-09-12T00:54:00.246 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.246 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.246 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.246 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.247 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.247 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.247 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.247 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.247 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.247 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.247 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: _finish_auth 0 2024-09-12T00:54:00.247 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: _check_auth_tickets 2024-09-12T00:54:00.247 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:00.247 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.247 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:00.247 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:53:59.905+0000 7f202560a640 10 monclient: dump: 2024-09-12T00:54:00.247 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.248 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.248 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.248 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.248 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.248 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.248 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.248 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.248 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.248 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.248 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:53:59.905+0000 7f213d20f800 5 monclient: authenticate success, global_id 7746 2024-09-12T00:54:00.248 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:53:59.905+0000 7f213d20f800 10 monclient: _renew_subs 2024-09-12T00:54:00.248 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:53:59.905+0000 7f213d20f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.249 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:53:59.905+0000 7f2026e0d640 4 set_mon_vals no callback set 2024-09-12T00:54:00.249 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:53:59.905+0000 7f213d20f800 10 monclient: _renew_subs 2024-09-12T00:54:00.249 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:53:59.905+0000 7f213d20f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.249 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:53:59.905+0000 7f213d20f800 1 librados: init done 2024-09-12T00:54:00.249 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:53:59.907+0000 7f202560a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:00.249 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:53:59.907+0000 7f202560a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:00.249 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:53:59.907+0000 7f202560a640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:00.249 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:53:59.907+0000 7f2138922640 10 monclient: get_auth_request con 0x7f2020076470 auth_method 0 2024-09-12T00:54:00.249 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:53:59.908+0000 7f2139123640 10 monclient: get_auth_request con 0x5613e36deee0 auth_method 0 2024-09-12T00:54:00.249 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:53:59.908+0000 7f2138922640 10 monclient: get_auth_request con 0x5613e36ea600 auth_method 0 2024-09-12T00:54:00.249 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:53:59.909+0000 7f2138121640 10 monclient: get_auth_request con 0x5613e36eea30 auth_method 0 2024-09-12T00:54:00.249 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:53:59.910+0000 7f213d20f800 10 monclient: build_initial_monmap 2024-09-12T00:54:00.249 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:53:59.910+0000 7f213d20f800 1 build_initial for_mkfs: 0 2024-09-12T00:54:00.250 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:53:59.910+0000 7f213d20f800 10 monclient: monmap: 2024-09-12T00:54:00.250 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:00.250 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:00.250 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:00.250 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:00.250 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:00.250 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.250 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:00.250 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:00.250 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:00.250 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.250 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding auth protocol: cephx 2024-09-12T00:54:00.250 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding auth protocol: cephx 2024-09-12T00:54:00.250 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding auth protocol: cephx 2024-09-12T00:54:00.251 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: secure 2024-09-12T00:54:00.251 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: crc 2024-09-12T00:54:00.251 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: secure 2024-09-12T00:54:00.251 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: crc 2024-09-12T00:54:00.251 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: secure 2024-09-12T00:54:00.251 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: crc 2024-09-12T00:54:00.251 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: crc 2024-09-12T00:54:00.251 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: secure 2024-09-12T00:54:00.251 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: crc 2024-09-12T00:54:00.251 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: secure 2024-09-12T00:54:00.251 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: crc 2024-09-12T00:54:00.251 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:53:59.910+0000 7f213d20f800 5 AuthRegistry(0x5613e36f39c0) adding con mode: secure 2024-09-12T00:54:00.251 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:53:59.910+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.251 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 asok(0x5613e347e630) register_command objecter_requests cmddesc objecter_requests hook 0x5613e36f6e80 EEXIST 2024-09-12T00:54:00.252 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient: init 2024-09-12T00:54:00.252 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding auth protocol: cephx 2024-09-12T00:54:00.252 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding auth protocol: cephx 2024-09-12T00:54:00.252 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding auth protocol: cephx 2024-09-12T00:54:00.252 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: secure 2024-09-12T00:54:00.252 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: crc 2024-09-12T00:54:00.252 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: secure 2024-09-12T00:54:00.252 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: crc 2024-09-12T00:54:00.252 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: secure 2024-09-12T00:54:00.252 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: crc 2024-09-12T00:54:00.252 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: crc 2024-09-12T00:54:00.252 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: secure 2024-09-12T00:54:00.253 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: crc 2024-09-12T00:54:00.253 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: secure 2024-09-12T00:54:00.253 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: crc 2024-09-12T00:54:00.253 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 AuthRegistry(0x5613e36f1fc8) adding con mode: secure 2024-09-12T00:54:00.253 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:53:59.911+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.253 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:53:59.911+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.253 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:53:59.911+0000 7f213d20f800 5 asok(0x5613e347e630) register_command rotate-key cmddesc rotate-key hook 0x5613e36f2110 EEXIST 2024-09-12T00:54:00.253 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:00.253 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:54:00.253 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-c con 0x5613e371b1a0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:00.253 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-a con 0x5613e371b580 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:00.253 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-b con 0x5613e3719eb0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:00.253 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.253 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.254 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.254 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:00.254 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:53:59.911+0000 7f213d20f800 10 monclient(hunting): authenticate will time out at 2126.404789s 2024-09-12T00:54:00.254 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:53:59.911+0000 7f2138121640 10 monclient(hunting): get_auth_request con 0x5613e371b580 auth_method 0 2024-09-12T00:54:00.254 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:53:59.911+0000 7f2138121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.254 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:53:59.911+0000 7f2138121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.254 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:53:59.911+0000 7f2138121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.254 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:53:59.911+0000 7f2138922640 10 monclient(hunting): get_auth_request con 0x5613e371b1a0 auth_method 0 2024-09-12T00:54:00.254 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:53:59.911+0000 7f2138922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.254 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:53:59.911+0000 7f2138922640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.254 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:53:59.911+0000 7f2138922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.254 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:53:59.911+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.255 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:53:59.911+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.255 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:53:59.912+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.255 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:53:59.912+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.255 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:53:59.912+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.255 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:53:59.912+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.255 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:53:59.912+0000 7f2139123640 10 monclient(hunting): get_auth_request con 0x5613e3719eb0 auth_method 0 2024-09-12T00:54:00.255 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:53:59.912+0000 7f2139123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.255 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:53:59.912+0000 7f2139123640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.255 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:53:59.912+0000 7f2139123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.255 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:53:59.912+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.255 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:53:59.912+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.255 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:53:59.912+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.255 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:53:59.912+0000 7f2138922640 10 monclient(hunting): handle_auth_done global_id 7316 payload 824 2024-09-12T00:54:00.255 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:53:59.912+0000 7f2138922640 10 monclient: _finish_hunting 0 2024-09-12T00:54:00.256 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:53:59.912+0000 7f2138922640 1 monclient: found mon.noname-c 2024-09-12T00:54:00.256 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:53:59.912+0000 7f2138922640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:54:00.256 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.256 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:00.256 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: dump: 2024-09-12T00:54:00.256 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.256 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.256 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.256 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.256 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.256 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.256 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.256 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.257 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.257 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.257 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:54:00.257 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:54:00.257 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:00.257 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.257 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:00.257 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:53:59.912+0000 7f201e7fc640 10 monclient: dump: 2024-09-12T00:54:00.257 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.257 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.257 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.257 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.257 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.258 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.258 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.258 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.258 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.258 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.258 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:53:59.912+0000 7f213d20f800 5 monclient: authenticate success, global_id 7316 2024-09-12T00:54:00.258 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:53:59.912+0000 7f213d20f800 10 monclient: _renew_subs 2024-09-12T00:54:00.258 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:53:59.912+0000 7f2139924640 4 set_mon_vals no callback set 2024-09-12T00:54:00.258 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:53:59.912+0000 7f213d20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:54:00.258 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:53:59.912+0000 7f213d20f800 10 monclient: _renew_subs 2024-09-12T00:54:00.258 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:53:59.912+0000 7f213d20f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:54:00.258 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:53:59.914+0000 7f201e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:00.258 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:53:59.914+0000 7f201e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:00.258 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:53:59.914+0000 7f201e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:00.259 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:53:59.914+0000 7f2138121640 10 monclient: get_auth_request con 0x7f2010076380 auth_method 0 2024-09-12T00:54:00.259 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:53:59.914+0000 7f213d20f800 10 monclient: get_monmap_and_config 2024-09-12T00:54:00.259 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:53:59.914+0000 7f213d20f800 10 monclient: build_initial_monmap 2024-09-12T00:54:00.259 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:53:59.914+0000 7f213d20f800 1 build_initial for_mkfs: 0 2024-09-12T00:54:00.259 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:53:59.914+0000 7f213d20f800 10 monclient: monmap: 2024-09-12T00:54:00.259 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:00.259 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:00.259 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:00.259 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:00.259 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:00.259 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.259 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:00.260 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:00.260 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:00.260 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.260 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding auth protocol: cephx 2024-09-12T00:54:00.260 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding auth protocol: cephx 2024-09-12T00:54:00.260 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding auth protocol: cephx 2024-09-12T00:54:00.260 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: secure 2024-09-12T00:54:00.260 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: crc 2024-09-12T00:54:00.260 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: secure 2024-09-12T00:54:00.260 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: crc 2024-09-12T00:54:00.260 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: secure 2024-09-12T00:54:00.260 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: crc 2024-09-12T00:54:00.260 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: crc 2024-09-12T00:54:00.260 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: secure 2024-09-12T00:54:00.261 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: crc 2024-09-12T00:54:00.261 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: secure 2024-09-12T00:54:00.261 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: crc 2024-09-12T00:54:00.261 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:53:59.914+0000 7f213d20f800 5 AuthRegistry(0x5613e373aff0) adding con mode: secure 2024-09-12T00:54:00.261 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:53:59.915+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.261 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient: init 2024-09-12T00:54:00.261 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding auth protocol: cephx 2024-09-12T00:54:00.261 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding auth protocol: cephx 2024-09-12T00:54:00.261 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding auth protocol: cephx 2024-09-12T00:54:00.261 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: secure 2024-09-12T00:54:00.261 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: crc 2024-09-12T00:54:00.261 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: secure 2024-09-12T00:54:00.262 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: crc 2024-09-12T00:54:00.262 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: secure 2024-09-12T00:54:00.262 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: crc 2024-09-12T00:54:00.262 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: crc 2024-09-12T00:54:00.262 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: secure 2024-09-12T00:54:00.262 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: crc 2024-09-12T00:54:00.262 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: secure 2024-09-12T00:54:00.262 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: crc 2024-09-12T00:54:00.262 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 AuthRegistry(0x7ffd01469010) adding con mode: secure 2024-09-12T00:54:00.262 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:53:59.915+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.262 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:53:59.915+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.262 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:53:59.915+0000 7f213d20f800 5 asok(0x5613e347e630) register_command rotate-key cmddesc rotate-key hook 0x7ffd01469158 EEXIST 2024-09-12T00:54:00.262 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:00.263 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:54:00.263 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-b con 0x5613e376f570 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:00.263 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-a con 0x5613e373f3a0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:00.263 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-c con 0x5613e376aee0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:00.263 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.263 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.263 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.263 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:00.263 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:53:59.915+0000 7f213d20f800 10 monclient(hunting): authenticate will time out at 2126.408919s 2024-09-12T00:54:00.263 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:53:59.916+0000 7f2139123640 10 monclient(hunting): get_auth_request con 0x5613e376aee0 auth_method 0 2024-09-12T00:54:00.263 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:53:59.916+0000 7f2139123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.263 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:53:59.916+0000 7f2139123640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.263 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:53:59.916+0000 7f2139123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.264 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): get_auth_request con 0x5613e373f3a0 auth_method 0 2024-09-12T00:54:00.264 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.264 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.264 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.264 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:53:59.916+0000 7f2138922640 10 monclient(hunting): get_auth_request con 0x5613e376f570 auth_method 0 2024-09-12T00:54:00.264 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:53:59.916+0000 7f2138922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.264 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:53:59.916+0000 7f2138922640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.264 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:53:59.916+0000 7f2138922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.264 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.264 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.264 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.264 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:53:59.916+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.264 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:53:59.916+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.265 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:53:59.916+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.265 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:53:59.916+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.265 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:53:59.916+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.265 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:53:59.916+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.265 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient(hunting): handle_auth_done global_id 7752 payload 274 2024-09-12T00:54:00.265 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient: _finish_hunting 0 2024-09-12T00:54:00.265 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:53:59.916+0000 7f2138121640 1 monclient: found mon.noname-a 2024-09-12T00:54:00.265 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:53:59.916+0000 7f2138121640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.265 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.265 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:00.265 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: dump: 2024-09-12T00:54:00.265 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.265 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.266 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.266 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.266 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.266 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.266 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.266 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.266 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.266 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.266 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: _finish_auth 0 2024-09-12T00:54:00.266 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:54:00.267 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:00.267 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:53:59.916+0000 7f213d20f800 5 monclient: authenticate success, global_id 7752 2024-09-12T00:54:00.267 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:53:59.916+0000 7f213d20f800 10 monclient: get_monmap_and_config success 2024-09-12T00:54:00.267 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:53:59.916+0000 7f213d20f800 4 set_mon_vals no callback set 2024-09-12T00:54:00.267 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.267 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:00.267 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:53:59.916+0000 7f200ffff640 10 monclient: dump: 2024-09-12T00:54:00.267 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.267 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.267 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.267 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.267 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.268 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.268 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.268 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.268 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.268 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.268 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:53:59.917+0000 7f213d20f800 10 monclient: shutdown 2024-09-12T00:54:00.268 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:53:59.917+0000 7f213d20f800 10 monclient: build_initial_monmap 2024-09-12T00:54:00.268 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:53:59.917+0000 7f213d20f800 1 build_initial for_mkfs: 0 2024-09-12T00:54:00.268 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:53:59.917+0000 7f213d20f800 10 monclient: monmap: 2024-09-12T00:54:00.268 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:00.268 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:00.268 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:00.268 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:00.269 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:00.269 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.269 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:00.269 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:00.269 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:00.269 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.269 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding auth protocol: cephx 2024-09-12T00:54:00.269 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding auth protocol: cephx 2024-09-12T00:54:00.269 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding auth protocol: cephx 2024-09-12T00:54:00.269 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: secure 2024-09-12T00:54:00.269 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: crc 2024-09-12T00:54:00.269 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: secure 2024-09-12T00:54:00.270 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: crc 2024-09-12T00:54:00.270 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: secure 2024-09-12T00:54:00.270 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: crc 2024-09-12T00:54:00.270 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: crc 2024-09-12T00:54:00.270 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: secure 2024-09-12T00:54:00.270 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: crc 2024-09-12T00:54:00.270 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: secure 2024-09-12T00:54:00.270 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: crc 2024-09-12T00:54:00.270 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e3761bf0) adding con mode: secure 2024-09-12T00:54:00.270 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:53:59.917+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.270 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:53:59.917+0000 7f213d20f800 1 librados: starting msgr at 2024-09-12T00:54:00.270 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:53:59.917+0000 7f213d20f800 1 librados: starting objecter 2024-09-12T00:54:00.270 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 asok(0x5613e347e630) register_command objecter_requests cmddesc objecter_requests hook 0x5613e37195e0 EEXIST 2024-09-12T00:54:00.271 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:53:59.917+0000 7f213d20f800 1 librados: setting wanted keys 2024-09-12T00:54:00.271 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:53:59.917+0000 7f213d20f800 1 librados: calling monclient init 2024-09-12T00:54:00.271 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:53:59.917+0000 7f213d20f800 10 monclient: init 2024-09-12T00:54:00.271 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding auth protocol: cephx 2024-09-12T00:54:00.271 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding auth protocol: cephx 2024-09-12T00:54:00.271 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding auth protocol: cephx 2024-09-12T00:54:00.271 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: secure 2024-09-12T00:54:00.271 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: crc 2024-09-12T00:54:00.271 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: secure 2024-09-12T00:54:00.271 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: crc 2024-09-12T00:54:00.271 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: secure 2024-09-12T00:54:00.271 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: crc 2024-09-12T00:54:00.271 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: crc 2024-09-12T00:54:00.272 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: secure 2024-09-12T00:54:00.272 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: crc 2024-09-12T00:54:00.272 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: secure 2024-09-12T00:54:00.272 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: crc 2024-09-12T00:54:00.272 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:53:59.917+0000 7f213d20f800 5 AuthRegistry(0x5613e372fa60) adding con mode: secure 2024-09-12T00:54:00.272 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:53:59.918+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.272 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:53:59.918+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.272 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:53:59.918+0000 7f213d20f800 5 asok(0x5613e347e630) register_command rotate-key cmddesc rotate-key hook 0x5613e372fba8 EEXIST 2024-09-12T00:54:00.272 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:00.272 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:54:00.272 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-a con 0x5613e373f3a0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:00.272 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-b con 0x5613e376aee0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:00.273 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): picked mon.noname-c con 0x5613e376f570 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:00.273 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.273 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.273 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:00.273 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:00.273 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient(hunting): authenticate will time out at 2126.411339s 2024-09-12T00:54:00.273 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): get_auth_request con 0x5613e373f3a0 auth_method 0 2024-09-12T00:54:00.273 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.273 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.273 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.273 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:53:59.918+0000 7f2139123640 10 monclient(hunting): get_auth_request con 0x5613e376f570 auth_method 0 2024-09-12T00:54:00.273 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:53:59.918+0000 7f2139123640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.273 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:53:59.918+0000 7f2139123640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.274 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:53:59.918+0000 7f2139123640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.274 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.274 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.274 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.274 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:53:59.918+0000 7f2138121640 10 monclient(hunting): get_auth_request con 0x5613e376aee0 auth_method 0 2024-09-12T00:54:00.274 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:53:59.918+0000 7f2138121640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:00.274 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:53:59.918+0000 7f2138121640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:00.274 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:53:59.918+0000 7f2138121640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:00.274 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:53:59.918+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.274 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:53:59.918+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.274 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:53:59.918+0000 7f2139123640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.274 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:53:59.918+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:00.274 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:53:59.918+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:00.275 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:53:59.918+0000 7f2138121640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:00.275 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient(hunting): handle_auth_done global_id 7755 payload 824 2024-09-12T00:54:00.275 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient: _finish_hunting 0 2024-09-12T00:54:00.275 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:53:59.918+0000 7f2138922640 1 monclient: found mon.noname-a 2024-09-12T00:54:00.275 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:53:59.918+0000 7f2138922640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.275 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.275 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:00.275 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: dump: 2024-09-12T00:54:00.275 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.275 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.275 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.275 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.275 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.276 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.276 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.276 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.276 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.276 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.276 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: _finish_auth 0 2024-09-12T00:54:00.276 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:54:00.276 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:00.276 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:00.276 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:00.276 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:53:59.918+0000 7f200e7fc640 10 monclient: dump: 2024-09-12T00:54:00.276 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:00.277 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:00.277 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.277 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:00.277 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:00.277 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:00.277 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:00.277 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:00.277 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:00.277 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.277 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:53:59.918+0000 7f213d20f800 5 monclient: authenticate success, global_id 7755 2024-09-12T00:54:00.277 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:53:59.918+0000 7f213d20f800 10 monclient: _renew_subs 2024-09-12T00:54:00.278 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:53:59.918+0000 7f200ffff640 4 set_mon_vals no callback set 2024-09-12T00:54:00.278 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:53:59.919+0000 7f213d20f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.278 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:53:59.919+0000 7f213d20f800 10 monclient: _renew_subs 2024-09-12T00:54:00.278 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:53:59.919+0000 7f213d20f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.278 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:53:59.919+0000 7f213d20f800 1 librados: init done 2024-09-12T00:54:00.278 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:53:59.919+0000 7f213d20f800 5 asok(0x5613e347e630) register_command cr dump hook 0x5613e375e4d8 2024-09-12T00:54:00.278 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:53:59.920+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.278 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:53:59.921+0000 7f200e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:00.278 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:53:59.921+0000 7f200e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:00.278 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:53:59.921+0000 7f200e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:00.278 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:53:59.921+0000 7f2138121640 10 monclient: get_auth_request con 0x7f20040764a0 auth_method 0 2024-09-12T00:54:00.278 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:53:59.922+0000 7f2139123640 10 monclient: get_auth_request con 0x5613e3789b00 auth_method 0 2024-09-12T00:54:00.278 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.279 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:53:59.922+0000 7f213d20f800 20 realm 2024-09-12T00:54:00.279 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.279 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.279 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:53:59.922+0000 7f213d20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:00.279 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.279 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.279 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:53:59.922+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.279 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:53:59.923+0000 7f2138922640 10 monclient: get_auth_request con 0x5613e378dd50 auth_method 0 2024-09-12T00:54:00.279 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:53:59.923+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:00.279 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:53:59.923+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.279 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:53:59.923+0000 7f2138121640 10 monclient: get_auth_request con 0x5613e37915b0 auth_method 0 2024-09-12T00:54:00.279 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:53:59.924+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:00.279 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:53:59.924+0000 7f213d20f800 20 searching for the correct realm 2024-09-12T00:54:00.280 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:53:59.924+0000 7f2139123640 10 monclient: get_auth_request con 0x5613e3796370 auth_method 0 2024-09-12T00:54:00.280 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:53:59.925+0000 7f2138922640 10 monclient: get_auth_request con 0x7f2130025040 auth_method 0 2024-09-12T00:54:00.280 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:53:59.927+0000 7f2138121640 10 monclient: get_auth_request con 0x7f2130036420 auth_method 0 2024-09-12T00:54:00.280 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:53:59.927+0000 7f2138121640 0 -- 172.21.15.62:0/3859591846 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f2130036420 msgr2=0x7f21300368a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:00.280 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:54:00.128+0000 7f2138121640 10 monclient: get_auth_request con 0x7f2130036420 auth_method 0 2024-09-12T00:54:00.280 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:54:00.130+0000 7f2139123640 10 monclient: get_auth_request con 0x7f2128023690 auth_method 0 2024-09-12T00:54:00.280 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:54:00.131+0000 7f2138922640 10 monclient: get_auth_request con 0x7f2130011380 auth_method 0 2024-09-12T00:54:00.280 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:54:00.132+0000 7f2139123640 0 -- 172.21.15.62:0/3859591846 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5613e3789b00 msgr2=0x5613e378bf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:00.280 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:54:00.132+0000 7f200e7fc640 1 client.7755.objecter ms_handle_reset 0x5613e3789b00 session 0x5613e37893f0 osd.6 2024-09-12T00:54:00.280 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:54:00.132+0000 7f200e7fc640 10 monclient: _renew_subs 2024-09-12T00:54:00.280 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:54:00.132+0000 7f200e7fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:00.280 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:54:00.133+0000 7f2139123640 10 monclient: get_auth_request con 0x7f2004086750 auth_method 0 2024-09-12T00:54:00.280 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:00.281 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:00.281 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:00.281 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:00.281 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:00.281 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:54:00.136+0000 7f213d20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:00.281 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.281 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.281 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.281 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:00.281 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.281 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:00.281 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 zone default found 2024-09-12T00:54:00.282 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:54:00.137+0000 7f213d20f800 4 Realm: () 2024-09-12T00:54:00.282 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:54:00.137+0000 7f213d20f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:00.282 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:54:00.137+0000 7f213d20f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:00.282 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:54:00.137+0000 7f213d20f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:00.282 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 zonegroup default 2024-09-12T00:54:00.282 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:54:00.137+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.282 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:54:00.138+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.282 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:54:00.138+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.282 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:54:00.138+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.282 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:54:00.138+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.282 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:54:00.138+0000 7f213d20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.282 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:54:00.138+0000 7f213d20f800 20 started sync module instance, tier type = 2024-09-12T00:54:00.282 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:54:00.138+0000 7f213d20f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:00.282 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=0 2024-09-12T00:54:00.283 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=1 2024-09-12T00:54:00.283 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=2 2024-09-12T00:54:00.283 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=3 2024-09-12T00:54:00.283 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=4 2024-09-12T00:54:00.283 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=5 2024-09-12T00:54:00.283 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:54:00.147+0000 7f213d20f800 20 add_watcher() i=6 2024-09-12T00:54:00.283 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:54:00.148+0000 7f213d20f800 20 add_watcher() i=7 2024-09-12T00:54:00.283 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:54:00.148+0000 7f213d20f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:00.283 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding auth protocol: cephx 2024-09-12T00:54:00.283 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding auth protocol: cephx 2024-09-12T00:54:00.283 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding auth protocol: cephx 2024-09-12T00:54:00.283 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: secure 2024-09-12T00:54:00.283 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: crc 2024-09-12T00:54:00.284 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: secure 2024-09-12T00:54:00.284 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: crc 2024-09-12T00:54:00.284 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: secure 2024-09-12T00:54:00.284 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: crc 2024-09-12T00:54:00.284 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: crc 2024-09-12T00:54:00.284 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: secure 2024-09-12T00:54:00.284 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: crc 2024-09-12T00:54:00.284 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: secure 2024-09-12T00:54:00.284 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: crc 2024-09-12T00:54:00.284 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 AuthRegistry(0x7ffd014694f0) adding con mode: secure 2024-09-12T00:54:00.284 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:54:00.150+0000 7f1fef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:00.284 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:54:00.150+0000 7f213d20f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:00.284 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:54:00.150+0000 7f213d20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:00.285 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:54:00.150+0000 7f213d20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:00.285 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 asok(0x5613e347e630) register_command cache list hook 0x5613e3760dc0 2024-09-12T00:54:00.285 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 asok(0x5613e347e630) register_command cache inspect hook 0x5613e3760dc0 2024-09-12T00:54:00.285 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 asok(0x5613e347e630) register_command cache erase hook 0x5613e3760dc0 2024-09-12T00:54:00.285 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 asok(0x5613e347e630) register_command cache zap hook 0x5613e3760dc0 2024-09-12T00:54:00.285 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:54:00.150+0000 7f213d20f800 5 note: GC not initialized 2024-09-12T00:54:00.285 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:54:00.151+0000 7f1fee7e4640 20 reqs_thread_entry: start 2024-09-12T00:54:00.285 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:54:00.151+0000 7f213d20f800 5 asok(0x5613e347e630) register_command sync trace show hook 0x7f21280044f0 2024-09-12T00:54:00.285 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:54:00.151+0000 7f213d20f800 5 asok(0x5613e347e630) register_command sync trace history hook 0x7f21280044f0 2024-09-12T00:54:00.285 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:54:00.151+0000 7f213d20f800 5 asok(0x5613e347e630) register_command sync trace active hook 0x7f21280044f0 2024-09-12T00:54:00.285 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:54:00.151+0000 7f213d20f800 5 asok(0x5613e347e630) register_command sync trace active_short hook 0x7f21280044f0 2024-09-12T00:54:00.285 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:54:00.151+0000 7f213d20f800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:00.285 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:54:00.151+0000 7f213d20f800 20 Filter name: none 2024-09-12T00:54:00.285 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:54:00.151+0000 7f1fe7fff640 20 reqs_thread_entry: start 2024-09-12T00:54:00.286 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:54:00.151+0000 7f213d20f800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:54:00.286 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:54:00.151+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.286 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:54:00.151+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:54:00.286 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:54:00.151+0000 7f213d20f800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:54:00.286 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:54:00.151+0000 7f213d20f800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:54:00.286 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:54:00.151+0000 7f213d20f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 : miss 2024-09-12T00:54:00.286 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:54:00.151+0000 7f213d20f800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.286 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:54:00.152+0000 7f213d20f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:54:00.286 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:54:00.152+0000 7f213d20f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:00.286 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:54:00.152+0000 7f213d20f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:00.286 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:54:00.152+0000 7f213d20f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:00.286 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:54:00.152+0000 7f213d20f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:00.286 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:54:00.152+0000 7f213d20f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 2024-09-12T00:54:00.287 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:54:00.156+0000 7f213d20f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:00.287 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:54:00.156+0000 7f213d20f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:00.287 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:54:00.156+0000 7f213d20f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:00.287 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:54:00.156+0000 7f213d20f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36, ofs0, ns] 2024-09-12T00:54:00.287 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:54:00.156+0000 7f200ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431585 cookie 94643420706128 notifier 7755 bl.length()=923 2024-09-12T00:54:00.287 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:54:00.156+0000 7f200ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:00.287 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:54:00.156+0000 7f200ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:00.287 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:54:00.156+0000 7f200ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:00.287 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:54:00.158+0000 7f213d20f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): orig_sources= new_sources= 2024-09-12T00:54:00.287 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:54:00.158+0000 7f213d20f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): potential sources added=[] removed=[] 2024-09-12T00:54:00.287 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:54:00.158+0000 7f213d20f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): orig_dests= new_dests= 2024-09-12T00:54:00.287 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:54:00.158+0000 7f213d20f800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): potential dests added=[] removed=[] 2024-09-12T00:54:00.287 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:54:00.160+0000 7f213d20f800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f213d20f800 time 2024-09-12T00:54:00.160643+0000 2024-09-12T00:54:00.288 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:00.288 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.288 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:00.288 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f213e38c71a] 2024-09-12T00:54:00.288 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f213e38c8d8] 2024-09-12T00:54:00.288 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613e2171641] 2024-09-12T00:54:00.288 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd8854c) [0x5613e268454c] 2024-09-12T00:54:00.288 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5613e218131d] 2024-09-12T00:54:00.288 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:54:00.288 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f213d029590] 2024-09-12T00:54:00.288 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:54:00.288 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:54:00.288 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.289 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:54:00.161+0000 7f213d20f800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:00.289 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f213d20f800 thread_name:radosgw-admin 2024-09-12T00:54:00.289 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.289 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:00.289 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f213d03e6f0] 2024-09-12T00:54:00.289 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f213d08b99c] 2024-09-12T00:54:00.289 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:54:00.289 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:54:00.289 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f213e38c774] 2024-09-12T00:54:00.289 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f213e38c8d8] 2024-09-12T00:54:00.289 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5613e2171641] 2024-09-12T00:54:00.289 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd8854c) [0x5613e268454c] 2024-09-12T00:54:00.290 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5613e218131d] 2024-09-12T00:54:00.290 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:54:00.290 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f213d029590] 2024-09-12T00:54:00.290 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:54:00.290 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:54:00.290 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:00.290 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.290 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:54:00.290 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:54:00.290 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:54:00.290 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:54:00.290 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:54:00.290 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:54:00.290 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:54:00.291 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:54:00.291 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:54:00.291 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:54:00.291 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:54:00.291 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:54:00.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:54:00.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:54:00.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:54:00.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:54:00.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:54:00.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:54:00.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:54:00.291 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:54:00.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:54:00.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:54:00.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:54:00.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:54:00.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:54:00.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:54:00.292 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:54:00.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:54:00.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:54:00.292 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:54:00.292 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:54:00.292 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:54:00.292 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:54:00.293 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:54:00.293 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:54:00.293 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:54:00.293 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:54:00.293 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:54:00.293 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:54:00.293 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:54:00.293 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:54:00.293 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:54:00.293 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:54:00.293 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:54:00.293 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:54:00.293 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:54:00.293 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:54:00.294 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:54:00.294 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:54:00.294 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:54:00.294 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:54:00.294 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:54:00.294 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:54:00.294 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:54:00.294 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:54:00.294 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:54:00.294 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:54:00.294 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:54:00.294 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:54:00.294 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:54:00.295 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:54:00.295 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:54:00.295 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:54:00.295 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:54:00.295 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:54:00.295 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:54:00.295 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:54:00.295 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:54:00.295 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:54:00.295 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:54:00.295 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:54:00.295 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:54:00.295 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:54:00.296 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:54:00.296 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:54:00.296 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:54:00.296 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:54:00.296 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:54:00.296 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:54:00.296 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:54:00.296 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:54:00.296 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:54:00.296 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:54:00.296 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:54:00.296 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:54:00.296 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:54:00.297 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:54:00.297 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:54:00.297 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:54:00.297 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:54:00.297 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:54:00.297 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:54:00.297 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:54:00.297 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:54:00.297 INFO:tasks.workunit.client.0.smithi062.stderr: 7f1fe7fff640 / http_manager 2024-09-12T00:54:00.297 INFO:tasks.workunit.client.0.smithi062.stderr: 7f1fee7e4640 / http_manager 2024-09-12T00:54:00.297 INFO:tasks.workunit.client.0.smithi062.stderr: 7f1fef7e6640 / rgw_dt_lg_renew 2024-09-12T00:54:00.297 INFO:tasks.workunit.client.0.smithi062.stderr: 7f200e7fc640 / ms_dispatch 2024-09-12T00:54:00.297 INFO:tasks.workunit.client.0.smithi062.stderr: 7f200ffff640 / io_context_pool 2024-09-12T00:54:00.298 INFO:tasks.workunit.client.0.smithi062.stderr: 7f201e7fc640 / ms_dispatch 2024-09-12T00:54:00.298 INFO:tasks.workunit.client.0.smithi062.stderr: 7f202560a640 / ms_dispatch 2024-09-12T00:54:00.298 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2026e0d640 / io_context_pool 2024-09-12T00:54:00.298 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2138121640 / msgr-worker-2 2024-09-12T00:54:00.298 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2138922640 / msgr-worker-1 2024-09-12T00:54:00.298 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2139123640 / msgr-worker-0 2024-09-12T00:54:00.298 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2139924640 / io_context_pool 2024-09-12T00:54:00.298 INFO:tasks.workunit.client.0.smithi062.stderr: 7f213d20f800 / radosgw-admin 2024-09-12T00:54:00.298 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:54:00.298 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:54:00.298 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:54:00.162465Z_bd1ca568-416f-44ef-a854-faa5aa5f6592/log 2024-09-12T00:54:00.298 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:54:00.299 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:54:00.303 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:00.304 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:00.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.240+0000 7fbc86723800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.242+0000 7fbc86723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.242+0000 7fbc86723800 20 realm 2024-09-12T00:54:00.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.242+0000 7fbc86723800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.242+0000 7fbc86723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.242+0000 7fbc86723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:00.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.242+0000 7fbc86723800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.242+0000 7fbc86723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.242+0000 7fbc86723800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.243+0000 7fbc86723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:00.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.243+0000 7fbc86723800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.243+0000 7fbc86723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:00.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.243+0000 7fbc86723800 20 searching for the correct realm 2024-09-12T00:54:00.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.247+0000 7fbc8240c640 0 -- 172.21.15.62:0/2732292198 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7fbc7c08a060 msgr2=0x7fbc7c0e0820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:00.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.250+0000 7fbc8240c640 0 -- 172.21.15.62:0/2732292198 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7fbc7c004040 msgr2=0x7fbc7c0e0820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:00.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.253+0000 7fbc86723800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:00.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.253+0000 7fbc86723800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:00.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.253+0000 7fbc86723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:00.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.253+0000 7fbc86723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:00.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.253+0000 7fbc86723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:00.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.253+0000 7fbc86723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:00.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.253+0000 7fbc86723800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.253+0000 7fbc86723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.253+0000 7fbc86723800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.254+0000 7fbc86723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:00.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.254+0000 7fbc86723800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.254+0000 7fbc86723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:00.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.254+0000 7fbc86723800 20 zone default found 2024-09-12T00:54:00.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.254+0000 7fbc86723800 4 Realm: () 2024-09-12T00:54:00.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.254+0000 7fbc86723800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:00.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.254+0000 7fbc86723800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:00.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.254+0000 7fbc86723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:00.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.254+0000 7fbc86723800 20 zonegroup default 2024-09-12T00:54:00.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.254+0000 7fbc86723800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.254+0000 7fbc86723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.254+0000 7fbc86723800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.255+0000 7fbc86723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.255+0000 7fbc86723800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.255+0000 7fbc86723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.255+0000 7fbc86723800 20 started sync module instance, tier type = 2024-09-12T00:54:00.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.255+0000 7fbc86723800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:00.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.263+0000 7fbc86723800 20 add_watcher() i=0 2024-09-12T00:54:00.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.263+0000 7fbc86723800 20 add_watcher() i=1 2024-09-12T00:54:00.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.263+0000 7fbc86723800 20 add_watcher() i=2 2024-09-12T00:54:00.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.263+0000 7fbc86723800 20 add_watcher() i=3 2024-09-12T00:54:00.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.263+0000 7fbc86723800 20 add_watcher() i=4 2024-09-12T00:54:00.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.263+0000 7fbc86723800 20 add_watcher() i=5 2024-09-12T00:54:00.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.263+0000 7fbc86723800 20 add_watcher() i=6 2024-09-12T00:54:00.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.264+0000 7fbc86723800 20 add_watcher() i=7 2024-09-12T00:54:00.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.264+0000 7fbc86723800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:00.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.266+0000 7fbb38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:00.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.266+0000 7fbc86723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:00.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.266+0000 7fbc86723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:00.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.266+0000 7fbc86723800 5 note: GC not initialized 2024-09-12T00:54:00.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.266+0000 7fbab37fe640 20 reqs_thread_entry: start 2024-09-12T00:54:00.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.266+0000 7fbc86723800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:00.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.266+0000 7fbc86723800 20 Filter name: none 2024-09-12T00:54:00.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.266+0000 7fbab17fa640 20 reqs_thread_entry: start 2024-09-12T00:54:00.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.266+0000 7fbc86723800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.267+0000 7fbc86723800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:54:00.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.267+0000 7fbc86723800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.267+0000 7fbc86723800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:54:00.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.267+0000 7fbc86723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:00.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.267+0000 7fbc86723800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.268+0000 7fbc86723800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:54:00.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.268+0000 7fbc86723800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.268+0000 7fbc86723800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:54:00.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.268+0000 7fbc86723800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:00.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.270+0000 7fbb38fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:00.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.272+0000 7fbc86723800 20 remove_watcher() i=0 2024-09-12T00:54:00.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.272+0000 7fbc86723800 2 removed watcher, disabling cache 2024-09-12T00:54:00.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.273+0000 7fbc86723800 20 remove_watcher() i=1 2024-09-12T00:54:00.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.274+0000 7fbc86723800 20 remove_watcher() i=2 2024-09-12T00:54:00.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.275+0000 7fbc86723800 20 remove_watcher() i=3 2024-09-12T00:54:00.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.276+0000 7fbc86723800 20 remove_watcher() i=4 2024-09-12T00:54:00.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.277+0000 7fbc86723800 20 remove_watcher() i=5 2024-09-12T00:54:00.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.278+0000 7fbc86723800 20 remove_watcher() i=6 2024-09-12T00:54:00.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.279+0000 7fbc86723800 20 remove_watcher() i=7 2024-09-12T00:54:00.310 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.310 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:54:00.310 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-logrecord-writes id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:00.310 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:00.382 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:54:00.414 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:00.414 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:00.453 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.454+0000 7fa37ef42800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.455 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.456+0000 7fa37ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.456+0000 7fa37ef42800 20 realm 2024-09-12T00:54:00.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.456+0000 7fa37ef42800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.456+0000 7fa37ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.456+0000 7fa37ef42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:00.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.456+0000 7fa37ef42800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.457+0000 7fa37ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.457+0000 7fa37ef42800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.457+0000 7fa37ef42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:00.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.457+0000 7fa37ef42800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.458+0000 7fa37ef42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:00.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.458+0000 7fa37ef42800 20 searching for the correct realm 2024-09-12T00:54:00.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.461+0000 7fa37a485640 0 -- 172.21.15.62:0/2852695194 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fa374061040 msgr2=0x7fa3740be940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:00.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.666+0000 7fa37a485640 0 -- 172.21.15.62:0/2852695194 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5613b5a94260 msgr2=0x5613b5a966f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:00.669 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.670+0000 7fa37ef42800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:00.669 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.670+0000 7fa37ef42800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:00.669 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.670+0000 7fa37ef42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:00.669 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.670+0000 7fa37ef42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:00.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.670+0000 7fa37ef42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:00.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.670+0000 7fa37ef42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:00.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.670+0000 7fa37ef42800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.670+0000 7fa37ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.670 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.670+0000 7fa37ef42800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.671+0000 7fa37ef42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:00.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.671+0000 7fa37ef42800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.671+0000 7fa37ef42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:00.671 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.671+0000 7fa37ef42800 20 zone default found 2024-09-12T00:54:00.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.671+0000 7fa37ef42800 4 Realm: () 2024-09-12T00:54:00.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.671+0000 7fa37ef42800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:00.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.671+0000 7fa37ef42800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:00.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.671+0000 7fa37ef42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:00.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.671+0000 7fa37ef42800 20 zonegroup default 2024-09-12T00:54:00.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.671+0000 7fa37ef42800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.671+0000 7fa37ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.671+0000 7fa37ef42800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.672+0000 7fa37ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.672 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.672+0000 7fa37ef42800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.672+0000 7fa37ef42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:00.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.672+0000 7fa37ef42800 20 started sync module instance, tier type = 2024-09-12T00:54:00.673 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.672+0000 7fa37ef42800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:00.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.681+0000 7fa37ef42800 20 add_watcher() i=0 2024-09-12T00:54:00.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.681+0000 7fa37ef42800 20 add_watcher() i=1 2024-09-12T00:54:00.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.681+0000 7fa37ef42800 20 add_watcher() i=2 2024-09-12T00:54:00.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.681+0000 7fa37ef42800 20 add_watcher() i=3 2024-09-12T00:54:00.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.681+0000 7fa37ef42800 20 add_watcher() i=4 2024-09-12T00:54:00.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.681+0000 7fa37ef42800 20 add_watcher() i=5 2024-09-12T00:54:00.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.681+0000 7fa37ef42800 20 add_watcher() i=6 2024-09-12T00:54:00.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.682+0000 7fa37ef42800 20 add_watcher() i=7 2024-09-12T00:54:00.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.682+0000 7fa37ef42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:00.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.684+0000 7fa2317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:00.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.684+0000 7fa37ef42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:00.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.684+0000 7fa37ef42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:00.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.684+0000 7fa37ef42800 5 note: GC not initialized 2024-09-12T00:54:00.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.684+0000 7fa1abfff640 20 reqs_thread_entry: start 2024-09-12T00:54:00.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.684+0000 7fa37ef42800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:00.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.684+0000 7fa37ef42800 20 Filter name: none 2024-09-12T00:54:00.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.685+0000 7fa1a9ffb640 20 reqs_thread_entry: start 2024-09-12T00:54:00.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.685+0000 7fa37ef42800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:54:00.684 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.685+0000 7fa37ef42800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.685+0000 7fa37ef42800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:54:00.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.685+0000 7fa37ef42800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:54:00.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.685+0000 7fa37ef42800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:54:00.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.685+0000 7fa37ef42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 : miss 2024-09-12T00:54:00.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.685+0000 7fa37ef42800 20 rados->read ofs=0 len=0 2024-09-12T00:54:00.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.685+0000 7fa37ef42800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:54:00.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.685+0000 7fa37ef42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:00.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.685+0000 7fa37ef42800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:00.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.685+0000 7fa37ef42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:00.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.685+0000 7fa37ef42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:00.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.685+0000 7fa37ef42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 2024-09-12T00:54:00.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.687+0000 7fa37ef42800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to be held by another RGW process; skipping for now 2024-09-12T00:54:00.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.687+0000 7fa2317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:00.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.689+0000 7fa37ef42800 20 remove_watcher() i=0 2024-09-12T00:54:00.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.689+0000 7fa37ef42800 2 removed watcher, disabling cache 2024-09-12T00:54:00.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.690+0000 7fa37ef42800 20 remove_watcher() i=1 2024-09-12T00:54:00.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.691+0000 7fa37ef42800 20 remove_watcher() i=2 2024-09-12T00:54:00.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.692+0000 7fa37ef42800 20 remove_watcher() i=3 2024-09-12T00:54:00.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.693+0000 7fa37ef42800 20 remove_watcher() i=4 2024-09-12T00:54:00.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.694+0000 7fa37ef42800 20 remove_watcher() i=5 2024-09-12T00:54:00.694 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.695+0000 7fa37ef42800 20 remove_watcher() i=6 2024-09-12T00:54:00.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:00.696+0000 7fa37ef42800 20 remove_watcher() i=7 2024-09-12T00:54:00.706 INFO:tasks.workunit.client.0.smithi062.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:54:30.733 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:54:30.794 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:30.795 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:30.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.815+0000 7fbbb3b39800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.817+0000 7fbbb3b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.817+0000 7fbbb3b39800 20 realm 2024-09-12T00:54:30.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.817+0000 7fbbb3b39800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.817+0000 7fbbb3b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.817+0000 7fbbb3b39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:30.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.817+0000 7fbbb3b39800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.818+0000 7fbbb3b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.818+0000 7fbbb3b39800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.819+0000 7fbbb3b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:30.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.819+0000 7fbbb3b39800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.819+0000 7fbbb3b39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:30.822 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.819+0000 7fbbb3b39800 20 searching for the correct realm 2024-09-12T00:54:30.823 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.823+0000 7fbbaefc6640 0 -- 172.21.15.62:0/2928734455 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fbba803f400 msgr2=0x7fbba803f880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:30.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.827+0000 7fbbaffc8640 0 -- 172.21.15.62:0/2928734455 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55fd3b1673c0 msgr2=0x55fd3b169850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:30.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.831+0000 7fbbb3b39800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:30.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.831+0000 7fbbb3b39800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:30.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.831+0000 7fbbb3b39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:30.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.831+0000 7fbbb3b39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:30.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.831+0000 7fbbb3b39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:30.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.831+0000 7fbbb3b39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:30.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.831+0000 7fbbb3b39800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.832+0000 7fbbb3b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.832+0000 7fbbb3b39800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.832+0000 7fbbb3b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:30.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.832+0000 7fbbb3b39800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.832+0000 7fbbb3b39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:30.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.832+0000 7fbbb3b39800 20 zone default found 2024-09-12T00:54:30.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.832+0000 7fbbb3b39800 4 Realm: () 2024-09-12T00:54:30.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.832+0000 7fbbb3b39800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:30.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.832+0000 7fbbb3b39800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:30.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.832+0000 7fbbb3b39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:30.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.832+0000 7fbbb3b39800 20 zonegroup default 2024-09-12T00:54:30.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.832+0000 7fbbb3b39800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.833+0000 7fbbb3b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.833+0000 7fbbb3b39800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.833+0000 7fbbb3b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.833+0000 7fbbb3b39800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.833+0000 7fbbb3b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.833+0000 7fbbb3b39800 20 started sync module instance, tier type = 2024-09-12T00:54:30.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.833+0000 7fbbb3b39800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:30.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.843+0000 7fbbb3b39800 20 add_watcher() i=0 2024-09-12T00:54:30.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.843+0000 7fbbb3b39800 20 add_watcher() i=1 2024-09-12T00:54:30.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.843+0000 7fbbb3b39800 20 add_watcher() i=2 2024-09-12T00:54:30.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.843+0000 7fbbb3b39800 20 add_watcher() i=3 2024-09-12T00:54:30.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.843+0000 7fbbb3b39800 20 add_watcher() i=4 2024-09-12T00:54:30.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.843+0000 7fbbb3b39800 20 add_watcher() i=5 2024-09-12T00:54:30.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.843+0000 7fbbb3b39800 20 add_watcher() i=6 2024-09-12T00:54:30.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.844+0000 7fbbb3b39800 20 add_watcher() i=7 2024-09-12T00:54:30.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.844+0000 7fbbb3b39800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:30.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.846+0000 7fba65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:30.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.847+0000 7fbbb3b39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:30.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.847+0000 7fbbb3b39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:30.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.847+0000 7fbbb3b39800 5 note: GC not initialized 2024-09-12T00:54:30.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.847+0000 7fba64fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:30.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.847+0000 7fbbb3b39800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:30.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.847+0000 7fbbb3b39800 20 Filter name: none 2024-09-12T00:54:30.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.847+0000 7fb9de7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:30.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.847+0000 7fbbb3b39800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:54:30.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.847+0000 7fbbb3b39800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.848+0000 7fbbb3b39800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:54:30.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.848+0000 7fbbb3b39800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:54:30.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.848+0000 7fbbb3b39800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:54:30.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.848+0000 7fbbb3b39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 : miss 2024-09-12T00:54:30.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.848+0000 7fbbb3b39800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.848+0000 7fbbb3b39800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:54:30.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.848+0000 7fbbb3b39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:30.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.848+0000 7fbbb3b39800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:30.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.848+0000 7fbbb3b39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:30.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.848+0000 7fbbb3b39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:30.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.848+0000 7fbbb3b39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 2024-09-12T00:54:30.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.850+0000 7fbbb3b39800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:54:30.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.854+0000 7fbbb3b39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:30.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.854+0000 7fbbb3b39800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:30.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.854+0000 7fbbb3b39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:30.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.854+0000 7fbbb3b39800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36, ofs0, ns] 2024-09-12T00:54:30.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.855+0000 7fba927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431586 cookie 94546106419904 notifier 7809 bl.length()=923 2024-09-12T00:54:30.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.855+0000 7fba927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:30.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.855+0000 7fba927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:30.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.855+0000 7fba927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:30.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.856+0000 7fbbb3b39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): orig_sources= new_sources= 2024-09-12T00:54:30.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.856+0000 7fbbb3b39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): potential sources added=[] removed=[] 2024-09-12T00:54:30.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.856+0000 7fbbb3b39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): orig_dests= new_dests= 2024-09-12T00:54:30.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.856+0000 7fbbb3b39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): potential dests added=[] removed=[] 2024-09-12T00:54:30.859 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.859+0000 7fbbb3b39800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36.2.0 2024-09-12T00:54:30.859 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.859+0000 7fbbb3b39800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36.2.0 2024-09-12T00:54:30.859 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.859+0000 7fbbb3b39800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36.2.1 2024-09-12T00:54:30.859 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.859+0000 7fbbb3b39800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36.2.1 2024-09-12T00:54:30.859 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.859+0000 7fbbb3b39800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36.0 2024-09-12T00:54:30.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.862+0000 7fbbb3b39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:30.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.862+0000 7fbbb3b39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 2024-09-12T00:54:30.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.863+0000 7fbbb3b39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:30.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.863+0000 7fbbb3b39800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:30.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.863+0000 7fbbb3b39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:30.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.863+0000 7fbbb3b39800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36, ofs0, ns] 2024-09-12T00:54:30.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.864+0000 7fba927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431587 cookie 94546106419904 notifier 7809 bl.length()=923 2024-09-12T00:54:30.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.864+0000 7fba927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:30.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.864+0000 7fba927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:30.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.864+0000 7fba927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:30.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.865+0000 7fbbb3b39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): orig_sources= new_sources= 2024-09-12T00:54:30.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.865+0000 7fbbb3b39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): potential sources added=[] removed=[] 2024-09-12T00:54:30.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.865+0000 7fbbb3b39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): orig_dests= new_dests= 2024-09-12T00:54:30.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.865+0000 7fbbb3b39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): potential dests added=[] removed=[] 2024-09-12T00:54:30.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.867+0000 7fbbb3b39800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36.0 2024-09-12T00:54:30.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.867+0000 7fbbb3b39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:30.867 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.867+0000 7fbbb3b39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 2024-09-12T00:54:30.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.868+0000 7fbbb3b39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:30.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.868+0000 7fbbb3b39800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:30.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.868+0000 7fbbb3b39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:30.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.868+0000 7fbbb3b39800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36, ofs0, ns] 2024-09-12T00:54:30.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.869+0000 7fba927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431588 cookie 94546106419904 notifier 7809 bl.length()=891 2024-09-12T00:54:30.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.869+0000 7fba927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 info.flags=0x17 2024-09-12T00:54:30.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.869+0000 7fba927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 to cache LRU end 2024-09-12T00:54:30.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.869+0000 7fba927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:30.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.870+0000 7fbbb3b39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): orig_sources= new_sources= 2024-09-12T00:54:30.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.870+0000 7fbbb3b39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): potential sources added=[] removed=[] 2024-09-12T00:54:30.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.870+0000 7fbbb3b39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): orig_dests= new_dests= 2024-09-12T00:54:30.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.870+0000 7fbbb3b39800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36]): potential dests added=[] removed=[] 2024-09-12T00:54:30.871 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.871+0000 7fbbb3b39800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-12T00:54:30.873 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.874+0000 7fba65fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:30.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.876+0000 7fbbb3b39800 20 remove_watcher() i=0 2024-09-12T00:54:30.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.876+0000 7fbbb3b39800 2 removed watcher, disabling cache 2024-09-12T00:54:30.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.877+0000 7fbbb3b39800 20 remove_watcher() i=1 2024-09-12T00:54:30.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.878+0000 7fbbb3b39800 20 remove_watcher() i=2 2024-09-12T00:54:30.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.879+0000 7fbbb3b39800 20 remove_watcher() i=3 2024-09-12T00:54:30.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.880+0000 7fbbb3b39800 20 remove_watcher() i=4 2024-09-12T00:54:30.881 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.881+0000 7fbbb3b39800 20 remove_watcher() i=5 2024-09-12T00:54:30.882 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.882+0000 7fbbb3b39800 20 remove_watcher() i=6 2024-09-12T00:54:30.883 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.884+0000 7fbbb3b39800 20 remove_watcher() i=7 2024-09-12T00:54:30.897 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:54:30.926 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:30.927 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:30.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.965+0000 7f777dd31800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.967+0000 7f777dd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.967+0000 7f777dd31800 20 realm 2024-09-12T00:54:30.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.967+0000 7f777dd31800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.967+0000 7f777dd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.967+0000 7f777dd31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:30.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.967+0000 7f777dd31800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.967+0000 7f777dd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.967 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.967+0000 7f777dd31800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.968+0000 7f777dd31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:30.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.968+0000 7f777dd31800 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.968+0000 7f777dd31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:30.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.968+0000 7f777dd31800 20 searching for the correct realm 2024-09-12T00:54:30.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:30.971+0000 7f7779275640 0 -- 172.21.15.62:0/417828294 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f7774014940 msgr2=0x7f7774033430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:31.176 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.176+0000 7f777a277640 0 -- 172.21.15.62:0/417828294 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x557f9393b420 msgr2=0x557f9393d8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:31.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.181+0000 7f777dd31800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:31.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.181+0000 7f777dd31800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:31.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.181+0000 7f777dd31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:31.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.181+0000 7f777dd31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:31.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.181+0000 7f777dd31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:31.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.181+0000 7f777dd31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:31.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.181+0000 7f777dd31800 20 rados->read ofs=0 len=0 2024-09-12T00:54:31.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.181+0000 7f777dd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:31.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.181+0000 7f777dd31800 20 rados->read ofs=0 len=0 2024-09-12T00:54:31.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.182+0000 7f777dd31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:31.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.182+0000 7f777dd31800 20 rados->read ofs=0 len=0 2024-09-12T00:54:31.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.182+0000 7f777dd31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:31.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.182+0000 7f777dd31800 20 zone default found 2024-09-12T00:54:31.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.182+0000 7f777dd31800 4 Realm: () 2024-09-12T00:54:31.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.182+0000 7f777dd31800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:31.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.182+0000 7f777dd31800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:31.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.182+0000 7f777dd31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:31.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.182+0000 7f777dd31800 20 zonegroup default 2024-09-12T00:54:31.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.182+0000 7f777dd31800 20 rados->read ofs=0 len=0 2024-09-12T00:54:31.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.182+0000 7f777dd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:31.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.182+0000 7f777dd31800 20 rados->read ofs=0 len=0 2024-09-12T00:54:31.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.183+0000 7f777dd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:31.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.183+0000 7f777dd31800 20 rados->read ofs=0 len=0 2024-09-12T00:54:31.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.183+0000 7f777dd31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:31.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.183+0000 7f777dd31800 20 started sync module instance, tier type = 2024-09-12T00:54:31.184 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.183+0000 7f777dd31800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:31.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.193+0000 7f777dd31800 20 add_watcher() i=0 2024-09-12T00:54:31.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.193+0000 7f777dd31800 20 add_watcher() i=1 2024-09-12T00:54:31.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.193+0000 7f777dd31800 20 add_watcher() i=2 2024-09-12T00:54:31.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.193+0000 7f777dd31800 20 add_watcher() i=3 2024-09-12T00:54:31.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.193+0000 7f777dd31800 20 add_watcher() i=4 2024-09-12T00:54:31.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.193+0000 7f777dd31800 20 add_watcher() i=5 2024-09-12T00:54:31.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.193+0000 7f777dd31800 20 add_watcher() i=6 2024-09-12T00:54:31.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.194+0000 7f777dd31800 20 add_watcher() i=7 2024-09-12T00:54:31.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.194+0000 7f777dd31800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:31.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.196+0000 7f76137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:31.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.197+0000 7f777dd31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:31.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.197+0000 7f777dd31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:31.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.197+0000 7f777dd31800 5 note: GC not initialized 2024-09-12T00:54:31.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.197+0000 7f76127fc640 20 reqs_thread_entry: start 2024-09-12T00:54:31.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.197+0000 7f777dd31800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:31.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.197+0000 7f777dd31800 20 Filter name: none 2024-09-12T00:54:31.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.197+0000 7f759bfff640 20 reqs_thread_entry: start 2024-09-12T00:54:31.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.197+0000 7f777dd31800 20 rados->read ofs=0 len=0 2024-09-12T00:54:31.199 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.198+0000 7f777dd31800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:54:31.199 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.198+0000 7f777dd31800 20 rados->read ofs=0 len=0 2024-09-12T00:54:31.199 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.198+0000 7f777dd31800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:54:31.199 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.198+0000 7f777dd31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:31.199 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.198+0000 7f777dd31800 20 rados->read ofs=0 len=0 2024-09-12T00:54:31.199 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.199+0000 7f777dd31800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:54:31.199 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.199+0000 7f777dd31800 20 rados->read ofs=0 len=0 2024-09-12T00:54:31.199 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.199+0000 7f777dd31800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:54:31.200 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.199+0000 7f777dd31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:31.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.201+0000 7f76137fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:31.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.203+0000 7f777dd31800 20 remove_watcher() i=0 2024-09-12T00:54:31.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.203+0000 7f777dd31800 2 removed watcher, disabling cache 2024-09-12T00:54:31.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.204+0000 7f777dd31800 20 remove_watcher() i=1 2024-09-12T00:54:31.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.205+0000 7f777dd31800 20 remove_watcher() i=2 2024-09-12T00:54:31.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.206+0000 7f777dd31800 20 remove_watcher() i=3 2024-09-12T00:54:31.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.207+0000 7f777dd31800 20 remove_watcher() i=4 2024-09-12T00:54:31.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.208+0000 7f777dd31800 20 remove_watcher() i=5 2024-09-12T00:54:31.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.210+0000 7f777dd31800 20 remove_watcher() i=6 2024-09-12T00:54:31.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:31.211+0000 7f777dd31800 20 remove_watcher() i=7 2024-09-12T00:54:31.221 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:31.221 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:54:31.222 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-logrecord-writes id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:54:31.222 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:31.527 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T00:54:31.527 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:32.388 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:54:32.417 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:32.417 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:32.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.457+0000 7ff8db72c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.459+0000 7ff8db72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:32.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.459+0000 7ff8db72c800 20 realm 2024-09-12T00:54:32.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.459+0000 7ff8db72c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.459+0000 7ff8db72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:32.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.459+0000 7ff8db72c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:32.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.459+0000 7ff8db72c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.459+0000 7ff8db72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:32.459 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.459+0000 7ff8db72c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.460+0000 7ff8db72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:32.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.460+0000 7ff8db72c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.460+0000 7ff8db72c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:32.460 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.460+0000 7ff8db72c800 20 searching for the correct realm 2024-09-12T00:54:32.461 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.461+0000 7ff8d7345640 0 -- 172.21.15.62:0/2279013263 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7ff8c0003b20 msgr2=0x7ff8d005f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:32.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.666+0000 7ff8d7b46640 0 -- 172.21.15.62:0/2279013263 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7ff8c802a900 msgr2=0x7ff8c8012a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:32.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.874+0000 7ff8db72c800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:32.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.874+0000 7ff8db72c800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:32.875 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.874+0000 7ff8db72c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:32.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.874+0000 7ff8db72c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:32.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.874+0000 7ff8db72c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:32.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.874+0000 7ff8db72c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:32.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.874+0000 7ff8db72c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.874+0000 7ff8db72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:32.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.874+0000 7ff8db72c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.875+0000 7ff8db72c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:32.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.875+0000 7ff8db72c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.876 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.875+0000 7ff8db72c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:32.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.875+0000 7ff8db72c800 20 zone default found 2024-09-12T00:54:32.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.875+0000 7ff8db72c800 4 Realm: () 2024-09-12T00:54:32.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.875+0000 7ff8db72c800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:32.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.875+0000 7ff8db72c800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:32.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.875+0000 7ff8db72c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:32.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.875+0000 7ff8db72c800 20 zonegroup default 2024-09-12T00:54:32.877 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.875+0000 7ff8db72c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.875+0000 7ff8db72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:32.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.876+0000 7ff8db72c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.876+0000 7ff8db72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:32.878 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.876+0000 7ff8db72c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.876+0000 7ff8db72c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:32.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.876+0000 7ff8db72c800 20 started sync module instance, tier type = 2024-09-12T00:54:32.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.876+0000 7ff8db72c800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:32.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.885+0000 7ff8db72c800 20 add_watcher() i=0 2024-09-12T00:54:32.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.885+0000 7ff8db72c800 20 add_watcher() i=1 2024-09-12T00:54:32.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.885+0000 7ff8db72c800 20 add_watcher() i=2 2024-09-12T00:54:32.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.885+0000 7ff8db72c800 20 add_watcher() i=3 2024-09-12T00:54:32.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.885+0000 7ff8db72c800 20 add_watcher() i=4 2024-09-12T00:54:32.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.885+0000 7ff8db72c800 20 add_watcher() i=5 2024-09-12T00:54:32.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.885+0000 7ff8db72c800 20 add_watcher() i=6 2024-09-12T00:54:32.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.886+0000 7ff8db72c800 20 add_watcher() i=7 2024-09-12T00:54:32.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.886+0000 7ff8db72c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:32.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.888+0000 7ff78dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:32.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.888+0000 7ff8db72c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:32.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.888+0000 7ff8db72c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:32.889 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.888+0000 7ff8db72c800 5 note: GC not initialized 2024-09-12T00:54:32.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.889+0000 7ff78cfe1640 20 reqs_thread_entry: start 2024-09-12T00:54:32.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.889+0000 7ff8db72c800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:32.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.889+0000 7ff8db72c800 20 Filter name: none 2024-09-12T00:54:32.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.889+0000 7ff7067fc640 20 reqs_thread_entry: start 2024-09-12T00:54:32.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.889+0000 7ff8db72c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.889+0000 7ff8db72c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:32.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.889+0000 7ff8db72c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.890+0000 7ff8db72c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:32.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.890+0000 7ff8db72c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:32.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.890+0000 7ff8db72c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.890+0000 7ff8db72c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:32.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.890+0000 7ff8db72c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.891+0000 7ff8db72c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:32.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.891+0000 7ff8db72c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:32.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.892+0000 7ff78dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:32.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.894+0000 7ff8db72c800 20 remove_watcher() i=0 2024-09-12T00:54:32.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.894+0000 7ff8db72c800 2 removed watcher, disabling cache 2024-09-12T00:54:32.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.895+0000 7ff8db72c800 20 remove_watcher() i=1 2024-09-12T00:54:32.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.896+0000 7ff8db72c800 20 remove_watcher() i=2 2024-09-12T00:54:32.897 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.897+0000 7ff8db72c800 20 remove_watcher() i=3 2024-09-12T00:54:32.898 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.898+0000 7ff8db72c800 20 remove_watcher() i=4 2024-09-12T00:54:32.899 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.899+0000 7ff8db72c800 20 remove_watcher() i=5 2024-09-12T00:54:32.900 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.900+0000 7ff8db72c800 20 remove_watcher() i=6 2024-09-12T00:54:32.901 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.901+0000 7ff8db72c800 20 remove_watcher() i=7 2024-09-12T00:54:32.912 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:32.912 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:54:32.912 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-change-reshard-state id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:32.912 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:32.913 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T00:54:32.948 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:32.948 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:32.991 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.991+0000 7fabf1120800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.993 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.993+0000 7fabf1120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:32.993 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.993+0000 7fabf1120800 20 realm 2024-09-12T00:54:32.993 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.993+0000 7fabf1120800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.993+0000 7fabf1120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:32.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.993+0000 7fabf1120800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:32.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.993+0000 7fabf1120800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.993+0000 7fabf1120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:32.994 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.993+0000 7fabf1120800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.994+0000 7fabf1120800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:32.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.994+0000 7fabf1120800 20 rados->read ofs=0 len=0 2024-09-12T00:54:32.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.994+0000 7fabf1120800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:32.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.994+0000 7fabf1120800 20 searching for the correct realm 2024-09-12T00:54:32.997 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:32.997+0000 7fabe4501640 0 -- 172.21.15.62:0/3523123202 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fabe8066190 msgr2=0x7fabe806b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:33.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.202+0000 7fabe4501640 0 -- 172.21.15.62:0/3523123202 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x56094689d670 msgr2=0x56094689fae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:33.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.206+0000 7fabf1120800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:33.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.206+0000 7fabf1120800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:33.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.206+0000 7fabf1120800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:33.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.206+0000 7fabf1120800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:33.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.206+0000 7fabf1120800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:33.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.206+0000 7fabf1120800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:33.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.206+0000 7fabf1120800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.207+0000 7fabf1120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.207+0000 7fabf1120800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.207+0000 7fabf1120800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:33.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.207+0000 7fabf1120800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.207+0000 7fabf1120800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:33.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.207+0000 7fabf1120800 20 zone default found 2024-09-12T00:54:33.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.207+0000 7fabf1120800 4 Realm: () 2024-09-12T00:54:33.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.207+0000 7fabf1120800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:33.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.207+0000 7fabf1120800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:33.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.207+0000 7fabf1120800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:33.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.207+0000 7fabf1120800 20 zonegroup default 2024-09-12T00:54:33.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.207+0000 7fabf1120800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.208+0000 7fabf1120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.208+0000 7fabf1120800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.208+0000 7fabf1120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.208+0000 7fabf1120800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.208+0000 7fabf1120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.208+0000 7fabf1120800 20 started sync module instance, tier type = 2024-09-12T00:54:33.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.208+0000 7fabf1120800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:33.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.217+0000 7fabf1120800 20 add_watcher() i=0 2024-09-12T00:54:33.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.217+0000 7fabf1120800 20 add_watcher() i=1 2024-09-12T00:54:33.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.217+0000 7fabf1120800 20 add_watcher() i=2 2024-09-12T00:54:33.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.217+0000 7fabf1120800 20 add_watcher() i=3 2024-09-12T00:54:33.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.217+0000 7fabf1120800 20 add_watcher() i=4 2024-09-12T00:54:33.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.217+0000 7fabf1120800 20 add_watcher() i=5 2024-09-12T00:54:33.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.217+0000 7fabf1120800 20 add_watcher() i=6 2024-09-12T00:54:33.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.218+0000 7fabf1120800 20 add_watcher() i=7 2024-09-12T00:54:33.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.218+0000 7fabf1120800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:33.220 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.220+0000 7faaa37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:33.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.221+0000 7fabf1120800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:33.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.221+0000 7fabf1120800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:33.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.221+0000 7fabf1120800 5 note: GC not initialized 2024-09-12T00:54:33.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.221+0000 7faaa27e4640 20 reqs_thread_entry: start 2024-09-12T00:54:33.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.221+0000 7fabf1120800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:33.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.221+0000 7fabf1120800 20 Filter name: none 2024-09-12T00:54:33.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.221+0000 7faa9bfff640 20 reqs_thread_entry: start 2024-09-12T00:54:33.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.221+0000 7fabf1120800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:54:33.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.221+0000 7fabf1120800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.222+0000 7fabf1120800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:33.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.222+0000 7fabf1120800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:54:33.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.222+0000 7fabf1120800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:54:33.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.222+0000 7fabf1120800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 : miss 2024-09-12T00:54:33.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.222+0000 7fabf1120800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.222+0000 7fabf1120800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:33.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.222+0000 7fabf1120800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 info.flags=0x17 2024-09-12T00:54:33.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.222+0000 7fabf1120800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 to cache LRU end 2024-09-12T00:54:33.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.222+0000 7fabf1120800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:33.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.222+0000 7fabf1120800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:33.223 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.222+0000 7fabf1120800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 2024-09-12T00:54:33.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.226+0000 7fabf1120800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 info.flags=0x17 2024-09-12T00:54:33.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.226+0000 7fabf1120800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 to cache LRU end 2024-09-12T00:54:33.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.226+0000 7fabf1120800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:33.226 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.226+0000 7fabf1120800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37, ofs0, ns] 2024-09-12T00:54:33.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.226+0000 7faac3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431672 cookie 94597838139072 notifier 7421 bl.length()=931 2024-09-12T00:54:33.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.226+0000 7faac3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 info.flags=0x17 2024-09-12T00:54:33.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.226+0000 7faac3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 to cache LRU end 2024-09-12T00:54:33.227 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.226+0000 7faac3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:33.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.228+0000 7fabf1120800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): orig_sources= new_sources= 2024-09-12T00:54:33.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.228+0000 7fabf1120800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): potential sources added=[] removed=[] 2024-09-12T00:54:33.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.228+0000 7fabf1120800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): orig_dests= new_dests= 2024-09-12T00:54:33.228 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.228+0000 7fabf1120800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): potential dests added=[] removed=[] 2024-09-12T00:54:33.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.230+0000 7fabf1120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37.1.0 2024-09-12T00:54:33.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.230+0000 7fabf1120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37.1.0 2024-09-12T00:54:33.230 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.230+0000 7fabf1120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37.1.1 2024-09-12T00:54:33.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.230+0000 7fabf1120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37.1.1 2024-09-12T00:54:33.231 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.230+0000 7fabf1120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37.0 2024-09-12T00:54:33.232 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.233+0000 7fabf1120800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T00:54:33.233 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.233+0000 7fabf1120800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T00:54:33.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.237+0000 7fabf1120800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:33.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.237+0000 7fabf1120800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 2024-09-12T00:54:33.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.238+0000 7fabf1120800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 info.flags=0x17 2024-09-12T00:54:33.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.238+0000 7fabf1120800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 to cache LRU end 2024-09-12T00:54:33.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.238+0000 7fabf1120800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:33.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.238+0000 7fabf1120800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37, ofs0, ns] 2024-09-12T00:54:33.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.239+0000 7faac37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431673 cookie 94597838139072 notifier 7421 bl.length()=899 2024-09-12T00:54:33.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.239+0000 7faac37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 info.flags=0x17 2024-09-12T00:54:33.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.239+0000 7faac37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 to cache LRU end 2024-09-12T00:54:33.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.239+0000 7faac37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:33.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.240+0000 7fabf1120800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): orig_sources= new_sources= 2024-09-12T00:54:33.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.240+0000 7fabf1120800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): potential sources added=[] removed=[] 2024-09-12T00:54:33.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.240+0000 7fabf1120800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): orig_dests= new_dests= 2024-09-12T00:54:33.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.240+0000 7fabf1120800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): potential dests added=[] removed=[] 2024-09-12T00:54:33.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.240+0000 7fabf1120800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T00:54:33.242 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.242+0000 7faaa37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:33.244 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.244+0000 7fabf1120800 20 remove_watcher() i=0 2024-09-12T00:54:33.245 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.244+0000 7fabf1120800 2 removed watcher, disabling cache 2024-09-12T00:54:33.245 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.245+0000 7fabf1120800 20 remove_watcher() i=1 2024-09-12T00:54:33.246 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.247+0000 7fabf1120800 20 remove_watcher() i=2 2024-09-12T00:54:33.247 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.248+0000 7fabf1120800 20 remove_watcher() i=3 2024-09-12T00:54:33.248 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.249+0000 7fabf1120800 20 remove_watcher() i=4 2024-09-12T00:54:33.249 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.250+0000 7fabf1120800 20 remove_watcher() i=5 2024-09-12T00:54:33.250 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.251+0000 7fabf1120800 20 remove_watcher() i=6 2024-09-12T00:54:33.252 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.252+0000 7fabf1120800 20 remove_watcher() i=7 2024-09-12T00:54:33.264 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:54:33.294 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:33.294 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:33.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.332+0000 7f28edb0c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.334+0000 7f28edb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.334+0000 7f28edb0c800 20 realm 2024-09-12T00:54:33.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.334+0000 7f28edb0c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.335+0000 7f28edb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.335+0000 7f28edb0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:33.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.335+0000 7f28edb0c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.335+0000 7f28edb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.335+0000 7f28edb0c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.335+0000 7f28edb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:33.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.335+0000 7f28edb0c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.336+0000 7f28edb0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:33.336 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.336+0000 7f28edb0c800 20 searching for the correct realm 2024-09-12T00:54:33.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.339+0000 7f28eadf5640 0 -- 172.21.15.62:0/804353925 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f28e40e1130 msgr2=0x7f28e40e1930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:33.342 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.343+0000 7f28ebdf7640 0 -- 172.21.15.62:0/804353925 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55d808461f10 msgr2=0x55d8084643a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:33.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.347+0000 7f28edb0c800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:33.347 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.347+0000 7f28edb0c800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:33.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.347+0000 7f28edb0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:33.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.347+0000 7f28edb0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:33.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.347+0000 7f28edb0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:33.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.347+0000 7f28edb0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:33.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.347+0000 7f28edb0c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.348+0000 7f28edb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.348 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.348+0000 7f28edb0c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.348+0000 7f28edb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:33.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.348+0000 7f28edb0c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.348+0000 7f28edb0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:33.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.348+0000 7f28edb0c800 20 zone default found 2024-09-12T00:54:33.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.348+0000 7f28edb0c800 4 Realm: () 2024-09-12T00:54:33.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.348+0000 7f28edb0c800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:33.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.348+0000 7f28edb0c800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:33.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.348+0000 7f28edb0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:33.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.348+0000 7f28edb0c800 20 zonegroup default 2024-09-12T00:54:33.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.348+0000 7f28edb0c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.348+0000 7f28edb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.348+0000 7f28edb0c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.349+0000 7f28edb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.349+0000 7f28edb0c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.349+0000 7f28edb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.349+0000 7f28edb0c800 20 started sync module instance, tier type = 2024-09-12T00:54:33.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.349+0000 7f28edb0c800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:33.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.358+0000 7f28edb0c800 20 add_watcher() i=0 2024-09-12T00:54:33.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.358+0000 7f28edb0c800 20 add_watcher() i=1 2024-09-12T00:54:33.358 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.358+0000 7f28edb0c800 20 add_watcher() i=2 2024-09-12T00:54:33.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.358+0000 7f28edb0c800 20 add_watcher() i=3 2024-09-12T00:54:33.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.358+0000 7f28edb0c800 20 add_watcher() i=4 2024-09-12T00:54:33.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.358+0000 7f28edb0c800 20 add_watcher() i=5 2024-09-12T00:54:33.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.358+0000 7f28edb0c800 20 add_watcher() i=6 2024-09-12T00:54:33.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.359+0000 7f28edb0c800 20 add_watcher() i=7 2024-09-12T00:54:33.359 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.359+0000 7f28edb0c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:33.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.361+0000 7f27a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:33.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.361+0000 7f28edb0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:33.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.361+0000 7f28edb0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:33.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.361+0000 7f28edb0c800 5 note: GC not initialized 2024-09-12T00:54:33.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.361+0000 7f27a0fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:33.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.362+0000 7f28edb0c800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:33.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.362+0000 7f28edb0c800 20 Filter name: none 2024-09-12T00:54:33.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.362+0000 7f271a7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:33.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.362+0000 7f28edb0c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.362+0000 7f28edb0c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:33.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.362+0000 7f28edb0c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.363+0000 7f28edb0c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:33.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.363+0000 7f28edb0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:33.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.363+0000 7f28edb0c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.363+0000 7f28edb0c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:33.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.363+0000 7f28edb0c800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.363+0000 7f28edb0c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:33.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.363+0000 7f28edb0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:33.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.365+0000 7f27a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:33.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.367+0000 7f28edb0c800 20 remove_watcher() i=0 2024-09-12T00:54:33.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.367+0000 7f28edb0c800 2 removed watcher, disabling cache 2024-09-12T00:54:33.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.368+0000 7f28edb0c800 20 remove_watcher() i=1 2024-09-12T00:54:33.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.369+0000 7f28edb0c800 20 remove_watcher() i=2 2024-09-12T00:54:33.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.370+0000 7f28edb0c800 20 remove_watcher() i=3 2024-09-12T00:54:33.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.371+0000 7f28edb0c800 20 remove_watcher() i=4 2024-09-12T00:54:33.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.372+0000 7f28edb0c800 20 remove_watcher() i=5 2024-09-12T00:54:33.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.373+0000 7f28edb0c800 20 remove_watcher() i=6 2024-09-12T00:54:33.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.374+0000 7f28edb0c800 20 remove_watcher() i=7 2024-09-12T00:54:33.384 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:33.385 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:54:33.385 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-change-reshard-state id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:33.385 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:33.478 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:54:33.510 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:33.510 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:33.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.549+0000 7fdd2eb21800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.551+0000 7fdd2eb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.551+0000 7fdd2eb21800 20 realm 2024-09-12T00:54:33.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.551+0000 7fdd2eb21800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.551+0000 7fdd2eb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.551+0000 7fdd2eb21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:33.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.551+0000 7fdd2eb21800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.551+0000 7fdd2eb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.551+0000 7fdd2eb21800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.552+0000 7fdd2eb21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:33.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.552+0000 7fdd2eb21800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.553+0000 7fdd2eb21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:33.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.553+0000 7fdd2eb21800 20 searching for the correct realm 2024-09-12T00:54:33.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.556+0000 7fdd2a00b640 0 -- 172.21.15.62:0/2548175356 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fdd240a9290 msgr2=0x7fdd240ae980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:33.760 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.760+0000 7fdd2a00b640 0 -- 172.21.15.62:0/2548175356 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x56407ccc2710 msgr2=0x56407ccc4bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:33.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.765+0000 7fdd2eb21800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:33.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.765+0000 7fdd2eb21800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:33.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.765+0000 7fdd2eb21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:33.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.765+0000 7fdd2eb21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:33.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.765+0000 7fdd2eb21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:33.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.765+0000 7fdd2eb21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:33.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.765+0000 7fdd2eb21800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.765+0000 7fdd2eb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.765+0000 7fdd2eb21800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.766+0000 7fdd2eb21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.766+0000 7fdd2eb21800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.766+0000 7fdd2eb21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.766+0000 7fdd2eb21800 20 zone default found 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.766+0000 7fdd2eb21800 4 Realm: () 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.766+0000 7fdd2eb21800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.766+0000 7fdd2eb21800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:33.768 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.766+0000 7fdd2eb21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:33.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.766+0000 7fdd2eb21800 20 zonegroup default 2024-09-12T00:54:33.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.766+0000 7fdd2eb21800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.766+0000 7fdd2eb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.766+0000 7fdd2eb21800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.767+0000 7fdd2eb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.767+0000 7fdd2eb21800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.767+0000 7fdd2eb21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.767+0000 7fdd2eb21800 20 started sync module instance, tier type = 2024-09-12T00:54:33.769 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.767+0000 7fdd2eb21800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:33.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.776+0000 7fdd2eb21800 20 add_watcher() i=0 2024-09-12T00:54:33.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.777+0000 7fdd2eb21800 20 add_watcher() i=1 2024-09-12T00:54:33.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.777+0000 7fdd2eb21800 20 add_watcher() i=2 2024-09-12T00:54:33.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.777+0000 7fdd2eb21800 20 add_watcher() i=3 2024-09-12T00:54:33.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.777+0000 7fdd2eb21800 20 add_watcher() i=4 2024-09-12T00:54:33.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.777+0000 7fdd2eb21800 20 add_watcher() i=5 2024-09-12T00:54:33.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.777+0000 7fdd2eb21800 20 add_watcher() i=6 2024-09-12T00:54:33.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.777+0000 7fdd2eb21800 20 add_watcher() i=7 2024-09-12T00:54:33.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.777+0000 7fdd2eb21800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:33.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.779+0000 7fdbe17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:33.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.780+0000 7fdd2eb21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:33.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.780+0000 7fdd2eb21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:33.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.780+0000 7fdd2eb21800 5 note: GC not initialized 2024-09-12T00:54:33.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.780+0000 7fdb5bfff640 20 reqs_thread_entry: start 2024-09-12T00:54:33.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.780+0000 7fdd2eb21800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:33.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.780+0000 7fdd2eb21800 20 Filter name: none 2024-09-12T00:54:33.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.780+0000 7fdb59ffb640 20 reqs_thread_entry: start 2024-09-12T00:54:33.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.780+0000 7fdd2eb21800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:54:33.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.780+0000 7fdd2eb21800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.781+0000 7fdd2eb21800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:33.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.781+0000 7fdd2eb21800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:54:33.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.781+0000 7fdd2eb21800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:54:33.782 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.781+0000 7fdd2eb21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 : miss 2024-09-12T00:54:33.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.781+0000 7fdd2eb21800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.781+0000 7fdd2eb21800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:33.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.781+0000 7fdd2eb21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 info.flags=0x17 2024-09-12T00:54:33.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.781+0000 7fdd2eb21800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 to cache LRU end 2024-09-12T00:54:33.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.781+0000 7fdd2eb21800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:33.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.781+0000 7fdd2eb21800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:33.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.781+0000 7fdd2eb21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 2024-09-12T00:54:33.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.785+0000 7fdd2eb21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 info.flags=0x17 2024-09-12T00:54:33.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.785+0000 7fdd2eb21800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 to cache LRU end 2024-09-12T00:54:33.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.785+0000 7fdd2eb21800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:33.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.785+0000 7fdd2eb21800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37, ofs0, ns] 2024-09-12T00:54:33.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.785+0000 7fdc0e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431674 cookie 94834971714224 notifier 7896 bl.length()=931 2024-09-12T00:54:33.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.785+0000 7fdc0e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 info.flags=0x17 2024-09-12T00:54:33.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.785+0000 7fdc0e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 to cache LRU end 2024-09-12T00:54:33.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.785+0000 7fdc0e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:33.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.787+0000 7fdd2eb21800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): orig_sources= new_sources= 2024-09-12T00:54:33.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.787+0000 7fdd2eb21800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): potential sources added=[] removed=[] 2024-09-12T00:54:33.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.787+0000 7fdd2eb21800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): orig_dests= new_dests= 2024-09-12T00:54:33.787 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.787+0000 7fdd2eb21800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): potential dests added=[] removed=[] 2024-09-12T00:54:33.789 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.790+0000 7fdd2eb21800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37.1.0 2024-09-12T00:54:33.790 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.790+0000 7fdd2eb21800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37.1.0 2024-09-12T00:54:33.790 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.790+0000 7fdd2eb21800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37.1.1 2024-09-12T00:54:33.790 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.790+0000 7fdd2eb21800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37.1.1 2024-09-12T00:54:33.790 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.790+0000 7fdd2eb21800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37.0 2024-09-12T00:54:33.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.792+0000 7fdd2eb21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:33.792 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.792+0000 7fdd2eb21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 2024-09-12T00:54:33.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.793+0000 7fdd2eb21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 info.flags=0x17 2024-09-12T00:54:33.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.793+0000 7fdd2eb21800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 to cache LRU end 2024-09-12T00:54:33.793 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.793+0000 7fdd2eb21800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:33.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.793+0000 7fdd2eb21800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37, ofs0, ns] 2024-09-12T00:54:33.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.793+0000 7fdc0e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431675 cookie 94834971714224 notifier 7896 bl.length()=931 2024-09-12T00:54:33.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.793+0000 7fdc0e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 info.flags=0x17 2024-09-12T00:54:33.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.793+0000 7fdc0e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 to cache LRU end 2024-09-12T00:54:33.794 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.793+0000 7fdc0e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:33.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.795+0000 7fdd2eb21800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): orig_sources= new_sources= 2024-09-12T00:54:33.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.795+0000 7fdd2eb21800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): potential sources added=[] removed=[] 2024-09-12T00:54:33.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.795+0000 7fdd2eb21800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): orig_dests= new_dests= 2024-09-12T00:54:33.795 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.795+0000 7fdd2eb21800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): potential dests added=[] removed=[] 2024-09-12T00:54:33.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.796+0000 7fdd2eb21800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37.0 2024-09-12T00:54:33.796 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.796+0000 7fdd2eb21800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:33.797 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.796+0000 7fdd2eb21800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 2024-09-12T00:54:33.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.798+0000 7fdd2eb21800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 info.flags=0x17 2024-09-12T00:54:33.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.798+0000 7fdd2eb21800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 to cache LRU end 2024-09-12T00:54:33.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.798+0000 7fdd2eb21800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:33.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.798+0000 7fdd2eb21800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37, ofs0, ns] 2024-09-12T00:54:33.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.798+0000 7fdc0dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431676 cookie 94834971714224 notifier 7896 bl.length()=899 2024-09-12T00:54:33.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.798+0000 7fdc0dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 info.flags=0x17 2024-09-12T00:54:33.798 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.798+0000 7fdc0dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 to cache LRU end 2024-09-12T00:54:33.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.798+0000 7fdc0dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:33.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.799+0000 7fdd2eb21800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): orig_sources= new_sources= 2024-09-12T00:54:33.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.799+0000 7fdd2eb21800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): potential sources added=[] removed=[] 2024-09-12T00:54:33.799 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.799+0000 7fdd2eb21800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): orig_dests= new_dests= 2024-09-12T00:54:33.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.799+0000 7fdd2eb21800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37]): potential dests added=[] removed=[] 2024-09-12T00:54:33.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.800+0000 7fdd2eb21800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:54:33.802 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.802+0000 7fdbe17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:33.804 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.805+0000 7fdd2eb21800 20 remove_watcher() i=0 2024-09-12T00:54:33.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.805+0000 7fdd2eb21800 2 removed watcher, disabling cache 2024-09-12T00:54:33.806 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.806+0000 7fdd2eb21800 20 remove_watcher() i=1 2024-09-12T00:54:33.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.807+0000 7fdd2eb21800 20 remove_watcher() i=2 2024-09-12T00:54:33.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.808+0000 7fdd2eb21800 20 remove_watcher() i=3 2024-09-12T00:54:33.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.809+0000 7fdd2eb21800 20 remove_watcher() i=4 2024-09-12T00:54:33.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.810+0000 7fdd2eb21800 20 remove_watcher() i=5 2024-09-12T00:54:33.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.811+0000 7fdd2eb21800 20 remove_watcher() i=6 2024-09-12T00:54:33.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.812+0000 7fdd2eb21800 20 remove_watcher() i=7 2024-09-12T00:54:33.824 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:54:33.853 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:33.853 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:33.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.892+0000 7f9862f19800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.894+0000 7f9862f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.894+0000 7f9862f19800 20 realm 2024-09-12T00:54:33.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.894+0000 7f9862f19800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.894+0000 7f9862f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.894+0000 7f9862f19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:33.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.894+0000 7f9862f19800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.894+0000 7f9862f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:33.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.894+0000 7f9862f19800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.895+0000 7f9862f19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:33.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.895+0000 7f9862f19800 20 rados->read ofs=0 len=0 2024-09-12T00:54:33.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.896+0000 7f9862f19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:33.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:33.896+0000 7f9862f19800 20 searching for the correct realm 2024-09-12T00:54:34.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.100+0000 7f9860209640 0 -- 172.21.15.62:0/2037258797 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f98580a8be0 msgr2=0x7f98580ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:34.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.305+0000 7f986120b640 0 -- 172.21.15.62:0/2037258797 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55a29fffd7f0 msgr2=0x55a29ffffcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:34.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.309+0000 7f9862f19800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:34.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.309+0000 7f9862f19800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:34.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.309+0000 7f9862f19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:34.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.309+0000 7f9862f19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:34.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.309+0000 7f9862f19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:34.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.309+0000 7f9862f19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:34.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.309+0000 7f9862f19800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.309+0000 7f9862f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.309+0000 7f9862f19800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.310+0000 7f9862f19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:34.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.310+0000 7f9862f19800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.310+0000 7f9862f19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:34.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.310+0000 7f9862f19800 20 zone default found 2024-09-12T00:54:34.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.310+0000 7f9862f19800 4 Realm: () 2024-09-12T00:54:34.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.310+0000 7f9862f19800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:34.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.310+0000 7f9862f19800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:34.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.310+0000 7f9862f19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:34.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.310+0000 7f9862f19800 20 zonegroup default 2024-09-12T00:54:34.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.310+0000 7f9862f19800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.310+0000 7f9862f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.310+0000 7f9862f19800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.311+0000 7f9862f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.311+0000 7f9862f19800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.311+0000 7f9862f19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:34.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.311+0000 7f9862f19800 20 started sync module instance, tier type = 2024-09-12T00:54:34.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.311+0000 7f9862f19800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:34.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.319+0000 7f9862f19800 20 add_watcher() i=0 2024-09-12T00:54:34.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.319+0000 7f9862f19800 20 add_watcher() i=1 2024-09-12T00:54:34.319 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.319+0000 7f9862f19800 20 add_watcher() i=2 2024-09-12T00:54:34.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.319+0000 7f9862f19800 20 add_watcher() i=3 2024-09-12T00:54:34.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.319+0000 7f9862f19800 20 add_watcher() i=4 2024-09-12T00:54:34.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.319+0000 7f9862f19800 20 add_watcher() i=5 2024-09-12T00:54:34.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.319+0000 7f9862f19800 20 add_watcher() i=6 2024-09-12T00:54:34.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.321+0000 7f9862f19800 20 add_watcher() i=7 2024-09-12T00:54:34.320 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.321+0000 7f9862f19800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:34.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.322+0000 7f97177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:34.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.323+0000 7f9862f19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:34.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.323+0000 7f9862f19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:34.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.323+0000 7f9862f19800 5 note: GC not initialized 2024-09-12T00:54:34.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.323+0000 7f97167e4640 20 reqs_thread_entry: start 2024-09-12T00:54:34.323 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.323+0000 7f9862f19800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:34.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.323+0000 7f9862f19800 20 Filter name: none 2024-09-12T00:54:34.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.323+0000 7f970f7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:34.324 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.323+0000 7f9862f19800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.324+0000 7f9862f19800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:34.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.324+0000 7f9862f19800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.324+0000 7f9862f19800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:34.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.324+0000 7f9862f19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:34.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.324+0000 7f9862f19800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.325+0000 7f9862f19800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:34.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.325+0000 7f9862f19800 20 rados->read ofs=0 len=0 2024-09-12T00:54:34.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.325+0000 7f9862f19800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:34.325 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.325+0000 7f9862f19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:34.326 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.326+0000 7f97177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:34.328 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.328+0000 7f9862f19800 20 remove_watcher() i=0 2024-09-12T00:54:34.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.328+0000 7f9862f19800 2 removed watcher, disabling cache 2024-09-12T00:54:34.329 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.329+0000 7f9862f19800 20 remove_watcher() i=1 2024-09-12T00:54:34.330 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.330+0000 7f9862f19800 20 remove_watcher() i=2 2024-09-12T00:54:34.331 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.332+0000 7f9862f19800 20 remove_watcher() i=3 2024-09-12T00:54:34.332 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.333+0000 7f9862f19800 20 remove_watcher() i=4 2024-09-12T00:54:34.333 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.334+0000 7f9862f19800 20 remove_watcher() i=5 2024-09-12T00:54:34.334 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.334+0000 7f9862f19800 20 remove_watcher() i=6 2024-09-12T00:54:34.335 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:34.335+0000 7f9862f19800 20 remove_watcher() i=7 2024-09-12T00:54:34.347 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:34.347 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:54:34.347 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-change-reshard-state id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:54:34.347 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:34.655 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T00:54:34.656 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:35.520 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:54:35.549 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:35.549 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:35.588 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.589+0000 7f4916f46800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.590 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.591+0000 7f4916f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.590 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.591+0000 7f4916f46800 20 realm 2024-09-12T00:54:35.590 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.591+0000 7f4916f46800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.591+0000 7f4916f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.591+0000 7f4916f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:35.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.591+0000 7f4916f46800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.591+0000 7f4916f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.591+0000 7f4916f46800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.592+0000 7f4916f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:35.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.592+0000 7f4916f46800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.593+0000 7f4916f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:35.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.593+0000 7f4916f46800 20 searching for the correct realm 2024-09-12T00:54:35.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.596+0000 7f4914236640 0 -- 172.21.15.62:0/505425885 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f490c070920 msgr2=0x7f490c06f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:35.800 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.801+0000 7f4915238640 0 -- 172.21.15.62:0/505425885 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5642bcfe2780 msgr2=0x5642bcfe4b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:35.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.805+0000 7f4916f46800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:35.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.805+0000 7f4916f46800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:35.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.805+0000 7f4916f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:35.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.805+0000 7f4916f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:35.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.805+0000 7f4916f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:35.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.805+0000 7f4916f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:35.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.805+0000 7f4916f46800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.806+0000 7f4916f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.806 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.806+0000 7f4916f46800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.806 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.806+0000 7f4916f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:35.806 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.806+0000 7f4916f46800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.806+0000 7f4916f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:35.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.806+0000 7f4916f46800 20 zone default found 2024-09-12T00:54:35.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.806+0000 7f4916f46800 4 Realm: () 2024-09-12T00:54:35.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.806+0000 7f4916f46800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:35.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.806+0000 7f4916f46800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:35.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.806+0000 7f4916f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:35.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.806+0000 7f4916f46800 20 zonegroup default 2024-09-12T00:54:35.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.806+0000 7f4916f46800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.806+0000 7f4916f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.806+0000 7f4916f46800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.807+0000 7f4916f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.807+0000 7f4916f46800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.807+0000 7f4916f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.807+0000 7f4916f46800 20 started sync module instance, tier type = 2024-09-12T00:54:35.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.807+0000 7f4916f46800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:35.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.816+0000 7f4916f46800 20 add_watcher() i=0 2024-09-12T00:54:35.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.816+0000 7f4916f46800 20 add_watcher() i=1 2024-09-12T00:54:35.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.816+0000 7f4916f46800 20 add_watcher() i=2 2024-09-12T00:54:35.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.816+0000 7f4916f46800 20 add_watcher() i=3 2024-09-12T00:54:35.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.816+0000 7f4916f46800 20 add_watcher() i=4 2024-09-12T00:54:35.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.816+0000 7f4916f46800 20 add_watcher() i=5 2024-09-12T00:54:35.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.816+0000 7f4916f46800 20 add_watcher() i=6 2024-09-12T00:54:35.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.817+0000 7f4916f46800 20 add_watcher() i=7 2024-09-12T00:54:35.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.817+0000 7f4916f46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:35.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.819+0000 7f47cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:35.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.819+0000 7f4916f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:35.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.819+0000 7f4916f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:35.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.819+0000 7f4916f46800 5 note: GC not initialized 2024-09-12T00:54:35.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.819+0000 7f47ca7e4640 20 reqs_thread_entry: start 2024-09-12T00:54:35.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.819+0000 7f4916f46800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:35.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.820+0000 7f4916f46800 20 Filter name: none 2024-09-12T00:54:35.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.820+0000 7f47c3fff640 20 reqs_thread_entry: start 2024-09-12T00:54:35.819 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.820+0000 7f4916f46800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.820 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.820+0000 7f4916f46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:35.820 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.820+0000 7f4916f46800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.821+0000 7f4916f46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:35.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.821+0000 7f4916f46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:35.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.821+0000 7f4916f46800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.821+0000 7f4916f46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:35.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.821+0000 7f4916f46800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.821+0000 7f4916f46800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:35.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.821+0000 7f4916f46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:35.821 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.823+0000 7f47cb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:35.824 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.825+0000 7f4916f46800 20 remove_watcher() i=0 2024-09-12T00:54:35.824 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.825+0000 7f4916f46800 2 removed watcher, disabling cache 2024-09-12T00:54:35.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.826+0000 7f4916f46800 20 remove_watcher() i=1 2024-09-12T00:54:35.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.827+0000 7f4916f46800 20 remove_watcher() i=2 2024-09-12T00:54:35.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.828+0000 7f4916f46800 20 remove_watcher() i=3 2024-09-12T00:54:35.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.830+0000 7f4916f46800 20 remove_watcher() i=4 2024-09-12T00:54:35.829 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.831+0000 7f4916f46800 20 remove_watcher() i=5 2024-09-12T00:54:35.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.832+0000 7f4916f46800 20 remove_watcher() i=6 2024-09-12T00:54:35.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.832+0000 7f4916f46800 20 remove_watcher() i=7 2024-09-12T00:54:35.842 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:35.843 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:54:35.843 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-change-reshard-state id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:35.843 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:35.844 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T00:54:35.881 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:35.881 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:35.920 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.921+0000 7f90e8b36800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.923+0000 7f90e8b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.923+0000 7f90e8b36800 20 realm 2024-09-12T00:54:35.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.923+0000 7f90e8b36800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.924+0000 7f90e8b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.924+0000 7f90e8b36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:35.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.924+0000 7f90e8b36800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.924+0000 7f90e8b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:35.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.924+0000 7f90e8b36800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.924+0000 7f90e8b36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:35.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.925+0000 7f90e8b36800 20 rados->read ofs=0 len=0 2024-09-12T00:54:35.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.925+0000 7f90e8b36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:35.924 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.925+0000 7f90e8b36800 20 searching for the correct realm 2024-09-12T00:54:35.927 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:35.928+0000 7f90e40b6640 0 -- 172.21.15.62:0/341615214 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f90dc02e920 msgr2=0x7f90dc01f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:36.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.134+0000 7f90e50b8640 0 -- 172.21.15.62:0/341615214 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5571ffe08c20 msgr2=0x5571ffe0b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:36.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.138+0000 7f90e8b36800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:36.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.138+0000 7f90e8b36800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:36.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.138+0000 7f90e8b36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:36.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.138+0000 7f90e8b36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:36.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.138+0000 7f90e8b36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:36.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.138+0000 7f90e8b36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:36.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.138+0000 7f90e8b36800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.138+0000 7f90e8b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.138 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.138+0000 7f90e8b36800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.139+0000 7f90e8b36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:36.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.139+0000 7f90e8b36800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.139+0000 7f90e8b36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:36.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.139+0000 7f90e8b36800 20 zone default found 2024-09-12T00:54:36.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.139+0000 7f90e8b36800 4 Realm: () 2024-09-12T00:54:36.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.139+0000 7f90e8b36800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:36.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.139+0000 7f90e8b36800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:36.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.139+0000 7f90e8b36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:36.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.139+0000 7f90e8b36800 20 zonegroup default 2024-09-12T00:54:36.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.139+0000 7f90e8b36800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.140+0000 7f90e8b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.140+0000 7f90e8b36800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.140+0000 7f90e8b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.140+0000 7f90e8b36800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.140+0000 7f90e8b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.140+0000 7f90e8b36800 20 started sync module instance, tier type = 2024-09-12T00:54:36.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.140+0000 7f90e8b36800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:36.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.149+0000 7f90e8b36800 20 add_watcher() i=0 2024-09-12T00:54:36.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.149+0000 7f90e8b36800 20 add_watcher() i=1 2024-09-12T00:54:36.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.149+0000 7f90e8b36800 20 add_watcher() i=2 2024-09-12T00:54:36.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.149+0000 7f90e8b36800 20 add_watcher() i=3 2024-09-12T00:54:36.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.149+0000 7f90e8b36800 20 add_watcher() i=4 2024-09-12T00:54:36.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.149+0000 7f90e8b36800 20 add_watcher() i=5 2024-09-12T00:54:36.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.149+0000 7f90e8b36800 20 add_watcher() i=6 2024-09-12T00:54:36.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.150+0000 7f90e8b36800 20 add_watcher() i=7 2024-09-12T00:54:36.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.150+0000 7f90e8b36800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:36.151 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.152+0000 7f8f9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:36.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.152+0000 7f90e8b36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:36.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.152+0000 7f90e8b36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:36.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.152+0000 7f90e8b36800 5 note: GC not initialized 2024-09-12T00:54:36.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.153+0000 7f8f9a7e4640 20 reqs_thread_entry: start 2024-09-12T00:54:36.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.153+0000 7f90e8b36800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:36.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.153+0000 7f90e8b36800 20 Filter name: none 2024-09-12T00:54:36.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.153+0000 7f8f937fe640 20 reqs_thread_entry: start 2024-09-12T00:54:36.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.153+0000 7f90e8b36800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:54:36.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.153+0000 7f90e8b36800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.153+0000 7f90e8b36800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:36.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.153+0000 7f90e8b36800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:54:36.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.153+0000 7f90e8b36800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:54:36.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.153+0000 7f90e8b36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 : miss 2024-09-12T00:54:36.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.153+0000 7f90e8b36800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.154+0000 7f90e8b36800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:36.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.154+0000 7f90e8b36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 info.flags=0x17 2024-09-12T00:54:36.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.154+0000 7f90e8b36800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 to cache LRU end 2024-09-12T00:54:36.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.154+0000 7f90e8b36800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:36.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.154+0000 7f90e8b36800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:36.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.154+0000 7f90e8b36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 2024-09-12T00:54:36.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.157+0000 7f90e8b36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 info.flags=0x17 2024-09-12T00:54:36.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.157+0000 7f90e8b36800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 to cache LRU end 2024-09-12T00:54:36.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.157+0000 7f90e8b36800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:36.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.157+0000 7f90e8b36800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38, ofs0, ns] 2024-09-12T00:54:36.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.158+0000 7f8fbbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431681 cookie 93948112638160 notifier 7508 bl.length()=931 2024-09-12T00:54:36.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.158+0000 7f8fbbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 info.flags=0x17 2024-09-12T00:54:36.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.158+0000 7f8fbbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 to cache LRU end 2024-09-12T00:54:36.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.158+0000 7f8fbbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:36.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.160+0000 7f90e8b36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38]): orig_sources= new_sources= 2024-09-12T00:54:36.158 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.160+0000 7f90e8b36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38]): potential sources added=[] removed=[] 2024-09-12T00:54:36.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.160+0000 7f90e8b36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38]): orig_dests= new_dests= 2024-09-12T00:54:36.159 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.160+0000 7f90e8b36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38]): potential dests added=[] removed=[] 2024-09-12T00:54:36.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.162+0000 7f90e8b36800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38.1.0 2024-09-12T00:54:36.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.162+0000 7f90e8b36800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38.1.0 2024-09-12T00:54:36.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.162+0000 7f90e8b36800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38.1.1 2024-09-12T00:54:36.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.162+0000 7f90e8b36800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38.1.1 2024-09-12T00:54:36.161 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.162+0000 7f90e8b36800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38.0 2024-09-12T00:54:36.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.164+0000 7f90e8b36800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T00:54:36.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.164+0000 7f90e8b36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:36.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.164+0000 7f90e8b36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 2024-09-12T00:54:36.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.165+0000 7f90e8b36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 info.flags=0x17 2024-09-12T00:54:36.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.165+0000 7f90e8b36800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 to cache LRU end 2024-09-12T00:54:36.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.165+0000 7f90e8b36800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:36.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.165+0000 7f90e8b36800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38, ofs0, ns] 2024-09-12T00:54:36.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.166+0000 7f8fbbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431682 cookie 93948112638160 notifier 7508 bl.length()=931 2024-09-12T00:54:36.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.166+0000 7f8fbbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 info.flags=0x17 2024-09-12T00:54:36.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.166+0000 7f8fbbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 to cache LRU end 2024-09-12T00:54:36.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.166+0000 7f8fbbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:36.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.167+0000 7f90e8b36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38]): orig_sources= new_sources= 2024-09-12T00:54:36.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.167+0000 7f90e8b36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38]): potential sources added=[] removed=[] 2024-09-12T00:54:36.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.167+0000 7f90e8b36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38]): orig_dests= new_dests= 2024-09-12T00:54:36.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.167+0000 7f90e8b36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38]): potential dests added=[] removed=[] 2024-09-12T00:54:36.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.168+0000 7f90e8b36800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38.0 2024-09-12T00:54:36.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.169+0000 7f90e8b36800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:54:36.168 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.169+0000 7f90e8b36800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 2024-09-12T00:54:36.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.170+0000 7f90e8b36800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 info.flags=0x17 2024-09-12T00:54:36.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.170+0000 7f90e8b36800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 to cache LRU end 2024-09-12T00:54:36.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.170+0000 7f90e8b36800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:36.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.170+0000 7f90e8b36800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38, ofs0, ns] 2024-09-12T00:54:36.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.170+0000 7f8fbbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431683 cookie 93948112638160 notifier 7508 bl.length()=899 2024-09-12T00:54:36.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.170+0000 7f8fbbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 info.flags=0x17 2024-09-12T00:54:36.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.170+0000 7f8fbbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 to cache LRU end 2024-09-12T00:54:36.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.170+0000 7f8fbbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:36.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.171+0000 7f90e8b36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38]): orig_sources= new_sources= 2024-09-12T00:54:36.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.171+0000 7f90e8b36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38]): potential sources added=[] removed=[] 2024-09-12T00:54:36.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.171+0000 7f90e8b36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38]): orig_dests= new_dests= 2024-09-12T00:54:36.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.171+0000 7f90e8b36800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38]): potential dests added=[] removed=[] 2024-09-12T00:54:36.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.173+0000 7f90e8b36800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:54:36.175 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.176+0000 7f8f9b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:36.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.178+0000 7f90e8b36800 20 remove_watcher() i=0 2024-09-12T00:54:36.177 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.178+0000 7f90e8b36800 2 removed watcher, disabling cache 2024-09-12T00:54:36.178 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.179+0000 7f90e8b36800 20 remove_watcher() i=1 2024-09-12T00:54:36.179 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.180+0000 7f90e8b36800 20 remove_watcher() i=2 2024-09-12T00:54:36.180 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.181+0000 7f90e8b36800 20 remove_watcher() i=3 2024-09-12T00:54:36.181 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.182+0000 7f90e8b36800 20 remove_watcher() i=4 2024-09-12T00:54:36.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.183+0000 7f90e8b36800 20 remove_watcher() i=5 2024-09-12T00:54:36.182 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.184+0000 7f90e8b36800 20 remove_watcher() i=6 2024-09-12T00:54:36.183 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.185+0000 7f90e8b36800 20 remove_watcher() i=7 2024-09-12T00:54:36.197 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:54:36.226 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:36.227 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:36.265 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.266+0000 7fd79ee96800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.268+0000 7fd79ee96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.268+0000 7fd79ee96800 20 realm 2024-09-12T00:54:36.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.268+0000 7fd79ee96800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.267 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.268+0000 7fd79ee96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.268+0000 7fd79ee96800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:36.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.268+0000 7fd79ee96800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.268+0000 7fd79ee96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.268+0000 7fd79ee96800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.269+0000 7fd79ee96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:36.268 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.269+0000 7fd79ee96800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.270+0000 7fd79ee96800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:36.269 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.270+0000 7fd79ee96800 20 searching for the correct realm 2024-09-12T00:54:36.271 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.272+0000 7fd797fff640 0 -- 172.21.15.62:0/3721246843 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fd798055920 msgr2=0x7fd798080400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:36.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.478+0000 7fd79d181640 0 -- 172.21.15.62:0/3721246843 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55f220feb8b0 msgr2=0x55f220fedd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:36.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.481+0000 7fd79ee96800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:36.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.481+0000 7fd79ee96800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:36.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.481+0000 7fd79ee96800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:36.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.481+0000 7fd79ee96800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:36.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.481+0000 7fd79ee96800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:36.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.481+0000 7fd79ee96800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:36.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.481+0000 7fd79ee96800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.482+0000 7fd79ee96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.482+0000 7fd79ee96800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.482+0000 7fd79ee96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:36.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.482+0000 7fd79ee96800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.483+0000 7fd79ee96800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:36.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.483+0000 7fd79ee96800 20 zone default found 2024-09-12T00:54:36.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.483+0000 7fd79ee96800 4 Realm: () 2024-09-12T00:54:36.482 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.483+0000 7fd79ee96800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:36.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.483+0000 7fd79ee96800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:36.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.483+0000 7fd79ee96800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:36.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.483+0000 7fd79ee96800 20 zonegroup default 2024-09-12T00:54:36.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.483+0000 7fd79ee96800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.483+0000 7fd79ee96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.483+0000 7fd79ee96800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.483+0000 7fd79ee96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.483+0000 7fd79ee96800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.483 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.483+0000 7fd79ee96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:36.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.483+0000 7fd79ee96800 20 started sync module instance, tier type = 2024-09-12T00:54:36.484 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.483+0000 7fd79ee96800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:36.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.492+0000 7fd79ee96800 20 add_watcher() i=0 2024-09-12T00:54:36.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.492+0000 7fd79ee96800 20 add_watcher() i=1 2024-09-12T00:54:36.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.492+0000 7fd79ee96800 20 add_watcher() i=2 2024-09-12T00:54:36.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.492+0000 7fd79ee96800 20 add_watcher() i=3 2024-09-12T00:54:36.491 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.492+0000 7fd79ee96800 20 add_watcher() i=4 2024-09-12T00:54:36.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.492+0000 7fd79ee96800 20 add_watcher() i=5 2024-09-12T00:54:36.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.492+0000 7fd79ee96800 20 add_watcher() i=6 2024-09-12T00:54:36.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.493+0000 7fd79ee96800 20 add_watcher() i=7 2024-09-12T00:54:36.492 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.493+0000 7fd79ee96800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:36.494 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.495+0000 7fd652fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:36.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.495+0000 7fd79ee96800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:36.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.495+0000 7fd79ee96800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:36.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.496+0000 7fd79ee96800 5 note: GC not initialized 2024-09-12T00:54:36.495 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.496+0000 7fd651fe3640 20 reqs_thread_entry: start 2024-09-12T00:54:36.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.496+0000 7fd79ee96800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:36.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.496+0000 7fd79ee96800 20 Filter name: none 2024-09-12T00:54:36.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.496+0000 7fd5c37fe640 20 reqs_thread_entry: start 2024-09-12T00:54:36.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.496+0000 7fd79ee96800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.497 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.497+0000 7fd79ee96800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:36.497 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.497+0000 7fd79ee96800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.497 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.497+0000 7fd79ee96800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:36.497 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.497+0000 7fd79ee96800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:36.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.497+0000 7fd79ee96800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.498+0000 7fd79ee96800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:36.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.498+0000 7fd79ee96800 20 rados->read ofs=0 len=0 2024-09-12T00:54:36.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.498+0000 7fd79ee96800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:36.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.498+0000 7fd79ee96800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:36.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.500+0000 7fd652fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:36.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.502+0000 7fd79ee96800 20 remove_watcher() i=0 2024-09-12T00:54:36.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.502+0000 7fd79ee96800 2 removed watcher, disabling cache 2024-09-12T00:54:36.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.503+0000 7fd79ee96800 20 remove_watcher() i=1 2024-09-12T00:54:36.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.504+0000 7fd79ee96800 20 remove_watcher() i=2 2024-09-12T00:54:36.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.505+0000 7fd79ee96800 20 remove_watcher() i=3 2024-09-12T00:54:36.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.506+0000 7fd79ee96800 20 remove_watcher() i=4 2024-09-12T00:54:36.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.507+0000 7fd79ee96800 20 remove_watcher() i=5 2024-09-12T00:54:36.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.508+0000 7fd79ee96800 20 remove_watcher() i=6 2024-09-12T00:54:36.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:36.509+0000 7fd79ee96800 20 remove_watcher() i=7 2024-09-12T00:54:36.519 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:36.519 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:54:36.519 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: error-at-change-reshard-state id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-12T00:54:36.519 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:36.834 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T00:54:36.834 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:37.679 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:54:37.708 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:37.708 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:37.747 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.748+0000 7fb606440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.749 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.750+0000 7fb606440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:37.749 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.750+0000 7fb606440800 20 realm 2024-09-12T00:54:37.749 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.750+0000 7fb606440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.749 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.750+0000 7fb606440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:37.749 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.750+0000 7fb606440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:37.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.750+0000 7fb606440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.750+0000 7fb606440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:37.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.750+0000 7fb606440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.751+0000 7fb606440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:37.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.751+0000 7fb606440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.751+0000 7fb606440800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:37.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.751+0000 7fb606440800 20 searching for the correct realm 2024-09-12T00:54:37.753 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.754+0000 7fb603729640 0 -- 172.21.15.62:0/1314861520 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fb5fc062b90 msgr2=0x7fb5fc07f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:37.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.959+0000 7fb60472b640 0 -- 172.21.15.62:0/1314861520 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x56162a809970 msgr2=0x56162a80bdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:37.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.963+0000 7fb606440800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:37.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.963+0000 7fb606440800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:37.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.963+0000 7fb606440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:37.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.963+0000 7fb606440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:37.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.963+0000 7fb606440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:37.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.963+0000 7fb606440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:37.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.963+0000 7fb606440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.963+0000 7fb606440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:37.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.963+0000 7fb606440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.963+0000 7fb606440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:37.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.963+0000 7fb606440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.964+0000 7fb606440800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:37.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.964+0000 7fb606440800 20 zone default found 2024-09-12T00:54:37.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.964+0000 7fb606440800 4 Realm: () 2024-09-12T00:54:37.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.964+0000 7fb606440800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:37.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.964+0000 7fb606440800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:37.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.964+0000 7fb606440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:37.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.964+0000 7fb606440800 20 zonegroup default 2024-09-12T00:54:37.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.964+0000 7fb606440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.964+0000 7fb606440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:37.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.964+0000 7fb606440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.964+0000 7fb606440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:37.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.964+0000 7fb606440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.964+0000 7fb606440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:37.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.964+0000 7fb606440800 20 started sync module instance, tier type = 2024-09-12T00:54:37.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.964+0000 7fb606440800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:37.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.973+0000 7fb606440800 20 add_watcher() i=0 2024-09-12T00:54:37.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.973+0000 7fb606440800 20 add_watcher() i=1 2024-09-12T00:54:37.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.973+0000 7fb606440800 20 add_watcher() i=2 2024-09-12T00:54:37.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.973+0000 7fb606440800 20 add_watcher() i=3 2024-09-12T00:54:37.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.973+0000 7fb606440800 20 add_watcher() i=4 2024-09-12T00:54:37.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.973+0000 7fb606440800 20 add_watcher() i=5 2024-09-12T00:54:37.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.973+0000 7fb606440800 20 add_watcher() i=6 2024-09-12T00:54:37.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.974+0000 7fb606440800 20 add_watcher() i=7 2024-09-12T00:54:37.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.974+0000 7fb606440800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:37.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.976+0000 7fb4b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:37.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.976+0000 7fb606440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:37.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.976+0000 7fb606440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:37.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.976+0000 7fb606440800 5 note: GC not initialized 2024-09-12T00:54:37.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.977+0000 7fb4b8fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:37.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.977+0000 7fb606440800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:37.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.977+0000 7fb606440800 20 Filter name: none 2024-09-12T00:54:37.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.977+0000 7fb4327fc640 20 reqs_thread_entry: start 2024-09-12T00:54:37.977 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.977+0000 7fb606440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.977 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.978+0000 7fb606440800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:37.977 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.978+0000 7fb606440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.978+0000 7fb606440800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:37.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.978+0000 7fb606440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:37.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.978+0000 7fb606440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.979+0000 7fb606440800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:37.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.979+0000 7fb606440800 20 rados->read ofs=0 len=0 2024-09-12T00:54:37.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.979+0000 7fb606440800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:37.978 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.979+0000 7fb606440800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:37.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.980+0000 7fb4b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:37.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.982+0000 7fb606440800 20 remove_watcher() i=0 2024-09-12T00:54:37.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.982+0000 7fb606440800 2 removed watcher, disabling cache 2024-09-12T00:54:37.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.984+0000 7fb606440800 20 remove_watcher() i=1 2024-09-12T00:54:37.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.985+0000 7fb606440800 20 remove_watcher() i=2 2024-09-12T00:54:37.985 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.986+0000 7fb606440800 20 remove_watcher() i=3 2024-09-12T00:54:37.986 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.987+0000 7fb606440800 20 remove_watcher() i=4 2024-09-12T00:54:37.987 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.988+0000 7fb606440800 20 remove_watcher() i=5 2024-09-12T00:54:37.988 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.989+0000 7fb606440800 20 remove_watcher() i=6 2024-09-12T00:54:37.989 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:37.990+0000 7fb606440800 20 remove_watcher() i=7 2024-09-12T00:54:38.002 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.002 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:54:38.003 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-change-reshard-state id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:38.003 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.004 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:54:38.038 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:38.039 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:38.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.079+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.081+0000 7f15a0613800 20 realm 2024-09-12T00:54:38.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.081+0000 7f15a0613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:38.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.081 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.082+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:38.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.082+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.083+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:38.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.083+0000 7f15a0613800 20 searching for the correct realm 2024-09-12T00:54:38.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.086+0000 7f159b547640 0 -- 172.21.15.62:0/2219204163 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f159400e8d0 msgr2=0x7f159401f3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:38.290 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.291+0000 7f159c549640 0 -- 172.21.15.62:0/2219204163 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55ee71a94370 msgr2=0x55ee71a967e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:38.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:38.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:38.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:38.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:38.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:38.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:38.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.295+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.295+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.295+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.295 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:38.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:38.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.296+0000 7f15a0613800 20 zone default found 2024-09-12T00:54:38.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.296+0000 7f15a0613800 4 Realm: () 2024-09-12T00:54:38.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.296+0000 7f15a0613800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:38.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.296+0000 7f15a0613800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:38.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.296+0000 7f15a0613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:38.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.296+0000 7f15a0613800 20 zonegroup default 2024-09-12T00:54:38.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.297+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.297+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.297 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.297+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.297+0000 7f15a0613800 20 started sync module instance, tier type = 2024-09-12T00:54:38.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.297+0000 7f15a0613800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:38.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=0 2024-09-12T00:54:38.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=1 2024-09-12T00:54:38.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=2 2024-09-12T00:54:38.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=3 2024-09-12T00:54:38.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=4 2024-09-12T00:54:38.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=5 2024-09-12T00:54:38.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=6 2024-09-12T00:54:38.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.307+0000 7f15a0613800 20 add_watcher() i=7 2024-09-12T00:54:38.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.307+0000 7f15a0613800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:38.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.308+0000 7f1451fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:38.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.309+0000 7f15a0613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:38.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.309+0000 7f15a0613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:38.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.309+0000 7f15a0613800 5 note: GC not initialized 2024-09-12T00:54:38.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.309+0000 7f1450fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:38.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.309+0000 7f15a0613800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:38.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.309+0000 7f15a0613800 20 Filter name: none 2024-09-12T00:54:38.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.309+0000 7f13ca7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:38.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.309+0000 7f15a0613800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:54:38.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.309+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.310+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:38.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.310+0000 7f15a0613800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:54:38.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.310+0000 7f15a0613800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:54:38.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.310+0000 7f15a0613800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 : miss 2024-09-12T00:54:38.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.310+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.310+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:38.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.310+0000 7f15a0613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:54:38.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.310+0000 7f15a0613800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:54:38.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.310+0000 7f15a0613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:38.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.310+0000 7f15a0613800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:38.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.310+0000 7f15a0613800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 2024-09-12T00:54:38.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.314+0000 7f15a0613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:54:38.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.314+0000 7f15a0613800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:54:38.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.314+0000 7f15a0613800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:38.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.314+0000 7f15a0613800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39, ofs0, ns] 2024-09-12T00:54:38.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.314+0000 7f147affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 94482597503600 notifier 7562 bl.length()=931 2024-09-12T00:54:38.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.314+0000 7f147affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:54:38.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.314+0000 7f147affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:54:38.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.314+0000 7f147affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:38.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.316+0000 7f15a0613800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): orig_sources= new_sources= 2024-09-12T00:54:38.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.316+0000 7f15a0613800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): potential sources added=[] removed=[] 2024-09-12T00:54:38.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.316+0000 7f15a0613800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): orig_dests= new_dests= 2024-09-12T00:54:38.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.316+0000 7f15a0613800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): potential dests added=[] removed=[] 2024-09-12T00:54:38.317 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.319+0000 7f15a0613800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.1.0 2024-09-12T00:54:38.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.319+0000 7f15a0613800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.1.0 2024-09-12T00:54:38.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.319+0000 7f15a0613800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.1.1 2024-09-12T00:54:38.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.319+0000 7f15a0613800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.1.1 2024-09-12T00:54:38.318 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.319+0000 7f15a0613800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.0 2024-09-12T00:54:38.320 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f15a0613800 time 2024-09-12T00:54:38.322264+0000 2024-09-12T00:54:38.320 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:38.321 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:38.321 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f15a178c71a] 2024-09-12T00:54:38.321 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f15a178c8d8] 2024-09-12T00:54:38.321 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee70be4641] 2024-09-12T00:54:38.321 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55ee70bf351b] 2024-09-12T00:54:38.321 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ee70bf43e4] 2024-09-12T00:54:38.321 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:54:38.321 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f15a0429590] 2024-09-12T00:54:38.321 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:54:38.321 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:54:38.322 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.322+0000 7f15a0613800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f15a0613800 time 2024-09-12T00:54:38.322264+0000 2024-09-12T00:54:38.322 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:38.322 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.322 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:38.322 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f15a178c71a] 2024-09-12T00:54:38.322 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f15a178c8d8] 2024-09-12T00:54:38.322 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee70be4641] 2024-09-12T00:54:38.322 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55ee70bf351b] 2024-09-12T00:54:38.322 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ee70bf43e4] 2024-09-12T00:54:38.322 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:54:38.322 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f15a0429590] 2024-09-12T00:54:38.322 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:54:38.323 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:54:38.323 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.323 INFO:tasks.workunit.client.0.smithi062.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:54:38.323 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f15a0613800 thread_name:radosgw-admin 2024-09-12T00:54:38.337 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:38.338 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f15a043e6f0] 2024-09-12T00:54:38.338 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f15a048b99c] 2024-09-12T00:54:38.338 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:54:38.338 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:54:38.338 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f15a178c774] 2024-09-12T00:54:38.338 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f15a178c8d8] 2024-09-12T00:54:38.338 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee70be4641] 2024-09-12T00:54:38.338 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55ee70bf351b] 2024-09-12T00:54:38.338 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ee70bf43e4] 2024-09-12T00:54:38.338 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:54:38.338 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f15a0429590] 2024-09-12T00:54:38.339 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:54:38.339 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:54:38.339 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.323+0000 7f15a0613800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:38.339 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f15a0613800 thread_name:radosgw-admin 2024-09-12T00:54:38.339 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.339 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:38.339 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f15a043e6f0] 2024-09-12T00:54:38.339 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f15a048b99c] 2024-09-12T00:54:38.339 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:54:38.339 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:54:38.339 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f15a178c774] 2024-09-12T00:54:38.339 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f15a178c8d8] 2024-09-12T00:54:38.339 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee70be4641] 2024-09-12T00:54:38.340 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55ee70bf351b] 2024-09-12T00:54:38.340 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ee70bf43e4] 2024-09-12T00:54:38.340 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:54:38.340 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f15a0429590] 2024-09-12T00:54:38.340 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:54:38.340 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:54:38.340 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:38.340 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.340 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:54:38.340 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:54:38.062+0000 7f15a0613800 10 monclient: shutdown 2024-09-12T00:54:38.340 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 asok(0x55ee71787630) unregister_commands rotate-key 2024-09-12T00:54:38.340 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:54:38.062+0000 7f15a0613800 10 monclient: build_initial_monmap 2024-09-12T00:54:38.341 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:54:38.062+0000 7f15a0613800 1 build_initial for_mkfs: 0 2024-09-12T00:54:38.341 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:54:38.062+0000 7f15a0613800 10 monclient: monmap: 2024-09-12T00:54:38.341 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:38.341 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:38.341 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:38.341 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:38.341 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:38.341 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.341 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:38.341 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:38.341 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:38.341 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.342 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding auth protocol: cephx 2024-09-12T00:54:38.342 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding auth protocol: cephx 2024-09-12T00:54:38.342 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding auth protocol: cephx 2024-09-12T00:54:38.342 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: secure 2024-09-12T00:54:38.342 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: crc 2024-09-12T00:54:38.342 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: secure 2024-09-12T00:54:38.342 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: crc 2024-09-12T00:54:38.342 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: secure 2024-09-12T00:54:38.342 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: crc 2024-09-12T00:54:38.342 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: crc 2024-09-12T00:54:38.342 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: secure 2024-09-12T00:54:38.342 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: crc 2024-09-12T00:54:38.342 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: secure 2024-09-12T00:54:38.343 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: crc 2024-09-12T00:54:38.343 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: secure 2024-09-12T00:54:38.343 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:54:38.062+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.343 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:54:38.062+0000 7f15a0613800 1 librados: starting msgr at 2024-09-12T00:54:38.343 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:54:38.062+0000 7f15a0613800 1 librados: starting objecter 2024-09-12T00:54:38.343 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 asok(0x55ee71787630) register_command objecter_requests hook 0x55ee719af4f0 2024-09-12T00:54:38.343 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:54:38.062+0000 7f15a0613800 1 librados: setting wanted keys 2024-09-12T00:54:38.343 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:54:38.062+0000 7f15a0613800 1 librados: calling monclient init 2024-09-12T00:54:38.343 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:54:38.062+0000 7f15a0613800 10 monclient: init 2024-09-12T00:54:38.343 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding auth protocol: cephx 2024-09-12T00:54:38.343 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding auth protocol: cephx 2024-09-12T00:54:38.343 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding auth protocol: cephx 2024-09-12T00:54:38.343 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: secure 2024-09-12T00:54:38.344 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: crc 2024-09-12T00:54:38.344 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: secure 2024-09-12T00:54:38.344 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: crc 2024-09-12T00:54:38.344 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: secure 2024-09-12T00:54:38.344 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: crc 2024-09-12T00:54:38.344 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: crc 2024-09-12T00:54:38.344 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: secure 2024-09-12T00:54:38.344 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: crc 2024-09-12T00:54:38.344 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: secure 2024-09-12T00:54:38.344 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: crc 2024-09-12T00:54:38.344 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: secure 2024-09-12T00:54:38.345 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:54:38.063+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.345 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:54:38.063+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.345 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 asok(0x55ee71787630) register_command rotate-key hook 0x55ee719a9fe8 2024-09-12T00:54:38.345 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:38.345 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:54:38.345 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-a con 0x55ee71853100 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:38.345 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-b con 0x55ee7185fda0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:38.345 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-c con 0x55ee718ed030 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:38.345 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.345 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.345 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.346 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:38.346 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): authenticate will time out at 2164.556538s 2024-09-12T00:54:38.346 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): get_auth_request con 0x55ee71853100 auth_method 0 2024-09-12T00:54:38.346 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.346 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.346 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.346 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:54:38.063+0000 7f159c549640 10 monclient(hunting): get_auth_request con 0x55ee718ed030 auth_method 0 2024-09-12T00:54:38.346 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:54:38.063+0000 7f159c549640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.346 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:54:38.063+0000 7f159c549640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.346 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:54:38.063+0000 7f159c549640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.346 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.346 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.347 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.347 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:54:38.063+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.347 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:54:38.063+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.347 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:54:38.063+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.347 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:54:38.063+0000 7f159b547640 10 monclient(hunting): get_auth_request con 0x55ee7185fda0 auth_method 0 2024-09-12T00:54:38.347 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:54:38.063+0000 7f159b547640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.347 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:54:38.063+0000 7f159b547640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.347 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:54:38.063+0000 7f159b547640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.347 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): handle_auth_done global_id 7992 payload 824 2024-09-12T00:54:38.347 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient: _finish_hunting 0 2024-09-12T00:54:38.347 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:54:38.063+0000 7f159bd48640 1 monclient: found mon.noname-a 2024-09-12T00:54:38.347 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:54:38.348 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.348 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:38.348 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: dump: 2024-09-12T00:54:38.348 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.348 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.348 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.348 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.348 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.348 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.348 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.348 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.349 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.349 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.349 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: _finish_auth 0 2024-09-12T00:54:38.349 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: _check_auth_tickets 2024-09-12T00:54:38.349 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:38.349 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.349 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:38.349 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: dump: 2024-09-12T00:54:38.349 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.349 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.349 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.349 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.349 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.350 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.350 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.350 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.350 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.350 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.350 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:54:38.064+0000 7f15a0613800 5 monclient: authenticate success, global_id 7992 2024-09-12T00:54:38.350 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:54:38.064+0000 7f15a0613800 10 monclient: _renew_subs 2024-09-12T00:54:38.350 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:54:38.064+0000 7f15a0613800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:38.350 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:54:38.064+0000 7f1489e0b640 4 set_mon_vals no callback set 2024-09-12T00:54:38.350 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:54:38.064+0000 7f15a0613800 10 monclient: _renew_subs 2024-09-12T00:54:38.350 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:54:38.064+0000 7f15a0613800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:38.350 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:54:38.064+0000 7f15a0613800 1 librados: init done 2024-09-12T00:54:38.350 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:54:38.066+0000 7f1483fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:38.351 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:54:38.066+0000 7f1483fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:38.351 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:54:38.066+0000 7f1483fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:38.351 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:54:38.066+0000 7f159b547640 10 monclient: get_auth_request con 0x7f1484076470 auth_method 0 2024-09-12T00:54:38.351 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:54:38.066+0000 7f159c549640 10 monclient: get_auth_request con 0x55ee719d21f0 auth_method 0 2024-09-12T00:54:38.351 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:54:38.067+0000 7f159bd48640 10 monclient: get_auth_request con 0x55ee719f52d0 auth_method 0 2024-09-12T00:54:38.351 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:54:38.068+0000 7f159b547640 10 monclient: get_auth_request con 0x55ee719f99c0 auth_method 0 2024-09-12T00:54:38.351 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:54:38.069+0000 7f15a0613800 10 monclient: build_initial_monmap 2024-09-12T00:54:38.351 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:54:38.069+0000 7f15a0613800 1 build_initial for_mkfs: 0 2024-09-12T00:54:38.351 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:54:38.069+0000 7f15a0613800 10 monclient: monmap: 2024-09-12T00:54:38.351 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:38.351 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:38.351 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:38.351 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:38.352 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:38.352 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.352 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:38.352 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:38.352 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:38.352 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.352 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding auth protocol: cephx 2024-09-12T00:54:38.352 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding auth protocol: cephx 2024-09-12T00:54:38.352 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding auth protocol: cephx 2024-09-12T00:54:38.352 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: secure 2024-09-12T00:54:38.352 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: crc 2024-09-12T00:54:38.352 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: secure 2024-09-12T00:54:38.353 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: crc 2024-09-12T00:54:38.353 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: secure 2024-09-12T00:54:38.353 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: crc 2024-09-12T00:54:38.353 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: crc 2024-09-12T00:54:38.353 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: secure 2024-09-12T00:54:38.353 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: crc 2024-09-12T00:54:38.353 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: secure 2024-09-12T00:54:38.353 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: crc 2024-09-12T00:54:38.353 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: secure 2024-09-12T00:54:38.353 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:54:38.069+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.353 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 asok(0x55ee71787630) register_command objecter_requests cmddesc objecter_requests hook 0x55ee71a02040 EEXIST 2024-09-12T00:54:38.353 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient: init 2024-09-12T00:54:38.354 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding auth protocol: cephx 2024-09-12T00:54:38.354 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding auth protocol: cephx 2024-09-12T00:54:38.354 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding auth protocol: cephx 2024-09-12T00:54:38.354 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: secure 2024-09-12T00:54:38.354 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: crc 2024-09-12T00:54:38.354 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: secure 2024-09-12T00:54:38.354 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: crc 2024-09-12T00:54:38.354 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: secure 2024-09-12T00:54:38.354 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: crc 2024-09-12T00:54:38.354 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: crc 2024-09-12T00:54:38.354 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: secure 2024-09-12T00:54:38.354 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: crc 2024-09-12T00:54:38.354 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: secure 2024-09-12T00:54:38.355 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: crc 2024-09-12T00:54:38.355 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: secure 2024-09-12T00:54:38.355 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:54:38.070+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.355 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:54:38.070+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.355 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 asok(0x55ee71787630) register_command rotate-key cmddesc rotate-key hook 0x55ee719fcf30 EEXIST 2024-09-12T00:54:38.355 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:38.355 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:54:38.355 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-a con 0x55ee71a25d30 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:38.355 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-c con 0x55ee71a28000 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:38.355 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-b con 0x55ee71a24500 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:38.355 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.355 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.355 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.356 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:38.356 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): authenticate will time out at 2164.563703s 2024-09-12T00:54:38.356 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:54:38.070+0000 7f159bd48640 10 monclient(hunting): get_auth_request con 0x55ee71a25d30 auth_method 0 2024-09-12T00:54:38.356 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:54:38.070+0000 7f159bd48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.356 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:54:38.070+0000 7f159bd48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.356 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:54:38.070+0000 7f159bd48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.356 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:54:38.070+0000 7f159b547640 10 monclient(hunting): get_auth_request con 0x55ee71a28000 auth_method 0 2024-09-12T00:54:38.356 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:54:38.070+0000 7f159b547640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.356 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:54:38.070+0000 7f159b547640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.356 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:54:38.070+0000 7f159b547640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.356 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:54:38.070+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.356 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:54:38.070+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.356 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:54:38.070+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.357 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:54:38.070+0000 7f159c549640 10 monclient(hunting): get_auth_request con 0x55ee71a24500 auth_method 0 2024-09-12T00:54:38.357 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:54:38.070+0000 7f159c549640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.357 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:54:38.070+0000 7f159c549640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.357 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:54:38.070+0000 7f159c549640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.357 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:54:38.070+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.357 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:54:38.070+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.357 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:54:38.070+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.357 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:54:38.071+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.357 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:54:38.071+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.357 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:54:38.071+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.357 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:54:38.071+0000 7f159bd48640 10 monclient(hunting): handle_auth_done global_id 7995 payload 824 2024-09-12T00:54:38.357 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:54:38.071+0000 7f159bd48640 10 monclient: _finish_hunting 0 2024-09-12T00:54:38.357 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:54:38.071+0000 7f159bd48640 1 monclient: found mon.noname-a 2024-09-12T00:54:38.358 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:54:38.071+0000 7f159bd48640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:54:38.358 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.358 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:38.358 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: dump: 2024-09-12T00:54:38.358 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.358 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.358 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.358 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.358 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.358 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.358 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.358 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.358 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.359 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.359 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: _finish_auth 0 2024-09-12T00:54:38.359 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: _check_auth_tickets 2024-09-12T00:54:38.359 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:38.359 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.359 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:38.359 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: dump: 2024-09-12T00:54:38.359 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.359 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.359 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.359 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.359 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.359 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.360 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.360 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.360 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.360 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.360 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:54:38.071+0000 7f15a0613800 5 monclient: authenticate success, global_id 7995 2024-09-12T00:54:38.360 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:54:38.071+0000 7f15a0613800 10 monclient: _renew_subs 2024-09-12T00:54:38.360 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:54:38.071+0000 7f159cd4a640 4 set_mon_vals no callback set 2024-09-12T00:54:38.360 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:54:38.071+0000 7f15a0613800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:38.360 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:54:38.071+0000 7f15a0613800 10 monclient: _renew_subs 2024-09-12T00:54:38.360 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:54:38.071+0000 7f15a0613800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:38.360 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:54:38.073+0000 7f14817fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:38.360 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:54:38.073+0000 7f14817fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:38.361 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:54:38.073+0000 7f14817fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:38.361 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:54:38.073+0000 7f15a0613800 10 monclient: get_monmap_and_config 2024-09-12T00:54:38.361 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:54:38.073+0000 7f15a0613800 10 monclient: build_initial_monmap 2024-09-12T00:54:38.361 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:54:38.073+0000 7f15a0613800 1 build_initial for_mkfs: 0 2024-09-12T00:54:38.361 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:54:38.073+0000 7f159b547640 10 monclient: get_auth_request con 0x7f1474076380 auth_method 0 2024-09-12T00:54:38.361 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:54:38.073+0000 7f15a0613800 10 monclient: monmap: 2024-09-12T00:54:38.361 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:38.361 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:38.361 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:38.361 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:38.361 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:38.361 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.362 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:38.362 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:38.362 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:38.362 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.362 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding auth protocol: cephx 2024-09-12T00:54:38.362 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding auth protocol: cephx 2024-09-12T00:54:38.362 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding auth protocol: cephx 2024-09-12T00:54:38.362 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: secure 2024-09-12T00:54:38.362 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: crc 2024-09-12T00:54:38.362 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: secure 2024-09-12T00:54:38.362 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: crc 2024-09-12T00:54:38.362 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: secure 2024-09-12T00:54:38.362 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: crc 2024-09-12T00:54:38.363 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: crc 2024-09-12T00:54:38.363 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: secure 2024-09-12T00:54:38.363 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: crc 2024-09-12T00:54:38.363 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: secure 2024-09-12T00:54:38.363 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: crc 2024-09-12T00:54:38.363 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: secure 2024-09-12T00:54:38.363 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:54:38.074+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.363 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient: init 2024-09-12T00:54:38.363 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding auth protocol: cephx 2024-09-12T00:54:38.363 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding auth protocol: cephx 2024-09-12T00:54:38.363 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding auth protocol: cephx 2024-09-12T00:54:38.363 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: secure 2024-09-12T00:54:38.364 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: crc 2024-09-12T00:54:38.364 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: secure 2024-09-12T00:54:38.364 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: crc 2024-09-12T00:54:38.364 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: secure 2024-09-12T00:54:38.364 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: crc 2024-09-12T00:54:38.364 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: crc 2024-09-12T00:54:38.364 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: secure 2024-09-12T00:54:38.364 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: crc 2024-09-12T00:54:38.364 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: secure 2024-09-12T00:54:38.364 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: crc 2024-09-12T00:54:38.364 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: secure 2024-09-12T00:54:38.364 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:54:38.074+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.364 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:54:38.074+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.365 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 asok(0x55ee71787630) register_command rotate-key cmddesc rotate-key hook 0x7ffdc250d598 EEXIST 2024-09-12T00:54:38.365 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:38.365 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:54:38.365 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-a con 0x55ee71a7a1a0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:38.365 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-c con 0x55ee71a49d00 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:38.365 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-b con 0x55ee71a46c30 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:38.365 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.365 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.365 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.365 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:38.365 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): authenticate will time out at 2164.567826s 2024-09-12T00:54:38.365 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:54:38.074+0000 7f159bd48640 10 monclient(hunting): get_auth_request con 0x55ee71a7a1a0 auth_method 0 2024-09-12T00:54:38.366 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:54:38.074+0000 7f159bd48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.366 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:54:38.074+0000 7f159bd48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.366 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:54:38.074+0000 7f159bd48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.366 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:54:38.074+0000 7f159b547640 10 monclient(hunting): get_auth_request con 0x55ee71a49d00 auth_method 0 2024-09-12T00:54:38.366 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:54:38.074+0000 7f159b547640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.366 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:54:38.074+0000 7f159b547640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.366 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:54:38.074+0000 7f159b547640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.366 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:54:38.074+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.366 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:54:38.074+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.366 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:54:38.074+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.366 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:54:38.075+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.366 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:54:38.075+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.367 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:54:38.075+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.367 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:54:38.075+0000 7f159c549640 10 monclient(hunting): get_auth_request con 0x55ee71a46c30 auth_method 0 2024-09-12T00:54:38.367 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:54:38.075+0000 7f159c549640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.367 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:54:38.075+0000 7f159c549640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.367 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:54:38.075+0000 7f159c549640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.367 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:54:38.075+0000 7f159bd48640 10 monclient(hunting): handle_auth_done global_id 7998 payload 274 2024-09-12T00:54:38.367 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:54:38.075+0000 7f159bd48640 10 monclient: _finish_hunting 0 2024-09-12T00:54:38.367 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:54:38.075+0000 7f159bd48640 1 monclient: found mon.noname-a 2024-09-12T00:54:38.367 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:54:38.075+0000 7f159bd48640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:54:38.367 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.367 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:38.367 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: dump: 2024-09-12T00:54:38.368 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.368 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.368 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.368 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.368 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.368 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.368 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.368 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.368 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.368 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.368 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: _finish_auth 0 2024-09-12T00:54:38.368 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: _check_auth_tickets 2024-09-12T00:54:38.369 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:38.369 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:54:38.075+0000 7f15a0613800 5 monclient: authenticate success, global_id 7998 2024-09-12T00:54:38.369 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:54:38.075+0000 7f15a0613800 10 monclient: get_monmap_and_config success 2024-09-12T00:54:38.369 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:54:38.075+0000 7f15a0613800 4 set_mon_vals no callback set 2024-09-12T00:54:38.369 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.369 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:38.369 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: dump: 2024-09-12T00:54:38.369 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.369 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.369 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.369 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.369 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.370 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.370 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.370 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.370 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.370 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.370 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:54:38.075+0000 7f15a0613800 10 monclient: shutdown 2024-09-12T00:54:38.370 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient: build_initial_monmap 2024-09-12T00:54:38.370 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:54:38.076+0000 7f15a0613800 1 build_initial for_mkfs: 0 2024-09-12T00:54:38.370 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient: monmap: 2024-09-12T00:54:38.370 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:38.370 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:38.370 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:38.370 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:38.371 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:38.371 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.371 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:38.371 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:38.371 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:38.371 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.371 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding auth protocol: cephx 2024-09-12T00:54:38.371 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding auth protocol: cephx 2024-09-12T00:54:38.371 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding auth protocol: cephx 2024-09-12T00:54:38.371 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: secure 2024-09-12T00:54:38.371 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: crc 2024-09-12T00:54:38.371 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: secure 2024-09-12T00:54:38.371 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: crc 2024-09-12T00:54:38.372 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: secure 2024-09-12T00:54:38.372 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: crc 2024-09-12T00:54:38.372 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: crc 2024-09-12T00:54:38.372 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: secure 2024-09-12T00:54:38.372 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: crc 2024-09-12T00:54:38.372 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: secure 2024-09-12T00:54:38.372 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: crc 2024-09-12T00:54:38.372 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: secure 2024-09-12T00:54:38.372 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:54:38.076+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.372 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:54:38.076+0000 7f15a0613800 1 librados: starting msgr at 2024-09-12T00:54:38.372 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:54:38.076+0000 7f15a0613800 1 librados: starting objecter 2024-09-12T00:54:38.372 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 asok(0x55ee71787630) register_command objecter_requests cmddesc objecter_requests hook 0x55ee71a48360 EEXIST 2024-09-12T00:54:38.373 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:54:38.076+0000 7f15a0613800 1 librados: setting wanted keys 2024-09-12T00:54:38.373 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:54:38.076+0000 7f15a0613800 1 librados: calling monclient init 2024-09-12T00:54:38.373 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient: init 2024-09-12T00:54:38.373 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding auth protocol: cephx 2024-09-12T00:54:38.373 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding auth protocol: cephx 2024-09-12T00:54:38.373 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding auth protocol: cephx 2024-09-12T00:54:38.373 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: secure 2024-09-12T00:54:38.373 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: crc 2024-09-12T00:54:38.373 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: secure 2024-09-12T00:54:38.373 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: crc 2024-09-12T00:54:38.373 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: secure 2024-09-12T00:54:38.373 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: crc 2024-09-12T00:54:38.374 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: crc 2024-09-12T00:54:38.374 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: secure 2024-09-12T00:54:38.374 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: crc 2024-09-12T00:54:38.374 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: secure 2024-09-12T00:54:38.374 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: crc 2024-09-12T00:54:38.374 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: secure 2024-09-12T00:54:38.374 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:54:38.076+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.374 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:54:38.076+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.374 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 asok(0x55ee71787630) register_command rotate-key cmddesc rotate-key hook 0x55ee71a3dc28 EEXIST 2024-09-12T00:54:38.374 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:38.374 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:38.374 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-b con 0x55ee71a46c30 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:38.374 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-c con 0x55ee71a49d00 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:38.375 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-a con 0x55ee71a7a1a0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:38.375 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.375 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.375 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.375 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:54:38.077+0000 7f15a0613800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:38.375 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:54:38.077+0000 7f15a0613800 10 monclient(hunting): authenticate will time out at 2164.570012s 2024-09-12T00:54:38.375 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): get_auth_request con 0x55ee71a49d00 auth_method 0 2024-09-12T00:54:38.375 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.375 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.375 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.375 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:54:38.077+0000 7f159c549640 10 monclient(hunting): get_auth_request con 0x55ee71a7a1a0 auth_method 0 2024-09-12T00:54:38.375 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:54:38.077+0000 7f159c549640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.376 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:54:38.077+0000 7f159c549640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.376 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:54:38.077+0000 7f159c549640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.376 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.376 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.376 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.376 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:54:38.077+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.376 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:54:38.077+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.376 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:54:38.077+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.376 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:54:38.077+0000 7f159bd48640 10 monclient(hunting): get_auth_request con 0x55ee71a46c30 auth_method 0 2024-09-12T00:54:38.376 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:54:38.077+0000 7f159bd48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.376 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:54:38.077+0000 7f159bd48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.376 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:54:38.077+0000 7f159bd48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.376 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): handle_auth_done global_id 7562 payload 824 2024-09-12T00:54:38.377 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient: _finish_hunting 0 2024-09-12T00:54:38.377 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:54:38.077+0000 7f159b547640 1 monclient: found mon.noname-c 2024-09-12T00:54:38.377 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:54:38.377 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.377 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:38.377 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: dump: 2024-09-12T00:54:38.377 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.377 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.377 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.377 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.377 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.377 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.377 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.378 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.378 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.378 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.378 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: _finish_auth 0 2024-09-12T00:54:38.378 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: _check_auth_tickets 2024-09-12T00:54:38.378 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:38.378 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.378 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:38.378 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: dump: 2024-09-12T00:54:38.378 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.378 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.378 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.378 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.379 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.379 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.379 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.379 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.379 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.379 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.379 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:54:38.077+0000 7f15a0613800 5 monclient: authenticate success, global_id 7562 2024-09-12T00:54:38.379 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:54:38.077+0000 7f15a0613800 10 monclient: _renew_subs 2024-09-12T00:54:38.379 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:54:38.077+0000 7f147affd640 4 set_mon_vals no callback set 2024-09-12T00:54:38.379 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:54:38.077+0000 7f15a0613800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:54:38.379 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:54:38.077+0000 7f15a0613800 10 monclient: _renew_subs 2024-09-12T00:54:38.379 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:54:38.077+0000 7f15a0613800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:54:38.379 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:54:38.077+0000 7f15a0613800 1 librados: init done 2024-09-12T00:54:38.380 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:54:38.077+0000 7f15a0613800 5 asok(0x55ee71787630) register_command cr dump hook 0x7f158c0606d8 2024-09-12T00:54:38.380 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:54:38.079+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.380 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:54:38.080+0000 7f14797fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:38.380 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:54:38.080+0000 7f14797fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:38.380 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:54:38.080+0000 7f14797fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:38.380 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:54:38.080+0000 7f159bd48640 10 monclient: get_auth_request con 0x7f1464076470 auth_method 0 2024-09-12T00:54:38.380 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:54:38.080+0000 7f159c549640 10 monclient: get_auth_request con 0x55ee71a94370 auth_method 0 2024-09-12T00:54:38.380 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.380 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:54:38.081+0000 7f15a0613800 20 realm 2024-09-12T00:54:38.380 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.380 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.380 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:54:38.081+0000 7f15a0613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:38.381 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.381 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.381 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.381 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:54:38.082+0000 7f159bd48640 10 monclient: get_auth_request con 0x55ee71a98750 auth_method 0 2024-09-12T00:54:38.381 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:54:38.082+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:38.381 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:54:38.082+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.381 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:54:38.082+0000 7f159b547640 10 monclient: get_auth_request con 0x55ee71a9be90 auth_method 0 2024-09-12T00:54:38.381 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:54:38.083+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:38.381 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:54:38.083+0000 7f15a0613800 20 searching for the correct realm 2024-09-12T00:54:38.381 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:54:38.083+0000 7f159c549640 10 monclient: get_auth_request con 0x55ee71aa0c10 auth_method 0 2024-09-12T00:54:38.381 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:54:38.084+0000 7f159bd48640 10 monclient: get_auth_request con 0x7f159402d3f0 auth_method 0 2024-09-12T00:54:38.381 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:54:38.086+0000 7f159b547640 10 monclient: get_auth_request con 0x7f159400e8d0 auth_method 0 2024-09-12T00:54:38.381 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:54:38.086+0000 7f159b547640 0 -- 172.21.15.62:0/2219204163 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f159400e8d0 msgr2=0x7f159401f3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:38.382 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:54:38.287+0000 7f159b547640 10 monclient: get_auth_request con 0x7f159400e8d0 auth_method 0 2024-09-12T00:54:38.382 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:54:38.290+0000 7f159c549640 10 monclient: get_auth_request con 0x7f158c00e070 auth_method 0 2024-09-12T00:54:38.382 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:54:38.290+0000 7f159bd48640 10 monclient: get_auth_request con 0x7f159403c970 auth_method 0 2024-09-12T00:54:38.382 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:54:38.291+0000 7f159c549640 0 -- 172.21.15.62:0/2219204163 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55ee71a94370 msgr2=0x55ee71a967e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:38.382 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:54:38.291+0000 7f14797fa640 1 client.7562.objecter ms_handle_reset 0x55ee71a94370 session 0x55ee71a93cf0 osd.6 2024-09-12T00:54:38.382 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:54:38.291+0000 7f14797fa640 10 monclient: _renew_subs 2024-09-12T00:54:38.382 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:54:38.291+0000 7f14797fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:54:38.382 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:54:38.292+0000 7f159c549640 10 monclient: get_auth_request con 0x7f14640866a0 auth_method 0 2024-09-12T00:54:38.382 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:38.382 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:38.382 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:38.382 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:38.382 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:38.383 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:38.383 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.383 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.383 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.383 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:38.383 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.383 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:38.383 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 zone default found 2024-09-12T00:54:38.383 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:54:38.296+0000 7f15a0613800 4 Realm: () 2024-09-12T00:54:38.383 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:54:38.296+0000 7f15a0613800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:38.383 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:54:38.296+0000 7f15a0613800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:38.383 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:54:38.296+0000 7f15a0613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:38.383 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 zonegroup default 2024-09-12T00:54:38.384 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.384 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.384 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.384 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:54:38.297+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.384 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:54:38.297+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.384 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:54:38.297+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.384 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:54:38.297+0000 7f15a0613800 20 started sync module instance, tier type = 2024-09-12T00:54:38.384 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:54:38.297+0000 7f15a0613800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:38.384 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=0 2024-09-12T00:54:38.384 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=1 2024-09-12T00:54:38.384 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=2 2024-09-12T00:54:38.384 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=3 2024-09-12T00:54:38.384 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=4 2024-09-12T00:54:38.385 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=5 2024-09-12T00:54:38.385 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=6 2024-09-12T00:54:38.385 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:54:38.307+0000 7f15a0613800 20 add_watcher() i=7 2024-09-12T00:54:38.385 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:54:38.307+0000 7f15a0613800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:38.385 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding auth protocol: cephx 2024-09-12T00:54:38.385 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding auth protocol: cephx 2024-09-12T00:54:38.385 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding auth protocol: cephx 2024-09-12T00:54:38.385 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: secure 2024-09-12T00:54:38.385 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: crc 2024-09-12T00:54:38.385 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: secure 2024-09-12T00:54:38.385 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: crc 2024-09-12T00:54:38.385 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: secure 2024-09-12T00:54:38.386 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: crc 2024-09-12T00:54:38.386 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: crc 2024-09-12T00:54:38.386 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: secure 2024-09-12T00:54:38.386 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: crc 2024-09-12T00:54:38.386 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: secure 2024-09-12T00:54:38.386 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: crc 2024-09-12T00:54:38.386 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: secure 2024-09-12T00:54:38.386 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:54:38.308+0000 7f1451fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:38.386 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:54:38.309+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.386 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:54:38.309+0000 7f15a0613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:38.386 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:54:38.309+0000 7f15a0613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:38.386 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command cache list hook 0x55ee71a6b5d0 2024-09-12T00:54:38.387 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command cache inspect hook 0x55ee71a6b5d0 2024-09-12T00:54:38.387 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command cache erase hook 0x55ee71a6b5d0 2024-09-12T00:54:38.387 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command cache zap hook 0x55ee71a6b5d0 2024-09-12T00:54:38.387 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 note: GC not initialized 2024-09-12T00:54:38.387 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:54:38.309+0000 7f1450fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:38.387 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command sync trace show hook 0x7f158c04b070 2024-09-12T00:54:38.387 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command sync trace history hook 0x7f158c04b070 2024-09-12T00:54:38.387 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command sync trace active hook 0x7f158c04b070 2024-09-12T00:54:38.387 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command sync trace active_short hook 0x7f158c04b070 2024-09-12T00:54:38.387 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:54:38.309+0000 7f15a0613800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:38.387 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:54:38.309+0000 7f15a0613800 20 Filter name: none 2024-09-12T00:54:38.387 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:54:38.309+0000 7f13ca7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:38.388 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:54:38.309+0000 7f15a0613800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:54:38.388 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:54:38.309+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.388 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:54:38.310+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:38.388 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:54:38.388 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:54:38.388 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 : miss 2024-09-12T00:54:38.388 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:54:38.310+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.388 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:54:38.310+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:38.388 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:54:38.388 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:54:38.388 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:38.388 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:38.389 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 2024-09-12T00:54:38.389 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:54:38.314+0000 7f15a0613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:54:38.389 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:54:38.314+0000 7f15a0613800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:54:38.389 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:54:38.314+0000 7f15a0613800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:38.389 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:54:38.314+0000 7f15a0613800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39, ofs0, ns] 2024-09-12T00:54:38.389 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:54:38.314+0000 7f147affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 94482597503600 notifier 7562 bl.length()=931 2024-09-12T00:54:38.389 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:54:38.314+0000 7f147affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:54:38.389 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:54:38.314+0000 7f147affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:54:38.389 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:54:38.314+0000 7f147affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:38.389 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:54:38.316+0000 7f15a0613800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): orig_sources= new_sources= 2024-09-12T00:54:38.389 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:54:38.316+0000 7f15a0613800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): potential sources added=[] removed=[] 2024-09-12T00:54:38.389 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:54:38.316+0000 7f15a0613800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): orig_dests= new_dests= 2024-09-12T00:54:38.389 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:54:38.316+0000 7f15a0613800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): potential dests added=[] removed=[] 2024-09-12T00:54:38.390 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:54:38.319+0000 7f15a0613800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.1.0 2024-09-12T00:54:38.390 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:54:38.319+0000 7f15a0613800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.1.0 2024-09-12T00:54:38.390 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:54:38.319+0000 7f15a0613800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.1.1 2024-09-12T00:54:38.390 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:54:38.319+0000 7f15a0613800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.1.1 2024-09-12T00:54:38.390 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:54:38.319+0000 7f15a0613800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.0 2024-09-12T00:54:38.390 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:54:38.322+0000 7f15a0613800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f15a0613800 time 2024-09-12T00:54:38.322264+0000 2024-09-12T00:54:38.390 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:38.390 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.390 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:38.390 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f15a178c71a] 2024-09-12T00:54:38.390 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f15a178c8d8] 2024-09-12T00:54:38.390 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee70be4641] 2024-09-12T00:54:38.390 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55ee70bf351b] 2024-09-12T00:54:38.391 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ee70bf43e4] 2024-09-12T00:54:38.391 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:54:38.391 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f15a0429590] 2024-09-12T00:54:38.391 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:54:38.391 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:54:38.391 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.391 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:54:38.323+0000 7f15a0613800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:38.391 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f15a0613800 thread_name:radosgw-admin 2024-09-12T00:54:38.391 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.391 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:38.391 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f15a043e6f0] 2024-09-12T00:54:38.391 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f15a048b99c] 2024-09-12T00:54:38.391 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:54:38.392 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:54:38.392 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f15a178c774] 2024-09-12T00:54:38.392 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f15a178c8d8] 2024-09-12T00:54:38.392 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee70be4641] 2024-09-12T00:54:38.392 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55ee70bf351b] 2024-09-12T00:54:38.392 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ee70bf43e4] 2024-09-12T00:54:38.392 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:54:38.392 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f15a0429590] 2024-09-12T00:54:38.392 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:54:38.392 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:54:38.392 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:38.392 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.393 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:54:38.393 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:54:38.393 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:54:38.393 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:54:38.393 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:54:38.393 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:54:38.393 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:54:38.393 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:54:38.393 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:54:38.393 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:54:38.393 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:54:38.393 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:54:38.394 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:54:38.394 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:54:38.394 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:54:38.394 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:54:38.394 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:54:38.394 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:54:38.394 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:54:38.394 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:54:38.394 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:54:38.394 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:54:38.394 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:54:38.394 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:54:38.394 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:54:38.395 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:54:38.395 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:54:38.395 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:54:38.395 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:54:38.395 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:54:38.395 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:54:38.395 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:54:38.395 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:54:38.395 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:54:38.395 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:54:38.395 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:54:38.395 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:54:38.395 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:54:38.396 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:54:38.396 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:54:38.396 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:54:38.396 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:54:38.396 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:54:38.396 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:54:38.396 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:54:38.396 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:54:38.396 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:54:38.396 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:54:38.396 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:54:38.396 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:54:38.396 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:54:38.397 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:54:38.397 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:54:38.397 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:54:38.397 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:54:38.397 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:54:38.397 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:54:38.397 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:54:38.397 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:54:38.397 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:54:38.397 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:54:38.397 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:54:38.397 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:54:38.398 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:54:38.398 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:54:38.398 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:54:38.398 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:54:38.398 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:54:38.398 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:54:38.398 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:54:38.398 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:54:38.398 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:54:38.398 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:54:38.398 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:54:38.398 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:54:38.398 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:54:38.398 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:54:38.399 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:54:38.399 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:54:38.399 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:54:38.399 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:54:38.399 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:54:38.399 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:54:38.399 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:54:38.399 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:54:38.399 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:54:38.399 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:54:38.399 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:54:38.399 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:54:38.399 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:54:38.400 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:54:38.400 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:54:38.400 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:54:38.400 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:54:38.400 INFO:tasks.workunit.client.0.smithi062.stderr: 7f13ca7fc640 / http_manager 2024-09-12T00:54:38.400 INFO:tasks.workunit.client.0.smithi062.stderr: 7f1450fe1640 / http_manager 2024-09-12T00:54:38.400 INFO:tasks.workunit.client.0.smithi062.stderr: 7f1451fe3640 / rgw_dt_lg_renew 2024-09-12T00:54:38.400 INFO:tasks.workunit.client.0.smithi062.stderr: 7f14797fa640 / ms_dispatch 2024-09-12T00:54:38.400 INFO:tasks.workunit.client.0.smithi062.stderr: 7f147affd640 / io_context_pool 2024-09-12T00:54:38.400 INFO:tasks.workunit.client.0.smithi062.stderr: 7f14817fa640 / ms_dispatch 2024-09-12T00:54:38.400 INFO:tasks.workunit.client.0.smithi062.stderr: 7f1483fff640 / ms_dispatch 2024-09-12T00:54:38.400 INFO:tasks.workunit.client.0.smithi062.stderr: 7f1489e0b640 / io_context_pool 2024-09-12T00:54:38.401 INFO:tasks.workunit.client.0.smithi062.stderr: 7f159b547640 / msgr-worker-2 2024-09-12T00:54:38.401 INFO:tasks.workunit.client.0.smithi062.stderr: 7f159bd48640 / msgr-worker-1 2024-09-12T00:54:38.401 INFO:tasks.workunit.client.0.smithi062.stderr: 7f159c549640 / msgr-worker-0 2024-09-12T00:54:38.401 INFO:tasks.workunit.client.0.smithi062.stderr: 7f159cd4a640 / io_context_pool 2024-09-12T00:54:38.401 INFO:tasks.workunit.client.0.smithi062.stderr: 7f15a0613800 / radosgw-admin 2024-09-12T00:54:38.401 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:54:38.401 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:54:38.401 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/log/ceph/ceph-client.admin.142261.log 2024-09-12T00:54:38.401 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:54:38.401 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:54:38.401 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:54:38.062+0000 7f15a0613800 10 monclient: shutdown 2024-09-12T00:54:38.401 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 asok(0x55ee71787630) unregister_commands rotate-key 2024-09-12T00:54:38.401 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:54:38.062+0000 7f15a0613800 10 monclient: build_initial_monmap 2024-09-12T00:54:38.402 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:54:38.062+0000 7f15a0613800 1 build_initial for_mkfs: 0 2024-09-12T00:54:38.402 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:54:38.062+0000 7f15a0613800 10 monclient: monmap: 2024-09-12T00:54:38.402 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:38.402 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:38.402 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:38.402 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:38.402 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:38.402 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.402 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:38.402 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:38.402 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:38.402 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.402 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding auth protocol: cephx 2024-09-12T00:54:38.403 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding auth protocol: cephx 2024-09-12T00:54:38.403 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding auth protocol: cephx 2024-09-12T00:54:38.403 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: secure 2024-09-12T00:54:38.403 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: crc 2024-09-12T00:54:38.403 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: secure 2024-09-12T00:54:38.403 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: crc 2024-09-12T00:54:38.403 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: secure 2024-09-12T00:54:38.403 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: crc 2024-09-12T00:54:38.403 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: crc 2024-09-12T00:54:38.403 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: secure 2024-09-12T00:54:38.403 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: crc 2024-09-12T00:54:38.403 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: secure 2024-09-12T00:54:38.404 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: crc 2024-09-12T00:54:38.404 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 AuthRegistry(0x55ee719ad4c0) adding con mode: secure 2024-09-12T00:54:38.404 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:54:38.062+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.404 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:54:38.062+0000 7f15a0613800 1 librados: starting msgr at 2024-09-12T00:54:38.404 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:54:38.062+0000 7f15a0613800 1 librados: starting objecter 2024-09-12T00:54:38.404 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:54:38.062+0000 7f15a0613800 5 asok(0x55ee71787630) register_command objecter_requests hook 0x55ee719af4f0 2024-09-12T00:54:38.404 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:54:38.062+0000 7f15a0613800 1 librados: setting wanted keys 2024-09-12T00:54:38.404 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:54:38.062+0000 7f15a0613800 1 librados: calling monclient init 2024-09-12T00:54:38.404 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:54:38.062+0000 7f15a0613800 10 monclient: init 2024-09-12T00:54:38.404 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding auth protocol: cephx 2024-09-12T00:54:38.404 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding auth protocol: cephx 2024-09-12T00:54:38.404 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding auth protocol: cephx 2024-09-12T00:54:38.404 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: secure 2024-09-12T00:54:38.405 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: crc 2024-09-12T00:54:38.405 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: secure 2024-09-12T00:54:38.405 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: crc 2024-09-12T00:54:38.405 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: secure 2024-09-12T00:54:38.405 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: crc 2024-09-12T00:54:38.405 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: crc 2024-09-12T00:54:38.405 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: secure 2024-09-12T00:54:38.405 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: crc 2024-09-12T00:54:38.405 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: secure 2024-09-12T00:54:38.405 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: crc 2024-09-12T00:54:38.405 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 AuthRegistry(0x55ee719a9ea0) adding con mode: secure 2024-09-12T00:54:38.405 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:54:38.063+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.405 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:54:38.063+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.406 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:54:38.063+0000 7f15a0613800 5 asok(0x55ee71787630) register_command rotate-key hook 0x55ee719a9fe8 2024-09-12T00:54:38.406 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:38.406 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:54:38.406 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-a con 0x55ee71853100 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:38.406 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-b con 0x55ee7185fda0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:38.406 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-c con 0x55ee718ed030 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:38.406 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.406 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.406 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.406 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:38.406 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:54:38.063+0000 7f15a0613800 10 monclient(hunting): authenticate will time out at 2164.556538s 2024-09-12T00:54:38.406 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): get_auth_request con 0x55ee71853100 auth_method 0 2024-09-12T00:54:38.406 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.407 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.407 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.407 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:54:38.063+0000 7f159c549640 10 monclient(hunting): get_auth_request con 0x55ee718ed030 auth_method 0 2024-09-12T00:54:38.407 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:54:38.063+0000 7f159c549640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.407 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:54:38.063+0000 7f159c549640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.407 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:54:38.063+0000 7f159c549640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.407 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.407 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.407 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.407 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:54:38.063+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.407 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:54:38.063+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.407 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:54:38.063+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.408 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:54:38.063+0000 7f159b547640 10 monclient(hunting): get_auth_request con 0x55ee7185fda0 auth_method 0 2024-09-12T00:54:38.408 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:54:38.063+0000 7f159b547640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.408 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:54:38.063+0000 7f159b547640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.408 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:54:38.063+0000 7f159b547640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.408 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient(hunting): handle_auth_done global_id 7992 payload 824 2024-09-12T00:54:38.408 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient: _finish_hunting 0 2024-09-12T00:54:38.408 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:54:38.063+0000 7f159bd48640 1 monclient: found mon.noname-a 2024-09-12T00:54:38.408 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:54:38.063+0000 7f159bd48640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:54:38.408 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.408 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:38.408 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: dump: 2024-09-12T00:54:38.408 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.408 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.409 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.409 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.409 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.409 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.409 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.409 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.409 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.409 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.409 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: _finish_auth 0 2024-09-12T00:54:38.409 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: _check_auth_tickets 2024-09-12T00:54:38.409 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:38.409 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.410 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:38.410 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:54:38.064+0000 7f1483fff640 10 monclient: dump: 2024-09-12T00:54:38.410 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.410 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.410 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.410 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.410 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.410 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.410 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.410 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.410 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.410 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.411 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:54:38.064+0000 7f15a0613800 5 monclient: authenticate success, global_id 7992 2024-09-12T00:54:38.411 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:54:38.064+0000 7f15a0613800 10 monclient: _renew_subs 2024-09-12T00:54:38.411 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:54:38.064+0000 7f15a0613800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:38.411 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:54:38.064+0000 7f1489e0b640 4 set_mon_vals no callback set 2024-09-12T00:54:38.411 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:54:38.064+0000 7f15a0613800 10 monclient: _renew_subs 2024-09-12T00:54:38.411 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:54:38.064+0000 7f15a0613800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:38.411 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:54:38.064+0000 7f15a0613800 1 librados: init done 2024-09-12T00:54:38.411 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:54:38.066+0000 7f1483fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:38.411 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:54:38.066+0000 7f1483fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:38.411 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:54:38.066+0000 7f1483fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:38.411 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:54:38.066+0000 7f159b547640 10 monclient: get_auth_request con 0x7f1484076470 auth_method 0 2024-09-12T00:54:38.411 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:54:38.066+0000 7f159c549640 10 monclient: get_auth_request con 0x55ee719d21f0 auth_method 0 2024-09-12T00:54:38.411 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:54:38.067+0000 7f159bd48640 10 monclient: get_auth_request con 0x55ee719f52d0 auth_method 0 2024-09-12T00:54:38.412 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:54:38.068+0000 7f159b547640 10 monclient: get_auth_request con 0x55ee719f99c0 auth_method 0 2024-09-12T00:54:38.412 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:54:38.069+0000 7f15a0613800 10 monclient: build_initial_monmap 2024-09-12T00:54:38.412 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:54:38.069+0000 7f15a0613800 1 build_initial for_mkfs: 0 2024-09-12T00:54:38.412 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:54:38.069+0000 7f15a0613800 10 monclient: monmap: 2024-09-12T00:54:38.412 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:38.412 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:38.412 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:38.412 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:38.412 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:38.412 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.412 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:38.412 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:38.412 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:38.413 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.413 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding auth protocol: cephx 2024-09-12T00:54:38.413 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding auth protocol: cephx 2024-09-12T00:54:38.413 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding auth protocol: cephx 2024-09-12T00:54:38.413 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: secure 2024-09-12T00:54:38.413 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: crc 2024-09-12T00:54:38.413 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: secure 2024-09-12T00:54:38.413 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: crc 2024-09-12T00:54:38.413 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: secure 2024-09-12T00:54:38.413 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: crc 2024-09-12T00:54:38.413 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: crc 2024-09-12T00:54:38.413 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: secure 2024-09-12T00:54:38.413 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: crc 2024-09-12T00:54:38.414 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: secure 2024-09-12T00:54:38.414 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: crc 2024-09-12T00:54:38.414 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:54:38.069+0000 7f15a0613800 5 AuthRegistry(0x55ee719fe6c0) adding con mode: secure 2024-09-12T00:54:38.414 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:54:38.069+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.414 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 asok(0x55ee71787630) register_command objecter_requests cmddesc objecter_requests hook 0x55ee71a02040 EEXIST 2024-09-12T00:54:38.414 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient: init 2024-09-12T00:54:38.414 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding auth protocol: cephx 2024-09-12T00:54:38.414 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding auth protocol: cephx 2024-09-12T00:54:38.414 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding auth protocol: cephx 2024-09-12T00:54:38.414 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: secure 2024-09-12T00:54:38.414 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: crc 2024-09-12T00:54:38.414 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: secure 2024-09-12T00:54:38.415 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: crc 2024-09-12T00:54:38.415 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: secure 2024-09-12T00:54:38.415 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: crc 2024-09-12T00:54:38.415 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: crc 2024-09-12T00:54:38.415 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: secure 2024-09-12T00:54:38.415 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: crc 2024-09-12T00:54:38.415 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: secure 2024-09-12T00:54:38.415 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: crc 2024-09-12T00:54:38.415 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 AuthRegistry(0x55ee719fcde8) adding con mode: secure 2024-09-12T00:54:38.415 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:54:38.070+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.415 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:54:38.070+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.415 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:54:38.070+0000 7f15a0613800 5 asok(0x55ee71787630) register_command rotate-key cmddesc rotate-key hook 0x55ee719fcf30 EEXIST 2024-09-12T00:54:38.416 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:38.416 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:54:38.416 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-a con 0x55ee71a25d30 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:38.416 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-c con 0x55ee71a28000 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:38.416 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-b con 0x55ee71a24500 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:38.416 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.416 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.416 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.416 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:38.416 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:54:38.070+0000 7f15a0613800 10 monclient(hunting): authenticate will time out at 2164.563703s 2024-09-12T00:54:38.416 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:54:38.070+0000 7f159bd48640 10 monclient(hunting): get_auth_request con 0x55ee71a25d30 auth_method 0 2024-09-12T00:54:38.417 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:54:38.070+0000 7f159bd48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.417 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:54:38.070+0000 7f159bd48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.417 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:54:38.070+0000 7f159bd48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.417 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:54:38.070+0000 7f159b547640 10 monclient(hunting): get_auth_request con 0x55ee71a28000 auth_method 0 2024-09-12T00:54:38.417 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:54:38.070+0000 7f159b547640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.417 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:54:38.070+0000 7f159b547640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.417 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:54:38.070+0000 7f159b547640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.417 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:54:38.070+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.417 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:54:38.070+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.417 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:54:38.070+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.417 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:54:38.070+0000 7f159c549640 10 monclient(hunting): get_auth_request con 0x55ee71a24500 auth_method 0 2024-09-12T00:54:38.417 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:54:38.070+0000 7f159c549640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.417 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:54:38.070+0000 7f159c549640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.418 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:54:38.070+0000 7f159c549640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.418 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:54:38.070+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.418 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:54:38.070+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.418 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:54:38.070+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.418 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:54:38.071+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.418 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:54:38.071+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.418 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:54:38.071+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.418 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:54:38.071+0000 7f159bd48640 10 monclient(hunting): handle_auth_done global_id 7995 payload 824 2024-09-12T00:54:38.418 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:54:38.071+0000 7f159bd48640 10 monclient: _finish_hunting 0 2024-09-12T00:54:38.418 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:54:38.071+0000 7f159bd48640 1 monclient: found mon.noname-a 2024-09-12T00:54:38.418 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:54:38.071+0000 7f159bd48640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:54:38.418 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.418 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:38.419 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: dump: 2024-09-12T00:54:38.419 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.419 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.419 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.419 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.419 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.419 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.419 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.419 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.419 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.419 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.419 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: _finish_auth 0 2024-09-12T00:54:38.420 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: _check_auth_tickets 2024-09-12T00:54:38.420 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:38.420 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.420 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:38.420 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:54:38.071+0000 7f14817fa640 10 monclient: dump: 2024-09-12T00:54:38.420 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.420 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.420 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.420 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.420 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.420 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.420 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.420 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.421 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.421 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.421 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:54:38.071+0000 7f15a0613800 5 monclient: authenticate success, global_id 7995 2024-09-12T00:54:38.421 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:54:38.071+0000 7f15a0613800 10 monclient: _renew_subs 2024-09-12T00:54:38.421 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:54:38.071+0000 7f159cd4a640 4 set_mon_vals no callback set 2024-09-12T00:54:38.421 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:54:38.071+0000 7f15a0613800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:38.421 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:54:38.071+0000 7f15a0613800 10 monclient: _renew_subs 2024-09-12T00:54:38.421 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:54:38.071+0000 7f15a0613800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:54:38.421 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:54:38.073+0000 7f14817fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:38.421 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:54:38.073+0000 7f14817fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:38.421 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:54:38.073+0000 7f14817fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:38.421 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:54:38.073+0000 7f15a0613800 10 monclient: get_monmap_and_config 2024-09-12T00:54:38.421 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:54:38.073+0000 7f15a0613800 10 monclient: build_initial_monmap 2024-09-12T00:54:38.422 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:54:38.073+0000 7f15a0613800 1 build_initial for_mkfs: 0 2024-09-12T00:54:38.422 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:54:38.073+0000 7f159b547640 10 monclient: get_auth_request con 0x7f1474076380 auth_method 0 2024-09-12T00:54:38.422 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:54:38.073+0000 7f15a0613800 10 monclient: monmap: 2024-09-12T00:54:38.422 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:38.422 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:38.422 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:38.422 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:38.422 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:38.422 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.422 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:38.422 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:38.422 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:38.423 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.423 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding auth protocol: cephx 2024-09-12T00:54:38.423 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding auth protocol: cephx 2024-09-12T00:54:38.423 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding auth protocol: cephx 2024-09-12T00:54:38.423 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: secure 2024-09-12T00:54:38.423 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: crc 2024-09-12T00:54:38.423 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: secure 2024-09-12T00:54:38.423 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: crc 2024-09-12T00:54:38.423 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: secure 2024-09-12T00:54:38.423 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: crc 2024-09-12T00:54:38.423 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: crc 2024-09-12T00:54:38.423 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: secure 2024-09-12T00:54:38.423 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: crc 2024-09-12T00:54:38.424 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: secure 2024-09-12T00:54:38.424 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: crc 2024-09-12T00:54:38.424 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:54:38.073+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c70) adding con mode: secure 2024-09-12T00:54:38.424 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:54:38.074+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.424 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient: init 2024-09-12T00:54:38.424 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding auth protocol: cephx 2024-09-12T00:54:38.424 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding auth protocol: cephx 2024-09-12T00:54:38.424 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding auth protocol: cephx 2024-09-12T00:54:38.424 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: secure 2024-09-12T00:54:38.424 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: crc 2024-09-12T00:54:38.424 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: secure 2024-09-12T00:54:38.424 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: crc 2024-09-12T00:54:38.424 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: secure 2024-09-12T00:54:38.425 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: crc 2024-09-12T00:54:38.425 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: crc 2024-09-12T00:54:38.425 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: secure 2024-09-12T00:54:38.425 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: crc 2024-09-12T00:54:38.425 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: secure 2024-09-12T00:54:38.425 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: crc 2024-09-12T00:54:38.425 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d450) adding con mode: secure 2024-09-12T00:54:38.425 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:54:38.074+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.425 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:54:38.074+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.425 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:54:38.074+0000 7f15a0613800 5 asok(0x55ee71787630) register_command rotate-key cmddesc rotate-key hook 0x7ffdc250d598 EEXIST 2024-09-12T00:54:38.425 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:38.425 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:54:38.425 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-a con 0x55ee71a7a1a0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:38.426 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-c con 0x55ee71a49d00 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:38.426 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-b con 0x55ee71a46c30 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:38.426 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.426 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.426 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.426 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:38.426 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:54:38.074+0000 7f15a0613800 10 monclient(hunting): authenticate will time out at 2164.567826s 2024-09-12T00:54:38.426 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:54:38.074+0000 7f159bd48640 10 monclient(hunting): get_auth_request con 0x55ee71a7a1a0 auth_method 0 2024-09-12T00:54:38.426 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:54:38.074+0000 7f159bd48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.426 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:54:38.074+0000 7f159bd48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.426 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:54:38.074+0000 7f159bd48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.426 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:54:38.074+0000 7f159b547640 10 monclient(hunting): get_auth_request con 0x55ee71a49d00 auth_method 0 2024-09-12T00:54:38.427 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:54:38.074+0000 7f159b547640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.427 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:54:38.074+0000 7f159b547640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.427 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:54:38.074+0000 7f159b547640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.427 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:54:38.074+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.427 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:54:38.074+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.427 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:54:38.074+0000 7f159bd48640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.427 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:54:38.075+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.427 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:54:38.075+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.427 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:54:38.075+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.427 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:54:38.075+0000 7f159c549640 10 monclient(hunting): get_auth_request con 0x55ee71a46c30 auth_method 0 2024-09-12T00:54:38.427 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:54:38.075+0000 7f159c549640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.427 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:54:38.075+0000 7f159c549640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.427 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:54:38.075+0000 7f159c549640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.428 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:54:38.075+0000 7f159bd48640 10 monclient(hunting): handle_auth_done global_id 7998 payload 274 2024-09-12T00:54:38.428 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:54:38.075+0000 7f159bd48640 10 monclient: _finish_hunting 0 2024-09-12T00:54:38.428 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:54:38.075+0000 7f159bd48640 1 monclient: found mon.noname-a 2024-09-12T00:54:38.428 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:54:38.075+0000 7f159bd48640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:54:38.428 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.428 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:54:38.428 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: dump: 2024-09-12T00:54:38.428 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.428 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.428 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.428 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.428 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.429 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.429 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.429 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.429 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.429 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.429 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: _finish_auth 0 2024-09-12T00:54:38.429 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: _check_auth_tickets 2024-09-12T00:54:38.429 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:38.429 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:54:38.075+0000 7f15a0613800 5 monclient: authenticate success, global_id 7998 2024-09-12T00:54:38.429 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:54:38.075+0000 7f15a0613800 10 monclient: get_monmap_and_config success 2024-09-12T00:54:38.429 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:54:38.075+0000 7f15a0613800 4 set_mon_vals no callback set 2024-09-12T00:54:38.429 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.429 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:54:38.430 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:54:38.075+0000 7f147affd640 10 monclient: dump: 2024-09-12T00:54:38.430 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.430 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.430 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.430 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.430 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.430 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.430 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.430 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.430 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.430 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.430 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:54:38.075+0000 7f15a0613800 10 monclient: shutdown 2024-09-12T00:54:38.431 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient: build_initial_monmap 2024-09-12T00:54:38.431 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:54:38.076+0000 7f15a0613800 1 build_initial for_mkfs: 0 2024-09-12T00:54:38.431 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient: monmap: 2024-09-12T00:54:38.431 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:54:38.431 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:54:38.431 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:54:38.431 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:54:38.431 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:54:38.431 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.431 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:54:38.431 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:54:38.431 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:54:38.431 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.432 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding auth protocol: cephx 2024-09-12T00:54:38.432 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding auth protocol: cephx 2024-09-12T00:54:38.432 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding auth protocol: cephx 2024-09-12T00:54:38.432 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: secure 2024-09-12T00:54:38.432 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: crc 2024-09-12T00:54:38.432 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: secure 2024-09-12T00:54:38.432 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: crc 2024-09-12T00:54:38.432 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: secure 2024-09-12T00:54:38.432 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: crc 2024-09-12T00:54:38.432 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: crc 2024-09-12T00:54:38.432 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: secure 2024-09-12T00:54:38.432 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: crc 2024-09-12T00:54:38.432 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: secure 2024-09-12T00:54:38.433 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: crc 2024-09-12T00:54:38.433 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a45c20) adding con mode: secure 2024-09-12T00:54:38.433 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:54:38.076+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.433 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:54:38.076+0000 7f15a0613800 1 librados: starting msgr at 2024-09-12T00:54:38.433 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:54:38.076+0000 7f15a0613800 1 librados: starting objecter 2024-09-12T00:54:38.433 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 asok(0x55ee71787630) register_command objecter_requests cmddesc objecter_requests hook 0x55ee71a48360 EEXIST 2024-09-12T00:54:38.433 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:54:38.076+0000 7f15a0613800 1 librados: setting wanted keys 2024-09-12T00:54:38.433 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:54:38.076+0000 7f15a0613800 1 librados: calling monclient init 2024-09-12T00:54:38.433 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient: init 2024-09-12T00:54:38.433 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding auth protocol: cephx 2024-09-12T00:54:38.433 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding auth protocol: cephx 2024-09-12T00:54:38.433 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding auth protocol: cephx 2024-09-12T00:54:38.434 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: secure 2024-09-12T00:54:38.434 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: crc 2024-09-12T00:54:38.434 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: secure 2024-09-12T00:54:38.434 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: crc 2024-09-12T00:54:38.434 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: secure 2024-09-12T00:54:38.434 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: crc 2024-09-12T00:54:38.434 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: crc 2024-09-12T00:54:38.434 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: secure 2024-09-12T00:54:38.434 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: crc 2024-09-12T00:54:38.435 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: secure 2024-09-12T00:54:38.435 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: crc 2024-09-12T00:54:38.435 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 AuthRegistry(0x55ee71a3dae0) adding con mode: secure 2024-09-12T00:54:38.435 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:54:38.076+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.435 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:54:38.076+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.435 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:54:38.076+0000 7f15a0613800 5 asok(0x55ee71787630) register_command rotate-key cmddesc rotate-key hook 0x55ee71a3dc28 EEXIST 2024-09-12T00:54:38.435 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient: _reopen_session rank -1 2024-09-12T00:54:38.435 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:54:38.435 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-b con 0x55ee71a46c30 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:54:38.435 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-c con 0x55ee71a49d00 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:54:38.435 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient(hunting): picked mon.noname-a con 0x55ee71a7a1a0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:54:38.435 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.435 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.436 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:54:38.076+0000 7f15a0613800 10 monclient(hunting): start opening mon connection 2024-09-12T00:54:38.436 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:54:38.077+0000 7f15a0613800 10 monclient(hunting): _renew_subs 2024-09-12T00:54:38.436 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:54:38.077+0000 7f15a0613800 10 monclient(hunting): authenticate will time out at 2164.570012s 2024-09-12T00:54:38.436 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): get_auth_request con 0x55ee71a49d00 auth_method 0 2024-09-12T00:54:38.436 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.436 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.436 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.436 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:54:38.077+0000 7f159c549640 10 monclient(hunting): get_auth_request con 0x55ee71a7a1a0 auth_method 0 2024-09-12T00:54:38.436 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:54:38.077+0000 7f159c549640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.436 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:54:38.077+0000 7f159c549640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.436 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:54:38.077+0000 7f159c549640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.437 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.437 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.437 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.437 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:54:38.077+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:54:38.437 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:54:38.077+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:54:38.437 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:54:38.077+0000 7f159c549640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:54:38.437 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:54:38.077+0000 7f159bd48640 10 monclient(hunting): get_auth_request con 0x55ee71a46c30 auth_method 0 2024-09-12T00:54:38.437 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:54:38.077+0000 7f159bd48640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:54:38.437 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:54:38.077+0000 7f159bd48640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:54:38.437 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:54:38.077+0000 7f159bd48640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:54:38.437 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient(hunting): handle_auth_done global_id 7562 payload 824 2024-09-12T00:54:38.437 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient: _finish_hunting 0 2024-09-12T00:54:38.437 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:54:38.077+0000 7f159b547640 1 monclient: found mon.noname-c 2024-09-12T00:54:38.438 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:54:38.077+0000 7f159b547640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:54:38.438 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.438 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:54:38.438 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: dump: 2024-09-12T00:54:38.438 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.438 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.438 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.438 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.438 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.438 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.438 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.438 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.439 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.439 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.439 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: _finish_auth 0 2024-09-12T00:54:38.439 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: _check_auth_tickets 2024-09-12T00:54:38.439 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:54:38.439 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:54:38.439 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:54:38.439 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:54:38.077+0000 7f14797fa640 10 monclient: dump: 2024-09-12T00:54:38.439 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:54:38.439 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:54:38.439 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.439 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:54:38.439 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:54:38.440 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:54:38.440 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:54:38.440 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:54:38.440 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:54:38.440 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.440 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:54:38.077+0000 7f15a0613800 5 monclient: authenticate success, global_id 7562 2024-09-12T00:54:38.440 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:54:38.077+0000 7f15a0613800 10 monclient: _renew_subs 2024-09-12T00:54:38.440 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:54:38.077+0000 7f147affd640 4 set_mon_vals no callback set 2024-09-12T00:54:38.440 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:54:38.077+0000 7f15a0613800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:54:38.440 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:54:38.077+0000 7f15a0613800 10 monclient: _renew_subs 2024-09-12T00:54:38.440 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:54:38.077+0000 7f15a0613800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:54:38.440 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:54:38.077+0000 7f15a0613800 1 librados: init done 2024-09-12T00:54:38.440 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:54:38.077+0000 7f15a0613800 5 asok(0x55ee71787630) register_command cr dump hook 0x7f158c0606d8 2024-09-12T00:54:38.441 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:54:38.079+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.441 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:54:38.080+0000 7f14797fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:54:38.441 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:54:38.080+0000 7f14797fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:38.441 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:54:38.080+0000 7f14797fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:54:38.441 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:54:38.080+0000 7f159bd48640 10 monclient: get_auth_request con 0x7f1464076470 auth_method 0 2024-09-12T00:54:38.441 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:54:38.080+0000 7f159c549640 10 monclient: get_auth_request con 0x55ee71a94370 auth_method 0 2024-09-12T00:54:38.441 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.441 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:54:38.081+0000 7f15a0613800 20 realm 2024-09-12T00:54:38.441 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.441 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.441 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:54:38.081+0000 7f15a0613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:38.441 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.441 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.442 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:54:38.081+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.442 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:54:38.082+0000 7f159bd48640 10 monclient: get_auth_request con 0x55ee71a98750 auth_method 0 2024-09-12T00:54:38.442 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:54:38.082+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:38.442 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:54:38.082+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.442 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:54:38.082+0000 7f159b547640 10 monclient: get_auth_request con 0x55ee71a9be90 auth_method 0 2024-09-12T00:54:38.442 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:54:38.083+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:38.442 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:54:38.083+0000 7f15a0613800 20 searching for the correct realm 2024-09-12T00:54:38.442 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:54:38.083+0000 7f159c549640 10 monclient: get_auth_request con 0x55ee71aa0c10 auth_method 0 2024-09-12T00:54:38.442 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:54:38.084+0000 7f159bd48640 10 monclient: get_auth_request con 0x7f159402d3f0 auth_method 0 2024-09-12T00:54:38.442 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:54:38.086+0000 7f159b547640 10 monclient: get_auth_request con 0x7f159400e8d0 auth_method 0 2024-09-12T00:54:38.442 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:54:38.086+0000 7f159b547640 0 -- 172.21.15.62:0/2219204163 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f159400e8d0 msgr2=0x7f159401f3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:38.442 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:54:38.287+0000 7f159b547640 10 monclient: get_auth_request con 0x7f159400e8d0 auth_method 0 2024-09-12T00:54:38.442 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:54:38.290+0000 7f159c549640 10 monclient: get_auth_request con 0x7f158c00e070 auth_method 0 2024-09-12T00:54:38.443 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:54:38.290+0000 7f159bd48640 10 monclient: get_auth_request con 0x7f159403c970 auth_method 0 2024-09-12T00:54:38.443 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:54:38.291+0000 7f159c549640 0 -- 172.21.15.62:0/2219204163 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55ee71a94370 msgr2=0x55ee71a967e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:38.443 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:54:38.291+0000 7f14797fa640 1 client.7562.objecter ms_handle_reset 0x55ee71a94370 session 0x55ee71a93cf0 osd.6 2024-09-12T00:54:38.443 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:54:38.291+0000 7f14797fa640 10 monclient: _renew_subs 2024-09-12T00:54:38.443 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:54:38.291+0000 7f14797fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:54:38.443 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:54:38.292+0000 7f159c549640 10 monclient: get_auth_request con 0x7f14640866a0 auth_method 0 2024-09-12T00:54:38.443 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:38.443 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:38.443 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:38.443 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:38.443 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:38.443 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:38.444 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.444 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.444 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:54:38.295+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.444 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:38.444 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.444 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:38.444 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 zone default found 2024-09-12T00:54:38.444 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:54:38.296+0000 7f15a0613800 4 Realm: () 2024-09-12T00:54:38.444 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:54:38.296+0000 7f15a0613800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:38.444 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:54:38.296+0000 7f15a0613800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:38.444 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:54:38.296+0000 7f15a0613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:38.444 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 zonegroup default 2024-09-12T00:54:38.444 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.445 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.445 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:54:38.296+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.445 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:54:38.297+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.445 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:54:38.297+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.445 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:54:38.297+0000 7f15a0613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.445 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:54:38.297+0000 7f15a0613800 20 started sync module instance, tier type = 2024-09-12T00:54:38.445 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:54:38.297+0000 7f15a0613800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:38.445 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=0 2024-09-12T00:54:38.445 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=1 2024-09-12T00:54:38.445 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=2 2024-09-12T00:54:38.445 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=3 2024-09-12T00:54:38.445 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=4 2024-09-12T00:54:38.446 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=5 2024-09-12T00:54:38.446 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:54:38.305+0000 7f15a0613800 20 add_watcher() i=6 2024-09-12T00:54:38.446 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:54:38.307+0000 7f15a0613800 20 add_watcher() i=7 2024-09-12T00:54:38.446 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:54:38.307+0000 7f15a0613800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:38.446 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding auth protocol: cephx 2024-09-12T00:54:38.446 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding auth protocol: cephx 2024-09-12T00:54:38.446 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding auth protocol: cephx 2024-09-12T00:54:38.446 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: secure 2024-09-12T00:54:38.446 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: crc 2024-09-12T00:54:38.446 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: secure 2024-09-12T00:54:38.446 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: crc 2024-09-12T00:54:38.446 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: secure 2024-09-12T00:54:38.446 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: crc 2024-09-12T00:54:38.447 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: crc 2024-09-12T00:54:38.447 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: secure 2024-09-12T00:54:38.447 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: crc 2024-09-12T00:54:38.447 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: secure 2024-09-12T00:54:38.447 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: crc 2024-09-12T00:54:38.447 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:54:38.308+0000 7f15a0613800 5 AuthRegistry(0x7ffdc250d930) adding con mode: secure 2024-09-12T00:54:38.447 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:54:38.308+0000 7f1451fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:38.447 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:54:38.309+0000 7f15a0613800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:54:38.447 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:54:38.309+0000 7f15a0613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:38.447 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:54:38.309+0000 7f15a0613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:38.447 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command cache list hook 0x55ee71a6b5d0 2024-09-12T00:54:38.447 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command cache inspect hook 0x55ee71a6b5d0 2024-09-12T00:54:38.447 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command cache erase hook 0x55ee71a6b5d0 2024-09-12T00:54:38.448 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command cache zap hook 0x55ee71a6b5d0 2024-09-12T00:54:38.448 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 note: GC not initialized 2024-09-12T00:54:38.448 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:54:38.309+0000 7f1450fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:38.448 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command sync trace show hook 0x7f158c04b070 2024-09-12T00:54:38.448 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command sync trace history hook 0x7f158c04b070 2024-09-12T00:54:38.448 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command sync trace active hook 0x7f158c04b070 2024-09-12T00:54:38.448 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:54:38.309+0000 7f15a0613800 5 asok(0x55ee71787630) register_command sync trace active_short hook 0x7f158c04b070 2024-09-12T00:54:38.448 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:54:38.309+0000 7f15a0613800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:38.448 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:54:38.309+0000 7f15a0613800 20 Filter name: none 2024-09-12T00:54:38.448 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:54:38.309+0000 7f13ca7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:38.448 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:54:38.309+0000 7f15a0613800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:54:38.448 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:54:38.309+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.449 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:54:38.310+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:38.449 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:54:38.449 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:54:38.449 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 : miss 2024-09-12T00:54:38.449 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:54:38.310+0000 7f15a0613800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.449 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:54:38.310+0000 7f15a0613800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:54:38.449 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:54:38.449 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:54:38.449 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:38.449 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:38.449 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:54:38.310+0000 7f15a0613800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 2024-09-12T00:54:38.449 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:54:38.314+0000 7f15a0613800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:54:38.450 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:54:38.314+0000 7f15a0613800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:54:38.450 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:54:38.314+0000 7f15a0613800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:38.450 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:54:38.314+0000 7f15a0613800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39, ofs0, ns] 2024-09-12T00:54:38.450 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:54:38.314+0000 7f147affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 94482597503600 notifier 7562 bl.length()=931 2024-09-12T00:54:38.450 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:54:38.314+0000 7f147affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:54:38.450 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:54:38.314+0000 7f147affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:54:38.450 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:54:38.314+0000 7f147affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:38.450 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:54:38.316+0000 7f15a0613800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): orig_sources= new_sources= 2024-09-12T00:54:38.450 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:54:38.316+0000 7f15a0613800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): potential sources added=[] removed=[] 2024-09-12T00:54:38.450 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:54:38.316+0000 7f15a0613800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): orig_dests= new_dests= 2024-09-12T00:54:38.450 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:54:38.316+0000 7f15a0613800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): potential dests added=[] removed=[] 2024-09-12T00:54:38.450 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:54:38.319+0000 7f15a0613800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.1.0 2024-09-12T00:54:38.450 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:54:38.319+0000 7f15a0613800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.1.0 2024-09-12T00:54:38.451 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:54:38.319+0000 7f15a0613800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.1.1 2024-09-12T00:54:38.451 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:54:38.319+0000 7f15a0613800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.1.1 2024-09-12T00:54:38.451 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:54:38.319+0000 7f15a0613800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.0 2024-09-12T00:54:38.451 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:54:38.322+0000 7f15a0613800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f15a0613800 time 2024-09-12T00:54:38.322264+0000 2024-09-12T00:54:38.451 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:54:38.451 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.451 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:38.451 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f15a178c71a] 2024-09-12T00:54:38.451 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f15a178c8d8] 2024-09-12T00:54:38.451 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee70be4641] 2024-09-12T00:54:38.451 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55ee70bf351b] 2024-09-12T00:54:38.451 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ee70bf43e4] 2024-09-12T00:54:38.452 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:54:38.452 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f15a0429590] 2024-09-12T00:54:38.452 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:54:38.452 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:54:38.452 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.452 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:54:38.323+0000 7f15a0613800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:54:38.452 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f15a0613800 thread_name:radosgw-admin 2024-09-12T00:54:38.452 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.452 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:54:38.452 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f15a043e6f0] 2024-09-12T00:54:38.452 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f15a048b99c] 2024-09-12T00:54:38.452 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:54:38.453 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:54:38.453 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f15a178c774] 2024-09-12T00:54:38.453 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f15a178c8d8] 2024-09-12T00:54:38.453 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55ee70be4641] 2024-09-12T00:54:38.453 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55ee70bf351b] 2024-09-12T00:54:38.453 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55ee70bf43e4] 2024-09-12T00:54:38.453 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:54:38.453 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f15a0429590] 2024-09-12T00:54:38.453 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:54:38.453 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:54:38.453 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:54:38.453 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.453 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:54:38.454 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:54:38.454 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:54:38.454 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:54:38.454 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:54:38.454 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:54:38.454 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:54:38.454 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:54:38.454 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:54:38.454 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:54:38.454 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:54:38.454 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:54:38.454 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:54:38.454 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:54:38.455 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:54:38.455 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:54:38.455 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:54:38.455 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:54:38.455 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:54:38.455 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:54:38.455 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:54:38.455 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:54:38.455 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:54:38.455 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:54:38.455 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:54:38.455 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:54:38.455 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:54:38.456 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:54:38.456 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:54:38.456 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:54:38.456 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:54:38.456 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:54:38.456 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:54:38.456 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:54:38.456 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:54:38.456 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:54:38.456 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:54:38.456 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:54:38.456 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:54:38.456 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:54:38.457 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:54:38.457 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:54:38.457 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:54:38.457 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:54:38.457 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:54:38.457 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:54:38.457 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:54:38.457 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:54:38.457 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:54:38.457 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:54:38.457 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:54:38.457 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:54:38.458 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:54:38.458 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:54:38.458 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:54:38.458 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:54:38.458 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:54:38.458 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:54:38.458 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:54:38.458 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:54:38.458 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:54:38.458 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:54:38.458 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:54:38.458 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:54:38.458 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:54:38.459 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:54:38.459 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:54:38.459 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:54:38.459 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:54:38.459 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:54:38.459 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:54:38.459 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:54:38.459 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:54:38.459 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:54:38.459 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:54:38.459 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:54:38.459 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:54:38.459 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:54:38.459 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:54:38.460 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:54:38.460 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:54:38.460 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:54:38.460 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:54:38.460 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:54:38.460 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:54:38.460 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:54:38.460 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:54:38.460 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:54:38.460 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:54:38.460 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:54:38.460 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:54:38.461 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:54:38.461 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:54:38.461 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:54:38.461 INFO:tasks.workunit.client.0.smithi062.stderr: 7f13ca7fc640 / http_manager 2024-09-12T00:54:38.461 INFO:tasks.workunit.client.0.smithi062.stderr: 7f1450fe1640 / http_manager 2024-09-12T00:54:38.461 INFO:tasks.workunit.client.0.smithi062.stderr: 7f1451fe3640 / rgw_dt_lg_renew 2024-09-12T00:54:38.461 INFO:tasks.workunit.client.0.smithi062.stderr: 7f14797fa640 / ms_dispatch 2024-09-12T00:54:38.461 INFO:tasks.workunit.client.0.smithi062.stderr: 7f147affd640 / io_context_pool 2024-09-12T00:54:38.461 INFO:tasks.workunit.client.0.smithi062.stderr: 7f14817fa640 / ms_dispatch 2024-09-12T00:54:38.461 INFO:tasks.workunit.client.0.smithi062.stderr: 7f1483fff640 / ms_dispatch 2024-09-12T00:54:38.461 INFO:tasks.workunit.client.0.smithi062.stderr: 7f1489e0b640 / io_context_pool 2024-09-12T00:54:38.461 INFO:tasks.workunit.client.0.smithi062.stderr: 7f159b547640 / msgr-worker-2 2024-09-12T00:54:38.461 INFO:tasks.workunit.client.0.smithi062.stderr: 7f159bd48640 / msgr-worker-1 2024-09-12T00:54:38.462 INFO:tasks.workunit.client.0.smithi062.stderr: 7f159c549640 / msgr-worker-0 2024-09-12T00:54:38.462 INFO:tasks.workunit.client.0.smithi062.stderr: 7f159cd4a640 / io_context_pool 2024-09-12T00:54:38.462 INFO:tasks.workunit.client.0.smithi062.stderr: 7f15a0613800 / radosgw-admin 2024-09-12T00:54:38.462 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:54:38.462 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:54:38.462 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:54:38.323945Z_52aa4efb-3a63-4003-a7ba-f354b91f31e1/log 2024-09-12T00:54:38.462 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:54:38.462 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:54:38.464 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:38.464 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:38.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.402+0000 7fbc0e420800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.404+0000 7fbc0e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.404+0000 7fbc0e420800 20 realm 2024-09-12T00:54:38.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.404+0000 7fbc0e420800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.404+0000 7fbc0e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.404+0000 7fbc0e420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:38.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.404+0000 7fbc0e420800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.404+0000 7fbc0e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.464 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.404+0000 7fbc0e420800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.405+0000 7fbc0e420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:38.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.405+0000 7fbc0e420800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.406+0000 7fbc0e420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:38.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.406+0000 7fbc0e420800 20 searching for the correct realm 2024-09-12T00:54:38.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.409+0000 7fbc0b710640 0 -- 172.21.15.62:0/2939410143 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fbc040b2340 msgr2=0x7fbc040c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:38.613 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.614+0000 7fbc0c712640 0 -- 172.21.15.62:0/2939410143 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55e56b182720 msgr2=0x55e56b184b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:38.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.618+0000 7fbc0e420800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:38.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.618+0000 7fbc0e420800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:38.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.618+0000 7fbc0e420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:38.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.618+0000 7fbc0e420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:38.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.618+0000 7fbc0e420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:38.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.618+0000 7fbc0e420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:38.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.618+0000 7fbc0e420800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.618+0000 7fbc0e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.618+0000 7fbc0e420800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.618+0000 7fbc0e420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:38.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.618+0000 7fbc0e420800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.618 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.619+0000 7fbc0e420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:38.619 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.619+0000 7fbc0e420800 20 zone default found 2024-09-12T00:54:38.619 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.619+0000 7fbc0e420800 4 Realm: () 2024-09-12T00:54:38.619 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.619+0000 7fbc0e420800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:38.619 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.619+0000 7fbc0e420800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:38.619 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.619+0000 7fbc0e420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:38.619 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.619+0000 7fbc0e420800 20 zonegroup default 2024-09-12T00:54:38.619 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.619+0000 7fbc0e420800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.619 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.619+0000 7fbc0e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.619 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.619+0000 7fbc0e420800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.620+0000 7fbc0e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.620+0000 7fbc0e420800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.620+0000 7fbc0e420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:38.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.620+0000 7fbc0e420800 20 started sync module instance, tier type = 2024-09-12T00:54:38.620 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.620+0000 7fbc0e420800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:38.627 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.629+0000 7fbc0e420800 20 add_watcher() i=0 2024-09-12T00:54:38.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.629+0000 7fbc0e420800 20 add_watcher() i=1 2024-09-12T00:54:38.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.629+0000 7fbc0e420800 20 add_watcher() i=2 2024-09-12T00:54:38.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.629+0000 7fbc0e420800 20 add_watcher() i=3 2024-09-12T00:54:38.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.629+0000 7fbc0e420800 20 add_watcher() i=4 2024-09-12T00:54:38.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.629+0000 7fbc0e420800 20 add_watcher() i=5 2024-09-12T00:54:38.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.629+0000 7fbc0e420800 20 add_watcher() i=6 2024-09-12T00:54:38.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.629+0000 7fbc0e420800 20 add_watcher() i=7 2024-09-12T00:54:38.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.629+0000 7fbc0e420800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:38.630 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.631+0000 7fbac1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:38.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.632+0000 7fbc0e420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:38.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.632+0000 7fbc0e420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:38.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.632+0000 7fbc0e420800 5 note: GC not initialized 2024-09-12T00:54:38.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.632+0000 7fbac0fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:38.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.632+0000 7fbc0e420800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:38.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.632+0000 7fbc0e420800 20 Filter name: none 2024-09-12T00:54:38.631 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.632+0000 7fba3a7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:38.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.632+0000 7fbc0e420800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.633+0000 7fbc0e420800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:38.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.633+0000 7fbc0e420800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.632 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.633+0000 7fbc0e420800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:54:38.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.633+0000 7fbc0e420800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:38.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.633+0000 7fbc0e420800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.634+0000 7fbc0e420800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:38.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.634+0000 7fbc0e420800 20 rados->read ofs=0 len=0 2024-09-12T00:54:38.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.634+0000 7fbc0e420800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:54:38.633 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.634+0000 7fbc0e420800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:38.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.636+0000 7fbac1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:38.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.638+0000 7fbc0e420800 20 remove_watcher() i=0 2024-09-12T00:54:38.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.638+0000 7fbc0e420800 2 removed watcher, disabling cache 2024-09-12T00:54:38.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.639+0000 7fbc0e420800 20 remove_watcher() i=1 2024-09-12T00:54:38.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.640+0000 7fbc0e420800 20 remove_watcher() i=2 2024-09-12T00:54:38.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.641+0000 7fbc0e420800 20 remove_watcher() i=3 2024-09-12T00:54:38.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.642+0000 7fbc0e420800 20 remove_watcher() i=4 2024-09-12T00:54:38.642 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.643+0000 7fbc0e420800 20 remove_watcher() i=5 2024-09-12T00:54:38.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.644+0000 7fbc0e420800 20 remove_watcher() i=6 2024-09-12T00:54:38.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:38.645+0000 7fbc0e420800 20 remove_watcher() i=7 2024-09-12T00:54:38.655 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.655 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:54:38.655 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-change-reshard-state id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-12T00:54:38.655 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:54:38.747 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:54:38.780 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:38.780 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:39.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.017+0000 7f5df77d9640 0 --2- 172.21.15.62:0/1859464286 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x56149d205920 0x56149d235b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:54:39.021 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.022+0000 7f5dfbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:39.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.023+0000 7f5dfbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:39.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.023+0000 7f5dfbb26800 20 realm 2024-09-12T00:54:39.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.023+0000 7f5dfbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:39.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.024+0000 7f5dfbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:39.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.024+0000 7f5dfbb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:39.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.024+0000 7f5dfbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:39.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.024+0000 7f5dfbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:39.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.024+0000 7f5dfbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:39.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.025+0000 7f5dfbb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:39.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.025+0000 7f5dfbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:39.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.025+0000 7f5dfbb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:39.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.025+0000 7f5dfbb26800 20 searching for the correct realm 2024-09-12T00:54:39.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.027+0000 7f5df6fd8640 0 -- 172.21.15.62:0/258793292 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x56149d24f870 msgr2=0x56149d251d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:39.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.031+0000 7f5df7fda640 0 -- 172.21.15.62:0/258793292 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7f5de8086a70 msgr2=0x7f5de807a130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:39.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.036+0000 7f5dfbb26800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:54:39.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.036+0000 7f5dfbb26800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:54:39.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.036+0000 7f5dfbb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:39.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.036+0000 7f5dfbb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:39.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.036+0000 7f5dfbb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:39.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.036+0000 7f5dfbb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:39.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.036+0000 7f5dfbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:39.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.036+0000 7f5dfbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:39.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.036+0000 7f5dfbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:39.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.037+0000 7f5dfbb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:39.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.037+0000 7f5dfbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:39.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.037+0000 7f5dfbb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:39.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.037+0000 7f5dfbb26800 20 zone default found 2024-09-12T00:54:39.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.037+0000 7f5dfbb26800 4 Realm: () 2024-09-12T00:54:39.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.037+0000 7f5dfbb26800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:54:39.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.037+0000 7f5dfbb26800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:54:39.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.037+0000 7f5dfbb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:39.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.037+0000 7f5dfbb26800 20 zonegroup default 2024-09-12T00:54:39.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.037+0000 7f5dfbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:39.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.037+0000 7f5dfbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:39.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.037+0000 7f5dfbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:39.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.038+0000 7f5dfbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:39.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.038+0000 7f5dfbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:39.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.038+0000 7f5dfbb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:39.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.038+0000 7f5dfbb26800 20 started sync module instance, tier type = 2024-09-12T00:54:39.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.038+0000 7f5dfbb26800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:54:39.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.046+0000 7f5dfbb26800 20 add_watcher() i=0 2024-09-12T00:54:39.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.046+0000 7f5dfbb26800 20 add_watcher() i=1 2024-09-12T00:54:39.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.046+0000 7f5dfbb26800 20 add_watcher() i=2 2024-09-12T00:54:39.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.046+0000 7f5dfbb26800 20 add_watcher() i=3 2024-09-12T00:54:39.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.046+0000 7f5dfbb26800 20 add_watcher() i=4 2024-09-12T00:54:39.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.046+0000 7f5dfbb26800 20 add_watcher() i=5 2024-09-12T00:54:39.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.047+0000 7f5dfbb26800 20 add_watcher() i=6 2024-09-12T00:54:39.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.047+0000 7f5dfbb26800 20 add_watcher() i=7 2024-09-12T00:54:39.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.047+0000 7f5dfbb26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:39.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.049+0000 7f5cadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:39.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.049+0000 7f5dfbb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:39.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.049+0000 7f5dfbb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:39.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.049+0000 7f5dfbb26800 5 note: GC not initialized 2024-09-12T00:54:39.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.049+0000 7f5cacfe1640 20 reqs_thread_entry: start 2024-09-12T00:54:39.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.050+0000 7f5dfbb26800 20 init_complete bucket index max shards: 1 2024-09-12T00:54:39.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.050+0000 7f5dfbb26800 20 Filter name: none 2024-09-12T00:54:39.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.050+0000 7f5c267fc640 20 reqs_thread_entry: start 2024-09-12T00:54:39.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.050+0000 7f5dfbb26800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:54:39.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.050+0000 7f5dfbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:39.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.050+0000 7f5dfbb26800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:54:39.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.050+0000 7f5dfbb26800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:54:39.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.050+0000 7f5dfbb26800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:54:39.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.050+0000 7f5dfbb26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 : miss 2024-09-12T00:54:39.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.050+0000 7f5dfbb26800 20 rados->read ofs=0 len=0 2024-09-12T00:54:39.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.051+0000 7f5dfbb26800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:54:39.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.051+0000 7f5dfbb26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:54:39.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.051+0000 7f5dfbb26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:54:39.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.051+0000 7f5dfbb26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:39.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.051+0000 7f5dfbb26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:54:39.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.051+0000 7f5dfbb26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 2024-09-12T00:54:39.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.052+0000 7f5dfbb26800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to be held by another RGW process; skipping for now 2024-09-12T00:54:39.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.053+0000 7f5cadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:39.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.055+0000 7f5dfbb26800 20 remove_watcher() i=0 2024-09-12T00:54:39.053 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.055+0000 7f5dfbb26800 2 removed watcher, disabling cache 2024-09-12T00:54:39.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.056+0000 7f5dfbb26800 20 remove_watcher() i=1 2024-09-12T00:54:39.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.057+0000 7f5dfbb26800 20 remove_watcher() i=2 2024-09-12T00:54:39.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.058+0000 7f5dfbb26800 20 remove_watcher() i=3 2024-09-12T00:54:39.057 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.059+0000 7f5dfbb26800 20 remove_watcher() i=4 2024-09-12T00:54:39.058 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.060+0000 7f5dfbb26800 20 remove_watcher() i=5 2024-09-12T00:54:39.060 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.061+0000 7f5dfbb26800 20 remove_watcher() i=6 2024-09-12T00:54:39.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:54:39.062+0000 7f5dfbb26800 20 remove_watcher() i=7 2024-09-12T00:54:39.071 INFO:tasks.workunit.client.0.smithi062.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:55:09.084 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:55:09.119 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:09.119 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:09.163 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.164+0000 7f496f52e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.166+0000 7f496f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:09.165 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.166+0000 7f496f52e800 20 realm 2024-09-12T00:55:09.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.166+0000 7f496f52e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.166+0000 7f496f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:09.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.166+0000 7f496f52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:09.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.166+0000 7f496f52e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.167+0000 7f496f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:09.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.167+0000 7f496f52e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.166 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.167+0000 7f496f52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:09.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.167+0000 7f496f52e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.168+0000 7f496f52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:09.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.168+0000 7f496f52e800 20 searching for the correct realm 2024-09-12T00:55:09.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.171+0000 7f496aadc640 0 -- 172.21.15.62:0/1599981713 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f4964097230 msgr2=0x7f4964090510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:09.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.377+0000 7f496bade640 0 -- 172.21.15.62:0/1599981713 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55f08e4881f0 msgr2=0x55f08e48a640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:09.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.381+0000 7f496f52e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:09.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.381+0000 7f496f52e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:09.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.381+0000 7f496f52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:09.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.381+0000 7f496f52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:09.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.381+0000 7f496f52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:09.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.381+0000 7f496f52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:09.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.381+0000 7f496f52e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.381+0000 7f496f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:09.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.381+0000 7f496f52e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.382+0000 7f496f52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:09.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.382+0000 7f496f52e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.382+0000 7f496f52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:09.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.382+0000 7f496f52e800 20 zone default found 2024-09-12T00:55:09.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.382+0000 7f496f52e800 4 Realm: () 2024-09-12T00:55:09.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.382+0000 7f496f52e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:09.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.382+0000 7f496f52e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:09.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.382+0000 7f496f52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:09.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.382+0000 7f496f52e800 20 zonegroup default 2024-09-12T00:55:09.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.382+0000 7f496f52e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.383+0000 7f496f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:09.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.383+0000 7f496f52e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.383+0000 7f496f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:09.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.383+0000 7f496f52e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.383+0000 7f496f52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:09.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.383+0000 7f496f52e800 20 started sync module instance, tier type = 2024-09-12T00:55:09.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.383+0000 7f496f52e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:09.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.393+0000 7f496f52e800 20 add_watcher() i=0 2024-09-12T00:55:09.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.393+0000 7f496f52e800 20 add_watcher() i=1 2024-09-12T00:55:09.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.393+0000 7f496f52e800 20 add_watcher() i=2 2024-09-12T00:55:09.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.393+0000 7f496f52e800 20 add_watcher() i=3 2024-09-12T00:55:09.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.393+0000 7f496f52e800 20 add_watcher() i=4 2024-09-12T00:55:09.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.393+0000 7f496f52e800 20 add_watcher() i=5 2024-09-12T00:55:09.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.393+0000 7f496f52e800 20 add_watcher() i=6 2024-09-12T00:55:09.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.395+0000 7f496f52e800 20 add_watcher() i=7 2024-09-12T00:55:09.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.395+0000 7f496f52e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:09.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.397+0000 7f4821fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:09.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.397+0000 7f496f52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:09.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.397+0000 7f496f52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:09.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.397+0000 7f496f52e800 5 note: GC not initialized 2024-09-12T00:55:09.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.397+0000 7f4820fe1640 20 reqs_thread_entry: start 2024-09-12T00:55:09.399 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.397+0000 7f496f52e800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:09.399 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.397+0000 7f496f52e800 20 Filter name: none 2024-09-12T00:55:09.399 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.398+0000 7f479a7fc640 20 reqs_thread_entry: start 2024-09-12T00:55:09.399 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.398+0000 7f496f52e800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:55:09.399 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.398+0000 7f496f52e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.399 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.398+0000 7f496f52e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:55:09.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.398+0000 7f496f52e800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:55:09.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.398+0000 7f496f52e800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:55:09.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.398+0000 7f496f52e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 : miss 2024-09-12T00:55:09.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.398+0000 7f496f52e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.399+0000 7f496f52e800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:55:09.400 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.399+0000 7f496f52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:55:09.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.399+0000 7f496f52e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:55:09.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.399+0000 7f496f52e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:09.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.399+0000 7f496f52e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:55:09.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.399+0000 7f496f52e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 2024-09-12T00:55:09.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.400+0000 7f496f52e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:55:09.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.404+0000 7f496f52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:55:09.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.404+0000 7f496f52e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:55:09.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.404+0000 7f496f52e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:55:09.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.404+0000 7f496f52e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39, ofs0, ns] 2024-09-12T00:55:09.404 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.405+0000 7f484effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431592 cookie 94491667634112 notifier 8055 bl.length()=931 2024-09-12T00:55:09.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.405+0000 7f484effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:55:09.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.405+0000 7f484effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:55:09.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.405+0000 7f484effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:55:09.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.406+0000 7f496f52e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): orig_sources= new_sources= 2024-09-12T00:55:09.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.406+0000 7f496f52e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): potential sources added=[] removed=[] 2024-09-12T00:55:09.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.406+0000 7f496f52e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): orig_dests= new_dests= 2024-09-12T00:55:09.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.406+0000 7f496f52e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): potential dests added=[] removed=[] 2024-09-12T00:55:09.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.410+0000 7f496f52e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.2.0 2024-09-12T00:55:09.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.410+0000 7f496f52e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.2.0 2024-09-12T00:55:09.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.410+0000 7f496f52e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.2.1 2024-09-12T00:55:09.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.410+0000 7f496f52e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.2.1 2024-09-12T00:55:09.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.410+0000 7f496f52e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.0 2024-09-12T00:55:09.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.413+0000 7f496f52e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:09.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.413+0000 7f496f52e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 2024-09-12T00:55:09.414 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.414+0000 7f496f52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:55:09.414 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.414+0000 7f496f52e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:55:09.414 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.414+0000 7f496f52e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:55:09.414 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.414+0000 7f496f52e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39, ofs0, ns] 2024-09-12T00:55:09.414 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.415+0000 7f484e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431593 cookie 94491667634112 notifier 8055 bl.length()=931 2024-09-12T00:55:09.415 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.415+0000 7f484e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:55:09.415 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.415+0000 7f484e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:55:09.415 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.415+0000 7f484e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:55:09.415 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.416+0000 7f496f52e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): orig_sources= new_sources= 2024-09-12T00:55:09.416 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.416+0000 7f496f52e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): potential sources added=[] removed=[] 2024-09-12T00:55:09.416 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.416+0000 7f496f52e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): orig_dests= new_dests= 2024-09-12T00:55:09.416 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.416+0000 7f496f52e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): potential dests added=[] removed=[] 2024-09-12T00:55:09.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.417+0000 7f496f52e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39.0 2024-09-12T00:55:09.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.418+0000 7f496f52e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:55:09.417 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.418+0000 7f496f52e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 2024-09-12T00:55:09.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.419+0000 7f496f52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:55:09.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.419+0000 7f496f52e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:55:09.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.419+0000 7f496f52e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:55:09.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.419+0000 7f496f52e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39, ofs0, ns] 2024-09-12T00:55:09.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.419+0000 7f484effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 94491667634112 notifier 8055 bl.length()=899 2024-09-12T00:55:09.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.419+0000 7f484effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 info.flags=0x17 2024-09-12T00:55:09.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.419+0000 7f484effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 to cache LRU end 2024-09-12T00:55:09.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.419+0000 7f484effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:55:09.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.421+0000 7f496f52e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): orig_sources= new_sources= 2024-09-12T00:55:09.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.421+0000 7f496f52e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): potential sources added=[] removed=[] 2024-09-12T00:55:09.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.421+0000 7f496f52e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): orig_dests= new_dests= 2024-09-12T00:55:09.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.421+0000 7f496f52e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39]): potential dests added=[] removed=[] 2024-09-12T00:55:09.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.423+0000 7f496f52e800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-12T00:55:09.424 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.425+0000 7f4821fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:09.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.427+0000 7f496f52e800 20 remove_watcher() i=0 2024-09-12T00:55:09.426 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.427+0000 7f496f52e800 2 removed watcher, disabling cache 2024-09-12T00:55:09.427 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.428+0000 7f496f52e800 20 remove_watcher() i=1 2024-09-12T00:55:09.428 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.430+0000 7f496f52e800 20 remove_watcher() i=2 2024-09-12T00:55:09.430 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.431+0000 7f496f52e800 20 remove_watcher() i=3 2024-09-12T00:55:09.430 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.432+0000 7f496f52e800 20 remove_watcher() i=4 2024-09-12T00:55:09.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.433+0000 7f496f52e800 20 remove_watcher() i=5 2024-09-12T00:55:09.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.434+0000 7f496f52e800 20 remove_watcher() i=6 2024-09-12T00:55:09.434 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.435+0000 7f496f52e800 20 remove_watcher() i=7 2024-09-12T00:55:09.447 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:55:09.477 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:09.478 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:09.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.517+0000 7f0474f26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.519+0000 7f0474f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:09.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.519+0000 7f0474f26800 20 realm 2024-09-12T00:55:09.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.519+0000 7f0474f26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.519+0000 7f0474f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:09.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.519+0000 7f0474f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:09.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.519+0000 7f0474f26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.519+0000 7f0474f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:09.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.519+0000 7f0474f26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.520+0000 7f0474f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:09.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.520+0000 7f0474f26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.521+0000 7f0474f26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:09.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.521+0000 7f0474f26800 20 searching for the correct realm 2024-09-12T00:55:09.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.524+0000 7f0470308640 0 -- 172.21.15.62:0/1668392024 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f04680d3b80 msgr2=0x7f04680da210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:09.728 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.729+0000 7f047130a640 0 -- 172.21.15.62:0/1668392024 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55af65aea370 msgr2=0x55af65aec800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:09.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.734+0000 7f0474f26800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:09.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.734+0000 7f0474f26800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:09.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.734+0000 7f0474f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:09.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.734+0000 7f0474f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:09.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.734+0000 7f0474f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:09.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.734+0000 7f0474f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:09.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.734+0000 7f0474f26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.734+0000 7f0474f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:09.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.734+0000 7f0474f26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.734+0000 7f0474f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:09.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.734+0000 7f0474f26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.735+0000 7f0474f26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:09.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.735+0000 7f0474f26800 20 zone default found 2024-09-12T00:55:09.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.735+0000 7f0474f26800 4 Realm: () 2024-09-12T00:55:09.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.735+0000 7f0474f26800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:09.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.735+0000 7f0474f26800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:09.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.735+0000 7f0474f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:09.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.735+0000 7f0474f26800 20 zonegroup default 2024-09-12T00:55:09.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.735+0000 7f0474f26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.736 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.735+0000 7f0474f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:09.736 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.735+0000 7f0474f26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.735+0000 7f0474f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:09.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.735+0000 7f0474f26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.736+0000 7f0474f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:09.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.736+0000 7f0474f26800 20 started sync module instance, tier type = 2024-09-12T00:55:09.737 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.736+0000 7f0474f26800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:09.745 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.746+0000 7f0474f26800 20 add_watcher() i=0 2024-09-12T00:55:09.745 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.746+0000 7f0474f26800 20 add_watcher() i=1 2024-09-12T00:55:09.745 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.746+0000 7f0474f26800 20 add_watcher() i=2 2024-09-12T00:55:09.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.746+0000 7f0474f26800 20 add_watcher() i=3 2024-09-12T00:55:09.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.746+0000 7f0474f26800 20 add_watcher() i=4 2024-09-12T00:55:09.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.746+0000 7f0474f26800 20 add_watcher() i=5 2024-09-12T00:55:09.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.746+0000 7f0474f26800 20 add_watcher() i=6 2024-09-12T00:55:09.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.747+0000 7f0474f26800 20 add_watcher() i=7 2024-09-12T00:55:09.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.747+0000 7f0474f26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:09.748 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.749+0000 7f0326fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:09.748 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.749+0000 7f0474f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.749+0000 7f0474f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:09.749 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.749+0000 7f0474f26800 5 note: GC not initialized 2024-09-12T00:55:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.750+0000 7f0325fe3640 20 reqs_thread_entry: start 2024-09-12T00:55:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.750+0000 7f0474f26800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.750+0000 7f0474f26800 20 Filter name: none 2024-09-12T00:55:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.750+0000 7f02977fe640 20 reqs_thread_entry: start 2024-09-12T00:55:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.750+0000 7f0474f26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.750 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.750+0000 7f0474f26800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:55:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.750+0000 7f0474f26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.751+0000 7f0474f26800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:55:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.751+0000 7f0474f26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:09.751 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.751+0000 7f0474f26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.751+0000 7f0474f26800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:55:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.751+0000 7f0474f26800 20 rados->read ofs=0 len=0 2024-09-12T00:55:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.752+0000 7f0474f26800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:55:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.752+0000 7f0474f26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:09.752 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.753+0000 7f0326fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.755+0000 7f0474f26800 20 remove_watcher() i=0 2024-09-12T00:55:09.754 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.755+0000 7f0474f26800 2 removed watcher, disabling cache 2024-09-12T00:55:09.755 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.757+0000 7f0474f26800 20 remove_watcher() i=1 2024-09-12T00:55:09.757 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.758+0000 7f0474f26800 20 remove_watcher() i=2 2024-09-12T00:55:09.758 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.759+0000 7f0474f26800 20 remove_watcher() i=3 2024-09-12T00:55:09.759 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.760+0000 7f0474f26800 20 remove_watcher() i=4 2024-09-12T00:55:09.760 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.761+0000 7f0474f26800 20 remove_watcher() i=5 2024-09-12T00:55:09.761 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.762+0000 7f0474f26800 20 remove_watcher() i=6 2024-09-12T00:55:09.762 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:09.763+0000 7f0474f26800 20 remove_watcher() i=7 2024-09-12T00:55:09.773 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:09.773 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:55:09.773 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: abort-at-change-reshard-state id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-12T00:55:09.773 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.094 INFO:tasks.workunit.client.0.smithi062.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T00:55:10.096 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:55:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:10.127 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:10.167 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.168+0000 7faca7330800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.170+0000 7faca7330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.170+0000 7faca7330800 20 realm 2024-09-12T00:55:10.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.170+0000 7faca7330800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.169 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.170+0000 7faca7330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.170+0000 7faca7330800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:10.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.170+0000 7faca7330800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.170+0000 7faca7330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.170+0000 7faca7330800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.171+0000 7faca7330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:10.170 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.171+0000 7faca7330800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.172+0000 7faca7330800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:10.171 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.172+0000 7faca7330800 20 searching for the correct realm 2024-09-12T00:55:10.174 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.175+0000 7faca28af640 0 -- 172.21.15.62:0/742412784 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fac9c080460 msgr2=0x7fac9c060e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:10.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.381+0000 7faca28af640 0 -- 172.21.15.62:0/742412784 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x560e3c5d2d20 msgr2=0x560e3c5d5180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:10.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.386+0000 7faca7330800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:10.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.386+0000 7faca7330800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:10.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.386+0000 7faca7330800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:10.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.386+0000 7faca7330800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:10.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.386+0000 7faca7330800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:10.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.386+0000 7faca7330800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:10.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.386+0000 7faca7330800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.386+0000 7faca7330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.386+0000 7faca7330800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.386+0000 7faca7330800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:10.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.386+0000 7faca7330800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.387+0000 7faca7330800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:10.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.387+0000 7faca7330800 20 zone default found 2024-09-12T00:55:10.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.387+0000 7faca7330800 4 Realm: () 2024-09-12T00:55:10.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.387+0000 7faca7330800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:10.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.387+0000 7faca7330800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:10.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.387+0000 7faca7330800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:10.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.387+0000 7faca7330800 20 zonegroup default 2024-09-12T00:55:10.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.387+0000 7faca7330800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.387+0000 7faca7330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.387+0000 7faca7330800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.387+0000 7faca7330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.387+0000 7faca7330800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.388+0000 7faca7330800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.388+0000 7faca7330800 20 started sync module instance, tier type = 2024-09-12T00:55:10.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.388+0000 7faca7330800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:10.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.398+0000 7faca7330800 20 add_watcher() i=0 2024-09-12T00:55:10.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.398+0000 7faca7330800 20 add_watcher() i=1 2024-09-12T00:55:10.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.398+0000 7faca7330800 20 add_watcher() i=2 2024-09-12T00:55:10.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.398+0000 7faca7330800 20 add_watcher() i=3 2024-09-12T00:55:10.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.398+0000 7faca7330800 20 add_watcher() i=4 2024-09-12T00:55:10.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.398+0000 7faca7330800 20 add_watcher() i=5 2024-09-12T00:55:10.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.398+0000 7faca7330800 20 add_watcher() i=6 2024-09-12T00:55:10.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.399+0000 7faca7330800 20 add_watcher() i=7 2024-09-12T00:55:10.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.399+0000 7faca7330800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:10.399 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.401+0000 7fab59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:10.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.401+0000 7faca7330800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:10.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.401+0000 7faca7330800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:10.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.401+0000 7faca7330800 5 note: GC not initialized 2024-09-12T00:55:10.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.401+0000 7fab58fe1640 20 reqs_thread_entry: start 2024-09-12T00:55:10.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.401+0000 7faca7330800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:10.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.401+0000 7faca7330800 20 Filter name: none 2024-09-12T00:55:10.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.401+0000 7faad27fc640 20 reqs_thread_entry: start 2024-09-12T00:55:10.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.402+0000 7faca7330800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.402+0000 7faca7330800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:10.401 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.402+0000 7faca7330800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.402 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.402+0000 7faca7330800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:10.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.402+0000 7faca7330800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:10.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.402+0000 7faca7330800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.402+0000 7faca7330800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:10.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.403+0000 7faca7330800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.403+0000 7faca7330800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:10.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.403+0000 7faca7330800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:10.403 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.404+0000 7fab59fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:10.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.407+0000 7faca7330800 20 remove_watcher() i=0 2024-09-12T00:55:10.405 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.407+0000 7faca7330800 2 removed watcher, disabling cache 2024-09-12T00:55:10.406 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.408+0000 7faca7330800 20 remove_watcher() i=1 2024-09-12T00:55:10.408 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.409+0000 7faca7330800 20 remove_watcher() i=2 2024-09-12T00:55:10.409 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.410+0000 7faca7330800 20 remove_watcher() i=3 2024-09-12T00:55:10.410 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.411+0000 7faca7330800 20 remove_watcher() i=4 2024-09-12T00:55:10.411 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.412+0000 7faca7330800 20 remove_watcher() i=5 2024-09-12T00:55:10.412 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.413+0000 7faca7330800 20 remove_watcher() i=6 2024-09-12T00:55:10.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.414+0000 7faca7330800 20 remove_watcher() i=7 2024-09-12T00:55:10.424 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.424 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:55:10.425 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: a-bucket id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-12T00:55:10.425 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.426 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:55:10.455 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:10.455 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:10.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.495+0000 7f56bdd22800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.496+0000 7f56bdd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.496+0000 7f56bdd22800 20 realm 2024-09-12T00:55:10.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.496+0000 7f56bdd22800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.497+0000 7f56bdd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.497+0000 7f56bdd22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:10.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.497+0000 7f56bdd22800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.497+0000 7f56bdd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.496 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.497+0000 7f56bdd22800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.497 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.498+0000 7f56bdd22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:10.497 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.498+0000 7f56bdd22800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.497 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.498+0000 7f56bdd22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:10.497 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.498+0000 7f56bdd22800 20 searching for the correct realm 2024-09-12T00:55:10.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.502+0000 7f56b9101640 0 -- 172.21.15.62:0/363976352 >> [v2:172.21.15.62:6808/741930476,v1:172.21.15.62:6809/741930476] conn(0x55f9385f1d80 msgr2=0x55f9385f4170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:10.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.506+0000 7f56b9902640 0 -- 172.21.15.62:0/363976352 >> [v2:172.21.15.62:6816/3104025159,v1:172.21.15.62:6817/3104025159] conn(0x55f9385ee4f0 msgr2=0x55f9385f0900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:10.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.509+0000 7f56bdd22800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:10.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.509+0000 7f56bdd22800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:10.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.509+0000 7f56bdd22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:10.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.509+0000 7f56bdd22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:10.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.509+0000 7f56bdd22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:10.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.509+0000 7f56bdd22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:10.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.509+0000 7f56bdd22800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.509+0000 7f56bdd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.509+0000 7f56bdd22800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.510 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.510+0000 7f56bdd22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:10.510 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.510+0000 7f56bdd22800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.510 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.510+0000 7f56bdd22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:10.510 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.510+0000 7f56bdd22800 20 zone default found 2024-09-12T00:55:10.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.510+0000 7f56bdd22800 4 Realm: () 2024-09-12T00:55:10.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.510+0000 7f56bdd22800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:10.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.510+0000 7f56bdd22800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:10.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.510+0000 7f56bdd22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:10.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.510+0000 7f56bdd22800 20 zonegroup default 2024-09-12T00:55:10.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.510+0000 7f56bdd22800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.511+0000 7f56bdd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.511+0000 7f56bdd22800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.511+0000 7f56bdd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.511+0000 7f56bdd22800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.511+0000 7f56bdd22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.511+0000 7f56bdd22800 20 started sync module instance, tier type = 2024-09-12T00:55:10.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.511+0000 7f56bdd22800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:10.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.521+0000 7f56bdd22800 20 add_watcher() i=0 2024-09-12T00:55:10.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.521+0000 7f56bdd22800 20 add_watcher() i=1 2024-09-12T00:55:10.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.521+0000 7f56bdd22800 20 add_watcher() i=2 2024-09-12T00:55:10.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.521+0000 7f56bdd22800 20 add_watcher() i=3 2024-09-12T00:55:10.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.521+0000 7f56bdd22800 20 add_watcher() i=4 2024-09-12T00:55:10.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.521+0000 7f56bdd22800 20 add_watcher() i=5 2024-09-12T00:55:10.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.521+0000 7f56bdd22800 20 add_watcher() i=6 2024-09-12T00:55:10.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.522+0000 7f56bdd22800 20 add_watcher() i=7 2024-09-12T00:55:10.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.522+0000 7f56bdd22800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:10.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.523+0000 7f556b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:10.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.524+0000 7f56bdd22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:10.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.524+0000 7f56bdd22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:10.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.524+0000 7f56bdd22800 5 note: GC not initialized 2024-09-12T00:55:10.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.524+0000 7f556a7fc640 20 reqs_thread_entry: start 2024-09-12T00:55:10.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.524+0000 7f56bdd22800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:10.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.524+0000 7f56bdd22800 20 Filter name: none 2024-09-12T00:55:10.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.524+0000 7f54dbfff640 20 reqs_thread_entry: start 2024-09-12T00:55:10.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.524+0000 7f56bdd22800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.525+0000 7f56bdd22800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:10.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.525+0000 7f56bdd22800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.525+0000 7f56bdd22800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:10.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.525+0000 7f56bdd22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:10.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.525+0000 7f56bdd22800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.525+0000 7f56bdd22800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:10.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.525+0000 7f56bdd22800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.526+0000 7f56bdd22800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:10.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.526+0000 7f56bdd22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:10.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.527+0000 7f556b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:10.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.530+0000 7f56bdd22800 20 remove_watcher() i=0 2024-09-12T00:55:10.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.530+0000 7f56bdd22800 2 removed watcher, disabling cache 2024-09-12T00:55:10.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.532+0000 7f56bdd22800 20 remove_watcher() i=1 2024-09-12T00:55:10.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.533+0000 7f56bdd22800 20 remove_watcher() i=2 2024-09-12T00:55:10.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.534+0000 7f56bdd22800 20 remove_watcher() i=3 2024-09-12T00:55:10.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.535+0000 7f56bdd22800 20 remove_watcher() i=4 2024-09-12T00:55:10.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.536+0000 7f56bdd22800 20 remove_watcher() i=5 2024-09-12T00:55:10.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.537+0000 7f56bdd22800 20 remove_watcher() i=6 2024-09-12T00:55:10.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.538+0000 7f56bdd22800 20 remove_watcher() i=7 2024-09-12T00:55:10.549 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:55:10.584 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:10.584 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:10.623 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.624+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.624 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.625+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.625+0000 7fbf1ab44800 20 realm 2024-09-12T00:55:10.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.625+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.626+0000 7fbf1ab44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:10.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.625 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:10.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.627+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:10.626 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.627+0000 7fbf1ab44800 20 searching for the correct realm 2024-09-12T00:55:10.630 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.631+0000 7fbf170f5640 0 -- 172.21.15.62:0/4278635496 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55694b1a7440 msgr2=0x55694b1a9890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:10.634 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.635+0000 7fbf170f5640 0 -- 172.21.15.62:0/4278635496 >> [v2:172.21.15.77:6816/3177889521,v1:172.21.15.77:6817/3177889521] conn(0x55694b1b3bc0 msgr2=0x55694b1b6080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:10.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:10.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:10.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:10.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:10.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:10.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:10.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:10.639 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 zone default found 2024-09-12T00:55:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.639+0000 7fbf1ab44800 4 Realm: () 2024-09-12T00:55:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.639+0000 7fbf1ab44800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.639+0000 7fbf1ab44800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.639+0000 7fbf1ab44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 zonegroup default 2024-09-12T00:55:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.640 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.640+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.640+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.640+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.640+0000 7fbf1ab44800 20 started sync module instance, tier type = 2024-09-12T00:55:10.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.640+0000 7fbf1ab44800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:10.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=0 2024-09-12T00:55:10.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=1 2024-09-12T00:55:10.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=2 2024-09-12T00:55:10.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=3 2024-09-12T00:55:10.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=4 2024-09-12T00:55:10.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=5 2024-09-12T00:55:10.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=6 2024-09-12T00:55:10.650 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.651+0000 7fbf1ab44800 20 add_watcher() i=7 2024-09-12T00:55:10.650 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.651+0000 7fbf1ab44800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:10.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.653+0000 7fbdcd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:10.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.653+0000 7fbf1ab44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:10.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.653+0000 7fbf1ab44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:10.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 note: GC not initialized 2024-09-12T00:55:10.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.653+0000 7fbd47fff640 20 reqs_thread_entry: start 2024-09-12T00:55:10.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.653+0000 7fbf1ab44800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:10.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.653+0000 7fbf1ab44800 20 Filter name: none 2024-09-12T00:55:10.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.653+0000 7fbd45ffb640 20 reqs_thread_entry: start 2024-09-12T00:55:10.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.653+0000 7fbf1ab44800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:10.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.653+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.654+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:10.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:10.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:10.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:55:10.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.654+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.654+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:10.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:10.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:10.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:10.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:10.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:55:10.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.659+0000 7fbf1ab44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:10.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.659+0000 7fbf1ab44800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:10.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.659+0000 7fbf1ab44800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:10.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.659+0000 7fbf1ab44800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:55:10.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.659+0000 7fbdf9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431686 cookie 93910720009760 notifier 8127 bl.length()=827 2024-09-12T00:55:10.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.659+0000 7fbdf9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:10.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.659+0000 7fbdf9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:10.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.659+0000 7fbdf9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:10.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.661+0000 7fbf1ab44800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:55:10.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.661+0000 7fbf1ab44800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:55:10.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.661+0000 7fbf1ab44800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:55:10.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.661+0000 7fbf1ab44800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:55:10.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.663+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.0 2024-09-12T00:55:10.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.663+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.0 2024-09-12T00:55:10.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.663+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.1 2024-09-12T00:55:10.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.663+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.1 2024-09-12T00:55:10.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.663+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.2 2024-09-12T00:55:10.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.663+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.2 2024-09-12T00:55:10.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.663+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.3 2024-09-12T00:55:10.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.663+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.3 2024-09-12T00:55:10.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.663+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:55:10.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.663+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:55:10.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.664+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:55:10.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.664+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:55:10.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.664+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:55:10.664 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.664+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:55:10.665 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbf1ab44800 time 2024-09-12T00:55:10.667761+0000 2024-09-12T00:55:10.665 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:10.666 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:10.666 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbf1c38c71a] 2024-09-12T00:55:10.666 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbf1c38c8d8] 2024-09-12T00:55:10.666 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569492d4641] 2024-09-12T00:55:10.666 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5569492e351b] 2024-09-12T00:55:10.666 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5569492e43e4] 2024-09-12T00:55:10.666 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:55:10.667 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbf1b029590] 2024-09-12T00:55:10.667 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:55:10.667 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:55:10.667 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.667+0000 7fbf1ab44800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbf1ab44800 time 2024-09-12T00:55:10.667761+0000 2024-09-12T00:55:10.667 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:10.667 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.667 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:10.667 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbf1c38c71a] 2024-09-12T00:55:10.667 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbf1c38c8d8] 2024-09-12T00:55:10.667 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569492d4641] 2024-09-12T00:55:10.667 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5569492e351b] 2024-09-12T00:55:10.667 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5569492e43e4] 2024-09-12T00:55:10.667 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:55:10.668 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbf1b029590] 2024-09-12T00:55:10.668 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:55:10.668 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:55:10.668 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.668 INFO:tasks.workunit.client.0.smithi062.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:55:10.668 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7fbf1ab44800 thread_name:radosgw-admin 2024-09-12T00:55:10.684 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:10.684 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbf1b03e6f0] 2024-09-12T00:55:10.684 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbf1b08b99c] 2024-09-12T00:55:10.684 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:55:10.684 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:55:10.685 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbf1c38c774] 2024-09-12T00:55:10.685 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbf1c38c8d8] 2024-09-12T00:55:10.685 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569492d4641] 2024-09-12T00:55:10.685 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5569492e351b] 2024-09-12T00:55:10.685 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5569492e43e4] 2024-09-12T00:55:10.685 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:55:10.685 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbf1b029590] 2024-09-12T00:55:10.685 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:55:10.685 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:55:10.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.668+0000 7fbf1ab44800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:55:10.685 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7fbf1ab44800 thread_name:radosgw-admin 2024-09-12T00:55:10.686 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.686 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:10.686 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbf1b03e6f0] 2024-09-12T00:55:10.686 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbf1b08b99c] 2024-09-12T00:55:10.686 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:55:10.686 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:55:10.686 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbf1c38c774] 2024-09-12T00:55:10.686 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbf1c38c8d8] 2024-09-12T00:55:10.686 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569492d4641] 2024-09-12T00:55:10.686 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5569492e351b] 2024-09-12T00:55:10.686 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5569492e43e4] 2024-09-12T00:55:10.686 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:55:10.687 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbf1b029590] 2024-09-12T00:55:10.687 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:55:10.687 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:55:10.687 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:55:10.687 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.687 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:55:10.687 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: secure 2024-09-12T00:55:10.687 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: crc 2024-09-12T00:55:10.687 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: secure 2024-09-12T00:55:10.687 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: crc 2024-09-12T00:55:10.687 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: crc 2024-09-12T00:55:10.687 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: secure 2024-09-12T00:55:10.687 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: crc 2024-09-12T00:55:10.688 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: secure 2024-09-12T00:55:10.688 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: crc 2024-09-12T00:55:10.688 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: secure 2024-09-12T00:55:10.688 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.688 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 1 librados: starting msgr at 2024-09-12T00:55:10.688 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 1 librados: starting objecter 2024-09-12T00:55:10.688 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command objecter_requests hook 0x55694af77640 2024-09-12T00:55:10.688 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 1 librados: setting wanted keys 2024-09-12T00:55:10.688 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 1 librados: calling monclient init 2024-09-12T00:55:10.688 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient: init 2024-09-12T00:55:10.688 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding auth protocol: cephx 2024-09-12T00:55:10.688 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding auth protocol: cephx 2024-09-12T00:55:10.688 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding auth protocol: cephx 2024-09-12T00:55:10.689 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: secure 2024-09-12T00:55:10.689 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: crc 2024-09-12T00:55:10.689 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: secure 2024-09-12T00:55:10.689 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: crc 2024-09-12T00:55:10.689 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: secure 2024-09-12T00:55:10.689 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: crc 2024-09-12T00:55:10.689 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: crc 2024-09-12T00:55:10.689 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: secure 2024-09-12T00:55:10.689 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: crc 2024-09-12T00:55:10.689 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: secure 2024-09-12T00:55:10.689 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: crc 2024-09-12T00:55:10.689 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: secure 2024-09-12T00:55:10.690 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.690 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.690 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command rotate-key hook 0x55694b0bebe8 2024-09-12T00:55:10.690 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:10.690 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:55:10.690 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-c con 0x55694af48f40 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:10.690 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-a con 0x55694af73290 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:10.690 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-b con 0x55694af76e00 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:10.690 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.690 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.690 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.690 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:10.691 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): authenticate will time out at 2197.101777s 2024-09-12T00:55:10.691 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:55:10.608+0000 7fbf168f4640 10 monclient(hunting): get_auth_request con 0x55694af48f40 auth_method 0 2024-09-12T00:55:10.691 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:55:10.608+0000 7fbf168f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.691 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:55:10.608+0000 7fbf168f4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.691 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:55:10.608+0000 7fbf168f4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.691 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:55:10.608+0000 7fbf160f3640 10 monclient(hunting): get_auth_request con 0x55694af73290 auth_method 0 2024-09-12T00:55:10.691 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:55:10.608+0000 7fbf160f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.691 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:55:10.608+0000 7fbf160f3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.691 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:55:10.608+0000 7fbf160f3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.691 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:55:10.608+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.691 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:55:10.608+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.691 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:55:10.608+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.691 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:55:10.608+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.692 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:55:10.608+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.692 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:55:10.608+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.692 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:55:10.609+0000 7fbf160f3640 10 monclient(hunting): handle_auth_done global_id 8118 payload 824 2024-09-12T00:55:10.692 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:55:10.609+0000 7fbf160f3640 10 monclient: _finish_hunting 0 2024-09-12T00:55:10.692 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:55:10.609+0000 7fbf160f3640 1 monclient: found mon.noname-a 2024-09-12T00:55:10.692 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:55:10.609+0000 7fbf160f3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:55:10.692 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:55:10.609+0000 7fbf170f5640 10 monclient: get_auth_request con 0x55694af76e00 auth_method 0 2024-09-12T00:55:10.692 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.692 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:10.692 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: dump: 2024-09-12T00:55:10.692 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.692 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.692 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.693 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.693 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.693 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.693 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.693 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.693 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.693 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.693 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: _finish_auth 0 2024-09-12T00:55:10.693 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: _check_auth_tickets 2024-09-12T00:55:10.693 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:10.693 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.693 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:10.693 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: dump: 2024-09-12T00:55:10.694 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.694 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.694 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.694 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.694 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.694 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.694 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.694 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.694 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.694 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.694 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:55:10.609+0000 7fbf1ab44800 5 monclient: authenticate success, global_id 8118 2024-09-12T00:55:10.694 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:55:10.609+0000 7fbf1ab44800 10 monclient: _renew_subs 2024-09-12T00:55:10.694 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:55:10.609+0000 7fbf1ab44800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:10.695 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:55:10.609+0000 7fbe04e09640 4 set_mon_vals no callback set 2024-09-12T00:55:10.695 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:55:10.609+0000 7fbf1ab44800 10 monclient: _renew_subs 2024-09-12T00:55:10.695 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:55:10.609+0000 7fbf1ab44800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:10.695 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:55:10.609+0000 7fbf1ab44800 1 librados: init done 2024-09-12T00:55:10.695 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:55:10.611+0000 7fbe03606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:10.695 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:55:10.611+0000 7fbe03606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:10.695 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:55:10.611+0000 7fbe03606640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:10.695 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:55:10.611+0000 7fbf168f4640 10 monclient: get_auth_request con 0x7fbdfc076470 auth_method 0 2024-09-12T00:55:10.695 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:55:10.612+0000 7fbf170f5640 10 monclient: get_auth_request con 0x55694b0e7380 auth_method 0 2024-09-12T00:55:10.695 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:55:10.612+0000 7fbf168f4640 10 monclient: get_auth_request con 0x55694b10a1d0 auth_method 0 2024-09-12T00:55:10.695 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:55:10.613+0000 7fbf160f3640 10 monclient: get_auth_request con 0x55694b10e530 auth_method 0 2024-09-12T00:55:10.695 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 10 monclient: build_initial_monmap 2024-09-12T00:55:10.696 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 1 build_initial for_mkfs: 0 2024-09-12T00:55:10.696 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 10 monclient: monmap: 2024-09-12T00:55:10.696 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:55:10.696 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:10.696 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:55:10.696 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:55:10.696 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:10.696 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.696 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:55:10.696 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:55:10.696 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:55:10.696 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.696 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding auth protocol: cephx 2024-09-12T00:55:10.696 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding auth protocol: cephx 2024-09-12T00:55:10.697 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding auth protocol: cephx 2024-09-12T00:55:10.697 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: secure 2024-09-12T00:55:10.697 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: crc 2024-09-12T00:55:10.697 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: secure 2024-09-12T00:55:10.697 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: crc 2024-09-12T00:55:10.697 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: secure 2024-09-12T00:55:10.697 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: crc 2024-09-12T00:55:10.697 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: crc 2024-09-12T00:55:10.697 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: secure 2024-09-12T00:55:10.697 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: crc 2024-09-12T00:55:10.697 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: secure 2024-09-12T00:55:10.697 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: crc 2024-09-12T00:55:10.697 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: secure 2024-09-12T00:55:10.698 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.698 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command objecter_requests cmddesc objecter_requests hook 0x55694b1167c0 EEXIST 2024-09-12T00:55:10.698 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient: init 2024-09-12T00:55:10.698 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding auth protocol: cephx 2024-09-12T00:55:10.698 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding auth protocol: cephx 2024-09-12T00:55:10.698 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding auth protocol: cephx 2024-09-12T00:55:10.698 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: secure 2024-09-12T00:55:10.698 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: crc 2024-09-12T00:55:10.698 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: secure 2024-09-12T00:55:10.698 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: crc 2024-09-12T00:55:10.698 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: secure 2024-09-12T00:55:10.698 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: crc 2024-09-12T00:55:10.699 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: crc 2024-09-12T00:55:10.699 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: secure 2024-09-12T00:55:10.699 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: crc 2024-09-12T00:55:10.699 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: secure 2024-09-12T00:55:10.699 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: crc 2024-09-12T00:55:10.699 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: secure 2024-09-12T00:55:10.699 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.699 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.699 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command rotate-key cmddesc rotate-key hook 0x55694b111b40 EEXIST 2024-09-12T00:55:10.699 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:10.699 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:55:10.699 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-b con 0x55694b13aae0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:10.700 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-c con 0x55694b13aec0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:10.700 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-a con 0x55694b1397f0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:10.700 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.700 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.700 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.700 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:10.700 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): authenticate will time out at 2197.108954s 2024-09-12T00:55:10.700 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): get_auth_request con 0x55694b13aec0 auth_method 0 2024-09-12T00:55:10.700 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.700 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.700 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.700 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:55:10.616+0000 7fbf170f5640 10 monclient(hunting): get_auth_request con 0x55694b1397f0 auth_method 0 2024-09-12T00:55:10.701 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:55:10.616+0000 7fbf170f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.701 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:55:10.616+0000 7fbf170f5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.701 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:55:10.616+0000 7fbf170f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.701 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.701 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.701 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.701 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:55:10.616+0000 7fbf168f4640 10 monclient(hunting): get_auth_request con 0x55694b13aae0 auth_method 0 2024-09-12T00:55:10.701 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:55:10.616+0000 7fbf168f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.701 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:55:10.616+0000 7fbf168f4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.701 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:55:10.616+0000 7fbf168f4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.701 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:55:10.616+0000 7fbf170f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.701 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:55:10.616+0000 7fbf170f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.702 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:55:10.616+0000 7fbf170f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.702 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:55:10.616+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.702 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:55:10.616+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.702 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:55:10.616+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.702 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): handle_auth_done global_id 7676 payload 824 2024-09-12T00:55:10.702 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient: _finish_hunting 0 2024-09-12T00:55:10.702 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:55:10.616+0000 7fbf160f3640 1 monclient: found mon.noname-c 2024-09-12T00:55:10.702 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:55:10.702 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.702 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:10.702 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: dump: 2024-09-12T00:55:10.702 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.703 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.703 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.703 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.703 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.703 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.703 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.703 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.703 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.703 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.703 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: _finish_auth 0 2024-09-12T00:55:10.703 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: _check_auth_tickets 2024-09-12T00:55:10.703 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:55:10.616+0000 7fbf1ab44800 5 monclient: authenticate success, global_id 7676 2024-09-12T00:55:10.703 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:10.704 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.704 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:10.704 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: dump: 2024-09-12T00:55:10.704 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.704 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.704 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.704 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.704 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.704 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.704 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.704 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.704 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.705 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.705 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:55:10.616+0000 7fbf1ab44800 10 monclient: _renew_subs 2024-09-12T00:55:10.705 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:55:10.616+0000 7fbf1ab44800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:55:10.705 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:55:10.616+0000 7fbf178f6640 4 set_mon_vals no callback set 2024-09-12T00:55:10.705 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:55:10.616+0000 7fbf1ab44800 10 monclient: _renew_subs 2024-09-12T00:55:10.705 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:55:10.616+0000 7fbf1ab44800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:55:10.705 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:55:10.618+0000 7fbe00e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:10.705 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:55:10.618+0000 7fbe00e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:10.705 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:55:10.618+0000 7fbe00e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:10.705 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:55:10.618+0000 7fbf168f4640 10 monclient: get_auth_request con 0x7fbdf0076380 auth_method 0 2024-09-12T00:55:10.705 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 10 monclient: get_monmap_and_config 2024-09-12T00:55:10.705 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 10 monclient: build_initial_monmap 2024-09-12T00:55:10.706 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 1 build_initial for_mkfs: 0 2024-09-12T00:55:10.706 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 10 monclient: monmap: 2024-09-12T00:55:10.706 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:55:10.706 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:10.706 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:55:10.706 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:55:10.706 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:10.706 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.706 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:55:10.706 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:55:10.706 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:55:10.706 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.706 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding auth protocol: cephx 2024-09-12T00:55:10.706 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding auth protocol: cephx 2024-09-12T00:55:10.706 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding auth protocol: cephx 2024-09-12T00:55:10.707 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: secure 2024-09-12T00:55:10.707 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: crc 2024-09-12T00:55:10.707 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: secure 2024-09-12T00:55:10.707 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: crc 2024-09-12T00:55:10.707 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: secure 2024-09-12T00:55:10.707 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: crc 2024-09-12T00:55:10.707 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: crc 2024-09-12T00:55:10.707 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: secure 2024-09-12T00:55:10.707 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: crc 2024-09-12T00:55:10.707 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: secure 2024-09-12T00:55:10.707 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: crc 2024-09-12T00:55:10.707 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: secure 2024-09-12T00:55:10.707 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.707 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient: init 2024-09-12T00:55:10.708 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding auth protocol: cephx 2024-09-12T00:55:10.708 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding auth protocol: cephx 2024-09-12T00:55:10.708 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding auth protocol: cephx 2024-09-12T00:55:10.708 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: secure 2024-09-12T00:55:10.708 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: crc 2024-09-12T00:55:10.708 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: secure 2024-09-12T00:55:10.708 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: crc 2024-09-12T00:55:10.708 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: secure 2024-09-12T00:55:10.708 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: crc 2024-09-12T00:55:10.708 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: crc 2024-09-12T00:55:10.708 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: secure 2024-09-12T00:55:10.708 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: crc 2024-09-12T00:55:10.708 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: secure 2024-09-12T00:55:10.709 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: crc 2024-09-12T00:55:10.709 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: secure 2024-09-12T00:55:10.709 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.709 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.709 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command rotate-key cmddesc rotate-key hook 0x7ffd7d3bc868 EEXIST 2024-09-12T00:55:10.709 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:10.709 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:55:10.709 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-a con 0x55694b18f000 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:10.709 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-c con 0x55694b15ee10 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:10.709 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-b con 0x55694b18a3c0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:10.709 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.709 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.709 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.710 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:10.710 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): authenticate will time out at 2197.112636s 2024-09-12T00:55:10.710 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): get_auth_request con 0x55694b15ee10 auth_method 0 2024-09-12T00:55:10.710 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.710 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.710 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.710 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:55:10.619+0000 7fbf168f4640 10 monclient(hunting): get_auth_request con 0x55694b18f000 auth_method 0 2024-09-12T00:55:10.710 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:55:10.619+0000 7fbf168f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.710 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:55:10.619+0000 7fbf168f4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.710 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:55:10.619+0000 7fbf168f4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.710 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.710 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.710 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.711 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:55:10.619+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.711 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:55:10.619+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.711 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:55:10.619+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.711 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:55:10.619+0000 7fbf170f5640 10 monclient(hunting): get_auth_request con 0x55694b18a3c0 auth_method 0 2024-09-12T00:55:10.711 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:55:10.619+0000 7fbf170f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.711 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:55:10.619+0000 7fbf170f5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.711 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:55:10.619+0000 7fbf170f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.711 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): handle_auth_done global_id 7679 payload 274 2024-09-12T00:55:10.711 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient: _finish_hunting 0 2024-09-12T00:55:10.711 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:55:10.619+0000 7fbf160f3640 1 monclient: found mon.noname-c 2024-09-12T00:55:10.711 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:55:10.711 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.711 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:10.712 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: dump: 2024-09-12T00:55:10.712 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.712 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.712 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.712 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.712 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.712 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.712 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.712 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.712 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.712 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.712 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: _finish_auth 0 2024-09-12T00:55:10.712 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:55:10.713 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:10.713 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.713 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:10.713 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: dump: 2024-09-12T00:55:10.713 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.713 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.713 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.713 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.713 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.713 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.713 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.713 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.713 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.713 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.714 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 monclient: authenticate success, global_id 7679 2024-09-12T00:55:10.714 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 10 monclient: get_monmap_and_config success 2024-09-12T00:55:10.714 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 4 set_mon_vals no callback set 2024-09-12T00:55:10.714 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 10 monclient: shutdown 2024-09-12T00:55:10.714 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 10 monclient: build_initial_monmap 2024-09-12T00:55:10.714 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 1 build_initial for_mkfs: 0 2024-09-12T00:55:10.714 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 10 monclient: monmap: 2024-09-12T00:55:10.714 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:55:10.714 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:10.714 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:55:10.714 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:55:10.714 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:10.714 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.715 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:55:10.715 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:55:10.715 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:55:10.715 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.715 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding auth protocol: cephx 2024-09-12T00:55:10.715 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding auth protocol: cephx 2024-09-12T00:55:10.715 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding auth protocol: cephx 2024-09-12T00:55:10.715 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: secure 2024-09-12T00:55:10.715 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: crc 2024-09-12T00:55:10.715 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: secure 2024-09-12T00:55:10.715 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: crc 2024-09-12T00:55:10.715 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: secure 2024-09-12T00:55:10.715 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: crc 2024-09-12T00:55:10.716 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: crc 2024-09-12T00:55:10.716 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: secure 2024-09-12T00:55:10.716 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: crc 2024-09-12T00:55:10.716 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: secure 2024-09-12T00:55:10.716 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: crc 2024-09-12T00:55:10.716 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: secure 2024-09-12T00:55:10.716 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.716 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 1 librados: starting msgr at 2024-09-12T00:55:10.716 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 1 librados: starting objecter 2024-09-12T00:55:10.716 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command objecter_requests cmddesc objecter_requests hook 0x55694b18b010 EEXIST 2024-09-12T00:55:10.716 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 1 librados: setting wanted keys 2024-09-12T00:55:10.716 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 1 librados: calling monclient init 2024-09-12T00:55:10.716 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient: init 2024-09-12T00:55:10.717 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding auth protocol: cephx 2024-09-12T00:55:10.717 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding auth protocol: cephx 2024-09-12T00:55:10.717 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding auth protocol: cephx 2024-09-12T00:55:10.717 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: secure 2024-09-12T00:55:10.717 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: crc 2024-09-12T00:55:10.717 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: secure 2024-09-12T00:55:10.717 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: crc 2024-09-12T00:55:10.717 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: secure 2024-09-12T00:55:10.717 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: crc 2024-09-12T00:55:10.717 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: crc 2024-09-12T00:55:10.717 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: secure 2024-09-12T00:55:10.717 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: crc 2024-09-12T00:55:10.717 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: secure 2024-09-12T00:55:10.718 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: crc 2024-09-12T00:55:10.718 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: secure 2024-09-12T00:55:10.718 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.718 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.718 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command rotate-key cmddesc rotate-key hook 0x55694b14f4e8 EEXIST 2024-09-12T00:55:10.718 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:10.718 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:55:10.718 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-a con 0x55694b15ee10 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:10.718 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-b con 0x55694b18a3c0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:10.718 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-c con 0x55694b18f000 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:10.718 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.718 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.719 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.719 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:10.719 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): authenticate will time out at 2197.114836s 2024-09-12T00:55:10.719 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:55:10.621+0000 7fbf168f4640 10 monclient(hunting): get_auth_request con 0x55694b15ee10 auth_method 0 2024-09-12T00:55:10.719 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:55:10.621+0000 7fbf168f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.719 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:55:10.621+0000 7fbf168f4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.719 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:55:10.621+0000 7fbf168f4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.719 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:55:10.621+0000 7fbf170f5640 10 monclient(hunting): get_auth_request con 0x55694b18f000 auth_method 0 2024-09-12T00:55:10.719 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:55:10.621+0000 7fbf170f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.719 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:55:10.621+0000 7fbf170f5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.719 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:55:10.621+0000 7fbf170f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.719 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:55:10.622+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.720 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:55:10.622+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.720 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:55:10.622+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.720 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:55:10.622+0000 7fbf160f3640 10 monclient(hunting): get_auth_request con 0x55694b18a3c0 auth_method 0 2024-09-12T00:55:10.720 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:55:10.622+0000 7fbf160f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.720 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:55:10.622+0000 7fbf160f3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.720 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:55:10.622+0000 7fbf160f3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.720 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:55:10.622+0000 7fbf170f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.720 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:55:10.622+0000 7fbf170f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.720 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:55:10.622+0000 7fbf170f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.720 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:55:10.622+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.720 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:55:10.622+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.720 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:55:10.622+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.721 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:55:10.622+0000 7fbf168f4640 10 monclient(hunting): handle_auth_done global_id 8127 payload 824 2024-09-12T00:55:10.721 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:55:10.622+0000 7fbf168f4640 10 monclient: _finish_hunting 0 2024-09-12T00:55:10.721 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:55:10.622+0000 7fbf168f4640 1 monclient: found mon.noname-a 2024-09-12T00:55:10.721 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:55:10.622+0000 7fbf168f4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:55:10.721 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.721 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:10.721 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: dump: 2024-09-12T00:55:10.721 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.721 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.721 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.721 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.721 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.721 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.722 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.722 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.722 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.722 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.722 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: _finish_auth 0 2024-09-12T00:55:10.722 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:55:10.722 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:55:10.622+0000 7fbf1ab44800 5 monclient: authenticate success, global_id 8127 2024-09-12T00:55:10.722 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:55:10.622+0000 7fbf1ab44800 10 monclient: _renew_subs 2024-09-12T00:55:10.722 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:55:10.622+0000 7fbf1ab44800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:10.722 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:10.722 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.722 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:10.722 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: dump: 2024-09-12T00:55:10.723 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.723 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.723 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.723 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.723 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.723 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.723 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.723 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.723 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.723 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.723 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:55:10.622+0000 7fbdfa7fc640 4 set_mon_vals no callback set 2024-09-12T00:55:10.723 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:55:10.622+0000 7fbf1ab44800 10 monclient: _renew_subs 2024-09-12T00:55:10.723 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:55:10.622+0000 7fbf1ab44800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:10.723 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:55:10.622+0000 7fbf1ab44800 1 librados: init done 2024-09-12T00:55:10.723 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:55:10.622+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command cr dump hook 0x55694b1835f8 2024-09-12T00:55:10.724 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:55:10.624+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.724 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:55:10.624+0000 7fbdf8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:10.724 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:55:10.624+0000 7fbdf8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:10.724 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:55:10.624+0000 7fbdf8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:10.724 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:55:10.625+0000 7fbf160f3640 10 monclient: get_auth_request con 0x7fbde0076470 auth_method 0 2024-09-12T00:55:10.724 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:55:10.625+0000 7fbf170f5640 10 monclient: get_auth_request con 0x55694b1a7440 auth_method 0 2024-09-12T00:55:10.724 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:55:10.625+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.724 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:55:10.625+0000 7fbf1ab44800 20 realm 2024-09-12T00:55:10.724 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:55:10.625+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.724 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.724 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:55:10.626+0000 7fbf1ab44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:10.724 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.724 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.725 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.725 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:55:10.626+0000 7fbf168f4640 10 monclient: get_auth_request con 0x55694b1ab730 auth_method 0 2024-09-12T00:55:10.725 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:10.725 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.725 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:55:10.627+0000 7fbf160f3640 10 monclient: get_auth_request con 0x55694b1aee00 auth_method 0 2024-09-12T00:55:10.725 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:55:10.627+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:10.725 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:55:10.627+0000 7fbf1ab44800 20 searching for the correct realm 2024-09-12T00:55:10.725 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:55:10.627+0000 7fbf170f5640 10 monclient: get_auth_request con 0x55694b1b3bc0 auth_method 0 2024-09-12T00:55:10.725 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:55:10.628+0000 7fbf168f4640 10 monclient: get_auth_request con 0x7fbf10036040 auth_method 0 2024-09-12T00:55:10.725 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:55:10.630+0000 7fbf160f3640 10 monclient: get_auth_request con 0x7fbf10026040 auth_method 0 2024-09-12T00:55:10.725 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:55:10.631+0000 7fbf170f5640 0 -- 172.21.15.62:0/4278635496 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55694b1a7440 msgr2=0x55694b1a9890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:10.725 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:55:10.631+0000 7fbdf8ff9640 1 client.8127.objecter ms_handle_reset 0x55694b1a7440 session 0x55694b1a6d70 osd.6 2024-09-12T00:55:10.726 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:55:10.631+0000 7fbdf8ff9640 10 monclient: _renew_subs 2024-09-12T00:55:10.726 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:55:10.631+0000 7fbdf8ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:10.726 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:55:10.631+0000 7fbf170f5640 10 monclient: get_auth_request con 0x7fbde00866a0 auth_method 0 2024-09-12T00:55:10.726 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:55:10.633+0000 7fbf170f5640 10 monclient: get_auth_request con 0x7fbf080c5c20 auth_method 0 2024-09-12T00:55:10.726 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:55:10.633+0000 7fbf168f4640 10 monclient: get_auth_request con 0x7fbf1000ac20 auth_method 0 2024-09-12T00:55:10.726 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:55:10.635+0000 7fbf170f5640 0 -- 172.21.15.62:0/4278635496 >> [v2:172.21.15.77:6816/3177889521,v1:172.21.15.77:6817/3177889521] conn(0x55694b1b3bc0 msgr2=0x55694b1b6080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:10.726 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:55:10.635+0000 7fbdf8ff9640 1 client.8127.objecter ms_handle_reset 0x55694b1b3bc0 session 0x55694b1b3540 osd.4 2024-09-12T00:55:10.726 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:55:10.635+0000 7fbf170f5640 10 monclient: get_auth_request con 0x55694b1a7440 auth_method 0 2024-09-12T00:55:10.726 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:10.726 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:10.726 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:10.726 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:10.727 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:10.727 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:10.727 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.727 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.727 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.727 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:10.727 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.727 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:10.727 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 zone default found 2024-09-12T00:55:10.727 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 4 Realm: () 2024-09-12T00:55:10.727 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:10.727 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:10.727 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:10.727 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 zonegroup default 2024-09-12T00:55:10.727 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.728 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.728 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.728 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:55:10.640+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.728 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:55:10.640+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.728 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:55:10.640+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.728 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:55:10.640+0000 7fbf1ab44800 20 started sync module instance, tier type = 2024-09-12T00:55:10.728 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:55:10.640+0000 7fbf1ab44800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:10.728 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=0 2024-09-12T00:55:10.728 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=1 2024-09-12T00:55:10.728 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=2 2024-09-12T00:55:10.728 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=3 2024-09-12T00:55:10.728 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=4 2024-09-12T00:55:10.728 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=5 2024-09-12T00:55:10.728 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=6 2024-09-12T00:55:10.729 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:55:10.651+0000 7fbf1ab44800 20 add_watcher() i=7 2024-09-12T00:55:10.729 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:55:10.651+0000 7fbf1ab44800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:10.729 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding auth protocol: cephx 2024-09-12T00:55:10.729 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding auth protocol: cephx 2024-09-12T00:55:10.729 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding auth protocol: cephx 2024-09-12T00:55:10.729 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: secure 2024-09-12T00:55:10.729 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: crc 2024-09-12T00:55:10.729 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: secure 2024-09-12T00:55:10.729 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: crc 2024-09-12T00:55:10.729 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: secure 2024-09-12T00:55:10.729 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: crc 2024-09-12T00:55:10.729 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: crc 2024-09-12T00:55:10.730 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: secure 2024-09-12T00:55:10.730 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: crc 2024-09-12T00:55:10.730 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: secure 2024-09-12T00:55:10.730 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: crc 2024-09-12T00:55:10.730 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: secure 2024-09-12T00:55:10.730 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:55:10.653+0000 7fbdcd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:10.730 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.730 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:10.730 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:10.730 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command cache list hook 0x55694b15d940 2024-09-12T00:55:10.730 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command cache inspect hook 0x55694b15d940 2024-09-12T00:55:10.730 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command cache erase hook 0x55694b15d940 2024-09-12T00:55:10.731 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command cache zap hook 0x55694b15d940 2024-09-12T00:55:10.731 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 note: GC not initialized 2024-09-12T00:55:10.731 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:55:10.653+0000 7fbd47fff640 20 reqs_thread_entry: start 2024-09-12T00:55:10.731 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command sync trace show hook 0x7fbf0c004300 2024-09-12T00:55:10.731 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command sync trace history hook 0x7fbf0c004300 2024-09-12T00:55:10.731 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command sync trace active hook 0x7fbf0c004300 2024-09-12T00:55:10.731 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command sync trace active_short hook 0x7fbf0c004300 2024-09-12T00:55:10.731 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:10.731 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 20 Filter name: none 2024-09-12T00:55:10.731 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:55:10.653+0000 7fbd45ffb640 20 reqs_thread_entry: start 2024-09-12T00:55:10.731 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:10.731 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.732 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:10.732 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:10.732 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:10.732 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:55:10.732 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.732 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:10.732 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:10.732 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:10.732 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:10.732 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:10.732 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:55:10.732 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:55:10.659+0000 7fbf1ab44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:10.733 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:55:10.659+0000 7fbf1ab44800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:10.733 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:55:10.659+0000 7fbf1ab44800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:10.733 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:55:10.659+0000 7fbf1ab44800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:55:10.733 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:55:10.659+0000 7fbdf9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431686 cookie 93910720009760 notifier 8127 bl.length()=827 2024-09-12T00:55:10.733 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:55:10.659+0000 7fbdf9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:10.733 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:55:10.659+0000 7fbdf9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:10.733 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:55:10.659+0000 7fbdf9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:10.733 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:55:10.661+0000 7fbf1ab44800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:55:10.734 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:55:10.661+0000 7fbf1ab44800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:55:10.734 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:55:10.661+0000 7fbf1ab44800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:55:10.734 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:55:10.661+0000 7fbf1ab44800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:55:10.734 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.0 2024-09-12T00:55:10.734 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.0 2024-09-12T00:55:10.734 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.1 2024-09-12T00:55:10.734 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.1 2024-09-12T00:55:10.734 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.2 2024-09-12T00:55:10.734 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.2 2024-09-12T00:55:10.734 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.3 2024-09-12T00:55:10.734 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.3 2024-09-12T00:55:10.734 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:55:10.734 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:55:10.735 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:55:10.664+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:55:10.735 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:55:10.664+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:55:10.735 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:55:10.664+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:55:10.735 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:55:10.664+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:55:10.735 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:55:10.667+0000 7fbf1ab44800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbf1ab44800 time 2024-09-12T00:55:10.667761+0000 2024-09-12T00:55:10.735 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:10.735 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.735 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:10.735 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbf1c38c71a] 2024-09-12T00:55:10.735 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbf1c38c8d8] 2024-09-12T00:55:10.735 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569492d4641] 2024-09-12T00:55:10.735 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5569492e351b] 2024-09-12T00:55:10.736 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5569492e43e4] 2024-09-12T00:55:10.736 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:55:10.736 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbf1b029590] 2024-09-12T00:55:10.736 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:55:10.736 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:55:10.736 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.736 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:55:10.668+0000 7fbf1ab44800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:55:10.736 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7fbf1ab44800 thread_name:radosgw-admin 2024-09-12T00:55:10.736 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.736 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:10.736 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbf1b03e6f0] 2024-09-12T00:55:10.736 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbf1b08b99c] 2024-09-12T00:55:10.737 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:55:10.737 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:55:10.737 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbf1c38c774] 2024-09-12T00:55:10.737 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbf1c38c8d8] 2024-09-12T00:55:10.737 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569492d4641] 2024-09-12T00:55:10.737 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5569492e351b] 2024-09-12T00:55:10.737 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5569492e43e4] 2024-09-12T00:55:10.737 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:55:10.737 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbf1b029590] 2024-09-12T00:55:10.737 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:55:10.737 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:55:10.737 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:55:10.737 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.738 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:55:10.738 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:55:10.738 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:55:10.738 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:55:10.738 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:55:10.738 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:55:10.738 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:55:10.738 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:55:10.738 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:55:10.738 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:55:10.738 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:55:10.738 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:55:10.739 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:55:10.739 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:55:10.739 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:55:10.739 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:55:10.739 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:55:10.739 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:55:10.739 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:55:10.739 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:55:10.739 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:55:10.739 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:55:10.739 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:55:10.739 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:55:10.739 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:55:10.740 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:55:10.740 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:55:10.740 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:55:10.740 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:55:10.740 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:55:10.740 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:55:10.740 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:55:10.740 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:55:10.740 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:55:10.740 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:55:10.740 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:55:10.740 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:55:10.741 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:55:10.741 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:55:10.741 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:55:10.741 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:55:10.741 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:55:10.741 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:55:10.741 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:55:10.741 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:55:10.741 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:55:10.741 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:55:10.741 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:55:10.741 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:55:10.741 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:55:10.742 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:55:10.742 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:55:10.742 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:55:10.742 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:55:10.742 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:55:10.742 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:55:10.742 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:55:10.742 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:55:10.742 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:55:10.742 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:55:10.742 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:55:10.742 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:55:10.743 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:55:10.743 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:55:10.743 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:55:10.743 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:55:10.743 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:55:10.743 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:55:10.743 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:55:10.743 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:55:10.743 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:55:10.743 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:55:10.743 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:55:10.743 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:55:10.743 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:55:10.744 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:55:10.744 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:55:10.744 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:55:10.744 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:55:10.744 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:55:10.744 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:55:10.744 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:55:10.744 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:55:10.744 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:55:10.744 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:55:10.744 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:55:10.744 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:55:10.745 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:55:10.745 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:55:10.745 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:55:10.745 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:55:10.745 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:55:10.745 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:55:10.745 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:55:10.745 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbd45ffb640 / http_manager 2024-09-12T00:55:10.745 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbd47fff640 / http_manager 2024-09-12T00:55:10.745 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbdcd7e2640 / rgw_dt_lg_renew 2024-09-12T00:55:10.745 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbdf8ff9640 / ms_dispatch 2024-09-12T00:55:10.745 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbdf9ffb640 / io_context_pool 2024-09-12T00:55:10.745 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbdfa7fc640 / io_context_pool 2024-09-12T00:55:10.746 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbe00e01640 / ms_dispatch 2024-09-12T00:55:10.746 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbe03606640 / ms_dispatch 2024-09-12T00:55:10.746 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbe04e09640 / io_context_pool 2024-09-12T00:55:10.746 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbf160f3640 / msgr-worker-2 2024-09-12T00:55:10.746 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbf168f4640 / msgr-worker-1 2024-09-12T00:55:10.746 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbf170f5640 / msgr-worker-0 2024-09-12T00:55:10.746 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbf178f6640 / io_context_pool 2024-09-12T00:55:10.746 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbf1ab44800 / radosgw-admin 2024-09-12T00:55:10.746 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:55:10.746 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:55:10.746 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/log/ceph/ceph-client.admin.146384.log 2024-09-12T00:55:10.746 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:55:10.746 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:55:10.747 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: secure 2024-09-12T00:55:10.747 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: crc 2024-09-12T00:55:10.747 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: secure 2024-09-12T00:55:10.747 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: crc 2024-09-12T00:55:10.747 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: crc 2024-09-12T00:55:10.747 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: secure 2024-09-12T00:55:10.747 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: crc 2024-09-12T00:55:10.747 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: secure 2024-09-12T00:55:10.747 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: crc 2024-09-12T00:55:10.747 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0c4720) adding con mode: secure 2024-09-12T00:55:10.747 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:55:10.607+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.747 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 1 librados: starting msgr at 2024-09-12T00:55:10.747 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 1 librados: starting objecter 2024-09-12T00:55:10.748 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command objecter_requests hook 0x55694af77640 2024-09-12T00:55:10.748 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 1 librados: setting wanted keys 2024-09-12T00:55:10.748 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 1 librados: calling monclient init 2024-09-12T00:55:10.748 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient: init 2024-09-12T00:55:10.748 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding auth protocol: cephx 2024-09-12T00:55:10.748 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding auth protocol: cephx 2024-09-12T00:55:10.748 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding auth protocol: cephx 2024-09-12T00:55:10.748 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: secure 2024-09-12T00:55:10.748 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: crc 2024-09-12T00:55:10.748 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: secure 2024-09-12T00:55:10.748 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: crc 2024-09-12T00:55:10.748 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: secure 2024-09-12T00:55:10.749 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: crc 2024-09-12T00:55:10.749 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: crc 2024-09-12T00:55:10.749 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: secure 2024-09-12T00:55:10.749 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: crc 2024-09-12T00:55:10.749 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: secure 2024-09-12T00:55:10.749 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: crc 2024-09-12T00:55:10.749 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 AuthRegistry(0x55694b0beaa0) adding con mode: secure 2024-09-12T00:55:10.749 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.749 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.749 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command rotate-key hook 0x55694b0bebe8 2024-09-12T00:55:10.749 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:10.749 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:55:10.750 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-c con 0x55694af48f40 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:10.750 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-a con 0x55694af73290 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:10.750 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-b con 0x55694af76e00 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:10.750 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.750 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.750 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.750 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:10.750 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:55:10.608+0000 7fbf1ab44800 10 monclient(hunting): authenticate will time out at 2197.101777s 2024-09-12T00:55:10.750 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:55:10.608+0000 7fbf168f4640 10 monclient(hunting): get_auth_request con 0x55694af48f40 auth_method 0 2024-09-12T00:55:10.750 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:55:10.608+0000 7fbf168f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.750 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:55:10.608+0000 7fbf168f4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.750 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:55:10.608+0000 7fbf168f4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.751 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:55:10.608+0000 7fbf160f3640 10 monclient(hunting): get_auth_request con 0x55694af73290 auth_method 0 2024-09-12T00:55:10.751 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:55:10.608+0000 7fbf160f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.751 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:55:10.608+0000 7fbf160f3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.751 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:55:10.608+0000 7fbf160f3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.751 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:55:10.608+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.751 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:55:10.608+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.751 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:55:10.608+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.751 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:55:10.608+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.751 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:55:10.608+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.751 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:55:10.608+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.751 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:55:10.609+0000 7fbf160f3640 10 monclient(hunting): handle_auth_done global_id 8118 payload 824 2024-09-12T00:55:10.751 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:55:10.609+0000 7fbf160f3640 10 monclient: _finish_hunting 0 2024-09-12T00:55:10.752 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:55:10.609+0000 7fbf160f3640 1 monclient: found mon.noname-a 2024-09-12T00:55:10.752 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:55:10.609+0000 7fbf160f3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:55:10.752 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:55:10.609+0000 7fbf170f5640 10 monclient: get_auth_request con 0x55694af76e00 auth_method 0 2024-09-12T00:55:10.752 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.752 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:10.752 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: dump: 2024-09-12T00:55:10.752 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.752 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.752 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.752 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.752 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.752 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.752 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.753 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.753 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.753 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.753 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: _finish_auth 0 2024-09-12T00:55:10.753 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: _check_auth_tickets 2024-09-12T00:55:10.753 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:10.753 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.753 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:10.753 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:55:10.609+0000 7fbe03606640 10 monclient: dump: 2024-09-12T00:55:10.753 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.753 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.753 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.753 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.754 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.754 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.754 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.754 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.754 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.754 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.754 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:55:10.609+0000 7fbf1ab44800 5 monclient: authenticate success, global_id 8118 2024-09-12T00:55:10.754 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:55:10.609+0000 7fbf1ab44800 10 monclient: _renew_subs 2024-09-12T00:55:10.754 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:55:10.609+0000 7fbf1ab44800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:10.754 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:55:10.609+0000 7fbe04e09640 4 set_mon_vals no callback set 2024-09-12T00:55:10.754 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:55:10.609+0000 7fbf1ab44800 10 monclient: _renew_subs 2024-09-12T00:55:10.754 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:55:10.609+0000 7fbf1ab44800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:10.755 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:55:10.609+0000 7fbf1ab44800 1 librados: init done 2024-09-12T00:55:10.755 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:55:10.611+0000 7fbe03606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:10.755 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:55:10.611+0000 7fbe03606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:10.755 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:55:10.611+0000 7fbe03606640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:10.755 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:55:10.611+0000 7fbf168f4640 10 monclient: get_auth_request con 0x7fbdfc076470 auth_method 0 2024-09-12T00:55:10.755 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:55:10.612+0000 7fbf170f5640 10 monclient: get_auth_request con 0x55694b0e7380 auth_method 0 2024-09-12T00:55:10.755 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:55:10.612+0000 7fbf168f4640 10 monclient: get_auth_request con 0x55694b10a1d0 auth_method 0 2024-09-12T00:55:10.755 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:55:10.613+0000 7fbf160f3640 10 monclient: get_auth_request con 0x55694b10e530 auth_method 0 2024-09-12T00:55:10.755 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 10 monclient: build_initial_monmap 2024-09-12T00:55:10.755 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 1 build_initial for_mkfs: 0 2024-09-12T00:55:10.755 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 10 monclient: monmap: 2024-09-12T00:55:10.755 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:55:10.755 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:10.756 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:55:10.756 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:55:10.756 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:10.756 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.756 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:55:10.756 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:55:10.756 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:55:10.756 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.756 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding auth protocol: cephx 2024-09-12T00:55:10.756 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding auth protocol: cephx 2024-09-12T00:55:10.756 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding auth protocol: cephx 2024-09-12T00:55:10.756 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: secure 2024-09-12T00:55:10.756 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: crc 2024-09-12T00:55:10.757 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: secure 2024-09-12T00:55:10.757 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: crc 2024-09-12T00:55:10.757 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: secure 2024-09-12T00:55:10.757 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: crc 2024-09-12T00:55:10.757 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: crc 2024-09-12T00:55:10.757 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: secure 2024-09-12T00:55:10.757 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: crc 2024-09-12T00:55:10.757 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: secure 2024-09-12T00:55:10.757 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: crc 2024-09-12T00:55:10.757 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:55:10.614+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1132d0) adding con mode: secure 2024-09-12T00:55:10.757 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.757 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command objecter_requests cmddesc objecter_requests hook 0x55694b1167c0 EEXIST 2024-09-12T00:55:10.757 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient: init 2024-09-12T00:55:10.758 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding auth protocol: cephx 2024-09-12T00:55:10.758 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding auth protocol: cephx 2024-09-12T00:55:10.758 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding auth protocol: cephx 2024-09-12T00:55:10.758 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: secure 2024-09-12T00:55:10.758 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: crc 2024-09-12T00:55:10.758 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: secure 2024-09-12T00:55:10.758 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: crc 2024-09-12T00:55:10.758 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: secure 2024-09-12T00:55:10.758 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: crc 2024-09-12T00:55:10.758 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: crc 2024-09-12T00:55:10.758 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: secure 2024-09-12T00:55:10.758 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: crc 2024-09-12T00:55:10.758 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: secure 2024-09-12T00:55:10.759 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: crc 2024-09-12T00:55:10.759 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 AuthRegistry(0x55694b1119f8) adding con mode: secure 2024-09-12T00:55:10.759 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.759 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.759 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command rotate-key cmddesc rotate-key hook 0x55694b111b40 EEXIST 2024-09-12T00:55:10.759 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:10.759 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:55:10.759 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-b con 0x55694b13aae0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:10.759 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-c con 0x55694b13aec0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:10.759 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-a con 0x55694b1397f0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:10.759 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.759 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.760 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.760 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:10.760 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:55:10.615+0000 7fbf1ab44800 10 monclient(hunting): authenticate will time out at 2197.108954s 2024-09-12T00:55:10.760 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): get_auth_request con 0x55694b13aec0 auth_method 0 2024-09-12T00:55:10.760 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.760 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.760 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.760 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:55:10.616+0000 7fbf170f5640 10 monclient(hunting): get_auth_request con 0x55694b1397f0 auth_method 0 2024-09-12T00:55:10.760 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:55:10.616+0000 7fbf170f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.760 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:55:10.616+0000 7fbf170f5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.760 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:55:10.616+0000 7fbf170f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.760 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.761 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.761 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.761 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:55:10.616+0000 7fbf168f4640 10 monclient(hunting): get_auth_request con 0x55694b13aae0 auth_method 0 2024-09-12T00:55:10.761 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:55:10.616+0000 7fbf168f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.761 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:55:10.616+0000 7fbf168f4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.761 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:55:10.616+0000 7fbf168f4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.761 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:55:10.616+0000 7fbf170f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.761 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:55:10.616+0000 7fbf170f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.761 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:55:10.616+0000 7fbf170f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.761 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:55:10.616+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.761 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:55:10.616+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.761 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:55:10.616+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.761 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient(hunting): handle_auth_done global_id 7676 payload 824 2024-09-12T00:55:10.761 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient: _finish_hunting 0 2024-09-12T00:55:10.762 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:55:10.616+0000 7fbf160f3640 1 monclient: found mon.noname-c 2024-09-12T00:55:10.762 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:55:10.616+0000 7fbf160f3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:55:10.762 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.762 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:10.762 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: dump: 2024-09-12T00:55:10.762 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.762 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.762 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.762 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.762 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.762 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.762 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.762 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.763 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.763 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.763 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: _finish_auth 0 2024-09-12T00:55:10.763 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: _check_auth_tickets 2024-09-12T00:55:10.763 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:55:10.616+0000 7fbf1ab44800 5 monclient: authenticate success, global_id 7676 2024-09-12T00:55:10.763 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:10.763 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.763 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:10.763 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:55:10.616+0000 7fbe00e01640 10 monclient: dump: 2024-09-12T00:55:10.763 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.763 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.763 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.763 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.764 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.764 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.764 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.764 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.764 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.764 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.764 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:55:10.616+0000 7fbf1ab44800 10 monclient: _renew_subs 2024-09-12T00:55:10.764 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:55:10.616+0000 7fbf1ab44800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:55:10.764 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:55:10.616+0000 7fbf178f6640 4 set_mon_vals no callback set 2024-09-12T00:55:10.764 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:55:10.616+0000 7fbf1ab44800 10 monclient: _renew_subs 2024-09-12T00:55:10.764 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:55:10.616+0000 7fbf1ab44800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:55:10.764 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:55:10.618+0000 7fbe00e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:10.764 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:55:10.618+0000 7fbe00e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:10.765 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:55:10.618+0000 7fbe00e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:10.765 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:55:10.618+0000 7fbf168f4640 10 monclient: get_auth_request con 0x7fbdf0076380 auth_method 0 2024-09-12T00:55:10.765 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 10 monclient: get_monmap_and_config 2024-09-12T00:55:10.765 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 10 monclient: build_initial_monmap 2024-09-12T00:55:10.765 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 1 build_initial for_mkfs: 0 2024-09-12T00:55:10.765 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 10 monclient: monmap: 2024-09-12T00:55:10.765 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:55:10.765 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:10.765 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:55:10.765 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:55:10.765 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:10.765 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.765 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:55:10.766 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:55:10.766 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:55:10.766 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.766 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding auth protocol: cephx 2024-09-12T00:55:10.766 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding auth protocol: cephx 2024-09-12T00:55:10.766 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding auth protocol: cephx 2024-09-12T00:55:10.766 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: secure 2024-09-12T00:55:10.766 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: crc 2024-09-12T00:55:10.766 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: secure 2024-09-12T00:55:10.766 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: crc 2024-09-12T00:55:10.766 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: secure 2024-09-12T00:55:10.766 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: crc 2024-09-12T00:55:10.766 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: crc 2024-09-12T00:55:10.767 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: secure 2024-09-12T00:55:10.767 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: crc 2024-09-12T00:55:10.767 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: secure 2024-09-12T00:55:10.767 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: crc 2024-09-12T00:55:10.767 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:55:10.618+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15a960) adding con mode: secure 2024-09-12T00:55:10.767 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.767 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient: init 2024-09-12T00:55:10.767 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding auth protocol: cephx 2024-09-12T00:55:10.767 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding auth protocol: cephx 2024-09-12T00:55:10.767 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding auth protocol: cephx 2024-09-12T00:55:10.767 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: secure 2024-09-12T00:55:10.767 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: crc 2024-09-12T00:55:10.767 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: secure 2024-09-12T00:55:10.768 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: crc 2024-09-12T00:55:10.768 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: secure 2024-09-12T00:55:10.768 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: crc 2024-09-12T00:55:10.768 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: crc 2024-09-12T00:55:10.768 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: secure 2024-09-12T00:55:10.768 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: crc 2024-09-12T00:55:10.768 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: secure 2024-09-12T00:55:10.768 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: crc 2024-09-12T00:55:10.768 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bc720) adding con mode: secure 2024-09-12T00:55:10.768 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.768 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.768 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command rotate-key cmddesc rotate-key hook 0x7ffd7d3bc868 EEXIST 2024-09-12T00:55:10.768 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:10.769 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:55:10.769 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-a con 0x55694b18f000 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:10.769 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-c con 0x55694b15ee10 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:10.769 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-b con 0x55694b18a3c0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:10.769 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.769 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.769 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.769 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:10.769 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:55:10.619+0000 7fbf1ab44800 10 monclient(hunting): authenticate will time out at 2197.112636s 2024-09-12T00:55:10.769 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): get_auth_request con 0x55694b15ee10 auth_method 0 2024-09-12T00:55:10.769 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.769 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.770 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.770 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:55:10.619+0000 7fbf168f4640 10 monclient(hunting): get_auth_request con 0x55694b18f000 auth_method 0 2024-09-12T00:55:10.770 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:55:10.619+0000 7fbf168f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.770 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:55:10.619+0000 7fbf168f4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.770 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:55:10.619+0000 7fbf168f4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.770 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.770 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.770 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.770 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:55:10.619+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.770 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:55:10.619+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.770 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:55:10.619+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.770 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:55:10.619+0000 7fbf170f5640 10 monclient(hunting): get_auth_request con 0x55694b18a3c0 auth_method 0 2024-09-12T00:55:10.770 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:55:10.619+0000 7fbf170f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.771 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:55:10.619+0000 7fbf170f5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.771 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:55:10.619+0000 7fbf170f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.771 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient(hunting): handle_auth_done global_id 7679 payload 274 2024-09-12T00:55:10.771 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient: _finish_hunting 0 2024-09-12T00:55:10.771 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:55:10.619+0000 7fbf160f3640 1 monclient: found mon.noname-c 2024-09-12T00:55:10.771 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:55:10.619+0000 7fbf160f3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:55:10.771 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.771 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:55:10.771 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: dump: 2024-09-12T00:55:10.771 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.771 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.771 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.771 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.772 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.772 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.772 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.772 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.772 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.772 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.772 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: _finish_auth 0 2024-09-12T00:55:10.772 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:55:10.772 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:10.772 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.772 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:55:10.772 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:55:10.620+0000 7fbdfa7fc640 10 monclient: dump: 2024-09-12T00:55:10.773 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.773 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.773 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.773 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.773 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.773 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.773 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.773 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.773 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.773 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.773 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 monclient: authenticate success, global_id 7679 2024-09-12T00:55:10.773 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 10 monclient: get_monmap_and_config success 2024-09-12T00:55:10.774 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 4 set_mon_vals no callback set 2024-09-12T00:55:10.774 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 10 monclient: shutdown 2024-09-12T00:55:10.774 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 10 monclient: build_initial_monmap 2024-09-12T00:55:10.774 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 1 build_initial for_mkfs: 0 2024-09-12T00:55:10.774 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 10 monclient: monmap: 2024-09-12T00:55:10.774 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:55:10.774 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:10.774 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:55:10.774 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:55:10.774 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:10.774 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.774 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:55:10.775 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:55:10.775 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:55:10.775 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.775 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding auth protocol: cephx 2024-09-12T00:55:10.775 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding auth protocol: cephx 2024-09-12T00:55:10.775 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding auth protocol: cephx 2024-09-12T00:55:10.775 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: secure 2024-09-12T00:55:10.775 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: crc 2024-09-12T00:55:10.775 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: secure 2024-09-12T00:55:10.775 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: crc 2024-09-12T00:55:10.775 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: secure 2024-09-12T00:55:10.775 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: crc 2024-09-12T00:55:10.776 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: crc 2024-09-12T00:55:10.776 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: secure 2024-09-12T00:55:10.776 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: crc 2024-09-12T00:55:10.776 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: secure 2024-09-12T00:55:10.776 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: crc 2024-09-12T00:55:10.776 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:55:10.620+0000 7fbf1ab44800 5 AuthRegistry(0x55694b15fc50) adding con mode: secure 2024-09-12T00:55:10.776 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.776 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 1 librados: starting msgr at 2024-09-12T00:55:10.776 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 1 librados: starting objecter 2024-09-12T00:55:10.776 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command objecter_requests cmddesc objecter_requests hook 0x55694b18b010 EEXIST 2024-09-12T00:55:10.776 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 1 librados: setting wanted keys 2024-09-12T00:55:10.776 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 1 librados: calling monclient init 2024-09-12T00:55:10.777 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient: init 2024-09-12T00:55:10.777 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding auth protocol: cephx 2024-09-12T00:55:10.777 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding auth protocol: cephx 2024-09-12T00:55:10.777 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding auth protocol: cephx 2024-09-12T00:55:10.777 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: secure 2024-09-12T00:55:10.777 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: crc 2024-09-12T00:55:10.777 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: secure 2024-09-12T00:55:10.777 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: crc 2024-09-12T00:55:10.777 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: secure 2024-09-12T00:55:10.777 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: crc 2024-09-12T00:55:10.777 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: crc 2024-09-12T00:55:10.777 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: secure 2024-09-12T00:55:10.777 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: crc 2024-09-12T00:55:10.778 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: secure 2024-09-12T00:55:10.778 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: crc 2024-09-12T00:55:10.778 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 AuthRegistry(0x55694b14f3a0) adding con mode: secure 2024-09-12T00:55:10.778 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.778 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.778 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command rotate-key cmddesc rotate-key hook 0x55694b14f4e8 EEXIST 2024-09-12T00:55:10.778 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:10.778 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:55:10.778 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-a con 0x55694b15ee10 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:10.778 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-b con 0x55694b18a3c0 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:10.778 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): picked mon.noname-c con 0x55694b18f000 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:10.778 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.779 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.779 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:10.779 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:10.779 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:55:10.621+0000 7fbf1ab44800 10 monclient(hunting): authenticate will time out at 2197.114836s 2024-09-12T00:55:10.779 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:55:10.621+0000 7fbf168f4640 10 monclient(hunting): get_auth_request con 0x55694b15ee10 auth_method 0 2024-09-12T00:55:10.779 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:55:10.621+0000 7fbf168f4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.779 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:55:10.621+0000 7fbf168f4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.779 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:55:10.621+0000 7fbf168f4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.779 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:55:10.621+0000 7fbf170f5640 10 monclient(hunting): get_auth_request con 0x55694b18f000 auth_method 0 2024-09-12T00:55:10.779 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:55:10.621+0000 7fbf170f5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.779 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:55:10.621+0000 7fbf170f5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.779 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:55:10.621+0000 7fbf170f5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.779 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:55:10.622+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.780 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:55:10.622+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.780 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:55:10.622+0000 7fbf168f4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.780 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:55:10.622+0000 7fbf160f3640 10 monclient(hunting): get_auth_request con 0x55694b18a3c0 auth_method 0 2024-09-12T00:55:10.780 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:55:10.622+0000 7fbf160f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:10.780 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:55:10.622+0000 7fbf160f3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:10.780 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:55:10.622+0000 7fbf160f3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:10.780 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:55:10.622+0000 7fbf170f5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.780 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:55:10.622+0000 7fbf170f5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.780 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:55:10.622+0000 7fbf170f5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.780 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:55:10.622+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:10.780 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:55:10.622+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:10.780 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:55:10.622+0000 7fbf160f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:10.781 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:55:10.622+0000 7fbf168f4640 10 monclient(hunting): handle_auth_done global_id 8127 payload 824 2024-09-12T00:55:10.781 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:55:10.622+0000 7fbf168f4640 10 monclient: _finish_hunting 0 2024-09-12T00:55:10.781 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:55:10.622+0000 7fbf168f4640 1 monclient: found mon.noname-a 2024-09-12T00:55:10.781 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:55:10.622+0000 7fbf168f4640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:55:10.781 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.781 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:10.781 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: dump: 2024-09-12T00:55:10.781 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.781 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.781 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.781 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.781 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.781 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.782 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.782 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.782 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.782 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.782 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: _finish_auth 0 2024-09-12T00:55:10.782 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:55:10.782 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:55:10.622+0000 7fbf1ab44800 5 monclient: authenticate success, global_id 8127 2024-09-12T00:55:10.782 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:55:10.622+0000 7fbf1ab44800 10 monclient: _renew_subs 2024-09-12T00:55:10.782 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:55:10.622+0000 7fbf1ab44800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:10.782 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:10.782 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:10.782 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:10.782 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:55:10.622+0000 7fbdf8ff9640 10 monclient: dump: 2024-09-12T00:55:10.783 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:10.783 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:10.783 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.783 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:10.783 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:10.783 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:10.783 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:10.783 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:10.783 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:10.783 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.783 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:55:10.622+0000 7fbdfa7fc640 4 set_mon_vals no callback set 2024-09-12T00:55:10.783 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:55:10.622+0000 7fbf1ab44800 10 monclient: _renew_subs 2024-09-12T00:55:10.783 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:55:10.622+0000 7fbf1ab44800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:10.784 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:55:10.622+0000 7fbf1ab44800 1 librados: init done 2024-09-12T00:55:10.784 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:55:10.622+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command cr dump hook 0x55694b1835f8 2024-09-12T00:55:10.784 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:55:10.624+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.784 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:55:10.624+0000 7fbdf8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:10.784 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:55:10.624+0000 7fbdf8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:10.784 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:55:10.624+0000 7fbdf8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:10.784 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:55:10.625+0000 7fbf160f3640 10 monclient: get_auth_request con 0x7fbde0076470 auth_method 0 2024-09-12T00:55:10.784 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:55:10.625+0000 7fbf170f5640 10 monclient: get_auth_request con 0x55694b1a7440 auth_method 0 2024-09-12T00:55:10.784 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:55:10.625+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.784 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:55:10.625+0000 7fbf1ab44800 20 realm 2024-09-12T00:55:10.784 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:55:10.625+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.784 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.785 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:55:10.626+0000 7fbf1ab44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:10.785 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.785 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.785 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.785 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:55:10.626+0000 7fbf168f4640 10 monclient: get_auth_request con 0x55694b1ab730 auth_method 0 2024-09-12T00:55:10.785 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:10.785 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:55:10.626+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.785 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:55:10.627+0000 7fbf160f3640 10 monclient: get_auth_request con 0x55694b1aee00 auth_method 0 2024-09-12T00:55:10.785 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:55:10.627+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:10.785 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:55:10.627+0000 7fbf1ab44800 20 searching for the correct realm 2024-09-12T00:55:10.785 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:55:10.627+0000 7fbf170f5640 10 monclient: get_auth_request con 0x55694b1b3bc0 auth_method 0 2024-09-12T00:55:10.785 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:55:10.628+0000 7fbf168f4640 10 monclient: get_auth_request con 0x7fbf10036040 auth_method 0 2024-09-12T00:55:10.785 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:55:10.630+0000 7fbf160f3640 10 monclient: get_auth_request con 0x7fbf10026040 auth_method 0 2024-09-12T00:55:10.786 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:55:10.631+0000 7fbf170f5640 0 -- 172.21.15.62:0/4278635496 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55694b1a7440 msgr2=0x55694b1a9890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:10.786 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:55:10.631+0000 7fbdf8ff9640 1 client.8127.objecter ms_handle_reset 0x55694b1a7440 session 0x55694b1a6d70 osd.6 2024-09-12T00:55:10.786 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:55:10.631+0000 7fbdf8ff9640 10 monclient: _renew_subs 2024-09-12T00:55:10.786 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:55:10.631+0000 7fbdf8ff9640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:10.786 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:55:10.631+0000 7fbf170f5640 10 monclient: get_auth_request con 0x7fbde00866a0 auth_method 0 2024-09-12T00:55:10.786 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:55:10.633+0000 7fbf170f5640 10 monclient: get_auth_request con 0x7fbf080c5c20 auth_method 0 2024-09-12T00:55:10.786 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:55:10.633+0000 7fbf168f4640 10 monclient: get_auth_request con 0x7fbf1000ac20 auth_method 0 2024-09-12T00:55:10.786 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:55:10.635+0000 7fbf170f5640 0 -- 172.21.15.62:0/4278635496 >> [v2:172.21.15.77:6816/3177889521,v1:172.21.15.77:6817/3177889521] conn(0x55694b1b3bc0 msgr2=0x55694b1b6080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:10.786 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:55:10.635+0000 7fbdf8ff9640 1 client.8127.objecter ms_handle_reset 0x55694b1b3bc0 session 0x55694b1b3540 osd.4 2024-09-12T00:55:10.786 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:55:10.635+0000 7fbf170f5640 10 monclient: get_auth_request con 0x55694b1a7440 auth_method 0 2024-09-12T00:55:10.786 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:10.786 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:10.786 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:10.787 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:10.787 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:10.787 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:10.787 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:55:10.638+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.787 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.787 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.787 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:10.787 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.787 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:10.787 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 zone default found 2024-09-12T00:55:10.787 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 4 Realm: () 2024-09-12T00:55:10.787 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:10.788 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:10.788 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:10.788 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 zonegroup default 2024-09-12T00:55:10.788 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.788 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.788 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:55:10.639+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.788 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:55:10.640+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.788 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:55:10.640+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.788 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:55:10.640+0000 7fbf1ab44800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.788 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:55:10.640+0000 7fbf1ab44800 20 started sync module instance, tier type = 2024-09-12T00:55:10.788 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:55:10.640+0000 7fbf1ab44800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:10.788 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=0 2024-09-12T00:55:10.788 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=1 2024-09-12T00:55:10.789 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=2 2024-09-12T00:55:10.789 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=3 2024-09-12T00:55:10.789 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=4 2024-09-12T00:55:10.789 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=5 2024-09-12T00:55:10.789 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:55:10.650+0000 7fbf1ab44800 20 add_watcher() i=6 2024-09-12T00:55:10.789 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:55:10.651+0000 7fbf1ab44800 20 add_watcher() i=7 2024-09-12T00:55:10.789 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:55:10.651+0000 7fbf1ab44800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:10.789 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding auth protocol: cephx 2024-09-12T00:55:10.789 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding auth protocol: cephx 2024-09-12T00:55:10.789 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding auth protocol: cephx 2024-09-12T00:55:10.789 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: secure 2024-09-12T00:55:10.789 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: crc 2024-09-12T00:55:10.790 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: secure 2024-09-12T00:55:10.790 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: crc 2024-09-12T00:55:10.790 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: secure 2024-09-12T00:55:10.790 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: crc 2024-09-12T00:55:10.790 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: crc 2024-09-12T00:55:10.790 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: secure 2024-09-12T00:55:10.790 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: crc 2024-09-12T00:55:10.790 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: secure 2024-09-12T00:55:10.790 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: crc 2024-09-12T00:55:10.790 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 AuthRegistry(0x7ffd7d3bcc00) adding con mode: secure 2024-09-12T00:55:10.790 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:55:10.653+0000 7fbdcd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:10.790 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:10.790 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:10.791 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:10.791 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command cache list hook 0x55694b15d940 2024-09-12T00:55:10.791 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command cache inspect hook 0x55694b15d940 2024-09-12T00:55:10.791 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command cache erase hook 0x55694b15d940 2024-09-12T00:55:10.791 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command cache zap hook 0x55694b15d940 2024-09-12T00:55:10.791 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 note: GC not initialized 2024-09-12T00:55:10.791 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:55:10.653+0000 7fbd47fff640 20 reqs_thread_entry: start 2024-09-12T00:55:10.791 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command sync trace show hook 0x7fbf0c004300 2024-09-12T00:55:10.791 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command sync trace history hook 0x7fbf0c004300 2024-09-12T00:55:10.791 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command sync trace active hook 0x7fbf0c004300 2024-09-12T00:55:10.791 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 5 asok(0x55694ae9e630) register_command sync trace active_short hook 0x7fbf0c004300 2024-09-12T00:55:10.791 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:10.792 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 20 Filter name: none 2024-09-12T00:55:10.792 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:55:10.653+0000 7fbd45ffb640 20 reqs_thread_entry: start 2024-09-12T00:55:10.792 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:10.792 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:55:10.653+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.792 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:10.792 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:10.792 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:10.792 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:55:10.792 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.792 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:10.792 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:10.792 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:10.792 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:10.793 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:10.793 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:55:10.654+0000 7fbf1ab44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:55:10.793 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:55:10.659+0000 7fbf1ab44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:10.793 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:55:10.659+0000 7fbf1ab44800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:10.793 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:55:10.659+0000 7fbf1ab44800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:10.793 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:55:10.659+0000 7fbf1ab44800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:55:10.793 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:55:10.659+0000 7fbdf9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431686 cookie 93910720009760 notifier 8127 bl.length()=827 2024-09-12T00:55:10.793 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:55:10.659+0000 7fbdf9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:10.793 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:55:10.659+0000 7fbdf9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:10.793 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:55:10.659+0000 7fbdf9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:10.793 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:55:10.661+0000 7fbf1ab44800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:55:10.793 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:55:10.661+0000 7fbf1ab44800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:55:10.794 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:55:10.661+0000 7fbf1ab44800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:55:10.794 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:55:10.661+0000 7fbf1ab44800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:55:10.794 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.0 2024-09-12T00:55:10.794 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.0 2024-09-12T00:55:10.794 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.1 2024-09-12T00:55:10.794 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.1 2024-09-12T00:55:10.794 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.2 2024-09-12T00:55:10.794 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.2 2024-09-12T00:55:10.794 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.3 2024-09-12T00:55:10.794 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.3 2024-09-12T00:55:10.794 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:55:10.794 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:55:10.663+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:55:10.794 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:55:10.664+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:55:10.795 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:55:10.664+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:55:10.795 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:55:10.664+0000 7fbf1ab44800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:55:10.795 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:55:10.664+0000 7fbf1ab44800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:55:10.795 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:55:10.667+0000 7fbf1ab44800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbf1ab44800 time 2024-09-12T00:55:10.667761+0000 2024-09-12T00:55:10.795 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:10.795 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.795 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:10.795 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbf1c38c71a] 2024-09-12T00:55:10.795 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbf1c38c8d8] 2024-09-12T00:55:10.795 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569492d4641] 2024-09-12T00:55:10.795 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5569492e351b] 2024-09-12T00:55:10.795 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5569492e43e4] 2024-09-12T00:55:10.795 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:55:10.796 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbf1b029590] 2024-09-12T00:55:10.796 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:55:10.796 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:55:10.796 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.796 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:55:10.668+0000 7fbf1ab44800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:55:10.796 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7fbf1ab44800 thread_name:radosgw-admin 2024-09-12T00:55:10.796 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.796 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:10.796 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbf1b03e6f0] 2024-09-12T00:55:10.796 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbf1b08b99c] 2024-09-12T00:55:10.796 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:55:10.796 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:55:10.796 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbf1c38c774] 2024-09-12T00:55:10.797 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fbf1c38c8d8] 2024-09-12T00:55:10.797 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5569492d4641] 2024-09-12T00:55:10.797 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x5569492e351b] 2024-09-12T00:55:10.797 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5569492e43e4] 2024-09-12T00:55:10.797 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:55:10.797 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbf1b029590] 2024-09-12T00:55:10.797 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:55:10.797 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:55:10.797 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:55:10.797 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:10.797 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:55:10.797 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:55:10.797 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:55:10.798 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:55:10.798 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:55:10.798 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:55:10.798 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:55:10.798 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:55:10.798 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:55:10.798 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:55:10.798 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:55:10.798 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:55:10.798 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:55:10.798 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:55:10.798 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:55:10.798 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:55:10.799 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:55:10.799 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:55:10.799 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:55:10.799 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:55:10.799 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:55:10.799 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:55:10.799 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:55:10.799 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:55:10.799 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:55:10.799 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:55:10.799 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:55:10.799 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:55:10.799 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:55:10.800 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:55:10.800 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:55:10.800 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:55:10.800 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:55:10.800 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:55:10.800 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:55:10.800 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:55:10.800 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:55:10.800 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:55:10.800 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:55:10.800 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:55:10.800 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:55:10.801 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:55:10.801 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:55:10.801 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:55:10.801 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:55:10.801 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:55:10.801 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:55:10.801 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:55:10.801 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:55:10.801 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:55:10.801 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:55:10.801 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:55:10.801 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:55:10.801 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:55:10.802 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:55:10.802 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:55:10.802 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:55:10.802 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:55:10.802 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:55:10.802 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:55:10.802 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:55:10.802 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:55:10.802 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:55:10.802 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:55:10.802 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:55:10.802 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:55:10.802 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:55:10.802 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:55:10.803 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:55:10.803 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:55:10.803 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:55:10.803 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:55:10.803 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:55:10.803 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:55:10.803 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:55:10.803 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:55:10.803 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:55:10.803 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:55:10.803 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:55:10.803 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:55:10.803 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:55:10.804 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:55:10.804 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:55:10.804 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:55:10.804 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:55:10.804 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:55:10.804 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:55:10.804 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:55:10.804 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:55:10.804 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:55:10.804 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:55:10.804 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:55:10.804 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:55:10.804 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:55:10.805 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbd45ffb640 / http_manager 2024-09-12T00:55:10.805 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbd47fff640 / http_manager 2024-09-12T00:55:10.805 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbdcd7e2640 / rgw_dt_lg_renew 2024-09-12T00:55:10.805 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbdf8ff9640 / ms_dispatch 2024-09-12T00:55:10.805 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbdf9ffb640 / io_context_pool 2024-09-12T00:55:10.805 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbdfa7fc640 / io_context_pool 2024-09-12T00:55:10.805 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbe00e01640 / ms_dispatch 2024-09-12T00:55:10.805 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbe03606640 / ms_dispatch 2024-09-12T00:55:10.805 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbe04e09640 / io_context_pool 2024-09-12T00:55:10.805 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbf160f3640 / msgr-worker-2 2024-09-12T00:55:10.805 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbf168f4640 / msgr-worker-1 2024-09-12T00:55:10.805 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbf170f5640 / msgr-worker-0 2024-09-12T00:55:10.805 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbf178f6640 / io_context_pool 2024-09-12T00:55:10.806 INFO:tasks.workunit.client.0.smithi062.stderr: 7fbf1ab44800 / radosgw-admin 2024-09-12T00:55:10.806 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:55:10.806 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:55:10.806 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:55:10.669405Z_5c4484c4-5893-4028-a7c6-d564717d1188/log 2024-09-12T00:55:10.806 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:55:10.806 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:55:10.811 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:10.811 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:10.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.746+0000 7faf4002f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.748+0000 7faf4002f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.748+0000 7faf4002f800 20 realm 2024-09-12T00:55:10.811 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.748+0000 7faf4002f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.748+0000 7faf4002f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.748+0000 7faf4002f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:10.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.748+0000 7faf4002f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.748+0000 7faf4002f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.748+0000 7faf4002f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.749+0000 7faf4002f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:10.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.749+0000 7faf4002f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.750+0000 7faf4002f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:10.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.750+0000 7faf4002f800 20 searching for the correct realm 2024-09-12T00:55:10.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.753+0000 7faf3ab8a640 0 -- 172.21.15.62:0/4052800693 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7faf340d3bd0 msgr2=0x7faf340be130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:10.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.756+0000 7faf3b38b640 0 -- 172.21.15.62:0/4052800693 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7faf340ada80 msgr2=0x7faf340c62f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:10.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.760+0000 7faf4002f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:10.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.760+0000 7faf4002f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:10.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.760+0000 7faf4002f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:10.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.760+0000 7faf4002f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:10.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.760+0000 7faf4002f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:10.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.760+0000 7faf4002f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:10.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.760+0000 7faf4002f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.761+0000 7faf4002f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.761+0000 7faf4002f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.761+0000 7faf4002f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:10.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.761+0000 7faf4002f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.761+0000 7faf4002f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:10.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.761+0000 7faf4002f800 20 zone default found 2024-09-12T00:55:10.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.761+0000 7faf4002f800 4 Realm: () 2024-09-12T00:55:10.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.761+0000 7faf4002f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:10.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.761+0000 7faf4002f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:10.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.761+0000 7faf4002f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:10.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.761+0000 7faf4002f800 20 zonegroup default 2024-09-12T00:55:10.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.761+0000 7faf4002f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.762+0000 7faf4002f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.762+0000 7faf4002f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.762+0000 7faf4002f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.762+0000 7faf4002f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.763+0000 7faf4002f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.763+0000 7faf4002f800 20 started sync module instance, tier type = 2024-09-12T00:55:10.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.763+0000 7faf4002f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:10.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.772+0000 7faf4002f800 20 add_watcher() i=0 2024-09-12T00:55:10.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.772+0000 7faf4002f800 20 add_watcher() i=1 2024-09-12T00:55:10.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.772+0000 7faf4002f800 20 add_watcher() i=2 2024-09-12T00:55:10.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.772+0000 7faf4002f800 20 add_watcher() i=3 2024-09-12T00:55:10.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.772+0000 7faf4002f800 20 add_watcher() i=4 2024-09-12T00:55:10.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.772+0000 7faf4002f800 20 add_watcher() i=5 2024-09-12T00:55:10.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.772+0000 7faf4002f800 20 add_watcher() i=6 2024-09-12T00:55:10.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.773+0000 7faf4002f800 20 add_watcher() i=7 2024-09-12T00:55:10.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.773+0000 7faf4002f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:10.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.774+0000 7fadf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:10.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.775+0000 7faf4002f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:10.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.775+0000 7faf4002f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:10.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.775+0000 7faf4002f800 5 note: GC not initialized 2024-09-12T00:55:10.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.775+0000 7fadf0fe1640 20 reqs_thread_entry: start 2024-09-12T00:55:10.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.775+0000 7faf4002f800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:10.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.775+0000 7faf4002f800 20 Filter name: none 2024-09-12T00:55:10.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.775+0000 7fad6a7fc640 20 reqs_thread_entry: start 2024-09-12T00:55:10.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.775+0000 7faf4002f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.776+0000 7faf4002f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:10.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.776+0000 7faf4002f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.776+0000 7faf4002f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:10.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.776+0000 7faf4002f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:10.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.776+0000 7faf4002f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.776+0000 7faf4002f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:10.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.776+0000 7faf4002f800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.816 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.777+0000 7faf4002f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:10.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.777+0000 7faf4002f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:10.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.778+0000 7fadf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:10.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.781+0000 7faf4002f800 20 remove_watcher() i=0 2024-09-12T00:55:10.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.781+0000 7faf4002f800 2 removed watcher, disabling cache 2024-09-12T00:55:10.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.782+0000 7faf4002f800 20 remove_watcher() i=1 2024-09-12T00:55:10.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.783+0000 7faf4002f800 20 remove_watcher() i=2 2024-09-12T00:55:10.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.784+0000 7faf4002f800 20 remove_watcher() i=3 2024-09-12T00:55:10.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.785+0000 7faf4002f800 20 remove_watcher() i=4 2024-09-12T00:55:10.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.787+0000 7faf4002f800 20 remove_watcher() i=5 2024-09-12T00:55:10.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.789+0000 7faf4002f800 20 remove_watcher() i=6 2024-09-12T00:55:10.817 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.790+0000 7faf4002f800 20 remove_watcher() i=7 2024-09-12T00:55:10.841 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:55:10.870 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:10.871 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:10.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.911+0000 7f885512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.912+0000 7f885512e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.912+0000 7f885512e800 20 realm 2024-09-12T00:55:10.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.912+0000 7f885512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.912+0000 7f885512e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.912+0000 7f885512e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:10.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.913+0000 7f885512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.913+0000 7f885512e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:10.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.913+0000 7f885512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.913+0000 7f885512e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:10.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.913+0000 7f885512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:10.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.914+0000 7f885512e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:10.913 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.914+0000 7f885512e800 20 searching for the correct realm 2024-09-12T00:55:10.916 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:10.917+0000 7f8850563640 0 -- 172.21.15.62:0/2851672458 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f884801f3b0 msgr2=0x7f884801f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:11.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.123+0000 7f8851565640 0 -- 172.21.15.62:0/2851672458 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5635e2cfeff0 msgr2=0x5635e2d01420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:11.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.127+0000 7f885512e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:11.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.127+0000 7f885512e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:11.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.127+0000 7f885512e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:11.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.127+0000 7f885512e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:11.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.127+0000 7f885512e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:11.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.127+0000 7f885512e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:11.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.127+0000 7f885512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:11.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.128+0000 7f885512e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:11.127 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.128+0000 7f885512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:11.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.128+0000 7f885512e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:11.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.128+0000 7f885512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:11.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.128+0000 7f885512e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:11.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.128+0000 7f885512e800 20 zone default found 2024-09-12T00:55:11.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.128+0000 7f885512e800 4 Realm: () 2024-09-12T00:55:11.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.128+0000 7f885512e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:11.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.128+0000 7f885512e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:11.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.128+0000 7f885512e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:11.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.128+0000 7f885512e800 20 zonegroup default 2024-09-12T00:55:11.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.128+0000 7f885512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:11.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.129+0000 7f885512e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:11.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.129+0000 7f885512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:11.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.129+0000 7f885512e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:11.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.129+0000 7f885512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:11.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.129+0000 7f885512e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:11.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.129+0000 7f885512e800 20 started sync module instance, tier type = 2024-09-12T00:55:11.130 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.129+0000 7f885512e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:11.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.140+0000 7f885512e800 20 add_watcher() i=0 2024-09-12T00:55:11.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.140+0000 7f885512e800 20 add_watcher() i=1 2024-09-12T00:55:11.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.140+0000 7f885512e800 20 add_watcher() i=2 2024-09-12T00:55:11.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.140+0000 7f885512e800 20 add_watcher() i=3 2024-09-12T00:55:11.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.140+0000 7f885512e800 20 add_watcher() i=4 2024-09-12T00:55:11.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.140+0000 7f885512e800 20 add_watcher() i=5 2024-09-12T00:55:11.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.140+0000 7f885512e800 20 add_watcher() i=6 2024-09-12T00:55:11.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.141+0000 7f885512e800 20 add_watcher() i=7 2024-09-12T00:55:11.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.141+0000 7f885512e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:11.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.143+0000 7f87077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:11.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.143+0000 7f885512e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:11.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.143+0000 7f885512e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:11.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.143+0000 7f885512e800 5 note: GC not initialized 2024-09-12T00:55:11.144 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.143+0000 7f87067e4640 20 reqs_thread_entry: start 2024-09-12T00:55:11.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.143+0000 7f885512e800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:11.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.143+0000 7f885512e800 20 Filter name: none 2024-09-12T00:55:11.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.143+0000 7f86ff7fe640 20 reqs_thread_entry: start 2024-09-12T00:55:11.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.143+0000 7f885512e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:11.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.143+0000 7f885512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:11.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.144+0000 7f885512e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:11.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.144+0000 7f885512e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:11.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.144+0000 7f885512e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:11.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.144+0000 7f885512e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:55:11.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.144+0000 7f885512e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:11.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.144+0000 7f885512e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:11.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.144+0000 7f885512e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:11.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.144+0000 7f885512e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:11.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.144+0000 7f885512e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:11.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.144+0000 7f885512e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:11.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.144+0000 7f885512e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:55:11.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.144+0000 7f885512e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:55:11.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.144+0000 7f885512e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:55:11.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.145+0000 7f885512e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:55:11.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.145+0000 7f885512e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:55:11.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.145+0000 7f885512e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:55:11.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.145+0000 7f885512e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:55:11.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.146+0000 7f87077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:11.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.149+0000 7f885512e800 20 remove_watcher() i=0 2024-09-12T00:55:11.148 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.149+0000 7f885512e800 2 removed watcher, disabling cache 2024-09-12T00:55:11.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.150+0000 7f885512e800 20 remove_watcher() i=1 2024-09-12T00:55:11.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.151+0000 7f885512e800 20 remove_watcher() i=2 2024-09-12T00:55:11.151 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.152+0000 7f885512e800 20 remove_watcher() i=3 2024-09-12T00:55:11.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.153+0000 7f885512e800 20 remove_watcher() i=4 2024-09-12T00:55:11.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.154+0000 7f885512e800 20 remove_watcher() i=5 2024-09-12T00:55:11.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.155+0000 7f885512e800 20 remove_watcher() i=6 2024-09-12T00:55:11.155 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:11.156+0000 7f885512e800 20 remove_watcher() i=7 2024-09-12T00:55:41.198 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:55:41.234 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:41.234 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:41.279 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.280+0000 7f07c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.282+0000 7f07c260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.282+0000 7f07c260e800 20 realm 2024-09-12T00:55:41.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.282+0000 7f07c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.282+0000 7f07c260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.282+0000 7f07c260e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:41.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.282+0000 7f07c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.282+0000 7f07c260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.282+0000 7f07c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.283+0000 7f07c260e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:41.282 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.283+0000 7f07c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.283 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.284+0000 7f07c260e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:41.283 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.284+0000 7f07c260e800 20 searching for the correct realm 2024-09-12T00:55:41.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.288+0000 7f07bd56a640 0 -- 172.21.15.62:0/2339381152 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f07b800e070 msgr2=0x7f07b80310b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:41.493 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.494+0000 7f07be56c640 0 -- 172.21.15.62:0/2339381152 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x559abc4979c0 msgr2=0x559abc499db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:41.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.500+0000 7f07c260e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:41.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.500+0000 7f07c260e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:41.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.500+0000 7f07c260e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:41.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.500+0000 7f07c260e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:41.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.500+0000 7f07c260e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:41.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.500+0000 7f07c260e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:41.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.500+0000 7f07c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.500+0000 7f07c260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.499 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.500+0000 7f07c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.500+0000 7f07c260e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:41.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.500+0000 7f07c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.501+0000 7f07c260e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:41.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.501+0000 7f07c260e800 20 zone default found 2024-09-12T00:55:41.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.501+0000 7f07c260e800 4 Realm: () 2024-09-12T00:55:41.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.501+0000 7f07c260e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:41.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.501+0000 7f07c260e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:41.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.501+0000 7f07c260e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:41.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.501+0000 7f07c260e800 20 zonegroup default 2024-09-12T00:55:41.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.501+0000 7f07c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.501+0000 7f07c260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.501+0000 7f07c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.502+0000 7f07c260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.502+0000 7f07c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.502+0000 7f07c260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.502+0000 7f07c260e800 20 started sync module instance, tier type = 2024-09-12T00:55:41.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.502+0000 7f07c260e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:41.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.512+0000 7f07c260e800 20 add_watcher() i=0 2024-09-12T00:55:41.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.512+0000 7f07c260e800 20 add_watcher() i=1 2024-09-12T00:55:41.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.512+0000 7f07c260e800 20 add_watcher() i=2 2024-09-12T00:55:41.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.512+0000 7f07c260e800 20 add_watcher() i=3 2024-09-12T00:55:41.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.512+0000 7f07c260e800 20 add_watcher() i=4 2024-09-12T00:55:41.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.512+0000 7f07c260e800 20 add_watcher() i=5 2024-09-12T00:55:41.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.512+0000 7f07c260e800 20 add_watcher() i=6 2024-09-12T00:55:41.512 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.513+0000 7f07c260e800 20 add_watcher() i=7 2024-09-12T00:55:41.512 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.513+0000 7f07c260e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:41.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.515+0000 7f066ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:41.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.515+0000 7f07c260e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:41.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.515+0000 7f07c260e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:41.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.515+0000 7f07c260e800 5 note: GC not initialized 2024-09-12T00:55:41.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.515+0000 7f066effd640 20 reqs_thread_entry: start 2024-09-12T00:55:41.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.516+0000 7f07c260e800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:41.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.516+0000 7f07c260e800 20 Filter name: none 2024-09-12T00:55:41.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.516+0000 7f066cff9640 20 reqs_thread_entry: start 2024-09-12T00:55:41.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.516+0000 7f07c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.516+0000 7f07c260e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:41.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.516+0000 7f07c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.517+0000 7f07c260e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:41.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.517+0000 7f07c260e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:41.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.517+0000 7f07c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.517+0000 7f07c260e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:41.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.517+0000 7f07c260e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.517+0000 7f07c260e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:41.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.517+0000 7f07c260e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:41.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.519+0000 7f066ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:41.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.521+0000 7f07c260e800 20 remove_watcher() i=0 2024-09-12T00:55:41.520 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.521+0000 7f07c260e800 2 removed watcher, disabling cache 2024-09-12T00:55:41.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.522+0000 7f07c260e800 20 remove_watcher() i=1 2024-09-12T00:55:41.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.524+0000 7f07c260e800 20 remove_watcher() i=2 2024-09-12T00:55:41.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.525+0000 7f07c260e800 20 remove_watcher() i=3 2024-09-12T00:55:41.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.526+0000 7f07c260e800 20 remove_watcher() i=4 2024-09-12T00:55:41.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.527+0000 7f07c260e800 20 remove_watcher() i=5 2024-09-12T00:55:41.527 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.528+0000 7f07c260e800 20 remove_watcher() i=6 2024-09-12T00:55:41.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.530+0000 7f07c260e800 20 remove_watcher() i=7 2024-09-12T00:55:41.616 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:55:41.646 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:41.646 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:41.685 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.686+0000 7f095ca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.688+0000 7f095ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.688+0000 7f095ca0e800 20 realm 2024-09-12T00:55:41.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.688+0000 7f095ca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.688+0000 7f095ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.688+0000 7f095ca0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:41.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.688+0000 7f095ca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.687 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.688+0000 7f095ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.688+0000 7f095ca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.689+0000 7f095ca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:41.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.689+0000 7f095ca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.688 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.689+0000 7f095ca0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:41.689 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.689+0000 7f095ca0e800 20 searching for the correct realm 2024-09-12T00:55:41.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.693+0000 7f0957979640 0 -- 172.21.15.62:0/1398468215 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f0950061070 msgr2=0x7f09500619e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:41.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.696+0000 7f095817a640 0 -- 172.21.15.62:0/1398468215 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f0950004040 msgr2=0x7f09500619e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:41.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.701+0000 7f095ca0e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:41.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.701+0000 7f095ca0e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:41.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.701+0000 7f095ca0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:41.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.701+0000 7f095ca0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:41.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.701+0000 7f095ca0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:41.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.701+0000 7f095ca0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:41.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.701+0000 7f095ca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.701+0000 7f095ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.701+0000 7f095ca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.701+0000 7f095ca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:41.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.701+0000 7f095ca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.702+0000 7f095ca0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:41.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.702+0000 7f095ca0e800 20 zone default found 2024-09-12T00:55:41.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.702+0000 7f095ca0e800 4 Realm: () 2024-09-12T00:55:41.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.702+0000 7f095ca0e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:41.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.702+0000 7f095ca0e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:41.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.702+0000 7f095ca0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:41.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.702+0000 7f095ca0e800 20 zonegroup default 2024-09-12T00:55:41.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.702+0000 7f095ca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.702+0000 7f095ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.702+0000 7f095ca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.702+0000 7f095ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.702+0000 7f095ca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.702+0000 7f095ca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.702+0000 7f095ca0e800 20 started sync module instance, tier type = 2024-09-12T00:55:41.704 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.702+0000 7f095ca0e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:41.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.711+0000 7f095ca0e800 20 add_watcher() i=0 2024-09-12T00:55:41.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.711+0000 7f095ca0e800 20 add_watcher() i=1 2024-09-12T00:55:41.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.711+0000 7f095ca0e800 20 add_watcher() i=2 2024-09-12T00:55:41.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.711+0000 7f095ca0e800 20 add_watcher() i=3 2024-09-12T00:55:41.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.711+0000 7f095ca0e800 20 add_watcher() i=4 2024-09-12T00:55:41.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.711+0000 7f095ca0e800 20 add_watcher() i=5 2024-09-12T00:55:41.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.711+0000 7f095ca0e800 20 add_watcher() i=6 2024-09-12T00:55:41.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.712+0000 7f095ca0e800 20 add_watcher() i=7 2024-09-12T00:55:41.711 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.712+0000 7f095ca0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:41.714 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.714+0000 7f080efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:41.714 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.714+0000 7f095ca0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:41.714 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.714+0000 7f095ca0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:41.714 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.714+0000 7f095ca0e800 5 note: GC not initialized 2024-09-12T00:55:41.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.715+0000 7f080dfe3640 20 reqs_thread_entry: start 2024-09-12T00:55:41.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.715+0000 7f095ca0e800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:41.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.715+0000 7f095ca0e800 20 Filter name: none 2024-09-12T00:55:41.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.715+0000 7f08077fe640 20 reqs_thread_entry: start 2024-09-12T00:55:41.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.715+0000 7f095ca0e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:41.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.715+0000 7f095ca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.715+0000 7f095ca0e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:41.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.715+0000 7f095ca0e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:41.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.715+0000 7f095ca0e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:41.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.715+0000 7f095ca0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:55:41.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.715+0000 7f095ca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.716+0000 7f095ca0e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:41.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.716+0000 7f095ca0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:41.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.716+0000 7f095ca0e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:41.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.716+0000 7f095ca0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:41.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.716+0000 7f095ca0e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:41.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.716+0000 7f095ca0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:55:41.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.716+0000 7f095ca0e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:55:41.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.716+0000 7f095ca0e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:55:41.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.716+0000 7f095ca0e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:55:41.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.716+0000 7f095ca0e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:55:41.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.716+0000 7f095ca0e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:55:41.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.716+0000 7f095ca0e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:55:41.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.718+0000 7f080efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:41.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.720+0000 7f095ca0e800 20 remove_watcher() i=0 2024-09-12T00:55:41.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.720+0000 7f095ca0e800 2 removed watcher, disabling cache 2024-09-12T00:55:41.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.721+0000 7f095ca0e800 20 remove_watcher() i=1 2024-09-12T00:55:41.721 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.722+0000 7f095ca0e800 20 remove_watcher() i=2 2024-09-12T00:55:41.722 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.723+0000 7f095ca0e800 20 remove_watcher() i=3 2024-09-12T00:55:41.723 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.724+0000 7f095ca0e800 20 remove_watcher() i=4 2024-09-12T00:55:41.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.726+0000 7f095ca0e800 20 remove_watcher() i=5 2024-09-12T00:55:41.725 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.727+0000 7f095ca0e800 20 remove_watcher() i=6 2024-09-12T00:55:41.727 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.728+0000 7f095ca0e800 20 remove_watcher() i=7 2024-09-12T00:55:41.739 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:55:41.768 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:41.769 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:41.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.808+0000 7fbc7aa15800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.810+0000 7fbc7aa15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.810+0000 7fbc7aa15800 20 realm 2024-09-12T00:55:41.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.810+0000 7fbc7aa15800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.810+0000 7fbc7aa15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.810+0000 7fbc7aa15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:41.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.810+0000 7fbc7aa15800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.810+0000 7fbc7aa15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:41.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.810+0000 7fbc7aa15800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.811+0000 7fbc7aa15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:41.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.811+0000 7fbc7aa15800 20 rados->read ofs=0 len=0 2024-09-12T00:55:41.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.811+0000 7fbc7aa15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:41.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.811+0000 7fbc7aa15800 20 searching for the correct realm 2024-09-12T00:55:41.813 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:41.814+0000 7fbc75991640 0 -- 172.21.15.62:0/40279049 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fbc700603b0 msgr2=0x7fbc70060830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:42.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.019+0000 7fbc76993640 0 -- 172.21.15.62:0/40279049 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55a4f91b9910 msgr2=0x55a4f91bbda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:42.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.024+0000 7fbc7aa15800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:42.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.024+0000 7fbc7aa15800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:42.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.024+0000 7fbc7aa15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:42.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.024+0000 7fbc7aa15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:42.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.024+0000 7fbc7aa15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:42.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.024+0000 7fbc7aa15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:42.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.024+0000 7fbc7aa15800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.024+0000 7fbc7aa15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.024+0000 7fbc7aa15800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.024+0000 7fbc7aa15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:42.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.024+0000 7fbc7aa15800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.025+0000 7fbc7aa15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:42.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.025+0000 7fbc7aa15800 20 zone default found 2024-09-12T00:55:42.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.025+0000 7fbc7aa15800 4 Realm: () 2024-09-12T00:55:42.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.025+0000 7fbc7aa15800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:42.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.025+0000 7fbc7aa15800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:42.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.025+0000 7fbc7aa15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:42.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.025+0000 7fbc7aa15800 20 zonegroup default 2024-09-12T00:55:42.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.025+0000 7fbc7aa15800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.025+0000 7fbc7aa15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.025+0000 7fbc7aa15800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.025+0000 7fbc7aa15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.025+0000 7fbc7aa15800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.026+0000 7fbc7aa15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.026+0000 7fbc7aa15800 20 started sync module instance, tier type = 2024-09-12T00:55:42.026 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.026+0000 7fbc7aa15800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:42.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.034+0000 7fbc7aa15800 20 add_watcher() i=0 2024-09-12T00:55:42.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.034+0000 7fbc7aa15800 20 add_watcher() i=1 2024-09-12T00:55:42.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.034+0000 7fbc7aa15800 20 add_watcher() i=2 2024-09-12T00:55:42.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.034+0000 7fbc7aa15800 20 add_watcher() i=3 2024-09-12T00:55:42.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.034+0000 7fbc7aa15800 20 add_watcher() i=4 2024-09-12T00:55:42.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.034+0000 7fbc7aa15800 20 add_watcher() i=5 2024-09-12T00:55:42.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.034+0000 7fbc7aa15800 20 add_watcher() i=6 2024-09-12T00:55:42.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.036+0000 7fbc7aa15800 20 add_watcher() i=7 2024-09-12T00:55:42.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.036+0000 7fbc7aa15800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:42.036 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.037+0000 7fbb2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:42.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.038+0000 7fbc7aa15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:42.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.038+0000 7fbc7aa15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:42.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.038+0000 7fbc7aa15800 5 note: GC not initialized 2024-09-12T00:55:42.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.038+0000 7fbaa77fe640 20 reqs_thread_entry: start 2024-09-12T00:55:42.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.038+0000 7fbc7aa15800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:42.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.038+0000 7fbc7aa15800 20 Filter name: none 2024-09-12T00:55:42.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.038+0000 7fbaa57fa640 20 reqs_thread_entry: start 2024-09-12T00:55:42.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.038+0000 7fbc7aa15800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.039+0000 7fbc7aa15800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:42.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.039+0000 7fbc7aa15800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.039+0000 7fbc7aa15800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:42.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.039+0000 7fbc7aa15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:42.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.039+0000 7fbc7aa15800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.039+0000 7fbc7aa15800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:42.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.039+0000 7fbc7aa15800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.039+0000 7fbc7aa15800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:42.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.039+0000 7fbc7aa15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:42.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.041+0000 7fbb2cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:42.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.043+0000 7fbc7aa15800 20 remove_watcher() i=0 2024-09-12T00:55:42.042 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.043+0000 7fbc7aa15800 2 removed watcher, disabling cache 2024-09-12T00:55:42.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.044+0000 7fbc7aa15800 20 remove_watcher() i=1 2024-09-12T00:55:42.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.045+0000 7fbc7aa15800 20 remove_watcher() i=2 2024-09-12T00:55:42.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.046+0000 7fbc7aa15800 20 remove_watcher() i=3 2024-09-12T00:55:42.046 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.047+0000 7fbc7aa15800 20 remove_watcher() i=4 2024-09-12T00:55:42.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.048+0000 7fbc7aa15800 20 remove_watcher() i=5 2024-09-12T00:55:42.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.049+0000 7fbc7aa15800 20 remove_watcher() i=6 2024-09-12T00:55:42.049 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.050+0000 7fbc7aa15800 20 remove_watcher() i=7 2024-09-12T00:55:42.061 INFO:tasks.workunit.client.0.smithi062.stderr: test: duplicated entries should be purged before reshard 2024-09-12T00:55:42.062 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:55:42.091 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:42.091 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:42.131 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.132+0000 7fc3be146800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.134+0000 7fc3be146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.134+0000 7fc3be146800 20 realm 2024-09-12T00:55:42.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.134+0000 7fc3be146800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.134 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.134+0000 7fc3be146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.134 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.134+0000 7fc3be146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:42.134 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.134+0000 7fc3be146800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.134 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.135+0000 7fc3be146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.134 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.135+0000 7fc3be146800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.134 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.135+0000 7fc3be146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:42.134 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.135+0000 7fc3be146800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.135 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.136+0000 7fc3be146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:42.135 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.136+0000 7fc3be146800 20 searching for the correct realm 2024-09-12T00:55:42.136 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.137+0000 7fc3bbc37640 0 -- 172.21.15.62:0/2211420416 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x555666d11730 msgr2=0x7fc3b40608c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:42.140 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.142+0000 7fc3bc438640 0 -- 172.21.15.62:0/2211420416 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7fc3ac080070 msgr2=0x7fc3ac0688b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:42.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.350+0000 7fc3be146800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:42.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.350+0000 7fc3be146800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:42.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.350+0000 7fc3be146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:42.349 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.350+0000 7fc3be146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:42.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.350+0000 7fc3be146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:42.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.350+0000 7fc3be146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:42.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.350+0000 7fc3be146800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.350+0000 7fc3be146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.350+0000 7fc3be146800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.350+0000 7fc3be146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:42.350 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.350+0000 7fc3be146800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.351+0000 7fc3be146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:42.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.351+0000 7fc3be146800 20 zone default found 2024-09-12T00:55:42.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.351+0000 7fc3be146800 4 Realm: () 2024-09-12T00:55:42.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.351+0000 7fc3be146800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:42.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.351+0000 7fc3be146800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:42.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.351+0000 7fc3be146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:42.351 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.351+0000 7fc3be146800 20 zonegroup default 2024-09-12T00:55:42.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.351+0000 7fc3be146800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.351+0000 7fc3be146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.351+0000 7fc3be146800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.351+0000 7fc3be146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.351+0000 7fc3be146800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.352+0000 7fc3be146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.352+0000 7fc3be146800 20 started sync module instance, tier type = 2024-09-12T00:55:42.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.352+0000 7fc3be146800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:42.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.362+0000 7fc3be146800 20 add_watcher() i=0 2024-09-12T00:55:42.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.362+0000 7fc3be146800 20 add_watcher() i=1 2024-09-12T00:55:42.361 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.362+0000 7fc3be146800 20 add_watcher() i=2 2024-09-12T00:55:42.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.362+0000 7fc3be146800 20 add_watcher() i=3 2024-09-12T00:55:42.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.362+0000 7fc3be146800 20 add_watcher() i=4 2024-09-12T00:55:42.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.362+0000 7fc3be146800 20 add_watcher() i=5 2024-09-12T00:55:42.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.362+0000 7fc3be146800 20 add_watcher() i=6 2024-09-12T00:55:42.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.363+0000 7fc3be146800 20 add_watcher() i=7 2024-09-12T00:55:42.362 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.363+0000 7fc3be146800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:42.364 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.365+0000 7fc271fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:42.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.365+0000 7fc3be146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:42.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.365+0000 7fc3be146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:42.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.365+0000 7fc3be146800 5 note: GC not initialized 2024-09-12T00:55:42.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.365+0000 7fc270fe1640 20 reqs_thread_entry: start 2024-09-12T00:55:42.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.366+0000 7fc3be146800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:42.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.366+0000 7fc3be146800 20 Filter name: none 2024-09-12T00:55:42.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.366+0000 7fc1ea7fc640 20 reqs_thread_entry: start 2024-09-12T00:55:42.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.366+0000 7fc3be146800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.366+0000 7fc3be146800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:42.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.366+0000 7fc3be146800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.366+0000 7fc3be146800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:42.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.366+0000 7fc3be146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:42.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.366+0000 7fc3be146800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.367+0000 7fc3be146800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:42.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.367+0000 7fc3be146800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.367+0000 7fc3be146800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:42.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.367+0000 7fc3be146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:42.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.368+0000 7fc271fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:42.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.371+0000 7fc3be146800 20 remove_watcher() i=0 2024-09-12T00:55:42.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.371+0000 7fc3be146800 2 removed watcher, disabling cache 2024-09-12T00:55:42.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.372+0000 7fc3be146800 20 remove_watcher() i=1 2024-09-12T00:55:42.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.373+0000 7fc3be146800 20 remove_watcher() i=2 2024-09-12T00:55:42.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.374+0000 7fc3be146800 20 remove_watcher() i=3 2024-09-12T00:55:42.374 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.375+0000 7fc3be146800 20 remove_watcher() i=4 2024-09-12T00:55:42.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.376+0000 7fc3be146800 20 remove_watcher() i=5 2024-09-12T00:55:42.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.377+0000 7fc3be146800 20 remove_watcher() i=6 2024-09-12T00:55:42.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.378+0000 7fc3be146800 20 remove_watcher() i=7 2024-09-12T00:55:42.388 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.388 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:55:42.388 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: a-bucket id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 num_objects: 10 size_kb: 1 num_shards: 3 2024-09-12T00:55:42.388 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.389 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:55:42.424 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:42.439 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:42.463 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.464+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.465+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.465+0000 7f05c4d2c800 20 realm 2024-09-12T00:55:42.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.465+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.466+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.466+0000 7f05c4d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:42.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.466+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.466+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.466+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.467+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:42.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.467+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.467+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:42.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.467+0000 7f05c4d2c800 20 searching for the correct realm 2024-09-12T00:55:42.468 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.470+0000 7f05c0945640 0 -- 172.21.15.62:0/844967091 >> [v2:172.21.15.62:6816/3104025159,v1:172.21.15.62:6817/3104025159] conn(0x5638a923a900 msgr2=0x5638a923cd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:42.472 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.473+0000 7f05c0945640 0 -- 172.21.15.62:0/844967091 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f05bc003410 msgr2=0x7f05bc003890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:42.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:42.679 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:42.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:42.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:42.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:42.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:42.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:42.680 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:42.681 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 zone default found 2024-09-12T00:55:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.681+0000 7f05c4d2c800 4 Realm: () 2024-09-12T00:55:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.681+0000 7f05c4d2c800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.681+0000 7f05c4d2c800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.681+0000 7f05c4d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 zonegroup default 2024-09-12T00:55:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.682+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.682+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.682+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.682 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.682+0000 7f05c4d2c800 20 started sync module instance, tier type = 2024-09-12T00:55:42.683 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.682+0000 7f05c4d2c800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:42.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=0 2024-09-12T00:55:42.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=1 2024-09-12T00:55:42.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=2 2024-09-12T00:55:42.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=3 2024-09-12T00:55:42.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=4 2024-09-12T00:55:42.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=5 2024-09-12T00:55:42.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=6 2024-09-12T00:55:42.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.692+0000 7f05c4d2c800 20 add_watcher() i=7 2024-09-12T00:55:42.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.692+0000 7f05c4d2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:42.694 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.695+0000 7f0476fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:42.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.695+0000 7f05c4d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:42.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.695+0000 7f05c4d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:42.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 note: GC not initialized 2024-09-12T00:55:42.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.696+0000 7f0475fe3640 20 reqs_thread_entry: start 2024-09-12T00:55:42.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.696+0000 7f05c4d2c800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:42.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.696+0000 7f05c4d2c800 20 Filter name: none 2024-09-12T00:55:42.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.696+0000 7f03e77fe640 20 reqs_thread_entry: start 2024-09-12T00:55:42.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.696+0000 7f05c4d2c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:42.695 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.696+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.696+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:42.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.696+0000 7f05c4d2c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:42.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.696+0000 7f05c4d2c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:42.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.696+0000 7f05c4d2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:55:42.696 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.696+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.697+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:42.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.697+0000 7f05c4d2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:42.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.697+0000 7f05c4d2c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:42.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.697+0000 7f05c4d2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:42.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.697+0000 7f05c4d2c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:42.697 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.697+0000 7f05c4d2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:55:42.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.701+0000 7f05c4d2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:42.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.701+0000 7f05c4d2c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:42.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.701+0000 7f05c4d2c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:42.700 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.701+0000 7f05c4d2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:55:42.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.701+0000 7f0497fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431688 cookie 94801355892160 notifier 7802 bl.length()=827 2024-09-12T00:55:42.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.701+0000 7f0497fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:42.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.701+0000 7f0497fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:42.701 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.701+0000 7f0497fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:42.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.703+0000 7f05c4d2c800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:55:42.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.703+0000 7f05c4d2c800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:55:42.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.703+0000 7f05c4d2c800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:55:42.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.703+0000 7f05c4d2c800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:55:42.705 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f05c4d2c800 time 2024-09-12T00:55:42.707487+0000 2024-09-12T00:55:42.705 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:42.706 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:42.706 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f05c638c71a] 2024-09-12T00:55:42.706 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f05c638c8d8] 2024-09-12T00:55:42.706 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5638a69f6641] 2024-09-12T00:55:42.706 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5638a6a0638a] 2024-09-12T00:55:42.706 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:55:42.706 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f05c5029590] 2024-09-12T00:55:42.706 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:55:42.706 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:55:42.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.707+0000 7f05c4d2c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f05c4d2c800 time 2024-09-12T00:55:42.707487+0000 2024-09-12T00:55:42.707 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:42.707 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.707 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:42.707 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f05c638c71a] 2024-09-12T00:55:42.707 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f05c638c8d8] 2024-09-12T00:55:42.707 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5638a69f6641] 2024-09-12T00:55:42.707 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5638a6a0638a] 2024-09-12T00:55:42.707 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:55:42.707 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f05c5029590] 2024-09-12T00:55:42.707 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:55:42.707 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:55:42.707 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.707 INFO:tasks.workunit.client.0.smithi062.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:55:42.708 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f05c4d2c800 thread_name:radosgw-admin 2024-09-12T00:55:42.723 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:42.723 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f05c503e6f0] 2024-09-12T00:55:42.724 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f05c508b99c] 2024-09-12T00:55:42.724 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:55:42.724 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:55:42.724 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f05c638c774] 2024-09-12T00:55:42.724 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f05c638c8d8] 2024-09-12T00:55:42.724 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5638a69f6641] 2024-09-12T00:55:42.724 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5638a6a0638a] 2024-09-12T00:55:42.724 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:55:42.724 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f05c5029590] 2024-09-12T00:55:42.724 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:55:42.724 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:55:42.724 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.708+0000 7f05c4d2c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:55:42.725 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f05c4d2c800 thread_name:radosgw-admin 2024-09-12T00:55:42.725 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.725 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:42.725 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f05c503e6f0] 2024-09-12T00:55:42.725 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f05c508b99c] 2024-09-12T00:55:42.725 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:55:42.725 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:55:42.725 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f05c638c774] 2024-09-12T00:55:42.725 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f05c638c8d8] 2024-09-12T00:55:42.726 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5638a69f6641] 2024-09-12T00:55:42.726 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5638a6a0638a] 2024-09-12T00:55:42.726 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:55:42.726 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f05c5029590] 2024-09-12T00:55:42.726 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:55:42.726 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:55:42.726 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:55:42.726 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.726 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:55:42.726 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91597a0) adding con mode: secure 2024-09-12T00:55:42.726 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.726 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 1 librados: starting msgr at 2024-09-12T00:55:42.727 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 1 librados: starting objecter 2024-09-12T00:55:42.727 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command objecter_requests hook 0x5638a915bee0 2024-09-12T00:55:42.727 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 1 librados: setting wanted keys 2024-09-12T00:55:42.727 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 1 librados: calling monclient init 2024-09-12T00:55:42.727 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 10 monclient: init 2024-09-12T00:55:42.727 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding auth protocol: cephx 2024-09-12T00:55:42.727 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding auth protocol: cephx 2024-09-12T00:55:42.727 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding auth protocol: cephx 2024-09-12T00:55:42.727 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: secure 2024-09-12T00:55:42.727 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: crc 2024-09-12T00:55:42.727 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: secure 2024-09-12T00:55:42.727 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: crc 2024-09-12T00:55:42.727 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: secure 2024-09-12T00:55:42.728 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: crc 2024-09-12T00:55:42.728 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: crc 2024-09-12T00:55:42.728 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: secure 2024-09-12T00:55:42.728 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: crc 2024-09-12T00:55:42.728 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: secure 2024-09-12T00:55:42.728 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: crc 2024-09-12T00:55:42.728 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: secure 2024-09-12T00:55:42.728 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.728 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.728 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command rotate-key hook 0x5638a9153d68 2024-09-12T00:55:42.728 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:42.728 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:55:42.729 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-a con 0x5638a8fddf40 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:42.729 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-b con 0x5638a9008290 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:42.729 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-c con 0x5638a915aed0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:42.729 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.729 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.729 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.729 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:42.729 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): authenticate will time out at 2228.941520s 2024-09-12T00:55:42.729 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): get_auth_request con 0x5638a8fddf40 auth_method 0 2024-09-12T00:55:42.729 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.729 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.729 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.729 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:55:42.448+0000 7f05c1146640 10 monclient(hunting): get_auth_request con 0x5638a915aed0 auth_method 0 2024-09-12T00:55:42.730 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:55:42.448+0000 7f05c1146640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.730 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:55:42.448+0000 7f05c1146640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.730 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:55:42.448+0000 7f05c1146640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.730 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.730 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.730 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.730 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:55:42.448+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.730 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:55:42.448+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.730 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:55:42.448+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.730 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:55:42.448+0000 7f05b8144640 10 monclient(hunting): get_auth_request con 0x5638a9008290 auth_method 0 2024-09-12T00:55:42.730 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:55:42.448+0000 7f05b8144640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.730 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:55:42.448+0000 7f05b8144640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.731 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:55:42.448+0000 7f05b8144640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.731 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): handle_auth_done global_id 8235 payload 824 2024-09-12T00:55:42.731 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient: _finish_hunting 0 2024-09-12T00:55:42.731 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:55:42.448+0000 7f05c0945640 1 monclient: found mon.noname-a 2024-09-12T00:55:42.731 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.731 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.731 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:42.731 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: dump: 2024-09-12T00:55:42.731 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.731 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.731 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.731 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.731 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.732 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.732 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.732 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.732 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.732 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.732 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: _finish_auth 0 2024-09-12T00:55:42.732 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: _check_auth_tickets 2024-09-12T00:55:42.732 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:42.732 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.732 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:42.732 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: dump: 2024-09-12T00:55:42.732 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.733 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.733 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.733 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.733 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.733 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.733 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.733 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.733 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.733 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.733 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:55:42.449+0000 7f05c4d2c800 5 monclient: authenticate success, global_id 8235 2024-09-12T00:55:42.733 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:55:42.449+0000 7f05c4d2c800 10 monclient: _renew_subs 2024-09-12T00:55:42.733 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:55:42.449+0000 7f05c4d2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.733 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:55:42.449+0000 7f04aee0d640 4 set_mon_vals no callback set 2024-09-12T00:55:42.734 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:55:42.449+0000 7f05c4d2c800 10 monclient: _renew_subs 2024-09-12T00:55:42.734 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:55:42.449+0000 7f05c4d2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.734 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:55:42.449+0000 7f05c4d2c800 1 librados: init done 2024-09-12T00:55:42.734 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:55:42.451+0000 7f04ad60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:42.734 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:55:42.451+0000 7f04ad60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:42.734 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:55:42.451+0000 7f04ad60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:42.734 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:55:42.451+0000 7f05b8144640 10 monclient: get_auth_request con 0x7f04a8076470 auth_method 0 2024-09-12T00:55:42.734 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:55:42.451+0000 7f05c1146640 10 monclient: get_auth_request con 0x5638a917cc40 auth_method 0 2024-09-12T00:55:42.734 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:55:42.452+0000 7f05c0945640 10 monclient: get_auth_request con 0x5638a919f5a0 auth_method 0 2024-09-12T00:55:42.734 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:55:42.453+0000 7f05b8144640 10 monclient: get_auth_request con 0x5638a91a3790 auth_method 0 2024-09-12T00:55:42.734 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 10 monclient: build_initial_monmap 2024-09-12T00:55:42.734 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 1 build_initial for_mkfs: 0 2024-09-12T00:55:42.734 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 10 monclient: monmap: 2024-09-12T00:55:42.735 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:55:42.735 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:42.735 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:55:42.735 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:55:42.735 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:42.735 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.735 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:55:42.735 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:55:42.735 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:55:42.735 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.735 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding auth protocol: cephx 2024-09-12T00:55:42.735 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding auth protocol: cephx 2024-09-12T00:55:42.735 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding auth protocol: cephx 2024-09-12T00:55:42.736 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: secure 2024-09-12T00:55:42.736 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: crc 2024-09-12T00:55:42.736 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: secure 2024-09-12T00:55:42.736 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: crc 2024-09-12T00:55:42.736 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: secure 2024-09-12T00:55:42.736 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: crc 2024-09-12T00:55:42.736 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: crc 2024-09-12T00:55:42.736 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: secure 2024-09-12T00:55:42.736 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: crc 2024-09-12T00:55:42.736 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: secure 2024-09-12T00:55:42.736 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: crc 2024-09-12T00:55:42.736 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: secure 2024-09-12T00:55:42.736 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.737 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command objecter_requests cmddesc objecter_requests hook 0x5638a91aba20 EEXIST 2024-09-12T00:55:42.737 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 10 monclient: init 2024-09-12T00:55:42.737 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding auth protocol: cephx 2024-09-12T00:55:42.737 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding auth protocol: cephx 2024-09-12T00:55:42.737 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding auth protocol: cephx 2024-09-12T00:55:42.737 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: secure 2024-09-12T00:55:42.737 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: crc 2024-09-12T00:55:42.737 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: secure 2024-09-12T00:55:42.737 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: crc 2024-09-12T00:55:42.737 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: secure 2024-09-12T00:55:42.737 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: crc 2024-09-12T00:55:42.737 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: crc 2024-09-12T00:55:42.737 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: secure 2024-09-12T00:55:42.738 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: crc 2024-09-12T00:55:42.738 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: secure 2024-09-12T00:55:42.738 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: crc 2024-09-12T00:55:42.738 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: secure 2024-09-12T00:55:42.738 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.738 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.738 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command rotate-key cmddesc rotate-key hook 0x5638a91a6d30 EEXIST 2024-09-12T00:55:42.738 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:42.738 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:55:42.738 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-a con 0x5638a91cfd40 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:42.738 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-c con 0x5638a91d0120 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:42.738 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-b con 0x5638a91cea50 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:42.739 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.739 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.739 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.739 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:42.739 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): authenticate will time out at 2228.948519s 2024-09-12T00:55:42.739 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): get_auth_request con 0x5638a91cfd40 auth_method 0 2024-09-12T00:55:42.739 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.739 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.739 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.739 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:55:42.455+0000 7f05b8144640 10 monclient(hunting): get_auth_request con 0x5638a91d0120 auth_method 0 2024-09-12T00:55:42.739 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:55:42.455+0000 7f05b8144640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.739 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:55:42.455+0000 7f05b8144640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.739 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:55:42.455+0000 7f05b8144640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.740 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.740 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.740 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.740 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:55:42.455+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.740 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:55:42.455+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.740 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:55:42.455+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.740 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:55:42.455+0000 7f05c1146640 10 monclient(hunting): get_auth_request con 0x5638a91cea50 auth_method 0 2024-09-12T00:55:42.740 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:55:42.455+0000 7f05c1146640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.740 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:55:42.455+0000 7f05c1146640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.740 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:55:42.455+0000 7f05c1146640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.740 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): handle_auth_done global_id 8238 payload 824 2024-09-12T00:55:42.740 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient: _finish_hunting 0 2024-09-12T00:55:42.740 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:55:42.455+0000 7f05c0945640 1 monclient: found mon.noname-a 2024-09-12T00:55:42.741 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.741 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.741 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:42.741 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: dump: 2024-09-12T00:55:42.741 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.741 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.741 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.741 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.741 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.741 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.741 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.741 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.742 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.742 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.742 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: _finish_auth 0 2024-09-12T00:55:42.742 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: _check_auth_tickets 2024-09-12T00:55:42.742 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:55:42.456+0000 7f05c4d2c800 5 monclient: authenticate success, global_id 8238 2024-09-12T00:55:42.742 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:42.742 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.742 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:42.742 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: dump: 2024-09-12T00:55:42.742 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.742 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.742 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.742 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.742 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.743 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.743 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.743 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.743 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.743 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.743 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:55:42.456+0000 7f05c4d2c800 10 monclient: _renew_subs 2024-09-12T00:55:42.743 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:55:42.456+0000 7f05c4d2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.743 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:55:42.456+0000 7f05c1947640 4 set_mon_vals no callback set 2024-09-12T00:55:42.743 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:55:42.456+0000 7f05c4d2c800 10 monclient: _renew_subs 2024-09-12T00:55:42.743 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:55:42.456+0000 7f05c4d2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.743 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:55:42.457+0000 7f04a67fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:42.743 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:55:42.457+0000 7f04a67fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:42.743 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:55:42.457+0000 7f04a67fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:42.744 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:55:42.458+0000 7f05b8144640 10 monclient: get_auth_request con 0x7f0498076380 auth_method 0 2024-09-12T00:55:42.744 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 10 monclient: get_monmap_and_config 2024-09-12T00:55:42.744 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 10 monclient: build_initial_monmap 2024-09-12T00:55:42.744 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 1 build_initial for_mkfs: 0 2024-09-12T00:55:42.744 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 10 monclient: monmap: 2024-09-12T00:55:42.744 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:55:42.744 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:42.744 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:55:42.744 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:55:42.744 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:42.744 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.744 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:55:42.745 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:55:42.745 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:55:42.745 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.745 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding auth protocol: cephx 2024-09-12T00:55:42.745 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding auth protocol: cephx 2024-09-12T00:55:42.745 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding auth protocol: cephx 2024-09-12T00:55:42.745 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: secure 2024-09-12T00:55:42.745 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: crc 2024-09-12T00:55:42.745 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: secure 2024-09-12T00:55:42.745 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: crc 2024-09-12T00:55:42.745 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: secure 2024-09-12T00:55:42.745 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: crc 2024-09-12T00:55:42.745 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: crc 2024-09-12T00:55:42.746 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: secure 2024-09-12T00:55:42.746 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: crc 2024-09-12T00:55:42.746 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: secure 2024-09-12T00:55:42.746 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: crc 2024-09-12T00:55:42.746 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: secure 2024-09-12T00:55:42.746 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.746 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 10 monclient: init 2024-09-12T00:55:42.746 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding auth protocol: cephx 2024-09-12T00:55:42.746 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding auth protocol: cephx 2024-09-12T00:55:42.746 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding auth protocol: cephx 2024-09-12T00:55:42.746 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: secure 2024-09-12T00:55:42.746 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: crc 2024-09-12T00:55:42.746 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: secure 2024-09-12T00:55:42.747 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: crc 2024-09-12T00:55:42.747 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: secure 2024-09-12T00:55:42.747 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: crc 2024-09-12T00:55:42.747 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: crc 2024-09-12T00:55:42.747 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: secure 2024-09-12T00:55:42.747 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: crc 2024-09-12T00:55:42.747 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: secure 2024-09-12T00:55:42.747 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: crc 2024-09-12T00:55:42.747 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: secure 2024-09-12T00:55:42.747 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.747 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.747 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command rotate-key cmddesc rotate-key hook 0x7fff7b3a6238 EEXIST 2024-09-12T00:55:42.747 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:42.748 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:55:42.748 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-b con 0x5638a9223a20 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:42.748 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-c con 0x5638a9214370 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:42.748 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-a con 0x5638a921ee50 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:42.748 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.748 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.748 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.748 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:42.748 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): authenticate will time out at 2228.952263s 2024-09-12T00:55:42.748 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): get_auth_request con 0x5638a921ee50 auth_method 0 2024-09-12T00:55:42.748 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.748 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.749 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.749 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:55:42.459+0000 7f05b8144640 10 monclient(hunting): get_auth_request con 0x5638a9214370 auth_method 0 2024-09-12T00:55:42.749 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:55:42.459+0000 7f05b8144640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.749 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:55:42.459+0000 7f05b8144640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.749 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:55:42.459+0000 7f05b8144640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.749 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.749 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.749 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.749 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:55:42.459+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.749 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:55:42.459+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.749 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:55:42.459+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.749 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:55:42.459+0000 7f05c0945640 10 monclient(hunting): get_auth_request con 0x5638a9223a20 auth_method 0 2024-09-12T00:55:42.749 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:55:42.459+0000 7f05c0945640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.750 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:55:42.459+0000 7f05c0945640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.750 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:55:42.459+0000 7f05c0945640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.750 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): handle_auth_done global_id 8241 payload 274 2024-09-12T00:55:42.750 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient: _finish_hunting 0 2024-09-12T00:55:42.750 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:55:42.459+0000 7f05c1146640 1 monclient: found mon.noname-a 2024-09-12T00:55:42.750 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.750 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.750 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:42.750 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: dump: 2024-09-12T00:55:42.750 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.750 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.750 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.750 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.751 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.751 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.751 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.751 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.751 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.751 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.751 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: _finish_auth 0 2024-09-12T00:55:42.751 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: _check_auth_tickets 2024-09-12T00:55:42.751 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:42.751 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 5 monclient: authenticate success, global_id 8241 2024-09-12T00:55:42.751 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient: get_monmap_and_config success 2024-09-12T00:55:42.751 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 4 set_mon_vals no callback set 2024-09-12T00:55:42.751 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.752 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:42.752 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: dump: 2024-09-12T00:55:42.752 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.752 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.752 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.752 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.752 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.752 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.752 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.752 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.752 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.752 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.753 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 10 monclient: shutdown 2024-09-12T00:55:42.753 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 10 monclient: build_initial_monmap 2024-09-12T00:55:42.753 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 1 build_initial for_mkfs: 0 2024-09-12T00:55:42.753 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 10 monclient: monmap: 2024-09-12T00:55:42.753 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:55:42.753 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:42.753 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:55:42.753 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:55:42.753 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:42.753 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.753 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:55:42.753 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:55:42.753 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:55:42.754 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.754 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding auth protocol: cephx 2024-09-12T00:55:42.754 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding auth protocol: cephx 2024-09-12T00:55:42.754 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding auth protocol: cephx 2024-09-12T00:55:42.754 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: secure 2024-09-12T00:55:42.754 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: crc 2024-09-12T00:55:42.754 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: secure 2024-09-12T00:55:42.754 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: crc 2024-09-12T00:55:42.754 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: secure 2024-09-12T00:55:42.754 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: crc 2024-09-12T00:55:42.754 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: crc 2024-09-12T00:55:42.754 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: secure 2024-09-12T00:55:42.754 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: crc 2024-09-12T00:55:42.755 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: secure 2024-09-12T00:55:42.755 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: crc 2024-09-12T00:55:42.755 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: secure 2024-09-12T00:55:42.755 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.755 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 1 librados: starting msgr at 2024-09-12T00:55:42.755 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 1 librados: starting objecter 2024-09-12T00:55:42.755 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command objecter_requests cmddesc objecter_requests hook 0x5638a92168b0 EEXIST 2024-09-12T00:55:42.755 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 1 librados: setting wanted keys 2024-09-12T00:55:42.755 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 1 librados: calling monclient init 2024-09-12T00:55:42.755 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 10 monclient: init 2024-09-12T00:55:42.755 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding auth protocol: cephx 2024-09-12T00:55:42.755 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding auth protocol: cephx 2024-09-12T00:55:42.755 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding auth protocol: cephx 2024-09-12T00:55:42.756 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: secure 2024-09-12T00:55:42.756 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: crc 2024-09-12T00:55:42.756 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: secure 2024-09-12T00:55:42.756 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: crc 2024-09-12T00:55:42.756 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: secure 2024-09-12T00:55:42.756 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: crc 2024-09-12T00:55:42.756 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: crc 2024-09-12T00:55:42.756 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: secure 2024-09-12T00:55:42.756 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: crc 2024-09-12T00:55:42.756 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: secure 2024-09-12T00:55:42.756 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: crc 2024-09-12T00:55:42.756 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: secure 2024-09-12T00:55:42.756 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.757 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.757 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command rotate-key cmddesc rotate-key hook 0x5638a91e4748 EEXIST 2024-09-12T00:55:42.757 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:42.757 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:55:42.757 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-c con 0x5638a9214370 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:42.757 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-a con 0x5638a921ee50 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:42.757 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-b con 0x5638a9223a20 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:42.757 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.757 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.757 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.757 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:42.757 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): authenticate will time out at 2228.954555s 2024-09-12T00:55:42.757 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): get_auth_request con 0x5638a9214370 auth_method 0 2024-09-12T00:55:42.758 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.758 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.758 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.758 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:55:42.461+0000 7f05b8144640 10 monclient(hunting): get_auth_request con 0x5638a921ee50 auth_method 0 2024-09-12T00:55:42.758 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:55:42.461+0000 7f05b8144640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.758 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:55:42.461+0000 7f05b8144640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.758 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:55:42.461+0000 7f05b8144640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.758 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.758 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.758 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.758 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:55:42.461+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.758 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:55:42.461+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.758 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:55:42.461+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.759 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): handle_auth_done global_id 7802 payload 824 2024-09-12T00:55:42.759 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient: _finish_hunting 0 2024-09-12T00:55:42.759 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:55:42.461+0000 7f05c0945640 1 monclient: found mon.noname-c 2024-09-12T00:55:42.760 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:55:42.760 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: ms_handle_reset current mon [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:42.760 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: _reopen_session rank -1 2024-09-12T00:55:42.760 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:55:42.760 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient(hunting): picked mon.noname-a con 0x5638a921ee50 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:42.760 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient(hunting): picked mon.noname-b con 0x5638a9223a20 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:42.760 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient(hunting): picked mon.noname-c con 0x7f048c007410 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:42.760 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.760 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.761 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.761 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient(hunting): _renew_subs 2024-09-12T00:55:42.761 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): get_auth_request con 0x5638a921ee50 auth_method 0 2024-09-12T00:55:42.761 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.761 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.761 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T00:55:42.761 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:55:42.462+0000 7f05c1146640 10 monclient(hunting): get_auth_request con 0x7f048c007410 auth_method 0 2024-09-12T00:55:42.761 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:55:42.462+0000 7f05c1146640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.761 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:55:42.462+0000 7f05c1146640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.761 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:55:42.462+0000 7f05c1146640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T00:55:42.761 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.761 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.761 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T00:55:42.762 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:55:42.462+0000 7f05b8144640 10 monclient(hunting): get_auth_request con 0x5638a9223a20 auth_method 0 2024-09-12T00:55:42.762 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:55:42.462+0000 7f05b8144640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.762 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:55:42.462+0000 7f05b8144640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.762 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:55:42.462+0000 7f05b8144640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T00:55:42.762 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:55:42.462+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.762 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:55:42.462+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.762 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:55:42.462+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T00:55:42.762 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): handle_auth_done global_id 7802 payload 293 2024-09-12T00:55:42.762 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient: _finish_hunting 0 2024-09-12T00:55:42.762 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:55:42.462+0000 7f05c0945640 1 monclient: found mon.noname-a 2024-09-12T00:55:42.762 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.762 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.762 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:42.763 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: dump: 2024-09-12T00:55:42.763 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.763 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.763 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.763 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.763 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.763 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.763 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.763 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.763 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.763 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.763 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: _finish_auth 0 2024-09-12T00:55:42.763 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: _check_auth_tickets 2024-09-12T00:55:42.764 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:42.764 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:55:42.462+0000 7f05c4d2c800 5 monclient: authenticate success, global_id 7802 2024-09-12T00:55:42.764 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:55:42.462+0000 7f05c4d2c800 10 monclient: _renew_subs 2024-09-12T00:55:42.764 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:55:42.462+0000 7f05c4d2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.764 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.764 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:42.764 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: dump: 2024-09-12T00:55:42.764 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.764 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.764 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.764 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.764 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.765 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.765 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.765 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.765 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.765 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.765 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:55:42.462+0000 7f0497fff640 4 set_mon_vals no callback set 2024-09-12T00:55:42.765 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:55:42.462+0000 7f05c4d2c800 10 monclient: _renew_subs 2024-09-12T00:55:42.765 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:55:42.462+0000 7f05c4d2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.765 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:55:42.462+0000 7f05c4d2c800 1 librados: init done 2024-09-12T00:55:42.765 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:55:42.462+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command cr dump hook 0x7f05bc00ad28 2024-09-12T00:55:42.765 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:55:42.464+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.765 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:55:42.464+0000 7f04967fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:42.765 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:55:42.464+0000 7f04967fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:42.766 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:55:42.464+0000 7f04967fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:42.766 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:55:42.465+0000 7f05b8144640 10 monclient: get_auth_request con 0x5638a9214370 auth_method 0 2024-09-12T00:55:42.766 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:55:42.465+0000 7f05c1146640 10 monclient: get_auth_request con 0x5638a9236690 auth_method 0 2024-09-12T00:55:42.766 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:55:42.465+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.766 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:55:42.465+0000 7f05c4d2c800 20 realm 2024-09-12T00:55:42.766 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:55:42.465+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.766 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:55:42.466+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.766 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:55:42.466+0000 7f05c4d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:42.766 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:55:42.466+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.766 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:55:42.466+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.766 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:55:42.466+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.766 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:55:42.466+0000 7f05c0945640 10 monclient: get_auth_request con 0x5638a923a900 auth_method 0 2024-09-12T00:55:42.766 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:55:42.467+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:42.766 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:55:42.467+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.767 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:55:42.467+0000 7f05b8144640 10 monclient: get_auth_request con 0x5638a923e160 auth_method 0 2024-09-12T00:55:42.767 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:55:42.467+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:42.767 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:55:42.467+0000 7f05c4d2c800 20 searching for the correct realm 2024-09-12T00:55:42.767 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:55:42.468+0000 7f05c1146640 10 monclient: get_auth_request con 0x5638a9242f00 auth_method 0 2024-09-12T00:55:42.767 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:55:42.468+0000 7f05c0945640 10 monclient: get_auth_request con 0x7f05bc01e950 auth_method 0 2024-09-12T00:55:42.767 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:55:42.470+0000 7f05c0945640 0 -- 172.21.15.62:0/844967091 >> [v2:172.21.15.62:6816/3104025159,v1:172.21.15.62:6817/3104025159] conn(0x5638a923a900 msgr2=0x5638a923cd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:42.767 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:55:42.470+0000 7f04967fc640 1 client.7802.objecter ms_handle_reset 0x5638a923a900 session 0x5638a923a280 osd.1 2024-09-12T00:55:42.767 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:55:42.470+0000 7f04967fc640 10 monclient: _renew_subs 2024-09-12T00:55:42.767 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:55:42.470+0000 7f04967fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.767 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:55:42.470+0000 7f05c0945640 10 monclient: get_auth_request con 0x7f048c08dff0 auth_method 0 2024-09-12T00:55:42.767 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:55:42.470+0000 7f05b8144640 10 monclient: get_auth_request con 0x7f05bc026400 auth_method 0 2024-09-12T00:55:42.767 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:55:42.473+0000 7f05c1146640 10 monclient: get_auth_request con 0x7f05b00d5280 auth_method 0 2024-09-12T00:55:42.768 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:55:42.473+0000 7f05c0945640 0 -- 172.21.15.62:0/844967091 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f05bc003410 msgr2=0x7f05bc003890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:42.768 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:55:42.674+0000 7f05c0945640 10 monclient: get_auth_request con 0x7f05bc003410 auth_method 0 2024-09-12T00:55:42.768 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:42.768 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:42.768 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:42.768 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:42.768 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:42.768 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:42.768 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.768 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.768 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.768 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:42.768 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.769 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:42.769 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 zone default found 2024-09-12T00:55:42.769 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 4 Realm: () 2024-09-12T00:55:42.769 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:42.769 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:42.769 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:42.769 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 zonegroup default 2024-09-12T00:55:42.769 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.769 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.769 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.769 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:55:42.682+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.769 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:55:42.682+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.769 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:55:42.682+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.770 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:55:42.682+0000 7f05c4d2c800 20 started sync module instance, tier type = 2024-09-12T00:55:42.770 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:55:42.682+0000 7f05c4d2c800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:42.770 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=0 2024-09-12T00:55:42.770 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=1 2024-09-12T00:55:42.770 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=2 2024-09-12T00:55:42.770 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=3 2024-09-12T00:55:42.770 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=4 2024-09-12T00:55:42.770 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=5 2024-09-12T00:55:42.770 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=6 2024-09-12T00:55:42.770 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:55:42.692+0000 7f05c4d2c800 20 add_watcher() i=7 2024-09-12T00:55:42.770 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:55:42.692+0000 7f05c4d2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:42.770 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding auth protocol: cephx 2024-09-12T00:55:42.770 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding auth protocol: cephx 2024-09-12T00:55:42.771 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding auth protocol: cephx 2024-09-12T00:55:42.771 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: secure 2024-09-12T00:55:42.771 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: crc 2024-09-12T00:55:42.771 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: secure 2024-09-12T00:55:42.771 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: crc 2024-09-12T00:55:42.771 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: secure 2024-09-12T00:55:42.771 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: crc 2024-09-12T00:55:42.771 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: crc 2024-09-12T00:55:42.771 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: secure 2024-09-12T00:55:42.771 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: crc 2024-09-12T00:55:42.772 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: secure 2024-09-12T00:55:42.772 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:55:42.695+0000 7f0476fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:42.772 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: crc 2024-09-12T00:55:42.772 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: secure 2024-09-12T00:55:42.772 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.772 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:42.772 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:42.772 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command cache list hook 0x5638a9218d50 2024-09-12T00:55:42.772 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command cache inspect hook 0x5638a9218d50 2024-09-12T00:55:42.772 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command cache erase hook 0x5638a9218d50 2024-09-12T00:55:42.772 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command cache zap hook 0x5638a9218d50 2024-09-12T00:55:42.772 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 note: GC not initialized 2024-09-12T00:55:42.772 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:55:42.696+0000 7f0475fe3640 20 reqs_thread_entry: start 2024-09-12T00:55:42.773 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command sync trace show hook 0x7f05bc010440 2024-09-12T00:55:42.773 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command sync trace history hook 0x7f05bc010440 2024-09-12T00:55:42.773 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command sync trace active hook 0x7f05bc010440 2024-09-12T00:55:42.773 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command sync trace active_short hook 0x7f05bc010440 2024-09-12T00:55:42.773 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:42.773 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 20 Filter name: none 2024-09-12T00:55:42.773 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:55:42.696+0000 7f03e77fe640 20 reqs_thread_entry: start 2024-09-12T00:55:42.773 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:42.773 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.773 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:42.773 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:42.773 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:42.773 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:55:42.774 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.774 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:55:42.697+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:42.774 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:55:42.697+0000 7f05c4d2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:42.774 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:55:42.697+0000 7f05c4d2c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:42.774 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:55:42.697+0000 7f05c4d2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:42.774 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:55:42.697+0000 7f05c4d2c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:42.774 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:55:42.697+0000 7f05c4d2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:55:42.774 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:55:42.701+0000 7f05c4d2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:42.774 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:55:42.701+0000 7f05c4d2c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:42.774 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:55:42.701+0000 7f05c4d2c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:42.774 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:55:42.701+0000 7f05c4d2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:55:42.774 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:55:42.701+0000 7f0497fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431688 cookie 94801355892160 notifier 7802 bl.length()=827 2024-09-12T00:55:42.774 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:55:42.701+0000 7f0497fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:42.775 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:55:42.701+0000 7f0497fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:42.775 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:55:42.701+0000 7f0497fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:42.775 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:55:42.703+0000 7f05c4d2c800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:55:42.775 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:55:42.703+0000 7f05c4d2c800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:55:42.775 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:55:42.703+0000 7f05c4d2c800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:55:42.775 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:55:42.703+0000 7f05c4d2c800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:55:42.775 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:55:42.707+0000 7f05c4d2c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f05c4d2c800 time 2024-09-12T00:55:42.707487+0000 2024-09-12T00:55:42.775 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:42.775 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.775 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:42.775 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f05c638c71a] 2024-09-12T00:55:42.775 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f05c638c8d8] 2024-09-12T00:55:42.776 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5638a69f6641] 2024-09-12T00:55:42.776 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5638a6a0638a] 2024-09-12T00:55:42.776 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:55:42.776 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f05c5029590] 2024-09-12T00:55:42.776 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:55:42.776 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:55:42.776 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.776 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:55:42.708+0000 7f05c4d2c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:55:42.776 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f05c4d2c800 thread_name:radosgw-admin 2024-09-12T00:55:42.776 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.776 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:42.776 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f05c503e6f0] 2024-09-12T00:55:42.776 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f05c508b99c] 2024-09-12T00:55:42.777 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:55:42.777 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:55:42.777 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f05c638c774] 2024-09-12T00:55:42.777 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f05c638c8d8] 2024-09-12T00:55:42.777 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5638a69f6641] 2024-09-12T00:55:42.777 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5638a6a0638a] 2024-09-12T00:55:42.777 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:55:42.777 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f05c5029590] 2024-09-12T00:55:42.777 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:55:42.777 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:55:42.777 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:55:42.777 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.777 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:55:42.778 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:55:42.778 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:55:42.778 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:55:42.778 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:55:42.778 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:55:42.778 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:55:42.778 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:55:42.778 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:55:42.778 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:55:42.778 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:55:42.778 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:55:42.778 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:55:42.779 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:55:42.779 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:55:42.779 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:55:42.779 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:55:42.779 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:55:42.779 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:55:42.779 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:55:42.779 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:55:42.779 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:55:42.779 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:55:42.779 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:55:42.779 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:55:42.779 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:55:42.780 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:55:42.780 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:55:42.780 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:55:42.780 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:55:42.780 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:55:42.780 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:55:42.780 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:55:42.780 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:55:42.780 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:55:42.780 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:55:42.780 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:55:42.780 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:55:42.780 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:55:42.781 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:55:42.781 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:55:42.781 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:55:42.781 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:55:42.781 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:55:42.781 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:55:42.781 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:55:42.781 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:55:42.781 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:55:42.781 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:55:42.781 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:55:42.781 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:55:42.781 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:55:42.782 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:55:42.782 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:55:42.782 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:55:42.782 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:55:42.782 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:55:42.782 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:55:42.782 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:55:42.782 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:55:42.782 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:55:42.782 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:55:42.782 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:55:42.782 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:55:42.782 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:55:42.783 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:55:42.783 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:55:42.783 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:55:42.783 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:55:42.783 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:55:42.783 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:55:42.783 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:55:42.783 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:55:42.783 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:55:42.783 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:55:42.783 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:55:42.783 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:55:42.783 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:55:42.784 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:55:42.784 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:55:42.784 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:55:42.784 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:55:42.784 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:55:42.784 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:55:42.784 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:55:42.784 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:55:42.784 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:55:42.784 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:55:42.784 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:55:42.784 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:55:42.784 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:55:42.785 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:55:42.785 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:55:42.785 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:55:42.785 INFO:tasks.workunit.client.0.smithi062.stderr: 7f03e77fe640 / http_manager 2024-09-12T00:55:42.785 INFO:tasks.workunit.client.0.smithi062.stderr: 7f0475fe3640 / http_manager 2024-09-12T00:55:42.785 INFO:tasks.workunit.client.0.smithi062.stderr: 7f0476fe5640 / rgw_dt_lg_renew 2024-09-12T00:55:42.785 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04967fc640 / ms_dispatch 2024-09-12T00:55:42.785 INFO:tasks.workunit.client.0.smithi062.stderr: 7f0497fff640 / io_context_pool 2024-09-12T00:55:42.785 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04a67fc640 / ms_dispatch 2024-09-12T00:55:42.785 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04ad60a640 / ms_dispatch 2024-09-12T00:55:42.785 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04aee0d640 / io_context_pool 2024-09-12T00:55:42.785 INFO:tasks.workunit.client.0.smithi062.stderr: 7f05b8144640 / msgr-worker-2 2024-09-12T00:55:42.785 INFO:tasks.workunit.client.0.smithi062.stderr: 7f05c0945640 / msgr-worker-1 2024-09-12T00:55:42.786 INFO:tasks.workunit.client.0.smithi062.stderr: 7f05c1146640 / msgr-worker-0 2024-09-12T00:55:42.786 INFO:tasks.workunit.client.0.smithi062.stderr: 7f05c1947640 / io_context_pool 2024-09-12T00:55:42.786 INFO:tasks.workunit.client.0.smithi062.stderr: 7f05c4d2c800 / radosgw-admin 2024-09-12T00:55:42.786 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:55:42.786 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:55:42.786 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/log/ceph/ceph-client.admin.150507.log 2024-09-12T00:55:42.786 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:55:42.786 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:55:42.786 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91597a0) adding con mode: secure 2024-09-12T00:55:42.786 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.786 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 1 librados: starting msgr at 2024-09-12T00:55:42.786 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 1 librados: starting objecter 2024-09-12T00:55:42.786 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command objecter_requests hook 0x5638a915bee0 2024-09-12T00:55:42.787 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 1 librados: setting wanted keys 2024-09-12T00:55:42.787 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 1 librados: calling monclient init 2024-09-12T00:55:42.787 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 10 monclient: init 2024-09-12T00:55:42.787 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding auth protocol: cephx 2024-09-12T00:55:42.787 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding auth protocol: cephx 2024-09-12T00:55:42.787 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding auth protocol: cephx 2024-09-12T00:55:42.787 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: secure 2024-09-12T00:55:42.787 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: crc 2024-09-12T00:55:42.787 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: secure 2024-09-12T00:55:42.787 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: crc 2024-09-12T00:55:42.787 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: secure 2024-09-12T00:55:42.787 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: crc 2024-09-12T00:55:42.787 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: crc 2024-09-12T00:55:42.788 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: secure 2024-09-12T00:55:42.788 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: crc 2024-09-12T00:55:42.788 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: secure 2024-09-12T00:55:42.788 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: crc 2024-09-12T00:55:42.788 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:55:42.447+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9153c20) adding con mode: secure 2024-09-12T00:55:42.788 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.788 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.788 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command rotate-key hook 0x5638a9153d68 2024-09-12T00:55:42.788 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:42.788 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:55:42.788 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-a con 0x5638a8fddf40 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:42.788 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-b con 0x5638a9008290 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:42.789 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-c con 0x5638a915aed0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:42.789 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.789 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.789 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.789 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:42.789 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:55:42.448+0000 7f05c4d2c800 10 monclient(hunting): authenticate will time out at 2228.941520s 2024-09-12T00:55:42.789 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): get_auth_request con 0x5638a8fddf40 auth_method 0 2024-09-12T00:55:42.789 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.789 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.789 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.789 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:55:42.448+0000 7f05c1146640 10 monclient(hunting): get_auth_request con 0x5638a915aed0 auth_method 0 2024-09-12T00:55:42.789 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:55:42.448+0000 7f05c1146640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.789 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:55:42.448+0000 7f05c1146640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.790 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:55:42.448+0000 7f05c1146640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.790 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.790 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.790 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.790 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:55:42.448+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.790 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:55:42.448+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.790 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:55:42.448+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.790 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:55:42.448+0000 7f05b8144640 10 monclient(hunting): get_auth_request con 0x5638a9008290 auth_method 0 2024-09-12T00:55:42.790 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:55:42.448+0000 7f05b8144640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.790 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:55:42.448+0000 7f05b8144640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.790 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:55:42.448+0000 7f05b8144640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.790 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient(hunting): handle_auth_done global_id 8235 payload 824 2024-09-12T00:55:42.790 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient: _finish_hunting 0 2024-09-12T00:55:42.791 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:55:42.448+0000 7f05c0945640 1 monclient: found mon.noname-a 2024-09-12T00:55:42.791 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:55:42.448+0000 7f05c0945640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.791 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.791 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:42.791 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: dump: 2024-09-12T00:55:42.791 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.791 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.791 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.791 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.791 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.791 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.791 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.791 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.792 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.792 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.792 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: _finish_auth 0 2024-09-12T00:55:42.792 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: _check_auth_tickets 2024-09-12T00:55:42.792 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:42.792 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.792 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:42.792 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:55:42.449+0000 7f04ad60a640 10 monclient: dump: 2024-09-12T00:55:42.792 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.792 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.792 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.792 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.792 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.793 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.793 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.793 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.793 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.793 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.793 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:55:42.449+0000 7f05c4d2c800 5 monclient: authenticate success, global_id 8235 2024-09-12T00:55:42.793 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:55:42.449+0000 7f05c4d2c800 10 monclient: _renew_subs 2024-09-12T00:55:42.793 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:55:42.449+0000 7f05c4d2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.793 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:55:42.449+0000 7f04aee0d640 4 set_mon_vals no callback set 2024-09-12T00:55:42.793 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:55:42.449+0000 7f05c4d2c800 10 monclient: _renew_subs 2024-09-12T00:55:42.793 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:55:42.449+0000 7f05c4d2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.793 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:55:42.449+0000 7f05c4d2c800 1 librados: init done 2024-09-12T00:55:42.793 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:55:42.451+0000 7f04ad60a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:42.794 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:55:42.451+0000 7f04ad60a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:42.794 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:55:42.451+0000 7f04ad60a640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:42.794 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:55:42.451+0000 7f05b8144640 10 monclient: get_auth_request con 0x7f04a8076470 auth_method 0 2024-09-12T00:55:42.794 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:55:42.451+0000 7f05c1146640 10 monclient: get_auth_request con 0x5638a917cc40 auth_method 0 2024-09-12T00:55:42.794 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:55:42.452+0000 7f05c0945640 10 monclient: get_auth_request con 0x5638a919f5a0 auth_method 0 2024-09-12T00:55:42.794 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:55:42.453+0000 7f05b8144640 10 monclient: get_auth_request con 0x5638a91a3790 auth_method 0 2024-09-12T00:55:42.794 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 10 monclient: build_initial_monmap 2024-09-12T00:55:42.794 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 1 build_initial for_mkfs: 0 2024-09-12T00:55:42.794 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 10 monclient: monmap: 2024-09-12T00:55:42.794 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:55:42.794 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:42.794 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:55:42.795 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:55:42.795 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:42.795 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.795 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:55:42.795 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:55:42.795 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:55:42.795 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.795 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding auth protocol: cephx 2024-09-12T00:55:42.795 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding auth protocol: cephx 2024-09-12T00:55:42.795 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding auth protocol: cephx 2024-09-12T00:55:42.795 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: secure 2024-09-12T00:55:42.795 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: crc 2024-09-12T00:55:42.795 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: secure 2024-09-12T00:55:42.796 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: crc 2024-09-12T00:55:42.796 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: secure 2024-09-12T00:55:42.796 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: crc 2024-09-12T00:55:42.796 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: crc 2024-09-12T00:55:42.796 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: secure 2024-09-12T00:55:42.796 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: crc 2024-09-12T00:55:42.796 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: secure 2024-09-12T00:55:42.796 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: crc 2024-09-12T00:55:42.796 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a8510) adding con mode: secure 2024-09-12T00:55:42.796 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.796 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command objecter_requests cmddesc objecter_requests hook 0x5638a91aba20 EEXIST 2024-09-12T00:55:42.796 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 10 monclient: init 2024-09-12T00:55:42.796 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding auth protocol: cephx 2024-09-12T00:55:42.797 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding auth protocol: cephx 2024-09-12T00:55:42.797 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding auth protocol: cephx 2024-09-12T00:55:42.797 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: secure 2024-09-12T00:55:42.797 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: crc 2024-09-12T00:55:42.797 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: secure 2024-09-12T00:55:42.797 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: crc 2024-09-12T00:55:42.797 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: secure 2024-09-12T00:55:42.797 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: crc 2024-09-12T00:55:42.797 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: crc 2024-09-12T00:55:42.797 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: secure 2024-09-12T00:55:42.797 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: crc 2024-09-12T00:55:42.797 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: secure 2024-09-12T00:55:42.797 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: crc 2024-09-12T00:55:42.798 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:55:42.454+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91a6be8) adding con mode: secure 2024-09-12T00:55:42.798 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.798 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.798 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command rotate-key cmddesc rotate-key hook 0x5638a91a6d30 EEXIST 2024-09-12T00:55:42.798 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:42.798 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:55:42.798 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-a con 0x5638a91cfd40 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:42.798 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-c con 0x5638a91d0120 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:42.798 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-b con 0x5638a91cea50 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:42.798 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.798 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.798 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.798 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:42.799 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:55:42.455+0000 7f05c4d2c800 10 monclient(hunting): authenticate will time out at 2228.948519s 2024-09-12T00:55:42.799 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): get_auth_request con 0x5638a91cfd40 auth_method 0 2024-09-12T00:55:42.799 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.799 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.799 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.799 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:55:42.455+0000 7f05b8144640 10 monclient(hunting): get_auth_request con 0x5638a91d0120 auth_method 0 2024-09-12T00:55:42.799 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:55:42.455+0000 7f05b8144640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.799 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:55:42.455+0000 7f05b8144640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.799 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:55:42.455+0000 7f05b8144640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.799 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.799 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.799 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.800 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:55:42.455+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.800 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:55:42.455+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.800 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:55:42.455+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.800 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:55:42.455+0000 7f05c1146640 10 monclient(hunting): get_auth_request con 0x5638a91cea50 auth_method 0 2024-09-12T00:55:42.800 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:55:42.455+0000 7f05c1146640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.800 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:55:42.455+0000 7f05c1146640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.800 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:55:42.455+0000 7f05c1146640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.800 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient(hunting): handle_auth_done global_id 8238 payload 824 2024-09-12T00:55:42.800 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient: _finish_hunting 0 2024-09-12T00:55:42.800 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:55:42.455+0000 7f05c0945640 1 monclient: found mon.noname-a 2024-09-12T00:55:42.800 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:55:42.455+0000 7f05c0945640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.800 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.801 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:42.801 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: dump: 2024-09-12T00:55:42.801 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.801 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.801 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.801 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.801 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.801 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.801 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.801 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.801 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.801 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.801 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: _finish_auth 0 2024-09-12T00:55:42.802 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: _check_auth_tickets 2024-09-12T00:55:42.802 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:55:42.456+0000 7f05c4d2c800 5 monclient: authenticate success, global_id 8238 2024-09-12T00:55:42.802 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:42.802 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.802 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:42.802 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:55:42.456+0000 7f04a67fc640 10 monclient: dump: 2024-09-12T00:55:42.802 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.802 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.802 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.802 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.802 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.802 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.802 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.803 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.803 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.803 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.803 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:55:42.456+0000 7f05c4d2c800 10 monclient: _renew_subs 2024-09-12T00:55:42.803 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:55:42.456+0000 7f05c4d2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.803 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:55:42.456+0000 7f05c1947640 4 set_mon_vals no callback set 2024-09-12T00:55:42.803 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:55:42.456+0000 7f05c4d2c800 10 monclient: _renew_subs 2024-09-12T00:55:42.803 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:55:42.456+0000 7f05c4d2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.803 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:55:42.457+0000 7f04a67fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:42.803 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:55:42.457+0000 7f04a67fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:42.803 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:55:42.457+0000 7f04a67fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:42.803 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:55:42.458+0000 7f05b8144640 10 monclient: get_auth_request con 0x7f0498076380 auth_method 0 2024-09-12T00:55:42.803 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 10 monclient: get_monmap_and_config 2024-09-12T00:55:42.804 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 10 monclient: build_initial_monmap 2024-09-12T00:55:42.804 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 1 build_initial for_mkfs: 0 2024-09-12T00:55:42.804 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 10 monclient: monmap: 2024-09-12T00:55:42.804 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:55:42.804 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:42.804 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:55:42.804 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:55:42.804 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:42.804 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.804 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:55:42.804 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:55:42.804 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:55:42.804 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.805 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding auth protocol: cephx 2024-09-12T00:55:42.805 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding auth protocol: cephx 2024-09-12T00:55:42.805 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding auth protocol: cephx 2024-09-12T00:55:42.805 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: secure 2024-09-12T00:55:42.805 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: crc 2024-09-12T00:55:42.805 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: secure 2024-09-12T00:55:42.805 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: crc 2024-09-12T00:55:42.805 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: secure 2024-09-12T00:55:42.805 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: crc 2024-09-12T00:55:42.805 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: crc 2024-09-12T00:55:42.805 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: secure 2024-09-12T00:55:42.805 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: crc 2024-09-12T00:55:42.805 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: secure 2024-09-12T00:55:42.806 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: crc 2024-09-12T00:55:42.806 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91ef510) adding con mode: secure 2024-09-12T00:55:42.806 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.806 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 10 monclient: init 2024-09-12T00:55:42.806 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding auth protocol: cephx 2024-09-12T00:55:42.806 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding auth protocol: cephx 2024-09-12T00:55:42.806 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding auth protocol: cephx 2024-09-12T00:55:42.806 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: secure 2024-09-12T00:55:42.806 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: crc 2024-09-12T00:55:42.806 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: secure 2024-09-12T00:55:42.806 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: crc 2024-09-12T00:55:42.806 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: secure 2024-09-12T00:55:42.806 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: crc 2024-09-12T00:55:42.807 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: crc 2024-09-12T00:55:42.807 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: secure 2024-09-12T00:55:42.807 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: crc 2024-09-12T00:55:42.807 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: secure 2024-09-12T00:55:42.807 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: crc 2024-09-12T00:55:42.807 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a60f0) adding con mode: secure 2024-09-12T00:55:42.807 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:55:42.458+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.807 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.807 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command rotate-key cmddesc rotate-key hook 0x7fff7b3a6238 EEXIST 2024-09-12T00:55:42.807 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:42.807 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:55:42.807 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-b con 0x5638a9223a20 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:42.808 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-c con 0x5638a9214370 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:42.808 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-a con 0x5638a921ee50 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:42.808 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.808 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.808 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.808 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:42.808 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient(hunting): authenticate will time out at 2228.952263s 2024-09-12T00:55:42.808 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): get_auth_request con 0x5638a921ee50 auth_method 0 2024-09-12T00:55:42.808 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.808 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.808 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.808 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:55:42.459+0000 7f05b8144640 10 monclient(hunting): get_auth_request con 0x5638a9214370 auth_method 0 2024-09-12T00:55:42.808 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:55:42.459+0000 7f05b8144640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.809 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:55:42.459+0000 7f05b8144640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.809 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:55:42.459+0000 7f05b8144640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.809 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.809 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.809 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.809 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:55:42.459+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.809 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:55:42.459+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.809 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:55:42.459+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.809 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:55:42.459+0000 7f05c0945640 10 monclient(hunting): get_auth_request con 0x5638a9223a20 auth_method 0 2024-09-12T00:55:42.809 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:55:42.459+0000 7f05c0945640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.809 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:55:42.459+0000 7f05c0945640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.809 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:55:42.459+0000 7f05c0945640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.809 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient(hunting): handle_auth_done global_id 8241 payload 274 2024-09-12T00:55:42.810 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient: _finish_hunting 0 2024-09-12T00:55:42.810 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:55:42.459+0000 7f05c1146640 1 monclient: found mon.noname-a 2024-09-12T00:55:42.810 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:55:42.459+0000 7f05c1146640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.810 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.810 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:42.810 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: dump: 2024-09-12T00:55:42.810 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.810 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.810 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.810 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.810 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.810 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.810 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.810 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.811 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.811 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.811 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: _finish_auth 0 2024-09-12T00:55:42.811 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: _check_auth_tickets 2024-09-12T00:55:42.811 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:42.811 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 5 monclient: authenticate success, global_id 8241 2024-09-12T00:55:42.811 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 10 monclient: get_monmap_and_config success 2024-09-12T00:55:42.811 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:55:42.459+0000 7f05c4d2c800 4 set_mon_vals no callback set 2024-09-12T00:55:42.811 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.811 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:42.811 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:55:42.459+0000 7f0497fff640 10 monclient: dump: 2024-09-12T00:55:42.811 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.811 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.812 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.812 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.812 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.812 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.812 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.812 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.812 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.812 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.812 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 10 monclient: shutdown 2024-09-12T00:55:42.812 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 10 monclient: build_initial_monmap 2024-09-12T00:55:42.812 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 1 build_initial for_mkfs: 0 2024-09-12T00:55:42.812 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 10 monclient: monmap: 2024-09-12T00:55:42.812 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:55:42.813 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:55:42.813 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:55:42.813 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:55:42.813 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:55:42.813 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.813 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:55:42.813 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:55:42.813 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:55:42.813 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.813 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding auth protocol: cephx 2024-09-12T00:55:42.813 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding auth protocol: cephx 2024-09-12T00:55:42.813 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding auth protocol: cephx 2024-09-12T00:55:42.813 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: secure 2024-09-12T00:55:42.814 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: crc 2024-09-12T00:55:42.814 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: secure 2024-09-12T00:55:42.814 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: crc 2024-09-12T00:55:42.814 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: secure 2024-09-12T00:55:42.814 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: crc 2024-09-12T00:55:42.814 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: crc 2024-09-12T00:55:42.814 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: secure 2024-09-12T00:55:42.814 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: crc 2024-09-12T00:55:42.814 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: secure 2024-09-12T00:55:42.814 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: crc 2024-09-12T00:55:42.814 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a9214860) adding con mode: secure 2024-09-12T00:55:42.814 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.814 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 1 librados: starting msgr at 2024-09-12T00:55:42.815 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 1 librados: starting objecter 2024-09-12T00:55:42.815 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command objecter_requests cmddesc objecter_requests hook 0x5638a92168b0 EEXIST 2024-09-12T00:55:42.815 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 1 librados: setting wanted keys 2024-09-12T00:55:42.815 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 1 librados: calling monclient init 2024-09-12T00:55:42.815 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 10 monclient: init 2024-09-12T00:55:42.815 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding auth protocol: cephx 2024-09-12T00:55:42.815 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding auth protocol: cephx 2024-09-12T00:55:42.815 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding auth protocol: cephx 2024-09-12T00:55:42.815 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: secure 2024-09-12T00:55:42.815 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: crc 2024-09-12T00:55:42.815 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: secure 2024-09-12T00:55:42.815 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:55:42.460+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: crc 2024-09-12T00:55:42.816 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: secure 2024-09-12T00:55:42.816 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: crc 2024-09-12T00:55:42.816 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: crc 2024-09-12T00:55:42.816 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: secure 2024-09-12T00:55:42.816 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: crc 2024-09-12T00:55:42.816 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: secure 2024-09-12T00:55:42.816 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: crc 2024-09-12T00:55:42.816 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 AuthRegistry(0x5638a91e4600) adding con mode: secure 2024-09-12T00:55:42.816 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.816 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.816 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command rotate-key cmddesc rotate-key hook 0x5638a91e4748 EEXIST 2024-09-12T00:55:42.816 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient: _reopen_session rank -1 2024-09-12T00:55:42.816 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:55:42.817 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-c con 0x5638a9214370 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:42.817 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-a con 0x5638a921ee50 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:42.817 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): picked mon.noname-b con 0x5638a9223a20 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:42.817 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.817 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.817 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.817 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): _renew_subs 2024-09-12T00:55:42.817 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:55:42.461+0000 7f05c4d2c800 10 monclient(hunting): authenticate will time out at 2228.954555s 2024-09-12T00:55:42.817 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): get_auth_request con 0x5638a9214370 auth_method 0 2024-09-12T00:55:42.817 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.817 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.817 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.817 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:55:42.461+0000 7f05b8144640 10 monclient(hunting): get_auth_request con 0x5638a921ee50 auth_method 0 2024-09-12T00:55:42.818 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:55:42.461+0000 7f05b8144640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.818 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:55:42.461+0000 7f05b8144640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.818 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:55:42.461+0000 7f05b8144640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:55:42.818 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.818 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.818 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.818 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:55:42.461+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.818 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:55:42.461+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.818 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:55:42.461+0000 7f05b8144640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:55:42.818 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient(hunting): handle_auth_done global_id 7802 payload 824 2024-09-12T00:55:42.818 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient: _finish_hunting 0 2024-09-12T00:55:42.818 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:55:42.461+0000 7f05c0945640 1 monclient: found mon.noname-c 2024-09-12T00:55:42.818 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:55:42.461+0000 7f05c0945640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:55:42.819 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: ms_handle_reset current mon [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:42.819 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: _reopen_session rank -1 2024-09-12T00:55:42.819 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:55:42.819 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient(hunting): picked mon.noname-a con 0x5638a921ee50 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:55:42.819 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient(hunting): picked mon.noname-b con 0x5638a9223a20 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:55:42.819 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient(hunting): picked mon.noname-c con 0x7f048c007410 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:55:42.819 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.819 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.819 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient(hunting): start opening mon connection 2024-09-12T00:55:42.819 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient(hunting): _renew_subs 2024-09-12T00:55:42.819 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): get_auth_request con 0x5638a921ee50 auth_method 0 2024-09-12T00:55:42.819 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.819 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.820 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T00:55:42.820 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:55:42.462+0000 7f05c1146640 10 monclient(hunting): get_auth_request con 0x7f048c007410 auth_method 0 2024-09-12T00:55:42.820 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:55:42.462+0000 7f05c1146640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.820 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:55:42.462+0000 7f05c1146640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.820 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:55:42.462+0000 7f05c1146640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T00:55:42.820 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.820 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.820 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T00:55:42.820 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:55:42.462+0000 7f05b8144640 10 monclient(hunting): get_auth_request con 0x5638a9223a20 auth_method 0 2024-09-12T00:55:42.820 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:55:42.462+0000 7f05b8144640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:55:42.820 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:55:42.462+0000 7f05b8144640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:55:42.820 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:55:42.462+0000 7f05b8144640 10 monclient(hunting): _init_auth already have auth, reseting 2024-09-12T00:55:42.820 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:55:42.462+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:55:42.821 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:55:42.462+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:55:42.821 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:55:42.462+0000 7f05c1146640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2024-09-12T00:55:42.821 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient(hunting): handle_auth_done global_id 7802 payload 293 2024-09-12T00:55:42.821 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient: _finish_hunting 0 2024-09-12T00:55:42.821 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:55:42.462+0000 7f05c0945640 1 monclient: found mon.noname-a 2024-09-12T00:55:42.821 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:55:42.462+0000 7f05c0945640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.821 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.821 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:55:42.821 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: dump: 2024-09-12T00:55:42.821 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.821 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.821 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.821 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.822 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.822 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.822 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.822 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.822 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.822 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.822 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: _finish_auth 0 2024-09-12T00:55:42.822 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: _check_auth_tickets 2024-09-12T00:55:42.822 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:55:42.822 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:55:42.462+0000 7f05c4d2c800 5 monclient: authenticate success, global_id 7802 2024-09-12T00:55:42.822 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:55:42.462+0000 7f05c4d2c800 10 monclient: _renew_subs 2024-09-12T00:55:42.822 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:55:42.462+0000 7f05c4d2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.822 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:55:42.823 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:55:42.823 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:55:42.462+0000 7f04967fc640 10 monclient: dump: 2024-09-12T00:55:42.823 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:55:42.823 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:55:42.823 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.823 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:55:42.823 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:55:42.823 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:55:42.823 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:55:42.823 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:55:42.823 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:55:42.823 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.823 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:55:42.462+0000 7f0497fff640 4 set_mon_vals no callback set 2024-09-12T00:55:42.824 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:55:42.462+0000 7f05c4d2c800 10 monclient: _renew_subs 2024-09-12T00:55:42.824 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:55:42.462+0000 7f05c4d2c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.824 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:55:42.462+0000 7f05c4d2c800 1 librados: init done 2024-09-12T00:55:42.824 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:55:42.462+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command cr dump hook 0x7f05bc00ad28 2024-09-12T00:55:42.824 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:55:42.464+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.824 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:55:42.464+0000 7f04967fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:55:42.824 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:55:42.464+0000 7f04967fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:42.824 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:55:42.464+0000 7f04967fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:55:42.824 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:55:42.465+0000 7f05b8144640 10 monclient: get_auth_request con 0x5638a9214370 auth_method 0 2024-09-12T00:55:42.824 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:55:42.465+0000 7f05c1146640 10 monclient: get_auth_request con 0x5638a9236690 auth_method 0 2024-09-12T00:55:42.824 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:55:42.465+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.824 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:55:42.465+0000 7f05c4d2c800 20 realm 2024-09-12T00:55:42.824 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:55:42.465+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.825 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:55:42.466+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.825 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:55:42.466+0000 7f05c4d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:42.825 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:55:42.466+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.825 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:55:42.466+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.825 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:55:42.466+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.825 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:55:42.466+0000 7f05c0945640 10 monclient: get_auth_request con 0x5638a923a900 auth_method 0 2024-09-12T00:55:42.825 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:55:42.467+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:42.825 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:55:42.467+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.825 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:55:42.467+0000 7f05b8144640 10 monclient: get_auth_request con 0x5638a923e160 auth_method 0 2024-09-12T00:55:42.825 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:55:42.467+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:42.825 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:55:42.467+0000 7f05c4d2c800 20 searching for the correct realm 2024-09-12T00:55:42.825 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:55:42.468+0000 7f05c1146640 10 monclient: get_auth_request con 0x5638a9242f00 auth_method 0 2024-09-12T00:55:42.825 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:55:42.468+0000 7f05c0945640 10 monclient: get_auth_request con 0x7f05bc01e950 auth_method 0 2024-09-12T00:55:42.826 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:55:42.470+0000 7f05c0945640 0 -- 172.21.15.62:0/844967091 >> [v2:172.21.15.62:6816/3104025159,v1:172.21.15.62:6817/3104025159] conn(0x5638a923a900 msgr2=0x5638a923cd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:42.826 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:55:42.470+0000 7f04967fc640 1 client.7802.objecter ms_handle_reset 0x5638a923a900 session 0x5638a923a280 osd.1 2024-09-12T00:55:42.826 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:55:42.470+0000 7f04967fc640 10 monclient: _renew_subs 2024-09-12T00:55:42.826 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:55:42.470+0000 7f04967fc640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:55:42.826 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:55:42.470+0000 7f05c0945640 10 monclient: get_auth_request con 0x7f048c08dff0 auth_method 0 2024-09-12T00:55:42.826 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:55:42.470+0000 7f05b8144640 10 monclient: get_auth_request con 0x7f05bc026400 auth_method 0 2024-09-12T00:55:42.826 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:55:42.473+0000 7f05c1146640 10 monclient: get_auth_request con 0x7f05b00d5280 auth_method 0 2024-09-12T00:55:42.826 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:55:42.473+0000 7f05c0945640 0 -- 172.21.15.62:0/844967091 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f05bc003410 msgr2=0x7f05bc003890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:42.826 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:55:42.674+0000 7f05c0945640 10 monclient: get_auth_request con 0x7f05bc003410 auth_method 0 2024-09-12T00:55:42.826 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:42.826 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:42.826 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:42.826 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:42.827 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:42.827 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:42.827 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.827 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.827 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:55:42.680+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.827 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:42.827 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.827 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:42.827 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 zone default found 2024-09-12T00:55:42.827 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 4 Realm: () 2024-09-12T00:55:42.827 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:42.827 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:42.827 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:42.828 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 zonegroup default 2024-09-12T00:55:42.828 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.828 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.828 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:55:42.681+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.828 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:55:42.682+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.828 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:55:42.682+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.828 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:55:42.682+0000 7f05c4d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.828 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:55:42.682+0000 7f05c4d2c800 20 started sync module instance, tier type = 2024-09-12T00:55:42.828 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:55:42.682+0000 7f05c4d2c800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:42.828 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=0 2024-09-12T00:55:42.828 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=1 2024-09-12T00:55:42.828 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=2 2024-09-12T00:55:42.828 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=3 2024-09-12T00:55:42.829 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=4 2024-09-12T00:55:42.829 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=5 2024-09-12T00:55:42.829 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:55:42.691+0000 7f05c4d2c800 20 add_watcher() i=6 2024-09-12T00:55:42.829 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:55:42.692+0000 7f05c4d2c800 20 add_watcher() i=7 2024-09-12T00:55:42.829 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:55:42.692+0000 7f05c4d2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:42.829 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding auth protocol: cephx 2024-09-12T00:55:42.829 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding auth protocol: cephx 2024-09-12T00:55:42.829 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding auth protocol: cephx 2024-09-12T00:55:42.829 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: secure 2024-09-12T00:55:42.829 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: crc 2024-09-12T00:55:42.829 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: secure 2024-09-12T00:55:42.829 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: crc 2024-09-12T00:55:42.829 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: secure 2024-09-12T00:55:42.830 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: crc 2024-09-12T00:55:42.830 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: crc 2024-09-12T00:55:42.830 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: secure 2024-09-12T00:55:42.830 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: crc 2024-09-12T00:55:42.830 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: secure 2024-09-12T00:55:42.830 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:55:42.695+0000 7f0476fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:42.830 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: crc 2024-09-12T00:55:42.830 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 AuthRegistry(0x7fff7b3a65d0) adding con mode: secure 2024-09-12T00:55:42.830 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:55:42.830 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:42.830 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:42.830 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command cache list hook 0x5638a9218d50 2024-09-12T00:55:42.830 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command cache inspect hook 0x5638a9218d50 2024-09-12T00:55:42.831 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command cache erase hook 0x5638a9218d50 2024-09-12T00:55:42.831 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command cache zap hook 0x5638a9218d50 2024-09-12T00:55:42.831 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:55:42.695+0000 7f05c4d2c800 5 note: GC not initialized 2024-09-12T00:55:42.831 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:55:42.696+0000 7f0475fe3640 20 reqs_thread_entry: start 2024-09-12T00:55:42.831 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command sync trace show hook 0x7f05bc010440 2024-09-12T00:55:42.831 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command sync trace history hook 0x7f05bc010440 2024-09-12T00:55:42.831 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command sync trace active hook 0x7f05bc010440 2024-09-12T00:55:42.831 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 5 asok(0x5638a8f33630) register_command sync trace active_short hook 0x7f05bc010440 2024-09-12T00:55:42.831 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:42.831 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 20 Filter name: none 2024-09-12T00:55:42.831 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:55:42.696+0000 7f03e77fe640 20 reqs_thread_entry: start 2024-09-12T00:55:42.831 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:42.832 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.832 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:42.832 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:42.832 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:42.832 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:55:42.832 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:55:42.696+0000 7f05c4d2c800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.832 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:55:42.697+0000 7f05c4d2c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:55:42.832 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:55:42.697+0000 7f05c4d2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:42.832 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:55:42.697+0000 7f05c4d2c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:42.832 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:55:42.697+0000 7f05c4d2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:42.832 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:55:42.697+0000 7f05c4d2c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:42.832 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:55:42.697+0000 7f05c4d2c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:55:42.833 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:55:42.701+0000 7f05c4d2c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:42.833 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:55:42.701+0000 7f05c4d2c800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:42.833 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:55:42.701+0000 7f05c4d2c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:42.833 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:55:42.701+0000 7f05c4d2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:55:42.833 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:55:42.701+0000 7f0497fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431688 cookie 94801355892160 notifier 7802 bl.length()=827 2024-09-12T00:55:42.833 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:55:42.701+0000 7f0497fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:42.833 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:55:42.701+0000 7f0497fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:42.833 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:55:42.701+0000 7f0497fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:42.833 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:55:42.703+0000 7f05c4d2c800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:55:42.833 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:55:42.703+0000 7f05c4d2c800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:55:42.833 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:55:42.703+0000 7f05c4d2c800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:55:42.833 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:55:42.703+0000 7f05c4d2c800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:55:42.834 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:55:42.707+0000 7f05c4d2c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f05c4d2c800 time 2024-09-12T00:55:42.707487+0000 2024-09-12T00:55:42.834 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:55:42.834 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.834 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:42.834 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f05c638c71a] 2024-09-12T00:55:42.834 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f05c638c8d8] 2024-09-12T00:55:42.834 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5638a69f6641] 2024-09-12T00:55:42.834 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5638a6a0638a] 2024-09-12T00:55:42.834 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:55:42.834 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f05c5029590] 2024-09-12T00:55:42.834 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:55:42.834 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:55:42.834 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.835 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:55:42.708+0000 7f05c4d2c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:55:42.835 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f05c4d2c800 thread_name:radosgw-admin 2024-09-12T00:55:42.835 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.835 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:55:42.835 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f05c503e6f0] 2024-09-12T00:55:42.835 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f05c508b99c] 2024-09-12T00:55:42.835 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:55:42.835 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:55:42.835 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f05c638c774] 2024-09-12T00:55:42.835 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f05c638c8d8] 2024-09-12T00:55:42.835 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5638a69f6641] 2024-09-12T00:55:42.835 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5638a6a0638a] 2024-09-12T00:55:42.835 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:55:42.836 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f05c5029590] 2024-09-12T00:55:42.836 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:55:42.836 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:55:42.836 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:55:42.836 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:55:42.836 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:55:42.836 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:55:42.836 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:55:42.836 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:55:42.836 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:55:42.836 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:55:42.836 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:55:42.836 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:55:42.837 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:55:42.837 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:55:42.837 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:55:42.837 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:55:42.837 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:55:42.837 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:55:42.837 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:55:42.837 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:55:42.837 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:55:42.837 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:55:42.837 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:55:42.837 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:55:42.837 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:55:42.838 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:55:42.838 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:55:42.838 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:55:42.838 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:55:42.838 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:55:42.838 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:55:42.838 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:55:42.838 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:55:42.838 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:55:42.838 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:55:42.838 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:55:42.838 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:55:42.838 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:55:42.839 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:55:42.839 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:55:42.839 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:55:42.839 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:55:42.839 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:55:42.839 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:55:42.839 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:55:42.839 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:55:42.839 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:55:42.839 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:55:42.839 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:55:42.839 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:55:42.839 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:55:42.839 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:55:42.840 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:55:42.840 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:55:42.840 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:55:42.840 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:55:42.840 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:55:42.840 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:55:42.840 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:55:42.840 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:55:42.840 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:55:42.840 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:55:42.840 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:55:42.840 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:55:42.840 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:55:42.841 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:55:42.841 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:55:42.841 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:55:42.841 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:55:42.841 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:55:42.841 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:55:42.841 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:55:42.841 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:55:42.841 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:55:42.841 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:55:42.841 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:55:42.841 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:55:42.841 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:55:42.842 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:55:42.842 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:55:42.842 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:55:42.842 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:55:42.842 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:55:42.842 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:55:42.842 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:55:42.842 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:55:42.842 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:55:42.842 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:55:42.842 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:55:42.842 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:55:42.842 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:55:42.843 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:55:42.843 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:55:42.843 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:55:42.843 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:55:42.843 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:55:42.843 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:55:42.843 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:55:42.843 INFO:tasks.workunit.client.0.smithi062.stderr: 7f03e77fe640 / http_manager 2024-09-12T00:55:42.843 INFO:tasks.workunit.client.0.smithi062.stderr: 7f0475fe3640 / http_manager 2024-09-12T00:55:42.843 INFO:tasks.workunit.client.0.smithi062.stderr: 7f0476fe5640 / rgw_dt_lg_renew 2024-09-12T00:55:42.843 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04967fc640 / ms_dispatch 2024-09-12T00:55:42.843 INFO:tasks.workunit.client.0.smithi062.stderr: 7f0497fff640 / io_context_pool 2024-09-12T00:55:42.843 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04a67fc640 / ms_dispatch 2024-09-12T00:55:42.844 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04ad60a640 / ms_dispatch 2024-09-12T00:55:42.844 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04aee0d640 / io_context_pool 2024-09-12T00:55:42.844 INFO:tasks.workunit.client.0.smithi062.stderr: 7f05b8144640 / msgr-worker-2 2024-09-12T00:55:42.844 INFO:tasks.workunit.client.0.smithi062.stderr: 7f05c0945640 / msgr-worker-1 2024-09-12T00:55:42.844 INFO:tasks.workunit.client.0.smithi062.stderr: 7f05c1146640 / msgr-worker-0 2024-09-12T00:55:42.844 INFO:tasks.workunit.client.0.smithi062.stderr: 7f05c1947640 / io_context_pool 2024-09-12T00:55:42.844 INFO:tasks.workunit.client.0.smithi062.stderr: 7f05c4d2c800 / radosgw-admin 2024-09-12T00:55:42.844 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:55:42.844 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:55:42.844 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:55:42.708951Z_f21fc789-f9a0-4b7f-bb32-7c19c6d7ebc8/log 2024-09-12T00:55:42.844 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:55:42.844 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:55:42.850 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:42.850 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:42.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.787+0000 7f1c6a323800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.788+0000 7f1c6a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.788+0000 7f1c6a323800 20 realm 2024-09-12T00:55:42.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.788+0000 7f1c6a323800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.789+0000 7f1c6a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.789+0000 7f1c6a323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:42.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.789+0000 7f1c6a323800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.789+0000 7f1c6a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.789+0000 7f1c6a323800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.789+0000 7f1c6a323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:42.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.790+0000 7f1c6a323800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.790+0000 7f1c6a323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:42.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.790+0000 7f1c6a323800 20 searching for the correct realm 2024-09-12T00:55:42.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.793+0000 7f1c6600c640 0 -- 172.21.15.62:0/3350421002 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7f1c6000f430 msgr2=0x7f1c6000f8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:55:42.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.797+0000 7f1c6600c640 0 -- 172.21.15.62:0/3350421002 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f1c60032400 msgr2=0x7f1c60032820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:42.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.802+0000 7f1c6a323800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:42.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.802+0000 7f1c6a323800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:42.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.802+0000 7f1c6a323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:42.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.802+0000 7f1c6a323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:42.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.802+0000 7f1c6a323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:42.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.802+0000 7f1c6a323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:42.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.802+0000 7f1c6a323800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.802+0000 7f1c6a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.802+0000 7f1c6a323800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.802+0000 7f1c6a323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:42.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.802+0000 7f1c6a323800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.803+0000 7f1c6a323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:42.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.803+0000 7f1c6a323800 20 zone default found 2024-09-12T00:55:42.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.803+0000 7f1c6a323800 4 Realm: () 2024-09-12T00:55:42.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.803+0000 7f1c6a323800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:42.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.803+0000 7f1c6a323800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:42.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.803+0000 7f1c6a323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:42.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.803+0000 7f1c6a323800 20 zonegroup default 2024-09-12T00:55:42.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.803+0000 7f1c6a323800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.803+0000 7f1c6a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.803+0000 7f1c6a323800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.803+0000 7f1c6a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.803+0000 7f1c6a323800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.803+0000 7f1c6a323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.803+0000 7f1c6a323800 20 started sync module instance, tier type = 2024-09-12T00:55:42.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.803+0000 7f1c6a323800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:42.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.812+0000 7f1c6a323800 20 add_watcher() i=0 2024-09-12T00:55:42.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.812+0000 7f1c6a323800 20 add_watcher() i=1 2024-09-12T00:55:42.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.812+0000 7f1c6a323800 20 add_watcher() i=2 2024-09-12T00:55:42.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.812+0000 7f1c6a323800 20 add_watcher() i=3 2024-09-12T00:55:42.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.812+0000 7f1c6a323800 20 add_watcher() i=4 2024-09-12T00:55:42.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.812+0000 7f1c6a323800 20 add_watcher() i=5 2024-09-12T00:55:42.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.812+0000 7f1c6a323800 20 add_watcher() i=6 2024-09-12T00:55:42.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.812+0000 7f1c6a323800 20 add_watcher() i=7 2024-09-12T00:55:42.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.812+0000 7f1c6a323800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:42.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.814+0000 7f1b1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:42.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.814+0000 7f1c6a323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:42.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.814+0000 7f1c6a323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:42.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.814+0000 7f1c6a323800 5 note: GC not initialized 2024-09-12T00:55:42.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.814+0000 7f1a977fe640 20 reqs_thread_entry: start 2024-09-12T00:55:42.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.815+0000 7f1c6a323800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:42.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.815+0000 7f1c6a323800 20 Filter name: none 2024-09-12T00:55:42.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.815+0000 7f1a957fa640 20 reqs_thread_entry: start 2024-09-12T00:55:42.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.815+0000 7f1c6a323800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.815+0000 7f1c6a323800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:42.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.815+0000 7f1c6a323800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.816+0000 7f1c6a323800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:42.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.816+0000 7f1c6a323800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:42.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.816+0000 7f1c6a323800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.816+0000 7f1c6a323800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:42.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.816+0000 7f1c6a323800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.816+0000 7f1c6a323800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:42.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.816+0000 7f1c6a323800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:55:42.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.818+0000 7f1b1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:42.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.820+0000 7f1c6a323800 20 remove_watcher() i=0 2024-09-12T00:55:42.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.820+0000 7f1c6a323800 2 removed watcher, disabling cache 2024-09-12T00:55:42.855 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.821+0000 7f1c6a323800 20 remove_watcher() i=1 2024-09-12T00:55:42.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.822+0000 7f1c6a323800 20 remove_watcher() i=2 2024-09-12T00:55:42.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.823+0000 7f1c6a323800 20 remove_watcher() i=3 2024-09-12T00:55:42.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.824+0000 7f1c6a323800 20 remove_watcher() i=4 2024-09-12T00:55:42.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.825+0000 7f1c6a323800 20 remove_watcher() i=5 2024-09-12T00:55:42.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.826+0000 7f1c6a323800 20 remove_watcher() i=6 2024-09-12T00:55:42.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.827+0000 7f1c6a323800 20 remove_watcher() i=7 2024-09-12T00:55:42.878 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:55:42.906 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:55:42.907 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:55:42.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.948+0000 7fc8a832e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.949+0000 7fc8a832e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.949+0000 7fc8a832e800 20 realm 2024-09-12T00:55:42.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.949+0000 7fc8a832e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.950+0000 7fc8a832e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.950+0000 7fc8a832e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:55:42.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.950+0000 7fc8a832e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.950+0000 7fc8a832e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:42.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.950+0000 7fc8a832e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.951+0000 7fc8a832e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:42.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.951+0000 7fc8a832e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:42.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.951+0000 7fc8a832e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:55:42.950 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.951+0000 7fc8a832e800 20 searching for the correct realm 2024-09-12T00:55:42.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:42.952+0000 7fc8a3f64640 0 -- 172.21.15.62:0/2975681436 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7fc89c01a040 msgr2=0x7fc89c01c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:43.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.158+0000 7fc8a4765640 0 -- 172.21.15.62:0/2975681436 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7fc8940bc040 msgr2=0x7fc8940b6860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:55:43.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.366+0000 7fc8a832e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:55:43.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.366+0000 7fc8a832e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:55:43.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.366+0000 7fc8a832e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:55:43.365 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.366+0000 7fc8a832e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:55:43.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.366+0000 7fc8a832e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:55:43.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.366+0000 7fc8a832e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:55:43.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.366+0000 7fc8a832e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:43.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.366+0000 7fc8a832e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:43.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.366+0000 7fc8a832e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:43.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.367+0000 7fc8a832e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:55:43.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.367+0000 7fc8a832e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:43.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.367+0000 7fc8a832e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:55:43.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.367+0000 7fc8a832e800 20 zone default found 2024-09-12T00:55:43.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.367+0000 7fc8a832e800 4 Realm: () 2024-09-12T00:55:43.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.367+0000 7fc8a832e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:55:43.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.367+0000 7fc8a832e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:55:43.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.367+0000 7fc8a832e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:55:43.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.367+0000 7fc8a832e800 20 zonegroup default 2024-09-12T00:55:43.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.367+0000 7fc8a832e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:43.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.368+0000 7fc8a832e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:43.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.368+0000 7fc8a832e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:43.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.368+0000 7fc8a832e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:43.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.368+0000 7fc8a832e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:43.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.368+0000 7fc8a832e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:55:43.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.368+0000 7fc8a832e800 20 started sync module instance, tier type = 2024-09-12T00:55:43.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.368+0000 7fc8a832e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:55:43.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.378+0000 7fc8a832e800 20 add_watcher() i=0 2024-09-12T00:55:43.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.378+0000 7fc8a832e800 20 add_watcher() i=1 2024-09-12T00:55:43.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.378+0000 7fc8a832e800 20 add_watcher() i=2 2024-09-12T00:55:43.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.378+0000 7fc8a832e800 20 add_watcher() i=3 2024-09-12T00:55:43.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.378+0000 7fc8a832e800 20 add_watcher() i=4 2024-09-12T00:55:43.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.378+0000 7fc8a832e800 20 add_watcher() i=5 2024-09-12T00:55:43.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.378+0000 7fc8a832e800 20 add_watcher() i=6 2024-09-12T00:55:43.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.379+0000 7fc8a832e800 20 add_watcher() i=7 2024-09-12T00:55:43.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.379+0000 7fc8a832e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:55:43.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.381+0000 7fc759fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:43.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.381+0000 7fc8a832e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:55:43.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.381+0000 7fc8a832e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:55:43.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.382+0000 7fc8a832e800 5 note: GC not initialized 2024-09-12T00:55:43.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.382+0000 7fc758fe1640 20 reqs_thread_entry: start 2024-09-12T00:55:43.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.382+0000 7fc8a832e800 20 init_complete bucket index max shards: 1 2024-09-12T00:55:43.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.382+0000 7fc8a832e800 20 Filter name: none 2024-09-12T00:55:43.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.382+0000 7fc6d27fc640 20 reqs_thread_entry: start 2024-09-12T00:55:43.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.382+0000 7fc8a832e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:55:43.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.382+0000 7fc8a832e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:43.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.383+0000 7fc8a832e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:55:43.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.383+0000 7fc8a832e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:55:43.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.383+0000 7fc8a832e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:55:43.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.383+0000 7fc8a832e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:55:43.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.383+0000 7fc8a832e800 20 rados->read ofs=0 len=0 2024-09-12T00:55:43.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.383+0000 7fc8a832e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:55:43.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.383+0000 7fc8a832e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:55:43.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.383+0000 7fc8a832e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:55:43.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.383+0000 7fc8a832e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:55:43.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.383+0000 7fc8a832e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:55:43.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.383+0000 7fc8a832e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:55:43.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.383+0000 7fc8a832e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:55:43.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.383+0000 7fc8a832e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:55:43.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.383+0000 7fc8a832e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:55:43.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.383+0000 7fc8a832e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:55:43.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.384+0000 7fc8a832e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:55:43.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.384+0000 7fc8a832e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:55:43.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.385+0000 7fc759fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:55:43.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.387+0000 7fc8a832e800 20 remove_watcher() i=0 2024-09-12T00:55:43.386 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.387+0000 7fc8a832e800 2 removed watcher, disabling cache 2024-09-12T00:55:43.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.388+0000 7fc8a832e800 20 remove_watcher() i=1 2024-09-12T00:55:43.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.389+0000 7fc8a832e800 20 remove_watcher() i=2 2024-09-12T00:55:43.389 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.390+0000 7fc8a832e800 20 remove_watcher() i=3 2024-09-12T00:55:43.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.391+0000 7fc8a832e800 20 remove_watcher() i=4 2024-09-12T00:55:43.391 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.393+0000 7fc8a832e800 20 remove_watcher() i=5 2024-09-12T00:55:43.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.394+0000 7fc8a832e800 20 remove_watcher() i=6 2024-09-12T00:55:43.394 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:55:43.395+0000 7fc8a832e800 20 remove_watcher() i=7 2024-09-12T00:56:13.412 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:56:13.451 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:13.451 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:13.498 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.499+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.500+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.500+0000 7f04a8746800 20 realm 2024-09-12T00:56:13.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.500+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.500+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.500+0000 7f04a8746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:13.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.501+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.501+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.501+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.502+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:13.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.502+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.502+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:13.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.502+0000 7f04a8746800 20 searching for the correct realm 2024-09-12T00:56:13.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.503+0000 7f04a6237640 0 -- 172.21.15.62:0/2929494308 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7f04a0029020 msgr2=0x7f04a0061690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:13.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.711+0000 7f04a6a38640 0 -- 172.21.15.62:0/2929494308 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7f04980a3960 msgr2=0x7f0498097410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:13.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:56:13.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:56:13.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:13.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:13.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:13.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:13.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.919+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.920+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.919 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.920+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.920 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.920+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:13.920 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.920+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.920 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.920+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:13.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.921+0000 7f04a8746800 20 zone default found 2024-09-12T00:56:13.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.921+0000 7f04a8746800 4 Realm: () 2024-09-12T00:56:13.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.921+0000 7f04a8746800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:56:13.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.921+0000 7f04a8746800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:56:13.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.921+0000 7f04a8746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:13.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.921+0000 7f04a8746800 20 zonegroup default 2024-09-12T00:56:13.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.921+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.921+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.921+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.921+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.921 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.921+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.922+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:13.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.922+0000 7f04a8746800 20 started sync module instance, tier type = 2024-09-12T00:56:13.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.922+0000 7f04a8746800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:56:13.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=0 2024-09-12T00:56:13.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=1 2024-09-12T00:56:13.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=2 2024-09-12T00:56:13.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=3 2024-09-12T00:56:13.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=4 2024-09-12T00:56:13.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=5 2024-09-12T00:56:13.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=6 2024-09-12T00:56:13.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.934+0000 7f04a8746800 20 add_watcher() i=7 2024-09-12T00:56:13.933 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.934+0000 7f04a8746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:13.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.936+0000 7f035cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:13.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.937+0000 7f04a8746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:13.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.937+0000 7f04a8746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:13.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.937+0000 7f04a8746800 5 note: GC not initialized 2024-09-12T00:56:13.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.937+0000 7f02d77fe640 20 reqs_thread_entry: start 2024-09-12T00:56:13.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.937+0000 7f04a8746800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:13.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.937+0000 7f04a8746800 20 Filter name: none 2024-09-12T00:56:13.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.937+0000 7f02d57fa640 20 reqs_thread_entry: start 2024-09-12T00:56:13.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.938+0000 7f04a8746800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:56:13.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.938+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.938+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:56:13.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.938+0000 7f04a8746800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:56:13.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.938+0000 7f04a8746800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:56:13.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.938+0000 7f04a8746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:56:13.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.938+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:13.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.938+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:56:13.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.938+0000 7f04a8746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:13.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.938+0000 7f04a8746800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:13.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.938+0000 7f04a8746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:13.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.938+0000 7f04a8746800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:13.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.938+0000 7f04a8746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:56:13.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.940+0000 7f04a8746800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:56:13.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.945+0000 7f04a8746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:13.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.945+0000 7f04a8746800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:13.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.945+0000 7f04a8746800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:13.944 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.945+0000 7f04a8746800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:56:13.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.945+0000 7f0389ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431689 cookie 94250260346368 notifier 7850 bl.length()=827 2024-09-12T00:56:13.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.945+0000 7f0389ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:13.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.945+0000 7f0389ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:13.945 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.945+0000 7f0389ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:13.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.947+0000 7f04a8746800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:56:13.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.947+0000 7f04a8746800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:56:13.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.947+0000 7f04a8746800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:56:13.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.947+0000 7f04a8746800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:56:13.949 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f04a8746800 time 2024-09-12T00:56:13.951422+0000 2024-09-12T00:56:13.949 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:56:13.950 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:13.950 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f04abd8c71a] 2024-09-12T00:56:13.950 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f04abd8c8d8] 2024-09-12T00:56:13.950 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b857729641] 2024-09-12T00:56:13.950 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd8854c) [0x55b857c3c54c] 2024-09-12T00:56:13.950 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85773931d] 2024-09-12T00:56:13.950 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:56:13.950 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f04aaa29590] 2024-09-12T00:56:13.950 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:56:13.951 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:56:13.951 INFO:tasks.workunit.client.0.smithi062.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:56:13.951 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f04a8746800 thread_name:radosgw-admin 2024-09-12T00:56:13.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.951+0000 7f04a8746800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f04a8746800 time 2024-09-12T00:56:13.951422+0000 2024-09-12T00:56:13.951 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:56:13.951 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:13.951 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:13.951 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f04abd8c71a] 2024-09-12T00:56:13.951 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f04abd8c8d8] 2024-09-12T00:56:13.951 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b857729641] 2024-09-12T00:56:13.951 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd8854c) [0x55b857c3c54c] 2024-09-12T00:56:13.951 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85773931d] 2024-09-12T00:56:13.951 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:56:13.952 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f04aaa29590] 2024-09-12T00:56:13.952 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:56:13.952 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:56:13.952 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:13.964 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:13.964 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f04aaa3e6f0] 2024-09-12T00:56:13.964 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f04aaa8b99c] 2024-09-12T00:56:13.964 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:56:13.964 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:56:13.965 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f04abd8c774] 2024-09-12T00:56:13.965 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f04abd8c8d8] 2024-09-12T00:56:13.965 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b857729641] 2024-09-12T00:56:13.965 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd8854c) [0x55b857c3c54c] 2024-09-12T00:56:13.965 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85773931d] 2024-09-12T00:56:13.965 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:56:13.965 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f04aaa29590] 2024-09-12T00:56:13.965 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:56:13.965 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:56:13.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:13.952+0000 7f04a8746800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:56:13.965 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f04a8746800 thread_name:radosgw-admin 2024-09-12T00:56:13.966 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:13.966 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:13.966 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f04aaa3e6f0] 2024-09-12T00:56:13.966 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f04aaa8b99c] 2024-09-12T00:56:13.966 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:56:13.966 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:56:13.966 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f04abd8c774] 2024-09-12T00:56:13.966 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f04abd8c8d8] 2024-09-12T00:56:13.966 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b857729641] 2024-09-12T00:56:13.966 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd8854c) [0x55b857c3c54c] 2024-09-12T00:56:13.966 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85773931d] 2024-09-12T00:56:13.966 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:56:13.966 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f04aaa29590] 2024-09-12T00:56:13.967 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:56:13.967 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:56:13.967 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:56:13.967 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:13.967 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:56:13.967 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:56:13.480+0000 7f04a8746800 10 monclient: build_initial_monmap 2024-09-12T00:56:13.967 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:56:13.480+0000 7f04a8746800 1 build_initial for_mkfs: 0 2024-09-12T00:56:13.967 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:56:13.480+0000 7f04a8746800 10 monclient: monmap: 2024-09-12T00:56:13.967 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:13.967 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:13.967 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:13.967 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:13.967 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:13.968 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:13.968 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:13.968 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:13.968 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:13.968 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:13.968 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding auth protocol: cephx 2024-09-12T00:56:13.968 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding auth protocol: cephx 2024-09-12T00:56:13.968 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding auth protocol: cephx 2024-09-12T00:56:13.968 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: secure 2024-09-12T00:56:13.968 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: crc 2024-09-12T00:56:13.968 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: secure 2024-09-12T00:56:13.968 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: crc 2024-09-12T00:56:13.969 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: secure 2024-09-12T00:56:13.969 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: crc 2024-09-12T00:56:13.969 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: crc 2024-09-12T00:56:13.969 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: secure 2024-09-12T00:56:13.969 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: crc 2024-09-12T00:56:13.969 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: secure 2024-09-12T00:56:13.969 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: crc 2024-09-12T00:56:13.969 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: secure 2024-09-12T00:56:13.969 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:56:13.480+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:13.970 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:56:13.480+0000 7f04a8746800 1 librados: starting msgr at 2024-09-12T00:56:13.970 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:56:13.480+0000 7f04a8746800 1 librados: starting objecter 2024-09-12T00:56:13.970 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 asok(0x55b859180630) register_command objecter_requests hook 0x55b8593a8540 2024-09-12T00:56:13.970 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:56:13.480+0000 7f04a8746800 1 librados: setting wanted keys 2024-09-12T00:56:13.970 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:56:13.480+0000 7f04a8746800 1 librados: calling monclient init 2024-09-12T00:56:13.970 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:56:13.480+0000 7f04a8746800 10 monclient: init 2024-09-12T00:56:13.970 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding auth protocol: cephx 2024-09-12T00:56:13.970 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding auth protocol: cephx 2024-09-12T00:56:13.970 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding auth protocol: cephx 2024-09-12T00:56:13.970 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: secure 2024-09-12T00:56:13.970 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: crc 2024-09-12T00:56:13.970 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: secure 2024-09-12T00:56:13.970 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: crc 2024-09-12T00:56:13.970 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: secure 2024-09-12T00:56:13.971 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: crc 2024-09-12T00:56:13.971 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: crc 2024-09-12T00:56:13.971 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: secure 2024-09-12T00:56:13.971 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: crc 2024-09-12T00:56:13.971 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: secure 2024-09-12T00:56:13.971 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: crc 2024-09-12T00:56:13.971 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: secure 2024-09-12T00:56:13.971 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:56:13.480+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:13.971 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:56:13.481+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:13.971 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:56:13.481+0000 7f04a8746800 5 asok(0x55b859180630) register_command rotate-key hook 0x55b8593a0828 2024-09-12T00:56:13.971 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:13.971 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:56:13.971 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-a con 0x55b8593a7450 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:13.971 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-b con 0x55b8593ca410 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:13.972 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-c con 0x7f0494002340 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:13.972 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:13.972 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:13.972 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:13.972 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:13.972 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): authenticate will time out at 2259.974332s 2024-09-12T00:56:13.972 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:56:13.481+0000 7f04a6237640 10 monclient(hunting): get_auth_request con 0x55b8593a7450 auth_method 0 2024-09-12T00:56:13.972 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:56:13.481+0000 7f04a6237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:13.972 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:56:13.481+0000 7f04a6237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:13.972 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:56:13.481+0000 7f04a6237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:13.972 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): get_auth_request con 0x7f0494002340 auth_method 0 2024-09-12T00:56:13.972 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:13.973 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:13.973 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:13.973 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:56:13.481+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:13.973 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:56:13.481+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:13.973 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:56:13.481+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:13.973 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:13.973 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:13.973 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:13.973 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:56:13.481+0000 7f049da36640 10 monclient(hunting): get_auth_request con 0x55b8593ca410 auth_method 0 2024-09-12T00:56:13.973 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:56:13.481+0000 7f049da36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:13.973 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:56:13.481+0000 7f049da36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:13.973 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:56:13.481+0000 7f049da36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:13.973 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:56:13.481+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:13.974 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:56:13.481+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:13.974 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:56:13.481+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:13.974 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): handle_auth_done global_id 7841 payload 824 2024-09-12T00:56:13.974 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient: _finish_hunting 0 2024-09-12T00:56:13.974 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:56:13.481+0000 7f04a6a38640 1 monclient: found mon.noname-c 2024-09-12T00:56:13.974 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:56:13.974 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:13.974 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:56:13.974 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: dump: 2024-09-12T00:56:13.974 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:13.974 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:13.974 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:13.974 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:13.974 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:13.974 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:13.975 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:13.975 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:13.975 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:13.975 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:13.975 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: _finish_auth 0 2024-09-12T00:56:13.975 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: _check_auth_tickets 2024-09-12T00:56:13.975 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:13.975 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:13.975 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:56:13.975 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: dump: 2024-09-12T00:56:13.975 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:13.976 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:13.976 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:13.976 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:13.976 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:13.976 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:13.976 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:13.976 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:13.976 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:13.976 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:13.977 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:56:13.482+0000 7f04a8746800 5 monclient: authenticate success, global_id 7841 2024-09-12T00:56:13.977 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:56:13.482+0000 7f04a8746800 10 monclient: _renew_subs 2024-09-12T00:56:13.977 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:56:13.482+0000 7f04a8746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:13.977 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:56:13.482+0000 7f0394608640 4 set_mon_vals no callback set 2024-09-12T00:56:13.977 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:56:13.482+0000 7f04a8746800 10 monclient: _renew_subs 2024-09-12T00:56:13.977 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:56:13.482+0000 7f04a8746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:13.977 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:56:13.482+0000 7f04a8746800 1 librados: init done 2024-09-12T00:56:13.977 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:56:13.484+0000 7f0392e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:13.977 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:56:13.484+0000 7f0392e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:13.977 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:56:13.484+0000 7f0392e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:13.977 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:56:13.484+0000 7f04a6237640 10 monclient: get_auth_request con 0x7f038c0764a0 auth_method 0 2024-09-12T00:56:13.977 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:56:13.485+0000 7f049da36640 10 monclient: get_auth_request con 0x55b8593e3020 auth_method 0 2024-09-12T00:56:13.978 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:56:13.485+0000 7f04a6237640 10 monclient: get_auth_request con 0x55b8593ec750 auth_method 0 2024-09-12T00:56:13.978 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:56:13.486+0000 7f049da36640 10 monclient: get_auth_request con 0x55b8593f0bc0 auth_method 0 2024-09-12T00:56:13.978 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:56:13.488+0000 7f04a8746800 10 monclient: build_initial_monmap 2024-09-12T00:56:13.978 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:56:13.488+0000 7f04a8746800 1 build_initial for_mkfs: 0 2024-09-12T00:56:13.978 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:56:13.488+0000 7f04a8746800 10 monclient: monmap: 2024-09-12T00:56:13.978 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:13.978 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:13.978 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:13.978 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:13.978 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:13.978 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:13.978 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:13.978 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:13.979 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:13.979 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:13.979 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding auth protocol: cephx 2024-09-12T00:56:13.979 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding auth protocol: cephx 2024-09-12T00:56:13.979 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding auth protocol: cephx 2024-09-12T00:56:13.979 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: secure 2024-09-12T00:56:13.979 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: crc 2024-09-12T00:56:13.979 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: secure 2024-09-12T00:56:13.979 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: crc 2024-09-12T00:56:13.979 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: secure 2024-09-12T00:56:13.979 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: crc 2024-09-12T00:56:13.980 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: crc 2024-09-12T00:56:13.980 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: secure 2024-09-12T00:56:13.980 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: crc 2024-09-12T00:56:13.980 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: secure 2024-09-12T00:56:13.980 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: crc 2024-09-12T00:56:13.980 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: secure 2024-09-12T00:56:13.980 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:56:13.488+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:13.980 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 asok(0x55b859180630) register_command objecter_requests cmddesc objecter_requests hook 0x55b8593f9290 EEXIST 2024-09-12T00:56:13.981 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:56:13.488+0000 7f04a8746800 10 monclient: init 2024-09-12T00:56:13.981 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding auth protocol: cephx 2024-09-12T00:56:13.981 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding auth protocol: cephx 2024-09-12T00:56:13.981 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding auth protocol: cephx 2024-09-12T00:56:13.981 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: secure 2024-09-12T00:56:13.981 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: crc 2024-09-12T00:56:13.981 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: secure 2024-09-12T00:56:13.981 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: crc 2024-09-12T00:56:13.981 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: secure 2024-09-12T00:56:13.981 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: crc 2024-09-12T00:56:13.981 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: crc 2024-09-12T00:56:13.981 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: secure 2024-09-12T00:56:13.982 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: crc 2024-09-12T00:56:13.982 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: secure 2024-09-12T00:56:13.982 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: crc 2024-09-12T00:56:13.982 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: secure 2024-09-12T00:56:13.982 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:56:13.488+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:13.982 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:56:13.489+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:13.982 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:56:13.489+0000 7f04a8746800 5 asok(0x55b859180630) register_command rotate-key cmddesc rotate-key hook 0x55b8593f42a0 EEXIST 2024-09-12T00:56:13.982 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:13.983 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:56:13.983 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-b con 0x55b85941cf80 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:13.983 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-c con 0x55b85941f250 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:13.983 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-a con 0x55b85941b750 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:13.983 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:13.983 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:13.983 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:13.983 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:13.983 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): authenticate will time out at 2259.982264s 2024-09-12T00:56:13.983 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): get_auth_request con 0x55b85941f250 auth_method 0 2024-09-12T00:56:13.983 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:13.983 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:13.983 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:13.984 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:56:13.489+0000 7f04a6a38640 10 monclient(hunting): get_auth_request con 0x55b85941b750 auth_method 0 2024-09-12T00:56:13.984 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:56:13.489+0000 7f04a6a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:13.984 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:56:13.489+0000 7f04a6a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:13.984 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:56:13.489+0000 7f04a6a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:13.984 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:13.984 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:13.984 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:13.984 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:56:13.489+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:13.984 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:56:13.489+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:13.984 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:56:13.489+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:13.984 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:56:13.489+0000 7f04a6237640 10 monclient(hunting): get_auth_request con 0x55b85941cf80 auth_method 0 2024-09-12T00:56:13.984 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:56:13.489+0000 7f04a6237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:13.985 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:56:13.489+0000 7f04a6237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:13.985 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:56:13.489+0000 7f04a6237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:13.985 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:56:13.489+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:13.985 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:56:13.489+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:13.985 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:56:13.489+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:13.985 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): handle_auth_done global_id 7844 payload 824 2024-09-12T00:56:13.985 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient: _finish_hunting 0 2024-09-12T00:56:13.985 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:56:13.489+0000 7f049da36640 1 monclient: found mon.noname-c 2024-09-12T00:56:13.985 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:56:13.985 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:13.985 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:56:13.985 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: dump: 2024-09-12T00:56:13.986 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:13.986 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:13.986 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:13.986 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:13.986 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:13.986 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:13.986 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:13.986 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:13.986 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:13.986 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:13.986 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: _finish_auth 0 2024-09-12T00:56:13.986 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:56:13.986 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:13.987 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:13.987 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:56:13.987 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: dump: 2024-09-12T00:56:13.987 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:13.987 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:13.987 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:13.987 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:13.987 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:13.987 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:13.987 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:13.987 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:13.987 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:13.987 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:13.988 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:56:13.490+0000 7f04a8746800 5 monclient: authenticate success, global_id 7844 2024-09-12T00:56:13.988 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:56:13.490+0000 7f04a8746800 10 monclient: _renew_subs 2024-09-12T00:56:13.988 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:56:13.490+0000 7f04a8746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:13.988 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:56:13.490+0000 7f04a7239640 4 set_mon_vals no callback set 2024-09-12T00:56:13.988 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:56:13.490+0000 7f04a8746800 10 monclient: _renew_subs 2024-09-12T00:56:13.988 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:56:13.490+0000 7f04a8746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:13.988 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:56:13.492+0000 7f038bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:13.988 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:56:13.492+0000 7f038bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:13.988 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:56:13.492+0000 7f038bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:13.988 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:56:13.492+0000 7f04a8746800 10 monclient: get_monmap_and_config 2024-09-12T00:56:13.988 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:56:13.492+0000 7f04a8746800 10 monclient: build_initial_monmap 2024-09-12T00:56:13.988 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:56:13.492+0000 7f04a8746800 1 build_initial for_mkfs: 0 2024-09-12T00:56:13.989 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:56:13.492+0000 7f04a8746800 10 monclient: monmap: 2024-09-12T00:56:13.989 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:13.989 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:13.989 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:13.989 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:13.989 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:13.989 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:13.989 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:13.989 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:13.989 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:13.989 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:13.989 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding auth protocol: cephx 2024-09-12T00:56:13.989 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding auth protocol: cephx 2024-09-12T00:56:13.990 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding auth protocol: cephx 2024-09-12T00:56:13.990 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: secure 2024-09-12T00:56:13.990 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: crc 2024-09-12T00:56:13.990 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: secure 2024-09-12T00:56:13.990 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: crc 2024-09-12T00:56:13.990 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: secure 2024-09-12T00:56:13.990 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: crc 2024-09-12T00:56:13.990 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: crc 2024-09-12T00:56:13.990 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: secure 2024-09-12T00:56:13.990 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: crc 2024-09-12T00:56:13.990 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: secure 2024-09-12T00:56:13.990 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: crc 2024-09-12T00:56:13.990 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: secure 2024-09-12T00:56:13.991 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:56:13.492+0000 7f04a6237640 10 monclient: get_auth_request con 0x7f0380076380 auth_method 0 2024-09-12T00:56:13.991 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:56:13.492+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:13.991 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient: init 2024-09-12T00:56:13.991 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding auth protocol: cephx 2024-09-12T00:56:13.991 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding auth protocol: cephx 2024-09-12T00:56:13.991 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding auth protocol: cephx 2024-09-12T00:56:13.991 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: secure 2024-09-12T00:56:13.991 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: crc 2024-09-12T00:56:13.991 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: secure 2024-09-12T00:56:13.991 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: crc 2024-09-12T00:56:13.991 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: secure 2024-09-12T00:56:13.991 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: crc 2024-09-12T00:56:13.991 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: crc 2024-09-12T00:56:13.992 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: secure 2024-09-12T00:56:13.992 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: crc 2024-09-12T00:56:13.992 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: secure 2024-09-12T00:56:13.992 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: crc 2024-09-12T00:56:13.992 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: secure 2024-09-12T00:56:13.992 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:56:13.493+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:13.992 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:56:13.493+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:13.992 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 asok(0x55b859180630) register_command rotate-key cmddesc rotate-key hook 0x7ffe44837a18 EEXIST 2024-09-12T00:56:13.992 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:13.992 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:56:13.992 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-c con 0x55b8594713f0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:13.992 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-b con 0x55b859442340 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:13.992 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-a con 0x55b85946cc90 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:13.993 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:13.993 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:13.993 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:13.993 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:13.993 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): authenticate will time out at 2259.986671s 2024-09-12T00:56:13.993 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:56:13.493+0000 7f04a6237640 10 monclient(hunting): get_auth_request con 0x55b8594713f0 auth_method 0 2024-09-12T00:56:13.993 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:56:13.493+0000 7f04a6237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:13.993 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:56:13.493+0000 7f04a6237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:13.993 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:56:13.493+0000 7f04a6237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:13.993 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:56:13.493+0000 7f04a6a38640 10 monclient(hunting): get_auth_request con 0x55b85946cc90 auth_method 0 2024-09-12T00:56:13.993 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:56:13.493+0000 7f04a6a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:13.993 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:56:13.493+0000 7f04a6a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:13.994 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:56:13.493+0000 7f04a6a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:13.994 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:56:13.493+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:13.994 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:56:13.493+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:13.994 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:56:13.493+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:13.994 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:56:13.493+0000 7f049da36640 10 monclient(hunting): get_auth_request con 0x55b859442340 auth_method 0 2024-09-12T00:56:13.994 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:56:13.493+0000 7f049da36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:13.994 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:56:13.493+0000 7f049da36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:13.994 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:56:13.493+0000 7f049da36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:13.994 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:56:13.493+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:13.994 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:56:13.493+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:13.994 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:56:13.493+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:13.994 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:56:13.494+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:13.995 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:56:13.494+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:13.995 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:56:13.494+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:13.995 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:56:13.494+0000 7f04a6237640 10 monclient(hunting): handle_auth_done global_id 7847 payload 274 2024-09-12T00:56:13.995 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:56:13.494+0000 7f04a6237640 10 monclient: _finish_hunting 0 2024-09-12T00:56:13.995 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:56:13.494+0000 7f04a6237640 1 monclient: found mon.noname-c 2024-09-12T00:56:13.995 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:56:13.494+0000 7f04a6237640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:56:13.995 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:13.995 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:56:13.995 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: dump: 2024-09-12T00:56:13.995 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:13.995 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:13.995 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:13.996 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:13.996 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:13.996 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:13.996 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:13.996 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:13.996 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:13.996 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:13.996 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: _finish_auth 0 2024-09-12T00:56:13.996 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:56:13.996 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:13.996 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:13.996 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:56:13.996 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: dump: 2024-09-12T00:56:13.997 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:13.997 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:13.997 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:13.997 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:13.997 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:13.997 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:13.997 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:13.997 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:13.997 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:13.997 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:13.997 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:56:13.494+0000 7f04a8746800 5 monclient: authenticate success, global_id 7847 2024-09-12T00:56:13.997 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:56:13.494+0000 7f04a8746800 10 monclient: get_monmap_and_config success 2024-09-12T00:56:13.998 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:56:13.494+0000 7f04a8746800 4 set_mon_vals no callback set 2024-09-12T00:56:13.998 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:56:13.495+0000 7f04a8746800 10 monclient: shutdown 2024-09-12T00:56:13.998 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:56:13.495+0000 7f04a8746800 10 monclient: build_initial_monmap 2024-09-12T00:56:13.998 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:56:13.495+0000 7f04a8746800 1 build_initial for_mkfs: 0 2024-09-12T00:56:13.998 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:56:13.495+0000 7f04a8746800 10 monclient: monmap: 2024-09-12T00:56:13.998 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:13.998 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:13.998 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:13.998 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:13.998 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:13.998 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:13.998 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:13.999 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:13.999 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:13.999 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:13.999 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding auth protocol: cephx 2024-09-12T00:56:13.999 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding auth protocol: cephx 2024-09-12T00:56:13.999 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding auth protocol: cephx 2024-09-12T00:56:13.999 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: secure 2024-09-12T00:56:13.999 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: crc 2024-09-12T00:56:13.999 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: secure 2024-09-12T00:56:13.999 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: crc 2024-09-12T00:56:13.999 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: secure 2024-09-12T00:56:13.999 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: crc 2024-09-12T00:56:13.999 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: crc 2024-09-12T00:56:13.999 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: secure 2024-09-12T00:56:14.000 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: crc 2024-09-12T00:56:14.000 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: secure 2024-09-12T00:56:14.000 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: crc 2024-09-12T00:56:14.000 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: secure 2024-09-12T00:56:14.000 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:56:13.495+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.000 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:56:13.495+0000 7f04a8746800 1 librados: starting msgr at 2024-09-12T00:56:14.000 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:56:13.495+0000 7f04a8746800 1 librados: starting objecter 2024-09-12T00:56:14.000 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 asok(0x55b859180630) register_command objecter_requests cmddesc objecter_requests hook 0x55b8593c8f70 EEXIST 2024-09-12T00:56:14.000 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:56:13.496+0000 7f04a8746800 1 librados: setting wanted keys 2024-09-12T00:56:14.000 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:56:13.496+0000 7f04a8746800 1 librados: calling monclient init 2024-09-12T00:56:14.000 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient: init 2024-09-12T00:56:14.000 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding auth protocol: cephx 2024-09-12T00:56:14.001 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding auth protocol: cephx 2024-09-12T00:56:14.001 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding auth protocol: cephx 2024-09-12T00:56:14.001 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: secure 2024-09-12T00:56:14.001 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: crc 2024-09-12T00:56:14.001 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: secure 2024-09-12T00:56:14.001 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: crc 2024-09-12T00:56:14.001 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: secure 2024-09-12T00:56:14.001 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: crc 2024-09-12T00:56:14.001 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: crc 2024-09-12T00:56:14.001 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: secure 2024-09-12T00:56:14.001 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: crc 2024-09-12T00:56:14.001 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: secure 2024-09-12T00:56:14.001 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: crc 2024-09-12T00:56:14.002 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: secure 2024-09-12T00:56:14.002 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:56:13.496+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.002 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:56:13.496+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.002 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 asok(0x55b859180630) register_command rotate-key cmddesc rotate-key hook 0x55b859434e78 EEXIST 2024-09-12T00:56:14.002 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:14.002 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:56:14.002 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-a con 0x55b859442340 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:14.002 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-b con 0x55b85946cc90 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:14.002 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-c con 0x55b8594713f0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:14.002 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:14.002 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:14.002 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:14.003 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:14.003 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): authenticate will time out at 2259.989586s 2024-09-12T00:56:14.003 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:56:13.496+0000 7f04a6237640 10 monclient(hunting): get_auth_request con 0x55b859442340 auth_method 0 2024-09-12T00:56:14.003 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:56:13.496+0000 7f04a6237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:14.003 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:56:13.496+0000 7f04a6237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:14.003 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:56:13.496+0000 7f04a6237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:14.003 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): get_auth_request con 0x55b8594713f0 auth_method 0 2024-09-12T00:56:14.003 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:14.003 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:14.003 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:14.003 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:56:13.496+0000 7f049da36640 10 monclient(hunting): get_auth_request con 0x55b85946cc90 auth_method 0 2024-09-12T00:56:14.004 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:56:13.496+0000 7f049da36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:14.004 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:56:13.496+0000 7f049da36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:14.004 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:56:13.496+0000 7f049da36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:14.004 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:56:13.496+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:14.004 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:56:13.496+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:14.004 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:56:13.496+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:14.004 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:14.004 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:14.004 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:14.004 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:56:13.496+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:14.004 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:56:13.496+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:14.004 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:56:13.496+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:14.004 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): handle_auth_done global_id 7850 payload 824 2024-09-12T00:56:14.005 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient: _finish_hunting 0 2024-09-12T00:56:14.005 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:56:13.496+0000 7f04a6a38640 1 monclient: found mon.noname-c 2024-09-12T00:56:14.005 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:56:14.005 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:14.005 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:56:14.005 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: dump: 2024-09-12T00:56:14.005 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:14.005 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:14.005 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.005 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.005 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:14.005 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:14.006 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:14.006 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:14.006 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:14.006 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.006 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: _finish_auth 0 2024-09-12T00:56:14.006 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: _check_auth_tickets 2024-09-12T00:56:14.006 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:14.006 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:14.006 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:56:14.006 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: dump: 2024-09-12T00:56:14.006 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:14.006 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:14.007 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.007 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.007 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:14.007 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:14.007 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:14.007 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:14.007 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:14.007 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.007 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:56:13.497+0000 7f04a8746800 5 monclient: authenticate success, global_id 7850 2024-09-12T00:56:14.007 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:56:13.497+0000 7f04a8746800 10 monclient: _renew_subs 2024-09-12T00:56:14.008 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:56:13.497+0000 7f0389ffb640 4 set_mon_vals no callback set 2024-09-12T00:56:14.008 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:56:13.497+0000 7f04a8746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:14.008 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:56:13.497+0000 7f04a8746800 10 monclient: _renew_subs 2024-09-12T00:56:14.008 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:56:13.497+0000 7f04a8746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:14.008 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:56:13.497+0000 7f04a8746800 1 librados: init done 2024-09-12T00:56:14.008 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:56:13.497+0000 7f04a8746800 5 asok(0x55b859180630) register_command cr dump hook 0x55b859469528 2024-09-12T00:56:14.008 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:56:13.499+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.008 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:56:13.499+0000 7f0377fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:14.008 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:56:13.499+0000 7f0377fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:14.009 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:56:13.499+0000 7f0377fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:14.009 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:56:13.499+0000 7f04a6237640 10 monclient: get_auth_request con 0x7f03700764a0 auth_method 0 2024-09-12T00:56:14.009 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:56:13.500+0000 7f049da36640 10 monclient: get_auth_request con 0x55b85948b7c0 auth_method 0 2024-09-12T00:56:14.009 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:56:13.500+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.009 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:56:13.500+0000 7f04a8746800 20 realm 2024-09-12T00:56:14.009 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:56:13.500+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.009 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:56:13.500+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.009 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:56:13.500+0000 7f04a8746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:14.009 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:56:13.501+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.009 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:56:13.501+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.009 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:56:13.501+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.009 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:56:13.501+0000 7f04a6237640 10 monclient: get_auth_request con 0x55b85948f9a0 auth_method 0 2024-09-12T00:56:14.010 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:56:13.502+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:14.010 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:56:13.502+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.010 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:56:13.502+0000 7f049da36640 10 monclient: get_auth_request con 0x55b859493200 auth_method 0 2024-09-12T00:56:14.010 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:56:13.502+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:14.010 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:56:13.502+0000 7f04a8746800 20 searching for the correct realm 2024-09-12T00:56:14.010 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:56:13.503+0000 7f04a6a38640 10 monclient: get_auth_request con 0x55b859497cb0 auth_method 0 2024-09-12T00:56:14.010 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:56:13.503+0000 7f04a6237640 0 -- 172.21.15.62:0/2929494308 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7f04a0029020 msgr2=0x7f04a0061690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:14.010 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:56:13.504+0000 7f04a6237640 10 monclient: get_auth_request con 0x7f04a0029020 auth_method 0 2024-09-12T00:56:14.010 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:56:13.705+0000 7f04a6237640 10 monclient: get_auth_request con 0x7f04a0029020 auth_method 0 2024-09-12T00:56:14.010 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:56:13.708+0000 7f049da36640 10 monclient: get_auth_request con 0x7f0494003cb0 auth_method 0 2024-09-12T00:56:14.010 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:56:13.710+0000 7f04a6a38640 10 monclient: get_auth_request con 0x7f04980a3960 auth_method 0 2024-09-12T00:56:14.010 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:56:13.711+0000 7f04a6a38640 0 -- 172.21.15.62:0/2929494308 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7f04980a3960 msgr2=0x7f0498097410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:14.010 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:56:13.912+0000 7f04a6a38640 10 monclient: get_auth_request con 0x7f04980a3960 auth_method 0 2024-09-12T00:56:14.011 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:56:13.912+0000 7f04a6237640 10 monclient: get_auth_request con 0x7f04a009f040 auth_method 0 2024-09-12T00:56:14.011 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:56:14.011 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:56:14.011 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:14.011 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:14.011 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:14.011 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:14.011 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:56:13.919+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.011 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:56:13.920+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.011 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:56:13.920+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.011 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:56:13.920+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:14.011 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:56:13.920+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.011 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:56:13.920+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:14.012 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:56:13.921+0000 7f04a8746800 20 zone default found 2024-09-12T00:56:14.012 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:56:13.921+0000 7f04a8746800 4 Realm: () 2024-09-12T00:56:14.012 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:56:13.921+0000 7f04a8746800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:56:14.012 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:56:13.921+0000 7f04a8746800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:56:14.012 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:56:13.921+0000 7f04a8746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:14.012 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:56:13.921+0000 7f04a8746800 20 zonegroup default 2024-09-12T00:56:14.012 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:56:13.921+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.012 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:56:13.921+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.012 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:56:13.921+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.012 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:56:13.921+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.012 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:56:13.921+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.013 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:56:13.922+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.013 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:56:13.922+0000 7f04a8746800 20 started sync module instance, tier type = 2024-09-12T00:56:14.013 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:56:13.922+0000 7f04a8746800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:56:14.013 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=0 2024-09-12T00:56:14.013 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=1 2024-09-12T00:56:14.013 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=2 2024-09-12T00:56:14.013 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=3 2024-09-12T00:56:14.013 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=4 2024-09-12T00:56:14.013 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=5 2024-09-12T00:56:14.013 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=6 2024-09-12T00:56:14.013 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:56:13.934+0000 7f04a8746800 20 add_watcher() i=7 2024-09-12T00:56:14.013 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:56:13.934+0000 7f04a8746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:14.013 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding auth protocol: cephx 2024-09-12T00:56:14.013 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding auth protocol: cephx 2024-09-12T00:56:14.014 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding auth protocol: cephx 2024-09-12T00:56:14.014 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: secure 2024-09-12T00:56:14.014 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: crc 2024-09-12T00:56:14.014 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: secure 2024-09-12T00:56:14.014 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: crc 2024-09-12T00:56:14.014 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: secure 2024-09-12T00:56:14.014 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: crc 2024-09-12T00:56:14.014 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: crc 2024-09-12T00:56:14.014 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: secure 2024-09-12T00:56:14.014 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: crc 2024-09-12T00:56:14.014 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: secure 2024-09-12T00:56:14.014 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: crc 2024-09-12T00:56:14.014 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: secure 2024-09-12T00:56:14.015 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:56:13.936+0000 7f035cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:14.015 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:56:13.937+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.015 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:56:13.937+0000 7f04a8746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:14.015 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:56:13.937+0000 7f04a8746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:14.015 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command cache list hook 0x55b859469830 2024-09-12T00:56:14.015 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command cache inspect hook 0x55b859469830 2024-09-12T00:56:14.015 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command cache erase hook 0x55b859469830 2024-09-12T00:56:14.015 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command cache zap hook 0x55b859469830 2024-09-12T00:56:14.015 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 note: GC not initialized 2024-09-12T00:56:14.015 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:56:13.937+0000 7f02d77fe640 20 reqs_thread_entry: start 2024-09-12T00:56:14.015 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command sync trace show hook 0x7f0498064070 2024-09-12T00:56:14.015 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command sync trace history hook 0x7f0498064070 2024-09-12T00:56:14.015 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command sync trace active hook 0x7f0498064070 2024-09-12T00:56:14.015 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command sync trace active_short hook 0x7f0498064070 2024-09-12T00:56:14.016 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:56:13.937+0000 7f04a8746800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:14.016 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:56:13.937+0000 7f04a8746800 20 Filter name: none 2024-09-12T00:56:14.016 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:56:13.937+0000 7f02d57fa640 20 reqs_thread_entry: start 2024-09-12T00:56:14.016 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:56:14.016 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:56:13.938+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.016 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:56:13.938+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:56:14.016 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:56:14.016 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:56:14.016 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:56:14.016 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:56:13.938+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.016 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:56:13.938+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:56:14.016 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:14.016 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:14.017 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:14.017 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:14.017 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:56:14.017 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:56:13.940+0000 7f04a8746800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:56:14.017 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:56:13.945+0000 7f04a8746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:14.017 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:56:13.945+0000 7f04a8746800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:14.017 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:56:13.945+0000 7f04a8746800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:14.017 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:56:13.945+0000 7f04a8746800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:56:14.017 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:56:13.945+0000 7f0389ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431689 cookie 94250260346368 notifier 7850 bl.length()=827 2024-09-12T00:56:14.017 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:56:13.945+0000 7f0389ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:14.017 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:56:13.945+0000 7f0389ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:14.017 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:56:13.945+0000 7f0389ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:14.017 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:56:13.947+0000 7f04a8746800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:56:14.018 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:56:13.947+0000 7f04a8746800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:56:14.018 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:56:13.947+0000 7f04a8746800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:56:14.018 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:56:13.947+0000 7f04a8746800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:56:14.018 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:56:13.951+0000 7f04a8746800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f04a8746800 time 2024-09-12T00:56:13.951422+0000 2024-09-12T00:56:14.018 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:56:14.018 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.018 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:14.018 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f04abd8c71a] 2024-09-12T00:56:14.018 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f04abd8c8d8] 2024-09-12T00:56:14.018 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b857729641] 2024-09-12T00:56:14.018 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd8854c) [0x55b857c3c54c] 2024-09-12T00:56:14.018 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85773931d] 2024-09-12T00:56:14.018 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:56:14.019 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f04aaa29590] 2024-09-12T00:56:14.019 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:56:14.019 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:56:14.019 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.019 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:56:13.952+0000 7f04a8746800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:56:14.019 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f04a8746800 thread_name:radosgw-admin 2024-09-12T00:56:14.019 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.019 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:14.019 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f04aaa3e6f0] 2024-09-12T00:56:14.019 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f04aaa8b99c] 2024-09-12T00:56:14.019 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:56:14.019 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:56:14.020 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f04abd8c774] 2024-09-12T00:56:14.020 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f04abd8c8d8] 2024-09-12T00:56:14.020 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b857729641] 2024-09-12T00:56:14.020 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd8854c) [0x55b857c3c54c] 2024-09-12T00:56:14.020 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85773931d] 2024-09-12T00:56:14.020 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:56:14.020 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f04aaa29590] 2024-09-12T00:56:14.020 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:56:14.020 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:56:14.020 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:56:14.020 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.020 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:56:14.021 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:56:14.021 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:56:14.021 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:56:14.021 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:56:14.021 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:56:14.021 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:56:14.021 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:56:14.021 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:56:14.021 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:56:14.021 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:56:14.021 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:56:14.021 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:56:14.021 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:56:14.022 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:56:14.022 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:56:14.022 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:56:14.022 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:56:14.022 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:56:14.022 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:56:14.022 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:56:14.022 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:56:14.022 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:56:14.022 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:56:14.022 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:56:14.022 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:56:14.022 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:56:14.023 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:56:14.023 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:56:14.023 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:56:14.023 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:56:14.023 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:56:14.023 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:56:14.023 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:56:14.023 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:56:14.023 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:56:14.023 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:56:14.023 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:56:14.023 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:56:14.023 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:56:14.024 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:56:14.024 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:56:14.024 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:56:14.024 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:56:14.024 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:56:14.024 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:56:14.024 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:56:14.024 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:56:14.024 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:56:14.024 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:56:14.024 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:56:14.024 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:56:14.024 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:56:14.024 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:56:14.025 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:56:14.025 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:56:14.025 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:56:14.025 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:56:14.025 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:56:14.025 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:56:14.025 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:56:14.025 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:56:14.025 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:56:14.025 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:56:14.025 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:56:14.025 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:56:14.025 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:56:14.026 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:56:14.026 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:56:14.026 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:56:14.026 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:56:14.026 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:56:14.026 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:56:14.026 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:56:14.026 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:56:14.026 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:56:14.026 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:56:14.026 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:56:14.026 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:56:14.026 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:56:14.027 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:56:14.027 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:56:14.027 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:56:14.027 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:56:14.027 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:56:14.027 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:56:14.027 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:56:14.027 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:56:14.027 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:56:14.027 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:56:14.027 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:56:14.027 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:56:14.027 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:56:14.028 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:56:14.028 INFO:tasks.workunit.client.0.smithi062.stderr: 7f02d57fa640 / http_manager 2024-09-12T00:56:14.028 INFO:tasks.workunit.client.0.smithi062.stderr: 7f02d77fe640 / http_manager 2024-09-12T00:56:14.028 INFO:tasks.workunit.client.0.smithi062.stderr: 7f035cfe1640 / rgw_dt_lg_renew 2024-09-12T00:56:14.028 INFO:tasks.workunit.client.0.smithi062.stderr: 7f0377fff640 / ms_dispatch 2024-09-12T00:56:14.028 INFO:tasks.workunit.client.0.smithi062.stderr: 7f0389ffb640 / io_context_pool 2024-09-12T00:56:14.028 INFO:tasks.workunit.client.0.smithi062.stderr: 7f038bfff640 / ms_dispatch 2024-09-12T00:56:14.028 INFO:tasks.workunit.client.0.smithi062.stderr: 7f0392e05640 / ms_dispatch 2024-09-12T00:56:14.028 INFO:tasks.workunit.client.0.smithi062.stderr: 7f0394608640 / io_context_pool 2024-09-12T00:56:14.028 INFO:tasks.workunit.client.0.smithi062.stderr: 7f049da36640 / msgr-worker-2 2024-09-12T00:56:14.028 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04a6237640 / msgr-worker-1 2024-09-12T00:56:14.028 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04a6a38640 / msgr-worker-0 2024-09-12T00:56:14.028 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04a7239640 / io_context_pool 2024-09-12T00:56:14.029 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04a8746800 / radosgw-admin 2024-09-12T00:56:14.029 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:56:14.029 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:56:14.029 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/log/ceph/ceph-client.admin.152274.log 2024-09-12T00:56:14.029 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:56:14.029 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:56:14.029 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:56:13.480+0000 7f04a8746800 10 monclient: build_initial_monmap 2024-09-12T00:56:14.029 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:56:13.480+0000 7f04a8746800 1 build_initial for_mkfs: 0 2024-09-12T00:56:14.029 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:56:13.480+0000 7f04a8746800 10 monclient: monmap: 2024-09-12T00:56:14.029 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:14.029 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:14.029 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:14.030 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:14.030 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:14.030 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:14.030 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:14.030 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:14.030 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:14.030 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.030 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding auth protocol: cephx 2024-09-12T00:56:14.030 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding auth protocol: cephx 2024-09-12T00:56:14.030 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding auth protocol: cephx 2024-09-12T00:56:14.030 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: secure 2024-09-12T00:56:14.030 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: crc 2024-09-12T00:56:14.030 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: secure 2024-09-12T00:56:14.030 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: crc 2024-09-12T00:56:14.031 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: secure 2024-09-12T00:56:14.031 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: crc 2024-09-12T00:56:14.031 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: crc 2024-09-12T00:56:14.031 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: secure 2024-09-12T00:56:14.031 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: crc 2024-09-12T00:56:14.031 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: secure 2024-09-12T00:56:14.031 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: crc 2024-09-12T00:56:14.031 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a6350) adding con mode: secure 2024-09-12T00:56:14.031 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:56:13.480+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.031 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:56:13.480+0000 7f04a8746800 1 librados: starting msgr at 2024-09-12T00:56:14.031 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:56:13.480+0000 7f04a8746800 1 librados: starting objecter 2024-09-12T00:56:14.031 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 asok(0x55b859180630) register_command objecter_requests hook 0x55b8593a8540 2024-09-12T00:56:14.031 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:56:13.480+0000 7f04a8746800 1 librados: setting wanted keys 2024-09-12T00:56:14.031 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:56:13.480+0000 7f04a8746800 1 librados: calling monclient init 2024-09-12T00:56:14.031 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:56:13.480+0000 7f04a8746800 10 monclient: init 2024-09-12T00:56:14.032 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding auth protocol: cephx 2024-09-12T00:56:14.032 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding auth protocol: cephx 2024-09-12T00:56:14.032 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding auth protocol: cephx 2024-09-12T00:56:14.032 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: secure 2024-09-12T00:56:14.032 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: crc 2024-09-12T00:56:14.032 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: secure 2024-09-12T00:56:14.032 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: crc 2024-09-12T00:56:14.032 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: secure 2024-09-12T00:56:14.032 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: crc 2024-09-12T00:56:14.032 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: crc 2024-09-12T00:56:14.032 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: secure 2024-09-12T00:56:14.032 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: crc 2024-09-12T00:56:14.032 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: secure 2024-09-12T00:56:14.033 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: crc 2024-09-12T00:56:14.033 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:56:13.480+0000 7f04a8746800 5 AuthRegistry(0x55b8593a06e0) adding con mode: secure 2024-09-12T00:56:14.033 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:56:13.480+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.033 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:56:13.481+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.033 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:56:13.481+0000 7f04a8746800 5 asok(0x55b859180630) register_command rotate-key hook 0x55b8593a0828 2024-09-12T00:56:14.033 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:14.033 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:56:14.033 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-a con 0x55b8593a7450 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:14.033 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-b con 0x55b8593ca410 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:14.033 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-c con 0x7f0494002340 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:14.033 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:14.033 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:14.033 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:14.034 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:14.034 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:56:13.481+0000 7f04a8746800 10 monclient(hunting): authenticate will time out at 2259.974332s 2024-09-12T00:56:14.034 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:56:13.481+0000 7f04a6237640 10 monclient(hunting): get_auth_request con 0x55b8593a7450 auth_method 0 2024-09-12T00:56:14.034 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:56:13.481+0000 7f04a6237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:14.034 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:56:13.481+0000 7f04a6237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:14.034 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:56:13.481+0000 7f04a6237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:14.034 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): get_auth_request con 0x7f0494002340 auth_method 0 2024-09-12T00:56:14.034 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:14.034 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:14.034 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:14.034 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:56:13.481+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:14.034 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:56:13.481+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:14.034 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:56:13.481+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:14.035 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:14.035 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:14.035 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:14.035 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:56:13.481+0000 7f049da36640 10 monclient(hunting): get_auth_request con 0x55b8593ca410 auth_method 0 2024-09-12T00:56:14.035 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:56:13.481+0000 7f049da36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:14.035 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:56:13.481+0000 7f049da36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:14.035 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:56:13.481+0000 7f049da36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:14.035 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:56:13.481+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:14.035 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:56:13.481+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:14.035 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:56:13.481+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:14.035 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient(hunting): handle_auth_done global_id 7841 payload 824 2024-09-12T00:56:14.035 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient: _finish_hunting 0 2024-09-12T00:56:14.035 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:56:13.481+0000 7f04a6a38640 1 monclient: found mon.noname-c 2024-09-12T00:56:14.035 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:56:13.481+0000 7f04a6a38640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:56:14.036 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:14.036 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:56:14.036 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: dump: 2024-09-12T00:56:14.036 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:14.036 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:14.036 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.036 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.036 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:14.036 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:14.036 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:14.036 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:14.036 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:14.036 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.037 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: _finish_auth 0 2024-09-12T00:56:14.037 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: _check_auth_tickets 2024-09-12T00:56:14.037 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:14.037 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:14.037 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:56:14.037 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:56:13.482+0000 7f0392e05640 10 monclient: dump: 2024-09-12T00:56:14.037 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:14.037 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:14.037 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.037 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.037 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:14.037 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:14.037 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:14.038 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:14.038 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:14.038 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.038 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:56:13.482+0000 7f04a8746800 5 monclient: authenticate success, global_id 7841 2024-09-12T00:56:14.038 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:56:13.482+0000 7f04a8746800 10 monclient: _renew_subs 2024-09-12T00:56:14.038 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:56:13.482+0000 7f04a8746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:14.038 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:56:13.482+0000 7f0394608640 4 set_mon_vals no callback set 2024-09-12T00:56:14.038 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:56:13.482+0000 7f04a8746800 10 monclient: _renew_subs 2024-09-12T00:56:14.038 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:56:13.482+0000 7f04a8746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:14.038 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:56:13.482+0000 7f04a8746800 1 librados: init done 2024-09-12T00:56:14.038 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:56:13.484+0000 7f0392e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:14.038 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:56:13.484+0000 7f0392e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:14.038 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:56:13.484+0000 7f0392e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:14.039 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:56:13.484+0000 7f04a6237640 10 monclient: get_auth_request con 0x7f038c0764a0 auth_method 0 2024-09-12T00:56:14.039 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:56:13.485+0000 7f049da36640 10 monclient: get_auth_request con 0x55b8593e3020 auth_method 0 2024-09-12T00:56:14.039 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:56:13.485+0000 7f04a6237640 10 monclient: get_auth_request con 0x55b8593ec750 auth_method 0 2024-09-12T00:56:14.039 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:56:13.486+0000 7f049da36640 10 monclient: get_auth_request con 0x55b8593f0bc0 auth_method 0 2024-09-12T00:56:14.039 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:56:13.488+0000 7f04a8746800 10 monclient: build_initial_monmap 2024-09-12T00:56:14.039 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:56:13.488+0000 7f04a8746800 1 build_initial for_mkfs: 0 2024-09-12T00:56:14.039 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:56:13.488+0000 7f04a8746800 10 monclient: monmap: 2024-09-12T00:56:14.039 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:14.039 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:14.039 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:14.039 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:14.039 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:14.039 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:14.040 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:14.040 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:14.040 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:14.040 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.040 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding auth protocol: cephx 2024-09-12T00:56:14.040 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding auth protocol: cephx 2024-09-12T00:56:14.040 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding auth protocol: cephx 2024-09-12T00:56:14.040 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: secure 2024-09-12T00:56:14.040 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: crc 2024-09-12T00:56:14.040 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: secure 2024-09-12T00:56:14.040 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: crc 2024-09-12T00:56:14.040 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: secure 2024-09-12T00:56:14.040 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: crc 2024-09-12T00:56:14.040 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: crc 2024-09-12T00:56:14.041 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: secure 2024-09-12T00:56:14.041 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: crc 2024-09-12T00:56:14.041 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: secure 2024-09-12T00:56:14.041 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: crc 2024-09-12T00:56:14.041 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f5950) adding con mode: secure 2024-09-12T00:56:14.041 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:56:13.488+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.041 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 asok(0x55b859180630) register_command objecter_requests cmddesc objecter_requests hook 0x55b8593f9290 EEXIST 2024-09-12T00:56:14.041 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:56:13.488+0000 7f04a8746800 10 monclient: init 2024-09-12T00:56:14.041 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding auth protocol: cephx 2024-09-12T00:56:14.041 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding auth protocol: cephx 2024-09-12T00:56:14.041 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding auth protocol: cephx 2024-09-12T00:56:14.041 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: secure 2024-09-12T00:56:14.041 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: crc 2024-09-12T00:56:14.041 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: secure 2024-09-12T00:56:14.042 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: crc 2024-09-12T00:56:14.042 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: secure 2024-09-12T00:56:14.042 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: crc 2024-09-12T00:56:14.042 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: crc 2024-09-12T00:56:14.042 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: secure 2024-09-12T00:56:14.042 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: crc 2024-09-12T00:56:14.042 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: secure 2024-09-12T00:56:14.042 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: crc 2024-09-12T00:56:14.042 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:56:13.488+0000 7f04a8746800 5 AuthRegistry(0x55b8593f4158) adding con mode: secure 2024-09-12T00:56:14.042 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:56:13.488+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.042 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:56:13.489+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.042 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:56:13.489+0000 7f04a8746800 5 asok(0x55b859180630) register_command rotate-key cmddesc rotate-key hook 0x55b8593f42a0 EEXIST 2024-09-12T00:56:14.042 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:14.043 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:56:14.043 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-b con 0x55b85941cf80 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:14.043 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-c con 0x55b85941f250 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:14.043 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-a con 0x55b85941b750 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:14.043 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:14.043 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:14.043 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:14.043 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:14.043 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:56:13.489+0000 7f04a8746800 10 monclient(hunting): authenticate will time out at 2259.982264s 2024-09-12T00:56:14.043 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): get_auth_request con 0x55b85941f250 auth_method 0 2024-09-12T00:56:14.043 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:14.043 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:14.043 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:14.044 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:56:13.489+0000 7f04a6a38640 10 monclient(hunting): get_auth_request con 0x55b85941b750 auth_method 0 2024-09-12T00:56:14.044 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:56:13.489+0000 7f04a6a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:14.044 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:56:13.489+0000 7f04a6a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:14.044 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:56:13.489+0000 7f04a6a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:14.044 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:14.044 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:14.044 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:14.044 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:56:13.489+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:14.044 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:56:13.489+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:14.044 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:56:13.489+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:14.044 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:56:13.489+0000 7f04a6237640 10 monclient(hunting): get_auth_request con 0x55b85941cf80 auth_method 0 2024-09-12T00:56:14.044 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:56:13.489+0000 7f04a6237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:14.044 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:56:13.489+0000 7f04a6237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:14.045 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:56:13.489+0000 7f04a6237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:14.045 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:56:13.489+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:14.045 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:56:13.489+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:14.045 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:56:13.489+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:14.045 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient(hunting): handle_auth_done global_id 7844 payload 824 2024-09-12T00:56:14.045 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient: _finish_hunting 0 2024-09-12T00:56:14.045 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:56:13.489+0000 7f049da36640 1 monclient: found mon.noname-c 2024-09-12T00:56:14.045 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:56:13.489+0000 7f049da36640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:56:14.045 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:14.045 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:56:14.045 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: dump: 2024-09-12T00:56:14.045 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:14.045 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:14.045 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.046 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.046 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:14.046 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:14.046 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:14.046 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:14.046 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:14.046 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.046 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: _finish_auth 0 2024-09-12T00:56:14.046 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: _check_auth_tickets 2024-09-12T00:56:14.046 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:14.046 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:14.046 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:56:14.046 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:56:13.490+0000 7f038bfff640 10 monclient: dump: 2024-09-12T00:56:14.047 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:14.047 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:14.047 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.047 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.047 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:14.047 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:14.047 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:14.047 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:14.047 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:14.047 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.047 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:56:13.490+0000 7f04a8746800 5 monclient: authenticate success, global_id 7844 2024-09-12T00:56:14.047 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:56:13.490+0000 7f04a8746800 10 monclient: _renew_subs 2024-09-12T00:56:14.047 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:56:13.490+0000 7f04a8746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:14.048 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:56:13.490+0000 7f04a7239640 4 set_mon_vals no callback set 2024-09-12T00:56:14.048 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:56:13.490+0000 7f04a8746800 10 monclient: _renew_subs 2024-09-12T00:56:14.048 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:56:13.490+0000 7f04a8746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:14.048 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:56:13.492+0000 7f038bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:14.048 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:56:13.492+0000 7f038bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:14.048 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:56:13.492+0000 7f038bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:14.048 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:56:13.492+0000 7f04a8746800 10 monclient: get_monmap_and_config 2024-09-12T00:56:14.048 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:56:13.492+0000 7f04a8746800 10 monclient: build_initial_monmap 2024-09-12T00:56:14.048 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:56:13.492+0000 7f04a8746800 1 build_initial for_mkfs: 0 2024-09-12T00:56:14.048 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:56:13.492+0000 7f04a8746800 10 monclient: monmap: 2024-09-12T00:56:14.048 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:14.048 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:14.048 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:14.049 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:14.049 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:14.049 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:14.049 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:14.049 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:14.049 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:14.049 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.049 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding auth protocol: cephx 2024-09-12T00:56:14.049 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding auth protocol: cephx 2024-09-12T00:56:14.049 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding auth protocol: cephx 2024-09-12T00:56:14.049 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: secure 2024-09-12T00:56:14.049 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: crc 2024-09-12T00:56:14.049 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: secure 2024-09-12T00:56:14.050 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: crc 2024-09-12T00:56:14.050 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: secure 2024-09-12T00:56:14.050 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: crc 2024-09-12T00:56:14.050 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: crc 2024-09-12T00:56:14.050 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: secure 2024-09-12T00:56:14.050 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: crc 2024-09-12T00:56:14.050 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: secure 2024-09-12T00:56:14.050 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: crc 2024-09-12T00:56:14.050 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:56:13.492+0000 7f04a8746800 5 AuthRegistry(0x55b85943cd50) adding con mode: secure 2024-09-12T00:56:14.050 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:56:13.492+0000 7f04a6237640 10 monclient: get_auth_request con 0x7f0380076380 auth_method 0 2024-09-12T00:56:14.050 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:56:13.492+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.050 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient: init 2024-09-12T00:56:14.050 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding auth protocol: cephx 2024-09-12T00:56:14.050 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding auth protocol: cephx 2024-09-12T00:56:14.051 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding auth protocol: cephx 2024-09-12T00:56:14.051 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: secure 2024-09-12T00:56:14.051 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: crc 2024-09-12T00:56:14.051 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: secure 2024-09-12T00:56:14.051 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: crc 2024-09-12T00:56:14.051 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: secure 2024-09-12T00:56:14.051 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: crc 2024-09-12T00:56:14.051 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: crc 2024-09-12T00:56:14.051 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: secure 2024-09-12T00:56:14.051 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: crc 2024-09-12T00:56:14.051 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: secure 2024-09-12T00:56:14.051 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: crc 2024-09-12T00:56:14.051 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 AuthRegistry(0x7ffe448378d0) adding con mode: secure 2024-09-12T00:56:14.052 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:56:13.493+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.052 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:56:13.493+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.052 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:56:13.493+0000 7f04a8746800 5 asok(0x55b859180630) register_command rotate-key cmddesc rotate-key hook 0x7ffe44837a18 EEXIST 2024-09-12T00:56:14.052 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:14.052 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:56:14.052 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-c con 0x55b8594713f0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:14.052 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-b con 0x55b859442340 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:14.052 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-a con 0x55b85946cc90 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:14.052 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:14.052 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:14.052 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:14.052 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:14.052 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:56:13.493+0000 7f04a8746800 10 monclient(hunting): authenticate will time out at 2259.986671s 2024-09-12T00:56:14.053 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:56:13.493+0000 7f04a6237640 10 monclient(hunting): get_auth_request con 0x55b8594713f0 auth_method 0 2024-09-12T00:56:14.053 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:56:13.493+0000 7f04a6237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:14.053 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:56:13.493+0000 7f04a6237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:14.053 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:56:13.493+0000 7f04a6237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:14.053 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:56:13.493+0000 7f04a6a38640 10 monclient(hunting): get_auth_request con 0x55b85946cc90 auth_method 0 2024-09-12T00:56:14.053 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:56:13.493+0000 7f04a6a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:14.053 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:56:13.493+0000 7f04a6a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:14.053 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:56:13.493+0000 7f04a6a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:14.053 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:56:13.493+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:14.053 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:56:13.493+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:14.053 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:56:13.493+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:14.053 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:56:13.493+0000 7f049da36640 10 monclient(hunting): get_auth_request con 0x55b859442340 auth_method 0 2024-09-12T00:56:14.053 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:56:13.493+0000 7f049da36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:14.054 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:56:13.493+0000 7f049da36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:14.054 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:56:13.493+0000 7f049da36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:14.054 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:56:13.493+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:14.054 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:56:13.493+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:14.054 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:56:13.493+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:14.054 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:56:13.494+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:14.054 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:56:13.494+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:14.054 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:56:13.494+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:14.054 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:56:13.494+0000 7f04a6237640 10 monclient(hunting): handle_auth_done global_id 7847 payload 274 2024-09-12T00:56:14.054 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:56:13.494+0000 7f04a6237640 10 monclient: _finish_hunting 0 2024-09-12T00:56:14.054 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:56:13.494+0000 7f04a6237640 1 monclient: found mon.noname-c 2024-09-12T00:56:14.054 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:56:13.494+0000 7f04a6237640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:56:14.054 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:14.054 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:56:14.055 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: dump: 2024-09-12T00:56:14.055 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:14.055 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:14.055 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.055 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.055 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:14.055 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:14.055 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:14.055 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:14.055 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:14.055 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.055 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: _finish_auth 0 2024-09-12T00:56:14.055 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:56:14.056 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:14.056 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:14.056 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:56:14.056 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:56:13.494+0000 7f0389ffb640 10 monclient: dump: 2024-09-12T00:56:14.056 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:14.056 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:14.056 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.056 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.056 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:14.056 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:14.056 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:14.056 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:14.056 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:14.057 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.057 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:56:13.494+0000 7f04a8746800 5 monclient: authenticate success, global_id 7847 2024-09-12T00:56:14.057 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:56:13.494+0000 7f04a8746800 10 monclient: get_monmap_and_config success 2024-09-12T00:56:14.057 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:56:13.494+0000 7f04a8746800 4 set_mon_vals no callback set 2024-09-12T00:56:14.057 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:56:13.495+0000 7f04a8746800 10 monclient: shutdown 2024-09-12T00:56:14.057 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:56:13.495+0000 7f04a8746800 10 monclient: build_initial_monmap 2024-09-12T00:56:14.057 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:56:13.495+0000 7f04a8746800 1 build_initial for_mkfs: 0 2024-09-12T00:56:14.057 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:56:13.495+0000 7f04a8746800 10 monclient: monmap: 2024-09-12T00:56:14.057 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:14.057 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:14.057 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:14.057 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:14.057 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:14.058 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:14.058 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:14.058 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:14.058 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:14.058 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.058 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding auth protocol: cephx 2024-09-12T00:56:14.058 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding auth protocol: cephx 2024-09-12T00:56:14.058 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding auth protocol: cephx 2024-09-12T00:56:14.058 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: secure 2024-09-12T00:56:14.058 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: crc 2024-09-12T00:56:14.058 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: secure 2024-09-12T00:56:14.058 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: crc 2024-09-12T00:56:14.058 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: secure 2024-09-12T00:56:14.059 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: crc 2024-09-12T00:56:14.059 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: crc 2024-09-12T00:56:14.059 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: secure 2024-09-12T00:56:14.059 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: crc 2024-09-12T00:56:14.059 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: secure 2024-09-12T00:56:14.059 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: crc 2024-09-12T00:56:14.059 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 AuthRegistry(0x55b8594638c0) adding con mode: secure 2024-09-12T00:56:14.059 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:56:13.495+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.059 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:56:13.495+0000 7f04a8746800 1 librados: starting msgr at 2024-09-12T00:56:14.059 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:56:13.495+0000 7f04a8746800 1 librados: starting objecter 2024-09-12T00:56:14.059 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:56:13.495+0000 7f04a8746800 5 asok(0x55b859180630) register_command objecter_requests cmddesc objecter_requests hook 0x55b8593c8f70 EEXIST 2024-09-12T00:56:14.059 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:56:13.496+0000 7f04a8746800 1 librados: setting wanted keys 2024-09-12T00:56:14.059 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:56:13.496+0000 7f04a8746800 1 librados: calling monclient init 2024-09-12T00:56:14.059 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient: init 2024-09-12T00:56:14.060 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding auth protocol: cephx 2024-09-12T00:56:14.060 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding auth protocol: cephx 2024-09-12T00:56:14.060 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding auth protocol: cephx 2024-09-12T00:56:14.060 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: secure 2024-09-12T00:56:14.060 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: crc 2024-09-12T00:56:14.060 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: secure 2024-09-12T00:56:14.060 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: crc 2024-09-12T00:56:14.060 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: secure 2024-09-12T00:56:14.060 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: crc 2024-09-12T00:56:14.060 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: crc 2024-09-12T00:56:14.060 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: secure 2024-09-12T00:56:14.060 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: crc 2024-09-12T00:56:14.060 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: secure 2024-09-12T00:56:14.061 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: crc 2024-09-12T00:56:14.061 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 AuthRegistry(0x55b859434d30) adding con mode: secure 2024-09-12T00:56:14.061 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:56:13.496+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.061 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:56:13.496+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.061 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:56:13.496+0000 7f04a8746800 5 asok(0x55b859180630) register_command rotate-key cmddesc rotate-key hook 0x55b859434e78 EEXIST 2024-09-12T00:56:14.061 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:14.061 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:56:14.061 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-a con 0x55b859442340 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:14.061 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-b con 0x55b85946cc90 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:14.061 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): picked mon.noname-c con 0x55b8594713f0 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:14.061 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:14.061 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:14.061 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:14.062 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:14.062 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:56:13.496+0000 7f04a8746800 10 monclient(hunting): authenticate will time out at 2259.989586s 2024-09-12T00:56:14.062 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:56:13.496+0000 7f04a6237640 10 monclient(hunting): get_auth_request con 0x55b859442340 auth_method 0 2024-09-12T00:56:14.062 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:56:13.496+0000 7f04a6237640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:14.062 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:56:13.496+0000 7f04a6237640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:14.062 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:56:13.496+0000 7f04a6237640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:14.062 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): get_auth_request con 0x55b8594713f0 auth_method 0 2024-09-12T00:56:14.062 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:14.062 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:14.062 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:14.062 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:56:13.496+0000 7f049da36640 10 monclient(hunting): get_auth_request con 0x55b85946cc90 auth_method 0 2024-09-12T00:56:14.062 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:56:13.496+0000 7f049da36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:14.062 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:56:13.496+0000 7f049da36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:14.063 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:56:13.496+0000 7f049da36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:14.063 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:56:13.496+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:14.063 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:56:13.496+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:14.063 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:56:13.496+0000 7f04a6237640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:14.063 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:14.063 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:14.063 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:14.063 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:56:13.496+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:14.063 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:56:13.496+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:14.063 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:56:13.496+0000 7f049da36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:14.063 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient(hunting): handle_auth_done global_id 7850 payload 824 2024-09-12T00:56:14.063 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient: _finish_hunting 0 2024-09-12T00:56:14.063 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:56:13.496+0000 7f04a6a38640 1 monclient: found mon.noname-c 2024-09-12T00:56:14.064 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:56:13.496+0000 7f04a6a38640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:56:14.064 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:14.064 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:56:14.064 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: dump: 2024-09-12T00:56:14.064 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:14.064 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:14.064 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.064 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.064 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:14.064 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:14.064 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:14.064 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:14.064 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:14.065 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.065 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: _finish_auth 0 2024-09-12T00:56:14.065 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: _check_auth_tickets 2024-09-12T00:56:14.065 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:14.065 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:14.065 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:56:14.065 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:56:13.497+0000 7f0377fff640 10 monclient: dump: 2024-09-12T00:56:14.065 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:14.065 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:14.065 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.065 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:14.065 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:14.066 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:14.066 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:14.066 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:14.066 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:14.066 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.066 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:56:13.497+0000 7f04a8746800 5 monclient: authenticate success, global_id 7850 2024-09-12T00:56:14.066 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:56:13.497+0000 7f04a8746800 10 monclient: _renew_subs 2024-09-12T00:56:14.066 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:56:13.497+0000 7f0389ffb640 4 set_mon_vals no callback set 2024-09-12T00:56:14.066 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:56:13.497+0000 7f04a8746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:14.066 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:56:13.497+0000 7f04a8746800 10 monclient: _renew_subs 2024-09-12T00:56:14.067 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:56:13.497+0000 7f04a8746800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:14.067 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:56:13.497+0000 7f04a8746800 1 librados: init done 2024-09-12T00:56:14.067 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:56:13.497+0000 7f04a8746800 5 asok(0x55b859180630) register_command cr dump hook 0x55b859469528 2024-09-12T00:56:14.067 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:56:13.499+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.067 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:56:13.499+0000 7f0377fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:14.067 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:56:13.499+0000 7f0377fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:14.067 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:56:13.499+0000 7f0377fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:14.067 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:56:13.499+0000 7f04a6237640 10 monclient: get_auth_request con 0x7f03700764a0 auth_method 0 2024-09-12T00:56:14.067 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:56:13.500+0000 7f049da36640 10 monclient: get_auth_request con 0x55b85948b7c0 auth_method 0 2024-09-12T00:56:14.067 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:56:13.500+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.067 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:56:13.500+0000 7f04a8746800 20 realm 2024-09-12T00:56:14.067 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:56:13.500+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.067 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:56:13.500+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.068 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:56:13.500+0000 7f04a8746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:14.068 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:56:13.501+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.068 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:56:13.501+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.068 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:56:13.501+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.068 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:56:13.501+0000 7f04a6237640 10 monclient: get_auth_request con 0x55b85948f9a0 auth_method 0 2024-09-12T00:56:14.068 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:56:13.502+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:14.068 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:56:13.502+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.068 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:56:13.502+0000 7f049da36640 10 monclient: get_auth_request con 0x55b859493200 auth_method 0 2024-09-12T00:56:14.068 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:56:13.502+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:14.068 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:56:13.502+0000 7f04a8746800 20 searching for the correct realm 2024-09-12T00:56:14.068 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:56:13.503+0000 7f04a6a38640 10 monclient: get_auth_request con 0x55b859497cb0 auth_method 0 2024-09-12T00:56:14.068 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:56:13.503+0000 7f04a6237640 0 -- 172.21.15.62:0/2929494308 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7f04a0029020 msgr2=0x7f04a0061690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:14.068 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:56:13.504+0000 7f04a6237640 10 monclient: get_auth_request con 0x7f04a0029020 auth_method 0 2024-09-12T00:56:14.068 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:56:13.705+0000 7f04a6237640 10 monclient: get_auth_request con 0x7f04a0029020 auth_method 0 2024-09-12T00:56:14.069 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:56:13.708+0000 7f049da36640 10 monclient: get_auth_request con 0x7f0494003cb0 auth_method 0 2024-09-12T00:56:14.069 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:56:13.710+0000 7f04a6a38640 10 monclient: get_auth_request con 0x7f04980a3960 auth_method 0 2024-09-12T00:56:14.069 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:56:13.711+0000 7f04a6a38640 0 -- 172.21.15.62:0/2929494308 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7f04980a3960 msgr2=0x7f0498097410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:14.069 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:56:13.912+0000 7f04a6a38640 10 monclient: get_auth_request con 0x7f04980a3960 auth_method 0 2024-09-12T00:56:14.069 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:56:13.912+0000 7f04a6237640 10 monclient: get_auth_request con 0x7f04a009f040 auth_method 0 2024-09-12T00:56:14.069 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:56:14.069 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:56:14.069 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:14.069 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:14.069 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:14.069 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:56:13.919+0000 7f04a8746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:14.069 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:56:13.919+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.070 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:56:13.920+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.070 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:56:13.920+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.070 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:56:13.920+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:14.070 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:56:13.920+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.070 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:56:13.920+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:14.070 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:56:13.921+0000 7f04a8746800 20 zone default found 2024-09-12T00:56:14.070 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:56:13.921+0000 7f04a8746800 4 Realm: () 2024-09-12T00:56:14.070 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:56:13.921+0000 7f04a8746800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:56:14.070 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:56:13.921+0000 7f04a8746800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:56:14.070 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:56:13.921+0000 7f04a8746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:14.070 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:56:13.921+0000 7f04a8746800 20 zonegroup default 2024-09-12T00:56:14.070 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:56:13.921+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.070 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:56:13.921+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.070 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:56:13.921+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.071 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:56:13.921+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.071 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:56:13.921+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.071 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:56:13.922+0000 7f04a8746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.071 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:56:13.922+0000 7f04a8746800 20 started sync module instance, tier type = 2024-09-12T00:56:14.071 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:56:13.922+0000 7f04a8746800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:56:14.071 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=0 2024-09-12T00:56:14.071 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=1 2024-09-12T00:56:14.071 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=2 2024-09-12T00:56:14.071 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=3 2024-09-12T00:56:14.071 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=4 2024-09-12T00:56:14.071 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=5 2024-09-12T00:56:14.071 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:56:13.933+0000 7f04a8746800 20 add_watcher() i=6 2024-09-12T00:56:14.071 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:56:13.934+0000 7f04a8746800 20 add_watcher() i=7 2024-09-12T00:56:14.072 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:56:13.934+0000 7f04a8746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:14.072 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding auth protocol: cephx 2024-09-12T00:56:14.072 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding auth protocol: cephx 2024-09-12T00:56:14.072 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding auth protocol: cephx 2024-09-12T00:56:14.072 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: secure 2024-09-12T00:56:14.072 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: crc 2024-09-12T00:56:14.072 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: secure 2024-09-12T00:56:14.072 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: crc 2024-09-12T00:56:14.072 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: secure 2024-09-12T00:56:14.072 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: crc 2024-09-12T00:56:14.072 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: crc 2024-09-12T00:56:14.072 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: secure 2024-09-12T00:56:14.072 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: crc 2024-09-12T00:56:14.073 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: secure 2024-09-12T00:56:14.073 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: crc 2024-09-12T00:56:14.073 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:56:13.936+0000 7f04a8746800 5 AuthRegistry(0x7ffe44837db0) adding con mode: secure 2024-09-12T00:56:14.073 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:56:13.936+0000 7f035cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:14.073 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:56:13.937+0000 7f04a8746800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:14.073 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:56:13.937+0000 7f04a8746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:14.073 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:56:13.937+0000 7f04a8746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:14.073 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command cache list hook 0x55b859469830 2024-09-12T00:56:14.073 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command cache inspect hook 0x55b859469830 2024-09-12T00:56:14.073 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command cache erase hook 0x55b859469830 2024-09-12T00:56:14.073 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command cache zap hook 0x55b859469830 2024-09-12T00:56:14.073 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 note: GC not initialized 2024-09-12T00:56:14.073 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:56:13.937+0000 7f02d77fe640 20 reqs_thread_entry: start 2024-09-12T00:56:14.074 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command sync trace show hook 0x7f0498064070 2024-09-12T00:56:14.074 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command sync trace history hook 0x7f0498064070 2024-09-12T00:56:14.074 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command sync trace active hook 0x7f0498064070 2024-09-12T00:56:14.074 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:56:13.937+0000 7f04a8746800 5 asok(0x55b859180630) register_command sync trace active_short hook 0x7f0498064070 2024-09-12T00:56:14.074 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:56:13.937+0000 7f04a8746800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:14.074 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:56:13.937+0000 7f04a8746800 20 Filter name: none 2024-09-12T00:56:14.074 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:56:13.937+0000 7f02d57fa640 20 reqs_thread_entry: start 2024-09-12T00:56:14.074 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:56:14.074 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:56:13.938+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.074 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:56:13.938+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:56:14.074 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:56:14.074 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:56:14.074 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:56:14.074 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:56:13.938+0000 7f04a8746800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.075 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:56:13.938+0000 7f04a8746800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:56:14.075 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:14.075 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:14.075 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:14.075 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:14.075 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:56:13.938+0000 7f04a8746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:56:14.075 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:56:13.940+0000 7f04a8746800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:56:14.075 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:56:13.945+0000 7f04a8746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:14.075 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:56:13.945+0000 7f04a8746800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:14.075 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:56:13.945+0000 7f04a8746800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:14.075 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:56:13.945+0000 7f04a8746800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:56:14.075 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:56:13.945+0000 7f0389ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431689 cookie 94250260346368 notifier 7850 bl.length()=827 2024-09-12T00:56:14.075 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:56:13.945+0000 7f0389ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:14.076 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:56:13.945+0000 7f0389ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:14.076 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:56:13.945+0000 7f0389ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:14.076 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:56:13.947+0000 7f04a8746800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:56:14.076 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:56:13.947+0000 7f04a8746800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:56:14.076 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:56:13.947+0000 7f04a8746800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:56:14.076 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:56:13.947+0000 7f04a8746800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:56:14.076 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:56:13.951+0000 7f04a8746800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f04a8746800 time 2024-09-12T00:56:13.951422+0000 2024-09-12T00:56:14.076 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:56:14.076 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.076 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:14.076 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f04abd8c71a] 2024-09-12T00:56:14.076 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f04abd8c8d8] 2024-09-12T00:56:14.076 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b857729641] 2024-09-12T00:56:14.077 INFO:tasks.workunit.client.0.smithi062.stderr: 4: radosgw-admin(+0xd8854c) [0x55b857c3c54c] 2024-09-12T00:56:14.077 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85773931d] 2024-09-12T00:56:14.077 INFO:tasks.workunit.client.0.smithi062.stderr: 6: main() 2024-09-12T00:56:14.077 INFO:tasks.workunit.client.0.smithi062.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f04aaa29590] 2024-09-12T00:56:14.077 INFO:tasks.workunit.client.0.smithi062.stderr: 8: __libc_start_main() 2024-09-12T00:56:14.077 INFO:tasks.workunit.client.0.smithi062.stderr: 9: _start() 2024-09-12T00:56:14.077 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.077 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:56:13.952+0000 7f04a8746800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:56:14.077 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f04a8746800 thread_name:radosgw-admin 2024-09-12T00:56:14.077 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.077 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:14.077 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f04aaa3e6f0] 2024-09-12T00:56:14.078 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f04aaa8b99c] 2024-09-12T00:56:14.078 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:56:14.078 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:56:14.078 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f04abd8c774] 2024-09-12T00:56:14.078 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f04abd8c8d8] 2024-09-12T00:56:14.078 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b857729641] 2024-09-12T00:56:14.078 INFO:tasks.workunit.client.0.smithi062.stderr: 8: radosgw-admin(+0xd8854c) [0x55b857c3c54c] 2024-09-12T00:56:14.078 INFO:tasks.workunit.client.0.smithi062.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b85773931d] 2024-09-12T00:56:14.078 INFO:tasks.workunit.client.0.smithi062.stderr: 10: main() 2024-09-12T00:56:14.078 INFO:tasks.workunit.client.0.smithi062.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f04aaa29590] 2024-09-12T00:56:14.078 INFO:tasks.workunit.client.0.smithi062.stderr: 12: __libc_start_main() 2024-09-12T00:56:14.078 INFO:tasks.workunit.client.0.smithi062.stderr: 13: _start() 2024-09-12T00:56:14.078 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:56:14.079 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:14.079 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:56:14.079 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:56:14.079 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:56:14.079 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:56:14.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:56:14.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:56:14.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:56:14.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:56:14.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:56:14.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:56:14.079 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:56:14.079 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:56:14.080 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:56:14.080 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:56:14.080 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:56:14.080 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:56:14.080 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:56:14.080 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:56:14.080 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:56:14.080 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:56:14.080 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:56:14.080 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:56:14.080 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:56:14.080 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:56:14.080 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:56:14.081 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:56:14.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:56:14.081 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:56:14.081 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:56:14.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:56:14.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:56:14.081 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:56:14.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:56:14.081 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:56:14.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:56:14.081 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:56:14.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:56:14.081 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:56:14.082 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:56:14.082 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:56:14.082 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:56:14.082 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:56:14.082 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:56:14.082 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:56:14.082 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:56:14.082 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:56:14.082 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:56:14.082 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:56:14.083 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:56:14.083 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:56:14.083 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:56:14.083 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:56:14.083 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:56:14.083 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:56:14.083 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:56:14.083 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:56:14.083 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:56:14.083 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:56:14.083 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:56:14.083 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:56:14.084 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:56:14.084 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:56:14.084 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:56:14.084 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:56:14.084 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:56:14.084 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:56:14.084 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:56:14.084 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:56:14.084 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:56:14.084 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:56:14.084 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:56:14.084 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:56:14.084 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:56:14.084 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:56:14.085 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:56:14.085 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:56:14.085 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:56:14.085 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:56:14.085 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:56:14.085 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:56:14.085 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:56:14.085 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:56:14.085 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:56:14.085 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:56:14.085 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:56:14.085 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:56:14.085 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:56:14.086 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:56:14.086 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:56:14.086 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:56:14.086 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:56:14.086 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:56:14.086 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:56:14.086 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:56:14.086 INFO:tasks.workunit.client.0.smithi062.stderr: 7f02d57fa640 / http_manager 2024-09-12T00:56:14.086 INFO:tasks.workunit.client.0.smithi062.stderr: 7f02d77fe640 / http_manager 2024-09-12T00:56:14.086 INFO:tasks.workunit.client.0.smithi062.stderr: 7f035cfe1640 / rgw_dt_lg_renew 2024-09-12T00:56:14.086 INFO:tasks.workunit.client.0.smithi062.stderr: 7f0377fff640 / ms_dispatch 2024-09-12T00:56:14.086 INFO:tasks.workunit.client.0.smithi062.stderr: 7f0389ffb640 / io_context_pool 2024-09-12T00:56:14.086 INFO:tasks.workunit.client.0.smithi062.stderr: 7f038bfff640 / ms_dispatch 2024-09-12T00:56:14.086 INFO:tasks.workunit.client.0.smithi062.stderr: 7f0392e05640 / ms_dispatch 2024-09-12T00:56:14.087 INFO:tasks.workunit.client.0.smithi062.stderr: 7f0394608640 / io_context_pool 2024-09-12T00:56:14.087 INFO:tasks.workunit.client.0.smithi062.stderr: 7f049da36640 / msgr-worker-2 2024-09-12T00:56:14.087 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04a6237640 / msgr-worker-1 2024-09-12T00:56:14.087 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04a6a38640 / msgr-worker-0 2024-09-12T00:56:14.087 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04a7239640 / io_context_pool 2024-09-12T00:56:14.087 INFO:tasks.workunit.client.0.smithi062.stderr: 7f04a8746800 / radosgw-admin 2024-09-12T00:56:14.087 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:56:14.087 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:56:14.087 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:56:13.953132Z_f6cc1d9e-a2fd-4e1f-9bbe-09c389516af2/log 2024-09-12T00:56:14.087 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:56:14.087 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:56:14.092 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:14.093 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:14.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.039+0000 7f0379a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.041+0000 7f0379a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.041+0000 7f0379a2f800 20 realm 2024-09-12T00:56:14.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.041+0000 7f0379a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.041+0000 7f0379a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.041+0000 7f0379a2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:14.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.041+0000 7f0379a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.041+0000 7f0379a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.041+0000 7f0379a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.042+0000 7f0379a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:14.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.042+0000 7f0379a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.043+0000 7f0379a2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:14.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.043+0000 7f0379a2f800 20 searching for the correct realm 2024-09-12T00:56:14.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.046+0000 7f0376d18640 0 -- 172.21.15.62:0/2044947790 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f0370014a60 msgr2=0x7f0370017410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:14.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.050+0000 7f0377d1a640 0 -- 172.21.15.62:0/2044947790 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x560310ac4360 msgr2=0x560310ac6820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:14.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.054+0000 7f0379a2f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:56:14.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.054+0000 7f0379a2f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:56:14.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.054+0000 7f0379a2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:14.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.054+0000 7f0379a2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:14.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.054+0000 7f0379a2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:14.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.054+0000 7f0379a2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:14.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.054+0000 7f0379a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.055+0000 7f0379a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.094 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.055+0000 7f0379a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.055+0000 7f0379a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:14.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.055+0000 7f0379a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.055+0000 7f0379a2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:14.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.055+0000 7f0379a2f800 20 zone default found 2024-09-12T00:56:14.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.055+0000 7f0379a2f800 4 Realm: () 2024-09-12T00:56:14.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.055+0000 7f0379a2f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:56:14.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.055+0000 7f0379a2f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:56:14.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.055+0000 7f0379a2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:14.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.055+0000 7f0379a2f800 20 zonegroup default 2024-09-12T00:56:14.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.055+0000 7f0379a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.056+0000 7f0379a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.056+0000 7f0379a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.056+0000 7f0379a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.056+0000 7f0379a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.056+0000 7f0379a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:14.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.056+0000 7f0379a2f800 20 started sync module instance, tier type = 2024-09-12T00:56:14.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.056+0000 7f0379a2f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:56:14.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.065+0000 7f0379a2f800 20 add_watcher() i=0 2024-09-12T00:56:14.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.065+0000 7f0379a2f800 20 add_watcher() i=1 2024-09-12T00:56:14.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.065+0000 7f0379a2f800 20 add_watcher() i=2 2024-09-12T00:56:14.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.065+0000 7f0379a2f800 20 add_watcher() i=3 2024-09-12T00:56:14.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.065+0000 7f0379a2f800 20 add_watcher() i=4 2024-09-12T00:56:14.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.065+0000 7f0379a2f800 20 add_watcher() i=5 2024-09-12T00:56:14.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.065+0000 7f0379a2f800 20 add_watcher() i=6 2024-09-12T00:56:14.096 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.067+0000 7f0379a2f800 20 add_watcher() i=7 2024-09-12T00:56:14.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.067+0000 7f0379a2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:14.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.068+0000 7f022dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:14.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.069+0000 7f0379a2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:14.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.069+0000 7f0379a2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:14.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.069+0000 7f0379a2f800 5 note: GC not initialized 2024-09-12T00:56:14.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.069+0000 7f022cfe1640 20 reqs_thread_entry: start 2024-09-12T00:56:14.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.069+0000 7f0379a2f800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:14.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.069+0000 7f0379a2f800 20 Filter name: none 2024-09-12T00:56:14.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.069+0000 7f01a67fc640 20 reqs_thread_entry: start 2024-09-12T00:56:14.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.070+0000 7f0379a2f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:56:14.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.070+0000 7f0379a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.070+0000 7f0379a2f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:56:14.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.070+0000 7f0379a2f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:56:14.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.070+0000 7f0379a2f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:56:14.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.070+0000 7f0379a2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:56:14.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.070+0000 7f0379a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:14.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.070+0000 7f0379a2f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:56:14.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.070+0000 7f0379a2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:14.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.071+0000 7f0379a2f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:14.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.071+0000 7f0379a2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:14.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.071+0000 7f0379a2f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:14.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.071+0000 7f0379a2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:56:14.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.071+0000 7f0379a2f800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:56:14.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.071+0000 7f0379a2f800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:56:14.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.071+0000 7f0379a2f800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:56:14.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.071+0000 7f0379a2f800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:56:14.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.071+0000 7f0379a2f800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:56:14.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.071+0000 7f0379a2f800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:56:14.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.072+0000 7f022dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:14.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.075+0000 7f0379a2f800 20 remove_watcher() i=0 2024-09-12T00:56:14.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.075+0000 7f0379a2f800 2 removed watcher, disabling cache 2024-09-12T00:56:14.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.076+0000 7f0379a2f800 20 remove_watcher() i=1 2024-09-12T00:56:14.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.077+0000 7f0379a2f800 20 remove_watcher() i=2 2024-09-12T00:56:14.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.078+0000 7f0379a2f800 20 remove_watcher() i=3 2024-09-12T00:56:14.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.079+0000 7f0379a2f800 20 remove_watcher() i=4 2024-09-12T00:56:14.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.080+0000 7f0379a2f800 20 remove_watcher() i=5 2024-09-12T00:56:14.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.082+0000 7f0379a2f800 20 remove_watcher() i=6 2024-09-12T00:56:14.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:14.083+0000 7f0379a2f800 20 remove_watcher() i=7 2024-09-12T00:56:14.099 INFO:tasks.workunit.client.0.smithi062.stderr: test: duplicated entries can be purged manually 2024-09-12T00:56:44.119 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:56:44.152 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:44.152 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:44.198 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.199+0000 7fe4c0526800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.201+0000 7fe4c0526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.201+0000 7fe4c0526800 20 realm 2024-09-12T00:56:44.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.201+0000 7fe4c0526800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.202+0000 7fe4c0526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.202+0000 7fe4c0526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:44.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.202+0000 7fe4c0526800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.202+0000 7fe4c0526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.201 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.202+0000 7fe4c0526800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.203+0000 7fe4c0526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:44.202 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.203+0000 7fe4c0526800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.204+0000 7fe4c0526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:44.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.204+0000 7fe4c0526800 20 searching for the correct realm 2024-09-12T00:56:44.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.207+0000 7fe4bb9d8640 0 -- 172.21.15.62:0/271732186 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fe4b40990e0 msgr2=0x7fe4b405f5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:44.413 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.414+0000 7fe4bc9da640 0 -- 172.21.15.62:0/271732186 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55f49766e160 msgr2=0x55f4976705c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:44.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.420+0000 7fe4c0526800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:56:44.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.420+0000 7fe4c0526800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:56:44.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.420+0000 7fe4c0526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:44.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.420+0000 7fe4c0526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:44.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.420+0000 7fe4c0526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:44.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.420+0000 7fe4c0526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:44.419 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.420+0000 7fe4c0526800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.420+0000 7fe4c0526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.420+0000 7fe4c0526800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.420+0000 7fe4c0526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:44.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.420+0000 7fe4c0526800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.420 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.421+0000 7fe4c0526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:44.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.421+0000 7fe4c0526800 20 zone default found 2024-09-12T00:56:44.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.421+0000 7fe4c0526800 4 Realm: () 2024-09-12T00:56:44.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.421+0000 7fe4c0526800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:56:44.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.421+0000 7fe4c0526800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:56:44.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.421+0000 7fe4c0526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:44.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.421+0000 7fe4c0526800 20 zonegroup default 2024-09-12T00:56:44.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.421+0000 7fe4c0526800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.421+0000 7fe4c0526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.421 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.421+0000 7fe4c0526800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.422+0000 7fe4c0526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.422+0000 7fe4c0526800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.422+0000 7fe4c0526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.422+0000 7fe4c0526800 20 started sync module instance, tier type = 2024-09-12T00:56:44.422 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.422+0000 7fe4c0526800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:56:44.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.433+0000 7fe4c0526800 20 add_watcher() i=0 2024-09-12T00:56:44.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.433+0000 7fe4c0526800 20 add_watcher() i=1 2024-09-12T00:56:44.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.433+0000 7fe4c0526800 20 add_watcher() i=2 2024-09-12T00:56:44.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.433+0000 7fe4c0526800 20 add_watcher() i=3 2024-09-12T00:56:44.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.433+0000 7fe4c0526800 20 add_watcher() i=4 2024-09-12T00:56:44.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.433+0000 7fe4c0526800 20 add_watcher() i=5 2024-09-12T00:56:44.432 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.433+0000 7fe4c0526800 20 add_watcher() i=6 2024-09-12T00:56:44.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.434+0000 7fe4c0526800 20 add_watcher() i=7 2024-09-12T00:56:44.433 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.434+0000 7fe4c0526800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:44.435 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.436+0000 7fe3727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:44.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.436+0000 7fe4c0526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:44.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.436+0000 7fe4c0526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:44.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.436+0000 7fe4c0526800 5 note: GC not initialized 2024-09-12T00:56:44.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.437+0000 7fe3717e2640 20 reqs_thread_entry: start 2024-09-12T00:56:44.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.437+0000 7fe4c0526800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:44.436 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.437+0000 7fe4c0526800 20 Filter name: none 2024-09-12T00:56:44.437 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.437+0000 7fe2e2ffd640 20 reqs_thread_entry: start 2024-09-12T00:56:44.437 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.437+0000 7fe4c0526800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.437 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.438+0000 7fe4c0526800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:56:44.437 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.438+0000 7fe4c0526800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.437 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.438+0000 7fe4c0526800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:56:44.437 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.438+0000 7fe4c0526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:44.437 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.438+0000 7fe4c0526800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.439+0000 7fe4c0526800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:56:44.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.439+0000 7fe4c0526800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.439+0000 7fe4c0526800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:56:44.438 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.439+0000 7fe4c0526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:44.439 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.441+0000 7fe3727e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:44.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.443+0000 7fe4c0526800 20 remove_watcher() i=0 2024-09-12T00:56:44.442 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.443+0000 7fe4c0526800 2 removed watcher, disabling cache 2024-09-12T00:56:44.443 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.444+0000 7fe4c0526800 20 remove_watcher() i=1 2024-09-12T00:56:44.444 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.446+0000 7fe4c0526800 20 remove_watcher() i=2 2024-09-12T00:56:44.446 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.447+0000 7fe4c0526800 20 remove_watcher() i=3 2024-09-12T00:56:44.447 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.448+0000 7fe4c0526800 20 remove_watcher() i=4 2024-09-12T00:56:44.448 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.449+0000 7fe4c0526800 20 remove_watcher() i=5 2024-09-12T00:56:44.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.450+0000 7fe4c0526800 20 remove_watcher() i=6 2024-09-12T00:56:44.450 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.451+0000 7fe4c0526800 20 remove_watcher() i=7 2024-09-12T00:56:44.464 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.464 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:56:44.464 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: a-bucket id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 num_objects: 11 size_kb: 1 num_shards: 3 2024-09-12T00:56:44.464 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.465 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:56:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:44.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.546+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.548+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.548+0000 7f2321415800 20 realm 2024-09-12T00:56:44.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.548+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.548+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.548+0000 7f2321415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:44.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.548+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.548+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.548+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.549+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:44.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.549+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.550+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:44.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.550+0000 7f2321415800 20 searching for the correct realm 2024-09-12T00:56:44.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.553+0000 7f231c391640 0 -- 172.21.15.62:0/1717188447 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f23140b1e10 msgr2=0x7f23140a7490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:44.758 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.759+0000 7f231c391640 0 -- 172.21.15.62:0/1717188447 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5595dfd48220 msgr2=0x5595dfd4a690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:44.762 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:56:44.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:56:44.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:44.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:44.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:44.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:44.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.763+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.763+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.763+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.764+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:44.763 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.764+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.764 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.764+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:44.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.764+0000 7f2321415800 20 zone default found 2024-09-12T00:56:44.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.764+0000 7f2321415800 4 Realm: () 2024-09-12T00:56:44.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.764+0000 7f2321415800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:56:44.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.764+0000 7f2321415800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:56:44.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.764+0000 7f2321415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:44.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.764+0000 7f2321415800 20 zonegroup default 2024-09-12T00:56:44.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.764+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.765 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.764+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.764+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.765+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.765+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.765+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.765+0000 7f2321415800 20 started sync module instance, tier type = 2024-09-12T00:56:44.766 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.765+0000 7f2321415800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:56:44.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=0 2024-09-12T00:56:44.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=1 2024-09-12T00:56:44.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=2 2024-09-12T00:56:44.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=3 2024-09-12T00:56:44.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=4 2024-09-12T00:56:44.774 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=5 2024-09-12T00:56:44.775 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=6 2024-09-12T00:56:44.775 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.776+0000 7f2321415800 20 add_watcher() i=7 2024-09-12T00:56:44.775 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.776+0000 7f2321415800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:44.777 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.778+0000 7f21d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:44.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.778+0000 7f2321415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:44.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.778+0000 7f2321415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:44.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.779+0000 7f2321415800 5 note: GC not initialized 2024-09-12T00:56:44.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.779+0000 7f21d1fe3640 20 reqs_thread_entry: start 2024-09-12T00:56:44.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.779+0000 7f2321415800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:44.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.779+0000 7f2321415800 20 Filter name: none 2024-09-12T00:56:44.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.779+0000 7f21437fe640 20 reqs_thread_entry: start 2024-09-12T00:56:44.778 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.779+0000 7f2321415800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:56:44.779 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.779+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.779+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:56:44.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.779+0000 7f2321415800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:56:44.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.779+0000 7f2321415800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:56:44.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.779+0000 7f2321415800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:56:44.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.779+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.780 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.780+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:56:44.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.780+0000 7f2321415800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:44.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.780+0000 7f2321415800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:44.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.780+0000 7f2321415800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:44.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.780+0000 7f2321415800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:44.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.780+0000 7f2321415800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:56:44.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.781+0000 7f2321415800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:56:44.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.786+0000 7f2321415800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:44.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.786+0000 7f2321415800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:44.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.786+0000 7f2321415800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:44.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.786+0000 7f2321415800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:56:44.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.786+0000 7f21f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431690 cookie 94102193798368 notifier 7901 bl.length()=827 2024-09-12T00:56:44.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.786+0000 7f21f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:44.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.786+0000 7f21f37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:44.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.786+0000 7f21f37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:44.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.788+0000 7f2321415800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:56:44.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.788+0000 7f2321415800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:56:44.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.788+0000 7f2321415800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:56:44.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.788+0000 7f2321415800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:56:44.789 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2321415800 time 2024-09-12T00:56:44.791855+0000 2024-09-12T00:56:44.790 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:56:44.790 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:44.790 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f232258c71a] 2024-09-12T00:56:44.790 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f232258c8d8] 2024-09-12T00:56:44.790 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595de2be641] 2024-09-12T00:56:44.790 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595de2ce38a] 2024-09-12T00:56:44.791 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:56:44.791 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f2321229590] 2024-09-12T00:56:44.791 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:56:44.791 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:56:44.791 INFO:tasks.workunit.client.0.smithi062.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:56:44.791 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f2321415800 thread_name:radosgw-admin 2024-09-12T00:56:44.791 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.791+0000 7f2321415800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2321415800 time 2024-09-12T00:56:44.791855+0000 2024-09-12T00:56:44.791 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:56:44.791 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.791 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:44.791 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f232258c71a] 2024-09-12T00:56:44.791 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f232258c8d8] 2024-09-12T00:56:44.792 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595de2be641] 2024-09-12T00:56:44.792 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595de2ce38a] 2024-09-12T00:56:44.792 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:56:44.792 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f2321229590] 2024-09-12T00:56:44.792 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:56:44.792 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:56:44.792 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.806 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:44.807 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f232123e6f0] 2024-09-12T00:56:44.807 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f232128b99c] 2024-09-12T00:56:44.807 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:56:44.807 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:56:44.807 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f232258c774] 2024-09-12T00:56:44.807 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f232258c8d8] 2024-09-12T00:56:44.807 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595de2be641] 2024-09-12T00:56:44.807 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595de2ce38a] 2024-09-12T00:56:44.807 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:56:44.808 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f2321229590] 2024-09-12T00:56:44.808 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:56:44.808 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:56:44.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.792+0000 7f2321415800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:56:44.808 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f2321415800 thread_name:radosgw-admin 2024-09-12T00:56:44.808 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.808 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:44.808 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f232123e6f0] 2024-09-12T00:56:44.808 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f232128b99c] 2024-09-12T00:56:44.808 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:56:44.808 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:56:44.808 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f232258c774] 2024-09-12T00:56:44.809 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f232258c8d8] 2024-09-12T00:56:44.809 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595de2be641] 2024-09-12T00:56:44.809 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595de2ce38a] 2024-09-12T00:56:44.809 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:56:44.809 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f2321229590] 2024-09-12T00:56:44.809 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:56:44.809 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:56:44.809 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:56:44.809 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.809 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:56:44.809 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:56:44.527+0000 7f220ae0d640 10 monclient: dump: 2024-09-12T00:56:44.809 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.809 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.810 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.810 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.810 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.810 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.810 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.810 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.810 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.810 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.810 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:56:44.527+0000 7f2321415800 5 monclient: authenticate success, global_id 8337 2024-09-12T00:56:44.810 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:56:44.527+0000 7f2321415800 10 monclient: get_monmap_and_config success 2024-09-12T00:56:44.810 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:56:44.527+0000 7f2321415800 4 set_mon_vals no callback set 2024-09-12T00:56:44.810 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:56:44.528+0000 7f2321415800 10 monclient: shutdown 2024-09-12T00:56:44.811 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:56:44.528+0000 7f2321415800 5 asok(0x5595dfa3d630) unregister_commands rotate-key 2024-09-12T00:56:44.811 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:56:44.528+0000 7f2321415800 10 monclient: build_initial_monmap 2024-09-12T00:56:44.811 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:56:44.528+0000 7f2321415800 1 build_initial for_mkfs: 0 2024-09-12T00:56:44.811 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:56:44.528+0000 7f2321415800 10 monclient: monmap: 2024-09-12T00:56:44.811 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:44.811 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:44.811 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:44.811 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:44.811 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:44.811 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.812 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:44.812 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:44.812 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:44.812 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.812 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding auth protocol: cephx 2024-09-12T00:56:44.812 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding auth protocol: cephx 2024-09-12T00:56:44.812 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding auth protocol: cephx 2024-09-12T00:56:44.812 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: secure 2024-09-12T00:56:44.812 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: crc 2024-09-12T00:56:44.812 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: secure 2024-09-12T00:56:44.812 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: crc 2024-09-12T00:56:44.812 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: secure 2024-09-12T00:56:44.812 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: crc 2024-09-12T00:56:44.813 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: crc 2024-09-12T00:56:44.813 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: secure 2024-09-12T00:56:44.813 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: crc 2024-09-12T00:56:44.813 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: secure 2024-09-12T00:56:44.813 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: crc 2024-09-12T00:56:44.813 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: secure 2024-09-12T00:56:44.813 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:56:44.528+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.813 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:56:44.528+0000 7f2321415800 1 librados: starting msgr at 2024-09-12T00:56:44.813 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:56:44.528+0000 7f2321415800 1 librados: starting objecter 2024-09-12T00:56:44.813 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:56:44.529+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command objecter_requests hook 0x5595dfc62bc0 2024-09-12T00:56:44.813 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:56:44.529+0000 7f2321415800 1 librados: setting wanted keys 2024-09-12T00:56:44.813 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:56:44.529+0000 7f2321415800 1 librados: calling monclient init 2024-09-12T00:56:44.813 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient: init 2024-09-12T00:56:44.814 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding auth protocol: cephx 2024-09-12T00:56:44.814 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding auth protocol: cephx 2024-09-12T00:56:44.814 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding auth protocol: cephx 2024-09-12T00:56:44.814 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: secure 2024-09-12T00:56:44.814 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: crc 2024-09-12T00:56:44.814 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: secure 2024-09-12T00:56:44.814 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: crc 2024-09-12T00:56:44.814 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: secure 2024-09-12T00:56:44.814 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: crc 2024-09-12T00:56:44.814 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: crc 2024-09-12T00:56:44.814 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: secure 2024-09-12T00:56:44.814 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: crc 2024-09-12T00:56:44.814 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: secure 2024-09-12T00:56:44.815 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: crc 2024-09-12T00:56:44.815 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: secure 2024-09-12T00:56:44.815 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:56:44.529+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.815 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:56:44.529+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.815 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:56:44.529+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command rotate-key hook 0x5595dfc5dd08 2024-09-12T00:56:44.815 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:44.815 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:56:44.815 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): picked mon.noname-a con 0x5595dfb128b0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:44.815 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): picked mon.noname-b con 0x5595dfb15b00 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:44.816 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): picked mon.noname-c con 0x5595dfc8fa90 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:44.816 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.816 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.816 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.816 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:44.816 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): authenticate will time out at 2291.022708s 2024-09-12T00:56:44.816 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:56:44.529+0000 7f231cb92640 10 monclient(hunting): get_auth_request con 0x5595dfb128b0 auth_method 0 2024-09-12T00:56:44.816 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:56:44.529+0000 7f231cb92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.816 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:56:44.529+0000 7f231cb92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.816 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:56:44.529+0000 7f231cb92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.816 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:56:44.529+0000 7f231d393640 10 monclient(hunting): get_auth_request con 0x5595dfc8fa90 auth_method 0 2024-09-12T00:56:44.816 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:56:44.529+0000 7f231d393640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.817 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:56:44.529+0000 7f231d393640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.817 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:56:44.529+0000 7f231d393640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.817 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:56:44.529+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.817 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:56:44.529+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.817 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:56:44.529+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.817 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:56:44.529+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.817 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:56:44.529+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.817 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:56:44.529+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.817 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:56:44.530+0000 7f231cb92640 10 monclient(hunting): handle_auth_done global_id 8340 payload 824 2024-09-12T00:56:44.817 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:56:44.530+0000 7f231cb92640 10 monclient: _finish_hunting 0 2024-09-12T00:56:44.817 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:56:44.530+0000 7f231cb92640 1 monclient: found mon.noname-a 2024-09-12T00:56:44.818 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:56:44.530+0000 7f231cb92640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:56:44.818 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:56:44.530+0000 7f231c391640 10 monclient: get_auth_request con 0x5595dfb15b00 auth_method 0 2024-09-12T00:56:44.818 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.818 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:56:44.818 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: dump: 2024-09-12T00:56:44.818 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.819 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.819 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.819 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.819 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.819 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.819 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.819 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.820 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.820 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.820 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: _finish_auth 0 2024-09-12T00:56:44.820 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: _check_auth_tickets 2024-09-12T00:56:44.820 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:56:44.530+0000 7f2321415800 5 monclient: authenticate success, global_id 8340 2024-09-12T00:56:44.820 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:56:44.530+0000 7f2321415800 10 monclient: _renew_subs 2024-09-12T00:56:44.820 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:56:44.530+0000 7f2321415800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:56:44.820 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:44.820 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.820 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:56:44.820 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: dump: 2024-09-12T00:56:44.820 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.821 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.821 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.821 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.821 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.821 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.821 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.821 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.821 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.822 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.822 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:56:44.530+0000 7f220ae0d640 4 set_mon_vals no callback set 2024-09-12T00:56:44.822 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:56:44.530+0000 7f2321415800 10 monclient: _renew_subs 2024-09-12T00:56:44.822 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:56:44.530+0000 7f2321415800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:56:44.822 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:56:44.530+0000 7f2321415800 1 librados: init done 2024-09-12T00:56:44.822 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:56:44.532+0000 7f220960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:44.822 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:56:44.532+0000 7f220960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:44.823 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:56:44.532+0000 7f220960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:44.823 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:56:44.532+0000 7f231c391640 10 monclient: get_auth_request con 0x7f2204076470 auth_method 0 2024-09-12T00:56:44.823 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:56:44.533+0000 7f231d393640 10 monclient: get_auth_request con 0x5595dfc899d0 auth_method 0 2024-09-12T00:56:44.823 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:56:44.533+0000 7f231cb92640 10 monclient: get_auth_request con 0x5595dfca9370 auth_method 0 2024-09-12T00:56:44.823 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:56:44.534+0000 7f231c391640 10 monclient: get_auth_request con 0x5595dfcad6d0 auth_method 0 2024-09-12T00:56:44.823 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:56:44.536+0000 7f2321415800 10 monclient: build_initial_monmap 2024-09-12T00:56:44.823 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:56:44.536+0000 7f2321415800 1 build_initial for_mkfs: 0 2024-09-12T00:56:44.823 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:56:44.536+0000 7f2321415800 10 monclient: monmap: 2024-09-12T00:56:44.823 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:44.823 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:44.824 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:44.824 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:44.824 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:44.824 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.824 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:44.824 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:44.824 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:44.824 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.824 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding auth protocol: cephx 2024-09-12T00:56:44.824 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding auth protocol: cephx 2024-09-12T00:56:44.824 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding auth protocol: cephx 2024-09-12T00:56:44.824 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: secure 2024-09-12T00:56:44.825 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: crc 2024-09-12T00:56:44.825 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: secure 2024-09-12T00:56:44.825 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: crc 2024-09-12T00:56:44.825 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: secure 2024-09-12T00:56:44.825 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: crc 2024-09-12T00:56:44.825 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: crc 2024-09-12T00:56:44.825 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: secure 2024-09-12T00:56:44.825 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: crc 2024-09-12T00:56:44.825 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: secure 2024-09-12T00:56:44.825 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: crc 2024-09-12T00:56:44.825 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: secure 2024-09-12T00:56:44.825 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:56:44.536+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.826 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:56:44.536+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command objecter_requests cmddesc objecter_requests hook 0x5595dfcb5f40 EEXIST 2024-09-12T00:56:44.826 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:56:44.536+0000 7f2321415800 10 monclient: init 2024-09-12T00:56:44.826 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding auth protocol: cephx 2024-09-12T00:56:44.826 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding auth protocol: cephx 2024-09-12T00:56:44.826 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding auth protocol: cephx 2024-09-12T00:56:44.826 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: secure 2024-09-12T00:56:44.826 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: crc 2024-09-12T00:56:44.826 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: secure 2024-09-12T00:56:44.826 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: crc 2024-09-12T00:56:44.827 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: secure 2024-09-12T00:56:44.827 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: crc 2024-09-12T00:56:44.827 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: crc 2024-09-12T00:56:44.827 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: secure 2024-09-12T00:56:44.827 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: crc 2024-09-12T00:56:44.827 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: secure 2024-09-12T00:56:44.827 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: crc 2024-09-12T00:56:44.828 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: secure 2024-09-12T00:56:44.828 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:56:44.536+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.828 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:56:44.537+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.828 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:56:44.537+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command rotate-key cmddesc rotate-key hook 0x5595dfcb0d40 EEXIST 2024-09-12T00:56:44.828 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:44.828 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:56:44.828 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): picked mon.noname-a con 0x5595dfcd9c30 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:44.828 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): picked mon.noname-c con 0x5595dfcdbf00 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:44.828 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): picked mon.noname-b con 0x5595dfcd8400 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:44.829 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.829 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.829 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.829 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:44.829 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): authenticate will time out at 2291.030260s 2024-09-12T00:56:44.829 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:56:44.537+0000 7f231c391640 10 monclient(hunting): get_auth_request con 0x5595dfcdbf00 auth_method 0 2024-09-12T00:56:44.829 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:56:44.537+0000 7f231c391640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.829 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:56:44.537+0000 7f231c391640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.829 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:56:44.537+0000 7f231c391640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.829 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): get_auth_request con 0x5595dfcd9c30 auth_method 0 2024-09-12T00:56:44.829 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.829 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.829 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.830 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:56:44.537+0000 7f231c391640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.830 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:56:44.537+0000 7f231c391640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.830 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:56:44.537+0000 7f231c391640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.830 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.830 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.830 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.830 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:56:44.537+0000 7f231d393640 10 monclient(hunting): get_auth_request con 0x5595dfcd8400 auth_method 0 2024-09-12T00:56:44.830 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:56:44.537+0000 7f231d393640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.830 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:56:44.537+0000 7f231d393640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.830 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:56:44.537+0000 7f231d393640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.830 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:56:44.537+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.830 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:56:44.537+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.830 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:56:44.537+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.831 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): handle_auth_done global_id 8343 payload 824 2024-09-12T00:56:44.831 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient: _finish_hunting 0 2024-09-12T00:56:44.831 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:56:44.537+0000 7f231cb92640 1 monclient: found mon.noname-a 2024-09-12T00:56:44.831 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:56:44.831 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:56:44.537+0000 7f22027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.831 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:56:44.831 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: dump: 2024-09-12T00:56:44.831 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.831 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.831 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.831 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.831 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.831 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.832 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.832 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.832 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.832 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.832 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: _finish_auth 0 2024-09-12T00:56:44.832 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: _check_auth_tickets 2024-09-12T00:56:44.832 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:56:44.538+0000 7f2321415800 5 monclient: authenticate success, global_id 8343 2024-09-12T00:56:44.832 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:56:44.538+0000 7f2321415800 10 monclient: _renew_subs 2024-09-12T00:56:44.832 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:56:44.538+0000 7f2321415800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:56:44.832 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:44.832 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.832 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:56:44.832 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: dump: 2024-09-12T00:56:44.833 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.833 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.833 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.833 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.833 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.833 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.833 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.833 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.833 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.833 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.833 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:56:44.538+0000 7f231db94640 4 set_mon_vals no callback set 2024-09-12T00:56:44.833 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:56:44.538+0000 7f2321415800 10 monclient: _renew_subs 2024-09-12T00:56:44.833 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:56:44.538+0000 7f2321415800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:56:44.834 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:56:44.539+0000 7f22027fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:44.834 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:56:44.539+0000 7f22027fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:44.834 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:56:44.539+0000 7f22027fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:44.834 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:56:44.540+0000 7f2321415800 10 monclient: get_monmap_and_config 2024-09-12T00:56:44.834 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:56:44.540+0000 7f2321415800 10 monclient: build_initial_monmap 2024-09-12T00:56:44.834 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:56:44.540+0000 7f2321415800 1 build_initial for_mkfs: 0 2024-09-12T00:56:44.834 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:56:44.540+0000 7f2321415800 10 monclient: monmap: 2024-09-12T00:56:44.834 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:44.834 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:44.834 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:44.834 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:44.834 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:44.834 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.834 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:44.835 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:44.835 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:44.835 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.835 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding auth protocol: cephx 2024-09-12T00:56:44.835 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding auth protocol: cephx 2024-09-12T00:56:44.835 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding auth protocol: cephx 2024-09-12T00:56:44.835 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: secure 2024-09-12T00:56:44.835 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: crc 2024-09-12T00:56:44.835 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: secure 2024-09-12T00:56:44.835 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: crc 2024-09-12T00:56:44.835 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: secure 2024-09-12T00:56:44.835 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: crc 2024-09-12T00:56:44.835 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: crc 2024-09-12T00:56:44.836 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: secure 2024-09-12T00:56:44.836 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: crc 2024-09-12T00:56:44.836 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: secure 2024-09-12T00:56:44.836 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: crc 2024-09-12T00:56:44.836 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: secure 2024-09-12T00:56:44.836 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:56:44.540+0000 7f231c391640 10 monclient: get_auth_request con 0x7f21f4076380 auth_method 0 2024-09-12T00:56:44.836 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:56:44.540+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.836 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:56:44.540+0000 7f2321415800 10 monclient: init 2024-09-12T00:56:44.836 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding auth protocol: cephx 2024-09-12T00:56:44.837 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding auth protocol: cephx 2024-09-12T00:56:44.837 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding auth protocol: cephx 2024-09-12T00:56:44.837 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: secure 2024-09-12T00:56:44.837 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: crc 2024-09-12T00:56:44.837 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: secure 2024-09-12T00:56:44.837 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: crc 2024-09-12T00:56:44.837 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: secure 2024-09-12T00:56:44.837 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: crc 2024-09-12T00:56:44.837 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: crc 2024-09-12T00:56:44.837 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: secure 2024-09-12T00:56:44.837 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: crc 2024-09-12T00:56:44.837 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: secure 2024-09-12T00:56:44.837 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: crc 2024-09-12T00:56:44.838 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: secure 2024-09-12T00:56:44.838 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:56:44.540+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.838 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:56:44.541+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.838 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:56:44.541+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command rotate-key cmddesc rotate-key hook 0x7ffdf9929f48 EEXIST 2024-09-12T00:56:44.838 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:44.838 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:56:44.838 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): picked mon.noname-a con 0x5595dfd2de40 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:44.838 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): picked mon.noname-b con 0x5595dfd1e790 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:44.838 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): picked mon.noname-c con 0x5595dfd29270 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:44.838 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.838 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.838 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.838 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:44.839 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): authenticate will time out at 2291.034132s 2024-09-12T00:56:44.839 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): get_auth_request con 0x5595dfd2de40 auth_method 0 2024-09-12T00:56:44.839 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.839 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.839 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.839 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:56:44.541+0000 7f231d393640 10 monclient(hunting): get_auth_request con 0x5595dfd29270 auth_method 0 2024-09-12T00:56:44.839 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:56:44.541+0000 7f231d393640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.839 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:56:44.541+0000 7f231d393640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.839 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:56:44.541+0000 7f231d393640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.839 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:56:44.541+0000 7f231c391640 10 monclient(hunting): get_auth_request con 0x5595dfd1e790 auth_method 0 2024-09-12T00:56:44.839 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:56:44.541+0000 7f231c391640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.839 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:56:44.541+0000 7f231c391640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.839 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:56:44.541+0000 7f231c391640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.840 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.840 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.840 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.840 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:56:44.541+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.840 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:56:44.541+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.840 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:56:44.541+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.840 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:56:44.541+0000 7f231c391640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.840 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:56:44.541+0000 7f231c391640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.840 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:56:44.541+0000 7f231c391640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.841 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): handle_auth_done global_id 8346 payload 274 2024-09-12T00:56:44.841 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient: _finish_hunting 0 2024-09-12T00:56:44.841 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:56:44.541+0000 7f231cb92640 1 monclient: found mon.noname-a 2024-09-12T00:56:44.841 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:56:44.841 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.841 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:56:44.842 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: dump: 2024-09-12T00:56:44.842 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.842 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.842 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.842 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.842 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.842 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.842 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.842 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.842 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.842 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.843 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: _finish_auth 0 2024-09-12T00:56:44.843 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: _check_auth_tickets 2024-09-12T00:56:44.843 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:44.843 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.843 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:56:44.843 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: dump: 2024-09-12T00:56:44.843 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.843 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.843 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.843 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.843 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.843 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.844 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.844 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.844 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.844 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.844 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:56:44.541+0000 7f2321415800 5 monclient: authenticate success, global_id 8346 2024-09-12T00:56:44.844 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient: get_monmap_and_config success 2024-09-12T00:56:44.844 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:56:44.541+0000 7f2321415800 4 set_mon_vals no callback set 2024-09-12T00:56:44.844 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:56:44.542+0000 7f2321415800 10 monclient: shutdown 2024-09-12T00:56:44.844 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:56:44.542+0000 7f2321415800 10 monclient: build_initial_monmap 2024-09-12T00:56:44.844 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:56:44.542+0000 7f2321415800 1 build_initial for_mkfs: 0 2024-09-12T00:56:44.844 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:56:44.542+0000 7f2321415800 10 monclient: monmap: 2024-09-12T00:56:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:44.845 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:44.846 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.846 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding auth protocol: cephx 2024-09-12T00:56:44.846 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding auth protocol: cephx 2024-09-12T00:56:44.846 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding auth protocol: cephx 2024-09-12T00:56:44.846 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: secure 2024-09-12T00:56:44.846 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: crc 2024-09-12T00:56:44.846 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: secure 2024-09-12T00:56:44.846 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: crc 2024-09-12T00:56:44.846 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: secure 2024-09-12T00:56:44.847 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: crc 2024-09-12T00:56:44.847 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: crc 2024-09-12T00:56:44.847 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: secure 2024-09-12T00:56:44.847 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: crc 2024-09-12T00:56:44.847 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: secure 2024-09-12T00:56:44.847 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: crc 2024-09-12T00:56:44.847 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: secure 2024-09-12T00:56:44.847 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:56:44.542+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.847 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:56:44.542+0000 7f2321415800 1 librados: starting msgr at 2024-09-12T00:56:44.847 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:56:44.542+0000 7f2321415800 1 librados: starting objecter 2024-09-12T00:56:44.848 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:56:44.542+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command objecter_requests cmddesc objecter_requests hook 0x5595dfcf9570 EEXIST 2024-09-12T00:56:44.848 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:56:44.542+0000 7f2321415800 1 librados: setting wanted keys 2024-09-12T00:56:44.848 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:56:44.542+0000 7f2321415800 1 librados: calling monclient init 2024-09-12T00:56:44.848 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:56:44.542+0000 7f2321415800 10 monclient: init 2024-09-12T00:56:44.848 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding auth protocol: cephx 2024-09-12T00:56:44.848 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding auth protocol: cephx 2024-09-12T00:56:44.848 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding auth protocol: cephx 2024-09-12T00:56:44.848 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: secure 2024-09-12T00:56:44.848 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: crc 2024-09-12T00:56:44.848 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: secure 2024-09-12T00:56:44.848 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: crc 2024-09-12T00:56:44.848 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: secure 2024-09-12T00:56:44.849 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: crc 2024-09-12T00:56:44.849 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: crc 2024-09-12T00:56:44.849 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: secure 2024-09-12T00:56:44.849 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: crc 2024-09-12T00:56:44.849 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: secure 2024-09-12T00:56:44.849 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: crc 2024-09-12T00:56:44.849 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: secure 2024-09-12T00:56:44.849 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:56:44.543+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.849 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:56:44.543+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.850 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:56:44.543+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command rotate-key cmddesc rotate-key hook 0x5595dfcf1b28 EEXIST 2024-09-12T00:56:44.850 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:44.850 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:56:44.850 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): picked mon.noname-b con 0x5595dfd1e790 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:44.850 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): picked mon.noname-a con 0x5595dfd29270 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:44.850 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): picked mon.noname-c con 0x5595dfd2de40 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:44.851 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.851 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.851 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.851 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:44.851 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): authenticate will time out at 2291.036489s 2024-09-12T00:56:44.851 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): get_auth_request con 0x5595dfd2de40 auth_method 0 2024-09-12T00:56:44.852 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.852 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.852 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.852 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:56:44.543+0000 7f231cb92640 10 monclient(hunting): get_auth_request con 0x5595dfd1e790 auth_method 0 2024-09-12T00:56:44.852 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:56:44.543+0000 7f231cb92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.852 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:56:44.543+0000 7f231cb92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.852 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:56:44.543+0000 7f231cb92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.853 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.853 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.853 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.853 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:56:44.543+0000 7f231c391640 10 monclient(hunting): get_auth_request con 0x5595dfd29270 auth_method 0 2024-09-12T00:56:44.853 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:56:44.543+0000 7f231c391640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.853 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:56:44.543+0000 7f231c391640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.853 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:56:44.543+0000 7f231c391640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.854 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:56:44.543+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.854 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:56:44.543+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.854 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:56:44.543+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.854 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): handle_auth_done global_id 7901 payload 824 2024-09-12T00:56:44.854 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient: _finish_hunting 0 2024-09-12T00:56:44.854 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:56:44.543+0000 7f231d393640 1 monclient: found mon.noname-c 2024-09-12T00:56:44.854 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:56:44.855 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.855 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:56:44.855 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: dump: 2024-09-12T00:56:44.855 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.855 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.855 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.856 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.856 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.856 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.856 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.856 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.856 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.856 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.857 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: _finish_auth 0 2024-09-12T00:56:44.857 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: _check_auth_tickets 2024-09-12T00:56:44.857 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:44.857 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.857 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:56:44.857 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: dump: 2024-09-12T00:56:44.858 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.858 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.858 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.858 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.858 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.858 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.858 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.858 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.858 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.859 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.859 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:56:44.544+0000 7f2321415800 5 monclient: authenticate success, global_id 7901 2024-09-12T00:56:44.859 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:56:44.544+0000 7f2321415800 10 monclient: _renew_subs 2024-09-12T00:56:44.859 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:56:44.544+0000 7f21f3fff640 4 set_mon_vals no callback set 2024-09-12T00:56:44.859 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:56:44.544+0000 7f2321415800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:44.859 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:56:44.544+0000 7f2321415800 10 monclient: _renew_subs 2024-09-12T00:56:44.859 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:56:44.544+0000 7f2321415800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:44.859 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:56:44.544+0000 7f2321415800 1 librados: init done 2024-09-12T00:56:44.859 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:56:44.544+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command cr dump hook 0x7f230c004a78 2024-09-12T00:56:44.859 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:56:44.546+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.859 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:56:44.546+0000 7f21f27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:44.859 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:56:44.546+0000 7f21f27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:44.860 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:56:44.546+0000 7f21f27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:44.860 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:56:44.547+0000 7f231cb92640 10 monclient: get_auth_request con 0x7f21e8076470 auth_method 0 2024-09-12T00:56:44.860 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:56:44.547+0000 7f231c391640 10 monclient: get_auth_request con 0x5595dfd48220 auth_method 0 2024-09-12T00:56:44.860 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:56:44.548+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.860 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:56:44.548+0000 7f2321415800 20 realm 2024-09-12T00:56:44.860 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:56:44.548+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.860 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:56:44.548+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.860 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:56:44.548+0000 7f2321415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:44.860 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:56:44.548+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.860 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:56:44.548+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.860 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:56:44.548+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.861 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:56:44.548+0000 7f231cb92640 10 monclient: get_auth_request con 0x5595dfd4c5b0 auth_method 0 2024-09-12T00:56:44.861 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:56:44.549+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:44.861 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:56:44.549+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.861 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:56:44.549+0000 7f231c391640 10 monclient: get_auth_request con 0x5595dfd4fcf0 auth_method 0 2024-09-12T00:56:44.861 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:56:44.550+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:44.861 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:56:44.550+0000 7f2321415800 20 searching for the correct realm 2024-09-12T00:56:44.861 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:56:44.550+0000 7f231d393640 10 monclient: get_auth_request con 0x5595dfd549c0 auth_method 0 2024-09-12T00:56:44.861 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:56:44.551+0000 7f231cb92640 10 monclient: get_auth_request con 0x7f23140a9320 auth_method 0 2024-09-12T00:56:44.862 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:56:44.553+0000 7f231c391640 10 monclient: get_auth_request con 0x7f23140b1e10 auth_method 0 2024-09-12T00:56:44.862 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:56:44.553+0000 7f231c391640 0 -- 172.21.15.62:0/1717188447 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f23140b1e10 msgr2=0x7f23140a7490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:44.862 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:56:44.755+0000 7f231c391640 10 monclient: get_auth_request con 0x7f23140b1e10 auth_method 0 2024-09-12T00:56:44.862 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:56:44.757+0000 7f231d393640 10 monclient: get_auth_request con 0x7f230c097070 auth_method 0 2024-09-12T00:56:44.862 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:56:44.758+0000 7f231cb92640 10 monclient: get_auth_request con 0x7f23140ad3c0 auth_method 0 2024-09-12T00:56:44.862 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:56:44.759+0000 7f231c391640 0 -- 172.21.15.62:0/1717188447 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5595dfd48220 msgr2=0x5595dfd4a690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:44.862 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:56:44.759+0000 7f21f27fc640 1 client.7901.objecter ms_handle_reset 0x5595dfd48220 session 0x5595dfd47ba0 osd.6 2024-09-12T00:56:44.862 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:56:44.759+0000 7f21f27fc640 10 monclient: _renew_subs 2024-09-12T00:56:44.863 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:56:44.759+0000 7f21f27fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:44.863 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:56:44.759+0000 7f231c391640 10 monclient: get_auth_request con 0x7f21e8086720 auth_method 0 2024-09-12T00:56:44.863 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:56:44.863 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:56:44.863 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:44.863 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:44.863 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:44.863 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:44.864 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:56:44.763+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.864 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:56:44.763+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.864 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:56:44.763+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.864 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:56:44.764+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:44.864 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:56:44.764+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.864 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:56:44.764+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:44.864 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:56:44.764+0000 7f2321415800 20 zone default found 2024-09-12T00:56:44.864 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:56:44.764+0000 7f2321415800 4 Realm: () 2024-09-12T00:56:44.865 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:56:44.764+0000 7f2321415800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:56:44.865 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:56:44.764+0000 7f2321415800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:56:44.865 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:56:44.764+0000 7f2321415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:44.865 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:56:44.764+0000 7f2321415800 20 zonegroup default 2024-09-12T00:56:44.865 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:56:44.764+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.865 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:56:44.764+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.865 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:56:44.764+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.865 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:56:44.765+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.866 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:56:44.765+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.866 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:56:44.765+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.866 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:56:44.765+0000 7f2321415800 20 started sync module instance, tier type = 2024-09-12T00:56:44.866 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:56:44.765+0000 7f2321415800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:56:44.866 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=0 2024-09-12T00:56:44.866 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=1 2024-09-12T00:56:44.866 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=2 2024-09-12T00:56:44.866 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=3 2024-09-12T00:56:44.867 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=4 2024-09-12T00:56:44.867 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=5 2024-09-12T00:56:44.867 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=6 2024-09-12T00:56:44.867 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:56:44.776+0000 7f2321415800 20 add_watcher() i=7 2024-09-12T00:56:44.867 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:56:44.776+0000 7f2321415800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:44.867 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding auth protocol: cephx 2024-09-12T00:56:44.867 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding auth protocol: cephx 2024-09-12T00:56:44.867 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding auth protocol: cephx 2024-09-12T00:56:44.868 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: secure 2024-09-12T00:56:44.868 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: crc 2024-09-12T00:56:44.868 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: secure 2024-09-12T00:56:44.868 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: crc 2024-09-12T00:56:44.868 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: secure 2024-09-12T00:56:44.868 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: crc 2024-09-12T00:56:44.868 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: crc 2024-09-12T00:56:44.868 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: secure 2024-09-12T00:56:44.868 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: crc 2024-09-12T00:56:44.869 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: secure 2024-09-12T00:56:44.869 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: crc 2024-09-12T00:56:44.869 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: secure 2024-09-12T00:56:44.869 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:56:44.778+0000 7f21d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:44.869 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:56:44.778+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.869 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:56:44.778+0000 7f2321415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:44.869 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:56:44.778+0000 7f2321415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:44.869 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:56:44.778+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command cache list hook 0x5595dfd22960 2024-09-12T00:56:44.870 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:56:44.779+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command cache inspect hook 0x5595dfd22960 2024-09-12T00:56:44.870 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:56:44.779+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command cache erase hook 0x5595dfd22960 2024-09-12T00:56:44.870 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:56:44.779+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command cache zap hook 0x5595dfd22960 2024-09-12T00:56:44.870 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:56:44.779+0000 7f2321415800 5 note: GC not initialized 2024-09-12T00:56:44.870 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:56:44.779+0000 7f21d1fe3640 20 reqs_thread_entry: start 2024-09-12T00:56:44.870 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:56:44.779+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command sync trace show hook 0x7f230c087070 2024-09-12T00:56:44.870 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:56:44.779+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command sync trace history hook 0x7f230c087070 2024-09-12T00:56:44.870 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:56:44.779+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command sync trace active hook 0x7f230c087070 2024-09-12T00:56:44.870 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:56:44.779+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command sync trace active_short hook 0x7f230c087070 2024-09-12T00:56:44.871 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:56:44.779+0000 7f2321415800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:44.871 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:56:44.779+0000 7f2321415800 20 Filter name: none 2024-09-12T00:56:44.871 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:56:44.779+0000 7f21437fe640 20 reqs_thread_entry: start 2024-09-12T00:56:44.871 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:56:44.779+0000 7f2321415800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:56:44.871 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:56:44.779+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.871 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:56:44.779+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:56:44.871 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:56:44.779+0000 7f2321415800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:56:44.871 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:56:44.779+0000 7f2321415800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:56:44.872 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:56:44.779+0000 7f2321415800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:56:44.872 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:56:44.779+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.872 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:56:44.780+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:56:44.872 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:56:44.780+0000 7f2321415800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:44.872 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:56:44.780+0000 7f2321415800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:44.872 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:56:44.780+0000 7f2321415800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:44.872 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:56:44.780+0000 7f2321415800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:44.873 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:56:44.780+0000 7f2321415800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:56:44.873 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:56:44.781+0000 7f2321415800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:56:44.873 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:56:44.786+0000 7f2321415800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:44.873 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:56:44.786+0000 7f2321415800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:44.873 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:56:44.786+0000 7f2321415800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:44.873 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:56:44.786+0000 7f2321415800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:56:44.873 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:56:44.786+0000 7f21f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431690 cookie 94102193798368 notifier 7901 bl.length()=827 2024-09-12T00:56:44.873 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:56:44.786+0000 7f21f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:44.874 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:56:44.786+0000 7f21f37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:44.874 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:56:44.786+0000 7f21f37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:44.874 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:56:44.788+0000 7f2321415800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:56:44.874 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:56:44.788+0000 7f2321415800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:56:44.874 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:56:44.788+0000 7f2321415800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:56:44.874 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:56:44.788+0000 7f2321415800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:56:44.874 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:56:44.791+0000 7f2321415800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2321415800 time 2024-09-12T00:56:44.791855+0000 2024-09-12T00:56:44.875 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:56:44.875 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.875 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:44.875 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f232258c71a] 2024-09-12T00:56:44.875 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f232258c8d8] 2024-09-12T00:56:44.876 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595de2be641] 2024-09-12T00:56:44.876 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595de2ce38a] 2024-09-12T00:56:44.876 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:56:44.876 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f2321229590] 2024-09-12T00:56:44.876 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:56:44.876 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:56:44.876 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.876 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:56:44.792+0000 7f2321415800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:56:44.876 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f2321415800 thread_name:radosgw-admin 2024-09-12T00:56:44.877 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.877 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:44.877 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f232123e6f0] 2024-09-12T00:56:44.877 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f232128b99c] 2024-09-12T00:56:44.877 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:56:44.877 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:56:44.877 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f232258c774] 2024-09-12T00:56:44.878 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f232258c8d8] 2024-09-12T00:56:44.878 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595de2be641] 2024-09-12T00:56:44.878 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595de2ce38a] 2024-09-12T00:56:44.878 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:56:44.878 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f2321229590] 2024-09-12T00:56:44.878 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:56:44.878 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:56:44.878 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:56:44.878 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.878 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:56:44.878 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:56:44.878 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:56:44.879 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:56:44.879 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:56:44.879 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:56:44.879 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:56:44.879 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:56:44.879 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:56:44.879 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:56:44.879 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:56:44.879 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:56:44.879 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:56:44.879 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:56:44.879 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:56:44.879 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:56:44.879 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:56:44.880 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:56:44.880 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:56:44.880 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:56:44.880 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:56:44.880 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:56:44.880 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:56:44.880 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:56:44.880 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:56:44.880 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:56:44.880 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:56:44.880 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:56:44.880 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:56:44.880 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:56:44.881 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:56:44.881 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:56:44.881 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:56:44.881 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:56:44.881 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:56:44.881 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:56:44.881 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:56:44.881 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:56:44.881 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:56:44.881 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:56:44.881 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:56:44.881 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:56:44.881 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:56:44.882 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:56:44.882 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:56:44.882 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:56:44.882 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:56:44.882 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:56:44.882 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:56:44.882 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:56:44.882 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:56:44.882 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:56:44.882 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:56:44.882 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:56:44.882 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:56:44.882 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:56:44.883 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:56:44.883 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:56:44.883 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:56:44.883 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:56:44.883 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:56:44.883 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:56:44.883 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:56:44.883 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:56:44.883 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:56:44.883 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:56:44.883 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:56:44.883 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:56:44.883 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:56:44.884 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:56:44.884 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:56:44.884 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:56:44.884 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:56:44.884 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:56:44.884 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:56:44.884 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:56:44.884 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:56:44.884 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:56:44.884 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:56:44.884 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:56:44.884 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:56:44.884 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:56:44.884 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:56:44.885 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:56:44.885 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:56:44.885 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:56:44.885 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:56:44.885 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:56:44.885 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:56:44.885 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:56:44.885 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:56:44.885 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:56:44.885 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:56:44.885 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:56:44.885 INFO:tasks.workunit.client.0.smithi062.stderr: 7f21437fe640 / http_manager 2024-09-12T00:56:44.885 INFO:tasks.workunit.client.0.smithi062.stderr: 7f21d1fe3640 / http_manager 2024-09-12T00:56:44.886 INFO:tasks.workunit.client.0.smithi062.stderr: 7f21d2fe5640 / rgw_dt_lg_renew 2024-09-12T00:56:44.886 INFO:tasks.workunit.client.0.smithi062.stderr: 7f21f27fc640 / ms_dispatch 2024-09-12T00:56:44.886 INFO:tasks.workunit.client.0.smithi062.stderr: 7f21f37fe640 / io_context_pool 2024-09-12T00:56:44.886 INFO:tasks.workunit.client.0.smithi062.stderr: 7f21f3fff640 / io_context_pool 2024-09-12T00:56:44.886 INFO:tasks.workunit.client.0.smithi062.stderr: 7f22027fc640 / ms_dispatch 2024-09-12T00:56:44.886 INFO:tasks.workunit.client.0.smithi062.stderr: 7f220960a640 / ms_dispatch 2024-09-12T00:56:44.886 INFO:tasks.workunit.client.0.smithi062.stderr: 7f220ae0d640 / io_context_pool 2024-09-12T00:56:44.886 INFO:tasks.workunit.client.0.smithi062.stderr: 7f231c391640 / msgr-worker-2 2024-09-12T00:56:44.886 INFO:tasks.workunit.client.0.smithi062.stderr: 7f231cb92640 / msgr-worker-1 2024-09-12T00:56:44.886 INFO:tasks.workunit.client.0.smithi062.stderr: 7f231d393640 / msgr-worker-0 2024-09-12T00:56:44.886 INFO:tasks.workunit.client.0.smithi062.stderr: 7f231db94640 / io_context_pool 2024-09-12T00:56:44.886 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2321415800 / radosgw-admin 2024-09-12T00:56:44.886 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:56:44.886 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:56:44.887 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/log/ceph/ceph-client.admin.154042.log 2024-09-12T00:56:44.887 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:56:44.887 INFO:tasks.workunit.client.0.smithi062.stderr:--- begin dump of recent events --- 2024-09-12T00:56:44.887 INFO:tasks.workunit.client.0.smithi062.stderr: -499> 2024-09-12T00:56:44.527+0000 7f220ae0d640 10 monclient: dump: 2024-09-12T00:56:44.887 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.887 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.887 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.887 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.887 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.887 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.887 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.887 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.887 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.888 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.888 INFO:tasks.workunit.client.0.smithi062.stderr: -498> 2024-09-12T00:56:44.527+0000 7f2321415800 5 monclient: authenticate success, global_id 8337 2024-09-12T00:56:44.888 INFO:tasks.workunit.client.0.smithi062.stderr: -497> 2024-09-12T00:56:44.527+0000 7f2321415800 10 monclient: get_monmap_and_config success 2024-09-12T00:56:44.888 INFO:tasks.workunit.client.0.smithi062.stderr: -496> 2024-09-12T00:56:44.527+0000 7f2321415800 4 set_mon_vals no callback set 2024-09-12T00:56:44.888 INFO:tasks.workunit.client.0.smithi062.stderr: -495> 2024-09-12T00:56:44.528+0000 7f2321415800 10 monclient: shutdown 2024-09-12T00:56:44.888 INFO:tasks.workunit.client.0.smithi062.stderr: -494> 2024-09-12T00:56:44.528+0000 7f2321415800 5 asok(0x5595dfa3d630) unregister_commands rotate-key 2024-09-12T00:56:44.888 INFO:tasks.workunit.client.0.smithi062.stderr: -493> 2024-09-12T00:56:44.528+0000 7f2321415800 10 monclient: build_initial_monmap 2024-09-12T00:56:44.888 INFO:tasks.workunit.client.0.smithi062.stderr: -492> 2024-09-12T00:56:44.528+0000 7f2321415800 1 build_initial for_mkfs: 0 2024-09-12T00:56:44.888 INFO:tasks.workunit.client.0.smithi062.stderr: -491> 2024-09-12T00:56:44.528+0000 7f2321415800 10 monclient: monmap: 2024-09-12T00:56:44.888 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:44.888 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:44.888 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:44.888 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:44.889 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:44.889 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.889 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:44.889 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:44.889 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:44.889 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.889 INFO:tasks.workunit.client.0.smithi062.stderr: -490> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding auth protocol: cephx 2024-09-12T00:56:44.889 INFO:tasks.workunit.client.0.smithi062.stderr: -489> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding auth protocol: cephx 2024-09-12T00:56:44.889 INFO:tasks.workunit.client.0.smithi062.stderr: -488> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding auth protocol: cephx 2024-09-12T00:56:44.889 INFO:tasks.workunit.client.0.smithi062.stderr: -487> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: secure 2024-09-12T00:56:44.889 INFO:tasks.workunit.client.0.smithi062.stderr: -486> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: crc 2024-09-12T00:56:44.889 INFO:tasks.workunit.client.0.smithi062.stderr: -485> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: secure 2024-09-12T00:56:44.889 INFO:tasks.workunit.client.0.smithi062.stderr: -484> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: crc 2024-09-12T00:56:44.889 INFO:tasks.workunit.client.0.smithi062.stderr: -483> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: secure 2024-09-12T00:56:44.890 INFO:tasks.workunit.client.0.smithi062.stderr: -482> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: crc 2024-09-12T00:56:44.890 INFO:tasks.workunit.client.0.smithi062.stderr: -481> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: crc 2024-09-12T00:56:44.890 INFO:tasks.workunit.client.0.smithi062.stderr: -480> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: secure 2024-09-12T00:56:44.890 INFO:tasks.workunit.client.0.smithi062.stderr: -479> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: crc 2024-09-12T00:56:44.890 INFO:tasks.workunit.client.0.smithi062.stderr: -478> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: secure 2024-09-12T00:56:44.890 INFO:tasks.workunit.client.0.smithi062.stderr: -477> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: crc 2024-09-12T00:56:44.890 INFO:tasks.workunit.client.0.smithi062.stderr: -476> 2024-09-12T00:56:44.528+0000 7f2321415800 5 AuthRegistry(0x5595dfc63670) adding con mode: secure 2024-09-12T00:56:44.890 INFO:tasks.workunit.client.0.smithi062.stderr: -475> 2024-09-12T00:56:44.528+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.890 INFO:tasks.workunit.client.0.smithi062.stderr: -474> 2024-09-12T00:56:44.528+0000 7f2321415800 1 librados: starting msgr at 2024-09-12T00:56:44.890 INFO:tasks.workunit.client.0.smithi062.stderr: -473> 2024-09-12T00:56:44.528+0000 7f2321415800 1 librados: starting objecter 2024-09-12T00:56:44.890 INFO:tasks.workunit.client.0.smithi062.stderr: -472> 2024-09-12T00:56:44.529+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command objecter_requests hook 0x5595dfc62bc0 2024-09-12T00:56:44.890 INFO:tasks.workunit.client.0.smithi062.stderr: -471> 2024-09-12T00:56:44.529+0000 7f2321415800 1 librados: setting wanted keys 2024-09-12T00:56:44.890 INFO:tasks.workunit.client.0.smithi062.stderr: -470> 2024-09-12T00:56:44.529+0000 7f2321415800 1 librados: calling monclient init 2024-09-12T00:56:44.891 INFO:tasks.workunit.client.0.smithi062.stderr: -469> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient: init 2024-09-12T00:56:44.891 INFO:tasks.workunit.client.0.smithi062.stderr: -468> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding auth protocol: cephx 2024-09-12T00:56:44.891 INFO:tasks.workunit.client.0.smithi062.stderr: -467> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding auth protocol: cephx 2024-09-12T00:56:44.891 INFO:tasks.workunit.client.0.smithi062.stderr: -466> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding auth protocol: cephx 2024-09-12T00:56:44.891 INFO:tasks.workunit.client.0.smithi062.stderr: -465> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: secure 2024-09-12T00:56:44.891 INFO:tasks.workunit.client.0.smithi062.stderr: -464> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: crc 2024-09-12T00:56:44.891 INFO:tasks.workunit.client.0.smithi062.stderr: -463> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: secure 2024-09-12T00:56:44.891 INFO:tasks.workunit.client.0.smithi062.stderr: -462> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: crc 2024-09-12T00:56:44.891 INFO:tasks.workunit.client.0.smithi062.stderr: -461> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: secure 2024-09-12T00:56:44.891 INFO:tasks.workunit.client.0.smithi062.stderr: -460> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: crc 2024-09-12T00:56:44.891 INFO:tasks.workunit.client.0.smithi062.stderr: -459> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: crc 2024-09-12T00:56:44.891 INFO:tasks.workunit.client.0.smithi062.stderr: -458> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: secure 2024-09-12T00:56:44.891 INFO:tasks.workunit.client.0.smithi062.stderr: -457> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: crc 2024-09-12T00:56:44.891 INFO:tasks.workunit.client.0.smithi062.stderr: -456> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: secure 2024-09-12T00:56:44.892 INFO:tasks.workunit.client.0.smithi062.stderr: -455> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: crc 2024-09-12T00:56:44.892 INFO:tasks.workunit.client.0.smithi062.stderr: -454> 2024-09-12T00:56:44.529+0000 7f2321415800 5 AuthRegistry(0x5595dfc5dbc0) adding con mode: secure 2024-09-12T00:56:44.892 INFO:tasks.workunit.client.0.smithi062.stderr: -453> 2024-09-12T00:56:44.529+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.892 INFO:tasks.workunit.client.0.smithi062.stderr: -452> 2024-09-12T00:56:44.529+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.892 INFO:tasks.workunit.client.0.smithi062.stderr: -451> 2024-09-12T00:56:44.529+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command rotate-key hook 0x5595dfc5dd08 2024-09-12T00:56:44.892 INFO:tasks.workunit.client.0.smithi062.stderr: -450> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:44.892 INFO:tasks.workunit.client.0.smithi062.stderr: -449> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:56:44.892 INFO:tasks.workunit.client.0.smithi062.stderr: -448> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): picked mon.noname-a con 0x5595dfb128b0 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:44.892 INFO:tasks.workunit.client.0.smithi062.stderr: -447> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): picked mon.noname-b con 0x5595dfb15b00 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:44.893 INFO:tasks.workunit.client.0.smithi062.stderr: -446> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): picked mon.noname-c con 0x5595dfc8fa90 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:44.893 INFO:tasks.workunit.client.0.smithi062.stderr: -445> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.893 INFO:tasks.workunit.client.0.smithi062.stderr: -444> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.893 INFO:tasks.workunit.client.0.smithi062.stderr: -443> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.893 INFO:tasks.workunit.client.0.smithi062.stderr: -442> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:44.893 INFO:tasks.workunit.client.0.smithi062.stderr: -441> 2024-09-12T00:56:44.529+0000 7f2321415800 10 monclient(hunting): authenticate will time out at 2291.022708s 2024-09-12T00:56:44.893 INFO:tasks.workunit.client.0.smithi062.stderr: -440> 2024-09-12T00:56:44.529+0000 7f231cb92640 10 monclient(hunting): get_auth_request con 0x5595dfb128b0 auth_method 0 2024-09-12T00:56:44.893 INFO:tasks.workunit.client.0.smithi062.stderr: -439> 2024-09-12T00:56:44.529+0000 7f231cb92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.893 INFO:tasks.workunit.client.0.smithi062.stderr: -438> 2024-09-12T00:56:44.529+0000 7f231cb92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.894 INFO:tasks.workunit.client.0.smithi062.stderr: -437> 2024-09-12T00:56:44.529+0000 7f231cb92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.894 INFO:tasks.workunit.client.0.smithi062.stderr: -436> 2024-09-12T00:56:44.529+0000 7f231d393640 10 monclient(hunting): get_auth_request con 0x5595dfc8fa90 auth_method 0 2024-09-12T00:56:44.894 INFO:tasks.workunit.client.0.smithi062.stderr: -435> 2024-09-12T00:56:44.529+0000 7f231d393640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.894 INFO:tasks.workunit.client.0.smithi062.stderr: -434> 2024-09-12T00:56:44.529+0000 7f231d393640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.894 INFO:tasks.workunit.client.0.smithi062.stderr: -433> 2024-09-12T00:56:44.529+0000 7f231d393640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.894 INFO:tasks.workunit.client.0.smithi062.stderr: -432> 2024-09-12T00:56:44.529+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.894 INFO:tasks.workunit.client.0.smithi062.stderr: -431> 2024-09-12T00:56:44.529+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.894 INFO:tasks.workunit.client.0.smithi062.stderr: -430> 2024-09-12T00:56:44.529+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.894 INFO:tasks.workunit.client.0.smithi062.stderr: -429> 2024-09-12T00:56:44.529+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.894 INFO:tasks.workunit.client.0.smithi062.stderr: -428> 2024-09-12T00:56:44.529+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.894 INFO:tasks.workunit.client.0.smithi062.stderr: -427> 2024-09-12T00:56:44.529+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.894 INFO:tasks.workunit.client.0.smithi062.stderr: -426> 2024-09-12T00:56:44.530+0000 7f231cb92640 10 monclient(hunting): handle_auth_done global_id 8340 payload 824 2024-09-12T00:56:44.894 INFO:tasks.workunit.client.0.smithi062.stderr: -425> 2024-09-12T00:56:44.530+0000 7f231cb92640 10 monclient: _finish_hunting 0 2024-09-12T00:56:44.895 INFO:tasks.workunit.client.0.smithi062.stderr: -424> 2024-09-12T00:56:44.530+0000 7f231cb92640 1 monclient: found mon.noname-a 2024-09-12T00:56:44.895 INFO:tasks.workunit.client.0.smithi062.stderr: -423> 2024-09-12T00:56:44.530+0000 7f231cb92640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:56:44.895 INFO:tasks.workunit.client.0.smithi062.stderr: -422> 2024-09-12T00:56:44.530+0000 7f231c391640 10 monclient: get_auth_request con 0x5595dfb15b00 auth_method 0 2024-09-12T00:56:44.895 INFO:tasks.workunit.client.0.smithi062.stderr: -421> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.895 INFO:tasks.workunit.client.0.smithi062.stderr: -420> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:56:44.895 INFO:tasks.workunit.client.0.smithi062.stderr: -419> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: dump: 2024-09-12T00:56:44.895 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.895 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.895 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.895 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.895 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.895 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.895 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.896 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.896 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.896 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.896 INFO:tasks.workunit.client.0.smithi062.stderr: -418> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: _finish_auth 0 2024-09-12T00:56:44.896 INFO:tasks.workunit.client.0.smithi062.stderr: -417> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: _check_auth_tickets 2024-09-12T00:56:44.896 INFO:tasks.workunit.client.0.smithi062.stderr: -416> 2024-09-12T00:56:44.530+0000 7f2321415800 5 monclient: authenticate success, global_id 8340 2024-09-12T00:56:44.896 INFO:tasks.workunit.client.0.smithi062.stderr: -415> 2024-09-12T00:56:44.530+0000 7f2321415800 10 monclient: _renew_subs 2024-09-12T00:56:44.896 INFO:tasks.workunit.client.0.smithi062.stderr: -414> 2024-09-12T00:56:44.530+0000 7f2321415800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:56:44.896 INFO:tasks.workunit.client.0.smithi062.stderr: -413> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:44.896 INFO:tasks.workunit.client.0.smithi062.stderr: -412> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.896 INFO:tasks.workunit.client.0.smithi062.stderr: -411> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:56:44.896 INFO:tasks.workunit.client.0.smithi062.stderr: -410> 2024-09-12T00:56:44.530+0000 7f220960a640 10 monclient: dump: 2024-09-12T00:56:44.896 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.897 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.897 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.897 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.897 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.897 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.897 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.897 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.897 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.897 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.897 INFO:tasks.workunit.client.0.smithi062.stderr: -409> 2024-09-12T00:56:44.530+0000 7f220ae0d640 4 set_mon_vals no callback set 2024-09-12T00:56:44.897 INFO:tasks.workunit.client.0.smithi062.stderr: -408> 2024-09-12T00:56:44.530+0000 7f2321415800 10 monclient: _renew_subs 2024-09-12T00:56:44.897 INFO:tasks.workunit.client.0.smithi062.stderr: -407> 2024-09-12T00:56:44.530+0000 7f2321415800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:56:44.897 INFO:tasks.workunit.client.0.smithi062.stderr: -406> 2024-09-12T00:56:44.530+0000 7f2321415800 1 librados: init done 2024-09-12T00:56:44.897 INFO:tasks.workunit.client.0.smithi062.stderr: -405> 2024-09-12T00:56:44.532+0000 7f220960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:44.898 INFO:tasks.workunit.client.0.smithi062.stderr: -404> 2024-09-12T00:56:44.532+0000 7f220960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:44.898 INFO:tasks.workunit.client.0.smithi062.stderr: -403> 2024-09-12T00:56:44.532+0000 7f220960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:44.898 INFO:tasks.workunit.client.0.smithi062.stderr: -402> 2024-09-12T00:56:44.532+0000 7f231c391640 10 monclient: get_auth_request con 0x7f2204076470 auth_method 0 2024-09-12T00:56:44.898 INFO:tasks.workunit.client.0.smithi062.stderr: -401> 2024-09-12T00:56:44.533+0000 7f231d393640 10 monclient: get_auth_request con 0x5595dfc899d0 auth_method 0 2024-09-12T00:56:44.898 INFO:tasks.workunit.client.0.smithi062.stderr: -400> 2024-09-12T00:56:44.533+0000 7f231cb92640 10 monclient: get_auth_request con 0x5595dfca9370 auth_method 0 2024-09-12T00:56:44.898 INFO:tasks.workunit.client.0.smithi062.stderr: -399> 2024-09-12T00:56:44.534+0000 7f231c391640 10 monclient: get_auth_request con 0x5595dfcad6d0 auth_method 0 2024-09-12T00:56:44.898 INFO:tasks.workunit.client.0.smithi062.stderr: -398> 2024-09-12T00:56:44.536+0000 7f2321415800 10 monclient: build_initial_monmap 2024-09-12T00:56:44.898 INFO:tasks.workunit.client.0.smithi062.stderr: -397> 2024-09-12T00:56:44.536+0000 7f2321415800 1 build_initial for_mkfs: 0 2024-09-12T00:56:44.898 INFO:tasks.workunit.client.0.smithi062.stderr: -396> 2024-09-12T00:56:44.536+0000 7f2321415800 10 monclient: monmap: 2024-09-12T00:56:44.898 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:44.898 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:44.898 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:44.898 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:44.899 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:44.899 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.899 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:44.899 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:44.899 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:44.899 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.899 INFO:tasks.workunit.client.0.smithi062.stderr: -395> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding auth protocol: cephx 2024-09-12T00:56:44.899 INFO:tasks.workunit.client.0.smithi062.stderr: -394> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding auth protocol: cephx 2024-09-12T00:56:44.899 INFO:tasks.workunit.client.0.smithi062.stderr: -393> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding auth protocol: cephx 2024-09-12T00:56:44.899 INFO:tasks.workunit.client.0.smithi062.stderr: -392> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: secure 2024-09-12T00:56:44.899 INFO:tasks.workunit.client.0.smithi062.stderr: -391> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: crc 2024-09-12T00:56:44.899 INFO:tasks.workunit.client.0.smithi062.stderr: -390> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: secure 2024-09-12T00:56:44.899 INFO:tasks.workunit.client.0.smithi062.stderr: -389> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: crc 2024-09-12T00:56:44.899 INFO:tasks.workunit.client.0.smithi062.stderr: -388> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: secure 2024-09-12T00:56:44.900 INFO:tasks.workunit.client.0.smithi062.stderr: -387> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: crc 2024-09-12T00:56:44.900 INFO:tasks.workunit.client.0.smithi062.stderr: -386> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: crc 2024-09-12T00:56:44.900 INFO:tasks.workunit.client.0.smithi062.stderr: -385> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: secure 2024-09-12T00:56:44.900 INFO:tasks.workunit.client.0.smithi062.stderr: -384> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: crc 2024-09-12T00:56:44.900 INFO:tasks.workunit.client.0.smithi062.stderr: -383> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: secure 2024-09-12T00:56:44.900 INFO:tasks.workunit.client.0.smithi062.stderr: -382> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: crc 2024-09-12T00:56:44.900 INFO:tasks.workunit.client.0.smithi062.stderr: -381> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb2570) adding con mode: secure 2024-09-12T00:56:44.900 INFO:tasks.workunit.client.0.smithi062.stderr: -380> 2024-09-12T00:56:44.536+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.900 INFO:tasks.workunit.client.0.smithi062.stderr: -379> 2024-09-12T00:56:44.536+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command objecter_requests cmddesc objecter_requests hook 0x5595dfcb5f40 EEXIST 2024-09-12T00:56:44.900 INFO:tasks.workunit.client.0.smithi062.stderr: -378> 2024-09-12T00:56:44.536+0000 7f2321415800 10 monclient: init 2024-09-12T00:56:44.900 INFO:tasks.workunit.client.0.smithi062.stderr: -377> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding auth protocol: cephx 2024-09-12T00:56:44.900 INFO:tasks.workunit.client.0.smithi062.stderr: -376> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding auth protocol: cephx 2024-09-12T00:56:44.900 INFO:tasks.workunit.client.0.smithi062.stderr: -375> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding auth protocol: cephx 2024-09-12T00:56:44.901 INFO:tasks.workunit.client.0.smithi062.stderr: -374> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: secure 2024-09-12T00:56:44.901 INFO:tasks.workunit.client.0.smithi062.stderr: -373> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: crc 2024-09-12T00:56:44.901 INFO:tasks.workunit.client.0.smithi062.stderr: -372> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: secure 2024-09-12T00:56:44.901 INFO:tasks.workunit.client.0.smithi062.stderr: -371> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: crc 2024-09-12T00:56:44.901 INFO:tasks.workunit.client.0.smithi062.stderr: -370> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: secure 2024-09-12T00:56:44.901 INFO:tasks.workunit.client.0.smithi062.stderr: -369> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: crc 2024-09-12T00:56:44.901 INFO:tasks.workunit.client.0.smithi062.stderr: -368> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: crc 2024-09-12T00:56:44.901 INFO:tasks.workunit.client.0.smithi062.stderr: -367> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: secure 2024-09-12T00:56:44.901 INFO:tasks.workunit.client.0.smithi062.stderr: -366> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: crc 2024-09-12T00:56:44.901 INFO:tasks.workunit.client.0.smithi062.stderr: -365> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: secure 2024-09-12T00:56:44.901 INFO:tasks.workunit.client.0.smithi062.stderr: -364> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: crc 2024-09-12T00:56:44.901 INFO:tasks.workunit.client.0.smithi062.stderr: -363> 2024-09-12T00:56:44.536+0000 7f2321415800 5 AuthRegistry(0x5595dfcb0bf8) adding con mode: secure 2024-09-12T00:56:44.901 INFO:tasks.workunit.client.0.smithi062.stderr: -362> 2024-09-12T00:56:44.536+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.902 INFO:tasks.workunit.client.0.smithi062.stderr: -361> 2024-09-12T00:56:44.537+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.902 INFO:tasks.workunit.client.0.smithi062.stderr: -360> 2024-09-12T00:56:44.537+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command rotate-key cmddesc rotate-key hook 0x5595dfcb0d40 EEXIST 2024-09-12T00:56:44.902 INFO:tasks.workunit.client.0.smithi062.stderr: -359> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:44.902 INFO:tasks.workunit.client.0.smithi062.stderr: -358> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:56:44.902 INFO:tasks.workunit.client.0.smithi062.stderr: -357> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): picked mon.noname-a con 0x5595dfcd9c30 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:44.902 INFO:tasks.workunit.client.0.smithi062.stderr: -356> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): picked mon.noname-c con 0x5595dfcdbf00 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:44.902 INFO:tasks.workunit.client.0.smithi062.stderr: -355> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): picked mon.noname-b con 0x5595dfcd8400 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:44.902 INFO:tasks.workunit.client.0.smithi062.stderr: -354> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.902 INFO:tasks.workunit.client.0.smithi062.stderr: -353> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.902 INFO:tasks.workunit.client.0.smithi062.stderr: -352> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.902 INFO:tasks.workunit.client.0.smithi062.stderr: -351> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:44.902 INFO:tasks.workunit.client.0.smithi062.stderr: -350> 2024-09-12T00:56:44.537+0000 7f2321415800 10 monclient(hunting): authenticate will time out at 2291.030260s 2024-09-12T00:56:44.902 INFO:tasks.workunit.client.0.smithi062.stderr: -349> 2024-09-12T00:56:44.537+0000 7f231c391640 10 monclient(hunting): get_auth_request con 0x5595dfcdbf00 auth_method 0 2024-09-12T00:56:44.903 INFO:tasks.workunit.client.0.smithi062.stderr: -348> 2024-09-12T00:56:44.537+0000 7f231c391640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.903 INFO:tasks.workunit.client.0.smithi062.stderr: -347> 2024-09-12T00:56:44.537+0000 7f231c391640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.903 INFO:tasks.workunit.client.0.smithi062.stderr: -346> 2024-09-12T00:56:44.537+0000 7f231c391640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.903 INFO:tasks.workunit.client.0.smithi062.stderr: -345> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): get_auth_request con 0x5595dfcd9c30 auth_method 0 2024-09-12T00:56:44.903 INFO:tasks.workunit.client.0.smithi062.stderr: -344> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.903 INFO:tasks.workunit.client.0.smithi062.stderr: -343> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.903 INFO:tasks.workunit.client.0.smithi062.stderr: -342> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.903 INFO:tasks.workunit.client.0.smithi062.stderr: -341> 2024-09-12T00:56:44.537+0000 7f231c391640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.903 INFO:tasks.workunit.client.0.smithi062.stderr: -340> 2024-09-12T00:56:44.537+0000 7f231c391640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.903 INFO:tasks.workunit.client.0.smithi062.stderr: -339> 2024-09-12T00:56:44.537+0000 7f231c391640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.903 INFO:tasks.workunit.client.0.smithi062.stderr: -338> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.903 INFO:tasks.workunit.client.0.smithi062.stderr: -337> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.903 INFO:tasks.workunit.client.0.smithi062.stderr: -336> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.903 INFO:tasks.workunit.client.0.smithi062.stderr: -335> 2024-09-12T00:56:44.537+0000 7f231d393640 10 monclient(hunting): get_auth_request con 0x5595dfcd8400 auth_method 0 2024-09-12T00:56:44.904 INFO:tasks.workunit.client.0.smithi062.stderr: -334> 2024-09-12T00:56:44.537+0000 7f231d393640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.904 INFO:tasks.workunit.client.0.smithi062.stderr: -333> 2024-09-12T00:56:44.537+0000 7f231d393640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.904 INFO:tasks.workunit.client.0.smithi062.stderr: -332> 2024-09-12T00:56:44.537+0000 7f231d393640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.904 INFO:tasks.workunit.client.0.smithi062.stderr: -331> 2024-09-12T00:56:44.537+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.904 INFO:tasks.workunit.client.0.smithi062.stderr: -330> 2024-09-12T00:56:44.537+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.904 INFO:tasks.workunit.client.0.smithi062.stderr: -329> 2024-09-12T00:56:44.537+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.904 INFO:tasks.workunit.client.0.smithi062.stderr: -328> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient(hunting): handle_auth_done global_id 8343 payload 824 2024-09-12T00:56:44.904 INFO:tasks.workunit.client.0.smithi062.stderr: -327> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient: _finish_hunting 0 2024-09-12T00:56:44.904 INFO:tasks.workunit.client.0.smithi062.stderr: -326> 2024-09-12T00:56:44.537+0000 7f231cb92640 1 monclient: found mon.noname-a 2024-09-12T00:56:44.904 INFO:tasks.workunit.client.0.smithi062.stderr: -325> 2024-09-12T00:56:44.537+0000 7f231cb92640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:56:44.904 INFO:tasks.workunit.client.0.smithi062.stderr: -324> 2024-09-12T00:56:44.537+0000 7f22027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.904 INFO:tasks.workunit.client.0.smithi062.stderr: -323> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:56:44.904 INFO:tasks.workunit.client.0.smithi062.stderr: -322> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: dump: 2024-09-12T00:56:44.905 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.905 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.905 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.905 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.905 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.905 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.905 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.905 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.905 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.905 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.905 INFO:tasks.workunit.client.0.smithi062.stderr: -321> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: _finish_auth 0 2024-09-12T00:56:44.906 INFO:tasks.workunit.client.0.smithi062.stderr: -320> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: _check_auth_tickets 2024-09-12T00:56:44.906 INFO:tasks.workunit.client.0.smithi062.stderr: -319> 2024-09-12T00:56:44.538+0000 7f2321415800 5 monclient: authenticate success, global_id 8343 2024-09-12T00:56:44.906 INFO:tasks.workunit.client.0.smithi062.stderr: -318> 2024-09-12T00:56:44.538+0000 7f2321415800 10 monclient: _renew_subs 2024-09-12T00:56:44.906 INFO:tasks.workunit.client.0.smithi062.stderr: -317> 2024-09-12T00:56:44.538+0000 7f2321415800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:56:44.906 INFO:tasks.workunit.client.0.smithi062.stderr: -316> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:44.906 INFO:tasks.workunit.client.0.smithi062.stderr: -315> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.906 INFO:tasks.workunit.client.0.smithi062.stderr: -314> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:56:44.906 INFO:tasks.workunit.client.0.smithi062.stderr: -313> 2024-09-12T00:56:44.538+0000 7f22027fc640 10 monclient: dump: 2024-09-12T00:56:44.906 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.906 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.906 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.906 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.907 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.907 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.907 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.907 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.907 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.907 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.907 INFO:tasks.workunit.client.0.smithi062.stderr: -312> 2024-09-12T00:56:44.538+0000 7f231db94640 4 set_mon_vals no callback set 2024-09-12T00:56:44.907 INFO:tasks.workunit.client.0.smithi062.stderr: -311> 2024-09-12T00:56:44.538+0000 7f2321415800 10 monclient: _renew_subs 2024-09-12T00:56:44.907 INFO:tasks.workunit.client.0.smithi062.stderr: -310> 2024-09-12T00:56:44.538+0000 7f2321415800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.62:3300/0 2024-09-12T00:56:44.907 INFO:tasks.workunit.client.0.smithi062.stderr: -309> 2024-09-12T00:56:44.539+0000 7f22027fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:44.907 INFO:tasks.workunit.client.0.smithi062.stderr: -308> 2024-09-12T00:56:44.539+0000 7f22027fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:44.907 INFO:tasks.workunit.client.0.smithi062.stderr: -307> 2024-09-12T00:56:44.539+0000 7f22027fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:44.907 INFO:tasks.workunit.client.0.smithi062.stderr: -306> 2024-09-12T00:56:44.540+0000 7f2321415800 10 monclient: get_monmap_and_config 2024-09-12T00:56:44.907 INFO:tasks.workunit.client.0.smithi062.stderr: -305> 2024-09-12T00:56:44.540+0000 7f2321415800 10 monclient: build_initial_monmap 2024-09-12T00:56:44.908 INFO:tasks.workunit.client.0.smithi062.stderr: -304> 2024-09-12T00:56:44.540+0000 7f2321415800 1 build_initial for_mkfs: 0 2024-09-12T00:56:44.908 INFO:tasks.workunit.client.0.smithi062.stderr: -303> 2024-09-12T00:56:44.540+0000 7f2321415800 10 monclient: monmap: 2024-09-12T00:56:44.908 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:44.908 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:44.908 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:44.908 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:44.908 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:44.908 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.908 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:44.908 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:44.908 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:44.908 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.909 INFO:tasks.workunit.client.0.smithi062.stderr: -302> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding auth protocol: cephx 2024-09-12T00:56:44.909 INFO:tasks.workunit.client.0.smithi062.stderr: -301> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding auth protocol: cephx 2024-09-12T00:56:44.909 INFO:tasks.workunit.client.0.smithi062.stderr: -300> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding auth protocol: cephx 2024-09-12T00:56:44.909 INFO:tasks.workunit.client.0.smithi062.stderr: -299> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: secure 2024-09-12T00:56:44.909 INFO:tasks.workunit.client.0.smithi062.stderr: -298> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: crc 2024-09-12T00:56:44.909 INFO:tasks.workunit.client.0.smithi062.stderr: -297> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: secure 2024-09-12T00:56:44.909 INFO:tasks.workunit.client.0.smithi062.stderr: -296> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: crc 2024-09-12T00:56:44.909 INFO:tasks.workunit.client.0.smithi062.stderr: -295> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: secure 2024-09-12T00:56:44.909 INFO:tasks.workunit.client.0.smithi062.stderr: -294> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: crc 2024-09-12T00:56:44.909 INFO:tasks.workunit.client.0.smithi062.stderr: -293> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: crc 2024-09-12T00:56:44.909 INFO:tasks.workunit.client.0.smithi062.stderr: -292> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: secure 2024-09-12T00:56:44.909 INFO:tasks.workunit.client.0.smithi062.stderr: -291> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: crc 2024-09-12T00:56:44.909 INFO:tasks.workunit.client.0.smithi062.stderr: -290> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: secure 2024-09-12T00:56:44.910 INFO:tasks.workunit.client.0.smithi062.stderr: -289> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: crc 2024-09-12T00:56:44.910 INFO:tasks.workunit.client.0.smithi062.stderr: -288> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x5595dfcf9880) adding con mode: secure 2024-09-12T00:56:44.910 INFO:tasks.workunit.client.0.smithi062.stderr: -287> 2024-09-12T00:56:44.540+0000 7f231c391640 10 monclient: get_auth_request con 0x7f21f4076380 auth_method 0 2024-09-12T00:56:44.910 INFO:tasks.workunit.client.0.smithi062.stderr: -286> 2024-09-12T00:56:44.540+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.910 INFO:tasks.workunit.client.0.smithi062.stderr: -285> 2024-09-12T00:56:44.540+0000 7f2321415800 10 monclient: init 2024-09-12T00:56:44.910 INFO:tasks.workunit.client.0.smithi062.stderr: -284> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding auth protocol: cephx 2024-09-12T00:56:44.910 INFO:tasks.workunit.client.0.smithi062.stderr: -283> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding auth protocol: cephx 2024-09-12T00:56:44.910 INFO:tasks.workunit.client.0.smithi062.stderr: -282> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding auth protocol: cephx 2024-09-12T00:56:44.910 INFO:tasks.workunit.client.0.smithi062.stderr: -281> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: secure 2024-09-12T00:56:44.910 INFO:tasks.workunit.client.0.smithi062.stderr: -280> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: crc 2024-09-12T00:56:44.910 INFO:tasks.workunit.client.0.smithi062.stderr: -279> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: secure 2024-09-12T00:56:44.910 INFO:tasks.workunit.client.0.smithi062.stderr: -278> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: crc 2024-09-12T00:56:44.910 INFO:tasks.workunit.client.0.smithi062.stderr: -277> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: secure 2024-09-12T00:56:44.910 INFO:tasks.workunit.client.0.smithi062.stderr: -276> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: crc 2024-09-12T00:56:44.911 INFO:tasks.workunit.client.0.smithi062.stderr: -275> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: crc 2024-09-12T00:56:44.911 INFO:tasks.workunit.client.0.smithi062.stderr: -274> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: secure 2024-09-12T00:56:44.911 INFO:tasks.workunit.client.0.smithi062.stderr: -273> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: crc 2024-09-12T00:56:44.911 INFO:tasks.workunit.client.0.smithi062.stderr: -272> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: secure 2024-09-12T00:56:44.911 INFO:tasks.workunit.client.0.smithi062.stderr: -271> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: crc 2024-09-12T00:56:44.911 INFO:tasks.workunit.client.0.smithi062.stderr: -270> 2024-09-12T00:56:44.540+0000 7f2321415800 5 AuthRegistry(0x7ffdf9929e00) adding con mode: secure 2024-09-12T00:56:44.911 INFO:tasks.workunit.client.0.smithi062.stderr: -269> 2024-09-12T00:56:44.540+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.911 INFO:tasks.workunit.client.0.smithi062.stderr: -268> 2024-09-12T00:56:44.541+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.911 INFO:tasks.workunit.client.0.smithi062.stderr: -267> 2024-09-12T00:56:44.541+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command rotate-key cmddesc rotate-key hook 0x7ffdf9929f48 EEXIST 2024-09-12T00:56:44.911 INFO:tasks.workunit.client.0.smithi062.stderr: -266> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:44.911 INFO:tasks.workunit.client.0.smithi062.stderr: -265> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:56:44.911 INFO:tasks.workunit.client.0.smithi062.stderr: -264> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): picked mon.noname-a con 0x5595dfd2de40 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:44.911 INFO:tasks.workunit.client.0.smithi062.stderr: -263> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): picked mon.noname-b con 0x5595dfd1e790 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:44.912 INFO:tasks.workunit.client.0.smithi062.stderr: -262> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): picked mon.noname-c con 0x5595dfd29270 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:44.912 INFO:tasks.workunit.client.0.smithi062.stderr: -261> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.912 INFO:tasks.workunit.client.0.smithi062.stderr: -260> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.912 INFO:tasks.workunit.client.0.smithi062.stderr: -259> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.912 INFO:tasks.workunit.client.0.smithi062.stderr: -258> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:44.912 INFO:tasks.workunit.client.0.smithi062.stderr: -257> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient(hunting): authenticate will time out at 2291.034132s 2024-09-12T00:56:44.912 INFO:tasks.workunit.client.0.smithi062.stderr: -256> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): get_auth_request con 0x5595dfd2de40 auth_method 0 2024-09-12T00:56:44.912 INFO:tasks.workunit.client.0.smithi062.stderr: -255> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.912 INFO:tasks.workunit.client.0.smithi062.stderr: -254> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.912 INFO:tasks.workunit.client.0.smithi062.stderr: -253> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.912 INFO:tasks.workunit.client.0.smithi062.stderr: -252> 2024-09-12T00:56:44.541+0000 7f231d393640 10 monclient(hunting): get_auth_request con 0x5595dfd29270 auth_method 0 2024-09-12T00:56:44.912 INFO:tasks.workunit.client.0.smithi062.stderr: -251> 2024-09-12T00:56:44.541+0000 7f231d393640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.912 INFO:tasks.workunit.client.0.smithi062.stderr: -250> 2024-09-12T00:56:44.541+0000 7f231d393640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.913 INFO:tasks.workunit.client.0.smithi062.stderr: -249> 2024-09-12T00:56:44.541+0000 7f231d393640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.913 INFO:tasks.workunit.client.0.smithi062.stderr: -248> 2024-09-12T00:56:44.541+0000 7f231c391640 10 monclient(hunting): get_auth_request con 0x5595dfd1e790 auth_method 0 2024-09-12T00:56:44.913 INFO:tasks.workunit.client.0.smithi062.stderr: -247> 2024-09-12T00:56:44.541+0000 7f231c391640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.913 INFO:tasks.workunit.client.0.smithi062.stderr: -246> 2024-09-12T00:56:44.541+0000 7f231c391640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.913 INFO:tasks.workunit.client.0.smithi062.stderr: -245> 2024-09-12T00:56:44.541+0000 7f231c391640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.913 INFO:tasks.workunit.client.0.smithi062.stderr: -244> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.913 INFO:tasks.workunit.client.0.smithi062.stderr: -243> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.913 INFO:tasks.workunit.client.0.smithi062.stderr: -242> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.913 INFO:tasks.workunit.client.0.smithi062.stderr: -241> 2024-09-12T00:56:44.541+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.913 INFO:tasks.workunit.client.0.smithi062.stderr: -240> 2024-09-12T00:56:44.541+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.913 INFO:tasks.workunit.client.0.smithi062.stderr: -239> 2024-09-12T00:56:44.541+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.913 INFO:tasks.workunit.client.0.smithi062.stderr: -238> 2024-09-12T00:56:44.541+0000 7f231c391640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.913 INFO:tasks.workunit.client.0.smithi062.stderr: -237> 2024-09-12T00:56:44.541+0000 7f231c391640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.914 INFO:tasks.workunit.client.0.smithi062.stderr: -236> 2024-09-12T00:56:44.541+0000 7f231c391640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.914 INFO:tasks.workunit.client.0.smithi062.stderr: -235> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient(hunting): handle_auth_done global_id 8346 payload 274 2024-09-12T00:56:44.914 INFO:tasks.workunit.client.0.smithi062.stderr: -234> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient: _finish_hunting 0 2024-09-12T00:56:44.914 INFO:tasks.workunit.client.0.smithi062.stderr: -233> 2024-09-12T00:56:44.541+0000 7f231cb92640 1 monclient: found mon.noname-a 2024-09-12T00:56:44.914 INFO:tasks.workunit.client.0.smithi062.stderr: -232> 2024-09-12T00:56:44.541+0000 7f231cb92640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.62:3300/0 2024-09-12T00:56:44.914 INFO:tasks.workunit.client.0.smithi062.stderr: -231> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.914 INFO:tasks.workunit.client.0.smithi062.stderr: -230> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:56:44.914 INFO:tasks.workunit.client.0.smithi062.stderr: -229> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: dump: 2024-09-12T00:56:44.914 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.914 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.914 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.914 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.914 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.915 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.915 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.915 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.915 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.915 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.915 INFO:tasks.workunit.client.0.smithi062.stderr: -228> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: _finish_auth 0 2024-09-12T00:56:44.915 INFO:tasks.workunit.client.0.smithi062.stderr: -227> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: _check_auth_tickets 2024-09-12T00:56:44.915 INFO:tasks.workunit.client.0.smithi062.stderr: -226> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:44.915 INFO:tasks.workunit.client.0.smithi062.stderr: -225> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.915 INFO:tasks.workunit.client.0.smithi062.stderr: -224> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:56:44.915 INFO:tasks.workunit.client.0.smithi062.stderr: -223> 2024-09-12T00:56:44.541+0000 7f21f3fff640 10 monclient: dump: 2024-09-12T00:56:44.915 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.915 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.916 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.916 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.916 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.916 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.916 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.916 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.916 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.916 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.916 INFO:tasks.workunit.client.0.smithi062.stderr: -222> 2024-09-12T00:56:44.541+0000 7f2321415800 5 monclient: authenticate success, global_id 8346 2024-09-12T00:56:44.916 INFO:tasks.workunit.client.0.smithi062.stderr: -221> 2024-09-12T00:56:44.541+0000 7f2321415800 10 monclient: get_monmap_and_config success 2024-09-12T00:56:44.916 INFO:tasks.workunit.client.0.smithi062.stderr: -220> 2024-09-12T00:56:44.541+0000 7f2321415800 4 set_mon_vals no callback set 2024-09-12T00:56:44.916 INFO:tasks.workunit.client.0.smithi062.stderr: -219> 2024-09-12T00:56:44.542+0000 7f2321415800 10 monclient: shutdown 2024-09-12T00:56:44.916 INFO:tasks.workunit.client.0.smithi062.stderr: -218> 2024-09-12T00:56:44.542+0000 7f2321415800 10 monclient: build_initial_monmap 2024-09-12T00:56:44.917 INFO:tasks.workunit.client.0.smithi062.stderr: -217> 2024-09-12T00:56:44.542+0000 7f2321415800 1 build_initial for_mkfs: 0 2024-09-12T00:56:44.917 INFO:tasks.workunit.client.0.smithi062.stderr: -216> 2024-09-12T00:56:44.542+0000 7f2321415800 10 monclient: monmap: 2024-09-12T00:56:44.917 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 0 2024-09-12T00:56:44.917 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:56:44.917 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 0.000000 2024-09-12T00:56:44.917 INFO:tasks.workunit.client.0.smithi062.stderr:created 0.000000 2024-09-12T00:56:44.917 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 0 (unknown) 2024-09-12T00:56:44.917 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.917 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.noname-a 2024-09-12T00:56:44.917 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.noname-b 2024-09-12T00:56:44.917 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.noname-c 2024-09-12T00:56:44.917 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.917 INFO:tasks.workunit.client.0.smithi062.stderr: -215> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding auth protocol: cephx 2024-09-12T00:56:44.917 INFO:tasks.workunit.client.0.smithi062.stderr: -214> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding auth protocol: cephx 2024-09-12T00:56:44.918 INFO:tasks.workunit.client.0.smithi062.stderr: -213> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding auth protocol: cephx 2024-09-12T00:56:44.918 INFO:tasks.workunit.client.0.smithi062.stderr: -212> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: secure 2024-09-12T00:56:44.918 INFO:tasks.workunit.client.0.smithi062.stderr: -211> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: crc 2024-09-12T00:56:44.918 INFO:tasks.workunit.client.0.smithi062.stderr: -210> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: secure 2024-09-12T00:56:44.918 INFO:tasks.workunit.client.0.smithi062.stderr: -209> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: crc 2024-09-12T00:56:44.918 INFO:tasks.workunit.client.0.smithi062.stderr: -208> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: secure 2024-09-12T00:56:44.918 INFO:tasks.workunit.client.0.smithi062.stderr: -207> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: crc 2024-09-12T00:56:44.918 INFO:tasks.workunit.client.0.smithi062.stderr: -206> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: crc 2024-09-12T00:56:44.918 INFO:tasks.workunit.client.0.smithi062.stderr: -205> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: secure 2024-09-12T00:56:44.918 INFO:tasks.workunit.client.0.smithi062.stderr: -204> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: crc 2024-09-12T00:56:44.918 INFO:tasks.workunit.client.0.smithi062.stderr: -203> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: secure 2024-09-12T00:56:44.918 INFO:tasks.workunit.client.0.smithi062.stderr: -202> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: crc 2024-09-12T00:56:44.918 INFO:tasks.workunit.client.0.smithi062.stderr: -201> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfd1ec60) adding con mode: secure 2024-09-12T00:56:44.919 INFO:tasks.workunit.client.0.smithi062.stderr: -200> 2024-09-12T00:56:44.542+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.919 INFO:tasks.workunit.client.0.smithi062.stderr: -199> 2024-09-12T00:56:44.542+0000 7f2321415800 1 librados: starting msgr at 2024-09-12T00:56:44.919 INFO:tasks.workunit.client.0.smithi062.stderr: -198> 2024-09-12T00:56:44.542+0000 7f2321415800 1 librados: starting objecter 2024-09-12T00:56:44.919 INFO:tasks.workunit.client.0.smithi062.stderr: -197> 2024-09-12T00:56:44.542+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command objecter_requests cmddesc objecter_requests hook 0x5595dfcf9570 EEXIST 2024-09-12T00:56:44.919 INFO:tasks.workunit.client.0.smithi062.stderr: -196> 2024-09-12T00:56:44.542+0000 7f2321415800 1 librados: setting wanted keys 2024-09-12T00:56:44.919 INFO:tasks.workunit.client.0.smithi062.stderr: -195> 2024-09-12T00:56:44.542+0000 7f2321415800 1 librados: calling monclient init 2024-09-12T00:56:44.919 INFO:tasks.workunit.client.0.smithi062.stderr: -194> 2024-09-12T00:56:44.542+0000 7f2321415800 10 monclient: init 2024-09-12T00:56:44.919 INFO:tasks.workunit.client.0.smithi062.stderr: -193> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding auth protocol: cephx 2024-09-12T00:56:44.919 INFO:tasks.workunit.client.0.smithi062.stderr: -192> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding auth protocol: cephx 2024-09-12T00:56:44.919 INFO:tasks.workunit.client.0.smithi062.stderr: -191> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding auth protocol: cephx 2024-09-12T00:56:44.919 INFO:tasks.workunit.client.0.smithi062.stderr: -190> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: secure 2024-09-12T00:56:44.919 INFO:tasks.workunit.client.0.smithi062.stderr: -189> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: crc 2024-09-12T00:56:44.919 INFO:tasks.workunit.client.0.smithi062.stderr: -188> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: secure 2024-09-12T00:56:44.920 INFO:tasks.workunit.client.0.smithi062.stderr: -187> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: crc 2024-09-12T00:56:44.920 INFO:tasks.workunit.client.0.smithi062.stderr: -186> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: secure 2024-09-12T00:56:44.920 INFO:tasks.workunit.client.0.smithi062.stderr: -185> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: crc 2024-09-12T00:56:44.920 INFO:tasks.workunit.client.0.smithi062.stderr: -184> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: crc 2024-09-12T00:56:44.920 INFO:tasks.workunit.client.0.smithi062.stderr: -183> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: secure 2024-09-12T00:56:44.920 INFO:tasks.workunit.client.0.smithi062.stderr: -182> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: crc 2024-09-12T00:56:44.920 INFO:tasks.workunit.client.0.smithi062.stderr: -181> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: secure 2024-09-12T00:56:44.920 INFO:tasks.workunit.client.0.smithi062.stderr: -180> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: crc 2024-09-12T00:56:44.920 INFO:tasks.workunit.client.0.smithi062.stderr: -179> 2024-09-12T00:56:44.542+0000 7f2321415800 5 AuthRegistry(0x5595dfcf19e0) adding con mode: secure 2024-09-12T00:56:44.920 INFO:tasks.workunit.client.0.smithi062.stderr: -178> 2024-09-12T00:56:44.543+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.920 INFO:tasks.workunit.client.0.smithi062.stderr: -177> 2024-09-12T00:56:44.543+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.920 INFO:tasks.workunit.client.0.smithi062.stderr: -176> 2024-09-12T00:56:44.543+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command rotate-key cmddesc rotate-key hook 0x5595dfcf1b28 EEXIST 2024-09-12T00:56:44.920 INFO:tasks.workunit.client.0.smithi062.stderr: -175> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient: _reopen_session rank -1 2024-09-12T00:56:44.920 INFO:tasks.workunit.client.0.smithi062.stderr: -174> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:56:44.921 INFO:tasks.workunit.client.0.smithi062.stderr: -173> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): picked mon.noname-b con 0x5595dfd1e790 addr [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] 2024-09-12T00:56:44.921 INFO:tasks.workunit.client.0.smithi062.stderr: -172> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): picked mon.noname-a con 0x5595dfd29270 addr [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] 2024-09-12T00:56:44.921 INFO:tasks.workunit.client.0.smithi062.stderr: -171> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): picked mon.noname-c con 0x5595dfd2de40 addr [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] 2024-09-12T00:56:44.921 INFO:tasks.workunit.client.0.smithi062.stderr: -170> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.921 INFO:tasks.workunit.client.0.smithi062.stderr: -169> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.921 INFO:tasks.workunit.client.0.smithi062.stderr: -168> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): start opening mon connection 2024-09-12T00:56:44.921 INFO:tasks.workunit.client.0.smithi062.stderr: -167> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): _renew_subs 2024-09-12T00:56:44.921 INFO:tasks.workunit.client.0.smithi062.stderr: -166> 2024-09-12T00:56:44.543+0000 7f2321415800 10 monclient(hunting): authenticate will time out at 2291.036489s 2024-09-12T00:56:44.921 INFO:tasks.workunit.client.0.smithi062.stderr: -165> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): get_auth_request con 0x5595dfd2de40 auth_method 0 2024-09-12T00:56:44.921 INFO:tasks.workunit.client.0.smithi062.stderr: -164> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.921 INFO:tasks.workunit.client.0.smithi062.stderr: -163> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.921 INFO:tasks.workunit.client.0.smithi062.stderr: -162> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.921 INFO:tasks.workunit.client.0.smithi062.stderr: -161> 2024-09-12T00:56:44.543+0000 7f231cb92640 10 monclient(hunting): get_auth_request con 0x5595dfd1e790 auth_method 0 2024-09-12T00:56:44.922 INFO:tasks.workunit.client.0.smithi062.stderr: -160> 2024-09-12T00:56:44.543+0000 7f231cb92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.922 INFO:tasks.workunit.client.0.smithi062.stderr: -159> 2024-09-12T00:56:44.543+0000 7f231cb92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.922 INFO:tasks.workunit.client.0.smithi062.stderr: -158> 2024-09-12T00:56:44.543+0000 7f231cb92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.922 INFO:tasks.workunit.client.0.smithi062.stderr: -157> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.922 INFO:tasks.workunit.client.0.smithi062.stderr: -156> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.922 INFO:tasks.workunit.client.0.smithi062.stderr: -155> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.922 INFO:tasks.workunit.client.0.smithi062.stderr: -154> 2024-09-12T00:56:44.543+0000 7f231c391640 10 monclient(hunting): get_auth_request con 0x5595dfd29270 auth_method 0 2024-09-12T00:56:44.922 INFO:tasks.workunit.client.0.smithi062.stderr: -153> 2024-09-12T00:56:44.543+0000 7f231c391640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:56:44.922 INFO:tasks.workunit.client.0.smithi062.stderr: -152> 2024-09-12T00:56:44.543+0000 7f231c391640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:56:44.922 INFO:tasks.workunit.client.0.smithi062.stderr: -151> 2024-09-12T00:56:44.543+0000 7f231c391640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:56:44.922 INFO:tasks.workunit.client.0.smithi062.stderr: -150> 2024-09-12T00:56:44.543+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:56:44.922 INFO:tasks.workunit.client.0.smithi062.stderr: -149> 2024-09-12T00:56:44.543+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:56:44.923 INFO:tasks.workunit.client.0.smithi062.stderr: -148> 2024-09-12T00:56:44.543+0000 7f231cb92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:56:44.923 INFO:tasks.workunit.client.0.smithi062.stderr: -147> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient(hunting): handle_auth_done global_id 7901 payload 824 2024-09-12T00:56:44.923 INFO:tasks.workunit.client.0.smithi062.stderr: -146> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient: _finish_hunting 0 2024-09-12T00:56:44.923 INFO:tasks.workunit.client.0.smithi062.stderr: -145> 2024-09-12T00:56:44.543+0000 7f231d393640 1 monclient: found mon.noname-c 2024-09-12T00:56:44.923 INFO:tasks.workunit.client.0.smithi062.stderr: -144> 2024-09-12T00:56:44.543+0000 7f231d393640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.62:3301/0 2024-09-12T00:56:44.923 INFO:tasks.workunit.client.0.smithi062.stderr: -143> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.923 INFO:tasks.workunit.client.0.smithi062.stderr: -142> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:56:44.923 INFO:tasks.workunit.client.0.smithi062.stderr: -141> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: dump: 2024-09-12T00:56:44.923 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.923 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.923 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.923 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.923 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.924 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.924 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.924 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.924 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.924 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.924 INFO:tasks.workunit.client.0.smithi062.stderr: -140> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: _finish_auth 0 2024-09-12T00:56:44.924 INFO:tasks.workunit.client.0.smithi062.stderr: -139> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: _check_auth_tickets 2024-09-12T00:56:44.924 INFO:tasks.workunit.client.0.smithi062.stderr: -138> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:56:44.924 INFO:tasks.workunit.client.0.smithi062.stderr: -137> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:56:44.924 INFO:tasks.workunit.client.0.smithi062.stderr: -136> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:56:44.924 INFO:tasks.workunit.client.0.smithi062.stderr: -135> 2024-09-12T00:56:44.544+0000 7f21f27fc640 10 monclient: dump: 2024-09-12T00:56:44.924 INFO:tasks.workunit.client.0.smithi062.stderr:epoch 1 2024-09-12T00:56:44.924 INFO:tasks.workunit.client.0.smithi062.stderr:fsid 96ca3065-0479-453c-a9a3-396e70051c3b 2024-09-12T00:56:44.925 INFO:tasks.workunit.client.0.smithi062.stderr:last_changed 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.925 INFO:tasks.workunit.client.0.smithi062.stderr:created 2024-09-12T00:30:34.432547+0000 2024-09-12T00:56:44.925 INFO:tasks.workunit.client.0.smithi062.stderr:min_mon_release 19 (squid) 2024-09-12T00:56:44.925 INFO:tasks.workunit.client.0.smithi062.stderr:election_strategy: 1 2024-09-12T00:56:44.925 INFO:tasks.workunit.client.0.smithi062.stderr:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2024-09-12T00:56:44.925 INFO:tasks.workunit.client.0.smithi062.stderr:1: [v2:172.21.15.77:3300/0,v1:172.21.15.77:6789/0] mon.b 2024-09-12T00:56:44.925 INFO:tasks.workunit.client.0.smithi062.stderr:2: [v2:172.21.15.62:3301/0,v1:172.21.15.62:6790/0] mon.c 2024-09-12T00:56:44.925 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.925 INFO:tasks.workunit.client.0.smithi062.stderr: -134> 2024-09-12T00:56:44.544+0000 7f2321415800 5 monclient: authenticate success, global_id 7901 2024-09-12T00:56:44.925 INFO:tasks.workunit.client.0.smithi062.stderr: -133> 2024-09-12T00:56:44.544+0000 7f2321415800 10 monclient: _renew_subs 2024-09-12T00:56:44.925 INFO:tasks.workunit.client.0.smithi062.stderr: -132> 2024-09-12T00:56:44.544+0000 7f21f3fff640 4 set_mon_vals no callback set 2024-09-12T00:56:44.925 INFO:tasks.workunit.client.0.smithi062.stderr: -131> 2024-09-12T00:56:44.544+0000 7f2321415800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:44.925 INFO:tasks.workunit.client.0.smithi062.stderr: -130> 2024-09-12T00:56:44.544+0000 7f2321415800 10 monclient: _renew_subs 2024-09-12T00:56:44.926 INFO:tasks.workunit.client.0.smithi062.stderr: -129> 2024-09-12T00:56:44.544+0000 7f2321415800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:44.926 INFO:tasks.workunit.client.0.smithi062.stderr: -128> 2024-09-12T00:56:44.544+0000 7f2321415800 1 librados: init done 2024-09-12T00:56:44.926 INFO:tasks.workunit.client.0.smithi062.stderr: -127> 2024-09-12T00:56:44.544+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command cr dump hook 0x7f230c004a78 2024-09-12T00:56:44.926 INFO:tasks.workunit.client.0.smithi062.stderr: -126> 2024-09-12T00:56:44.546+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.926 INFO:tasks.workunit.client.0.smithi062.stderr: -125> 2024-09-12T00:56:44.546+0000 7f21f27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:56:44.926 INFO:tasks.workunit.client.0.smithi062.stderr: -124> 2024-09-12T00:56:44.546+0000 7f21f27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:44.926 INFO:tasks.workunit.client.0.smithi062.stderr: -123> 2024-09-12T00:56:44.546+0000 7f21f27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.77:6832/1419612558,v1:172.21.15.77:6833/1419612558] 2024-09-12T00:56:44.926 INFO:tasks.workunit.client.0.smithi062.stderr: -122> 2024-09-12T00:56:44.547+0000 7f231cb92640 10 monclient: get_auth_request con 0x7f21e8076470 auth_method 0 2024-09-12T00:56:44.926 INFO:tasks.workunit.client.0.smithi062.stderr: -121> 2024-09-12T00:56:44.547+0000 7f231c391640 10 monclient: get_auth_request con 0x5595dfd48220 auth_method 0 2024-09-12T00:56:44.926 INFO:tasks.workunit.client.0.smithi062.stderr: -120> 2024-09-12T00:56:44.548+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.926 INFO:tasks.workunit.client.0.smithi062.stderr: -119> 2024-09-12T00:56:44.548+0000 7f2321415800 20 realm 2024-09-12T00:56:44.926 INFO:tasks.workunit.client.0.smithi062.stderr: -118> 2024-09-12T00:56:44.548+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.926 INFO:tasks.workunit.client.0.smithi062.stderr: -117> 2024-09-12T00:56:44.548+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.926 INFO:tasks.workunit.client.0.smithi062.stderr: -116> 2024-09-12T00:56:44.548+0000 7f2321415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:44.927 INFO:tasks.workunit.client.0.smithi062.stderr: -115> 2024-09-12T00:56:44.548+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.927 INFO:tasks.workunit.client.0.smithi062.stderr: -114> 2024-09-12T00:56:44.548+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.927 INFO:tasks.workunit.client.0.smithi062.stderr: -113> 2024-09-12T00:56:44.548+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.927 INFO:tasks.workunit.client.0.smithi062.stderr: -112> 2024-09-12T00:56:44.548+0000 7f231cb92640 10 monclient: get_auth_request con 0x5595dfd4c5b0 auth_method 0 2024-09-12T00:56:44.927 INFO:tasks.workunit.client.0.smithi062.stderr: -111> 2024-09-12T00:56:44.549+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:44.927 INFO:tasks.workunit.client.0.smithi062.stderr: -110> 2024-09-12T00:56:44.549+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.927 INFO:tasks.workunit.client.0.smithi062.stderr: -109> 2024-09-12T00:56:44.549+0000 7f231c391640 10 monclient: get_auth_request con 0x5595dfd4fcf0 auth_method 0 2024-09-12T00:56:44.927 INFO:tasks.workunit.client.0.smithi062.stderr: -108> 2024-09-12T00:56:44.550+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:44.927 INFO:tasks.workunit.client.0.smithi062.stderr: -107> 2024-09-12T00:56:44.550+0000 7f2321415800 20 searching for the correct realm 2024-09-12T00:56:44.927 INFO:tasks.workunit.client.0.smithi062.stderr: -106> 2024-09-12T00:56:44.550+0000 7f231d393640 10 monclient: get_auth_request con 0x5595dfd549c0 auth_method 0 2024-09-12T00:56:44.927 INFO:tasks.workunit.client.0.smithi062.stderr: -105> 2024-09-12T00:56:44.551+0000 7f231cb92640 10 monclient: get_auth_request con 0x7f23140a9320 auth_method 0 2024-09-12T00:56:44.927 INFO:tasks.workunit.client.0.smithi062.stderr: -104> 2024-09-12T00:56:44.553+0000 7f231c391640 10 monclient: get_auth_request con 0x7f23140b1e10 auth_method 0 2024-09-12T00:56:44.927 INFO:tasks.workunit.client.0.smithi062.stderr: -103> 2024-09-12T00:56:44.553+0000 7f231c391640 0 -- 172.21.15.62:0/1717188447 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f23140b1e10 msgr2=0x7f23140a7490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:44.928 INFO:tasks.workunit.client.0.smithi062.stderr: -102> 2024-09-12T00:56:44.755+0000 7f231c391640 10 monclient: get_auth_request con 0x7f23140b1e10 auth_method 0 2024-09-12T00:56:44.928 INFO:tasks.workunit.client.0.smithi062.stderr: -101> 2024-09-12T00:56:44.757+0000 7f231d393640 10 monclient: get_auth_request con 0x7f230c097070 auth_method 0 2024-09-12T00:56:44.928 INFO:tasks.workunit.client.0.smithi062.stderr: -100> 2024-09-12T00:56:44.758+0000 7f231cb92640 10 monclient: get_auth_request con 0x7f23140ad3c0 auth_method 0 2024-09-12T00:56:44.928 INFO:tasks.workunit.client.0.smithi062.stderr: -99> 2024-09-12T00:56:44.759+0000 7f231c391640 0 -- 172.21.15.62:0/1717188447 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5595dfd48220 msgr2=0x5595dfd4a690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:44.928 INFO:tasks.workunit.client.0.smithi062.stderr: -98> 2024-09-12T00:56:44.759+0000 7f21f27fc640 1 client.7901.objecter ms_handle_reset 0x5595dfd48220 session 0x5595dfd47ba0 osd.6 2024-09-12T00:56:44.928 INFO:tasks.workunit.client.0.smithi062.stderr: -97> 2024-09-12T00:56:44.759+0000 7f21f27fc640 10 monclient: _renew_subs 2024-09-12T00:56:44.928 INFO:tasks.workunit.client.0.smithi062.stderr: -96> 2024-09-12T00:56:44.759+0000 7f21f27fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.62:3301/0 2024-09-12T00:56:44.928 INFO:tasks.workunit.client.0.smithi062.stderr: -95> 2024-09-12T00:56:44.759+0000 7f231c391640 10 monclient: get_auth_request con 0x7f21e8086720 auth_method 0 2024-09-12T00:56:44.928 INFO:tasks.workunit.client.0.smithi062.stderr: -94> 2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:56:44.928 INFO:tasks.workunit.client.0.smithi062.stderr: -93> 2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:56:44.928 INFO:tasks.workunit.client.0.smithi062.stderr: -92> 2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:44.928 INFO:tasks.workunit.client.0.smithi062.stderr: -91> 2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:44.928 INFO:tasks.workunit.client.0.smithi062.stderr: -90> 2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:44.929 INFO:tasks.workunit.client.0.smithi062.stderr: -89> 2024-09-12T00:56:44.763+0000 7f2321415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:44.929 INFO:tasks.workunit.client.0.smithi062.stderr: -88> 2024-09-12T00:56:44.763+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.929 INFO:tasks.workunit.client.0.smithi062.stderr: -87> 2024-09-12T00:56:44.763+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.929 INFO:tasks.workunit.client.0.smithi062.stderr: -86> 2024-09-12T00:56:44.763+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.929 INFO:tasks.workunit.client.0.smithi062.stderr: -85> 2024-09-12T00:56:44.764+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:44.929 INFO:tasks.workunit.client.0.smithi062.stderr: -84> 2024-09-12T00:56:44.764+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.929 INFO:tasks.workunit.client.0.smithi062.stderr: -83> 2024-09-12T00:56:44.764+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:44.929 INFO:tasks.workunit.client.0.smithi062.stderr: -82> 2024-09-12T00:56:44.764+0000 7f2321415800 20 zone default found 2024-09-12T00:56:44.929 INFO:tasks.workunit.client.0.smithi062.stderr: -81> 2024-09-12T00:56:44.764+0000 7f2321415800 4 Realm: () 2024-09-12T00:56:44.929 INFO:tasks.workunit.client.0.smithi062.stderr: -80> 2024-09-12T00:56:44.764+0000 7f2321415800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:56:44.929 INFO:tasks.workunit.client.0.smithi062.stderr: -79> 2024-09-12T00:56:44.764+0000 7f2321415800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:56:44.929 INFO:tasks.workunit.client.0.smithi062.stderr: -78> 2024-09-12T00:56:44.764+0000 7f2321415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:44.929 INFO:tasks.workunit.client.0.smithi062.stderr: -77> 2024-09-12T00:56:44.764+0000 7f2321415800 20 zonegroup default 2024-09-12T00:56:44.930 INFO:tasks.workunit.client.0.smithi062.stderr: -76> 2024-09-12T00:56:44.764+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.930 INFO:tasks.workunit.client.0.smithi062.stderr: -75> 2024-09-12T00:56:44.764+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.930 INFO:tasks.workunit.client.0.smithi062.stderr: -74> 2024-09-12T00:56:44.764+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.930 INFO:tasks.workunit.client.0.smithi062.stderr: -73> 2024-09-12T00:56:44.765+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.930 INFO:tasks.workunit.client.0.smithi062.stderr: -72> 2024-09-12T00:56:44.765+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.930 INFO:tasks.workunit.client.0.smithi062.stderr: -71> 2024-09-12T00:56:44.765+0000 7f2321415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.930 INFO:tasks.workunit.client.0.smithi062.stderr: -70> 2024-09-12T00:56:44.765+0000 7f2321415800 20 started sync module instance, tier type = 2024-09-12T00:56:44.930 INFO:tasks.workunit.client.0.smithi062.stderr: -69> 2024-09-12T00:56:44.765+0000 7f2321415800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:56:44.930 INFO:tasks.workunit.client.0.smithi062.stderr: -68> 2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=0 2024-09-12T00:56:44.930 INFO:tasks.workunit.client.0.smithi062.stderr: -67> 2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=1 2024-09-12T00:56:44.930 INFO:tasks.workunit.client.0.smithi062.stderr: -66> 2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=2 2024-09-12T00:56:44.930 INFO:tasks.workunit.client.0.smithi062.stderr: -65> 2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=3 2024-09-12T00:56:44.930 INFO:tasks.workunit.client.0.smithi062.stderr: -64> 2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=4 2024-09-12T00:56:44.931 INFO:tasks.workunit.client.0.smithi062.stderr: -63> 2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=5 2024-09-12T00:56:44.931 INFO:tasks.workunit.client.0.smithi062.stderr: -62> 2024-09-12T00:56:44.775+0000 7f2321415800 20 add_watcher() i=6 2024-09-12T00:56:44.931 INFO:tasks.workunit.client.0.smithi062.stderr: -61> 2024-09-12T00:56:44.776+0000 7f2321415800 20 add_watcher() i=7 2024-09-12T00:56:44.931 INFO:tasks.workunit.client.0.smithi062.stderr: -60> 2024-09-12T00:56:44.776+0000 7f2321415800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:44.931 INFO:tasks.workunit.client.0.smithi062.stderr: -59> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding auth protocol: cephx 2024-09-12T00:56:44.931 INFO:tasks.workunit.client.0.smithi062.stderr: -58> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding auth protocol: cephx 2024-09-12T00:56:44.931 INFO:tasks.workunit.client.0.smithi062.stderr: -57> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding auth protocol: cephx 2024-09-12T00:56:44.931 INFO:tasks.workunit.client.0.smithi062.stderr: -56> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: secure 2024-09-12T00:56:44.931 INFO:tasks.workunit.client.0.smithi062.stderr: -55> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: crc 2024-09-12T00:56:44.931 INFO:tasks.workunit.client.0.smithi062.stderr: -54> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: secure 2024-09-12T00:56:44.931 INFO:tasks.workunit.client.0.smithi062.stderr: -53> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: crc 2024-09-12T00:56:44.931 INFO:tasks.workunit.client.0.smithi062.stderr: -52> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: secure 2024-09-12T00:56:44.931 INFO:tasks.workunit.client.0.smithi062.stderr: -51> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: crc 2024-09-12T00:56:44.931 INFO:tasks.workunit.client.0.smithi062.stderr: -50> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: crc 2024-09-12T00:56:44.932 INFO:tasks.workunit.client.0.smithi062.stderr: -49> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: secure 2024-09-12T00:56:44.932 INFO:tasks.workunit.client.0.smithi062.stderr: -48> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: crc 2024-09-12T00:56:44.932 INFO:tasks.workunit.client.0.smithi062.stderr: -47> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: secure 2024-09-12T00:56:44.932 INFO:tasks.workunit.client.0.smithi062.stderr: -46> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: crc 2024-09-12T00:56:44.932 INFO:tasks.workunit.client.0.smithi062.stderr: -45> 2024-09-12T00:56:44.778+0000 7f2321415800 5 AuthRegistry(0x7ffdf992a2e0) adding con mode: secure 2024-09-12T00:56:44.932 INFO:tasks.workunit.client.0.smithi062.stderr: -44> 2024-09-12T00:56:44.778+0000 7f21d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:44.932 INFO:tasks.workunit.client.0.smithi062.stderr: -43> 2024-09-12T00:56:44.778+0000 7f2321415800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:56:44.932 INFO:tasks.workunit.client.0.smithi062.stderr: -42> 2024-09-12T00:56:44.778+0000 7f2321415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:44.932 INFO:tasks.workunit.client.0.smithi062.stderr: -41> 2024-09-12T00:56:44.778+0000 7f2321415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:44.932 INFO:tasks.workunit.client.0.smithi062.stderr: -40> 2024-09-12T00:56:44.778+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command cache list hook 0x5595dfd22960 2024-09-12T00:56:44.932 INFO:tasks.workunit.client.0.smithi062.stderr: -39> 2024-09-12T00:56:44.779+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command cache inspect hook 0x5595dfd22960 2024-09-12T00:56:44.933 INFO:tasks.workunit.client.0.smithi062.stderr: -38> 2024-09-12T00:56:44.779+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command cache erase hook 0x5595dfd22960 2024-09-12T00:56:44.933 INFO:tasks.workunit.client.0.smithi062.stderr: -37> 2024-09-12T00:56:44.779+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command cache zap hook 0x5595dfd22960 2024-09-12T00:56:44.933 INFO:tasks.workunit.client.0.smithi062.stderr: -36> 2024-09-12T00:56:44.779+0000 7f2321415800 5 note: GC not initialized 2024-09-12T00:56:44.933 INFO:tasks.workunit.client.0.smithi062.stderr: -35> 2024-09-12T00:56:44.779+0000 7f21d1fe3640 20 reqs_thread_entry: start 2024-09-12T00:56:44.933 INFO:tasks.workunit.client.0.smithi062.stderr: -34> 2024-09-12T00:56:44.779+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command sync trace show hook 0x7f230c087070 2024-09-12T00:56:44.933 INFO:tasks.workunit.client.0.smithi062.stderr: -33> 2024-09-12T00:56:44.779+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command sync trace history hook 0x7f230c087070 2024-09-12T00:56:44.933 INFO:tasks.workunit.client.0.smithi062.stderr: -32> 2024-09-12T00:56:44.779+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command sync trace active hook 0x7f230c087070 2024-09-12T00:56:44.933 INFO:tasks.workunit.client.0.smithi062.stderr: -31> 2024-09-12T00:56:44.779+0000 7f2321415800 5 asok(0x5595dfa3d630) register_command sync trace active_short hook 0x7f230c087070 2024-09-12T00:56:44.933 INFO:tasks.workunit.client.0.smithi062.stderr: -30> 2024-09-12T00:56:44.779+0000 7f2321415800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:44.933 INFO:tasks.workunit.client.0.smithi062.stderr: -29> 2024-09-12T00:56:44.779+0000 7f2321415800 20 Filter name: none 2024-09-12T00:56:44.933 INFO:tasks.workunit.client.0.smithi062.stderr: -28> 2024-09-12T00:56:44.779+0000 7f21437fe640 20 reqs_thread_entry: start 2024-09-12T00:56:44.933 INFO:tasks.workunit.client.0.smithi062.stderr: -27> 2024-09-12T00:56:44.779+0000 7f2321415800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:56:44.933 INFO:tasks.workunit.client.0.smithi062.stderr: -26> 2024-09-12T00:56:44.779+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.934 INFO:tasks.workunit.client.0.smithi062.stderr: -25> 2024-09-12T00:56:44.779+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:56:44.934 INFO:tasks.workunit.client.0.smithi062.stderr: -24> 2024-09-12T00:56:44.779+0000 7f2321415800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:56:44.934 INFO:tasks.workunit.client.0.smithi062.stderr: -23> 2024-09-12T00:56:44.779+0000 7f2321415800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:56:44.934 INFO:tasks.workunit.client.0.smithi062.stderr: -22> 2024-09-12T00:56:44.779+0000 7f2321415800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:56:44.934 INFO:tasks.workunit.client.0.smithi062.stderr: -21> 2024-09-12T00:56:44.779+0000 7f2321415800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.934 INFO:tasks.workunit.client.0.smithi062.stderr: -20> 2024-09-12T00:56:44.780+0000 7f2321415800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:56:44.934 INFO:tasks.workunit.client.0.smithi062.stderr: -19> 2024-09-12T00:56:44.780+0000 7f2321415800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:44.934 INFO:tasks.workunit.client.0.smithi062.stderr: -18> 2024-09-12T00:56:44.780+0000 7f2321415800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:44.934 INFO:tasks.workunit.client.0.smithi062.stderr: -17> 2024-09-12T00:56:44.780+0000 7f2321415800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:44.934 INFO:tasks.workunit.client.0.smithi062.stderr: -16> 2024-09-12T00:56:44.780+0000 7f2321415800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:44.934 INFO:tasks.workunit.client.0.smithi062.stderr: -15> 2024-09-12T00:56:44.780+0000 7f2321415800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:56:44.934 INFO:tasks.workunit.client.0.smithi062.stderr: -14> 2024-09-12T00:56:44.781+0000 7f2321415800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:56:44.934 INFO:tasks.workunit.client.0.smithi062.stderr: -13> 2024-09-12T00:56:44.786+0000 7f2321415800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:44.934 INFO:tasks.workunit.client.0.smithi062.stderr: -12> 2024-09-12T00:56:44.786+0000 7f2321415800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:44.935 INFO:tasks.workunit.client.0.smithi062.stderr: -11> 2024-09-12T00:56:44.786+0000 7f2321415800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:44.935 INFO:tasks.workunit.client.0.smithi062.stderr: -10> 2024-09-12T00:56:44.786+0000 7f2321415800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:56:44.935 INFO:tasks.workunit.client.0.smithi062.stderr: -9> 2024-09-12T00:56:44.786+0000 7f21f37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431690 cookie 94102193798368 notifier 7901 bl.length()=827 2024-09-12T00:56:44.935 INFO:tasks.workunit.client.0.smithi062.stderr: -8> 2024-09-12T00:56:44.786+0000 7f21f37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:44.935 INFO:tasks.workunit.client.0.smithi062.stderr: -7> 2024-09-12T00:56:44.786+0000 7f21f37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:44.935 INFO:tasks.workunit.client.0.smithi062.stderr: -6> 2024-09-12T00:56:44.786+0000 7f21f37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:44.935 INFO:tasks.workunit.client.0.smithi062.stderr: -5> 2024-09-12T00:56:44.788+0000 7f2321415800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:56:44.935 INFO:tasks.workunit.client.0.smithi062.stderr: -4> 2024-09-12T00:56:44.788+0000 7f2321415800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:56:44.935 INFO:tasks.workunit.client.0.smithi062.stderr: -3> 2024-09-12T00:56:44.788+0000 7f2321415800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:56:44.935 INFO:tasks.workunit.client.0.smithi062.stderr: -2> 2024-09-12T00:56:44.788+0000 7f2321415800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:56:44.935 INFO:tasks.workunit.client.0.smithi062.stderr: -1> 2024-09-12T00:56:44.791+0000 7f2321415800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f2321415800 time 2024-09-12T00:56:44.791855+0000 2024-09-12T00:56:44.935 INFO:tasks.workunit.client.0.smithi062.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:56:44.935 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.936 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:44.936 INFO:tasks.workunit.client.0.smithi062.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f232258c71a] 2024-09-12T00:56:44.936 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f232258c8d8] 2024-09-12T00:56:44.936 INFO:tasks.workunit.client.0.smithi062.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595de2be641] 2024-09-12T00:56:44.936 INFO:tasks.workunit.client.0.smithi062.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595de2ce38a] 2024-09-12T00:56:44.936 INFO:tasks.workunit.client.0.smithi062.stderr: 5: main() 2024-09-12T00:56:44.936 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f2321229590] 2024-09-12T00:56:44.936 INFO:tasks.workunit.client.0.smithi062.stderr: 7: __libc_start_main() 2024-09-12T00:56:44.936 INFO:tasks.workunit.client.0.smithi062.stderr: 8: _start() 2024-09-12T00:56:44.936 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.936 INFO:tasks.workunit.client.0.smithi062.stderr: 0> 2024-09-12T00:56:44.792+0000 7f2321415800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:56:44.936 INFO:tasks.workunit.client.0.smithi062.stderr: in thread 7f2321415800 thread_name:radosgw-admin 2024-09-12T00:56:44.936 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.937 INFO:tasks.workunit.client.0.smithi062.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:56:44.937 INFO:tasks.workunit.client.0.smithi062.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f232123e6f0] 2024-09-12T00:56:44.937 INFO:tasks.workunit.client.0.smithi062.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f232128b99c] 2024-09-12T00:56:44.937 INFO:tasks.workunit.client.0.smithi062.stderr: 3: raise() 2024-09-12T00:56:44.937 INFO:tasks.workunit.client.0.smithi062.stderr: 4: abort() 2024-09-12T00:56:44.937 INFO:tasks.workunit.client.0.smithi062.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f232258c774] 2024-09-12T00:56:44.937 INFO:tasks.workunit.client.0.smithi062.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f232258c8d8] 2024-09-12T00:56:44.937 INFO:tasks.workunit.client.0.smithi062.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595de2be641] 2024-09-12T00:56:44.937 INFO:tasks.workunit.client.0.smithi062.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5595de2ce38a] 2024-09-12T00:56:44.937 INFO:tasks.workunit.client.0.smithi062.stderr: 9: main() 2024-09-12T00:56:44.937 INFO:tasks.workunit.client.0.smithi062.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f2321229590] 2024-09-12T00:56:44.937 INFO:tasks.workunit.client.0.smithi062.stderr: 11: __libc_start_main() 2024-09-12T00:56:44.937 INFO:tasks.workunit.client.0.smithi062.stderr: 12: _start() 2024-09-12T00:56:44.938 INFO:tasks.workunit.client.0.smithi062.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:56:44.938 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:56:44.938 INFO:tasks.workunit.client.0.smithi062.stderr:--- logging levels --- 2024-09-12T00:56:44.938 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 none 2024-09-12T00:56:44.938 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 lockdep 2024-09-12T00:56:44.938 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 context 2024-09-12T00:56:44.938 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 crush 2024-09-12T00:56:44.938 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds 2024-09-12T00:56:44.938 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_balancer 2024-09-12T00:56:44.938 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_locker 2024-09-12T00:56:44.938 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log 2024-09-12T00:56:44.938 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_log_expire 2024-09-12T00:56:44.938 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mds_migrator 2024-09-12T00:56:44.938 INFO:tasks.workunit.client.0.smithi062.stderr: 3/ 5 mds_quiesce 2024-09-12T00:56:44.939 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 buffer 2024-09-12T00:56:44.939 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 timer 2024-09-12T00:56:44.939 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 filer 2024-09-12T00:56:44.939 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 striper 2024-09-12T00:56:44.939 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 1 objecter 2024-09-12T00:56:44.939 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rados 2024-09-12T00:56:44.939 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd 2024-09-12T00:56:44.939 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_mirror 2024-09-12T00:56:44.939 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_replay 2024-09-12T00:56:44.939 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 rbd_pwl 2024-09-12T00:56:44.939 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 journaler 2024-09-12T00:56:44.939 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objectcacher 2024-09-12T00:56:44.939 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:56:44.939 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 client 2024-09-12T00:56:44.940 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 osd 2024-09-12T00:56:44.940 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 optracker 2024-09-12T00:56:44.940 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 objclass 2024-09-12T00:56:44.940 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 filestore 2024-09-12T00:56:44.940 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 journal 2024-09-12T00:56:44.940 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 ms 2024-09-12T00:56:44.940 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mon 2024-09-12T00:56:44.940 INFO:tasks.workunit.client.0.smithi062.stderr: 0/10 monc 2024-09-12T00:56:44.940 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 paxos 2024-09-12T00:56:44.940 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 tp 2024-09-12T00:56:44.940 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 auth 2024-09-12T00:56:44.940 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 crypto 2024-09-12T00:56:44.940 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 finisher 2024-09-12T00:56:44.941 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 reserver 2024-09-12T00:56:44.941 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 heartbeatmap 2024-09-12T00:56:44.941 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 perfcounter 2024-09-12T00:56:44.941 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw 2024-09-12T00:56:44.941 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_sync 2024-09-12T00:56:44.941 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_datacache 2024-09-12T00:56:44.941 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_access 2024-09-12T00:56:44.941 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:56:44.941 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_flight 2024-09-12T00:56:44.941 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:56:44.941 INFO:tasks.workunit.client.0.smithi062.stderr: 20/20 rgw_notification 2024-09-12T00:56:44.941 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 javaclient 2024-09-12T00:56:44.941 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 asok 2024-09-12T00:56:44.941 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 1 throttle 2024-09-12T00:56:44.942 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 0 refs 2024-09-12T00:56:44.942 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 compressor 2024-09-12T00:56:44.942 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluestore 2024-09-12T00:56:44.942 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 bluefs 2024-09-12T00:56:44.942 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 3 bdev 2024-09-12T00:56:44.942 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 kstore 2024-09-12T00:56:44.942 INFO:tasks.workunit.client.0.smithi062.stderr: 4/ 5 rocksdb 2024-09-12T00:56:44.942 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 fuse 2024-09-12T00:56:44.942 INFO:tasks.workunit.client.0.smithi062.stderr: 2/ 5 mgr 2024-09-12T00:56:44.942 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mgrc 2024-09-12T00:56:44.942 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 dpdk 2024-09-12T00:56:44.942 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 eventtrace 2024-09-12T00:56:44.942 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 prioritycache 2024-09-12T00:56:44.943 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 test 2024-09-12T00:56:44.943 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:56:44.943 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cephsqlite 2024-09-12T00:56:44.943 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:56:44.943 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore 2024-09-12T00:56:44.943 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_onode 2024-09-12T00:56:44.943 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_odata 2024-09-12T00:56:44.943 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_omap 2024-09-12T00:56:44.943 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_tm 2024-09-12T00:56:44.943 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_t 2024-09-12T00:56:44.943 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:56:44.943 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_epm 2024-09-12T00:56:44.943 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_lba 2024-09-12T00:56:44.944 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:56:44.944 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_cache 2024-09-12T00:56:44.944 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_journal 2024-09-12T00:56:44.944 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_device 2024-09-12T00:56:44.944 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 seastore_backref 2024-09-12T00:56:44.944 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 alienstore 2024-09-12T00:56:44.944 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 mclock 2024-09-12T00:56:44.944 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 cyanstore 2024-09-12T00:56:44.944 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 ceph_exporter 2024-09-12T00:56:44.944 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 memstore 2024-09-12T00:56:44.944 INFO:tasks.workunit.client.0.smithi062.stderr: 1/ 5 trace 2024-09-12T00:56:44.944 INFO:tasks.workunit.client.0.smithi062.stderr: 0/ 5 ceph_dedup 2024-09-12T00:56:44.944 INFO:tasks.workunit.client.0.smithi062.stderr: -2/-2 (syslog threshold) 2024-09-12T00:56:44.945 INFO:tasks.workunit.client.0.smithi062.stderr: 99/99 (stderr threshold) 2024-09-12T00:56:44.945 INFO:tasks.workunit.client.0.smithi062.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:56:44.945 INFO:tasks.workunit.client.0.smithi062.stderr: 7f21437fe640 / http_manager 2024-09-12T00:56:44.945 INFO:tasks.workunit.client.0.smithi062.stderr: 7f21d1fe3640 / http_manager 2024-09-12T00:56:44.945 INFO:tasks.workunit.client.0.smithi062.stderr: 7f21d2fe5640 / rgw_dt_lg_renew 2024-09-12T00:56:44.945 INFO:tasks.workunit.client.0.smithi062.stderr: 7f21f27fc640 / ms_dispatch 2024-09-12T00:56:44.945 INFO:tasks.workunit.client.0.smithi062.stderr: 7f21f37fe640 / io_context_pool 2024-09-12T00:56:44.945 INFO:tasks.workunit.client.0.smithi062.stderr: 7f21f3fff640 / io_context_pool 2024-09-12T00:56:44.945 INFO:tasks.workunit.client.0.smithi062.stderr: 7f22027fc640 / ms_dispatch 2024-09-12T00:56:44.945 INFO:tasks.workunit.client.0.smithi062.stderr: 7f220960a640 / ms_dispatch 2024-09-12T00:56:44.945 INFO:tasks.workunit.client.0.smithi062.stderr: 7f220ae0d640 / io_context_pool 2024-09-12T00:56:44.945 INFO:tasks.workunit.client.0.smithi062.stderr: 7f231c391640 / msgr-worker-2 2024-09-12T00:56:44.945 INFO:tasks.workunit.client.0.smithi062.stderr: 7f231cb92640 / msgr-worker-1 2024-09-12T00:56:44.945 INFO:tasks.workunit.client.0.smithi062.stderr: 7f231d393640 / msgr-worker-0 2024-09-12T00:56:44.946 INFO:tasks.workunit.client.0.smithi062.stderr: 7f231db94640 / io_context_pool 2024-09-12T00:56:44.946 INFO:tasks.workunit.client.0.smithi062.stderr: 7f2321415800 / radosgw-admin 2024-09-12T00:56:44.946 INFO:tasks.workunit.client.0.smithi062.stderr: max_recent 500 2024-09-12T00:56:44.946 INFO:tasks.workunit.client.0.smithi062.stderr: max_new 1000 2024-09-12T00:56:44.946 INFO:tasks.workunit.client.0.smithi062.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:56:44.793326Z_ffddea44-bb2a-4a12-98eb-5bd31ae0d397/log 2024-09-12T00:56:44.946 INFO:tasks.workunit.client.0.smithi062.stderr:--- end dump of recent events --- 2024-09-12T00:56:44.946 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:56:44.948 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:44.948 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:44.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.872+0000 7f462871f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.874+0000 7f462871f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.874+0000 7f462871f800 20 realm 2024-09-12T00:56:44.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.874+0000 7f462871f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.874+0000 7f462871f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.874+0000 7f462871f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:44.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.874+0000 7f462871f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.874+0000 7f462871f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:44.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.874+0000 7f462871f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.875+0000 7f462871f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:44.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.875+0000 7f462871f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:44.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.875+0000 7f462871f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:44.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.875+0000 7f462871f800 20 searching for the correct realm 2024-09-12T00:56:44.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:44.878+0000 7f4623ca1640 0 -- 172.21.15.62:0/821500747 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f461c055410 msgr2=0x7f461c055890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:45.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.083+0000 7f46244a2640 0 -- 172.21.15.62:0/821500747 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f461c089400 msgr2=0x7f461c089880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:45.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.088+0000 7f462871f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:56:45.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.088+0000 7f462871f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:56:45.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.088+0000 7f462871f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:45.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.088+0000 7f462871f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:45.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.088+0000 7f462871f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:45.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.088+0000 7f462871f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:45.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.088+0000 7f462871f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.088+0000 7f462871f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:45.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.088+0000 7f462871f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.089+0000 7f462871f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:45.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.089+0000 7f462871f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.089+0000 7f462871f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:45.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.089+0000 7f462871f800 20 zone default found 2024-09-12T00:56:45.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.089+0000 7f462871f800 4 Realm: () 2024-09-12T00:56:45.089 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.089+0000 7f462871f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:56:45.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.089+0000 7f462871f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:56:45.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.089+0000 7f462871f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:45.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.089+0000 7f462871f800 20 zonegroup default 2024-09-12T00:56:45.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.089+0000 7f462871f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.090+0000 7f462871f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:45.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.090+0000 7f462871f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.090+0000 7f462871f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:45.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.090+0000 7f462871f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.090+0000 7f462871f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:45.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.090+0000 7f462871f800 20 started sync module instance, tier type = 2024-09-12T00:56:45.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.090+0000 7f462871f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:56:45.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.100+0000 7f462871f800 20 add_watcher() i=0 2024-09-12T00:56:45.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.100+0000 7f462871f800 20 add_watcher() i=1 2024-09-12T00:56:45.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.100+0000 7f462871f800 20 add_watcher() i=2 2024-09-12T00:56:45.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.100+0000 7f462871f800 20 add_watcher() i=3 2024-09-12T00:56:45.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.100+0000 7f462871f800 20 add_watcher() i=4 2024-09-12T00:56:45.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.100+0000 7f462871f800 20 add_watcher() i=5 2024-09-12T00:56:45.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.100+0000 7f462871f800 20 add_watcher() i=6 2024-09-12T00:56:45.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.101+0000 7f462871f800 20 add_watcher() i=7 2024-09-12T00:56:45.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.101+0000 7f462871f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:45.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.103+0000 7f44dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:45.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.103+0000 7f462871f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:45.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.103+0000 7f462871f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:45.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.104+0000 7f462871f800 5 note: GC not initialized 2024-09-12T00:56:45.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.104+0000 7f44d9fdb640 20 reqs_thread_entry: start 2024-09-12T00:56:45.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.104+0000 7f462871f800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:45.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.104+0000 7f462871f800 20 Filter name: none 2024-09-12T00:56:45.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.104+0000 7f444b7fe640 20 reqs_thread_entry: start 2024-09-12T00:56:45.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.104+0000 7f462871f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.105+0000 7f462871f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:56:45.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.105+0000 7f462871f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.105+0000 7f462871f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:56:45.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.105+0000 7f462871f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:45.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.105+0000 7f462871f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.105+0000 7f462871f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:56:45.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.105+0000 7f462871f800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.106+0000 7f462871f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:56:45.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.106+0000 7f462871f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:56:45.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.107+0000 7f44dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:45.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.110+0000 7f462871f800 20 remove_watcher() i=0 2024-09-12T00:56:45.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.110+0000 7f462871f800 2 removed watcher, disabling cache 2024-09-12T00:56:45.110 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.111+0000 7f462871f800 20 remove_watcher() i=1 2024-09-12T00:56:45.111 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.112+0000 7f462871f800 20 remove_watcher() i=2 2024-09-12T00:56:45.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.113+0000 7f462871f800 20 remove_watcher() i=3 2024-09-12T00:56:45.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.114+0000 7f462871f800 20 remove_watcher() i=4 2024-09-12T00:56:45.114 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.115+0000 7f462871f800 20 remove_watcher() i=5 2024-09-12T00:56:45.115 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.116+0000 7f462871f800 20 remove_watcher() i=6 2024-09-12T00:56:45.116 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.117+0000 7f462871f800 20 remove_watcher() i=7 2024-09-12T00:56:45.169 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:56:45.198 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:56:45.198 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:56:45.237 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.238+0000 7fcac593d800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.239 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.240+0000 7fcac593d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:45.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.240+0000 7fcac593d800 20 realm 2024-09-12T00:56:45.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.240+0000 7fcac593d800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.240+0000 7fcac593d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:45.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.240+0000 7fcac593d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:56:45.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.240+0000 7fcac593d800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.241+0000 7fcac593d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:45.240 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.241+0000 7fcac593d800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.241+0000 7fcac593d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:45.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.241+0000 7fcac593d800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.242+0000 7fcac593d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:56:45.241 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.242+0000 7fcac593d800 20 searching for the correct realm 2024-09-12T00:56:45.243 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.245+0000 7fcac0e29640 0 -- 172.21.15.62:0/1049180345 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fcabc070410 msgr2=0x7fcabc070890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:56:45.449 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.450+0000 7fcac1e2b640 0 -- 172.21.15.62:0/1049180345 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55d805fe08e0 msgr2=0x55d805fe2da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:56:45.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.455+0000 7fcac593d800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:56:45.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.455+0000 7fcac593d800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:56:45.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.455+0000 7fcac593d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:56:45.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.455+0000 7fcac593d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:56:45.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.455+0000 7fcac593d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:56:45.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.455+0000 7fcac593d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:56:45.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.455+0000 7fcac593d800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.455+0000 7fcac593d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:45.454 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.455+0000 7fcac593d800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.455+0000 7fcac593d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:56:45.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.455+0000 7fcac593d800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.456+0000 7fcac593d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:56:45.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.456+0000 7fcac593d800 20 zone default found 2024-09-12T00:56:45.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.456+0000 7fcac593d800 4 Realm: () 2024-09-12T00:56:45.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.456+0000 7fcac593d800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:56:45.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.456+0000 7fcac593d800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:56:45.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.456+0000 7fcac593d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:56:45.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.456+0000 7fcac593d800 20 zonegroup default 2024-09-12T00:56:45.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.456+0000 7fcac593d800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.456+0000 7fcac593d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:45.456 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.456+0000 7fcac593d800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.456+0000 7fcac593d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:45.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.456+0000 7fcac593d800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.457+0000 7fcac593d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:56:45.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.457+0000 7fcac593d800 20 started sync module instance, tier type = 2024-09-12T00:56:45.457 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.457+0000 7fcac593d800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:56:45.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.466+0000 7fcac593d800 20 add_watcher() i=0 2024-09-12T00:56:45.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.466+0000 7fcac593d800 20 add_watcher() i=1 2024-09-12T00:56:45.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.466+0000 7fcac593d800 20 add_watcher() i=2 2024-09-12T00:56:45.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.466+0000 7fcac593d800 20 add_watcher() i=3 2024-09-12T00:56:45.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.466+0000 7fcac593d800 20 add_watcher() i=4 2024-09-12T00:56:45.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.466+0000 7fcac593d800 20 add_watcher() i=5 2024-09-12T00:56:45.465 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.466+0000 7fcac593d800 20 add_watcher() i=6 2024-09-12T00:56:45.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.467+0000 7fcac593d800 20 add_watcher() i=7 2024-09-12T00:56:45.466 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.467+0000 7fcac593d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:56:45.467 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.469+0000 7fc977fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:45.468 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.469+0000 7fcac593d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:56:45.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.469+0000 7fcac593d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:56:45.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.469+0000 7fcac593d800 5 note: GC not initialized 2024-09-12T00:56:45.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.469+0000 7fc976fe5640 20 reqs_thread_entry: start 2024-09-12T00:56:45.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.469+0000 7fcac593d800 20 init_complete bucket index max shards: 1 2024-09-12T00:56:45.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 20 Filter name: none 2024-09-12T00:56:45.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fc974fe1640 20 reqs_thread_entry: start 2024-09-12T00:56:45.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:56:45.469 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:56:45.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:56:45.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:56:45.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:56:45.470 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 20 rados->read ofs=0 len=0 2024-09-12T00:56:45.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:56:45.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:56:45.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:56:45.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:56:45.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:56:45.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:56:45.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:56:45.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.470+0000 7fcac593d800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:56:45.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.471+0000 7fcac593d800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:56:45.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.471+0000 7fcac593d800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:56:45.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.471+0000 7fcac593d800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:56:45.471 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.471+0000 7fcac593d800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:56:45.472 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.472+0000 7fc977fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:56:45.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.474+0000 7fcac593d800 20 remove_watcher() i=0 2024-09-12T00:56:45.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.474+0000 7fcac593d800 2 removed watcher, disabling cache 2024-09-12T00:56:45.474 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.476+0000 7fcac593d800 20 remove_watcher() i=1 2024-09-12T00:56:45.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.477+0000 7fcac593d800 20 remove_watcher() i=2 2024-09-12T00:56:45.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.478+0000 7fcac593d800 20 remove_watcher() i=3 2024-09-12T00:56:45.478 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.479+0000 7fcac593d800 20 remove_watcher() i=4 2024-09-12T00:56:45.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.480+0000 7fcac593d800 20 remove_watcher() i=5 2024-09-12T00:56:45.480 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.481+0000 7fcac593d800 20 remove_watcher() i=6 2024-09-12T00:56:45.481 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:56:45.482+0000 7fcac593d800 20 remove_watcher() i=7 2024-09-12T00:57:15.515 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T00:57:15.549 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:15.549 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:15.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.595+0000 7f611b939800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.597+0000 7f611b939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:15.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.597+0000 7f611b939800 20 realm 2024-09-12T00:57:15.597 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.597+0000 7f611b939800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.598+0000 7f611b939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:15.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.598+0000 7f611b939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:15.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.598+0000 7f611b939800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.598+0000 7f611b939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:15.598 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.598+0000 7f611b939800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.599 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.599+0000 7f611b939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:15.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.599+0000 7f611b939800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.599+0000 7f611b939800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:15.600 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.599+0000 7f611b939800 20 searching for the correct realm 2024-09-12T00:57:15.601 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.602+0000 7f6116dc6640 0 -- 172.21.15.62:0/2515356264 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f6110067330 msgr2=0x7f611009f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:15.807 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.808+0000 7f6116dc6640 0 -- 172.21.15.62:0/2515356264 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x564992adad20 msgr2=0x564992add1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:15.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.813+0000 7f611b939800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:15.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.813+0000 7f611b939800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:15.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.813+0000 7f611b939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:15.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.813+0000 7f611b939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:15.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.813+0000 7f611b939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:15.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.813+0000 7f611b939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:15.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.813+0000 7f611b939800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.813+0000 7f611b939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:15.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.813+0000 7f611b939800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.813+0000 7f611b939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:15.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.813+0000 7f611b939800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.814+0000 7f611b939800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:15.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.814+0000 7f611b939800 20 zone default found 2024-09-12T00:57:15.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.814+0000 7f611b939800 4 Realm: () 2024-09-12T00:57:15.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.814+0000 7f611b939800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:15.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.814+0000 7f611b939800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:15.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.814+0000 7f611b939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:15.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.814+0000 7f611b939800 20 zonegroup default 2024-09-12T00:57:15.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.814+0000 7f611b939800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.814+0000 7f611b939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:15.814 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.814+0000 7f611b939800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.815+0000 7f611b939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:15.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.815+0000 7f611b939800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.815+0000 7f611b939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:15.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.815+0000 7f611b939800 20 started sync module instance, tier type = 2024-09-12T00:57:15.815 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.815+0000 7f611b939800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:15.824 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.826+0000 7f611b939800 20 add_watcher() i=0 2024-09-12T00:57:15.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.826+0000 7f611b939800 20 add_watcher() i=1 2024-09-12T00:57:15.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.826+0000 7f611b939800 20 add_watcher() i=2 2024-09-12T00:57:15.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.826+0000 7f611b939800 20 add_watcher() i=3 2024-09-12T00:57:15.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.826+0000 7f611b939800 20 add_watcher() i=4 2024-09-12T00:57:15.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.826+0000 7f611b939800 20 add_watcher() i=5 2024-09-12T00:57:15.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.826+0000 7f611b939800 20 add_watcher() i=6 2024-09-12T00:57:15.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.827+0000 7f611b939800 20 add_watcher() i=7 2024-09-12T00:57:15.826 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.827+0000 7f611b939800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:15.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.829+0000 7f5fcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:15.830 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.830+0000 7f611b939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:15.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.830+0000 7f611b939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:15.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.830+0000 7f611b939800 5 note: GC not initialized 2024-09-12T00:57:15.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.830+0000 7f5fccfe1640 20 reqs_thread_entry: start 2024-09-12T00:57:15.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.830+0000 7f611b939800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:15.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.830+0000 7f611b939800 20 Filter name: none 2024-09-12T00:57:15.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.830+0000 7f5f467fc640 20 reqs_thread_entry: start 2024-09-12T00:57:15.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.830+0000 7f611b939800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:57:15.831 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.830+0000 7f611b939800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.831+0000 7f611b939800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:57:15.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.831+0000 7f611b939800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:57:15.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.831+0000 7f611b939800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:57:15.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.831+0000 7f611b939800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:57:15.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.831+0000 7f611b939800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.831+0000 7f611b939800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:57:15.832 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.831+0000 7f611b939800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:57:15.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.831+0000 7f611b939800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:57:15.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.831+0000 7f611b939800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:15.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.831+0000 7f611b939800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:15.833 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.831+0000 7f611b939800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:57:15.834 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.835+0000 7f5fcdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:15.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.838+0000 7f611b939800 20 remove_watcher() i=0 2024-09-12T00:57:15.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.838+0000 7f611b939800 2 removed watcher, disabling cache 2024-09-12T00:57:15.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.839+0000 7f611b939800 20 remove_watcher() i=1 2024-09-12T00:57:15.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.840+0000 7f611b939800 20 remove_watcher() i=2 2024-09-12T00:57:15.840 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.841+0000 7f611b939800 20 remove_watcher() i=3 2024-09-12T00:57:15.841 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.842+0000 7f611b939800 20 remove_watcher() i=4 2024-09-12T00:57:15.842 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.843+0000 7f611b939800 20 remove_watcher() i=5 2024-09-12T00:57:15.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.845+0000 7f611b939800 20 remove_watcher() i=6 2024-09-12T00:57:15.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.846+0000 7f611b939800 20 remove_watcher() i=7 2024-09-12T00:57:15.859 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:57:15.889 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:15.890 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:15.932 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.933+0000 7f1956615800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.935+0000 7f1956615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:15.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.935+0000 7f1956615800 20 realm 2024-09-12T00:57:15.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.935+0000 7f1956615800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.935+0000 7f1956615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:15.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.935+0000 7f1956615800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:15.936 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.935+0000 7f1956615800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.935+0000 7f1956615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:15.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.935+0000 7f1956615800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.936+0000 7f1956615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:15.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.936+0000 7f1956615800 20 rados->read ofs=0 len=0 2024-09-12T00:57:15.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.937+0000 7f1956615800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:15.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:15.937+0000 7f1956615800 20 searching for the correct realm 2024-09-12T00:57:16.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.140+0000 7f1951d92640 0 -- 172.21.15.62:0/508019585 >> [v2:172.21.15.62:6816/3104025159,v1:172.21.15.62:6817/3104025159] conn(0x565495e71b20 msgr2=0x565495e73f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:16.143 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.145+0000 7f1951d92640 0 -- 172.21.15.62:0/508019585 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f194c008420 msgr2=0x7f194c0088a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:16.352 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.353+0000 7f1956615800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:16.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.353+0000 7f1956615800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:16.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.353+0000 7f1956615800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:16.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.353+0000 7f1956615800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:16.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.353+0000 7f1956615800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:16.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.353+0000 7f1956615800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:16.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.353+0000 7f1956615800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.354+0000 7f1956615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:16.353 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.354+0000 7f1956615800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.354+0000 7f1956615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:16.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.354+0000 7f1956615800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.354+0000 7f1956615800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:16.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.355+0000 7f1956615800 20 zone default found 2024-09-12T00:57:16.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.355+0000 7f1956615800 4 Realm: () 2024-09-12T00:57:16.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.355+0000 7f1956615800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:16.354 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.355+0000 7f1956615800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:16.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.355+0000 7f1956615800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:16.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.355+0000 7f1956615800 20 zonegroup default 2024-09-12T00:57:16.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.355+0000 7f1956615800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.355+0000 7f1956615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:16.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.355+0000 7f1956615800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.355+0000 7f1956615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:16.355 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.355+0000 7f1956615800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.356+0000 7f1956615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:16.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.356+0000 7f1956615800 20 started sync module instance, tier type = 2024-09-12T00:57:16.356 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.356+0000 7f1956615800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:16.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.367+0000 7f1956615800 20 add_watcher() i=0 2024-09-12T00:57:16.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.367+0000 7f1956615800 20 add_watcher() i=1 2024-09-12T00:57:16.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.367+0000 7f1956615800 20 add_watcher() i=2 2024-09-12T00:57:16.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.367+0000 7f1956615800 20 add_watcher() i=3 2024-09-12T00:57:16.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.367+0000 7f1956615800 20 add_watcher() i=4 2024-09-12T00:57:16.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.367+0000 7f1956615800 20 add_watcher() i=5 2024-09-12T00:57:16.366 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.367+0000 7f1956615800 20 add_watcher() i=6 2024-09-12T00:57:16.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.368+0000 7f1956615800 20 add_watcher() i=7 2024-09-12T00:57:16.367 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.368+0000 7f1956615800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:16.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.370+0000 7f18037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:16.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.370+0000 7f1956615800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:16.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.370+0000 7f1956615800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:16.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.370+0000 7f1956615800 5 note: GC not initialized 2024-09-12T00:57:16.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.371+0000 7f18027fc640 20 reqs_thread_entry: start 2024-09-12T00:57:16.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.371+0000 7f1956615800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:16.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.371+0000 7f1956615800 20 Filter name: none 2024-09-12T00:57:16.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.371+0000 7f1777fff640 20 reqs_thread_entry: start 2024-09-12T00:57:16.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.371+0000 7f1956615800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:57:16.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.371+0000 7f1956615800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.371+0000 7f1956615800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:57:16.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.371+0000 7f1956615800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:57:16.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.371+0000 7f1956615800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:57:16.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.371+0000 7f1956615800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:57:16.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.371+0000 7f1956615800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.372+0000 7f1956615800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:57:16.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.372+0000 7f1956615800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:57:16.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.372+0000 7f1956615800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:57:16.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.372+0000 7f1956615800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:16.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.372+0000 7f1956615800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:16.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.372+0000 7f1956615800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:57:16.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.372+0000 7f1956615800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:57:16.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.372+0000 7f1956615800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:57:16.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.372+0000 7f1956615800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:57:16.372 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.372+0000 7f1956615800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:57:16.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.373+0000 7f1956615800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:57:16.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.373+0000 7f1956615800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:57:16.373 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.375+0000 7f18037fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:16.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.377+0000 7f1956615800 20 remove_watcher() i=0 2024-09-12T00:57:16.376 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.377+0000 7f1956615800 2 removed watcher, disabling cache 2024-09-12T00:57:16.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.378+0000 7f1956615800 20 remove_watcher() i=1 2024-09-12T00:57:16.379 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.380+0000 7f1956615800 20 remove_watcher() i=2 2024-09-12T00:57:16.380 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.381+0000 7f1956615800 20 remove_watcher() i=3 2024-09-12T00:57:16.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.382+0000 7f1956615800 20 remove_watcher() i=4 2024-09-12T00:57:16.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.384+0000 7f1956615800 20 remove_watcher() i=5 2024-09-12T00:57:16.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.385+0000 7f1956615800 20 remove_watcher() i=6 2024-09-12T00:57:16.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.386+0000 7f1956615800 20 remove_watcher() i=7 2024-09-12T00:57:16.398 INFO:tasks.workunit.client.0.smithi062.stderr:check reshard logrecord successfully 2024-09-12T00:57:16.398 INFO:tasks.workunit.client.0.smithi062.stderr: test: reshard versioned bucket 2024-09-12T00:57:16.400 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:57:16.431 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:16.431 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:16.473 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.474+0000 7fbaf6d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.476+0000 7fbaf6d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:16.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.476+0000 7fbaf6d2d800 20 realm 2024-09-12T00:57:16.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.476+0000 7fbaf6d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.476+0000 7fbaf6d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:16.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.476+0000 7fbaf6d2d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:16.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.476+0000 7fbaf6d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.476+0000 7fbaf6d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:16.475 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.476+0000 7fbaf6d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.477+0000 7fbaf6d2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:16.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.477+0000 7fbaf6d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.476 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.478+0000 7fbaf6d2d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:16.477 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.478+0000 7fbaf6d2d800 20 searching for the correct realm 2024-09-12T00:57:16.479 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.481+0000 7fbaf2275640 0 -- 172.21.15.62:0/305860840 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fbaec06a9e0 msgr2=0x7fbaec07b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:16.686 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.687+0000 7fbaf3277640 0 -- 172.21.15.62:0/305860840 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55f007272020 msgr2=0x55f0072744c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:16.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.691+0000 7fbaf6d2d800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:16.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.691+0000 7fbaf6d2d800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:16.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.691+0000 7fbaf6d2d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:16.690 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.691+0000 7fbaf6d2d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:16.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.691+0000 7fbaf6d2d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:16.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.691+0000 7fbaf6d2d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:16.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.691+0000 7fbaf6d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.692+0000 7fbaf6d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:16.691 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.692+0000 7fbaf6d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.692+0000 7fbaf6d2d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:16.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.692+0000 7fbaf6d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.692+0000 7fbaf6d2d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:16.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.692+0000 7fbaf6d2d800 20 zone default found 2024-09-12T00:57:16.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.692+0000 7fbaf6d2d800 4 Realm: () 2024-09-12T00:57:16.692 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.692+0000 7fbaf6d2d800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:16.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.692+0000 7fbaf6d2d800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:16.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.692+0000 7fbaf6d2d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:16.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.692+0000 7fbaf6d2d800 20 zonegroup default 2024-09-12T00:57:16.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.692+0000 7fbaf6d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.692+0000 7fbaf6d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:16.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.692+0000 7fbaf6d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.693+0000 7fbaf6d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:16.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.693+0000 7fbaf6d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.693+0000 7fbaf6d2d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:16.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.693+0000 7fbaf6d2d800 20 started sync module instance, tier type = 2024-09-12T00:57:16.693 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.693+0000 7fbaf6d2d800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:16.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.703+0000 7fbaf6d2d800 20 add_watcher() i=0 2024-09-12T00:57:16.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.703+0000 7fbaf6d2d800 20 add_watcher() i=1 2024-09-12T00:57:16.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.703+0000 7fbaf6d2d800 20 add_watcher() i=2 2024-09-12T00:57:16.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.703+0000 7fbaf6d2d800 20 add_watcher() i=3 2024-09-12T00:57:16.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.703+0000 7fbaf6d2d800 20 add_watcher() i=4 2024-09-12T00:57:16.702 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.703+0000 7fbaf6d2d800 20 add_watcher() i=5 2024-09-12T00:57:16.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.703+0000 7fbaf6d2d800 20 add_watcher() i=6 2024-09-12T00:57:16.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.704+0000 7fbaf6d2d800 20 add_watcher() i=7 2024-09-12T00:57:16.703 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.704+0000 7fbaf6d2d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:16.705 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.706+0000 7fb9a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:16.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.707+0000 7fbaf6d2d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:16.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.707+0000 7fbaf6d2d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:16.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.707+0000 7fbaf6d2d800 5 note: GC not initialized 2024-09-12T00:57:16.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.707+0000 7fb923fff640 20 reqs_thread_entry: start 2024-09-12T00:57:16.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.707+0000 7fbaf6d2d800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:16.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.707+0000 7fbaf6d2d800 20 Filter name: none 2024-09-12T00:57:16.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.707+0000 7fb921ffb640 20 reqs_thread_entry: start 2024-09-12T00:57:16.706 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.707+0000 7fbaf6d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.707 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.708+0000 7fbaf6d2d800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:57:16.707 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.708+0000 7fbaf6d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.707 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.708+0000 7fbaf6d2d800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:57:16.707 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.708+0000 7fbaf6d2d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:16.707 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.709+0000 7fbaf6d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.709+0000 7fbaf6d2d800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:57:16.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.709+0000 7fbaf6d2d800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.709+0000 7fbaf6d2d800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:57:16.708 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.709+0000 7fbaf6d2d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:16.710 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.711+0000 7fb9a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:16.712 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.713+0000 7fbaf6d2d800 20 remove_watcher() i=0 2024-09-12T00:57:16.712 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.713+0000 7fbaf6d2d800 2 removed watcher, disabling cache 2024-09-12T00:57:16.713 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.714+0000 7fbaf6d2d800 20 remove_watcher() i=1 2024-09-12T00:57:16.714 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.716+0000 7fbaf6d2d800 20 remove_watcher() i=2 2024-09-12T00:57:16.715 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.717+0000 7fbaf6d2d800 20 remove_watcher() i=3 2024-09-12T00:57:16.716 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.718+0000 7fbaf6d2d800 20 remove_watcher() i=4 2024-09-12T00:57:16.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.719+0000 7fbaf6d2d800 20 remove_watcher() i=5 2024-09-12T00:57:16.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.720+0000 7fbaf6d2d800 20 remove_watcher() i=6 2024-09-12T00:57:16.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.721+0000 7fbaf6d2d800 20 remove_watcher() i=7 2024-09-12T00:57:16.731 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:57:16.731 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:57:16.732 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: myver id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-12T00:57:16.732 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:57:16.733 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-09-12T00:57:16.765 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:16.765 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:16.805 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.806+0000 7fcabe32c800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.808+0000 7fcabe32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:16.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.808+0000 7fcabe32c800 20 realm 2024-09-12T00:57:16.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.808+0000 7fcabe32c800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.808+0000 7fcabe32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:16.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.808+0000 7fcabe32c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:16.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.808+0000 7fcabe32c800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.809+0000 7fcabe32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:16.808 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.809+0000 7fcabe32c800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.809+0000 7fcabe32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:16.809 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.809+0000 7fcabe32c800 20 rados->read ofs=0 len=0 2024-09-12T00:57:16.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.810+0000 7fcabe32c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:16.810 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.810+0000 7fcabe32c800 20 searching for the correct realm 2024-09-12T00:57:16.812 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:16.813+0000 7fcab9744640 0 -- 172.21.15.62:0/3462762887 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fcab4064380 msgr2=0x7fcab40798f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:17.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.018+0000 7fcaba746640 0 -- 172.21.15.62:0/3462762887 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55a18fe99270 msgr2=0x55a18fe9b700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:17.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.023+0000 7fcabe32c800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:17.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.023+0000 7fcabe32c800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:17.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.023+0000 7fcabe32c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:17.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.023+0000 7fcabe32c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:17.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.023+0000 7fcabe32c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:17.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.023+0000 7fcabe32c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:17.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.023+0000 7fcabe32c800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.023+0000 7fcabe32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:17.023 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.023+0000 7fcabe32c800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.024+0000 7fcabe32c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:17.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.024+0000 7fcabe32c800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.024+0000 7fcabe32c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:17.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.024+0000 7fcabe32c800 20 zone default found 2024-09-12T00:57:17.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.024+0000 7fcabe32c800 4 Realm: () 2024-09-12T00:57:17.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.024+0000 7fcabe32c800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:17.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.024+0000 7fcabe32c800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:17.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.024+0000 7fcabe32c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:17.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.024+0000 7fcabe32c800 20 zonegroup default 2024-09-12T00:57:17.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.024+0000 7fcabe32c800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.024+0000 7fcabe32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:17.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.024+0000 7fcabe32c800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.024+0000 7fcabe32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:17.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.024+0000 7fcabe32c800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.025+0000 7fcabe32c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:17.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.025+0000 7fcabe32c800 20 started sync module instance, tier type = 2024-09-12T00:57:17.025 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.025+0000 7fcabe32c800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:17.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.035+0000 7fcabe32c800 20 add_watcher() i=0 2024-09-12T00:57:17.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.035+0000 7fcabe32c800 20 add_watcher() i=1 2024-09-12T00:57:17.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.035+0000 7fcabe32c800 20 add_watcher() i=2 2024-09-12T00:57:17.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.035+0000 7fcabe32c800 20 add_watcher() i=3 2024-09-12T00:57:17.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.035+0000 7fcabe32c800 20 add_watcher() i=4 2024-09-12T00:57:17.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.035+0000 7fcabe32c800 20 add_watcher() i=5 2024-09-12T00:57:17.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.035+0000 7fcabe32c800 20 add_watcher() i=6 2024-09-12T00:57:17.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.036+0000 7fcabe32c800 20 add_watcher() i=7 2024-09-12T00:57:17.035 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.036+0000 7fcabe32c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:17.037 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.038+0000 7fc96b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:17.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.038+0000 7fcabe32c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:17.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.038+0000 7fcabe32c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:17.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.038+0000 7fcabe32c800 5 note: GC not initialized 2024-09-12T00:57:17.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.039+0000 7fc96a7fc640 20 reqs_thread_entry: start 2024-09-12T00:57:17.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.039+0000 7fcabe32c800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:17.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.039+0000 7fcabe32c800 20 Filter name: none 2024-09-12T00:57:17.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.039+0000 7fc8dbfff640 20 reqs_thread_entry: start 2024-09-12T00:57:17.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.039+0000 7fcabe32c800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:57:17.038 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.039+0000 7fcabe32c800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.040+0000 7fcabe32c800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:57:17.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.040+0000 7fcabe32c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:57:17.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.040+0000 7fcabe32c800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:57:17.039 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.040+0000 7fcabe32c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 : miss 2024-09-12T00:57:17.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.040+0000 7fcabe32c800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.040+0000 7fcabe32c800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:57:17.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.040+0000 7fcabe32c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:17.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.040+0000 7fcabe32c800 10 adding default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:17.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.040+0000 7fcabe32c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:17.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.040+0000 7fcabe32c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:17.040 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.040+0000 7fcabe32c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 2024-09-12T00:57:17.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.044+0000 7fcabe32c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:17.043 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.044+0000 7fcabe32c800 10 moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:17.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.044+0000 7fcabe32c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:17.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.044+0000 7fcabe32c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18, ofs0, ns] 2024-09-12T00:57:17.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.045+0000 7fc99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431591 cookie 94152392610720 notifier 8003 bl.length()=821 2024-09-12T00:57:17.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.045+0000 7fc99d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:17.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.045+0000 7fc99d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:17.044 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.045+0000 7fc99d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:17.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.046+0000 7fcabe32c800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_sources= new_sources= 2024-09-12T00:57:17.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.046+0000 7fcabe32c800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential sources added=[] removed=[] 2024-09-12T00:57:17.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.046+0000 7fcabe32c800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_dests= new_dests= 2024-09-12T00:57:17.045 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.046+0000 7fcabe32c800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential dests added=[] removed=[] 2024-09-12T00:57:17.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.048+0000 7fcabe32c800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.1.0 2024-09-12T00:57:17.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.048+0000 7fcabe32c800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.1.0 2024-09-12T00:57:17.047 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.049+0000 7fcabe32c800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.1.1 2024-09-12T00:57:17.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.049+0000 7fcabe32c800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.1.1 2024-09-12T00:57:17.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.049+0000 7fcabe32c800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.0 2024-09-12T00:57:17.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.049+0000 7fcabe32c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:17.048 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.049+0000 7fcabe32c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 2024-09-12T00:57:17.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.050+0000 7fcabe32c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:17.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.051+0000 7fcabe32c800 10 moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:17.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.051+0000 7fcabe32c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:17.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.051+0000 7fcabe32c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18, ofs0, ns] 2024-09-12T00:57:17.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.051+0000 7fc99d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431592 cookie 94152392610720 notifier 8003 bl.length()=821 2024-09-12T00:57:17.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.051+0000 7fc99d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:17.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.051+0000 7fc99d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:17.050 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.051+0000 7fc99d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:17.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.052+0000 7fcabe32c800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_sources= new_sources= 2024-09-12T00:57:17.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.052+0000 7fcabe32c800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential sources added=[] removed=[] 2024-09-12T00:57:17.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.052+0000 7fcabe32c800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_dests= new_dests= 2024-09-12T00:57:17.051 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.052+0000 7fcabe32c800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential dests added=[] removed=[] 2024-09-12T00:57:17.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.053+0000 7fcabe32c800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.0 2024-09-12T00:57:17.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.054+0000 7fcabe32c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:17.052 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.054+0000 7fcabe32c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 2024-09-12T00:57:17.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.055+0000 7fcabe32c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:17.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.055+0000 7fcabe32c800 10 moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:17.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.055+0000 7fcabe32c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:17.054 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.055+0000 7fcabe32c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18, ofs0, ns] 2024-09-12T00:57:17.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.055+0000 7fc99cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431593 cookie 94152392610720 notifier 8003 bl.length()=789 2024-09-12T00:57:17.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.055+0000 7fc99cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:17.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.055+0000 7fc99cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:17.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.055+0000 7fc99cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:17.055 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.057+0000 7fcabe32c800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_sources= new_sources= 2024-09-12T00:57:17.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.057+0000 7fcabe32c800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential sources added=[] removed=[] 2024-09-12T00:57:17.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.057+0000 7fcabe32c800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_dests= new_dests= 2024-09-12T00:57:17.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.057+0000 7fcabe32c800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential dests added=[] removed=[] 2024-09-12T00:57:17.056 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.058+0000 7fcabe32c800 1 execute INFO: reshard of bucket "myver" from 1 shards to 2 shards completed successfully 2024-09-12T00:57:17.059 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.060+0000 7fc96b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:17.061 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.063+0000 7fcabe32c800 20 remove_watcher() i=0 2024-09-12T00:57:17.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.063+0000 7fcabe32c800 2 removed watcher, disabling cache 2024-09-12T00:57:17.062 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.064+0000 7fcabe32c800 20 remove_watcher() i=1 2024-09-12T00:57:17.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.065+0000 7fcabe32c800 20 remove_watcher() i=2 2024-09-12T00:57:17.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.066+0000 7fcabe32c800 20 remove_watcher() i=3 2024-09-12T00:57:17.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.067+0000 7fcabe32c800 20 remove_watcher() i=4 2024-09-12T00:57:17.066 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.068+0000 7fcabe32c800 20 remove_watcher() i=5 2024-09-12T00:57:17.067 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.069+0000 7fcabe32c800 20 remove_watcher() i=6 2024-09-12T00:57:17.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.070+0000 7fcabe32c800 20 remove_watcher() i=7 2024-09-12T00:57:17.081 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:57:17.111 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:17.111 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:17.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.151+0000 7fca7c613800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.153+0000 7fca7c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:17.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.153+0000 7fca7c613800 20 realm 2024-09-12T00:57:17.152 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.153+0000 7fca7c613800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.153+0000 7fca7c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:17.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.153+0000 7fca7c613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:17.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.153+0000 7fca7c613800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.153+0000 7fca7c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:17.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.153+0000 7fca7c613800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.154+0000 7fca7c613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:17.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.154+0000 7fca7c613800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.155+0000 7fca7c613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:17.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.155+0000 7fca7c613800 20 searching for the correct realm 2024-09-12T00:57:17.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.158+0000 7fca6f547640 0 -- 172.21.15.62:0/4047415397 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fca70026400 msgr2=0x7fca70026860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:17.363 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.364+0000 7fca78549640 0 -- 172.21.15.62:0/4047415397 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x559651d68280 msgr2=0x559651d6a6d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:17.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.368+0000 7fca7c613800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:17.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.368+0000 7fca7c613800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:17.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.368+0000 7fca7c613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:17.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.368+0000 7fca7c613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:17.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.368+0000 7fca7c613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:17.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.368+0000 7fca7c613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:17.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.368+0000 7fca7c613800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.369+0000 7fca7c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:17.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.369+0000 7fca7c613800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.369+0000 7fca7c613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:17.368 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.369+0000 7fca7c613800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.369 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.369+0000 7fca7c613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:17.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.369+0000 7fca7c613800 20 zone default found 2024-09-12T00:57:17.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.369+0000 7fca7c613800 4 Realm: () 2024-09-12T00:57:17.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.369+0000 7fca7c613800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:17.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.369+0000 7fca7c613800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:17.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.369+0000 7fca7c613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:17.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.369+0000 7fca7c613800 20 zonegroup default 2024-09-12T00:57:17.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.369+0000 7fca7c613800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.370+0000 7fca7c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:17.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.370+0000 7fca7c613800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.370+0000 7fca7c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:17.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.370+0000 7fca7c613800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.370 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.370+0000 7fca7c613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:17.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.370+0000 7fca7c613800 20 started sync module instance, tier type = 2024-09-12T00:57:17.371 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.370+0000 7fca7c613800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:17.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.382+0000 7fca7c613800 20 add_watcher() i=0 2024-09-12T00:57:17.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.382+0000 7fca7c613800 20 add_watcher() i=1 2024-09-12T00:57:17.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.382+0000 7fca7c613800 20 add_watcher() i=2 2024-09-12T00:57:17.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.382+0000 7fca7c613800 20 add_watcher() i=3 2024-09-12T00:57:17.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.382+0000 7fca7c613800 20 add_watcher() i=4 2024-09-12T00:57:17.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.382+0000 7fca7c613800 20 add_watcher() i=5 2024-09-12T00:57:17.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.382+0000 7fca7c613800 20 add_watcher() i=6 2024-09-12T00:57:17.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.383+0000 7fca7c613800 20 add_watcher() i=7 2024-09-12T00:57:17.382 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.383+0000 7fca7c613800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:17.383 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.385+0000 7fc92dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:17.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.385+0000 7fca7c613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:17.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.385+0000 7fca7c613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:17.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.385+0000 7fca7c613800 5 note: GC not initialized 2024-09-12T00:57:17.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.385+0000 7fc92cfe1640 20 reqs_thread_entry: start 2024-09-12T00:57:17.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.385+0000 7fca7c613800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:17.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.385+0000 7fca7c613800 20 Filter name: none 2024-09-12T00:57:17.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.386+0000 7fc8a67fc640 20 reqs_thread_entry: start 2024-09-12T00:57:17.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.386+0000 7fca7c613800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.386+0000 7fca7c613800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:57:17.385 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.386+0000 7fca7c613800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.387+0000 7fca7c613800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:57:17.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.387+0000 7fca7c613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:17.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.387+0000 7fca7c613800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.387+0000 7fca7c613800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:57:17.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.387+0000 7fca7c613800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.388+0000 7fca7c613800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:57:17.387 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.388+0000 7fca7c613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:17.388 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.389+0000 7fc92dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:17.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.391+0000 7fca7c613800 20 remove_watcher() i=0 2024-09-12T00:57:17.390 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.391+0000 7fca7c613800 2 removed watcher, disabling cache 2024-09-12T00:57:17.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.393+0000 7fca7c613800 20 remove_watcher() i=1 2024-09-12T00:57:17.392 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.394+0000 7fca7c613800 20 remove_watcher() i=2 2024-09-12T00:57:17.393 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.395+0000 7fca7c613800 20 remove_watcher() i=3 2024-09-12T00:57:17.395 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.396+0000 7fca7c613800 20 remove_watcher() i=4 2024-09-12T00:57:17.396 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.397+0000 7fca7c613800 20 remove_watcher() i=5 2024-09-12T00:57:17.397 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.398+0000 7fca7c613800 20 remove_watcher() i=6 2024-09-12T00:57:17.398 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.399+0000 7fca7c613800 20 remove_watcher() i=7 2024-09-12T00:57:17.409 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:57:17.409 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:57:17.410 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: myver id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:57:17.410 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:57:17.489 INFO:tasks.workunit.client.0.smithi062.stderr: test: reshard removes olh entries with empty name 2024-09-12T00:57:17.792 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:57:17.823 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:17.824 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:17.862 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.863+0000 7f9a91eb7800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.865+0000 7f9a91eb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:17.864 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.865+0000 7f9a91eb7800 20 realm 2024-09-12T00:57:17.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.865+0000 7f9a91eb7800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.865+0000 7f9a91eb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:17.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.865+0000 7f9a91eb7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:17.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.865+0000 7f9a91eb7800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.865+0000 7f9a91eb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:17.865 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.865+0000 7f9a91eb7800 20 rados->read ofs=0 len=0 2024-09-12T00:57:17.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.866+0000 7f9a91eb7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:17.866 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:17.866+0000 7f9a91eb7800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.069+0000 7f9a91eb7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:18.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.069+0000 7f9a91eb7800 20 searching for the correct realm 2024-09-12T00:57:18.069 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.070+0000 7f9a8f9a1640 0 -- 172.21.15.62:0/1846932473 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7f9a88061040 msgr2=0x7f9a88055920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:18.275 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.276+0000 7f9a901a2640 0 -- 172.21.15.62:0/1846932473 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7f9a80046030 msgr2=0x7f9a80048970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:18.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.486+0000 7f9a91eb7800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:18.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.486+0000 7f9a91eb7800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:18.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.486+0000 7f9a91eb7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:18.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.486+0000 7f9a91eb7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:18.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.486+0000 7f9a91eb7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:18.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.486+0000 7f9a91eb7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:18.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.486+0000 7f9a91eb7800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.487+0000 7f9a91eb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:18.486 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.487+0000 7f9a91eb7800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.487+0000 7f9a91eb7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:18.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.487+0000 7f9a91eb7800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.488+0000 7f9a91eb7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:18.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.488+0000 7f9a91eb7800 20 zone default found 2024-09-12T00:57:18.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.488+0000 7f9a91eb7800 4 Realm: () 2024-09-12T00:57:18.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.488+0000 7f9a91eb7800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:18.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.488+0000 7f9a91eb7800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:18.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.488+0000 7f9a91eb7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:18.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.488+0000 7f9a91eb7800 20 zonegroup default 2024-09-12T00:57:18.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.488+0000 7f9a91eb7800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.488 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.488+0000 7f9a91eb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:18.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.488+0000 7f9a91eb7800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.489+0000 7f9a91eb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:18.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.489+0000 7f9a91eb7800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.489+0000 7f9a91eb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:18.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.489+0000 7f9a91eb7800 20 started sync module instance, tier type = 2024-09-12T00:57:18.489 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.489+0000 7f9a91eb7800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:18.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.501+0000 7f9a91eb7800 20 add_watcher() i=0 2024-09-12T00:57:18.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.501+0000 7f9a91eb7800 20 add_watcher() i=1 2024-09-12T00:57:18.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.501+0000 7f9a91eb7800 20 add_watcher() i=2 2024-09-12T00:57:18.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.501+0000 7f9a91eb7800 20 add_watcher() i=3 2024-09-12T00:57:18.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.501+0000 7f9a91eb7800 20 add_watcher() i=4 2024-09-12T00:57:18.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.501+0000 7f9a91eb7800 20 add_watcher() i=5 2024-09-12T00:57:18.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.501+0000 7f9a91eb7800 20 add_watcher() i=6 2024-09-12T00:57:18.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.502+0000 7f9a91eb7800 20 add_watcher() i=7 2024-09-12T00:57:18.501 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.502+0000 7f9a91eb7800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:18.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.504+0000 7f9945fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:18.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.505+0000 7f9a91eb7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:18.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.505+0000 7f9a91eb7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:18.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.505+0000 7f9a91eb7800 5 note: GC not initialized 2024-09-12T00:57:18.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.505+0000 7f9944fe1640 20 reqs_thread_entry: start 2024-09-12T00:57:18.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.505+0000 7f9a91eb7800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:18.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.505+0000 7f9a91eb7800 20 Filter name: none 2024-09-12T00:57:18.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.505+0000 7f98be7fc640 20 reqs_thread_entry: start 2024-09-12T00:57:18.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.506+0000 7f9a91eb7800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.506+0000 7f9a91eb7800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:57:18.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.506+0000 7f9a91eb7800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.507+0000 7f9a91eb7800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:57:18.506 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.507+0000 7f9a91eb7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:18.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.507+0000 7f9a91eb7800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.507+0000 7f9a91eb7800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:57:18.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.507+0000 7f9a91eb7800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.507+0000 7f9a91eb7800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:57:18.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.507+0000 7f9a91eb7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:18.508 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.509+0000 7f9945fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:18.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.512+0000 7f9a91eb7800 20 remove_watcher() i=0 2024-09-12T00:57:18.511 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.512+0000 7f9a91eb7800 2 removed watcher, disabling cache 2024-09-12T00:57:18.512 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.513+0000 7f9a91eb7800 20 remove_watcher() i=1 2024-09-12T00:57:18.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.514+0000 7f9a91eb7800 20 remove_watcher() i=2 2024-09-12T00:57:18.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.515+0000 7f9a91eb7800 20 remove_watcher() i=3 2024-09-12T00:57:18.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.517+0000 7f9a91eb7800 20 remove_watcher() i=4 2024-09-12T00:57:18.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.518+0000 7f9a91eb7800 20 remove_watcher() i=5 2024-09-12T00:57:18.518 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.519+0000 7f9a91eb7800 20 remove_watcher() i=6 2024-09-12T00:57:18.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.520+0000 7f9a91eb7800 20 remove_watcher() i=7 2024-09-12T00:57:18.532 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:57:18.532 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:57:18.532 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: a-bucket id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 num_objects: 0 size_kb: 0 num_shards: 3 2024-09-12T00:57:18.533 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:57:18.534 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T00:57:18.566 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:18.566 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:18.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.609+0000 7f32dd887800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.611+0000 7f32dd887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:18.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.611+0000 7f32dd887800 20 realm 2024-09-12T00:57:18.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.611+0000 7f32dd887800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.611+0000 7f32dd887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:18.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.611+0000 7f32dd887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:18.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.611+0000 7f32dd887800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.611+0000 7f32dd887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:18.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.611+0000 7f32dd887800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.612+0000 7f32dd887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:18.612 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.612+0000 7f32dd887800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.612 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.613+0000 7f32dd887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:18.612 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.613+0000 7f32dd887800 20 searching for the correct realm 2024-09-12T00:57:18.614 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.616+0000 7f32dab70640 0 -- 172.21.15.62:0/638643944 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f32d4036420 msgr2=0x7f32d4036880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:18.820 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.821+0000 7f32dbb72640 0 -- 172.21.15.62:0/638643944 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5620b87156f0 msgr2=0x5620b8717b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:18.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.826+0000 7f32dd887800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:18.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.826+0000 7f32dd887800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:18.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.826+0000 7f32dd887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:18.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.826+0000 7f32dd887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:18.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.826+0000 7f32dd887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:18.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.826+0000 7f32dd887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:18.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.826+0000 7f32dd887800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.826+0000 7f32dd887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:18.825 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.826+0000 7f32dd887800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.826+0000 7f32dd887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:18.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.826+0000 7f32dd887800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.827+0000 7f32dd887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:18.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.827+0000 7f32dd887800 20 zone default found 2024-09-12T00:57:18.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.827+0000 7f32dd887800 4 Realm: () 2024-09-12T00:57:18.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.827+0000 7f32dd887800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:18.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.827+0000 7f32dd887800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:18.827 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.827+0000 7f32dd887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:18.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.827+0000 7f32dd887800 20 zonegroup default 2024-09-12T00:57:18.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.827+0000 7f32dd887800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.827+0000 7f32dd887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:18.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.827+0000 7f32dd887800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.827+0000 7f32dd887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:18.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.827+0000 7f32dd887800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.828+0000 7f32dd887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:18.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.828+0000 7f32dd887800 20 started sync module instance, tier type = 2024-09-12T00:57:18.828 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.828+0000 7f32dd887800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:18.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.838+0000 7f32dd887800 20 add_watcher() i=0 2024-09-12T00:57:18.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.838+0000 7f32dd887800 20 add_watcher() i=1 2024-09-12T00:57:18.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.838+0000 7f32dd887800 20 add_watcher() i=2 2024-09-12T00:57:18.837 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.838+0000 7f32dd887800 20 add_watcher() i=3 2024-09-12T00:57:18.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.838+0000 7f32dd887800 20 add_watcher() i=4 2024-09-12T00:57:18.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.838+0000 7f32dd887800 20 add_watcher() i=5 2024-09-12T00:57:18.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.838+0000 7f32dd887800 20 add_watcher() i=6 2024-09-12T00:57:18.838 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.839+0000 7f32dd887800 20 add_watcher() i=7 2024-09-12T00:57:18.839 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.839+0000 7f32dd887800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:18.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.841+0000 7f3191fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:18.843 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.842+0000 7f32dd887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:18.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.842+0000 7f32dd887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:18.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.842+0000 7f32dd887800 5 note: GC not initialized 2024-09-12T00:57:18.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.842+0000 7f3190fe1640 20 reqs_thread_entry: start 2024-09-12T00:57:18.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.842+0000 7f32dd887800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:18.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.842+0000 7f32dd887800 20 Filter name: none 2024-09-12T00:57:18.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.842+0000 7f310a7fc640 20 reqs_thread_entry: start 2024-09-12T00:57:18.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.842+0000 7f32dd887800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.844 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.843+0000 7f32dd887800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:57:18.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.843+0000 7f32dd887800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.843+0000 7f32dd887800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:57:18.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.843+0000 7f32dd887800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:18.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.844+0000 7f3191fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:18.845 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.846+0000 7f32dd887800 20 remove_watcher() i=0 2024-09-12T00:57:18.846 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.846+0000 7f32dd887800 2 removed watcher, disabling cache 2024-09-12T00:57:18.847 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.848+0000 7f32dd887800 20 remove_watcher() i=1 2024-09-12T00:57:18.848 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.849+0000 7f32dd887800 20 remove_watcher() i=2 2024-09-12T00:57:18.849 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.850+0000 7f32dd887800 20 remove_watcher() i=3 2024-09-12T00:57:18.850 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.851+0000 7f32dd887800 20 remove_watcher() i=4 2024-09-12T00:57:18.851 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.852+0000 7f32dd887800 20 remove_watcher() i=5 2024-09-12T00:57:18.852 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.854+0000 7f32dd887800 20 remove_watcher() i=6 2024-09-12T00:57:18.853 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.855+0000 7f32dd887800 20 remove_watcher() i=7 2024-09-12T00:57:18.866 INFO:tasks.workunit.client.0.smithi062.stderr:rados -p default.rgw.buckets.index setomapval .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T00:57:18.893 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:18.893 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:18.910 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:57:18.939 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:18.939 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:18.977 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.978+0000 7f3c93011800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.980+0000 7f3c93011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:18.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.980+0000 7f3c93011800 20 realm 2024-09-12T00:57:18.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.980+0000 7f3c93011800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.980+0000 7f3c93011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:18.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.980+0000 7f3c93011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:18.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.980+0000 7f3c93011800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.981+0000 7f3c93011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:18.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.981+0000 7f3c93011800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.981+0000 7f3c93011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:18.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.981+0000 7f3c93011800 20 rados->read ofs=0 len=0 2024-09-12T00:57:18.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.982+0000 7f3c93011800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:18.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.982+0000 7f3c93011800 20 searching for the correct realm 2024-09-12T00:57:18.984 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:18.985+0000 7f3c8df21640 0 -- 172.21.15.62:0/318256770 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f3c8807e460 msgr2=0x7f3c8807e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:19.192 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.190+0000 7f3c8ef23640 0 -- 172.21.15.62:0/318256770 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55b4bd547f80 msgr2=0x55b4bd54a3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:19.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.195+0000 7f3c93011800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:19.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.195+0000 7f3c93011800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:19.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.195+0000 7f3c93011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:19.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.195+0000 7f3c93011800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:19.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.195+0000 7f3c93011800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:19.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.195+0000 7f3c93011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:19.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.195+0000 7f3c93011800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.195+0000 7f3c93011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.195+0000 7f3c93011800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.195+0000 7f3c93011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:19.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.195+0000 7f3c93011800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.195+0000 7f3c93011800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:19.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.196+0000 7f3c93011800 20 zone default found 2024-09-12T00:57:19.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.196+0000 7f3c93011800 4 Realm: () 2024-09-12T00:57:19.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.196+0000 7f3c93011800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:19.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.196+0000 7f3c93011800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:19.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.196+0000 7f3c93011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:19.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.196+0000 7f3c93011800 20 zonegroup default 2024-09-12T00:57:19.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.196+0000 7f3c93011800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.196+0000 7f3c93011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.196+0000 7f3c93011800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.196+0000 7f3c93011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.196+0000 7f3c93011800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.196+0000 7f3c93011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.196+0000 7f3c93011800 20 started sync module instance, tier type = 2024-09-12T00:57:19.197 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.196+0000 7f3c93011800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:19.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.205+0000 7f3c93011800 20 add_watcher() i=0 2024-09-12T00:57:19.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.205+0000 7f3c93011800 20 add_watcher() i=1 2024-09-12T00:57:19.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.205+0000 7f3c93011800 20 add_watcher() i=2 2024-09-12T00:57:19.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.205+0000 7f3c93011800 20 add_watcher() i=3 2024-09-12T00:57:19.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.205+0000 7f3c93011800 20 add_watcher() i=4 2024-09-12T00:57:19.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.205+0000 7f3c93011800 20 add_watcher() i=5 2024-09-12T00:57:19.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.206+0000 7f3c93011800 20 add_watcher() i=6 2024-09-12T00:57:19.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.206+0000 7f3c93011800 20 add_watcher() i=7 2024-09-12T00:57:19.205 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.206+0000 7f3c93011800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:19.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.209+0000 7f3b44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:19.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.209+0000 7f3c93011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:19.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.209+0000 7f3c93011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:19.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.209+0000 7f3c93011800 5 note: GC not initialized 2024-09-12T00:57:19.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.209+0000 7f3abf7fe640 20 reqs_thread_entry: start 2024-09-12T00:57:19.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.209+0000 7f3c93011800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:19.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.209+0000 7f3c93011800 20 Filter name: none 2024-09-12T00:57:19.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.209+0000 7f3abd7fa640 20 reqs_thread_entry: start 2024-09-12T00:57:19.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.209+0000 7f3c93011800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.210+0000 7f3c93011800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:57:19.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.210+0000 7f3c93011800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.210+0000 7f3c93011800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:57:19.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.210+0000 7f3c93011800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:19.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.210+0000 7f3c93011800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:57:19.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.210+0000 7f3c93011800 20 INFO: main: starting shard=0 2024-09-12T00:57:19.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.210+0000 7f3c93011800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:57:19.210 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.210+0000 7f3c93011800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:57:19.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.211+0000 7f3c93011800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:57:19.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.211+0000 7f3c93011800 20 INFO: main: starting shard=1 2024-09-12T00:57:19.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.211+0000 7f3c93011800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:57:19.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.211+0000 7f3c93011800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:57:19.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.211+0000 7f3c93011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:57:19.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.211+0000 7f3c93011800 20 INFO: main: starting shard=2 2024-09-12T00:57:19.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.211+0000 7f3c93011800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:57:19.211 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.211+0000 7f3c93011800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:57:19.212 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.212+0000 7f3c93011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:57:19.212 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.212+0000 7f3c93011800 20 INFO: main: done 2024-09-12T00:57:19.212 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.212+0000 7f3b44fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:19.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.215+0000 7f3c93011800 20 remove_watcher() i=0 2024-09-12T00:57:19.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.215+0000 7f3c93011800 2 removed watcher, disabling cache 2024-09-12T00:57:19.215 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.216+0000 7f3c93011800 20 remove_watcher() i=1 2024-09-12T00:57:19.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.217+0000 7f3c93011800 20 remove_watcher() i=2 2024-09-12T00:57:19.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.218+0000 7f3c93011800 20 remove_watcher() i=3 2024-09-12T00:57:19.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.219+0000 7f3c93011800 20 remove_watcher() i=4 2024-09-12T00:57:19.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.221+0000 7f3c93011800 20 remove_watcher() i=5 2024-09-12T00:57:19.221 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.222+0000 7f3c93011800 20 remove_watcher() i=6 2024-09-12T00:57:19.222 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.223+0000 7f3c93011800 20 remove_watcher() i=7 2024-09-12T00:57:19.235 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T00:57:19.267 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:19.267 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:19.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.307+0000 7f9561e14800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.309+0000 7f9561e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.309+0000 7f9561e14800 20 realm 2024-09-12T00:57:19.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.309+0000 7f9561e14800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.309+0000 7f9561e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.309+0000 7f9561e14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:19.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.309+0000 7f9561e14800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.309+0000 7f9561e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.309+0000 7f9561e14800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.310+0000 7f9561e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:19.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.310+0000 7f9561e14800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.311+0000 7f9561e14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:19.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.311+0000 7f9561e14800 20 searching for the correct realm 2024-09-12T00:57:19.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.314+0000 7f955ccca640 0 -- 172.21.15.62:0/2853873402 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f9558061040 msgr2=0x7f955807e400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:19.519 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.520+0000 7f955dccc640 0 -- 172.21.15.62:0/2853873402 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5614a59e72b0 msgr2=0x5614a59e96c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:19.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.524+0000 7f9561e14800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:19.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.524+0000 7f9561e14800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:19.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.524+0000 7f9561e14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:19.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.524+0000 7f9561e14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:19.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.524+0000 7f9561e14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:19.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.524+0000 7f9561e14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:19.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.524+0000 7f9561e14800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.524+0000 7f9561e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.524+0000 7f9561e14800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.525+0000 7f9561e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:19.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.525+0000 7f9561e14800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.525+0000 7f9561e14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:19.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.525+0000 7f9561e14800 20 zone default found 2024-09-12T00:57:19.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.525+0000 7f9561e14800 4 Realm: () 2024-09-12T00:57:19.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.525+0000 7f9561e14800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:19.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.525+0000 7f9561e14800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:19.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.525+0000 7f9561e14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:19.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.525+0000 7f9561e14800 20 zonegroup default 2024-09-12T00:57:19.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.525+0000 7f9561e14800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.525+0000 7f9561e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.525+0000 7f9561e14800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.526+0000 7f9561e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.526+0000 7f9561e14800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.526+0000 7f9561e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.526+0000 7f9561e14800 20 started sync module instance, tier type = 2024-09-12T00:57:19.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.526+0000 7f9561e14800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:19.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.535+0000 7f9561e14800 20 add_watcher() i=0 2024-09-12T00:57:19.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.535+0000 7f9561e14800 20 add_watcher() i=1 2024-09-12T00:57:19.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.535+0000 7f9561e14800 20 add_watcher() i=2 2024-09-12T00:57:19.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.535+0000 7f9561e14800 20 add_watcher() i=3 2024-09-12T00:57:19.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.535+0000 7f9561e14800 20 add_watcher() i=4 2024-09-12T00:57:19.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.535+0000 7f9561e14800 20 add_watcher() i=5 2024-09-12T00:57:19.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.536+0000 7f9561e14800 20 add_watcher() i=6 2024-09-12T00:57:19.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.536+0000 7f9561e14800 20 add_watcher() i=7 2024-09-12T00:57:19.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.536+0000 7f9561e14800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:19.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.538+0000 7f9413fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:19.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.539+0000 7f9561e14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:19.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.539+0000 7f9561e14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:19.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.539+0000 7f9561e14800 5 note: GC not initialized 2024-09-12T00:57:19.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.539+0000 7f9412fe5640 20 reqs_thread_entry: start 2024-09-12T00:57:19.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.539+0000 7f9561e14800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:19.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.539+0000 7f9561e14800 20 Filter name: none 2024-09-12T00:57:19.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.539+0000 7f9410fe1640 20 reqs_thread_entry: start 2024-09-12T00:57:19.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.539+0000 7f9561e14800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:57:19.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.539+0000 7f9561e14800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.540+0000 7f9561e14800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:57:19.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.540+0000 7f9561e14800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:57:19.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.540+0000 7f9561e14800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:57:19.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.540+0000 7f9561e14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : miss 2024-09-12T00:57:19.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.540+0000 7f9561e14800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.540+0000 7f9561e14800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:57:19.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.540+0000 7f9561e14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:57:19.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.540+0000 7f9561e14800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:57:19.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.540+0000 7f9561e14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:19.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.540+0000 7f9561e14800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:19.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.540+0000 7f9561e14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:57:19.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.544+0000 7f9561e14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:57:19.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.544+0000 7f9561e14800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:57:19.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.544+0000 7f9561e14800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:19.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.544+0000 7f9561e14800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:57:19.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.544+0000 7f942ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431692 cookie 94646678023536 notifier 8093 bl.length()=827 2024-09-12T00:57:19.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.544+0000 7f942ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:57:19.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.544+0000 7f942ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:57:19.544 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.544+0000 7f942ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:19.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.546+0000 7f9561e14800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:57:19.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.546+0000 7f9561e14800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:57:19.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.546+0000 7f9561e14800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:57:19.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.546+0000 7f9561e14800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:57:19.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.549+0000 7f9561e14800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.0 2024-09-12T00:57:19.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.549+0000 7f9561e14800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.0 2024-09-12T00:57:19.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.549+0000 7f9561e14800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:57:19.548 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.549+0000 7f9561e14800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:57:19.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.550+0000 7f9561e14800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T00:57:19.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.550+0000 7f9561e14800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:57:19.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.550+0000 7f9561e14800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:57:19.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.550+0000 7f9561e14800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:57:19.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.550+0000 7f9561e14800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:57:19.550 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.551+0000 7f9561e14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:19.550 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.551+0000 7f9561e14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:57:19.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.552+0000 7f9561e14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:57:19.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.552+0000 7f9561e14800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:57:19.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.552+0000 7f9561e14800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:19.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.552+0000 7f9561e14800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:57:19.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.553+0000 7f9440ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431693 cookie 94646678023536 notifier 8093 bl.length()=827 2024-09-12T00:57:19.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.553+0000 7f9440ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:57:19.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.553+0000 7f9440ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:57:19.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.553+0000 7f9440ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:19.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.554+0000 7f9561e14800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:57:19.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.554+0000 7f9561e14800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:57:19.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.554+0000 7f9561e14800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:57:19.553 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.554+0000 7f9561e14800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:57:19.554 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.556+0000 7f9561e14800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:57:19.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.556+0000 7f9561e14800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.0 2024-09-12T00:57:19.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.556+0000 7f9561e14800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:57:19.555 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.556+0000 7f9561e14800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.1 2024-09-12T00:57:19.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.556+0000 7f9561e14800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:57:19.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.556+0000 7f9561e14800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.2.2 2024-09-12T00:57:19.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.557+0000 7f9561e14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:19.556 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.557+0000 7f9561e14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 2024-09-12T00:57:19.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.558+0000 7f9561e14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:57:19.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.558+0000 7f9561e14800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:57:19.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.558+0000 7f9561e14800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:19.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.558+0000 7f9561e14800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17, ofs0, ns] 2024-09-12T00:57:19.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.558+0000 7f942ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431694 cookie 94646678023536 notifier 8093 bl.length()=795 2024-09-12T00:57:19.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.558+0000 7f942ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 info.flags=0x17 2024-09-12T00:57:19.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.558+0000 7f942ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17 to cache LRU end 2024-09-12T00:57:19.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.558+0000 7f942ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:19.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.560+0000 7f9561e14800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_sources= new_sources= 2024-09-12T00:57:19.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.560+0000 7f9561e14800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential sources added=[] removed=[] 2024-09-12T00:57:19.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.560+0000 7f9561e14800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): orig_dests= new_dests= 2024-09-12T00:57:19.559 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.560+0000 7f9561e14800 20 handle_bi_update(): bucket=:a-bucket[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17]): potential dests added=[] removed=[] 2024-09-12T00:57:19.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.561+0000 7f9561e14800 1 execute INFO: reshard of bucket "a-bucket" from 3 shards to 1 shards completed successfully 2024-09-12T00:57:19.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.563+0000 7f9413fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:19.564 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.566+0000 7f9561e14800 20 remove_watcher() i=0 2024-09-12T00:57:19.564 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.566+0000 7f9561e14800 2 removed watcher, disabling cache 2024-09-12T00:57:19.565 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.567+0000 7f9561e14800 20 remove_watcher() i=1 2024-09-12T00:57:19.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.568+0000 7f9561e14800 20 remove_watcher() i=2 2024-09-12T00:57:19.567 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.569+0000 7f9561e14800 20 remove_watcher() i=3 2024-09-12T00:57:19.568 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.570+0000 7f9561e14800 20 remove_watcher() i=4 2024-09-12T00:57:19.569 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.571+0000 7f9561e14800 20 remove_watcher() i=5 2024-09-12T00:57:19.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.572+0000 7f9561e14800 20 remove_watcher() i=6 2024-09-12T00:57:19.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.573+0000 7f9561e14800 20 remove_watcher() i=7 2024-09-12T00:57:19.584 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:57:19.613 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:19.613 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:19.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.654+0000 7f35244bb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.655+0000 7f35244bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.655+0000 7f35244bb800 20 realm 2024-09-12T00:57:19.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.655+0000 7f35244bb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.655+0000 7f35244bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.655+0000 7f35244bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:19.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.655+0000 7f35244bb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.656+0000 7f35244bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.656+0000 7f35244bb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.656+0000 7f35244bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:19.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.656+0000 7f35244bb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.657+0000 7f35244bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:19.656 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.657+0000 7f35244bb800 20 searching for the correct realm 2024-09-12T00:57:19.659 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.660+0000 7f35217a4640 0 -- 172.21.15.62:0/789115225 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f351c0b8ed0 msgr2=0x7f351c0bb5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:19.863 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.864+0000 7f35217a4640 0 -- 172.21.15.62:0/789115225 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x560ce6b0b180 msgr2=0x560ce6b0d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:19.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:19.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:19.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:19.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:19.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:19.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:19.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.868 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:19.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:19.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 20 zone default found 2024-09-12T00:57:19.869 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 4 Realm: () 2024-09-12T00:57:19.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:19.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:19.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:19.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 20 zonegroup default 2024-09-12T00:57:19.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.869+0000 7f35244bb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.870+0000 7f35244bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.870+0000 7f35244bb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.870+0000 7f35244bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.870 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.870+0000 7f35244bb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.871 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.871+0000 7f35244bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.871 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.871+0000 7f35244bb800 20 started sync module instance, tier type = 2024-09-12T00:57:19.871 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.871+0000 7f35244bb800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:19.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.880+0000 7f35244bb800 20 add_watcher() i=0 2024-09-12T00:57:19.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.880+0000 7f35244bb800 20 add_watcher() i=1 2024-09-12T00:57:19.879 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.880+0000 7f35244bb800 20 add_watcher() i=2 2024-09-12T00:57:19.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.880+0000 7f35244bb800 20 add_watcher() i=3 2024-09-12T00:57:19.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.880+0000 7f35244bb800 20 add_watcher() i=4 2024-09-12T00:57:19.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.880+0000 7f35244bb800 20 add_watcher() i=5 2024-09-12T00:57:19.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.880+0000 7f35244bb800 20 add_watcher() i=6 2024-09-12T00:57:19.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.881+0000 7f35244bb800 20 add_watcher() i=7 2024-09-12T00:57:19.880 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.881+0000 7f35244bb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:19.882 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.883+0000 7f33d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:19.882 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.884+0000 7f35244bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:19.883 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.884+0000 7f35244bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:19.883 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.884+0000 7f35244bb800 5 note: GC not initialized 2024-09-12T00:57:19.884 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.884+0000 7f33d27fc640 20 reqs_thread_entry: start 2024-09-12T00:57:19.884 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.884+0000 7f35244bb800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:19.884 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.884+0000 7f35244bb800 20 Filter name: none 2024-09-12T00:57:19.884 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.884+0000 7f3347fff640 20 reqs_thread_entry: start 2024-09-12T00:57:19.884 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.884+0000 7f35244bb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.884 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.885+0000 7f35244bb800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:57:19.884 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.885+0000 7f35244bb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.885+0000 7f35244bb800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:57:19.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.885+0000 7f35244bb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:19.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.885+0000 7f35244bb800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T00:57:19.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.885+0000 7f35244bb800 20 INFO: main: starting shard=0 2024-09-12T00:57:19.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.885+0000 7f35244bb800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.0 2024-09-12T00:57:19.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.885+0000 7f35244bb800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17.3.0 2024-09-12T00:57:19.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.886+0000 7f35244bb800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:57:19.885 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.886+0000 7f35244bb800 20 INFO: main: done 2024-09-12T00:57:19.886 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.887+0000 7f33d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:19.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.890+0000 7f35244bb800 20 remove_watcher() i=0 2024-09-12T00:57:19.888 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.890+0000 7f35244bb800 2 removed watcher, disabling cache 2024-09-12T00:57:19.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.891+0000 7f35244bb800 20 remove_watcher() i=1 2024-09-12T00:57:19.890 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.892+0000 7f35244bb800 20 remove_watcher() i=2 2024-09-12T00:57:19.891 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.893+0000 7f35244bb800 20 remove_watcher() i=3 2024-09-12T00:57:19.892 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.894+0000 7f35244bb800 20 remove_watcher() i=4 2024-09-12T00:57:19.894 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.895+0000 7f35244bb800 20 remove_watcher() i=5 2024-09-12T00:57:19.895 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.896+0000 7f35244bb800 20 remove_watcher() i=6 2024-09-12T00:57:19.896 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.897+0000 7f35244bb800 20 remove_watcher() i=7 2024-09-12T00:57:19.906 INFO:tasks.workunit.client.0.smithi062.stderr: test: PUT succeeds during reshard 2024-09-12T00:57:19.908 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:57:19.937 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:19.938 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:19.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.977+0000 7f0e91abb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.980+0000 7f0e91abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.980+0000 7f0e91abb800 20 realm 2024-09-12T00:57:19.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.980+0000 7f0e91abb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.980+0000 7f0e91abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.980+0000 7f0e91abb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:19.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.980+0000 7f0e91abb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.980+0000 7f0e91abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:19.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.980+0000 7f0e91abb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.981+0000 7f0e91abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:19.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.981+0000 7f0e91abb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:19.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.981+0000 7f0e91abb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:19.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.981+0000 7f0e91abb800 20 searching for the correct realm 2024-09-12T00:57:19.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:19.984+0000 7f0e8eda4640 0 -- 172.21.15.62:0/3135047995 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f0e88084430 msgr2=0x7f0e880848b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:20.188 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.189+0000 7f0e8fda6640 0 -- 172.21.15.62:0/3135047995 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5557dea05830 msgr2=0x5557dea07ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:20.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.193+0000 7f0e91abb800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:20.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.193+0000 7f0e91abb800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:20.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.193+0000 7f0e91abb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:20.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.193+0000 7f0e91abb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:20.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.193+0000 7f0e91abb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:20.193 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.193+0000 7f0e91abb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:20.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.193+0000 7f0e91abb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.193+0000 7f0e91abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:20.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.193+0000 7f0e91abb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.194+0000 7f0e91abb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:20.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.194+0000 7f0e91abb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.194+0000 7f0e91abb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:20.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.194+0000 7f0e91abb800 20 zone default found 2024-09-12T00:57:20.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.194+0000 7f0e91abb800 4 Realm: () 2024-09-12T00:57:20.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.194+0000 7f0e91abb800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:20.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.194+0000 7f0e91abb800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:20.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.194+0000 7f0e91abb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:20.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.194+0000 7f0e91abb800 20 zonegroup default 2024-09-12T00:57:20.194 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.194+0000 7f0e91abb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.194+0000 7f0e91abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:20.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.194+0000 7f0e91abb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.195+0000 7f0e91abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:20.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.195+0000 7f0e91abb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.195+0000 7f0e91abb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:20.195 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.195+0000 7f0e91abb800 20 started sync module instance, tier type = 2024-09-12T00:57:20.196 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.195+0000 7f0e91abb800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:20.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.205+0000 7f0e91abb800 20 add_watcher() i=0 2024-09-12T00:57:20.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.205+0000 7f0e91abb800 20 add_watcher() i=1 2024-09-12T00:57:20.203 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.205+0000 7f0e91abb800 20 add_watcher() i=2 2024-09-12T00:57:20.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.205+0000 7f0e91abb800 20 add_watcher() i=3 2024-09-12T00:57:20.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.205+0000 7f0e91abb800 20 add_watcher() i=4 2024-09-12T00:57:20.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.205+0000 7f0e91abb800 20 add_watcher() i=5 2024-09-12T00:57:20.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.205+0000 7f0e91abb800 20 add_watcher() i=6 2024-09-12T00:57:20.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.206+0000 7f0e91abb800 20 add_watcher() i=7 2024-09-12T00:57:20.204 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.206+0000 7f0e91abb800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:20.206 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.207+0000 7f0d45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:20.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.207+0000 7f0e91abb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:20.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.207+0000 7f0e91abb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:20.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.207+0000 7f0e91abb800 5 note: GC not initialized 2024-09-12T00:57:20.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.208+0000 7f0d44fe1640 20 reqs_thread_entry: start 2024-09-12T00:57:20.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.208+0000 7f0e91abb800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:20.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.208+0000 7f0e91abb800 20 Filter name: none 2024-09-12T00:57:20.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.208+0000 7f0cbe7fc640 20 reqs_thread_entry: start 2024-09-12T00:57:20.207 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.208+0000 7f0e91abb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.208 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.208+0000 7f0e91abb800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:57:20.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.208+0000 7f0e91abb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.209+0000 7f0e91abb800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:57:20.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.209+0000 7f0e91abb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:20.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.209+0000 7f0e91abb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.209+0000 7f0e91abb800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:57:20.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.209+0000 7f0e91abb800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.210+0000 7f0e91abb800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:57:20.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.210+0000 7f0e91abb800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:20.209 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.211+0000 7f0d45fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:20.212 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.213+0000 7f0e91abb800 20 remove_watcher() i=0 2024-09-12T00:57:20.212 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.213+0000 7f0e91abb800 2 removed watcher, disabling cache 2024-09-12T00:57:20.213 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.214+0000 7f0e91abb800 20 remove_watcher() i=1 2024-09-12T00:57:20.214 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.215+0000 7f0e91abb800 20 remove_watcher() i=2 2024-09-12T00:57:20.215 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.216+0000 7f0e91abb800 20 remove_watcher() i=3 2024-09-12T00:57:20.216 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.217+0000 7f0e91abb800 20 remove_watcher() i=4 2024-09-12T00:57:20.217 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.218+0000 7f0e91abb800 20 remove_watcher() i=5 2024-09-12T00:57:20.218 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.219+0000 7f0e91abb800 20 remove_watcher() i=6 2024-09-12T00:57:20.219 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.220+0000 7f0e91abb800 20 remove_watcher() i=7 2024-09-12T00:57:20.230 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:57:20.230 INFO:tasks.workunit.client.0.smithi062.stderr:BUCKET_STATS: 2024-09-12T00:57:20.231 INFO:tasks.workunit.client.0.smithi062.stderr:bucket: myver id: 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-12T00:57:20.231 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:57:20.232 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-09-12T00:57:20.265 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:20.265 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:20.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.305+0000 7fa924d31800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.307+0000 7fa924d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:20.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.307+0000 7fa924d31800 20 realm 2024-09-12T00:57:20.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.307+0000 7fa924d31800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.307+0000 7fa924d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:20.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.307+0000 7fa924d31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:20.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.308+0000 7fa924d31800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.308+0000 7fa924d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:20.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.308+0000 7fa924d31800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.308+0000 7fa924d31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:20.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.308+0000 7fa924d31800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.309+0000 7fa924d31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:20.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.309+0000 7fa924d31800 20 searching for the correct realm 2024-09-12T00:57:20.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.312+0000 7fa920219640 0 -- 172.21.15.62:0/1168230631 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fa91800f430 msgr2=0x7fa91800f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:20.517 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.517+0000 7fa92121b640 0 -- 172.21.15.62:0/1168230631 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x56100e7ca2f0 msgr2=0x56100e7cc780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:20.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.522+0000 7fa924d31800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:20.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.522+0000 7fa924d31800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:20.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.522+0000 7fa924d31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:20.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.522+0000 7fa924d31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:20.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.522+0000 7fa924d31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:20.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.522+0000 7fa924d31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:20.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.522+0000 7fa924d31800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.522+0000 7fa924d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:20.521 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.522+0000 7fa924d31800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.522 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.522+0000 7fa924d31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:20.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.522+0000 7fa924d31800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.522+0000 7fa924d31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:20.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.523+0000 7fa924d31800 20 zone default found 2024-09-12T00:57:20.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.523+0000 7fa924d31800 4 Realm: () 2024-09-12T00:57:20.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.523+0000 7fa924d31800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:20.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.523+0000 7fa924d31800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:20.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.523+0000 7fa924d31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:20.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.523+0000 7fa924d31800 20 zonegroup default 2024-09-12T00:57:20.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.523+0000 7fa924d31800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.523+0000 7fa924d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:20.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.523+0000 7fa924d31800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.523+0000 7fa924d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:20.523 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.523+0000 7fa924d31800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.523+0000 7fa924d31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:20.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.523+0000 7fa924d31800 20 started sync module instance, tier type = 2024-09-12T00:57:20.524 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.523+0000 7fa924d31800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:20.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.533+0000 7fa924d31800 20 add_watcher() i=0 2024-09-12T00:57:20.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.533+0000 7fa924d31800 20 add_watcher() i=1 2024-09-12T00:57:20.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.533+0000 7fa924d31800 20 add_watcher() i=2 2024-09-12T00:57:20.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.533+0000 7fa924d31800 20 add_watcher() i=3 2024-09-12T00:57:20.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.533+0000 7fa924d31800 20 add_watcher() i=4 2024-09-12T00:57:20.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.533+0000 7fa924d31800 20 add_watcher() i=5 2024-09-12T00:57:20.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.533+0000 7fa924d31800 20 add_watcher() i=6 2024-09-12T00:57:20.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.534+0000 7fa924d31800 20 add_watcher() i=7 2024-09-12T00:57:20.533 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.534+0000 7fa924d31800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:20.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.536+0000 7fa7d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:20.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.536+0000 7fa924d31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:20.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.536+0000 7fa924d31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:20.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.536+0000 7fa924d31800 5 note: GC not initialized 2024-09-12T00:57:20.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.536+0000 7fa7d5fe3640 20 reqs_thread_entry: start 2024-09-12T00:57:20.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.536+0000 7fa924d31800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:20.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.537+0000 7fa924d31800 20 Filter name: none 2024-09-12T00:57:20.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.537+0000 7fa7477fe640 20 reqs_thread_entry: start 2024-09-12T00:57:20.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.537+0000 7fa924d31800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:57:20.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.537+0000 7fa924d31800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.537+0000 7fa924d31800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:57:20.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.537+0000 7fa924d31800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:57:20.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.537+0000 7fa924d31800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:57:20.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.537+0000 7fa924d31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 : miss 2024-09-12T00:57:20.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.537+0000 7fa924d31800 20 rados->read ofs=0 len=0 2024-09-12T00:57:20.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.538+0000 7fa924d31800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:57:20.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.538+0000 7fa924d31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:20.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.538+0000 7fa924d31800 10 adding default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:20.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.538+0000 7fa924d31800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:20.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.538+0000 7fa924d31800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:20.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.538+0000 7fa924d31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 2024-09-12T00:57:20.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.542+0000 7fa924d31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:20.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.542+0000 7fa924d31800 10 moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:20.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.542+0000 7fa924d31800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:20.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.542+0000 7fa924d31800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18, ofs0, ns] 2024-09-12T00:57:20.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.542+0000 7fa7f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431594 cookie 94626962584208 notifier 8147 bl.length()=821 2024-09-12T00:57:20.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.542+0000 7fa7f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:20.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.542+0000 7fa7f77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:20.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.542+0000 7fa7f77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:20.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.544+0000 7fa924d31800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_sources= new_sources= 2024-09-12T00:57:20.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.544+0000 7fa924d31800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential sources added=[] removed=[] 2024-09-12T00:57:20.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.544+0000 7fa924d31800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_dests= new_dests= 2024-09-12T00:57:20.543 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.544+0000 7fa924d31800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential dests added=[] removed=[] 2024-09-12T00:57:20.545 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:20.546+0000 7fa924d31800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T00:57:21.305 INFO:tasks.workunit.client.0.smithi062.stderr:put object successful 2024-09-12T00:57:25.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.547+0000 7fa924d31800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.0 2024-09-12T00:57:25.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.547+0000 7fa924d31800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.0 2024-09-12T00:57:25.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.547+0000 7fa924d31800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.1 2024-09-12T00:57:25.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.547+0000 7fa924d31800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.1 2024-09-12T00:57:25.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.547+0000 7fa924d31800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.2 2024-09-12T00:57:25.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.547+0000 7fa924d31800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.2 2024-09-12T00:57:25.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.547+0000 7fa924d31800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.1.0 2024-09-12T00:57:25.546 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.547+0000 7fa924d31800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.1.0 2024-09-12T00:57:25.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.548+0000 7fa924d31800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.1.1 2024-09-12T00:57:25.547 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.548+0000 7fa924d31800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.1.1 2024-09-12T00:57:25.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.550+0000 7fa924d31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:25.549 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.550+0000 7fa924d31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 2024-09-12T00:57:25.551 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.553+0000 7fa924d31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:25.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.553+0000 7fa924d31800 10 moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:25.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.553+0000 7fa924d31800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:25.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.553+0000 7fa924d31800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18, ofs0, ns] 2024-09-12T00:57:25.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.553+0000 7fa7f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431595 cookie 94626962584208 notifier 8147 bl.length()=821 2024-09-12T00:57:25.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.553+0000 7fa7f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:25.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.553+0000 7fa7f77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:25.552 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.553+0000 7fa7f77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:25.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.555+0000 7fa924d31800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_sources= new_sources= 2024-09-12T00:57:25.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.555+0000 7fa924d31800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential sources added=[] removed=[] 2024-09-12T00:57:25.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.555+0000 7fa924d31800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_dests= new_dests= 2024-09-12T00:57:25.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.555+0000 7fa924d31800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential dests added=[] removed=[] 2024-09-12T00:57:25.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.557+0000 7fa924d31800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.1.0 2024-09-12T00:57:25.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.557+0000 7fa924d31800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.1.0 2024-09-12T00:57:25.557 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.557+0000 7fa924d31800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.1.1 2024-09-12T00:57:25.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.557+0000 7fa924d31800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.1.1 2024-09-12T00:57:25.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.559+0000 7fa924d31800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:25.558 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.559+0000 7fa924d31800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 2024-09-12T00:57:25.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.561+0000 7fa924d31800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:25.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.561+0000 7fa924d31800 10 moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:25.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.561+0000 7fa924d31800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:25.560 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.561+0000 7fa924d31800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18, ofs0, ns] 2024-09-12T00:57:25.561 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.561+0000 7fa7f77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431596 cookie 94626962584208 notifier 8147 bl.length()=789 2024-09-12T00:57:25.561 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.561+0000 7fa7f77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:25.561 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.561+0000 7fa7f77fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:25.561 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.561+0000 7fa7f77fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:25.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.563+0000 7fa924d31800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_sources= new_sources= 2024-09-12T00:57:25.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.563+0000 7fa924d31800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential sources added=[] removed=[] 2024-09-12T00:57:25.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.563+0000 7fa924d31800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_dests= new_dests= 2024-09-12T00:57:25.562 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.563+0000 7fa924d31800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential dests added=[] removed=[] 2024-09-12T00:57:25.563 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.564+0000 7fa924d31800 1 execute INFO: reshard of bucket "myver" from 2 shards to 3 shards completed successfully 2024-09-12T00:57:25.566 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.567+0000 7fa7d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:25.569 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.570+0000 7fa924d31800 20 remove_watcher() i=0 2024-09-12T00:57:25.569 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.570+0000 7fa924d31800 2 removed watcher, disabling cache 2024-09-12T00:57:25.570 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.571+0000 7fa924d31800 20 remove_watcher() i=1 2024-09-12T00:57:25.571 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.573+0000 7fa924d31800 20 remove_watcher() i=2 2024-09-12T00:57:25.572 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.574+0000 7fa924d31800 20 remove_watcher() i=3 2024-09-12T00:57:25.574 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.575+0000 7fa924d31800 20 remove_watcher() i=4 2024-09-12T00:57:25.575 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.576+0000 7fa924d31800 20 remove_watcher() i=5 2024-09-12T00:57:25.576 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.578+0000 7fa924d31800 20 remove_watcher() i=6 2024-09-12T00:57:25.578 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:25.579+0000 7fa924d31800 20 remove_watcher() i=7 2024-09-12T00:57:26.311 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T00:57:26.311 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T00:57:26.651 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:57:27.059 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:57:28.564 INFO:tasks.workunit.client.0.smithi062.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:57:28.566 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T00:57:28.599 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:28.599 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:28.641 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:28.642+0000 7f140c335800 20 rados->read ofs=0 len=0 2024-09-12T00:57:28.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:28.643+0000 7f140c335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:28.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:28.643+0000 7f140c335800 20 realm 2024-09-12T00:57:28.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:28.643+0000 7f140c335800 20 rados->read ofs=0 len=0 2024-09-12T00:57:28.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:28.644+0000 7f140c335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:28.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:28.644+0000 7f140c335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:28.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:28.644+0000 7f140c335800 20 rados->read ofs=0 len=0 2024-09-12T00:57:28.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:28.644+0000 7f140c335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:28.643 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:28.644+0000 7f140c335800 20 rados->read ofs=0 len=0 2024-09-12T00:57:28.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:28.645+0000 7f140c335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:28.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:28.645+0000 7f140c335800 20 rados->read ofs=0 len=0 2024-09-12T00:57:28.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:28.645+0000 7f140c335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:28.644 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:28.645+0000 7f140c335800 20 searching for the correct realm 2024-09-12T00:57:28.647 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:28.648+0000 7f140787c640 0 -- 172.21.15.62:0/1283196394 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f140007f400 msgr2=0x7f140007f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:28.854 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:28.855+0000 7f140807d640 0 -- 172.21.15.62:0/1283196394 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f12d80868c0 msgr2=0x7f12d8088cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:29.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.062+0000 7f140c335800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:29.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.062+0000 7f140c335800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:29.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.062+0000 7f140c335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:29.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.062+0000 7f140c335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:29.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.062+0000 7f140c335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:29.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.062+0000 7f140c335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:29.063 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.062+0000 7f140c335800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.063+0000 7f140c335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.063+0000 7f140c335800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.063+0000 7f140c335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:29.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.063+0000 7f140c335800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.063+0000 7f140c335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:29.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.063+0000 7f140c335800 20 zone default found 2024-09-12T00:57:29.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.063+0000 7f140c335800 4 Realm: () 2024-09-12T00:57:29.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.063+0000 7f140c335800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:29.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.063+0000 7f140c335800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:29.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.063+0000 7f140c335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:29.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.063+0000 7f140c335800 20 zonegroup default 2024-09-12T00:57:29.064 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.063+0000 7f140c335800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.064+0000 7f140c335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.064+0000 7f140c335800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.064+0000 7f140c335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.064+0000 7f140c335800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.064+0000 7f140c335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.065 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.064+0000 7f140c335800 20 started sync module instance, tier type = 2024-09-12T00:57:29.066 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.064+0000 7f140c335800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:29.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.075+0000 7f140c335800 20 add_watcher() i=0 2024-09-12T00:57:29.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.075+0000 7f140c335800 20 add_watcher() i=1 2024-09-12T00:57:29.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.075+0000 7f140c335800 20 add_watcher() i=2 2024-09-12T00:57:29.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.075+0000 7f140c335800 20 add_watcher() i=3 2024-09-12T00:57:29.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.075+0000 7f140c335800 20 add_watcher() i=4 2024-09-12T00:57:29.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.075+0000 7f140c335800 20 add_watcher() i=5 2024-09-12T00:57:29.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.075+0000 7f140c335800 20 add_watcher() i=6 2024-09-12T00:57:29.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.076+0000 7f140c335800 20 add_watcher() i=7 2024-09-12T00:57:29.076 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.076+0000 7f140c335800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:29.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.078+0000 7f12befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:29.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.078+0000 7f140c335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:29.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.078+0000 7f140c335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:29.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.078+0000 7f140c335800 5 note: GC not initialized 2024-09-12T00:57:29.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.078+0000 7f12bdfe3640 20 reqs_thread_entry: start 2024-09-12T00:57:29.079 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.078+0000 7f140c335800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:29.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.078+0000 7f140c335800 20 Filter name: none 2024-09-12T00:57:29.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.079+0000 7f12b6ffd640 20 reqs_thread_entry: start 2024-09-12T00:57:29.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.079+0000 7f140c335800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.079+0000 7f140c335800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:57:29.080 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.079+0000 7f140c335800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.080+0000 7f140c335800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:57:29.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.080+0000 7f140c335800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:29.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.080+0000 7f140c335800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:57:29.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.080+0000 7f140c335800 20 INFO: main: starting shard=0 2024-09-12T00:57:29.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.080+0000 7f140c335800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.0 2024-09-12T00:57:29.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.080+0000 7f140c335800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.0 2024-09-12T00:57:29.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.080+0000 7f140c335800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:57:29.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.080+0000 7f140c335800 20 INFO: main: starting shard=1 2024-09-12T00:57:29.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.080+0000 7f140c335800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.1 2024-09-12T00:57:29.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.080+0000 7f140c335800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.1 2024-09-12T00:57:29.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.081+0000 7f140c335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:57:29.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.081+0000 7f140c335800 20 INFO: main: starting shard=2 2024-09-12T00:57:29.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.081+0000 7f140c335800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.2 2024-09-12T00:57:29.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.081+0000 7f140c335800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.2 2024-09-12T00:57:29.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.082+0000 7f140c335800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:57:29.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.082+0000 7f140c335800 20 INFO: main: done 2024-09-12T00:57:29.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.083+0000 7f12befe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:29.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.085+0000 7f140c335800 20 remove_watcher() i=0 2024-09-12T00:57:29.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.085+0000 7f140c335800 2 removed watcher, disabling cache 2024-09-12T00:57:29.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.087+0000 7f140c335800 20 remove_watcher() i=1 2024-09-12T00:57:29.087 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.088+0000 7f140c335800 20 remove_watcher() i=2 2024-09-12T00:57:29.088 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.089+0000 7f140c335800 20 remove_watcher() i=3 2024-09-12T00:57:29.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.090+0000 7f140c335800 20 remove_watcher() i=4 2024-09-12T00:57:29.090 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.092+0000 7f140c335800 20 remove_watcher() i=5 2024-09-12T00:57:29.091 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.093+0000 7f140c335800 20 remove_watcher() i=6 2024-09-12T00:57:29.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.094+0000 7f140c335800 20 remove_watcher() i=7 2024-09-12T00:57:29.222 INFO:tasks.workunit.client.0.smithi062.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:57:29.224 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T00:57:29.257 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:29.257 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:29.296 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.297+0000 7f694bf21800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.299+0000 7f694bf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.299+0000 7f694bf21800 20 realm 2024-09-12T00:57:29.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.299+0000 7f694bf21800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.299+0000 7f694bf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.299+0000 7f694bf21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:29.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.299+0000 7f694bf21800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.299+0000 7f694bf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.299+0000 7f694bf21800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.300+0000 7f694bf21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:29.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.300+0000 7f694bf21800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.301+0000 7f694bf21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:29.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.301+0000 7f694bf21800 20 searching for the correct realm 2024-09-12T00:57:29.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.304+0000 7f694740b640 0 -- 172.21.15.62:0/57151782 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f6940078cf0 msgr2=0x7f694004b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:29.507 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.509+0000 7f694740b640 0 -- 172.21.15.62:0/57151782 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5646a04b9160 msgr2=0x5646a04bb590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:29.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.513+0000 7f694bf21800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:29.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.513+0000 7f694bf21800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:29.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.513+0000 7f694bf21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:29.513 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.513+0000 7f694bf21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:29.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.513+0000 7f694bf21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:29.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.513+0000 7f694bf21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:29.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.513+0000 7f694bf21800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.513+0000 7f694bf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.513+0000 7f694bf21800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.514+0000 7f694bf21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:29.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.514+0000 7f694bf21800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.514+0000 7f694bf21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:29.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.514+0000 7f694bf21800 20 zone default found 2024-09-12T00:57:29.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.514+0000 7f694bf21800 4 Realm: () 2024-09-12T00:57:29.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.514+0000 7f694bf21800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:29.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.514+0000 7f694bf21800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:29.514 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.514+0000 7f694bf21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:29.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.514+0000 7f694bf21800 20 zonegroup default 2024-09-12T00:57:29.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.514+0000 7f694bf21800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.514+0000 7f694bf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.514+0000 7f694bf21800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.515 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.515+0000 7f694bf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.515+0000 7f694bf21800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.515+0000 7f694bf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.515+0000 7f694bf21800 20 started sync module instance, tier type = 2024-09-12T00:57:29.516 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.515+0000 7f694bf21800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:29.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.526+0000 7f694bf21800 20 add_watcher() i=0 2024-09-12T00:57:29.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.526+0000 7f694bf21800 20 add_watcher() i=1 2024-09-12T00:57:29.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.526+0000 7f694bf21800 20 add_watcher() i=2 2024-09-12T00:57:29.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.526+0000 7f694bf21800 20 add_watcher() i=3 2024-09-12T00:57:29.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.526+0000 7f694bf21800 20 add_watcher() i=4 2024-09-12T00:57:29.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.526+0000 7f694bf21800 20 add_watcher() i=5 2024-09-12T00:57:29.525 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.526+0000 7f694bf21800 20 add_watcher() i=6 2024-09-12T00:57:29.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.527+0000 7f694bf21800 20 add_watcher() i=7 2024-09-12T00:57:29.526 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.527+0000 7f694bf21800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:29.528 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.529+0000 7f67fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:29.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.529+0000 7f694bf21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:29.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.529+0000 7f694bf21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:29.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.529+0000 7f694bf21800 5 note: GC not initialized 2024-09-12T00:57:29.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.530+0000 7f67fcfe1640 20 reqs_thread_entry: start 2024-09-12T00:57:29.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.530+0000 7f694bf21800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:29.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.530+0000 7f694bf21800 20 Filter name: none 2024-09-12T00:57:29.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.530+0000 7f67767fc640 20 reqs_thread_entry: start 2024-09-12T00:57:29.529 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.530+0000 7f694bf21800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.530+0000 7f694bf21800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:57:29.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.530+0000 7f694bf21800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.531+0000 7f694bf21800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:57:29.530 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.531+0000 7f694bf21800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:29.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.531+0000 7f694bf21800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:57:29.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.531+0000 7f694bf21800 20 INFO: main: starting shard=0 2024-09-12T00:57:29.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.531+0000 7f694bf21800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.0 2024-09-12T00:57:29.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.531+0000 7f694bf21800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.0 2024-09-12T00:57:29.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.532+0000 7f694bf21800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:57:29.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.532+0000 7f694bf21800 20 INFO: main: starting shard=1 2024-09-12T00:57:29.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.532+0000 7f694bf21800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.1 2024-09-12T00:57:29.531 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.532+0000 7f694bf21800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.1 2024-09-12T00:57:29.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.532+0000 7f694bf21800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:57:29.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.532+0000 7f694bf21800 20 INFO: main: starting shard=2 2024-09-12T00:57:29.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.532+0000 7f694bf21800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.2 2024-09-12T00:57:29.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.532+0000 7f694bf21800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.2 2024-09-12T00:57:29.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.533+0000 7f694bf21800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:57:29.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.533+0000 7f694bf21800 20 INFO: main: done 2024-09-12T00:57:29.532 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.534+0000 7f67fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:29.534 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.536+0000 7f694bf21800 20 remove_watcher() i=0 2024-09-12T00:57:29.535 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.536+0000 7f694bf21800 2 removed watcher, disabling cache 2024-09-12T00:57:29.536 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.537+0000 7f694bf21800 20 remove_watcher() i=1 2024-09-12T00:57:29.537 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.538+0000 7f694bf21800 20 remove_watcher() i=2 2024-09-12T00:57:29.538 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.539+0000 7f694bf21800 20 remove_watcher() i=3 2024-09-12T00:57:29.539 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.540+0000 7f694bf21800 20 remove_watcher() i=4 2024-09-12T00:57:29.540 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.541+0000 7f694bf21800 20 remove_watcher() i=5 2024-09-12T00:57:29.541 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.542+0000 7f694bf21800 20 remove_watcher() i=6 2024-09-12T00:57:29.542 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.543+0000 7f694bf21800 20 remove_watcher() i=7 2024-09-12T00:57:29.665 INFO:tasks.workunit.client.0.smithi062.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:57:29.666 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T00:57:29.697 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:29.697 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:29.736 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.737+0000 7f9c6873e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.739+0000 7f9c6873e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.739+0000 7f9c6873e800 20 realm 2024-09-12T00:57:29.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.739+0000 7f9c6873e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.740+0000 7f9c6873e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.740+0000 7f9c6873e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:29.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.740+0000 7f9c6873e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.740+0000 7f9c6873e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.740+0000 7f9c6873e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.740+0000 7f9c6873e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:29.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.740+0000 7f9c6873e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.740 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.741+0000 7f9c6873e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:29.740 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.741+0000 7f9c6873e800 20 searching for the correct realm 2024-09-12T00:57:29.743 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.744+0000 7f9c63cbf640 0 -- 172.21.15.62:0/2955227115 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f9c5c00c910 msgr2=0x7f9c5c00d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:29.949 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.950+0000 7f9c64cc1640 0 -- 172.21.15.62:0/2955227115 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x559345f743f0 msgr2=0x559345f76820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:29.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.954+0000 7f9c6873e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:29.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.954+0000 7f9c6873e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:29.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.954+0000 7f9c6873e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:29.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.954+0000 7f9c6873e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:29.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.954+0000 7f9c6873e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:29.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.954+0000 7f9c6873e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:29.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.954+0000 7f9c6873e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.955+0000 7f9c6873e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.955+0000 7f9c6873e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.955+0000 7f9c6873e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:29.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.955+0000 7f9c6873e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.955+0000 7f9c6873e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:29.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.955+0000 7f9c6873e800 20 zone default found 2024-09-12T00:57:29.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.955+0000 7f9c6873e800 4 Realm: () 2024-09-12T00:57:29.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.955+0000 7f9c6873e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:29.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.955+0000 7f9c6873e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:29.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.955+0000 7f9c6873e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:29.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.955+0000 7f9c6873e800 20 zonegroup default 2024-09-12T00:57:29.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.955+0000 7f9c6873e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.955+0000 7f9c6873e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.955+0000 7f9c6873e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.956+0000 7f9c6873e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.956+0000 7f9c6873e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.956+0000 7f9c6873e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:29.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.956+0000 7f9c6873e800 20 started sync module instance, tier type = 2024-09-12T00:57:29.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.956+0000 7f9c6873e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:29.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.966+0000 7f9c6873e800 20 add_watcher() i=0 2024-09-12T00:57:29.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.966+0000 7f9c6873e800 20 add_watcher() i=1 2024-09-12T00:57:29.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.966+0000 7f9c6873e800 20 add_watcher() i=2 2024-09-12T00:57:29.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.966+0000 7f9c6873e800 20 add_watcher() i=3 2024-09-12T00:57:29.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.966+0000 7f9c6873e800 20 add_watcher() i=4 2024-09-12T00:57:29.965 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.966+0000 7f9c6873e800 20 add_watcher() i=5 2024-09-12T00:57:29.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.966+0000 7f9c6873e800 20 add_watcher() i=6 2024-09-12T00:57:29.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.967+0000 7f9c6873e800 20 add_watcher() i=7 2024-09-12T00:57:29.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.967+0000 7f9c6873e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:29.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.969+0000 7f9b1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:29.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.970+0000 7f9c6873e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:29.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.970+0000 7f9c6873e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:29.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.970+0000 7f9c6873e800 5 note: GC not initialized 2024-09-12T00:57:29.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.970+0000 7f9b19fdb640 20 reqs_thread_entry: start 2024-09-12T00:57:29.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.970+0000 7f9c6873e800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:29.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.970+0000 7f9c6873e800 20 Filter name: none 2024-09-12T00:57:29.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.970+0000 7f9a8b7fe640 20 reqs_thread_entry: start 2024-09-12T00:57:29.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.970+0000 7f9c6873e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.971+0000 7f9c6873e800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:57:29.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.971+0000 7f9c6873e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:29.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.971+0000 7f9c6873e800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:57:29.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.971+0000 7f9c6873e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:29.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.971+0000 7f9c6873e800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-12T00:57:29.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.971+0000 7f9c6873e800 20 INFO: main: starting shard=0 2024-09-12T00:57:29.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.971+0000 7f9c6873e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.0 2024-09-12T00:57:29.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.971+0000 7f9c6873e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.0 2024-09-12T00:57:29.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.972+0000 7f9c6873e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:57:29.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.972+0000 7f9c6873e800 20 INFO: main: starting shard=1 2024-09-12T00:57:29.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.972+0000 7f9c6873e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.1 2024-09-12T00:57:29.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.972+0000 7f9c6873e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.1 2024-09-12T00:57:29.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.973+0000 7f9c6873e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:57:29.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.973+0000 7f9c6873e800 20 INFO: main: starting shard=2 2024-09-12T00:57:29.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.973+0000 7f9c6873e800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.2 2024-09-12T00:57:29.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.973+0000 7f9c6873e800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.2 2024-09-12T00:57:29.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.974+0000 7f9c6873e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:57:29.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.974+0000 7f9c6873e800 20 INFO: main: done 2024-09-12T00:57:29.974 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.974+0000 7f9b1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:29.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.977+0000 7f9c6873e800 20 remove_watcher() i=0 2024-09-12T00:57:29.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.977+0000 7f9c6873e800 2 removed watcher, disabling cache 2024-09-12T00:57:29.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.978+0000 7f9c6873e800 20 remove_watcher() i=1 2024-09-12T00:57:29.977 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.979+0000 7f9c6873e800 20 remove_watcher() i=2 2024-09-12T00:57:29.979 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.980+0000 7f9c6873e800 20 remove_watcher() i=3 2024-09-12T00:57:29.980 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.981+0000 7f9c6873e800 20 remove_watcher() i=4 2024-09-12T00:57:29.981 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.982+0000 7f9c6873e800 20 remove_watcher() i=5 2024-09-12T00:57:29.982 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.983+0000 7f9c6873e800 20 remove_watcher() i=6 2024-09-12T00:57:29.983 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:29.984+0000 7f9c6873e800 20 remove_watcher() i=7 2024-09-12T00:57:30.020 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:57:30.428 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:57:30.836 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T00:57:30.867 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:30.868 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:30.908 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.909+0000 7fc9dd120800 20 rados->read ofs=0 len=0 2024-09-12T00:57:30.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.911+0000 7fc9dd120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:30.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.911+0000 7fc9dd120800 20 realm 2024-09-12T00:57:30.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.911+0000 7fc9dd120800 20 rados->read ofs=0 len=0 2024-09-12T00:57:30.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.911+0000 7fc9dd120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:30.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.911+0000 7fc9dd120800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:30.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.911+0000 7fc9dd120800 20 rados->read ofs=0 len=0 2024-09-12T00:57:30.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.911+0000 7fc9dd120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:30.910 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.911+0000 7fc9dd120800 20 rados->read ofs=0 len=0 2024-09-12T00:57:30.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.912+0000 7fc9dd120800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:30.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.912+0000 7fc9dd120800 20 rados->read ofs=0 len=0 2024-09-12T00:57:30.911 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.913+0000 7fc9dd120800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:30.912 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.913+0000 7fc9dd120800 20 searching for the correct realm 2024-09-12T00:57:30.915 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.916+0000 7fc9d8e68640 0 -- 172.21.15.62:0/2420030266 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7fc9d4026060 msgr2=0x7fc9d4063100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:30.918 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.919+0000 7fc9d8e68640 0 -- 172.21.15.62:0/2420030266 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7fc9d409c0b0 msgr2=0x7fc9d409c4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:30.922 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.923+0000 7fc9dd120800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:30.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:30.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:30.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:30.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:30.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:30.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 20 rados->read ofs=0 len=0 2024-09-12T00:57:30.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:30.923 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 20 rados->read ofs=0 len=0 2024-09-12T00:57:30.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:30.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 20 rados->read ofs=0 len=0 2024-09-12T00:57:30.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:30.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 20 zone default found 2024-09-12T00:57:30.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 4 Realm: () 2024-09-12T00:57:30.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:30.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:30.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:30.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 20 zonegroup default 2024-09-12T00:57:30.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.924+0000 7fc9dd120800 20 rados->read ofs=0 len=0 2024-09-12T00:57:30.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.925+0000 7fc9dd120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:30.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.925+0000 7fc9dd120800 20 rados->read ofs=0 len=0 2024-09-12T00:57:30.925 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.925+0000 7fc9dd120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:30.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.925+0000 7fc9dd120800 20 rados->read ofs=0 len=0 2024-09-12T00:57:30.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.925+0000 7fc9dd120800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:30.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.925+0000 7fc9dd120800 20 started sync module instance, tier type = 2024-09-12T00:57:30.926 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.925+0000 7fc9dd120800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:30.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.935+0000 7fc9dd120800 20 add_watcher() i=0 2024-09-12T00:57:30.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.935+0000 7fc9dd120800 20 add_watcher() i=1 2024-09-12T00:57:30.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.935+0000 7fc9dd120800 20 add_watcher() i=2 2024-09-12T00:57:30.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.935+0000 7fc9dd120800 20 add_watcher() i=3 2024-09-12T00:57:30.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.935+0000 7fc9dd120800 20 add_watcher() i=4 2024-09-12T00:57:30.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.935+0000 7fc9dd120800 20 add_watcher() i=5 2024-09-12T00:57:30.934 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.935+0000 7fc9dd120800 20 add_watcher() i=6 2024-09-12T00:57:30.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.936+0000 7fc9dd120800 20 add_watcher() i=7 2024-09-12T00:57:30.935 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.936+0000 7fc9dd120800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:30.937 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.938+0000 7fc88f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:30.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.939+0000 7fc9dd120800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:30.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.939+0000 7fc9dd120800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:30.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.939+0000 7fc9dd120800 5 note: GC not initialized 2024-09-12T00:57:30.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.939+0000 7fc88e7e4640 20 reqs_thread_entry: start 2024-09-12T00:57:30.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.939+0000 7fc9dd120800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:30.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.939+0000 7fc9dd120800 20 Filter name: none 2024-09-12T00:57:30.938 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.939+0000 7fc887fff640 20 reqs_thread_entry: start 2024-09-12T00:57:30.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.939+0000 7fc9dd120800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:57:30.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.939+0000 7fc9dd120800 20 rados->read ofs=0 len=0 2024-09-12T00:57:30.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.940+0000 7fc9dd120800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:57:30.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.940+0000 7fc9dd120800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:57:30.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.940+0000 7fc9dd120800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:57:30.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.940+0000 7fc9dd120800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 : miss 2024-09-12T00:57:30.939 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.940+0000 7fc9dd120800 20 rados->read ofs=0 len=0 2024-09-12T00:57:30.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.941+0000 7fc9dd120800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:57:30.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.941+0000 7fc9dd120800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:30.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.941+0000 7fc9dd120800 10 adding default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:30.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.941+0000 7fc9dd120800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:30.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.941+0000 7fc9dd120800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:30.940 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.941+0000 7fc9dd120800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 2024-09-12T00:57:30.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.947+0000 7fc9dd120800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:30.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.947+0000 7fc9dd120800 10 moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:30.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.947+0000 7fc9dd120800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:30.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.947+0000 7fc9dd120800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18, ofs0, ns] 2024-09-12T00:57:30.946 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.947+0000 7fc8affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431597 cookie 94182111443280 notifier 8709 bl.length()=821 2024-09-12T00:57:30.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.947+0000 7fc8affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:30.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.947+0000 7fc8affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:30.947 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.947+0000 7fc8affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:30.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.949+0000 7fc9dd120800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_sources= new_sources= 2024-09-12T00:57:30.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.949+0000 7fc9dd120800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential sources added=[] removed=[] 2024-09-12T00:57:30.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.949+0000 7fc9dd120800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_dests= new_dests= 2024-09-12T00:57:30.948 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.949+0000 7fc9dd120800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential dests added=[] removed=[] 2024-09-12T00:57:30.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.0 2024-09-12T00:57:30.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.0 2024-09-12T00:57:30.951 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.1 2024-09-12T00:57:30.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.1 2024-09-12T00:57:30.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.2 2024-09-12T00:57:30.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.2 2024-09-12T00:57:30.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.3 2024-09-12T00:57:30.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.3 2024-09-12T00:57:30.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.4 2024-09-12T00:57:30.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.4 2024-09-12T00:57:30.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.5 2024-09-12T00:57:30.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.5 2024-09-12T00:57:30.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.6 2024-09-12T00:57:30.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.6 2024-09-12T00:57:30.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.7 2024-09-12T00:57:30.952 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.7 2024-09-12T00:57:30.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.8 2024-09-12T00:57:30.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.8 2024-09-12T00:57:30.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:30.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:30.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.10 2024-09-12T00:57:30.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.10 2024-09-12T00:57:30.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.11 2024-09-12T00:57:30.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.11 2024-09-12T00:57:30.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.12 2024-09-12T00:57:30.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.12 2024-09-12T00:57:30.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.13 2024-09-12T00:57:30.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.13 2024-09-12T00:57:30.953 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.14 2024-09-12T00:57:30.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.14 2024-09-12T00:57:30.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.15 2024-09-12T00:57:30.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.15 2024-09-12T00:57:30.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.16 2024-09-12T00:57:30.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.16 2024-09-12T00:57:30.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.0 2024-09-12T00:57:30.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.0 2024-09-12T00:57:30.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.1 2024-09-12T00:57:30.954 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.952+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.1 2024-09-12T00:57:30.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.953+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.2 2024-09-12T00:57:30.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.953+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.2 2024-09-12T00:57:30.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.956+0000 7fc9dd120800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:30.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.956+0000 7fc9dd120800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 2024-09-12T00:57:30.955 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.957+0000 7fc9dd120800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:30.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.957+0000 7fc9dd120800 10 moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:30.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.957+0000 7fc9dd120800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:30.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.957+0000 7fc9dd120800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18, ofs0, ns] 2024-09-12T00:57:30.956 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.957+0000 7fc8affff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431598 cookie 94182111443280 notifier 8709 bl.length()=821 2024-09-12T00:57:30.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.957+0000 7fc8affff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:30.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.957+0000 7fc8affff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:30.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.957+0000 7fc8affff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:30.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.959+0000 7fc9dd120800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_sources= new_sources= 2024-09-12T00:57:30.957 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.959+0000 7fc9dd120800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential sources added=[] removed=[] 2024-09-12T00:57:30.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.959+0000 7fc9dd120800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_dests= new_dests= 2024-09-12T00:57:30.958 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.959+0000 7fc9dd120800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential dests added=[] removed=[] 2024-09-12T00:57:30.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.960+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.0 2024-09-12T00:57:30.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.960+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.0 2024-09-12T00:57:30.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.960+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.1 2024-09-12T00:57:30.959 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.960+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.1 2024-09-12T00:57:30.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.961+0000 7fc9dd120800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.2 2024-09-12T00:57:30.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.961+0000 7fc9dd120800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.2.2 2024-09-12T00:57:30.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.961+0000 7fc9dd120800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:57:30.960 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.961+0000 7fc9dd120800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 2024-09-12T00:57:30.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.962+0000 7fc9dd120800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:30.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.962+0000 7fc9dd120800 10 moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:30.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.962+0000 7fc9dd120800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:30.961 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.962+0000 7fc9dd120800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18, ofs0, ns] 2024-09-12T00:57:30.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.962+0000 7fc8af7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431599 cookie 94182111443280 notifier 8709 bl.length()=789 2024-09-12T00:57:30.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.962+0000 7fc8af7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:30.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.962+0000 7fc8af7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:30.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.962+0000 7fc8af7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:30.962 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.964+0000 7fc9dd120800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_sources= new_sources= 2024-09-12T00:57:30.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.964+0000 7fc9dd120800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential sources added=[] removed=[] 2024-09-12T00:57:30.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.964+0000 7fc9dd120800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): orig_dests= new_dests= 2024-09-12T00:57:30.963 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.964+0000 7fc9dd120800 20 handle_bi_update(): bucket=:myver[8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18]): potential dests added=[] removed=[] 2024-09-12T00:57:30.964 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.965+0000 7fc9dd120800 1 execute INFO: reshard of bucket "myver" from 3 shards to 17 shards completed successfully 2024-09-12T00:57:30.966 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.968+0000 7fc88f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:30.968 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.970+0000 7fc9dd120800 20 remove_watcher() i=0 2024-09-12T00:57:30.969 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.970+0000 7fc9dd120800 2 removed watcher, disabling cache 2024-09-12T00:57:30.970 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.971+0000 7fc9dd120800 20 remove_watcher() i=1 2024-09-12T00:57:30.971 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.972+0000 7fc9dd120800 20 remove_watcher() i=2 2024-09-12T00:57:30.972 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.973+0000 7fc9dd120800 20 remove_watcher() i=3 2024-09-12T00:57:30.973 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.974+0000 7fc9dd120800 20 remove_watcher() i=4 2024-09-12T00:57:30.974 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.975+0000 7fc9dd120800 20 remove_watcher() i=5 2024-09-12T00:57:30.975 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.976+0000 7fc9dd120800 20 remove_watcher() i=6 2024-09-12T00:57:30.976 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:30.977+0000 7fc9dd120800 20 remove_watcher() i=7 2024-09-12T00:57:30.989 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:57:31.024 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:31.025 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:31.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.069+0000 7f8a3e926800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.071+0000 7f8a3e926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:31.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.071+0000 7f8a3e926800 20 realm 2024-09-12T00:57:31.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.071+0000 7f8a3e926800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.071+0000 7f8a3e926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:31.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.071+0000 7f8a3e926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:31.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.071+0000 7f8a3e926800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.071+0000 7f8a3e926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:31.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.071+0000 7f8a3e926800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.072+0000 7f8a3e926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:31.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.072+0000 7f8a3e926800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.072+0000 7f8a3e926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:31.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.072+0000 7f8a3e926800 20 searching for the correct realm 2024-09-12T00:57:31.074 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.076+0000 7f8a39db4640 0 -- 172.21.15.62:0/3336166576 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f8a34078410 msgr2=0x7f8a34078870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:31.078 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.079+0000 7f8a3a5b5640 0 -- 172.21.15.62:0/3336166576 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f8a34095910 msgr2=0x7f8a34055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:31.082 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.083+0000 7f8a3e926800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:31.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.083+0000 7f8a3e926800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:31.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.083+0000 7f8a3e926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:31.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.083+0000 7f8a3e926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:31.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.083+0000 7f8a3e926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:31.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.083+0000 7f8a3e926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:31.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.083+0000 7f8a3e926800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.083+0000 7f8a3e926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:31.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.084+0000 7f8a3e926800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.084+0000 7f8a3e926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:31.083 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.084+0000 7f8a3e926800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.084 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.084+0000 7f8a3e926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:31.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.084+0000 7f8a3e926800 20 zone default found 2024-09-12T00:57:31.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.084+0000 7f8a3e926800 4 Realm: () 2024-09-12T00:57:31.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.084+0000 7f8a3e926800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:31.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.084+0000 7f8a3e926800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:31.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.084+0000 7f8a3e926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:31.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.084+0000 7f8a3e926800 20 zonegroup default 2024-09-12T00:57:31.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.084+0000 7f8a3e926800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.084+0000 7f8a3e926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:31.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.084+0000 7f8a3e926800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.085+0000 7f8a3e926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:31.085 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.085+0000 7f8a3e926800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.085+0000 7f8a3e926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:31.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.085+0000 7f8a3e926800 20 started sync module instance, tier type = 2024-09-12T00:57:31.086 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.085+0000 7f8a3e926800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:31.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.093+0000 7f8a3e926800 20 add_watcher() i=0 2024-09-12T00:57:31.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.093+0000 7f8a3e926800 20 add_watcher() i=1 2024-09-12T00:57:31.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.093+0000 7f8a3e926800 20 add_watcher() i=2 2024-09-12T00:57:31.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.093+0000 7f8a3e926800 20 add_watcher() i=3 2024-09-12T00:57:31.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.093+0000 7f8a3e926800 20 add_watcher() i=4 2024-09-12T00:57:31.092 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.093+0000 7f8a3e926800 20 add_watcher() i=5 2024-09-12T00:57:31.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.093+0000 7f8a3e926800 20 add_watcher() i=6 2024-09-12T00:57:31.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.094+0000 7f8a3e926800 20 add_watcher() i=7 2024-09-12T00:57:31.093 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.094+0000 7f8a3e926800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:31.095 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.096+0000 7f88f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:31.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.097+0000 7f8a3e926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:31.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.097+0000 7f8a3e926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:31.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.097+0000 7f8a3e926800 5 note: GC not initialized 2024-09-12T00:57:31.097 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.097+0000 7f886b7fe640 20 reqs_thread_entry: start 2024-09-12T00:57:31.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.097+0000 7f8a3e926800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:31.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.097+0000 7f8a3e926800 20 Filter name: none 2024-09-12T00:57:31.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.097+0000 7f88697fa640 20 reqs_thread_entry: start 2024-09-12T00:57:31.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.097+0000 7f8a3e926800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:57:31.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.097+0000 7f8a3e926800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.098+0000 7f8a3e926800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:57:31.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.098+0000 7f8a3e926800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:57:31.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.098+0000 7f8a3e926800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:57:31.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.098+0000 7f8a3e926800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 : miss 2024-09-12T00:57:31.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.098+0000 7f8a3e926800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.098+0000 7f8a3e926800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:57:31.098 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.098+0000 7f8a3e926800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 info.flags=0x17 2024-09-12T00:57:31.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.098+0000 7f8a3e926800 10 adding default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 to cache LRU end 2024-09-12T00:57:31.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.098+0000 7f8a3e926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:57:31.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.098+0000 7f8a3e926800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:57:31.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.098+0000 7f8a3e926800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18 2024-09-12T00:57:31.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.098+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.0 2024-09-12T00:57:31.099 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.098+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.0 2024-09-12T00:57:31.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.099+0000 7f8a3e926800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:57:31.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.099+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.1 2024-09-12T00:57:31.100 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.099+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.1 2024-09-12T00:57:31.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.099+0000 7f8a3e926800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:57:31.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.099+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.2 2024-09-12T00:57:31.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.099+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.2 2024-09-12T00:57:31.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.100+0000 7f8a3e926800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:57:31.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.100+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.3 2024-09-12T00:57:31.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.100+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.3 2024-09-12T00:57:31.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.100+0000 7f8a3e926800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:57:31.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.100+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.4 2024-09-12T00:57:31.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.100+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.4 2024-09-12T00:57:31.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.101+0000 7f8a3e926800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:57:31.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.101+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.5 2024-09-12T00:57:31.101 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.101+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.5 2024-09-12T00:57:31.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.101+0000 7f8a3e926800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T00:57:31.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.101+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.6 2024-09-12T00:57:31.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.101+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.6 2024-09-12T00:57:31.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.101+0000 7f8a3e926800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:57:31.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.101+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.7 2024-09-12T00:57:31.102 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.101+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.7 2024-09-12T00:57:31.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.102+0000 7f8a3e926800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:57:31.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.102+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.8 2024-09-12T00:57:31.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.102+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.8 2024-09-12T00:57:31.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.103+0000 7f8a3e926800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T00:57:31.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.103+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.103+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.104+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.10 2024-09-12T00:57:31.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.104+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.10 2024-09-12T00:57:31.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.104+0000 7f8a3e926800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:57:31.103 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.104+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.11 2024-09-12T00:57:31.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.104+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.11 2024-09-12T00:57:31.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.104+0000 7f8a3e926800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T00:57:31.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.104+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.12 2024-09-12T00:57:31.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.104+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.12 2024-09-12T00:57:31.104 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.105+0000 7f8a3e926800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T00:57:31.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.105+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.13 2024-09-12T00:57:31.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.105+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.13 2024-09-12T00:57:31.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.105+0000 7f8a3e926800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T00:57:31.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.105+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.14 2024-09-12T00:57:31.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.105+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.14 2024-09-12T00:57:31.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.106+0000 7f8a3e926800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T00:57:31.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.106+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.15 2024-09-12T00:57:31.105 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.106+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.15 2024-09-12T00:57:31.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.106+0000 7f8a3e926800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T00:57:31.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.106+0000 7f8a3e926800 10 bucket_obj is .dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.16 2024-09-12T00:57:31.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.106+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.16 2024-09-12T00:57:31.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.106+0000 7f8a3e926800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T00:57:31.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.107+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.106 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.107+0000 7f8a3e926800 20 get_obj_state: octx=0x55d19fafa690 obj=myver:x state=0x55d19fdc5c48 s->prefetch_data=0 2024-09-12T00:57:31.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.107+0000 7f8a3e926800 20 get_obj_state: setting s->obj_tag to 6bhp39anth1dylhibmsr5o3n6h3owrs3 2024-09-12T00:57:31.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.107+0000 7f8a3e926800 20 get_obj_state_impl: setting s->olh_tag to siubza5b1rbyzril61f1j4ph29t3osst 2024-09-12T00:57:31.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.107+0000 7f8a3e926800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=siubza5b1rbyzril61f1j4ph29t3osst 2024-09-12T00:57:31.107 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.109+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.110+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.110+0000 7f8a3e926800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T00:57:31.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.110+0000 7f8a3e926800 20 olh_log_entry: epoch=2 op=3 key=x[ZXg6aVMN3L.7BzUvV7Lwrzk7zklXCOa] 2024-09-12T00:57:31.109 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.110+0000 7f8a3e926800 20 get_obj_state: octx=0x55d19fafa690 obj=myver:_:ZXg6aVMN3L.7BzUvV7Lwrzk7zklXCOa_x state=0x55d19fe03218 s->prefetch_data=0 2024-09-12T00:57:31.110 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.111+0000 7f8a3e926800 10 manifest: total_size = 22 2024-09-12T00:57:31.110 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.111+0000 7f8a3e926800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7588693641803458590 2024-09-12T00:57:31.110 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.111+0000 7f8a3e926800 20 get_obj_state: octx=0x55d19fafa690 obj=myver:_:ZXg6aVMN3L.7BzUvV7Lwrzk7zklXCOa_x state=0x55d19fe03218 s->prefetch_data=0 2024-09-12T00:57:31.110 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.111+0000 7f8a3e926800 20 prepare_atomic_modification: state is not atomic. state=0x55d19fe03218 2024-09-12T00:57:31.110 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.111+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.113+0000 7f8a3e926800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:57:31.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.113+0000 7f8a3e926800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:57:31.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.113+0000 7f8a3e926800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:57:31.112 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.113+0000 7f8a3e926800 5 delete_objs_inline: removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18__shadow:ZXg6aVMN3L.7BzUvV7Lwrzk7zklXCOa_.EZqs98FAj_tj2Vr7g2-d1mW39o-8HWs_0 2024-09-12T00:57:31.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.114+0000 7f8a3e926800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:57:31.113 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.114+0000 7f891d7fa640 20 handle_completion(): completion ok for obj=x[ZXg6aVMN3L.7BzUvV7Lwrzk7zklXCOa] 2024-09-12T00:57:31.114 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.115+0000 7f8a3e926800 20 get_obj_state: octx=0x55d19fafa690 obj=myver:x state=0x55d19fdc5c48 s->prefetch_data=0 2024-09-12T00:57:31.114 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.115+0000 7f8a3e926800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=siubza5b1rbyzril61f1j4ph29t3osst 2024-09-12T00:57:31.117 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.118+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.120+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.120+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.120+0000 7f8a3e926800 20 get_obj_state: octx=0x55d19fafa690 obj=myver:y state=0x55d19fdc34f8 s->prefetch_data=0 2024-09-12T00:57:31.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.121+0000 7f8a3e926800 20 get_obj_state: setting s->obj_tag to l693391w9mlonwglgr2k3rjv5qol6ln6 2024-09-12T00:57:31.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.121+0000 7f8a3e926800 20 get_obj_state_impl: setting s->olh_tag to qlpj16hg31oix9dqcvhzqo9rihy91ses 2024-09-12T00:57:31.119 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.121+0000 7f8a3e926800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qlpj16hg31oix9dqcvhzqo9rihy91ses 2024-09-12T00:57:31.120 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.122+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.123+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.123+0000 7f8a3e926800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T00:57:31.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.123+0000 7f8a3e926800 20 olh_log_entry: epoch=2 op=3 key=y[VsibmB.Bu-qDPO0T1Z2x68dntVTioa-] 2024-09-12T00:57:31.122 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.123+0000 7f8a3e926800 20 get_obj_state: octx=0x55d19fafa690 obj=myver:_:VsibmB.Bu-qDPO0T1Z2x68dntVTioa-_y state=0x55d19fe06468 s->prefetch_data=0 2024-09-12T00:57:31.123 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.124+0000 7f8a3e926800 10 manifest: total_size = 22 2024-09-12T00:57:31.123 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.124+0000 7f8a3e926800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17811723619837850637 2024-09-12T00:57:31.123 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.124+0000 7f8a3e926800 20 get_obj_state: octx=0x55d19fafa690 obj=myver:_:VsibmB.Bu-qDPO0T1Z2x68dntVTioa-_y state=0x55d19fe06468 s->prefetch_data=0 2024-09-12T00:57:31.123 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.124+0000 7f8a3e926800 20 prepare_atomic_modification: state is not atomic. state=0x55d19fe06468 2024-09-12T00:57:31.123 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.124+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.125 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.126+0000 7f8a3e926800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:57:31.125 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.126+0000 7f8a3e926800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:57:31.125 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.126+0000 7f8a3e926800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:57:31.125 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.126+0000 7f8a3e926800 5 delete_objs_inline: removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18__shadow:VsibmB.Bu-qDPO0T1Z2x68dntVTioa-_.OHzWKQEO4plUIlNtEzfJrMzQK7HZPIu_0 2024-09-12T00:57:31.126 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.127+0000 7f8a3e926800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:57:31.126 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.127+0000 7f891d7fa640 20 handle_completion(): completion ok for obj=y[VsibmB.Bu-qDPO0T1Z2x68dntVTioa-] 2024-09-12T00:57:31.128 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.130+0000 7f8a3e926800 20 get_obj_state: octx=0x55d19fafa690 obj=myver:y state=0x55d19fdc34f8 s->prefetch_data=0 2024-09-12T00:57:31.129 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.130+0000 7f8a3e926800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=qlpj16hg31oix9dqcvhzqo9rihy91ses 2024-09-12T00:57:31.131 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.133+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.132 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.134+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.134+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.134+0000 7f8a3e926800 20 get_obj_state: octx=0x55d19fafa690 obj=myver:z state=0x55d19fdc34f8 s->prefetch_data=0 2024-09-12T00:57:31.133 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.135+0000 7f8a3e926800 20 get_obj_state: setting s->obj_tag to uqyhig34z6k6ewpjo45i0cyw1ql8rf74 2024-09-12T00:57:31.134 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.135+0000 7f8a3e926800 20 get_obj_state_impl: setting s->olh_tag to q9tp5sxrc92hfisspcdvjxzp2gbr4983 2024-09-12T00:57:31.134 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.135+0000 7f8a3e926800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=q9tp5sxrc92hfisspcdvjxzp2gbr4983 2024-09-12T00:57:31.135 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.136+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.136 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.138+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.138+0000 7f8a3e926800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T00:57:31.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.138+0000 7f8a3e926800 20 olh_log_entry: epoch=2 op=3 key=z[vA7fykJ4ujX86MYZ1LrabIkuQG2Dnju] 2024-09-12T00:57:31.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.138+0000 7f8a3e926800 20 get_obj_state: octx=0x55d19fafa690 obj=myver:_:vA7fykJ4ujX86MYZ1LrabIkuQG2Dnju_z state=0x55d19fe06468 s->prefetch_data=0 2024-09-12T00:57:31.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.138+0000 7f8a3e926800 10 manifest: total_size = 22 2024-09-12T00:57:31.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.138+0000 7f8a3e926800 20 get_obj_state: setting s->obj_tag to 8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1542079094642621927 2024-09-12T00:57:31.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.138+0000 7f8a3e926800 20 get_obj_state: octx=0x55d19fafa690 obj=myver:_:vA7fykJ4ujX86MYZ1LrabIkuQG2Dnju_z state=0x55d19fe06468 s->prefetch_data=0 2024-09-12T00:57:31.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.138+0000 7f8a3e926800 20 prepare_atomic_modification: state is not atomic. state=0x55d19fe06468 2024-09-12T00:57:31.137 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.138+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.140+0000 7f8a3e926800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:57:31.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.140+0000 7f8a3e926800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-12T00:57:31.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.140+0000 7f8a3e926800 0 deleting objects inline since gc isn't initialized 2024-09-12T00:57:31.139 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.140+0000 7f8a3e926800 5 delete_objs_inline: removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18__shadow:vA7fykJ4ujX86MYZ1LrabIkuQG2Dnju_.dkGTRgHqtpKkhrHO_ConNvgTrO60w_l_0 2024-09-12T00:57:31.141 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.142+0000 7f8a3e926800 5 delete_objs_inline: refcount put returned error -2 2024-09-12T00:57:31.141 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.142+0000 7f891d7fa640 20 handle_completion(): completion ok for obj=z[vA7fykJ4ujX86MYZ1LrabIkuQG2Dnju] 2024-09-12T00:57:31.142 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.143+0000 7f8a3e926800 20 get_obj_state: octx=0x55d19fafa690 obj=myver:z state=0x55d19fdc34f8 s->prefetch_data=0 2024-09-12T00:57:31.142 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.143+0000 7f8a3e926800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=q9tp5sxrc92hfisspcdvjxzp2gbr4983 2024-09-12T00:57:31.145 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.146+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.146 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.148+0000 7f8a3e926800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18.3.9 2024-09-12T00:57:31.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.148+0000 7f8a3e926800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T00:57:31.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.148+0000 7f8a3e926800 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T00:57:31.147 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.149+0000 7f88f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:31.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.150+0000 7f8a3e926800 20 remove_watcher() i=0 2024-09-12T00:57:31.149 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.150+0000 7f8a3e926800 2 removed watcher, disabling cache 2024-09-12T00:57:31.150 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.152+0000 7f8a3e926800 20 remove_watcher() i=1 2024-09-12T00:57:31.151 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.153+0000 7f8a3e926800 20 remove_watcher() i=2 2024-09-12T00:57:31.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.154+0000 7f8a3e926800 20 remove_watcher() i=3 2024-09-12T00:57:31.153 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.155+0000 7f8a3e926800 20 remove_watcher() i=4 2024-09-12T00:57:31.154 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.156+0000 7f8a3e926800 20 remove_watcher() i=5 2024-09-12T00:57:31.156 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.157+0000 7f8a3e926800 20 remove_watcher() i=6 2024-09-12T00:57:31.157 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.158+0000 7f8a3e926800 20 remove_watcher() i=7 2024-09-12T00:57:31.307 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:57:31.336 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:31.336 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:31.375 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.376+0000 7f4ef3739800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.378+0000 7f4ef3739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:31.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.378+0000 7f4ef3739800 20 realm 2024-09-12T00:57:31.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.378+0000 7f4ef3739800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.378+0000 7f4ef3739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:31.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.378+0000 7f4ef3739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:31.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.378+0000 7f4ef3739800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.378+0000 7f4ef3739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:31.377 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.378+0000 7f4ef3739800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.379+0000 7f4ef3739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:31.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.379+0000 7f4ef3739800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.379+0000 7f4ef3739800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:31.378 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.379+0000 7f4ef3739800 20 searching for the correct realm 2024-09-12T00:57:31.381 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.382+0000 7f4eefbcf640 0 -- 172.21.15.62:0/3053599699 >> [v2:172.21.15.77:6816/3177889521,v1:172.21.15.77:6817/3177889521] conn(0x5653a8bdb7b0 msgr2=0x5653a8bddc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:31.384 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.385+0000 7f4eef3ce640 0 -- 172.21.15.62:0/3053599699 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f4ee8018940 msgr2=0x7f4ee8040400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:57:31.591 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.592+0000 7f4ef3739800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:31.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.592+0000 7f4ef3739800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:31.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.592+0000 7f4ef3739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:31.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.592+0000 7f4ef3739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:31.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.592+0000 7f4ef3739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:31.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.592+0000 7f4ef3739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:31.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.592+0000 7f4ef3739800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.592+0000 7f4ef3739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:31.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.592+0000 7f4ef3739800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.593+0000 7f4ef3739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:31.592 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.593+0000 7f4ef3739800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.593+0000 7f4ef3739800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:31.593 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.593+0000 7f4ef3739800 20 zone default found 2024-09-12T00:57:31.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.593+0000 7f4ef3739800 4 Realm: () 2024-09-12T00:57:31.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.593+0000 7f4ef3739800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:31.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.593+0000 7f4ef3739800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:31.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.593+0000 7f4ef3739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:31.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.593+0000 7f4ef3739800 20 zonegroup default 2024-09-12T00:57:31.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.593+0000 7f4ef3739800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.593+0000 7f4ef3739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:31.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.593+0000 7f4ef3739800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.594+0000 7f4ef3739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:31.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.594+0000 7f4ef3739800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.594+0000 7f4ef3739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:31.594 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.594+0000 7f4ef3739800 20 started sync module instance, tier type = 2024-09-12T00:57:31.595 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.594+0000 7f4ef3739800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:31.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.603+0000 7f4ef3739800 20 add_watcher() i=0 2024-09-12T00:57:31.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.603+0000 7f4ef3739800 20 add_watcher() i=1 2024-09-12T00:57:31.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.603+0000 7f4ef3739800 20 add_watcher() i=2 2024-09-12T00:57:31.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.603+0000 7f4ef3739800 20 add_watcher() i=3 2024-09-12T00:57:31.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.603+0000 7f4ef3739800 20 add_watcher() i=4 2024-09-12T00:57:31.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.603+0000 7f4ef3739800 20 add_watcher() i=5 2024-09-12T00:57:31.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.603+0000 7f4ef3739800 20 add_watcher() i=6 2024-09-12T00:57:31.602 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.604+0000 7f4ef3739800 20 add_watcher() i=7 2024-09-12T00:57:31.603 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.604+0000 7f4ef3739800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:31.604 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.605+0000 7f4da5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:31.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.606+0000 7f4ef3739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:31.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.606+0000 7f4ef3739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:31.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.606+0000 7f4ef3739800 5 note: GC not initialized 2024-09-12T00:57:31.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.606+0000 7f4da4fe1640 20 reqs_thread_entry: start 2024-09-12T00:57:31.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.606+0000 7f4ef3739800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:31.605 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.606+0000 7f4ef3739800 20 Filter name: none 2024-09-12T00:57:31.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.606+0000 7f4d1e7fc640 20 reqs_thread_entry: start 2024-09-12T00:57:31.606 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.606+0000 7f4ef3739800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.607+0000 7f4ef3739800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:57:31.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.607+0000 7f4ef3739800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.607+0000 7f4ef3739800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:57:31.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.607+0000 7f4ef3739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:31.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.607+0000 7f4ef3739800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.607+0000 7f4ef3739800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:57:31.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.607+0000 7f4ef3739800 20 rados->read ofs=0 len=0 2024-09-12T00:57:31.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.608+0000 7f4ef3739800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:57:31.607 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.608+0000 7f4ef3739800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:57:31.608 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.610+0000 7f4da5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:31.610 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.612+0000 7f4ef3739800 20 remove_watcher() i=0 2024-09-12T00:57:31.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.612+0000 7f4ef3739800 2 removed watcher, disabling cache 2024-09-12T00:57:31.611 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.613+0000 7f4ef3739800 20 remove_watcher() i=1 2024-09-12T00:57:31.612 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.614+0000 7f4ef3739800 20 remove_watcher() i=2 2024-09-12T00:57:31.613 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.615+0000 7f4ef3739800 20 remove_watcher() i=3 2024-09-12T00:57:31.614 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.615+0000 7f4ef3739800 20 remove_watcher() i=4 2024-09-12T00:57:31.615 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.616+0000 7f4ef3739800 20 remove_watcher() i=5 2024-09-12T00:57:31.616 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.617+0000 7f4ef3739800 20 remove_watcher() i=6 2024-09-12T00:57:31.617 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T00:57:31.618+0000 7f4ef3739800 20 remove_watcher() i=7 2024-09-12T00:57:31.629 INFO:tasks.workunit.client.0.smithi062.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:57:31.629 INFO:tasks.workunit.client.0.smithi062.stderr:Deleting bucket a-bucket 2024-09-12T00:57:31.713 INFO:tasks.workunit.client.0.smithi062.stderr:Deleting bucket myver 2024-09-12T00:57:31.959 INFO:tasks.workunit.client.0.smithi062.stderr:Completed resharding tests 2024-09-12T00:57:31.959 INFO:tasks.workunit.client.0.smithi062.stdout:connected to http://localhost:80 2024-09-12T00:57:32.036 INFO:tasks.workunit.client.0.smithi062.stderr:+ deactivate 2024-09-12T00:57:32.036 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:57:32.036 INFO:tasks.workunit.client.0.smithi062.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:57:32.036 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-09-12T00:57:32.036 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:57:32.036 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -n '' ']' 2024-09-12T00:57:32.036 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:57:32.036 INFO:tasks.workunit.client.0.smithi062.stderr:+ hash -r 2024-09-12T00:57:32.037 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -n '' ']' 2024-09-12T00:57:32.037 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:57:32.037 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:57:32.037 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset -f deactivate 2024-09-12T00:57:32.037 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo OK. 2024-09-12T00:57:32.038 INFO:tasks.workunit.client.0.smithi062.stdout:OK. 2024-09-12T00:57:32.038 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:57:32.038 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:57:32.117 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T00:57:32.118 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:57:32.557 DEBUG:teuthology.parallel:result is None 2024-09-12T00:57:32.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:57:32.597 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:57:32.597 DEBUG:teuthology.orchestra.run.smithi062:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:57:32.666 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:57:32.666 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T00:57:32.683 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T00:57:32.684 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T00:57:32.684 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T00:57:32.684 DEBUG:teuthology.orchestra.run.smithi062:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T00:57:32.736 INFO:teuthology.orchestra.run.smithi062.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T00:57:36.938 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T00:57:36.938 DEBUG:teuthology.orchestra.run.smithi062:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T00:57:39.072 INFO:teuthology.orchestra.run.smithi062.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-12T00:57:39.667 INFO:teuthology.orchestra.run.smithi062.stdout:Last metadata expiration check: 0:29:05 ago on Thu 12 Sep 2024 12:28:34 AM UTC. 2024-09-12T00:57:39.814 INFO:teuthology.orchestra.run.smithi062.stdout:Dependencies resolved. 2024-09-12T00:57:39.814 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-09-12T00:57:39.814 INFO:teuthology.orchestra.run.smithi062.stdout: Package Arch Version Repository Size 2024-09-12T00:57:39.814 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-09-12T00:57:39.815 INFO:teuthology.orchestra.run.smithi062.stdout:Installing: 2024-09-12T00:57:39.815 INFO:teuthology.orchestra.run.smithi062.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-12T00:57:39.815 INFO:teuthology.orchestra.run.smithi062.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-12T00:57:39.815 INFO:teuthology.orchestra.run.smithi062.stdout:Installing dependencies: 2024-09-12T00:57:39.815 INFO:teuthology.orchestra.run.smithi062.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-12T00:57:39.815 INFO:teuthology.orchestra.run.smithi062.stdout:Installing weak dependencies: 2024-09-12T00:57:39.815 INFO:teuthology.orchestra.run.smithi062.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-12T00:57:39.815 INFO:teuthology.orchestra.run.smithi062.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-12T00:57:39.815 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:57:39.815 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction Summary 2024-09-12T00:57:39.815 INFO:teuthology.orchestra.run.smithi062.stdout:================================================================================ 2024-09-12T00:57:39.815 INFO:teuthology.orchestra.run.smithi062.stdout:Install 5 Packages 2024-09-12T00:57:39.816 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:57:39.816 INFO:teuthology.orchestra.run.smithi062.stdout:Total download size: 46 M 2024-09-12T00:57:39.816 INFO:teuthology.orchestra.run.smithi062.stdout:Installed size: 166 M 2024-09-12T00:57:39.816 INFO:teuthology.orchestra.run.smithi062.stdout:Downloading Packages: 2024-09-12T00:57:40.247 INFO:teuthology.orchestra.run.smithi062.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 2.4 MB/s | 426 kB 00:00 2024-09-12T00:57:40.339 INFO:teuthology.orchestra.run.smithi062.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 13 MB/s | 3.5 MB 00:00 2024-09-12T00:57:40.381 INFO:teuthology.orchestra.run.smithi062.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 623 kB/s | 26 kB 00:00 2024-09-12T00:57:40.490 INFO:teuthology.orchestra.run.smithi062.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 22 MB/s | 9.3 MB 00:00 2024-09-12T00:57:40.915 INFO:teuthology.orchestra.run.smithi062.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 48 MB/s | 32 MB 00:00 2024-09-12T00:57:40.915 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:57:40.915 INFO:teuthology.orchestra.run.smithi062.stdout:Total 41 MB/s | 46 MB 00:01 2024-09-12T00:57:41.355 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction check 2024-09-12T00:57:41.378 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction check succeeded. 2024-09-12T00:57:41.378 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction test 2024-09-12T00:57:41.882 INFO:teuthology.orchestra.run.smithi062.stdout:Transaction test succeeded. 2024-09-12T00:57:41.882 INFO:teuthology.orchestra.run.smithi062.stdout:Running transaction 2024-09-12T00:57:42.421 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-12T00:57:42.577 INFO:teuthology.orchestra.run.smithi062.stdout: Preparing : 1/1 2024-09-12T00:57:42.769 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-12T00:57:43.422 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-12T00:57:43.468 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T00:57:43.714 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T00:57:43.744 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T00:57:43.986 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T00:57:44.031 INFO:teuthology.orchestra.run.smithi062.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:57:44.040 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:57:44.049 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-12T00:57:44.092 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-12T00:57:47.246 INFO:teuthology.orchestra.run.smithi062.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:57:47.246 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-12T00:57:47.247 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-12T00:57:47.247 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-12T00:57:47.247 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-12T00:57:47.655 INFO:teuthology.orchestra.run.smithi062.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-12T00:57:47.655 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:57:47.655 INFO:teuthology.orchestra.run.smithi062.stdout:Installed: 2024-09-12T00:57:47.656 INFO:teuthology.orchestra.run.smithi062.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-12T00:57:47.656 INFO:teuthology.orchestra.run.smithi062.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:57:47.656 INFO:teuthology.orchestra.run.smithi062.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:57:47.656 INFO:teuthology.orchestra.run.smithi062.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:57:47.656 INFO:teuthology.orchestra.run.smithi062.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-12T00:57:47.656 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:57:47.656 INFO:teuthology.orchestra.run.smithi062.stdout:Complete! 2024-09-12T00:57:48.067 INFO:teuthology.orchestra.run.smithi062.stdout: Gradle will be installed under /opt/gradle 2024-09-12T00:57:48.139 INFO:teuthology.orchestra.run.smithi062.stderr:--2024-09-12 00:57:48-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T00:57:48.519 INFO:teuthology.orchestra.run.smithi062.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-12T00:57:48.533 INFO:teuthology.orchestra.run.smithi062.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-12T00:57:48.607 INFO:teuthology.orchestra.run.smithi062.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T00:57:48.607 INFO:teuthology.orchestra.run.smithi062.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T00:57:48.607 INFO:teuthology.orchestra.run.smithi062.stderr:--2024-09-12 00:57:48-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T00:57:48.607 INFO:teuthology.orchestra.run.smithi062.stderr:Resolving github.com (github.com)... 140.82.113.4 2024-09-12T00:57:48.615 INFO:teuthology.orchestra.run.smithi062.stderr:Connecting to github.com (github.com)|140.82.113.4|:443... connected. 2024-09-12T00:57:48.700 INFO:teuthology.orchestra.run.smithi062.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T00:57:48.700 INFO:teuthology.orchestra.run.smithi062.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T005616Z&X-Amz-Expires=300&X-Amz-Signature=4c23fffcaf6a1b717b9bda84ed2c137044721c3983befb40e0b0734a53a11a6e&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T00:57:48.700 INFO:teuthology.orchestra.run.smithi062.stderr:--2024-09-12 00:57:48-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T005616Z&X-Amz-Expires=300&X-Amz-Signature=4c23fffcaf6a1b717b9bda84ed2c137044721c3983befb40e0b0734a53a11a6e&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T00:57:48.715 INFO:teuthology.orchestra.run.smithi062.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.110.133, 185.199.108.133, 185.199.111.133, ... 2024-09-12T00:57:48.727 INFO:teuthology.orchestra.run.smithi062.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.110.133|:443... connected. 2024-09-12T00:57:48.799 INFO:teuthology.orchestra.run.smithi062.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T00:57:48.800 INFO:teuthology.orchestra.run.smithi062.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T00:57:48.800 INFO:teuthology.orchestra.run.smithi062.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-12T00:57:48.800 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T00:57:48.813 INFO:teuthology.orchestra.run.smithi062.stderr: 0K .......... .......... .......... .......... .......... 0% 3.48M 26s 2024-09-12T00:57:48.825 INFO:teuthology.orchestra.run.smithi062.stderr: 50K .......... .......... .......... .......... .......... 0% 4.04M 24s 2024-09-12T00:57:48.834 INFO:teuthology.orchestra.run.smithi062.stderr: 100K .......... .......... .......... .......... .......... 0% 5.36M 22s 2024-09-12T00:57:48.836 INFO:teuthology.orchestra.run.smithi062.stderr: 150K .......... .......... .......... .......... .......... 0% 21.9M 17s 2024-09-12T00:57:48.838 INFO:teuthology.orchestra.run.smithi062.stderr: 200K .......... .......... .......... .......... .......... 0% 23.5M 15s 2024-09-12T00:57:48.845 INFO:teuthology.orchestra.run.smithi062.stderr: 250K .......... .......... .......... .......... .......... 0% 33.8M 13s 2024-09-12T00:57:48.846 INFO:teuthology.orchestra.run.smithi062.stderr: 300K .......... .......... .......... .......... .......... 0% 7.81M 12s 2024-09-12T00:57:48.847 INFO:teuthology.orchestra.run.smithi062.stderr: 350K .......... .......... .......... .......... .......... 0% 48.2M 11s 2024-09-12T00:57:48.848 INFO:teuthology.orchestra.run.smithi062.stderr: 400K .......... .......... .......... .......... .......... 0% 35.1M 10s 2024-09-12T00:57:48.850 INFO:teuthology.orchestra.run.smithi062.stderr: 450K .......... .......... .......... .......... .......... 0% 28.3M 9s 2024-09-12T00:57:48.862 INFO:teuthology.orchestra.run.smithi062.stderr: 500K .......... .......... .......... .......... .......... 0% 4.26M 11s 2024-09-12T00:57:48.869 INFO:teuthology.orchestra.run.smithi062.stderr: 550K .......... .......... .......... .......... .......... 0% 7.59M 11s 2024-09-12T00:57:48.869 INFO:teuthology.orchestra.run.smithi062.stderr: 600K .......... .......... .......... .......... .......... 0% 292M 10s 2024-09-12T00:57:48.871 INFO:teuthology.orchestra.run.smithi062.stderr: 650K .......... .......... .......... .......... .......... 0% 81.2M 9s 2024-09-12T00:57:48.871 INFO:teuthology.orchestra.run.smithi062.stderr: 700K .......... .......... .......... .......... .......... 0% 70.1M 9s 2024-09-12T00:57:48.876 INFO:teuthology.orchestra.run.smithi062.stderr: 750K .......... .......... .......... .......... .......... 0% 22.6M 8s 2024-09-12T00:57:48.876 INFO:teuthology.orchestra.run.smithi062.stderr: 800K .......... .......... .......... .......... .......... 0% 286M 8s 2024-09-12T00:57:48.877 INFO:teuthology.orchestra.run.smithi062.stderr: 850K .......... .......... .......... .......... .......... 0% 74.4M 8s 2024-09-12T00:57:48.877 INFO:teuthology.orchestra.run.smithi062.stderr: 900K .......... .......... .......... .......... .......... 1% 74.6M 7s 2024-09-12T00:57:48.877 INFO:teuthology.orchestra.run.smithi062.stderr: 950K .......... .......... .......... .......... .......... 1% 296M 7s 2024-09-12T00:57:48.877 INFO:teuthology.orchestra.run.smithi062.stderr: 1000K .......... .......... .......... .......... .......... 1% 71.2M 7s 2024-09-12T00:57:50.444 INFO:teuthology.orchestra.run.smithi062.stderr: 1050K .......... .......... .......... .......... .......... 1% 7.06M 7s 2024-09-12T00:57:50.453 INFO:teuthology.orchestra.run.smithi062.stderr: 1100K .......... .......... .......... .......... .......... 1% 100M 7s 2024-09-12T00:57:50.453 INFO:teuthology.orchestra.run.smithi062.stderr: 1150K .......... .......... .......... .......... .......... 1% 230M 6s 2024-09-12T00:57:50.453 INFO:teuthology.orchestra.run.smithi062.stderr: 1200K .......... .......... .......... .......... .......... 1% 275M 6s 2024-09-12T00:57:50.453 INFO:teuthology.orchestra.run.smithi062.stderr: 1250K .......... .......... .......... .......... .......... 1% 45.3M 6s 2024-09-12T00:57:50.453 INFO:teuthology.orchestra.run.smithi062.stderr: 1300K .......... .......... .......... .......... .......... 1% 246M 6s 2024-09-12T00:57:50.453 INFO:teuthology.orchestra.run.smithi062.stderr: 1350K .......... .......... .......... .......... .......... 1% 126M 6s 2024-09-12T00:57:50.453 INFO:teuthology.orchestra.run.smithi062.stderr: 1400K .......... .......... .......... .......... .......... 1% 323M 5s 2024-09-12T00:57:50.453 INFO:teuthology.orchestra.run.smithi062.stderr: 1450K .......... .......... .......... .......... .......... 1% 104M 5s 2024-09-12T00:57:50.454 INFO:teuthology.orchestra.run.smithi062.stderr: 1500K .......... .......... .......... .......... .......... 1% 137M 5s 2024-09-12T00:57:50.454 INFO:teuthology.orchestra.run.smithi062.stderr: 1550K .......... .......... .......... .......... .......... 1% 151M 5s 2024-09-12T00:57:50.454 INFO:teuthology.orchestra.run.smithi062.stderr: 1600K .......... .......... .......... .......... .......... 1% 159M 5s 2024-09-12T00:57:50.454 INFO:teuthology.orchestra.run.smithi062.stderr: 1650K .......... .......... .......... .......... .......... 1% 287M 5s 2024-09-12T00:57:50.454 INFO:teuthology.orchestra.run.smithi062.stderr: 1700K .......... .......... .......... .......... .......... 1% 135M 5s 2024-09-12T00:57:50.454 INFO:teuthology.orchestra.run.smithi062.stderr: 1750K .......... .......... .......... .......... .......... 1% 148M 4s 2024-09-12T00:57:50.454 INFO:teuthology.orchestra.run.smithi062.stderr: 1800K .......... .......... .......... .......... .......... 1% 170M 4s 2024-09-12T00:57:50.454 INFO:teuthology.orchestra.run.smithi062.stderr: 1850K .......... .......... .......... .......... .......... 2% 329M 4s 2024-09-12T00:57:50.454 INFO:teuthology.orchestra.run.smithi062.stderr: 1900K .......... .......... .......... .......... .......... 2% 27.9M 4s 2024-09-12T00:57:50.454 INFO:teuthology.orchestra.run.smithi062.stderr: 1950K .......... .......... .......... .......... .......... 2% 193M 4s 2024-09-12T00:57:50.454 INFO:teuthology.orchestra.run.smithi062.stderr: 2000K .......... .......... .......... .......... .......... 2% 359M 4s 2024-09-12T00:57:50.454 INFO:teuthology.orchestra.run.smithi062.stderr: 2050K .......... .......... .......... .......... .......... 2% 359M 4s 2024-09-12T00:57:50.454 INFO:teuthology.orchestra.run.smithi062.stderr: 2100K .......... .......... .......... .......... .......... 2% 41.4M 4s 2024-09-12T00:57:50.455 INFO:teuthology.orchestra.run.smithi062.stderr: 2150K .......... .......... .......... .......... .......... 2% 16.5M 4s 2024-09-12T00:57:50.455 INFO:teuthology.orchestra.run.smithi062.stderr: 2200K .......... .......... .......... .......... .......... 2% 306M 4s 2024-09-12T00:57:50.455 INFO:teuthology.orchestra.run.smithi062.stderr: 2250K .......... .......... .......... .......... .......... 2% 294M 4s 2024-09-12T00:57:50.455 INFO:teuthology.orchestra.run.smithi062.stderr: 2300K .......... .......... .......... .......... .......... 2% 236M 4s 2024-09-12T00:57:50.455 INFO:teuthology.orchestra.run.smithi062.stderr: 2350K .......... .......... .......... .......... .......... 2% 293M 4s 2024-09-12T00:57:50.455 INFO:teuthology.orchestra.run.smithi062.stderr: 2400K .......... .......... .......... .......... .......... 2% 320M 4s 2024-09-12T00:57:50.455 INFO:teuthology.orchestra.run.smithi062.stderr: 2450K .......... .......... .......... .......... .......... 2% 314M 3s 2024-09-12T00:57:50.455 INFO:teuthology.orchestra.run.smithi062.stderr: 2500K .......... .......... .......... .......... .......... 2% 265M 3s 2024-09-12T00:57:50.455 INFO:teuthology.orchestra.run.smithi062.stderr: 2550K .......... .......... .......... .......... .......... 2% 83.4M 3s 2024-09-12T00:57:50.455 INFO:teuthology.orchestra.run.smithi062.stderr: 2600K .......... .......... .......... .......... .......... 2% 301M 3s 2024-09-12T00:57:50.455 INFO:teuthology.orchestra.run.smithi062.stderr: 2650K .......... .......... .......... .......... .......... 2% 284M 3s 2024-09-12T00:57:50.455 INFO:teuthology.orchestra.run.smithi062.stderr: 2700K .......... .......... .......... .......... .......... 2% 270M 3s 2024-09-12T00:57:50.455 INFO:teuthology.orchestra.run.smithi062.stderr: 2750K .......... .......... .......... .......... .......... 3% 248M 3s 2024-09-12T00:57:50.455 INFO:teuthology.orchestra.run.smithi062.stderr: 2800K .......... .......... .......... .......... .......... 3% 27.7M 3s 2024-09-12T00:57:50.456 INFO:teuthology.orchestra.run.smithi062.stderr: 2850K .......... .......... .......... .......... .......... 3% 30.5M 3s 2024-09-12T00:57:50.456 INFO:teuthology.orchestra.run.smithi062.stderr: 2900K .......... .......... .......... .......... .......... 3% 218M 3s 2024-09-12T00:57:50.456 INFO:teuthology.orchestra.run.smithi062.stderr: 2950K .......... .......... .......... .......... .......... 3% 375M 3s 2024-09-12T00:57:50.456 INFO:teuthology.orchestra.run.smithi062.stderr: 3000K .......... .......... .......... .......... .......... 3% 387M 3s 2024-09-12T00:57:50.456 INFO:teuthology.orchestra.run.smithi062.stderr: 3050K .......... .......... .......... .......... .......... 3% 49.4M 3s 2024-09-12T00:57:50.456 INFO:teuthology.orchestra.run.smithi062.stderr: 3100K .......... .......... .......... .......... .......... 3% 249M 3s 2024-09-12T00:57:50.456 INFO:teuthology.orchestra.run.smithi062.stderr: 3150K .......... .......... .......... .......... .......... 3% 312M 3s 2024-09-12T00:57:50.456 INFO:teuthology.orchestra.run.smithi062.stderr: 3200K .......... .......... .......... .......... .......... 3% 368M 3s 2024-09-12T00:57:50.456 INFO:teuthology.orchestra.run.smithi062.stderr: 3250K .......... .......... .......... .......... .......... 3% 24.9M 3s 2024-09-12T00:57:50.456 INFO:teuthology.orchestra.run.smithi062.stderr: 3300K .......... .......... .......... .......... .......... 3% 244M 3s 2024-09-12T00:57:50.456 INFO:teuthology.orchestra.run.smithi062.stderr: 3350K .......... .......... .......... .......... .......... 3% 361M 3s 2024-09-12T00:57:50.456 INFO:teuthology.orchestra.run.smithi062.stderr: 3400K .......... .......... .......... .......... .......... 3% 379M 3s 2024-09-12T00:57:50.456 INFO:teuthology.orchestra.run.smithi062.stderr: 3450K .......... .......... .......... .......... .......... 3% 33.5M 3s 2024-09-12T00:57:50.457 INFO:teuthology.orchestra.run.smithi062.stderr: 3500K .......... .......... .......... .......... .......... 3% 227M 3s 2024-09-12T00:57:50.457 INFO:teuthology.orchestra.run.smithi062.stderr: 3550K .......... .......... .......... .......... .......... 3% 327M 3s 2024-09-12T00:57:50.457 INFO:teuthology.orchestra.run.smithi062.stderr: 3600K .......... .......... .......... .......... .......... 3% 37.4M 3s 2024-09-12T00:57:50.457 INFO:teuthology.orchestra.run.smithi062.stderr: 3650K .......... .......... .......... .......... .......... 3% 252M 3s 2024-09-12T00:57:50.457 INFO:teuthology.orchestra.run.smithi062.stderr: 3700K .......... .......... .......... .......... .......... 4% 221M 3s 2024-09-12T00:57:50.457 INFO:teuthology.orchestra.run.smithi062.stderr: 3750K .......... .......... .......... .......... .......... 4% 368M 3s 2024-09-12T00:57:50.457 INFO:teuthology.orchestra.run.smithi062.stderr: 3800K .......... .......... .......... .......... .......... 4% 44.2M 3s 2024-09-12T00:57:50.457 INFO:teuthology.orchestra.run.smithi062.stderr: 3850K .......... .......... .......... .......... .......... 4% 271M 2s 2024-09-12T00:57:50.457 INFO:teuthology.orchestra.run.smithi062.stderr: 3900K .......... .......... .......... .......... .......... 4% 253M 2s 2024-09-12T00:57:50.457 INFO:teuthology.orchestra.run.smithi062.stderr: 3950K .......... .......... .......... .......... .......... 4% 378M 2s 2024-09-12T00:57:50.457 INFO:teuthology.orchestra.run.smithi062.stderr: 4000K .......... .......... .......... .......... .......... 4% 60.5M 2s 2024-09-12T00:57:50.457 INFO:teuthology.orchestra.run.smithi062.stderr: 4050K .......... .......... .......... .......... .......... 4% 303M 2s 2024-09-12T00:57:50.457 INFO:teuthology.orchestra.run.smithi062.stderr: 4100K .......... .......... .......... .......... .......... 4% 249M 2s 2024-09-12T00:57:50.458 INFO:teuthology.orchestra.run.smithi062.stderr: 4150K .......... .......... .......... .......... .......... 4% 372M 2s 2024-09-12T00:57:50.458 INFO:teuthology.orchestra.run.smithi062.stderr: 4200K .......... .......... .......... .......... .......... 4% 39.3M 2s 2024-09-12T00:57:50.458 INFO:teuthology.orchestra.run.smithi062.stderr: 4250K .......... .......... .......... .......... .......... 4% 215M 2s 2024-09-12T00:57:50.458 INFO:teuthology.orchestra.run.smithi062.stderr: 4300K .......... .......... .......... .......... .......... 4% 293M 2s 2024-09-12T00:57:50.458 INFO:teuthology.orchestra.run.smithi062.stderr: 4350K .......... .......... .......... .......... .......... 4% 379M 2s 2024-09-12T00:57:50.458 INFO:teuthology.orchestra.run.smithi062.stderr: 4400K .......... .......... .......... .......... .......... 4% 49.4M 2s 2024-09-12T00:57:50.458 INFO:teuthology.orchestra.run.smithi062.stderr: 4450K .......... .......... .......... .......... .......... 4% 297M 2s 2024-09-12T00:57:50.458 INFO:teuthology.orchestra.run.smithi062.stderr: 4500K .......... .......... .......... .......... .......... 4% 342M 2s 2024-09-12T00:57:50.458 INFO:teuthology.orchestra.run.smithi062.stderr: 4550K .......... .......... .......... .......... .......... 4% 316M 2s 2024-09-12T00:57:50.458 INFO:teuthology.orchestra.run.smithi062.stderr: 4600K .......... .......... .......... .......... .......... 5% 55.0M 2s 2024-09-12T00:57:50.458 INFO:teuthology.orchestra.run.smithi062.stderr: 4650K .......... .......... .......... .......... .......... 5% 287M 2s 2024-09-12T00:57:50.458 INFO:teuthology.orchestra.run.smithi062.stderr: 4700K .......... .......... .......... .......... .......... 5% 302M 2s 2024-09-12T00:57:50.458 INFO:teuthology.orchestra.run.smithi062.stderr: 4750K .......... .......... .......... .......... .......... 5% 81.5M 2s 2024-09-12T00:57:50.458 INFO:teuthology.orchestra.run.smithi062.stderr: 4800K .......... .......... .......... .......... .......... 5% 275M 2s 2024-09-12T00:57:50.459 INFO:teuthology.orchestra.run.smithi062.stderr: 4850K .......... .......... .......... .......... .......... 5% 313M 2s 2024-09-12T00:57:50.459 INFO:teuthology.orchestra.run.smithi062.stderr: 4900K .......... .......... .......... .......... .......... 5% 331M 2s 2024-09-12T00:57:50.459 INFO:teuthology.orchestra.run.smithi062.stderr: 4950K .......... .......... .......... .......... .......... 5% 258M 2s 2024-09-12T00:57:50.459 INFO:teuthology.orchestra.run.smithi062.stderr: 5000K .......... .......... .......... .......... .......... 5% 195M 2s 2024-09-12T00:57:50.459 INFO:teuthology.orchestra.run.smithi062.stderr: 5050K .......... .......... .......... .......... .......... 5% 341M 2s 2024-09-12T00:57:50.459 INFO:teuthology.orchestra.run.smithi062.stderr: 5100K .......... .......... .......... .......... .......... 5% 229M 2s 2024-09-12T00:57:50.459 INFO:teuthology.orchestra.run.smithi062.stderr: 5150K .......... .......... .......... .......... .......... 5% 315M 2s 2024-09-12T00:57:50.459 INFO:teuthology.orchestra.run.smithi062.stderr: 5200K .......... .......... .......... .......... .......... 5% 366M 2s 2024-09-12T00:57:50.459 INFO:teuthology.orchestra.run.smithi062.stderr: 5250K .......... .......... .......... .......... .......... 5% 349M 2s 2024-09-12T00:57:50.459 INFO:teuthology.orchestra.run.smithi062.stderr: 5300K .......... .......... .......... .......... .......... 5% 261M 2s 2024-09-12T00:57:50.459 INFO:teuthology.orchestra.run.smithi062.stderr: 5350K .......... .......... .......... .......... .......... 5% 260M 2s 2024-09-12T00:57:50.459 INFO:teuthology.orchestra.run.smithi062.stderr: 5400K .......... .......... .......... .......... .......... 5% 380M 2s 2024-09-12T00:57:50.459 INFO:teuthology.orchestra.run.smithi062.stderr: 5450K .......... .......... .......... .......... .......... 5% 387M 2s 2024-09-12T00:57:50.460 INFO:teuthology.orchestra.run.smithi062.stderr: 5500K .......... .......... .......... .......... .......... 5% 322M 2s 2024-09-12T00:57:50.460 INFO:teuthology.orchestra.run.smithi062.stderr: 5550K .......... .......... .......... .......... .......... 6% 235M 2s 2024-09-12T00:57:50.460 INFO:teuthology.orchestra.run.smithi062.stderr: 5600K .......... .......... .......... .......... .......... 6% 276M 2s 2024-09-12T00:57:50.460 INFO:teuthology.orchestra.run.smithi062.stderr: 5650K .......... .......... .......... .......... .......... 6% 385M 2s 2024-09-12T00:57:50.460 INFO:teuthology.orchestra.run.smithi062.stderr: 5700K .......... .......... .......... .......... .......... 6% 289M 2s 2024-09-12T00:57:50.460 INFO:teuthology.orchestra.run.smithi062.stderr: 5750K .......... .......... .......... .......... .......... 6% 266M 2s 2024-09-12T00:57:50.460 INFO:teuthology.orchestra.run.smithi062.stderr: 5800K .......... .......... .......... .......... .......... 6% 307M 2s 2024-09-12T00:57:50.460 INFO:teuthology.orchestra.run.smithi062.stderr: 5850K .......... .......... .......... .......... .......... 6% 378M 2s 2024-09-12T00:57:50.460 INFO:teuthology.orchestra.run.smithi062.stderr: 5900K .......... .......... .......... .......... .......... 6% 88.7M 2s 2024-09-12T00:57:50.460 INFO:teuthology.orchestra.run.smithi062.stderr: 5950K .......... .......... .......... .......... .......... 6% 273M 2s 2024-09-12T00:57:50.460 INFO:teuthology.orchestra.run.smithi062.stderr: 6000K .......... .......... .......... .......... .......... 6% 297M 2s 2024-09-12T00:57:50.460 INFO:teuthology.orchestra.run.smithi062.stderr: 6050K .......... .......... .......... .......... .......... 6% 377M 2s 2024-09-12T00:57:50.460 INFO:teuthology.orchestra.run.smithi062.stderr: 6100K .......... .......... .......... .......... .......... 6% 272M 2s 2024-09-12T00:57:50.461 INFO:teuthology.orchestra.run.smithi062.stderr: 6150K .......... .......... .......... .......... .......... 6% 279M 2s 2024-09-12T00:57:50.461 INFO:teuthology.orchestra.run.smithi062.stderr: 6200K .......... .......... .......... .......... .......... 6% 295M 2s 2024-09-12T00:57:50.461 INFO:teuthology.orchestra.run.smithi062.stderr: 6250K .......... .......... .......... .......... .......... 6% 371M 2s 2024-09-12T00:57:50.461 INFO:teuthology.orchestra.run.smithi062.stderr: 6300K .......... .......... .......... .......... .......... 6% 249M 2s 2024-09-12T00:57:50.461 INFO:teuthology.orchestra.run.smithi062.stderr: 6350K .......... .......... .......... .......... .......... 6% 308M 2s 2024-09-12T00:57:50.461 INFO:teuthology.orchestra.run.smithi062.stderr: 6400K .......... .......... .......... .......... .......... 6% 341M 2s 2024-09-12T00:57:50.461 INFO:teuthology.orchestra.run.smithi062.stderr: 6450K .......... .......... .......... .......... .......... 6% 257M 2s 2024-09-12T00:57:50.461 INFO:teuthology.orchestra.run.smithi062.stderr: 6500K .......... .......... .......... .......... .......... 7% 265M 2s 2024-09-12T00:57:50.461 INFO:teuthology.orchestra.run.smithi062.stderr: 6550K .......... .......... .......... .......... .......... 7% 378M 2s 2024-09-12T00:57:50.461 INFO:teuthology.orchestra.run.smithi062.stderr: 6600K .......... .......... .......... .......... .......... 7% 223M 2s 2024-09-12T00:57:50.461 INFO:teuthology.orchestra.run.smithi062.stderr: 6650K .......... .......... .......... .......... .......... 7% 258M 2s 2024-09-12T00:57:50.461 INFO:teuthology.orchestra.run.smithi062.stderr: 6700K .......... .......... .......... .......... .......... 7% 265M 2s 2024-09-12T00:57:50.461 INFO:teuthology.orchestra.run.smithi062.stderr: 6750K .......... .......... .......... .......... .......... 7% 285M 2s 2024-09-12T00:57:50.462 INFO:teuthology.orchestra.run.smithi062.stderr: 6800K .......... .......... .......... .......... .......... 7% 298M 2s 2024-09-12T00:57:50.462 INFO:teuthology.orchestra.run.smithi062.stderr: 6850K .......... .......... .......... .......... .......... 7% 297M 2s 2024-09-12T00:57:50.462 INFO:teuthology.orchestra.run.smithi062.stderr: 6900K .......... .......... .......... .......... .......... 7% 220M 2s 2024-09-12T00:57:50.462 INFO:teuthology.orchestra.run.smithi062.stderr: 6950K .......... .......... .......... .......... .......... 7% 308M 2s 2024-09-12T00:57:50.462 INFO:teuthology.orchestra.run.smithi062.stderr: 7000K .......... .......... .......... .......... .......... 7% 378M 2s 2024-09-12T00:57:50.462 INFO:teuthology.orchestra.run.smithi062.stderr: 7050K .......... .......... .......... .......... .......... 7% 387M 1s 2024-09-12T00:57:50.462 INFO:teuthology.orchestra.run.smithi062.stderr: 7100K .......... .......... .......... .......... .......... 7% 292M 1s 2024-09-12T00:57:50.462 INFO:teuthology.orchestra.run.smithi062.stderr: 7150K .......... .......... .......... .......... .......... 7% 292M 1s 2024-09-12T00:57:50.462 INFO:teuthology.orchestra.run.smithi062.stderr: 7200K .......... .......... .......... .......... .......... 7% 311M 1s 2024-09-12T00:57:50.462 INFO:teuthology.orchestra.run.smithi062.stderr: 7250K .......... .......... .......... .......... .......... 7% 383M 1s 2024-09-12T00:57:50.462 INFO:teuthology.orchestra.run.smithi062.stderr: 7300K .......... .......... .......... .......... .......... 7% 335M 1s 2024-09-12T00:57:50.462 INFO:teuthology.orchestra.run.smithi062.stderr: 7350K .......... .......... .......... .......... .......... 7% 338M 1s 2024-09-12T00:57:50.462 INFO:teuthology.orchestra.run.smithi062.stderr: 7400K .......... .......... .......... .......... .......... 8% 308M 1s 2024-09-12T00:57:50.462 INFO:teuthology.orchestra.run.smithi062.stderr: 7450K .......... .......... .......... .......... .......... 8% 341M 1s 2024-09-12T00:57:50.463 INFO:teuthology.orchestra.run.smithi062.stderr: 7500K .......... .......... .......... .......... .......... 8% 266M 1s 2024-09-12T00:57:50.463 INFO:teuthology.orchestra.run.smithi062.stderr: 7550K .......... .......... .......... .......... .......... 8% 68.4M 1s 2024-09-12T00:57:50.463 INFO:teuthology.orchestra.run.smithi062.stderr: 7600K .......... .......... .......... .......... .......... 8% 102M 1s 2024-09-12T00:57:50.463 INFO:teuthology.orchestra.run.smithi062.stderr: 7650K .......... .......... .......... .......... .......... 8% 337M 1s 2024-09-12T00:57:50.463 INFO:teuthology.orchestra.run.smithi062.stderr: 7700K .......... .......... .......... .......... .......... 8% 189M 1s 2024-09-12T00:57:50.463 INFO:teuthology.orchestra.run.smithi062.stderr: 7750K .......... .......... .......... .......... .......... 8% 76.7M 1s 2024-09-12T00:57:50.463 INFO:teuthology.orchestra.run.smithi062.stderr: 7800K .......... .......... .......... .......... .......... 8% 299M 1s 2024-09-12T00:57:50.463 INFO:teuthology.orchestra.run.smithi062.stderr: 7850K .......... .......... .......... .......... .......... 8% 315M 1s 2024-09-12T00:57:50.463 INFO:teuthology.orchestra.run.smithi062.stderr: 7900K .......... .......... .......... .......... .......... 8% 280M 1s 2024-09-12T00:57:50.463 INFO:teuthology.orchestra.run.smithi062.stderr: 7950K .......... .......... .......... .......... .......... 8% 252M 1s 2024-09-12T00:57:50.463 INFO:teuthology.orchestra.run.smithi062.stderr: 8000K .......... .......... .......... .......... .......... 8% 314M 1s 2024-09-12T00:57:50.463 INFO:teuthology.orchestra.run.smithi062.stderr: 8050K .......... .......... .......... .......... .......... 8% 337M 1s 2024-09-12T00:57:50.463 INFO:teuthology.orchestra.run.smithi062.stderr: 8100K .......... .......... .......... .......... .......... 8% 243M 1s 2024-09-12T00:57:50.463 INFO:teuthology.orchestra.run.smithi062.stderr: 8150K .......... .......... .......... .......... .......... 8% 79.0M 1s 2024-09-12T00:57:50.464 INFO:teuthology.orchestra.run.smithi062.stderr: 8200K .......... .......... .......... .......... .......... 8% 129M 1s 2024-09-12T00:57:50.464 INFO:teuthology.orchestra.run.smithi062.stderr: 8250K .......... .......... .......... .......... .......... 8% 255M 1s 2024-09-12T00:57:50.464 INFO:teuthology.orchestra.run.smithi062.stderr: 8300K .......... .......... .......... .......... .......... 8% 249M 1s 2024-09-12T00:57:50.464 INFO:teuthology.orchestra.run.smithi062.stderr: 8350K .......... .......... .......... .......... .......... 9% 327M 1s 2024-09-12T00:57:50.464 INFO:teuthology.orchestra.run.smithi062.stderr: 8400K .......... .......... .......... .......... .......... 9% 391M 1s 2024-09-12T00:57:50.464 INFO:teuthology.orchestra.run.smithi062.stderr: 8450K .......... .......... .......... .......... .......... 9% 72.5M 1s 2024-09-12T00:57:50.464 INFO:teuthology.orchestra.run.smithi062.stderr: 8500K .......... .......... .......... .......... .......... 9% 197M 1s 2024-09-12T00:57:50.464 INFO:teuthology.orchestra.run.smithi062.stderr: 8550K .......... .......... .......... .......... .......... 9% 300M 1s 2024-09-12T00:57:50.464 INFO:teuthology.orchestra.run.smithi062.stderr: 8600K .......... .......... .......... .......... .......... 9% 365M 1s 2024-09-12T00:57:50.464 INFO:teuthology.orchestra.run.smithi062.stderr: 8650K .......... .......... .......... .......... .......... 9% 117M 1s 2024-09-12T00:57:50.464 INFO:teuthology.orchestra.run.smithi062.stderr: 8700K .......... .......... .......... .......... .......... 9% 63.0M 1s 2024-09-12T00:57:50.464 INFO:teuthology.orchestra.run.smithi062.stderr: 8750K .......... .......... .......... .......... .......... 9% 361M 1s 2024-09-12T00:57:50.464 INFO:teuthology.orchestra.run.smithi062.stderr: 8800K .......... .......... .......... .......... .......... 9% 81.5M 1s 2024-09-12T00:57:50.464 INFO:teuthology.orchestra.run.smithi062.stderr: 8850K .......... .......... .......... .......... .......... 9% 267M 1s 2024-09-12T00:57:50.465 INFO:teuthology.orchestra.run.smithi062.stderr: 8900K .......... .......... .......... .......... .......... 9% 44.3M 1s 2024-09-12T00:57:50.465 INFO:teuthology.orchestra.run.smithi062.stderr: 8950K .......... .......... .......... .......... .......... 9% 365M 1s 2024-09-12T00:57:50.465 INFO:teuthology.orchestra.run.smithi062.stderr: 9000K .......... .......... .......... .......... .......... 9% 156M 1s 2024-09-12T00:57:50.465 INFO:teuthology.orchestra.run.smithi062.stderr: 9050K .......... .......... .......... .......... .......... 9% 353M 1s 2024-09-12T00:57:50.465 INFO:teuthology.orchestra.run.smithi062.stderr: 9100K .......... .......... .......... .......... .......... 9% 186M 1s 2024-09-12T00:57:50.465 INFO:teuthology.orchestra.run.smithi062.stderr: 9150K .......... .......... .......... .......... .......... 9% 359M 1s 2024-09-12T00:57:50.465 INFO:teuthology.orchestra.run.smithi062.stderr: 9200K .......... .......... .......... .......... .......... 9% 174M 1s 2024-09-12T00:57:50.465 INFO:teuthology.orchestra.run.smithi062.stderr: 9250K .......... .......... .......... .......... .......... 10% 184M 1s 2024-09-12T00:57:50.465 INFO:teuthology.orchestra.run.smithi062.stderr: 9300K .......... .......... .......... .......... .......... 10% 205M 1s 2024-09-12T00:57:50.465 INFO:teuthology.orchestra.run.smithi062.stderr: 9350K .......... .......... .......... .......... .......... 10% 368M 1s 2024-09-12T00:57:50.465 INFO:teuthology.orchestra.run.smithi062.stderr: 9400K .......... .......... .......... .......... .......... 10% 63.8M 1s 2024-09-12T00:57:50.465 INFO:teuthology.orchestra.run.smithi062.stderr: 9450K .......... .......... .......... .......... .......... 10% 157M 1s 2024-09-12T00:57:50.466 INFO:teuthology.orchestra.run.smithi062.stderr: 9500K .......... .......... .......... .......... .......... 10% 248M 1s 2024-09-12T00:57:50.466 INFO:teuthology.orchestra.run.smithi062.stderr: 9550K .......... .......... .......... .......... .......... 10% 342M 1s 2024-09-12T00:57:50.466 INFO:teuthology.orchestra.run.smithi062.stderr: 9600K .......... .......... .......... .......... .......... 10% 160M 1s 2024-09-12T00:57:50.466 INFO:teuthology.orchestra.run.smithi062.stderr: 9650K .......... .......... .......... .......... .......... 10% 68.7M 1s 2024-09-12T00:57:50.466 INFO:teuthology.orchestra.run.smithi062.stderr: 9700K .......... .......... .......... .......... .......... 10% 287M 1s 2024-09-12T00:57:50.466 INFO:teuthology.orchestra.run.smithi062.stderr: 9750K .......... .......... .......... .......... .......... 10% 298M 1s 2024-09-12T00:57:50.466 INFO:teuthology.orchestra.run.smithi062.stderr: 9800K .......... .......... .......... .......... .......... 10% 373M 1s 2024-09-12T00:57:50.466 INFO:teuthology.orchestra.run.smithi062.stderr: 9850K .......... .......... .......... .......... .......... 10% 116M 1s 2024-09-12T00:57:50.466 INFO:teuthology.orchestra.run.smithi062.stderr: 9900K .......... .......... .......... .......... .......... 10% 281M 1s 2024-09-12T00:57:50.466 INFO:teuthology.orchestra.run.smithi062.stderr: 9950K .......... .......... .......... .......... .......... 10% 55.2M 1s 2024-09-12T00:57:50.466 INFO:teuthology.orchestra.run.smithi062.stderr: 10000K .......... .......... .......... .......... .......... 10% 281M 1s 2024-09-12T00:57:50.466 INFO:teuthology.orchestra.run.smithi062.stderr: 10050K .......... .......... .......... .......... .......... 10% 302M 1s 2024-09-12T00:57:50.466 INFO:teuthology.orchestra.run.smithi062.stderr: 10100K .......... .......... .......... .......... .......... 10% 336M 1s 2024-09-12T00:57:50.466 INFO:teuthology.orchestra.run.smithi062.stderr: 10150K .......... .......... .......... .......... .......... 10% 259M 1s 2024-09-12T00:57:50.467 INFO:teuthology.orchestra.run.smithi062.stderr: 10200K .......... .......... .......... .......... .......... 11% 11.0M 1s 2024-09-12T00:57:50.467 INFO:teuthology.orchestra.run.smithi062.stderr: 10250K .......... .......... .......... .......... .......... 11% 264M 1s 2024-09-12T00:57:50.467 INFO:teuthology.orchestra.run.smithi062.stderr: 10300K .......... .......... .......... .......... .......... 11% 390M 1s 2024-09-12T00:57:50.467 INFO:teuthology.orchestra.run.smithi062.stderr: 10350K .......... .......... .......... .......... .......... 11% 76.6M 1s 2024-09-12T00:57:50.467 INFO:teuthology.orchestra.run.smithi062.stderr: 10400K .......... .......... .......... .......... .......... 11% 239M 1s 2024-09-12T00:57:50.467 INFO:teuthology.orchestra.run.smithi062.stderr: 10450K .......... .......... .......... .......... .......... 11% 352M 1s 2024-09-12T00:57:50.467 INFO:teuthology.orchestra.run.smithi062.stderr: 10500K .......... .......... .......... .......... .......... 11% 164M 1s 2024-09-12T00:57:50.467 INFO:teuthology.orchestra.run.smithi062.stderr: 10550K .......... .......... .......... .......... .......... 11% 28.9M 1s 2024-09-12T00:57:50.467 INFO:teuthology.orchestra.run.smithi062.stderr: 10600K .......... .......... .......... .......... .......... 11% 194M 1s 2024-09-12T00:57:50.467 INFO:teuthology.orchestra.run.smithi062.stderr: 10650K .......... .......... .......... .......... .......... 11% 259M 1s 2024-09-12T00:57:50.467 INFO:teuthology.orchestra.run.smithi062.stderr: 10700K .......... .......... .......... .......... .......... 11% 304M 1s 2024-09-12T00:57:50.467 INFO:teuthology.orchestra.run.smithi062.stderr: 10750K .......... .......... .......... .......... .......... 11% 276M 1s 2024-09-12T00:57:50.467 INFO:teuthology.orchestra.run.smithi062.stderr: 10800K .......... .......... .......... .......... .......... 11% 393M 1s 2024-09-12T00:57:50.468 INFO:teuthology.orchestra.run.smithi062.stderr: 10850K .......... .......... .......... .......... .......... 11% 38.7M 1s 2024-09-12T00:57:50.468 INFO:teuthology.orchestra.run.smithi062.stderr: 10900K .......... .......... .......... .......... .......... 11% 279M 1s 2024-09-12T00:57:50.468 INFO:teuthology.orchestra.run.smithi062.stderr: 10950K .......... .......... .......... .......... .......... 11% 320M 1s 2024-09-12T00:57:50.468 INFO:teuthology.orchestra.run.smithi062.stderr: 11000K .......... .......... .......... .......... .......... 11% 114M 1s 2024-09-12T00:57:50.468 INFO:teuthology.orchestra.run.smithi062.stderr: 11050K .......... .......... .......... .......... .......... 11% 254M 1s 2024-09-12T00:57:50.468 INFO:teuthology.orchestra.run.smithi062.stderr: 11100K .......... .......... .......... .......... .......... 12% 282M 1s 2024-09-12T00:57:50.468 INFO:teuthology.orchestra.run.smithi062.stderr: 11150K .......... .......... .......... .......... .......... 12% 274M 1s 2024-09-12T00:57:50.468 INFO:teuthology.orchestra.run.smithi062.stderr: 11200K .......... .......... .......... .......... .......... 12% 316M 1s 2024-09-12T00:57:50.468 INFO:teuthology.orchestra.run.smithi062.stderr: 11250K .......... .......... .......... .......... .......... 12% 171M 1s 2024-09-12T00:57:50.468 INFO:teuthology.orchestra.run.smithi062.stderr: 11300K .......... .......... .......... .......... .......... 12% 294M 1s 2024-09-12T00:57:50.468 INFO:teuthology.orchestra.run.smithi062.stderr: 11350K .......... .......... .......... .......... .......... 12% 299M 1s 2024-09-12T00:57:50.468 INFO:teuthology.orchestra.run.smithi062.stderr: 11400K .......... .......... .......... .......... .......... 12% 199M 1s 2024-09-12T00:57:50.468 INFO:teuthology.orchestra.run.smithi062.stderr: 11450K .......... .......... .......... .......... .......... 12% 274M 1s 2024-09-12T00:57:50.469 INFO:teuthology.orchestra.run.smithi062.stderr: 11500K .......... .......... .......... .......... .......... 12% 318M 1s 2024-09-12T00:57:50.469 INFO:teuthology.orchestra.run.smithi062.stderr: 11550K .......... .......... .......... .......... .......... 12% 290M 1s 2024-09-12T00:57:50.469 INFO:teuthology.orchestra.run.smithi062.stderr: 11600K .......... .......... .......... .......... .......... 12% 391M 1s 2024-09-12T00:57:50.469 INFO:teuthology.orchestra.run.smithi062.stderr: 11650K .......... .......... .......... .......... .......... 12% 32.1M 1s 2024-09-12T00:57:50.469 INFO:teuthology.orchestra.run.smithi062.stderr: 11700K .......... .......... .......... .......... .......... 12% 300M 1s 2024-09-12T00:57:50.469 INFO:teuthology.orchestra.run.smithi062.stderr: 11750K .......... .......... .......... .......... .......... 12% 353M 1s 2024-09-12T00:57:50.469 INFO:teuthology.orchestra.run.smithi062.stderr: 11800K .......... .......... .......... .......... .......... 12% 392M 1s 2024-09-12T00:57:50.469 INFO:teuthology.orchestra.run.smithi062.stderr: 11850K .......... .......... .......... .......... .......... 12% 158M 1s 2024-09-12T00:57:50.469 INFO:teuthology.orchestra.run.smithi062.stderr: 11900K .......... .......... .......... .......... .......... 12% 291M 1s 2024-09-12T00:57:50.469 INFO:teuthology.orchestra.run.smithi062.stderr: 11950K .......... .......... .......... .......... .......... 12% 301M 1s 2024-09-12T00:57:50.469 INFO:teuthology.orchestra.run.smithi062.stderr: 12000K .......... .......... .......... .......... .......... 12% 101M 1s 2024-09-12T00:57:50.469 INFO:teuthology.orchestra.run.smithi062.stderr: 12050K .......... .......... .......... .......... .......... 13% 192M 1s 2024-09-12T00:57:50.470 INFO:teuthology.orchestra.run.smithi062.stderr: 12100K .......... .......... .......... .......... .......... 13% 288M 1s 2024-09-12T00:57:50.470 INFO:teuthology.orchestra.run.smithi062.stderr: 12150K .......... .......... .......... .......... .......... 13% 286M 1s 2024-09-12T00:57:50.470 INFO:teuthology.orchestra.run.smithi062.stderr: 12200K .......... .......... .......... .......... .......... 13% 340M 1s 2024-09-12T00:57:50.470 INFO:teuthology.orchestra.run.smithi062.stderr: 12250K .......... .......... .......... .......... .......... 13% 339M 1s 2024-09-12T00:57:50.470 INFO:teuthology.orchestra.run.smithi062.stderr: 12300K .......... .......... .......... .......... .......... 13% 372M 1s 2024-09-12T00:57:50.470 INFO:teuthology.orchestra.run.smithi062.stderr: 12350K .......... .......... .......... .......... .......... 13% 99.8M 1s 2024-09-12T00:57:50.470 INFO:teuthology.orchestra.run.smithi062.stderr: 12400K .......... .......... .......... .......... .......... 13% 152M 1s 2024-09-12T00:57:50.470 INFO:teuthology.orchestra.run.smithi062.stderr: 12450K .......... .......... .......... .......... .......... 13% 323M 1s 2024-09-12T00:57:50.470 INFO:teuthology.orchestra.run.smithi062.stderr: 12500K .......... .......... .......... .......... .......... 13% 208M 1s 2024-09-12T00:57:50.470 INFO:teuthology.orchestra.run.smithi062.stderr: 12550K .......... .......... .......... .......... .......... 13% 51.4M 1s 2024-09-12T00:57:50.470 INFO:teuthology.orchestra.run.smithi062.stderr: 12600K .......... .......... .......... .......... .......... 13% 110M 1s 2024-09-12T00:57:50.470 INFO:teuthology.orchestra.run.smithi062.stderr: 12650K .......... .......... .......... .......... .......... 13% 376M 1s 2024-09-12T00:57:50.470 INFO:teuthology.orchestra.run.smithi062.stderr: 12700K .......... .......... .......... .......... .......... 13% 348M 1s 2024-09-12T00:57:50.470 INFO:teuthology.orchestra.run.smithi062.stderr: 12750K .......... .......... .......... .......... .......... 13% 109M 1s 2024-09-12T00:57:50.471 INFO:teuthology.orchestra.run.smithi062.stderr: 12800K .......... .......... .......... .......... .......... 13% 290M 1s 2024-09-12T00:57:50.471 INFO:teuthology.orchestra.run.smithi062.stderr: 12850K .......... .......... .......... .......... .......... 13% 374M 1s 2024-09-12T00:57:50.471 INFO:teuthology.orchestra.run.smithi062.stderr: 12900K .......... .......... .......... .......... .......... 13% 288M 1s 2024-09-12T00:57:50.471 INFO:teuthology.orchestra.run.smithi062.stderr: 12950K .......... .......... .......... .......... .......... 13% 104M 1s 2024-09-12T00:57:50.471 INFO:teuthology.orchestra.run.smithi062.stderr: 13000K .......... .......... .......... .......... .......... 14% 250M 1s 2024-09-12T00:57:50.471 INFO:teuthology.orchestra.run.smithi062.stderr: 13050K .......... .......... .......... .......... .......... 14% 296M 1s 2024-09-12T00:57:50.471 INFO:teuthology.orchestra.run.smithi062.stderr: 13100K .......... .......... .......... .......... .......... 14% 349M 1s 2024-09-12T00:57:50.471 INFO:teuthology.orchestra.run.smithi062.stderr: 13150K .......... .......... .......... .......... .......... 14% 247M 1s 2024-09-12T00:57:50.471 INFO:teuthology.orchestra.run.smithi062.stderr: 13200K .......... .......... .......... .......... .......... 14% 263M 1s 2024-09-12T00:57:50.471 INFO:teuthology.orchestra.run.smithi062.stderr: 13250K .......... .......... .......... .......... .......... 14% 389M 1s 2024-09-12T00:57:50.471 INFO:teuthology.orchestra.run.smithi062.stderr: 13300K .......... .......... .......... .......... .......... 14% 288M 1s 2024-09-12T00:57:50.471 INFO:teuthology.orchestra.run.smithi062.stderr: 13350K .......... .......... .......... .......... .......... 14% 246M 1s 2024-09-12T00:57:50.471 INFO:teuthology.orchestra.run.smithi062.stderr: 13400K .......... .......... .......... .......... .......... 14% 314M 1s 2024-09-12T00:57:50.471 INFO:teuthology.orchestra.run.smithi062.stderr: 13450K .......... .......... .......... .......... .......... 14% 308M 1s 2024-09-12T00:57:50.472 INFO:teuthology.orchestra.run.smithi062.stderr: 13500K .......... .......... .......... .......... .......... 14% 279M 1s 2024-09-12T00:57:50.472 INFO:teuthology.orchestra.run.smithi062.stderr: 13550K .......... .......... .......... .......... .......... 14% 277M 1s 2024-09-12T00:57:50.472 INFO:teuthology.orchestra.run.smithi062.stderr: 13600K .......... .......... .......... .......... .......... 14% 262M 1s 2024-09-12T00:57:50.472 INFO:teuthology.orchestra.run.smithi062.stderr: 13650K .......... .......... .......... .......... .......... 14% 306M 1s 2024-09-12T00:57:50.472 INFO:teuthology.orchestra.run.smithi062.stderr: 13700K .......... .......... .......... .......... .......... 14% 298M 1s 2024-09-12T00:57:50.472 INFO:teuthology.orchestra.run.smithi062.stderr: 13750K .......... .......... .......... .......... .......... 14% 267M 1s 2024-09-12T00:57:50.472 INFO:teuthology.orchestra.run.smithi062.stderr: 13800K .......... .......... .......... .......... .......... 14% 278M 1s 2024-09-12T00:57:50.472 INFO:teuthology.orchestra.run.smithi062.stderr: 13850K .......... .......... .......... .......... .......... 14% 342M 1s 2024-09-12T00:57:50.472 INFO:teuthology.orchestra.run.smithi062.stderr: 13900K .......... .......... .......... .......... .......... 15% 286M 1s 2024-09-12T00:57:50.472 INFO:teuthology.orchestra.run.smithi062.stderr: 13950K .......... .......... .......... .......... .......... 15% 267M 1s 2024-09-12T00:57:50.472 INFO:teuthology.orchestra.run.smithi062.stderr: 14000K .......... .......... .......... .......... .......... 15% 316M 1s 2024-09-12T00:57:50.472 INFO:teuthology.orchestra.run.smithi062.stderr: 14050K .......... .......... .......... .......... .......... 15% 312M 1s 2024-09-12T00:57:50.472 INFO:teuthology.orchestra.run.smithi062.stderr: 14100K .......... .......... .......... .......... .......... 15% 310M 1s 2024-09-12T00:57:50.472 INFO:teuthology.orchestra.run.smithi062.stderr: 14150K .......... .......... .......... .......... .......... 15% 285M 1s 2024-09-12T00:57:50.473 INFO:teuthology.orchestra.run.smithi062.stderr: 14200K .......... .......... .......... .......... .......... 15% 388M 1s 2024-09-12T00:57:50.473 INFO:teuthology.orchestra.run.smithi062.stderr: 14250K .......... .......... .......... .......... .......... 15% 398M 1s 2024-09-12T00:57:50.473 INFO:teuthology.orchestra.run.smithi062.stderr: 14300K .......... .......... .......... .......... .......... 15% 388M 1s 2024-09-12T00:57:50.473 INFO:teuthology.orchestra.run.smithi062.stderr: 14350K .......... .......... .......... .......... .......... 15% 328M 1s 2024-09-12T00:57:50.473 INFO:teuthology.orchestra.run.smithi062.stderr: 14400K .......... .......... .......... .......... .......... 15% 337M 1s 2024-09-12T00:57:50.473 INFO:teuthology.orchestra.run.smithi062.stderr: 14450K .......... .......... .......... .......... .......... 15% 319M 1s 2024-09-12T00:57:50.473 INFO:teuthology.orchestra.run.smithi062.stderr: 14500K .......... .......... .......... .......... .......... 15% 349M 1s 2024-09-12T00:57:50.473 INFO:teuthology.orchestra.run.smithi062.stderr: 14550K .......... .......... .......... .......... .......... 15% 352M 1s 2024-09-12T00:57:50.473 INFO:teuthology.orchestra.run.smithi062.stderr: 14600K .......... .......... .......... .......... .......... 15% 385M 1s 2024-09-12T00:57:50.473 INFO:teuthology.orchestra.run.smithi062.stderr: 14650K .......... .......... .......... .......... .......... 15% 373M 1s 2024-09-12T00:57:50.473 INFO:teuthology.orchestra.run.smithi062.stderr: 14700K .......... .......... .......... .......... .......... 15% 310M 1s 2024-09-12T00:57:50.473 INFO:teuthology.orchestra.run.smithi062.stderr: 14750K .......... .......... .......... .......... .......... 15% 251M 1s 2024-09-12T00:57:50.473 INFO:teuthology.orchestra.run.smithi062.stderr: 14800K .......... .......... .......... .......... .......... 15% 394M 1s 2024-09-12T00:57:50.473 INFO:teuthology.orchestra.run.smithi062.stderr: 14850K .......... .......... .......... .......... .......... 16% 390M 1s 2024-09-12T00:57:50.474 INFO:teuthology.orchestra.run.smithi062.stderr: 14900K .......... .......... .......... .......... .......... 16% 391M 1s 2024-09-12T00:57:50.474 INFO:teuthology.orchestra.run.smithi062.stderr: 14950K .......... .......... .......... .......... .......... 16% 356M 1s 2024-09-12T00:57:50.474 INFO:teuthology.orchestra.run.smithi062.stderr: 15000K .......... .......... .......... .......... .......... 16% 215M 1s 2024-09-12T00:57:50.474 INFO:teuthology.orchestra.run.smithi062.stderr: 15050K .......... .......... .......... .......... .......... 16% 319M 1s 2024-09-12T00:57:50.474 INFO:teuthology.orchestra.run.smithi062.stderr: 15100K .......... .......... .......... .......... .......... 16% 297M 1s 2024-09-12T00:57:50.474 INFO:teuthology.orchestra.run.smithi062.stderr: 15150K .......... .......... .......... .......... .......... 16% 291M 1s 2024-09-12T00:57:50.474 INFO:teuthology.orchestra.run.smithi062.stderr: 15200K .......... .......... .......... .......... .......... 16% 330M 1s 2024-09-12T00:57:50.474 INFO:teuthology.orchestra.run.smithi062.stderr: 15250K .......... .......... .......... .......... .......... 16% 359M 1s 2024-09-12T00:57:50.474 INFO:teuthology.orchestra.run.smithi062.stderr: 15300K .......... .......... .......... .......... .......... 16% 352M 1s 2024-09-12T00:57:50.474 INFO:teuthology.orchestra.run.smithi062.stderr: 15350K .......... .......... .......... .......... .......... 16% 125M 1s 2024-09-12T00:57:50.474 INFO:teuthology.orchestra.run.smithi062.stderr: 15400K .......... .......... .......... .......... .......... 16% 359M 1s 2024-09-12T00:57:50.474 INFO:teuthology.orchestra.run.smithi062.stderr: 15450K .......... .......... .......... .......... .......... 16% 347M 1s 2024-09-12T00:57:50.474 INFO:teuthology.orchestra.run.smithi062.stderr: 15500K .......... .......... .......... .......... .......... 16% 158M 1s 2024-09-12T00:57:50.475 INFO:teuthology.orchestra.run.smithi062.stderr: 15550K .......... .......... .......... .......... .......... 16% 167M 1s 2024-09-12T00:57:50.475 INFO:teuthology.orchestra.run.smithi062.stderr: 15600K .......... .......... .......... .......... .......... 16% 52.4M 1s 2024-09-12T00:57:50.475 INFO:teuthology.orchestra.run.smithi062.stderr: 15650K .......... .......... .......... .......... .......... 16% 281M 1s 2024-09-12T00:57:50.475 INFO:teuthology.orchestra.run.smithi062.stderr: 15700K .......... .......... .......... .......... .......... 16% 158M 1s 2024-09-12T00:57:50.475 INFO:teuthology.orchestra.run.smithi062.stderr: 15750K .......... .......... .......... .......... .......... 17% 265M 1s 2024-09-12T00:57:50.475 INFO:teuthology.orchestra.run.smithi062.stderr: 15800K .......... .......... .......... .......... .......... 17% 127M 1s 2024-09-12T00:57:50.475 INFO:teuthology.orchestra.run.smithi062.stderr: 15850K .......... .......... .......... .......... .......... 17% 249M 1s 2024-09-12T00:57:50.475 INFO:teuthology.orchestra.run.smithi062.stderr: 15900K .......... .......... .......... .......... .......... 17% 371M 1s 2024-09-12T00:57:50.475 INFO:teuthology.orchestra.run.smithi062.stderr: 15950K .......... .......... .......... .......... .......... 17% 157M 1s 2024-09-12T00:57:50.475 INFO:teuthology.orchestra.run.smithi062.stderr: 16000K .......... .......... .......... .......... .......... 17% 161M 1s 2024-09-12T00:57:50.475 INFO:teuthology.orchestra.run.smithi062.stderr: 16050K .......... .......... .......... .......... .......... 17% 200M 1s 2024-09-12T00:57:50.475 INFO:teuthology.orchestra.run.smithi062.stderr: 16100K .......... .......... .......... .......... .......... 17% 201M 1s 2024-09-12T00:57:50.475 INFO:teuthology.orchestra.run.smithi062.stderr: 16150K .......... .......... .......... .......... .......... 17% 199M 1s 2024-09-12T00:57:50.475 INFO:teuthology.orchestra.run.smithi062.stderr: 16200K .......... .......... .......... .......... .......... 17% 264M 1s 2024-09-12T00:57:50.476 INFO:teuthology.orchestra.run.smithi062.stderr: 16250K .......... .......... .......... .......... .......... 17% 290M 1s 2024-09-12T00:57:50.476 INFO:teuthology.orchestra.run.smithi062.stderr: 16300K .......... .......... .......... .......... .......... 17% 359M 1s 2024-09-12T00:57:50.476 INFO:teuthology.orchestra.run.smithi062.stderr: 16350K .......... .......... .......... .......... .......... 17% 248M 1s 2024-09-12T00:57:50.476 INFO:teuthology.orchestra.run.smithi062.stderr: 16400K .......... .......... .......... .......... .......... 17% 293M 1s 2024-09-12T00:57:50.476 INFO:teuthology.orchestra.run.smithi062.stderr: 16450K .......... .......... .......... .......... .......... 17% 320M 1s 2024-09-12T00:57:50.476 INFO:teuthology.orchestra.run.smithi062.stderr: 16500K .......... .......... .......... .......... .......... 17% 321M 1s 2024-09-12T00:57:50.476 INFO:teuthology.orchestra.run.smithi062.stderr: 16550K .......... .......... .......... .......... .......... 17% 326M 1s 2024-09-12T00:57:50.476 INFO:teuthology.orchestra.run.smithi062.stderr: 16600K .......... .......... .......... .......... .......... 17% 314M 1s 2024-09-12T00:57:50.476 INFO:teuthology.orchestra.run.smithi062.stderr: 16650K .......... .......... .......... .......... .......... 17% 338M 1s 2024-09-12T00:57:50.476 INFO:teuthology.orchestra.run.smithi062.stderr: 16700K .......... .......... .......... .......... .......... 18% 336M 1s 2024-09-12T00:57:50.476 INFO:teuthology.orchestra.run.smithi062.stderr: 16750K .......... .......... .......... .......... .......... 18% 269M 1s 2024-09-12T00:57:50.476 INFO:teuthology.orchestra.run.smithi062.stderr: 16800K .......... .......... .......... .......... .......... 18% 363M 1s 2024-09-12T00:57:50.476 INFO:teuthology.orchestra.run.smithi062.stderr: 16850K .......... .......... .......... .......... .......... 18% 336M 1s 2024-09-12T00:57:50.477 INFO:teuthology.orchestra.run.smithi062.stderr: 16900K .......... .......... .......... .......... .......... 18% 354M 1s 2024-09-12T00:57:50.477 INFO:teuthology.orchestra.run.smithi062.stderr: 16950K .......... .......... .......... .......... .......... 18% 302M 1s 2024-09-12T00:57:50.477 INFO:teuthology.orchestra.run.smithi062.stderr: 17000K .......... .......... .......... .......... .......... 18% 312M 1s 2024-09-12T00:57:50.477 INFO:teuthology.orchestra.run.smithi062.stderr: 17050K .......... .......... .......... .......... .......... 18% 316M 1s 2024-09-12T00:57:50.477 INFO:teuthology.orchestra.run.smithi062.stderr: 17100K .......... .......... .......... .......... .......... 18% 317M 1s 2024-09-12T00:57:50.477 INFO:teuthology.orchestra.run.smithi062.stderr: 17150K .......... .......... .......... .......... .......... 18% 139M 1s 2024-09-12T00:57:50.477 INFO:teuthology.orchestra.run.smithi062.stderr: 17200K .......... .......... .......... .......... .......... 18% 274M 1s 2024-09-12T00:57:50.477 INFO:teuthology.orchestra.run.smithi062.stderr: 17250K .......... .......... .......... .......... .......... 18% 349M 1s 2024-09-12T00:57:50.477 INFO:teuthology.orchestra.run.smithi062.stderr: 17300K .......... .......... .......... .......... .......... 18% 393M 1s 2024-09-12T00:57:50.477 INFO:teuthology.orchestra.run.smithi062.stderr: 17350K .......... .......... .......... .......... .......... 18% 151M 1s 2024-09-12T00:57:50.477 INFO:teuthology.orchestra.run.smithi062.stderr: 17400K .......... .......... .......... .......... .......... 18% 310M 1s 2024-09-12T00:57:50.477 INFO:teuthology.orchestra.run.smithi062.stderr: 17450K .......... .......... .......... .......... .......... 18% 289M 1s 2024-09-12T00:57:50.477 INFO:teuthology.orchestra.run.smithi062.stderr: 17500K .......... .......... .......... .......... .......... 18% 324M 1s 2024-09-12T00:57:50.478 INFO:teuthology.orchestra.run.smithi062.stderr: 17550K .......... .......... .......... .......... .......... 18% 283M 1s 2024-09-12T00:57:50.478 INFO:teuthology.orchestra.run.smithi062.stderr: 17600K .......... .......... .......... .......... .......... 18% 306M 1s 2024-09-12T00:57:50.478 INFO:teuthology.orchestra.run.smithi062.stderr: 17650K .......... .......... .......... .......... .......... 19% 345M 1s 2024-09-12T00:57:50.478 INFO:teuthology.orchestra.run.smithi062.stderr: 17700K .......... .......... .......... .......... .......... 19% 387M 1s 2024-09-12T00:57:50.478 INFO:teuthology.orchestra.run.smithi062.stderr: 17750K .......... .......... .......... .......... .......... 19% 354M 1s 2024-09-12T00:57:50.478 INFO:teuthology.orchestra.run.smithi062.stderr: 17800K .......... .......... .......... .......... .......... 19% 344M 1s 2024-09-12T00:57:50.478 INFO:teuthology.orchestra.run.smithi062.stderr: 17850K .......... .......... .......... .......... .......... 19% 157M 1s 2024-09-12T00:57:50.478 INFO:teuthology.orchestra.run.smithi062.stderr: 17900K .......... .......... .......... .......... .......... 19% 305M 1s 2024-09-12T00:57:50.478 INFO:teuthology.orchestra.run.smithi062.stderr: 17950K .......... .......... .......... .......... .......... 19% 228M 1s 2024-09-12T00:57:50.478 INFO:teuthology.orchestra.run.smithi062.stderr: 18000K .......... .......... .......... .......... .......... 19% 320M 1s 2024-09-12T00:57:50.478 INFO:teuthology.orchestra.run.smithi062.stderr: 18050K .......... .......... .......... .......... .......... 19% 313M 1s 2024-09-12T00:57:50.478 INFO:teuthology.orchestra.run.smithi062.stderr: 18100K .......... .......... .......... .......... .......... 19% 306M 1s 2024-09-12T00:57:50.478 INFO:teuthology.orchestra.run.smithi062.stderr: 18150K .......... .......... .......... .......... .......... 19% 325M 1s 2024-09-12T00:57:50.478 INFO:teuthology.orchestra.run.smithi062.stderr: 18200K .......... .......... .......... .......... .......... 19% 391M 1s 2024-09-12T00:57:50.479 INFO:teuthology.orchestra.run.smithi062.stderr: 18250K .......... .......... .......... .......... .......... 19% 313M 1s 2024-09-12T00:57:50.479 INFO:teuthology.orchestra.run.smithi062.stderr: 18300K .......... .......... .......... .......... .......... 19% 333M 1s 2024-09-12T00:57:50.479 INFO:teuthology.orchestra.run.smithi062.stderr: 18350K .......... .......... .......... .......... .......... 19% 325M 1s 2024-09-12T00:57:50.479 INFO:teuthology.orchestra.run.smithi062.stderr: 18400K .......... .......... .......... .......... .......... 19% 350M 1s 2024-09-12T00:57:50.479 INFO:teuthology.orchestra.run.smithi062.stderr: 18450K .......... .......... .......... .......... .......... 19% 321M 1s 2024-09-12T00:57:50.479 INFO:teuthology.orchestra.run.smithi062.stderr: 18500K .......... .......... .......... .......... .......... 19% 312M 1s 2024-09-12T00:57:50.479 INFO:teuthology.orchestra.run.smithi062.stderr: 18550K .......... .......... .......... .......... .......... 20% 306M 1s 2024-09-12T00:57:50.479 INFO:teuthology.orchestra.run.smithi062.stderr: 18600K .......... .......... .......... .......... .......... 20% 393M 1s 2024-09-12T00:57:50.479 INFO:teuthology.orchestra.run.smithi062.stderr: 18650K .......... .......... .......... .......... .......... 20% 381M 1s 2024-09-12T00:57:50.479 INFO:teuthology.orchestra.run.smithi062.stderr: 18700K .......... .......... .......... .......... .......... 20% 60.7M 1s 2024-09-12T00:57:50.479 INFO:teuthology.orchestra.run.smithi062.stderr: 18750K .......... .......... .......... .......... .......... 20% 157M 1s 2024-09-12T00:57:50.479 INFO:teuthology.orchestra.run.smithi062.stderr: 18800K .......... .......... .......... .......... .......... 20% 206M 1s 2024-09-12T00:57:50.479 INFO:teuthology.orchestra.run.smithi062.stderr: 18850K .......... .......... .......... .......... .......... 20% 159M 1s 2024-09-12T00:57:50.480 INFO:teuthology.orchestra.run.smithi062.stderr: 18900K .......... .......... .......... .......... .......... 20% 80.8M 1s 2024-09-12T00:57:50.480 INFO:teuthology.orchestra.run.smithi062.stderr: 18950K .......... .......... .......... .......... .......... 20% 235M 1s 2024-09-12T00:57:50.480 INFO:teuthology.orchestra.run.smithi062.stderr: 19000K .......... .......... .......... .......... .......... 20% 282M 1s 2024-09-12T00:57:50.480 INFO:teuthology.orchestra.run.smithi062.stderr: 19050K .......... .......... .......... .......... .......... 20% 388M 1s 2024-09-12T00:57:50.480 INFO:teuthology.orchestra.run.smithi062.stderr: 19100K .......... .......... .......... .......... .......... 20% 341M 1s 2024-09-12T00:57:50.480 INFO:teuthology.orchestra.run.smithi062.stderr: 19150K .......... .......... .......... .......... .......... 20% 125M 1s 2024-09-12T00:57:50.480 INFO:teuthology.orchestra.run.smithi062.stderr: 19200K .......... .......... .......... .......... .......... 20% 278M 1s 2024-09-12T00:57:50.480 INFO:teuthology.orchestra.run.smithi062.stderr: 19250K .......... .......... .......... .......... .......... 20% 319M 1s 2024-09-12T00:57:50.480 INFO:teuthology.orchestra.run.smithi062.stderr: 19300K .......... .......... .......... .......... .......... 20% 322M 1s 2024-09-12T00:57:50.480 INFO:teuthology.orchestra.run.smithi062.stderr: 19350K .......... .......... .......... .......... .......... 20% 292M 1s 2024-09-12T00:57:50.480 INFO:teuthology.orchestra.run.smithi062.stderr: 19400K .......... .......... .......... .......... .......... 20% 301M 1s 2024-09-12T00:57:50.480 INFO:teuthology.orchestra.run.smithi062.stderr: 19450K .......... .......... .......... .......... .......... 20% 317M 1s 2024-09-12T00:57:50.480 INFO:teuthology.orchestra.run.smithi062.stderr: 19500K .......... .......... .......... .......... .......... 21% 354M 1s 2024-09-12T00:57:50.481 INFO:teuthology.orchestra.run.smithi062.stderr: 19550K .......... .......... .......... .......... .......... 21% 284M 1s 2024-09-12T00:57:50.481 INFO:teuthology.orchestra.run.smithi062.stderr: 19600K .......... .......... .......... .......... .......... 21% 356M 1s 2024-09-12T00:57:50.481 INFO:teuthology.orchestra.run.smithi062.stderr: 19650K .......... .......... .......... .......... .......... 21% 349M 1s 2024-09-12T00:57:50.481 INFO:teuthology.orchestra.run.smithi062.stderr: 19700K .......... .......... .......... .......... .......... 21% 211M 1s 2024-09-12T00:57:50.481 INFO:teuthology.orchestra.run.smithi062.stderr: 19750K .......... .......... .......... .......... .......... 21% 262M 1s 2024-09-12T00:57:50.481 INFO:teuthology.orchestra.run.smithi062.stderr: 19800K .......... .......... .......... .......... .......... 21% 313M 1s 2024-09-12T00:57:50.481 INFO:teuthology.orchestra.run.smithi062.stderr: 19850K .......... .......... .......... .......... .......... 21% 314M 1s 2024-09-12T00:57:50.481 INFO:teuthology.orchestra.run.smithi062.stderr: 19900K .......... .......... .......... .......... .......... 21% 326M 1s 2024-09-12T00:57:50.481 INFO:teuthology.orchestra.run.smithi062.stderr: 19950K .......... .......... .......... .......... .......... 21% 292M 1s 2024-09-12T00:57:50.481 INFO:teuthology.orchestra.run.smithi062.stderr: 20000K .......... .......... .......... .......... .......... 21% 314M 1s 2024-09-12T00:57:50.481 INFO:teuthology.orchestra.run.smithi062.stderr: 20050K .......... .......... .......... .......... .......... 21% 328M 1s 2024-09-12T00:57:50.481 INFO:teuthology.orchestra.run.smithi062.stderr: 20100K .......... .......... .......... .......... .......... 21% 367M 1s 2024-09-12T00:57:50.481 INFO:teuthology.orchestra.run.smithi062.stderr: 20150K .......... .......... .......... .......... .......... 21% 293M 1s 2024-09-12T00:57:50.482 INFO:teuthology.orchestra.run.smithi062.stderr: 20200K .......... .......... .......... .......... .......... 21% 112M 1s 2024-09-12T00:57:50.482 INFO:teuthology.orchestra.run.smithi062.stderr: 20250K .......... .......... .......... .......... .......... 21% 294M 1s 2024-09-12T00:57:50.482 INFO:teuthology.orchestra.run.smithi062.stderr: 20300K .......... .......... .......... .......... .......... 21% 371M 1s 2024-09-12T00:57:50.482 INFO:teuthology.orchestra.run.smithi062.stderr: 20350K .......... .......... .......... .......... .......... 21% 116M 1s 2024-09-12T00:57:50.482 INFO:teuthology.orchestra.run.smithi062.stderr: 20400K .......... .......... .......... .......... .......... 22% 393M 1s 2024-09-12T00:57:50.482 INFO:teuthology.orchestra.run.smithi062.stderr: 20450K .......... .......... .......... .......... .......... 22% 10.9M 1s 2024-09-12T00:57:50.482 INFO:teuthology.orchestra.run.smithi062.stderr: 20500K .......... .......... .......... .......... .......... 22% 310M 1s 2024-09-12T00:57:50.482 INFO:teuthology.orchestra.run.smithi062.stderr: 20550K .......... .......... .......... .......... .......... 22% 320M 1s 2024-09-12T00:57:50.482 INFO:teuthology.orchestra.run.smithi062.stderr: 20600K .......... .......... .......... .......... .......... 22% 56.3M 1s 2024-09-12T00:57:50.482 INFO:teuthology.orchestra.run.smithi062.stderr: 20650K .......... .......... .......... .......... .......... 22% 84.1M 1s 2024-09-12T00:57:50.482 INFO:teuthology.orchestra.run.smithi062.stderr: 20700K .......... .......... .......... .......... .......... 22% 314M 1s 2024-09-12T00:57:50.482 INFO:teuthology.orchestra.run.smithi062.stderr: 20750K .......... .......... .......... .......... .......... 22% 340M 1s 2024-09-12T00:57:50.482 INFO:teuthology.orchestra.run.smithi062.stderr: 20800K .......... .......... .......... .......... .......... 22% 319M 1s 2024-09-12T00:57:50.483 INFO:teuthology.orchestra.run.smithi062.stderr: 20850K .......... .......... .......... .......... .......... 22% 149M 1s 2024-09-12T00:57:50.483 INFO:teuthology.orchestra.run.smithi062.stderr: 20900K .......... .......... .......... .......... .......... 22% 395M 1s 2024-09-12T00:57:50.483 INFO:teuthology.orchestra.run.smithi062.stderr: 20950K .......... .......... .......... .......... .......... 22% 272M 1s 2024-09-12T00:57:50.483 INFO:teuthology.orchestra.run.smithi062.stderr: 21000K .......... .......... .......... .......... .......... 22% 315M 1s 2024-09-12T00:57:50.483 INFO:teuthology.orchestra.run.smithi062.stderr: 21050K .......... .......... .......... .......... .......... 22% 77.3M 1s 2024-09-12T00:57:50.483 INFO:teuthology.orchestra.run.smithi062.stderr: 21100K .......... .......... .......... .......... .......... 22% 355M 1s 2024-09-12T00:57:50.483 INFO:teuthology.orchestra.run.smithi062.stderr: 21150K .......... .......... .......... .......... .......... 22% 333M 1s 2024-09-12T00:57:50.483 INFO:teuthology.orchestra.run.smithi062.stderr: 21200K .......... .......... .......... .......... .......... 22% 40.6M 1s 2024-09-12T00:57:50.483 INFO:teuthology.orchestra.run.smithi062.stderr: 21250K .......... .......... .......... .......... .......... 22% 324M 1s 2024-09-12T00:57:50.483 INFO:teuthology.orchestra.run.smithi062.stderr: 21300K .......... .......... .......... .......... .......... 22% 350M 1s 2024-09-12T00:57:50.483 INFO:teuthology.orchestra.run.smithi062.stderr: 21350K .......... .......... .......... .......... .......... 23% 419M 1s 2024-09-12T00:57:50.483 INFO:teuthology.orchestra.run.smithi062.stderr: 21400K .......... .......... .......... .......... .......... 23% 82.1M 1s 2024-09-12T00:57:50.483 INFO:teuthology.orchestra.run.smithi062.stderr: 21450K .......... .......... .......... .......... .......... 23% 303M 1s 2024-09-12T00:57:50.484 INFO:teuthology.orchestra.run.smithi062.stderr: 21500K .......... .......... .......... .......... .......... 23% 348M 1s 2024-09-12T00:57:50.484 INFO:teuthology.orchestra.run.smithi062.stderr: 21550K .......... .......... .......... .......... .......... 23% 413M 1s 2024-09-12T00:57:50.484 INFO:teuthology.orchestra.run.smithi062.stderr: 21600K .......... .......... .......... .......... .......... 23% 186M 1s 2024-09-12T00:57:50.484 INFO:teuthology.orchestra.run.smithi062.stderr: 21650K .......... .......... .......... .......... .......... 23% 249M 1s 2024-09-12T00:57:50.484 INFO:teuthology.orchestra.run.smithi062.stderr: 21700K .......... .......... .......... .......... .......... 23% 337M 1s 2024-09-12T00:57:50.484 INFO:teuthology.orchestra.run.smithi062.stderr: 21750K .......... .......... .......... .......... .......... 23% 355M 1s 2024-09-12T00:57:50.484 INFO:teuthology.orchestra.run.smithi062.stderr: 21800K .......... .......... .......... .......... .......... 23% 197M 1s 2024-09-12T00:57:50.484 INFO:teuthology.orchestra.run.smithi062.stderr: 21850K .......... .......... .......... .......... .......... 23% 281M 1s 2024-09-12T00:57:50.484 INFO:teuthology.orchestra.run.smithi062.stderr: 21900K .......... .......... .......... .......... .......... 23% 346M 1s 2024-09-12T00:57:50.484 INFO:teuthology.orchestra.run.smithi062.stderr: 21950K .......... .......... .......... .......... .......... 23% 399M 1s 2024-09-12T00:57:50.484 INFO:teuthology.orchestra.run.smithi062.stderr: 22000K .......... .......... .......... .......... .......... 23% 92.4M 1s 2024-09-12T00:57:50.484 INFO:teuthology.orchestra.run.smithi062.stderr: 22050K .......... .......... .......... .......... .......... 23% 317M 1s 2024-09-12T00:57:50.484 INFO:teuthology.orchestra.run.smithi062.stderr: 22100K .......... .......... .......... .......... .......... 23% 410M 1s 2024-09-12T00:57:50.484 INFO:teuthology.orchestra.run.smithi062.stderr: 22150K .......... .......... .......... .......... .......... 23% 368M 1s 2024-09-12T00:57:50.485 INFO:teuthology.orchestra.run.smithi062.stderr: 22200K .......... .......... .......... .......... .......... 23% 294M 1s 2024-09-12T00:57:50.485 INFO:teuthology.orchestra.run.smithi062.stderr: 22250K .......... .......... .......... .......... .......... 24% 328M 1s 2024-09-12T00:57:50.485 INFO:teuthology.orchestra.run.smithi062.stderr: 22300K .......... .......... .......... .......... .......... 24% 422M 1s 2024-09-12T00:57:50.485 INFO:teuthology.orchestra.run.smithi062.stderr: 22350K .......... .......... .......... .......... .......... 24% 387M 1s 2024-09-12T00:57:50.485 INFO:teuthology.orchestra.run.smithi062.stderr: 22400K .......... .......... .......... .......... .......... 24% 183M 1s 2024-09-12T00:57:50.485 INFO:teuthology.orchestra.run.smithi062.stderr: 22450K .......... .......... .......... .......... .......... 24% 366M 1s 2024-09-12T00:57:50.485 INFO:teuthology.orchestra.run.smithi062.stderr: 22500K .......... .......... .......... .......... .......... 24% 361M 1s 2024-09-12T00:57:50.485 INFO:teuthology.orchestra.run.smithi062.stderr: 22550K .......... .......... .......... .......... .......... 24% 380M 1s 2024-09-12T00:57:50.485 INFO:teuthology.orchestra.run.smithi062.stderr: 22600K .......... .......... .......... .......... .......... 24% 273M 1s 2024-09-12T00:57:50.485 INFO:teuthology.orchestra.run.smithi062.stderr: 22650K .......... .......... .......... .......... .......... 24% 377M 1s 2024-09-12T00:57:50.485 INFO:teuthology.orchestra.run.smithi062.stderr: 22700K .......... .......... .......... .......... .......... 24% 380M 1s 2024-09-12T00:57:50.485 INFO:teuthology.orchestra.run.smithi062.stderr: 22750K .......... .......... .......... .......... .......... 24% 346M 1s 2024-09-12T00:57:50.486 INFO:teuthology.orchestra.run.smithi062.stderr: 22800K .......... .......... .......... .......... .......... 24% 303M 1s 2024-09-12T00:57:50.486 INFO:teuthology.orchestra.run.smithi062.stderr: 22850K .......... .......... .......... .......... .......... 24% 355M 1s 2024-09-12T00:57:50.486 INFO:teuthology.orchestra.run.smithi062.stderr: 22900K .......... .......... .......... .......... .......... 24% 419M 1s 2024-09-12T00:57:50.486 INFO:teuthology.orchestra.run.smithi062.stderr: 22950K .......... .......... .......... .......... .......... 24% 180M 1s 2024-09-12T00:57:50.486 INFO:teuthology.orchestra.run.smithi062.stderr: 23000K .......... .......... .......... .......... .......... 24% 302M 1s 2024-09-12T00:57:50.486 INFO:teuthology.orchestra.run.smithi062.stderr: 23050K .......... .......... .......... .......... .......... 24% 391M 1s 2024-09-12T00:57:50.486 INFO:teuthology.orchestra.run.smithi062.stderr: 23100K .......... .......... .......... .......... .......... 24% 343M 1s 2024-09-12T00:57:50.486 INFO:teuthology.orchestra.run.smithi062.stderr: 23150K .......... .......... .......... .......... .......... 24% 363M 1s 2024-09-12T00:57:50.486 INFO:teuthology.orchestra.run.smithi062.stderr: 23200K .......... .......... .......... .......... .......... 25% 250M 1s 2024-09-12T00:57:50.486 INFO:teuthology.orchestra.run.smithi062.stderr: 23250K .......... .......... .......... .......... .......... 25% 330M 1s 2024-09-12T00:57:50.486 INFO:teuthology.orchestra.run.smithi062.stderr: 23300K .......... .......... .......... .......... .......... 25% 370M 1s 2024-09-12T00:57:50.486 INFO:teuthology.orchestra.run.smithi062.stderr: 23350K .......... .......... .......... .......... .......... 25% 386M 1s 2024-09-12T00:57:50.487 INFO:teuthology.orchestra.run.smithi062.stderr: 23400K .......... .......... .......... .......... .......... 25% 384M 1s 2024-09-12T00:57:50.487 INFO:teuthology.orchestra.run.smithi062.stderr: 23450K .......... .......... .......... .......... .......... 25% 431M 1s 2024-09-12T00:57:50.487 INFO:teuthology.orchestra.run.smithi062.stderr: 23500K .......... .......... .......... .......... .......... 25% 428M 1s 2024-09-12T00:57:50.487 INFO:teuthology.orchestra.run.smithi062.stderr: 23550K .......... .......... .......... .......... .......... 25% 153M 1s 2024-09-12T00:57:50.487 INFO:teuthology.orchestra.run.smithi062.stderr: 23600K .......... .......... .......... .......... .......... 25% 296M 1s 2024-09-12T00:57:50.487 INFO:teuthology.orchestra.run.smithi062.stderr: 23650K .......... .......... .......... .......... .......... 25% 334M 1s 2024-09-12T00:57:50.487 INFO:teuthology.orchestra.run.smithi062.stderr: 23700K .......... .......... .......... .......... .......... 25% 357M 1s 2024-09-12T00:57:50.487 INFO:teuthology.orchestra.run.smithi062.stderr: 23750K .......... .......... .......... .......... .......... 25% 379M 1s 2024-09-12T00:57:50.487 INFO:teuthology.orchestra.run.smithi062.stderr: 23800K .......... .......... .......... .......... .......... 25% 324M 1s 2024-09-12T00:57:50.487 INFO:teuthology.orchestra.run.smithi062.stderr: 23850K .......... .......... .......... .......... .......... 25% 335M 1s 2024-09-12T00:57:50.487 INFO:teuthology.orchestra.run.smithi062.stderr: 23900K .......... .......... .......... .......... .......... 25% 428M 1s 2024-09-12T00:57:50.487 INFO:teuthology.orchestra.run.smithi062.stderr: 23950K .......... .......... .......... .......... .......... 25% 250M 1s 2024-09-12T00:57:50.487 INFO:teuthology.orchestra.run.smithi062.stderr: 24000K .......... .......... .......... .......... .......... 25% 268M 1s 2024-09-12T00:57:50.488 INFO:teuthology.orchestra.run.smithi062.stderr: 24050K .......... .......... .......... .......... .......... 25% 101M 1s 2024-09-12T00:57:50.488 INFO:teuthology.orchestra.run.smithi062.stderr: 24100K .......... .......... .......... .......... .......... 25% 315M 1s 2024-09-12T00:57:50.488 INFO:teuthology.orchestra.run.smithi062.stderr: 24150K .......... .......... .......... .......... .......... 26% 231M 1s 2024-09-12T00:57:50.488 INFO:teuthology.orchestra.run.smithi062.stderr: 24200K .......... .......... .......... .......... .......... 26% 231M 1s 2024-09-12T00:57:50.488 INFO:teuthology.orchestra.run.smithi062.stderr: 24250K .......... .......... .......... .......... .......... 26% 49.4M 1s 2024-09-12T00:57:50.488 INFO:teuthology.orchestra.run.smithi062.stderr: 24300K .......... .......... .......... .......... .......... 26% 224M 1s 2024-09-12T00:57:50.488 INFO:teuthology.orchestra.run.smithi062.stderr: 24350K .......... .......... .......... .......... .......... 26% 297M 1s 2024-09-12T00:57:50.488 INFO:teuthology.orchestra.run.smithi062.stderr: 24400K .......... .......... .......... .......... .......... 26% 68.3M 1s 2024-09-12T00:57:50.488 INFO:teuthology.orchestra.run.smithi062.stderr: 24450K .......... .......... .......... .......... .......... 26% 249M 1s 2024-09-12T00:57:50.488 INFO:teuthology.orchestra.run.smithi062.stderr: 24500K .......... .......... .......... .......... .......... 26% 302M 1s 2024-09-12T00:57:50.488 INFO:teuthology.orchestra.run.smithi062.stderr: 24550K .......... .......... .......... .......... .......... 26% 388M 1s 2024-09-12T00:57:50.488 INFO:teuthology.orchestra.run.smithi062.stderr: 24600K .......... .......... .......... .......... .......... 26% 213M 1s 2024-09-12T00:57:50.488 INFO:teuthology.orchestra.run.smithi062.stderr: 24650K .......... .......... .......... .......... .......... 26% 326M 1s 2024-09-12T00:57:50.489 INFO:teuthology.orchestra.run.smithi062.stderr: 24700K .......... .......... .......... .......... .......... 26% 262M 1s 2024-09-12T00:57:50.489 INFO:teuthology.orchestra.run.smithi062.stderr: 24750K .......... .......... .......... .......... .......... 26% 320M 1s 2024-09-12T00:57:50.489 INFO:teuthology.orchestra.run.smithi062.stderr: 24800K .......... .......... .......... .......... .......... 26% 316M 1s 2024-09-12T00:57:50.489 INFO:teuthology.orchestra.run.smithi062.stderr: 24850K .......... .......... .......... .......... .......... 26% 113M 1s 2024-09-12T00:57:50.489 INFO:teuthology.orchestra.run.smithi062.stderr: 24900K .......... .......... .......... .......... .......... 26% 284M 1s 2024-09-12T00:57:50.489 INFO:teuthology.orchestra.run.smithi062.stderr: 24950K .......... .......... .......... .......... .......... 26% 343M 1s 2024-09-12T00:57:50.489 INFO:teuthology.orchestra.run.smithi062.stderr: 25000K .......... .......... .......... .......... .......... 26% 336M 1s 2024-09-12T00:57:50.489 INFO:teuthology.orchestra.run.smithi062.stderr: 25050K .......... .......... .......... .......... .......... 27% 313M 1s 2024-09-12T00:57:50.489 INFO:teuthology.orchestra.run.smithi062.stderr: 25100K .......... .......... .......... .......... .......... 27% 151M 1s 2024-09-12T00:57:50.489 INFO:teuthology.orchestra.run.smithi062.stderr: 25150K .......... .......... .......... .......... .......... 27% 332M 1s 2024-09-12T00:57:50.489 INFO:teuthology.orchestra.run.smithi062.stderr: 25200K .......... .......... .......... .......... .......... 27% 324M 1s 2024-09-12T00:57:50.489 INFO:teuthology.orchestra.run.smithi062.stderr: 25250K .......... .......... .......... .......... .......... 27% 326M 1s 2024-09-12T00:57:50.489 INFO:teuthology.orchestra.run.smithi062.stderr: 25300K .......... .......... .......... .......... .......... 27% 256M 1s 2024-09-12T00:57:50.489 INFO:teuthology.orchestra.run.smithi062.stderr: 25350K .......... .......... .......... .......... .......... 27% 355M 1s 2024-09-12T00:57:50.490 INFO:teuthology.orchestra.run.smithi062.stderr: 25400K .......... .......... .......... .......... .......... 27% 291M 1s 2024-09-12T00:57:50.490 INFO:teuthology.orchestra.run.smithi062.stderr: 25450K .......... .......... .......... .......... .......... 27% 286M 1s 2024-09-12T00:57:50.490 INFO:teuthology.orchestra.run.smithi062.stderr: 25500K .......... .......... .......... .......... .......... 27% 320M 1s 2024-09-12T00:57:50.490 INFO:teuthology.orchestra.run.smithi062.stderr: 25550K .......... .......... .......... .......... .......... 27% 232M 1s 2024-09-12T00:57:50.490 INFO:teuthology.orchestra.run.smithi062.stderr: 25600K .......... .......... .......... .......... .......... 27% 307M 1s 2024-09-12T00:57:50.490 INFO:teuthology.orchestra.run.smithi062.stderr: 25650K .......... .......... .......... .......... .......... 27% 303M 1s 2024-09-12T00:57:50.490 INFO:teuthology.orchestra.run.smithi062.stderr: 25700K .......... .......... .......... .......... .......... 27% 267M 1s 2024-09-12T00:57:50.490 INFO:teuthology.orchestra.run.smithi062.stderr: 25750K .......... .......... .......... .......... .......... 27% 308M 1s 2024-09-12T00:57:50.490 INFO:teuthology.orchestra.run.smithi062.stderr: 25800K .......... .......... .......... .......... .......... 27% 331M 1s 2024-09-12T00:57:50.490 INFO:teuthology.orchestra.run.smithi062.stderr: 25850K .......... .......... .......... .......... .......... 27% 327M 1s 2024-09-12T00:57:50.490 INFO:teuthology.orchestra.run.smithi062.stderr: 25900K .......... .......... .......... .......... .......... 27% 267M 1s 2024-09-12T00:57:50.490 INFO:teuthology.orchestra.run.smithi062.stderr: 25950K .......... .......... .......... .......... .......... 27% 311M 1s 2024-09-12T00:57:50.490 INFO:teuthology.orchestra.run.smithi062.stderr: 26000K .......... .......... .......... .......... .......... 28% 281M 1s 2024-09-12T00:57:50.490 INFO:teuthology.orchestra.run.smithi062.stderr: 26050K .......... .......... .......... .......... .......... 28% 325M 1s 2024-09-12T00:57:50.491 INFO:teuthology.orchestra.run.smithi062.stderr: 26100K .......... .......... .......... .......... .......... 28% 273M 1s 2024-09-12T00:57:50.491 INFO:teuthology.orchestra.run.smithi062.stderr: 26150K .......... .......... .......... .......... .......... 28% 312M 1s 2024-09-12T00:57:50.491 INFO:teuthology.orchestra.run.smithi062.stderr: 26200K .......... .......... .......... .......... .......... 28% 264M 1s 2024-09-12T00:57:50.491 INFO:teuthology.orchestra.run.smithi062.stderr: 26250K .......... .......... .......... .......... .......... 28% 387M 1s 2024-09-12T00:57:50.491 INFO:teuthology.orchestra.run.smithi062.stderr: 26300K .......... .......... .......... .......... .......... 28% 323M 1s 2024-09-12T00:57:50.491 INFO:teuthology.orchestra.run.smithi062.stderr: 26350K .......... .......... .......... .......... .......... 28% 378M 1s 2024-09-12T00:57:50.491 INFO:teuthology.orchestra.run.smithi062.stderr: 26400K .......... .......... .......... .......... .......... 28% 329M 1s 2024-09-12T00:57:50.491 INFO:teuthology.orchestra.run.smithi062.stderr: 26450K .......... .......... .......... .......... .......... 28% 274M 1s 2024-09-12T00:57:50.491 INFO:teuthology.orchestra.run.smithi062.stderr: 26500K .......... .......... .......... .......... .......... 28% 282M 1s 2024-09-12T00:57:50.491 INFO:teuthology.orchestra.run.smithi062.stderr: 26550K .......... .......... .......... .......... .......... 28% 317M 1s 2024-09-12T00:57:50.491 INFO:teuthology.orchestra.run.smithi062.stderr: 26600K .......... .......... .......... .......... .......... 28% 302M 1s 2024-09-12T00:57:50.491 INFO:teuthology.orchestra.run.smithi062.stderr: 26650K .......... .......... .......... .......... .......... 28% 344M 1s 2024-09-12T00:57:50.491 INFO:teuthology.orchestra.run.smithi062.stderr: 26700K .......... .......... .......... .......... .......... 28% 309M 1s 2024-09-12T00:57:50.491 INFO:teuthology.orchestra.run.smithi062.stderr: 26750K .......... .......... .......... .......... .......... 28% 205M 1s 2024-09-12T00:57:50.492 INFO:teuthology.orchestra.run.smithi062.stderr: 26800K .......... .......... .......... .......... .......... 28% 320M 1s 2024-09-12T00:57:50.492 INFO:teuthology.orchestra.run.smithi062.stderr: 26850K .......... .......... .......... .......... .......... 28% 316M 1s 2024-09-12T00:57:50.492 INFO:teuthology.orchestra.run.smithi062.stderr: 26900K .......... .......... .......... .......... .......... 29% 316M 1s 2024-09-12T00:57:50.492 INFO:teuthology.orchestra.run.smithi062.stderr: 26950K .......... .......... .......... .......... .......... 29% 346M 1s 2024-09-12T00:57:50.492 INFO:teuthology.orchestra.run.smithi062.stderr: 27000K .......... .......... .......... .......... .......... 29% 394M 1s 2024-09-12T00:57:50.492 INFO:teuthology.orchestra.run.smithi062.stderr: 27050K .......... .......... .......... .......... .......... 29% 336M 1s 2024-09-12T00:57:50.492 INFO:teuthology.orchestra.run.smithi062.stderr: 27100K .......... .......... .......... .......... .......... 29% 260M 1s 2024-09-12T00:57:50.492 INFO:teuthology.orchestra.run.smithi062.stderr: 27150K .......... .......... .......... .......... .......... 29% 367M 1s 2024-09-12T00:57:50.492 INFO:teuthology.orchestra.run.smithi062.stderr: 27200K .......... .......... .......... .......... .......... 29% 390M 1s 2024-09-12T00:57:50.492 INFO:teuthology.orchestra.run.smithi062.stderr: 27250K .......... .......... .......... .......... .......... 29% 52.2M 1s 2024-09-12T00:57:50.492 INFO:teuthology.orchestra.run.smithi062.stderr: 27300K .......... .......... .......... .......... .......... 29% 54.1M 1s 2024-09-12T00:57:50.492 INFO:teuthology.orchestra.run.smithi062.stderr: 27350K .......... .......... .......... .......... .......... 29% 287M 1s 2024-09-12T00:57:50.492 INFO:teuthology.orchestra.run.smithi062.stderr: 27400K .......... .......... .......... .......... .......... 29% 370M 1s 2024-09-12T00:57:50.493 INFO:teuthology.orchestra.run.smithi062.stderr: 27450K .......... .......... .......... .......... .......... 29% 205M 1s 2024-09-12T00:57:50.493 INFO:teuthology.orchestra.run.smithi062.stderr: 27500K .......... .......... .......... .......... .......... 29% 164M 1s 2024-09-12T00:57:50.493 INFO:teuthology.orchestra.run.smithi062.stderr: 27550K .......... .......... .......... .......... .......... 29% 332M 1s 2024-09-12T00:57:50.493 INFO:teuthology.orchestra.run.smithi062.stderr: 27600K .......... .......... .......... .......... .......... 29% 30.9M 1s 2024-09-12T00:57:50.493 INFO:teuthology.orchestra.run.smithi062.stderr: 27650K .......... .......... .......... .......... .......... 29% 311M 1s 2024-09-12T00:57:50.493 INFO:teuthology.orchestra.run.smithi062.stderr: 27700K .......... .......... .......... .......... .......... 29% 334M 1s 2024-09-12T00:57:50.493 INFO:teuthology.orchestra.run.smithi062.stderr: 27750K .......... .......... .......... .......... .......... 29% 137M 1s 2024-09-12T00:57:50.493 INFO:teuthology.orchestra.run.smithi062.stderr: 27800K .......... .......... .......... .......... .......... 29% 317M 1s 2024-09-12T00:57:50.493 INFO:teuthology.orchestra.run.smithi062.stderr: 27850K .......... .......... .......... .......... .......... 30% 321M 1s 2024-09-12T00:57:50.493 INFO:teuthology.orchestra.run.smithi062.stderr: 27900K .......... .......... .......... .......... .......... 30% 303M 1s 2024-09-12T00:57:50.493 INFO:teuthology.orchestra.run.smithi062.stderr: 27950K .......... .......... .......... .......... .......... 30% 345M 1s 2024-09-12T00:57:50.493 INFO:teuthology.orchestra.run.smithi062.stderr: 28000K .......... .......... .......... .......... .......... 30% 285M 1s 2024-09-12T00:57:50.493 INFO:teuthology.orchestra.run.smithi062.stderr: 28050K .......... .......... .......... .......... .......... 30% 286M 1s 2024-09-12T00:57:50.494 INFO:teuthology.orchestra.run.smithi062.stderr: 28100K .......... .......... .......... .......... .......... 30% 275M 1s 2024-09-12T00:57:50.494 INFO:teuthology.orchestra.run.smithi062.stderr: 28150K .......... .......... .......... .......... .......... 30% 270M 1s 2024-09-12T00:57:50.494 INFO:teuthology.orchestra.run.smithi062.stderr: 28200K .......... .......... .......... .......... .......... 30% 197M 1s 2024-09-12T00:57:50.494 INFO:teuthology.orchestra.run.smithi062.stderr: 28250K .......... .......... .......... .......... .......... 30% 93.4M 1s 2024-09-12T00:57:50.494 INFO:teuthology.orchestra.run.smithi062.stderr: 28300K .......... .......... .......... .......... .......... 30% 251M 1s 2024-09-12T00:57:50.494 INFO:teuthology.orchestra.run.smithi062.stderr: 28350K .......... .......... .......... .......... .......... 30% 246M 1s 2024-09-12T00:57:50.494 INFO:teuthology.orchestra.run.smithi062.stderr: 28400K .......... .......... .......... .......... .......... 30% 38.5M 1s 2024-09-12T00:57:50.494 INFO:teuthology.orchestra.run.smithi062.stderr: 28450K .......... .......... .......... .......... .......... 30% 104M 1s 2024-09-12T00:57:50.494 INFO:teuthology.orchestra.run.smithi062.stderr: 28500K .......... .......... .......... .......... .......... 30% 46.0M 1s 2024-09-12T00:57:50.494 INFO:teuthology.orchestra.run.smithi062.stderr: 28550K .......... .......... .......... .......... .......... 30% 323M 1s 2024-09-12T00:57:50.494 INFO:teuthology.orchestra.run.smithi062.stderr: 28600K .......... .......... .......... .......... .......... 30% 180M 1s 2024-09-12T00:57:50.494 INFO:teuthology.orchestra.run.smithi062.stderr: 28650K .......... .......... .......... .......... .......... 30% 24.0M 1s 2024-09-12T00:57:50.494 INFO:teuthology.orchestra.run.smithi062.stderr: 28700K .......... .......... .......... .......... .......... 30% 228M 1s 2024-09-12T00:57:50.494 INFO:teuthology.orchestra.run.smithi062.stderr: 28750K .......... .......... .......... .......... .......... 31% 350M 1s 2024-09-12T00:57:50.495 INFO:teuthology.orchestra.run.smithi062.stderr: 28800K .......... .......... .......... .......... .......... 31% 388M 1s 2024-09-12T00:57:50.495 INFO:teuthology.orchestra.run.smithi062.stderr: 28850K .......... .......... .......... .......... .......... 31% 116M 1s 2024-09-12T00:57:50.495 INFO:teuthology.orchestra.run.smithi062.stderr: 28900K .......... .......... .......... .......... .......... 31% 270M 1s 2024-09-12T00:57:50.495 INFO:teuthology.orchestra.run.smithi062.stderr: 28950K .......... .......... .......... .......... .......... 31% 67.6M 1s 2024-09-12T00:57:50.495 INFO:teuthology.orchestra.run.smithi062.stderr: 29000K .......... .......... .......... .......... .......... 31% 237M 1s 2024-09-12T00:57:50.495 INFO:teuthology.orchestra.run.smithi062.stderr: 29050K .......... .......... .......... .......... .......... 31% 244M 1s 2024-09-12T00:57:50.495 INFO:teuthology.orchestra.run.smithi062.stderr: 29100K .......... .......... .......... .......... .......... 31% 133M 1s 2024-09-12T00:57:50.495 INFO:teuthology.orchestra.run.smithi062.stderr: 29150K .......... .......... .......... .......... .......... 31% 239M 1s 2024-09-12T00:57:50.495 INFO:teuthology.orchestra.run.smithi062.stderr: 29200K .......... .......... .......... .......... .......... 31% 147M 1s 2024-09-12T00:57:50.495 INFO:teuthology.orchestra.run.smithi062.stderr: 29250K .......... .......... .......... .......... .......... 31% 323M 1s 2024-09-12T00:57:50.495 INFO:teuthology.orchestra.run.smithi062.stderr: 29300K .......... .......... .......... .......... .......... 31% 52.1M 1s 2024-09-12T00:57:50.495 INFO:teuthology.orchestra.run.smithi062.stderr: 29350K .......... .......... .......... .......... .......... 31% 319M 1s 2024-09-12T00:57:50.495 INFO:teuthology.orchestra.run.smithi062.stderr: 29400K .......... .......... .......... .......... .......... 31% 332M 1s 2024-09-12T00:57:50.496 INFO:teuthology.orchestra.run.smithi062.stderr: 29450K .......... .......... .......... .......... .......... 31% 329M 1s 2024-09-12T00:57:50.496 INFO:teuthology.orchestra.run.smithi062.stderr: 29500K .......... .......... .......... .......... .......... 31% 221M 1s 2024-09-12T00:57:50.496 INFO:teuthology.orchestra.run.smithi062.stderr: 29550K .......... .......... .......... .......... .......... 31% 303M 1s 2024-09-12T00:57:50.496 INFO:teuthology.orchestra.run.smithi062.stderr: 29600K .......... .......... .......... .......... .......... 31% 379M 1s 2024-09-12T00:57:50.496 INFO:teuthology.orchestra.run.smithi062.stderr: 29650K .......... .......... .......... .......... .......... 31% 24.7M 1s 2024-09-12T00:57:50.496 INFO:teuthology.orchestra.run.smithi062.stderr: 29700K .......... .......... .......... .......... .......... 32% 230M 1s 2024-09-12T00:57:50.496 INFO:teuthology.orchestra.run.smithi062.stderr: 29750K .......... .......... .......... .......... .......... 32% 330M 1s 2024-09-12T00:57:50.496 INFO:teuthology.orchestra.run.smithi062.stderr: 29800K .......... .......... .......... .......... .......... 32% 292M 1s 2024-09-12T00:57:50.496 INFO:teuthology.orchestra.run.smithi062.stderr: 29850K .......... .......... .......... .......... .......... 32% 327M 1s 2024-09-12T00:57:50.496 INFO:teuthology.orchestra.run.smithi062.stderr: 29900K .......... .......... .......... .......... .......... 32% 218M 1s 2024-09-12T00:57:50.496 INFO:teuthology.orchestra.run.smithi062.stderr: 29950K .......... .......... .......... .......... .......... 32% 310M 1s 2024-09-12T00:57:50.496 INFO:teuthology.orchestra.run.smithi062.stderr: 30000K .......... .......... .......... .......... .......... 32% 328M 1s 2024-09-12T00:57:50.496 INFO:teuthology.orchestra.run.smithi062.stderr: 30050K .......... .......... .......... .......... .......... 32% 316M 1s 2024-09-12T00:57:50.496 INFO:teuthology.orchestra.run.smithi062.stderr: 30100K .......... .......... .......... .......... .......... 32% 338M 1s 2024-09-12T00:57:50.497 INFO:teuthology.orchestra.run.smithi062.stderr: 30150K .......... .......... .......... .......... .......... 32% 331M 1s 2024-09-12T00:57:50.497 INFO:teuthology.orchestra.run.smithi062.stderr: 30200K .......... .......... .......... .......... .......... 32% 317M 1s 2024-09-12T00:57:50.497 INFO:teuthology.orchestra.run.smithi062.stderr: 30250K .......... .......... .......... .......... .......... 32% 365M 1s 2024-09-12T00:57:50.497 INFO:teuthology.orchestra.run.smithi062.stderr: 30300K .......... .......... .......... .......... .......... 32% 207M 1s 2024-09-12T00:57:50.497 INFO:teuthology.orchestra.run.smithi062.stderr: 30350K .......... .......... .......... .......... .......... 32% 310M 1s 2024-09-12T00:57:50.497 INFO:teuthology.orchestra.run.smithi062.stderr: 30400K .......... .......... .......... .......... .......... 32% 308M 1s 2024-09-12T00:57:50.497 INFO:teuthology.orchestra.run.smithi062.stderr: 30450K .......... .......... .......... .......... .......... 32% 80.8M 1s 2024-09-12T00:57:50.497 INFO:teuthology.orchestra.run.smithi062.stderr: 30500K .......... .......... .......... .......... .......... 32% 237M 1s 2024-09-12T00:57:50.497 INFO:teuthology.orchestra.run.smithi062.stderr: 30550K .......... .......... .......... .......... .......... 32% 318M 1s 2024-09-12T00:57:50.497 INFO:teuthology.orchestra.run.smithi062.stderr: 30600K .......... .......... .......... .......... .......... 32% 306M 1s 2024-09-12T00:57:50.497 INFO:teuthology.orchestra.run.smithi062.stderr: 30650K .......... .......... .......... .......... .......... 33% 321M 0s 2024-09-12T00:57:50.497 INFO:teuthology.orchestra.run.smithi062.stderr: 30700K .......... .......... .......... .......... .......... 33% 13.8M 1s 2024-09-12T00:57:50.497 INFO:teuthology.orchestra.run.smithi062.stderr: 30750K .......... .......... .......... .......... .......... 33% 34.7M 1s 2024-09-12T00:57:50.498 INFO:teuthology.orchestra.run.smithi062.stderr: 30800K .......... .......... .......... .......... .......... 33% 215M 1s 2024-09-12T00:57:50.498 INFO:teuthology.orchestra.run.smithi062.stderr: 30850K .......... .......... .......... .......... .......... 33% 292M 1s 2024-09-12T00:57:50.498 INFO:teuthology.orchestra.run.smithi062.stderr: 30900K .......... .......... .......... .......... .......... 33% 275M 1s 2024-09-12T00:57:50.498 INFO:teuthology.orchestra.run.smithi062.stderr: 30950K .......... .......... .......... .......... .......... 33% 326M 1s 2024-09-12T00:57:50.498 INFO:teuthology.orchestra.run.smithi062.stderr: 31000K .......... .......... .......... .......... .......... 33% 391M 1s 2024-09-12T00:57:50.498 INFO:teuthology.orchestra.run.smithi062.stderr: 31050K .......... .......... .......... .......... .......... 33% 395M 1s 2024-09-12T00:57:50.498 INFO:teuthology.orchestra.run.smithi062.stderr: 31100K .......... .......... .......... .......... .......... 33% 102M 1s 2024-09-12T00:57:50.498 INFO:teuthology.orchestra.run.smithi062.stderr: 31150K .......... .......... .......... .......... .......... 33% 261M 1s 2024-09-12T00:57:50.498 INFO:teuthology.orchestra.run.smithi062.stderr: 31200K .......... .......... .......... .......... .......... 33% 321M 0s 2024-09-12T00:57:50.498 INFO:teuthology.orchestra.run.smithi062.stderr: 31250K .......... .......... .......... .......... .......... 33% 289M 0s 2024-09-12T00:57:50.498 INFO:teuthology.orchestra.run.smithi062.stderr: 31300K .......... .......... .......... .......... .......... 33% 388M 0s 2024-09-12T00:57:50.498 INFO:teuthology.orchestra.run.smithi062.stderr: 31350K .......... .......... .......... .......... .......... 33% 46.5M 0s 2024-09-12T00:57:50.498 INFO:teuthology.orchestra.run.smithi062.stderr: 31400K .......... .......... .......... .......... .......... 33% 189M 0s 2024-09-12T00:57:50.499 INFO:teuthology.orchestra.run.smithi062.stderr: 31450K .......... .......... .......... .......... .......... 33% 78.5M 0s 2024-09-12T00:57:50.499 INFO:teuthology.orchestra.run.smithi062.stderr: 31500K .......... .......... .......... .......... .......... 33% 244M 0s 2024-09-12T00:57:50.499 INFO:teuthology.orchestra.run.smithi062.stderr: 31550K .......... .......... .......... .......... .......... 34% 122M 0s 2024-09-12T00:57:50.499 INFO:teuthology.orchestra.run.smithi062.stderr: 31600K .......... .......... .......... .......... .......... 34% 331M 0s 2024-09-12T00:57:50.499 INFO:teuthology.orchestra.run.smithi062.stderr: 31650K .......... .......... .......... .......... .......... 34% 104M 0s 2024-09-12T00:57:50.499 INFO:teuthology.orchestra.run.smithi062.stderr: 31700K .......... .......... .......... .......... .......... 34% 318M 0s 2024-09-12T00:57:50.499 INFO:teuthology.orchestra.run.smithi062.stderr: 31750K .......... .......... .......... .......... .......... 34% 291M 0s 2024-09-12T00:57:50.499 INFO:teuthology.orchestra.run.smithi062.stderr: 31800K .......... .......... .......... .......... .......... 34% 362M 0s 2024-09-12T00:57:50.499 INFO:teuthology.orchestra.run.smithi062.stderr: 31850K .......... .......... .......... .......... .......... 34% 152M 0s 2024-09-12T00:57:50.499 INFO:teuthology.orchestra.run.smithi062.stderr: 31900K .......... .......... .......... .......... .......... 34% 354M 0s 2024-09-12T00:57:50.499 INFO:teuthology.orchestra.run.smithi062.stderr: 31950K .......... .......... .......... .......... .......... 34% 63.0M 0s 2024-09-12T00:57:50.499 INFO:teuthology.orchestra.run.smithi062.stderr: 32000K .......... .......... .......... .......... .......... 34% 314M 0s 2024-09-12T00:57:50.499 INFO:teuthology.orchestra.run.smithi062.stderr: 32050K .......... .......... .......... .......... .......... 34% 375M 0s 2024-09-12T00:57:50.499 INFO:teuthology.orchestra.run.smithi062.stderr: 32100K .......... .......... .......... .......... .......... 34% 285M 0s 2024-09-12T00:57:50.500 INFO:teuthology.orchestra.run.smithi062.stderr: 32150K .......... .......... .......... .......... .......... 34% 263M 0s 2024-09-12T00:57:50.500 INFO:teuthology.orchestra.run.smithi062.stderr: 32200K .......... .......... .......... .......... .......... 34% 355M 0s 2024-09-12T00:57:50.500 INFO:teuthology.orchestra.run.smithi062.stderr: 32250K .......... .......... .......... .......... .......... 34% 304M 0s 2024-09-12T00:57:50.500 INFO:teuthology.orchestra.run.smithi062.stderr: 32300K .......... .......... .......... .......... .......... 34% 24.4M 0s 2024-09-12T00:57:50.500 INFO:teuthology.orchestra.run.smithi062.stderr: 32350K .......... .......... .......... .......... .......... 34% 137M 0s 2024-09-12T00:57:50.500 INFO:teuthology.orchestra.run.smithi062.stderr: 32400K .......... .......... .......... .......... .......... 34% 246M 0s 2024-09-12T00:57:50.500 INFO:teuthology.orchestra.run.smithi062.stderr: 32450K .......... .......... .......... .......... .......... 34% 97.9M 0s 2024-09-12T00:57:50.500 INFO:teuthology.orchestra.run.smithi062.stderr: 32500K .......... .......... .......... .......... .......... 35% 314M 0s 2024-09-12T00:57:50.500 INFO:teuthology.orchestra.run.smithi062.stderr: 32550K .......... .......... .......... .......... .......... 35% 227M 0s 2024-09-12T00:57:50.500 INFO:teuthology.orchestra.run.smithi062.stderr: 32600K .......... .......... .......... .......... .......... 35% 78.7M 0s 2024-09-12T00:57:50.500 INFO:teuthology.orchestra.run.smithi062.stderr: 32650K .......... .......... .......... .......... .......... 35% 269M 0s 2024-09-12T00:57:50.500 INFO:teuthology.orchestra.run.smithi062.stderr: 32700K .......... .......... .......... .......... .......... 35% 254M 0s 2024-09-12T00:57:50.500 INFO:teuthology.orchestra.run.smithi062.stderr: 32750K .......... .......... .......... .......... .......... 35% 216M 0s 2024-09-12T00:57:50.501 INFO:teuthology.orchestra.run.smithi062.stderr: 32800K .......... .......... .......... .......... .......... 35% 351M 0s 2024-09-12T00:57:50.501 INFO:teuthology.orchestra.run.smithi062.stderr: 32850K .......... .......... .......... .......... .......... 35% 372M 0s 2024-09-12T00:57:50.501 INFO:teuthology.orchestra.run.smithi062.stderr: 32900K .......... .......... .......... .......... .......... 35% 394M 0s 2024-09-12T00:57:50.501 INFO:teuthology.orchestra.run.smithi062.stderr: 32950K .......... .......... .......... .......... .......... 35% 362M 0s 2024-09-12T00:57:50.501 INFO:teuthology.orchestra.run.smithi062.stderr: 33000K .......... .......... .......... .......... .......... 35% 25.9M 0s 2024-09-12T00:57:50.501 INFO:teuthology.orchestra.run.smithi062.stderr: 33050K .......... .......... .......... .......... .......... 35% 384M 0s 2024-09-12T00:57:50.501 INFO:teuthology.orchestra.run.smithi062.stderr: 33100K .......... .......... .......... .......... .......... 35% 369M 0s 2024-09-12T00:57:50.501 INFO:teuthology.orchestra.run.smithi062.stderr: 33150K .......... .......... .......... .......... .......... 35% 225M 0s 2024-09-12T00:57:50.501 INFO:teuthology.orchestra.run.smithi062.stderr: 33200K .......... .......... .......... .......... .......... 35% 75.5M 0s 2024-09-12T00:57:50.501 INFO:teuthology.orchestra.run.smithi062.stderr: 33250K .......... .......... .......... .......... .......... 35% 304M 0s 2024-09-12T00:57:50.501 INFO:teuthology.orchestra.run.smithi062.stderr: 33300K .......... .......... .......... .......... .......... 35% 342M 0s 2024-09-12T00:57:50.501 INFO:teuthology.orchestra.run.smithi062.stderr: 33350K .......... .......... .......... .......... .......... 35% 358M 0s 2024-09-12T00:57:50.501 INFO:teuthology.orchestra.run.smithi062.stderr: 33400K .......... .......... .......... .......... .......... 36% 89.4M 0s 2024-09-12T00:57:50.502 INFO:teuthology.orchestra.run.smithi062.stderr: 33450K .......... .......... .......... .......... .......... 36% 294M 0s 2024-09-12T00:57:50.502 INFO:teuthology.orchestra.run.smithi062.stderr: 33500K .......... .......... .......... .......... .......... 36% 321M 0s 2024-09-12T00:57:50.502 INFO:teuthology.orchestra.run.smithi062.stderr: 33550K .......... .......... .......... .......... .......... 36% 133M 0s 2024-09-12T00:57:50.502 INFO:teuthology.orchestra.run.smithi062.stderr: 33600K .......... .......... .......... .......... .......... 36% 286M 0s 2024-09-12T00:57:50.502 INFO:teuthology.orchestra.run.smithi062.stderr: 33650K .......... .......... .......... .......... .......... 36% 336M 0s 2024-09-12T00:57:50.502 INFO:teuthology.orchestra.run.smithi062.stderr: 33700K .......... .......... .......... .......... .......... 36% 369M 0s 2024-09-12T00:57:50.502 INFO:teuthology.orchestra.run.smithi062.stderr: 33750K .......... .......... .......... .......... .......... 36% 79.0M 0s 2024-09-12T00:57:50.502 INFO:teuthology.orchestra.run.smithi062.stderr: 33800K .......... .......... .......... .......... .......... 36% 312M 0s 2024-09-12T00:57:50.502 INFO:teuthology.orchestra.run.smithi062.stderr: 33850K .......... .......... .......... .......... .......... 36% 245M 0s 2024-09-12T00:57:50.502 INFO:teuthology.orchestra.run.smithi062.stderr: 33900K .......... .......... .......... .......... .......... 36% 322M 0s 2024-09-12T00:57:50.502 INFO:teuthology.orchestra.run.smithi062.stderr: 33950K .......... .......... .......... .......... .......... 36% 33.5M 0s 2024-09-12T00:57:50.502 INFO:teuthology.orchestra.run.smithi062.stderr: 34000K .......... .......... .......... .......... .......... 36% 267M 0s 2024-09-12T00:57:50.502 INFO:teuthology.orchestra.run.smithi062.stderr: 34050K .......... .......... .......... .......... .......... 36% 250M 0s 2024-09-12T00:57:50.503 INFO:teuthology.orchestra.run.smithi062.stderr: 34100K .......... .......... .......... .......... .......... 36% 210M 0s 2024-09-12T00:57:50.503 INFO:teuthology.orchestra.run.smithi062.stderr: 34150K .......... .......... .......... .......... .......... 36% 31.9M 0s 2024-09-12T00:57:50.503 INFO:teuthology.orchestra.run.smithi062.stderr: 34200K .......... .......... .......... .......... .......... 36% 312M 0s 2024-09-12T00:57:50.503 INFO:teuthology.orchestra.run.smithi062.stderr: 34250K .......... .......... .......... .......... .......... 36% 270M 0s 2024-09-12T00:57:50.503 INFO:teuthology.orchestra.run.smithi062.stderr: 34300K .......... .......... .......... .......... .......... 36% 327M 0s 2024-09-12T00:57:50.503 INFO:teuthology.orchestra.run.smithi062.stderr: 34350K .......... .......... .......... .......... .......... 37% 30.6M 0s 2024-09-12T00:57:50.503 INFO:teuthology.orchestra.run.smithi062.stderr: 34400K .......... .......... .......... .......... .......... 37% 304M 0s 2024-09-12T00:57:50.503 INFO:teuthology.orchestra.run.smithi062.stderr: 34450K .......... .......... .......... .......... .......... 37% 288M 0s 2024-09-12T00:57:50.503 INFO:teuthology.orchestra.run.smithi062.stderr: 34500K .......... .......... .......... .......... .......... 37% 394M 0s 2024-09-12T00:57:50.503 INFO:teuthology.orchestra.run.smithi062.stderr: 34550K .......... .......... .......... .......... .......... 37% 35.8M 0s 2024-09-12T00:57:50.503 INFO:teuthology.orchestra.run.smithi062.stderr: 34600K .......... .......... .......... .......... .......... 37% 269M 0s 2024-09-12T00:57:50.503 INFO:teuthology.orchestra.run.smithi062.stderr: 34650K .......... .......... .......... .......... .......... 37% 317M 0s 2024-09-12T00:57:50.503 INFO:teuthology.orchestra.run.smithi062.stderr: 34700K .......... .......... .......... .......... .......... 37% 380M 0s 2024-09-12T00:57:50.503 INFO:teuthology.orchestra.run.smithi062.stderr: 34750K .......... .......... .......... .......... .......... 37% 45.5M 0s 2024-09-12T00:57:50.504 INFO:teuthology.orchestra.run.smithi062.stderr: 34800K .......... .......... .......... .......... .......... 37% 196M 0s 2024-09-12T00:57:50.504 INFO:teuthology.orchestra.run.smithi062.stderr: 34850K .......... .......... .......... .......... .......... 37% 394M 0s 2024-09-12T00:57:50.504 INFO:teuthology.orchestra.run.smithi062.stderr: 34900K .......... .......... .......... .......... .......... 37% 47.3M 0s 2024-09-12T00:57:50.504 INFO:teuthology.orchestra.run.smithi062.stderr: 34950K .......... .......... .......... .......... .......... 37% 246M 0s 2024-09-12T00:57:50.504 INFO:teuthology.orchestra.run.smithi062.stderr: 35000K .......... .......... .......... .......... .......... 37% 310M 0s 2024-09-12T00:57:50.504 INFO:teuthology.orchestra.run.smithi062.stderr: 35050K .......... .......... .......... .......... .......... 37% 330M 0s 2024-09-12T00:57:50.504 INFO:teuthology.orchestra.run.smithi062.stderr: 35100K .......... .......... .......... .......... .......... 37% 44.2M 0s 2024-09-12T00:57:50.504 INFO:teuthology.orchestra.run.smithi062.stderr: 35150K .......... .......... .......... .......... .......... 37% 237M 0s 2024-09-12T00:57:50.504 INFO:teuthology.orchestra.run.smithi062.stderr: 35200K .......... .......... .......... .......... .......... 37% 323M 0s 2024-09-12T00:57:50.504 INFO:teuthology.orchestra.run.smithi062.stderr: 35250K .......... .......... .......... .......... .......... 37% 396M 0s 2024-09-12T00:57:50.504 INFO:teuthology.orchestra.run.smithi062.stderr: 35300K .......... .......... .......... .......... .......... 38% 18.2M 0s 2024-09-12T00:57:50.504 INFO:teuthology.orchestra.run.smithi062.stderr: 35350K .......... .......... .......... .......... .......... 38% 231M 0s 2024-09-12T00:57:50.504 INFO:teuthology.orchestra.run.smithi062.stderr: 35400K .......... .......... .......... .......... .......... 38% 354M 0s 2024-09-12T00:57:50.505 INFO:teuthology.orchestra.run.smithi062.stderr: 35450K .......... .......... .......... .......... .......... 38% 298M 0s 2024-09-12T00:57:50.505 INFO:teuthology.orchestra.run.smithi062.stderr: 35500K .......... .......... .......... .......... .......... 38% 35.1M 0s 2024-09-12T00:57:50.505 INFO:teuthology.orchestra.run.smithi062.stderr: 35550K .......... .......... .......... .......... .......... 38% 154M 0s 2024-09-12T00:57:50.505 INFO:teuthology.orchestra.run.smithi062.stderr: 35600K .......... .......... .......... .......... .......... 38% 260M 0s 2024-09-12T00:57:50.505 INFO:teuthology.orchestra.run.smithi062.stderr: 35650K .......... .......... .......... .......... .......... 38% 255M 0s 2024-09-12T00:57:50.505 INFO:teuthology.orchestra.run.smithi062.stderr: 35700K .......... .......... .......... .......... .......... 38% 78.5M 0s 2024-09-12T00:57:50.505 INFO:teuthology.orchestra.run.smithi062.stderr: 35750K .......... .......... .......... .......... .......... 38% 40.1M 0s 2024-09-12T00:57:50.505 INFO:teuthology.orchestra.run.smithi062.stderr: 35800K .......... .......... .......... .......... .......... 38% 304M 0s 2024-09-12T00:57:50.505 INFO:teuthology.orchestra.run.smithi062.stderr: 35850K .......... .......... .......... .......... .......... 38% 312M 0s 2024-09-12T00:57:50.505 INFO:teuthology.orchestra.run.smithi062.stderr: 35900K .......... .......... .......... .......... .......... 38% 150M 0s 2024-09-12T00:57:50.505 INFO:teuthology.orchestra.run.smithi062.stderr: 35950K .......... .......... .......... .......... .......... 38% 176M 0s 2024-09-12T00:57:50.505 INFO:teuthology.orchestra.run.smithi062.stderr: 36000K .......... .......... .......... .......... .......... 38% 322M 0s 2024-09-12T00:57:50.505 INFO:teuthology.orchestra.run.smithi062.stderr: 36050K .......... .......... .......... .......... .......... 38% 91.5M 0s 2024-09-12T00:57:50.505 INFO:teuthology.orchestra.run.smithi062.stderr: 36100K .......... .......... .......... .......... .......... 38% 204M 0s 2024-09-12T00:57:50.506 INFO:teuthology.orchestra.run.smithi062.stderr: 36150K .......... .......... .......... .......... .......... 38% 149M 0s 2024-09-12T00:57:50.506 INFO:teuthology.orchestra.run.smithi062.stderr: 36200K .......... .......... .......... .......... .......... 39% 365M 0s 2024-09-12T00:57:50.506 INFO:teuthology.orchestra.run.smithi062.stderr: 36250K .......... .......... .......... .......... .......... 39% 153M 0s 2024-09-12T00:57:50.506 INFO:teuthology.orchestra.run.smithi062.stderr: 36300K .......... .......... .......... .......... .......... 39% 358M 0s 2024-09-12T00:57:50.506 INFO:teuthology.orchestra.run.smithi062.stderr: 36350K .......... .......... .......... .......... .......... 39% 30.7M 0s 2024-09-12T00:57:50.506 INFO:teuthology.orchestra.run.smithi062.stderr: 36400K .......... .......... .......... .......... .......... 39% 358M 0s 2024-09-12T00:57:50.506 INFO:teuthology.orchestra.run.smithi062.stderr: 36450K .......... .......... .......... .......... .......... 39% 86.1M 0s 2024-09-12T00:57:50.506 INFO:teuthology.orchestra.run.smithi062.stderr: 36500K .......... .......... .......... .......... .......... 39% 45.7M 0s 2024-09-12T00:57:50.506 INFO:teuthology.orchestra.run.smithi062.stderr: 36550K .......... .......... .......... .......... .......... 39% 286M 0s 2024-09-12T00:57:50.506 INFO:teuthology.orchestra.run.smithi062.stderr: 36600K .......... .......... .......... .......... .......... 39% 364M 0s 2024-09-12T00:57:50.506 INFO:teuthology.orchestra.run.smithi062.stderr: 36650K .......... .......... .......... .......... .......... 39% 181M 0s 2024-09-12T00:57:50.506 INFO:teuthology.orchestra.run.smithi062.stderr: 36700K .......... .......... .......... .......... .......... 39% 89.1M 0s 2024-09-12T00:57:50.506 INFO:teuthology.orchestra.run.smithi062.stderr: 36750K .......... .......... .......... .......... .......... 39% 259M 0s 2024-09-12T00:57:50.506 INFO:teuthology.orchestra.run.smithi062.stderr: 36800K .......... .......... .......... .......... .......... 39% 395M 0s 2024-09-12T00:57:50.507 INFO:teuthology.orchestra.run.smithi062.stderr: 36850K .......... .......... .......... .......... .......... 39% 145M 0s 2024-09-12T00:57:50.507 INFO:teuthology.orchestra.run.smithi062.stderr: 36900K .......... .......... .......... .......... .......... 39% 150M 0s 2024-09-12T00:57:50.507 INFO:teuthology.orchestra.run.smithi062.stderr: 36950K .......... .......... .......... .......... .......... 39% 296M 0s 2024-09-12T00:57:50.507 INFO:teuthology.orchestra.run.smithi062.stderr: 37000K .......... .......... .......... .......... .......... 39% 354M 0s 2024-09-12T00:57:50.507 INFO:teuthology.orchestra.run.smithi062.stderr: 37050K .......... .......... .......... .......... .......... 39% 206M 0s 2024-09-12T00:57:50.507 INFO:teuthology.orchestra.run.smithi062.stderr: 37100K .......... .......... .......... .......... .......... 39% 71.4M 0s 2024-09-12T00:57:50.507 INFO:teuthology.orchestra.run.smithi062.stderr: 37150K .......... .......... .......... .......... .......... 40% 310M 0s 2024-09-12T00:57:50.507 INFO:teuthology.orchestra.run.smithi062.stderr: 37200K .......... .......... .......... .......... .......... 40% 387M 0s 2024-09-12T00:57:50.507 INFO:teuthology.orchestra.run.smithi062.stderr: 37250K .......... .......... .......... .......... .......... 40% 161M 0s 2024-09-12T00:57:50.507 INFO:teuthology.orchestra.run.smithi062.stderr: 37300K .......... .......... .......... .......... .......... 40% 289M 0s 2024-09-12T00:57:50.507 INFO:teuthology.orchestra.run.smithi062.stderr: 37350K .......... .......... .......... .......... .......... 40% 348M 0s 2024-09-12T00:57:50.507 INFO:teuthology.orchestra.run.smithi062.stderr: 37400K .......... .......... .......... .......... .......... 40% 272M 0s 2024-09-12T00:57:50.507 INFO:teuthology.orchestra.run.smithi062.stderr: 37450K .......... .......... .......... .......... .......... 40% 312M 0s 2024-09-12T00:57:50.507 INFO:teuthology.orchestra.run.smithi062.stderr: 37500K .......... .......... .......... .......... .......... 40% 127M 0s 2024-09-12T00:57:50.508 INFO:teuthology.orchestra.run.smithi062.stderr: 37550K .......... .......... .......... .......... .......... 40% 373M 0s 2024-09-12T00:57:50.508 INFO:teuthology.orchestra.run.smithi062.stderr: 37600K .......... .......... .......... .......... .......... 40% 327M 0s 2024-09-12T00:57:50.508 INFO:teuthology.orchestra.run.smithi062.stderr: 37650K .......... .......... .......... .......... .......... 40% 243M 0s 2024-09-12T00:57:50.508 INFO:teuthology.orchestra.run.smithi062.stderr: 37700K .......... .......... .......... .......... .......... 40% 298M 0s 2024-09-12T00:57:50.508 INFO:teuthology.orchestra.run.smithi062.stderr: 37750K .......... .......... .......... .......... .......... 40% 342M 0s 2024-09-12T00:57:50.508 INFO:teuthology.orchestra.run.smithi062.stderr: 37800K .......... .......... .......... .......... .......... 40% 79.2M 0s 2024-09-12T00:57:50.508 INFO:teuthology.orchestra.run.smithi062.stderr: 37850K .......... .......... .......... .......... .......... 40% 161M 0s 2024-09-12T00:57:50.508 INFO:teuthology.orchestra.run.smithi062.stderr: 37900K .......... .......... .......... .......... .......... 40% 349M 0s 2024-09-12T00:57:50.508 INFO:teuthology.orchestra.run.smithi062.stderr: 37950K .......... .......... .......... .......... .......... 40% 233M 0s 2024-09-12T00:57:50.508 INFO:teuthology.orchestra.run.smithi062.stderr: 38000K .......... .......... .......... .......... .......... 40% 84.1M 0s 2024-09-12T00:57:50.508 INFO:teuthology.orchestra.run.smithi062.stderr: 38050K .......... .......... .......... .......... .......... 41% 72.7M 0s 2024-09-12T00:57:50.508 INFO:teuthology.orchestra.run.smithi062.stderr: 38100K .......... .......... .......... .......... .......... 41% 318M 0s 2024-09-12T00:57:50.508 INFO:teuthology.orchestra.run.smithi062.stderr: 38150K .......... .......... .......... .......... .......... 41% 383M 0s 2024-09-12T00:57:50.509 INFO:teuthology.orchestra.run.smithi062.stderr: 38200K .......... .......... .......... .......... .......... 41% 97.9M 0s 2024-09-12T00:57:50.509 INFO:teuthology.orchestra.run.smithi062.stderr: 38250K .......... .......... .......... .......... .......... 41% 129M 0s 2024-09-12T00:57:50.509 INFO:teuthology.orchestra.run.smithi062.stderr: 38300K .......... .......... .......... .......... .......... 41% 333M 0s 2024-09-12T00:57:50.509 INFO:teuthology.orchestra.run.smithi062.stderr: 38350K .......... .......... .......... .......... .......... 41% 302M 0s 2024-09-12T00:57:50.509 INFO:teuthology.orchestra.run.smithi062.stderr: 38400K .......... .......... .......... .......... .......... 41% 379M 0s 2024-09-12T00:57:50.509 INFO:teuthology.orchestra.run.smithi062.stderr: 38450K .......... .......... .......... .......... .......... 41% 143M 0s 2024-09-12T00:57:50.509 INFO:teuthology.orchestra.run.smithi062.stderr: 38500K .......... .......... .......... .......... .......... 41% 314M 0s 2024-09-12T00:57:50.509 INFO:teuthology.orchestra.run.smithi062.stderr: 38550K .......... .......... .......... .......... .......... 41% 191M 0s 2024-09-12T00:57:50.509 INFO:teuthology.orchestra.run.smithi062.stderr: 38600K .......... .......... .......... .......... .......... 41% 341M 0s 2024-09-12T00:57:50.509 INFO:teuthology.orchestra.run.smithi062.stderr: 38650K .......... .......... .......... .......... .......... 41% 60.5M 0s 2024-09-12T00:57:50.509 INFO:teuthology.orchestra.run.smithi062.stderr: 38700K .......... .......... .......... .......... .......... 41% 347M 0s 2024-09-12T00:57:50.509 INFO:teuthology.orchestra.run.smithi062.stderr: 38750K .......... .......... .......... .......... .......... 41% 250M 0s 2024-09-12T00:57:50.509 INFO:teuthology.orchestra.run.smithi062.stderr: 38800K .......... .......... .......... .......... .......... 41% 352M 0s 2024-09-12T00:57:50.510 INFO:teuthology.orchestra.run.smithi062.stderr: 38850K .......... .......... .......... .......... .......... 41% 102M 0s 2024-09-12T00:57:50.510 INFO:teuthology.orchestra.run.smithi062.stderr: 38900K .......... .......... .......... .......... .......... 41% 358M 0s 2024-09-12T00:57:50.510 INFO:teuthology.orchestra.run.smithi062.stderr: 38950K .......... .......... .......... .......... .......... 41% 237M 0s 2024-09-12T00:57:50.510 INFO:teuthology.orchestra.run.smithi062.stderr: 39000K .......... .......... .......... .......... .......... 42% 94.9M 0s 2024-09-12T00:57:50.510 INFO:teuthology.orchestra.run.smithi062.stderr: 39050K .......... .......... .......... .......... .......... 42% 267M 0s 2024-09-12T00:57:50.510 INFO:teuthology.orchestra.run.smithi062.stderr: 39100K .......... .......... .......... .......... .......... 42% 384M 0s 2024-09-12T00:57:50.510 INFO:teuthology.orchestra.run.smithi062.stderr: 39150K .......... .......... .......... .......... .......... 42% 254M 0s 2024-09-12T00:57:50.510 INFO:teuthology.orchestra.run.smithi062.stderr: 39200K .......... .......... .......... .......... .......... 42% 204M 0s 2024-09-12T00:57:50.510 INFO:teuthology.orchestra.run.smithi062.stderr: 39250K .......... .......... .......... .......... .......... 42% 211M 0s 2024-09-12T00:57:50.510 INFO:teuthology.orchestra.run.smithi062.stderr: 39300K .......... .......... .......... .......... .......... 42% 323M 0s 2024-09-12T00:57:50.510 INFO:teuthology.orchestra.run.smithi062.stderr: 39350K .......... .......... .......... .......... .......... 42% 353M 0s 2024-09-12T00:57:50.510 INFO:teuthology.orchestra.run.smithi062.stderr: 39400K .......... .......... .......... .......... .......... 42% 128M 0s 2024-09-12T00:57:50.510 INFO:teuthology.orchestra.run.smithi062.stderr: 39450K .......... .......... .......... .......... .......... 42% 263M 0s 2024-09-12T00:57:50.511 INFO:teuthology.orchestra.run.smithi062.stderr: 39500K .......... .......... .......... .......... .......... 42% 358M 0s 2024-09-12T00:57:50.511 INFO:teuthology.orchestra.run.smithi062.stderr: 39550K .......... .......... .......... .......... .......... 42% 225M 0s 2024-09-12T00:57:50.511 INFO:teuthology.orchestra.run.smithi062.stderr: 39600K .......... .......... .......... .......... .......... 42% 64.2M 0s 2024-09-12T00:57:50.511 INFO:teuthology.orchestra.run.smithi062.stderr: 39650K .......... .......... .......... .......... .......... 42% 250M 0s 2024-09-12T00:57:50.511 INFO:teuthology.orchestra.run.smithi062.stderr: 39700K .......... .......... .......... .......... .......... 42% 157M 0s 2024-09-12T00:57:50.511 INFO:teuthology.orchestra.run.smithi062.stderr: 39750K .......... .......... .......... .......... .......... 42% 335M 0s 2024-09-12T00:57:50.511 INFO:teuthology.orchestra.run.smithi062.stderr: 39800K .......... .......... .......... .......... .......... 42% 64.2M 0s 2024-09-12T00:57:50.511 INFO:teuthology.orchestra.run.smithi062.stderr: 39850K .......... .......... .......... .......... .......... 42% 283M 0s 2024-09-12T00:57:50.511 INFO:teuthology.orchestra.run.smithi062.stderr: 39900K .......... .......... .......... .......... .......... 43% 138M 0s 2024-09-12T00:57:50.511 INFO:teuthology.orchestra.run.smithi062.stderr: 39950K .......... .......... .......... .......... .......... 43% 340M 0s 2024-09-12T00:57:50.511 INFO:teuthology.orchestra.run.smithi062.stderr: 40000K .......... .......... .......... .......... .......... 43% 182M 0s 2024-09-12T00:57:50.511 INFO:teuthology.orchestra.run.smithi062.stderr: 40050K .......... .......... .......... .......... .......... 43% 266M 0s 2024-09-12T00:57:50.511 INFO:teuthology.orchestra.run.smithi062.stderr: 40100K .......... .......... .......... .......... .......... 43% 351M 0s 2024-09-12T00:57:50.512 INFO:teuthology.orchestra.run.smithi062.stderr: 40150K .......... .......... .......... .......... .......... 43% 225M 0s 2024-09-12T00:57:50.512 INFO:teuthology.orchestra.run.smithi062.stderr: 40200K .......... .......... .......... .......... .......... 43% 256M 0s 2024-09-12T00:57:50.512 INFO:teuthology.orchestra.run.smithi062.stderr: 40250K .......... .......... .......... .......... .......... 43% 279M 0s 2024-09-12T00:57:50.512 INFO:teuthology.orchestra.run.smithi062.stderr: 40300K .......... .......... .......... .......... .......... 43% 295M 0s 2024-09-12T00:57:50.512 INFO:teuthology.orchestra.run.smithi062.stderr: 40350K .......... .......... .......... .......... .......... 43% 307M 0s 2024-09-12T00:57:50.512 INFO:teuthology.orchestra.run.smithi062.stderr: 40400K .......... .......... .......... .......... .......... 43% 322M 0s 2024-09-12T00:57:50.512 INFO:teuthology.orchestra.run.smithi062.stderr: 40450K .......... .......... .......... .......... .......... 43% 236M 0s 2024-09-12T00:57:50.512 INFO:teuthology.orchestra.run.smithi062.stderr: 40500K .......... .......... .......... .......... .......... 43% 310M 0s 2024-09-12T00:57:50.512 INFO:teuthology.orchestra.run.smithi062.stderr: 40550K .......... .......... .......... .......... .......... 43% 316M 0s 2024-09-12T00:57:50.512 INFO:teuthology.orchestra.run.smithi062.stderr: 40600K .......... .......... .......... .......... .......... 43% 330M 0s 2024-09-12T00:57:50.512 INFO:teuthology.orchestra.run.smithi062.stderr: 40650K .......... .......... .......... .......... .......... 43% 372M 0s 2024-09-12T00:57:50.512 INFO:teuthology.orchestra.run.smithi062.stderr: 40700K .......... .......... .......... .......... .......... 43% 392M 0s 2024-09-12T00:57:50.512 INFO:teuthology.orchestra.run.smithi062.stderr: 40750K .......... .......... .......... .......... .......... 43% 305M 0s 2024-09-12T00:57:50.513 INFO:teuthology.orchestra.run.smithi062.stderr: 40800K .......... .......... .......... .......... .......... 43% 388M 0s 2024-09-12T00:57:50.513 INFO:teuthology.orchestra.run.smithi062.stderr: 40850K .......... .......... .......... .......... .......... 44% 396M 0s 2024-09-12T00:57:50.513 INFO:teuthology.orchestra.run.smithi062.stderr: 40900K .......... .......... .......... .......... .......... 44% 394M 0s 2024-09-12T00:57:50.513 INFO:teuthology.orchestra.run.smithi062.stderr: 40950K .......... .......... .......... .......... .......... 44% 61.6M 0s 2024-09-12T00:57:50.513 INFO:teuthology.orchestra.run.smithi062.stderr: 41000K .......... .......... .......... .......... .......... 44% 302M 0s 2024-09-12T00:57:50.513 INFO:teuthology.orchestra.run.smithi062.stderr: 41050K .......... .......... .......... .......... .......... 44% 62.0M 0s 2024-09-12T00:57:50.513 INFO:teuthology.orchestra.run.smithi062.stderr: 41100K .......... .......... .......... .......... .......... 44% 168M 0s 2024-09-12T00:57:50.513 INFO:teuthology.orchestra.run.smithi062.stderr: 41150K .......... .......... .......... .......... .......... 44% 284M 0s 2024-09-12T00:57:50.513 INFO:teuthology.orchestra.run.smithi062.stderr: 41200K .......... .......... .......... .......... .......... 44% 285M 0s 2024-09-12T00:57:50.513 INFO:teuthology.orchestra.run.smithi062.stderr: 41250K .......... .......... .......... .......... .......... 44% 299M 0s 2024-09-12T00:57:50.513 INFO:teuthology.orchestra.run.smithi062.stderr: 41300K .......... .......... .......... .......... .......... 44% 278M 0s 2024-09-12T00:57:50.513 INFO:teuthology.orchestra.run.smithi062.stderr: 41350K .......... .......... .......... .......... .......... 44% 306M 0s 2024-09-12T00:57:50.513 INFO:teuthology.orchestra.run.smithi062.stderr: 41400K .......... .......... .......... .......... .......... 44% 327M 0s 2024-09-12T00:57:50.513 INFO:teuthology.orchestra.run.smithi062.stderr: 41450K .......... .......... .......... .......... .......... 44% 356M 0s 2024-09-12T00:57:50.514 INFO:teuthology.orchestra.run.smithi062.stderr: 41500K .......... .......... .......... .......... .......... 44% 319M 0s 2024-09-12T00:57:50.514 INFO:teuthology.orchestra.run.smithi062.stderr: 41550K .......... .......... .......... .......... .......... 44% 289M 0s 2024-09-12T00:57:50.514 INFO:teuthology.orchestra.run.smithi062.stderr: 41600K .......... .......... .......... .......... .......... 44% 268M 0s 2024-09-12T00:57:50.514 INFO:teuthology.orchestra.run.smithi062.stderr: 41650K .......... .......... .......... .......... .......... 44% 287M 0s 2024-09-12T00:57:50.514 INFO:teuthology.orchestra.run.smithi062.stderr: 41700K .......... .......... .......... .......... .......... 44% 271M 0s 2024-09-12T00:57:50.514 INFO:teuthology.orchestra.run.smithi062.stderr: 41750K .......... .......... .......... .......... .......... 44% 372M 0s 2024-09-12T00:57:50.514 INFO:teuthology.orchestra.run.smithi062.stderr: 41800K .......... .......... .......... .......... .......... 45% 258M 0s 2024-09-12T00:57:50.514 INFO:teuthology.orchestra.run.smithi062.stderr: 41850K .......... .......... .......... .......... .......... 45% 287M 0s 2024-09-12T00:57:50.514 INFO:teuthology.orchestra.run.smithi062.stderr: 41900K .......... .......... .......... .......... .......... 45% 359M 0s 2024-09-12T00:57:50.514 INFO:teuthology.orchestra.run.smithi062.stderr: 41950K .......... .......... .......... .......... .......... 45% 283M 0s 2024-09-12T00:57:50.514 INFO:teuthology.orchestra.run.smithi062.stderr: 42000K .......... .......... .......... .......... .......... 45% 216M 0s 2024-09-12T00:57:50.514 INFO:teuthology.orchestra.run.smithi062.stderr: 42050K .......... .......... .......... .......... .......... 45% 230M 0s 2024-09-12T00:57:50.514 INFO:teuthology.orchestra.run.smithi062.stderr: 42100K .......... .......... .......... .......... .......... 45% 250M 0s 2024-09-12T00:57:50.515 INFO:teuthology.orchestra.run.smithi062.stderr: 42150K .......... .......... .......... .......... .......... 45% 277M 0s 2024-09-12T00:57:50.515 INFO:teuthology.orchestra.run.smithi062.stderr: 42200K .......... .......... .......... .......... .......... 45% 265M 0s 2024-09-12T00:57:50.515 INFO:teuthology.orchestra.run.smithi062.stderr: 42250K .......... .......... .......... .......... .......... 45% 309M 0s 2024-09-12T00:57:50.515 INFO:teuthology.orchestra.run.smithi062.stderr: 42300K .......... .......... .......... .......... .......... 45% 379M 0s 2024-09-12T00:57:50.515 INFO:teuthology.orchestra.run.smithi062.stderr: 42350K .......... .......... .......... .......... .......... 45% 386M 0s 2024-09-12T00:57:50.515 INFO:teuthology.orchestra.run.smithi062.stderr: 42400K .......... .......... .......... .......... .......... 45% 344M 0s 2024-09-12T00:57:50.515 INFO:teuthology.orchestra.run.smithi062.stderr: 42450K .......... .......... .......... .......... .......... 45% 385M 0s 2024-09-12T00:57:50.515 INFO:teuthology.orchestra.run.smithi062.stderr: 42500K .......... .......... .......... .......... .......... 45% 308M 0s 2024-09-12T00:57:50.515 INFO:teuthology.orchestra.run.smithi062.stderr: 42550K .......... .......... .......... .......... .......... 45% 348M 0s 2024-09-12T00:57:50.515 INFO:teuthology.orchestra.run.smithi062.stderr: 42600K .......... .......... .......... .......... .......... 45% 269M 0s 2024-09-12T00:57:50.515 INFO:teuthology.orchestra.run.smithi062.stderr: 42650K .......... .......... .......... .......... .......... 45% 373M 0s 2024-09-12T00:57:50.515 INFO:teuthology.orchestra.run.smithi062.stderr: 42700K .......... .......... .......... .......... .......... 46% 396M 0s 2024-09-12T00:57:50.515 INFO:teuthology.orchestra.run.smithi062.stderr: 42750K .......... .......... .......... .......... .......... 46% 391M 0s 2024-09-12T00:57:50.515 INFO:teuthology.orchestra.run.smithi062.stderr: 42800K .......... .......... .......... .......... .......... 46% 124M 0s 2024-09-12T00:57:50.516 INFO:teuthology.orchestra.run.smithi062.stderr: 42850K .......... .......... .......... .......... .......... 46% 234M 0s 2024-09-12T00:57:50.516 INFO:teuthology.orchestra.run.smithi062.stderr: 42900K .......... .......... .......... .......... .......... 46% 327M 0s 2024-09-12T00:57:50.516 INFO:teuthology.orchestra.run.smithi062.stderr: 42950K .......... .......... .......... .......... .......... 46% 179M 0s 2024-09-12T00:57:50.516 INFO:teuthology.orchestra.run.smithi062.stderr: 43000K .......... .......... .......... .......... .......... 46% 86.0M 0s 2024-09-12T00:57:50.516 INFO:teuthology.orchestra.run.smithi062.stderr: 43050K .......... .......... .......... .......... .......... 46% 191M 0s 2024-09-12T00:57:50.516 INFO:teuthology.orchestra.run.smithi062.stderr: 43100K .......... .......... .......... .......... .......... 46% 263M 0s 2024-09-12T00:57:50.516 INFO:teuthology.orchestra.run.smithi062.stderr: 43150K .......... .......... .......... .......... .......... 46% 275M 0s 2024-09-12T00:57:50.516 INFO:teuthology.orchestra.run.smithi062.stderr: 43200K .......... .......... .......... .......... .......... 46% 381M 0s 2024-09-12T00:57:50.516 INFO:teuthology.orchestra.run.smithi062.stderr: 43250K .......... .......... .......... .......... .......... 46% 291M 0s 2024-09-12T00:57:50.516 INFO:teuthology.orchestra.run.smithi062.stderr: 43300K .......... .......... .......... .......... .......... 46% 266M 0s 2024-09-12T00:57:50.516 INFO:teuthology.orchestra.run.smithi062.stderr: 43350K .......... .......... .......... .......... .......... 46% 306M 0s 2024-09-12T00:57:50.516 INFO:teuthology.orchestra.run.smithi062.stderr: 43400K .......... .......... .......... .......... .......... 46% 333M 0s 2024-09-12T00:57:50.516 INFO:teuthology.orchestra.run.smithi062.stderr: 43450K .......... .......... .......... .......... .......... 46% 336M 0s 2024-09-12T00:57:50.517 INFO:teuthology.orchestra.run.smithi062.stderr: 43500K .......... .......... .......... .......... .......... 46% 257M 0s 2024-09-12T00:57:50.517 INFO:teuthology.orchestra.run.smithi062.stderr: 43550K .......... .......... .......... .......... .......... 46% 271M 0s 2024-09-12T00:57:50.517 INFO:teuthology.orchestra.run.smithi062.stderr: 43600K .......... .......... .......... .......... .......... 46% 351M 0s 2024-09-12T00:57:50.517 INFO:teuthology.orchestra.run.smithi062.stderr: 43650K .......... .......... .......... .......... .......... 47% 390M 0s 2024-09-12T00:57:50.517 INFO:teuthology.orchestra.run.smithi062.stderr: 43700K .......... .......... .......... .......... .......... 47% 57.6M 0s 2024-09-12T00:57:50.517 INFO:teuthology.orchestra.run.smithi062.stderr: 43750K .......... .......... .......... .......... .......... 47% 309M 0s 2024-09-12T00:57:50.517 INFO:teuthology.orchestra.run.smithi062.stderr: 43800K .......... .......... .......... .......... .......... 47% 312M 0s 2024-09-12T00:57:50.517 INFO:teuthology.orchestra.run.smithi062.stderr: 43850K .......... .......... .......... .......... .......... 47% 317M 0s 2024-09-12T00:57:50.517 INFO:teuthology.orchestra.run.smithi062.stderr: 43900K .......... .......... .......... .......... .......... 47% 268M 0s 2024-09-12T00:57:50.517 INFO:teuthology.orchestra.run.smithi062.stderr: 43950K .......... .......... .......... .......... .......... 47% 385M 0s 2024-09-12T00:57:50.517 INFO:teuthology.orchestra.run.smithi062.stderr: 44000K .......... .......... .......... .......... .......... 47% 386M 0s 2024-09-12T00:57:50.517 INFO:teuthology.orchestra.run.smithi062.stderr: 44050K .......... .......... .......... .......... .......... 47% 384M 0s 2024-09-12T00:57:50.517 INFO:teuthology.orchestra.run.smithi062.stderr: 44100K .......... .......... .......... .......... .......... 47% 199M 0s 2024-09-12T00:57:50.518 INFO:teuthology.orchestra.run.smithi062.stderr: 44150K .......... .......... .......... .......... .......... 47% 129M 0s 2024-09-12T00:57:50.518 INFO:teuthology.orchestra.run.smithi062.stderr: 44200K .......... .......... .......... .......... .......... 47% 174M 0s 2024-09-12T00:57:50.518 INFO:teuthology.orchestra.run.smithi062.stderr: 44250K .......... .......... .......... .......... .......... 47% 310M 0s 2024-09-12T00:57:50.518 INFO:teuthology.orchestra.run.smithi062.stderr: 44300K .......... .......... .......... .......... .......... 47% 278M 0s 2024-09-12T00:57:50.518 INFO:teuthology.orchestra.run.smithi062.stderr: 44350K .......... .......... .......... .......... .......... 47% 338M 0s 2024-09-12T00:57:50.518 INFO:teuthology.orchestra.run.smithi062.stderr: 44400K .......... .......... .......... .......... .......... 47% 383M 0s 2024-09-12T00:57:50.518 INFO:teuthology.orchestra.run.smithi062.stderr: 44450K .......... .......... .......... .......... .......... 47% 207M 0s 2024-09-12T00:57:50.518 INFO:teuthology.orchestra.run.smithi062.stderr: 44500K .......... .......... .......... .......... .......... 47% 259M 0s 2024-09-12T00:57:50.518 INFO:teuthology.orchestra.run.smithi062.stderr: 44550K .......... .......... .......... .......... .......... 48% 323M 0s 2024-09-12T00:57:50.518 INFO:teuthology.orchestra.run.smithi062.stderr: 44600K .......... .......... .......... .......... .......... 48% 306M 0s 2024-09-12T00:57:50.518 INFO:teuthology.orchestra.run.smithi062.stderr: 44650K .......... .......... .......... .......... .......... 48% 317M 0s 2024-09-12T00:57:50.518 INFO:teuthology.orchestra.run.smithi062.stderr: 44700K .......... .......... .......... .......... .......... 48% 245M 0s 2024-09-12T00:57:50.518 INFO:teuthology.orchestra.run.smithi062.stderr: 44750K .......... .......... .......... .......... .......... 48% 356M 0s 2024-09-12T00:57:50.519 INFO:teuthology.orchestra.run.smithi062.stderr: 44800K .......... .......... .......... .......... .......... 48% 316M 0s 2024-09-12T00:57:50.519 INFO:teuthology.orchestra.run.smithi062.stderr: 44850K .......... .......... .......... .......... .......... 48% 316M 0s 2024-09-12T00:57:50.519 INFO:teuthology.orchestra.run.smithi062.stderr: 44900K .......... .......... .......... .......... .......... 48% 266M 0s 2024-09-12T00:57:50.519 INFO:teuthology.orchestra.run.smithi062.stderr: 44950K .......... .......... .......... .......... .......... 48% 389M 0s 2024-09-12T00:57:50.519 INFO:teuthology.orchestra.run.smithi062.stderr: 45000K .......... .......... .......... .......... .......... 48% 397M 0s 2024-09-12T00:57:50.519 INFO:teuthology.orchestra.run.smithi062.stderr: 45050K .......... .......... .......... .......... .......... 48% 211M 0s 2024-09-12T00:57:50.519 INFO:teuthology.orchestra.run.smithi062.stderr: 45100K .......... .......... .......... .......... .......... 48% 14.6M 0s 2024-09-12T00:57:50.519 INFO:teuthology.orchestra.run.smithi062.stderr: 45150K .......... .......... .......... .......... .......... 48% 282M 0s 2024-09-12T00:57:50.519 INFO:teuthology.orchestra.run.smithi062.stderr: 45200K .......... .......... .......... .......... .......... 48% 97.1M 0s 2024-09-12T00:57:50.519 INFO:teuthology.orchestra.run.smithi062.stderr: 45250K .......... .......... .......... .......... .......... 48% 245M 0s 2024-09-12T00:57:50.519 INFO:teuthology.orchestra.run.smithi062.stderr: 45300K .......... .......... .......... .......... .......... 48% 284M 0s 2024-09-12T00:57:50.519 INFO:teuthology.orchestra.run.smithi062.stderr: 45350K .......... .......... .......... .......... .......... 48% 393M 0s 2024-09-12T00:57:50.519 INFO:teuthology.orchestra.run.smithi062.stderr: 45400K .......... .......... .......... .......... .......... 48% 320M 0s 2024-09-12T00:57:50.519 INFO:teuthology.orchestra.run.smithi062.stderr: 45450K .......... .......... .......... .......... .......... 48% 265M 0s 2024-09-12T00:57:50.520 INFO:teuthology.orchestra.run.smithi062.stderr: 45500K .......... .......... .......... .......... .......... 49% 57.5M 0s 2024-09-12T00:57:50.520 INFO:teuthology.orchestra.run.smithi062.stderr: 45550K .......... .......... .......... .......... .......... 49% 301M 0s 2024-09-12T00:57:50.520 INFO:teuthology.orchestra.run.smithi062.stderr: 45600K .......... .......... .......... .......... .......... 49% 282M 0s 2024-09-12T00:57:50.520 INFO:teuthology.orchestra.run.smithi062.stderr: 45650K .......... .......... .......... .......... .......... 49% 298M 0s 2024-09-12T00:57:50.520 INFO:teuthology.orchestra.run.smithi062.stderr: 45700K .......... .......... .......... .......... .......... 49% 341M 0s 2024-09-12T00:57:50.520 INFO:teuthology.orchestra.run.smithi062.stderr: 45750K .......... .......... .......... .......... .......... 49% 359M 0s 2024-09-12T00:57:50.520 INFO:teuthology.orchestra.run.smithi062.stderr: 45800K .......... .......... .......... .......... .......... 49% 323M 0s 2024-09-12T00:57:50.520 INFO:teuthology.orchestra.run.smithi062.stderr: 45850K .......... .......... .......... .......... .......... 49% 327M 0s 2024-09-12T00:57:50.520 INFO:teuthology.orchestra.run.smithi062.stderr: 45900K .......... .......... .......... .......... .......... 49% 258M 0s 2024-09-12T00:57:50.520 INFO:teuthology.orchestra.run.smithi062.stderr: 45950K .......... .......... .......... .......... .......... 49% 301M 0s 2024-09-12T00:57:50.520 INFO:teuthology.orchestra.run.smithi062.stderr: 46000K .......... .......... .......... .......... .......... 49% 287M 0s 2024-09-12T00:57:50.520 INFO:teuthology.orchestra.run.smithi062.stderr: 46050K .......... .......... .......... .......... .......... 49% 268M 0s 2024-09-12T00:57:50.520 INFO:teuthology.orchestra.run.smithi062.stderr: 46100K .......... .......... .......... .......... .......... 49% 295M 0s 2024-09-12T00:57:50.521 INFO:teuthology.orchestra.run.smithi062.stderr: 46150K .......... .......... .......... .......... .......... 49% 313M 0s 2024-09-12T00:57:50.521 INFO:teuthology.orchestra.run.smithi062.stderr: 46200K .......... .......... .......... .......... .......... 49% 294M 0s 2024-09-12T00:57:50.521 INFO:teuthology.orchestra.run.smithi062.stderr: 46250K .......... .......... .......... .......... .......... 49% 298M 0s 2024-09-12T00:57:50.521 INFO:teuthology.orchestra.run.smithi062.stderr: 46300K .......... .......... .......... .......... .......... 49% 311M 0s 2024-09-12T00:57:50.521 INFO:teuthology.orchestra.run.smithi062.stderr: 46350K .......... .......... .......... .......... .......... 49% 393M 0s 2024-09-12T00:57:50.521 INFO:teuthology.orchestra.run.smithi062.stderr: 46400K .......... .......... .......... .......... .......... 49% 394M 0s 2024-09-12T00:57:50.521 INFO:teuthology.orchestra.run.smithi062.stderr: 46450K .......... .......... .......... .......... .......... 50% 397M 0s 2024-09-12T00:57:50.521 INFO:teuthology.orchestra.run.smithi062.stderr: 46500K .......... .......... .......... .......... .......... 50% 345M 0s 2024-09-12T00:57:50.521 INFO:teuthology.orchestra.run.smithi062.stderr: 46550K .......... .......... .......... .......... .......... 50% 302M 0s 2024-09-12T00:57:50.521 INFO:teuthology.orchestra.run.smithi062.stderr: 46600K .......... .......... .......... .......... .......... 50% 310M 0s 2024-09-12T00:57:50.521 INFO:teuthology.orchestra.run.smithi062.stderr: 46650K .......... .......... .......... .......... .......... 50% 349M 0s 2024-09-12T00:57:50.521 INFO:teuthology.orchestra.run.smithi062.stderr: 46700K .......... .......... .......... .......... .......... 50% 291M 0s 2024-09-12T00:57:50.521 INFO:teuthology.orchestra.run.smithi062.stderr: 46750K .......... .......... .......... .......... .......... 50% 309M 0s 2024-09-12T00:57:50.521 INFO:teuthology.orchestra.run.smithi062.stderr: 46800K .......... .......... .......... .......... .......... 50% 332M 0s 2024-09-12T00:57:50.522 INFO:teuthology.orchestra.run.smithi062.stderr: 46850K .......... .......... .......... .......... .......... 50% 358M 0s 2024-09-12T00:57:50.522 INFO:teuthology.orchestra.run.smithi062.stderr: 46900K .......... .......... .......... .......... .......... 50% 354M 0s 2024-09-12T00:57:50.522 INFO:teuthology.orchestra.run.smithi062.stderr: 46950K .......... .......... .......... .......... .......... 50% 399M 0s 2024-09-12T00:57:50.522 INFO:teuthology.orchestra.run.smithi062.stderr: 47000K .......... .......... .......... .......... .......... 50% 151M 0s 2024-09-12T00:57:50.522 INFO:teuthology.orchestra.run.smithi062.stderr: 47050K .......... .......... .......... .......... .......... 50% 307M 0s 2024-09-12T00:57:50.522 INFO:teuthology.orchestra.run.smithi062.stderr: 47100K .......... .......... .......... .......... .......... 50% 261M 0s 2024-09-12T00:57:50.522 INFO:teuthology.orchestra.run.smithi062.stderr: 47150K .......... .......... .......... .......... .......... 50% 316M 0s 2024-09-12T00:57:50.522 INFO:teuthology.orchestra.run.smithi062.stderr: 47200K .......... .......... .......... .......... .......... 50% 320M 0s 2024-09-12T00:57:50.522 INFO:teuthology.orchestra.run.smithi062.stderr: 47250K .......... .......... .......... .......... .......... 50% 305M 0s 2024-09-12T00:57:50.522 INFO:teuthology.orchestra.run.smithi062.stderr: 47300K .......... .......... .......... .......... .......... 50% 280M 0s 2024-09-12T00:57:50.522 INFO:teuthology.orchestra.run.smithi062.stderr: 47350K .......... .......... .......... .......... .......... 51% 332M 0s 2024-09-12T00:57:50.522 INFO:teuthology.orchestra.run.smithi062.stderr: 47400K .......... .......... .......... .......... .......... 51% 336M 0s 2024-09-12T00:57:50.522 INFO:teuthology.orchestra.run.smithi062.stderr: 47450K .......... .......... .......... .......... .......... 51% 280M 0s 2024-09-12T00:57:50.523 INFO:teuthology.orchestra.run.smithi062.stderr: 47500K .......... .......... .......... .......... .......... 51% 273M 0s 2024-09-12T00:57:50.523 INFO:teuthology.orchestra.run.smithi062.stderr: 47550K .......... .......... .......... .......... .......... 51% 325M 0s 2024-09-12T00:57:50.523 INFO:teuthology.orchestra.run.smithi062.stderr: 47600K .......... .......... .......... .......... .......... 51% 329M 0s 2024-09-12T00:57:50.523 INFO:teuthology.orchestra.run.smithi062.stderr: 47650K .......... .......... .......... .......... .......... 51% 348M 0s 2024-09-12T00:57:50.523 INFO:teuthology.orchestra.run.smithi062.stderr: 47700K .......... .......... .......... .......... .......... 51% 271M 0s 2024-09-12T00:57:50.523 INFO:teuthology.orchestra.run.smithi062.stderr: 47750K .......... .......... .......... .......... .......... 51% 301M 0s 2024-09-12T00:57:50.523 INFO:teuthology.orchestra.run.smithi062.stderr: 47800K .......... .......... .......... .......... .......... 51% 387M 0s 2024-09-12T00:57:50.523 INFO:teuthology.orchestra.run.smithi062.stderr: 47850K .......... .......... .......... .......... .......... 51% 396M 0s 2024-09-12T00:57:50.523 INFO:teuthology.orchestra.run.smithi062.stderr: 47900K .......... .......... .......... .......... .......... 51% 332M 0s 2024-09-12T00:57:50.523 INFO:teuthology.orchestra.run.smithi062.stderr: 47950K .......... .......... .......... .......... .......... 51% 398M 0s 2024-09-12T00:57:50.523 INFO:teuthology.orchestra.run.smithi062.stderr: 48000K .......... .......... .......... .......... .......... 51% 397M 0s 2024-09-12T00:57:50.523 INFO:teuthology.orchestra.run.smithi062.stderr: 48050K .......... .......... .......... .......... .......... 51% 396M 0s 2024-09-12T00:57:50.523 INFO:teuthology.orchestra.run.smithi062.stderr: 48100K .......... .......... .......... .......... .......... 51% 353M 0s 2024-09-12T00:57:50.523 INFO:teuthology.orchestra.run.smithi062.stderr: 48150K .......... .......... .......... .......... .......... 51% 47.8M 0s 2024-09-12T00:57:50.524 INFO:teuthology.orchestra.run.smithi062.stderr: 48200K .......... .......... .......... .......... .......... 51% 296M 0s 2024-09-12T00:57:50.524 INFO:teuthology.orchestra.run.smithi062.stderr: 48250K .......... .......... .......... .......... .......... 51% 73.2M 0s 2024-09-12T00:57:50.524 INFO:teuthology.orchestra.run.smithi062.stderr: 48300K .......... .......... .......... .......... .......... 52% 239M 0s 2024-09-12T00:57:50.524 INFO:teuthology.orchestra.run.smithi062.stderr: 48350K .......... .......... .......... .......... .......... 52% 311M 0s 2024-09-12T00:57:50.524 INFO:teuthology.orchestra.run.smithi062.stderr: 48400K .......... .......... .......... .......... .......... 52% 302M 0s 2024-09-12T00:57:50.524 INFO:teuthology.orchestra.run.smithi062.stderr: 48450K .......... .......... .......... .......... .......... 52% 346M 0s 2024-09-12T00:57:50.524 INFO:teuthology.orchestra.run.smithi062.stderr: 48500K .......... .......... .......... .......... .......... 52% 259M 0s 2024-09-12T00:57:50.524 INFO:teuthology.orchestra.run.smithi062.stderr: 48550K .......... .......... .......... .......... .......... 52% 46.2M 0s 2024-09-12T00:57:50.524 INFO:teuthology.orchestra.run.smithi062.stderr: 48600K .......... .......... .......... .......... .......... 52% 272M 0s 2024-09-12T00:57:50.524 INFO:teuthology.orchestra.run.smithi062.stderr: 48650K .......... .......... .......... .......... .......... 52% 300M 0s 2024-09-12T00:57:50.524 INFO:teuthology.orchestra.run.smithi062.stderr: 48700K .......... .......... .......... .......... .......... 52% 260M 0s 2024-09-12T00:57:50.524 INFO:teuthology.orchestra.run.smithi062.stderr: 48750K .......... .......... .......... .......... .......... 52% 269M 0s 2024-09-12T00:57:50.524 INFO:teuthology.orchestra.run.smithi062.stderr: 48800K .......... .......... .......... .......... .......... 52% 301M 0s 2024-09-12T00:57:50.525 INFO:teuthology.orchestra.run.smithi062.stderr: 48850K .......... .......... .......... .......... .......... 52% 388M 0s 2024-09-12T00:57:50.525 INFO:teuthology.orchestra.run.smithi062.stderr: 48900K .......... .......... .......... .......... .......... 52% 309M 0s 2024-09-12T00:57:50.525 INFO:teuthology.orchestra.run.smithi062.stderr: 48950K .......... .......... .......... .......... .......... 52% 309M 0s 2024-09-12T00:57:50.525 INFO:teuthology.orchestra.run.smithi062.stderr: 49000K .......... .......... .......... .......... .......... 52% 322M 0s 2024-09-12T00:57:50.525 INFO:teuthology.orchestra.run.smithi062.stderr: 49050K .......... .......... .......... .......... .......... 52% 361M 0s 2024-09-12T00:57:50.525 INFO:teuthology.orchestra.run.smithi062.stderr: 49100K .......... .......... .......... .......... .......... 52% 263M 0s 2024-09-12T00:57:50.525 INFO:teuthology.orchestra.run.smithi062.stderr: 49150K .......... .......... .......... .......... .......... 52% 315M 0s 2024-09-12T00:57:50.525 INFO:teuthology.orchestra.run.smithi062.stderr: 49200K .......... .......... .......... .......... .......... 53% 292M 0s 2024-09-12T00:57:50.525 INFO:teuthology.orchestra.run.smithi062.stderr: 49250K .......... .......... .......... .......... .......... 53% 308M 0s 2024-09-12T00:57:50.525 INFO:teuthology.orchestra.run.smithi062.stderr: 49300K .......... .......... .......... .......... .......... 53% 313M 0s 2024-09-12T00:57:50.525 INFO:teuthology.orchestra.run.smithi062.stderr: 49350K .......... .......... .......... .......... .......... 53% 379M 0s 2024-09-12T00:57:50.525 INFO:teuthology.orchestra.run.smithi062.stderr: 49400K .......... .......... .......... .......... .......... 53% 394M 0s 2024-09-12T00:57:50.525 INFO:teuthology.orchestra.run.smithi062.stderr: 49450K .......... .......... .......... .......... .......... 53% 140M 0s 2024-09-12T00:57:50.526 INFO:teuthology.orchestra.run.smithi062.stderr: 49500K .......... .......... .......... .......... .......... 53% 225M 0s 2024-09-12T00:57:50.526 INFO:teuthology.orchestra.run.smithi062.stderr: 49550K .......... .......... .......... .......... .......... 53% 278M 0s 2024-09-12T00:57:50.526 INFO:teuthology.orchestra.run.smithi062.stderr: 49600K .......... .......... .......... .......... .......... 53% 317M 0s 2024-09-12T00:57:50.526 INFO:teuthology.orchestra.run.smithi062.stderr: 49650K .......... .......... .......... .......... .......... 53% 329M 0s 2024-09-12T00:57:50.526 INFO:teuthology.orchestra.run.smithi062.stderr: 49700K .......... .......... .......... .......... .......... 53% 281M 0s 2024-09-12T00:57:50.526 INFO:teuthology.orchestra.run.smithi062.stderr: 49750K .......... .......... .......... .......... .......... 53% 363M 0s 2024-09-12T00:57:50.526 INFO:teuthology.orchestra.run.smithi062.stderr: 49800K .......... .......... .......... .......... .......... 53% 385M 0s 2024-09-12T00:57:50.526 INFO:teuthology.orchestra.run.smithi062.stderr: 49850K .......... .......... .......... .......... .......... 53% 394M 0s 2024-09-12T00:57:50.526 INFO:teuthology.orchestra.run.smithi062.stderr: 49900K .......... .......... .......... .......... .......... 53% 314M 0s 2024-09-12T00:57:50.526 INFO:teuthology.orchestra.run.smithi062.stderr: 49950K .......... .......... .......... .......... .......... 53% 161M 0s 2024-09-12T00:57:50.526 INFO:teuthology.orchestra.run.smithi062.stderr: 50000K .......... .......... .......... .......... .......... 53% 295M 0s 2024-09-12T00:57:50.526 INFO:teuthology.orchestra.run.smithi062.stderr: 50050K .......... .......... .......... .......... .......... 53% 294M 0s 2024-09-12T00:57:50.526 INFO:teuthology.orchestra.run.smithi062.stderr: 50100K .......... .......... .......... .......... .......... 53% 282M 0s 2024-09-12T00:57:50.526 INFO:teuthology.orchestra.run.smithi062.stderr: 50150K .......... .......... .......... .......... .......... 54% 286M 0s 2024-09-12T00:57:50.527 INFO:teuthology.orchestra.run.smithi062.stderr: 50200K .......... .......... .......... .......... .......... 54% 278M 0s 2024-09-12T00:57:50.527 INFO:teuthology.orchestra.run.smithi062.stderr: 50250K .......... .......... .......... .......... .......... 54% 319M 0s 2024-09-12T00:57:50.527 INFO:teuthology.orchestra.run.smithi062.stderr: 50300K .......... .......... .......... .......... .......... 54% 259M 0s 2024-09-12T00:57:50.527 INFO:teuthology.orchestra.run.smithi062.stderr: 50350K .......... .......... .......... .......... .......... 54% 316M 0s 2024-09-12T00:57:50.527 INFO:teuthology.orchestra.run.smithi062.stderr: 50400K .......... .......... .......... .......... .......... 54% 315M 0s 2024-09-12T00:57:50.527 INFO:teuthology.orchestra.run.smithi062.stderr: 50450K .......... .......... .......... .......... .......... 54% 201M 0s 2024-09-12T00:57:50.527 INFO:teuthology.orchestra.run.smithi062.stderr: 50500K .......... .......... .......... .......... .......... 54% 319M 0s 2024-09-12T00:57:50.527 INFO:teuthology.orchestra.run.smithi062.stderr: 50550K .......... .......... .......... .......... .......... 54% 264M 0s 2024-09-12T00:57:50.527 INFO:teuthology.orchestra.run.smithi062.stderr: 50600K .......... .......... .......... .......... .......... 54% 280M 0s 2024-09-12T00:57:50.527 INFO:teuthology.orchestra.run.smithi062.stderr: 50650K .......... .......... .......... .......... .......... 54% 336M 0s 2024-09-12T00:57:50.527 INFO:teuthology.orchestra.run.smithi062.stderr: 50700K .......... .......... .......... .......... .......... 54% 328M 0s 2024-09-12T00:57:50.527 INFO:teuthology.orchestra.run.smithi062.stderr: 50750K .......... .......... .......... .......... .......... 54% 376M 0s 2024-09-12T00:57:50.527 INFO:teuthology.orchestra.run.smithi062.stderr: 50800K .......... .......... .......... .......... .......... 54% 392M 0s 2024-09-12T00:57:50.527 INFO:teuthology.orchestra.run.smithi062.stderr: 50850K .......... .......... .......... .......... .......... 54% 398M 0s 2024-09-12T00:57:50.528 INFO:teuthology.orchestra.run.smithi062.stderr: 50900K .......... .......... .......... .......... .......... 54% 113M 0s 2024-09-12T00:57:50.528 INFO:teuthology.orchestra.run.smithi062.stderr: 50950K .......... .......... .......... .......... .......... 54% 63.6M 0s 2024-09-12T00:57:50.528 INFO:teuthology.orchestra.run.smithi062.stderr: 51000K .......... .......... .......... .......... .......... 54% 305M 0s 2024-09-12T00:57:50.528 INFO:teuthology.orchestra.run.smithi062.stderr: 51050K .......... .......... .......... .......... .......... 55% 293M 0s 2024-09-12T00:57:50.528 INFO:teuthology.orchestra.run.smithi062.stderr: 51100K .......... .......... .......... .......... .......... 55% 244M 0s 2024-09-12T00:57:50.528 INFO:teuthology.orchestra.run.smithi062.stderr: 51150K .......... .......... .......... .......... .......... 55% 335M 0s 2024-09-12T00:57:50.528 INFO:teuthology.orchestra.run.smithi062.stderr: 51200K .......... .......... .......... .......... .......... 55% 332M 0s 2024-09-12T00:57:50.528 INFO:teuthology.orchestra.run.smithi062.stderr: 51250K .......... .......... .......... .......... .......... 55% 368M 0s 2024-09-12T00:57:50.528 INFO:teuthology.orchestra.run.smithi062.stderr: 51300K .......... .......... .......... .......... .......... 55% 290M 0s 2024-09-12T00:57:50.528 INFO:teuthology.orchestra.run.smithi062.stderr: 51350K .......... .......... .......... .......... .......... 55% 288M 0s 2024-09-12T00:57:50.528 INFO:teuthology.orchestra.run.smithi062.stderr: 51400K .......... .......... .......... .......... .......... 55% 295M 0s 2024-09-12T00:57:50.528 INFO:teuthology.orchestra.run.smithi062.stderr: 51450K .......... .......... .......... .......... .......... 55% 266M 0s 2024-09-12T00:57:50.528 INFO:teuthology.orchestra.run.smithi062.stderr: 51500K .......... .......... .......... .......... .......... 55% 268M 0s 2024-09-12T00:57:50.529 INFO:teuthology.orchestra.run.smithi062.stderr: 51550K .......... .......... .......... .......... .......... 55% 390M 0s 2024-09-12T00:57:50.529 INFO:teuthology.orchestra.run.smithi062.stderr: 51600K .......... .......... .......... .......... .......... 55% 67.8M 0s 2024-09-12T00:57:50.529 INFO:teuthology.orchestra.run.smithi062.stderr: 51650K .......... .......... .......... .......... .......... 55% 199M 0s 2024-09-12T00:57:50.529 INFO:teuthology.orchestra.run.smithi062.stderr: 51700K .......... .......... .......... .......... .......... 55% 293M 0s 2024-09-12T00:57:50.529 INFO:teuthology.orchestra.run.smithi062.stderr: 51750K .......... .......... .......... .......... .......... 55% 149M 0s 2024-09-12T00:57:50.529 INFO:teuthology.orchestra.run.smithi062.stderr: 51800K .......... .......... .......... .......... .......... 55% 303M 0s 2024-09-12T00:57:50.529 INFO:teuthology.orchestra.run.smithi062.stderr: 51850K .......... .......... .......... .......... .......... 55% 331M 0s 2024-09-12T00:57:50.529 INFO:teuthology.orchestra.run.smithi062.stderr: 51900K .......... .......... .......... .......... .......... 55% 189M 0s 2024-09-12T00:57:50.529 INFO:teuthology.orchestra.run.smithi062.stderr: 51950K .......... .......... .......... .......... .......... 55% 275M 0s 2024-09-12T00:57:50.529 INFO:teuthology.orchestra.run.smithi062.stderr: 52000K .......... .......... .......... .......... .......... 56% 324M 0s 2024-09-12T00:57:50.529 INFO:teuthology.orchestra.run.smithi062.stderr: 52050K .......... .......... .......... .......... .......... 56% 396M 0s 2024-09-12T00:57:50.529 INFO:teuthology.orchestra.run.smithi062.stderr: 52100K .......... .......... .......... .......... .......... 56% 248M 0s 2024-09-12T00:57:50.529 INFO:teuthology.orchestra.run.smithi062.stderr: 52150K .......... .......... .......... .......... .......... 56% 312M 0s 2024-09-12T00:57:50.530 INFO:teuthology.orchestra.run.smithi062.stderr: 52200K .......... .......... .......... .......... .......... 56% 189M 0s 2024-09-12T00:57:50.530 INFO:teuthology.orchestra.run.smithi062.stderr: 52250K .......... .......... .......... .......... .......... 56% 395M 0s 2024-09-12T00:57:50.530 INFO:teuthology.orchestra.run.smithi062.stderr: 52300K .......... .......... .......... .......... .......... 56% 324M 0s 2024-09-12T00:57:50.530 INFO:teuthology.orchestra.run.smithi062.stderr: 52350K .......... .......... .......... .......... .......... 56% 117M 0s 2024-09-12T00:57:50.530 INFO:teuthology.orchestra.run.smithi062.stderr: 52400K .......... .......... .......... .......... .......... 56% 348M 0s 2024-09-12T00:57:50.530 INFO:teuthology.orchestra.run.smithi062.stderr: 52450K .......... .......... .......... .......... .......... 56% 307M 0s 2024-09-12T00:57:50.530 INFO:teuthology.orchestra.run.smithi062.stderr: 52500K .......... .......... .......... .......... .......... 56% 291M 0s 2024-09-12T00:57:50.530 INFO:teuthology.orchestra.run.smithi062.stderr: 52550K .......... .......... .......... .......... .......... 56% 316M 0s 2024-09-12T00:57:50.530 INFO:teuthology.orchestra.run.smithi062.stderr: 52600K .......... .......... .......... .......... .......... 56% 355M 0s 2024-09-12T00:57:50.530 INFO:teuthology.orchestra.run.smithi062.stderr: 52650K .......... .......... .......... .......... .......... 56% 358M 0s 2024-09-12T00:57:50.530 INFO:teuthology.orchestra.run.smithi062.stderr: 52700K .......... .......... .......... .......... .......... 56% 277M 0s 2024-09-12T00:57:50.530 INFO:teuthology.orchestra.run.smithi062.stderr: 52750K .......... .......... .......... .......... .......... 56% 338M 0s 2024-09-12T00:57:50.531 INFO:teuthology.orchestra.run.smithi062.stderr: 52800K .......... .......... .......... .......... .......... 56% 335M 0s 2024-09-12T00:57:50.531 INFO:teuthology.orchestra.run.smithi062.stderr: 52850K .......... .......... .......... .......... .......... 56% 122M 0s 2024-09-12T00:57:50.531 INFO:teuthology.orchestra.run.smithi062.stderr: 52900K .......... .......... .......... .......... .......... 56% 263M 0s 2024-09-12T00:57:50.531 INFO:teuthology.orchestra.run.smithi062.stderr: 52950K .......... .......... .......... .......... .......... 57% 339M 0s 2024-09-12T00:57:50.531 INFO:teuthology.orchestra.run.smithi062.stderr: 53000K .......... .......... .......... .......... .......... 57% 326M 0s 2024-09-12T00:57:50.531 INFO:teuthology.orchestra.run.smithi062.stderr: 53050K .......... .......... .......... .......... .......... 57% 327M 0s 2024-09-12T00:57:50.531 INFO:teuthology.orchestra.run.smithi062.stderr: 53100K .......... .......... .......... .......... .......... 57% 289M 0s 2024-09-12T00:57:50.531 INFO:teuthology.orchestra.run.smithi062.stderr: 53150K .......... .......... .......... .......... .......... 57% 329M 0s 2024-09-12T00:57:50.531 INFO:teuthology.orchestra.run.smithi062.stderr: 53200K .......... .......... .......... .......... .......... 57% 300M 0s 2024-09-12T00:57:50.531 INFO:teuthology.orchestra.run.smithi062.stderr: 53250K .......... .......... .......... .......... .......... 57% 351M 0s 2024-09-12T00:57:50.531 INFO:teuthology.orchestra.run.smithi062.stderr: 53300K .......... .......... .......... .......... .......... 57% 322M 0s 2024-09-12T00:57:50.531 INFO:teuthology.orchestra.run.smithi062.stderr: 53350K .......... .......... .......... .......... .......... 57% 355M 0s 2024-09-12T00:57:50.531 INFO:teuthology.orchestra.run.smithi062.stderr: 53400K .......... .......... .......... .......... .......... 57% 318M 0s 2024-09-12T00:57:50.532 INFO:teuthology.orchestra.run.smithi062.stderr: 53450K .......... .......... .......... .......... .......... 57% 364M 0s 2024-09-12T00:57:50.532 INFO:teuthology.orchestra.run.smithi062.stderr: 53500K .......... .......... .......... .......... .......... 57% 263M 0s 2024-09-12T00:57:50.532 INFO:teuthology.orchestra.run.smithi062.stderr: 53550K .......... .......... .......... .......... .......... 57% 342M 0s 2024-09-12T00:57:50.532 INFO:teuthology.orchestra.run.smithi062.stderr: 53600K .......... .......... .......... .......... .......... 57% 358M 0s 2024-09-12T00:57:50.532 INFO:teuthology.orchestra.run.smithi062.stderr: 53650K .......... .......... .......... .......... .......... 57% 357M 0s 2024-09-12T00:57:50.532 INFO:teuthology.orchestra.run.smithi062.stderr: 53700K .......... .......... .......... .......... .......... 57% 348M 0s 2024-09-12T00:57:50.532 INFO:teuthology.orchestra.run.smithi062.stderr: 53750K .......... .......... .......... .......... .......... 57% 65.3M 0s 2024-09-12T00:57:50.532 INFO:teuthology.orchestra.run.smithi062.stderr: 53800K .......... .......... .......... .......... .......... 57% 311M 0s 2024-09-12T00:57:50.532 INFO:teuthology.orchestra.run.smithi062.stderr: 53850K .......... .......... .......... .......... .......... 58% 339M 0s 2024-09-12T00:57:50.532 INFO:teuthology.orchestra.run.smithi062.stderr: 53900K .......... .......... .......... .......... .......... 58% 285M 0s 2024-09-12T00:57:50.532 INFO:teuthology.orchestra.run.smithi062.stderr: 53950K .......... .......... .......... .......... .......... 58% 394M 0s 2024-09-12T00:57:50.532 INFO:teuthology.orchestra.run.smithi062.stderr: 54000K .......... .......... .......... .......... .......... 58% 173M 0s 2024-09-12T00:57:50.532 INFO:teuthology.orchestra.run.smithi062.stderr: 54050K .......... .......... .......... .......... .......... 58% 326M 0s 2024-09-12T00:57:50.533 INFO:teuthology.orchestra.run.smithi062.stderr: 54100K .......... .......... .......... .......... .......... 58% 275M 0s 2024-09-12T00:57:50.533 INFO:teuthology.orchestra.run.smithi062.stderr: 54150K .......... .......... .......... .......... .......... 58% 349M 0s 2024-09-12T00:57:50.533 INFO:teuthology.orchestra.run.smithi062.stderr: 54200K .......... .......... .......... .......... .......... 58% 280M 0s 2024-09-12T00:57:50.533 INFO:teuthology.orchestra.run.smithi062.stderr: 54250K .......... .......... .......... .......... .......... 58% 298M 0s 2024-09-12T00:57:50.533 INFO:teuthology.orchestra.run.smithi062.stderr: 54300K .......... .......... .......... .......... .......... 58% 217M 0s 2024-09-12T00:57:50.533 INFO:teuthology.orchestra.run.smithi062.stderr: 54350K .......... .......... .......... .......... .......... 58% 324M 0s 2024-09-12T00:57:50.533 INFO:teuthology.orchestra.run.smithi062.stderr: 54400K .......... .......... .......... .......... .......... 58% 325M 0s 2024-09-12T00:57:50.533 INFO:teuthology.orchestra.run.smithi062.stderr: 54450K .......... .......... .......... .......... .......... 58% 357M 0s 2024-09-12T00:57:50.533 INFO:teuthology.orchestra.run.smithi062.stderr: 54500K .......... .......... .......... .......... .......... 58% 330M 0s 2024-09-12T00:57:50.533 INFO:teuthology.orchestra.run.smithi062.stderr: 54550K .......... .......... .......... .......... .......... 58% 286M 0s 2024-09-12T00:57:50.533 INFO:teuthology.orchestra.run.smithi062.stderr: 54600K .......... .......... .......... .......... .......... 58% 62.3M 0s 2024-09-12T00:57:50.533 INFO:teuthology.orchestra.run.smithi062.stderr: 54650K .......... .......... .......... .......... .......... 58% 350M 0s 2024-09-12T00:57:50.533 INFO:teuthology.orchestra.run.smithi062.stderr: 54700K .......... .......... .......... .......... .......... 58% 248M 0s 2024-09-12T00:57:50.534 INFO:teuthology.orchestra.run.smithi062.stderr: 54750K .......... .......... .......... .......... .......... 58% 110M 0s 2024-09-12T00:57:50.534 INFO:teuthology.orchestra.run.smithi062.stderr: 54800K .......... .......... .......... .......... .......... 59% 305M 0s 2024-09-12T00:57:50.534 INFO:teuthology.orchestra.run.smithi062.stderr: 54850K .......... .......... .......... .......... .......... 59% 290M 0s 2024-09-12T00:57:50.534 INFO:teuthology.orchestra.run.smithi062.stderr: 54900K .......... .......... .......... .......... .......... 59% 250M 0s 2024-09-12T00:57:50.534 INFO:teuthology.orchestra.run.smithi062.stderr: 54950K .......... .......... .......... .......... .......... 59% 302M 0s 2024-09-12T00:57:50.534 INFO:teuthology.orchestra.run.smithi062.stderr: 55000K .......... .......... .......... .......... .......... 59% 317M 0s 2024-09-12T00:57:50.534 INFO:teuthology.orchestra.run.smithi062.stderr: 55050K .......... .......... .......... .......... .......... 59% 392M 0s 2024-09-12T00:57:50.534 INFO:teuthology.orchestra.run.smithi062.stderr: 55100K .......... .......... .......... .......... .......... 59% 167M 0s 2024-09-12T00:57:50.534 INFO:teuthology.orchestra.run.smithi062.stderr: 55150K .......... .......... .......... .......... .......... 59% 328M 0s 2024-09-12T00:57:50.534 INFO:teuthology.orchestra.run.smithi062.stderr: 55200K .......... .......... .......... .......... .......... 59% 328M 0s 2024-09-12T00:57:50.534 INFO:teuthology.orchestra.run.smithi062.stderr: 55250K .......... .......... .......... .......... .......... 59% 388M 0s 2024-09-12T00:57:50.534 INFO:teuthology.orchestra.run.smithi062.stderr: 55300K .......... .......... .......... .......... .......... 59% 74.9M 0s 2024-09-12T00:57:50.534 INFO:teuthology.orchestra.run.smithi062.stderr: 55350K .......... .......... .......... .......... .......... 59% 301M 0s 2024-09-12T00:57:50.535 INFO:teuthology.orchestra.run.smithi062.stderr: 55400K .......... .......... .......... .......... .......... 59% 301M 0s 2024-09-12T00:57:50.535 INFO:teuthology.orchestra.run.smithi062.stderr: 55450K .......... .......... .......... .......... .......... 59% 332M 0s 2024-09-12T00:57:50.535 INFO:teuthology.orchestra.run.smithi062.stderr: 55500K .......... .......... .......... .......... .......... 59% 299M 0s 2024-09-12T00:57:50.535 INFO:teuthology.orchestra.run.smithi062.stderr: 55550K .......... .......... .......... .......... .......... 59% 307M 0s 2024-09-12T00:57:50.535 INFO:teuthology.orchestra.run.smithi062.stderr: 55600K .......... .......... .......... .......... .......... 59% 319M 0s 2024-09-12T00:57:50.535 INFO:teuthology.orchestra.run.smithi062.stderr: 55650K .......... .......... .......... .......... .......... 59% 323M 0s 2024-09-12T00:57:50.535 INFO:teuthology.orchestra.run.smithi062.stderr: 55700K .......... .......... .......... .......... .......... 60% 313M 0s 2024-09-12T00:57:50.535 INFO:teuthology.orchestra.run.smithi062.stderr: 55750K .......... .......... .......... .......... .......... 60% 390M 0s 2024-09-12T00:57:50.535 INFO:teuthology.orchestra.run.smithi062.stderr: 55800K .......... .......... .......... .......... .......... 60% 392M 0s 2024-09-12T00:57:50.535 INFO:teuthology.orchestra.run.smithi062.stderr: 55850K .......... .......... .......... .......... .......... 60% 188M 0s 2024-09-12T00:57:50.535 INFO:teuthology.orchestra.run.smithi062.stderr: 55900K .......... .......... .......... .......... .......... 60% 271M 0s 2024-09-12T00:57:50.535 INFO:teuthology.orchestra.run.smithi062.stderr: 55950K .......... .......... .......... .......... .......... 60% 385M 0s 2024-09-12T00:57:50.535 INFO:teuthology.orchestra.run.smithi062.stderr: 56000K .......... .......... .......... .......... .......... 60% 270M 0s 2024-09-12T00:57:50.536 INFO:teuthology.orchestra.run.smithi062.stderr: 56050K .......... .......... .......... .......... .......... 60% 361M 0s 2024-09-12T00:57:50.536 INFO:teuthology.orchestra.run.smithi062.stderr: 56100K .......... .......... .......... .......... .......... 60% 326M 0s 2024-09-12T00:57:50.536 INFO:teuthology.orchestra.run.smithi062.stderr: 56150K .......... .......... .......... .......... .......... 60% 313M 0s 2024-09-12T00:57:50.536 INFO:teuthology.orchestra.run.smithi062.stderr: 56200K .......... .......... .......... .......... .......... 60% 336M 0s 2024-09-12T00:57:50.536 INFO:teuthology.orchestra.run.smithi062.stderr: 56250K .......... .......... .......... .......... .......... 60% 356M 0s 2024-09-12T00:57:50.536 INFO:teuthology.orchestra.run.smithi062.stderr: 56300K .......... .......... .......... .......... .......... 60% 270M 0s 2024-09-12T00:57:50.536 INFO:teuthology.orchestra.run.smithi062.stderr: 56350K .......... .......... .......... .......... .......... 60% 331M 0s 2024-09-12T00:57:50.536 INFO:teuthology.orchestra.run.smithi062.stderr: 56400K .......... .......... .......... .......... .......... 60% 359M 0s 2024-09-12T00:57:50.536 INFO:teuthology.orchestra.run.smithi062.stderr: 56450K .......... .......... .......... .......... .......... 60% 348M 0s 2024-09-12T00:57:50.536 INFO:teuthology.orchestra.run.smithi062.stderr: 56500K .......... .......... .......... .......... .......... 60% 342M 0s 2024-09-12T00:57:50.536 INFO:teuthology.orchestra.run.smithi062.stderr: 56550K .......... .......... .......... .......... .......... 60% 348M 0s 2024-09-12T00:57:50.536 INFO:teuthology.orchestra.run.smithi062.stderr: 56600K .......... .......... .......... .......... .......... 60% 340M 0s 2024-09-12T00:57:50.537 INFO:teuthology.orchestra.run.smithi062.stderr: 56650K .......... .......... .......... .......... .......... 61% 311M 0s 2024-09-12T00:57:50.537 INFO:teuthology.orchestra.run.smithi062.stderr: 56700K .......... .......... .......... .......... .......... 61% 314M 0s 2024-09-12T00:57:50.537 INFO:teuthology.orchestra.run.smithi062.stderr: 56750K .......... .......... .......... .......... .......... 61% 61.1M 0s 2024-09-12T00:57:50.537 INFO:teuthology.orchestra.run.smithi062.stderr: 56800K .......... .......... .......... .......... .......... 61% 338M 0s 2024-09-12T00:57:50.537 INFO:teuthology.orchestra.run.smithi062.stderr: 56850K .......... .......... .......... .......... .......... 61% 345M 0s 2024-09-12T00:57:50.537 INFO:teuthology.orchestra.run.smithi062.stderr: 56900K .......... .......... .......... .......... .......... 61% 338M 0s 2024-09-12T00:57:50.537 INFO:teuthology.orchestra.run.smithi062.stderr: 56950K .......... .......... .......... .......... .......... 61% 172M 0s 2024-09-12T00:57:50.537 INFO:teuthology.orchestra.run.smithi062.stderr: 57000K .......... .......... .......... .......... .......... 61% 311M 0s 2024-09-12T00:57:50.537 INFO:teuthology.orchestra.run.smithi062.stderr: 57050K .......... .......... .......... .......... .......... 61% 310M 0s 2024-09-12T00:57:50.537 INFO:teuthology.orchestra.run.smithi062.stderr: 57100K .......... .......... .......... .......... .......... 61% 236M 0s 2024-09-12T00:57:50.537 INFO:teuthology.orchestra.run.smithi062.stderr: 57150K .......... .......... .......... .......... .......... 61% 282M 0s 2024-09-12T00:57:50.537 INFO:teuthology.orchestra.run.smithi062.stderr: 57200K .......... .......... .......... .......... .......... 61% 389M 0s 2024-09-12T00:57:50.537 INFO:teuthology.orchestra.run.smithi062.stderr: 57250K .......... .......... .......... .......... .......... 61% 331M 0s 2024-09-12T00:57:50.538 INFO:teuthology.orchestra.run.smithi062.stderr: 57300K .......... .......... .......... .......... .......... 61% 310M 0s 2024-09-12T00:57:50.538 INFO:teuthology.orchestra.run.smithi062.stderr: 57350K .......... .......... .......... .......... .......... 61% 301M 0s 2024-09-12T00:57:50.538 INFO:teuthology.orchestra.run.smithi062.stderr: 57400K .......... .......... .......... .......... .......... 61% 385M 0s 2024-09-12T00:57:50.538 INFO:teuthology.orchestra.run.smithi062.stderr: 57450K .......... .......... .......... .......... .......... 61% 311M 0s 2024-09-12T00:57:50.538 INFO:teuthology.orchestra.run.smithi062.stderr: 57500K .......... .......... .......... .......... .......... 61% 276M 0s 2024-09-12T00:57:50.538 INFO:teuthology.orchestra.run.smithi062.stderr: 57550K .......... .......... .......... .......... .......... 62% 319M 0s 2024-09-12T00:57:50.538 INFO:teuthology.orchestra.run.smithi062.stderr: 57600K .......... .......... .......... .......... .......... 62% 380M 0s 2024-09-12T00:57:50.538 INFO:teuthology.orchestra.run.smithi062.stderr: 57650K .......... .......... .......... .......... .......... 62% 78.2M 0s 2024-09-12T00:57:50.538 INFO:teuthology.orchestra.run.smithi062.stderr: 57700K .......... .......... .......... .......... .......... 62% 239M 0s 2024-09-12T00:57:50.538 INFO:teuthology.orchestra.run.smithi062.stderr: 57750K .......... .......... .......... .......... .......... 62% 87.3M 0s 2024-09-12T00:57:50.538 INFO:teuthology.orchestra.run.smithi062.stderr: 57800K .......... .......... .......... .......... .......... 62% 254M 0s 2024-09-12T00:57:50.538 INFO:teuthology.orchestra.run.smithi062.stderr: 57850K .......... .......... .......... .......... .......... 62% 337M 0s 2024-09-12T00:57:50.539 INFO:teuthology.orchestra.run.smithi062.stderr: 57900K .......... .......... .......... .......... .......... 62% 232M 0s 2024-09-12T00:57:50.539 INFO:teuthology.orchestra.run.smithi062.stderr: 57950K .......... .......... .......... .......... .......... 62% 280M 0s 2024-09-12T00:57:50.539 INFO:teuthology.orchestra.run.smithi062.stderr: 58000K .......... .......... .......... .......... .......... 62% 343M 0s 2024-09-12T00:57:50.539 INFO:teuthology.orchestra.run.smithi062.stderr: 58050K .......... .......... .......... .......... .......... 62% 390M 0s 2024-09-12T00:57:50.539 INFO:teuthology.orchestra.run.smithi062.stderr: 58100K .......... .......... .......... .......... .......... 62% 223M 0s 2024-09-12T00:57:50.539 INFO:teuthology.orchestra.run.smithi062.stderr: 58150K .......... .......... .......... .......... .......... 62% 319M 0s 2024-09-12T00:57:50.539 INFO:teuthology.orchestra.run.smithi062.stderr: 58200K .......... .......... .......... .......... .......... 62% 312M 0s 2024-09-12T00:57:50.539 INFO:teuthology.orchestra.run.smithi062.stderr: 58250K .......... .......... .......... .......... .......... 62% 359M 0s 2024-09-12T00:57:50.539 INFO:teuthology.orchestra.run.smithi062.stderr: 58300K .......... .......... .......... .......... .......... 62% 71.7M 0s 2024-09-12T00:57:50.539 INFO:teuthology.orchestra.run.smithi062.stderr: 58350K .......... .......... .......... .......... .......... 62% 301M 0s 2024-09-12T00:57:50.539 INFO:teuthology.orchestra.run.smithi062.stderr: 58400K .......... .......... .......... .......... .......... 62% 290M 0s 2024-09-12T00:57:50.539 INFO:teuthology.orchestra.run.smithi062.stderr: 58450K .......... .......... .......... .......... .......... 62% 321M 0s 2024-09-12T00:57:50.539 INFO:teuthology.orchestra.run.smithi062.stderr: 58500K .......... .......... .......... .......... .......... 63% 244M 0s 2024-09-12T00:57:50.540 INFO:teuthology.orchestra.run.smithi062.stderr: 58550K .......... .......... .......... .......... .......... 63% 284M 0s 2024-09-12T00:57:50.540 INFO:teuthology.orchestra.run.smithi062.stderr: 58600K .......... .......... .......... .......... .......... 63% 301M 0s 2024-09-12T00:57:50.540 INFO:teuthology.orchestra.run.smithi062.stderr: 58650K .......... .......... .......... .......... .......... 63% 337M 0s 2024-09-12T00:57:50.540 INFO:teuthology.orchestra.run.smithi062.stderr: 58700K .......... .......... .......... .......... .......... 63% 300M 0s 2024-09-12T00:57:50.540 INFO:teuthology.orchestra.run.smithi062.stderr: 58750K .......... .......... .......... .......... .......... 63% 396M 0s 2024-09-12T00:57:50.540 INFO:teuthology.orchestra.run.smithi062.stderr: 58800K .......... .......... .......... .......... .......... 63% 154M 0s 2024-09-12T00:57:50.540 INFO:teuthology.orchestra.run.smithi062.stderr: 58850K .......... .......... .......... .......... .......... 63% 308M 0s 2024-09-12T00:57:50.540 INFO:teuthology.orchestra.run.smithi062.stderr: 58900K .......... .......... .......... .......... .......... 63% 275M 0s 2024-09-12T00:57:50.540 INFO:teuthology.orchestra.run.smithi062.stderr: 58950K .......... .......... .......... .......... .......... 63% 325M 0s 2024-09-12T00:57:50.540 INFO:teuthology.orchestra.run.smithi062.stderr: 59000K .......... .......... .......... .......... .......... 63% 388M 0s 2024-09-12T00:57:50.540 INFO:teuthology.orchestra.run.smithi062.stderr: 59050K .......... .......... .......... .......... .......... 63% 276M 0s 2024-09-12T00:57:50.540 INFO:teuthology.orchestra.run.smithi062.stderr: 59100K .......... .......... .......... .......... .......... 63% 259M 0s 2024-09-12T00:57:50.540 INFO:teuthology.orchestra.run.smithi062.stderr: 59150K .......... .......... .......... .......... .......... 63% 321M 0s 2024-09-12T00:57:50.541 INFO:teuthology.orchestra.run.smithi062.stderr: 59200K .......... .......... .......... .......... .......... 63% 325M 0s 2024-09-12T00:57:50.541 INFO:teuthology.orchestra.run.smithi062.stderr: 59250K .......... .......... .......... .......... .......... 63% 322M 0s 2024-09-12T00:57:50.541 INFO:teuthology.orchestra.run.smithi062.stderr: 59300K .......... .......... .......... .......... .......... 63% 300M 0s 2024-09-12T00:57:50.541 INFO:teuthology.orchestra.run.smithi062.stderr: 59350K .......... .......... .......... .......... .......... 63% 307M 0s 2024-09-12T00:57:50.541 INFO:teuthology.orchestra.run.smithi062.stderr: 59400K .......... .......... .......... .......... .......... 63% 341M 0s 2024-09-12T00:57:50.541 INFO:teuthology.orchestra.run.smithi062.stderr: 59450K .......... .......... .......... .......... .......... 64% 389M 0s 2024-09-12T00:57:50.541 INFO:teuthology.orchestra.run.smithi062.stderr: 59500K .......... .......... .......... .......... .......... 64% 270M 0s 2024-09-12T00:57:50.541 INFO:teuthology.orchestra.run.smithi062.stderr: 59550K .......... .......... .......... .......... .......... 64% 303M 0s 2024-09-12T00:57:50.541 INFO:teuthology.orchestra.run.smithi062.stderr: 59600K .......... .......... .......... .......... .......... 64% 337M 0s 2024-09-12T00:57:50.541 INFO:teuthology.orchestra.run.smithi062.stderr: 59650K .......... .......... .......... .......... .......... 64% 366M 0s 2024-09-12T00:57:50.541 INFO:teuthology.orchestra.run.smithi062.stderr: 59700K .......... .......... .......... .......... .......... 64% 340M 0s 2024-09-12T00:57:50.541 INFO:teuthology.orchestra.run.smithi062.stderr: 59750K .......... .......... .......... .......... .......... 64% 84.6M 0s 2024-09-12T00:57:50.541 INFO:teuthology.orchestra.run.smithi062.stderr: 59800K .......... .......... .......... .......... .......... 64% 319M 0s 2024-09-12T00:57:50.542 INFO:teuthology.orchestra.run.smithi062.stderr: 59850K .......... .......... .......... .......... .......... 64% 310M 0s 2024-09-12T00:57:50.542 INFO:teuthology.orchestra.run.smithi062.stderr: 59900K .......... .......... .......... .......... .......... 64% 148M 0s 2024-09-12T00:57:50.542 INFO:teuthology.orchestra.run.smithi062.stderr: 59950K .......... .......... .......... .......... .......... 64% 206M 0s 2024-09-12T00:57:50.542 INFO:teuthology.orchestra.run.smithi062.stderr: 60000K .......... .......... .......... .......... .......... 64% 269M 0s 2024-09-12T00:57:50.542 INFO:teuthology.orchestra.run.smithi062.stderr: 60050K .......... .......... .......... .......... .......... 64% 325M 0s 2024-09-12T00:57:50.542 INFO:teuthology.orchestra.run.smithi062.stderr: 60100K .......... .......... .......... .......... .......... 64% 287M 0s 2024-09-12T00:57:50.542 INFO:teuthology.orchestra.run.smithi062.stderr: 60150K .......... .......... .......... .......... .......... 64% 293M 0s 2024-09-12T00:57:50.542 INFO:teuthology.orchestra.run.smithi062.stderr: 60200K .......... .......... .......... .......... .......... 64% 334M 0s 2024-09-12T00:57:50.542 INFO:teuthology.orchestra.run.smithi062.stderr: 60250K .......... .......... .......... .......... .......... 64% 188M 0s 2024-09-12T00:57:50.542 INFO:teuthology.orchestra.run.smithi062.stderr: 60300K .......... .......... .......... .......... .......... 64% 303M 0s 2024-09-12T00:57:50.542 INFO:teuthology.orchestra.run.smithi062.stderr: 60350K .......... .......... .......... .......... .......... 65% 314M 0s 2024-09-12T00:57:50.542 INFO:teuthology.orchestra.run.smithi062.stderr: 60400K .......... .......... .......... .......... .......... 65% 329M 0s 2024-09-12T00:57:50.543 INFO:teuthology.orchestra.run.smithi062.stderr: 60450K .......... .......... .......... .......... .......... 65% 325M 0s 2024-09-12T00:57:50.543 INFO:teuthology.orchestra.run.smithi062.stderr: 60500K .......... .......... .......... .......... .......... 65% 343M 0s 2024-09-12T00:57:50.543 INFO:teuthology.orchestra.run.smithi062.stderr: 60550K .......... .......... .......... .......... .......... 65% 385M 0s 2024-09-12T00:57:50.543 INFO:teuthology.orchestra.run.smithi062.stderr: 60600K .......... .......... .......... .......... .......... 65% 394M 0s 2024-09-12T00:57:50.543 INFO:teuthology.orchestra.run.smithi062.stderr: 60650K .......... .......... .......... .......... .......... 65% 129M 0s 2024-09-12T00:57:50.543 INFO:teuthology.orchestra.run.smithi062.stderr: 60700K .......... .......... .......... .......... .......... 65% 267M 0s 2024-09-12T00:57:50.543 INFO:teuthology.orchestra.run.smithi062.stderr: 60750K .......... .......... .......... .......... .......... 65% 335M 0s 2024-09-12T00:57:50.543 INFO:teuthology.orchestra.run.smithi062.stderr: 60800K .......... .......... .......... .......... .......... 65% 99.5M 0s 2024-09-12T00:57:50.543 INFO:teuthology.orchestra.run.smithi062.stderr: 60850K .......... .......... .......... .......... .......... 65% 339M 0s 2024-09-12T00:57:50.543 INFO:teuthology.orchestra.run.smithi062.stderr: 60900K .......... .......... .......... .......... .......... 65% 186M 0s 2024-09-12T00:57:50.543 INFO:teuthology.orchestra.run.smithi062.stderr: 60950K .......... .......... .......... .......... .......... 65% 305M 0s 2024-09-12T00:57:50.543 INFO:teuthology.orchestra.run.smithi062.stderr: 61000K .......... .......... .......... .......... .......... 65% 260M 0s 2024-09-12T00:57:50.544 INFO:teuthology.orchestra.run.smithi062.stderr: 61050K .......... .......... .......... .......... .......... 65% 404M 0s 2024-09-12T00:57:50.544 INFO:teuthology.orchestra.run.smithi062.stderr: 61100K .......... .......... .......... .......... .......... 65% 193M 0s 2024-09-12T00:57:50.544 INFO:teuthology.orchestra.run.smithi062.stderr: 61150K .......... .......... .......... .......... .......... 65% 296M 0s 2024-09-12T00:57:50.544 INFO:teuthology.orchestra.run.smithi062.stderr: 61200K .......... .......... .......... .......... .......... 65% 382M 0s 2024-09-12T00:57:50.544 INFO:teuthology.orchestra.run.smithi062.stderr: 61250K .......... .......... .......... .......... .......... 65% 70.8M 0s 2024-09-12T00:57:50.544 INFO:teuthology.orchestra.run.smithi062.stderr: 61300K .......... .......... .......... .......... .......... 66% 241M 0s 2024-09-12T00:57:50.544 INFO:teuthology.orchestra.run.smithi062.stderr: 61350K .......... .......... .......... .......... .......... 66% 379M 0s 2024-09-12T00:57:50.544 INFO:teuthology.orchestra.run.smithi062.stderr: 61400K .......... .......... .......... .......... .......... 66% 273M 0s 2024-09-12T00:57:50.544 INFO:teuthology.orchestra.run.smithi062.stderr: 61450K .......... .......... .......... .......... .......... 66% 320M 0s 2024-09-12T00:57:50.544 INFO:teuthology.orchestra.run.smithi062.stderr: 61500K .......... .......... .......... .......... .......... 66% 297M 0s 2024-09-12T00:57:50.544 INFO:teuthology.orchestra.run.smithi062.stderr: 61550K .......... .......... .......... .......... .......... 66% 318M 0s 2024-09-12T00:57:50.544 INFO:teuthology.orchestra.run.smithi062.stderr: 61600K .......... .......... .......... .......... .......... 66% 324M 0s 2024-09-12T00:57:50.544 INFO:teuthology.orchestra.run.smithi062.stderr: 61650K .......... .......... .......... .......... .......... 66% 300M 0s 2024-09-12T00:57:50.545 INFO:teuthology.orchestra.run.smithi062.stderr: 61700K .......... .......... .......... .......... .......... 66% 357M 0s 2024-09-12T00:57:50.545 INFO:teuthology.orchestra.run.smithi062.stderr: 61750K .......... .......... .......... .......... .......... 66% 362M 0s 2024-09-12T00:57:50.545 INFO:teuthology.orchestra.run.smithi062.stderr: 61800K .......... .......... .......... .......... .......... 66% 86.6M 0s 2024-09-12T00:57:50.545 INFO:teuthology.orchestra.run.smithi062.stderr: 61850K .......... .......... .......... .......... .......... 66% 326M 0s 2024-09-12T00:57:50.545 INFO:teuthology.orchestra.run.smithi062.stderr: 61900K .......... .......... .......... .......... .......... 66% 372M 0s 2024-09-12T00:57:50.545 INFO:teuthology.orchestra.run.smithi062.stderr: 61950K .......... .......... .......... .......... .......... 66% 314M 0s 2024-09-12T00:57:50.545 INFO:teuthology.orchestra.run.smithi062.stderr: 62000K .......... .......... .......... .......... .......... 66% 364M 0s 2024-09-12T00:57:50.545 INFO:teuthology.orchestra.run.smithi062.stderr: 62050K .......... .......... .......... .......... .......... 66% 364M 0s 2024-09-12T00:57:50.545 INFO:teuthology.orchestra.run.smithi062.stderr: 62100K .......... .......... .......... .......... .......... 66% 387M 0s 2024-09-12T00:57:50.545 INFO:teuthology.orchestra.run.smithi062.stderr: 62150K .......... .......... .......... .......... .......... 66% 343M 0s 2024-09-12T00:57:50.545 INFO:teuthology.orchestra.run.smithi062.stderr: 62200K .......... .......... .......... .......... .......... 67% 357M 0s 2024-09-12T00:57:50.545 INFO:teuthology.orchestra.run.smithi062.stderr: 62250K .......... .......... .......... .......... .......... 67% 384M 0s 2024-09-12T00:57:50.546 INFO:teuthology.orchestra.run.smithi062.stderr: 62300K .......... .......... .......... .......... .......... 67% 377M 0s 2024-09-12T00:57:50.546 INFO:teuthology.orchestra.run.smithi062.stderr: 62350K .......... .......... .......... .......... .......... 67% 310M 0s 2024-09-12T00:57:50.546 INFO:teuthology.orchestra.run.smithi062.stderr: 62400K .......... .......... .......... .......... .......... 67% 367M 0s 2024-09-12T00:57:50.546 INFO:teuthology.orchestra.run.smithi062.stderr: 62450K .......... .......... .......... .......... .......... 67% 247M 0s 2024-09-12T00:57:50.546 INFO:teuthology.orchestra.run.smithi062.stderr: 62500K .......... .......... .......... .......... .......... 67% 293M 0s 2024-09-12T00:57:50.546 INFO:teuthology.orchestra.run.smithi062.stderr: 62550K .......... .......... .......... .......... .......... 67% 292M 0s 2024-09-12T00:57:50.546 INFO:teuthology.orchestra.run.smithi062.stderr: 62600K .......... .......... .......... .......... .......... 67% 378M 0s 2024-09-12T00:57:50.546 INFO:teuthology.orchestra.run.smithi062.stderr: 62650K .......... .......... .......... .......... .......... 67% 61.8M 0s 2024-09-12T00:57:50.546 INFO:teuthology.orchestra.run.smithi062.stderr: 62700K .......... .......... .......... .......... .......... 67% 329M 0s 2024-09-12T00:57:50.546 INFO:teuthology.orchestra.run.smithi062.stderr: 62750K .......... .......... .......... .......... .......... 67% 294M 0s 2024-09-12T00:57:50.547 INFO:teuthology.orchestra.run.smithi062.stderr: 62800K .......... .......... .......... .......... .......... 67% 348M 0s 2024-09-12T00:57:50.547 INFO:teuthology.orchestra.run.smithi062.stderr: 62850K .......... .......... .......... .......... .......... 67% 388M 0s 2024-09-12T00:57:50.547 INFO:teuthology.orchestra.run.smithi062.stderr: 62900K .......... .......... .......... .......... .......... 67% 338M 0s 2024-09-12T00:57:50.547 INFO:teuthology.orchestra.run.smithi062.stderr: 62950K .......... .......... .......... .......... .......... 67% 300M 0s 2024-09-12T00:57:50.547 INFO:teuthology.orchestra.run.smithi062.stderr: 63000K .......... .......... .......... .......... .......... 67% 380M 0s 2024-09-12T00:57:50.547 INFO:teuthology.orchestra.run.smithi062.stderr: 63050K .......... .......... .......... .......... .......... 67% 225M 0s 2024-09-12T00:57:50.547 INFO:teuthology.orchestra.run.smithi062.stderr: 63100K .......... .......... .......... .......... .......... 67% 317M 0s 2024-09-12T00:57:50.547 INFO:teuthology.orchestra.run.smithi062.stderr: 63150K .......... .......... .......... .......... .......... 68% 229M 0s 2024-09-12T00:57:50.547 INFO:teuthology.orchestra.run.smithi062.stderr: 63200K .......... .......... .......... .......... .......... 68% 304M 0s 2024-09-12T00:57:50.547 INFO:teuthology.orchestra.run.smithi062.stderr: 63250K .......... .......... .......... .......... .......... 68% 287M 0s 2024-09-12T00:57:50.547 INFO:teuthology.orchestra.run.smithi062.stderr: 63300K .......... .......... .......... .......... .......... 68% 388M 0s 2024-09-12T00:57:50.547 INFO:teuthology.orchestra.run.smithi062.stderr: 63350K .......... .......... .......... .......... .......... 68% 294M 0s 2024-09-12T00:57:50.547 INFO:teuthology.orchestra.run.smithi062.stderr: 63400K .......... .......... .......... .......... .......... 68% 324M 0s 2024-09-12T00:57:50.548 INFO:teuthology.orchestra.run.smithi062.stderr: 63450K .......... .......... .......... .......... .......... 68% 365M 0s 2024-09-12T00:57:50.548 INFO:teuthology.orchestra.run.smithi062.stderr: 63500K .......... .......... .......... .......... .......... 68% 323M 0s 2024-09-12T00:57:50.548 INFO:teuthology.orchestra.run.smithi062.stderr: 63550K .......... .......... .......... .......... .......... 68% 66.2M 0s 2024-09-12T00:57:50.548 INFO:teuthology.orchestra.run.smithi062.stderr: 63600K .......... .......... .......... .......... .......... 68% 324M 0s 2024-09-12T00:57:50.548 INFO:teuthology.orchestra.run.smithi062.stderr: 63650K .......... .......... .......... .......... .......... 68% 297M 0s 2024-09-12T00:57:50.548 INFO:teuthology.orchestra.run.smithi062.stderr: 63700K .......... .......... .......... .......... .......... 68% 350M 0s 2024-09-12T00:57:50.548 INFO:teuthology.orchestra.run.smithi062.stderr: 63750K .......... .......... .......... .......... .......... 68% 332M 0s 2024-09-12T00:57:50.548 INFO:teuthology.orchestra.run.smithi062.stderr: 63800K .......... .......... .......... .......... .......... 68% 182M 0s 2024-09-12T00:57:50.548 INFO:teuthology.orchestra.run.smithi062.stderr: 63850K .......... .......... .......... .......... .......... 68% 320M 0s 2024-09-12T00:57:50.548 INFO:teuthology.orchestra.run.smithi062.stderr: 63900K .......... .......... .......... .......... .......... 68% 333M 0s 2024-09-12T00:57:50.548 INFO:teuthology.orchestra.run.smithi062.stderr: 63950K .......... .......... .......... .......... .......... 68% 282M 0s 2024-09-12T00:57:50.548 INFO:teuthology.orchestra.run.smithi062.stderr: 64000K .......... .......... .......... .......... .......... 68% 319M 0s 2024-09-12T00:57:50.548 INFO:teuthology.orchestra.run.smithi062.stderr: 64050K .......... .......... .......... .......... .......... 68% 176M 0s 2024-09-12T00:57:50.548 INFO:teuthology.orchestra.run.smithi062.stderr: 64100K .......... .......... .......... .......... .......... 69% 322M 0s 2024-09-12T00:57:50.549 INFO:teuthology.orchestra.run.smithi062.stderr: 64150K .......... .......... .......... .......... .......... 69% 301M 0s 2024-09-12T00:57:50.549 INFO:teuthology.orchestra.run.smithi062.stderr: 64200K .......... .......... .......... .......... .......... 69% 334M 0s 2024-09-12T00:57:50.549 INFO:teuthology.orchestra.run.smithi062.stderr: 64250K .......... .......... .......... .......... .......... 69% 69.9M 0s 2024-09-12T00:57:50.549 INFO:teuthology.orchestra.run.smithi062.stderr: 64300K .......... .......... .......... .......... .......... 69% 289M 0s 2024-09-12T00:57:50.549 INFO:teuthology.orchestra.run.smithi062.stderr: 64350K .......... .......... .......... .......... .......... 69% 263M 0s 2024-09-12T00:57:50.549 INFO:teuthology.orchestra.run.smithi062.stderr: 64400K .......... .......... .......... .......... .......... 69% 310M 0s 2024-09-12T00:57:50.549 INFO:teuthology.orchestra.run.smithi062.stderr: 64450K .......... .......... .......... .......... .......... 69% 304M 0s 2024-09-12T00:57:50.549 INFO:teuthology.orchestra.run.smithi062.stderr: 64500K .......... .......... .......... .......... .......... 69% 303M 0s 2024-09-12T00:57:50.549 INFO:teuthology.orchestra.run.smithi062.stderr: 64550K .......... .......... .......... .......... .......... 69% 291M 0s 2024-09-12T00:57:50.549 INFO:teuthology.orchestra.run.smithi062.stderr: 64600K .......... .......... .......... .......... .......... 69% 295M 0s 2024-09-12T00:57:50.549 INFO:teuthology.orchestra.run.smithi062.stderr: 64650K .......... .......... .......... .......... .......... 69% 285M 0s 2024-09-12T00:57:50.549 INFO:teuthology.orchestra.run.smithi062.stderr: 64700K .......... .......... .......... .......... .......... 69% 344M 0s 2024-09-12T00:57:50.549 INFO:teuthology.orchestra.run.smithi062.stderr: 64750K .......... .......... .......... .......... .......... 69% 91.7M 0s 2024-09-12T00:57:50.550 INFO:teuthology.orchestra.run.smithi062.stderr: 64800K .......... .......... .......... .......... .......... 69% 311M 0s 2024-09-12T00:57:50.550 INFO:teuthology.orchestra.run.smithi062.stderr: 64850K .......... .......... .......... .......... .......... 69% 300M 0s 2024-09-12T00:57:50.550 INFO:teuthology.orchestra.run.smithi062.stderr: 64900K .......... .......... .......... .......... .......... 69% 322M 0s 2024-09-12T00:57:50.550 INFO:teuthology.orchestra.run.smithi062.stderr: 64950K .......... .......... .......... .......... .......... 69% 264M 0s 2024-09-12T00:57:50.550 INFO:teuthology.orchestra.run.smithi062.stderr: 65000K .......... .......... .......... .......... .......... 70% 277M 0s 2024-09-12T00:57:50.550 INFO:teuthology.orchestra.run.smithi062.stderr: 65050K .......... .......... .......... .......... .......... 70% 333M 0s 2024-09-12T00:57:50.550 INFO:teuthology.orchestra.run.smithi062.stderr: 65100K .......... .......... .......... .......... .......... 70% 356M 0s 2024-09-12T00:57:50.550 INFO:teuthology.orchestra.run.smithi062.stderr: 65150K .......... .......... .......... .......... .......... 70% 242M 0s 2024-09-12T00:57:50.550 INFO:teuthology.orchestra.run.smithi062.stderr: 65200K .......... .......... .......... .......... .......... 70% 290M 0s 2024-09-12T00:57:50.550 INFO:teuthology.orchestra.run.smithi062.stderr: 65250K .......... .......... .......... .......... .......... 70% 333M 0s 2024-09-12T00:57:50.550 INFO:teuthology.orchestra.run.smithi062.stderr: 65300K .......... .......... .......... .......... .......... 70% 292M 0s 2024-09-12T00:57:50.550 INFO:teuthology.orchestra.run.smithi062.stderr: 65350K .......... .......... .......... .......... .......... 70% 290M 0s 2024-09-12T00:57:50.550 INFO:teuthology.orchestra.run.smithi062.stderr: 65400K .......... .......... .......... .......... .......... 70% 330M 0s 2024-09-12T00:57:50.551 INFO:teuthology.orchestra.run.smithi062.stderr: 65450K .......... .......... .......... .......... .......... 70% 320M 0s 2024-09-12T00:57:50.551 INFO:teuthology.orchestra.run.smithi062.stderr: 65500K .......... .......... .......... .......... .......... 70% 323M 0s 2024-09-12T00:57:50.551 INFO:teuthology.orchestra.run.smithi062.stderr: 65550K .......... .......... .......... .......... .......... 70% 315M 0s 2024-09-12T00:57:50.551 INFO:teuthology.orchestra.run.smithi062.stderr: 65600K .......... .......... .......... .......... .......... 70% 391M 0s 2024-09-12T00:57:50.551 INFO:teuthology.orchestra.run.smithi062.stderr: 65650K .......... .......... .......... .......... .......... 70% 66.7M 0s 2024-09-12T00:57:50.551 INFO:teuthology.orchestra.run.smithi062.stderr: 65700K .......... .......... .......... .......... .......... 70% 296M 0s 2024-09-12T00:57:50.551 INFO:teuthology.orchestra.run.smithi062.stderr: 65750K .......... .......... .......... .......... .......... 70% 299M 0s 2024-09-12T00:57:50.551 INFO:teuthology.orchestra.run.smithi062.stderr: 65800K .......... .......... .......... .......... .......... 70% 296M 0s 2024-09-12T00:57:50.551 INFO:teuthology.orchestra.run.smithi062.stderr: 65850K .......... .......... .......... .......... .......... 70% 343M 0s 2024-09-12T00:57:50.551 INFO:teuthology.orchestra.run.smithi062.stderr: 65900K .......... .......... .......... .......... .......... 70% 316M 0s 2024-09-12T00:57:50.551 INFO:teuthology.orchestra.run.smithi062.stderr: 65950K .......... .......... .......... .......... .......... 71% 297M 0s 2024-09-12T00:57:50.551 INFO:teuthology.orchestra.run.smithi062.stderr: 66000K .......... .......... .......... .......... .......... 71% 358M 0s 2024-09-12T00:57:50.551 INFO:teuthology.orchestra.run.smithi062.stderr: 66050K .......... .......... .......... .......... .......... 71% 293M 0s 2024-09-12T00:57:50.552 INFO:teuthology.orchestra.run.smithi062.stderr: 66100K .......... .......... .......... .......... .......... 71% 375M 0s 2024-09-12T00:57:50.552 INFO:teuthology.orchestra.run.smithi062.stderr: 66150K .......... .......... .......... .......... .......... 71% 306M 0s 2024-09-12T00:57:50.552 INFO:teuthology.orchestra.run.smithi062.stderr: 66200K .......... .......... .......... .......... .......... 71% 347M 0s 2024-09-12T00:57:50.552 INFO:teuthology.orchestra.run.smithi062.stderr: 66250K .......... .......... .......... .......... .......... 71% 324M 0s 2024-09-12T00:57:50.552 INFO:teuthology.orchestra.run.smithi062.stderr: 66300K .......... .......... .......... .......... .......... 71% 334M 0s 2024-09-12T00:57:50.552 INFO:teuthology.orchestra.run.smithi062.stderr: 66350K .......... .......... .......... .......... .......... 71% 272M 0s 2024-09-12T00:57:50.552 INFO:teuthology.orchestra.run.smithi062.stderr: 66400K .......... .......... .......... .......... .......... 71% 384M 0s 2024-09-12T00:57:50.552 INFO:teuthology.orchestra.run.smithi062.stderr: 66450K .......... .......... .......... .......... .......... 71% 343M 0s 2024-09-12T00:57:50.552 INFO:teuthology.orchestra.run.smithi062.stderr: 66500K .......... .......... .......... .......... .......... 71% 302M 0s 2024-09-12T00:57:50.552 INFO:teuthology.orchestra.run.smithi062.stderr: 66550K .......... .......... .......... .......... .......... 71% 326M 0s 2024-09-12T00:57:50.552 INFO:teuthology.orchestra.run.smithi062.stderr: 66600K .......... .......... .......... .......... .......... 71% 101M 0s 2024-09-12T00:57:50.552 INFO:teuthology.orchestra.run.smithi062.stderr: 66650K .......... .......... .......... .......... .......... 71% 19.1M 0s 2024-09-12T00:57:50.552 INFO:teuthology.orchestra.run.smithi062.stderr: 66700K .......... .......... .......... .......... .......... 71% 51.8M 0s 2024-09-12T00:57:50.553 INFO:teuthology.orchestra.run.smithi062.stderr: 66750K .......... .......... .......... .......... .......... 71% 152M 0s 2024-09-12T00:57:50.553 INFO:teuthology.orchestra.run.smithi062.stderr: 66800K .......... .......... .......... .......... .......... 71% 274M 0s 2024-09-12T00:57:50.553 INFO:teuthology.orchestra.run.smithi062.stderr: 66850K .......... .......... .......... .......... .......... 72% 281M 0s 2024-09-12T00:57:50.553 INFO:teuthology.orchestra.run.smithi062.stderr: 66900K .......... .......... .......... .......... .......... 72% 287M 0s 2024-09-12T00:57:50.553 INFO:teuthology.orchestra.run.smithi062.stderr: 66950K .......... .......... .......... .......... .......... 72% 283M 0s 2024-09-12T00:57:50.553 INFO:teuthology.orchestra.run.smithi062.stderr: 67000K .......... .......... .......... .......... .......... 72% 330M 0s 2024-09-12T00:57:50.553 INFO:teuthology.orchestra.run.smithi062.stderr: 67050K .......... .......... .......... .......... .......... 72% 306M 0s 2024-09-12T00:57:50.553 INFO:teuthology.orchestra.run.smithi062.stderr: 67100K .......... .......... .......... .......... .......... 72% 313M 0s 2024-09-12T00:57:50.553 INFO:teuthology.orchestra.run.smithi062.stderr: 67150K .......... .......... .......... .......... .......... 72% 254M 0s 2024-09-12T00:57:50.553 INFO:teuthology.orchestra.run.smithi062.stderr: 67200K .......... .......... .......... .......... .......... 72% 334M 0s 2024-09-12T00:57:50.553 INFO:teuthology.orchestra.run.smithi062.stderr: 67250K .......... .......... .......... .......... .......... 72% 336M 0s 2024-09-12T00:57:50.553 INFO:teuthology.orchestra.run.smithi062.stderr: 67300K .......... .......... .......... .......... .......... 72% 336M 0s 2024-09-12T00:57:50.553 INFO:teuthology.orchestra.run.smithi062.stderr: 67350K .......... .......... .......... .......... .......... 72% 296M 0s 2024-09-12T00:57:50.554 INFO:teuthology.orchestra.run.smithi062.stderr: 67400K .......... .......... .......... .......... .......... 72% 315M 0s 2024-09-12T00:57:50.554 INFO:teuthology.orchestra.run.smithi062.stderr: 67450K .......... .......... .......... .......... .......... 72% 346M 0s 2024-09-12T00:57:50.554 INFO:teuthology.orchestra.run.smithi062.stderr: 67500K .......... .......... .......... .......... .......... 72% 316M 0s 2024-09-12T00:57:50.554 INFO:teuthology.orchestra.run.smithi062.stderr: 67550K .......... .......... .......... .......... .......... 72% 265M 0s 2024-09-12T00:57:50.554 INFO:teuthology.orchestra.run.smithi062.stderr: 67600K .......... .......... .......... .......... .......... 72% 344M 0s 2024-09-12T00:57:50.554 INFO:teuthology.orchestra.run.smithi062.stderr: 67650K .......... .......... .......... .......... .......... 72% 339M 0s 2024-09-12T00:57:50.554 INFO:teuthology.orchestra.run.smithi062.stderr: 67700K .......... .......... .......... .......... .......... 72% 343M 0s 2024-09-12T00:57:50.554 INFO:teuthology.orchestra.run.smithi062.stderr: 67750K .......... .......... .......... .......... .......... 72% 282M 0s 2024-09-12T00:57:50.554 INFO:teuthology.orchestra.run.smithi062.stderr: 67800K .......... .......... .......... .......... .......... 73% 336M 0s 2024-09-12T00:57:50.554 INFO:teuthology.orchestra.run.smithi062.stderr: 67850K .......... .......... .......... .......... .......... 73% 341M 0s 2024-09-12T00:57:50.554 INFO:teuthology.orchestra.run.smithi062.stderr: 67900K .......... .......... .......... .......... .......... 73% 371M 0s 2024-09-12T00:57:50.554 INFO:teuthology.orchestra.run.smithi062.stderr: 67950K .......... .......... .......... .......... .......... 73% 322M 0s 2024-09-12T00:57:50.554 INFO:teuthology.orchestra.run.smithi062.stderr: 68000K .......... .......... .......... .......... .......... 73% 379M 0s 2024-09-12T00:57:50.555 INFO:teuthology.orchestra.run.smithi062.stderr: 68050K .......... .......... .......... .......... .......... 73% 401M 0s 2024-09-12T00:57:50.555 INFO:teuthology.orchestra.run.smithi062.stderr: 68100K .......... .......... .......... .......... .......... 73% 379M 0s 2024-09-12T00:57:50.555 INFO:teuthology.orchestra.run.smithi062.stderr: 68150K .......... .......... .......... .......... .......... 73% 362M 0s 2024-09-12T00:57:50.555 INFO:teuthology.orchestra.run.smithi062.stderr: 68200K .......... .......... .......... .......... .......... 73% 396M 0s 2024-09-12T00:57:50.555 INFO:teuthology.orchestra.run.smithi062.stderr: 68250K .......... .......... .......... .......... .......... 73% 358M 0s 2024-09-12T00:57:50.555 INFO:teuthology.orchestra.run.smithi062.stderr: 68300K .......... .......... .......... .......... .......... 73% 290M 0s 2024-09-12T00:57:50.555 INFO:teuthology.orchestra.run.smithi062.stderr: 68350K .......... .......... .......... .......... .......... 73% 265M 0s 2024-09-12T00:57:50.555 INFO:teuthology.orchestra.run.smithi062.stderr: 68400K .......... .......... .......... .......... .......... 73% 348M 0s 2024-09-12T00:57:50.555 INFO:teuthology.orchestra.run.smithi062.stderr: 68450K .......... .......... .......... .......... .......... 73% 300M 0s 2024-09-12T00:57:50.555 INFO:teuthology.orchestra.run.smithi062.stderr: 68500K .......... .......... .......... .......... .......... 73% 316M 0s 2024-09-12T00:57:50.555 INFO:teuthology.orchestra.run.smithi062.stderr: 68550K .......... .......... .......... .......... .......... 73% 334M 0s 2024-09-12T00:57:50.555 INFO:teuthology.orchestra.run.smithi062.stderr: 68600K .......... .......... .......... .......... .......... 73% 301M 0s 2024-09-12T00:57:50.555 INFO:teuthology.orchestra.run.smithi062.stderr: 68650K .......... .......... .......... .......... .......... 73% 297M 0s 2024-09-12T00:57:50.556 INFO:teuthology.orchestra.run.smithi062.stderr: 68700K .......... .......... .......... .......... .......... 74% 378M 0s 2024-09-12T00:57:50.556 INFO:teuthology.orchestra.run.smithi062.stderr: 68750K .......... .......... .......... .......... .......... 74% 226M 0s 2024-09-12T00:57:50.556 INFO:teuthology.orchestra.run.smithi062.stderr: 68800K .......... .......... .......... .......... .......... 74% 312M 0s 2024-09-12T00:57:50.556 INFO:teuthology.orchestra.run.smithi062.stderr: 68850K .......... .......... .......... .......... .......... 74% 281M 0s 2024-09-12T00:57:50.556 INFO:teuthology.orchestra.run.smithi062.stderr: 68900K .......... .......... .......... .......... .......... 74% 301M 0s 2024-09-12T00:57:50.556 INFO:teuthology.orchestra.run.smithi062.stderr: 68950K .......... .......... .......... .......... .......... 74% 294M 0s 2024-09-12T00:57:50.556 INFO:teuthology.orchestra.run.smithi062.stderr: 69000K .......... .......... .......... .......... .......... 74% 362M 0s 2024-09-12T00:57:50.556 INFO:teuthology.orchestra.run.smithi062.stderr: 69050K .......... .......... .......... .......... .......... 74% 266M 0s 2024-09-12T00:57:50.556 INFO:teuthology.orchestra.run.smithi062.stderr: 69100K .......... .......... .......... .......... .......... 74% 319M 0s 2024-09-12T00:57:50.556 INFO:teuthology.orchestra.run.smithi062.stderr: 69150K .......... .......... .......... .......... .......... 74% 273M 0s 2024-09-12T00:57:50.556 INFO:teuthology.orchestra.run.smithi062.stderr: 69200K .......... .......... .......... .......... .......... 74% 391M 0s 2024-09-12T00:57:50.556 INFO:teuthology.orchestra.run.smithi062.stderr: 69250K .......... .......... .......... .......... .......... 74% 294M 0s 2024-09-12T00:57:50.556 INFO:teuthology.orchestra.run.smithi062.stderr: 69300K .......... .......... .......... .......... .......... 74% 323M 0s 2024-09-12T00:57:50.557 INFO:teuthology.orchestra.run.smithi062.stderr: 69350K .......... .......... .......... .......... .......... 74% 288M 0s 2024-09-12T00:57:50.557 INFO:teuthology.orchestra.run.smithi062.stderr: 69400K .......... .......... .......... .......... .......... 74% 393M 0s 2024-09-12T00:57:50.557 INFO:teuthology.orchestra.run.smithi062.stderr: 69450K .......... .......... .......... .......... .......... 74% 403M 0s 2024-09-12T00:57:50.557 INFO:teuthology.orchestra.run.smithi062.stderr: 69500K .......... .......... .......... .......... .......... 74% 396M 0s 2024-09-12T00:57:50.557 INFO:teuthology.orchestra.run.smithi062.stderr: 69550K .......... .......... .......... .......... .......... 74% 333M 0s 2024-09-12T00:57:50.557 INFO:teuthology.orchestra.run.smithi062.stderr: 69600K .......... .......... .......... .......... .......... 74% 406M 0s 2024-09-12T00:57:50.557 INFO:teuthology.orchestra.run.smithi062.stderr: 69650K .......... .......... .......... .......... .......... 75% 394M 0s 2024-09-12T00:57:50.557 INFO:teuthology.orchestra.run.smithi062.stderr: 69700K .......... .......... .......... .......... .......... 75% 340M 0s 2024-09-12T00:57:50.557 INFO:teuthology.orchestra.run.smithi062.stderr: 69750K .......... .......... .......... .......... .......... 75% 15.7M 0s 2024-09-12T00:57:50.557 INFO:teuthology.orchestra.run.smithi062.stderr: 69800K .......... .......... .......... .......... .......... 75% 66.5M 0s 2024-09-12T00:57:50.557 INFO:teuthology.orchestra.run.smithi062.stderr: 69850K .......... .......... .......... .......... .......... 75% 301M 0s 2024-09-12T00:57:50.557 INFO:teuthology.orchestra.run.smithi062.stderr: 69900K .......... .......... .......... .......... .......... 75% 278M 0s 2024-09-12T00:57:50.557 INFO:teuthology.orchestra.run.smithi062.stderr: 69950K .......... .......... .......... .......... .......... 75% 233M 0s 2024-09-12T00:57:50.558 INFO:teuthology.orchestra.run.smithi062.stderr: 70000K .......... .......... .......... .......... .......... 75% 265M 0s 2024-09-12T00:57:50.558 INFO:teuthology.orchestra.run.smithi062.stderr: 70050K .......... .......... .......... .......... .......... 75% 339M 0s 2024-09-12T00:57:50.558 INFO:teuthology.orchestra.run.smithi062.stderr: 70100K .......... .......... .......... .......... .......... 75% 315M 0s 2024-09-12T00:57:50.558 INFO:teuthology.orchestra.run.smithi062.stderr: 70150K .......... .......... .......... .......... .......... 75% 251M 0s 2024-09-12T00:57:50.558 INFO:teuthology.orchestra.run.smithi062.stderr: 70200K .......... .......... .......... .......... .......... 75% 304M 0s 2024-09-12T00:57:50.558 INFO:teuthology.orchestra.run.smithi062.stderr: 70250K .......... .......... .......... .......... .......... 75% 319M 0s 2024-09-12T00:57:50.558 INFO:teuthology.orchestra.run.smithi062.stderr: 70300K .......... .......... .......... .......... .......... 75% 294M 0s 2024-09-12T00:57:50.558 INFO:teuthology.orchestra.run.smithi062.stderr: 70350K .......... .......... .......... .......... .......... 75% 233M 0s 2024-09-12T00:57:50.558 INFO:teuthology.orchestra.run.smithi062.stderr: 70400K .......... .......... .......... .......... .......... 75% 344M 0s 2024-09-12T00:57:50.558 INFO:teuthology.orchestra.run.smithi062.stderr: 70450K .......... .......... .......... .......... .......... 75% 289M 0s 2024-09-12T00:57:50.558 INFO:teuthology.orchestra.run.smithi062.stderr: 70500K .......... .......... .......... .......... .......... 75% 353M 0s 2024-09-12T00:57:50.558 INFO:teuthology.orchestra.run.smithi062.stderr: 70550K .......... .......... .......... .......... .......... 75% 350M 0s 2024-09-12T00:57:50.558 INFO:teuthology.orchestra.run.smithi062.stderr: 70600K .......... .......... .......... .......... .......... 76% 385M 0s 2024-09-12T00:57:50.559 INFO:teuthology.orchestra.run.smithi062.stderr: 70650K .......... .......... .......... .......... .......... 76% 400M 0s 2024-09-12T00:57:50.559 INFO:teuthology.orchestra.run.smithi062.stderr: 70700K .......... .......... .......... .......... .......... 76% 370M 0s 2024-09-12T00:57:50.559 INFO:teuthology.orchestra.run.smithi062.stderr: 70750K .......... .......... .......... .......... .......... 76% 325M 0s 2024-09-12T00:57:50.559 INFO:teuthology.orchestra.run.smithi062.stderr: 70800K .......... .......... .......... .......... .......... 76% 385M 0s 2024-09-12T00:57:50.559 INFO:teuthology.orchestra.run.smithi062.stderr: 70850K .......... .......... .......... .......... .......... 76% 250M 0s 2024-09-12T00:57:50.559 INFO:teuthology.orchestra.run.smithi062.stderr: 70900K .......... .......... .......... .......... .......... 76% 287M 0s 2024-09-12T00:57:50.559 INFO:teuthology.orchestra.run.smithi062.stderr: 70950K .......... .......... .......... .......... .......... 76% 303M 0s 2024-09-12T00:57:50.559 INFO:teuthology.orchestra.run.smithi062.stderr: 71000K .......... .......... .......... .......... .......... 76% 263M 0s 2024-09-12T00:57:50.559 INFO:teuthology.orchestra.run.smithi062.stderr: 71050K .......... .......... .......... .......... .......... 76% 301M 0s 2024-09-12T00:57:50.559 INFO:teuthology.orchestra.run.smithi062.stderr: 71100K .......... .......... .......... .......... .......... 76% 314M 0s 2024-09-12T00:57:50.559 INFO:teuthology.orchestra.run.smithi062.stderr: 71150K .......... .......... .......... .......... .......... 76% 235M 0s 2024-09-12T00:57:50.559 INFO:teuthology.orchestra.run.smithi062.stderr: 71200K .......... .......... .......... .......... .......... 76% 310M 0s 2024-09-12T00:57:50.559 INFO:teuthology.orchestra.run.smithi062.stderr: 71250K .......... .......... .......... .......... .......... 76% 310M 0s 2024-09-12T00:57:50.560 INFO:teuthology.orchestra.run.smithi062.stderr: 71300K .......... .......... .......... .......... .......... 76% 294M 0s 2024-09-12T00:57:50.560 INFO:teuthology.orchestra.run.smithi062.stderr: 71350K .......... .......... .......... .......... .......... 76% 360M 0s 2024-09-12T00:57:50.560 INFO:teuthology.orchestra.run.smithi062.stderr: 71400K .......... .......... .......... .......... .......... 76% 343M 0s 2024-09-12T00:57:50.560 INFO:teuthology.orchestra.run.smithi062.stderr: 71450K .......... .......... .......... .......... .......... 76% 283M 0s 2024-09-12T00:57:50.560 INFO:teuthology.orchestra.run.smithi062.stderr: 71500K .......... .......... .......... .......... .......... 77% 294M 0s 2024-09-12T00:57:50.560 INFO:teuthology.orchestra.run.smithi062.stderr: 71550K .......... .......... .......... .......... .......... 77% 266M 0s 2024-09-12T00:57:50.560 INFO:teuthology.orchestra.run.smithi062.stderr: 71600K .......... .......... .......... .......... .......... 77% 290M 0s 2024-09-12T00:57:50.560 INFO:teuthology.orchestra.run.smithi062.stderr: 71650K .......... .......... .......... .......... .......... 77% 316M 0s 2024-09-12T00:57:50.560 INFO:teuthology.orchestra.run.smithi062.stderr: 71700K .......... .......... .......... .......... .......... 77% 376M 0s 2024-09-12T00:57:50.560 INFO:teuthology.orchestra.run.smithi062.stderr: 71750K .......... .......... .......... .......... .......... 77% 361M 0s 2024-09-12T00:57:50.560 INFO:teuthology.orchestra.run.smithi062.stderr: 71800K .......... .......... .......... .......... .......... 77% 305M 0s 2024-09-12T00:57:50.560 INFO:teuthology.orchestra.run.smithi062.stderr: 71850K .......... .......... .......... .......... .......... 77% 384M 0s 2024-09-12T00:57:50.560 INFO:teuthology.orchestra.run.smithi062.stderr: 71900K .......... .......... .......... .......... .......... 77% 252M 0s 2024-09-12T00:57:50.561 INFO:teuthology.orchestra.run.smithi062.stderr: 71950K .......... .......... .......... .......... .......... 77% 346M 0s 2024-09-12T00:57:50.561 INFO:teuthology.orchestra.run.smithi062.stderr: 72000K .......... .......... .......... .......... .......... 77% 386M 0s 2024-09-12T00:57:50.561 INFO:teuthology.orchestra.run.smithi062.stderr: 72050K .......... .......... .......... .......... .......... 77% 390M 0s 2024-09-12T00:57:50.561 INFO:teuthology.orchestra.run.smithi062.stderr: 72100K .......... .......... .......... .......... .......... 77% 324M 0s 2024-09-12T00:57:50.561 INFO:teuthology.orchestra.run.smithi062.stderr: 72150K .......... .......... .......... .......... .......... 77% 386M 0s 2024-09-12T00:57:50.561 INFO:teuthology.orchestra.run.smithi062.stderr: 72200K .......... .......... .......... .......... .......... 77% 391M 0s 2024-09-12T00:57:50.561 INFO:teuthology.orchestra.run.smithi062.stderr: 72250K .......... .......... .......... .......... .......... 77% 320M 0s 2024-09-12T00:57:50.561 INFO:teuthology.orchestra.run.smithi062.stderr: 72300K .......... .......... .......... .......... .......... 77% 260M 0s 2024-09-12T00:57:50.561 INFO:teuthology.orchestra.run.smithi062.stderr: 72350K .......... .......... .......... .......... .......... 77% 301M 0s 2024-09-12T00:57:50.561 INFO:teuthology.orchestra.run.smithi062.stderr: 72400K .......... .......... .......... .......... .......... 77% 237M 0s 2024-09-12T00:57:50.561 INFO:teuthology.orchestra.run.smithi062.stderr: 72450K .......... .......... .......... .......... .......... 78% 380M 0s 2024-09-12T00:57:50.561 INFO:teuthology.orchestra.run.smithi062.stderr: 72500K .......... .......... .......... .......... .......... 78% 346M 0s 2024-09-12T00:57:50.561 INFO:teuthology.orchestra.run.smithi062.stderr: 72550K .......... .......... .......... .......... .......... 78% 396M 0s 2024-09-12T00:57:50.562 INFO:teuthology.orchestra.run.smithi062.stderr: 72600K .......... .......... .......... .......... .......... 78% 393M 0s 2024-09-12T00:57:50.562 INFO:teuthology.orchestra.run.smithi062.stderr: 72650K .......... .......... .......... .......... .......... 78% 391M 0s 2024-09-12T00:57:50.562 INFO:teuthology.orchestra.run.smithi062.stderr: 72700K .......... .......... .......... .......... .......... 78% 325M 0s 2024-09-12T00:57:50.562 INFO:teuthology.orchestra.run.smithi062.stderr: 72750K .......... .......... .......... .......... .......... 78% 395M 0s 2024-09-12T00:57:50.562 INFO:teuthology.orchestra.run.smithi062.stderr: 72800K .......... .......... .......... .......... .......... 78% 27.6M 0s 2024-09-12T00:57:50.562 INFO:teuthology.orchestra.run.smithi062.stderr: 72850K .......... .......... .......... .......... .......... 78% 78.6M 0s 2024-09-12T00:57:50.562 INFO:teuthology.orchestra.run.smithi062.stderr: 72900K .......... .......... .......... .......... .......... 78% 249M 0s 2024-09-12T00:57:50.562 INFO:teuthology.orchestra.run.smithi062.stderr: 72950K .......... .......... .......... .......... .......... 78% 250M 0s 2024-09-12T00:57:50.562 INFO:teuthology.orchestra.run.smithi062.stderr: 73000K .......... .......... .......... .......... .......... 78% 74.1M 0s 2024-09-12T00:57:50.562 INFO:teuthology.orchestra.run.smithi062.stderr: 73050K .......... .......... .......... .......... .......... 78% 300M 0s 2024-09-12T00:57:50.562 INFO:teuthology.orchestra.run.smithi062.stderr: 73100K .......... .......... .......... .......... .......... 78% 242M 0s 2024-09-12T00:57:50.562 INFO:teuthology.orchestra.run.smithi062.stderr: 73150K .......... .......... .......... .......... .......... 78% 289M 0s 2024-09-12T00:57:50.562 INFO:teuthology.orchestra.run.smithi062.stderr: 73200K .......... .......... .......... .......... .......... 78% 307M 0s 2024-09-12T00:57:50.562 INFO:teuthology.orchestra.run.smithi062.stderr: 73250K .......... .......... .......... .......... .......... 78% 282M 0s 2024-09-12T00:57:50.563 INFO:teuthology.orchestra.run.smithi062.stderr: 73300K .......... .......... .......... .......... .......... 78% 294M 0s 2024-09-12T00:57:50.563 INFO:teuthology.orchestra.run.smithi062.stderr: 73350K .......... .......... .......... .......... .......... 79% 316M 0s 2024-09-12T00:57:50.563 INFO:teuthology.orchestra.run.smithi062.stderr: 73400K .......... .......... .......... .......... .......... 79% 373M 0s 2024-09-12T00:57:50.563 INFO:teuthology.orchestra.run.smithi062.stderr: 73450K .......... .......... .......... .......... .......... 79% 368M 0s 2024-09-12T00:57:50.563 INFO:teuthology.orchestra.run.smithi062.stderr: 73500K .......... .......... .......... .......... .......... 79% 238M 0s 2024-09-12T00:57:50.563 INFO:teuthology.orchestra.run.smithi062.stderr: 73550K .......... .......... .......... .......... .......... 79% 345M 0s 2024-09-12T00:57:50.563 INFO:teuthology.orchestra.run.smithi062.stderr: 73600K .......... .......... .......... .......... .......... 79% 390M 0s 2024-09-12T00:57:50.563 INFO:teuthology.orchestra.run.smithi062.stderr: 73650K .......... .......... .......... .......... .......... 79% 392M 0s 2024-09-12T00:57:50.563 INFO:teuthology.orchestra.run.smithi062.stderr: 73700K .......... .......... .......... .......... .......... 79% 346M 0s 2024-09-12T00:57:50.563 INFO:teuthology.orchestra.run.smithi062.stderr: 73750K .......... .......... .......... .......... .......... 79% 260M 0s 2024-09-12T00:57:50.563 INFO:teuthology.orchestra.run.smithi062.stderr: 73800K .......... .......... .......... .......... .......... 79% 289M 0s 2024-09-12T00:57:50.563 INFO:teuthology.orchestra.run.smithi062.stderr: 73850K .......... .......... .......... .......... .......... 79% 306M 0s 2024-09-12T00:57:50.563 INFO:teuthology.orchestra.run.smithi062.stderr: 73900K .......... .......... .......... .......... .......... 79% 280M 0s 2024-09-12T00:57:50.564 INFO:teuthology.orchestra.run.smithi062.stderr: 73950K .......... .......... .......... .......... .......... 79% 305M 0s 2024-09-12T00:57:50.564 INFO:teuthology.orchestra.run.smithi062.stderr: 74000K .......... .......... .......... .......... .......... 79% 298M 0s 2024-09-12T00:57:50.564 INFO:teuthology.orchestra.run.smithi062.stderr: 74050K .......... .......... .......... .......... .......... 79% 286M 0s 2024-09-12T00:57:50.564 INFO:teuthology.orchestra.run.smithi062.stderr: 74100K .......... .......... .......... .......... .......... 79% 335M 0s 2024-09-12T00:57:50.564 INFO:teuthology.orchestra.run.smithi062.stderr: 74150K .......... .......... .......... .......... .......... 79% 299M 0s 2024-09-12T00:57:50.564 INFO:teuthology.orchestra.run.smithi062.stderr: 74200K .......... .......... .......... .......... .......... 79% 303M 0s 2024-09-12T00:57:50.564 INFO:teuthology.orchestra.run.smithi062.stderr: 74250K .......... .......... .......... .......... .......... 79% 327M 0s 2024-09-12T00:57:50.564 INFO:teuthology.orchestra.run.smithi062.stderr: 74300K .......... .......... .......... .......... .......... 80% 252M 0s 2024-09-12T00:57:50.564 INFO:teuthology.orchestra.run.smithi062.stderr: 74350K .......... .......... .......... .......... .......... 80% 290M 0s 2024-09-12T00:57:50.564 INFO:teuthology.orchestra.run.smithi062.stderr: 74400K .......... .......... .......... .......... .......... 80% 296M 0s 2024-09-12T00:57:50.564 INFO:teuthology.orchestra.run.smithi062.stderr: 74450K .......... .......... .......... .......... .......... 80% 304M 0s 2024-09-12T00:57:50.564 INFO:teuthology.orchestra.run.smithi062.stderr: 74500K .......... .......... .......... .......... .......... 80% 281M 0s 2024-09-12T00:57:50.564 INFO:teuthology.orchestra.run.smithi062.stderr: 74550K .......... .......... .......... .......... .......... 80% 330M 0s 2024-09-12T00:57:50.565 INFO:teuthology.orchestra.run.smithi062.stderr: 74600K .......... .......... .......... .......... .......... 80% 345M 0s 2024-09-12T00:57:50.565 INFO:teuthology.orchestra.run.smithi062.stderr: 74650K .......... .......... .......... .......... .......... 80% 303M 0s 2024-09-12T00:57:50.565 INFO:teuthology.orchestra.run.smithi062.stderr: 74700K .......... .......... .......... .......... .......... 80% 323M 0s 2024-09-12T00:57:50.565 INFO:teuthology.orchestra.run.smithi062.stderr: 74750K .......... .......... .......... .......... .......... 80% 280M 0s 2024-09-12T00:57:50.565 INFO:teuthology.orchestra.run.smithi062.stderr: 74800K .......... .......... .......... .......... .......... 80% 265M 0s 2024-09-12T00:57:50.565 INFO:teuthology.orchestra.run.smithi062.stderr: 74850K .......... .......... .......... .......... .......... 80% 378M 0s 2024-09-12T00:57:50.565 INFO:teuthology.orchestra.run.smithi062.stderr: 74900K .......... .......... .......... .......... .......... 80% 355M 0s 2024-09-12T00:57:50.565 INFO:teuthology.orchestra.run.smithi062.stderr: 74950K .......... .......... .......... .......... .......... 80% 387M 0s 2024-09-12T00:57:50.565 INFO:teuthology.orchestra.run.smithi062.stderr: 75000K .......... .......... .......... .......... .......... 80% 392M 0s 2024-09-12T00:57:50.565 INFO:teuthology.orchestra.run.smithi062.stderr: 75050K .......... .......... .......... .......... .......... 80% 393M 0s 2024-09-12T00:57:50.565 INFO:teuthology.orchestra.run.smithi062.stderr: 75100K .......... .......... .......... .......... .......... 80% 300M 0s 2024-09-12T00:57:50.565 INFO:teuthology.orchestra.run.smithi062.stderr: 75150K .......... .......... .......... .......... .......... 80% 294M 0s 2024-09-12T00:57:50.565 INFO:teuthology.orchestra.run.smithi062.stderr: 75200K .......... .......... .......... .......... .......... 81% 322M 0s 2024-09-12T00:57:50.565 INFO:teuthology.orchestra.run.smithi062.stderr: 75250K .......... .......... .......... .......... .......... 81% 303M 0s 2024-09-12T00:57:50.566 INFO:teuthology.orchestra.run.smithi062.stderr: 75300K .......... .......... .......... .......... .......... 81% 296M 0s 2024-09-12T00:57:50.566 INFO:teuthology.orchestra.run.smithi062.stderr: 75350K .......... .......... .......... .......... .......... 81% 318M 0s 2024-09-12T00:57:50.566 INFO:teuthology.orchestra.run.smithi062.stderr: 75400K .......... .......... .......... .......... .......... 81% 334M 0s 2024-09-12T00:57:50.566 INFO:teuthology.orchestra.run.smithi062.stderr: 75450K .......... .......... .......... .......... .......... 81% 368M 0s 2024-09-12T00:57:50.566 INFO:teuthology.orchestra.run.smithi062.stderr: 75500K .......... .......... .......... .......... .......... 81% 322M 0s 2024-09-12T00:57:50.566 INFO:teuthology.orchestra.run.smithi062.stderr: 75550K .......... .......... .......... .......... .......... 81% 389M 0s 2024-09-12T00:57:50.566 INFO:teuthology.orchestra.run.smithi062.stderr: 75600K .......... .......... .......... .......... .......... 81% 22.0M 0s 2024-09-12T00:57:50.566 INFO:teuthology.orchestra.run.smithi062.stderr: 75650K .......... .......... .......... .......... .......... 81% 298M 0s 2024-09-12T00:57:50.566 INFO:teuthology.orchestra.run.smithi062.stderr: 75700K .......... .......... .......... .......... .......... 81% 304M 0s 2024-09-12T00:57:50.566 INFO:teuthology.orchestra.run.smithi062.stderr: 75750K .......... .......... .......... .......... .......... 81% 322M 0s 2024-09-12T00:57:50.566 INFO:teuthology.orchestra.run.smithi062.stderr: 75800K .......... .......... .......... .......... .......... 81% 384M 0s 2024-09-12T00:57:50.566 INFO:teuthology.orchestra.run.smithi062.stderr: 75850K .......... .......... .......... .......... .......... 81% 329M 0s 2024-09-12T00:57:50.566 INFO:teuthology.orchestra.run.smithi062.stderr: 75900K .......... .......... .......... .......... .......... 81% 298M 0s 2024-09-12T00:57:50.567 INFO:teuthology.orchestra.run.smithi062.stderr: 75950K .......... .......... .......... .......... .......... 81% 396M 0s 2024-09-12T00:57:50.567 INFO:teuthology.orchestra.run.smithi062.stderr: 76000K .......... .......... .......... .......... .......... 81% 392M 0s 2024-09-12T00:57:50.567 INFO:teuthology.orchestra.run.smithi062.stderr: 76050K .......... .......... .......... .......... .......... 81% 236M 0s 2024-09-12T00:57:50.567 INFO:teuthology.orchestra.run.smithi062.stderr: 76100K .......... .......... .......... .......... .......... 81% 171M 0s 2024-09-12T00:57:50.567 INFO:teuthology.orchestra.run.smithi062.stderr: 76150K .......... .......... .......... .......... .......... 82% 284M 0s 2024-09-12T00:57:50.567 INFO:teuthology.orchestra.run.smithi062.stderr: 76200K .......... .......... .......... .......... .......... 82% 317M 0s 2024-09-12T00:57:50.567 INFO:teuthology.orchestra.run.smithi062.stderr: 76250K .......... .......... .......... .......... .......... 82% 361M 0s 2024-09-12T00:57:50.567 INFO:teuthology.orchestra.run.smithi062.stderr: 76300K .......... .......... .......... .......... .......... 82% 286M 0s 2024-09-12T00:57:50.567 INFO:teuthology.orchestra.run.smithi062.stderr: 76350K .......... .......... .......... .......... .......... 82% 299M 0s 2024-09-12T00:57:50.567 INFO:teuthology.orchestra.run.smithi062.stderr: 76400K .......... .......... .......... .......... .......... 82% 176M 0s 2024-09-12T00:57:50.567 INFO:teuthology.orchestra.run.smithi062.stderr: 76450K .......... .......... .......... .......... .......... 82% 321M 0s 2024-09-12T00:57:50.567 INFO:teuthology.orchestra.run.smithi062.stderr: 76500K .......... .......... .......... .......... .......... 82% 315M 0s 2024-09-12T00:57:50.567 INFO:teuthology.orchestra.run.smithi062.stderr: 76550K .......... .......... .......... .......... .......... 82% 326M 0s 2024-09-12T00:57:50.568 INFO:teuthology.orchestra.run.smithi062.stderr: 76600K .......... .......... .......... .......... .......... 82% 367M 0s 2024-09-12T00:57:50.568 INFO:teuthology.orchestra.run.smithi062.stderr: 76650K .......... .......... .......... .......... .......... 82% 173M 0s 2024-09-12T00:57:50.568 INFO:teuthology.orchestra.run.smithi062.stderr: 76700K .......... .......... .......... .......... .......... 82% 173M 0s 2024-09-12T00:57:50.568 INFO:teuthology.orchestra.run.smithi062.stderr: 76750K .......... .......... .......... .......... .......... 82% 334M 0s 2024-09-12T00:57:50.568 INFO:teuthology.orchestra.run.smithi062.stderr: 76800K .......... .......... .......... .......... .......... 82% 320M 0s 2024-09-12T00:57:50.568 INFO:teuthology.orchestra.run.smithi062.stderr: 76850K .......... .......... .......... .......... .......... 82% 333M 0s 2024-09-12T00:57:50.568 INFO:teuthology.orchestra.run.smithi062.stderr: 76900K .......... .......... .......... .......... .......... 82% 289M 0s 2024-09-12T00:57:50.568 INFO:teuthology.orchestra.run.smithi062.stderr: 76950K .......... .......... .......... .......... .......... 82% 337M 0s 2024-09-12T00:57:50.568 INFO:teuthology.orchestra.run.smithi062.stderr: 77000K .......... .......... .......... .......... .......... 82% 380M 0s 2024-09-12T00:57:50.568 INFO:teuthology.orchestra.run.smithi062.stderr: 77050K .......... .......... .......... .......... .......... 82% 293M 0s 2024-09-12T00:57:50.568 INFO:teuthology.orchestra.run.smithi062.stderr: 77100K .......... .......... .......... .......... .......... 83% 302M 0s 2024-09-12T00:57:50.568 INFO:teuthology.orchestra.run.smithi062.stderr: 77150K .......... .......... .......... .......... .......... 83% 278M 0s 2024-09-12T00:57:50.568 INFO:teuthology.orchestra.run.smithi062.stderr: 77200K .......... .......... .......... .......... .......... 83% 303M 0s 2024-09-12T00:57:50.569 INFO:teuthology.orchestra.run.smithi062.stderr: 77250K .......... .......... .......... .......... .......... 83% 286M 0s 2024-09-12T00:57:50.569 INFO:teuthology.orchestra.run.smithi062.stderr: 77300K .......... .......... .......... .......... .......... 83% 285M 0s 2024-09-12T00:57:50.569 INFO:teuthology.orchestra.run.smithi062.stderr: 77350K .......... .......... .......... .......... .......... 83% 301M 0s 2024-09-12T00:57:50.569 INFO:teuthology.orchestra.run.smithi062.stderr: 77400K .......... .......... .......... .......... .......... 83% 329M 0s 2024-09-12T00:57:50.569 INFO:teuthology.orchestra.run.smithi062.stderr: 77450K .......... .......... .......... .......... .......... 83% 322M 0s 2024-09-12T00:57:50.569 INFO:teuthology.orchestra.run.smithi062.stderr: 77500K .......... .......... .......... .......... .......... 83% 290M 0s 2024-09-12T00:57:50.569 INFO:teuthology.orchestra.run.smithi062.stderr: 77550K .......... .......... .......... .......... .......... 83% 304M 0s 2024-09-12T00:57:50.569 INFO:teuthology.orchestra.run.smithi062.stderr: 77600K .......... .......... .......... .......... .......... 83% 281M 0s 2024-09-12T00:57:50.569 INFO:teuthology.orchestra.run.smithi062.stderr: 77650K .......... .......... .......... .......... .......... 83% 333M 0s 2024-09-12T00:57:50.569 INFO:teuthology.orchestra.run.smithi062.stderr: 77700K .......... .......... .......... .......... .......... 83% 350M 0s 2024-09-12T00:57:50.569 INFO:teuthology.orchestra.run.smithi062.stderr: 77750K .......... .......... .......... .......... .......... 83% 342M 0s 2024-09-12T00:57:50.569 INFO:teuthology.orchestra.run.smithi062.stderr: 77800K .......... .......... .......... .......... .......... 83% 281M 0s 2024-09-12T00:57:50.569 INFO:teuthology.orchestra.run.smithi062.stderr: 77850K .......... .......... .......... .......... .......... 83% 377M 0s 2024-09-12T00:57:50.569 INFO:teuthology.orchestra.run.smithi062.stderr: 77900K .......... .......... .......... .......... .......... 83% 388M 0s 2024-09-12T00:57:50.570 INFO:teuthology.orchestra.run.smithi062.stderr: 77950K .......... .......... .......... .......... .......... 83% 387M 0s 2024-09-12T00:57:50.570 INFO:teuthology.orchestra.run.smithi062.stderr: 78000K .......... .......... .......... .......... .......... 84% 108M 0s 2024-09-12T00:57:50.570 INFO:teuthology.orchestra.run.smithi062.stderr: 78050K .......... .......... .......... .......... .......... 84% 345M 0s 2024-09-12T00:57:50.570 INFO:teuthology.orchestra.run.smithi062.stderr: 78100K .......... .......... .......... .......... .......... 84% 276M 0s 2024-09-12T00:57:50.570 INFO:teuthology.orchestra.run.smithi062.stderr: 78150K .......... .......... .......... .......... .......... 84% 350M 0s 2024-09-12T00:57:50.570 INFO:teuthology.orchestra.run.smithi062.stderr: 78200K .......... .......... .......... .......... .......... 84% 339M 0s 2024-09-12T00:57:50.570 INFO:teuthology.orchestra.run.smithi062.stderr: 78250K .......... .......... .......... .......... .......... 84% 375M 0s 2024-09-12T00:57:50.570 INFO:teuthology.orchestra.run.smithi062.stderr: 78300K .......... .......... .......... .......... .......... 84% 376M 0s 2024-09-12T00:57:50.570 INFO:teuthology.orchestra.run.smithi062.stderr: 78350K .......... .......... .......... .......... .......... 84% 387M 0s 2024-09-12T00:57:50.570 INFO:teuthology.orchestra.run.smithi062.stderr: 78400K .......... .......... .......... .......... .......... 84% 320M 0s 2024-09-12T00:57:50.570 INFO:teuthology.orchestra.run.smithi062.stderr: 78450K .......... .......... .......... .......... .......... 84% 30.5M 0s 2024-09-12T00:57:50.570 INFO:teuthology.orchestra.run.smithi062.stderr: 78500K .......... .......... .......... .......... .......... 84% 161M 0s 2024-09-12T00:57:50.570 INFO:teuthology.orchestra.run.smithi062.stderr: 78550K .......... .......... .......... .......... .......... 84% 351M 0s 2024-09-12T00:57:50.571 INFO:teuthology.orchestra.run.smithi062.stderr: 78600K .......... .......... .......... .......... .......... 84% 280M 0s 2024-09-12T00:57:50.571 INFO:teuthology.orchestra.run.smithi062.stderr: 78650K .......... .......... .......... .......... .......... 84% 372M 0s 2024-09-12T00:57:50.571 INFO:teuthology.orchestra.run.smithi062.stderr: 78700K .......... .......... .......... .......... .......... 84% 363M 0s 2024-09-12T00:57:50.571 INFO:teuthology.orchestra.run.smithi062.stderr: 78750K .......... .......... .......... .......... .......... 84% 207M 0s 2024-09-12T00:57:50.571 INFO:teuthology.orchestra.run.smithi062.stderr: 78800K .......... .......... .......... .......... .......... 84% 265M 0s 2024-09-12T00:57:50.571 INFO:teuthology.orchestra.run.smithi062.stderr: 78850K .......... .......... .......... .......... .......... 84% 342M 0s 2024-09-12T00:57:50.571 INFO:teuthology.orchestra.run.smithi062.stderr: 78900K .......... .......... .......... .......... .......... 84% 337M 0s 2024-09-12T00:57:50.571 INFO:teuthology.orchestra.run.smithi062.stderr: 78950K .......... .......... .......... .......... .......... 85% 232M 0s 2024-09-12T00:57:50.571 INFO:teuthology.orchestra.run.smithi062.stderr: 79000K .......... .......... .......... .......... .......... 85% 165M 0s 2024-09-12T00:57:50.571 INFO:teuthology.orchestra.run.smithi062.stderr: 79050K .......... .......... .......... .......... .......... 85% 345M 0s 2024-09-12T00:57:50.571 INFO:teuthology.orchestra.run.smithi062.stderr: 79100K .......... .......... .......... .......... .......... 85% 371M 0s 2024-09-12T00:57:50.571 INFO:teuthology.orchestra.run.smithi062.stderr: 79150K .......... .......... .......... .......... .......... 85% 222M 0s 2024-09-12T00:57:50.571 INFO:teuthology.orchestra.run.smithi062.stderr: 79200K .......... .......... .......... .......... .......... 85% 240M 0s 2024-09-12T00:57:50.572 INFO:teuthology.orchestra.run.smithi062.stderr: 79250K .......... .......... .......... .......... .......... 85% 355M 0s 2024-09-12T00:57:50.572 INFO:teuthology.orchestra.run.smithi062.stderr: 79300K .......... .......... .......... .......... .......... 85% 330M 0s 2024-09-12T00:57:50.572 INFO:teuthology.orchestra.run.smithi062.stderr: 79350K .......... .......... .......... .......... .......... 85% 362M 0s 2024-09-12T00:57:50.572 INFO:teuthology.orchestra.run.smithi062.stderr: 79400K .......... .......... .......... .......... .......... 85% 318M 0s 2024-09-12T00:57:50.572 INFO:teuthology.orchestra.run.smithi062.stderr: 79450K .......... .......... .......... .......... .......... 85% 354M 0s 2024-09-12T00:57:50.572 INFO:teuthology.orchestra.run.smithi062.stderr: 79500K .......... .......... .......... .......... .......... 85% 378M 0s 2024-09-12T00:57:50.572 INFO:teuthology.orchestra.run.smithi062.stderr: 79550K .......... .......... .......... .......... .......... 85% 288M 0s 2024-09-12T00:57:50.572 INFO:teuthology.orchestra.run.smithi062.stderr: 79600K .......... .......... .......... .......... .......... 85% 306M 0s 2024-09-12T00:57:50.572 INFO:teuthology.orchestra.run.smithi062.stderr: 79650K .......... .......... .......... .......... .......... 85% 373M 0s 2024-09-12T00:57:50.572 INFO:teuthology.orchestra.run.smithi062.stderr: 79700K .......... .......... .......... .......... .......... 85% 215M 0s 2024-09-12T00:57:50.572 INFO:teuthology.orchestra.run.smithi062.stderr: 79750K .......... .......... .......... .......... .......... 85% 363M 0s 2024-09-12T00:57:50.572 INFO:teuthology.orchestra.run.smithi062.stderr: 79800K .......... .......... .......... .......... .......... 85% 150M 0s 2024-09-12T00:57:50.572 INFO:teuthology.orchestra.run.smithi062.stderr: 79850K .......... .......... .......... .......... .......... 86% 297M 0s 2024-09-12T00:57:50.573 INFO:teuthology.orchestra.run.smithi062.stderr: 79900K .......... .......... .......... .......... .......... 86% 347M 0s 2024-09-12T00:57:50.573 INFO:teuthology.orchestra.run.smithi062.stderr: 79950K .......... .......... .......... .......... .......... 86% 357M 0s 2024-09-12T00:57:50.573 INFO:teuthology.orchestra.run.smithi062.stderr: 80000K .......... .......... .......... .......... .......... 86% 303M 0s 2024-09-12T00:57:50.573 INFO:teuthology.orchestra.run.smithi062.stderr: 80050K .......... .......... .......... .......... .......... 86% 327M 0s 2024-09-12T00:57:50.573 INFO:teuthology.orchestra.run.smithi062.stderr: 80100K .......... .......... .......... .......... .......... 86% 364M 0s 2024-09-12T00:57:50.573 INFO:teuthology.orchestra.run.smithi062.stderr: 80150K .......... .......... .......... .......... .......... 86% 337M 0s 2024-09-12T00:57:50.573 INFO:teuthology.orchestra.run.smithi062.stderr: 80200K .......... .......... .......... .......... .......... 86% 328M 0s 2024-09-12T00:57:50.573 INFO:teuthology.orchestra.run.smithi062.stderr: 80250K .......... .......... .......... .......... .......... 86% 118M 0s 2024-09-12T00:57:50.573 INFO:teuthology.orchestra.run.smithi062.stderr: 80300K .......... .......... .......... .......... .......... 86% 337M 0s 2024-09-12T00:57:50.573 INFO:teuthology.orchestra.run.smithi062.stderr: 80350K .......... .......... .......... .......... .......... 86% 352M 0s 2024-09-12T00:57:50.573 INFO:teuthology.orchestra.run.smithi062.stderr: 80400K .......... .......... .......... .......... .......... 86% 308M 0s 2024-09-12T00:57:50.573 INFO:teuthology.orchestra.run.smithi062.stderr: 80450K .......... .......... .......... .......... .......... 86% 385M 0s 2024-09-12T00:57:50.573 INFO:teuthology.orchestra.run.smithi062.stderr: 80500K .......... .......... .......... .......... .......... 86% 358M 0s 2024-09-12T00:57:50.573 INFO:teuthology.orchestra.run.smithi062.stderr: 80550K .......... .......... .......... .......... .......... 86% 377M 0s 2024-09-12T00:57:50.574 INFO:teuthology.orchestra.run.smithi062.stderr: 80600K .......... .......... .......... .......... .......... 86% 337M 0s 2024-09-12T00:57:50.574 INFO:teuthology.orchestra.run.smithi062.stderr: 80650K .......... .......... .......... .......... .......... 86% 358M 0s 2024-09-12T00:57:50.574 INFO:teuthology.orchestra.run.smithi062.stderr: 80700K .......... .......... .......... .......... .......... 86% 330M 0s 2024-09-12T00:57:50.574 INFO:teuthology.orchestra.run.smithi062.stderr: 80750K .......... .......... .......... .......... .......... 86% 388M 0s 2024-09-12T00:57:50.574 INFO:teuthology.orchestra.run.smithi062.stderr: 80800K .......... .......... .......... .......... .......... 87% 312M 0s 2024-09-12T00:57:50.574 INFO:teuthology.orchestra.run.smithi062.stderr: 80850K .......... .......... .......... .......... .......... 87% 335M 0s 2024-09-12T00:57:50.574 INFO:teuthology.orchestra.run.smithi062.stderr: 80900K .......... .......... .......... .......... .......... 87% 72.9M 0s 2024-09-12T00:57:50.574 INFO:teuthology.orchestra.run.smithi062.stderr: 80950K .......... .......... .......... .......... .......... 87% 274M 0s 2024-09-12T00:57:50.574 INFO:teuthology.orchestra.run.smithi062.stderr: 81000K .......... .......... .......... .......... .......... 87% 316M 0s 2024-09-12T00:57:50.574 INFO:teuthology.orchestra.run.smithi062.stderr: 81050K .......... .......... .......... .......... .......... 87% 266M 0s 2024-09-12T00:57:50.574 INFO:teuthology.orchestra.run.smithi062.stderr: 81100K .......... .......... .......... .......... .......... 87% 287M 0s 2024-09-12T00:57:50.574 INFO:teuthology.orchestra.run.smithi062.stderr: 81150K .......... .......... .......... .......... .......... 87% 323M 0s 2024-09-12T00:57:50.574 INFO:teuthology.orchestra.run.smithi062.stderr: 81200K .......... .......... .......... .......... .......... 87% 368M 0s 2024-09-12T00:57:50.574 INFO:teuthology.orchestra.run.smithi062.stderr: 81250K .......... .......... .......... .......... .......... 87% 386M 0s 2024-09-12T00:57:50.575 INFO:teuthology.orchestra.run.smithi062.stderr: 81300K .......... .......... .......... .......... .......... 87% 330M 0s 2024-09-12T00:57:50.575 INFO:teuthology.orchestra.run.smithi062.stderr: 81350K .......... .......... .......... .......... .......... 87% 387M 0s 2024-09-12T00:57:50.575 INFO:teuthology.orchestra.run.smithi062.stderr: 81400K .......... .......... .......... .......... .......... 87% 37.8M 0s 2024-09-12T00:57:50.575 INFO:teuthology.orchestra.run.smithi062.stderr: 81450K .......... .......... .......... .......... .......... 87% 309M 0s 2024-09-12T00:57:50.575 INFO:teuthology.orchestra.run.smithi062.stderr: 81500K .......... .......... .......... .......... .......... 87% 304M 0s 2024-09-12T00:57:50.575 INFO:teuthology.orchestra.run.smithi062.stderr: 81550K .......... .......... .......... .......... .......... 87% 86.6M 0s 2024-09-12T00:57:50.575 INFO:teuthology.orchestra.run.smithi062.stderr: 81600K .......... .......... .......... .......... .......... 87% 333M 0s 2024-09-12T00:57:50.575 INFO:teuthology.orchestra.run.smithi062.stderr: 81650K .......... .......... .......... .......... .......... 87% 319M 0s 2024-09-12T00:57:50.575 INFO:teuthology.orchestra.run.smithi062.stderr: 81700K .......... .......... .......... .......... .......... 87% 335M 0s 2024-09-12T00:57:50.575 INFO:teuthology.orchestra.run.smithi062.stderr: 81750K .......... .......... .......... .......... .......... 88% 362M 0s 2024-09-12T00:57:50.575 INFO:teuthology.orchestra.run.smithi062.stderr: 81800K .......... .......... .......... .......... .......... 88% 340M 0s 2024-09-12T00:57:50.575 INFO:teuthology.orchestra.run.smithi062.stderr: 81850K .......... .......... .......... .......... .......... 88% 383M 0s 2024-09-12T00:57:50.575 INFO:teuthology.orchestra.run.smithi062.stderr: 81900K .......... .......... .......... .......... .......... 88% 342M 0s 2024-09-12T00:57:50.575 INFO:teuthology.orchestra.run.smithi062.stderr: 81950K .......... .......... .......... .......... .......... 88% 183M 0s 2024-09-12T00:57:50.576 INFO:teuthology.orchestra.run.smithi062.stderr: 82000K .......... .......... .......... .......... .......... 88% 336M 0s 2024-09-12T00:57:50.576 INFO:teuthology.orchestra.run.smithi062.stderr: 82050K .......... .......... .......... .......... .......... 88% 190M 0s 2024-09-12T00:57:50.576 INFO:teuthology.orchestra.run.smithi062.stderr: 82100K .......... .......... .......... .......... .......... 88% 326M 0s 2024-09-12T00:57:50.576 INFO:teuthology.orchestra.run.smithi062.stderr: 82150K .......... .......... .......... .......... .......... 88% 372M 0s 2024-09-12T00:57:50.576 INFO:teuthology.orchestra.run.smithi062.stderr: 82200K .......... .......... .......... .......... .......... 88% 375M 0s 2024-09-12T00:57:50.576 INFO:teuthology.orchestra.run.smithi062.stderr: 82250K .......... .......... .......... .......... .......... 88% 355M 0s 2024-09-12T00:57:50.576 INFO:teuthology.orchestra.run.smithi062.stderr: 82300K .......... .......... .......... .......... .......... 88% 237M 0s 2024-09-12T00:57:50.576 INFO:teuthology.orchestra.run.smithi062.stderr: 82350K .......... .......... .......... .......... .......... 88% 313M 0s 2024-09-12T00:57:50.576 INFO:teuthology.orchestra.run.smithi062.stderr: 82400K .......... .......... .......... .......... .......... 88% 339M 0s 2024-09-12T00:57:50.576 INFO:teuthology.orchestra.run.smithi062.stderr: 82450K .......... .......... .......... .......... .......... 88% 308M 0s 2024-09-12T00:57:50.576 INFO:teuthology.orchestra.run.smithi062.stderr: 82500K .......... .......... .......... .......... .......... 88% 46.6M 0s 2024-09-12T00:57:50.576 INFO:teuthology.orchestra.run.smithi062.stderr: 82550K .......... .......... .......... .......... .......... 88% 226M 0s 2024-09-12T00:57:50.576 INFO:teuthology.orchestra.run.smithi062.stderr: 82600K .......... .......... .......... .......... .......... 88% 294M 0s 2024-09-12T00:57:50.576 INFO:teuthology.orchestra.run.smithi062.stderr: 82650K .......... .......... .......... .......... .......... 89% 362M 0s 2024-09-12T00:57:50.577 INFO:teuthology.orchestra.run.smithi062.stderr: 82700K .......... .......... .......... .......... .......... 89% 298M 0s 2024-09-12T00:57:50.577 INFO:teuthology.orchestra.run.smithi062.stderr: 82750K .......... .......... .......... .......... .......... 89% 364M 0s 2024-09-12T00:57:50.577 INFO:teuthology.orchestra.run.smithi062.stderr: 82800K .......... .......... .......... .......... .......... 89% 283M 0s 2024-09-12T00:57:50.577 INFO:teuthology.orchestra.run.smithi062.stderr: 82850K .......... .......... .......... .......... .......... 89% 361M 0s 2024-09-12T00:57:50.577 INFO:teuthology.orchestra.run.smithi062.stderr: 82900K .......... .......... .......... .......... .......... 89% 363M 0s 2024-09-12T00:57:50.577 INFO:teuthology.orchestra.run.smithi062.stderr: 82950K .......... .......... .......... .......... .......... 89% 356M 0s 2024-09-12T00:57:50.577 INFO:teuthology.orchestra.run.smithi062.stderr: 83000K .......... .......... .......... .......... .......... 89% 335M 0s 2024-09-12T00:57:50.577 INFO:teuthology.orchestra.run.smithi062.stderr: 83050K .......... .......... .......... .......... .......... 89% 372M 0s 2024-09-12T00:57:50.577 INFO:teuthology.orchestra.run.smithi062.stderr: 83100K .......... .......... .......... .......... .......... 89% 372M 0s 2024-09-12T00:57:50.577 INFO:teuthology.orchestra.run.smithi062.stderr: 83150K .......... .......... .......... .......... .......... 89% 377M 0s 2024-09-12T00:57:50.577 INFO:teuthology.orchestra.run.smithi062.stderr: 83200K .......... .......... .......... .......... .......... 89% 307M 0s 2024-09-12T00:57:50.577 INFO:teuthology.orchestra.run.smithi062.stderr: 83250K .......... .......... .......... .......... .......... 89% 369M 0s 2024-09-12T00:57:50.577 INFO:teuthology.orchestra.run.smithi062.stderr: 83300K .......... .......... .......... .......... .......... 89% 332M 0s 2024-09-12T00:57:50.577 INFO:teuthology.orchestra.run.smithi062.stderr: 83350K .......... .......... .......... .......... .......... 89% 367M 0s 2024-09-12T00:57:50.577 INFO:teuthology.orchestra.run.smithi062.stderr: 83400K .......... .......... .......... .......... .......... 89% 311M 0s 2024-09-12T00:57:50.578 INFO:teuthology.orchestra.run.smithi062.stderr: 83450K .......... .......... .......... .......... .......... 89% 373M 0s 2024-09-12T00:57:50.578 INFO:teuthology.orchestra.run.smithi062.stderr: 83500K .......... .......... .......... .......... .......... 89% 378M 0s 2024-09-12T00:57:50.578 INFO:teuthology.orchestra.run.smithi062.stderr: 83550K .......... .......... .......... .......... .......... 89% 377M 0s 2024-09-12T00:57:50.578 INFO:teuthology.orchestra.run.smithi062.stderr: 83600K .......... .......... .......... .......... .......... 90% 313M 0s 2024-09-12T00:57:50.578 INFO:teuthology.orchestra.run.smithi062.stderr: 83650K .......... .......... .......... .......... .......... 90% 347M 0s 2024-09-12T00:57:50.578 INFO:teuthology.orchestra.run.smithi062.stderr: 83700K .......... .......... .......... .......... .......... 90% 370M 0s 2024-09-12T00:57:50.578 INFO:teuthology.orchestra.run.smithi062.stderr: 83750K .......... .......... .......... .......... .......... 90% 376M 0s 2024-09-12T00:57:50.578 INFO:teuthology.orchestra.run.smithi062.stderr: 83800K .......... .......... .......... .......... .......... 90% 346M 0s 2024-09-12T00:57:50.578 INFO:teuthology.orchestra.run.smithi062.stderr: 83850K .......... .......... .......... .......... .......... 90% 393M 0s 2024-09-12T00:57:50.578 INFO:teuthology.orchestra.run.smithi062.stderr: 83900K .......... .......... .......... .......... .......... 90% 390M 0s 2024-09-12T00:57:50.578 INFO:teuthology.orchestra.run.smithi062.stderr: 83950K .......... .......... .......... .......... .......... 90% 382M 0s 2024-09-12T00:57:50.578 INFO:teuthology.orchestra.run.smithi062.stderr: 84000K .......... .......... .......... .......... .......... 90% 291M 0s 2024-09-12T00:57:50.578 INFO:teuthology.orchestra.run.smithi062.stderr: 84050K .......... .......... .......... .......... .......... 90% 356M 0s 2024-09-12T00:57:50.579 INFO:teuthology.orchestra.run.smithi062.stderr: 84100K .......... .......... .......... .......... .......... 90% 126M 0s 2024-09-12T00:57:50.579 INFO:teuthology.orchestra.run.smithi062.stderr: 84150K .......... .......... .......... .......... .......... 90% 228M 0s 2024-09-12T00:57:50.579 INFO:teuthology.orchestra.run.smithi062.stderr: 84200K .......... .......... .......... .......... .......... 90% 354M 0s 2024-09-12T00:57:50.579 INFO:teuthology.orchestra.run.smithi062.stderr: 84250K .......... .......... .......... .......... .......... 90% 351M 0s 2024-09-12T00:57:50.579 INFO:teuthology.orchestra.run.smithi062.stderr: 84300K .......... .......... .......... .......... .......... 90% 39.2M 0s 2024-09-12T00:57:50.579 INFO:teuthology.orchestra.run.smithi062.stderr: 84350K .......... .......... .......... .......... .......... 90% 320M 0s 2024-09-12T00:57:50.579 INFO:teuthology.orchestra.run.smithi062.stderr: 84400K .......... .......... .......... .......... .......... 90% 388M 0s 2024-09-12T00:57:50.579 INFO:teuthology.orchestra.run.smithi062.stderr: 84450K .......... .......... .......... .......... .......... 90% 354M 0s 2024-09-12T00:57:50.579 INFO:teuthology.orchestra.run.smithi062.stderr: 84500K .......... .......... .......... .......... .......... 91% 329M 0s 2024-09-12T00:57:50.579 INFO:teuthology.orchestra.run.smithi062.stderr: 84550K .......... .......... .......... .......... .......... 91% 78.3M 0s 2024-09-12T00:57:50.579 INFO:teuthology.orchestra.run.smithi062.stderr: 84600K .......... .......... .......... .......... .......... 91% 355M 0s 2024-09-12T00:57:50.579 INFO:teuthology.orchestra.run.smithi062.stderr: 84650K .......... .......... .......... .......... .......... 91% 381M 0s 2024-09-12T00:57:50.579 INFO:teuthology.orchestra.run.smithi062.stderr: 84700K .......... .......... .......... .......... .......... 91% 304M 0s 2024-09-12T00:57:50.579 INFO:teuthology.orchestra.run.smithi062.stderr: 84750K .......... .......... .......... .......... .......... 91% 276M 0s 2024-09-12T00:57:50.580 INFO:teuthology.orchestra.run.smithi062.stderr: 84800K .......... .......... .......... .......... .......... 91% 262M 0s 2024-09-12T00:57:50.580 INFO:teuthology.orchestra.run.smithi062.stderr: 84850K .......... .......... .......... .......... .......... 91% 371M 0s 2024-09-12T00:57:50.580 INFO:teuthology.orchestra.run.smithi062.stderr: 84900K .......... .......... .......... .......... .......... 91% 330M 0s 2024-09-12T00:57:50.580 INFO:teuthology.orchestra.run.smithi062.stderr: 84950K .......... .......... .......... .......... .......... 91% 379M 0s 2024-09-12T00:57:50.580 INFO:teuthology.orchestra.run.smithi062.stderr: 85000K .......... .......... .......... .......... .......... 91% 373M 0s 2024-09-12T00:57:50.580 INFO:teuthology.orchestra.run.smithi062.stderr: 85050K .......... .......... .......... .......... .......... 91% 27.4M 0s 2024-09-12T00:57:50.580 INFO:teuthology.orchestra.run.smithi062.stderr: 85100K .......... .......... .......... .......... .......... 91% 12.1M 0s 2024-09-12T00:57:50.580 INFO:teuthology.orchestra.run.smithi062.stderr: 85150K .......... .......... .......... .......... .......... 91% 354M 0s 2024-09-12T00:57:50.580 INFO:teuthology.orchestra.run.smithi062.stderr: 85200K .......... .......... .......... .......... .......... 91% 34.2M 0s 2024-09-12T00:57:50.580 INFO:teuthology.orchestra.run.smithi062.stderr: 85250K .......... .......... .......... .......... .......... 91% 154M 0s 2024-09-12T00:57:50.580 INFO:teuthology.orchestra.run.smithi062.stderr: 85300K .......... .......... .......... .......... .......... 91% 337M 0s 2024-09-12T00:57:50.580 INFO:teuthology.orchestra.run.smithi062.stderr: 85350K .......... .......... .......... .......... .......... 91% 23.0M 0s 2024-09-12T00:57:50.580 INFO:teuthology.orchestra.run.smithi062.stderr: 85400K .......... .......... .......... .......... .......... 91% 98.6M 0s 2024-09-12T00:57:50.580 INFO:teuthology.orchestra.run.smithi062.stderr: 85450K .......... .......... .......... .......... .......... 92% 342M 0s 2024-09-12T00:57:50.581 INFO:teuthology.orchestra.run.smithi062.stderr: 85500K .......... .......... .......... .......... .......... 92% 281M 0s 2024-09-12T00:57:50.581 INFO:teuthology.orchestra.run.smithi062.stderr: 85550K .......... .......... .......... .......... .......... 92% 68.7M 0s 2024-09-12T00:57:50.581 INFO:teuthology.orchestra.run.smithi062.stderr: 85600K .......... .......... .......... .......... .......... 92% 44.6M 0s 2024-09-12T00:57:50.581 INFO:teuthology.orchestra.run.smithi062.stderr: 85650K .......... .......... .......... .......... .......... 92% 353M 0s 2024-09-12T00:57:50.581 INFO:teuthology.orchestra.run.smithi062.stderr: 85700K .......... .......... .......... .......... .......... 92% 39.0M 0s 2024-09-12T00:57:50.581 INFO:teuthology.orchestra.run.smithi062.stderr: 85750K .......... .......... .......... .......... .......... 92% 347M 0s 2024-09-12T00:57:50.581 INFO:teuthology.orchestra.run.smithi062.stderr: 85800K .......... .......... .......... .......... .......... 92% 13.8M 0s 2024-09-12T00:57:50.581 INFO:teuthology.orchestra.run.smithi062.stderr: 85850K .......... .......... .......... .......... .......... 92% 267M 0s 2024-09-12T00:57:50.581 INFO:teuthology.orchestra.run.smithi062.stderr: 85900K .......... .......... .......... .......... .......... 92% 24.6M 0s 2024-09-12T00:57:50.581 INFO:teuthology.orchestra.run.smithi062.stderr: 85950K .......... .......... .......... .......... .......... 92% 248M 0s 2024-09-12T00:57:50.581 INFO:teuthology.orchestra.run.smithi062.stderr: 86000K .......... .......... .......... .......... .......... 92% 35.0M 0s 2024-09-12T00:57:50.581 INFO:teuthology.orchestra.run.smithi062.stderr: 86050K .......... .......... .......... .......... .......... 92% 40.2M 0s 2024-09-12T00:57:50.581 INFO:teuthology.orchestra.run.smithi062.stderr: 86100K .......... .......... .......... .......... .......... 92% 74.7M 0s 2024-09-12T00:57:50.582 INFO:teuthology.orchestra.run.smithi062.stderr: 86150K .......... .......... .......... .......... .......... 92% 314M 0s 2024-09-12T00:57:50.582 INFO:teuthology.orchestra.run.smithi062.stderr: 86200K .......... .......... .......... .......... .......... 92% 245M 0s 2024-09-12T00:57:50.582 INFO:teuthology.orchestra.run.smithi062.stderr: 86250K .......... .......... .......... .......... .......... 92% 36.1M 0s 2024-09-12T00:57:50.582 INFO:teuthology.orchestra.run.smithi062.stderr: 86300K .......... .......... .......... .......... .......... 92% 99.2M 0s 2024-09-12T00:57:50.582 INFO:teuthology.orchestra.run.smithi062.stderr: 86350K .......... .......... .......... .......... .......... 93% 250M 0s 2024-09-12T00:57:50.582 INFO:teuthology.orchestra.run.smithi062.stderr: 86400K .......... .......... .......... .......... .......... 93% 315M 0s 2024-09-12T00:57:50.582 INFO:teuthology.orchestra.run.smithi062.stderr: 86450K .......... .......... .......... .......... .......... 93% 25.3M 0s 2024-09-12T00:57:50.582 INFO:teuthology.orchestra.run.smithi062.stderr: 86500K .......... .......... .......... .......... .......... 93% 67.6M 0s 2024-09-12T00:57:50.582 INFO:teuthology.orchestra.run.smithi062.stderr: 86550K .......... .......... .......... .......... .......... 93% 315M 0s 2024-09-12T00:57:50.582 INFO:teuthology.orchestra.run.smithi062.stderr: 86600K .......... .......... .......... .......... .......... 93% 22.1M 0s 2024-09-12T00:57:50.582 INFO:teuthology.orchestra.run.smithi062.stderr: 86650K .......... .......... .......... .......... .......... 93% 305M 0s 2024-09-12T00:57:50.582 INFO:teuthology.orchestra.run.smithi062.stderr: 86700K .......... .......... .......... .......... .......... 93% 18.0M 0s 2024-09-12T00:57:50.582 INFO:teuthology.orchestra.run.smithi062.stderr: 86750K .......... .......... .......... .......... .......... 93% 70.2M 0s 2024-09-12T00:57:50.583 INFO:teuthology.orchestra.run.smithi062.stderr: 86800K .......... .......... .......... .......... .......... 93% 256M 0s 2024-09-12T00:57:50.583 INFO:teuthology.orchestra.run.smithi062.stderr: 86850K .......... .......... .......... .......... .......... 93% 323M 0s 2024-09-12T00:57:50.583 INFO:teuthology.orchestra.run.smithi062.stderr: 86900K .......... .......... .......... .......... .......... 93% 17.9M 0s 2024-09-12T00:57:50.583 INFO:teuthology.orchestra.run.smithi062.stderr: 86950K .......... .......... .......... .......... .......... 93% 311M 0s 2024-09-12T00:57:50.583 INFO:teuthology.orchestra.run.smithi062.stderr: 87000K .......... .......... .......... .......... .......... 93% 1.68M 0s 2024-09-12T00:57:50.583 INFO:teuthology.orchestra.run.smithi062.stderr: 87050K .......... .......... .......... .......... .......... 93% 360M 0s 2024-09-12T00:57:50.583 INFO:teuthology.orchestra.run.smithi062.stderr: 87100K .......... .......... .......... .......... .......... 93% 11.0M 0s 2024-09-12T00:57:50.583 INFO:teuthology.orchestra.run.smithi062.stderr: 87150K .......... .......... .......... .......... .......... 93% 372M 0s 2024-09-12T00:57:50.583 INFO:teuthology.orchestra.run.smithi062.stderr: 87200K .......... .......... .......... .......... .......... 93% 5.52M 0s 2024-09-12T00:57:50.583 INFO:teuthology.orchestra.run.smithi062.stderr: 87250K .......... .......... .......... .......... .......... 93% 2.94M 0s 2024-09-12T00:57:50.583 INFO:teuthology.orchestra.run.smithi062.stderr: 87300K .......... .......... .......... .......... .......... 94% 16.5M 0s 2024-09-12T00:57:50.583 INFO:teuthology.orchestra.run.smithi062.stderr: 87350K .......... .......... .......... .......... .......... 94% 34.8M 0s 2024-09-12T00:57:50.583 INFO:teuthology.orchestra.run.smithi062.stderr: 87400K .......... .......... .......... .......... .......... 94% 10.5M 0s 2024-09-12T00:57:50.584 INFO:teuthology.orchestra.run.smithi062.stderr: 87450K .......... .......... .......... .......... .......... 94% 297M 0s 2024-09-12T00:57:50.584 INFO:teuthology.orchestra.run.smithi062.stderr: 87500K .......... .......... .......... .......... .......... 94% 30.3M 0s 2024-09-12T00:57:50.584 INFO:teuthology.orchestra.run.smithi062.stderr: 87550K .......... .......... .......... .......... .......... 94% 18.0M 0s 2024-09-12T00:57:50.584 INFO:teuthology.orchestra.run.smithi062.stderr: 87600K .......... .......... .......... .......... .......... 94% 339M 0s 2024-09-12T00:57:50.584 INFO:teuthology.orchestra.run.smithi062.stderr: 87650K .......... .......... .......... .......... .......... 94% 28.0M 0s 2024-09-12T00:57:50.584 INFO:teuthology.orchestra.run.smithi062.stderr: 87700K .......... .......... .......... .......... .......... 94% 11.7M 0s 2024-09-12T00:57:50.584 INFO:teuthology.orchestra.run.smithi062.stderr: 87750K .......... .......... .......... .......... .......... 94% 43.0M 0s 2024-09-12T00:57:50.584 INFO:teuthology.orchestra.run.smithi062.stderr: 87800K .......... .......... .......... .......... .......... 94% 365M 0s 2024-09-12T00:57:50.584 INFO:teuthology.orchestra.run.smithi062.stderr: 87850K .......... .......... .......... .......... .......... 94% 28.9M 0s 2024-09-12T00:57:50.584 INFO:teuthology.orchestra.run.smithi062.stderr: 87900K .......... .......... .......... .......... .......... 94% 108M 0s 2024-09-12T00:57:50.584 INFO:teuthology.orchestra.run.smithi062.stderr: 87950K .......... .......... .......... .......... .......... 94% 10.2M 0s 2024-09-12T00:57:50.584 INFO:teuthology.orchestra.run.smithi062.stderr: 88000K .......... .......... .......... .......... .......... 94% 132M 0s 2024-09-12T00:57:50.585 INFO:teuthology.orchestra.run.smithi062.stderr: 88050K .......... .......... .......... .......... .......... 94% 329M 0s 2024-09-12T00:57:50.585 INFO:teuthology.orchestra.run.smithi062.stderr: 88100K .......... .......... .......... .......... .......... 94% 32.9M 0s 2024-09-12T00:57:50.585 INFO:teuthology.orchestra.run.smithi062.stderr: 88150K .......... .......... .......... .......... .......... 94% 17.8M 0s 2024-09-12T00:57:50.585 INFO:teuthology.orchestra.run.smithi062.stderr: 88200K .......... .......... .......... .......... .......... 94% 272M 0s 2024-09-12T00:57:50.585 INFO:teuthology.orchestra.run.smithi062.stderr: 88250K .......... .......... .......... .......... .......... 95% 289M 0s 2024-09-12T00:57:50.585 INFO:teuthology.orchestra.run.smithi062.stderr: 88300K .......... .......... .......... .......... .......... 95% 236M 0s 2024-09-12T00:57:50.585 INFO:teuthology.orchestra.run.smithi062.stderr: 88350K .......... .......... .......... .......... .......... 95% 388M 0s 2024-09-12T00:57:50.585 INFO:teuthology.orchestra.run.smithi062.stderr: 88400K .......... .......... .......... .......... .......... 95% 23.3M 0s 2024-09-12T00:57:50.585 INFO:teuthology.orchestra.run.smithi062.stderr: 88450K .......... .......... .......... .......... .......... 95% 199M 0s 2024-09-12T00:57:50.585 INFO:teuthology.orchestra.run.smithi062.stderr: 88500K .......... .......... .......... .......... .......... 95% 63.3M 0s 2024-09-12T00:57:50.585 INFO:teuthology.orchestra.run.smithi062.stderr: 88550K .......... .......... .......... .......... .......... 95% 271M 0s 2024-09-12T00:57:50.585 INFO:teuthology.orchestra.run.smithi062.stderr: 88600K .......... .......... .......... .......... .......... 95% 20.4M 0s 2024-09-12T00:57:50.585 INFO:teuthology.orchestra.run.smithi062.stderr: 88650K .......... .......... .......... .......... .......... 95% 290M 0s 2024-09-12T00:57:50.586 INFO:teuthology.orchestra.run.smithi062.stderr: 88700K .......... .......... .......... .......... .......... 95% 303M 0s 2024-09-12T00:57:50.586 INFO:teuthology.orchestra.run.smithi062.stderr: 88750K .......... .......... .......... .......... .......... 95% 39.3M 0s 2024-09-12T00:57:50.586 INFO:teuthology.orchestra.run.smithi062.stderr: 88800K .......... .......... .......... .......... .......... 95% 281M 0s 2024-09-12T00:57:50.586 INFO:teuthology.orchestra.run.smithi062.stderr: 88850K .......... .......... .......... .......... .......... 95% 385M 0s 2024-09-12T00:57:50.586 INFO:teuthology.orchestra.run.smithi062.stderr: 88900K .......... .......... .......... .......... .......... 95% 27.7M 0s 2024-09-12T00:57:50.586 INFO:teuthology.orchestra.run.smithi062.stderr: 88950K .......... .......... .......... .......... .......... 95% 51.1M 0s 2024-09-12T00:57:50.586 INFO:teuthology.orchestra.run.smithi062.stderr: 89000K .......... .......... .......... .......... .......... 95% 142M 0s 2024-09-12T00:57:50.586 INFO:teuthology.orchestra.run.smithi062.stderr: 89050K .......... .......... .......... .......... .......... 95% 142M 0s 2024-09-12T00:57:50.586 INFO:teuthology.orchestra.run.smithi062.stderr: 89100K .......... .......... .......... .......... .......... 95% 223M 0s 2024-09-12T00:57:50.586 INFO:teuthology.orchestra.run.smithi062.stderr: 89150K .......... .......... .......... .......... .......... 96% 375M 0s 2024-09-12T00:57:50.586 INFO:teuthology.orchestra.run.smithi062.stderr: 89200K .......... .......... .......... .......... .......... 96% 54.4M 0s 2024-09-12T00:57:50.586 INFO:teuthology.orchestra.run.smithi062.stderr: 89250K .......... .......... .......... .......... .......... 96% 135M 0s 2024-09-12T00:57:50.586 INFO:teuthology.orchestra.run.smithi062.stderr: 89300K .......... .......... .......... .......... .......... 96% 44.7M 0s 2024-09-12T00:57:50.587 INFO:teuthology.orchestra.run.smithi062.stderr: 89350K .......... .......... .......... .......... .......... 96% 282M 0s 2024-09-12T00:57:50.587 INFO:teuthology.orchestra.run.smithi062.stderr: 89400K .......... .......... .......... .......... .......... 96% 301M 0s 2024-09-12T00:57:50.587 INFO:teuthology.orchestra.run.smithi062.stderr: 89450K .......... .......... .......... .......... .......... 96% 378M 0s 2024-09-12T00:57:50.587 INFO:teuthology.orchestra.run.smithi062.stderr: 89500K .......... .......... .......... .......... .......... 96% 30.5M 0s 2024-09-12T00:57:50.587 INFO:teuthology.orchestra.run.smithi062.stderr: 89550K .......... .......... .......... .......... .......... 96% 148M 0s 2024-09-12T00:57:50.587 INFO:teuthology.orchestra.run.smithi062.stderr: 89600K .......... .......... .......... .......... .......... 96% 285M 0s 2024-09-12T00:57:50.587 INFO:teuthology.orchestra.run.smithi062.stderr: 89650K .......... .......... .......... .......... .......... 96% 43.5M 0s 2024-09-12T00:57:50.587 INFO:teuthology.orchestra.run.smithi062.stderr: 89700K .......... .......... .......... .......... .......... 96% 275M 0s 2024-09-12T00:57:50.587 INFO:teuthology.orchestra.run.smithi062.stderr: 89750K .......... .......... .......... .......... .......... 96% 54.5M 0s 2024-09-12T00:57:50.587 INFO:teuthology.orchestra.run.smithi062.stderr: 89800K .......... .......... .......... .......... .......... 96% 199M 0s 2024-09-12T00:57:50.587 INFO:teuthology.orchestra.run.smithi062.stderr: 89850K .......... .......... .......... .......... .......... 96% 277M 0s 2024-09-12T00:57:50.587 INFO:teuthology.orchestra.run.smithi062.stderr: 89900K .......... .......... .......... .......... .......... 96% 283M 0s 2024-09-12T00:57:50.587 INFO:teuthology.orchestra.run.smithi062.stderr: 89950K .......... .......... .......... .......... .......... 96% 97.7M 0s 2024-09-12T00:57:50.588 INFO:teuthology.orchestra.run.smithi062.stderr: 90000K .......... .......... .......... .......... .......... 96% 290M 0s 2024-09-12T00:57:50.588 INFO:teuthology.orchestra.run.smithi062.stderr: 90050K .......... .......... .......... .......... .......... 96% 77.3M 0s 2024-09-12T00:57:50.588 INFO:teuthology.orchestra.run.smithi062.stderr: 90100K .......... .......... .......... .......... .......... 97% 266M 0s 2024-09-12T00:57:50.588 INFO:teuthology.orchestra.run.smithi062.stderr: 90150K .......... .......... .......... .......... .......... 97% 92.4M 0s 2024-09-12T00:57:50.588 INFO:teuthology.orchestra.run.smithi062.stderr: 90200K .......... .......... .......... .......... .......... 97% 232M 0s 2024-09-12T00:57:50.588 INFO:teuthology.orchestra.run.smithi062.stderr: 90250K .......... .......... .......... .......... .......... 97% 383M 0s 2024-09-12T00:57:50.588 INFO:teuthology.orchestra.run.smithi062.stderr: 90300K .......... .......... .......... .......... .......... 97% 282M 0s 2024-09-12T00:57:50.588 INFO:teuthology.orchestra.run.smithi062.stderr: 90350K .......... .......... .......... .......... .......... 97% 322M 0s 2024-09-12T00:57:50.588 INFO:teuthology.orchestra.run.smithi062.stderr: 90400K .......... .......... .......... .......... .......... 97% 70.4M 0s 2024-09-12T00:57:50.588 INFO:teuthology.orchestra.run.smithi062.stderr: 90450K .......... .......... .......... .......... .......... 97% 311M 0s 2024-09-12T00:57:50.588 INFO:teuthology.orchestra.run.smithi062.stderr: 90500K .......... .......... .......... .......... .......... 97% 263M 0s 2024-09-12T00:57:50.588 INFO:teuthology.orchestra.run.smithi062.stderr: 90550K .......... .......... .......... .......... .......... 97% 382M 0s 2024-09-12T00:57:50.589 INFO:teuthology.orchestra.run.smithi062.stderr: 90600K .......... .......... .......... .......... .......... 97% 393M 0s 2024-09-12T00:57:50.589 INFO:teuthology.orchestra.run.smithi062.stderr: 90650K .......... .......... .......... .......... .......... 97% 94.4M 0s 2024-09-12T00:57:50.589 INFO:teuthology.orchestra.run.smithi062.stderr: 90700K .......... .......... .......... .......... .......... 97% 118M 0s 2024-09-12T00:57:50.589 INFO:teuthology.orchestra.run.smithi062.stderr: 90750K .......... .......... .......... .......... .......... 97% 334M 0s 2024-09-12T00:57:50.589 INFO:teuthology.orchestra.run.smithi062.stderr: 90800K .......... .......... .......... .......... .......... 97% 146M 0s 2024-09-12T00:57:50.589 INFO:teuthology.orchestra.run.smithi062.stderr: 90850K .......... .......... .......... .......... .......... 97% 37.5M 0s 2024-09-12T00:57:50.589 INFO:teuthology.orchestra.run.smithi062.stderr: 90900K .......... .......... .......... .......... .......... 97% 117M 0s 2024-09-12T00:57:50.589 INFO:teuthology.orchestra.run.smithi062.stderr: 90950K .......... .......... .......... .......... .......... 97% 193M 0s 2024-09-12T00:57:50.589 INFO:teuthology.orchestra.run.smithi062.stderr: 91000K .......... .......... .......... .......... .......... 98% 31.6M 0s 2024-09-12T00:57:50.589 INFO:teuthology.orchestra.run.smithi062.stderr: 91050K .......... .......... .......... .......... .......... 98% 355M 0s 2024-09-12T00:57:50.589 INFO:teuthology.orchestra.run.smithi062.stderr: 91100K .......... .......... .......... .......... .......... 98% 56.3M 0s 2024-09-12T00:57:50.589 INFO:teuthology.orchestra.run.smithi062.stderr: 91150K .......... .......... .......... .......... .......... 98% 374M 0s 2024-09-12T00:57:50.589 INFO:teuthology.orchestra.run.smithi062.stderr: 91200K .......... .......... .......... .......... .......... 98% 365M 0s 2024-09-12T00:57:50.590 INFO:teuthology.orchestra.run.smithi062.stderr: 91250K .......... .......... .......... .......... .......... 98% 43.6M 0s 2024-09-12T00:57:50.590 INFO:teuthology.orchestra.run.smithi062.stderr: 91300K .......... .......... .......... .......... .......... 98% 336M 0s 2024-09-12T00:57:50.590 INFO:teuthology.orchestra.run.smithi062.stderr: 91350K .......... .......... .......... .......... .......... 98% 273M 0s 2024-09-12T00:57:50.590 INFO:teuthology.orchestra.run.smithi062.stderr: 91400K .......... .......... .......... .......... .......... 98% 393M 0s 2024-09-12T00:57:50.590 INFO:teuthology.orchestra.run.smithi062.stderr: 91450K .......... .......... .......... .......... .......... 98% 153M 0s 2024-09-12T00:57:50.590 INFO:teuthology.orchestra.run.smithi062.stderr: 91500K .......... .......... .......... .......... .......... 98% 238M 0s 2024-09-12T00:57:50.590 INFO:teuthology.orchestra.run.smithi062.stderr: 91550K .......... .......... .......... .......... .......... 98% 128M 0s 2024-09-12T00:57:50.590 INFO:teuthology.orchestra.run.smithi062.stderr: 91600K .......... .......... .......... .......... .......... 98% 91.0M 0s 2024-09-12T00:57:50.590 INFO:teuthology.orchestra.run.smithi062.stderr: 91650K .......... .......... .......... .......... .......... 98% 263M 0s 2024-09-12T00:57:50.590 INFO:teuthology.orchestra.run.smithi062.stderr: 91700K .......... .......... .......... .......... .......... 98% 346M 0s 2024-09-12T00:57:50.590 INFO:teuthology.orchestra.run.smithi062.stderr: 91750K .......... .......... .......... .......... .......... 98% 256M 0s 2024-09-12T00:57:50.590 INFO:teuthology.orchestra.run.smithi062.stderr: 91800K .......... .......... .......... .......... .......... 98% 338M 0s 2024-09-12T00:57:50.590 INFO:teuthology.orchestra.run.smithi062.stderr: 91850K .......... .......... .......... .......... .......... 98% 375M 0s 2024-09-12T00:57:50.591 INFO:teuthology.orchestra.run.smithi062.stderr: 91900K .......... .......... .......... .......... .......... 98% 136M 0s 2024-09-12T00:57:50.591 INFO:teuthology.orchestra.run.smithi062.stderr: 91950K .......... .......... .......... .......... .......... 99% 145M 0s 2024-09-12T00:57:50.591 INFO:teuthology.orchestra.run.smithi062.stderr: 92000K .......... .......... .......... .......... .......... 99% 60.5M 0s 2024-09-12T00:57:50.591 INFO:teuthology.orchestra.run.smithi062.stderr: 92050K .......... .......... .......... .......... .......... 99% 325M 0s 2024-09-12T00:57:50.591 INFO:teuthology.orchestra.run.smithi062.stderr: 92100K .......... .......... .......... .......... .......... 99% 240M 0s 2024-09-12T00:57:50.591 INFO:teuthology.orchestra.run.smithi062.stderr: 92150K .......... .......... .......... .......... .......... 99% 17.8M 0s 2024-09-12T00:57:50.591 INFO:teuthology.orchestra.run.smithi062.stderr: 92200K .......... .......... .......... .......... .......... 99% 278M 0s 2024-09-12T00:57:50.591 INFO:teuthology.orchestra.run.smithi062.stderr: 92250K .......... .......... .......... .......... .......... 99% 249M 0s 2024-09-12T00:57:50.591 INFO:teuthology.orchestra.run.smithi062.stderr: 92300K .......... .......... .......... .......... .......... 99% 273M 0s 2024-09-12T00:57:50.591 INFO:teuthology.orchestra.run.smithi062.stderr: 92350K .......... .......... .......... .......... .......... 99% 163M 0s 2024-09-12T00:57:50.591 INFO:teuthology.orchestra.run.smithi062.stderr: 92400K .......... .......... .......... .......... .......... 99% 294M 0s 2024-09-12T00:57:50.591 INFO:teuthology.orchestra.run.smithi062.stderr: 92450K .......... .......... .......... .......... .......... 99% 263M 0s 2024-09-12T00:57:50.591 INFO:teuthology.orchestra.run.smithi062.stderr: 92500K .......... .......... .......... .......... .......... 99% 309M 0s 2024-09-12T00:57:50.591 INFO:teuthology.orchestra.run.smithi062.stderr: 92550K .......... .......... .......... .......... .......... 99% 322M 0s 2024-09-12T00:57:50.592 INFO:teuthology.orchestra.run.smithi062.stderr: 92600K .......... .......... .......... .......... .......... 99% 331M 0s 2024-09-12T00:57:50.592 INFO:teuthology.orchestra.run.smithi062.stderr: 92650K .......... .......... .......... .......... .......... 99% 348M 0s 2024-09-12T00:57:50.592 INFO:teuthology.orchestra.run.smithi062.stderr: 92700K .......... .......... .......... .......... .......... 99% 390M 0s 2024-09-12T00:57:50.592 INFO:teuthology.orchestra.run.smithi062.stderr: 92750K .......... .......... .......... .......... .......... 99% 331M 0s 2024-09-12T00:57:50.592 INFO:teuthology.orchestra.run.smithi062.stderr: 92800K .......... .......... .......... .......... .......... 99% 400M 0s 2024-09-12T00:57:50.592 INFO:teuthology.orchestra.run.smithi062.stderr: 92850K .......... .......... .......... .......... .......... 99% 411M 0s 2024-09-12T00:57:50.592 INFO:teuthology.orchestra.run.smithi062.stderr: 92900K 100% 134G=0.7s 2024-09-12T00:57:50.592 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T00:57:50.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12 00:57:49 (136 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-12T00:57:50.592 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T00:57:50.630 INFO:teuthology.orchestra.run.smithi062.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T00:57:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T00:57:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T00:57:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T00:57:50.630 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T00:57:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T00:57:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T00:57:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T00:57:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T00:57:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T00:57:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T00:57:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T00:57:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T00:57:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T00:57:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T00:57:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T00:57:50.631 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T00:57:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T00:57:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T00:57:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T00:57:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T00:57:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T00:57:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T00:57:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T00:57:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T00:57:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T00:57:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T00:57:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T00:57:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T00:57:50.632 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T00:57:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T00:57:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T00:57:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T00:57:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T00:57:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T00:57:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T00:57:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T00:57:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T00:57:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T00:57:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T00:57:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T00:57:50.633 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T00:57:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T00:57:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T00:57:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T00:57:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T00:57:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T00:57:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T00:57:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T00:57:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:57:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T00:57:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T00:57:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T00:57:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T00:57:50.634 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T00:57:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T00:57:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T00:57:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T00:57:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T00:57:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T00:57:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T00:57:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T00:57:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T00:57:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T00:57:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T00:57:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T00:57:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T00:57:50.635 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T00:57:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T00:57:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T00:57:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T00:57:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T00:57:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T00:57:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T00:57:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T00:57:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T00:57:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T00:57:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T00:57:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T00:57:50.636 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T00:57:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T00:57:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T00:57:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T00:57:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T00:57:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T00:57:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T00:57:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T00:57:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T00:57:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T00:57:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T00:57:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T00:57:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T00:57:50.637 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T00:57:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T00:57:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T00:57:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T00:57:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T00:57:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T00:57:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T00:57:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T00:57:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T00:57:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T00:57:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T00:57:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T00:57:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T00:57:50.638 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T00:57:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T00:57:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T00:57:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T00:57:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T00:57:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T00:57:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T00:57:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T00:57:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T00:57:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T00:57:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T00:57:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T00:57:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T00:57:50.639 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T00:57:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T00:57:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T00:57:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T00:57:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T00:57:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T00:57:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T00:57:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T00:57:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T00:57:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T00:57:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T00:57:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T00:57:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T00:57:50.640 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T00:57:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T00:57:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T00:57:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T00:57:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T00:57:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T00:57:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T00:57:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T00:57:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T00:57:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T00:57:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T00:57:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T00:57:50.641 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T00:57:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T00:57:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T00:57:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T00:57:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T00:57:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T00:57:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T00:57:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T00:57:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T00:57:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T00:57:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T00:57:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T00:57:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T00:57:50.642 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T00:57:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T00:57:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T00:57:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T00:57:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T00:57:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T00:57:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T00:57:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T00:57:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T00:57:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T00:57:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T00:57:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T00:57:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T00:57:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T00:57:50.643 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T00:57:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T00:57:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T00:57:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T00:57:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T00:57:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T00:57:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T00:57:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T00:57:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T00:57:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T00:57:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T00:57:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T00:57:50.644 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T00:57:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T00:57:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T00:57:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T00:57:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T00:57:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T00:57:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T00:57:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T00:57:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T00:57:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T00:57:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T00:57:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T00:57:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T00:57:50.645 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T00:57:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T00:57:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T00:57:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T00:57:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T00:57:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T00:57:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T00:57:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T00:57:50.646 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T00:57:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T00:57:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T00:57:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T00:57:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T00:57:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T00:57:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T00:57:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T00:57:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T00:57:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T00:57:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T00:57:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T00:57:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T00:57:50.647 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T00:57:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T00:57:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T00:57:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T00:57:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T00:57:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T00:57:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T00:57:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T00:57:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T00:57:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T00:57:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T00:57:50.648 INFO:teuthology.orchestra.run.smithi062.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-12T00:57:50.648 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:57:50.648 INFO:teuthology.orchestra.run.smithi062.stdout:Welcome to Gradle 6.0.1! 2024-09-12T00:57:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:57:50.649 INFO:teuthology.orchestra.run.smithi062.stdout:Here are the highlights of this release: 2024-09-12T00:57:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: - Substantial improvements in dependency management, including 2024-09-12T00:57:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T00:57:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: - Advanced control of transitive versions 2024-09-12T00:57:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: - Support for optional features and dependencies 2024-09-12T00:57:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: - Rules to tweak published metadata 2024-09-12T00:57:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: - Support for Java 13 2024-09-12T00:57:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T00:57:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: - New Zinc compiler for Scala 2024-09-12T00:57:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: - VS2019 support 2024-09-12T00:57:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T00:57:50.649 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:57:50.649 INFO:teuthology.orchestra.run.smithi062.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T00:57:50.650 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:57:50.650 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:57:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:------------------------------------------------------------ 2024-09-12T00:57:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:Gradle 6.0.1 2024-09-12T00:57:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:------------------------------------------------------------ 2024-09-12T00:57:50.650 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:57:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T00:57:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T00:57:50.650 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:57:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:Kotlin: 1.3.50 2024-09-12T00:57:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:Groovy: 2.5.8 2024-09-12T00:57:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T00:57:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-12T00:57:50.650 INFO:teuthology.orchestra.run.smithi062.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-12T00:57:50.650 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:57:50.651 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T00:57:50.651 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:57:50.651 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T00:57:50.651 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:57:50.651 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi077.front.sepia.ceph.com 2024-09-12T00:57:50.651 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T00:57:51.068 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T00:57:51.069 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T00:57:51.069 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'ABLQDWKLNJXYANIIEOZQ', 'access_secret': '8U46G/fDxPCL05+SBZfH5m6f9uFiApMKy6fP6nsndqUKkxEgHsEuhg==', 'region': 'mexico', 'endpoint': 'smithi062.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi062.front.sepia.ceph.com'} 2024-09-12T00:57:51.069 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T00:57:51.069 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'ABLQDWKLNJXYANIIEOZQ', '--secret', '8U46G/fDxPCL05+SBZfH5m6f9uFiApMKy6fP6nsndqUKkxEgHsEuhg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T00:57:51.069 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key ABLQDWKLNJXYANIIEOZQ --secret 8U46G/fDxPCL05+SBZfH5m6f9uFiApMKy6fP6nsndqUKkxEgHsEuhg== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T00:57:51.136 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:51.136 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:51.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.173+0000 7fcb9d00e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.175+0000 7fcb9d00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.175+0000 7fcb9d00e800 20 realm 2024-09-12T00:57:51.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.175+0000 7fcb9d00e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.175+0000 7fcb9d00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.175+0000 7fcb9d00e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:51.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.175+0000 7fcb9d00e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.176+0000 7fcb9d00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.176+0000 7fcb9d00e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.176+0000 7fcb9d00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:51.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.176+0000 7fcb9d00e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.177+0000 7fcb9d00e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:51.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.177+0000 7fcb9d00e800 20 searching for the correct realm 2024-09-12T00:57:51.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.180+0000 7fcb97e58640 0 -- 172.21.15.62:0/271252495 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fcb9006a8d0 msgr2=0x7fcb900870c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:51.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.387+0000 7fcb98e5a640 0 -- 172.21.15.62:0/271252495 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x558a2e71bc00 msgr2=0x558a2e71e0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:51.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.391+0000 7fcb9d00e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:51.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.391+0000 7fcb9d00e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:51.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.391+0000 7fcb9d00e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:51.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.391+0000 7fcb9d00e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:51.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.391+0000 7fcb9d00e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:51.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.391+0000 7fcb9d00e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:51.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.391+0000 7fcb9d00e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.391+0000 7fcb9d00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.391+0000 7fcb9d00e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.392+0000 7fcb9d00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:51.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.392+0000 7fcb9d00e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.392+0000 7fcb9d00e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.392+0000 7fcb9d00e800 20 zone default found 2024-09-12T00:57:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.392+0000 7fcb9d00e800 4 Realm: () 2024-09-12T00:57:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.392+0000 7fcb9d00e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.392+0000 7fcb9d00e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.392+0000 7fcb9d00e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.392+0000 7fcb9d00e800 20 zonegroup default 2024-09-12T00:57:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.392+0000 7fcb9d00e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.392+0000 7fcb9d00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.393+0000 7fcb9d00e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.393+0000 7fcb9d00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.393+0000 7fcb9d00e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.393+0000 7fcb9d00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.393+0000 7fcb9d00e800 20 started sync module instance, tier type = 2024-09-12T00:57:51.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.393+0000 7fcb9d00e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:51.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.403+0000 7fcb9d00e800 20 add_watcher() i=0 2024-09-12T00:57:51.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.403+0000 7fcb9d00e800 20 add_watcher() i=1 2024-09-12T00:57:51.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.403+0000 7fcb9d00e800 20 add_watcher() i=2 2024-09-12T00:57:51.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.403+0000 7fcb9d00e800 20 add_watcher() i=3 2024-09-12T00:57:51.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.403+0000 7fcb9d00e800 20 add_watcher() i=4 2024-09-12T00:57:51.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.403+0000 7fcb9d00e800 20 add_watcher() i=5 2024-09-12T00:57:51.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.404+0000 7fcb9d00e800 20 add_watcher() i=6 2024-09-12T00:57:51.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.404+0000 7fcb9d00e800 20 add_watcher() i=7 2024-09-12T00:57:51.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.404+0000 7fcb9d00e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.406+0000 7fca4efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.406+0000 7fcb9d00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.406+0000 7fcb9d00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:51.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.406+0000 7fcb9d00e800 5 note: GC not initialized 2024-09-12T00:57:51.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.407+0000 7fca4dfdb640 20 reqs_thread_entry: start 2024-09-12T00:57:51.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.407+0000 7fcb9d00e800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:51.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.407+0000 7fcb9d00e800 20 Filter name: none 2024-09-12T00:57:51.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.407+0000 7fc9bf7fe640 20 reqs_thread_entry: start 2024-09-12T00:57:51.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.407+0000 7fcb9d00e800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T00:57:51.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.407+0000 7fcb9d00e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.408+0000 7fcb9d00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.408+0000 7fcb9d00e800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T00:57:51.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.408+0000 7fcb9d00e800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:57:51.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.408+0000 7fcb9d00e800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T00:57:51.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.408+0000 7fcb9d00e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.408+0000 7fcb9d00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.408+0000 7fcb9d00e800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T00:57:51.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.408+0000 7fcb9d00e800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:57:51.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.408+0000 7fcb9d00e800 10 cache get: name=default.rgw.meta+users.keys+ABLQDWKLNJXYANIIEOZQ : miss 2024-09-12T00:57:51.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.408+0000 7fcb9d00e800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.408+0000 7fcb9d00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.408+0000 7fcb9d00e800 10 cache put: name=default.rgw.meta+users.keys+ABLQDWKLNJXYANIIEOZQ info.flags=0x0 2024-09-12T00:57:51.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.408+0000 7fcb9d00e800 10 adding default.rgw.meta+users.keys+ABLQDWKLNJXYANIIEOZQ to cache LRU end 2024-09-12T00:57:51.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.408+0000 7fcb9d00e800 10 cache get: name=default.rgw.meta+users.keys+ABLQDWKLNJXYANIIEOZQ : hit (negative entry) 2024-09-12T00:57:51.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.408+0000 7fcb9d00e800 10 cache get: name=default.rgw.meta+users.keys+ABLQDWKLNJXYANIIEOZQ : hit (negative entry) 2024-09-12T00:57:51.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.410+0000 7fcb9d00e800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:57:51.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.410+0000 7fcb9d00e800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:57:51.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.410+0000 7fcb9d00e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T00:57:51.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.410+0000 7fca6f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431693 cookie 94051973133216 notifier 8763 bl.length()=670 2024-09-12T00:57:51.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.410+0000 7fca6f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:57:51.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.410+0000 7fca6f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:57:51.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.413+0000 7fcb9d00e800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:57:51.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.413+0000 7fcb9d00e800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:57:51.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.413+0000 7fcb9d00e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T00:57:51.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.413+0000 7fca6f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431600 cookie 94051973127728 notifier 8763 bl.length()=200 2024-09-12T00:57:51.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.414+0000 7fca6f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:57:51.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.414+0000 7fca6f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:57:51.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.416+0000 7fcb9d00e800 10 cache put: name=default.rgw.meta+users.keys+ABLQDWKLNJXYANIIEOZQ info.flags=0x7 2024-09-12T00:57:51.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.416+0000 7fcb9d00e800 10 moving default.rgw.meta+users.keys+ABLQDWKLNJXYANIIEOZQ to cache LRU end 2024-09-12T00:57:51.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.416+0000 7fcb9d00e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:ABLQDWKLNJXYANIIEOZQ, ofs0, ns] 2024-09-12T00:57:51.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.416+0000 7fca6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431601 cookie 94051973127728 notifier 8763 bl.length()=189 2024-09-12T00:57:51.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.416+0000 7fca6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ABLQDWKLNJXYANIIEOZQ info.flags=0x7 2024-09-12T00:57:51.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.416+0000 7fca6effd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ABLQDWKLNJXYANIIEOZQ to cache LRU end 2024-09-12T00:57:51.417 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T00:57:51.417 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "tester.client.0", 2024-09-12T00:57:51.417 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T00:57:51.417 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T00:57:51.417 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2024-09-12T00:57:51.417 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2024-09-12T00:57:51.417 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2024-09-12T00:57:51.417 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2024-09-12T00:57:51.417 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T00:57:51.417 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "tester.client.0", 2024-09-12T00:57:51.417 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "ABLQDWKLNJXYANIIEOZQ", 2024-09-12T00:57:51.418 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "8U46G/fDxPCL05+SBZfH5m6f9uFiApMKy6fP6nsndqUKkxEgHsEuhg==", 2024-09-12T00:57:51.418 INFO:teuthology.orchestra.run.smithi062.stdout: "active": true, 2024-09-12T00:57:51.418 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T00:57:51.409804Z" 2024-09-12T00:57:51.418 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T00:57:51.418 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T00:57:51.418 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2024-09-12T00:57:51.418 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2024-09-12T00:57:51.418 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2024-09-12T00:57:51.418 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2024-09-12T00:57:51.418 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2024-09-12T00:57:51.418 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2024-09-12T00:57:51.418 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2024-09-12T00:57:51.419 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T00:57:51.419 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T00:57:51.419 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T00:57:51.419 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T00:57:51.419 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T00:57:51.419 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T00:57:51.419 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2024-09-12T00:57:51.419 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T00:57:51.419 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T00:57:51.419 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T00:57:51.419 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T00:57:51.419 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T00:57:51.420 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T00:57:51.420 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2024-09-12T00:57:51.420 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "rgw", 2024-09-12T00:57:51.420 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [], 2024-09-12T00:57:51.420 INFO:teuthology.orchestra.run.smithi062.stdout: "account_id": "", 2024-09-12T00:57:51.420 INFO:teuthology.orchestra.run.smithi062.stdout: "path": "/", 2024-09-12T00:57:51.420 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T00:57:51.409788Z", 2024-09-12T00:57:51.420 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T00:57:51.420 INFO:teuthology.orchestra.run.smithi062.stdout: "group_ids": [] 2024-09-12T00:57:51.420 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T00:57:51.420 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:57:51.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.419+0000 7fca4efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:51.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.421+0000 7fcb9d00e800 20 remove_watcher() i=0 2024-09-12T00:57:51.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.421+0000 7fcb9d00e800 2 removed watcher, disabling cache 2024-09-12T00:57:51.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.422+0000 7fcb9d00e800 20 remove_watcher() i=1 2024-09-12T00:57:51.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.423+0000 7fcb9d00e800 20 remove_watcher() i=2 2024-09-12T00:57:51.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.424+0000 7fcb9d00e800 20 remove_watcher() i=3 2024-09-12T00:57:51.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.425+0000 7fcb9d00e800 20 remove_watcher() i=4 2024-09-12T00:57:51.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.428+0000 7fcb9d00e800 20 remove_watcher() i=5 2024-09-12T00:57:51.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.429+0000 7fcb9d00e800 20 remove_watcher() i=6 2024-09-12T00:57:51.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.431+0000 7fcb9d00e800 20 remove_watcher() i=7 2024-09-12T00:57:51.442 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T00:57:51.443 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T00:57:51.474 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T00:57:51.475 DEBUG:teuthology.orchestra.run.smithi062:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T00:57:51.542 DEBUG:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2024-09-12T00:57:51.636 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:51.637 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:51.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.677+0000 7f8a77f23800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.679+0000 7f8a77f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.679+0000 7f8a77f23800 20 realm 2024-09-12T00:57:51.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.679+0000 7f8a77f23800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.679+0000 7f8a77f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.679+0000 7f8a77f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:51.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.679+0000 7f8a77f23800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.679+0000 7f8a77f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.679+0000 7f8a77f23800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.680+0000 7f8a77f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:51.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.680+0000 7f8a77f23800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.681+0000 7f8a77f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:51.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.681+0000 7f8a77f23800 20 searching for the correct realm 2024-09-12T00:57:51.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.683+0000 7f8a7340b640 0 -- 172.21.15.62:0/3305190200 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f8a6c083020 msgr2=0x7f8a6c07a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:51.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.889+0000 7f8a7340b640 0 -- 172.21.15.62:0/3305190200 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x559e90060f10 msgr2=0x559e900633d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:51.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.893+0000 7f8a77f23800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:51.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.893+0000 7f8a77f23800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:51.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.893+0000 7f8a77f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:51.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.893+0000 7f8a77f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:51.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.893+0000 7f8a77f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:51.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.893+0000 7f8a77f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:51.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.893+0000 7f8a77f23800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.893+0000 7f8a77f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.893+0000 7f8a77f23800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.893+0000 7f8a77f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.894+0000 7f8a77f23800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.894+0000 7f8a77f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.894+0000 7f8a77f23800 20 zone default found 2024-09-12T00:57:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.894+0000 7f8a77f23800 4 Realm: () 2024-09-12T00:57:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.894+0000 7f8a77f23800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.894+0000 7f8a77f23800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.894+0000 7f8a77f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.894+0000 7f8a77f23800 20 zonegroup default 2024-09-12T00:57:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.894+0000 7f8a77f23800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.894+0000 7f8a77f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.894+0000 7f8a77f23800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.895+0000 7f8a77f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.895+0000 7f8a77f23800 20 rados->read ofs=0 len=0 2024-09-12T00:57:51.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.895+0000 7f8a77f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:51.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.895+0000 7f8a77f23800 20 started sync module instance, tier type = 2024-09-12T00:57:51.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.895+0000 7f8a77f23800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:51.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.905+0000 7f8a77f23800 20 add_watcher() i=0 2024-09-12T00:57:51.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.905+0000 7f8a77f23800 20 add_watcher() i=1 2024-09-12T00:57:51.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.905+0000 7f8a77f23800 20 add_watcher() i=2 2024-09-12T00:57:51.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.905+0000 7f8a77f23800 20 add_watcher() i=3 2024-09-12T00:57:51.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.905+0000 7f8a77f23800 20 add_watcher() i=4 2024-09-12T00:57:51.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.905+0000 7f8a77f23800 20 add_watcher() i=5 2024-09-12T00:57:51.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.905+0000 7f8a77f23800 20 add_watcher() i=6 2024-09-12T00:57:51.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.906+0000 7f8a77f23800 20 add_watcher() i=7 2024-09-12T00:57:51.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.906+0000 7f8a77f23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:51.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.908+0000 7f8929fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:51.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.908+0000 7f8a77f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:51.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.908+0000 7f8a77f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:51.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.949+0000 7f8928fe1640 20 reqs_thread_entry: start 2024-09-12T00:57:51.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.949+0000 7f8a77f23800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:51.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.949+0000 7f8a77f23800 20 Filter name: none 2024-09-12T00:57:51.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.949+0000 7f88a27fc640 20 reqs_thread_entry: start 2024-09-12T00:57:51.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.949+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:57:51.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.951+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:51.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.951+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:51.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T00:57:51.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2103710606034193721', time=2024-09-12T02:49:07.379167+0000, chain.objs.size()=4 2024-09-12T00:57:51.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11__multipart_foo.2~PgvCP2onVJlEsMH6yjEXH8I7q4ZWBV1.1 2024-09-12T00:57:51.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11__multipart_foo.2~PgvCP2onVJlEsMH6yjEXH8I7q4ZWBV1.2 2024-09-12T00:57:51.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11__multipart_foo.2~PgvCP2onVJlEsMH6yjEXH8I7q4ZWBV1.3 2024-09-12T00:57:51.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11__multipart_foo.2~PgvCP2onVJlEsMH6yjEXH8I7q4ZWBV1.4 2024-09-12T00:57:51.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17220267716643202921', time=2024-09-12T02:50:13.869108+0000, chain.objs.size()=1 2024-09-12T00:57:51.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.edYwgLy5ybbxjOJM-R9uhm2d8HEOnWM_0 2024-09-12T00:57:51.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18186012448779349683', time=2024-09-12T02:50:13.955291+0000, chain.objs.size()=1 2024-09-12T00:57:51.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.zImTqD3hYDLkUrXMUKlzXYwJIz4t7tM_0 2024-09-12T00:57:51.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9687594714412829622', time=2024-09-12T02:50:49.799270+0000, chain.objs.size()=1 2024-09-12T00:57:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.GF_DI8O1EwzZF1NHpH2C_nJRBgmjW9P_0 2024-09-12T00:57:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8995018098013765936', time=2024-09-12T02:50:52.445449+0000, chain.objs.size()=1 2024-09-12T00:57:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.mM8Sm6q3-A2ZtZUnKNcniiQwH-QI0pK_0 2024-09-12T00:57:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15271293350926500973', time=2024-09-12T02:52:05.400542+0000, chain.objs.size()=1 2024-09-12T00:57:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.iWSREfdffkWEMRyeLDPX4mdGjLSzVUU_0 2024-09-12T00:57:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11002659491734474925', time=2024-09-12T02:52:05.468728+0000, chain.objs.size()=1 2024-09-12T00:57:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.MHm_4R4G3BsaiuPC7apAG_Hp2dnn90z_0 2024-09-12T00:57:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15994577445674955040', time=2024-09-12T02:52:08.602151+0000, chain.objs.size()=1 2024-09-12T00:57:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.CHlNl6UGKd5fQX3_41RzXroJHxXyIAU_0 2024-09-12T00:57:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6778212780108620242', time=2024-09-12T02:52:42.022529+0000, chain.objs.size()=1 2024-09-12T00:57:51.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.952+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.WSH4B3VvBMycu4zlFIHt5FFcaeIqvEC_0 2024-09-12T00:57:51.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.954+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13002979918970407353', time=2024-09-12T02:52:42.041703+0000, chain.objs.size()=1 2024-09-12T00:57:51.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.954+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_._rrJ6WeoW4duiKlQu8fMUApakcJfYuU_0 2024-09-12T00:57:51.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.956+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3831097224864968543', time=2024-09-12T02:53:19.981713+0000, chain.objs.size()=1 2024-09-12T00:57:51.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.956+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.u3S6Vc04zwpAcnR5FvGrsWLIjk421gs_0 2024-09-12T00:57:51.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.956+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1378142099088724644', time=2024-09-12T02:53:22.897638+0000, chain.objs.size()=1 2024-09-12T00:57:51.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.956+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.qtP0OQrHdfMSMrHaRn5v44m3yw87AA2_0 2024-09-12T00:57:51.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.957+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12819211368769474143', time=2024-09-12T02:53:22.898771+0000, chain.objs.size()=1 2024-09-12T00:57:51.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.957+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.SdkcYd7JGN89nVa6Ecc_QAZ3VY3DPm8_0 2024-09-12T00:57:51.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.957+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1682936411049095963', time=2024-09-12T02:53:56.047129+0000, chain.objs.size()=1 2024-09-12T00:57:51.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.957+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.qwLPeIAxBiK7G_kfjHXJTAgBdCR14Q__0 2024-09-12T00:57:51.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.958+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17926234163725063175', time=2024-09-12T02:53:56.047647+0000, chain.objs.size()=1 2024-09-12T00:57:51.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.958+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.5vPT5ADIFSlO0cgYjJqqmLVrOk_DU7c_0 2024-09-12T00:57:51.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.958+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3765279619504677740', time=2024-09-12T02:54:31.394959+0000, chain.objs.size()=1 2024-09-12T00:57:51.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.958+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.XrKOxh0aM3b80KIEPrd6gOPwJaSCTEw_0 2024-09-12T00:57:51.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.958+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15278668896135273722', time=2024-09-12T02:57:17.769081+0000, chain.objs.size()=1 2024-09-12T00:57:51.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.958+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17__shadow_.6ahJJA1romwobbsznB7hOvMG3hsJh7C_0 2024-09-12T00:57:51.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.958+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5202655437606965683', time=2024-09-12T02:57:17.769606+0000, chain.objs.size()=1 2024-09-12T00:57:51.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.958+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17__shadow_.gscntPQMnxAJNAZi6vdzdYJdp-B6In1_0 2024-09-12T00:57:51.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.958+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15738577930335491699', time=2024-09-12T02:57:31.288485+0000, chain.objs.size()=1 2024-09-12T00:57:51.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.958+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18__shadow:OWP.3jqY-.WSsthsglE42hYidLVudz9_.3GANbJBXD_A3Jo2Sl1bYk6wdM7JO30Y_0 2024-09-12T00:57:51.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.961+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:51.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.964+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:57:51.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.965+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:51.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:57:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1415521386748406063', time=2024-09-12T02:49:07.612091+0000, chain.objs.size()=2 2024-09-12T00:57:51.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13__shadow_.oRup_dPLHghGNyR4w_DZhBjK_98NwW1_0 2024-09-12T00:57:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13__shadow_.oRup_dPLHghGNyR4w_DZhBjK_98NwW1_1 2024-09-12T00:57:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5632232529009526647', time=2024-09-12T02:50:15.831759+0000, chain.objs.size()=1 2024-09-12T00:57:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.0R4q6m62Mq3kUYrzbTCIQRaIRQtQltX_0 2024-09-12T00:57:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16746909529207657897', time=2024-09-12T02:50:52.410857+0000, chain.objs.size()=1 2024-09-12T00:57:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.hdG7QTLd9D6gohZtmn-LRPr5ZKku9BI_0 2024-09-12T00:57:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11777933460048000672', time=2024-09-12T02:50:52.435973+0000, chain.objs.size()=1 2024-09-12T00:57:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.Ge6KOMnuIv4R-axtGoFY5fcCpfGtgC-_0 2024-09-12T00:57:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9098153289050722562', time=2024-09-12T02:50:54.657558+0000, chain.objs.size()=1 2024-09-12T00:57:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.mE6QKwnEC8q-Rq2e42NuAvyW87fHPrE_0 2024-09-12T00:57:51.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7977878457313067950', time=2024-09-12T02:51:30.556758+0000, chain.objs.size()=1 2024-09-12T00:57:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.qFQv55glFhLvB-rA2csMsJmkXiieh38_0 2024-09-12T00:57:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2855706657285996144', time=2024-09-12T02:52:42.061068+0000, chain.objs.size()=1 2024-09-12T00:57:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.HLrqvsAx17aTErTDoM2qb_SFD-bphh3_0 2024-09-12T00:57:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14753204311760060432', time=2024-09-12T02:52:45.031133+0000, chain.objs.size()=1 2024-09-12T00:57:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.HmYSxC9q3dk9-OyrfZ1UXncIHUKYnKH_0 2024-09-12T00:57:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12956898126244456378', time=2024-09-12T02:52:47.305440+0000, chain.objs.size()=1 2024-09-12T00:57:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.MtuMBt_Gclr1-lM3SQUSRKA8nU47EtM_0 2024-09-12T00:57:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15336394687575649550', time=2024-09-12T02:52:47.354953+0000, chain.objs.size()=1 2024-09-12T00:57:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.ZYW6AogreeRfdlg-WY0GUDwHPx1ciPh_0 2024-09-12T00:57:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14579845797923189239', time=2024-09-12T02:52:47.375330+0000, chain.objs.size()=1 2024-09-12T00:57:51.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.966+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.yWmIkyoTaiFiodDuW5pNm1Laapbu9F7_0 2024-09-12T00:57:51.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.970+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11549298799947640193', time=2024-09-12T02:54:31.385045+0000, chain.objs.size()=1 2024-09-12T00:57:51.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.970+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_._ye-eIOz66fY1u6WA9VUCfKFUJcdMjZ_0 2024-09-12T00:57:51.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.971+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3132675099347483214', time=2024-09-12T02:54:31.413654+0000, chain.objs.size()=1 2024-09-12T00:57:51.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.971+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.q8GMpmigwFTeFxz9W6hAMavxq36vjzx_0 2024-09-12T00:57:51.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.971+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12175554864232786410', time=2024-09-12T02:55:09.998393+0000, chain.objs.size()=1 2024-09-12T00:57:51.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.971+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.ge-6K_x1bDnhkN0zvvOTQdm48yfVOBJ_0 2024-09-12T00:57:51.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.973+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:51.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.975+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:57:51.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:51.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:51.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:57:51.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17734208575214362076', time=2024-09-12T02:49:07.457242+0000, chain.objs.size()=1 2024-09-12T00:57:51.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.yhhJEn-Q1yAgiSmbem8pdjRuex-ago__0 2024-09-12T00:57:51.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4652751125539869321', time=2024-09-12T02:50:49.754443+0000, chain.objs.size()=1 2024-09-12T00:57:51.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.O1FR74g6J4eEyMhAgcIWOqCrtP2hYRg_0 2024-09-12T00:57:51.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5186892520138432022', time=2024-09-12T02:51:30.610046+0000, chain.objs.size()=1 2024-09-12T00:57:51.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.VJ8DcavyxLi_3GBIQl7Q7hV-bT5Bz91_0 2024-09-12T00:57:51.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3474501851874354210', time=2024-09-12T02:51:30.622301+0000, chain.objs.size()=1 2024-09-12T00:57:51.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.ppdxe8c7IS86n1k7r4ew-TaGC2WrZqc_0 2024-09-12T00:57:51.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9183878874304187462', time=2024-09-12T02:51:32.562164+0000, chain.objs.size()=1 2024-09-12T00:57:51.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.su6qjKUCe59eExhdog02Yf4tPO4WPpn_0 2024-09-12T00:57:51.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7934273275927191838', time=2024-09-12T02:52:42.104548+0000, chain.objs.size()=1 2024-09-12T00:57:51.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.YBO_v_cLgC4sXnM7ajqcEaFB-1SJfxG_0 2024-09-12T00:57:51.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4280093928787635550', time=2024-09-12T02:52:44.998100+0000, chain.objs.size()=1 2024-09-12T00:57:51.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.CkCQlOHBT7Xt3kQq8gF-wI3AaD6LnqW_0 2024-09-12T00:57:51.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1487823084109373461', time=2024-09-12T02:53:22.862140+0000, chain.objs.size()=1 2024-09-12T00:57:51.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.977+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.qfzspEtnVXb1dsvWrsZgbxjt7dWbnKT_0 2024-09-12T00:57:51.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.978+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.905656683754835127', time=2024-09-12T02:54:31.368895+0000, chain.objs.size()=1 2024-09-12T00:57:51.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.978+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.baGkEJwza9-BMeQkzf6l-Z6ebg7sINg_0 2024-09-12T00:57:51.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.978+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5839347694811691457', time=2024-09-12T02:54:34.531415+0000, chain.objs.size()=1 2024-09-12T00:57:51.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.978+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.w2jaBSbTeO0KaQLjWnqjotIfiphGSTI_0 2024-09-12T00:57:51.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.978+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9187107581105445144', time=2024-09-12T02:54:34.553794+0000, chain.objs.size()=1 2024-09-12T00:57:51.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.978+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.tuWrWaoH-hkasLVS_9JXkc35JbCx4gi_0 2024-09-12T00:57:51.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.978+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10320367574983034365', time=2024-09-12T02:54:34.554791+0000, chain.objs.size()=1 2024-09-12T00:57:51.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.978+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.MFfCSMFAd6NBh5XingLPQqknSWW3AJm_0 2024-09-12T00:57:51.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.980+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14962518513731213978', time=2024-09-12T02:54:36.694436+0000, chain.objs.size()=1 2024-09-12T00:57:51.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.980+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.PRwHiCIk4kFMBplOPtNqQdfl3n2pOgC_0 2024-09-12T00:57:51.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.980+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4506040876105874007', time=2024-09-12T02:57:17.770293+0000, chain.objs.size()=1 2024-09-12T00:57:51.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.980+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17__shadow_.IdN0VduDbhF0setT3gQidZYSfqsmNFG_0 2024-09-12T00:57:51.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.980+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8787363359837748546', time=2024-09-12T02:57:17.770975+0000, chain.objs.size()=1 2024-09-12T00:57:51.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.980+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17__shadow_.lxfESprYclDZRUIUmNk-uDjhML5f8WS_0 2024-09-12T00:57:51.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.983+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:51.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.985+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:57:51.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.986+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:51.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:51.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:57:51.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='_RD8AIJ1rjMPVTyAubA_mOoaJYYjhE2x', time=2024-09-12T02:49:07.558014+0000, chain.objs.size()=1 2024-09-12T00:57:51.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.NSQYFrWl4tmQm3I5Ffz0fUjAvhaKbN1_0 2024-09-12T00:57:51.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17384778736920703457', time=2024-09-12T02:50:49.721317+0000, chain.objs.size()=1 2024-09-12T00:57:51.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.rHJ3ipgdDS0dwBJGLLOq3f_e9xP_4GH_0 2024-09-12T00:57:51.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5299403706743759864', time=2024-09-12T02:50:49.750749+0000, chain.objs.size()=1 2024-09-12T00:57:51.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.3iPxkJ2JOD-9wx8LmQb3tO7sccuHfUA_0 2024-09-12T00:57:51.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6754506612801526952', time=2024-09-12T02:50:49.795120+0000, chain.objs.size()=1 2024-09-12T00:57:51.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.G-MUNkE97Klef2l7vvb0oAMSyP30SPB_0 2024-09-12T00:57:51.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13277665988960309763', time=2024-09-12T02:50:54.585752+0000, chain.objs.size()=1 2024-09-12T00:57:51.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.aqRoGx8PU83xu9jD1ZU4pEkBvqfikHS_0 2024-09-12T00:57:51.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13940826391114933302', time=2024-09-12T02:50:54.586407+0000, chain.objs.size()=1 2024-09-12T00:57:51.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.JMxlkL1hm5AXa04nF7q19n_y__8wIot_0 2024-09-12T00:57:51.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11085937669506525309', time=2024-09-12T02:51:27.879654+0000, chain.objs.size()=1 2024-09-12T00:57:51.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.Bone7UqzKzCvKrzBdcKg5TwSyx4K5gL_0 2024-09-12T00:57:51.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7149199008905757523', time=2024-09-12T02:51:30.572225+0000, chain.objs.size()=1 2024-09-12T00:57:51.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.AezYpug7H6BNBQsCB-1b8XfMwpRyevM_0 2024-09-12T00:57:51.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6077069421474458820', time=2024-09-12T02:51:30.619013+0000, chain.objs.size()=1 2024-09-12T00:57:51.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.oomfhCfi3m23ouKGzyNAMF-3h6lIfmW_0 2024-09-12T00:57:51.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569578953151032485', time=2024-09-12T02:51:30.641510+0000, chain.objs.size()=1 2024-09-12T00:57:51.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.5eG3ATd2xqhYH6IcGuuTTxNwPoz4sT9_0 2024-09-12T00:57:51.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5403751073738983641', time=2024-09-12T02:51:32.590653+0000, chain.objs.size()=1 2024-09-12T00:57:51.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.987+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.7XsIalZa2Sgyoc_yEs60LP2sAfik9OW_0 2024-09-12T00:57:51.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.988+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7308900223025877838', time=2024-09-12T02:51:32.593867+0000, chain.objs.size()=1 2024-09-12T00:57:51.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.988+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.Pebkv2nBijeyHB_aFYXChi24PxXQ9mz_0 2024-09-12T00:57:51.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.989+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4014319884745699641', time=2024-09-12T02:52:05.435264+0000, chain.objs.size()=1 2024-09-12T00:57:51.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.989+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.rty1tiK8dfXw0XJMFrrzxVjMD2FyUh7_0 2024-09-12T00:57:51.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.992+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7361081958576455056', time=2024-09-12T02:52:08.542638+0000, chain.objs.size()=1 2024-09-12T00:57:51.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.992+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.u9unoiUxbrsVhPwzfCyJ7o7027Y-KFO_0 2024-09-12T00:57:51.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.992+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.704068522688888913', time=2024-09-12T02:53:20.028627+0000, chain.objs.size()=1 2024-09-12T00:57:51.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.992+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.CbuVEoD1yYWKvbx5MpwPuVcbWxZim27_0 2024-09-12T00:57:51.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.992+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17589157293502931888', time=2024-09-12T02:55:09.930521+0000, chain.objs.size()=1 2024-09-12T00:57:51.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.992+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.LeMNq5d_IIV6Fj0lxuPox88j_JdAEvf_0 2024-09-12T00:57:51.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.992+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13805125700041498533', time=2024-09-12T02:57:17.770492+0000, chain.objs.size()=1 2024-09-12T00:57:51.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.992+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17__shadow_.bhz6O04uMilIS-GudIuZ0W_yJqkwmpg_0 2024-09-12T00:57:51.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.997+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:51.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:51.999+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:57:51.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.000+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:51.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T00:57:52.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13401983192451755849', time=2024-09-12T02:49:07.554030+0000, chain.objs.size()=3 2024-09-12T00:57:52.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-STANDARD.2~4f3D88pjn0OItXXOzbP8IC28Pin2_ea.1 2024-09-12T00:57:52.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-STANDARD.2~4f3D88pjn0OItXXOzbP8IC28Pin2_ea.2 2024-09-12T00:57:52.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-STANDARD.2~4f3D88pjn0OItXXOzbP8IC28Pin2_ea.3 2024-09-12T00:57:52.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1908380241961171968', time=2024-09-12T02:49:07.565933+0000, chain.objs.size()=3 2024-09-12T00:57:52.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-STANDARD.2~4f3D88pjn0OItXXOzbP8IC28Pin2_ea.1 2024-09-12T00:57:52.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-STANDARD.2~4f3D88pjn0OItXXOzbP8IC28Pin2_ea.2 2024-09-12T00:57:52.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-STANDARD.2~4f3D88pjn0OItXXOzbP8IC28Pin2_ea.3 2024-09-12T00:57:52.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13104328969455472647', time=2024-09-12T02:49:07.608059+0000, chain.objs.size()=2 2024-09-12T00:57:52.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13__shadow_.4zb_TR6t0zjWXy_eUT8i3r17e5DI5W__0 2024-09-12T00:57:52.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13__shadow_.4zb_TR6t0zjWXy_eUT8i3r17e5DI5W__1 2024-09-12T00:57:52.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9595691302935826334', time=2024-09-12T02:50:49.756722+0000, chain.objs.size()=1 2024-09-12T00:57:52.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.MvbshcMGtCMkkekVWtULvKf-EdbqkUA_0 2024-09-12T00:57:52.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1212494763306442376', time=2024-09-12T02:50:52.433279+0000, chain.objs.size()=1 2024-09-12T00:57:52.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.YlXTfqdjR1Wj43TwqxLZ_b_sLIrEhIs_0 2024-09-12T00:57:52.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3587074216472587116', time=2024-09-12T02:50:52.434029+0000, chain.objs.size()=1 2024-09-12T00:57:52.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.FdFRXHt3hDPoEbs7frRwfuDf4fhYOed_0 2024-09-12T00:57:52.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4640966970208362617', time=2024-09-12T02:51:32.627281+0000, chain.objs.size()=1 2024-09-12T00:57:52.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.001+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.G-NFQM4-frM_IVIdcI5C7vBynOAD9zy_0 2024-09-12T00:57:52.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.005+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12172649697702277255', time=2024-09-12T02:51:32.633421+0000, chain.objs.size()=1 2024-09-12T00:57:52.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.005+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.-HgvoXRNEq3kWcWRAf-W4EsmuHgjzRX_0 2024-09-12T00:57:52.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.005+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16989731902309189789', time=2024-09-12T02:52:08.558682+0000, chain.objs.size()=1 2024-09-12T00:57:52.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.005+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.WiElGu2zQfwbfE8tzopjPiLf9yrkT2y_0 2024-09-12T00:57:52.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.005+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2959897733493251487', time=2024-09-12T02:52:47.364025+0000, chain.objs.size()=1 2024-09-12T00:57:52.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.005+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.w5te3L79RXmwOX-1v_PnOJYkzZTvmVK_0 2024-09-12T00:57:52.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.006+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16470291937180180155', time=2024-09-12T02:53:22.870207+0000, chain.objs.size()=1 2024-09-12T00:57:52.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.006+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.UpBMbzYeSGvHW4ZrDyjHzGvGII0CSu3_0 2024-09-12T00:57:52.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.006+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8820226451897001616', time=2024-09-12T02:53:22.913804+0000, chain.objs.size()=1 2024-09-12T00:57:52.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.006+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.TBTrZcsbU3poT3obm24vWWtjgdjuSfK_0 2024-09-12T00:57:52.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.006+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6787086604171045132', time=2024-09-12T02:53:22.914351+0000, chain.objs.size()=1 2024-09-12T00:57:52.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.006+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.D6lIaa_4bSlQI-BIKWV09R7Lxa6qWng_0 2024-09-12T00:57:52.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.006+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9090436439447437264', time=2024-09-12T02:53:22.946436+0000, chain.objs.size()=1 2024-09-12T00:57:52.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.006+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.c7Piif7hN2yiV90aS5ENnawOlpdznGn_0 2024-09-12T00:57:52.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.006+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2129298106145775280', time=2024-09-12T02:53:55.994177+0000, chain.objs.size()=1 2024-09-12T00:57:52.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.006+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.Ii2oK-8LseWHydjnFh53I_mpxHHRWej_0 2024-09-12T00:57:52.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.007+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5683641576717043617', time=2024-09-12T02:53:56.038656+0000, chain.objs.size()=1 2024-09-12T00:57:52.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.007+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.CuZrijTf3elI-e0ctpuUWSUC5TB2KVz_0 2024-09-12T00:57:52.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.007+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15931811081973486905', time=2024-09-12T02:53:58.693756+0000, chain.objs.size()=1 2024-09-12T00:57:52.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.007+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.4Bq6fBmqZf5ip1beqhpcDx429IUFl4l_0 2024-09-12T00:57:52.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.007+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5336701881163831020', time=2024-09-12T02:53:58.766002+0000, chain.objs.size()=1 2024-09-12T00:57:52.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.007+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.Szms6MXt7lphmcT5j4aTSYjxiUZjeRx_0 2024-09-12T00:57:52.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.009+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9200128881383002836', time=2024-09-12T02:54:34.583946+0000, chain.objs.size()=1 2024-09-12T00:57:52.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.009+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.gFwLgU3m3pnFwEEGBi2jl1rp2zwR_RR_0 2024-09-12T00:57:52.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.009+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2054207754891393048', time=2024-09-12T02:54:36.675541+0000, chain.objs.size()=1 2024-09-12T00:57:52.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.009+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.0xwE6bdcS2XjL9sLlxfEJaROiE_SmYn_0 2024-09-12T00:57:52.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.009+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15172623107539162304', time=2024-09-12T02:55:09.948337+0000, chain.objs.size()=1 2024-09-12T00:57:52.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.009+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.By_6K0rlVUgx4oPD06gcVYVGTlMfpWl_0 2024-09-12T00:57:52.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.009+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6785685712315452894', time=2024-09-12T02:55:10.010272+0000, chain.objs.size()=1 2024-09-12T00:57:52.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.009+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.gs50wGI66Dkrt4k3jInKU7YfBHj_dxo_0 2024-09-12T00:57:52.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.009+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11686630431715194371', time=2024-09-12T02:57:17.763973+0000, chain.objs.size()=1 2024-09-12T00:57:52.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.009+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17__shadow_.8_oaoZEUXqaHXzCt9V4n-Hxsx7WpSC__0 2024-09-12T00:57:52.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.013+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.015+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:57:52.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.016+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:57:52.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3479441248946587522', time=2024-09-12T02:49:07.469965+0000, chain.objs.size()=1 2024-09-12T00:57:52.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.8EyjqqUeTiv9Banl1MxllmsT8C2Ujkd_0 2024-09-12T00:57:52.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14849402414903250578', time=2024-09-12T02:50:52.446100+0000, chain.objs.size()=1 2024-09-12T00:57:52.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.ppKY-13DKhWkZ_A8ZarSYYptk9tSPGQ_0 2024-09-12T00:57:52.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10620116323891277411', time=2024-09-12T02:50:52.484351+0000, chain.objs.size()=1 2024-09-12T00:57:52.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.dTlIVvKbK2p3MeXSboJswDTEH3zMhJe_0 2024-09-12T00:57:52.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17236390956770260899', time=2024-09-12T02:50:54.601823+0000, chain.objs.size()=1 2024-09-12T00:57:52.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.lrIhpGbIDA3RywfqV174bcbCWldhXnh_0 2024-09-12T00:57:52.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8193947357817014233', time=2024-09-12T02:50:54.602341+0000, chain.objs.size()=1 2024-09-12T00:57:52.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.dYxTq35H0malqnDKhyBqGGicuNA7MGr_0 2024-09-12T00:57:52.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9822694019459355852', time=2024-09-12T02:51:27.871217+0000, chain.objs.size()=1 2024-09-12T00:57:52.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.Y66uwdx3q9mx1vUoCLWce2YCTZiaiNw_0 2024-09-12T00:57:52.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16834859793933020806', time=2024-09-12T02:51:30.573614+0000, chain.objs.size()=1 2024-09-12T00:57:52.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.KW2kIA1Q3h7oz4x2LW3kGLN1FTT2xeN_0 2024-09-12T00:57:52.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3850516644110033816', time=2024-09-12T02:51:30.609048+0000, chain.objs.size()=1 2024-09-12T00:57:52.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.6e8JmHTZ4m4g2mY7jwSW02AeUQyt4nC_0 2024-09-12T00:57:52.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5420711016550105344', time=2024-09-12T02:52:42.021789+0000, chain.objs.size()=1 2024-09-12T00:57:52.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.GyXFYyB3zObNG6GGVMbWXiATwksT0XF_0 2024-09-12T00:57:52.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6433876245949677345', time=2024-09-12T02:52:44.074981+0000, chain.objs.size()=1 2024-09-12T00:57:52.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.Ra18aQdwItEVNry2ofqYOAAd73hOnQD_0 2024-09-12T00:57:52.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9060279487871693409', time=2024-09-12T02:52:47.357853+0000, chain.objs.size()=1 2024-09-12T00:57:52.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.kXVeRyl3Bd2xZseOwxlH2IyO6gFVcD__0 2024-09-12T00:57:52.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5281333982943470503', time=2024-09-12T02:52:47.407506+0000, chain.objs.size()=1 2024-09-12T00:57:52.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.017+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.foiwi5ALBerGz9M2bzHKvhLSMIBcROn_0 2024-09-12T00:57:52.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.019+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15895450091783658538', time=2024-09-12T02:55:09.914913+0000, chain.objs.size()=1 2024-09-12T00:57:52.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.019+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.1-KFpi4Lz1jzKlURWBwjcs57j9WT-yu_0 2024-09-12T00:57:52.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.019+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9106683822280699072', time=2024-09-12T02:57:17.751784+0000, chain.objs.size()=1 2024-09-12T00:57:52.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.019+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17__shadow_.w6UToLw68Rjvi2VIKGsLyw4cIYDC1JT_0 2024-09-12T00:57:52.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.020+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7663188918534780457', time=2024-09-12T02:57:31.279261+0000, chain.objs.size()=1 2024-09-12T00:57:52.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.020+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18__shadow:GY1cEcClzpY5r5i6Kfrr4HLFrJ4VLDf_.xTl31cZiiYcFSfinwcJJ29lAHWLM7U-_0 2024-09-12T00:57:52.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.022+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.025+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:57:52.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.026+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:57:52.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18136700819666902748', time=2024-09-12T02:49:07.396184+0000, chain.objs.size()=4 2024-09-12T00:57:52.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12__multipart_foo.2~R1LdMZ7aqSMeT4ujNiYPiJt1y5zgfNT.1 2024-09-12T00:57:52.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12__multipart_foo.2~R1LdMZ7aqSMeT4ujNiYPiJt1y5zgfNT.2 2024-09-12T00:57:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12__multipart_foo.2~R1LdMZ7aqSMeT4ujNiYPiJt1y5zgfNT.3 2024-09-12T00:57:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12__multipart_foo.2~R1LdMZ7aqSMeT4ujNiYPiJt1y5zgfNT.4 2024-09-12T00:57:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15632293412704005277', time=2024-09-12T02:50:13.954937+0000, chain.objs.size()=1 2024-09-12T00:57:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.3uApV0mf8uFa0tlQQU-HS29bH92bRqp_0 2024-09-12T00:57:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9702912031979850336', time=2024-09-12T02:50:15.882150+0000, chain.objs.size()=1 2024-09-12T00:57:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.W5LPRiojErZs16vND309WZtTL3ZmX80_0 2024-09-12T00:57:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15746997057684451122', time=2024-09-12T02:50:54.677104+0000, chain.objs.size()=1 2024-09-12T00:57:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_._BcXQ2VDscRbpgbF_2h8yzRZknR5wqw_0 2024-09-12T00:57:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11674412885022233219', time=2024-09-12T02:52:08.582914+0000, chain.objs.size()=1 2024-09-12T00:57:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.Qw_qWOLgt6IShmrpN60BGGLemMh4F9f_0 2024-09-12T00:57:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15944673211664951884', time=2024-09-12T02:52:08.583411+0000, chain.objs.size()=1 2024-09-12T00:57:52.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.dJGzZhIiaGwsZN8KoMISI2i4R_iZWml_0 2024-09-12T00:57:52.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8694292854879487936', time=2024-09-12T02:52:08.604836+0000, chain.objs.size()=1 2024-09-12T00:57:52.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.uc6msq6Y8HhQOQedqKlPudn-5LyA6Dc_0 2024-09-12T00:57:52.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10508078306798294936', time=2024-09-12T02:54:31.421157+0000, chain.objs.size()=1 2024-09-12T00:57:52.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.WGpk_P8QaUaRb8N_qksITn4ZvDJMBkq_0 2024-09-12T00:57:52.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3894245313214475593', time=2024-09-12T02:54:34.509738+0000, chain.objs.size()=1 2024-09-12T00:57:52.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.027+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.Jla6fqecLWpoSA-U4qRYfzizrPIgrA__0 2024-09-12T00:57:52.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.030+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1013759898045063555', time=2024-09-12T02:54:34.510587+0000, chain.objs.size()=1 2024-09-12T00:57:52.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.030+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.Z6JQKi4hJ-k_s0IbVfdc3C1LLLvx03q_0 2024-09-12T00:57:52.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.031+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6160917515801762674', time=2024-09-12T02:54:36.670180+0000, chain.objs.size()=1 2024-09-12T00:57:52.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.031+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.C5IbFSr40VbBp8U-NNPIswQNoJ8b7GR_0 2024-09-12T00:57:52.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.031+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2495795962358336474', time=2024-09-12T02:54:36.719161+0000, chain.objs.size()=1 2024-09-12T00:57:52.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.031+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.aJJIzaeo5LGvArigNvCULfgzfE4H0Sp_0 2024-09-12T00:57:52.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.031+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8932394656909963116', time=2024-09-12T02:55:09.999048+0000, chain.objs.size()=1 2024-09-12T00:57:52.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.031+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.14NO7vPAfr4x5uNjTX0H4VzJLsC_Wk5_0 2024-09-12T00:57:52.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.035+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.041+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:57:52.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.042+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T00:57:52.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='_BV8IQ8c9GYeLlNqRVBw3bTrVUkMmAlz', time=2024-09-12T02:49:07.498649+0000, chain.objs.size()=1 2024-09-12T00:57:52.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.eZBltDgB2i0PMlH6VFcNHuIpKFIaiw3_0 2024-09-12T00:57:52.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.259414573640064163', time=2024-09-12T02:49:07.545872+0000, chain.objs.size()=3 2024-09-12T00:57:52.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-LUKEWARM.2~Mk4_zA6Aa-1MYXyOhg0WFYg_jDOeN1V.1 2024-09-12T00:57:52.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-LUKEWARM.2~Mk4_zA6Aa-1MYXyOhg0WFYg_jDOeN1V.2 2024-09-12T00:57:52.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-LUKEWARM.2~Mk4_zA6Aa-1MYXyOhg0WFYg_jDOeN1V.3 2024-09-12T00:57:52.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4650659140120962182', time=2024-09-12T02:50:15.863242+0000, chain.objs.size()=1 2024-09-12T00:57:52.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.7axCEH-jBBtDiH7djbbhMe59iqQtUrM_0 2024-09-12T00:57:52.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12274821693983487550', time=2024-09-12T02:50:54.620296+0000, chain.objs.size()=1 2024-09-12T00:57:52.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.fXE2hiJRkgZM5dm_C_XH6E7At6N8CCv_0 2024-09-12T00:57:52.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6610912242642522766', time=2024-09-12T02:50:54.621093+0000, chain.objs.size()=1 2024-09-12T00:57:52.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.GLJEBtOeUGphtXepObM7TnLAOj8w1rc_0 2024-09-12T00:57:52.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10868956850115165782', time=2024-09-12T02:50:54.670996+0000, chain.objs.size()=1 2024-09-12T00:57:52.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.gsNrZB4qJi6oHWoifJbGJpMBy3jvzx3_0 2024-09-12T00:57:52.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16017661583033301909', time=2024-09-12T02:51:27.891010+0000, chain.objs.size()=1 2024-09-12T00:57:52.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.tZvTFEOH7RHtsFprBtuk_xstDxYWiBe_0 2024-09-12T00:57:52.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14579501931560636261', time=2024-09-12T02:51:27.891720+0000, chain.objs.size()=1 2024-09-12T00:57:52.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.Cqc5_DWtlPeMrI68Gg5M8Bws126-Ocx_0 2024-09-12T00:57:52.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4393333197504097571', time=2024-09-12T02:52:08.620326+0000, chain.objs.size()=1 2024-09-12T00:57:52.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.d3RybwGHvOBtAUcAMqfmEZpszYpl7GS_0 2024-09-12T00:57:52.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15872712911041033320', time=2024-09-12T02:52:44.956577+0000, chain.objs.size()=1 2024-09-12T00:57:52.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.043+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.SBfXzwDtk28WSn35f8d-xkdLaV7msn9_0 2024-09-12T00:57:52.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.045+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11209947630108127073', time=2024-09-12T02:52:44.998094+0000, chain.objs.size()=1 2024-09-12T00:57:52.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.045+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.k9bbkicXPTgbj1B97yF6VhbQ-EkaAX8_0 2024-09-12T00:57:52.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.045+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17600656969449412876', time=2024-09-12T02:52:47.427648+0000, chain.objs.size()=1 2024-09-12T00:57:52.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.045+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.h4XPLUN-s2fpdTqWmTOaPz8af5EgsQ1_0 2024-09-12T00:57:52.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.045+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.205939862426675669', time=2024-09-12T02:53:56.082425+0000, chain.objs.size()=1 2024-09-12T00:57:52.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.045+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.MJfPShJROtisbbFL1P0rW9BZjNTvBaE_0 2024-09-12T00:57:52.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.045+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15338659106543447130', time=2024-09-12T02:53:58.025912+0000, chain.objs.size()=1 2024-09-12T00:57:52.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.045+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.BDe2g2tBQJFHym7QXXu42dWJiIpZiKZ_0 2024-09-12T00:57:52.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.047+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8309691544077022110', time=2024-09-12T02:53:58.756637+0000, chain.objs.size()=1 2024-09-12T00:57:52.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.047+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.teRoMG2l3mCq7aUwbwEfvRP0M2Be4G5_0 2024-09-12T00:57:52.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.047+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16341551514120418355', time=2024-09-12T02:54:33.417354+0000, chain.objs.size()=1 2024-09-12T00:57:52.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.047+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.n0PfUL8xchIiKxousNerT_VRemVhy8N_0 2024-09-12T00:57:52.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.047+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7005234821988726307', time=2024-09-12T02:54:36.694389+0000, chain.objs.size()=1 2024-09-12T00:57:52.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.047+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.iAwlTOcyIicOT3Kfd96_JMa2B6HmaGQ_0 2024-09-12T00:57:52.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.047+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13016179109595489753', time=2024-09-12T02:54:36.725117+0000, chain.objs.size()=1 2024-09-12T00:57:52.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.047+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.aKOFEs-ZEbf3ZkJruHJHQ16giR3CQvi_0 2024-09-12T00:57:52.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.047+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16611655030745894716', time=2024-09-12T02:54:38.687331+0000, chain.objs.size()=1 2024-09-12T00:57:52.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.047+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.FregjRfHnLzudKtZMK8KNLTkyEUKHqw_0 2024-09-12T00:57:52.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.047+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5238040957928458371', time=2024-09-12T02:57:17.746849+0000, chain.objs.size()=1 2024-09-12T00:57:52.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.047+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17__shadow_.P5lDC7ZFusbEGOFAc_Lca6FJ1vCTXnN_0 2024-09-12T00:57:52.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.051+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.056+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:57:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.058+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.058+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-12T00:57:52.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5366260902040912020', time=2024-09-12T02:49:07.415944+0000, chain.objs.size()=4 2024-09-12T00:57:52.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10__multipart_foo.2~euoSQOmOx70Qhx_U5DP6Ip-oNvkG2xe.1 2024-09-12T00:57:52.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10__multipart_foo.2~euoSQOmOx70Qhx_U5DP6Ip-oNvkG2xe.2 2024-09-12T00:57:52.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10__multipart_foo.2~euoSQOmOx70Qhx_U5DP6Ip-oNvkG2xe.3 2024-09-12T00:57:52.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10__multipart_foo.2~euoSQOmOx70Qhx_U5DP6Ip-oNvkG2xe.4 2024-09-12T00:57:52.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15656772392409185089', time=2024-09-12T02:51:27.874422+0000, chain.objs.size()=1 2024-09-12T00:57:52.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.ibFGFGugCE8pQnhCxgq5fWCnpMmjIas_0 2024-09-12T00:57:52.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16308162239352653966', time=2024-09-12T02:51:32.570826+0000, chain.objs.size()=1 2024-09-12T00:57:52.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.ZXVYnGBKgPJR_4hVz6CfD10alfE9No4_0 2024-09-12T00:57:52.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4882989450931112463', time=2024-09-12T02:51:32.577897+0000, chain.objs.size()=1 2024-09-12T00:57:52.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.3BF84XtELrFNUp1e9Ccf8pX2jD_HjrZ_0 2024-09-12T00:57:52.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15861464114687490410', time=2024-09-12T02:52:47.353806+0000, chain.objs.size()=1 2024-09-12T00:57:52.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.8aC7k0pEtYCau8PLK4cx36-LHV_Csje_0 2024-09-12T00:57:52.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12590522338252644610', time=2024-09-12T02:53:22.865034+0000, chain.objs.size()=1 2024-09-12T00:57:52.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.N6v5qFKGZeVb3qAwfUkoAbndYKZ0IlG_0 2024-09-12T00:57:52.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10082439041879125843', time=2024-09-12T02:53:56.002734+0000, chain.objs.size()=1 2024-09-12T00:57:52.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.omDml8ws3oFy4QdcKiIV9mc0eh_0h5T_0 2024-09-12T00:57:52.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10668183461458640451', time=2024-09-12T02:54:31.384789+0000, chain.objs.size()=1 2024-09-12T00:57:52.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.LjOMXNInOk0fej1NNqRL--P47y8ZsoJ_0 2024-09-12T00:57:52.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17354830301196461349', time=2024-09-12T02:54:34.486971+0000, chain.objs.size()=1 2024-09-12T00:57:52.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.059+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.JE3Fg8O6ZrBfh1379Wg67BkvkdanlDk_0 2024-09-12T00:57:52.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.062+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8700864148283559049', time=2024-09-12T02:54:36.719198+0000, chain.objs.size()=1 2024-09-12T00:57:52.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.062+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.W07kA5tEyTi_plazwfXjnG4iyEfmxl4_0 2024-09-12T00:57:52.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.062+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3551401955448091703', time=2024-09-12T02:55:09.984812+0000, chain.objs.size()=1 2024-09-12T00:57:52.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.062+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.zBgUXWgze954y5ezB7-3K8bS5Ob4ZfA_0 2024-09-12T00:57:52.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.067+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.073+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:57:52.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.074+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T00:57:52.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='_-dqO5XVzGyrHodrbdQga0Rk6jLxGaWm', time=2024-09-12T02:49:07.461802+0000, chain.objs.size()=1 2024-09-12T00:57:52.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.IzxRlxgpS_vSAlHbYBy8LywQK7OhdAn_0 2024-09-12T00:57:52.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9572802845818773631', time=2024-09-12T02:49:07.503001+0000, chain.objs.size()=1 2024-09-12T00:57:52.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.xjSTDEET_FrVac4NNWNCnWCrZeNEZdk_0 2024-09-12T00:57:52.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8554692150510671333', time=2024-09-12T02:49:07.537596+0000, chain.objs.size()=3 2024-09-12T00:57:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-LUKEWARM.2~Mk4_zA6Aa-1MYXyOhg0WFYg_jDOeN1V.1 2024-09-12T00:57:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-LUKEWARM.2~Mk4_zA6Aa-1MYXyOhg0WFYg_jDOeN1V.2 2024-09-12T00:57:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-LUKEWARM.2~Mk4_zA6Aa-1MYXyOhg0WFYg_jDOeN1V.3 2024-09-12T00:57:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='_r5h1lrhQhfAdIpAWSKN36ut4LI8zZMo', time=2024-09-12T02:49:07.562080+0000, chain.objs.size()=1 2024-09-12T00:57:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.cPsDBTkQsjhDOQSq16nV1wcFYOkh6vC_0 2024-09-12T00:57:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5987353666561560627', time=2024-09-12T02:50:13.910310+0000, chain.objs.size()=1 2024-09-12T00:57:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.vHaT89WRD1hQP-uq8rPVAUCUeonhPjx_0 2024-09-12T00:57:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16656096111650648325', time=2024-09-12T02:50:18.270629+0000, chain.objs.size()=1 2024-09-12T00:57:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.8upNRyu_IwcBhrV9Iep8Ny9rrRWcF1j_0 2024-09-12T00:57:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18185477347501440249', time=2024-09-12T02:50:52.409260+0000, chain.objs.size()=1 2024-09-12T00:57:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.Wb5jaS9fzpmIuoIR774mHoYIQhwiK6Y_0 2024-09-12T00:57:52.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1803481914397193352', time=2024-09-12T02:50:52.409901+0000, chain.objs.size()=1 2024-09-12T00:57:52.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.05OOw5p-WCCJjvR8RMihtMQBQ4HRjMt_0 2024-09-12T00:57:52.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5937745149806453736', time=2024-09-12T02:51:32.561054+0000, chain.objs.size()=1 2024-09-12T00:57:52.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.5YVAwWKJX76nc6xaasFxVWYufzLX2kt_0 2024-09-12T00:57:52.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11751292978186749658', time=2024-09-12T02:51:34.359830+0000, chain.objs.size()=1 2024-09-12T00:57:52.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.075+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.Sc-Ce2AuWOcsaDIdFhRjz8EQ5f5HRh1_0 2024-09-12T00:57:52.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9734893038227983238', time=2024-09-12T02:52:05.410088+0000, chain.objs.size()=1 2024-09-12T00:57:52.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_._ZvenyLuOAYq8K1c-2Mn1WF6T1I8W5U_0 2024-09-12T00:57:52.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16747349363070454539', time=2024-09-12T02:52:42.061093+0000, chain.objs.size()=1 2024-09-12T00:57:52.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.IpNsX2CkIOhQSnAyFJ3g9lHNA7Bt-pm_0 2024-09-12T00:57:52.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7696373624556875713', time=2024-09-12T02:52:47.375297+0000, chain.objs.size()=1 2024-09-12T00:57:52.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.i-u5q1KIN458IYxN5VWHRXqENU-SZDz_0 2024-09-12T00:57:52.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17314247161905748464', time=2024-09-12T02:53:22.897832+0000, chain.objs.size()=1 2024-09-12T00:57:52.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.KxkGGUBpbV7wnWPU2-6LJYBtqjGPt-F_0 2024-09-12T00:57:52.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10606826223129501356', time=2024-09-12T02:53:22.898623+0000, chain.objs.size()=1 2024-09-12T00:57:52.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.YmUGJ4OB9cnSCB_fI1wMq_v4QzDKr9E_0 2024-09-12T00:57:52.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13188479657334123272', time=2024-09-12T02:53:56.048499+0000, chain.objs.size()=1 2024-09-12T00:57:52.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.mL39mlfxbL6roblpkc8jD9qf8eLKs2O_0 2024-09-12T00:57:52.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13802933248108881889', time=2024-09-12T02:53:56.049181+0000, chain.objs.size()=1 2024-09-12T00:57:52.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.EAIvrf0sQqvVqU4x3LdkHfuRUhV6rK0_0 2024-09-12T00:57:52.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3158627294428511398', time=2024-09-12T02:53:58.765206+0000, chain.objs.size()=1 2024-09-12T00:57:52.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.P7UUooPEG-ZnOTwdfNepuTf5PT9H6IQ_0 2024-09-12T00:57:52.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5720027407044611835', time=2024-09-12T02:54:31.368291+0000, chain.objs.size()=1 2024-09-12T00:57:52.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.080+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.zsLWR55XU7jkapRWT0E-hSt7voiImBB_0 2024-09-12T00:57:52.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.083+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8803222399426575293', time=2024-09-12T02:54:34.555790+0000, chain.objs.size()=1 2024-09-12T00:57:52.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.083+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.59t1-FbA1UIa3DkW22o4X7SOdQIINHA_0 2024-09-12T00:57:52.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.083+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5550992026369943838', time=2024-09-12T02:55:09.947968+0000, chain.objs.size()=1 2024-09-12T00:57:52.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.083+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.U5hvOOTSl_r6k9YETalZ37TZ9Row0N3_0 2024-09-12T00:57:52.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.084+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9577582730852342203', time=2024-09-12T02:57:17.769347+0000, chain.objs.size()=1 2024-09-12T00:57:52.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.084+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17__shadow_.eKWHAuIyRinhxGOM_Z7q3erEfd5EiXg_0 2024-09-12T00:57:52.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.087+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.089+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:57:52.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.091+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.091+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.092+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:57:52.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.092+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='_Lqnr1nAx9Kkim0En_e-28LShik2GDpD', time=2024-09-12T02:49:07.533255+0000, chain.objs.size()=2 2024-09-12T00:57:52.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.092+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.XwlJJHqb8evpLaTRluOuPBWAyJ2JJ5q_0 2024-09-12T00:57:52.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.092+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.XwlJJHqb8evpLaTRluOuPBWAyJ2JJ5q_1 2024-09-12T00:57:52.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.092+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17173448491589145405', time=2024-09-12T02:49:07.655873+0000, chain.objs.size()=1 2024-09-12T00:57:52.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.092+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7__shadow_.NLFLh9SdSDKklBlh_rKJ3kzWOvq-y8h_0 2024-09-12T00:57:52.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.092+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12888014998347330457', time=2024-09-12T02:51:30.609016+0000, chain.objs.size()=1 2024-09-12T00:57:52.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.092+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.ds66FtM3FiWwDXdQm9jnTCIa1DUlDTt_0 2024-09-12T00:57:52.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.092+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.275969493570715548', time=2024-09-12T02:52:08.546542+0000, chain.objs.size()=1 2024-09-12T00:57:52.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.092+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.WZl98QNcm0cd1hbYbAYQPhMly6_Ir2w_0 2024-09-12T00:57:52.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.092+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11302332122489144580', time=2024-09-12T02:54:31.454437+0000, chain.objs.size()=1 2024-09-12T00:57:52.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.092+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.cZyKAdzMAWt-4Cwd_glvW2fLb41PO4f_0 2024-09-12T00:57:52.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.094+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.097+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:57:52.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.098+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:57:52.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8019701876900493203', time=2024-09-12T02:49:07.690338+0000, chain.objs.size()=1 2024-09-12T00:57:52.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8__shadow_.XoXPoxuDWP5PF5fW7pGyR6klAxzSrzk_0 2024-09-12T00:57:52.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12057207142913413205', time=2024-09-12T02:50:13.901112+0000, chain.objs.size()=1 2024-09-12T00:57:52.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.OFI4ZOwK1u6R8gzEFUwXV4NXIZI-9HY_0 2024-09-12T00:57:52.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17299683677127793852', time=2024-09-12T02:50:15.874484+0000, chain.objs.size()=1 2024-09-12T00:57:52.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.YVR7KvHMBcMb1V9qBnzqZg1i01zdZEb_0 2024-09-12T00:57:52.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6738643585304358984', time=2024-09-12T02:50:15.875072+0000, chain.objs.size()=1 2024-09-12T00:57:52.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.j5P1gAL9IO-4zuJCjPs40bcyl3kc3jM_0 2024-09-12T00:57:52.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10854930742965600784', time=2024-09-12T02:50:15.875613+0000, chain.objs.size()=1 2024-09-12T00:57:52.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.rVCi4SMxi69mnE0ai3EGZlWBkBwlVma_0 2024-09-12T00:57:52.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3711936887226629267', time=2024-09-12T02:50:54.619652+0000, chain.objs.size()=1 2024-09-12T00:57:52.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.8QGLQxczKdVPc12PXIi3cb00HkZqc-k_0 2024-09-12T00:57:52.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3003904480283851781', time=2024-09-12T02:51:30.568241+0000, chain.objs.size()=1 2024-09-12T00:57:52.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.ojRYYaQXqz3v6Rnx3St7yOw1VDLCxkJ_0 2024-09-12T00:57:52.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9487216781522256494', time=2024-09-12T02:52:05.448715+0000, chain.objs.size()=1 2024-09-12T00:57:52.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.RuTift1HOcDFdDomXRZTH3EHAybNuUH_0 2024-09-12T00:57:52.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8844421471912248532', time=2024-09-12T02:52:42.041075+0000, chain.objs.size()=1 2024-09-12T00:57:52.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.w4c50p5RcmzFWlN6nvgno6UqRje4smZ_0 2024-09-12T00:57:52.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16257861435023963500', time=2024-09-12T02:52:42.051915+0000, chain.objs.size()=1 2024-09-12T00:57:52.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.xgYgfk3d-OVzEJIscmv-q1ZfEjDefnG_0 2024-09-12T00:57:52.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14553494874285535286', time=2024-09-12T02:52:45.043205+0000, chain.objs.size()=1 2024-09-12T00:57:52.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.Zr5clZs8twKwFOgglsgny-kx2N55UV7_0 2024-09-12T00:57:52.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.099+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4666291487414452990', time=2024-09-12T02:53:21.986117+0000, chain.objs.size()=1 2024-09-12T00:57:52.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.100+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.4fr9Ot_8X9R3Kw2Yi9hJ3ffO3qTXQiw_0 2024-09-12T00:57:52.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.103+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7653790902496747373', time=2024-09-12T02:53:58.698908+0000, chain.objs.size()=1 2024-09-12T00:57:52.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.103+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.o83i2sVCEv5s-vaP1gE1HGdJrV9gKlw_0 2024-09-12T00:57:52.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.103+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3010712110407793256', time=2024-09-12T02:54:34.526048+0000, chain.objs.size()=1 2024-09-12T00:57:52.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.103+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.7QdCKNu95pysn-RQcqg9gBkU1i6GMa3_0 2024-09-12T00:57:52.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.103+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9082115631111717540', time=2024-09-12T02:54:36.750177+0000, chain.objs.size()=1 2024-09-12T00:57:52.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.103+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.5mKWSAUSZ4z3S2oTiCb2wvTYBuJdPPL_0 2024-09-12T00:57:52.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.106+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.109+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:57:52.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.110+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:57:52.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3536156622096272355', time=2024-09-12T02:49:07.453069+0000, chain.objs.size()=1 2024-09-12T00:57:52.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.yhhJEn-Q1yAgiSmbem8pdjRuex-ago__0 2024-09-12T00:57:52.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13786521059648355502', time=2024-09-12T02:49:07.592333+0000, chain.objs.size()=3 2024-09-12T00:57:52.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-STANDARD.2~JjWsQBuNjLr89QMMmnhGsUZJ5aUzRsh.1 2024-09-12T00:57:52.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-STANDARD.2~JjWsQBuNjLr89QMMmnhGsUZJ5aUzRsh.2 2024-09-12T00:57:52.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-STANDARD.2~JjWsQBuNjLr89QMMmnhGsUZJ5aUzRsh.3 2024-09-12T00:57:52.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12668308116110759234', time=2024-09-12T02:49:07.665191+0000, chain.objs.size()=1 2024-09-12T00:57:52.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7__shadow_.XH2grpHFTtgDccjeBl_rXSZnRv-GvQL_0 2024-09-12T00:57:52.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11875670595160956346', time=2024-09-12T02:50:49.751406+0000, chain.objs.size()=1 2024-09-12T00:57:52.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.-9E3gUMPCls2_KZoLPai8kOx46X_mn2_0 2024-09-12T00:57:52.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9326939884808166404', time=2024-09-12T02:50:52.447225+0000, chain.objs.size()=1 2024-09-12T00:57:52.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.7Eo3Au5mYAL7wvz6saSO4kRAOj05iwN_0 2024-09-12T00:57:52.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4546710748644899462', time=2024-09-12T02:51:27.874405+0000, chain.objs.size()=1 2024-09-12T00:57:52.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.McWbtHotI4I4N_Ophpa8k5FN2kyIly9_0 2024-09-12T00:57:52.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9221890944447383473', time=2024-09-12T02:52:07.656617+0000, chain.objs.size()=1 2024-09-12T00:57:52.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.JRnbLCgnR_jUqMPOtm7uVSmfzA1g2Vu_0 2024-09-12T00:57:52.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18327904798126723806', time=2024-09-12T02:52:47.352329+0000, chain.objs.size()=1 2024-09-12T00:57:52.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.nkpD-o3XT7iSSkI39y3v4Yoy92D-Z9N_0 2024-09-12T00:57:52.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.841025213762335203', time=2024-09-12T02:53:22.895710+0000, chain.objs.size()=1 2024-09-12T00:57:52.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.tp2FF6-eqgguXeb4UpK0nBMQkBFI3bu_0 2024-09-12T00:57:52.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16398149251490288754', time=2024-09-12T02:53:58.766227+0000, chain.objs.size()=1 2024-09-12T00:57:52.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.111+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.funSwZlylQjgBwQojZvFC7-J-9QGLyS_0 2024-09-12T00:57:52.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.115+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14676364619521566282', time=2024-09-12T02:54:34.486430+0000, chain.objs.size()=1 2024-09-12T00:57:52.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.115+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.Y4GfCuNSzxeGcS3hgLlKonx4X4cJNFk_0 2024-09-12T00:57:52.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.115+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10861615471638600263', time=2024-09-12T02:54:34.503296+0000, chain.objs.size()=1 2024-09-12T00:57:52.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.115+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.Wdz_DbAR_eoRw-As4K-sKgVKWIgkShY_0 2024-09-12T00:57:52.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.115+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5344288854234702978', time=2024-09-12T02:54:34.556462+0000, chain.objs.size()=1 2024-09-12T00:57:52.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.115+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.yDDL0sl_CHfkIezX340bYQofye-5kyJ_0 2024-09-12T00:57:52.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.115+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9494871911962522572', time=2024-09-12T02:54:36.671403+0000, chain.objs.size()=1 2024-09-12T00:57:52.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.115+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.2I08c81E5-fJUbxTuKlCw1dSKRXWq-o_0 2024-09-12T00:57:52.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.118+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.120+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:57:52.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.122+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.122+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:57:52.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='_9BZ04eS7qA_fslWWoOfHE6qHnpYvr5z', time=2024-09-12T02:49:07.485481+0000, chain.objs.size()=1 2024-09-12T00:57:52.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.nS7h-1bH5kpb7knIt5M7b-Nerrgx-ut_0 2024-09-12T00:57:52.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3958289044545462600', time=2024-09-12T02:50:13.854918+0000, chain.objs.size()=1 2024-09-12T00:57:52.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.BwhlRy4JKz4l_grFLoaU9aFvlcO3R7R_0 2024-09-12T00:57:52.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17202471468435618104', time=2024-09-12T02:50:13.910312+0000, chain.objs.size()=1 2024-09-12T00:57:52.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.XZMaPLucEkLl4dHQiO5_dLWxkLP9i6N_0 2024-09-12T00:57:52.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17713205906965204005', time=2024-09-12T02:52:05.410063+0000, chain.objs.size()=1 2024-09-12T00:57:52.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.zMVtrrGnKuf9gFFI6tVeANi4gpfk6Hz_0 2024-09-12T00:57:52.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16332774789290992666', time=2024-09-12T02:52:05.410927+0000, chain.objs.size()=1 2024-09-12T00:57:52.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.Ef72UhI5IL-nm9IaOoDuPxKi7pXWEFf_0 2024-09-12T00:57:52.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13213741564164489624', time=2024-09-12T02:52:45.049666+0000, chain.objs.size()=1 2024-09-12T00:57:52.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.dTB5tkGw_jP8y7sVycHKQN0XYe9PDOE_0 2024-09-12T00:57:52.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17544104361801579078', time=2024-09-12T02:53:20.010600+0000, chain.objs.size()=1 2024-09-12T00:57:52.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.vH9pysftz3HNWK7BPbQaBop9dHomMC-_0 2024-09-12T00:57:52.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12049414984764242103', time=2024-09-12T02:53:20.041997+0000, chain.objs.size()=1 2024-09-12T00:57:52.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.Vkt9Fw4gxCyGdThqgCBjGjSvjKPAg1L_0 2024-09-12T00:57:52.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17550356998350914980', time=2024-09-12T02:53:22.937670+0000, chain.objs.size()=1 2024-09-12T00:57:52.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.4XUGrXXIrfmM26qrxJNVxBpLR9toTJR_0 2024-09-12T00:57:52.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16672350033622789518', time=2024-09-12T02:53:22.946204+0000, chain.objs.size()=1 2024-09-12T00:57:52.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.LAo7qcKR0FHaYl8SkK2FaFw8zhI1BjH_0 2024-09-12T00:57:52.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6064151916336312783', time=2024-09-12T02:53:56.006244+0000, chain.objs.size()=1 2024-09-12T00:57:52.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.KGYlwXwjnlDxRztyXJZuUqEgVXelwcb_0 2024-09-12T00:57:52.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6653724942673680135', time=2024-09-12T02:54:31.385045+0000, chain.objs.size()=1 2024-09-12T00:57:52.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.123+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.8bttXDjJl2KSGMBwuwiOIqPfY5BgXl6_0 2024-09-12T00:57:52.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.125+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7181725134521413104', time=2024-09-12T02:54:36.756732+0000, chain.objs.size()=1 2024-09-12T00:57:52.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.125+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.0ONySpM_1qQWMBk5XaSdmqUd3bbQcYs_0 2024-09-12T00:57:52.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.129+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.131+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:57:52.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.132+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:57:52.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15370542712908517411', time=2024-09-12T02:49:07.349883+0000, chain.objs.size()=1 2024-09-12T00:57:52.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.n4Y2BoW11WBv_m5xN32QK7aUrSS1nti_0 2024-09-12T00:57:52.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10115956217478886812', time=2024-09-12T02:50:13.909348+0000, chain.objs.size()=1 2024-09-12T00:57:52.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.-XthJAixgkS3A_rildBIRNNfQsbPBvC_0 2024-09-12T00:57:52.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14906113044224434734', time=2024-09-12T02:50:15.823185+0000, chain.objs.size()=1 2024-09-12T00:57:52.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.Kx9elJEB0kSyE-8Rg_MXDpm35BRV6rt_0 2024-09-12T00:57:52.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9412486501668862384', time=2024-09-12T02:50:52.447912+0000, chain.objs.size()=1 2024-09-12T00:57:52.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.t8MToNj2yUAzDTr6q6sV2b5DOVk-s6w_0 2024-09-12T00:57:52.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15121342598471259649', time=2024-09-12T02:50:56.597328+0000, chain.objs.size()=1 2024-09-12T00:57:52.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.GraVo9mwdw3XwuIbnj107RRFWhZLJlH_0 2024-09-12T00:57:52.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17142174964332800600', time=2024-09-12T02:51:30.582968+0000, chain.objs.size()=1 2024-09-12T00:57:52.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.c7HJjWKygD0OTYlzhOfOTlheUWGDNhj_0 2024-09-12T00:57:52.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17024155666700239656', time=2024-09-12T02:52:08.546528+0000, chain.objs.size()=1 2024-09-12T00:57:52.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.gF4KirkvhnKjjISLwpD1Wu4JVLJd0FN_0 2024-09-12T00:57:52.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18224759745767687004', time=2024-09-12T02:52:42.089783+0000, chain.objs.size()=1 2024-09-12T00:57:52.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.q1z1nKbCvVA6X3CRh6saHNSPWUXvxLc_0 2024-09-12T00:57:52.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9012995749879633375', time=2024-09-12T02:52:44.960552+0000, chain.objs.size()=1 2024-09-12T00:57:52.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.v1-4SKc07nX2tvQoKsnJWKsdPE9nP37_0 2024-09-12T00:57:52.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1396083997219533280', time=2024-09-12T02:52:44.988340+0000, chain.objs.size()=1 2024-09-12T00:57:52.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.D-HYIwWa2F7ht9Uffgqz5E9CobviX5X_0 2024-09-12T00:57:52.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13453776236862807814', time=2024-09-12T02:53:56.038366+0000, chain.objs.size()=1 2024-09-12T00:57:52.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.bSGb4Vryz4WULMsKGjqA9HnJHwnzGdr_0 2024-09-12T00:57:52.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13927290004263704942', time=2024-09-12T02:53:56.091881+0000, chain.objs.size()=1 2024-09-12T00:57:52.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.133+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.PZBoF09EieHr06LKWDUF6jlv2b8nESE_0 2024-09-12T00:57:52.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.137+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13610316149925872405', time=2024-09-12T02:54:31.393845+0000, chain.objs.size()=1 2024-09-12T00:57:52.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.137+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.8JPNgWklMXls57H2_7QSy73YjnDjL0E_0 2024-09-12T00:57:52.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.137+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2327304721790984588', time=2024-09-12T02:54:34.580690+0000, chain.objs.size()=1 2024-09-12T00:57:52.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.137+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.p3qXCYNVdbI-gvztCRyHxCaWUj8b1wq_0 2024-09-12T00:57:52.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.137+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9195692662994445113', time=2024-09-12T02:55:09.914884+0000, chain.objs.size()=1 2024-09-12T00:57:52.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.137+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.Lp3zmP74OeDfo88LCXX57z37DYC0VIr_0 2024-09-12T00:57:52.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.137+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11384531887811144277', time=2024-09-12T02:55:10.021938+0000, chain.objs.size()=1 2024-09-12T00:57:52.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.137+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.1sv5Bcjxr93NgBuLJYjfvUtU4M1ROoY_0 2024-09-12T00:57:52.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.137+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8427111283205576825', time=2024-09-12T02:57:17.789144+0000, chain.objs.size()=1 2024-09-12T00:57:52.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.137+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17__shadow_.4kAkKgi1H4kHjpmvS0moKtjldu1TlnZ_0 2024-09-12T00:57:52.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.137+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16943884545765191465', time=2024-09-12T02:57:26.397824+0000, chain.objs.size()=1 2024-09-12T00:57:52.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.137+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18__shadow:t6yjclzvOe7j9Ro3iOAUVXK2DhCR6RL_.lnQwh84yOpFNf_UzaP8R_dN24zQtqtb_0 2024-09-12T00:57:52.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.142+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.148+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:57:52.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.150+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.150+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T00:57:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8108739569282808493', time=2024-09-12T02:50:52.409343+0000, chain.objs.size()=1 2024-09-12T00:57:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.UcSvjNO4q79_mlX03xP4JR00Hfmbj-3_0 2024-09-12T00:57:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8068839350168703197', time=2024-09-12T02:52:05.423893+0000, chain.objs.size()=1 2024-09-12T00:57:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.wbNMUhmfb7Fx6Y9YjPo5AIfxj-8O5hc_0 2024-09-12T00:57:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15933094262886748854', time=2024-09-12T02:52:05.445090+0000, chain.objs.size()=1 2024-09-12T00:57:52.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.x0f-2RoApssW_HH2prLFfmIe9SCl6-d_0 2024-09-12T00:57:52.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12246124222370711485', time=2024-09-12T02:52:42.019714+0000, chain.objs.size()=1 2024-09-12T00:57:52.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.9tyfeTnvbpp2UbsMetvZ_IkzXDt3WnL_0 2024-09-12T00:57:52.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14165264360732279578', time=2024-09-12T02:53:20.005668+0000, chain.objs.size()=1 2024-09-12T00:57:52.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.9OmNoid7_pZrTyvMDNGc-jJ9qaGGrSM_0 2024-09-12T00:57:52.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8442798112585560243', time=2024-09-12T02:54:31.444855+0000, chain.objs.size()=1 2024-09-12T00:57:52.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.8rmL99AQw8UML7Zf2_HjOZYjzIOhTzm_0 2024-09-12T00:57:52.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1506633364850911672', time=2024-09-12T02:55:10.012655+0000, chain.objs.size()=1 2024-09-12T00:57:52.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.YfJdboV6nJ94yOQ1-T5tMeyAkXfNHnL_0 2024-09-12T00:57:52.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15718210151267809419', time=2024-09-12T02:55:10.013445+0000, chain.objs.size()=1 2024-09-12T00:57:52.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.151+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.fBvMU-IR7pMjg0eUpMA83DIKv8FeNjB_0 2024-09-12T00:57:52.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.156+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.158+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:57:52.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.159+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T00:57:52.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='_pyzrXbyp8dd2TIAZEPx0U1o9gzVBSpl', time=2024-09-12T02:49:07.466049+0000, chain.objs.size()=1 2024-09-12T00:57:52.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.9oXkdxjIaWodtqrm3fi5grNd4dIh6Gk_0 2024-09-12T00:57:52.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10193902527438398157', time=2024-09-12T02:49:07.616008+0000, chain.objs.size()=1 2024-09-12T00:57:52.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13__shadow_.ARuxeCy9MxM17bLf0xxEPKc9_dFFqzt_0 2024-09-12T00:57:52.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8941652679540948777', time=2024-09-12T02:50:15.857522+0000, chain.objs.size()=1 2024-09-12T00:57:52.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.fWuA5arqqEbWef1j-6IhugTHli0aqF0_0 2024-09-12T00:57:52.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13299015933802740176', time=2024-09-12T02:50:15.923848+0000, chain.objs.size()=1 2024-09-12T00:57:52.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.GQZypMN0kwVrPtn09Kboccf7Xv7IlQZ_0 2024-09-12T00:57:52.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17431907425380056891', time=2024-09-12T02:50:49.746692+0000, chain.objs.size()=1 2024-09-12T00:57:52.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.cDRPOOpUo6kVtBHSnpoYYT4iQLKU74N_0 2024-09-12T00:57:52.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9770899136787916119', time=2024-09-12T02:51:27.870680+0000, chain.objs.size()=1 2024-09-12T00:57:52.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.XkHyIL4R27ZQDbZvGGNgCfPPyt3csp2_0 2024-09-12T00:57:52.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1821474789893772108', time=2024-09-12T02:51:27.871290+0000, chain.objs.size()=1 2024-09-12T00:57:52.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.IsOqOvZPuXSW3JFoyrVHBXsxOJpGBM0_0 2024-09-12T00:57:52.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5304054617195122162', time=2024-09-12T02:51:27.871944+0000, chain.objs.size()=1 2024-09-12T00:57:52.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.aDwzUMXbJHRfZVINSVmUUaGGKilD8Ak_0 2024-09-12T00:57:52.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8329953696187406326', time=2024-09-12T02:51:32.588367+0000, chain.objs.size()=1 2024-09-12T00:57:52.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.gB2nAUQ1IpD-mK1yiPU1yzOEXZ_KTfp_0 2024-09-12T00:57:52.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14738206885860535404', time=2024-09-12T02:51:32.589454+0000, chain.objs.size()=1 2024-09-12T00:57:52.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.gyMMhAzCtOWgf6kFZi6GUflMIPodCQD_0 2024-09-12T00:57:52.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5540233366929825448', time=2024-09-12T02:51:32.589965+0000, chain.objs.size()=1 2024-09-12T00:57:52.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.JfyQBA24bn6Rma57QcHcnVHnzhZ4E45_0 2024-09-12T00:57:52.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1296444866052764183', time=2024-09-12T02:53:20.039045+0000, chain.objs.size()=1 2024-09-12T00:57:52.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.160+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.lbMMGXzsPm_DuqgI5_0sQWYYfUFoCOA_0 2024-09-12T00:57:52.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.163+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1115294005086682024', time=2024-09-12T02:53:58.761320+0000, chain.objs.size()=1 2024-09-12T00:57:52.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.163+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.ud2Hs4ssUSS49gOmEJSgyrg5oR8bMIT_0 2024-09-12T00:57:52.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.163+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12230326105222235895', time=2024-09-12T02:54:31.394964+0000, chain.objs.size()=1 2024-09-12T00:57:52.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.163+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.1zR1aWPWK7tGLWYu1Bl0LpNFwqD82He_0 2024-09-12T00:57:52.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.164+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9068271372153012129', time=2024-09-12T02:55:10.017856+0000, chain.objs.size()=1 2024-09-12T00:57:52.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.164+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.ZDtDTbdBWRqMZmj9ULvYxsz9ojvifHj_0 2024-09-12T00:57:52.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.164+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18368094270519378643', time=2024-09-12T02:57:17.737602+0000, chain.objs.size()=1 2024-09-12T00:57:52.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.164+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17__shadow_.f2TBSRrBhurRl7FGmgy5axVYZqpNkv9_0 2024-09-12T00:57:52.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.169+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.171+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:57:52.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.173+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.173+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.173+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:57:52.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.173+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5700943695807861787', time=2024-09-12T02:49:07.332847+0000, chain.objs.size()=1 2024-09-12T00:57:52.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.173+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.2mAwp8GjCMQ95j9_bTwsO4QVVsgf-8V_0 2024-09-12T00:57:52.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.173+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2527009589384545750', time=2024-09-12T02:49:07.362944+0000, chain.objs.size()=1 2024-09-12T00:57:52.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.173+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.HB3mu3Da1xl7hDzRvZjyljdBA4k06Md_0 2024-09-12T00:57:52.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.173+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14268535235142857650', time=2024-09-12T02:49:07.587660+0000, chain.objs.size()=3 2024-09-12T00:57:52.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.173+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-LUKEWARM.2~A2nT8XLuBvIajTphgGTvC0TUzWnk50c.1 2024-09-12T00:57:52.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.173+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-LUKEWARM.2~A2nT8XLuBvIajTphgGTvC0TUzWnk50c.2 2024-09-12T00:57:52.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.173+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-LUKEWARM.2~A2nT8XLuBvIajTphgGTvC0TUzWnk50c.3 2024-09-12T00:57:52.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.173+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17083180691619763608', time=2024-09-12T02:51:27.891643+0000, chain.objs.size()=1 2024-09-12T00:57:52.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.173+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.RHjkQtNukZth7e1W-tGRRRq1OFLQJul_0 2024-09-12T00:57:52.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.173+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13809456811167884624', time=2024-09-12T02:51:27.892444+0000, chain.objs.size()=1 2024-09-12T00:57:52.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.174+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.vVxK6fMigSRZGlnozTn6N2LSwkpcxan_0 2024-09-12T00:57:52.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.174+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2735217706214828057', time=2024-09-12T02:51:27.938160+0000, chain.objs.size()=1 2024-09-12T00:57:52.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.174+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.Sq5aQT0vMK2CfHdKttw3RBJw3tXolCm_0 2024-09-12T00:57:52.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.174+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6849509165934957073', time=2024-09-12T02:52:05.409754+0000, chain.objs.size()=1 2024-09-12T00:57:52.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.174+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.D5f-XhlBGsKxAY64DIRE08sxENnD7uE_0 2024-09-12T00:57:52.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.174+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.860349258217281840', time=2024-09-12T02:52:05.445076+0000, chain.objs.size()=1 2024-09-12T00:57:52.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.174+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.lsPPGWYNdBajEyleoK22dzAXhKG84Um_0 2024-09-12T00:57:52.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.174+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.143699741563748343', time=2024-09-12T02:52:05.449110+0000, chain.objs.size()=1 2024-09-12T00:57:52.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.174+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.32WG7P9UweUPlLsKrulpamrek-urxna_0 2024-09-12T00:57:52.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.174+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14971858272376941272', time=2024-09-12T02:52:08.559093+0000, chain.objs.size()=1 2024-09-12T00:57:52.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.174+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.a-38ZfwAboNeWRgMseikphwKQ_mS8jB_0 2024-09-12T00:57:52.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.176+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2807259487300934347', time=2024-09-12T02:52:08.598455+0000, chain.objs.size()=1 2024-09-12T00:57:52.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.176+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.JtN9MLyIa_VYGM_d-IEiS3rD60VC6P2_0 2024-09-12T00:57:52.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.176+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4396982694134151497', time=2024-09-12T02:52:08.599578+0000, chain.objs.size()=1 2024-09-12T00:57:52.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.176+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.IHKrwOaLGa3QdG04idBYQO3a20DIond_0 2024-09-12T00:57:52.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.178+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17729346900478523740', time=2024-09-12T02:52:45.022037+0000, chain.objs.size()=1 2024-09-12T00:57:52.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.178+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.sA9wMWU4J9FMhFP1n-342t_FTwGDaa4_0 2024-09-12T00:57:52.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.178+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13428979725593146969', time=2024-09-12T02:53:19.962295+0000, chain.objs.size()=1 2024-09-12T00:57:52.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.178+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.PSaNFymSvFhnY24Ovgq7_bxTAyR4CIk_0 2024-09-12T00:57:52.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.178+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522735931644472082', time=2024-09-12T02:53:19.962853+0000, chain.objs.size()=1 2024-09-12T00:57:52.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.178+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.bUtlfSGvEovBn95U8hUhc8KH3aB042l_0 2024-09-12T00:57:52.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.178+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6684306461531500255', time=2024-09-12T02:53:22.854660+0000, chain.objs.size()=1 2024-09-12T00:57:52.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.178+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.-aIpmR4RtvZ7r77F952J6pXim9EfrIa_0 2024-09-12T00:57:52.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.178+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4190939438150665690', time=2024-09-12T02:53:22.883600+0000, chain.objs.size()=1 2024-09-12T00:57:52.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.178+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.sCVvJ93oBCrGzbTPWnXKOQ4lxOE7caC_0 2024-09-12T00:57:52.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.178+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2326615410653045677', time=2024-09-12T02:54:36.763485+0000, chain.objs.size()=1 2024-09-12T00:57:52.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.178+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.nwvVUpC7utl_O9g37AAMNMRp7C1wuYy_0 2024-09-12T00:57:52.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.181+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.184+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:57:52.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.185+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:57:52.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5326918768902047811', time=2024-09-12T02:49:07.490573+0000, chain.objs.size()=1 2024-09-12T00:57:52.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.xjSTDEET_FrVac4NNWNCnWCrZeNEZdk_0 2024-09-12T00:57:52.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11205100090220287189', time=2024-09-12T02:50:13.865433+0000, chain.objs.size()=1 2024-09-12T00:57:52.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.xlKe3n-SpAvkgmdBLjtnJNjANYwB2VF_0 2024-09-12T00:57:52.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4667592217701400049', time=2024-09-12T02:50:15.840325+0000, chain.objs.size()=1 2024-09-12T00:57:52.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.6A8sWKp1_7wVk2YgDAGevH1OQzKgdhi_0 2024-09-12T00:57:52.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1362556386915071184', time=2024-09-12T02:50:15.926992+0000, chain.objs.size()=1 2024-09-12T00:57:52.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.Je23hwBSqJWhxGFYD4V70qFXRurg8N8_0 2024-09-12T00:57:52.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11711993737074450024', time=2024-09-12T02:50:52.403847+0000, chain.objs.size()=1 2024-09-12T00:57:52.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.BdKql7FK7nti_upeYLRYtqrPanqgYfJ_0 2024-09-12T00:57:52.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16553103832473837943', time=2024-09-12T02:51:27.893759+0000, chain.objs.size()=1 2024-09-12T00:57:52.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.gkhQ_WDOxZEUzFJDM3-sqiSu7P_mcRA_0 2024-09-12T00:57:52.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15682934593707012596', time=2024-09-12T02:51:27.929331+0000, chain.objs.size()=1 2024-09-12T00:57:52.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.Zn3D5byaHFu6C95FTJlMloCz6QV2vKM_0 2024-09-12T00:57:52.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1633505627873997517', time=2024-09-12T02:51:30.609233+0000, chain.objs.size()=1 2024-09-12T00:57:52.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.JAD9tS0D7M-R44guGp0QnzojS_xYKcN_0 2024-09-12T00:57:52.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16188447032694735391', time=2024-09-12T02:51:30.651064+0000, chain.objs.size()=1 2024-09-12T00:57:52.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.NLP073TaSno_z_JfEEkl22l4OkizRDo_0 2024-09-12T00:57:52.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14980118400939877834', time=2024-09-12T02:52:08.600421+0000, chain.objs.size()=1 2024-09-12T00:57:52.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.Qvi24x1nM0jqzpwf1NIas6--gjH7yRf_0 2024-09-12T00:57:52.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12471297755990753386', time=2024-09-12T02:52:42.040890+0000, chain.objs.size()=1 2024-09-12T00:57:52.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.SiRnkr1Q6h9hC61dHxXkzOls7KMMBPa_0 2024-09-12T00:57:52.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18171099076047571881', time=2024-09-12T02:52:44.998144+0000, chain.objs.size()=1 2024-09-12T00:57:52.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.186+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.dkDZqGpj5IlwLJ-3oX20SV1x3YmZ3Lv_0 2024-09-12T00:57:52.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.190+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14107932723672564629', time=2024-09-12T02:52:45.022821+0000, chain.objs.size()=1 2024-09-12T00:57:52.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.190+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.w_yrBsqoEJeEflEBByZn9Iwkx5dHMFv_0 2024-09-12T00:57:52.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.190+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.106779991083536647', time=2024-09-12T02:53:20.023238+0000, chain.objs.size()=1 2024-09-12T00:57:52.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.190+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.SsZvphh3zOTcwP5VdlZ3YEEQD3SLIE1_0 2024-09-12T00:57:52.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.190+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13676502317903942492', time=2024-09-12T02:53:58.756639+0000, chain.objs.size()=1 2024-09-12T00:57:52.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.190+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.8w18Md8wPY16TtOAH9OKQdMRn7xFoqp_0 2024-09-12T00:57:52.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.190+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15092066396961371002', time=2024-09-12T02:53:58.807750+0000, chain.objs.size()=1 2024-09-12T00:57:52.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.190+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.D9GIEsM2p3ecUqP8h34DRmanwrDdpif_0 2024-09-12T00:57:52.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.191+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3192330585302548871', time=2024-09-12T02:54:31.451206+0000, chain.objs.size()=1 2024-09-12T00:57:52.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.191+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.IUoDT6e-gxSAJj-NmbP2Q0TJYep-9JC_0 2024-09-12T00:57:52.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.191+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17931380736608498756', time=2024-09-12T02:55:09.996826+0000, chain.objs.size()=1 2024-09-12T00:57:52.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.191+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.B54FPSJFTW9dRh5Z9NwtETTi3OqqR6W_0 2024-09-12T00:57:52.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.196+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.201+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:57:52.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.202+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:57:52.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11421859553854936482', time=2024-09-12T02:49:07.660962+0000, chain.objs.size()=1 2024-09-12T00:57:52.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7__shadow_.t6kDp09bK6AYxdhgVLuiqCQDZTyqkj1_0 2024-09-12T00:57:52.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14228236543024663686', time=2024-09-12T02:49:07.686402+0000, chain.objs.size()=1 2024-09-12T00:57:52.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8__shadow_.MsocIzsSjR1Gr8qNBkcYF5zrCrPYVUG_0 2024-09-12T00:57:52.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18266250618467447042', time=2024-09-12T02:50:49.748276+0000, chain.objs.size()=1 2024-09-12T00:57:52.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.N6eRGRb2fk7yFP6kMrC5iGs3rdJaU8n_0 2024-09-12T00:57:52.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14170781648028948349', time=2024-09-12T02:50:49.750888+0000, chain.objs.size()=1 2024-09-12T00:57:52.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.1eMPOwIJ9ZSAHN8jk1LhFn5Y-ZHFV3G_0 2024-09-12T00:57:52.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3418244836926390403', time=2024-09-12T02:50:52.428887+0000, chain.objs.size()=1 2024-09-12T00:57:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.KyMfO1A8WCsjpS1mTQiyZvWa9gR-fEr_0 2024-09-12T00:57:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10398627555301229055', time=2024-09-12T02:51:30.598937+0000, chain.objs.size()=1 2024-09-12T00:57:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.eKYhXAyUy6X-epOERKzx_B_iigyAoAf_0 2024-09-12T00:57:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16032857532464704069', time=2024-09-12T02:51:32.591921+0000, chain.objs.size()=1 2024-09-12T00:57:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.Y3VvQr54QTbE31EdRRAJ9671nYs0UW-_0 2024-09-12T00:57:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18199401727554546637', time=2024-09-12T02:51:32.594157+0000, chain.objs.size()=1 2024-09-12T00:57:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.-zaWP9GIeRPOJlhl99tGO5O32wMEkRO_0 2024-09-12T00:57:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8261077133199165226', time=2024-09-12T02:51:32.594671+0000, chain.objs.size()=1 2024-09-12T00:57:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.OIvf1lHySlKVqqNYyFBvG5KghN6SgPV_0 2024-09-12T00:57:52.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5589768389776912514', time=2024-09-12T02:52:08.600348+0000, chain.objs.size()=1 2024-09-12T00:57:52.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.dHVSGUh89HVB2VsBuOkys7M7Aav-H-u_0 2024-09-12T00:57:52.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6791035874684351040', time=2024-09-12T02:52:42.099143+0000, chain.objs.size()=1 2024-09-12T00:57:52.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.jMS2WFympubP9UTKSDEWkdeE2V37886_0 2024-09-12T00:57:52.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6121912273943980099', time=2024-09-12T02:52:44.967699+0000, chain.objs.size()=1 2024-09-12T00:57:52.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.203+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.153Lj_L-SWvgPyvBUSYQFPgegtrvVyE_0 2024-09-12T00:57:52.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.206+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7961007573493249416', time=2024-09-12T02:52:44.968317+0000, chain.objs.size()=1 2024-09-12T00:57:52.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.206+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.nD9GsCwjWnx6ggA8K8CCUHLE9RN_cYY_0 2024-09-12T00:57:52.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.208+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10577436968605748171', time=2024-09-12T02:52:44.984518+0000, chain.objs.size()=1 2024-09-12T00:57:52.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.208+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_._Y4AsAucJK-kL4pgIqGBHE-02XdqWlJ_0 2024-09-12T00:57:52.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.208+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12846616281334526814', time=2024-09-12T02:55:09.985393+0000, chain.objs.size()=1 2024-09-12T00:57:52.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.208+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.NWuKdI0k9U-FDqpUnBJHOxCzd8-H8tf_0 2024-09-12T00:57:52.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.214+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.216+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:57:52.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.217+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:57:52.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2464166650111924541', time=2024-09-12T02:49:07.345757+0000, chain.objs.size()=1 2024-09-12T00:57:52.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.JT0_XY812qqaQNjc9st_deu9eUJc-S__0 2024-09-12T00:57:52.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8657026134898551871', time=2024-09-12T02:50:13.903652+0000, chain.objs.size()=1 2024-09-12T00:57:52.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.g5Sr7qiUZgfIdQvbrGkhg1TRhNvtj96_0 2024-09-12T00:57:52.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13407380312065576099', time=2024-09-12T02:50:15.828341+0000, chain.objs.size()=1 2024-09-12T00:57:52.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.omk8LqQj3tNtD42DDGp-__T_2lxGtzT_0 2024-09-12T00:57:52.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1343955627055229918', time=2024-09-12T02:50:49.750716+0000, chain.objs.size()=1 2024-09-12T00:57:52.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.8YXZnG6z4E0T6i9jZK2OKpKwot-fXfV_0 2024-09-12T00:57:52.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2475122553173666881', time=2024-09-12T02:51:27.872765+0000, chain.objs.size()=1 2024-09-12T00:57:52.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.d4a3i7L7_LZ_XEhAZB0sV4RT1yc-eLa_0 2024-09-12T00:57:52.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9498936909127757003', time=2024-09-12T02:51:32.592029+0000, chain.objs.size()=1 2024-09-12T00:57:52.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.bWtNpwqP8E8NdCN70wz9Fq1WGfqsoQy_0 2024-09-12T00:57:52.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4197736165414807284', time=2024-09-12T02:51:32.627772+0000, chain.objs.size()=1 2024-09-12T00:57:52.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.U9gI6Oh35XODo8JoR8y0igWqc2Cd5G1_0 2024-09-12T00:57:52.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7867688695075079379', time=2024-09-12T02:53:19.967761+0000, chain.objs.size()=1 2024-09-12T00:57:52.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.LtJ3zjVJPpcyQN97g7lWPifuI6IKctH_0 2024-09-12T00:57:52.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8582375372691931445', time=2024-09-12T02:53:20.044522+0000, chain.objs.size()=1 2024-09-12T00:57:52.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.OvNm8pX2OZ9xKnmJ8bv5Gm738n_Rkdy_0 2024-09-12T00:57:52.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11530739173311492495', time=2024-09-12T02:54:00.322360+0000, chain.objs.size()=1 2024-09-12T00:57:52.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.tOdGGOYIuwBBR7v4yujnWRuOsJ5ge_Y_0 2024-09-12T00:57:52.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4203424651447606021', time=2024-09-12T02:54:31.414828+0000, chain.objs.size()=1 2024-09-12T00:57:52.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.7Nnxk-rf6iGpLQSIhfbOdsEOWZ5x72K_0 2024-09-12T00:57:52.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.974120217980933931', time=2024-09-12T02:54:31.416112+0000, chain.objs.size()=1 2024-09-12T00:57:52.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.218+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.qCLqLUoNV0AqIzi3T1m0dCY5VtgmyEh_0 2024-09-12T00:57:52.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.225+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.227+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:57:52.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.228+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-12T00:57:52.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10116059046243094617', time=2024-09-12T02:49:07.358575+0000, chain.objs.size()=1 2024-09-12T00:57:52.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.bqWlL06xN0HwJ3lKR2KGibcAOKAOz9g_0 2024-09-12T00:57:52.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1380286588746223986', time=2024-09-12T02:49:07.481237+0000, chain.objs.size()=1 2024-09-12T00:57:52.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.8EyjqqUeTiv9Banl1MxllmsT8C2Ujkd_0 2024-09-12T00:57:52.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='_kAgdZGJY3_smvrFW1147MA2nFVqHoCL', time=2024-09-12T02:49:07.541807+0000, chain.objs.size()=2 2024-09-12T00:57:52.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.JBqCoEfzWyBt9a3U-5vdNAoIq90ngVO_0 2024-09-12T00:57:52.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.JBqCoEfzWyBt9a3U-5vdNAoIq90ngVO_1 2024-09-12T00:57:52.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13729088189417269327', time=2024-09-12T02:50:13.905266+0000, chain.objs.size()=1 2024-09-12T00:57:52.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.HXwMss3TrKUvwn3BoeJWBb6AO96qrii_0 2024-09-12T00:57:52.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10515010442555999992', time=2024-09-12T02:50:15.881696+0000, chain.objs.size()=1 2024-09-12T00:57:52.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.Jv2RheiaPP4PrC-UhyM6S-tepc_2Msb_0 2024-09-12T00:57:52.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17100920623775468953', time=2024-09-12T02:51:27.872667+0000, chain.objs.size()=1 2024-09-12T00:57:52.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.ISABZK8WlslUKu-3Dbl-hSQpL4OzRGq_0 2024-09-12T00:57:52.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16153620122338611128', time=2024-09-12T02:51:29.676799+0000, chain.objs.size()=1 2024-09-12T00:57:52.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.VZ4osmXseGAkEjm-_UVbQUOFgsGPPGd_0 2024-09-12T00:57:52.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14253528594318905605', time=2024-09-12T02:52:47.423461+0000, chain.objs.size()=1 2024-09-12T00:57:52.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.0ASJJL_mjl30C-dkGBzNeAmjVmOB9g5_0 2024-09-12T00:57:52.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11599155501182616647', time=2024-09-12T02:53:22.899311+0000, chain.objs.size()=1 2024-09-12T00:57:52.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.ydJelSsCupt9QUpq39B8SAHVBbqsf0a_0 2024-09-12T00:57:52.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9606391395743590508', time=2024-09-12T02:53:56.008838+0000, chain.objs.size()=1 2024-09-12T00:57:52.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.8l9-fIILYE0OBOQfzhO8pQUjImu9N6b_0 2024-09-12T00:57:52.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10132566233681177171', time=2024-09-12T02:53:58.761371+0000, chain.objs.size()=1 2024-09-12T00:57:52.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.229+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.phdvLdTNjq7aW3XNM-pV-4hAAd3cmsd_0 2024-09-12T00:57:52.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.233+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7527263351951409794', time=2024-09-12T02:54:34.501818+0000, chain.objs.size()=1 2024-09-12T00:57:52.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.233+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.kC4iYVTgw85orpj4Td6nRgXQqX31ZW0_0 2024-09-12T00:57:52.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.233+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.75640096337880673', time=2024-09-12T02:54:36.706002+0000, chain.objs.size()=1 2024-09-12T00:57:52.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.233+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.Gl7jCTqS7Meh2YD-K87kYbvI-3Wq8hu_0 2024-09-12T00:57:52.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.235+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15120825263464597884', time=2024-09-12T02:54:36.728399+0000, chain.objs.size()=1 2024-09-12T00:57:52.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.235+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.9ql9OYowX7wp9e5LVb-zyWUx3A0Caa5_0 2024-09-12T00:57:52.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.237+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.239+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:57:52.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T00:57:52.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='_VjHYNoitpObpChx0ev8j_dXn5E00VVH', time=2024-09-12T02:49:07.475836+0000, chain.objs.size()=1 2024-09-12T00:57:52.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.6IXEtS1Ed_BYPuPivzGqy3cVgYgSfEA_0 2024-09-12T00:57:52.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16542217308709247480', time=2024-09-12T02:50:49.755233+0000, chain.objs.size()=1 2024-09-12T00:57:52.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.IwthkTd1Q9Ca6YwG__sok-U2RiryZy0_0 2024-09-12T00:57:52.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17726101157556155603', time=2024-09-12T02:51:30.609355+0000, chain.objs.size()=1 2024-09-12T00:57:52.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.oMlKOa0E4TPeME5Us_YrhIjmOBVFdJD_0 2024-09-12T00:57:52.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14341872152277264546', time=2024-09-12T02:51:32.628599+0000, chain.objs.size()=1 2024-09-12T00:57:52.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.hR62rk4jki_B7u_QRSxOeN5yjDdlLFm_0 2024-09-12T00:57:52.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18436930202799048983', time=2024-09-12T02:52:10.575664+0000, chain.objs.size()=1 2024-09-12T00:57:52.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.dIWRyoByrj0kmDLO0RgVC20sd9RFu2E_0 2024-09-12T00:57:52.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8968175583604880782', time=2024-09-12T02:52:42.018246+0000, chain.objs.size()=1 2024-09-12T00:57:52.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.LWrDeT88et5-Y2ek_os74eRZX4H2BlQ_0 2024-09-12T00:57:52.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1534855837280973220', time=2024-09-12T02:52:42.031673+0000, chain.objs.size()=1 2024-09-12T00:57:52.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.z3L4lwdXkbCGtoIE4xX3YOBfrW5iv9d_0 2024-09-12T00:57:52.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8687853911928352019', time=2024-09-12T02:53:56.036082+0000, chain.objs.size()=1 2024-09-12T00:57:52.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.782X61h9EPpnDac5HN3vTY9Z-BFD-5P_0 2024-09-12T00:57:52.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7456765917898656595', time=2024-09-12T02:53:56.046054+0000, chain.objs.size()=1 2024-09-12T00:57:52.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.kcD-WvSbKwcXCBXxfQpbUz2fPwhmL_5_0 2024-09-12T00:57:52.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13650715869055394107', time=2024-09-12T02:53:58.690052+0000, chain.objs.size()=1 2024-09-12T00:57:52.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.Cef0Nl3cNCGX53hJk4sCAQMyRGCp9tN_0 2024-09-12T00:57:52.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13016919022286619509', time=2024-09-12T02:53:58.756730+0000, chain.objs.size()=1 2024-09-12T00:57:52.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.QQtWm5_H3triaLkhGVJvUnGmLZmArlo_0 2024-09-12T00:57:52.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11170098961742396042', time=2024-09-12T02:54:36.695168+0000, chain.objs.size()=1 2024-09-12T00:57:52.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.241+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.Siktg4b4khtQT5uZh0jrV6raWuC4giv_0 2024-09-12T00:57:52.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.248+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.252+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:57:52.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.253+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:57:52.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6847261160313121772', time=2024-09-12T02:49:07.341255+0000, chain.objs.size()=1 2024-09-12T00:57:52.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.RZj5Qty7BObAOpAq0hrDCFLSgwmszud_0 2024-09-12T00:57:52.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12505822953270716608', time=2024-09-12T02:49:07.524457+0000, chain.objs.size()=3 2024-09-12T00:57:52.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-FROZEN.2~2VA8l241ZaNoMEuwZkhnw2YOTkFxAQM.1 2024-09-12T00:57:52.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-FROZEN.2~2VA8l241ZaNoMEuwZkhnw2YOTkFxAQM.2 2024-09-12T00:57:52.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-FROZEN.2~2VA8l241ZaNoMEuwZkhnw2YOTkFxAQM.3 2024-09-12T00:57:52.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7669579381663189899', time=2024-09-12T02:49:07.669204+0000, chain.objs.size()=1 2024-09-12T00:57:52.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7__shadow_.Trd-OwUTnX5BjIhznqIRy4rKtExOK3n_0 2024-09-12T00:57:52.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7589751489789171349', time=2024-09-12T02:50:13.871982+0000, chain.objs.size()=1 2024-09-12T00:57:52.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.M-T16q8tlvghfz2I_qXAYmQBHZjx-hj_0 2024-09-12T00:57:52.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6977756952390767061', time=2024-09-12T02:50:13.902533+0000, chain.objs.size()=1 2024-09-12T00:57:52.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.LmX2atrM3wmqoRurxVHrxyT936udsHg_0 2024-09-12T00:57:52.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6788507461338348911', time=2024-09-12T02:50:13.950551+0000, chain.objs.size()=1 2024-09-12T00:57:52.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.SUiK5R4wLfjSXqFtzmZgsiR30RfPTMb_0 2024-09-12T00:57:52.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10383897540453129299', time=2024-09-12T02:50:49.721265+0000, chain.objs.size()=1 2024-09-12T00:57:52.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.dbsUBRzmV5iGUZFr44dnnIwbKmFFLFE_0 2024-09-12T00:57:52.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18097555401864551051', time=2024-09-12T02:50:54.585333+0000, chain.objs.size()=1 2024-09-12T00:57:52.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.OqRXpd8TJW-w5KZNEVBDoQ7EXeO9IyS_0 2024-09-12T00:57:52.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16418187981948543756', time=2024-09-12T02:50:54.586021+0000, chain.objs.size()=1 2024-09-12T00:57:52.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.BXLEbQ7JXGnX0UQcC4gaP06buqFBgQZ_0 2024-09-12T00:57:52.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9491269086959813695', time=2024-09-12T02:50:54.588079+0000, chain.objs.size()=1 2024-09-12T00:57:52.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.254+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.o_LyCbnJfAsQQnv3y6lKCBxI6Y0_5AH_0 2024-09-12T00:57:52.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.256+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1407944798989724813', time=2024-09-12T02:52:05.467196+0000, chain.objs.size()=1 2024-09-12T00:57:52.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.256+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.fG082_IyEiNnEaX02QVJTUh4ZwW2pdR_0 2024-09-12T00:57:52.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.256+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1185702073055584081', time=2024-09-12T02:52:47.356391+0000, chain.objs.size()=1 2024-09-12T00:57:52.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.256+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.WTKpId0jfozpB2bK3KqdIKnhv5cP4s5_0 2024-09-12T00:57:52.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.256+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1359019640501301117', time=2024-09-12T02:53:22.911049+0000, chain.objs.size()=1 2024-09-12T00:57:52.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.256+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.byAQoPAasozEGy7Oz14arAsJU8ymx07_0 2024-09-12T00:57:52.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.257+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11193828977042036703', time=2024-09-12T02:53:58.701478+0000, chain.objs.size()=1 2024-09-12T00:57:52.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.257+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.Y8m5cUoA7n_e9BJxvyVe212r-0f3-Be_0 2024-09-12T00:57:52.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.257+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10486436690591821710', time=2024-09-12T02:54:31.417682+0000, chain.objs.size()=1 2024-09-12T00:57:52.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.257+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.XETky7ZLznvWrfB6de7KrWW07dRfO33_0 2024-09-12T00:57:52.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.260+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.263+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:57:52.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.264+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.264+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T00:57:52.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9751639566739069901', time=2024-09-12T02:49:07.520125+0000, chain.objs.size()=3 2024-09-12T00:57:52.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-FROZEN.2~2VA8l241ZaNoMEuwZkhnw2YOTkFxAQM.1 2024-09-12T00:57:52.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-FROZEN.2~2VA8l241ZaNoMEuwZkhnw2YOTkFxAQM.2 2024-09-12T00:57:52.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__multipart_foo-FROZEN.2~2VA8l241ZaNoMEuwZkhnw2YOTkFxAQM.3 2024-09-12T00:57:52.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='_OtLEv9v6bjEPBcB-r4bew8KqbPrtlRb', time=2024-09-12T02:49:07.550050+0000, chain.objs.size()=2 2024-09-12T00:57:52.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.7H6P2o-h9ojjDclpvhIZF335bsj2T92_0 2024-09-12T00:57:52.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.7H6P2o-h9ojjDclpvhIZF335bsj2T92_1 2024-09-12T00:57:52.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17062549092121413472', time=2024-09-12T02:49:07.698778+0000, chain.objs.size()=1 2024-09-12T00:57:52.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8__shadow_.KQZ1gmmVqznjD41ido411qajjES33ya_0 2024-09-12T00:57:52.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11977833434500235049', time=2024-09-12T02:50:13.906219+0000, chain.objs.size()=1 2024-09-12T00:57:52.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.x4XtlpPdXVLhN1WY67jIUuweiLjcZHK_0 2024-09-12T00:57:52.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14633070958846420062', time=2024-09-12T02:50:13.906806+0000, chain.objs.size()=1 2024-09-12T00:57:52.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.ksBhdXtB0gKxWAv09EGHFWHVWgg5WDb_0 2024-09-12T00:57:52.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.53575345232133333', time=2024-09-12T02:50:15.824546+0000, chain.objs.size()=1 2024-09-12T00:57:52.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.mqZ8dk_7xHRu4yRFsinFUiQlZiO13U1_0 2024-09-12T00:57:52.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3376966472281491045', time=2024-09-12T02:50:15.840636+0000, chain.objs.size()=1 2024-09-12T00:57:52.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.rvrIDWtRqaLFIl2i5l3VHIDc3VQ2S5p_0 2024-09-12T00:57:52.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6371675694930113803', time=2024-09-12T02:50:15.912615+0000, chain.objs.size()=1 2024-09-12T00:57:52.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.zB9qAAM6kezdrwp6oi03RcJZ69RTjxe_0 2024-09-12T00:57:52.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4390894848179593809', time=2024-09-12T02:50:49.756769+0000, chain.objs.size()=1 2024-09-12T00:57:52.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.265+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.edHmCYGZe1uUB2NHDPZNBICY4Ji-D9v_0 2024-09-12T00:57:52.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.268+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8942711648521898002', time=2024-09-12T02:50:52.433255+0000, chain.objs.size()=1 2024-09-12T00:57:52.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.268+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.q_QUZsE61dgpXexsev0e2Ac7n7MjoEf_0 2024-09-12T00:57:52.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.269+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18172107958875455787', time=2024-09-12T02:50:52.492792+0000, chain.objs.size()=1 2024-09-12T00:57:52.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.269+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.QCdC29vVvCAvUwsSB_DQgQLq4xYzelm_0 2024-09-12T00:57:52.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.269+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1727525779007629675', time=2024-09-12T02:51:27.934759+0000, chain.objs.size()=1 2024-09-12T00:57:52.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.269+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.wGSye0vEFk6U62yH_qCqohk7OY55Ypi_0 2024-09-12T00:57:52.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.269+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4709639196380983508', time=2024-09-12T02:51:32.561374+0000, chain.objs.size()=1 2024-09-12T00:57:52.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.269+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.NuxflgakSWpW2Bwq0ZCpdiIo4Uy-3rr_0 2024-09-12T00:57:52.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.269+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17002936672140449083', time=2024-09-12T02:52:08.580432+0000, chain.objs.size()=1 2024-09-12T00:57:52.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.269+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.eKFm2jNQuR_S-m2pU3IAz6I7eDHlmoh_0 2024-09-12T00:57:52.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.269+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3384423386282427964', time=2024-09-12T02:52:42.058869+0000, chain.objs.size()=1 2024-09-12T00:57:52.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.269+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.s-jnaASi2P8Y-ROKVGRQj_Zti6GraK5_0 2024-09-12T00:57:52.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.269+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10033202055587424282', time=2024-09-12T02:52:47.355165+0000, chain.objs.size()=1 2024-09-12T00:57:52.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.269+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.ZfmB4Pt5mEZBv9cnc-zEHAiBfQ13-zo_0 2024-09-12T00:57:52.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.270+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12628186266359885720', time=2024-09-12T02:53:19.949214+0000, chain.objs.size()=1 2024-09-12T00:57:52.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.270+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.e8pn0Rucu4bhDAKAbzHgWUE75a_3DyJ_0 2024-09-12T00:57:52.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.270+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10661899937410289050', time=2024-09-12T02:53:20.041875+0000, chain.objs.size()=1 2024-09-12T00:57:52.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.270+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.zaOFlt5OOODOit_c5szGC6uE5Z_jBv6_0 2024-09-12T00:57:52.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.270+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11401862482757969227', time=2024-09-12T02:53:24.946562+0000, chain.objs.size()=1 2024-09-12T00:57:52.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.270+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.fLbmchAjtBRPpvcR0fGdRAr2fCFZaj0_0 2024-09-12T00:57:52.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.270+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5801503073868817668', time=2024-09-12T02:53:56.040489+0000, chain.objs.size()=1 2024-09-12T00:57:52.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.270+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.rQPSZ_vh4Qy0wIElUVQiE2stRxmnfwx_0 2024-09-12T00:57:52.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.270+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7503291525953260880', time=2024-09-12T02:53:56.041240+0000, chain.objs.size()=1 2024-09-12T00:57:52.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.270+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.VvLp_rNf46e5sJx9PGsbeXa-8UYz6Ah_0 2024-09-12T00:57:52.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.272+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16145895692058726740', time=2024-09-12T02:53:58.802113+0000, chain.objs.size()=1 2024-09-12T00:57:52.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.272+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.BYE9Pf0Xkp2R7zKo5OHAKyiyKRXjgE__0 2024-09-12T00:57:52.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.273+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6223111078854852154', time=2024-09-12T02:54:31.385305+0000, chain.objs.size()=1 2024-09-12T00:57:52.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.273+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.ri2VXvJ25eaH_a1MyeojFdh_K0wrV1P_0 2024-09-12T00:57:52.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.273+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6545249227249841621', time=2024-09-12T02:55:10.010249+0000, chain.objs.size()=1 2024-09-12T00:57:52.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.273+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.oGsXq4nPQ-l62Zr7ioMQGgVjgI3zC3y_0 2024-09-12T00:57:52.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.276+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.278+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:57:52.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.279+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-12T00:57:52.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14608308240643887625', time=2024-09-12T02:50:13.863232+0000, chain.objs.size()=1 2024-09-12T00:57:52.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.RjlcydlqB6VQicHEGGdStRLLaMUSqq3_0 2024-09-12T00:57:52.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6844232909794148922', time=2024-09-12T02:50:49.714295+0000, chain.objs.size()=1 2024-09-12T00:57:52.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.G1TCr3tNp59SDyIAUVgRuippt8wXinX_0 2024-09-12T00:57:52.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13415759667706145962', time=2024-09-12T02:50:52.484327+0000, chain.objs.size()=1 2024-09-12T00:57:52.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.-xLRheHWh-TKEc9i7SgMF6dWwRKJRvb_0 2024-09-12T00:57:52.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7064239467128951289', time=2024-09-12T02:52:05.410038+0000, chain.objs.size()=1 2024-09-12T00:57:52.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.Vqr2JVhfoF4TDg3OxJBxWAHH4HuCzTz_0 2024-09-12T00:57:52.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3271017896735902837', time=2024-09-12T02:52:05.489982+0000, chain.objs.size()=1 2024-09-12T00:57:52.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.EHlBD4-25iwR-uLXARsz-nYUmcQBI0i_0 2024-09-12T00:57:52.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11966532541933202812', time=2024-09-12T02:52:42.051140+0000, chain.objs.size()=1 2024-09-12T00:57:52.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.I_Z9GdA5HB1syXCVFpsTLRGkKrn5MSh_0 2024-09-12T00:57:52.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10235579534739905164', time=2024-09-12T02:52:44.959207+0000, chain.objs.size()=1 2024-09-12T00:57:52.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.xPr4AERs8NDrqpN-f10qgsQDg6X206k_0 2024-09-12T00:57:52.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15729139732416482532', time=2024-09-12T02:52:44.961508+0000, chain.objs.size()=1 2024-09-12T00:57:52.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.NninUDK7ajmWTcenA5AMti69bGFY28z_0 2024-09-12T00:57:52.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10240002597540704615', time=2024-09-12T02:52:45.055318+0000, chain.objs.size()=1 2024-09-12T00:57:52.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.Mygomio8j_7Q-MD5sA5oz2kkYArJ3GT_0 2024-09-12T00:57:52.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15133932382155258362', time=2024-09-12T02:52:47.354606+0000, chain.objs.size()=1 2024-09-12T00:57:52.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.QnJAfx6L24-3Nku-usc-cx_x1ZO36FW_0 2024-09-12T00:57:52.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16775702961878176267', time=2024-09-12T02:52:47.382710+0000, chain.objs.size()=1 2024-09-12T00:57:52.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.gLCBEM9QPbq2A-FTm9LTP9fHh1IH_am_0 2024-09-12T00:57:52.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6227616863373101165', time=2024-09-12T02:53:19.982039+0000, chain.objs.size()=1 2024-09-12T00:57:52.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.280+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.lna5hdyR6wbd4wwXzNGNjDYN4rl_2G6_0 2024-09-12T00:57:52.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.283+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3925641767691751024', time=2024-09-12T02:53:19.983016+0000, chain.objs.size()=1 2024-09-12T00:57:52.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.283+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.IB5wguZZC_ogLVFpX7X9zitFJnE1eek_0 2024-09-12T00:57:52.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.284+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8030045632810557022', time=2024-09-12T02:53:58.765805+0000, chain.objs.size()=1 2024-09-12T00:57:52.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.284+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.p0rPmkVWjosHG5B5_TaJJXGo5stVIGc_0 2024-09-12T00:57:52.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.284+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.104455562363063629', time=2024-09-12T02:54:31.423528+0000, chain.objs.size()=1 2024-09-12T00:57:52.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.284+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.skKPfMdxvVNbZKNnH3ta0baP0W81arP_0 2024-09-12T00:57:52.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.284+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14561951924345011042', time=2024-09-12T02:54:34.539246+0000, chain.objs.size()=1 2024-09-12T00:57:52.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.284+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.28ox-ar2ShmMlrL-Mb_D3KLoE_RO5sm_0 2024-09-12T00:57:52.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.284+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.634989980840541804', time=2024-09-12T02:54:36.673232+0000, chain.objs.size()=1 2024-09-12T00:57:52.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.284+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.sID4LZRE5myKZxD7Ue4MzV_c8ZbziAQ_0 2024-09-12T00:57:52.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.289+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.296+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:57:52.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.297+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.297+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:57:52.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='_82Wesn3Ak7hx5UK8oeEe5V8Lp8ckmlr', time=2024-09-12T02:49:07.494631+0000, chain.objs.size()=1 2024-09-12T00:57:52.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15__shadow_.PizaVXjemrnb4OqwhucByL7GXM9hCgQ_0 2024-09-12T00:57:52.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='_dYQfqViMYWYqWzepjl_onlhAx950JKa', time=2024-09-12T02:49:07.528968+0000, chain.objs.size()=2 2024-09-12T00:57:52.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.MoiTzWsOI_jpMKAaLDEJewYv4gJGX2h_0 2024-09-12T00:57:52.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16__shadow_.MoiTzWsOI_jpMKAaLDEJewYv4gJGX2h_1 2024-09-12T00:57:52.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12822806943810653692', time=2024-09-12T02:49:07.583587+0000, chain.objs.size()=3 2024-09-12T00:57:52.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-FROZEN.2~hCtEj_gQoD6ef81Q3LzvVPUPZ5xeBXx.1 2024-09-12T00:57:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-FROZEN.2~hCtEj_gQoD6ef81Q3LzvVPUPZ5xeBXx.2 2024-09-12T00:57:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14__multipart_foo-FROZEN.2~hCtEj_gQoD6ef81Q3LzvVPUPZ5xeBXx.3 2024-09-12T00:57:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12886227981615271107', time=2024-09-12T02:50:49.754504+0000, chain.objs.size()=1 2024-09-12T00:57:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.jXJLvoYUPvsm4b_AsCYT6uhAeEjtlEM_0 2024-09-12T00:57:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7567692240579567789', time=2024-09-12T02:50:52.445201+0000, chain.objs.size()=1 2024-09-12T00:57:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.JP2kQQ1wbLG5w-kjiIhZS695FLbkVy5_0 2024-09-12T00:57:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14898266249368721600', time=2024-09-12T02:50:54.584540+0000, chain.objs.size()=1 2024-09-12T00:57:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.HADPVbtJOwwCnI4mR0yIhuctzID5kH__0 2024-09-12T00:57:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6248493806208221545', time=2024-09-12T02:51:27.890792+0000, chain.objs.size()=1 2024-09-12T00:57:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.ppc1mDaxbh6d-lehMpL0vYfE8zIDOje_0 2024-09-12T00:57:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16274365905873973009', time=2024-09-12T02:51:32.539194+0000, chain.objs.size()=1 2024-09-12T00:57:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.dhlR3SKwgTMxw7mq22sX4q9CFpkzk6b_0 2024-09-12T00:57:52.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12950112694832697564', time=2024-09-12T02:51:32.562187+0000, chain.objs.size()=1 2024-09-12T00:57:52.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.298+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.26__shadow_.jY3ri7-hkaUTKOF6-ii7X-HWu7gYZCP_0 2024-09-12T00:57:52.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.300+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13531334179955362309', time=2024-09-12T02:52:08.581917+0000, chain.objs.size()=1 2024-09-12T00:57:52.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.300+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.RkwepYk5NRU5ChNGswYZwjdFQ-UqGSf_0 2024-09-12T00:57:52.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.301+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6409127673332628819', time=2024-09-12T02:52:42.086295+0000, chain.objs.size()=1 2024-09-12T00:57:52.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.301+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.VYmbKPxjEFYhtQlC3biAmUh2D4YkuDu_0 2024-09-12T00:57:52.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.302+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4419334353447936896', time=2024-09-12T02:53:19.467482+0000, chain.objs.size()=1 2024-09-12T00:57:52.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.302+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.A9V1VKgeMPH14XkPGkB0H0UFEt0QqdJ_0 2024-09-12T00:57:52.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.302+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12835902953481470801', time=2024-09-12T02:53:58.756647+0000, chain.objs.size()=1 2024-09-12T00:57:52.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.302+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.I5aBgfHsKNgQhxnuKhd6CEc3gLZAWnq_0 2024-09-12T00:57:52.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.304+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.306+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:57:52.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.307+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:57:52.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15088688015821006967', time=2024-09-12T02:50:49.714302+0000, chain.objs.size()=1 2024-09-12T00:57:52.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.SH2w1oOBjglWiK2sS8FTE_CGBbta-qW_0 2024-09-12T00:57:52.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7834529780533407847', time=2024-09-12T02:50:52.436064+0000, chain.objs.size()=1 2024-09-12T00:57:52.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.1DwUlUpOikN891JJ5k0ykctiMZr64Jn_0 2024-09-12T00:57:52.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.205873055835083292', time=2024-09-12T02:50:54.602000+0000, chain.objs.size()=1 2024-09-12T00:57:52.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.NYZjN05MqlVNfofmjxX2gX4iIZDe3fH_0 2024-09-12T00:57:52.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10556043201869073840', time=2024-09-12T02:51:30.569746+0000, chain.objs.size()=1 2024-09-12T00:57:52.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.ShLD3bKb3NQYZI7bHysPcg4JVpBUbWe_0 2024-09-12T00:57:52.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8956900418093275485', time=2024-09-12T02:51:30.570406+0000, chain.objs.size()=1 2024-09-12T00:57:52.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.MUJFCuTOw0rqyyepUmnOFXPPdKbBA9C_0 2024-09-12T00:57:52.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14690523629031666091', time=2024-09-12T02:51:30.647917+0000, chain.objs.size()=1 2024-09-12T00:57:52.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.rXa0Dv7wdaHeb72KNefA4rMvwzRtcTW_0 2024-09-12T00:57:52.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8441889249591274812', time=2024-09-12T02:52:47.375332+0000, chain.objs.size()=1 2024-09-12T00:57:52.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.gwvUlSqkjDwVLEl_Q2x32IAMwjjld9E_0 2024-09-12T00:57:52.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6027804715246893129', time=2024-09-12T02:52:47.414176+0000, chain.objs.size()=1 2024-09-12T00:57:52.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.hWCT46JTLX9QSyRwz6rDMUVC7cLXtk2_0 2024-09-12T00:57:52.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13820630511578086577', time=2024-09-12T02:53:56.048461+0000, chain.objs.size()=1 2024-09-12T00:57:52.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.h1akreN7WMUZH9ezv3cFnfqYFJpoElz_0 2024-09-12T00:57:52.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10279323693765114430', time=2024-09-12T02:53:56.049181+0000, chain.objs.size()=1 2024-09-12T00:57:52.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.P1gmMzX2hX8cHEMJ67aIrzfitN5Vt_1_0 2024-09-12T00:57:52.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13741554545512731865', time=2024-09-12T02:53:58.748781+0000, chain.objs.size()=1 2024-09-12T00:57:52.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.hJPW3pDj3nho3EdsrIcsitycxtEOY-8_0 2024-09-12T00:57:52.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10924649583549064791', time=2024-09-12T02:53:58.765203+0000, chain.objs.size()=1 2024-09-12T00:57:52.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.308+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.cawNSUujhC4bCKRlUNemLv7ZBAv_HKD_0 2024-09-12T00:57:52.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.311+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1370233847065047556', time=2024-09-12T02:54:31.385066+0000, chain.objs.size()=1 2024-09-12T00:57:52.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.311+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.36__shadow_.scEtaEpqK745hNEPyZSvATHaM7HFaca_0 2024-09-12T00:57:52.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.312+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13863406920999105506', time=2024-09-12T02:54:36.765159+0000, chain.objs.size()=1 2024-09-12T00:57:52.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.312+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.Kt15xGxmEUzzimQc8Bfqt6HXaGXeO7o_0 2024-09-12T00:57:52.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.313+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9917233202125007645', time=2024-09-12T02:55:09.998385+0000, chain.objs.size()=1 2024-09-12T00:57:52.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.313+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.O3Edk-XNJHoUk9btHaEfMS4ZhqBLwYo_0 2024-09-12T00:57:52.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.315+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.317+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:57:52.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.318+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.319+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.319+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T00:57:52.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.319+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.244920165361680749', time=2024-09-12T02:49:07.336851+0000, chain.objs.size()=1 2024-09-12T00:57:52.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.319+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.LXtGQ4DgVGNuPGSm3kTbL_2FzU_1DwH_0 2024-09-12T00:57:52.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.319+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3180765973237370069', time=2024-09-12T02:50:12.972797+0000, chain.objs.size()=1 2024-09-12T00:57:52.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.319+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.SkuSYVXatTn-BwlSTAcyIR7c2cPTp9h_0 2024-09-12T00:57:52.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11254550392027002952', time=2024-09-12T02:50:15.824280+0000, chain.objs.size()=1 2024-09-12T00:57:52.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.SBTaeHj0rhQuaw2A9PsQ6J2cJq5Y9sl_0 2024-09-12T00:57:52.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12243553883373348631', time=2024-09-12T02:50:54.620402+0000, chain.objs.size()=1 2024-09-12T00:57:52.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.kRyj0XK1pJLlUmUUNK2NBZEzJYn-kil_0 2024-09-12T00:57:52.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15272504970682150797', time=2024-09-12T02:52:05.492004+0000, chain.objs.size()=1 2024-09-12T00:57:52.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.X9XJj6O5miz3gv8cdwH_J1-vNW5RrOS_0 2024-09-12T00:57:52.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11392405670305033456', time=2024-09-12T02:52:05.492701+0000, chain.objs.size()=1 2024-09-12T00:57:52.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.XUfohZi423y_QIBp9pHMeP4ZPEqX1FG_0 2024-09-12T00:57:52.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3992849331982827842', time=2024-09-12T02:52:08.548244+0000, chain.objs.size()=1 2024-09-12T00:57:52.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.9b8y3p_THS3u81mKJ032oktgznvBRrR_0 2024-09-12T00:57:52.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11082320372498246859', time=2024-09-12T02:52:42.106193+0000, chain.objs.size()=1 2024-09-12T00:57:52.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.gyVfB5UUs3gb4v6dNsblDnoA6Tt96eY_0 2024-09-12T00:57:52.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16427666769773598270', time=2024-09-12T02:52:45.010616+0000, chain.objs.size()=1 2024-09-12T00:57:52.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.sugnTbPZMu7DB8438JxzENHc1sXUv4o_0 2024-09-12T00:57:52.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5553844881936901560', time=2024-09-12T02:52:47.358847+0000, chain.objs.size()=1 2024-09-12T00:57:52.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.QiXXFr09pxjS_7kPCC7YBiwR_Dm-R0t_0 2024-09-12T00:57:52.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2173736058142368868', time=2024-09-12T02:52:47.374515+0000, chain.objs.size()=1 2024-09-12T00:57:52.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.Z0MQGunKEci_q-kElmWkA9tsDuQOghT_0 2024-09-12T00:57:52.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12869202413337789371', time=2024-09-12T02:53:19.969788+0000, chain.objs.size()=1 2024-09-12T00:57:52.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.320+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.bDbKBztxQrSu5b9UVisxHRy-Xt9LZce_0 2024-09-12T00:57:52.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.322+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11638641750929381233', time=2024-09-12T02:53:58.813228+0000, chain.objs.size()=1 2024-09-12T00:57:52.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.322+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.35__shadow_.CDCtIxh7XuB-BuEqugRoc0JDKE2ZDH8_0 2024-09-12T00:57:52.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.322+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6279601187797002293', time=2024-09-12T02:54:34.530657+0000, chain.objs.size()=1 2024-09-12T00:57:52.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.322+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.NCMcZnG-r7ZrW8JFda9wmmO-PrUi_se_0 2024-09-12T00:57:52.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.322+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16201545368108543099', time=2024-09-12T02:54:34.575059+0000, chain.objs.size()=1 2024-09-12T00:57:52.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.322+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.9XnlNeQduv-DJHEcH39NpQ3MoLFaLRH_0 2024-09-12T00:57:52.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.324+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8648757246681284328', time=2024-09-12T02:54:36.683801+0000, chain.objs.size()=1 2024-09-12T00:57:52.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.324+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.kCw6EW_DLnB-61BvvGYl0RBxPIM1TrC_0 2024-09-12T00:57:52.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.324+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4372260494970166264', time=2024-09-12T02:54:36.684698+0000, chain.objs.size()=1 2024-09-12T00:57:52.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.324+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.Zam-wE0C1ckUdYEGI0Bct2lhGHSvtN-_0 2024-09-12T00:57:52.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.324+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17088547035404591915', time=2024-09-12T02:57:31.283281+0000, chain.objs.size()=1 2024-09-12T00:57:52.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.324+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18__shadow:12qCR6AgLJv99DggYaAxkl6OK8yB8zC_.d3JGRhzBxajiZAaNrII51wa5TwkvgdZ_0 2024-09-12T00:57:52.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.328+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.333+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:57:52.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.334+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T00:57:52.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13831914473251547362', time=2024-09-12T02:50:49.746676+0000, chain.objs.size()=1 2024-09-12T00:57:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.sDOy65LEe1_GK0Qn7PLem_6IKg9Xvq3_0 2024-09-12T00:57:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3257614468080221066', time=2024-09-12T02:50:49.795718+0000, chain.objs.size()=1 2024-09-12T00:57:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.21__shadow_.SNE7cvLq2F1zU1dbLjQx7You29Qmy5M_0 2024-09-12T00:57:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13879293270351193054', time=2024-09-12T02:50:51.726942+0000, chain.objs.size()=1 2024-09-12T00:57:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22__shadow_.-FXxrBkTIVETcZ6LU-PCbgUGaS0c6Mt_0 2024-09-12T00:57:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1158072463223116308', time=2024-09-12T02:50:54.602058+0000, chain.objs.size()=1 2024-09-12T00:57:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.VpiunFB5Mv6WIleOhg3exm9F-T70wxW_0 2024-09-12T00:57:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7210061190397934275', time=2024-09-12T02:50:54.620651+0000, chain.objs.size()=1 2024-09-12T00:57:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.Th26QMO61YRtQhQPMXdMhhfpoAMAn2N_0 2024-09-12T00:57:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3173741619515195481', time=2024-09-12T02:51:30.609031+0000, chain.objs.size()=1 2024-09-12T00:57:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.25__shadow_.YeJRmECHFnb56dvxDwRZOGQ--Zr8Iou_0 2024-09-12T00:57:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5244025055988631176', time=2024-09-12T02:52:05.404400+0000, chain.objs.size()=1 2024-09-12T00:57:52.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.UDagIqpwUz9K61byeITM77gbcRLKoIj_0 2024-09-12T00:57:52.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7906446813318199367', time=2024-09-12T02:53:19.950279+0000, chain.objs.size()=1 2024-09-12T00:57:52.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.Aa8kTQUPcUhvJzwQqilWkRDfH4Sy0oF_0 2024-09-12T00:57:52.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.158634106112471026', time=2024-09-12T02:53:22.896492+0000, chain.objs.size()=1 2024-09-12T00:57:52.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.sIEcNXeb4-0iKBBDEpDK4tZiREh2Rl5_0 2024-09-12T00:57:52.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9652990942238791583', time=2024-09-12T02:54:34.501823+0000, chain.objs.size()=1 2024-09-12T00:57:52.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.335+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.ODd8LWp1ZOOMVrXjJ1T5woBIQ5MwI5P_0 2024-09-12T00:57:52.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.338+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.341+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:57:52.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.343+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-12T00:57:52.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13078076143638528540', time=2024-09-12T02:49:07.328182+0000, chain.objs.size()=1 2024-09-12T00:57:52.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.aWsiq6TgTNd59Jx8-eAP2mXLwfbMXVa_0 2024-09-12T00:57:52.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12889769836932602055', time=2024-09-12T02:49:07.353988+0000, chain.objs.size()=1 2024-09-12T00:57:52.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4__shadow_.sPjFBf8EWitz_dZflrvzlPNJrfKceHa_0 2024-09-12T00:57:52.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6999453304088803157', time=2024-09-12T02:49:07.436376+0000, chain.objs.size()=4 2024-09-12T00:57:52.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9__multipart_foo.2~U0m_TTboebyLRkB_xzjHbyl5oT7tuB-.1 2024-09-12T00:57:52.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9__multipart_foo.2~U0m_TTboebyLRkB_xzjHbyl5oT7tuB-.2 2024-09-12T00:57:52.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9__multipart_foo.2~U0m_TTboebyLRkB_xzjHbyl5oT7tuB-.3 2024-09-12T00:57:52.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9__multipart_foo.2~U0m_TTboebyLRkB_xzjHbyl5oT7tuB-.4 2024-09-12T00:57:52.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.564839967263591298', time=2024-09-12T02:50:13.911531+0000, chain.objs.size()=1 2024-09-12T00:57:52.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.DbT0iS1HsARdbi32-MegkrYIQV92SY1_0 2024-09-12T00:57:52.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17937657042907827624', time=2024-09-12T02:50:15.843367+0000, chain.objs.size()=1 2024-09-12T00:57:52.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.IJbNkFnuQiEyIV1xvJIqomFNNGYYPez_0 2024-09-12T00:57:52.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11384451493984168963', time=2024-09-12T02:50:15.919269+0000, chain.objs.size()=1 2024-09-12T00:57:52.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.pksF1We6fIkSBF6oknbB9dSlpPOezYw_0 2024-09-12T00:57:52.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6264547746495661213', time=2024-09-12T02:50:54.664486+0000, chain.objs.size()=1 2024-09-12T00:57:52.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.cVruDw7_0g6sgiNS_r0nPQZOJEyX8dH_0 2024-09-12T00:57:52.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.467586466432705266', time=2024-09-12T02:52:05.467280+0000, chain.objs.size()=1 2024-09-12T00:57:52.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.27__shadow_.5oR7uhHhQItRGkLWPG7LWtPLwQEvw47_0 2024-09-12T00:57:52.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5638085882947103100', time=2024-09-12T02:52:42.085871+0000, chain.objs.size()=1 2024-09-12T00:57:52.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.344+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.29__shadow_.k3oYFpPaZ5drgmlb5f_UXSoB5o1EgPU_0 2024-09-12T00:57:52.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.348+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12197396762774007775', time=2024-09-12T02:52:45.009373+0000, chain.objs.size()=1 2024-09-12T00:57:52.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.348+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.30__shadow_.nR7jvF_7vNAvzlQUMzEV3nQ63gkjXlx_0 2024-09-12T00:57:52.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.348+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3179149429386270765', time=2024-09-12T02:53:19.949645+0000, chain.objs.size()=1 2024-09-12T00:57:52.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.348+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.Efe2s1Vz54z84kHqnViqy2GiqPsc_GY_0 2024-09-12T00:57:52.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.348+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16134095404703817100', time=2024-09-12T02:53:56.088464+0000, chain.objs.size()=1 2024-09-12T00:57:52.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.348+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.34__shadow_.Yg_D9tUd_oqJ50Ia6mo7zjccaAKO9hI_0 2024-09-12T00:57:52.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.348+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17136058481459702157', time=2024-09-12T02:54:34.532866+0000, chain.objs.size()=1 2024-09-12T00:57:52.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.348+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37__shadow_.nHxOj2dHTadiiTpu7KCKCR8zK8KIjPL_0 2024-09-12T00:57:52.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.348+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10993773946614594367', time=2024-09-12T02:54:36.674472+0000, chain.objs.size()=1 2024-09-12T00:57:52.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.348+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.ssJmDb40X0cKhG5ZXNGBrHWntwXcNed_0 2024-09-12T00:57:52.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.348+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1830849013774269599', time=2024-09-12T02:55:09.951222+0000, chain.objs.size()=1 2024-09-12T00:57:52.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.348+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.Pyn48_nI-s-u__IEm5eJwiz5PirmYmC_0 2024-09-12T00:57:52.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.352+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.356+0000 7f8a77f23800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:57:52.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.358+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.358+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T00:57:52.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9348083246549502770', time=2024-09-12T02:49:07.694925+0000, chain.objs.size()=1 2024-09-12T00:57:52.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8__shadow_.X3ldoPsKPtRiVnff8CXrwE63h3sI3Gg_0 2024-09-12T00:57:52.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.690234086397272330', time=2024-09-12T02:50:13.905283+0000, chain.objs.size()=1 2024-09-12T00:57:52.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.19__shadow_.gXZDwyGeOxiAHOVtLyADHnUuMe-TVnb_0 2024-09-12T00:57:52.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4680823599358272919', time=2024-09-12T02:50:15.864527+0000, chain.objs.size()=1 2024-09-12T00:57:52.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.20__shadow_.5k-vueSmcwXpVvPTC-uyKytokC87CFN_0 2024-09-12T00:57:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6192026587473399933', time=2024-09-12T02:50:54.602035+0000, chain.objs.size()=1 2024-09-12T00:57:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.23__shadow_.rN83DKb5PnnGbMGkbcIOW2eanak8esa_0 2024-09-12T00:57:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9004633127562576482', time=2024-09-12T02:51:27.872981+0000, chain.objs.size()=1 2024-09-12T00:57:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.24__shadow_.CaxwRbeGts61yTrbg-qLX0l7kWvFgxN_0 2024-09-12T00:57:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6732424529219606643', time=2024-09-12T02:52:08.631419+0000, chain.objs.size()=1 2024-09-12T00:57:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.OKqSbltIBVCfd3eupnorhsa74tpdH4Q_0 2024-09-12T00:57:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13746033969462903495', time=2024-09-12T02:52:08.637274+0000, chain.objs.size()=1 2024-09-12T00:57:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.28__shadow_.CgtzGLzIMyX8Erm5RhiwM5dEJC2jRV-_0 2024-09-12T00:57:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11881676473170723477', time=2024-09-12T02:52:47.309909+0000, chain.objs.size()=1 2024-09-12T00:57:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.31__shadow_.pmSLZu6sRDOGdos5A6S607u_D5FRL90_0 2024-09-12T00:57:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2170621497432672689', time=2024-09-12T02:53:19.981637+0000, chain.objs.size()=1 2024-09-12T00:57:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.32__shadow_.TJ_DQwo3wpBIOcFeqR141n3dIfHFG9j_0 2024-09-12T00:57:52.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9353662950946837986', time=2024-09-12T02:53:22.870681+0000, chain.objs.size()=1 2024-09-12T00:57:52.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.33__shadow_.nJrAZZetZhagkvQWCukPabCn-yhgJ39_0 2024-09-12T00:57:52.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15189306737909481050', time=2024-09-12T02:54:36.706003+0000, chain.objs.size()=1 2024-09-12T00:57:52.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.38__shadow_.PCNQBmlxiuxFYUCvAfD4013KBtxvc0L_0 2024-09-12T00:57:52.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6247877014013063185', time=2024-09-12T02:55:09.914913+0000, chain.objs.size()=1 2024-09-12T00:57:52.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.359+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.39__shadow_.heAyu7UPOAyrmD14C_jusAgVKLgDp1r_0 2024-09-12T00:57:52.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.361+0000 7f8a77f23800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.458077963643865785', time=2024-09-12T02:57:17.751824+0000, chain.objs.size()=1 2024-09-12T00:57:52.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.361+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17__shadow_.stdTYKP29_ggpY9X-PPHw6gVTdkU84E_0 2024-09-12T00:57:52.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.364+0000 7f8a77f23800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:57:52.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.367+0000 7f8929fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:52.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.369+0000 7f8a77f23800 20 remove_watcher() i=0 2024-09-12T00:57:52.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.369+0000 7f8a77f23800 2 removed watcher, disabling cache 2024-09-12T00:57:52.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.370+0000 7f8a77f23800 20 remove_watcher() i=1 2024-09-12T00:57:52.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.371+0000 7f8a77f23800 20 remove_watcher() i=2 2024-09-12T00:57:52.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.372+0000 7f8a77f23800 20 remove_watcher() i=3 2024-09-12T00:57:52.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.373+0000 7f8a77f23800 20 remove_watcher() i=4 2024-09-12T00:57:52.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.374+0000 7f8a77f23800 20 remove_watcher() i=5 2024-09-12T00:57:52.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.375+0000 7f8a77f23800 20 remove_watcher() i=6 2024-09-12T00:57:52.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.376+0000 7f8a77f23800 20 remove_watcher() i=7 2024-09-12T00:57:52.386 DEBUG:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2024-09-12T00:57:52.479 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:57:52.479 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:57:52.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.519+0000 7f919722f800 20 rados->read ofs=0 len=0 2024-09-12T00:57:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.521+0000 7f919722f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.521+0000 7f919722f800 20 realm 2024-09-12T00:57:52.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.521+0000 7f919722f800 20 rados->read ofs=0 len=0 2024-09-12T00:57:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.521+0000 7f919722f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.521+0000 7f919722f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:57:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.521+0000 7f919722f800 20 rados->read ofs=0 len=0 2024-09-12T00:57:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.522+0000 7f919722f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:52.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.522+0000 7f919722f800 20 rados->read ofs=0 len=0 2024-09-12T00:57:52.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.522+0000 7f919722f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:52.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.522+0000 7f919722f800 20 rados->read ofs=0 len=0 2024-09-12T00:57:52.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.523+0000 7f919722f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:57:52.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.523+0000 7f919722f800 20 searching for the correct realm 2024-09-12T00:57:52.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.526+0000 7f919551a640 0 -- 172.21.15.62:0/828326947 >> [v2:172.21.15.77:6816/3177889521,v1:172.21.15.77:6817/3177889521] conn(0x559046c18110 msgr2=0x559046c1a5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:52.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.529+0000 7f9194d19640 0 -- 172.21.15.62:0/828326947 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f918c0b0050 msgr2=0x7f918c0a5e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:57:52.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.736+0000 7f919722f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T00:57:52.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.736+0000 7f919722f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T00:57:52.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.736+0000 7f919722f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:57:52.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.736+0000 7f919722f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:57:52.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.736+0000 7f919722f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:57:52.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.736+0000 7f919722f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:57:52.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.736+0000 7f919722f800 20 rados->read ofs=0 len=0 2024-09-12T00:57:52.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.736+0000 7f919722f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:52.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.736+0000 7f919722f800 20 rados->read ofs=0 len=0 2024-09-12T00:57:52.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.736+0000 7f919722f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:57:52.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.736+0000 7f919722f800 20 rados->read ofs=0 len=0 2024-09-12T00:57:52.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.737+0000 7f919722f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:57:52.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.737+0000 7f919722f800 20 zone default found 2024-09-12T00:57:52.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.737+0000 7f919722f800 4 Realm: () 2024-09-12T00:57:52.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.737+0000 7f919722f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T00:57:52.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.737+0000 7f919722f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T00:57:52.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.737+0000 7f919722f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:57:52.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.737+0000 7f919722f800 20 zonegroup default 2024-09-12T00:57:52.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.737+0000 7f919722f800 20 rados->read ofs=0 len=0 2024-09-12T00:57:52.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.737+0000 7f919722f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:52.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.737+0000 7f919722f800 20 rados->read ofs=0 len=0 2024-09-12T00:57:52.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.737+0000 7f919722f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:52.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.737+0000 7f919722f800 20 rados->read ofs=0 len=0 2024-09-12T00:57:52.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.737+0000 7f919722f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:57:52.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.737+0000 7f919722f800 20 started sync module instance, tier type = 2024-09-12T00:57:52.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.737+0000 7f919722f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T00:57:52.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.746+0000 7f919722f800 20 add_watcher() i=0 2024-09-12T00:57:52.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.746+0000 7f919722f800 20 add_watcher() i=1 2024-09-12T00:57:52.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.746+0000 7f919722f800 20 add_watcher() i=2 2024-09-12T00:57:52.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.746+0000 7f919722f800 20 add_watcher() i=3 2024-09-12T00:57:52.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.746+0000 7f919722f800 20 add_watcher() i=4 2024-09-12T00:57:52.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.746+0000 7f919722f800 20 add_watcher() i=5 2024-09-12T00:57:52.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.746+0000 7f919722f800 20 add_watcher() i=6 2024-09-12T00:57:52.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.747+0000 7f919722f800 20 add_watcher() i=7 2024-09-12T00:57:52.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.747+0000 7f919722f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:57:52.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.749+0000 7f904b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:52.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.749+0000 7f919722f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:57:52.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.749+0000 7f919722f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:57:52.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.783+0000 7f904a7e4640 20 reqs_thread_entry: start 2024-09-12T00:57:52.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.783+0000 7f919722f800 20 init_complete bucket index max shards: 1 2024-09-12T00:57:52.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.783+0000 7f919722f800 20 Filter name: none 2024-09-12T00:57:52.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.783+0000 7f9043fff640 20 reqs_thread_entry: start 2024-09-12T00:57:52.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.783+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:57:52.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.785+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.785+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.785+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.786+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:57:52.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.787+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.788+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.788+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.789+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:57:52.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.790+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.791+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.791+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.793+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:57:52.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.794+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.794+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.795+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.796+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:57:52.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.797+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.797+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.798+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.799+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:57:52.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.800+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.800+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.801+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.801+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:57:52.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.803+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.803+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.803+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.804+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:57:52.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.806+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.806+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.807+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.807+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:57:52.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.809+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.809+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.809+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.810+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:57:52.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.811+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.812+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.812+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.813+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:57:52.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.815+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.815+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.815+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.816+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:57:52.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.817+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.818+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.818+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.819+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:57:52.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.820+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.821+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.821+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.822+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:57:52.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.823+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.823+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.824+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.825+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:57:52.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.826+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.826+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.827+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.828+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:57:52.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.829+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.830+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.830+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.831+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:57:52.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.832+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.833+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.833+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.834+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:57:52.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.835+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.835+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.836+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.836+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:57:52.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.838+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.838+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.838+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.839+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:57:52.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.841+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.841+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.841+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.842+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:57:52.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.843+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.844+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.844+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.845+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:57:52.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.847+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.847+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.847+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.848+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:57:52.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.850+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.851+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.851+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.852+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:57:52.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.853+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.854+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.854+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.855+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:57:52.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.856+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.857+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.857+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.858+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:57:52.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.860+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.860+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.860+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.861+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:57:52.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.863+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.863+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.863+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.865+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:57:52.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.867+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.867+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.868+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.869+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:57:52.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.870+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.871+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.871+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.872+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:57:52.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.873+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.874+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.874+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.875+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:57:52.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.876+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.876+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.877+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.878+0000 7f919722f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:57:52.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.879+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.880+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:57:52.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.880+0000 7f919722f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:57:52.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.882+0000 7f904b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:57:52.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.884+0000 7f919722f800 20 remove_watcher() i=0 2024-09-12T00:57:52.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.884+0000 7f919722f800 2 removed watcher, disabling cache 2024-09-12T00:57:52.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.885+0000 7f919722f800 20 remove_watcher() i=1 2024-09-12T00:57:52.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.886+0000 7f919722f800 20 remove_watcher() i=2 2024-09-12T00:57:52.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.887+0000 7f919722f800 20 remove_watcher() i=3 2024-09-12T00:57:52.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.888+0000 7f919722f800 20 remove_watcher() i=4 2024-09-12T00:57:52.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.889+0000 7f919722f800 20 remove_watcher() i=5 2024-09-12T00:57:52.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.890+0000 7f919722f800 20 remove_watcher() i=6 2024-09-12T00:57:52.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T00:57:52.891+0000 7f919722f800 20 remove_watcher() i=7 2024-09-12T00:57:52.901 DEBUG:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T00:57:53.398 INFO:teuthology.orchestra.run.smithi062.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T00:57:56.998 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :clean UP-TO-DATE 2024-09-12T00:58:15.698 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :compileJava 2024-09-12T00:58:15.698 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :processResources 2024-09-12T00:58:15.698 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :classes 2024-09-12T00:58:16.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:16.397 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :compileTestJava 2024-09-12T00:58:16.398 INFO:teuthology.orchestra.run.smithi062.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:58:16.398 INFO:teuthology.orchestra.run.smithi062.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:58:16.398 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:16.399 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:58:16.399 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :testClasses 2024-09-12T00:58:22.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:22.397 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :test 2024-09-12T00:58:22.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:22.398 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T00:58:35.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:35.397 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T00:58:35.697 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:35.697 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T00:58:35.797 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:35.797 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T00:58:36.096 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:36.097 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T00:58:50.297 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:50.297 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T00:58:50.697 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:50.697 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:58:50.697 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:50.698 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:58:50.796 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:50.797 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T00:58:50.897 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:50.897 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T00:58:51.197 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:51.197 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T00:58:55.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:55.397 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T00:58:55.996 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:55.997 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:58:56.197 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:58:56.197 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T00:58:56.197 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12 00:58:56,174 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:59:37.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:59:37.398 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:59:37.997 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:59:38.302 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T00:59:38.302 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:59:38.302 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T00:59:38.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:59:38.397 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T00:59:38.497 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:59:38.497 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T00:59:38.997 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:59:38.997 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T00:59:43.097 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:59:43.097 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T00:59:43.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:59:43.397 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:59:43.497 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:59:43.497 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:59:43.597 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:59:43.597 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T00:59:49.997 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:59:49.997 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T00:59:50.296 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:59:50.297 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:59:57.997 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:59:57.997 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:59:58.497 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T00:59:58.497 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T01:00:00.497 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:00:00.497 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T01:00:00.796 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:00:00.797 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T01:00:53.998 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:00:53.998 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T01:00:54.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:00:54.397 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T01:00:59.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:00:59.397 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T01:00:59.697 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:00:59.697 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T01:01:03.997 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:03.997 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T01:01:04.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:04.397 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T01:01:05.997 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:05.997 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T01:01:10.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:10.397 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T01:01:10.497 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:10.497 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T01:01:10.897 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:10.897 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T01:01:10.996 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:10.997 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T01:01:11.297 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:11.297 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T01:01:11.397 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:11.397 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T01:01:11.797 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:11.797 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T01:01:11.896 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:11.897 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T01:01:12.197 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:12.197 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T01:01:12.297 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:12.297 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T01:01:12.697 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:12.697 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T01:01:12.797 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:12.797 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T01:01:13.096 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:13.097 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T01:01:13.197 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:13.197 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T01:01:13.497 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:13.497 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T01:01:23.197 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:23.197 INFO:teuthology.orchestra.run.smithi062.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T01:01:23.597 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:23.597 INFO:teuthology.orchestra.run.smithi062.stdout:---------------------------------------------------------------------- 2024-09-12T01:01:23.597 INFO:teuthology.orchestra.run.smithi062.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T01:01:23.597 INFO:teuthology.orchestra.run.smithi062.stdout:---------------------------------------------------------------------- 2024-09-12T01:01:23.641 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:23.642 INFO:teuthology.orchestra.run.smithi062.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T01:01:23.642 INFO:teuthology.orchestra.run.smithi062.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T01:01:23.642 INFO:teuthology.orchestra.run.smithi062.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T01:01:23.642 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:23.642 INFO:teuthology.orchestra.run.smithi062.stdout:BUILD SUCCESSFUL in 3m 30s 2024-09-12T01:01:23.642 INFO:teuthology.orchestra.run.smithi062.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T01:01:23.960 DEBUG:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2024-09-12T01:01:24.015 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:24.016 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:24.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.056+0000 7f92ae417800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.059+0000 7f92ae417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.059+0000 7f92ae417800 20 realm 2024-09-12T01:01:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.059+0000 7f92ae417800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.059+0000 7f92ae417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.059+0000 7f92ae417800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.059+0000 7f92ae417800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.059+0000 7f92ae417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.059+0000 7f92ae417800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.060+0000 7f92ae417800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:24.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.060+0000 7f92ae417800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.060+0000 7f92ae417800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:24.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.060+0000 7f92ae417800 20 searching for the correct realm 2024-09-12T01:01:24.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.064+0000 7f92a9be7640 0 -- 172.21.15.62:0/2040932523 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7f92a4061040 msgr2=0x7f92a4071a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:24.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.067+0000 7f92a9be7640 0 -- 172.21.15.62:0/2040932523 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f92a40b20f0 msgr2=0x7f92a40aa620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.072+0000 7f92ae417800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:01:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.072+0000 7f92ae417800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:01:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.072+0000 7f92ae417800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.072+0000 7f92ae417800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.072+0000 7f92ae417800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.072+0000 7f92ae417800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.072+0000 7f92ae417800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.072+0000 7f92ae417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.072+0000 7f92ae417800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.072+0000 7f92ae417800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:24.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.072+0000 7f92ae417800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.073+0000 7f92ae417800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:24.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.073+0000 7f92ae417800 20 zone default found 2024-09-12T01:01:24.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.073+0000 7f92ae417800 4 Realm: () 2024-09-12T01:01:24.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.073+0000 7f92ae417800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:01:24.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.073+0000 7f92ae417800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:01:24.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.073+0000 7f92ae417800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:24.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.073+0000 7f92ae417800 20 zonegroup default 2024-09-12T01:01:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.073+0000 7f92ae417800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.073+0000 7f92ae417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.073+0000 7f92ae417800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.073+0000 7f92ae417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.073+0000 7f92ae417800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.074+0000 7f92ae417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.074+0000 7f92ae417800 20 started sync module instance, tier type = 2024-09-12T01:01:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.074+0000 7f92ae417800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:01:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.083+0000 7f92ae417800 20 add_watcher() i=0 2024-09-12T01:01:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.083+0000 7f92ae417800 20 add_watcher() i=1 2024-09-12T01:01:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.083+0000 7f92ae417800 20 add_watcher() i=2 2024-09-12T01:01:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.083+0000 7f92ae417800 20 add_watcher() i=3 2024-09-12T01:01:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.083+0000 7f92ae417800 20 add_watcher() i=4 2024-09-12T01:01:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.083+0000 7f92ae417800 20 add_watcher() i=5 2024-09-12T01:01:24.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.083+0000 7f92ae417800 20 add_watcher() i=6 2024-09-12T01:01:24.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.084+0000 7f92ae417800 20 add_watcher() i=7 2024-09-12T01:01:24.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.084+0000 7f92ae417800 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:24.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.086+0000 7f915ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:24.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.086+0000 7f92ae417800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:24.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.086+0000 7f92ae417800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:24.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.123+0000 7f915efe5640 20 reqs_thread_entry: start 2024-09-12T01:01:24.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.123+0000 7f92ae417800 20 init_complete bucket index max shards: 1 2024-09-12T01:01:24.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.123+0000 7f92ae417800 20 Filter name: none 2024-09-12T01:01:24.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.123+0000 7f915cfe1640 20 reqs_thread_entry: start 2024-09-12T01:01:24.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.123+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:01:24.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.125+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.125+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.125+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:24.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.125+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3507507626011205053', time=2024-09-12T02:59:58.218572+0000, chain.objs.size()=1 2024-09-12T01:01:24.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.125+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.53__shadow_.Bd3vDOYCDHn9GoMzfegBa-hB02sTf0t_0 2024-09-12T01:01:24.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.127+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.130+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:01:24.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.131+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.132+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.132+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.133+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:01:24.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.134+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.134+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.135+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:24.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.135+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14134540267171867529', time=2024-09-12T02:58:50.438927+0000, chain.objs.size()=5 2024-09-12T01:01:24.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.135+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.42__multipart_key1.2~jIMt_Gg7EFStLn2dlEssaBOuOMpCPSH.1 2024-09-12T01:01:24.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.135+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.42__multipart_key1.2~jIMt_Gg7EFStLn2dlEssaBOuOMpCPSH.2 2024-09-12T01:01:24.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.135+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.42__multipart_key1.2~jIMt_Gg7EFStLn2dlEssaBOuOMpCPSH.3 2024-09-12T01:01:24.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.135+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.42__multipart_key1.2~jIMt_Gg7EFStLn2dlEssaBOuOMpCPSH.4 2024-09-12T01:01:24.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.135+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.42__multipart_key1.2~jIMt_Gg7EFStLn2dlEssaBOuOMpCPSH.5 2024-09-12T01:01:24.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.137+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.140+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:01:24.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.141+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.142+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.142+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.143+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:01:24.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.145+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.145+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.145+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:24.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.145+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9073448014337807422', time=2024-09-12T02:59:50.077111+0000, chain.objs.size()=5 2024-09-12T01:01:24.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.145+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.52__multipart_key1.2~MBZfsRK9MUT96ADjSxcq945t_0SCUMW.1 2024-09-12T01:01:24.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.145+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.52__multipart_key1.2~MBZfsRK9MUT96ADjSxcq945t_0SCUMW.2 2024-09-12T01:01:24.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.145+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.52__multipart_key1.2~MBZfsRK9MUT96ADjSxcq945t_0SCUMW.3 2024-09-12T01:01:24.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.145+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.52__multipart_key1.2~MBZfsRK9MUT96ADjSxcq945t_0SCUMW.4 2024-09-12T01:01:24.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.146+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.52__multipart_key1.2~MBZfsRK9MUT96ADjSxcq945t_0SCUMW.5 2024-09-12T01:01:24.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.148+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.151+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:01:24.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.152+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.153+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.153+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.154+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:01:24.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.155+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.156+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.156+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:24.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.156+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10677782932366669012', time=2024-09-12T03:01:12.414808+0000, chain.objs.size()=1 2024-09-12T01:01:24.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.156+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.63__shadow_.6bCnuCcAU1pzA6jafuAnB7bNJHMsFjv_0 2024-09-12T01:01:24.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.157+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.160+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:01:24.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.161+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.161+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:01:24.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13634197525352441412', time=2024-09-12T02:58:55.735401+0000, chain.objs.size()=5 2024-09-12T01:01:24.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.44__multipart_key1.2~SgII06Y1JRQWkztq-yY4-tp46gyxb6-.1 2024-09-12T01:01:24.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.44__multipart_key1.2~SgII06Y1JRQWkztq-yY4-tp46gyxb6-.2 2024-09-12T01:01:24.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.44__multipart_key1.2~SgII06Y1JRQWkztq-yY4-tp46gyxb6-.3 2024-09-12T01:01:24.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.44__multipart_key1.2~SgII06Y1JRQWkztq-yY4-tp46gyxb6-.4 2024-09-12T01:01:24.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.44__multipart_key1.2~SgII06Y1JRQWkztq-yY4-tp46gyxb6-.5 2024-09-12T01:01:24.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16000859324737959443', time=2024-09-12T02:59:37.505874+0000, chain.objs.size()=5 2024-09-12T01:01:24.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~LI1GeGHw60DzFn7cGBEpJ776rIQ03LN.1 2024-09-12T01:01:24.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__shadow_key1.2~LI1GeGHw60DzFn7cGBEpJ776rIQ03LN.1_1 2024-09-12T01:01:24.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~LI1GeGHw60DzFn7cGBEpJ776rIQ03LN.2 2024-09-12T01:01:24.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__shadow_key1.2~LI1GeGHw60DzFn7cGBEpJ776rIQ03LN.2_1 2024-09-12T01:01:24.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~LI1GeGHw60DzFn7cGBEpJ776rIQ03LN.3 2024-09-12T01:01:24.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17989742600503099978', time=2024-09-12T02:59:37.736297+0000, chain.objs.size()=4 2024-09-12T01:01:24.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.46__shadow_.HTygHynrDaFFRNMuiNcy361FzAoOstx_0 2024-09-12T01:01:24.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.162+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.46__shadow_.HTygHynrDaFFRNMuiNcy361FzAoOstx_1 2024-09-12T01:01:24.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.165+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.46__shadow_.HTygHynrDaFFRNMuiNcy361FzAoOstx_2 2024-09-12T01:01:24.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.166+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.46__shadow_.HTygHynrDaFFRNMuiNcy361FzAoOstx_3 2024-09-12T01:01:24.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.169+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.171+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:01:24.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.172+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.173+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.173+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:24.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.173+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5172946789635821908', time=2024-09-12T02:59:15.642339+0000, chain.objs.size()=5 2024-09-12T01:01:24.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.173+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~wxM6zAe_fjqvvmegsQCxASWLxGxM5JJ.1 2024-09-12T01:01:24.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.173+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~wxM6zAe_fjqvvmegsQCxASWLxGxM5JJ.2 2024-09-12T01:01:24.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.173+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~wxM6zAe_fjqvvmegsQCxASWLxGxM5JJ.3 2024-09-12T01:01:24.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.173+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~wxM6zAe_fjqvvmegsQCxASWLxGxM5JJ.4 2024-09-12T01:01:24.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.173+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~wxM6zAe_fjqvvmegsQCxASWLxGxM5JJ.5 2024-09-12T01:01:24.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.176+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.177 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.178+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:01:24.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.180+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.180+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.180+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:01:24.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.180+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5326605334768414296', time=2024-09-12T02:59:58.071537+0000, chain.objs.size()=5 2024-09-12T01:01:24.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.180+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.53__multipart_file.mpg.2~lHjgNBPhFxqLGqkNpREmsVfScfK3Kg6.1 2024-09-12T01:01:24.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.180+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.53__multipart_file.mpg.2~lHjgNBPhFxqLGqkNpREmsVfScfK3Kg6.2 2024-09-12T01:01:24.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.181+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.53__multipart_file.mpg.2~lHjgNBPhFxqLGqkNpREmsVfScfK3Kg6.3 2024-09-12T01:01:24.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.181+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.53__multipart_file.mpg.2~lHjgNBPhFxqLGqkNpREmsVfScfK3Kg6.4 2024-09-12T01:01:24.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.181+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.53__multipart_file.mpg.2~lHjgNBPhFxqLGqkNpREmsVfScfK3Kg6.5 2024-09-12T01:01:24.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.181+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16114309591816430073', time=2024-09-12T03:01:11.512316+0000, chain.objs.size()=1 2024-09-12T01:01:24.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.181+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.61__shadow_.1grI2RQIeEAd6hxr5pE2Q4QZgzo4XjV_0 2024-09-12T01:01:24.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.184+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.187+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:01:24.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.188+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.189+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.189+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:24.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.189+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='2~Z8CNPol_Zh1IVHDyMnqbzSruv22x4ZT', time=2024-09-12T02:58:35.282106+0000, chain.objs.size()=5 2024-09-12T01:01:24.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.189+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.40__multipart_key1.2~Z8CNPol_Zh1IVHDyMnqbzSruv22x4ZT.1 2024-09-12T01:01:24.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.189+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.40__multipart_key1.2~Z8CNPol_Zh1IVHDyMnqbzSruv22x4ZT.2 2024-09-12T01:01:24.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.189+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.40__multipart_key1.2~Z8CNPol_Zh1IVHDyMnqbzSruv22x4ZT.3 2024-09-12T01:01:24.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.189+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.40__multipart_key1.2~Z8CNPol_Zh1IVHDyMnqbzSruv22x4ZT.4 2024-09-12T01:01:24.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.189+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.40__multipart_key1.2~Z8CNPol_Zh1IVHDyMnqbzSruv22x4ZT.5 2024-09-12T01:01:24.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.192+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.194+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:01:24.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.196+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.196+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.197+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:24.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.197+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.410698958236692959', time=2024-09-12T03:00:45.445330+0000, chain.objs.size()=11 2024-09-12T01:01:24.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.197+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~v0jsIWUx-csvWrUQqY-S6m-la6pZ7T9.1 2024-09-12T01:01:24.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.197+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__shadow_key1.2~v0jsIWUx-csvWrUQqY-S6m-la6pZ7T9.1_1 2024-09-12T01:01:24.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.197+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~v0jsIWUx-csvWrUQqY-S6m-la6pZ7T9.2 2024-09-12T01:01:24.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.197+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__shadow_key1.2~v0jsIWUx-csvWrUQqY-S6m-la6pZ7T9.2_1 2024-09-12T01:01:24.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.197+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~v0jsIWUx-csvWrUQqY-S6m-la6pZ7T9.3 2024-09-12T01:01:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.197+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__shadow_key1.2~v0jsIWUx-csvWrUQqY-S6m-la6pZ7T9.3_1 2024-09-12T01:01:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.197+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~v0jsIWUx-csvWrUQqY-S6m-la6pZ7T9.4 2024-09-12T01:01:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.197+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__shadow_key1.2~v0jsIWUx-csvWrUQqY-S6m-la6pZ7T9.4_1 2024-09-12T01:01:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.197+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~v0jsIWUx-csvWrUQqY-S6m-la6pZ7T9.5 2024-09-12T01:01:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.197+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__shadow_key1.2~v0jsIWUx-csvWrUQqY-S6m-la6pZ7T9.5_1 2024-09-12T01:01:24.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.197+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~v0jsIWUx-csvWrUQqY-S6m-la6pZ7T9.6 2024-09-12T01:01:24.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.201+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.204+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:01:24.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.205+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.205+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.206+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:01:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.206+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11348968191524549826', time=2024-09-12T03:01:10.622476+0000, chain.objs.size()=1 2024-09-12T01:01:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.206+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.59__shadow_.9Vx-DN822jzLoIbAn4rjqXuS82xIKBC_0 2024-09-12T01:01:24.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.206+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14768028062855433185', time=2024-09-12T03:01:23.335802+0000, chain.objs.size()=11 2024-09-12T01:01:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.206+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.66__multipart_key1.2~gDHDi8TsWyJWP37peD4h6XD6fOLdWet.1 2024-09-12T01:01:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.206+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.66__multipart_key1.2~gDHDi8TsWyJWP37peD4h6XD6fOLdWet.2 2024-09-12T01:01:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.206+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.66__multipart_key1.2~gDHDi8TsWyJWP37peD4h6XD6fOLdWet.3 2024-09-12T01:01:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.206+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.66__multipart_key1.2~gDHDi8TsWyJWP37peD4h6XD6fOLdWet.4 2024-09-12T01:01:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.206+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.66__multipart_key1.2~gDHDi8TsWyJWP37peD4h6XD6fOLdWet.5 2024-09-12T01:01:24.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.206+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.66__multipart_key1.2~gDHDi8TsWyJWP37peD4h6XD6fOLdWet.6 2024-09-12T01:01:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.206+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.66__multipart_key1.2~gDHDi8TsWyJWP37peD4h6XD6fOLdWet.7 2024-09-12T01:01:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.206+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.66__multipart_key1.2~gDHDi8TsWyJWP37peD4h6XD6fOLdWet.8 2024-09-12T01:01:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.206+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.66__multipart_key1.2~gDHDi8TsWyJWP37peD4h6XD6fOLdWet.9 2024-09-12T01:01:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.206+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.66__multipart_key1.2~gDHDi8TsWyJWP37peD4h6XD6fOLdWet.10 2024-09-12T01:01:24.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.206+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.66__multipart_key1.2~gDHDi8TsWyJWP37peD4h6XD6fOLdWet.11 2024-09-12T01:01:24.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.213+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.215+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:01:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.216+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.216+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.217+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:24.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.217+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12116648791510854581', time=2024-09-12T02:59:58.108267+0000, chain.objs.size()=1 2024-09-12T01:01:24.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.217+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.53__shadow_.hcnZIv5aPlo0s1thv2ICE06rs47cxbR_0 2024-09-12T01:01:24.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.218+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.220+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:01:24.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.221+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.222+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.222+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.223+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:01:24.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.225+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.225+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.225+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:24.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.225+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13907175063309357070', time=2024-09-12T03:00:53.902335+0000, chain.objs.size()=11 2024-09-12T01:01:24.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.225+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~wCElyXpyPg3LNr1xhz9HpcIL-Jg8oUI.1 2024-09-12T01:01:24.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.225+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__shadow_key1.2~wCElyXpyPg3LNr1xhz9HpcIL-Jg8oUI.1_1 2024-09-12T01:01:24.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.225+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~wCElyXpyPg3LNr1xhz9HpcIL-Jg8oUI.2 2024-09-12T01:01:24.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.225+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__shadow_key1.2~wCElyXpyPg3LNr1xhz9HpcIL-Jg8oUI.2_1 2024-09-12T01:01:24.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.225+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~wCElyXpyPg3LNr1xhz9HpcIL-Jg8oUI.3 2024-09-12T01:01:24.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.225+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__shadow_key1.2~wCElyXpyPg3LNr1xhz9HpcIL-Jg8oUI.3_1 2024-09-12T01:01:24.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.225+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~wCElyXpyPg3LNr1xhz9HpcIL-Jg8oUI.4 2024-09-12T01:01:24.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.225+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__shadow_key1.2~wCElyXpyPg3LNr1xhz9HpcIL-Jg8oUI.4_1 2024-09-12T01:01:24.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.225+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~wCElyXpyPg3LNr1xhz9HpcIL-Jg8oUI.5 2024-09-12T01:01:24.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.225+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__shadow_key1.2~wCElyXpyPg3LNr1xhz9HpcIL-Jg8oUI.5_1 2024-09-12T01:01:24.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.225+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~wCElyXpyPg3LNr1xhz9HpcIL-Jg8oUI.6 2024-09-12T01:01:24.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.231+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.233+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:01:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.235+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.235+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.236+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:01:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.236+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9518387907367000447', time=2024-09-12T02:59:19.063439+0000, chain.objs.size()=5 2024-09-12T01:01:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.236+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~OMsV4EiJwnk9Min8HYsNwwmNyuE3t92.1 2024-09-12T01:01:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.236+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~OMsV4EiJwnk9Min8HYsNwwmNyuE3t92.2 2024-09-12T01:01:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.236+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~OMsV4EiJwnk9Min8HYsNwwmNyuE3t92.3 2024-09-12T01:01:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.236+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~OMsV4EiJwnk9Min8HYsNwwmNyuE3t92.4 2024-09-12T01:01:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.236+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~OMsV4EiJwnk9Min8HYsNwwmNyuE3t92.5 2024-09-12T01:01:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.236+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10544744628602530843', time=2024-09-12T03:00:59.447361+0000, chain.objs.size()=5 2024-09-12T01:01:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.236+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.56__multipart_key1.2~1RkCkGqVhMRphfm5dbalRxcalKaZ5DU.1 2024-09-12T01:01:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.236+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.56__multipart_key1.2~1RkCkGqVhMRphfm5dbalRxcalKaZ5DU.2 2024-09-12T01:01:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.236+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.56__multipart_key1.2~1RkCkGqVhMRphfm5dbalRxcalKaZ5DU.3 2024-09-12T01:01:24.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.236+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.56__multipart_key1.2~1RkCkGqVhMRphfm5dbalRxcalKaZ5DU.4 2024-09-12T01:01:24.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.236+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.56__multipart_key1.2~1RkCkGqVhMRphfm5dbalRxcalKaZ5DU.5 2024-09-12T01:01:24.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.241+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.244+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:01:24.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.245+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.246+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.246+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T01:01:24.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.246+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12222143772010726517', time=2024-09-12T02:59:58.146211+0000, chain.objs.size()=5 2024-09-12T01:01:24.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.246+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.53__multipart_file2.mpg.2~BpxAUXz5guyH_TttlMS3QWoXHXNgd-C.1 2024-09-12T01:01:24.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.246+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.53__multipart_file2.mpg.2~BpxAUXz5guyH_TttlMS3QWoXHXNgd-C.2 2024-09-12T01:01:24.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.246+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.53__multipart_file2.mpg.2~BpxAUXz5guyH_TttlMS3QWoXHXNgd-C.3 2024-09-12T01:01:24.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.246+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.53__multipart_file2.mpg.2~BpxAUXz5guyH_TttlMS3QWoXHXNgd-C.4 2024-09-12T01:01:24.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.246+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.53__multipart_file2.mpg.2~BpxAUXz5guyH_TttlMS3QWoXHXNgd-C.5 2024-09-12T01:01:24.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.246+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp', time=2024-09-12T03:01:07.808730+0000, chain.objs.size()=1 2024-09-12T01:01:24.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.246+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.12 2024-09-12T01:01:24.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.246+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp', time=2024-09-12T03:01:07.946006+0000, chain.objs.size()=1 2024-09-12T01:01:24.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.246+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.15 2024-09-12T01:01:24.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.246+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp', time=2024-09-12T03:01:08.014135+0000, chain.objs.size()=1 2024-09-12T01:01:24.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.246+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.16 2024-09-12T01:01:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.246+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp', time=2024-09-12T03:01:08.091781+0000, chain.objs.size()=1 2024-09-12T01:01:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.247+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.17 2024-09-12T01:01:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.247+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp', time=2024-09-12T03:01:08.211932+0000, chain.objs.size()=1 2024-09-12T01:01:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.247+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.18 2024-09-12T01:01:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.247+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp', time=2024-09-12T03:01:08.281197+0000, chain.objs.size()=1 2024-09-12T01:01:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.247+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.19 2024-09-12T01:01:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.247+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp', time=2024-09-12T03:01:08.332217+0000, chain.objs.size()=1 2024-09-12T01:01:24.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.247+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.20 2024-09-12T01:01:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.249+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp', time=2024-09-12T03:01:08.403706+0000, chain.objs.size()=23 2024-09-12T01:01:24.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.249+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.1 2024-09-12T01:01:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.251+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.2 2024-09-12T01:01:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.251+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.3 2024-09-12T01:01:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.251+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.4 2024-09-12T01:01:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.251+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.5 2024-09-12T01:01:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.251+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.6 2024-09-12T01:01:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.252+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.7 2024-09-12T01:01:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.252+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.8 2024-09-12T01:01:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.252+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.9 2024-09-12T01:01:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.252+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.10 2024-09-12T01:01:24.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.252+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.11 2024-09-12T01:01:24.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.253+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.juFhFvxuLmmnU5jXjG76U-i2PIwepfDt.12 2024-09-12T01:01:24.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.257+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.13 2024-09-12T01:01:24.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.257+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.14 2024-09-12T01:01:24.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.257+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.qgGgbHJ_F2N-nZLneLOy7kx_o__HEgPG.15 2024-09-12T01:01:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.257+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.kdSH0AgkLjtoxNkOI1_VDGjlZXTMgko1.16 2024-09-12T01:01:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.257+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.uL3b7oSiotEEXubICUm_oz4n-3-mqget.17 2024-09-12T01:01:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.258+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.pFHVG3NiIXIGEpfK1GsqGuxd8fQ__fpJ.18 2024-09-12T01:01:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.258+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.DNL0t1diiPvj5jo8j9bkw3hDbM8n5zV5.19 2024-09-12T01:01:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.258+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.KA5_vW1WW7eYRYYqawuuBpmQf6TUh0Yx.20 2024-09-12T01:01:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.258+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.21 2024-09-12T01:01:24.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.258+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.22 2024-09-12T01:01:24.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.258+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.58__multipart_key1.2~jOT_rfFjxD9n0YqgcVArg2Y9lyGFrgp.23 2024-09-12T01:01:24.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.264+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.266+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:01:24.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.268+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.268+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.269+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:01:24.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.269+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12319452064168187197', time=2024-09-12T02:59:43.183010+0000, chain.objs.size()=5 2024-09-12T01:01:24.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.269+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.51__multipart_key1.2~RizqQttI8z2p05ggRRVDa3w4xFaJNPj.1 2024-09-12T01:01:24.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.269+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.51__multipart_key1.2~RizqQttI8z2p05ggRRVDa3w4xFaJNPj.2 2024-09-12T01:01:24.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.269+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.51__multipart_key1.2~RizqQttI8z2p05ggRRVDa3w4xFaJNPj.3 2024-09-12T01:01:24.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.269+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.51__multipart_key1.2~RizqQttI8z2p05ggRRVDa3w4xFaJNPj.4 2024-09-12T01:01:24.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.269+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.51__multipart_key1.2~RizqQttI8z2p05ggRRVDa3w4xFaJNPj.5 2024-09-12T01:01:24.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.269+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10023340123616514614', time=2024-09-12T03:00:58.277631+0000, chain.objs.size()=1 2024-09-12T01:01:24.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.269+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.56__shadow_.3fNp7mKa04YZRKEL4b7EVB_0l6yloNM_0 2024-09-12T01:01:24.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.272+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.274+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:01:24.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.276+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.276+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.276+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:24.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.276+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14992744900439121488', time=2024-09-12T03:00:54.120198+0000, chain.objs.size()=11 2024-09-12T01:01:24.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.276+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~OTwVFuolYXSkls0y6Y51o_sr2WigP6i.1 2024-09-12T01:01:24.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.276+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__shadow_key1.2~OTwVFuolYXSkls0y6Y51o_sr2WigP6i.1_1 2024-09-12T01:01:24.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.276+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~OTwVFuolYXSkls0y6Y51o_sr2WigP6i.2 2024-09-12T01:01:24.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.276+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__shadow_key1.2~OTwVFuolYXSkls0y6Y51o_sr2WigP6i.2_1 2024-09-12T01:01:24.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.276+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~OTwVFuolYXSkls0y6Y51o_sr2WigP6i.3 2024-09-12T01:01:24.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.276+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__shadow_key1.2~OTwVFuolYXSkls0y6Y51o_sr2WigP6i.3_1 2024-09-12T01:01:24.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.276+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~OTwVFuolYXSkls0y6Y51o_sr2WigP6i.4 2024-09-12T01:01:24.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.276+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__shadow_key1.2~OTwVFuolYXSkls0y6Y51o_sr2WigP6i.4_1 2024-09-12T01:01:24.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.276+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~OTwVFuolYXSkls0y6Y51o_sr2WigP6i.5 2024-09-12T01:01:24.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.276+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__shadow_key1.2~OTwVFuolYXSkls0y6Y51o_sr2WigP6i.5_1 2024-09-12T01:01:24.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.276+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~OTwVFuolYXSkls0y6Y51o_sr2WigP6i.6 2024-09-12T01:01:24.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.282+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.285+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:01:24.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.286+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.287+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.287+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:01:24.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.287+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='2~mCfssYthzwd2rZ1DhTd0upVY3pGn4BR', time=2024-09-12T03:00:00.682290+0000, chain.objs.size()=3 2024-09-12T01:01:24.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.287+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.54__multipart_key1.2~mCfssYthzwd2rZ1DhTd0upVY3pGn4BR.7 2024-09-12T01:01:24.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.287+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.54__multipart_key1.2~mCfssYthzwd2rZ1DhTd0upVY3pGn4BR.10 2024-09-12T01:01:24.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.287+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.54__multipart_key1.2~mCfssYthzwd2rZ1DhTd0upVY3pGn4BR.13 2024-09-12T01:01:24.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.287+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12984257601994924475', time=2024-09-12T03:01:11.955510+0000, chain.objs.size()=1 2024-09-12T01:01:24.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.287+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.62__shadow_.XA_Shcynd9hpixfYt74G0h9GzghpAeD_0 2024-09-12T01:01:24.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.289+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.291+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:01:24.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.293+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.293+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.293+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:24.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.293+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6377598990809944013', time=2024-09-12T03:01:12.863896+0000, chain.objs.size()=1 2024-09-12T01:01:24.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.293+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.64__shadow_.GgX0S6OFTdDEY15RioeuMUTk8s_8qWg_0 2024-09-12T01:01:24.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.295+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.297+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:01:24.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.298+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.299+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.299+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:24.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.299+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10225667422125910245', time=2024-09-12T02:58:55.504083+0000, chain.objs.size()=5 2024-09-12T01:01:24.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.299+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.44__multipart_key1.2~SgII06Y1JRQWkztq-yY4-tp46gyxb6-.1 2024-09-12T01:01:24.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.299+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.44__multipart_key1.2~SgII06Y1JRQWkztq-yY4-tp46gyxb6-.2 2024-09-12T01:01:24.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.299+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.44__multipart_key1.2~SgII06Y1JRQWkztq-yY4-tp46gyxb6-.3 2024-09-12T01:01:24.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.299+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.44__multipart_key1.2~SgII06Y1JRQWkztq-yY4-tp46gyxb6-.4 2024-09-12T01:01:24.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.299+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.44__multipart_key1.2~SgII06Y1JRQWkztq-yY4-tp46gyxb6-.5 2024-09-12T01:01:24.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.302+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.304+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:01:24.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.306+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.306+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.306+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.307+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:01:24.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.309+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.309+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.310+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:01:24.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.310+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17173474697537173364', time=2024-09-12T02:59:34.378952+0000, chain.objs.size()=5 2024-09-12T01:01:24.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.310+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~C6s8eA7T3daqDz_nMClj0KzxTZfLA-P.1 2024-09-12T01:01:24.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.310+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__shadow_key1.2~C6s8eA7T3daqDz_nMClj0KzxTZfLA-P.1_1 2024-09-12T01:01:24.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.310+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~C6s8eA7T3daqDz_nMClj0KzxTZfLA-P.2 2024-09-12T01:01:24.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.310+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__shadow_key1.2~C6s8eA7T3daqDz_nMClj0KzxTZfLA-P.2_1 2024-09-12T01:01:24.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.310+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~C6s8eA7T3daqDz_nMClj0KzxTZfLA-P.3 2024-09-12T01:01:24.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.310+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6510977570315877744', time=2024-09-12T03:00:19.081601+0000, chain.objs.size()=11 2024-09-12T01:01:24.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.310+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~lyoSMVvzVxZLPZ1XOOdxwyi3wAFMioo.1 2024-09-12T01:01:24.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.310+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~lyoSMVvzVxZLPZ1XOOdxwyi3wAFMioo.2 2024-09-12T01:01:24.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.310+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~lyoSMVvzVxZLPZ1XOOdxwyi3wAFMioo.3 2024-09-12T01:01:24.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.310+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~lyoSMVvzVxZLPZ1XOOdxwyi3wAFMioo.4 2024-09-12T01:01:24.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.310+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~lyoSMVvzVxZLPZ1XOOdxwyi3wAFMioo.5 2024-09-12T01:01:24.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.310+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~lyoSMVvzVxZLPZ1XOOdxwyi3wAFMioo.6 2024-09-12T01:01:24.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.310+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~lyoSMVvzVxZLPZ1XOOdxwyi3wAFMioo.7 2024-09-12T01:01:24.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.316+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~lyoSMVvzVxZLPZ1XOOdxwyi3wAFMioo.8 2024-09-12T01:01:24.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.316+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~lyoSMVvzVxZLPZ1XOOdxwyi3wAFMioo.9 2024-09-12T01:01:24.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.316+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~lyoSMVvzVxZLPZ1XOOdxwyi3wAFMioo.10 2024-09-12T01:01:24.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.316+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~lyoSMVvzVxZLPZ1XOOdxwyi3wAFMioo.11 2024-09-12T01:01:24.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.319+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.322+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:01:24.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.323+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.323+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.324+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:24.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.324+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15735630275508519939', time=2024-09-12T02:59:31.235423+0000, chain.objs.size()=5 2024-09-12T01:01:24.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.324+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~c-k3gD8_SqAHz2JU_PNm4Z95ZVWrxeX.1 2024-09-12T01:01:24.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.324+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~c-k3gD8_SqAHz2JU_PNm4Z95ZVWrxeX.2 2024-09-12T01:01:24.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.324+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~c-k3gD8_SqAHz2JU_PNm4Z95ZVWrxeX.3 2024-09-12T01:01:24.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.324+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~c-k3gD8_SqAHz2JU_PNm4Z95ZVWrxeX.4 2024-09-12T01:01:24.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.324+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~c-k3gD8_SqAHz2JU_PNm4Z95ZVWrxeX.5 2024-09-12T01:01:24.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.327+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.329+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:01:24.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.330+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.331+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.331+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.332+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:01:24.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.333+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.334+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.334+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.335+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:01:24.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.336+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.336+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.337+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.338+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:01:24.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.339+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.339+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.340+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:01:24.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.340+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16468884119635626992', time=2024-09-12T02:59:58.182578+0000, chain.objs.size()=1 2024-09-12T01:01:24.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.340+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.53__shadow_.kKZUda08F-wdFvaXZzaI_VmhUk5spEO_0 2024-09-12T01:01:24.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.340+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14796801351971719221', time=2024-09-12T03:00:27.757805+0000, chain.objs.size()=11 2024-09-12T01:01:24.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.340+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~TdisZLe7MzEIus-XMcCHkAfap6hgfde.1 2024-09-12T01:01:24.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.340+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~TdisZLe7MzEIus-XMcCHkAfap6hgfde.2 2024-09-12T01:01:24.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.340+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~TdisZLe7MzEIus-XMcCHkAfap6hgfde.3 2024-09-12T01:01:24.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.340+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~TdisZLe7MzEIus-XMcCHkAfap6hgfde.4 2024-09-12T01:01:24.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.340+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~TdisZLe7MzEIus-XMcCHkAfap6hgfde.5 2024-09-12T01:01:24.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.340+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~TdisZLe7MzEIus-XMcCHkAfap6hgfde.6 2024-09-12T01:01:24.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.340+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~TdisZLe7MzEIus-XMcCHkAfap6hgfde.7 2024-09-12T01:01:24.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.340+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~TdisZLe7MzEIus-XMcCHkAfap6hgfde.8 2024-09-12T01:01:24.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.340+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~TdisZLe7MzEIus-XMcCHkAfap6hgfde.9 2024-09-12T01:01:24.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.340+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~TdisZLe7MzEIus-XMcCHkAfap6hgfde.10 2024-09-12T01:01:24.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.340+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~TdisZLe7MzEIus-XMcCHkAfap6hgfde.11 2024-09-12T01:01:24.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.343+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11175432710765348715', time=2024-09-12T03:01:04.145270+0000, chain.objs.size()=5 2024-09-12T01:01:24.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.343+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.57__multipart_key1.2~qn0iHK15-X7aRXr6z2pKdAkPA8gQBxl.1 2024-09-12T01:01:24.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.344+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.57__multipart_key1.2~qn0iHK15-X7aRXr6z2pKdAkPA8gQBxl.2 2024-09-12T01:01:24.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.344+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.57__multipart_key1.2~qn0iHK15-X7aRXr6z2pKdAkPA8gQBxl.3 2024-09-12T01:01:24.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.344+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.57__multipart_key1.2~qn0iHK15-X7aRXr6z2pKdAkPA8gQBxl.4 2024-09-12T01:01:24.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.346+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.57__multipart_key1.2~qn0iHK15-X7aRXr6z2pKdAkPA8gQBxl.5 2024-09-12T01:01:24.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.350+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.352+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:01:24.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.354+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.354+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.355+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:01:24.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.355+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3296409158256055644', time=2024-09-12T02:59:37.288837+0000, chain.objs.size()=5 2024-09-12T01:01:24.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.355+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~NErn1BfQ3MKip01S_nJoOJezZJQO689.1 2024-09-12T01:01:24.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.355+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__shadow_key1.2~NErn1BfQ3MKip01S_nJoOJezZJQO689.1_1 2024-09-12T01:01:24.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.355+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~NErn1BfQ3MKip01S_nJoOJezZJQO689.2 2024-09-12T01:01:24.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.355+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__shadow_key1.2~NErn1BfQ3MKip01S_nJoOJezZJQO689.2_1 2024-09-12T01:01:24.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.355+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.47__multipart_key1.2~NErn1BfQ3MKip01S_nJoOJezZJQO689.3 2024-09-12T01:01:24.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.355+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10711719287169886475', time=2024-09-12T03:00:36.174331+0000, chain.objs.size()=10 2024-09-12T01:01:24.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.355+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~215HfVKWBG96owRclzj-_aMjsMzPiQP.1 2024-09-12T01:01:24.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.355+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~215HfVKWBG96owRclzj-_aMjsMzPiQP.2 2024-09-12T01:01:24.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.355+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~215HfVKWBG96owRclzj-_aMjsMzPiQP.3 2024-09-12T01:01:24.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.355+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~215HfVKWBG96owRclzj-_aMjsMzPiQP.4 2024-09-12T01:01:24.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.355+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~215HfVKWBG96owRclzj-_aMjsMzPiQP.5 2024-09-12T01:01:24.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.355+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~215HfVKWBG96owRclzj-_aMjsMzPiQP.6 2024-09-12T01:01:24.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.355+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~215HfVKWBG96owRclzj-_aMjsMzPiQP.7 2024-09-12T01:01:24.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.359+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~215HfVKWBG96owRclzj-_aMjsMzPiQP.8 2024-09-12T01:01:24.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.359+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~215HfVKWBG96owRclzj-_aMjsMzPiQP.9 2024-09-12T01:01:24.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.359+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.55__multipart_key1.2~215HfVKWBG96owRclzj-_aMjsMzPiQP.10 2024-09-12T01:01:24.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.359+0000 7f92ae417800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3886413198671859167', time=2024-09-12T03:01:11.064828+0000, chain.objs.size()=1 2024-09-12T01:01:24.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.359+0000 7f92ae417800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.60__shadow_.7YjWMQNpG7Z3Mo7M1Mce4wS2BVljMQk_0 2024-09-12T01:01:24.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.364+0000 7f92ae417800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:24.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.366+0000 7f92ae417800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:01:24.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.368+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.368+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.369+0000 7f92ae417800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.370+0000 7f915ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:24.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.372+0000 7f92ae417800 20 remove_watcher() i=0 2024-09-12T01:01:24.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.372+0000 7f92ae417800 2 removed watcher, disabling cache 2024-09-12T01:01:24.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.373+0000 7f92ae417800 20 remove_watcher() i=1 2024-09-12T01:01:24.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.375+0000 7f92ae417800 20 remove_watcher() i=2 2024-09-12T01:01:24.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.376+0000 7f92ae417800 20 remove_watcher() i=3 2024-09-12T01:01:24.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.377+0000 7f92ae417800 20 remove_watcher() i=4 2024-09-12T01:01:24.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.378+0000 7f92ae417800 20 remove_watcher() i=5 2024-09-12T01:01:24.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.378+0000 7f92ae417800 20 remove_watcher() i=6 2024-09-12T01:01:24.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.380+0000 7f92ae417800 20 remove_watcher() i=7 2024-09-12T01:01:24.390 DEBUG:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2024-09-12T01:01:24.444 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:24.444 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:24.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.485+0000 7faabdf75800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.487+0000 7faabdf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.487+0000 7faabdf75800 20 realm 2024-09-12T01:01:24.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.487+0000 7faabdf75800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.487+0000 7faabdf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.487+0000 7faabdf75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:24.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.487+0000 7faabdf75800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.487+0000 7faabdf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.487+0000 7faabdf75800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.488+0000 7faabdf75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:24.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.488+0000 7faabdf75800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.489+0000 7faabdf75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:24.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.489+0000 7faabdf75800 20 searching for the correct realm 2024-09-12T01:01:24.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.491+0000 7faabb25e640 0 -- 172.21.15.62:0/3848558456 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7faab407e910 msgr2=0x7faab40543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:24.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.697+0000 7faabc260640 0 -- 172.21.15.62:0/3848558456 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5618361001f0 msgr2=0x561836102640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.701+0000 7faabdf75800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:01:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.701+0000 7faabdf75800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:01:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.701+0000 7faabdf75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.701+0000 7faabdf75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.701+0000 7faabdf75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.701+0000 7faabdf75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.701+0000 7faabdf75800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.701+0000 7faabdf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.701+0000 7faabdf75800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.702+0000 7faabdf75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.702+0000 7faabdf75800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.702+0000 7faabdf75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.702+0000 7faabdf75800 20 zone default found 2024-09-12T01:01:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.702+0000 7faabdf75800 4 Realm: () 2024-09-12T01:01:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.702+0000 7faabdf75800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:01:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.702+0000 7faabdf75800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:01:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.702+0000 7faabdf75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.702+0000 7faabdf75800 20 zonegroup default 2024-09-12T01:01:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.702+0000 7faabdf75800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.702+0000 7faabdf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.702+0000 7faabdf75800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.703+0000 7faabdf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.703+0000 7faabdf75800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.703+0000 7faabdf75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.703+0000 7faabdf75800 20 started sync module instance, tier type = 2024-09-12T01:01:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.703+0000 7faabdf75800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:01:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.711+0000 7faabdf75800 20 add_watcher() i=0 2024-09-12T01:01:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.711+0000 7faabdf75800 20 add_watcher() i=1 2024-09-12T01:01:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.711+0000 7faabdf75800 20 add_watcher() i=2 2024-09-12T01:01:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.711+0000 7faabdf75800 20 add_watcher() i=3 2024-09-12T01:01:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.711+0000 7faabdf75800 20 add_watcher() i=4 2024-09-12T01:01:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.711+0000 7faabdf75800 20 add_watcher() i=5 2024-09-12T01:01:24.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.711+0000 7faabdf75800 20 add_watcher() i=6 2024-09-12T01:01:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.712+0000 7faabdf75800 20 add_watcher() i=7 2024-09-12T01:01:24.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.712+0000 7faabdf75800 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.713+0000 7fa971fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.713+0000 7faabdf75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:24.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.713+0000 7faabdf75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.747+0000 7fa970fe1640 20 reqs_thread_entry: start 2024-09-12T01:01:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.747+0000 7faabdf75800 20 init_complete bucket index max shards: 1 2024-09-12T01:01:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.747+0000 7faabdf75800 20 Filter name: none 2024-09-12T01:01:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.747+0000 7fa8ea7fc640 20 reqs_thread_entry: start 2024-09-12T01:01:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.747+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:01:24.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.749+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.749+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.749+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.751+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:01:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.752+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.752+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.753+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.754+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:01:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.755+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.756+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.756+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.757+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:01:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.758+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.758+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.759+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.760+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:01:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.761+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.761+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.762+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.763+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:01:24.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.764+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.764+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.764+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.765+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:01:24.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.766+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.767+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.767+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.768+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:01:24.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.770+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.770+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.770+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.771+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:01:24.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.773+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.774+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.774+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.775+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:01:24.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.777+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.777+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.778+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.779+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:01:24.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.780+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.780+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.780+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.781+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:01:24.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.783+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.783+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.783+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.784+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:01:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.786+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.786+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.786+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.787+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:01:24.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.788+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.789+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.789+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.790+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:01:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.791+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.792+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.792+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.793+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:01:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.795+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.795+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.795+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.797+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:01:24.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.798+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.798+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.799+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.800+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:01:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.801+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.801+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.802+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.802+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:01:24.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.804+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.804+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.804+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.805+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:01:24.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.806+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.807+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.807+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.808+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:01:24.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.809+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.810+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.810+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.811+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:01:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.812+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.813+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.813+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.814+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:01:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.815+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.815+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.816+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.817+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:01:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.818+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.818+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.819+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.820+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:01:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.822+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.822+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.823+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.823+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:01:24.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.825+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.825+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.826+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.826+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:01:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.828+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.828+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.829+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.830+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:01:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.831+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.831+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.832+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.833+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:01:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.834+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.834+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.835+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.836+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:01:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.837+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.837+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.838+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.839+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:01:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.840+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.840+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.840+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.842+0000 7faabdf75800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:01:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.843+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.844+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:24.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.844+0000 7faabdf75800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:24.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.846+0000 7fa971fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.848+0000 7faabdf75800 20 remove_watcher() i=0 2024-09-12T01:01:24.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.848+0000 7faabdf75800 2 removed watcher, disabling cache 2024-09-12T01:01:24.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.849+0000 7faabdf75800 20 remove_watcher() i=1 2024-09-12T01:01:24.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.850+0000 7faabdf75800 20 remove_watcher() i=2 2024-09-12T01:01:24.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.851+0000 7faabdf75800 20 remove_watcher() i=3 2024-09-12T01:01:24.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.852+0000 7faabdf75800 20 remove_watcher() i=4 2024-09-12T01:01:24.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.853+0000 7faabdf75800 20 remove_watcher() i=5 2024-09-12T01:01:24.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.854+0000 7faabdf75800 20 remove_watcher() i=6 2024-09-12T01:01:24.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.855+0000 7faabdf75800 20 remove_watcher() i=7 2024-09-12T01:01:24.866 DEBUG:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2024-09-12T01:01:24.919 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:24.919 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:24.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.959+0000 7fb2cd93c800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.961+0000 7fb2cd93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.961+0000 7fb2cd93c800 20 realm 2024-09-12T01:01:24.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.961+0000 7fb2cd93c800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.961+0000 7fb2cd93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.961+0000 7fb2cd93c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:24.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.961+0000 7fb2cd93c800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.961+0000 7fb2cd93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:24.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.961+0000 7fb2cd93c800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.962+0000 7fb2cd93c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:24.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.962+0000 7fb2cd93c800 20 rados->read ofs=0 len=0 2024-09-12T01:01:24.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.963+0000 7fb2cd93c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:24.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.963+0000 7fb2cd93c800 20 searching for the correct realm 2024-09-12T01:01:24.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:24.966+0000 7fb2c8e80640 0 -- 172.21.15.62:0/1808352272 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fb2c4018040 msgr2=0x7fb2c4092ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:25.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.170+0000 7fb2c9681640 0 -- 172.21.15.62:0/1808352272 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7fb2c408a760 msgr2=0x7fb2c409aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.376+0000 7fb2cd93c800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:01:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.376+0000 7fb2cd93c800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:01:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.376+0000 7fb2cd93c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.376+0000 7fb2cd93c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.376+0000 7fb2cd93c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.376+0000 7fb2cd93c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.376+0000 7fb2cd93c800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.376+0000 7fb2cd93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.376+0000 7fb2cd93c800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.377+0000 7fb2cd93c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:25.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.377+0000 7fb2cd93c800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.377+0000 7fb2cd93c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.377+0000 7fb2cd93c800 20 zone default found 2024-09-12T01:01:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.377+0000 7fb2cd93c800 4 Realm: () 2024-09-12T01:01:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.377+0000 7fb2cd93c800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:01:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.377+0000 7fb2cd93c800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:01:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.377+0000 7fb2cd93c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.377+0000 7fb2cd93c800 20 zonegroup default 2024-09-12T01:01:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.377+0000 7fb2cd93c800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.378+0000 7fb2cd93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.378+0000 7fb2cd93c800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.378+0000 7fb2cd93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:25.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.378+0000 7fb2cd93c800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.378+0000 7fb2cd93c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:25.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.378+0000 7fb2cd93c800 20 started sync module instance, tier type = 2024-09-12T01:01:25.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.378+0000 7fb2cd93c800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:01:25.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.388+0000 7fb2cd93c800 20 add_watcher() i=0 2024-09-12T01:01:25.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.388+0000 7fb2cd93c800 20 add_watcher() i=1 2024-09-12T01:01:25.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.388+0000 7fb2cd93c800 20 add_watcher() i=2 2024-09-12T01:01:25.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.388+0000 7fb2cd93c800 20 add_watcher() i=3 2024-09-12T01:01:25.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.388+0000 7fb2cd93c800 20 add_watcher() i=4 2024-09-12T01:01:25.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.388+0000 7fb2cd93c800 20 add_watcher() i=5 2024-09-12T01:01:25.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.388+0000 7fb2cd93c800 20 add_watcher() i=6 2024-09-12T01:01:25.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.389+0000 7fb2cd93c800 20 add_watcher() i=7 2024-09-12T01:01:25.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.389+0000 7fb2cd93c800 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:25.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.390+0000 7fb17ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:25.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.390+0000 7fb2cd93c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:25.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.390+0000 7fb2cd93c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:25.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.426+0000 7fb17efe5640 20 reqs_thread_entry: start 2024-09-12T01:01:25.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.426+0000 7fb2cd93c800 20 init_complete bucket index max shards: 1 2024-09-12T01:01:25.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.426+0000 7fb2cd93c800 20 Filter name: none 2024-09-12T01:01:25.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.426+0000 7fb17cfe1640 20 reqs_thread_entry: start 2024-09-12T01:01:25.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.427+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:01:25.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.428+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.428+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.429+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.429+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:01:25.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.431+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.431+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.432+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.432+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:01:25.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.434+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.434+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.435+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.436+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:01:25.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.437+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.438+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.438+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.439+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:01:25.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.441+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.441+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.441+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.442+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:01:25.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.444+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.444+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.444+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.446+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:01:25.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.447+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.448+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.449+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.450+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:01:25.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.451+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.451+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.452+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.453+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:01:25.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.454+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.454+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.455+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.456+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:01:25.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.457+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.458+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.458+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.459+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:01:25.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.461+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.461+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.461+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.463+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:01:25.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.464+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.465+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.465+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.466+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:01:25.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.468+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.468+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.468+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.469+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:01:25.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.471+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.471+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.472+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.473+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:01:25.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.474+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.475+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.475+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.476+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:01:25.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.477+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.478+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.478+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.479+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:01:25.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.480+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.481+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.481+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.482+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:01:25.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.484+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.484+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.484+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.485+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:01:25.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.486+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.487+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.487+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.488+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:01:25.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.489+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.490+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.490+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.491+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:01:25.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.492+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.493+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.493+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.494+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:01:25.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.495+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.496+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.496+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.497+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:01:25.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.498+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.499+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.499+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.500+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:01:25.500 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.501+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.502+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.502+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.502 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.503+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:01:25.503 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.504+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.505+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.505+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.506+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:01:25.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.507+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.508+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.508+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.509+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:01:25.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.510+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.511+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.511+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.512+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:01:25.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.514+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.514+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.514+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.515+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:01:25.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.517+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.517+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.518+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.519+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:01:25.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.520+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.521+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.521+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.522+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:01:25.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.523+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.524+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.524+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.525+0000 7fb2cd93c800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:01:25.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.526+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.527+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.527+0000 7fb2cd93c800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.529+0000 7fb17ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:25.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.531+0000 7fb2cd93c800 20 remove_watcher() i=0 2024-09-12T01:01:25.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.531+0000 7fb2cd93c800 2 removed watcher, disabling cache 2024-09-12T01:01:25.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.532+0000 7fb2cd93c800 20 remove_watcher() i=1 2024-09-12T01:01:25.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.533+0000 7fb2cd93c800 20 remove_watcher() i=2 2024-09-12T01:01:25.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.534+0000 7fb2cd93c800 20 remove_watcher() i=3 2024-09-12T01:01:25.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.535+0000 7fb2cd93c800 20 remove_watcher() i=4 2024-09-12T01:01:25.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.536+0000 7fb2cd93c800 20 remove_watcher() i=5 2024-09-12T01:01:25.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.537+0000 7fb2cd93c800 20 remove_watcher() i=6 2024-09-12T01:01:25.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.537+0000 7fb2cd93c800 20 remove_watcher() i=7 2024-09-12T01:01:25.548 DEBUG:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2024-09-12T01:01:25.601 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:25.602 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:25.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.641+0000 7f0899126800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.643+0000 7f0899126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:25.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.643+0000 7f0899126800 20 realm 2024-09-12T01:01:25.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.643+0000 7f0899126800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.644+0000 7f0899126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:25.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.644+0000 7f0899126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:25.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.644+0000 7f0899126800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.644+0000 7f0899126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:25.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.644+0000 7f0899126800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.645+0000 7f0899126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:25.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.645+0000 7f0899126800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.645+0000 7f0899126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:25.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.645+0000 7f0899126800 20 searching for the correct realm 2024-09-12T01:01:25.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.648+0000 7f08945b4640 0 -- 172.21.15.62:0/2408155237 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f088c0b1bd0 msgr2=0x7f088c0b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:25.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.852+0000 7f08945b4640 0 -- 172.21.15.62:0/2408155237 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55d79ba1a920 msgr2=0x55d79ba1cd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:25.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.856+0000 7f0899126800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:01:25.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.856+0000 7f0899126800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:01:25.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.856+0000 7f0899126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:25.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.856+0000 7f0899126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:25.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.856+0000 7f0899126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:25.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.856+0000 7f0899126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:25.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.856+0000 7f0899126800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.856+0000 7f0899126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:25.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.856+0000 7f0899126800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.857+0000 7f0899126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:25.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.857+0000 7f0899126800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.857+0000 7f0899126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:25.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.857+0000 7f0899126800 20 zone default found 2024-09-12T01:01:25.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.857+0000 7f0899126800 4 Realm: () 2024-09-12T01:01:25.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.857+0000 7f0899126800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:01:25.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.857+0000 7f0899126800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:01:25.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.857+0000 7f0899126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:25.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.857+0000 7f0899126800 20 zonegroup default 2024-09-12T01:01:25.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.857+0000 7f0899126800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.857+0000 7f0899126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:25.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.857+0000 7f0899126800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.858+0000 7f0899126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:25.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.858+0000 7f0899126800 20 rados->read ofs=0 len=0 2024-09-12T01:01:25.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.858+0000 7f0899126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:25.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.858+0000 7f0899126800 20 started sync module instance, tier type = 2024-09-12T01:01:25.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.858+0000 7f0899126800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:01:25.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.866+0000 7f0899126800 20 add_watcher() i=0 2024-09-12T01:01:25.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.866+0000 7f0899126800 20 add_watcher() i=1 2024-09-12T01:01:25.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.866+0000 7f0899126800 20 add_watcher() i=2 2024-09-12T01:01:25.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.866+0000 7f0899126800 20 add_watcher() i=3 2024-09-12T01:01:25.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.866+0000 7f0899126800 20 add_watcher() i=4 2024-09-12T01:01:25.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.866+0000 7f0899126800 20 add_watcher() i=5 2024-09-12T01:01:25.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.866+0000 7f0899126800 20 add_watcher() i=6 2024-09-12T01:01:25.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.867+0000 7f0899126800 20 add_watcher() i=7 2024-09-12T01:01:25.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.867+0000 7f0899126800 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:25.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.869+0000 7f074afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:25.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.869+0000 7f0899126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:25.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.869+0000 7f0899126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:25.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.904+0000 7f0749fe3640 20 reqs_thread_entry: start 2024-09-12T01:01:25.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.904+0000 7f0899126800 20 init_complete bucket index max shards: 1 2024-09-12T01:01:25.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.905+0000 7f0899126800 20 Filter name: none 2024-09-12T01:01:25.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.905+0000 7f06bb7fe640 20 reqs_thread_entry: start 2024-09-12T01:01:25.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.905+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:01:25.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.906+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.907+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.907+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.908+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:01:25.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.910+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.911+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.911+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.912+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:01:25.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.913+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.914+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.914+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.915+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:01:25.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.916+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.917+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.917+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.917 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.918+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:01:25.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.919+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.920+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.920+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.921+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:01:25.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.922+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.923+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.923+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.924+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:01:25.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.926+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.926+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.927+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.928+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:01:25.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.930+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.930+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.930+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.931+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:01:25.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.932+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.933+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.933+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.934+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:01:25.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.935+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.936+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.936+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.937+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:01:25.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.938+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.939+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.939+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.940+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:01:25.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.941+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.942+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.942+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.943+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:01:25.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.944+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.944+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.945+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.946+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:01:25.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.947+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.947+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.948+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.949+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:01:25.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.950+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.950+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.951+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.952+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:01:25.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.953+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.953+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.954+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.955+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:01:25.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.956+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.956+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.957+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.958+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:01:25.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.959+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.960+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.960+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.961+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:01:25.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.962+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.963+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.963+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.964+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:01:25.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.965+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.965+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.966+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.967+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:01:25.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.968+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.968+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.968+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.969+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:01:25.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.971+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.971+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.972+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.973+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:01:25.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.974+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.974+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.974+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.974 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.975+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:01:25.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.977+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.977+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.977+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.978+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:01:25.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.979+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.980+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.980+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.981+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:01:25.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.982+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.983+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.983+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.984+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:01:25.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.986+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.986+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.986+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.987+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:01:25.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.988+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.989+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.989+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.990+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:01:25.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.991+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.992+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.992+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.993+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:01:25.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.994+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.995+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.995+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.996+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:01:25.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.997+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.998+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:25.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:25.998+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:25.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:26.000+0000 7f0899126800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:01:26.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:26.001+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:26.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:26.001+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:26.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:26.002+0000 7f0899126800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:26.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:26.004+0000 7f074afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:26.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:26.006+0000 7f0899126800 20 remove_watcher() i=0 2024-09-12T01:01:26.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:26.006+0000 7f0899126800 2 removed watcher, disabling cache 2024-09-12T01:01:26.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:26.006+0000 7f0899126800 20 remove_watcher() i=1 2024-09-12T01:01:26.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:26.008+0000 7f0899126800 20 remove_watcher() i=2 2024-09-12T01:01:26.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:26.009+0000 7f0899126800 20 remove_watcher() i=3 2024-09-12T01:01:26.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:26.010+0000 7f0899126800 20 remove_watcher() i=4 2024-09-12T01:01:26.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:26.011+0000 7f0899126800 20 remove_watcher() i=5 2024-09-12T01:01:26.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:26.012+0000 7f0899126800 20 remove_watcher() i=6 2024-09-12T01:01:26.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:26.012+0000 7f0899126800 20 remove_watcher() i=7 2024-09-12T01:01:26.025 DEBUG:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T01:01:26.633 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :clean 2024-09-12T01:01:27.531 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :compileJava 2024-09-12T01:01:27.531 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :processResources 2024-09-12T01:01:27.531 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :classes 2024-09-12T01:01:27.930 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:27.931 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :compileTestJava 2024-09-12T01:01:27.931 INFO:teuthology.orchestra.run.smithi062.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T01:01:27.931 INFO:teuthology.orchestra.run.smithi062.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T01:01:27.932 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:27.932 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T01:01:27.932 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :testClasses 2024-09-12T01:01:29.932 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:29.932 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :test 2024-09-12T01:01:29.932 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:29.932 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T01:01:29.932 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12 01:01:29,271 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T01:01:29.932 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:29.932 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T01:01:29.932 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:29.932 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T01:01:29.933 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:29.933 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T01:01:29.933 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:29.933 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:30.030 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:30.131 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T01:01:30.430 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:30.431 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T01:01:30.530 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:30.530 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T01:01:30.630 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:30.630 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T01:01:30.732 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:30.733 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T01:01:31.030 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:31.030 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T01:01:31.130 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:31.130 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T01:01:31.230 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:31.230 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T01:01:31.430 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:31.430 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T01:01:31.830 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:31.830 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T01:01:31.931 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:31.931 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T01:01:32.230 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:32.230 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T01:01:32.231 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:32.231 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T01:01:32.383 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:32.384 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------- 2024-09-12T01:01:32.384 INFO:teuthology.orchestra.run.smithi062.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T01:01:32.384 INFO:teuthology.orchestra.run.smithi062.stdout:-------------------------------------------------------------------- 2024-09-12T01:01:32.384 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:32.384 INFO:teuthology.orchestra.run.smithi062.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T01:01:32.384 INFO:teuthology.orchestra.run.smithi062.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T01:01:32.384 INFO:teuthology.orchestra.run.smithi062.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T01:01:32.384 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:32.384 INFO:teuthology.orchestra.run.smithi062.stdout:BUILD SUCCESSFUL in 6s 2024-09-12T01:01:32.384 INFO:teuthology.orchestra.run.smithi062.stdout:5 actionable tasks: 5 executed 2024-09-12T01:01:32.387 DEBUG:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2024-09-12T01:01:32.441 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:32.441 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:32.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.481+0000 7ff869b35800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.482+0000 7ff869b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.482+0000 7ff869b35800 20 realm 2024-09-12T01:01:32.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.482+0000 7ff869b35800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.483+0000 7ff869b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.483+0000 7ff869b35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:32.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.483+0000 7ff869b35800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.483+0000 7ff869b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.483+0000 7ff869b35800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.484+0000 7ff869b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:32.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.484+0000 7ff869b35800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.484+0000 7ff869b35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:32.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.484+0000 7ff869b35800 20 searching for the correct realm 2024-09-12T01:01:32.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.487+0000 7ff86507c640 0 -- 172.21.15.62:0/263243417 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7ff86001e9e0 msgr2=0x7ff860089190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:32.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.693+0000 7ff86607e640 0 -- 172.21.15.62:0/263243417 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55560daec620 msgr2=0x55560daeeac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.697+0000 7ff869b35800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:01:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.697+0000 7ff869b35800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:01:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.697+0000 7ff869b35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.697+0000 7ff869b35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.697+0000 7ff869b35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.697+0000 7ff869b35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.697+0000 7ff869b35800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.698+0000 7ff869b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.698+0000 7ff869b35800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.698+0000 7ff869b35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:32.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.698+0000 7ff869b35800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.698+0000 7ff869b35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.698+0000 7ff869b35800 20 zone default found 2024-09-12T01:01:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.698+0000 7ff869b35800 4 Realm: () 2024-09-12T01:01:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.698+0000 7ff869b35800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:01:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.698+0000 7ff869b35800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:01:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.698+0000 7ff869b35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.698+0000 7ff869b35800 20 zonegroup default 2024-09-12T01:01:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.698+0000 7ff869b35800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.698+0000 7ff869b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.699+0000 7ff869b35800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.699+0000 7ff869b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.699+0000 7ff869b35800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.699+0000 7ff869b35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.699+0000 7ff869b35800 20 started sync module instance, tier type = 2024-09-12T01:01:32.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.699+0000 7ff869b35800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:01:32.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.709+0000 7ff869b35800 20 add_watcher() i=0 2024-09-12T01:01:32.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.709+0000 7ff869b35800 20 add_watcher() i=1 2024-09-12T01:01:32.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.709+0000 7ff869b35800 20 add_watcher() i=2 2024-09-12T01:01:32.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.709+0000 7ff869b35800 20 add_watcher() i=3 2024-09-12T01:01:32.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.709+0000 7ff869b35800 20 add_watcher() i=4 2024-09-12T01:01:32.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.709+0000 7ff869b35800 20 add_watcher() i=5 2024-09-12T01:01:32.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.709+0000 7ff869b35800 20 add_watcher() i=6 2024-09-12T01:01:32.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.710+0000 7ff869b35800 20 add_watcher() i=7 2024-09-12T01:01:32.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.710+0000 7ff869b35800 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:32.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.712+0000 7ff717fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:32.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.712+0000 7ff869b35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:32.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.712+0000 7ff869b35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:32.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.751+0000 7ff716ffd640 20 reqs_thread_entry: start 2024-09-12T01:01:32.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.751+0000 7ff869b35800 20 init_complete bucket index max shards: 1 2024-09-12T01:01:32.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.752+0000 7ff869b35800 20 Filter name: none 2024-09-12T01:01:32.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.752+0000 7ff714ff9640 20 reqs_thread_entry: start 2024-09-12T01:01:32.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.752+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:01:32.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.753+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.754+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.754+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.755+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:01:32.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.756+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.757+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.757+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.758+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:01:32.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.760+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.760+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.760+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.761+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:01:32.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.763+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.763+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.763+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.764+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:01:32.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.766+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.766+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.766+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.767+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:01:32.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.769+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.769+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.769+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.770+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:01:32.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.772+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.772+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.772+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.773+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:01:32.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.774+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.775+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.775+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.776+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:01:32.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.778+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.778+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.778+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.779+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:01:32.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.781+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.781+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.781+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.782+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:01:32.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.784+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.784+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.784+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.786+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:01:32.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.787+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.787+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.788+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.789+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:01:32.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.790+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.790+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.791+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.792+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:01:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.793+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.793+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.793+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.794+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:01:32.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.796+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.796+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.796+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.797+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:01:32.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.799+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.799+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.799+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:32.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.799+0000 7ff869b35800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4493161171270718482', time=2024-09-12T03:01:31.636066+0000, chain.objs.size()=1 2024-09-12T01:01:32.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.799+0000 7ff869b35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.72__shadow_.AkSw8YJvHRpY-z-bUCTjMoQd7ZaZvdF_0 2024-09-12T01:01:32.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.800+0000 7ff869b35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:32.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.802+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:01:32.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.804+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.804+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.805+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.806+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:01:32.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.807+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.808+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.808+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.809+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:01:32.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.811+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.811+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.811+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.812+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:01:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.814+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.814+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.815+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.816+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:01:32.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.817+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.817+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.817+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.818+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:01:32.818 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.820+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.820+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.820+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.821+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:01:32.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.822+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.823+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.823+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.824+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:01:32.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.825+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.826+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.826+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.827+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:01:32.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.828+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.829+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.829+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.830+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:01:32.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.831+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.832+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.832+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.833+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:01:32.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.834+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.835+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.835+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.836+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:01:32.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.837+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.838+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.838+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:32.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.838+0000 7ff869b35800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5945401869397055034', time=2024-09-12T03:01:30.846552+0000, chain.objs.size()=1 2024-09-12T01:01:32.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.838+0000 7ff869b35800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.71__shadow_.AhYqmsdrM0RdaqDHfGmzoBWg82i2E4B_0 2024-09-12T01:01:32.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.839+0000 7ff869b35800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:32.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.842+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:01:32.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.843+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.844+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.844+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.845+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:01:32.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.846+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.847+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.847+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.848+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:01:32.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.850+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.850+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.850+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.851+0000 7ff869b35800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:01:32.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.853+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.853+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:32.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.853+0000 7ff869b35800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:32.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.855+0000 7ff717fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.857+0000 7ff869b35800 20 remove_watcher() i=0 2024-09-12T01:01:32.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.857+0000 7ff869b35800 2 removed watcher, disabling cache 2024-09-12T01:01:32.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.858+0000 7ff869b35800 20 remove_watcher() i=1 2024-09-12T01:01:32.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.859+0000 7ff869b35800 20 remove_watcher() i=2 2024-09-12T01:01:32.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.860+0000 7ff869b35800 20 remove_watcher() i=3 2024-09-12T01:01:32.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.861+0000 7ff869b35800 20 remove_watcher() i=4 2024-09-12T01:01:32.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.862+0000 7ff869b35800 20 remove_watcher() i=5 2024-09-12T01:01:32.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.863+0000 7ff869b35800 20 remove_watcher() i=6 2024-09-12T01:01:32.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.864+0000 7ff869b35800 20 remove_watcher() i=7 2024-09-12T01:01:32.874 DEBUG:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2024-09-12T01:01:32.928 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:32.928 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:32.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.969+0000 7f1335e20800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.970+0000 7f1335e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.970+0000 7f1335e20800 20 realm 2024-09-12T01:01:32.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.970+0000 7f1335e20800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.970+0000 7f1335e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.970+0000 7f1335e20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.970+0000 7f1335e20800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.971+0000 7f1335e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.971+0000 7f1335e20800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.971+0000 7f1335e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:32.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.971+0000 7f1335e20800 20 rados->read ofs=0 len=0 2024-09-12T01:01:32.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.972+0000 7f1335e20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:32.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.972+0000 7f1335e20800 20 searching for the correct realm 2024-09-12T01:01:32.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:32.974+0000 7f1333110640 0 -- 172.21.15.62:0/836791154 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f132c06e830 msgr2=0x7f132c08b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:33.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.180+0000 7f1334112640 0 -- 172.21.15.62:0/836791154 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55d590824c70 msgr2=0x55d5908270f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:01:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:01:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 20 zone default found 2024-09-12T01:01:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 4 Realm: () 2024-09-12T01:01:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:01:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:01:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 20 zonegroup default 2024-09-12T01:01:33.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.185+0000 7f1335e20800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.186+0000 7f1335e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.186+0000 7f1335e20800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.186+0000 7f1335e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.186+0000 7f1335e20800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.186+0000 7f1335e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.186+0000 7f1335e20800 20 started sync module instance, tier type = 2024-09-12T01:01:33.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.186+0000 7f1335e20800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:01:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.195+0000 7f1335e20800 20 add_watcher() i=0 2024-09-12T01:01:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.195+0000 7f1335e20800 20 add_watcher() i=1 2024-09-12T01:01:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.195+0000 7f1335e20800 20 add_watcher() i=2 2024-09-12T01:01:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.195+0000 7f1335e20800 20 add_watcher() i=3 2024-09-12T01:01:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.195+0000 7f1335e20800 20 add_watcher() i=4 2024-09-12T01:01:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.195+0000 7f1335e20800 20 add_watcher() i=5 2024-09-12T01:01:33.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.195+0000 7f1335e20800 20 add_watcher() i=6 2024-09-12T01:01:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.196+0000 7f1335e20800 20 add_watcher() i=7 2024-09-12T01:01:33.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.196+0000 7f1335e20800 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:33.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.198+0000 7f11e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.198+0000 7f1335e20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:33.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.198+0000 7f1335e20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.233+0000 7f11e8fe1640 20 reqs_thread_entry: start 2024-09-12T01:01:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.233+0000 7f1335e20800 20 init_complete bucket index max shards: 1 2024-09-12T01:01:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.233+0000 7f1335e20800 20 Filter name: none 2024-09-12T01:01:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.233+0000 7f11627fc640 20 reqs_thread_entry: start 2024-09-12T01:01:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.233+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:01:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.234+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.235+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.235+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.236+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:01:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.237+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.237+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.238+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.239+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:01:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.240+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.241+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.241+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.242+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:01:33.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.243+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.244+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.244+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.245+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:01:33.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.247+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.247+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.247+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.248+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:01:33.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.250+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.250+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.251+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.251 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.252+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:01:33.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.254+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.254+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.254+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.256+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:01:33.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.257+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.257+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.258+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.258+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:01:33.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.260+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.260+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.260+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.260 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.261+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:01:33.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.262+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.263+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.263+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.264+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:01:33.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.265+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.266+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.266+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.267+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:01:33.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.269+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.269+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.269+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.271+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:01:33.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.272+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.273+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.273+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.274+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:01:33.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.275+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.276+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.276+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.277+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:01:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.278+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.279+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.279+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.280+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:01:33.280 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.281+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.282+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.282+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.283+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:01:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.284+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.284+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.285+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.286+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:01:33.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.287+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.288+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.288+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.289+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:01:33.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.291+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.291+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.291+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.292+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:01:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.294+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.294+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.295+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.296+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:01:33.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.297+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.298+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.298+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.299+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:01:33.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.300+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.301+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.301+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.302+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:01:33.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.303+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.304+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.304+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.305+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:01:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.306+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.307+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.307+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.308+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:01:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.309+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.309+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.310+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.310+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:01:33.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.312+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.312+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.313+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.313+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:01:33.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.315+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.315+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.315+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.316+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:01:33.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.318+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.318+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.318+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.319+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:01:33.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.321+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.321+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.322+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.323+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:01:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.324+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.324+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.325+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.325+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:01:33.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.327+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.327+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.327+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.328+0000 7f1335e20800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:01:33.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.330+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.330+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.330+0000 7f1335e20800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.332+0000 7f11e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:33.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.334+0000 7f1335e20800 20 remove_watcher() i=0 2024-09-12T01:01:33.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.334+0000 7f1335e20800 2 removed watcher, disabling cache 2024-09-12T01:01:33.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.335+0000 7f1335e20800 20 remove_watcher() i=1 2024-09-12T01:01:33.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.336+0000 7f1335e20800 20 remove_watcher() i=2 2024-09-12T01:01:33.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.337+0000 7f1335e20800 20 remove_watcher() i=3 2024-09-12T01:01:33.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.338+0000 7f1335e20800 20 remove_watcher() i=4 2024-09-12T01:01:33.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.339+0000 7f1335e20800 20 remove_watcher() i=5 2024-09-12T01:01:33.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.340+0000 7f1335e20800 20 remove_watcher() i=6 2024-09-12T01:01:33.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.341+0000 7f1335e20800 20 remove_watcher() i=7 2024-09-12T01:01:33.352 DEBUG:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2024-09-12T01:01:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:33.405 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.446+0000 7fbb43535800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.447+0000 7fbb43535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.447+0000 7fbb43535800 20 realm 2024-09-12T01:01:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.447+0000 7fbb43535800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.447+0000 7fbb43535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.447+0000 7fbb43535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.447+0000 7fbb43535800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.447+0000 7fbb43535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.447+0000 7fbb43535800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.448+0000 7fbb43535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.448+0000 7fbb43535800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.449+0000 7fbb43535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.449+0000 7fbb43535800 20 searching for the correct realm 2024-09-12T01:01:33.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.452+0000 7fbb3ea7c640 0 -- 172.21.15.62:0/1022858584 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fbb3808a1d0 msgr2=0x7fbb3807e0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:33.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.455+0000 7fbb3f27d640 0 -- 172.21.15.62:0/1022858584 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7fbb3808a5b0 msgr2=0x7fbb3807e0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:01:33.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:01:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:33.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:33.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 20 zone default found 2024-09-12T01:01:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 4 Realm: () 2024-09-12T01:01:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:01:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:01:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 20 zonegroup default 2024-09-12T01:01:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.460+0000 7fbb43535800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.461+0000 7fbb43535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.461+0000 7fbb43535800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.461+0000 7fbb43535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.461+0000 7fbb43535800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.461+0000 7fbb43535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.461+0000 7fbb43535800 20 started sync module instance, tier type = 2024-09-12T01:01:33.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.461+0000 7fbb43535800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:01:33.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.469+0000 7fbb43535800 20 add_watcher() i=0 2024-09-12T01:01:33.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.469+0000 7fbb43535800 20 add_watcher() i=1 2024-09-12T01:01:33.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.469+0000 7fbb43535800 20 add_watcher() i=2 2024-09-12T01:01:33.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.469+0000 7fbb43535800 20 add_watcher() i=3 2024-09-12T01:01:33.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.469+0000 7fbb43535800 20 add_watcher() i=4 2024-09-12T01:01:33.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.469+0000 7fbb43535800 20 add_watcher() i=5 2024-09-12T01:01:33.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.470+0000 7fbb43535800 20 add_watcher() i=6 2024-09-12T01:01:33.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.470+0000 7fbb43535800 20 add_watcher() i=7 2024-09-12T01:01:33.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.470+0000 7fbb43535800 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:33.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.472+0000 7fb9f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:33.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.472+0000 7fbb43535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:33.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.472+0000 7fbb43535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:33.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.505+0000 7fb9f4fe1640 20 reqs_thread_entry: start 2024-09-12T01:01:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.505+0000 7fbb43535800 20 init_complete bucket index max shards: 1 2024-09-12T01:01:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.505+0000 7fbb43535800 20 Filter name: none 2024-09-12T01:01:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.505+0000 7fb96e7fc640 20 reqs_thread_entry: start 2024-09-12T01:01:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.505+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:01:33.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.507+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.507+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.507+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.508+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:01:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.510+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.510+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.510+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.511+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:01:33.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.513+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.513+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.512 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.513+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.514+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:01:33.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.515+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.516+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.516+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.517+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:01:33.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.518+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.519+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.519+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.520+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:01:33.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.521+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.522+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.522+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.522 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.523+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:01:33.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.524+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.525+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.525+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.526+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:01:33.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.527+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.528+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.528+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.527 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.529+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:01:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.530+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.530+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.531+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.532+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:01:33.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.533+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.534+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.534+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.534 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.535+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:01:33.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.537+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.537+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.538+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.538+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:01:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.540+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.540+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.540+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.541+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:01:33.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.543+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.543+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.544+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.545+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:01:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.546+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.546+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.546+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.547+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:01:33.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.548+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.549+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.549+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.550+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:01:33.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.552+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.552+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.552+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.553+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:01:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.555+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.555+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.556+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.555 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.557+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:01:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.558+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.558+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.558+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.559+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:01:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.561+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.561+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.562+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.563+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:01:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.564+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.565+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.565+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.566+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:01:33.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.567+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.567+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.568+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.569+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:01:33.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.570+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.570+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.570+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.572+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:01:33.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.573+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.573+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.574+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.574+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:01:33.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.576+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.576+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.576+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.578+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:01:33.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.579+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.579+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.580+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.581+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:01:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.582+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.582+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.583+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.584+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:01:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.585+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.585+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.586+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.587+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:01:33.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.588+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.588+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.589+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.590+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:01:33.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.591+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.591+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.592+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.592+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:01:33.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.594+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.594+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.594+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.595+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:01:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.597+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.597+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.598+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.599+0000 7fbb43535800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:01:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.601+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.601+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.602+0000 7fbb43535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.603+0000 7fb9f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.605+0000 7fbb43535800 20 remove_watcher() i=0 2024-09-12T01:01:33.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.605+0000 7fbb43535800 2 removed watcher, disabling cache 2024-09-12T01:01:33.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.606+0000 7fbb43535800 20 remove_watcher() i=1 2024-09-12T01:01:33.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.607+0000 7fbb43535800 20 remove_watcher() i=2 2024-09-12T01:01:33.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.608+0000 7fbb43535800 20 remove_watcher() i=3 2024-09-12T01:01:33.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.609+0000 7fbb43535800 20 remove_watcher() i=4 2024-09-12T01:01:33.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.610+0000 7fbb43535800 20 remove_watcher() i=5 2024-09-12T01:01:33.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.611+0000 7fbb43535800 20 remove_watcher() i=6 2024-09-12T01:01:33.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.612+0000 7fbb43535800 20 remove_watcher() i=7 2024-09-12T01:01:33.623 DEBUG:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2024-09-12T01:01:33.676 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:33.677 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:33.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.717+0000 7f52dca0e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.718+0000 7f52dca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.718+0000 7f52dca0e800 20 realm 2024-09-12T01:01:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.718+0000 7f52dca0e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.718+0000 7f52dca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.718+0000 7f52dca0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.718+0000 7f52dca0e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.719+0000 7f52dca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.719+0000 7f52dca0e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.719+0000 7f52dca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.719+0000 7f52dca0e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.720+0000 7f52dca0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:33.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.720+0000 7f52dca0e800 20 searching for the correct realm 2024-09-12T01:01:33.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.723+0000 7f52d78ca640 0 -- 172.21.15.62:0/429704785 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f52d0061040 msgr2=0x7f52d00e1040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:33.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.928+0000 7f52d78ca640 0 -- 172.21.15.62:0/429704785 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55c3952404d0 msgr2=0x55c395242940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.933+0000 7f52dca0e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:01:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.933+0000 7f52dca0e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:01:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.933+0000 7f52dca0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.933+0000 7f52dca0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.933+0000 7f52dca0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:33.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.933+0000 7f52dca0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.933+0000 7f52dca0e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.933+0000 7f52dca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.933+0000 7f52dca0e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.933+0000 7f52dca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.933+0000 7f52dca0e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.934+0000 7f52dca0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.934+0000 7f52dca0e800 20 zone default found 2024-09-12T01:01:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.934+0000 7f52dca0e800 4 Realm: () 2024-09-12T01:01:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.934+0000 7f52dca0e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:01:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.934+0000 7f52dca0e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:01:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.934+0000 7f52dca0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:33.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.934+0000 7f52dca0e800 20 zonegroup default 2024-09-12T01:01:33.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.934+0000 7f52dca0e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.934+0000 7f52dca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.934+0000 7f52dca0e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.934+0000 7f52dca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.934+0000 7f52dca0e800 20 rados->read ofs=0 len=0 2024-09-12T01:01:33.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.935+0000 7f52dca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.935+0000 7f52dca0e800 20 started sync module instance, tier type = 2024-09-12T01:01:33.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.935+0000 7f52dca0e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:01:33.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.943+0000 7f52dca0e800 20 add_watcher() i=0 2024-09-12T01:01:33.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.943+0000 7f52dca0e800 20 add_watcher() i=1 2024-09-12T01:01:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.943+0000 7f52dca0e800 20 add_watcher() i=2 2024-09-12T01:01:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.943+0000 7f52dca0e800 20 add_watcher() i=3 2024-09-12T01:01:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.943+0000 7f52dca0e800 20 add_watcher() i=4 2024-09-12T01:01:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.943+0000 7f52dca0e800 20 add_watcher() i=5 2024-09-12T01:01:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.943+0000 7f52dca0e800 20 add_watcher() i=6 2024-09-12T01:01:33.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.945+0000 7f52dca0e800 20 add_watcher() i=7 2024-09-12T01:01:33.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.945+0000 7f52dca0e800 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:33.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.947+0000 7f518efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.947+0000 7f52dca0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:33.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.947+0000 7f52dca0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:33.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.981+0000 7f518dfdb640 20 reqs_thread_entry: start 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.981+0000 7f52dca0e800 20 init_complete bucket index max shards: 1 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.981+0000 7f52dca0e800 20 Filter name: none 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.981+0000 7f50ff7fe640 20 reqs_thread_entry: start 2024-09-12T01:01:33.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.981+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:01:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.983+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.984+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.984+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.985+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.986+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.987+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.986 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.987+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.988+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:01:33.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.989+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.990+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.990+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.991+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:01:33.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.992+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.993+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.993+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.994+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:01:33.994 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.996+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.996+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.996+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.997+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:01:33.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.998+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.999+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:33.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:33.999+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:33.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.000+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:01:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.001+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.002+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.002+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.003+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:01:34.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.004+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.004+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.005+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.006+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:01:34.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.007+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.007+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.008+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.008+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:01:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.010+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.010+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.010+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.011+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:01:34.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.013+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.013+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.012 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.013+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.014+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:01:34.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.015+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.016+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.016+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.017+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:01:34.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.018+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.019+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.019+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.020+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:01:34.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.021+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.021+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.022+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.023+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:01:34.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.024+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.025+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.025+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.026+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:01:34.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.027+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.028+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.028+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.029+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:01:34.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.031+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.031+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.032+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.032+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:01:34.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.034+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.034+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.034+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.035+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:01:34.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.037+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.037+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.037+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.038+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:01:34.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.039+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.040+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.040+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.041+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:01:34.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.042+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.043+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.043+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.044+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:01:34.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.045+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.046+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.046+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.047+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:01:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.048+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.048+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.049+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.050+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:01:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.051+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.051+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.052+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.053+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:01:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.054+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.054+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.055+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.056+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:01:34.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.057+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.058+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.058+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.059+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:01:34.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.060+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.061+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.061+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.062+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:01:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.063+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.064+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.064+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.066+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:01:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.067+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.068+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.068+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.069+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:01:34.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.070+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.071+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.071+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.072+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:01:34.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.073+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.073+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.074+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.075+0000 7f52dca0e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:01:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.076+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.077+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:34.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.077+0000 7f52dca0e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:34.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.079+0000 7f518efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.081+0000 7f52dca0e800 20 remove_watcher() i=0 2024-09-12T01:01:34.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.081+0000 7f52dca0e800 2 removed watcher, disabling cache 2024-09-12T01:01:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.082+0000 7f52dca0e800 20 remove_watcher() i=1 2024-09-12T01:01:34.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.083+0000 7f52dca0e800 20 remove_watcher() i=2 2024-09-12T01:01:34.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.084+0000 7f52dca0e800 20 remove_watcher() i=3 2024-09-12T01:01:34.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.085+0000 7f52dca0e800 20 remove_watcher() i=4 2024-09-12T01:01:34.085 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.086+0000 7f52dca0e800 20 remove_watcher() i=5 2024-09-12T01:01:34.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.087+0000 7f52dca0e800 20 remove_watcher() i=6 2024-09-12T01:01:34.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:01:34.088+0000 7f52dca0e800 20 remove_watcher() i=7 2024-09-12T01:01:34.100 DEBUG:teuthology.orchestra.run.smithi062:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T01:01:34.599 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :clean 2024-09-12T01:01:35.295 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :compileJava 2024-09-12T01:01:35.295 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :processResources 2024-09-12T01:01:35.295 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :classes 2024-09-12T01:01:35.895 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:35.895 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :compileTestJava 2024-09-12T01:01:35.895 INFO:teuthology.orchestra.run.smithi062.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T01:01:35.895 INFO:teuthology.orchestra.run.smithi062.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T01:01:35.896 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:35.896 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T01:01:35.896 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :testClasses 2024-09-12T01:01:37.896 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:37.896 INFO:teuthology.orchestra.run.smithi062.stdout:> Task :test 2024-09-12T01:01:37.896 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:37.896 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests STANDARD_OUT 2024-09-12T01:01:37.897 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12 01:01:37,154 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T01:01:37.897 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:37.897 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T01:01:37.897 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:37.897 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T01:01:37.897 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:37.897 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T01:01:37.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:37.994 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T01:01:38.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:38.294 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T01:01:38.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:38.394 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T01:01:38.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:38.695 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T01:01:41.295 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:41.295 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T01:01:41.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:41.495 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T01:01:41.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:41.595 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T01:01:41.894 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:41.894 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T01:01:42.094 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:42.095 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T01:01:42.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:42.395 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T01:01:42.395 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:42.395 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T01:01:42.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:42.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T01:01:42.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:42.594 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T01:01:42.894 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:42.894 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T01:01:44.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:44.495 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T01:01:44.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:44.794 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T01:01:44.894 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:44.894 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T01:01:45.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:45.194 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T01:01:45.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:45.294 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T01:01:45.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:45.594 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T01:01:45.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:45.694 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T01:01:45.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:45.995 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T01:01:45.995 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:45.995 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T01:01:46.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:46.294 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T01:01:46.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:46.394 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T01:01:46.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:46.694 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T01:01:46.795 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:46.795 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T01:01:47.094 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:47.094 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T01:01:47.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:47.194 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T01:01:47.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:47.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T01:01:49.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:49.694 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T01:01:50.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:01:50.194 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T01:02:40.095 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:02:40.095 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T01:02:40.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:02:40.594 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T01:02:40.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:02:40.694 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T01:02:40.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:02:40.994 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T01:02:40.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:02:40.995 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T01:02:41.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:02:41.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T01:02:52.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:02:52.695 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T01:02:52.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:02:52.994 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T01:02:53.094 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:02:53.095 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T01:02:53.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:02:53.194 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T01:02:56.395 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:02:56.395 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T01:02:56.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:02:56.695 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T01:03:01.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:01.495 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T01:03:01.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:01.995 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T01:03:04.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:04.195 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T01:03:04.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:04.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T01:03:25.995 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:25.995 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T01:03:26.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:26.294 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T01:03:29.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:29.194 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T01:03:29.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:29.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T01:03:40.595 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:40.595 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T01:03:40.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:40.995 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T01:03:41.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:41.994 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T01:03:44.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:44.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T01:03:44.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:44.794 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T01:03:45.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:45.394 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T01:03:45.395 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:45.395 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T01:03:45.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:45.694 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T01:03:45.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:45.794 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T01:03:46.094 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:46.094 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T01:03:46.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:46.194 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T01:03:46.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:46.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T01:03:46.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:46.594 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T01:03:46.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:46.794 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:46.894 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T01:03:47.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:47.194 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T01:03:47.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:47.295 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T01:03:47.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:47.594 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T01:03:47.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:47.795 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T01:03:48.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:48.194 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T01:03:48.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:48.394 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T01:03:48.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:48.794 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T01:03:48.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:48.994 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T01:03:49.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:49.394 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T01:03:49.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:49.594 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T01:03:49.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:49.995 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T01:03:50.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:50.194 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T01:03:50.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:50.594 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T01:03:50.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:50.795 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T01:03:51.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:51.195 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T01:03:51.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:51.395 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T01:03:51.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:51.794 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T01:03:51.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:51.994 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T01:03:52.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:52.394 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T01:03:52.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:52.594 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T01:03:52.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:52.994 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T01:03:53.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:53.194 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T01:03:53.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:53.594 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T01:03:53.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:53.794 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T01:03:54.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:54.194 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T01:03:54.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:54.394 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T01:03:54.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:54.695 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T01:03:54.894 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:54.894 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T01:03:55.296 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:55.296 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T01:03:55.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:55.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T01:03:55.894 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:55.894 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T01:03:56.094 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:56.095 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T01:03:56.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:56.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T01:03:56.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:56.694 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T01:03:57.094 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:57.094 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T01:03:57.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:57.294 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T01:03:57.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:57.694 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T01:03:57.894 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:57.894 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T01:03:58.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:58.294 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T01:03:58.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:58.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T01:03:58.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:58.794 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T01:03:58.996 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:58.996 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T01:03:59.394 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:59.394 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T01:03:59.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:59.594 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T01:03:59.894 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:03:59.894 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T01:04:00.094 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:00.095 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T01:04:00.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:00.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T01:04:00.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:00.595 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T01:04:00.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:00.794 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T01:04:00.894 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:00.894 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T01:04:01.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:01.194 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T01:04:01.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:01.294 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T01:04:01.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:01.594 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T01:04:01.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:01.695 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T01:04:01.894 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:01.894 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T01:04:02.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:02.194 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T01:04:02.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:02.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T01:04:02.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:02.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T01:04:02.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:02.594 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T01:04:02.794 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:02.794 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T01:04:03.094 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:03.094 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T01:04:03.194 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:03.194 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T01:04:03.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:03.494 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T01:04:03.694 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:03.694 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T01:04:03.894 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:03.894 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T01:04:03.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:03.994 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T01:04:04.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:04.294 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T01:04:06.294 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:06.295 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T01:04:06.594 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:06.595 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T01:04:08.994 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:08.994 INFO:teuthology.orchestra.run.smithi062.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T01:04:09.330 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:---------------------------------------------------------------------- 2024-09-12T01:04:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T01:04:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:---------------------------------------------------------------------- 2024-09-12T01:04:09.330 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T01:04:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T01:04:09.330 INFO:teuthology.orchestra.run.smithi062.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T01:04:09.331 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:09.331 INFO:teuthology.orchestra.run.smithi062.stdout:BUILD SUCCESSFUL in 2m 35s 2024-09-12T01:04:09.331 INFO:teuthology.orchestra.run.smithi062.stdout:5 actionable tasks: 5 executed 2024-09-12T01:04:09.347 DEBUG:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2024-09-12T01:04:09.401 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:09.401 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:09.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.440+0000 7f4109a98800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.442+0000 7f4109a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:09.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.442+0000 7f4109a98800 20 realm 2024-09-12T01:04:09.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.442+0000 7f4109a98800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.442+0000 7f4109a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:09.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.442+0000 7f4109a98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:09.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.442+0000 7f4109a98800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.442+0000 7f4109a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:09.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.442+0000 7f4109a98800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.443+0000 7f4109a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:09.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.443+0000 7f4109a98800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.444+0000 7f4109a98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:09.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.444+0000 7f4109a98800 20 searching for the correct realm 2024-09-12T01:04:09.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.449+0000 7f4107d83640 0 -- 172.21.15.62:0/571070116 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x555f5ab77940 msgr2=0x555f5ab79de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:09.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.453+0000 7f4107d83640 0 -- 172.21.15.62:0/571070116 >> [v2:172.21.15.77:6816/3177889521,v1:172.21.15.77:6817/3177889521] conn(0x555f5ab84250 msgr2=0x555f5ab86710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:09.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.456+0000 7f4109a98800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:09.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.456+0000 7f4109a98800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:09.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.456+0000 7f4109a98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:09.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.456+0000 7f4109a98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:09.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.456+0000 7f4109a98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:09.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.456+0000 7f4109a98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:09.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.456+0000 7f4109a98800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.456+0000 7f4109a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:09.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.456+0000 7f4109a98800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.457+0000 7f4109a98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:09.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.457+0000 7f4109a98800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.457+0000 7f4109a98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.457+0000 7f4109a98800 20 zone default found 2024-09-12T01:04:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.457+0000 7f4109a98800 4 Realm: () 2024-09-12T01:04:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.457+0000 7f4109a98800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.457+0000 7f4109a98800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.457+0000 7f4109a98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.457+0000 7f4109a98800 20 zonegroup default 2024-09-12T01:04:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.457+0000 7f4109a98800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.457+0000 7f4109a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.457+0000 7f4109a98800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.458+0000 7f4109a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.458+0000 7f4109a98800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.458+0000 7f4109a98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.458+0000 7f4109a98800 20 started sync module instance, tier type = 2024-09-12T01:04:09.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.458+0000 7f4109a98800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:09.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.467+0000 7f4109a98800 20 add_watcher() i=0 2024-09-12T01:04:09.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.467+0000 7f4109a98800 20 add_watcher() i=1 2024-09-12T01:04:09.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.467+0000 7f4109a98800 20 add_watcher() i=2 2024-09-12T01:04:09.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.467+0000 7f4109a98800 20 add_watcher() i=3 2024-09-12T01:04:09.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.467+0000 7f4109a98800 20 add_watcher() i=4 2024-09-12T01:04:09.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.467+0000 7f4109a98800 20 add_watcher() i=5 2024-09-12T01:04:09.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.467+0000 7f4109a98800 20 add_watcher() i=6 2024-09-12T01:04:09.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.468+0000 7f4109a98800 20 add_watcher() i=7 2024-09-12T01:04:09.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.468+0000 7f4109a98800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:09.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.470+0000 7f3fbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:09.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.470+0000 7f4109a98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:09.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.470+0000 7f4109a98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:09.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.508+0000 7f3fbcfe1640 20 reqs_thread_entry: start 2024-09-12T01:04:09.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.508+0000 7f4109a98800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:09.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.508+0000 7f4109a98800 20 Filter name: none 2024-09-12T01:04:09.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.508+0000 7f3f367fc640 20 reqs_thread_entry: start 2024-09-12T01:04:09.508 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.508+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:04:09.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.510+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.510+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.510+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:09.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.510+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8427376643394069482', time=2024-09-12T03:03:50.912638+0000, chain.objs.size()=1 2024-09-12T01:04:09.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.510+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.117__shadow_.yvDo6GPPWCjDyiy6hY5dJ1941H9J7xT_0 2024-09-12T01:04:09.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.511+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16008503131408320046', time=2024-09-12T03:03:56.217431+0000, chain.objs.size()=1 2024-09-12T01:04:09.510 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.511+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.126__shadow_.jO4Dosrs3v1yixlF0U69-dt168yL2bG_0 2024-09-12T01:04:09.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.511+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.211273070279497380', time=2024-09-12T03:04:03.282500+0000, chain.objs.size()=1 2024-09-12T01:04:09.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.511+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.140__shadow_.CnZ0xlpLfRwL3RuM0qfnhOtnACs7Crw_0 2024-09-12T01:04:09.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.511+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18007889310047128936', time=2024-09-12T03:04:09.087302+0000, chain.objs.size()=5 2024-09-12T01:04:09.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.511+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.144__multipart_key1/data/file.mpg.2~lgtcdMUOgmXnc3GqqmRVAjaYj8KycZl.1 2024-09-12T01:04:09.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.511+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.144__multipart_key1/data/file.mpg.2~lgtcdMUOgmXnc3GqqmRVAjaYj8KycZl.2 2024-09-12T01:04:09.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.511+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.144__multipart_key1/data/file.mpg.2~lgtcdMUOgmXnc3GqqmRVAjaYj8KycZl.3 2024-09-12T01:04:09.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.511+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.144__multipart_key1/data/file.mpg.2~lgtcdMUOgmXnc3GqqmRVAjaYj8KycZl.4 2024-09-12T01:04:09.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.511+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.144__multipart_key1/data/file.mpg.2~lgtcdMUOgmXnc3GqqmRVAjaYj8KycZl.5 2024-09-12T01:04:09.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.514+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.517+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:04:09.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.518+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.518+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.519+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:04:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.519+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11692893004755563', time=2024-09-12T03:03:55.617586+0000, chain.objs.size()=1 2024-09-12T01:04:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.519+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.125__shadow_.ccMLI1rS8mC-Baj5Sb0dP3QQ67IRrrc_0 2024-09-12T01:04:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.519+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12035040580958672782', time=2024-09-12T03:03:56.271725+0000, chain.objs.size()=1 2024-09-12T01:04:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.519+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.126__shadow_.86uKGJit7fVaahnFLjWxAJOgVlfquCt_0 2024-09-12T01:04:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.519+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10220762279833402736', time=2024-09-12T03:03:56.847056+0000, chain.objs.size()=1 2024-09-12T01:04:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.519+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.127__shadow_.Tuc0wNRVw_MljE5Tu6C_f9BHgF-IlAf_0 2024-09-12T01:04:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.519+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5508047330223426018', time=2024-09-12T03:03:57.424030+0000, chain.objs.size()=1 2024-09-12T01:04:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.519+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.128__shadow_.lUHUvdGA_RC8oqQ0C2P_TlKESi1eNQi_0 2024-09-12T01:04:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.519+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9646140699263361229', time=2024-09-12T03:03:57.452335+0000, chain.objs.size()=1 2024-09-12T01:04:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.519+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.128__shadow_.q3Zt6mdQkOvX7JYTz5FvZyZ7zl2dY7V_0 2024-09-12T01:04:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.519+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16860142172885205607', time=2024-09-12T03:03:59.111028+0000, chain.objs.size()=1 2024-09-12T01:04:09.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.519+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.131__shadow_.Xn9HhUnjy_oVUYfaILoJr3hrL0HU5Ej_0 2024-09-12T01:04:09.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.522+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.523 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.524+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:04:09.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.525+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.526+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.526+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.526+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16044359010164065124', time=2024-09-12T03:03:23.990226+0000, chain.objs.size()=5 2024-09-12T01:04:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.526+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~3RPPL23igP8UzBVpWYPNnIBGl2-2qss.1 2024-09-12T01:04:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.526+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__shadow_key1.2~3RPPL23igP8UzBVpWYPNnIBGl2-2qss.1_1 2024-09-12T01:04:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.526+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~3RPPL23igP8UzBVpWYPNnIBGl2-2qss.2 2024-09-12T01:04:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.526+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__shadow_key1.2~3RPPL23igP8UzBVpWYPNnIBGl2-2qss.2_1 2024-09-12T01:04:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.526+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~3RPPL23igP8UzBVpWYPNnIBGl2-2qss.3 2024-09-12T01:04:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.526+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2950890328460148638', time=2024-09-12T03:03:50.338985+0000, chain.objs.size()=1 2024-09-12T01:04:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.526+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.116__shadow_.oQim2FOVIIOa-uO000FAZGcWvdTAo2Q_0 2024-09-12T01:04:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.526+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5895005477675701085', time=2024-09-12T03:03:52.152967+0000, chain.objs.size()=1 2024-09-12T01:04:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.526+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.119__shadow_.DN5O71Sertp5ZAbl052c7CpkJp-apbb_0 2024-09-12T01:04:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.526+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12818990116092802459', time=2024-09-12T03:03:58.623867+0000, chain.objs.size()=1 2024-09-12T01:04:09.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.526+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.130__shadow_.QRUqh622kFL_MHi1fzWRYTld_KOPV1V_0 2024-09-12T01:04:09.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.530+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.533+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:04:09.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.534+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.534+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:09.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='2~VIgbtO-4jBkghoxDkJVJF_htcbgHnZZ', time=2024-09-12T03:01:41.197650+0000, chain.objs.size()=5 2024-09-12T01:04:09.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.79__multipart_key1.2~VIgbtO-4jBkghoxDkJVJF_htcbgHnZZ.1 2024-09-12T01:04:09.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.79__multipart_key1.2~VIgbtO-4jBkghoxDkJVJF_htcbgHnZZ.2 2024-09-12T01:04:09.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.79__multipart_key1.2~VIgbtO-4jBkghoxDkJVJF_htcbgHnZZ.3 2024-09-12T01:04:09.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.79__multipart_key1.2~VIgbtO-4jBkghoxDkJVJF_htcbgHnZZ.4 2024-09-12T01:04:09.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.79__multipart_key1.2~VIgbtO-4jBkghoxDkJVJF_htcbgHnZZ.5 2024-09-12T01:04:09.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10614795953796146928', time=2024-09-12T03:03:01.628508+0000, chain.objs.size()=5 2024-09-12T01:04:09.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.100__multipart_file.mpg.2~RhWBvx3kk_7e1Qe7IFQ5mcJpaVHw5NF.1 2024-09-12T01:04:09.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.100__multipart_file.mpg.2~RhWBvx3kk_7e1Qe7IFQ5mcJpaVHw5NF.2 2024-09-12T01:04:09.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.100__multipart_file.mpg.2~RhWBvx3kk_7e1Qe7IFQ5mcJpaVHw5NF.3 2024-09-12T01:04:09.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.100__multipart_file.mpg.2~RhWBvx3kk_7e1Qe7IFQ5mcJpaVHw5NF.4 2024-09-12T01:04:09.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.100__multipart_file.mpg.2~RhWBvx3kk_7e1Qe7IFQ5mcJpaVHw5NF.5 2024-09-12T01:04:09.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11495715577683862062', time=2024-09-12T03:03:49.711084+0000, chain.objs.size()=1 2024-09-12T01:04:09.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.115__shadow_.KpETsjgj6O_fPTv6eYb-MKCwgLYOIEY_0 2024-09-12T01:04:09.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1022390174081096909', time=2024-09-12T03:03:52.729859+0000, chain.objs.size()=1 2024-09-12T01:04:09.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.535+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.120__shadow_._JeoDUhOFFNLj4hhbuq1LCRrOmbgaw-_0 2024-09-12T01:04:09.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.542+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.544+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:04:09.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.545+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:09.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6420809712870094920', time=2024-09-12T03:01:49.761595+0000, chain.objs.size()=5 2024-09-12T01:04:09.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.91__multipart_key1.2~VR9me_O1NseYlKTF_gU3285ODmA-2Tf.1 2024-09-12T01:04:09.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.91__multipart_key1.2~VR9me_O1NseYlKTF_gU3285ODmA-2Tf.2 2024-09-12T01:04:09.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.91__multipart_key1.2~VR9me_O1NseYlKTF_gU3285ODmA-2Tf.3 2024-09-12T01:04:09.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.91__multipart_key1.2~VR9me_O1NseYlKTF_gU3285ODmA-2Tf.4 2024-09-12T01:04:09.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.91__multipart_key1.2~VR9me_O1NseYlKTF_gU3285ODmA-2Tf.5 2024-09-12T01:04:09.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7907890131192741073', time=2024-09-12T03:02:40.398769+0000, chain.objs.size()=4 2024-09-12T01:04:09.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.93__shadow_.z1OyC5F9JR2ihOpjQgUeMnaOq-bJfiu_0 2024-09-12T01:04:09.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.93__shadow_.z1OyC5F9JR2ihOpjQgUeMnaOq-bJfiu_1 2024-09-12T01:04:09.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.93__shadow_.z1OyC5F9JR2ihOpjQgUeMnaOq-bJfiu_2 2024-09-12T01:04:09.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.93__shadow_.z1OyC5F9JR2ihOpjQgUeMnaOq-bJfiu_3 2024-09-12T01:04:09.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14305482168683820226', time=2024-09-12T03:03:59.165929+0000, chain.objs.size()=1 2024-09-12T01:04:09.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.131__shadow_.Ru5L1EVfIkKPz1h7LDsnce5CckX65RE_0 2024-09-12T01:04:09.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7278854522711118454', time=2024-09-12T03:04:06.425044+0000, chain.objs.size()=5 2024-09-12T01:04:09.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.143__multipart_key1.2~NHryoouqSJeA3_fhDI4FIJx0tGn6IHl.1 2024-09-12T01:04:09.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.546+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.143__multipart_key1.2~NHryoouqSJeA3_fhDI4FIJx0tGn6IHl.2 2024-09-12T01:04:09.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.550+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.143__multipart_key1.2~NHryoouqSJeA3_fhDI4FIJx0tGn6IHl.3 2024-09-12T01:04:09.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.553+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.143__multipart_key1.2~NHryoouqSJeA3_fhDI4FIJx0tGn6IHl.4 2024-09-12T01:04:09.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.553+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.143__multipart_key1.2~NHryoouqSJeA3_fhDI4FIJx0tGn6IHl.5 2024-09-12T01:04:09.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.555+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.558+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:04:09.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.559+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.559+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.560+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:04:09.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.560+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15697344899425138365', time=2024-09-12T03:03:50.883768+0000, chain.objs.size()=1 2024-09-12T01:04:09.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.560+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.117__shadow_.Ad9Qt8LNscYUKBn4dHFOFNZ8BQtnEuB_0 2024-09-12T01:04:09.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.561+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.563+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:04:09.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.565+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.566+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.566+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:04:09.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.566+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='2~O0n8gy5jXF3JumCXVHFmjChNZeCqZzj', time=2024-09-12T03:03:04.301801+0000, chain.objs.size()=5 2024-09-12T01:04:09.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.566+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.101__multipart_key1.2~O0n8gy5jXF3JumCXVHFmjChNZeCqZzj.7 2024-09-12T01:04:09.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.566+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.101__multipart_key1.2~O0n8gy5jXF3JumCXVHFmjChNZeCqZzj.8 2024-09-12T01:04:09.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.566+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.101__multipart_key1.2~O0n8gy5jXF3JumCXVHFmjChNZeCqZzj.9 2024-09-12T01:04:09.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.566+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.101__multipart_key1.2~O0n8gy5jXF3JumCXVHFmjChNZeCqZzj.10 2024-09-12T01:04:09.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.566+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.101__multipart_key1.2~O0n8gy5jXF3JumCXVHFmjChNZeCqZzj.11 2024-09-12T01:04:09.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.566+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14819481319007275613', time=2024-09-12T03:03:10.907279+0000, chain.objs.size()=5 2024-09-12T01:04:09.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.567+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~j-RkY76KBG6z-lgsEPtX751qdtg8K5o.1 2024-09-12T01:04:09.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.567+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~j-RkY76KBG6z-lgsEPtX751qdtg8K5o.2 2024-09-12T01:04:09.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.567+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~j-RkY76KBG6z-lgsEPtX751qdtg8K5o.3 2024-09-12T01:04:09.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.567+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~j-RkY76KBG6z-lgsEPtX751qdtg8K5o.4 2024-09-12T01:04:09.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.567+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~j-RkY76KBG6z-lgsEPtX751qdtg8K5o.5 2024-09-12T01:04:09.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.567+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14886300881506489397', time=2024-09-12T03:03:50.284424+0000, chain.objs.size()=1 2024-09-12T01:04:09.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.567+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.116__shadow_.ejw6arRWIQyn4IySu4SqeWZFPHdAdh-_0 2024-09-12T01:04:09.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.567+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94852470769271310', time=2024-09-12T03:03:58.021413+0000, chain.objs.size()=1 2024-09-12T01:04:09.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.567+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.129__shadow_.5flg73I_3k4sbFQ-qrjwttdbbbPDuKv_0 2024-09-12T01:04:09.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.569+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9294287471133371252', time=2024-09-12T03:03:58.075236+0000, chain.objs.size()=1 2024-09-12T01:04:09.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.569+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.129__shadow_.xn-HjsPRkNEuWeHmgsksgDL6l9rxrQJ_0 2024-09-12T01:04:09.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.572+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.575+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:04:09.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.576+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.577+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.577+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:04:09.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.577+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8358677577760770191', time=2024-09-12T03:01:44.586181+0000, chain.objs.size()=2 2024-09-12T01:04:09.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.577+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.83__shadow_.2JFuUPxgBW2pdWDRd6hINOXzjjlBiKf_0 2024-09-12T01:04:09.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.577+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.83__shadow_.2JFuUPxgBW2pdWDRd6hINOXzjjlBiKf_1 2024-09-12T01:04:09.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.579+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.581+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:04:09.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.583+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.583+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.584+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:04:09.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.584+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3659148959543163309', time=2024-09-12T03:03:48.510781+0000, chain.objs.size()=1 2024-09-12T01:04:09.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.584+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.113__shadow_.LD50-Ia9AGY6lQHmbRBaHbhhgu9s6dk_0 2024-09-12T01:04:09.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.584+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10985924413695803658', time=2024-09-12T03:03:49.143554+0000, chain.objs.size()=1 2024-09-12T01:04:09.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.584+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.114__shadow_.b0BQY6-uCplhsICeKk44TNG3HGnnWt__0 2024-09-12T01:04:09.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.584+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2629625738151980476', time=2024-09-12T03:03:50.968285+0000, chain.objs.size()=1 2024-09-12T01:04:09.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.584+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.117__shadow_.rm6lLBbimQVtY7er1qALcDiT9uPrvHQ_0 2024-09-12T01:04:09.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.584+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15968839171704068804', time=2024-09-12T03:03:53.324239+0000, chain.objs.size()=1 2024-09-12T01:04:09.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.584+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.121__shadow_.mBaTm-1bfcGRv1fGBqr32hn_yeUCwd0_0 2024-09-12T01:04:09.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.584+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.959937815748382787', time=2024-09-12T03:03:54.521561+0000, chain.objs.size()=1 2024-09-12T01:04:09.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.584+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.123__shadow_.qoXe89Q9YfXSepw72yaJANbY-jt18wQ_0 2024-09-12T01:04:09.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.584+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16287662238682063670', time=2024-09-12T03:03:55.646220+0000, chain.objs.size()=1 2024-09-12T01:04:09.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.584+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.125__shadow_.jz-wCgUYYkNF_5lft38ms1xnzQQKsgV_0 2024-09-12T01:04:09.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.586+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.588+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:04:09.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.589+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.590+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.590+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:04:09.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.590+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3050424597179797745', time=2024-09-12T03:03:08.729239+0000, chain.objs.size()=5 2024-09-12T01:04:09.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.590+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~oBHTaiyRd1e8_lBnovqIOH_way645yq.1 2024-09-12T01:04:09.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.590+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~oBHTaiyRd1e8_lBnovqIOH_way645yq.2 2024-09-12T01:04:09.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.590+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~oBHTaiyRd1e8_lBnovqIOH_way645yq.3 2024-09-12T01:04:09.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.590+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~oBHTaiyRd1e8_lBnovqIOH_way645yq.4 2024-09-12T01:04:09.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.590+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~oBHTaiyRd1e8_lBnovqIOH_way645yq.5 2024-09-12T01:04:09.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.590+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17356093458815499526', time=2024-09-12T03:03:48.483550+0000, chain.objs.size()=1 2024-09-12T01:04:09.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.590+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.113__shadow_.wvKOql8_3LSf0udEGCv4H_iW70ODd_g_0 2024-09-12T01:04:09.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.590+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14864750177584193473', time=2024-09-12T03:03:50.367239+0000, chain.objs.size()=1 2024-09-12T01:04:09.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.590+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.116__shadow_.QtybyiCYgM0kizZrbXPbozS3KVT33px_0 2024-09-12T01:04:09.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.591+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.971641368945387042', time=2024-09-12T03:03:53.926958+0000, chain.objs.size()=1 2024-09-12T01:04:09.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.591+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.122__shadow_.x0O7aO3ck4RNwprClyZRKS9-H7EgxNC_0 2024-09-12T01:04:09.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.591+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17577111207541155968', time=2024-09-12T03:03:56.245112+0000, chain.objs.size()=1 2024-09-12T01:04:09.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.591+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.126__shadow_.OAXideD5gTEaGErD_JEoLQfPzYjzJBE_0 2024-09-12T01:04:09.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.595+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.597+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:04:09.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.598+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:04:09.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.622572104567805741', time=2024-09-12T03:01:38.076213+0000, chain.objs.size()=1 2024-09-12T01:04:09.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.77__shadow_.bI3suGiM_WO_JXNhktd74v9iYz8gPJ2_0 2024-09-12T01:04:09.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14746938721487992034', time=2024-09-12T03:02:40.011895+0000, chain.objs.size()=5 2024-09-12T01:04:09.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~FvpJTDNMCzSNyDhSKOP-7-XPw5swovf.1 2024-09-12T01:04:09.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__shadow_key1.2~FvpJTDNMCzSNyDhSKOP-7-XPw5swovf.1_1 2024-09-12T01:04:09.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~FvpJTDNMCzSNyDhSKOP-7-XPw5swovf.2 2024-09-12T01:04:09.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__shadow_key1.2~FvpJTDNMCzSNyDhSKOP-7-XPw5swovf.2_1 2024-09-12T01:04:09.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~FvpJTDNMCzSNyDhSKOP-7-XPw5swovf.3 2024-09-12T01:04:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1554928423083869767', time=2024-09-12T03:03:52.181699+0000, chain.objs.size()=1 2024-09-12T01:04:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.119__shadow_.dlD0Y1PqM95rHcnh0ByiWgNBGUm3BFT_0 2024-09-12T01:04:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3827399488932222072', time=2024-09-12T03:03:55.037719+0000, chain.objs.size()=1 2024-09-12T01:04:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.124__shadow_.XmXE3CxcKYn_JKVkoEOUK4a8feD-Ouk_0 2024-09-12T01:04:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12528111022948588224', time=2024-09-12T03:03:56.792891+0000, chain.objs.size()=1 2024-09-12T01:04:09.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.599+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.127__shadow_.F-ZDaabkZS4LZ4QbeR6zNZBSne6sGh1_0 2024-09-12T01:04:09.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.603+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.606+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:04:09.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.607+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.608+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.608+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:04:09.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.608+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13619833728051626264', time=2024-09-12T03:03:53.983005+0000, chain.objs.size()=1 2024-09-12T01:04:09.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.608+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.122__shadow_.gti3zxI0fo2hzOHOGsCVyB9v2RtmsC0_0 2024-09-12T01:04:09.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.609+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.612+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:04:09.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.613+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.614+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.614+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:04:09.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.614+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2600880650011643236', time=2024-09-12T03:01:42.181519+0000, chain.objs.size()=1 2024-09-12T01:04:09.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.614+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.81__shadow_.cXz2kbsmdcnagulNIGkM4hcqKEkxOBh_0 2024-09-12T01:04:09.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.615+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.616 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.617+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:04:09.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.618+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.619+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.619+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:09.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.619+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7590885949853544883', time=2024-09-12T03:03:49.088310+0000, chain.objs.size()=1 2024-09-12T01:04:09.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.619+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.114__shadow_.H3JxVJzQOfMkxqTnaOJ6wDxSAwh0Nrl_0 2024-09-12T01:04:09.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.619+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5303693117706332795', time=2024-09-12T03:03:52.097681+0000, chain.objs.size()=1 2024-09-12T01:04:09.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.619+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.119__shadow_.yAJSq3-R1u-SFjSGlDTFyIwvOxF9n9o_0 2024-09-12T01:04:09.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.619+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15293205051822463456', time=2024-09-12T03:03:54.493836+0000, chain.objs.size()=1 2024-09-12T01:04:09.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.619+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.123__shadow_.qwzCuufSYPLiWun1AkCnUmSKkIJqDmi_0 2024-09-12T01:04:09.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.619+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3939676235060579551', time=2024-09-12T03:03:56.873969+0000, chain.objs.size()=1 2024-09-12T01:04:09.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.619+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.127__shadow_.NBLElcjmAAXrauuXYAgL4v0sbqtQby0_0 2024-09-12T01:04:09.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.621+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.624+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:04:09.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.625+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.625+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.626+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:04:09.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.626+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9604629208411768744', time=2024-09-12T03:03:51.492617+0000, chain.objs.size()=1 2024-09-12T01:04:09.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.626+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.118__shadow_.eC5eMIpO569ViFsEfrCke3JFSdBOAYI_0 2024-09-12T01:04:09.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.626+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8662932903614912599', time=2024-09-12T03:03:53.297213+0000, chain.objs.size()=1 2024-09-12T01:04:09.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.626+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.121__shadow_.936Zt-XF_QLSe2Vz8oXfKxpoQ_1ZH6k_0 2024-09-12T01:04:09.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.626+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1645916544097748601', time=2024-09-12T03:03:53.898163+0000, chain.objs.size()=1 2024-09-12T01:04:09.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.626+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.122__shadow_.EgZoNCcP5sXKPcWKS_uSDZgMJOoXxV-_0 2024-09-12T01:04:09.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.626+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3999763239756687834', time=2024-09-12T03:04:01.339223+0000, chain.objs.size()=1 2024-09-12T01:04:09.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.626+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.136__shadow_.wI4o0fJTwLUUtWGzBCF0RbyQ0RZYrao_0 2024-09-12T01:04:09.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.626+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11807908599940392641', time=2024-09-12T03:04:09.114783+0000, chain.objs.size()=1 2024-09-12T01:04:09.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.626+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.144__shadow_.nyrPJms61MDV-hixEppwMbaNJ7n8nDp_0 2024-09-12T01:04:09.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.629+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.631+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:04:09.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.632+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.633+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.632 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.633+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:04:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.633+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2187974303976683018', time=2024-09-12T03:03:54.465895+0000, chain.objs.size()=1 2024-09-12T01:04:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.633+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.123__shadow_.pfb-uXnih47slfTHmlgmACaDmKa9bGA_0 2024-09-12T01:04:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.633+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14108106130039160279', time=2024-09-12T03:03:55.008354+0000, chain.objs.size()=1 2024-09-12T01:04:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.633+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.124__shadow_.kTksf9nbXPxKi_pKEKMNCfRs7VSvc-3_0 2024-09-12T01:04:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.633+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.446089913881832190', time=2024-09-12T03:03:55.067980+0000, chain.objs.size()=1 2024-09-12T01:04:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.633+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.124__shadow_.6iKo5Y9Qf-IR0E7XRokua8BckusYYBm_0 2024-09-12T01:04:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.633+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9560738695083187075', time=2024-09-12T03:03:56.820286+0000, chain.objs.size()=1 2024-09-12T01:04:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.633+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.127__shadow_.AtWlVYvrfeaXCqiFea0tamKRZYPZCXk_0 2024-09-12T01:04:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.633+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8220601091903560710', time=2024-09-12T03:03:59.138701+0000, chain.objs.size()=1 2024-09-12T01:04:09.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.633+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.131__shadow_.RqyQ-FFvRfS-cwEbRBlZ0-ob76UCvId_0 2024-09-12T01:04:09.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.635+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.638+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:04:09.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.639+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T01:04:09.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8156755922759458989', time=2024-09-12T03:01:44.971452+0000, chain.objs.size()=1 2024-09-12T01:04:09.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.84__shadow_.0Ma0as_eOyqohWzTumskPZVnYBu4uhV_0 2024-09-12T01:04:09.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4630767107566152063', time=2024-09-12T03:02:24.211667+0000, chain.objs.size()=5 2024-09-12T01:04:09.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~NdM1Ukq0k1BIwWvHZ7TnMxc0uFMHYkb.1 2024-09-12T01:04:09.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~NdM1Ukq0k1BIwWvHZ7TnMxc0uFMHYkb.2 2024-09-12T01:04:09.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~NdM1Ukq0k1BIwWvHZ7TnMxc0uFMHYkb.3 2024-09-12T01:04:09.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~NdM1Ukq0k1BIwWvHZ7TnMxc0uFMHYkb.4 2024-09-12T01:04:09.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~NdM1Ukq0k1BIwWvHZ7TnMxc0uFMHYkb.5 2024-09-12T01:04:09.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14286244947672188379', time=2024-09-12T03:02:36.467758+0000, chain.objs.size()=5 2024-09-12T01:04:09.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~q8lMVP3_voskwrw19IxqRrbwI-rFH0u.1 2024-09-12T01:04:09.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__shadow_key1.2~q8lMVP3_voskwrw19IxqRrbwI-rFH0u.1_1 2024-09-12T01:04:09.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~q8lMVP3_voskwrw19IxqRrbwI-rFH0u.2 2024-09-12T01:04:09.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__shadow_key1.2~q8lMVP3_voskwrw19IxqRrbwI-rFH0u.2_1 2024-09-12T01:04:09.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~q8lMVP3_voskwrw19IxqRrbwI-rFH0u.3 2024-09-12T01:04:09.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13158182379488778585', time=2024-09-12T03:03:50.311703+0000, chain.objs.size()=1 2024-09-12T01:04:09.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.640+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.116__shadow_.3YuFjvQn7ztmKgwt3ciucLrlWQpk_l__0 2024-09-12T01:04:09.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.643+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17608426662596345145', time=2024-09-12T03:03:51.576775+0000, chain.objs.size()=1 2024-09-12T01:04:09.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.643+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.118__shadow_.cfiPUQzmHw3lA6NLfoqpwP9vc5JG0Ce_0 2024-09-12T01:04:09.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.643+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13913139206795320599', time=2024-09-12T03:03:52.125170+0000, chain.objs.size()=1 2024-09-12T01:04:09.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.643+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.119__shadow_.cdGFNkroHFkrOCuRPCrRx6lobdMC1xr_0 2024-09-12T01:04:09.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.643+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7112805071763996036', time=2024-09-12T03:03:57.479671+0000, chain.objs.size()=1 2024-09-12T01:04:09.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.643+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.128__shadow_.k4p0lvBEA05n6ZRp8-p1bVeHJYy9Cip_0 2024-09-12T01:04:09.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.646+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.649+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:04:09.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.650+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.650+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.651+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:04:09.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.651+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5231084293420579149', time=2024-09-12T03:02:21.005736+0000, chain.objs.size()=5 2024-09-12T01:04:09.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.651+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~dqryr6Gsl12SAh3g2qtYF0NyJrOxB8j.1 2024-09-12T01:04:09.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.651+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~dqryr6Gsl12SAh3g2qtYF0NyJrOxB8j.2 2024-09-12T01:04:09.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.651+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~dqryr6Gsl12SAh3g2qtYF0NyJrOxB8j.3 2024-09-12T01:04:09.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.651+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~dqryr6Gsl12SAh3g2qtYF0NyJrOxB8j.4 2024-09-12T01:04:09.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.651+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~dqryr6Gsl12SAh3g2qtYF0NyJrOxB8j.5 2024-09-12T01:04:09.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.651+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11857044619350795954', time=2024-09-12T03:03:53.351768+0000, chain.objs.size()=1 2024-09-12T01:04:09.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.651+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.121__shadow_.KpxmQkhx4nQLVfduxXmt_e2AMaxQEKX_0 2024-09-12T01:04:09.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.655+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.657+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:04:09.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.659+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.658 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.659+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.660+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:09.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.660+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18163193428941944282', time=2024-09-12T03:03:25.912940+0000, chain.objs.size()=5 2024-09-12T01:04:09.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.660+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~YCfRe_EMkIXc8A68xifvD1S_nD0M1Hg.1 2024-09-12T01:04:09.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.660+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__shadow_key1.2~YCfRe_EMkIXc8A68xifvD1S_nD0M1Hg.1_1 2024-09-12T01:04:09.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.660+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~YCfRe_EMkIXc8A68xifvD1S_nD0M1Hg.2 2024-09-12T01:04:09.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.660+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__shadow_key1.2~YCfRe_EMkIXc8A68xifvD1S_nD0M1Hg.2_1 2024-09-12T01:04:09.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.660+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~YCfRe_EMkIXc8A68xifvD1S_nD0M1Hg.3 2024-09-12T01:04:09.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.660+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12042197847778901252', time=2024-09-12T03:03:57.395860+0000, chain.objs.size()=1 2024-09-12T01:04:09.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.660+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.128__shadow_.pyC82PQ7gsjeqLuUy8ob0FFjqi6dhRH_0 2024-09-12T01:04:09.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.660+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7383024811113971951', time=2024-09-12T03:03:58.595835+0000, chain.objs.size()=1 2024-09-12T01:04:09.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.660+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.130__shadow_.qi7y1lWReZv9pxU_qEVSTCjbc3GN-Ah_0 2024-09-12T01:04:09.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.660+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11012780536815059473', time=2024-09-12T03:03:59.653358+0000, chain.objs.size()=1 2024-09-12T01:04:09.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.660+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.132__shadow_.cqbX7vxadbjGZ1a-MDAJqPFE4EoOq2b_0 2024-09-12T01:04:09.662 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.663+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.667+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:04:09.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.668+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.668+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.669+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:04:09.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.669+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11768502877165614649', time=2024-09-12T03:02:08.413680+0000, chain.objs.size()=5 2024-09-12T01:04:09.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.669+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~O5g3sehyZdRvnB8CGeYL-lHQyd6ECqj.1 2024-09-12T01:04:09.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.669+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~O5g3sehyZdRvnB8CGeYL-lHQyd6ECqj.2 2024-09-12T01:04:09.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.669+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~O5g3sehyZdRvnB8CGeYL-lHQyd6ECqj.3 2024-09-12T01:04:09.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.669+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~O5g3sehyZdRvnB8CGeYL-lHQyd6ECqj.4 2024-09-12T01:04:09.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.669+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~O5g3sehyZdRvnB8CGeYL-lHQyd6ECqj.5 2024-09-12T01:04:09.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.669+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10831819261483969060', time=2024-09-12T03:04:00.252402+0000, chain.objs.size()=1 2024-09-12T01:04:09.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.669+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.133__shadow_.G085UPLv2Mm_purZokRx74THQHyDgHl_0 2024-09-12T01:04:09.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.672+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.675+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:04:09.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.676+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.676+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:04:09.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2335405056992697067', time=2024-09-12T03:01:47.090987+0000, chain.objs.size()=1 2024-09-12T01:04:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.90__shadow_.dN0yWOHpezH3s2BxZpFlo5PpfjmaFi__0 2024-09-12T01:04:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3218793460286318167', time=2024-09-12T03:01:49.957565+0000, chain.objs.size()=5 2024-09-12T01:04:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.91__multipart_key1.2~VR9me_O1NseYlKTF_gU3285ODmA-2Tf.1 2024-09-12T01:04:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.91__multipart_key1.2~VR9me_O1NseYlKTF_gU3285ODmA-2Tf.2 2024-09-12T01:04:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.91__multipart_key1.2~VR9me_O1NseYlKTF_gU3285ODmA-2Tf.3 2024-09-12T01:04:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.91__multipart_key1.2~VR9me_O1NseYlKTF_gU3285ODmA-2Tf.4 2024-09-12T01:04:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.91__multipart_key1.2~VR9me_O1NseYlKTF_gU3285ODmA-2Tf.5 2024-09-12T01:04:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7048248139364702483', time=2024-09-12T03:03:26.102097+0000, chain.objs.size()=5 2024-09-12T01:04:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~tSRxVlhFyB8lIdcoHqJpt5_fpxCPsiE.1 2024-09-12T01:04:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__shadow_key1.2~tSRxVlhFyB8lIdcoHqJpt5_fpxCPsiE.1_1 2024-09-12T01:04:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~tSRxVlhFyB8lIdcoHqJpt5_fpxCPsiE.2 2024-09-12T01:04:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__shadow_key1.2~tSRxVlhFyB8lIdcoHqJpt5_fpxCPsiE.2_1 2024-09-12T01:04:09.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~tSRxVlhFyB8lIdcoHqJpt5_fpxCPsiE.3 2024-09-12T01:04:09.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17364467870910026583', time=2024-09-12T03:03:40.733784+0000, chain.objs.size()=5 2024-09-12T01:04:09.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.677+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.104__multipart_key1.2~gpaSepkfJk3n6FzXs285hHUUEcVbmI6.1 2024-09-12T01:04:09.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.679+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.104__multipart_key1.2~gpaSepkfJk3n6FzXs285hHUUEcVbmI6.2 2024-09-12T01:04:09.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.679+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.104__multipart_key1.2~gpaSepkfJk3n6FzXs285hHUUEcVbmI6.3 2024-09-12T01:04:09.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.681+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.104__multipart_key1.2~gpaSepkfJk3n6FzXs285hHUUEcVbmI6.4 2024-09-12T01:04:09.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.683+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.104__multipart_key1.2~gpaSepkfJk3n6FzXs285hHUUEcVbmI6.5 2024-09-12T01:04:09.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.683+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11133201940406978898', time=2024-09-12T03:03:53.955172+0000, chain.objs.size()=1 2024-09-12T01:04:09.682 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.683+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.122__shadow_.a0YsT-FSeoTUqq26cEM719rvUkopFql_0 2024-09-12T01:04:09.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.686+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.688+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:04:09.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.690+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T01:04:09.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2163986021682562765', time=2024-09-12T03:03:45.506026+0000, chain.objs.size()=1 2024-09-12T01:04:09.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.106__shadow_.AhHDDF3VQosEPxlNI2JmJ52ExChQ8MV_0 2024-09-12T01:04:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1053112210336074984', time=2024-09-12T03:03:48.537826+0000, chain.objs.size()=1 2024-09-12T01:04:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.113__shadow_.uLPGaGWdWtOB8woc_PdhnHNe4rwQUwH_0 2024-09-12T01:04:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18337175207540322371', time=2024-09-12T03:03:49.683830+0000, chain.objs.size()=1 2024-09-12T01:04:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.115__shadow_.GljdGIOOoafF2dTY_nr77k6Ir10fIw__0 2024-09-12T01:04:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10555978160522853829', time=2024-09-12T03:03:51.549673+0000, chain.objs.size()=1 2024-09-12T01:04:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.118__shadow_.oPfhHVEcEXAReYS2bPjDVSlw4xiVEmC_0 2024-09-12T01:04:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18306622800198643119', time=2024-09-12T03:03:59.681446+0000, chain.objs.size()=1 2024-09-12T01:04:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.132__shadow_.h8qhNJHTeCI8eIp2xo_GA8u8DEW0PYs_0 2024-09-12T01:04:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10959520092459385860', time=2024-09-12T03:04:00.197306+0000, chain.objs.size()=1 2024-09-12T01:04:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.133__shadow_.yZnt3P3dd_HzuQ-IjW4Q2inU8d8sW0w_0 2024-09-12T01:04:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14839914674148807507', time=2024-09-12T03:04:02.855573+0000, chain.objs.size()=1 2024-09-12T01:04:09.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.691+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.139__shadow_.GQ58tFQz4E_YdpPsbhublKI7kaqsqwk_0 2024-09-12T01:04:09.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.694+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.696+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:04:09.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.698+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.698+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.699+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:04:09.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.699+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.90669363226622332', time=2024-09-12T03:03:01.656899+0000, chain.objs.size()=1 2024-09-12T01:04:09.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.699+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.100__shadow_.PZzL09lFigpVKHM_iI6aHh7zdeUEDtg_0 2024-09-12T01:04:09.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.699+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10471345685212556754', time=2024-09-12T03:03:49.170427+0000, chain.objs.size()=1 2024-09-12T01:04:09.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.699+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.114__shadow_.rJyIKbLFntzmtZjzE_l6-uoqXay7gr-_0 2024-09-12T01:04:09.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.699+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3127392153742763968', time=2024-09-12T03:03:49.738547+0000, chain.objs.size()=1 2024-09-12T01:04:09.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.699+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.115__shadow_.zsHgfT9hxG_n9JsJUNDTAIhrf-S4O4X_0 2024-09-12T01:04:09.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.699+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10855024086220290882', time=2024-09-12T03:03:52.783380+0000, chain.objs.size()=1 2024-09-12T01:04:09.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.699+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.120__shadow_.RUHtjA8gdIRufCb_LLIAlkvk1QLbh7E_0 2024-09-12T01:04:09.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.699+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17850028420062829596', time=2024-09-12T03:04:02.020878+0000, chain.objs.size()=1 2024-09-12T01:04:09.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.699+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.138__shadow_.B-erOnlRuD-c496tqcxn2n0xOiAUn14_0 2024-09-12T01:04:09.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.701+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.703+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:04:09.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.704 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:04:09.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13881959166676196243', time=2024-09-12T03:02:52.823326+0000, chain.objs.size()=5 2024-09-12T01:04:09.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.98__multipart_key1.2~Txalrc0nfXiOxC4Mbt8o3o-NwH1BQ9q.1 2024-09-12T01:04:09.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.98__multipart_key1.2~Txalrc0nfXiOxC4Mbt8o3o-NwH1BQ9q.2 2024-09-12T01:04:09.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.98__multipart_key1.2~Txalrc0nfXiOxC4Mbt8o3o-NwH1BQ9q.3 2024-09-12T01:04:09.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.98__multipart_key1.2~Txalrc0nfXiOxC4Mbt8o3o-NwH1BQ9q.4 2024-09-12T01:04:09.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.98__multipart_key1.2~Txalrc0nfXiOxC4Mbt8o3o-NwH1BQ9q.5 2024-09-12T01:04:09.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5581452499217230160', time=2024-09-12T03:03:47.887213+0000, chain.objs.size()=1 2024-09-12T01:04:09.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.112__shadow_.pNO2vub5BPa0HxldH0zn-8OHeRn3Nbz_0 2024-09-12T01:04:09.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15260866010003788682', time=2024-09-12T03:03:47.915463+0000, chain.objs.size()=1 2024-09-12T01:04:09.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.112__shadow_.cZcrlp4Rljj0x3aquew1M6Ty_UapAU-_0 2024-09-12T01:04:09.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11391434450340111070', time=2024-09-12T03:03:48.571945+0000, chain.objs.size()=1 2024-09-12T01:04:09.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.113__shadow_.C0Tp-BSpvTrUzyRNBaJRy3u3PKnnU9Z_0 2024-09-12T01:04:09.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4107014184132085546', time=2024-09-12T03:03:53.381142+0000, chain.objs.size()=1 2024-09-12T01:04:09.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.705+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.121__shadow_.hjYCrmjasfHpAX99pOJQiBnWrDT4iG2_0 2024-09-12T01:04:09.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.709+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.712+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:04:09.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.713+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.713+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.714+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:09.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.714+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11156800507203874623', time=2024-09-12T03:03:28.328762+0000, chain.objs.size()=1 2024-09-12T01:04:09.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.714+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.103__shadow_.tgsknaCKDF9woUZiAf3VmMXSNnym74r_0 2024-09-12T01:04:09.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.714+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14450454104548496164', time=2024-09-12T03:03:55.589175+0000, chain.objs.size()=1 2024-09-12T01:04:09.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.714+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.125__shadow_.MBdXPpLzOxLD_OklIHvnDd-80u1ocd5_0 2024-09-12T01:04:09.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.714+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11843242943178573080', time=2024-09-12T03:03:55.674334+0000, chain.objs.size()=1 2024-09-12T01:04:09.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.714+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.125__shadow_.h5yybLu2CIWNozuLyw12l_6LMOML5zu_0 2024-09-12T01:04:09.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.714+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2913942946091591385', time=2024-09-12T03:04:01.695102+0000, chain.objs.size()=1 2024-09-12T01:04:09.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.714+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.137__shadow_._1F0G829JL6kkvwZBpLUkifIRnJrRjR_0 2024-09-12T01:04:09.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.716+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.718+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:04:09.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.719+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.720+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.720+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:04:09.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.720+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16928044019777786837', time=2024-09-12T03:01:45.348277+0000, chain.objs.size()=1 2024-09-12T01:04:09.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.720+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.85__shadow_.wdlwtt462SmjgVEfp8GifL0VHRKdD5j_0 2024-09-12T01:04:09.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.720+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3241377633769167588', time=2024-09-12T03:03:58.568623+0000, chain.objs.size()=1 2024-09-12T01:04:09.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.720+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.130__shadow_.GuhDfu3HoLaMoVBd2a2JyCA-tDeKODp_0 2024-09-12T01:04:09.720 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.721+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.722 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.723+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:04:09.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.725+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.725+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.725+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:09.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.725+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15852591817497887603', time=2024-09-12T03:03:12.973843+0000, chain.objs.size()=5 2024-09-12T01:04:09.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.725+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~OzO7ECbeVK81xx5wzcOxn-pxHFuOjqc.1 2024-09-12T01:04:09.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.725+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~OzO7ECbeVK81xx5wzcOxn-pxHFuOjqc.2 2024-09-12T01:04:09.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.725+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~OzO7ECbeVK81xx5wzcOxn-pxHFuOjqc.3 2024-09-12T01:04:09.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.726+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~OzO7ECbeVK81xx5wzcOxn-pxHFuOjqc.4 2024-09-12T01:04:09.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.726+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.102__multipart_key1.2~OzO7ECbeVK81xx5wzcOxn-pxHFuOjqc.5 2024-09-12T01:04:09.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.726+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11778047578222089898', time=2024-09-12T03:03:47.943797+0000, chain.objs.size()=1 2024-09-12T01:04:09.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.726+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.112__shadow_.N0qyAhkL5xSn6hJJxD2cdrBGW9UPwU3_0 2024-09-12T01:04:09.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.726+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4706407322016557651', time=2024-09-12T03:03:47.971297+0000, chain.objs.size()=1 2024-09-12T01:04:09.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.726+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.112__shadow_.OK2i7r9HNHO8l7--9Xm5iY7pYuxlMly_0 2024-09-12T01:04:09.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.726+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1415280649800107504', time=2024-09-12T03:03:51.521451+0000, chain.objs.size()=1 2024-09-12T01:04:09.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.726+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.118__shadow_.3BDfp089zbvj3Irnr42DVDiSrscCje2_0 2024-09-12T01:04:09.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.729+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.732+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:04:09.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.733+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.733+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.734+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:04:09.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.734+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17198103658673990696', time=2024-09-12T03:03:57.993685+0000, chain.objs.size()=1 2024-09-12T01:04:09.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.734+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.129__shadow_.b00J8pYbhqE4OET-Pp4f8rFJLCXRfCb_0 2024-09-12T01:04:09.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.734+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9186501129124984785', time=2024-09-12T03:04:00.224879+0000, chain.objs.size()=1 2024-09-12T01:04:09.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.734+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.133__shadow_.LRlZvoSQ2vrKK6--Ay7PqrpM43IQJSk_0 2024-09-12T01:04:09.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.734+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17534295997081969042', time=2024-09-12T03:04:02.109471+0000, chain.objs.size()=1 2024-09-12T01:04:09.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.734+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.138__shadow_.Z9Q0tTDxXkvFkmy48TWbu1MFT9JITP__0 2024-09-12T01:04:09.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.735+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.737+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:04:09.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.739+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.739+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.740+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:04:09.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.740+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2671040930788259535', time=2024-09-12T03:02:40.202978+0000, chain.objs.size()=5 2024-09-12T01:04:09.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.740+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~UWx64spe37k_3TLz6-tStQXWDpRKsXt.1 2024-09-12T01:04:09.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.740+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__shadow_key1.2~UWx64spe37k_3TLz6-tStQXWDpRKsXt.1_1 2024-09-12T01:04:09.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.740+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~UWx64spe37k_3TLz6-tStQXWDpRKsXt.2 2024-09-12T01:04:09.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.740+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__shadow_key1.2~UWx64spe37k_3TLz6-tStQXWDpRKsXt.2_1 2024-09-12T01:04:09.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.740+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.94__multipart_key1.2~UWx64spe37k_3TLz6-tStQXWDpRKsXt.3 2024-09-12T01:04:09.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.740+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13422975075953638954', time=2024-09-12T03:03:01.715665+0000, chain.objs.size()=1 2024-09-12T01:04:09.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.740+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.100__shadow_.h3hl0oUyEsTY9ePuju6lDXhzqTiSFrT_0 2024-09-12T01:04:09.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.740+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.600826635239425435', time=2024-09-12T03:03:50.940073+0000, chain.objs.size()=1 2024-09-12T01:04:09.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.740+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.117__shadow_.NRD2jaPt81kuZfRgnkBNWqgtzK70rYh_0 2024-09-12T01:04:09.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.743+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.746+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:04:09.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.747+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.747+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T01:04:09.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5761785856153315220', time=2024-09-12T03:03:01.687965+0000, chain.objs.size()=5 2024-09-12T01:04:09.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.100__multipart_file2.mpg.2~hnzoLrYL5MvMEqVFI1QqDxCCsEWipTv.1 2024-09-12T01:04:09.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.100__multipart_file2.mpg.2~hnzoLrYL5MvMEqVFI1QqDxCCsEWipTv.2 2024-09-12T01:04:09.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.100__multipart_file2.mpg.2~hnzoLrYL5MvMEqVFI1QqDxCCsEWipTv.3 2024-09-12T01:04:09.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.100__multipart_file2.mpg.2~hnzoLrYL5MvMEqVFI1QqDxCCsEWipTv.4 2024-09-12T01:04:09.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.100__multipart_file2.mpg.2~hnzoLrYL5MvMEqVFI1QqDxCCsEWipTv.5 2024-09-12T01:04:09.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14851550551016519114', time=2024-09-12T03:03:29.246036+0000, chain.objs.size()=5 2024-09-12T01:04:09.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.103__multipart_key1.2~fRU-d4TU1T8LSidJCdp5Owo8Rl5Po_B.1 2024-09-12T01:04:09.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.103__multipart_key1.2~fRU-d4TU1T8LSidJCdp5Owo8Rl5Po_B.2 2024-09-12T01:04:09.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.103__multipart_key1.2~fRU-d4TU1T8LSidJCdp5Owo8Rl5Po_B.3 2024-09-12T01:04:09.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.103__multipart_key1.2~fRU-d4TU1T8LSidJCdp5Owo8Rl5Po_B.4 2024-09-12T01:04:09.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.103__multipart_key1.2~fRU-d4TU1T8LSidJCdp5Owo8Rl5Po_B.5 2024-09-12T01:04:09.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7051139143129724103', time=2024-09-12T03:03:49.116185+0000, chain.objs.size()=1 2024-09-12T01:04:09.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.114__shadow_.7o9H4qCRrdzuYjFOuGSK6pESEaRRL5Q_0 2024-09-12T01:04:09.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1869680490632864067', time=2024-09-12T03:03:49.766294+0000, chain.objs.size()=1 2024-09-12T01:04:09.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.748+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.115__shadow_.ewdYpbQ6OqKWcPCgBgY7E9hIKz-JXG2_0 2024-09-12T01:04:09.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.751+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10631001393798077999', time=2024-09-12T03:03:52.701803+0000, chain.objs.size()=1 2024-09-12T01:04:09.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.751+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.120__shadow_.bJ9zVxR3FqAKgBXvSDyDL5quaededNW_0 2024-09-12T01:04:09.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.751+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5811719824454590614', time=2024-09-12T03:03:58.048419+0000, chain.objs.size()=1 2024-09-12T01:04:09.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.751+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.129__shadow_.bpsR_GOk3NOqk4ISNZFdRNcRnqCwEjH_0 2024-09-12T01:04:09.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.751+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13605712694939537307', time=2024-09-12T03:03:59.709406+0000, chain.objs.size()=1 2024-09-12T01:04:09.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.751+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.132__shadow_.lWgKc0JFdlV52XLyVeEeScYab0XZcvx_0 2024-09-12T01:04:09.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.755+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.758+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:04:09.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.759+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.759+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.760+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:04:09.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.760+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9563026178205849875', time=2024-09-12T03:02:56.505339+0000, chain.objs.size()=5 2024-09-12T01:04:09.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.760+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.99__multipart_key1.2~0-xEtQKDqCpnWm4FvwSfvV3cA2ohc90.1 2024-09-12T01:04:09.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.760+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.99__multipart_key1.2~0-xEtQKDqCpnWm4FvwSfvV3cA2ohc90.2 2024-09-12T01:04:09.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.760+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.99__multipart_key1.2~0-xEtQKDqCpnWm4FvwSfvV3cA2ohc90.3 2024-09-12T01:04:09.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.760+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.99__multipart_key1.2~0-xEtQKDqCpnWm4FvwSfvV3cA2ohc90.4 2024-09-12T01:04:09.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.760+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.99__multipart_key1.2~0-xEtQKDqCpnWm4FvwSfvV3cA2ohc90.5 2024-09-12T01:04:09.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.762+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.765+0000 7f4109a98800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:04:09.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.766+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:09.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:09.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:04:09.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7926844788389751280', time=2024-09-12T03:03:01.742939+0000, chain.objs.size()=1 2024-09-12T01:04:09.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.100__shadow_.q7j_0Nxp4izYZuKD-s78ewSmHtOPPGL_0 2024-09-12T01:04:09.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw', time=2024-09-12T03:03:43.167278+0000, chain.objs.size()=30 2024-09-12T01:04:09.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.1 2024-09-12T01:04:09.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.2 2024-09-12T01:04:09.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.3 2024-09-12T01:04:09.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.4 2024-09-12T01:04:09.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.5 2024-09-12T01:04:09.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.6 2024-09-12T01:04:09.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.7 2024-09-12T01:04:09.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.8 2024-09-12T01:04:09.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.9 2024-09-12T01:04:09.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.10 2024-09-12T01:04:09.768 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.767+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.11 2024-09-12T01:04:09.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.770+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.12 2024-09-12T01:04:09.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.770+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.13 2024-09-12T01:04:09.770 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.771+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.14 2024-09-12T01:04:09.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.771+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.15 2024-09-12T01:04:09.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.771+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.16 2024-09-12T01:04:09.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.771+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.17 2024-09-12T01:04:09.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.772+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.18 2024-09-12T01:04:09.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.773+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.19 2024-09-12T01:04:09.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.773+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.20 2024-09-12T01:04:09.772 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.773+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.21 2024-09-12T01:04:09.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.773+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.22 2024-09-12T01:04:09.773 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.774+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.23 2024-09-12T01:04:09.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.775+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.24 2024-09-12T01:04:09.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.776+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.25 2024-09-12T01:04:09.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.776+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.26 2024-09-12T01:04:09.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.776+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.27 2024-09-12T01:04:09.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.777+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.28 2024-09-12T01:04:09.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.777+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.29 2024-09-12T01:04:09.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.777+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.105__multipart_key1.2~kVVsuBoAN-wXe5u8YU08XqPGhzLpnqw.30 2024-09-12T01:04:09.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.777+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.246203477272470331', time=2024-09-12T03:03:52.756816+0000, chain.objs.size()=1 2024-09-12T01:04:09.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.777+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.120__shadow_.ybCrDnnfPlJiT2q3W2T3PM46YwKjXff_0 2024-09-12T01:04:09.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.777+0000 7f4109a98800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7158195392966535576', time=2024-09-12T03:03:56.189932+0000, chain.objs.size()=1 2024-09-12T01:04:09.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.777+0000 7f4109a98800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.126__shadow_.lmyCdWfOwRRBiAFUdUP2YRujQHVvskE_0 2024-09-12T01:04:09.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.782+0000 7f4109a98800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:04:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.786+0000 7f3fbdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:09.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.788+0000 7f4109a98800 20 remove_watcher() i=0 2024-09-12T01:04:09.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.788+0000 7f4109a98800 2 removed watcher, disabling cache 2024-09-12T01:04:09.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.789+0000 7f4109a98800 20 remove_watcher() i=1 2024-09-12T01:04:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.790+0000 7f4109a98800 20 remove_watcher() i=2 2024-09-12T01:04:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.791+0000 7f4109a98800 20 remove_watcher() i=3 2024-09-12T01:04:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.792+0000 7f4109a98800 20 remove_watcher() i=4 2024-09-12T01:04:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.793+0000 7f4109a98800 20 remove_watcher() i=5 2024-09-12T01:04:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.794+0000 7f4109a98800 20 remove_watcher() i=6 2024-09-12T01:04:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.795+0000 7f4109a98800 20 remove_watcher() i=7 2024-09-12T01:04:09.806 DEBUG:teuthology.orchestra.run.smithi062:> radosgw-admin gc process --include-all 2024-09-12T01:04:09.858 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:09.859 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:09.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.899+0000 7f5d8a324800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.901+0000 7f5d8a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.901+0000 7f5d8a324800 20 realm 2024-09-12T01:04:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.901+0000 7f5d8a324800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.901+0000 7f5d8a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:09.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.901+0000 7f5d8a324800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.901+0000 7f5d8a324800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.901+0000 7f5d8a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.901+0000 7f5d8a324800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.902+0000 7f5d8a324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:09.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.902+0000 7f5d8a324800 20 rados->read ofs=0 len=0 2024-09-12T01:04:09.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.902+0000 7f5d8a324800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:09.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.902+0000 7f5d8a324800 20 searching for the correct realm 2024-09-12T01:04:09.902 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:09.903+0000 7f5d85f02640 0 -- 172.21.15.62:0/2444912077 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7f5d80064040 msgr2=0x7f5d80055410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:10.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.109+0000 7f5d86703640 0 -- 172.21.15.62:0/2444912077 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7f5d78036060 msgr2=0x7f5d780123e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:10.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.317+0000 7f5d8a324800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:10.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.317+0000 7f5d8a324800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:10.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.317+0000 7f5d8a324800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:10.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.317+0000 7f5d8a324800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:10.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.317+0000 7f5d8a324800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:10.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.317+0000 7f5d8a324800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:10.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.317+0000 7f5d8a324800 20 rados->read ofs=0 len=0 2024-09-12T01:04:10.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.317+0000 7f5d8a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:10.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.317+0000 7f5d8a324800 20 rados->read ofs=0 len=0 2024-09-12T01:04:10.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.318+0000 7f5d8a324800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:10.318 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.318+0000 7f5d8a324800 20 rados->read ofs=0 len=0 2024-09-12T01:04:10.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.318+0000 7f5d8a324800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:10.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.318+0000 7f5d8a324800 20 zone default found 2024-09-12T01:04:10.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.318+0000 7f5d8a324800 4 Realm: () 2024-09-12T01:04:10.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.318+0000 7f5d8a324800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:10.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.318+0000 7f5d8a324800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:10.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.318+0000 7f5d8a324800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:10.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.318+0000 7f5d8a324800 20 zonegroup default 2024-09-12T01:04:10.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.318+0000 7f5d8a324800 20 rados->read ofs=0 len=0 2024-09-12T01:04:10.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.319+0000 7f5d8a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:10.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.319+0000 7f5d8a324800 20 rados->read ofs=0 len=0 2024-09-12T01:04:10.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.319+0000 7f5d8a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:10.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.319+0000 7f5d8a324800 20 rados->read ofs=0 len=0 2024-09-12T01:04:10.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.319+0000 7f5d8a324800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:10.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.319+0000 7f5d8a324800 20 started sync module instance, tier type = 2024-09-12T01:04:10.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.319+0000 7f5d8a324800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:10.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.328+0000 7f5d8a324800 20 add_watcher() i=0 2024-09-12T01:04:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.328+0000 7f5d8a324800 20 add_watcher() i=1 2024-09-12T01:04:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.328+0000 7f5d8a324800 20 add_watcher() i=2 2024-09-12T01:04:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.328+0000 7f5d8a324800 20 add_watcher() i=3 2024-09-12T01:04:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.328+0000 7f5d8a324800 20 add_watcher() i=4 2024-09-12T01:04:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.328+0000 7f5d8a324800 20 add_watcher() i=5 2024-09-12T01:04:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.328+0000 7f5d8a324800 20 add_watcher() i=6 2024-09-12T01:04:10.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.329+0000 7f5d8a324800 20 add_watcher() i=7 2024-09-12T01:04:10.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.329+0000 7f5d8a324800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:10.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.331+0000 7f5c377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:10.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.331+0000 7f5d8a324800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:10.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.331+0000 7f5d8a324800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:10.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.365+0000 7f5c367fc640 20 reqs_thread_entry: start 2024-09-12T01:04:10.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.366+0000 7f5d8a324800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:10.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.366+0000 7f5d8a324800 20 Filter name: none 2024-09-12T01:04:10.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.366+0000 7f5ba7fff640 20 reqs_thread_entry: start 2024-09-12T01:04:10.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.366+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:04:10.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.367+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.368+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.368+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.369+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:04:10.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.370+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.371+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.371+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.372+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:04:10.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.373+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.374+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.374+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.375+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:04:10.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.376+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.377+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.377+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.378+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:04:10.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.379+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.380+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.380+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.381+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:04:10.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.382+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.383+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.383+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.384+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:04:10.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.385+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.386+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.386+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.387+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:04:10.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.388+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.389+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.389+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.390+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:04:10.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.392+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.392+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.393+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.394+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:04:10.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.395+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.396+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.396+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.397+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:04:10.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.398+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.399+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.399+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.400+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:04:10.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.401+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.402+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.402+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.403+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:04:10.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.404+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.405+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.405+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.406+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:04:10.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.408+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.408+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.408+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.409+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:04:10.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.410+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.411+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.411+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.412+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:04:10.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.413+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.414+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.414+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.415+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:04:10.415 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.416+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.417+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.417+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.418+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:04:10.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.419+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.419+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.420+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.421+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:04:10.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.422+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.423+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.423+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.424+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:04:10.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.425+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.426+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.426+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.427+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:04:10.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.429+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.430+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.430+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.431+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:04:10.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.432+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.433+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.433+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.434+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:04:10.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.435+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.436+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.436+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.437+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:04:10.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.438+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.439+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.439+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.440+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:04:10.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.442+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.442+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.443+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.444+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:04:10.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.447+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.448+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.448+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.449+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:04:10.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.451+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.451+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.451+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.452+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:04:10.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.454+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.454+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.454+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.456+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:04:10.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.457+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.458+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.458+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.459+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:04:10.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.460+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.461+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.461+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.462+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:04:10.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.464+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.464+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.464+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.465+0000 7f5d8a324800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:04:10.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.467+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.467+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:04:10.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.467+0000 7f5d8a324800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:04:10.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.469+0000 7f5c377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:10.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.472+0000 7f5d8a324800 20 remove_watcher() i=0 2024-09-12T01:04:10.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.472+0000 7f5d8a324800 2 removed watcher, disabling cache 2024-09-12T01:04:10.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.473+0000 7f5d8a324800 20 remove_watcher() i=1 2024-09-12T01:04:10.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.474+0000 7f5d8a324800 20 remove_watcher() i=2 2024-09-12T01:04:10.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.475+0000 7f5d8a324800 20 remove_watcher() i=3 2024-09-12T01:04:10.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.476+0000 7f5d8a324800 20 remove_watcher() i=4 2024-09-12T01:04:10.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.477+0000 7f5d8a324800 20 remove_watcher() i=5 2024-09-12T01:04:10.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.478+0000 7f5d8a324800 20 remove_watcher() i=6 2024-09-12T01:04:10.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:10.479+0000 7f5d8a324800 20 remove_watcher() i=7 2024-09-12T01:04:10.491 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T01:04:10.510 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T01:04:10.511 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T01:04:10.511 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T01:04:10.511 DEBUG:teuthology.orchestra.run.smithi062:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:04:10.541 INFO:teuthology.orchestra.run.smithi062.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T01:04:11.315 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T01:04:11.316 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-12T01:04:11.316 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key TMKOXPFFBTDRVJHGVDRS --secret Sret0SFiwGA7IUclnqPE3yJ9ekYLHXYk9DMTRvM5tw16m3GdnKmrWQ== --cluster ceph 2024-09-12T01:04:11.424 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:11.425 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:11.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.459+0000 7f4263517800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.461+0000 7f4263517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.461+0000 7f4263517800 20 realm 2024-09-12T01:04:11.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.461+0000 7f4263517800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.461+0000 7f4263517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.461+0000 7f4263517800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:11.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.461+0000 7f4263517800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.461+0000 7f4263517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.461+0000 7f4263517800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.462+0000 7f4263517800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:11.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.462+0000 7f4263517800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.463+0000 7f4263517800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:11.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.463+0000 7f4263517800 20 searching for the correct realm 2024-09-12T01:04:11.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.466+0000 7f4260800640 0 -- 172.21.15.62:0/844156885 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f4258040040 msgr2=0x7f4258040930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:11.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.672+0000 7f4261802640 0 -- 172.21.15.62:0/844156885 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55d34e4b0000 msgr2=0x55d34e4b2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:11.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.676+0000 7f4263517800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:11.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.676+0000 7f4263517800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:11.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.676+0000 7f4263517800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:11.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.676+0000 7f4263517800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:11.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.676+0000 7f4263517800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:11.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.676+0000 7f4263517800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:11.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.677+0000 7f4263517800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.677+0000 7f4263517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.677+0000 7f4263517800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.677+0000 7f4263517800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.677+0000 7f4263517800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.677+0000 7f4263517800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.677+0000 7f4263517800 20 zone default found 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.677+0000 7f4263517800 4 Realm: () 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.677+0000 7f4263517800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.677+0000 7f4263517800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.677+0000 7f4263517800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.677+0000 7f4263517800 20 zonegroup default 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.677+0000 7f4263517800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.678+0000 7f4263517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.678+0000 7f4263517800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.678+0000 7f4263517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.678+0000 7f4263517800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.678+0000 7f4263517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.678+0000 7f4263517800 20 started sync module instance, tier type = 2024-09-12T01:04:11.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.678+0000 7f4263517800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:11.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.688+0000 7f4263517800 20 add_watcher() i=0 2024-09-12T01:04:11.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.688+0000 7f4263517800 20 add_watcher() i=1 2024-09-12T01:04:11.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.688+0000 7f4263517800 20 add_watcher() i=2 2024-09-12T01:04:11.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.688+0000 7f4263517800 20 add_watcher() i=3 2024-09-12T01:04:11.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.688+0000 7f4263517800 20 add_watcher() i=4 2024-09-12T01:04:11.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.688+0000 7f4263517800 20 add_watcher() i=5 2024-09-12T01:04:11.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.689+0000 7f4263517800 20 add_watcher() i=6 2024-09-12T01:04:11.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.690+0000 7f4263517800 20 add_watcher() i=7 2024-09-12T01:04:11.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.690+0000 7f4263517800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:11.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.691+0000 7f41177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:11.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.691+0000 7f4263517800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:11.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.691+0000 7f4263517800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:11.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.691+0000 7f4263517800 5 note: GC not initialized 2024-09-12T01:04:11.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.692+0000 7f41167e4640 20 reqs_thread_entry: start 2024-09-12T01:04:11.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.692+0000 7f4263517800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:11.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.692+0000 7f4263517800 20 Filter name: none 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.692+0000 7f4087fff640 20 reqs_thread_entry: start 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.692+0000 7f4263517800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.692+0000 7f4263517800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.692+0000 7f4263517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.692+0000 7f4263517800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.692+0000 7f4263517800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.692+0000 7f4263517800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.692+0000 7f4263517800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.693+0000 7f4263517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.693+0000 7f4263517800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.693+0000 7f4263517800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.693+0000 7f4263517800 10 cache get: name=default.rgw.meta+users.keys+TMKOXPFFBTDRVJHGVDRS : miss 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.693+0000 7f4263517800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.693+0000 7f4263517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.693+0000 7f4263517800 10 cache put: name=default.rgw.meta+users.keys+TMKOXPFFBTDRVJHGVDRS info.flags=0x0 2024-09-12T01:04:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.693+0000 7f4263517800 10 adding default.rgw.meta+users.keys+TMKOXPFFBTDRVJHGVDRS to cache LRU end 2024-09-12T01:04:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.693+0000 7f4263517800 10 cache get: name=default.rgw.meta+users.keys+TMKOXPFFBTDRVJHGVDRS : hit (negative entry) 2024-09-12T01:04:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.693+0000 7f4263517800 10 cache get: name=default.rgw.meta+users.keys+TMKOXPFFBTDRVJHGVDRS : hit (negative entry) 2024-09-12T01:04:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.694+0000 7f4263517800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:04:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.694+0000 7f4263517800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:04:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.694+0000 7f4263517800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T01:04:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.695+0000 7f4144ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431643 cookie 94366040004384 notifier 8991 bl.length()=645 2024-09-12T01:04:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.695+0000 7f4144ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:04:11.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.695+0000 7f4144ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:04:11.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.698+0000 7f4263517800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T01:04:11.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.698+0000 7f4263517800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T01:04:11.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.698+0000 7f4263517800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T01:04:11.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.698+0000 7f4144ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431816 cookie 94366040070176 notifier 8991 bl.length()=185 2024-09-12T01:04:11.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.698+0000 7f4144ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T01:04:11.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.698+0000 7f4144ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T01:04:11.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.700+0000 7f4263517800 10 cache put: name=default.rgw.meta+users.keys+TMKOXPFFBTDRVJHGVDRS info.flags=0x7 2024-09-12T01:04:11.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.700+0000 7f4263517800 10 moving default.rgw.meta+users.keys+TMKOXPFFBTDRVJHGVDRS to cache LRU end 2024-09-12T01:04:11.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.701+0000 7f4263517800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:TMKOXPFFBTDRVJHGVDRS, ofs0, ns] 2024-09-12T01:04:11.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.701+0000 7f4133fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1125281431830 cookie 94366040072192 notifier 8991 bl.length()=186 2024-09-12T01:04:11.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.701+0000 7f4133fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TMKOXPFFBTDRVJHGVDRS info.flags=0x7 2024-09-12T01:04:11.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.701+0000 7f4133fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TMKOXPFFBTDRVJHGVDRS to cache LRU end 2024-09-12T01:04:11.701 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:04:11.701 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "foo.client.0", 2024-09-12T01:04:11.701 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr.foo.client.0", 2024-09-12T01:04:11.701 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "foo+test@test.test", 2024-09-12T01:04:11.702 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2024-09-12T01:04:11.702 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2024-09-12T01:04:11.702 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2024-09-12T01:04:11.702 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2024-09-12T01:04:11.702 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T01:04:11.702 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "foo.client.0", 2024-09-12T01:04:11.702 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "TMKOXPFFBTDRVJHGVDRS", 2024-09-12T01:04:11.702 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "Sret0SFiwGA7IUclnqPE3yJ9ekYLHXYk9DMTRvM5tw16m3GdnKmrWQ==", 2024-09-12T01:04:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: "active": true, 2024-09-12T01:04:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T01:04:11.694441Z" 2024-09-12T01:04:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T01:04:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T01:04:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2024-09-12T01:04:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2024-09-12T01:04:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2024-09-12T01:04:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2024-09-12T01:04:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2024-09-12T01:04:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2024-09-12T01:04:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2024-09-12T01:04:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:11.703 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2024-09-12T01:04:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:11.704 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:11.705 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2024-09-12T01:04:11.705 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "rgw", 2024-09-12T01:04:11.705 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [], 2024-09-12T01:04:11.705 INFO:teuthology.orchestra.run.smithi062.stdout: "account_id": "", 2024-09-12T01:04:11.705 INFO:teuthology.orchestra.run.smithi062.stdout: "path": "/", 2024-09-12T01:04:11.705 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T01:04:11.694423Z", 2024-09-12T01:04:11.705 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T01:04:11.705 INFO:teuthology.orchestra.run.smithi062.stdout: "group_ids": [] 2024-09-12T01:04:11.705 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:04:11.706 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:11.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.703+0000 7f41177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:11.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.705+0000 7f4263517800 20 remove_watcher() i=0 2024-09-12T01:04:11.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.705+0000 7f4263517800 2 removed watcher, disabling cache 2024-09-12T01:04:11.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.707+0000 7f4263517800 20 remove_watcher() i=1 2024-09-12T01:04:11.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.708+0000 7f4263517800 20 remove_watcher() i=2 2024-09-12T01:04:11.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.709+0000 7f4263517800 20 remove_watcher() i=3 2024-09-12T01:04:11.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.710+0000 7f4263517800 20 remove_watcher() i=4 2024-09-12T01:04:11.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.711+0000 7f4263517800 20 remove_watcher() i=5 2024-09-12T01:04:11.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.712+0000 7f4263517800 20 remove_watcher() i=6 2024-09-12T01:04:11.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.713+0000 7f4263517800 20 remove_watcher() i=7 2024-09-12T01:04:11.724 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 5934427073 --totp-seed W7AANKWW2ISV7ASGC2TC57JNOVLYO2ZWQHQYE76WY2KF6BPSM7FFNWD47FGFGU22 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:04:11.792 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:11.792 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:11.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.829+0000 7f72e4146800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.831+0000 7f72e4146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.831+0000 7f72e4146800 20 realm 2024-09-12T01:04:11.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.831+0000 7f72e4146800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.831+0000 7f72e4146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.831+0000 7f72e4146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:11.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.832+0000 7f72e4146800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.832+0000 7f72e4146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.832+0000 7f72e4146800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.832+0000 7f72e4146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:11.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.832+0000 7f72e4146800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.833+0000 7f72e4146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:11.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.833+0000 7f72e4146800 20 searching for the correct realm 2024-09-12T01:04:11.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.837+0000 7f72e142f640 0 -- 172.21.15.62:0/2967200499 >> [v2:172.21.15.62:6808/741930476,v1:172.21.15.62:6809/741930476] conn(0x56338d490850 msgr2=0x56338d492c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:11.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.840+0000 7f72e1c30640 0 -- 172.21.15.62:0/2967200499 >> [v2:172.21.15.62:6816/3104025159,v1:172.21.15.62:6817/3104025159] conn(0x56338d48cf50 msgr2=0x56338d48f380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:11.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.844+0000 7f72e4146800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:11.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.844+0000 7f72e4146800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:11.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.844+0000 7f72e4146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:11.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.844+0000 7f72e4146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:11.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.844+0000 7f72e4146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:11.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.844+0000 7f72e4146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:11.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.844+0000 7f72e4146800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.844+0000 7f72e4146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.844+0000 7f72e4146800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.844+0000 7f72e4146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:11.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.844+0000 7f72e4146800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.845+0000 7f72e4146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:11.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.845+0000 7f72e4146800 20 zone default found 2024-09-12T01:04:11.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.845+0000 7f72e4146800 4 Realm: () 2024-09-12T01:04:11.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.845+0000 7f72e4146800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:11.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.845+0000 7f72e4146800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:11.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.845+0000 7f72e4146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:11.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.845+0000 7f72e4146800 20 zonegroup default 2024-09-12T01:04:11.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.845+0000 7f72e4146800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.845+0000 7f72e4146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.845+0000 7f72e4146800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.845+0000 7f72e4146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.845+0000 7f72e4146800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.846+0000 7f72e4146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:11.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.846+0000 7f72e4146800 20 started sync module instance, tier type = 2024-09-12T01:04:11.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.846+0000 7f72e4146800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:11.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.855+0000 7f72e4146800 20 add_watcher() i=0 2024-09-12T01:04:11.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.855+0000 7f72e4146800 20 add_watcher() i=1 2024-09-12T01:04:11.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.855+0000 7f72e4146800 20 add_watcher() i=2 2024-09-12T01:04:11.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.855+0000 7f72e4146800 20 add_watcher() i=3 2024-09-12T01:04:11.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.855+0000 7f72e4146800 20 add_watcher() i=4 2024-09-12T01:04:11.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.855+0000 7f72e4146800 20 add_watcher() i=5 2024-09-12T01:04:11.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.855+0000 7f72e4146800 20 add_watcher() i=6 2024-09-12T01:04:11.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.856+0000 7f72e4146800 20 add_watcher() i=7 2024-09-12T01:04:11.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.856+0000 7f72e4146800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:11.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.858+0000 7f71937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:11.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.858+0000 7f72e4146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:11.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.858+0000 7f72e4146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:11.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.858+0000 7f72e4146800 5 note: GC not initialized 2024-09-12T01:04:11.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.858+0000 7f71927fc640 20 reqs_thread_entry: start 2024-09-12T01:04:11.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.858+0000 7f72e4146800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:11.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.859+0000 7f72e4146800 20 Filter name: none 2024-09-12T01:04:11.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.859+0000 7f7103fff640 20 reqs_thread_entry: start 2024-09-12T01:04:11.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.859+0000 7f72e4146800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T01:04:11.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.859+0000 7f72e4146800 20 rados->read ofs=0 len=0 2024-09-12T01:04:11.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.859+0000 7f72e4146800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T01:04:11.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.859+0000 7f72e4146800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T01:04:11.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.859+0000 7f72e4146800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:04:11.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:11.859+0000 7f72e4146800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:13.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.471+0000 7f72e4146800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:04:13.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.471+0000 7f72e4146800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:04:13.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.471+0000 7f72e4146800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T01:04:13.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.472+0000 7f71c57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366236 cookie 94779413687232 notifier 9006 bl.length()=659 2024-09-12T01:04:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.472+0000 7f71c57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:04:13.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.472+0000 7f71c57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:04:13.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.475+0000 7f71937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:13.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.478+0000 7f72e4146800 20 remove_watcher() i=0 2024-09-12T01:04:13.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.478+0000 7f72e4146800 2 removed watcher, disabling cache 2024-09-12T01:04:13.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.479+0000 7f72e4146800 20 remove_watcher() i=1 2024-09-12T01:04:13.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.481+0000 7f72e4146800 20 remove_watcher() i=2 2024-09-12T01:04:13.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.482+0000 7f72e4146800 20 remove_watcher() i=3 2024-09-12T01:04:13.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.483+0000 7f72e4146800 20 remove_watcher() i=4 2024-09-12T01:04:13.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.484+0000 7f72e4146800 20 remove_watcher() i=5 2024-09-12T01:04:13.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.486+0000 7f72e4146800 20 remove_watcher() i=6 2024-09-12T01:04:13.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.487+0000 7f72e4146800 20 remove_watcher() i=7 2024-09-12T01:04:13.499 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T01:04:13.500 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key AFCCOPZCXYVGOKECECGW --secret Fw3O9bxkXSIRuAc+jCJwX9uoCWFib3rQFCKAPUAwn7UFucLNK8S95A== --cluster ceph 2024-09-12T01:04:13.569 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:13.569 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:13.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.608+0000 7ffa09e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.609+0000 7ffa09e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.609+0000 7ffa09e2f800 20 realm 2024-09-12T01:04:13.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.609+0000 7ffa09e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.609+0000 7ffa09e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.609+0000 7ffa09e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:13.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.609+0000 7ffa09e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.609+0000 7ffa09e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.609+0000 7ffa09e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.610+0000 7ffa09e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:13.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.610+0000 7ffa09e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.611+0000 7ffa09e2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:13.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.611+0000 7ffa09e2f800 20 searching for the correct realm 2024-09-12T01:04:13.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.614+0000 7ffa07118640 0 -- 172.21.15.62:0/3534586244 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7ffa0007d910 msgr2=0x7ffa000543c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:13.819 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.820+0000 7ffa0811a640 0 -- 172.21.15.62:0/3534586244 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55d49c3f2da0 msgr2=0x55d49c3f5260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:13.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.824+0000 7ffa09e2f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:13.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.824+0000 7ffa09e2f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:13.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.824+0000 7ffa09e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:13.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.824+0000 7ffa09e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:13.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.824+0000 7ffa09e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:13.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.824+0000 7ffa09e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.824+0000 7ffa09e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.824+0000 7ffa09e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.824+0000 7ffa09e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.825+0000 7ffa09e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.825+0000 7ffa09e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.825+0000 7ffa09e2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.825+0000 7ffa09e2f800 20 zone default found 2024-09-12T01:04:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.825+0000 7ffa09e2f800 4 Realm: () 2024-09-12T01:04:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.825+0000 7ffa09e2f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.825+0000 7ffa09e2f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.825+0000 7ffa09e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:13.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.825+0000 7ffa09e2f800 20 zonegroup default 2024-09-12T01:04:13.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.825+0000 7ffa09e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.825+0000 7ffa09e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.825+0000 7ffa09e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.826+0000 7ffa09e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.826+0000 7ffa09e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.826+0000 7ffa09e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.826+0000 7ffa09e2f800 20 started sync module instance, tier type = 2024-09-12T01:04:13.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.826+0000 7ffa09e2f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:13.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.835+0000 7ffa09e2f800 20 add_watcher() i=0 2024-09-12T01:04:13.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.835+0000 7ffa09e2f800 20 add_watcher() i=1 2024-09-12T01:04:13.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.835+0000 7ffa09e2f800 20 add_watcher() i=2 2024-09-12T01:04:13.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.835+0000 7ffa09e2f800 20 add_watcher() i=3 2024-09-12T01:04:13.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.835+0000 7ffa09e2f800 20 add_watcher() i=4 2024-09-12T01:04:13.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.835+0000 7ffa09e2f800 20 add_watcher() i=5 2024-09-12T01:04:13.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.835+0000 7ffa09e2f800 20 add_watcher() i=6 2024-09-12T01:04:13.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.836+0000 7ffa09e2f800 20 add_watcher() i=7 2024-09-12T01:04:13.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.836+0000 7ffa09e2f800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:13.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.838+0000 7ff8bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:13.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.839+0000 7ffa09e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:13.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.839+0000 7ffa09e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:13.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.839+0000 7ffa09e2f800 5 note: GC not initialized 2024-09-12T01:04:13.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.839+0000 7ff8bcfe1640 20 reqs_thread_entry: start 2024-09-12T01:04:13.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.839+0000 7ffa09e2f800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:13.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.839+0000 7ffa09e2f800 20 Filter name: none 2024-09-12T01:04:13.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.839+0000 7ff8367fc640 20 reqs_thread_entry: start 2024-09-12T01:04:13.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.839+0000 7ffa09e2f800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T01:04:13.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.839+0000 7ffa09e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.839+0000 7ffa09e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.839+0000 7ffa09e2f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T01:04:13.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.839+0000 7ffa09e2f800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:04:13.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.839+0000 7ffa09e2f800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T01:04:13.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.839+0000 7ffa09e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.840+0000 7ffa09e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.840+0000 7ffa09e2f800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T01:04:13.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.840+0000 7ffa09e2f800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T01:04:13.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.840+0000 7ffa09e2f800 10 cache get: name=default.rgw.meta+users.keys+AFCCOPZCXYVGOKECECGW : miss 2024-09-12T01:04:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.840+0000 7ffa09e2f800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.840+0000 7ffa09e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.840+0000 7ffa09e2f800 10 cache put: name=default.rgw.meta+users.keys+AFCCOPZCXYVGOKECECGW info.flags=0x0 2024-09-12T01:04:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.840+0000 7ffa09e2f800 10 adding default.rgw.meta+users.keys+AFCCOPZCXYVGOKECECGW to cache LRU end 2024-09-12T01:04:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.840+0000 7ffa09e2f800 10 cache get: name=default.rgw.meta+users.keys+AFCCOPZCXYVGOKECECGW : hit (negative entry) 2024-09-12T01:04:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.840+0000 7ffa09e2f800 10 cache get: name=default.rgw.meta+users.keys+AFCCOPZCXYVGOKECECGW : hit (negative entry) 2024-09-12T01:04:13.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.841+0000 7ffa09e2f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:04:13.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.841+0000 7ffa09e2f800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:04:13.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.841+0000 7ffa09e2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T01:04:13.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.842+0000 7ff8e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366409 cookie 94371642880160 notifier 9024 bl.length()=645 2024-09-12T01:04:13.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.842+0000 7ff8e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:04:13.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.842+0000 7ff8e6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:04:13.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.845+0000 7ffa09e2f800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T01:04:13.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.845+0000 7ffa09e2f800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T01:04:13.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.845+0000 7ffa09e2f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T01:04:13.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.845+0000 7ff8e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366423 cookie 94371642883712 notifier 9024 bl.length()=185 2024-09-12T01:04:13.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.845+0000 7ff8e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T01:04:13.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.845+0000 7ff8e6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T01:04:13.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.848+0000 7ffa09e2f800 10 cache put: name=default.rgw.meta+users.keys+AFCCOPZCXYVGOKECECGW info.flags=0x7 2024-09-12T01:04:13.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.848+0000 7ffa09e2f800 10 moving default.rgw.meta+users.keys+AFCCOPZCXYVGOKECECGW to cache LRU end 2024-09-12T01:04:13.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.848+0000 7ffa09e2f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:AFCCOPZCXYVGOKECECGW, ofs0, ns] 2024-09-12T01:04:13.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.848+0000 7ff8e67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366410 cookie 94371642880160 notifier 9024 bl.length()=186 2024-09-12T01:04:13.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.848+0000 7ff8e67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+AFCCOPZCXYVGOKECECGW info.flags=0x7 2024-09-12T01:04:13.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.848+0000 7ff8e67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+AFCCOPZCXYVGOKECECGW to cache LRU end 2024-09-12T01:04:13.849 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:04:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "bar.client.0", 2024-09-12T01:04:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T01:04:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "bar+test@test.test", 2024-09-12T01:04:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2024-09-12T01:04:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2024-09-12T01:04:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2024-09-12T01:04:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2024-09-12T01:04:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T01:04:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "bar.client.0", 2024-09-12T01:04:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "AFCCOPZCXYVGOKECECGW", 2024-09-12T01:04:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "Fw3O9bxkXSIRuAc+jCJwX9uoCWFib3rQFCKAPUAwn7UFucLNK8S95A==", 2024-09-12T01:04:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: "active": true, 2024-09-12T01:04:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T01:04:13.841508Z" 2024-09-12T01:04:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T01:04:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T01:04:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2024-09-12T01:04:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2024-09-12T01:04:13.850 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2024-09-12T01:04:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2024-09-12T01:04:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2024-09-12T01:04:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2024-09-12T01:04:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2024-09-12T01:04:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2024-09-12T01:04:13.851 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2024-09-12T01:04:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "rgw", 2024-09-12T01:04:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [], 2024-09-12T01:04:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "account_id": "", 2024-09-12T01:04:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "path": "/", 2024-09-12T01:04:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T01:04:13.841498Z", 2024-09-12T01:04:13.852 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T01:04:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: "group_ids": [] 2024-09-12T01:04:13.853 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:04:13.853 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:13.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.850+0000 7ff8bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:13.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.853+0000 7ffa09e2f800 20 remove_watcher() i=0 2024-09-12T01:04:13.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.853+0000 7ffa09e2f800 2 removed watcher, disabling cache 2024-09-12T01:04:13.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.854+0000 7ffa09e2f800 20 remove_watcher() i=1 2024-09-12T01:04:13.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.855+0000 7ffa09e2f800 20 remove_watcher() i=2 2024-09-12T01:04:13.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.856+0000 7ffa09e2f800 20 remove_watcher() i=3 2024-09-12T01:04:13.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.857+0000 7ffa09e2f800 20 remove_watcher() i=4 2024-09-12T01:04:13.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.858+0000 7ffa09e2f800 20 remove_watcher() i=5 2024-09-12T01:04:13.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.859+0000 7ffa09e2f800 20 remove_watcher() i=6 2024-09-12T01:04:13.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.860+0000 7ffa09e2f800 20 remove_watcher() i=7 2024-09-12T01:04:13.871 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 9745015347 --totp-seed I6MYUCNQV6LM735JVMTAW7LA36QQEXCHMXBJSPFIY74L75ADERKFT7XV2HYLS5QK --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:04:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:13.939 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:13.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.976+0000 7f6428925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.977+0000 7f6428925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.977+0000 7f6428925800 20 realm 2024-09-12T01:04:13.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.977+0000 7f6428925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.977+0000 7f6428925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.977+0000 7f6428925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:13.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.977+0000 7f6428925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.977+0000 7f6428925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:13.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.977+0000 7f6428925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.978+0000 7f6428925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:13.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.978+0000 7f6428925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:13.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.979+0000 7f6428925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:13.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.979+0000 7f6428925800 20 searching for the correct realm 2024-09-12T01:04:13.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:13.982+0000 7f6423d32640 0 -- 172.21.15.62:0/1172979859 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f641c0604f0 msgr2=0x7f641c001810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:14.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.187+0000 7f6424d34640 0 -- 172.21.15.62:0/1172979859 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x56314131b630 msgr2=0x56314131dad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:14.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.191+0000 7f6428925800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:14.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.191+0000 7f6428925800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:14.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.191+0000 7f6428925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:14.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.191+0000 7f6428925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:14.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.191+0000 7f6428925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:14.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.191+0000 7f6428925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:14.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.191+0000 7f6428925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.191+0000 7f6428925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.191+0000 7f6428925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.192+0000 7f6428925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:14.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.192+0000 7f6428925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.192+0000 7f6428925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.192+0000 7f6428925800 20 zone default found 2024-09-12T01:04:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.192+0000 7f6428925800 4 Realm: () 2024-09-12T01:04:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.192+0000 7f6428925800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.192+0000 7f6428925800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.192+0000 7f6428925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.192+0000 7f6428925800 20 zonegroup default 2024-09-12T01:04:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.192+0000 7f6428925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.192+0000 7f6428925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.192+0000 7f6428925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.193+0000 7f6428925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.193+0000 7f6428925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.193+0000 7f6428925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.193+0000 7f6428925800 20 started sync module instance, tier type = 2024-09-12T01:04:14.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.193+0000 7f6428925800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:14.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.203+0000 7f6428925800 20 add_watcher() i=0 2024-09-12T01:04:14.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.203+0000 7f6428925800 20 add_watcher() i=1 2024-09-12T01:04:14.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.203+0000 7f6428925800 20 add_watcher() i=2 2024-09-12T01:04:14.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.203+0000 7f6428925800 20 add_watcher() i=3 2024-09-12T01:04:14.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.203+0000 7f6428925800 20 add_watcher() i=4 2024-09-12T01:04:14.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.203+0000 7f6428925800 20 add_watcher() i=5 2024-09-12T01:04:14.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.203+0000 7f6428925800 20 add_watcher() i=6 2024-09-12T01:04:14.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.205+0000 7f6428925800 20 add_watcher() i=7 2024-09-12T01:04:14.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.205+0000 7f6428925800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:14.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.207+0000 7f62da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:14.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.207+0000 7f6428925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:14.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.207+0000 7f6428925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.207+0000 7f6428925800 5 note: GC not initialized 2024-09-12T01:04:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.207+0000 7f62d97e2640 20 reqs_thread_entry: start 2024-09-12T01:04:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.207+0000 7f6428925800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.207+0000 7f6428925800 20 Filter name: none 2024-09-12T01:04:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.207+0000 7f624affd640 20 reqs_thread_entry: start 2024-09-12T01:04:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.207+0000 7f6428925800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T01:04:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.207+0000 7f6428925800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.208+0000 7f6428925800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T01:04:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.208+0000 7f6428925800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T01:04:14.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.208+0000 7f6428925800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:04:14.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.208+0000 7f6428925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:14.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.210+0000 7f6428925800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:04:14.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.211+0000 7f6428925800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:04:14.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.211+0000 7f6428925800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T01:04:14.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.211+0000 7f63037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366411 cookie 94769547229152 notifier 9045 bl.length()=659 2024-09-12T01:04:14.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.211+0000 7f63037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:04:14.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.211+0000 7f63037fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:04:14.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.213+0000 7f62da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:14.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.216+0000 7f6428925800 20 remove_watcher() i=0 2024-09-12T01:04:14.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.216+0000 7f6428925800 2 removed watcher, disabling cache 2024-09-12T01:04:14.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.217+0000 7f6428925800 20 remove_watcher() i=1 2024-09-12T01:04:14.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.218+0000 7f6428925800 20 remove_watcher() i=2 2024-09-12T01:04:14.218 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.219+0000 7f6428925800 20 remove_watcher() i=3 2024-09-12T01:04:14.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.220+0000 7f6428925800 20 remove_watcher() i=4 2024-09-12T01:04:14.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.221+0000 7f6428925800 20 remove_watcher() i=5 2024-09-12T01:04:14.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.222+0000 7f6428925800 20 remove_watcher() i=6 2024-09-12T01:04:14.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.223+0000 7f6428925800 20 remove_watcher() i=7 2024-09-12T01:04:14.234 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-12T01:04:14.298 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:14.298 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:14.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.334+0000 7f90ae946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.335+0000 7f90ae946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.335+0000 7f90ae946800 20 realm 2024-09-12T01:04:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.335+0000 7f90ae946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.335+0000 7f90ae946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.335+0000 7f90ae946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.335+0000 7f90ae946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.336+0000 7f90ae946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.336+0000 7f90ae946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.336+0000 7f90ae946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:14.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.336+0000 7f90ae946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.337+0000 7f90ae946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:14.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.337+0000 7f90ae946800 20 searching for the correct realm 2024-09-12T01:04:14.339 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.340+0000 7f90abc2f640 0 -- 172.21.15.62:0/416644667 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f90a402d900 msgr2=0x7f90a400e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:14.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.554+0000 7f90acc31640 0 -- 172.21.15.62:0/416644667 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55a2c7767f40 msgr2=0x55a2c776a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.559+0000 7f90ae946800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.559+0000 7f90ae946800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.559+0000 7f90ae946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.559+0000 7f90ae946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.559+0000 7f90ae946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.559+0000 7f90ae946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.559+0000 7f90ae946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.560+0000 7f90ae946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.560+0000 7f90ae946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.560+0000 7f90ae946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:14.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.560+0000 7f90ae946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.560+0000 7f90ae946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.560+0000 7f90ae946800 20 zone default found 2024-09-12T01:04:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.560+0000 7f90ae946800 4 Realm: () 2024-09-12T01:04:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.560+0000 7f90ae946800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.560+0000 7f90ae946800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.560+0000 7f90ae946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.560+0000 7f90ae946800 20 zonegroup default 2024-09-12T01:04:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.560+0000 7f90ae946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.561+0000 7f90ae946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.561+0000 7f90ae946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.561+0000 7f90ae946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.561+0000 7f90ae946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.561+0000 7f90ae946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.561+0000 7f90ae946800 20 started sync module instance, tier type = 2024-09-12T01:04:14.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.561+0000 7f90ae946800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:14.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.571+0000 7f90ae946800 20 add_watcher() i=0 2024-09-12T01:04:14.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.571+0000 7f90ae946800 20 add_watcher() i=1 2024-09-12T01:04:14.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.571+0000 7f90ae946800 20 add_watcher() i=2 2024-09-12T01:04:14.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.571+0000 7f90ae946800 20 add_watcher() i=3 2024-09-12T01:04:14.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.571+0000 7f90ae946800 20 add_watcher() i=4 2024-09-12T01:04:14.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.571+0000 7f90ae946800 20 add_watcher() i=5 2024-09-12T01:04:14.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.571+0000 7f90ae946800 20 add_watcher() i=6 2024-09-12T01:04:14.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.572+0000 7f90ae946800 20 add_watcher() i=7 2024-09-12T01:04:14.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.572+0000 7f90ae946800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:14.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.573+0000 7f8f62fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:14.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.573+0000 7f90ae946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:14.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.573+0000 7f90ae946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:14.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.574+0000 7f90ae946800 5 note: GC not initialized 2024-09-12T01:04:14.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.574+0000 7f8f61fe3640 20 reqs_thread_entry: start 2024-09-12T01:04:14.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.574+0000 7f90ae946800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:14.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.574+0000 7f90ae946800 20 Filter name: none 2024-09-12T01:04:14.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.574+0000 7f8f5affd640 20 reqs_thread_entry: start 2024-09-12T01:04:14.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.574+0000 7f90ae946800 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-12T01:04:14.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.574+0000 7f90ae946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.575+0000 7f90ae946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.575+0000 7f90ae946800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-12T01:04:14.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.575+0000 7f90ae946800 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T01:04:14.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.575+0000 7f90ae946800 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-12T01:04:14.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.575+0000 7f90ae946800 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-12T01:04:14.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.575+0000 7f90ae946800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.575+0000 7f90ae946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.575+0000 7f90ae946800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-12T01:04:14.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.575+0000 7f90ae946800 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T01:04:14.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.575+0000 7f90ae946800 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-12T01:04:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.576+0000 7f90ae946800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T01:04:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.576+0000 7f90ae946800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T01:04:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.576+0000 7f90ae946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-12T01:04:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.576+0000 7f8f837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333708 cookie 94157619504160 notifier 9063 bl.length()=389 2024-09-12T01:04:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.576+0000 7f8f837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T01:04:14.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.576+0000 7f8f837fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T01:04:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.579+0000 7f90ae946800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T01:04:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.579+0000 7f90ae946800 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T01:04:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.579+0000 7f90ae946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-12T01:04:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.580+0000 7f8f837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333709 cookie 94157619568992 notifier 9063 bl.length()=230 2024-09-12T01:04:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.580+0000 7f8f837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-12T01:04:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.580+0000 7f8f837fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-12T01:04:14.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.582+0000 7f90ae946800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T01:04:14.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.582+0000 7f90ae946800 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T01:04:14.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.582+0000 7f90ae946800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-12T01:04:14.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.583+0000 7f8f837fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333554 cookie 94157619566240 notifier 9063 bl.length()=234 2024-09-12T01:04:14.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.583+0000 7f8f837fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-12T01:04:14.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.583+0000 7f8f837fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-12T01:04:14.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.586+0000 7f8f62fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:14.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.588+0000 7f90ae946800 20 remove_watcher() i=0 2024-09-12T01:04:14.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.588+0000 7f90ae946800 2 removed watcher, disabling cache 2024-09-12T01:04:14.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.589+0000 7f90ae946800 20 remove_watcher() i=1 2024-09-12T01:04:14.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.590+0000 7f90ae946800 20 remove_watcher() i=2 2024-09-12T01:04:14.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.591+0000 7f90ae946800 20 remove_watcher() i=3 2024-09-12T01:04:14.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.592+0000 7f90ae946800 20 remove_watcher() i=4 2024-09-12T01:04:14.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.593+0000 7f90ae946800 20 remove_watcher() i=5 2024-09-12T01:04:14.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.594+0000 7f90ae946800 20 remove_watcher() i=6 2024-09-12T01:04:14.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.595+0000 7f90ae946800 20 remove_watcher() i=7 2024-09-12T01:04:14.604 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:04:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: "id": "RGW33333333333333333", 2024-09-12T01:04:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: "tenant": "testx", 2024-09-12T01:04:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "Mr.RGW33333333333333333", 2024-09-12T01:04:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-12T01:04:14.604 INFO:teuthology.orchestra.run.smithi062.stdout: "quota": { 2024-09-12T01:04:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2024-09-12T01:04:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:14.605 INFO:teuthology.orchestra.run.smithi062.stdout: "max_users": 1000, 2024-09-12T01:04:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: "max_roles": 1000, 2024-09-12T01:04:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: "max_groups": 1000, 2024-09-12T01:04:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2024-09-12T01:04:14.606 INFO:teuthology.orchestra.run.smithi062.stdout: "max_access_keys": 4 2024-09-12T01:04:14.606 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:04:14.607 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-12T01:04:14.607 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key CYCSNRZLUCYOENTNGXRC --secret 5mMeU5MQus6Vbe6QNfoHKJtRCY+9zG4hv/kMDxxTCze+2aaDfqITDg== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-12T01:04:14.676 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:14.677 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:14.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.713+0000 7f0a1192e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.715+0000 7f0a1192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.715+0000 7f0a1192e800 20 realm 2024-09-12T01:04:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.715+0000 7f0a1192e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.715+0000 7f0a1192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.715+0000 7f0a1192e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.715+0000 7f0a1192e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.715+0000 7f0a1192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.715+0000 7f0a1192e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.716+0000 7f0a1192e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:14.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.716+0000 7f0a1192e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:14.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.717+0000 7f0a1192e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:14.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.717+0000 7f0a1192e800 20 searching for the correct realm 2024-09-12T01:04:14.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.720+0000 7f0a0cedc640 0 -- 172.21.15.62:0/374776332 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f0a08066260 msgr2=0x7f0a0806c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:14.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.926+0000 7f0a0cedc640 0 -- 172.21.15.62:0/374776332 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x563c0f1d43b0 msgr2=0x563c0f1d6820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:15.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.931+0000 7f0a1192e800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:15.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.931+0000 7f0a1192e800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:15.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.931+0000 7f0a1192e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:15.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.931+0000 7f0a1192e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:15.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.931+0000 7f0a1192e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:15.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.931+0000 7f0a1192e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:15.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.931+0000 7f0a1192e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.931+0000 7f0a1192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.931+0000 7f0a1192e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.931+0000 7f0a1192e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:15.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.931+0000 7f0a1192e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.932+0000 7f0a1192e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:15.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.932+0000 7f0a1192e800 20 zone default found 2024-09-12T01:04:15.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.932+0000 7f0a1192e800 4 Realm: () 2024-09-12T01:04:15.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.932+0000 7f0a1192e800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:15.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.932+0000 7f0a1192e800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:15.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.932+0000 7f0a1192e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:15.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.932+0000 7f0a1192e800 20 zonegroup default 2024-09-12T01:04:15.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.932+0000 7f0a1192e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.932+0000 7f0a1192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.932+0000 7f0a1192e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.932+0000 7f0a1192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.932+0000 7f0a1192e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.933+0000 7f0a1192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.933+0000 7f0a1192e800 20 started sync module instance, tier type = 2024-09-12T01:04:15.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.933+0000 7f0a1192e800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:15.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.943+0000 7f0a1192e800 20 add_watcher() i=0 2024-09-12T01:04:15.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.943+0000 7f0a1192e800 20 add_watcher() i=1 2024-09-12T01:04:15.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.943+0000 7f0a1192e800 20 add_watcher() i=2 2024-09-12T01:04:15.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.943+0000 7f0a1192e800 20 add_watcher() i=3 2024-09-12T01:04:15.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.943+0000 7f0a1192e800 20 add_watcher() i=4 2024-09-12T01:04:15.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.943+0000 7f0a1192e800 20 add_watcher() i=5 2024-09-12T01:04:15.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.943+0000 7f0a1192e800 20 add_watcher() i=6 2024-09-12T01:04:15.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.944+0000 7f0a1192e800 20 add_watcher() i=7 2024-09-12T01:04:15.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.944+0000 7f0a1192e800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.946+0000 7f08c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.946+0000 7f0a1192e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.946+0000 7f0a1192e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.946+0000 7f0a1192e800 5 note: GC not initialized 2024-09-12T01:04:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.946+0000 7f08c27e4640 20 reqs_thread_entry: start 2024-09-12T01:04:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.946+0000 7f0a1192e800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.946+0000 7f0a1192e800 20 Filter name: none 2024-09-12T01:04:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.946+0000 7f0833fff640 20 reqs_thread_entry: start 2024-09-12T01:04:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.946+0000 7f0a1192e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T01:04:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.946+0000 7f0a1192e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.947+0000 7f0a1192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.947+0000 7f0a1192e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T01:04:15.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.947+0000 7f0a1192e800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:04:15.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.947+0000 7f0a1192e800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T01:04:15.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.947+0000 7f0a1192e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.947+0000 7f0a1192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.947+0000 7f0a1192e800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T01:04:15.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.947+0000 7f0a1192e800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T01:04:15.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.947+0000 7f0a1192e800 10 cache get: name=default.rgw.meta+users.keys+CYCSNRZLUCYOENTNGXRC : miss 2024-09-12T01:04:15.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.947+0000 7f0a1192e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.947+0000 7f0a1192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.947+0000 7f0a1192e800 10 cache put: name=default.rgw.meta+users.keys+CYCSNRZLUCYOENTNGXRC info.flags=0x0 2024-09-12T01:04:15.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.947+0000 7f0a1192e800 10 adding default.rgw.meta+users.keys+CYCSNRZLUCYOENTNGXRC to cache LRU end 2024-09-12T01:04:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.947+0000 7f0a1192e800 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-12T01:04:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.947+0000 7f0a1192e800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.948+0000 7f0a1192e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T01:04:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.948+0000 7f0a1192e800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-12T01:04:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.948+0000 7f0a1192e800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-12T01:04:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.948+0000 7f0a1192e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.948+0000 7f0a1192e800 10 cache get: name=default.rgw.meta+users.keys+CYCSNRZLUCYOENTNGXRC : hit (negative entry) 2024-09-12T01:04:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.948+0000 7f0a1192e800 10 cache get: name=default.rgw.meta+users.keys+CYCSNRZLUCYOENTNGXRC : hit (negative entry) 2024-09-12T01:04:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.950+0000 7f0a1192e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:04:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.950+0000 7f0a1192e800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:04:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.950+0000 7f0a1192e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T01:04:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.950+0000 7f08f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333720 cookie 94815951678304 notifier 9084 bl.length()=732 2024-09-12T01:04:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.950+0000 7f08f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:04:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.950+0000 7f08f0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:04:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.953+0000 7f0a1192e800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T01:04:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.953+0000 7f0a1192e800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T01:04:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.953+0000 7f0a1192e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T01:04:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.954+0000 7f08f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333721 cookie 94815951685792 notifier 9084 bl.length()=215 2024-09-12T01:04:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.954+0000 7f08f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T01:04:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.954+0000 7f08f0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T01:04:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.956+0000 7f0a1192e800 10 cache put: name=default.rgw.meta+users.keys+CYCSNRZLUCYOENTNGXRC info.flags=0x7 2024-09-12T01:04:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.956+0000 7f0a1192e800 10 moving default.rgw.meta+users.keys+CYCSNRZLUCYOENTNGXRC to cache LRU end 2024-09-12T01:04:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.956+0000 7f0a1192e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:CYCSNRZLUCYOENTNGXRC, ofs0, ns] 2024-09-12T01:04:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.957+0000 7f08f0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333722 cookie 94815951683072 notifier 9084 bl.length()=201 2024-09-12T01:04:15.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.957+0000 7f08f0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CYCSNRZLUCYOENTNGXRC info.flags=0x7 2024-09-12T01:04:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.957+0000 7f08f0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CYCSNRZLUCYOENTNGXRC to cache LRU end 2024-09-12T01:04:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.959+0000 7f0a1192e800 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-12T01:04:15.043 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:04:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T01:04:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-12T01:04:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T01:04:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2024-09-12T01:04:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2024-09-12T01:04:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2024-09-12T01:04:15.043 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2024-09-12T01:04:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T01:04:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T01:04:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "CYCSNRZLUCYOENTNGXRC", 2024-09-12T01:04:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "5mMeU5MQus6Vbe6QNfoHKJtRCY+9zG4hv/kMDxxTCze+2aaDfqITDg==", 2024-09-12T01:04:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "active": true, 2024-09-12T01:04:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T01:04:14.949467Z" 2024-09-12T01:04:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T01:04:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T01:04:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2024-09-12T01:04:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2024-09-12T01:04:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2024-09-12T01:04:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2024-09-12T01:04:15.044 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2024-09-12T01:04:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2024-09-12T01:04:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2024-09-12T01:04:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2024-09-12T01:04:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:15.045 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2024-09-12T01:04:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "root", 2024-09-12T01:04:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [], 2024-09-12T01:04:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "account_id": "RGW33333333333333333", 2024-09-12T01:04:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "path": "/", 2024-09-12T01:04:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T01:04:14.949453Z", 2024-09-12T01:04:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T01:04:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: "group_ids": [] 2024-09-12T01:04:15.046 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:04:15.046 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.960+0000 7f08c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.962+0000 7f0a1192e800 20 remove_watcher() i=0 2024-09-12T01:04:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.962+0000 7f0a1192e800 2 removed watcher, disabling cache 2024-09-12T01:04:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.963+0000 7f0a1192e800 20 remove_watcher() i=1 2024-09-12T01:04:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.964+0000 7f0a1192e800 20 remove_watcher() i=2 2024-09-12T01:04:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.965+0000 7f0a1192e800 20 remove_watcher() i=3 2024-09-12T01:04:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.966+0000 7f0a1192e800 20 remove_watcher() i=4 2024-09-12T01:04:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.967+0000 7f0a1192e800 20 remove_watcher() i=5 2024-09-12T01:04:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.968+0000 7f0a1192e800 20 remove_watcher() i=6 2024-09-12T01:04:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:14.969+0000 7f0a1192e800 20 remove_watcher() i=7 2024-09-12T01:04:15.049 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 5118936749 --totp-seed 3N27JSGMT6564DCOQ5TPZYE2YFJYP6FUIUHMLHFZI6LWXU7KVBOOOQNGI3FLIUKW --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:04:15.117 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:15.117 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:15.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.154+0000 7f3776539800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.156+0000 7f3776539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.156+0000 7f3776539800 20 realm 2024-09-12T01:04:15.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.156+0000 7f3776539800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.156+0000 7f3776539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.156+0000 7f3776539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:15.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.156+0000 7f3776539800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.156+0000 7f3776539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.156+0000 7f3776539800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.157+0000 7f3776539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.157+0000 7f3776539800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.157+0000 7f3776539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:15.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.157+0000 7f3776539800 20 searching for the correct realm 2024-09-12T01:04:15.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.160+0000 7f37719c6640 0 -- 172.21.15.62:0/2652178263 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f376c01f420 msgr2=0x7f376c01f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:15.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.365+0000 7f37729c8640 0 -- 172.21.15.62:0/2652178263 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55892d4023e0 msgr2=0x55892d404830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.369+0000 7f3776539800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.369+0000 7f3776539800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.369+0000 7f3776539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.369+0000 7f3776539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.369+0000 7f3776539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.369+0000 7f3776539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.369+0000 7f3776539800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.370+0000 7f3776539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.370+0000 7f3776539800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.370+0000 7f3776539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:15.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.370+0000 7f3776539800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.370+0000 7f3776539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.370+0000 7f3776539800 20 zone default found 2024-09-12T01:04:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.370+0000 7f3776539800 4 Realm: () 2024-09-12T01:04:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.370+0000 7f3776539800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.370+0000 7f3776539800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.370+0000 7f3776539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.370+0000 7f3776539800 20 zonegroup default 2024-09-12T01:04:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.370+0000 7f3776539800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.370+0000 7f3776539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.371+0000 7f3776539800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.371+0000 7f3776539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.371+0000 7f3776539800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.371+0000 7f3776539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.371+0000 7f3776539800 20 started sync module instance, tier type = 2024-09-12T01:04:15.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.371+0000 7f3776539800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.380+0000 7f3776539800 20 add_watcher() i=0 2024-09-12T01:04:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.380+0000 7f3776539800 20 add_watcher() i=1 2024-09-12T01:04:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.380+0000 7f3776539800 20 add_watcher() i=2 2024-09-12T01:04:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.380+0000 7f3776539800 20 add_watcher() i=3 2024-09-12T01:04:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.380+0000 7f3776539800 20 add_watcher() i=4 2024-09-12T01:04:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.380+0000 7f3776539800 20 add_watcher() i=5 2024-09-12T01:04:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.380+0000 7f3776539800 20 add_watcher() i=6 2024-09-12T01:04:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.381+0000 7f3776539800 20 add_watcher() i=7 2024-09-12T01:04:15.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.381+0000 7f3776539800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.383+0000 7f3628fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.383+0000 7f3776539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.383+0000 7f3776539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.383+0000 7f3776539800 5 note: GC not initialized 2024-09-12T01:04:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.384+0000 7f35a37fe640 20 reqs_thread_entry: start 2024-09-12T01:04:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.384+0000 7f3776539800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:15.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.384+0000 7f3776539800 20 Filter name: none 2024-09-12T01:04:15.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.384+0000 7f35a17fa640 20 reqs_thread_entry: start 2024-09-12T01:04:15.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.384+0000 7f3776539800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T01:04:15.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.384+0000 7f3776539800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.385+0000 7f3776539800 20 rados_obj.operate() r=0 bl.length=532 2024-09-12T01:04:15.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.385+0000 7f3776539800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T01:04:15.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.385+0000 7f3776539800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:04:15.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.385+0000 7f3776539800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.388+0000 7f3776539800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:04:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.388+0000 7f3776539800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:04:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.388+0000 7f3776539800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T01:04:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.388+0000 7f3655ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333723 cookie 94047658134816 notifier 9102 bl.length()=746 2024-09-12T01:04:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.388+0000 7f3655ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:04:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.388+0000 7f3655ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:04:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.391+0000 7f3628fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:15.392 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.393+0000 7f3776539800 20 remove_watcher() i=0 2024-09-12T01:04:15.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.393+0000 7f3776539800 2 removed watcher, disabling cache 2024-09-12T01:04:15.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.395+0000 7f3776539800 20 remove_watcher() i=1 2024-09-12T01:04:15.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.396+0000 7f3776539800 20 remove_watcher() i=2 2024-09-12T01:04:15.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.397+0000 7f3776539800 20 remove_watcher() i=3 2024-09-12T01:04:15.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.398+0000 7f3776539800 20 remove_watcher() i=4 2024-09-12T01:04:15.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.399+0000 7f3776539800 20 remove_watcher() i=5 2024-09-12T01:04:15.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.400+0000 7f3776539800 20 remove_watcher() i=6 2024-09-12T01:04:15.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.401+0000 7f3776539800 20 remove_watcher() i=7 2024-09-12T01:04:15.412 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T01:04:15.412 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key ERKTORFXZYAMZFBDOVAY --secret tUqPZMMmc0fJdgGiiKu0TpplcqEoKiPSmRd0mlICi/BjEIvJr4mBqg== --cluster ceph 2024-09-12T01:04:15.479 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:15.479 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:15.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.515+0000 7fa72b698800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.517+0000 7fa72b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.517+0000 7fa72b698800 20 realm 2024-09-12T01:04:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.517+0000 7fa72b698800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.517+0000 7fa72b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.517+0000 7fa72b698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.517+0000 7fa72b698800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.517+0000 7fa72b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.517+0000 7fa72b698800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.518+0000 7fa72b698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:15.517 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.518+0000 7fa72b698800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.519+0000 7fa72b698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:15.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.519+0000 7fa72b698800 20 searching for the correct realm 2024-09-12T01:04:15.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.522+0000 7fa728981640 0 -- 172.21.15.62:0/180614496 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fa724061a60 msgr2=0x7fa724002a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:15.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.727+0000 7fa729983640 0 -- 172.21.15.62:0/180614496 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55bfbaf75af0 msgr2=0x55bfbaf77f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:15.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.731+0000 7fa72b698800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:15.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.731+0000 7fa72b698800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:15.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.731+0000 7fa72b698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.731+0000 7fa72b698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.731+0000 7fa72b698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.731+0000 7fa72b698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.731+0000 7fa72b698800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.731+0000 7fa72b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.731+0000 7fa72b698800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.732+0000 7fa72b698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:15.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.732+0000 7fa72b698800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.732+0000 7fa72b698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:15.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.732+0000 7fa72b698800 20 zone default found 2024-09-12T01:04:15.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.732+0000 7fa72b698800 4 Realm: () 2024-09-12T01:04:15.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.732+0000 7fa72b698800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:15.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.732+0000 7fa72b698800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:15.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.732+0000 7fa72b698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:15.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.732+0000 7fa72b698800 20 zonegroup default 2024-09-12T01:04:15.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.732+0000 7fa72b698800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.732+0000 7fa72b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.732+0000 7fa72b698800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.733+0000 7fa72b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.733+0000 7fa72b698800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.733+0000 7fa72b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.733+0000 7fa72b698800 20 started sync module instance, tier type = 2024-09-12T01:04:15.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.733+0000 7fa72b698800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:15.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.742+0000 7fa72b698800 20 add_watcher() i=0 2024-09-12T01:04:15.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.742+0000 7fa72b698800 20 add_watcher() i=1 2024-09-12T01:04:15.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.742+0000 7fa72b698800 20 add_watcher() i=2 2024-09-12T01:04:15.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.742+0000 7fa72b698800 20 add_watcher() i=3 2024-09-12T01:04:15.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.742+0000 7fa72b698800 20 add_watcher() i=4 2024-09-12T01:04:15.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.742+0000 7fa72b698800 20 add_watcher() i=5 2024-09-12T01:04:15.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.742+0000 7fa72b698800 20 add_watcher() i=6 2024-09-12T01:04:15.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.743+0000 7fa72b698800 20 add_watcher() i=7 2024-09-12T01:04:15.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.743+0000 7fa72b698800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:15.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.745+0000 7fa5df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:15.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.745+0000 7fa72b698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:15.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.745+0000 7fa72b698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:15.745 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.746+0000 7fa72b698800 5 note: GC not initialized 2024-09-12T01:04:15.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.746+0000 7fa5de7e4640 20 reqs_thread_entry: start 2024-09-12T01:04:15.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.746+0000 7fa72b698800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:15.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.746+0000 7fa72b698800 20 Filter name: none 2024-09-12T01:04:15.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.746+0000 7fa54ffff640 20 reqs_thread_entry: start 2024-09-12T01:04:15.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.746+0000 7fa72b698800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T01:04:15.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.746+0000 7fa72b698800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.747+0000 7fa72b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.747+0000 7fa72b698800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T01:04:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.747+0000 7fa72b698800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.747+0000 7fa72b698800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T01:04:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.747+0000 7fa72b698800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.747+0000 7fa72b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.747+0000 7fa72b698800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T01:04:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.747+0000 7fa72b698800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T01:04:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.747+0000 7fa72b698800 10 cache get: name=default.rgw.meta+users.keys+ERKTORFXZYAMZFBDOVAY : miss 2024-09-12T01:04:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.747+0000 7fa72b698800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.747+0000 7fa72b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.747+0000 7fa72b698800 10 cache put: name=default.rgw.meta+users.keys+ERKTORFXZYAMZFBDOVAY info.flags=0x0 2024-09-12T01:04:15.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.747+0000 7fa72b698800 10 adding default.rgw.meta+users.keys+ERKTORFXZYAMZFBDOVAY to cache LRU end 2024-09-12T01:04:15.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.747+0000 7fa72b698800 10 cache get: name=default.rgw.meta+users.keys+ERKTORFXZYAMZFBDOVAY : hit (negative entry) 2024-09-12T01:04:15.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.747+0000 7fa72b698800 10 cache get: name=default.rgw.meta+users.keys+ERKTORFXZYAMZFBDOVAY : hit (negative entry) 2024-09-12T01:04:15.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.749+0000 7fa72b698800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:04:15.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.749+0000 7fa72b698800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:15.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.749+0000 7fa72b698800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T01:04:15.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.749+0000 7fa60cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333724 cookie 94281963971936 notifier 8621 bl.length()=660 2024-09-12T01:04:15.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.749+0000 7fa60cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:04:15.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.749+0000 7fa60cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:15.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.752+0000 7fa72b698800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T01:04:15.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.752+0000 7fa72b698800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T01:04:15.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.752+0000 7fa72b698800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T01:04:15.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.752+0000 7fa60cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333710 cookie 94281963954176 notifier 8621 bl.length()=191 2024-09-12T01:04:15.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.752+0000 7fa60cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T01:04:15.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.752+0000 7fa60cff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T01:04:15.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.755+0000 7fa72b698800 10 cache put: name=default.rgw.meta+users.keys+ERKTORFXZYAMZFBDOVAY info.flags=0x7 2024-09-12T01:04:15.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.755+0000 7fa72b698800 10 moving default.rgw.meta+users.keys+ERKTORFXZYAMZFBDOVAY to cache LRU end 2024-09-12T01:04:15.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.755+0000 7fa72b698800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:ERKTORFXZYAMZFBDOVAY, ofs0, ns] 2024-09-12T01:04:15.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.755+0000 7fa5fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333711 cookie 94281963964176 notifier 8621 bl.length()=189 2024-09-12T01:04:15.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.755+0000 7fa5fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ERKTORFXZYAMZFBDOVAY info.flags=0x7 2024-09-12T01:04:15.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.755+0000 7fa5fbfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ERKTORFXZYAMZFBDOVAY to cache LRU end 2024-09-12T01:04:15.755 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:04:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "foobar.client.0", 2024-09-12T01:04:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T01:04:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "foobar+test@test.test", 2024-09-12T01:04:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2024-09-12T01:04:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2024-09-12T01:04:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2024-09-12T01:04:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2024-09-12T01:04:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T01:04:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "foobar.client.0", 2024-09-12T01:04:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "ERKTORFXZYAMZFBDOVAY", 2024-09-12T01:04:15.756 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "tUqPZMMmc0fJdgGiiKu0TpplcqEoKiPSmRd0mlICi/BjEIvJr4mBqg==", 2024-09-12T01:04:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "active": true, 2024-09-12T01:04:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T01:04:15.748774Z" 2024-09-12T01:04:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T01:04:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T01:04:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2024-09-12T01:04:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2024-09-12T01:04:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2024-09-12T01:04:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2024-09-12T01:04:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2024-09-12T01:04:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2024-09-12T01:04:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2024-09-12T01:04:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:15.757 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2024-09-12T01:04:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2024-09-12T01:04:15.758 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "rgw", 2024-09-12T01:04:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [], 2024-09-12T01:04:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "account_id": "", 2024-09-12T01:04:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "path": "/", 2024-09-12T01:04:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T01:04:15.748752Z", 2024-09-12T01:04:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T01:04:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: "group_ids": [] 2024-09-12T01:04:15.759 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:04:15.759 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:15.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.757+0000 7fa5df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:15.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.760+0000 7fa72b698800 20 remove_watcher() i=0 2024-09-12T01:04:15.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.760+0000 7fa72b698800 2 removed watcher, disabling cache 2024-09-12T01:04:15.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.761+0000 7fa72b698800 20 remove_watcher() i=1 2024-09-12T01:04:15.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.762+0000 7fa72b698800 20 remove_watcher() i=2 2024-09-12T01:04:15.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.763+0000 7fa72b698800 20 remove_watcher() i=3 2024-09-12T01:04:15.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.764+0000 7fa72b698800 20 remove_watcher() i=4 2024-09-12T01:04:15.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.765+0000 7fa72b698800 20 remove_watcher() i=5 2024-09-12T01:04:15.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.766+0000 7fa72b698800 20 remove_watcher() i=6 2024-09-12T01:04:15.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.767+0000 7fa72b698800 20 remove_watcher() i=7 2024-09-12T01:04:15.778 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 0185123289 --totp-seed 3ZNV3CXKPJKEVVFTRKBRNBTJF6I2NOKKXMSSMQJ4B7NSDNWQA4YY4EN66AQENH4B --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:04:15.845 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:15.845 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:15.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.882+0000 7f28ef214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.883+0000 7f28ef214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.884+0000 7f28ef214800 20 realm 2024-09-12T01:04:15.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.884+0000 7f28ef214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.884+0000 7f28ef214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.884+0000 7f28ef214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:15.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.884+0000 7f28ef214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.884+0000 7f28ef214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:15.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.884+0000 7f28ef214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.885+0000 7f28ef214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:15.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.885+0000 7f28ef214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:15.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.885+0000 7f28ef214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:15.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.885+0000 7f28ef214800 20 searching for the correct realm 2024-09-12T01:04:15.887 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:15.888+0000 7f28ea0ca640 0 -- 172.21.15.62:0/2937432332 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f28e4016910 msgr2=0x7f28e40153f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:16.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.093+0000 7f28eb0cc640 0 -- 172.21.15.62:0/2937432332 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5640f87d9930 msgr2=0x5640f87dbda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.097+0000 7f28ef214800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.097+0000 7f28ef214800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.097+0000 7f28ef214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.097+0000 7f28ef214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.097+0000 7f28ef214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.097+0000 7f28ef214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.097+0000 7f28ef214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.097+0000 7f28ef214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.097+0000 7f28ef214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.098+0000 7f28ef214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.098+0000 7f28ef214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.098+0000 7f28ef214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.098+0000 7f28ef214800 20 zone default found 2024-09-12T01:04:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.098+0000 7f28ef214800 4 Realm: () 2024-09-12T01:04:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.098+0000 7f28ef214800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.098+0000 7f28ef214800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.098+0000 7f28ef214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.098+0000 7f28ef214800 20 zonegroup default 2024-09-12T01:04:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.098+0000 7f28ef214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.098+0000 7f28ef214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.098+0000 7f28ef214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.099+0000 7f28ef214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.099+0000 7f28ef214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.099+0000 7f28ef214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.099+0000 7f28ef214800 20 started sync module instance, tier type = 2024-09-12T01:04:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.099+0000 7f28ef214800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:16.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.108+0000 7f28ef214800 20 add_watcher() i=0 2024-09-12T01:04:16.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.108+0000 7f28ef214800 20 add_watcher() i=1 2024-09-12T01:04:16.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.108+0000 7f28ef214800 20 add_watcher() i=2 2024-09-12T01:04:16.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.108+0000 7f28ef214800 20 add_watcher() i=3 2024-09-12T01:04:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.108+0000 7f28ef214800 20 add_watcher() i=4 2024-09-12T01:04:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.108+0000 7f28ef214800 20 add_watcher() i=5 2024-09-12T01:04:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.108+0000 7f28ef214800 20 add_watcher() i=6 2024-09-12T01:04:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.109+0000 7f28ef214800 20 add_watcher() i=7 2024-09-12T01:04:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.109+0000 7f28ef214800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.111+0000 7f27a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.111+0000 7f28ef214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.111+0000 7f28ef214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.111+0000 7f28ef214800 5 note: GC not initialized 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.111+0000 7f271bfff640 20 reqs_thread_entry: start 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.111+0000 7f28ef214800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.112+0000 7f28ef214800 20 Filter name: none 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.112+0000 7f2719ffb640 20 reqs_thread_entry: start 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.112+0000 7f28ef214800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T01:04:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.112+0000 7f28ef214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.112+0000 7f28ef214800 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.112+0000 7f28ef214800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.112+0000 7f28ef214800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:16.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.112+0000 7f28ef214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:16.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.115+0000 7f28ef214800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:04:16.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.115+0000 7f28ef214800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:16.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.115+0000 7f28ef214800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T01:04:16.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.115+0000 7f27ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333725 cookie 94837046958832 notifier 9141 bl.length()=674 2024-09-12T01:04:16.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.115+0000 7f27ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:04:16.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.115+0000 7f27ce7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:16.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.118+0000 7f27a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.120+0000 7f28ef214800 20 remove_watcher() i=0 2024-09-12T01:04:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.120+0000 7f28ef214800 2 removed watcher, disabling cache 2024-09-12T01:04:16.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.121+0000 7f28ef214800 20 remove_watcher() i=1 2024-09-12T01:04:16.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.122+0000 7f28ef214800 20 remove_watcher() i=2 2024-09-12T01:04:16.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.123+0000 7f28ef214800 20 remove_watcher() i=3 2024-09-12T01:04:16.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.124+0000 7f28ef214800 20 remove_watcher() i=4 2024-09-12T01:04:16.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.125+0000 7f28ef214800 20 remove_watcher() i=5 2024-09-12T01:04:16.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.126+0000 7f28ef214800 20 remove_watcher() i=6 2024-09-12T01:04:16.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.127+0000 7f28ef214800 20 remove_watcher() i=7 2024-09-12T01:04:16.138 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T01:04:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:16.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.232+0000 7f34b4530800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.234+0000 7f34b4530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.234+0000 7f34b4530800 20 realm 2024-09-12T01:04:16.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.234+0000 7f34b4530800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.235+0000 7f34b4530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.235+0000 7f34b4530800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:16.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.235+0000 7f34b4530800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.235+0000 7f34b4530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.235+0000 7f34b4530800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.236+0000 7f34b4530800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:16.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.236+0000 7f34b4530800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.236+0000 7f34b4530800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:16.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.236+0000 7f34b4530800 20 searching for the correct realm 2024-09-12T01:04:16.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.239+0000 7f34afaaf640 0 -- 172.21.15.62:0/3243799768 >> [v2:172.21.15.62:6808/741930476,v1:172.21.15.62:6809/741930476] conn(0x5565abfa8a40 msgr2=0x5565abfaae30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.242+0000 7f34b02b0640 0 -- 172.21.15.62:0/3243799768 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f34a808e910 msgr2=0x7f34a80543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:16.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.449+0000 7f34b4530800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.449+0000 7f34b4530800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.449+0000 7f34b4530800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.449+0000 7f34b4530800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.449+0000 7f34b4530800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.449+0000 7f34b4530800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.449+0000 7f34b4530800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.449+0000 7f34b4530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.449+0000 7f34b4530800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.450+0000 7f34b4530800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.450+0000 7f34b4530800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.450+0000 7f34b4530800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:16.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.450+0000 7f34b4530800 20 zone default found 2024-09-12T01:04:16.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.450+0000 7f34b4530800 4 Realm: () 2024-09-12T01:04:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.450+0000 7f34b4530800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.450+0000 7f34b4530800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.450+0000 7f34b4530800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.450+0000 7f34b4530800 20 zonegroup default 2024-09-12T01:04:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.450+0000 7f34b4530800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.450+0000 7f34b4530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.450+0000 7f34b4530800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.451+0000 7f34b4530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.451+0000 7f34b4530800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.451+0000 7f34b4530800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.451+0000 7f34b4530800 20 started sync module instance, tier type = 2024-09-12T01:04:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.451+0000 7f34b4530800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:16.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.460+0000 7f34b4530800 20 add_watcher() i=0 2024-09-12T01:04:16.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.460+0000 7f34b4530800 20 add_watcher() i=1 2024-09-12T01:04:16.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.460+0000 7f34b4530800 20 add_watcher() i=2 2024-09-12T01:04:16.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.460+0000 7f34b4530800 20 add_watcher() i=3 2024-09-12T01:04:16.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.460+0000 7f34b4530800 20 add_watcher() i=4 2024-09-12T01:04:16.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.460+0000 7f34b4530800 20 add_watcher() i=5 2024-09-12T01:04:16.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.460+0000 7f34b4530800 20 add_watcher() i=6 2024-09-12T01:04:16.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.461+0000 7f34b4530800 20 add_watcher() i=7 2024-09-12T01:04:16.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.461+0000 7f34b4530800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:16.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.463+0000 7f3366fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:16.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.463+0000 7f34b4530800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:16.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.463+0000 7f34b4530800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:16.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.463+0000 7f34b4530800 5 note: GC not initialized 2024-09-12T01:04:16.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.464+0000 7f3365fdb640 20 reqs_thread_entry: start 2024-09-12T01:04:16.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.464+0000 7f34b4530800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.464+0000 7f34b4530800 20 Filter name: none 2024-09-12T01:04:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.464+0000 7f32d77fe640 20 reqs_thread_entry: start 2024-09-12T01:04:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.464+0000 7f34b4530800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T01:04:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.464+0000 7f34b4530800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.464+0000 7f34b4530800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T01:04:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.464+0000 7f34b4530800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T01:04:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.464+0000 7f34b4530800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.464+0000 7f34b4530800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:16.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.466+0000 7f34b4530800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:04:16.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.466+0000 7f34b4530800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:16.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.466+0000 7f34b4530800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T01:04:16.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.466+0000 7f33877fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333726 cookie 93895165436208 notifier 9159 bl.length()=727 2024-09-12T01:04:16.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.466+0000 7f33877fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:04:16.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.466+0000 7f33877fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:04:16.467 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:04:16.467 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "foobar.client.0", 2024-09-12T01:04:16.467 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T01:04:16.467 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "foobar+test@test.test", 2024-09-12T01:04:16.467 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2024-09-12T01:04:16.467 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2024-09-12T01:04:16.467 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2024-09-12T01:04:16.467 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2024-09-12T01:04:16.467 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T01:04:16.467 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "foobar.client.0", 2024-09-12T01:04:16.468 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "ERKTORFXZYAMZFBDOVAY", 2024-09-12T01:04:16.468 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "tUqPZMMmc0fJdgGiiKu0TpplcqEoKiPSmRd0mlICi/BjEIvJr4mBqg==", 2024-09-12T01:04:16.468 INFO:teuthology.orchestra.run.smithi062.stdout: "active": true, 2024-09-12T01:04:16.468 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T01:04:15.748774Z" 2024-09-12T01:04:16.468 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T01:04:16.468 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T01:04:16.468 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2024-09-12T01:04:16.468 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [ 2024-09-12T01:04:16.468 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T01:04:16.468 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "oidc-provider", 2024-09-12T01:04:16.468 INFO:teuthology.orchestra.run.smithi062.stdout: "perm": "*" 2024-09-12T01:04:16.468 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:16.468 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T01:04:16.468 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "roles", 2024-09-12T01:04:16.469 INFO:teuthology.orchestra.run.smithi062.stdout: "perm": "*" 2024-09-12T01:04:16.469 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:16.469 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T01:04:16.469 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "user-policy", 2024-09-12T01:04:16.469 INFO:teuthology.orchestra.run.smithi062.stdout: "perm": "*" 2024-09-12T01:04:16.469 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T01:04:16.469 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T01:04:16.469 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2024-09-12T01:04:16.469 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2024-09-12T01:04:16.469 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2024-09-12T01:04:16.469 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2024-09-12T01:04:16.469 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2024-09-12T01:04:16.469 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:16.470 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:16.470 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:16.470 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:16.470 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:16.470 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:16.470 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2024-09-12T01:04:16.470 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:16.470 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:16.470 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:16.470 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:16.470 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:16.470 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:16.470 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2024-09-12T01:04:16.470 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "rgw", 2024-09-12T01:04:16.471 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [ 2024-09-12T01:04:16.471 INFO:teuthology.orchestra.run.smithi062.stdout: "0185123289" 2024-09-12T01:04:16.471 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T01:04:16.471 INFO:teuthology.orchestra.run.smithi062.stdout: "account_id": "", 2024-09-12T01:04:16.471 INFO:teuthology.orchestra.run.smithi062.stdout: "path": "/", 2024-09-12T01:04:16.471 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T01:04:15.748752Z", 2024-09-12T01:04:16.471 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T01:04:16.471 INFO:teuthology.orchestra.run.smithi062.stdout: "group_ids": [] 2024-09-12T01:04:16.471 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:04:16.471 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:16.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.469+0000 7f3366fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:16.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.473+0000 7f34b4530800 20 remove_watcher() i=0 2024-09-12T01:04:16.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.473+0000 7f34b4530800 2 removed watcher, disabling cache 2024-09-12T01:04:16.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.474+0000 7f34b4530800 20 remove_watcher() i=1 2024-09-12T01:04:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.475+0000 7f34b4530800 20 remove_watcher() i=2 2024-09-12T01:04:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.476+0000 7f34b4530800 20 remove_watcher() i=3 2024-09-12T01:04:16.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.477+0000 7f34b4530800 20 remove_watcher() i=4 2024-09-12T01:04:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.478+0000 7f34b4530800 20 remove_watcher() i=5 2024-09-12T01:04:16.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.479+0000 7f34b4530800 20 remove_watcher() i=6 2024-09-12T01:04:16.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.480+0000 7f34b4530800 20 remove_watcher() i=7 2024-09-12T01:04:16.491 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T01:04:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:16.553 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:16.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.589+0000 7fa105f36800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.591+0000 7fa105f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.591+0000 7fa105f36800 20 realm 2024-09-12T01:04:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.591+0000 7fa105f36800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.591+0000 7fa105f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.591+0000 7fa105f36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.591+0000 7fa105f36800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.591+0000 7fa105f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.591+0000 7fa105f36800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.592+0000 7fa105f36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:16.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.592+0000 7fa105f36800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.592+0000 7fa105f36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:16.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.592+0000 7fa105f36800 20 searching for the correct realm 2024-09-12T01:04:16.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.595+0000 7fa1014b6640 0 -- 172.21.15.62:0/451612978 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fa0fc06e1c0 msgr2=0x7fa0fc0858e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:16.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.800+0000 7fa1024b8640 0 -- 172.21.15.62:0/451612978 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5652219937b0 msgr2=0x565221995c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:16.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:16.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:16.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:16.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:16.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:16.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:16.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:16.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:16.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 20 zone default found 2024-09-12T01:04:16.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 4 Realm: () 2024-09-12T01:04:16.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:16.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:16.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:16.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.805+0000 7fa105f36800 20 zonegroup default 2024-09-12T01:04:16.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.806+0000 7fa105f36800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.806+0000 7fa105f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.806+0000 7fa105f36800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.806+0000 7fa105f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.806+0000 7fa105f36800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.807+0000 7fa105f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.807+0000 7fa105f36800 20 started sync module instance, tier type = 2024-09-12T01:04:16.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.807+0000 7fa105f36800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:16.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.816+0000 7fa105f36800 20 add_watcher() i=0 2024-09-12T01:04:16.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.816+0000 7fa105f36800 20 add_watcher() i=1 2024-09-12T01:04:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.816+0000 7fa105f36800 20 add_watcher() i=2 2024-09-12T01:04:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.816+0000 7fa105f36800 20 add_watcher() i=3 2024-09-12T01:04:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.816+0000 7fa105f36800 20 add_watcher() i=4 2024-09-12T01:04:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.816+0000 7fa105f36800 20 add_watcher() i=5 2024-09-12T01:04:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.816+0000 7fa105f36800 20 add_watcher() i=6 2024-09-12T01:04:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.817+0000 7fa105f36800 20 add_watcher() i=7 2024-09-12T01:04:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.817+0000 7fa105f36800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.819+0000 7f9fb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.819+0000 7fa105f36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.819+0000 7fa105f36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.819+0000 7fa105f36800 5 note: GC not initialized 2024-09-12T01:04:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.820+0000 7f9fb27fc640 20 reqs_thread_entry: start 2024-09-12T01:04:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.820+0000 7fa105f36800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.820+0000 7fa105f36800 20 Filter name: none 2024-09-12T01:04:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.820+0000 7f9f27fff640 20 reqs_thread_entry: start 2024-09-12T01:04:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.820+0000 7fa105f36800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T01:04:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.820+0000 7fa105f36800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.820+0000 7fa105f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.820+0000 7fa105f36800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T01:04:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.820+0000 7fa105f36800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T01:04:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.820+0000 7fa105f36800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T01:04:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.820+0000 7fa105f36800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T01:04:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.820+0000 7fa105f36800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.821+0000 7fa105f36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.821+0000 7fa105f36800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T01:04:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.821+0000 7fa105f36800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T01:04:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.821+0000 7fa105f36800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T01:04:16.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.822+0000 7fa105f36800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T01:04:16.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.822+0000 7fa105f36800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T01:04:16.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.822+0000 7fa105f36800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T01:04:16.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.822+0000 7f9fe57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333712 cookie 94910751063392 notifier 9177 bl.length()=384 2024-09-12T01:04:16.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.822+0000 7f9fe57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T01:04:16.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.822+0000 7f9fe57fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T01:04:16.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.825+0000 7fa105f36800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T01:04:16.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.825+0000 7fa105f36800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T01:04:16.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.825+0000 7fa105f36800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T01:04:16.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.825+0000 7f9fe4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333713 cookie 94910751060480 notifier 9177 bl.length()=225 2024-09-12T01:04:16.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.825+0000 7f9fe4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T01:04:16.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.825+0000 7f9fe4ff9640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T01:04:16.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.828+0000 7fa105f36800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T01:04:16.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.828+0000 7fa105f36800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T01:04:16.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.828+0000 7fa105f36800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T01:04:16.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.828+0000 7f9fe4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333555 cookie 94910751069792 notifier 9177 bl.length()=234 2024-09-12T01:04:16.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.828+0000 7f9fe4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T01:04:16.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.828+0000 7f9fe4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T01:04:16.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.830+0000 7f9fb37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.833+0000 7fa105f36800 20 remove_watcher() i=0 2024-09-12T01:04:16.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.833+0000 7fa105f36800 2 removed watcher, disabling cache 2024-09-12T01:04:16.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.834+0000 7fa105f36800 20 remove_watcher() i=1 2024-09-12T01:04:16.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.835+0000 7fa105f36800 20 remove_watcher() i=2 2024-09-12T01:04:16.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.836+0000 7fa105f36800 20 remove_watcher() i=3 2024-09-12T01:04:16.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.837+0000 7fa105f36800 20 remove_watcher() i=4 2024-09-12T01:04:16.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.838+0000 7fa105f36800 20 remove_watcher() i=5 2024-09-12T01:04:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.839+0000 7fa105f36800 20 remove_watcher() i=6 2024-09-12T01:04:16.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.840+0000 7fa105f36800 20 remove_watcher() i=7 2024-09-12T01:04:16.848 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:04:16.849 INFO:teuthology.orchestra.run.smithi062.stdout: "id": "RGW88888888888888888", 2024-09-12T01:04:16.849 INFO:teuthology.orchestra.run.smithi062.stdout: "tenant": "", 2024-09-12T01:04:16.849 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T01:04:16.849 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T01:04:16.849 INFO:teuthology.orchestra.run.smithi062.stdout: "quota": { 2024-09-12T01:04:16.849 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:16.849 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:16.849 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:16.849 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:16.849 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:16.850 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:16.850 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2024-09-12T01:04:16.850 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:16.850 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:16.850 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:16.850 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:16.850 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:16.850 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:16.850 INFO:teuthology.orchestra.run.smithi062.stdout: "max_users": 1000, 2024-09-12T01:04:16.850 INFO:teuthology.orchestra.run.smithi062.stdout: "max_roles": 1000, 2024-09-12T01:04:16.850 INFO:teuthology.orchestra.run.smithi062.stdout: "max_groups": 1000, 2024-09-12T01:04:16.850 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2024-09-12T01:04:16.851 INFO:teuthology.orchestra.run.smithi062.stdout: "max_access_keys": 4 2024-09-12T01:04:16.851 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:04:16.852 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T01:04:16.852 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key OGBPFMNMNGCKJUIEPRYH --secret mGQv5ACm44wcliL3PPPk3W5rx48YMGsceJxddPFk48E/LyyddvHUfw== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T01:04:16.921 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:16.921 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:16.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.958+0000 7feb92214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.959+0000 7feb92214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.959+0000 7feb92214800 20 realm 2024-09-12T01:04:16.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.959+0000 7feb92214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.959+0000 7feb92214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.959+0000 7feb92214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:16.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.959+0000 7feb92214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.960+0000 7feb92214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:16.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.960+0000 7feb92214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.960+0000 7feb92214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:16.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.960+0000 7feb92214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:16.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.961+0000 7feb92214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:16.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.961+0000 7feb92214800 20 searching for the correct realm 2024-09-12T01:04:16.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:16.964+0000 7feb8d1df640 0 -- 172.21.15.62:0/3226282164 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7feb8807f400 msgr2=0x7feb8807f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:17.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.169+0000 7feb8e1e1640 0 -- 172.21.15.62:0/3226282164 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55bd19ef7d90 msgr2=0x55bd19efa220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:17.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.173+0000 7feb92214800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:17.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.173+0000 7feb92214800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:17.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.173+0000 7feb92214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:17.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.173+0000 7feb92214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:17.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.173+0000 7feb92214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:17.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.173+0000 7feb92214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:17.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.173+0000 7feb92214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.174+0000 7feb92214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.174+0000 7feb92214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.174+0000 7feb92214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.174+0000 7feb92214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.174+0000 7feb92214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.174+0000 7feb92214800 20 zone default found 2024-09-12T01:04:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.174+0000 7feb92214800 4 Realm: () 2024-09-12T01:04:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.174+0000 7feb92214800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.174+0000 7feb92214800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.174+0000 7feb92214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.174+0000 7feb92214800 20 zonegroup default 2024-09-12T01:04:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.174+0000 7feb92214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.175+0000 7feb92214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.175+0000 7feb92214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.175+0000 7feb92214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.175+0000 7feb92214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.175+0000 7feb92214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.175+0000 7feb92214800 20 started sync module instance, tier type = 2024-09-12T01:04:17.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.175+0000 7feb92214800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:17.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.186+0000 7feb92214800 20 add_watcher() i=0 2024-09-12T01:04:17.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.186+0000 7feb92214800 20 add_watcher() i=1 2024-09-12T01:04:17.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.186+0000 7feb92214800 20 add_watcher() i=2 2024-09-12T01:04:17.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.186+0000 7feb92214800 20 add_watcher() i=3 2024-09-12T01:04:17.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.186+0000 7feb92214800 20 add_watcher() i=4 2024-09-12T01:04:17.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.186+0000 7feb92214800 20 add_watcher() i=5 2024-09-12T01:04:17.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.186+0000 7feb92214800 20 add_watcher() i=6 2024-09-12T01:04:17.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.187+0000 7feb92214800 20 add_watcher() i=7 2024-09-12T01:04:17.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.187+0000 7feb92214800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.189+0000 7fea3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.189+0000 7feb92214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:17.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.189+0000 7feb92214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.189+0000 7feb92214800 5 note: GC not initialized 2024-09-12T01:04:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.190+0000 7fea3e7fc640 20 reqs_thread_entry: start 2024-09-12T01:04:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.190+0000 7feb92214800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.190+0000 7feb92214800 20 Filter name: none 2024-09-12T01:04:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.190+0000 7fe9affff640 20 reqs_thread_entry: start 2024-09-12T01:04:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.190+0000 7feb92214800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T01:04:17.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.190+0000 7feb92214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.191+0000 7feb92214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.191+0000 7feb92214800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T01:04:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.191+0000 7feb92214800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:04:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.191+0000 7feb92214800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T01:04:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.191+0000 7feb92214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.191+0000 7feb92214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.191+0000 7feb92214800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T01:04:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.191+0000 7feb92214800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T01:04:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.191+0000 7feb92214800 10 cache get: name=default.rgw.meta+users.keys+OGBPFMNMNGCKJUIEPRYH : miss 2024-09-12T01:04:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.191+0000 7feb92214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.191+0000 7feb92214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.191+0000 7feb92214800 10 cache put: name=default.rgw.meta+users.keys+OGBPFMNMNGCKJUIEPRYH info.flags=0x0 2024-09-12T01:04:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.191+0000 7feb92214800 10 adding default.rgw.meta+users.keys+OGBPFMNMNGCKJUIEPRYH to cache LRU end 2024-09-12T01:04:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.191+0000 7feb92214800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T01:04:17.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.191+0000 7feb92214800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.192+0000 7feb92214800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T01:04:17.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.192+0000 7feb92214800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T01:04:17.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.192+0000 7feb92214800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T01:04:17.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.192+0000 7feb92214800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:17.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.192+0000 7feb92214800 10 cache get: name=default.rgw.meta+users.keys+OGBPFMNMNGCKJUIEPRYH : hit (negative entry) 2024-09-12T01:04:17.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.192+0000 7feb92214800 10 cache get: name=default.rgw.meta+users.keys+OGBPFMNMNGCKJUIEPRYH : hit (negative entry) 2024-09-12T01:04:17.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.194+0000 7feb92214800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:04:17.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.194+0000 7feb92214800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:04:17.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.194+0000 7feb92214800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T01:04:17.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.194+0000 7fea717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333714 cookie 94270672373600 notifier 8687 bl.length()=681 2024-09-12T01:04:17.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.194+0000 7fea717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:04:17.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.194+0000 7fea717fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:04:17.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.197+0000 7feb92214800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T01:04:17.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.197+0000 7feb92214800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T01:04:17.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.197+0000 7feb92214800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T01:04:17.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.197+0000 7fea717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333727 cookie 94270672383488 notifier 8687 bl.length()=189 2024-09-12T01:04:17.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.197+0000 7fea717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T01:04:17.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.197+0000 7fea717fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T01:04:17.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.200+0000 7feb92214800 10 cache put: name=default.rgw.meta+users.keys+OGBPFMNMNGCKJUIEPRYH info.flags=0x7 2024-09-12T01:04:17.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.200+0000 7feb92214800 10 moving default.rgw.meta+users.keys+OGBPFMNMNGCKJUIEPRYH to cache LRU end 2024-09-12T01:04:17.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.200+0000 7feb92214800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OGBPFMNMNGCKJUIEPRYH, ofs0, ns] 2024-09-12T01:04:17.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.200+0000 7fea717fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333533 cookie 94270672311520 notifier 8687 bl.length()=188 2024-09-12T01:04:17.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.200+0000 7fea717fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OGBPFMNMNGCKJUIEPRYH info.flags=0x7 2024-09-12T01:04:17.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.200+0000 7fea717fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OGBPFMNMNGCKJUIEPRYH to cache LRU end 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.203+0000 7feb92214800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "root1.client.0", 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "root1+test@test.test", 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2024-09-12T01:04:17.203 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "root1.client.0", 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "OGBPFMNMNGCKJUIEPRYH", 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "mGQv5ACm44wcliL3PPPk3W5rx48YMGsceJxddPFk48E/LyyddvHUfw==", 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi062.stdout: "active": true, 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T01:04:17.193328Z" 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2024-09-12T01:04:17.204 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2024-09-12T01:04:17.205 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "root", 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [], 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi062.stdout: "account_id": "RGW88888888888888888", 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi062.stdout: "path": "/", 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T01:04:17.193314Z", 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T01:04:17.206 INFO:teuthology.orchestra.run.smithi062.stdout: "group_ids": [] 2024-09-12T01:04:17.207 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:04:17.207 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:17.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.204+0000 7fea3f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:17.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.207+0000 7feb92214800 20 remove_watcher() i=0 2024-09-12T01:04:17.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.207+0000 7feb92214800 2 removed watcher, disabling cache 2024-09-12T01:04:17.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.208+0000 7feb92214800 20 remove_watcher() i=1 2024-09-12T01:04:17.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.209+0000 7feb92214800 20 remove_watcher() i=2 2024-09-12T01:04:17.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.210+0000 7feb92214800 20 remove_watcher() i=3 2024-09-12T01:04:17.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.211+0000 7feb92214800 20 remove_watcher() i=4 2024-09-12T01:04:17.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.212+0000 7feb92214800 20 remove_watcher() i=5 2024-09-12T01:04:17.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.213+0000 7feb92214800 20 remove_watcher() i=6 2024-09-12T01:04:17.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.214+0000 7feb92214800 20 remove_watcher() i=7 2024-09-12T01:04:17.225 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 0924131658 --totp-seed BLMDDZJKLUUMRJ7SBEJUU7OZRGOW3WDHJXQN4D7ALAPUUPW6BC5RDUGRUOVUBVYK --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:04:17.293 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:17.293 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:17.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.329+0000 7f9448b26800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.331+0000 7f9448b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.331+0000 7f9448b26800 20 realm 2024-09-12T01:04:17.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.331+0000 7f9448b26800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.331+0000 7f9448b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.331+0000 7f9448b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:17.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.331+0000 7f9448b26800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.332+0000 7f9448b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.332+0000 7f9448b26800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.332+0000 7f9448b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:17.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.332+0000 7f9448b26800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.333+0000 7f9448b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:17.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.333+0000 7f9448b26800 20 searching for the correct realm 2024-09-12T01:04:17.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.336+0000 7f9443f08640 0 -- 172.21.15.62:0/3283711214 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f943c036930 msgr2=0x7f943c025420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:17.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.542+0000 7f9444f0a640 0 -- 172.21.15.62:0/3283711214 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55ef13730d50 msgr2=0x55ef137331f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:17.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:17.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:17.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:17.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:17.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:17.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:17.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:17.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:17.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 20 zone default found 2024-09-12T01:04:17.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 4 Realm: () 2024-09-12T01:04:17.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:17.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:17.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:17.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 20 zonegroup default 2024-09-12T01:04:17.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.547+0000 7f9448b26800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.548+0000 7f9448b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.548+0000 7f9448b26800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.548+0000 7f9448b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.548+0000 7f9448b26800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.548+0000 7f9448b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.548+0000 7f9448b26800 20 started sync module instance, tier type = 2024-09-12T01:04:17.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.548+0000 7f9448b26800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:17.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.558+0000 7f9448b26800 20 add_watcher() i=0 2024-09-12T01:04:17.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.558+0000 7f9448b26800 20 add_watcher() i=1 2024-09-12T01:04:17.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.558+0000 7f9448b26800 20 add_watcher() i=2 2024-09-12T01:04:17.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.558+0000 7f9448b26800 20 add_watcher() i=3 2024-09-12T01:04:17.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.558+0000 7f9448b26800 20 add_watcher() i=4 2024-09-12T01:04:17.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.558+0000 7f9448b26800 20 add_watcher() i=5 2024-09-12T01:04:17.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.558+0000 7f9448b26800 20 add_watcher() i=6 2024-09-12T01:04:17.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.559+0000 7f9448b26800 20 add_watcher() i=7 2024-09-12T01:04:17.558 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.559+0000 7f9448b26800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:17.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.561+0000 7f92fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.561+0000 7f9448b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.561+0000 7f9448b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.561+0000 7f9448b26800 5 note: GC not initialized 2024-09-12T01:04:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.561+0000 7f92f9fdb640 20 reqs_thread_entry: start 2024-09-12T01:04:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.561+0000 7f9448b26800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.561+0000 7f9448b26800 20 Filter name: none 2024-09-12T01:04:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.562+0000 7f926b7fe640 20 reqs_thread_entry: start 2024-09-12T01:04:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.562+0000 7f9448b26800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T01:04:17.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.562+0000 7f9448b26800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.562+0000 7f9448b26800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T01:04:17.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.562+0000 7f9448b26800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T01:04:17.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.562+0000 7f9448b26800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:04:17.562 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.562+0000 7f9448b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:17.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.565+0000 7f9448b26800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:04:17.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.565+0000 7f9448b26800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:04:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.565+0000 7f9448b26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T01:04:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.566+0000 7f931b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333715 cookie 94485311921872 notifier 8705 bl.length()=695 2024-09-12T01:04:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.566+0000 7f931b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:04:17.565 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.566+0000 7f931b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:04:17.567 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.568+0000 7f92fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:17.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.571+0000 7f9448b26800 20 remove_watcher() i=0 2024-09-12T01:04:17.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.571+0000 7f9448b26800 2 removed watcher, disabling cache 2024-09-12T01:04:17.571 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.572+0000 7f9448b26800 20 remove_watcher() i=1 2024-09-12T01:04:17.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.573+0000 7f9448b26800 20 remove_watcher() i=2 2024-09-12T01:04:17.573 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.574+0000 7f9448b26800 20 remove_watcher() i=3 2024-09-12T01:04:17.574 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.575+0000 7f9448b26800 20 remove_watcher() i=4 2024-09-12T01:04:17.575 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.576+0000 7f9448b26800 20 remove_watcher() i=5 2024-09-12T01:04:17.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.578+0000 7f9448b26800 20 remove_watcher() i=6 2024-09-12T01:04:17.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.579+0000 7f9448b26800 20 remove_watcher() i=7 2024-09-12T01:04:17.590 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T01:04:17.651 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:17.651 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:17.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.687+0000 7fc279d23800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.689+0000 7fc279d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.689+0000 7fc279d23800 20 realm 2024-09-12T01:04:17.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.689+0000 7fc279d23800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.689+0000 7fc279d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.689+0000 7fc279d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:17.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.689+0000 7fc279d23800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.689+0000 7fc279d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.689 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.689+0000 7fc279d23800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.690+0000 7fc279d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:17.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.690+0000 7fc279d23800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.691+0000 7fc279d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:17.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.691+0000 7fc279d23800 20 searching for the correct realm 2024-09-12T01:04:17.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.694+0000 7fc27520b640 0 -- 172.21.15.62:0/1952431158 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fc270024410 msgr2=0x7fc270024890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:17.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.900+0000 7fc27620d640 0 -- 172.21.15.62:0/1952431158 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x560c2b2e30a0 msgr2=0x560c2b2e5560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:17.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.904+0000 7fc279d23800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:17.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.904+0000 7fc279d23800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:17.903 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.904+0000 7fc279d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.904+0000 7fc279d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.904+0000 7fc279d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.904+0000 7fc279d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.904+0000 7fc279d23800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.904+0000 7fc279d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.904+0000 7fc279d23800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.905+0000 7fc279d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:17.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.905+0000 7fc279d23800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.905+0000 7fc279d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.905+0000 7fc279d23800 20 zone default found 2024-09-12T01:04:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.905+0000 7fc279d23800 4 Realm: () 2024-09-12T01:04:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.905+0000 7fc279d23800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.905+0000 7fc279d23800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.905+0000 7fc279d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.905+0000 7fc279d23800 20 zonegroup default 2024-09-12T01:04:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.905+0000 7fc279d23800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.905+0000 7fc279d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.905+0000 7fc279d23800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.906+0000 7fc279d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.906+0000 7fc279d23800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.906+0000 7fc279d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.906+0000 7fc279d23800 20 started sync module instance, tier type = 2024-09-12T01:04:17.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.906+0000 7fc279d23800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:17.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.916+0000 7fc279d23800 20 add_watcher() i=0 2024-09-12T01:04:17.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.916+0000 7fc279d23800 20 add_watcher() i=1 2024-09-12T01:04:17.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.916+0000 7fc279d23800 20 add_watcher() i=2 2024-09-12T01:04:17.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.916+0000 7fc279d23800 20 add_watcher() i=3 2024-09-12T01:04:17.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.916+0000 7fc279d23800 20 add_watcher() i=4 2024-09-12T01:04:17.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.916+0000 7fc279d23800 20 add_watcher() i=5 2024-09-12T01:04:17.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.916+0000 7fc279d23800 20 add_watcher() i=6 2024-09-12T01:04:17.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.917+0000 7fc279d23800 20 add_watcher() i=7 2024-09-12T01:04:17.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.917+0000 7fc279d23800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:17.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.918+0000 7fc1277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:17.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.919+0000 7fc279d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:17.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.919+0000 7fc279d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:17.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.919+0000 7fc279d23800 5 note: GC not initialized 2024-09-12T01:04:17.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.919+0000 7fc1267fc640 20 reqs_thread_entry: start 2024-09-12T01:04:17.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.919+0000 7fc279d23800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:17.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.919+0000 7fc279d23800 20 Filter name: none 2024-09-12T01:04:17.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.919+0000 7fc097fff640 20 reqs_thread_entry: start 2024-09-12T01:04:17.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.919+0000 7fc279d23800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T01:04:17.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.919+0000 7fc279d23800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.920+0000 7fc279d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.920+0000 7fc279d23800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T01:04:17.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.920+0000 7fc279d23800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T01:04:17.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.920+0000 7fc279d23800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T01:04:17.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.920+0000 7fc279d23800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T01:04:17.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.920+0000 7fc279d23800 20 rados->read ofs=0 len=0 2024-09-12T01:04:17.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.920+0000 7fc279d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:17.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.920+0000 7fc279d23800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T01:04:17.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.920+0000 7fc279d23800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T01:04:17.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.920+0000 7fc279d23800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T01:04:17.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.921+0000 7fc279d23800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T01:04:17.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.921+0000 7fc279d23800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T01:04:17.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.921+0000 7fc279d23800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T01:04:17.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.921+0000 7fc1597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333716 cookie 94610264110144 notifier 8720 bl.length()=384 2024-09-12T01:04:17.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.921+0000 7fc1597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T01:04:17.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.921+0000 7fc1597fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T01:04:17.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.924+0000 7fc279d23800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T01:04:17.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.924+0000 7fc279d23800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T01:04:17.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.924+0000 7fc279d23800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T01:04:17.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.925+0000 7fc1597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333717 cookie 94610264118416 notifier 8720 bl.length()=225 2024-09-12T01:04:17.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.925+0000 7fc1597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T01:04:17.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.925+0000 7fc1597fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T01:04:17.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.927+0000 7fc279d23800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T01:04:17.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.927+0000 7fc279d23800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T01:04:17.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.927+0000 7fc279d23800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T01:04:17.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.927+0000 7fc1597fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333556 cookie 94610264111488 notifier 8720 bl.length()=234 2024-09-12T01:04:17.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.927+0000 7fc1597fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T01:04:17.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.927+0000 7fc1597fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T01:04:17.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.930+0000 7fc1277fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:17.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.932+0000 7fc279d23800 20 remove_watcher() i=0 2024-09-12T01:04:17.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.932+0000 7fc279d23800 2 removed watcher, disabling cache 2024-09-12T01:04:17.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.933+0000 7fc279d23800 20 remove_watcher() i=1 2024-09-12T01:04:17.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.935+0000 7fc279d23800 20 remove_watcher() i=2 2024-09-12T01:04:17.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.936+0000 7fc279d23800 20 remove_watcher() i=3 2024-09-12T01:04:17.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.937+0000 7fc279d23800 20 remove_watcher() i=4 2024-09-12T01:04:17.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.938+0000 7fc279d23800 20 remove_watcher() i=5 2024-09-12T01:04:17.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.939+0000 7fc279d23800 20 remove_watcher() i=6 2024-09-12T01:04:17.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:17.940+0000 7fc279d23800 20 remove_watcher() i=7 2024-09-12T01:04:17.949 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:04:17.949 INFO:teuthology.orchestra.run.smithi062.stdout: "id": "RGW99999999999999999", 2024-09-12T01:04:17.949 INFO:teuthology.orchestra.run.smithi062.stdout: "tenant": "", 2024-09-12T01:04:17.949 INFO:teuthology.orchestra.run.smithi062.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T01:04:17.949 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T01:04:17.949 INFO:teuthology.orchestra.run.smithi062.stdout: "quota": { 2024-09-12T01:04:17.949 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:17.949 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:17.949 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:17.949 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:17.949 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:17.950 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:17.950 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2024-09-12T01:04:17.950 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:17.950 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:17.950 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:17.950 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:17.950 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:17.950 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:17.950 INFO:teuthology.orchestra.run.smithi062.stdout: "max_users": 1000, 2024-09-12T01:04:17.950 INFO:teuthology.orchestra.run.smithi062.stdout: "max_roles": 1000, 2024-09-12T01:04:17.950 INFO:teuthology.orchestra.run.smithi062.stdout: "max_groups": 1000, 2024-09-12T01:04:17.950 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2024-09-12T01:04:17.950 INFO:teuthology.orchestra.run.smithi062.stdout: "max_access_keys": 4 2024-09-12T01:04:17.951 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:04:17.952 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T01:04:17.952 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key WVZDFZFGJZOPLXSKAGLL --secret NmV8XjtiPBtRa9PtiSJuavbjrIiMKO508TYxj85xBFRVIl+jujvxjA== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T01:04:18.021 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:18.021 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:18.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.057+0000 7fa6f5132800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.059+0000 7fa6f5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.059+0000 7fa6f5132800 20 realm 2024-09-12T01:04:18.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.059+0000 7fa6f5132800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.059+0000 7fa6f5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.059+0000 7fa6f5132800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.059+0000 7fa6f5132800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.059+0000 7fa6f5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.059+0000 7fa6f5132800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.060+0000 7fa6f5132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:18.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.060+0000 7fa6f5132800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.061+0000 7fa6f5132800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:18.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.061+0000 7fa6f5132800 20 searching for the correct realm 2024-09-12T01:04:18.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.064+0000 7fa6f05bb640 0 -- 172.21.15.62:0/1688879226 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fa6e80a9550 msgr2=0x7fa6e80717b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:18.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.270+0000 7fa6f05bb640 0 -- 172.21.15.62:0/1688879226 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x563e0408b0f0 msgr2=0x563e0408d560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.274+0000 7fa6f5132800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.274+0000 7fa6f5132800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 20 zone default found 2024-09-12T01:04:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 4 Realm: () 2024-09-12T01:04:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:18.276 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 20 zonegroup default 2024-09-12T01:04:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.275+0000 7fa6f5132800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.276+0000 7fa6f5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.276+0000 7fa6f5132800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.276+0000 7fa6f5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.276+0000 7fa6f5132800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.276+0000 7fa6f5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.276+0000 7fa6f5132800 20 started sync module instance, tier type = 2024-09-12T01:04:18.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.276+0000 7fa6f5132800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:18.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.286+0000 7fa6f5132800 20 add_watcher() i=0 2024-09-12T01:04:18.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.286+0000 7fa6f5132800 20 add_watcher() i=1 2024-09-12T01:04:18.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.286+0000 7fa6f5132800 20 add_watcher() i=2 2024-09-12T01:04:18.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.286+0000 7fa6f5132800 20 add_watcher() i=3 2024-09-12T01:04:18.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.286+0000 7fa6f5132800 20 add_watcher() i=4 2024-09-12T01:04:18.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.286+0000 7fa6f5132800 20 add_watcher() i=5 2024-09-12T01:04:18.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.286+0000 7fa6f5132800 20 add_watcher() i=6 2024-09-12T01:04:18.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.287+0000 7fa6f5132800 20 add_watcher() i=7 2024-09-12T01:04:18.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.287+0000 7fa6f5132800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:18.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.289+0000 7fa5a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:18.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.289+0000 7fa6f5132800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:18.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.289+0000 7fa6f5132800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:18.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.289+0000 7fa6f5132800 5 note: GC not initialized 2024-09-12T01:04:18.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.289+0000 7fa5a5fe3640 20 reqs_thread_entry: start 2024-09-12T01:04:18.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.290+0000 7fa6f5132800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:18.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.290+0000 7fa6f5132800 20 Filter name: none 2024-09-12T01:04:18.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.290+0000 7fa5177fe640 20 reqs_thread_entry: start 2024-09-12T01:04:18.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.290+0000 7fa6f5132800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T01:04:18.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.290+0000 7fa6f5132800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.290+0000 7fa6f5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.290+0000 7fa6f5132800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T01:04:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.290+0000 7fa6f5132800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:04:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.290+0000 7fa6f5132800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T01:04:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.290+0000 7fa6f5132800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T01:04:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T01:04:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 10 cache get: name=default.rgw.meta+users.keys+WVZDFZFGJZOPLXSKAGLL : miss 2024-09-12T01:04:18.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 10 cache put: name=default.rgw.meta+users.keys+WVZDFZFGJZOPLXSKAGLL info.flags=0x0 2024-09-12T01:04:18.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 10 adding default.rgw.meta+users.keys+WVZDFZFGJZOPLXSKAGLL to cache LRU end 2024-09-12T01:04:18.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T01:04:18.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T01:04:18.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T01:04:18.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T01:04:18.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:18.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 10 cache get: name=default.rgw.meta+users.keys+WVZDFZFGJZOPLXSKAGLL : hit (negative entry) 2024-09-12T01:04:18.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.291+0000 7fa6f5132800 10 cache get: name=default.rgw.meta+users.keys+WVZDFZFGJZOPLXSKAGLL : hit (negative entry) 2024-09-12T01:04:18.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.293+0000 7fa6f5132800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:04:18.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.293+0000 7fa6f5132800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:04:18.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.293+0000 7fa6f5132800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T01:04:18.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.293+0000 7fa5c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333718 cookie 94824355645296 notifier 8735 bl.length()=681 2024-09-12T01:04:18.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.293+0000 7fa5c7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:04:18.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.293+0000 7fa5c7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:04:18.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.296+0000 7fa6f5132800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T01:04:18.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.296+0000 7fa6f5132800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T01:04:18.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.296+0000 7fa6f5132800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T01:04:18.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.297+0000 7fa5c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333728 cookie 94824355720368 notifier 8735 bl.length()=189 2024-09-12T01:04:18.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.297+0000 7fa5c7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T01:04:18.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.297+0000 7fa5c7fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T01:04:18.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.299+0000 7fa6f5132800 10 cache put: name=default.rgw.meta+users.keys+WVZDFZFGJZOPLXSKAGLL info.flags=0x7 2024-09-12T01:04:18.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.299+0000 7fa6f5132800 10 moving default.rgw.meta+users.keys+WVZDFZFGJZOPLXSKAGLL to cache LRU end 2024-09-12T01:04:18.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.299+0000 7fa6f5132800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:WVZDFZFGJZOPLXSKAGLL, ofs0, ns] 2024-09-12T01:04:18.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.300+0000 7fa5c7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333729 cookie 94824355724320 notifier 8735 bl.length()=188 2024-09-12T01:04:18.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.300+0000 7fa5c7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WVZDFZFGJZOPLXSKAGLL info.flags=0x7 2024-09-12T01:04:18.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.300+0000 7fa5c7fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WVZDFZFGJZOPLXSKAGLL to cache LRU end 2024-09-12T01:04:18.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.302+0000 7fa6f5132800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T01:04:18.301 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:04:18.302 INFO:teuthology.orchestra.run.smithi062.stdout: "user_id": "root2.client.0", 2024-09-12T01:04:18.302 INFO:teuthology.orchestra.run.smithi062.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T01:04:18.302 INFO:teuthology.orchestra.run.smithi062.stdout: "email": "root2+test@test.test", 2024-09-12T01:04:18.302 INFO:teuthology.orchestra.run.smithi062.stdout: "suspended": 0, 2024-09-12T01:04:18.302 INFO:teuthology.orchestra.run.smithi062.stdout: "max_buckets": 1000, 2024-09-12T01:04:18.302 INFO:teuthology.orchestra.run.smithi062.stdout: "subusers": [], 2024-09-12T01:04:18.302 INFO:teuthology.orchestra.run.smithi062.stdout: "keys": [ 2024-09-12T01:04:18.302 INFO:teuthology.orchestra.run.smithi062.stdout: { 2024-09-12T01:04:18.302 INFO:teuthology.orchestra.run.smithi062.stdout: "user": "root2.client.0", 2024-09-12T01:04:18.302 INFO:teuthology.orchestra.run.smithi062.stdout: "access_key": "WVZDFZFGJZOPLXSKAGLL", 2024-09-12T01:04:18.302 INFO:teuthology.orchestra.run.smithi062.stdout: "secret_key": "NmV8XjtiPBtRa9PtiSJuavbjrIiMKO508TYxj85xBFRVIl+jujvxjA==", 2024-09-12T01:04:18.303 INFO:teuthology.orchestra.run.smithi062.stdout: "active": true, 2024-09-12T01:04:18.303 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T01:04:18.292832Z" 2024-09-12T01:04:18.303 INFO:teuthology.orchestra.run.smithi062.stdout: } 2024-09-12T01:04:18.303 INFO:teuthology.orchestra.run.smithi062.stdout: ], 2024-09-12T01:04:18.303 INFO:teuthology.orchestra.run.smithi062.stdout: "swift_keys": [], 2024-09-12T01:04:18.303 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": [], 2024-09-12T01:04:18.303 INFO:teuthology.orchestra.run.smithi062.stdout: "op_mask": "read, write, delete", 2024-09-12T01:04:18.303 INFO:teuthology.orchestra.run.smithi062.stdout: "default_placement": "", 2024-09-12T01:04:18.303 INFO:teuthology.orchestra.run.smithi062.stdout: "default_storage_class": "", 2024-09-12T01:04:18.303 INFO:teuthology.orchestra.run.smithi062.stdout: "placement_tags": [], 2024-09-12T01:04:18.303 INFO:teuthology.orchestra.run.smithi062.stdout: "bucket_quota": { 2024-09-12T01:04:18.303 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:18.303 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: "user_quota": { 2024-09-12T01:04:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: "enabled": false, 2024-09-12T01:04:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: "check_on_raw": false, 2024-09-12T01:04:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size": -1, 2024-09-12T01:04:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: "max_size_kb": 0, 2024-09-12T01:04:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: "max_objects": -1 2024-09-12T01:04:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2024-09-12T01:04:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: "temp_url_keys": [], 2024-09-12T01:04:18.304 INFO:teuthology.orchestra.run.smithi062.stdout: "type": "root", 2024-09-12T01:04:18.305 INFO:teuthology.orchestra.run.smithi062.stdout: "mfa_ids": [], 2024-09-12T01:04:18.305 INFO:teuthology.orchestra.run.smithi062.stdout: "account_id": "RGW99999999999999999", 2024-09-12T01:04:18.305 INFO:teuthology.orchestra.run.smithi062.stdout: "path": "/", 2024-09-12T01:04:18.305 INFO:teuthology.orchestra.run.smithi062.stdout: "create_date": "2024-09-12T01:04:18.292820Z", 2024-09-12T01:04:18.305 INFO:teuthology.orchestra.run.smithi062.stdout: "tags": [], 2024-09-12T01:04:18.305 INFO:teuthology.orchestra.run.smithi062.stdout: "group_ids": [] 2024-09-12T01:04:18.305 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:04:18.305 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:04:18.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.303+0000 7fa5a6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:18.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.306+0000 7fa6f5132800 20 remove_watcher() i=0 2024-09-12T01:04:18.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.306+0000 7fa6f5132800 2 removed watcher, disabling cache 2024-09-12T01:04:18.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.307+0000 7fa6f5132800 20 remove_watcher() i=1 2024-09-12T01:04:18.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.308+0000 7fa6f5132800 20 remove_watcher() i=2 2024-09-12T01:04:18.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.309+0000 7fa6f5132800 20 remove_watcher() i=3 2024-09-12T01:04:18.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.310+0000 7fa6f5132800 20 remove_watcher() i=4 2024-09-12T01:04:18.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.311+0000 7fa6f5132800 20 remove_watcher() i=5 2024-09-12T01:04:18.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.312+0000 7fa6f5132800 20 remove_watcher() i=6 2024-09-12T01:04:18.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.313+0000 7fa6f5132800 20 remove_watcher() i=7 2024-09-12T01:04:18.324 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 8985312719 --totp-seed DLIXE5QEUEDZO2H5UCGDNX4LEK55UH2T2IVRGJPSZXKABSJJIV4MDLKGX6LD745K --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:04:18.392 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:04:18.392 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:04:18.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.429+0000 7f2c35335800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.431+0000 7f2c35335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.431+0000 7f2c35335800 20 realm 2024-09-12T01:04:18.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.431+0000 7f2c35335800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.431+0000 7f2c35335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.431+0000 7f2c35335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:04:18.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.431+0000 7f2c35335800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.431+0000 7f2c35335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.431+0000 7f2c35335800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.432+0000 7f2c35335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:18.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.432+0000 7f2c35335800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.433+0000 7f2c35335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:04:18.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.433+0000 7f2c35335800 20 searching for the correct realm 2024-09-12T01:04:18.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.436+0000 7f2c308e3640 0 -- 172.21.15.62:0/2064228433 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f2c2c036430 msgr2=0x7f2c2c0368b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:04:18.640 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.641+0000 7f2c310e4640 0 -- 172.21.15.62:0/2064228433 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f2c2c046400 msgr2=0x7f2c2c046860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:04:18.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.849+0000 7f2c35335800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:04:18.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.849+0000 7f2c35335800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:04:18.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.849+0000 7f2c35335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:04:18.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.849+0000 7f2c35335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:04:18.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.849+0000 7f2c35335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:04:18.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.849+0000 7f2c35335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:04:18.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.849+0000 7f2c35335800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.850+0000 7f2c35335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.850+0000 7f2c35335800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.850+0000 7f2c35335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:04:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.850+0000 7f2c35335800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.850+0000 7f2c35335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:04:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.850+0000 7f2c35335800 20 zone default found 2024-09-12T01:04:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.851+0000 7f2c35335800 4 Realm: () 2024-09-12T01:04:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.851+0000 7f2c35335800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:04:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.851+0000 7f2c35335800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:04:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.851+0000 7f2c35335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:04:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.851+0000 7f2c35335800 20 zonegroup default 2024-09-12T01:04:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.851+0000 7f2c35335800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.851+0000 7f2c35335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.851+0000 7f2c35335800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.851+0000 7f2c35335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.851+0000 7f2c35335800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.852+0000 7f2c35335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:04:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.852+0000 7f2c35335800 20 started sync module instance, tier type = 2024-09-12T01:04:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.852+0000 7f2c35335800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:04:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.863+0000 7f2c35335800 20 add_watcher() i=0 2024-09-12T01:04:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.863+0000 7f2c35335800 20 add_watcher() i=1 2024-09-12T01:04:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.863+0000 7f2c35335800 20 add_watcher() i=2 2024-09-12T01:04:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.863+0000 7f2c35335800 20 add_watcher() i=3 2024-09-12T01:04:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.863+0000 7f2c35335800 20 add_watcher() i=4 2024-09-12T01:04:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.863+0000 7f2c35335800 20 add_watcher() i=5 2024-09-12T01:04:18.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.863+0000 7f2c35335800 20 add_watcher() i=6 2024-09-12T01:04:18.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.864+0000 7f2c35335800 20 add_watcher() i=7 2024-09-12T01:04:18.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.864+0000 7f2c35335800 2 all 8 watchers are set, enabling cache 2024-09-12T01:04:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.866+0000 7f2ae7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.866+0000 7f2c35335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:04:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.866+0000 7f2c35335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:04:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.866+0000 7f2c35335800 5 note: GC not initialized 2024-09-12T01:04:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.867+0000 7f2ae6fe5640 20 reqs_thread_entry: start 2024-09-12T01:04:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.867+0000 7f2c35335800 20 init_complete bucket index max shards: 1 2024-09-12T01:04:18.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.867+0000 7f2c35335800 20 Filter name: none 2024-09-12T01:04:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.867+0000 7f2ae4fe1640 20 reqs_thread_entry: start 2024-09-12T01:04:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.867+0000 7f2c35335800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T01:04:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.867+0000 7f2c35335800 20 rados->read ofs=0 len=0 2024-09-12T01:04:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.868+0000 7f2c35335800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T01:04:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.868+0000 7f2c35335800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T01:04:18.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.868+0000 7f2c35335800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:04:18.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.868+0000 7f2c35335800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:04:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.871+0000 7f2c35335800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:04:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.871+0000 7f2c35335800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:04:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.871+0000 7f2c35335800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T01:04:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.871+0000 7f2b14ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333719 cookie 93913630165872 notifier 8753 bl.length()=695 2024-09-12T01:04:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.871+0000 7f2b14ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:04:18.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.871+0000 7f2b14ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:04:18.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.874+0000 7f2ae7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:04:18.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.876+0000 7f2c35335800 20 remove_watcher() i=0 2024-09-12T01:04:18.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.876+0000 7f2c35335800 2 removed watcher, disabling cache 2024-09-12T01:04:18.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.878+0000 7f2c35335800 20 remove_watcher() i=1 2024-09-12T01:04:18.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.879+0000 7f2c35335800 20 remove_watcher() i=2 2024-09-12T01:04:18.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.880+0000 7f2c35335800 20 remove_watcher() i=3 2024-09-12T01:04:18.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.881+0000 7f2c35335800 20 remove_watcher() i=4 2024-09-12T01:04:18.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.882+0000 7f2c35335800 20 remove_watcher() i=5 2024-09-12T01:04:18.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.884+0000 7f2c35335800 20 remove_watcher() i=6 2024-09-12T01:04:18.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:04:18.885+0000 7f2c35335800 20 remove_watcher() i=7 2024-09-12T01:04:18.897 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T01:04:18.898 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:04:18.898 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T01:04:18.930 INFO:tasks.s3tests:Configuring boto... 2024-09-12T01:04:18.930 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:04:18.930 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T01:04:19.001 DEBUG:teuthology.orchestra.run.smithi062:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T01:04:19.191 INFO:teuthology.orchestra.run.smithi062.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T01:04:19.378 INFO:teuthology.orchestra.run.smithi062.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T01:04:19.661 INFO:teuthology.orchestra.run.smithi062.stdout:py installdeps: -rrequirements.txt 2024-09-12T01:06:24.970 INFO:teuthology.orchestra.run.smithi062.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T01:06:26.444 INFO:teuthology.orchestra.run.smithi062.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=34e5cb6f5515369789319e0c433625886dd5d47c7a8a79fac7d9e7437f2f20d4,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T01:06:26.444 INFO:teuthology.orchestra.run.smithi062.stdout:py run-test-pre: PYTHONHASHSEED='64650001' 2024-09-12T01:06:26.444 INFO:teuthology.orchestra.run.smithi062.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T01:06:26.584 INFO:teuthology.orchestra.run.smithi062.stdout:============================= test session starts ============================== 2024-09-12T01:06:26.584 INFO:teuthology.orchestra.run.smithi062.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T01:06:26.584 INFO:teuthology.orchestra.run.smithi062.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T01:06:26.584 INFO:teuthology.orchestra.run.smithi062.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:06:26.584 INFO:teuthology.orchestra.run.smithi062.stdout:configfile: pytest.ini 2024-09-12T01:06:28.409 INFO:teuthology.orchestra.run.smithi062.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T01:06:28.409 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:06:28.714 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T01:06:28.955 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T01:06:29.250 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T01:06:29.547 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T01:06:29.780 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T01:06:30.047 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T01:06:30.400 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T01:06:30.622 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T01:06:30.744 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T01:06:30.867 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T01:06:31.102 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T01:06:31.343 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T01:06:31.572 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T01:06:31.812 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T01:06:31.941 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T01:06:32.067 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T01:06:32.146 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T01:06:32.223 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T01:06:32.301 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T01:06:32.378 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T01:06:32.455 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T01:06:32.533 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T01:06:32.612 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T01:06:32.690 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T01:06:32.767 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T01:06:32.843 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T01:06:32.921 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T01:06:32.999 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T01:06:33.077 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T01:06:33.156 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T01:06:33.234 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T01:06:33.311 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T01:06:33.388 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T01:06:33.466 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T01:06:33.544 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T01:06:33.622 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T01:06:33.700 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T01:06:33.778 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T01:06:33.856 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T01:06:33.935 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T01:06:34.013 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T01:06:34.091 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T01:06:34.169 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T01:06:34.248 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T01:06:34.326 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T01:06:34.405 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T01:06:34.483 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T01:06:34.559 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T01:06:34.637 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T01:06:34.715 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T01:06:34.792 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T01:06:34.870 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T01:06:34.949 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T01:06:35.454 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T01:06:38.332 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T01:06:42.352 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T01:06:47.044 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T01:06:54.128 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T01:06:56.680 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T01:06:59.507 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T01:07:00.256 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T01:07:00.449 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T01:07:00.774 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T01:07:01.089 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T01:07:01.739 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T01:07:02.082 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T01:07:02.269 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T01:07:02.270 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T01:07:02.271 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T01:07:02.272 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T01:07:02.273 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T01:07:02.273 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T01:07:02.274 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T01:07:02.275 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T01:07:02.276 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T01:07:02.277 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T01:07:02.278 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T01:07:02.278 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:07:02.279 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T01:07:02.280 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:07:02.281 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:07:02.282 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:07:02.282 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:07:02.283 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:07:02.284 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:07:02.285 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:07:02.286 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T01:07:02.287 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T01:07:02.287 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T01:07:02.288 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T01:07:02.289 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T01:07:02.290 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T01:07:02.290 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T01:07:02.291 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T01:07:02.380 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T01:07:02.392 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T01:07:03.025 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T01:07:05.309 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T01:07:05.755 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T01:07:06.286 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T01:07:06.819 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T01:07:07.361 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T01:07:07.889 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T01:07:08.279 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T01:07:08.838 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T01:07:09.329 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T01:07:09.812 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T01:07:10.221 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T01:07:10.601 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T01:07:10.988 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T01:07:11.208 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T01:07:11.649 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T01:07:12.157 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T01:07:12.704 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T01:07:13.112 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T01:07:13.507 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T01:07:13.906 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T01:07:14.305 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T01:07:14.709 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T01:07:15.084 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T01:07:15.460 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T01:07:15.688 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T01:07:15.950 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T01:07:16.183 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T01:07:16.412 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T01:07:16.639 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T01:07:17.120 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T01:07:17.365 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T01:07:17.635 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T01:07:18.061 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T01:07:18.468 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T01:07:18.705 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T01:07:19.149 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T01:07:19.553 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T01:07:20.127 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T01:07:20.475 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T01:07:20.876 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T01:07:21.287 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T01:07:22.029 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T01:07:22.579 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T01:07:23.068 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T01:07:23.704 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:07:24.452 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:07:25.621 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:07:27.257 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:07:27.995 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:07:28.738 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:07:29.284 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T01:07:30.029 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T01:07:30.482 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T01:07:31.821 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T01:07:32.653 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T01:07:33.686 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T01:07:35.903 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T01:07:38.877 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T01:07:40.481 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T01:07:41.957 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T01:07:43.062 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T01:07:43.717 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T01:07:45.029 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T01:07:45.912 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T01:07:47.145 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T01:07:47.964 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T01:07:49.586 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T01:07:50.743 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T01:07:52.585 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T01:07:54.382 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T01:07:55.576 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T01:07:56.657 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T01:07:57.504 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T01:07:59.711 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T01:08:01.267 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T01:08:03.097 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T01:08:04.857 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T01:08:06.457 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T01:08:08.062 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T01:08:09.381 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T01:08:10.269 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T01:08:11.300 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T01:08:13.312 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T01:08:15.991 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T01:08:17.085 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T01:08:18.736 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T01:08:20.397 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T01:08:21.920 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T01:08:23.476 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T01:08:25.125 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T01:08:26.686 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T01:08:28.191 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T01:08:29.222 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T01:08:30.060 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T01:08:30.868 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T01:08:31.682 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T01:08:33.663 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T01:08:35.111 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T01:08:36.549 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T01:08:37.918 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T01:08:39.373 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T01:08:40.742 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T01:08:42.163 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T01:08:43.597 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T01:08:44.952 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T01:08:46.388 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T01:08:47.750 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T01:08:49.182 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T01:08:50.085 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T01:08:50.939 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T01:08:51.741 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T01:08:52.542 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T01:08:53.071 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T01:08:53.796 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T01:08:54.466 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T01:08:55.123 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T01:08:55.814 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T01:08:56.456 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T01:08:57.093 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T01:08:57.728 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T01:08:58.407 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T01:08:59.301 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T01:09:00.208 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T01:09:00.717 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T01:09:01.227 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T01:09:01.896 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T01:09:02.530 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T01:09:03.426 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T01:09:04.337 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T01:09:04.971 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T01:09:05.606 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T01:09:06.274 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T01:09:06.906 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T01:09:07.554 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T01:09:08.196 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T01:09:08.838 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T01:09:09.493 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T01:09:10.162 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T01:09:10.799 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T01:09:11.438 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T01:09:12.080 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T01:09:12.668 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T01:09:13.259 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T01:09:13.861 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T01:09:14.551 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T01:09:15.194 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T01:10:06.965 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T01:10:07.594 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T01:10:08.184 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T01:10:08.778 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T01:10:09.362 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T01:10:09.962 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T01:10:10.550 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T01:10:11.134 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T01:10:11.759 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T01:10:12.347 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T01:10:12.936 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T01:10:13.523 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T01:10:14.107 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T01:10:14.759 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T01:10:15.390 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T01:10:16.061 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T01:10:16.700 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T01:10:17.331 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T01:10:18.096 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T01:10:18.734 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:10:19.368 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:10:20.016 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:10:20.684 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:10:21.382 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T01:10:22.085 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T01:10:22.725 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T01:10:23.356 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T01:10:23.993 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T01:10:24.700 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T01:10:24.958 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T01:10:25.476 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T01:10:27.458 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T01:10:29.460 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T01:10:30.120 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T01:10:30.795 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T01:10:31.439 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T01:10:32.077 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T01:10:32.782 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T01:10:33.483 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T01:10:34.118 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T01:10:34.777 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T01:10:35.449 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T01:10:36.085 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T01:10:36.725 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T01:10:37.360 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T01:10:38.247 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T01:10:39.382 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T01:10:39.866 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T01:10:40.297 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T01:10:40.699 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T01:10:41.096 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T01:10:41.334 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T01:10:41.574 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T01:10:41.815 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T01:10:42.331 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T01:10:44.018 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T01:10:44.291 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T01:10:44.813 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T01:10:45.191 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T01:10:45.602 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T01:10:46.012 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T01:10:47.916 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T01:10:48.686 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T01:10:49.489 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T01:11:41.878 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T01:12:34.843 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T01:12:35.363 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T01:12:35.843 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T01:12:36.350 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T01:12:36.855 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T01:12:37.492 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T01:12:38.011 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T01:12:38.570 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T01:12:39.164 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T01:12:39.729 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T01:12:40.303 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T01:12:40.866 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T01:12:41.489 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T01:12:41.998 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T01:12:42.402 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T01:12:42.889 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T01:12:43.402 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T01:12:44.201 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T01:12:44.718 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T01:12:45.198 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T01:12:45.702 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T01:12:46.221 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T01:12:46.793 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T01:12:47.193 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T01:12:47.602 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T01:12:48.051 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T01:12:48.450 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T01:12:48.850 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T01:12:49.253 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T01:12:49.769 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T01:12:50.176 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T01:12:50.604 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T01:12:51.012 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T01:12:51.418 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T01:12:52.030 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T01:12:52.443 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T01:12:52.857 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T01:12:53.261 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T01:12:53.678 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T01:12:54.086 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T01:12:54.494 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T01:12:54.916 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T01:12:56.014 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T01:12:56.455 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T01:12:57.013 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T01:12:57.567 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T01:12:58.079 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T01:12:58.638 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T01:12:59.194 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T01:13:00.766 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T01:13:01.315 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T01:13:02.111 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T01:13:02.594 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T01:13:03.291 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T01:13:03.961 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T01:13:04.484 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T01:13:05.151 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T01:13:05.862 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T01:13:06.416 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T01:13:07.146 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T01:13:07.648 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T01:13:08.051 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T01:13:08.456 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T01:13:08.929 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T01:13:09.338 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T01:13:09.576 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T01:13:10.250 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T01:13:10.768 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T01:13:11.310 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T01:13:14.266 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T01:13:14.774 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T01:13:15.286 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T01:13:15.810 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T01:13:16.317 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T01:13:16.767 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T01:13:17.285 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T01:13:17.863 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T01:13:18.394 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T01:13:18.892 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T01:13:19.387 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T01:13:19.883 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T01:13:20.379 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T01:13:20.918 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T01:13:21.404 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T01:13:21.955 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T01:13:22.461 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T01:13:22.960 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T01:13:23.201 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T01:13:23.442 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T01:13:23.679 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T01:13:24.062 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T01:13:24.440 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T01:13:24.820 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T01:13:25.204 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T01:13:25.650 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T01:13:25.910 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T01:13:26.145 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T01:13:26.560 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T01:13:26.798 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T01:13:27.031 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T01:13:27.274 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T01:13:27.509 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T01:13:27.942 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T01:13:28.391 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T01:13:28.797 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T01:13:29.244 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T01:13:29.685 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T01:13:30.129 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T01:13:30.566 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T01:13:31.094 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T01:13:31.537 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T01:13:31.978 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T01:13:32.530 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T01:13:33.082 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T01:13:33.730 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T01:13:34.281 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T01:13:34.828 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T01:13:35.484 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T01:13:36.117 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T01:13:36.763 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T01:13:37.368 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T01:13:37.792 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T01:13:38.438 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T01:13:39.080 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T01:13:39.733 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T01:13:40.379 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T01:13:41.061 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T01:13:41.770 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T01:13:42.373 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T01:13:42.964 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T01:13:43.639 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T01:13:44.255 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T01:13:44.735 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T01:13:45.295 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T01:13:45.908 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T01:13:46.410 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T01:13:46.845 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T01:13:47.508 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T01:13:48.351 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T01:13:49.236 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T01:13:50.089 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T01:13:50.963 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T01:13:51.814 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T01:13:52.679 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T01:13:53.536 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T01:13:54.437 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T01:13:55.293 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T01:13:56.180 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T01:13:57.059 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T01:13:57.938 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T01:13:59.057 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T01:14:00.181 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T01:14:00.407 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T01:14:00.645 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T01:14:00.876 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T01:14:01.326 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T01:14:01.750 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T01:14:02.129 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T01:14:02.512 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T01:14:03.146 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T01:14:05.389 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T01:14:06.140 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T01:14:06.798 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T01:14:09.719 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T01:14:10.380 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T01:14:11.067 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T01:14:11.646 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T01:14:12.291 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T01:14:13.182 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T01:14:13.855 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T01:14:14.598 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T01:14:15.317 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T01:14:16.528 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T01:14:17.696 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T01:14:18.106 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T01:14:18.516 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T01:14:20.465 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T01:14:21.268 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T01:14:29.723 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T01:14:30.190 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T01:14:30.882 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T01:14:33.066 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T01:14:33.723 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T01:14:34.828 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T01:14:40.896 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T01:14:48.796 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T01:15:03.743 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T01:15:55.823 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T01:16:03.137 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T01:16:17.783 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T01:16:18.973 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T01:16:22.177 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T01:16:25.841 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T01:16:27.679 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T01:16:28.230 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T01:16:31.169 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T01:16:31.845 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T01:16:32.615 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T01:16:33.962 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T01:16:50.251 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T01:16:53.133 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T01:16:53.758 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T01:16:54.192 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T01:16:54.811 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T01:16:58.713 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T01:17:02.196 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T01:17:05.664 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T01:17:06.214 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T01:17:06.800 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T01:17:07.347 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T01:17:07.899 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T01:17:08.466 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T01:17:09.009 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T01:17:09.599 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T01:17:10.544 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T01:17:12.284 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T01:17:15.846 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T01:17:17.153 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T01:17:19.256 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T01:17:22.557 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T01:17:23.847 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T01:17:27.330 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T01:17:32.757 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T01:17:33.859 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T01:17:34.585 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T01:17:35.594 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T01:17:36.178 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T01:17:42.000 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T01:17:42.590 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T01:17:43.143 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T01:17:43.696 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T01:17:44.245 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T01:17:45.012 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T01:17:56.733 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T01:17:57.855 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T01:17:58.567 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T01:17:59.576 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T01:18:00.579 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T01:18:05.428 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T01:18:06.448 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T01:18:12.320 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T01:18:34.334 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T01:18:46.331 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T01:18:48.904 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T01:18:51.086 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T01:18:51.960 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T01:18:52.938 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T01:18:53.576 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T01:18:54.708 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T01:18:55.693 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T01:18:57.451 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T01:18:57.935 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T01:18:58.439 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T01:18:58.926 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T01:18:59.343 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T01:18:59.751 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T01:19:00.283 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T01:19:00.762 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T01:19:01.174 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T01:19:01.752 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T01:19:02.177 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T01:19:02.641 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T01:19:03.072 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T01:19:03.505 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T01:19:03.920 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T01:19:04.496 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T01:19:05.101 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T01:19:05.923 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T01:19:06.489 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T01:19:07.057 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T01:19:07.624 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T01:19:08.196 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T01:19:08.647 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T01:19:09.102 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T01:19:09.595 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T01:19:10.053 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T01:19:39.177 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T01:20:08.157 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T01:20:15.936 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T01:20:16.469 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T01:21:17.493 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T01:22:18.986 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T01:22:19.617 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T01:22:20.180 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T01:22:20.635 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T01:22:21.080 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T01:22:41.547 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T01:22:48.356 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T01:22:55.188 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T01:22:55.705 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T01:22:56.299 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T01:22:56.869 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T01:22:57.728 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T01:22:58.283 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T01:22:58.839 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T01:22:59.393 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T01:22:59.947 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T01:23:00.587 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T01:23:01.262 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T01:23:01.817 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T01:23:02.370 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T01:23:03.360 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T01:23:04.306 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T01:23:05.837 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T01:23:07.797 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T01:23:09.815 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T01:23:11.249 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T01:23:12.774 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T01:23:14.205 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T01:23:15.646 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T01:23:17.191 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T01:23:18.763 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T01:23:19.416 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T01:23:19.936 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T01:23:20.555 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T01:23:22.005 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T01:23:23.492 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T01:23:25.550 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T01:23:26.819 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T01:23:40.339 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T01:23:41.201 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T01:23:42.166 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:23:43.077 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:23:44.304 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T01:23:45.377 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T01:23:45.979 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T01:23:46.940 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T01:23:47.347 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T01:23:47.754 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T01:23:48.156 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T01:23:48.568 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T01:23:49.147 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T01:23:49.663 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T01:23:50.616 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T01:23:51.133 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T01:23:51.579 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T01:23:52.234 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T01:23:52.681 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T01:23:53.127 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T01:23:53.631 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T01:23:54.099 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T01:23:54.588 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T01:23:55.064 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T01:23:55.507 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T01:23:56.136 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T01:23:56.686 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T01:23:57.328 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T01:23:57.934 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T01:23:58.501 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T01:23:59.071 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T01:23:59.781 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T01:24:00.453 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T01:24:01.099 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T01:24:01.702 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T01:24:02.363 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T01:24:02.965 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:24:03.700 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T01:24:04.481 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T01:24:05.141 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:24:05.723 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T01:24:06.322 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T01:24:06.889 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T01:24:07.604 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T01:24:08.155 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T01:24:08.790 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:24:09.605 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:24:10.133 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T01:24:10.765 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T01:24:11.334 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T01:24:21.730 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T01:24:22.351 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T01:24:32.351 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T01:24:32.988 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T01:24:33.635 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T01:24:34.088 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T01:24:34.562 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:24:35.041 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:24:35.547 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:24:36.058 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T01:24:36.577 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T01:24:36.992 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T01:24:37.476 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T01:24:38.057 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T01:24:38.532 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T01:24:39.229 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T01:24:39.818 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T01:24:40.302 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T01:24:40.801 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T01:24:41.520 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T01:24:48.741 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T01:24:49.167 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:24:49.705 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:24:50.255 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:24:50.808 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T01:24:52.181 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T01:24:52.784 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T01:24:53.928 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T01:24:57.355 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T01:24:58.364 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T01:25:03.208 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T01:25:07.385 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T01:25:07.801 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T01:25:08.403 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T01:25:22.373 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T01:25:44.338 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T01:25:47.146 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T01:25:48.703 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T01:25:51.566 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T01:25:53.089 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T01:25:53.544 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T01:25:57.354 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T01:26:01.913 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T01:26:19.237 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T01:26:24.297 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T01:26:26.115 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T01:26:27.660 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T01:26:28.263 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T01:26:33.501 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T01:26:36.582 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T01:26:37.182 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T01:26:38.239 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T01:26:44.214 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T01:26:47.432 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T01:26:51.824 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T01:26:53.326 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T01:26:53.544 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T01:26:56.884 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T01:27:00.252 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T01:27:02.286 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T01:27:05.868 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T01:27:07.443 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T01:27:45.205 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T01:27:45.464 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T01:27:46.436 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T01:27:47.177 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T01:27:47.874 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T01:27:48.729 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T01:27:48.746 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T01:27:48.746 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.746 INFO:teuthology.orchestra.run.smithi062.stdout:=============================== warnings summary =============================== 2024-09-12T01:27:48.746 INFO:teuthology.orchestra.run.smithi062.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T01:27:48.746 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T01:27:48.746 INFO:teuthology.orchestra.run.smithi062.stdout: import imp 2024-09-12T01:27:48.746 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.746 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py:120 2024-09-12T01:27:48.747 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:27:48.747 INFO:teuthology.orchestra.run.smithi062.stdout: if boto_type is 'S3Connection': 2024-09-12T01:27:48.747 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.747 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_headers.py:124 2024-09-12T01:27:48.747 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:27:48.747 INFO:teuthology.orchestra.run.smithi062.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T01:27:48.747 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.747 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3.py:359 2024-09-12T01:27:48.747 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-12T01:27:48.747 INFO:teuthology.orchestra.run.smithi062.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T01:27:48.747 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.747 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T01:27:48.748 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:27:48.748 INFO:teuthology.orchestra.run.smithi062.stdout: if k is 'BucketName': 2024-09-12T01:27:48.748 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.748 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T01:27:48.748 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T01:27:48.748 INFO:teuthology.orchestra.run.smithi062.stdout: @pytest.mark.timeout(10) 2024-09-12T01:27:48.748 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.748 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T01:27:48.748 INFO:teuthology.orchestra.run.smithi062.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T01:27:48.748 INFO:teuthology.orchestra.run.smithi062.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T01:27:48.748 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.748 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T01:27:48.749 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:27:48.749 INFO:teuthology.orchestra.run.smithi062.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:27:48.749 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.749 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T01:27:48.749 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:27:48.749 INFO:teuthology.orchestra.run.smithi062.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:27:48.749 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.749 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T01:27:48.749 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:27:48.749 INFO:teuthology.orchestra.run.smithi062.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T01:27:48.749 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.749 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T01:27:48.749 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:27:48.750 INFO:teuthology.orchestra.run.smithi062.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:27:48.750 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.750 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T01:27:48.750 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:27:48.750 INFO:teuthology.orchestra.run.smithi062.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:27:48.750 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.750 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T01:27:48.750 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:27:48.750 INFO:teuthology.orchestra.run.smithi062.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:27:48.750 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.750 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T01:27:48.750 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:27:48.750 INFO:teuthology.orchestra.run.smithi062.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T01:27:48.751 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.751 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T01:27:48.751 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:27:48.751 INFO:teuthology.orchestra.run.smithi062.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:27:48.751 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.751 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T01:27:48.751 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:27:48.751 INFO:teuthology.orchestra.run.smithi062.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:27:48.751 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.751 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T01:27:48.752 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:27:48.752 INFO:teuthology.orchestra.run.smithi062.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:27:48.752 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.752 INFO:teuthology.orchestra.run.smithi062.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T01:27:48.752 INFO:teuthology.orchestra.run.smithi062.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:27:48.752 INFO:teuthology.orchestra.run.smithi062.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:27:48.752 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:27:48.752 INFO:teuthology.orchestra.run.smithi062.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T01:27:48.752 INFO:teuthology.orchestra.run.smithi062.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 1282.16s (0:21:22) = 2024-09-12T01:27:48.872 INFO:teuthology.orchestra.run.smithi062.stdout:___________________________________ summary ____________________________________ 2024-09-12T01:27:48.872 INFO:teuthology.orchestra.run.smithi062.stdout: py: commands succeeded 2024-09-12T01:27:48.873 INFO:teuthology.orchestra.run.smithi062.stdout: congratulations :) 2024-09-12T01:27:48.890 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T01:27:48.891 DEBUG:teuthology.orchestra.run.smithi062:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:27:49.004 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:27:49.005 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T01:27:49.005 DEBUG:teuthology.orchestra.run.smithi062:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T01:27:49.034 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T01:27:49.035 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:27:49.238 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T01:27:49.249 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:27:49.249 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T01:27:49.249 DEBUG:teuthology.orchestra.run.smithi062:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:27:49.278 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:27:49.278 INFO:teuthology.orchestra.run.smithi062.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T01:27:49.279 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:27:49.348 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T01:27:49.349 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T01:27:49.418 INFO:tasks.workunit:timeout=3h 2024-09-12T01:27:49.418 INFO:tasks.workunit:cleanup=True 2024-09-12T01:27:49.419 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:27:49.490 INFO:tasks.workunit.client.0.smithi062.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T01:28:36.099 INFO:tasks.workunit.client.0.smithi062.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T01:28:36.099 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T01:28:36.100 INFO:tasks.workunit.client.0.smithi062.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:28:36.100 INFO:tasks.workunit.client.0.smithi062.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:28:36.100 INFO:tasks.workunit.client.0.smithi062.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:28:36.100 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T01:28:36.100 INFO:tasks.workunit.client.0.smithi062.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:28:36.100 INFO:tasks.workunit.client.0.smithi062.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:28:36.100 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T01:28:36.100 INFO:tasks.workunit.client.0.smithi062.stderr: git switch -c 2024-09-12T01:28:36.100 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T01:28:36.100 INFO:tasks.workunit.client.0.smithi062.stderr:Or undo this operation with: 2024-09-12T01:28:36.100 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T01:28:36.101 INFO:tasks.workunit.client.0.smithi062.stderr: git switch - 2024-09-12T01:28:36.101 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T01:28:36.101 INFO:tasks.workunit.client.0.smithi062.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:28:36.101 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T01:28:36.101 INFO:tasks.workunit.client.0.smithi062.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T01:28:36.103 DEBUG:teuthology.orchestra.run.smithi062:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T01:28:36.174 INFO:tasks.workunit.client.0.smithi062.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T01:28:36.176 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:28:36.176 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T01:28:36.226 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T01:28:36.277 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T01:28:36.318 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:28:36.320 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:28:36.320 INFO:tasks.workunit.client.0.smithi062.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T01:28:36.360 INFO:tasks.workunit.client.0.smithi062.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:28:36.363 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2024-09-12T01:28:36.364 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T01:28:36.434 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T01:28:36.435 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T01:28:36.435 DEBUG:teuthology.orchestra.run.smithi062:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:28:36.508 INFO:tasks.workunit.client.0.smithi062.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:28:36.509 INFO:tasks.workunit.client.0.smithi062.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:28:36.509 INFO:tasks.workunit.client.0.smithi062.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:28:38.917 INFO:tasks.workunit.client.0.smithi062.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T01:28:38.917 INFO:tasks.workunit.client.0.smithi062.stderr:++ deactivate nondestructive 2024-09-12T01:28:38.917 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n '' ']' 2024-09-12T01:28:38.917 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n '' ']' 2024-09-12T01:28:38.917 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:28:38.918 INFO:tasks.workunit.client.0.smithi062.stderr:++ hash -r 2024-09-12T01:28:38.918 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n '' ']' 2024-09-12T01:28:38.918 INFO:tasks.workunit.client.0.smithi062.stderr:++ unset VIRTUAL_ENV 2024-09-12T01:28:38.918 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T01:28:38.918 INFO:tasks.workunit.client.0.smithi062.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:28:38.918 INFO:tasks.workunit.client.0.smithi062.stderr:++ export VIRTUAL_ENV 2024-09-12T01:28:38.918 INFO:tasks.workunit.client.0.smithi062.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:28:38.918 INFO:tasks.workunit.client.0.smithi062.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:28:38.918 INFO:tasks.workunit.client.0.smithi062.stderr:++ export PATH 2024-09-12T01:28:38.918 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n '' ']' 2024-09-12T01:28:38.918 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -z '' ']' 2024-09-12T01:28:38.918 INFO:tasks.workunit.client.0.smithi062.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T01:28:38.919 INFO:tasks.workunit.client.0.smithi062.stderr:++ PS1='(rgw) ' 2024-09-12T01:28:38.919 INFO:tasks.workunit.client.0.smithi062.stderr:++ export PS1 2024-09-12T01:28:38.919 INFO:tasks.workunit.client.0.smithi062.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:28:38.919 INFO:tasks.workunit.client.0.smithi062.stderr:++ hash -r 2024-09-12T01:28:38.919 INFO:tasks.workunit.client.0.smithi062.stderr:+ pip install pip --upgrade 2024-09-12T01:28:39.156 INFO:tasks.workunit.client.0.smithi062.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T01:28:39.346 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting pip 2024-09-12T01:28:39.352 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T01:28:39.398 INFO:tasks.workunit.client.0.smithi062.stdout:Installing collected packages: pip 2024-09-12T01:28:39.398 INFO:tasks.workunit.client.0.smithi062.stdout: Attempting uninstall: pip 2024-09-12T01:28:39.398 INFO:tasks.workunit.client.0.smithi062.stdout: Found existing installation: pip 21.3.1 2024-09-12T01:28:39.567 INFO:tasks.workunit.client.0.smithi062.stdout: Uninstalling pip-21.3.1: 2024-09-12T01:28:39.573 INFO:tasks.workunit.client.0.smithi062.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T01:28:40.352 INFO:tasks.workunit.client.0.smithi062.stdout:Successfully installed pip-24.2 2024-09-12T01:28:40.400 INFO:tasks.workunit.client.0.smithi062.stderr:+ pip install boto3 2024-09-12T01:28:41.215 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting boto3 2024-09-12T01:28:41.216 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T01:28:41.772 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T01:28:41.774 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T01:28:41.828 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T01:28:41.829 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T01:28:41.884 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T01:28:41.885 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T01:28:41.960 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:28:41.961 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T01:28:42.063 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:28:42.064 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T01:28:42.217 INFO:tasks.workunit.client.0.smithi062.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:28:42.218 INFO:tasks.workunit.client.0.smithi062.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T01:28:42.222 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T01:28:42.224 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T01:28:42.233 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T01:28:42.235 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T01:28:42.236 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T01:28:42.237 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T01:28:42.239 INFO:tasks.workunit.client.0.smithi062.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T01:28:42.315 INFO:tasks.workunit.client.0.smithi062.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T01:28:43.458 INFO:tasks.workunit.client.0.smithi062.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T01:28:43.578 INFO:tasks.workunit.client.0.smithi062.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T01:28:43.706 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T01:28:43.741 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:28:43.741 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:28:43.781 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:43.781+0000 7f8db9214800 20 rados->read ofs=0 len=0 2024-09-12T01:28:43.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:43.783+0000 7f8db9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:43.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:43.783+0000 7f8db9214800 20 realm 2024-09-12T01:28:43.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:43.783+0000 7f8db9214800 20 rados->read ofs=0 len=0 2024-09-12T01:28:43.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:43.784+0000 7f8db9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:43.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:43.784+0000 7f8db9214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:28:43.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:43.784+0000 7f8db9214800 20 rados->read ofs=0 len=0 2024-09-12T01:28:43.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:43.784+0000 7f8db9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:43.783 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:43.784+0000 7f8db9214800 20 rados->read ofs=0 len=0 2024-09-12T01:28:43.784 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:43.785+0000 7f8db9214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:28:43.784 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:43.785+0000 7f8db9214800 20 rados->read ofs=0 len=0 2024-09-12T01:28:43.784 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:43.785+0000 7f8db9214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:28:43.785 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:43.785+0000 7f8db9214800 20 searching for the correct realm 2024-09-12T01:28:43.788 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:43.789+0000 7f8db41df640 0 -- 172.21.15.62:0/2100072825 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f8dac091fc0 msgr2=0x7f8dac061650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:28:43.995 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:43.995+0000 7f8db41df640 0 -- 172.21.15.62:0/2100072825 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x5635918eaac0 msgr2=0x5635918ecee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:28:43.999 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.000+0000 7f8db9214800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:28:43.999 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.000+0000 7f8db9214800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:28:43.999 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.000+0000 7f8db9214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:28:43.999 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.000+0000 7f8db9214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:28:44.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.000+0000 7f8db9214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:28:44.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.000+0000 7f8db9214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:28:44.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.000+0000 7f8db9214800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.000+0000 7f8db9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:44.000 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.000+0000 7f8db9214800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.001+0000 7f8db9214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:28:44.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.001+0000 7f8db9214800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.001+0000 7f8db9214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:28:44.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.001+0000 7f8db9214800 20 zone default found 2024-09-12T01:28:44.001 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.001+0000 7f8db9214800 4 Realm: () 2024-09-12T01:28:44.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.001+0000 7f8db9214800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:28:44.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.001+0000 7f8db9214800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:28:44.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.001+0000 7f8db9214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:28:44.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.001+0000 7f8db9214800 20 zonegroup default 2024-09-12T01:28:44.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.001+0000 7f8db9214800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.001+0000 7f8db9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:44.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.001+0000 7f8db9214800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.001+0000 7f8db9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:44.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.002+0000 7f8db9214800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.002+0000 7f8db9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:44.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.002+0000 7f8db9214800 20 started sync module instance, tier type = 2024-09-12T01:28:44.002 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.002+0000 7f8db9214800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:28:44.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.012+0000 7f8db9214800 20 add_watcher() i=0 2024-09-12T01:28:44.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.012+0000 7f8db9214800 20 add_watcher() i=1 2024-09-12T01:28:44.011 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.012+0000 7f8db9214800 20 add_watcher() i=2 2024-09-12T01:28:44.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.012+0000 7f8db9214800 20 add_watcher() i=3 2024-09-12T01:28:44.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.012+0000 7f8db9214800 20 add_watcher() i=4 2024-09-12T01:28:44.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.012+0000 7f8db9214800 20 add_watcher() i=5 2024-09-12T01:28:44.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.012+0000 7f8db9214800 20 add_watcher() i=6 2024-09-12T01:28:44.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.013+0000 7f8db9214800 20 add_watcher() i=7 2024-09-12T01:28:44.012 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.013+0000 7f8db9214800 2 all 8 watchers are set, enabling cache 2024-09-12T01:28:44.014 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.015+0000 7f8c6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:28:44.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.016+0000 7f8db9214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:28:44.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.016+0000 7f8db9214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:28:44.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.016+0000 7f8db9214800 5 note: GC not initialized 2024-09-12T01:28:44.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.016+0000 7f8c6a7e4640 20 reqs_thread_entry: start 2024-09-12T01:28:44.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.016+0000 7f8db9214800 20 init_complete bucket index max shards: 1 2024-09-12T01:28:44.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.016+0000 7f8db9214800 20 Filter name: none 2024-09-12T01:28:44.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.016+0000 7f8c637fe640 20 reqs_thread_entry: start 2024-09-12T01:28:44.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.016+0000 7f8db9214800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T01:28:44.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.016+0000 7f8db9214800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.017+0000 7f8db9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:44.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.017+0000 7f8db9214800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T01:28:44.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.017+0000 7f8db9214800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:28:44.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.017+0000 7f8db9214800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T01:28:44.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.017+0000 7f8db9214800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.017+0000 7f8db9214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:44.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.017+0000 7f8db9214800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T01:28:44.018 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.017+0000 7f8db9214800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:28:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.017+0000 7f8db9214800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:28:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.017+0000 7f8db9214800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:28:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.019+0000 7f8db9214800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:28:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.019+0000 7f8db9214800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:28:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.019+0000 7f8db9214800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T01:28:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.019+0000 7f8c8bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166335339 cookie 94788075381312 notifier 8771 bl.length()=613 2024-09-12T01:28:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.019+0000 7f8c8bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:28:44.019 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.019+0000 7f8c8bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:28:44.021 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.022+0000 7f8db9214800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:28:44.021 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.022+0000 7f8db9214800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:28:44.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.022+0000 7f8db9214800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T01:28:44.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.023+0000 7f8c8bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166335340 cookie 94788075371264 notifier 8771 bl.length()=191 2024-09-12T01:28:44.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.023+0000 7f8c8bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:28:44.022 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.023+0000 7f8c8bfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:28:44.024 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.025+0000 7f8c6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:28:44.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.027+0000 7f8db9214800 20 remove_watcher() i=0 2024-09-12T01:28:44.027 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.027+0000 7f8db9214800 2 removed watcher, disabling cache 2024-09-12T01:28:44.028 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.028+0000 7f8db9214800 20 remove_watcher() i=1 2024-09-12T01:28:44.029 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.030+0000 7f8db9214800 20 remove_watcher() i=2 2024-09-12T01:28:44.030 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.031+0000 7f8db9214800 20 remove_watcher() i=3 2024-09-12T01:28:44.031 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.032+0000 7f8db9214800 20 remove_watcher() i=4 2024-09-12T01:28:44.032 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.033+0000 7f8db9214800 20 remove_watcher() i=5 2024-09-12T01:28:44.033 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.034+0000 7f8db9214800 20 remove_watcher() i=6 2024-09-12T01:28:44.034 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.035+0000 7f8db9214800 20 remove_watcher() i=7 2024-09-12T01:28:44.306 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T01:28:44.306 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T01:28:44.430 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:28:44.459 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:28:44.459 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:28:44.500 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.501+0000 7fabf4139800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.503+0000 7fabf4139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:44.502 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.503+0000 7fabf4139800 20 realm 2024-09-12T01:28:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.503+0000 7fabf4139800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.503+0000 7fabf4139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.503+0000 7fabf4139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:28:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.503+0000 7fabf4139800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.503+0000 7fabf4139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:44.503 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.503+0000 7fabf4139800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.504+0000 7fabf4139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:28:44.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.504+0000 7fabf4139800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.504+0000 7fabf4139800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:28:44.504 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.504+0000 7fabf4139800 20 searching for the correct realm 2024-09-12T01:28:44.505 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.506+0000 7fabefdc7640 0 -- 172.21.15.62:0/3400629020 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7fabe8024030 msgr2=0x7fabe8094120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:28:44.509 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.510+0000 7fabf05c8640 0 -- 172.21.15.62:0/3400629020 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7fabe0086040 msgr2=0x7fabe004e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:28:44.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.717+0000 7fabf4139800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:28:44.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.717+0000 7fabf4139800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:28:44.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.717+0000 7fabf4139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:28:44.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.717+0000 7fabf4139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:28:44.717 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.717+0000 7fabf4139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:28:44.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.717+0000 7fabf4139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:28:44.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.717+0000 7fabf4139800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.718+0000 7fabf4139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:44.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.718+0000 7fabf4139800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.718+0000 7fabf4139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:28:44.718 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.718+0000 7fabf4139800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.718+0000 7fabf4139800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:28:44.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.718+0000 7fabf4139800 20 zone default found 2024-09-12T01:28:44.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.718+0000 7fabf4139800 4 Realm: () 2024-09-12T01:28:44.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.718+0000 7fabf4139800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:28:44.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.718+0000 7fabf4139800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:28:44.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.718+0000 7fabf4139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:28:44.719 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.718+0000 7fabf4139800 20 zonegroup default 2024-09-12T01:28:44.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.718+0000 7fabf4139800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.719+0000 7fabf4139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:44.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.719+0000 7fabf4139800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.719+0000 7fabf4139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:44.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.719+0000 7fabf4139800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.719+0000 7fabf4139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:44.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.719+0000 7fabf4139800 20 started sync module instance, tier type = 2024-09-12T01:28:44.720 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.719+0000 7fabf4139800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:28:44.728 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.729+0000 7fabf4139800 20 add_watcher() i=0 2024-09-12T01:28:44.728 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.729+0000 7fabf4139800 20 add_watcher() i=1 2024-09-12T01:28:44.728 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.729+0000 7fabf4139800 20 add_watcher() i=2 2024-09-12T01:28:44.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.729+0000 7fabf4139800 20 add_watcher() i=3 2024-09-12T01:28:44.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.729+0000 7fabf4139800 20 add_watcher() i=4 2024-09-12T01:28:44.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.729+0000 7fabf4139800 20 add_watcher() i=5 2024-09-12T01:28:44.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.729+0000 7fabf4139800 20 add_watcher() i=6 2024-09-12T01:28:44.729 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.730+0000 7fabf4139800 20 add_watcher() i=7 2024-09-12T01:28:44.730 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.730+0000 7fabf4139800 2 all 8 watchers are set, enabling cache 2024-09-12T01:28:44.732 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.733+0000 7faaa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:28:44.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.733+0000 7fabf4139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:28:44.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.733+0000 7fabf4139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:28:44.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.733+0000 7fabf4139800 5 note: GC not initialized 2024-09-12T01:28:44.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.733+0000 7faaa4fe1640 20 reqs_thread_entry: start 2024-09-12T01:28:44.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.733+0000 7fabf4139800 20 init_complete bucket index max shards: 1 2024-09-12T01:28:44.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.733+0000 7fabf4139800 20 Filter name: none 2024-09-12T01:28:44.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.734+0000 7faa1e7fc640 20 reqs_thread_entry: start 2024-09-12T01:28:44.733 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.734+0000 7fabf4139800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.734+0000 7fabf4139800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:28:44.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.734+0000 7fabf4139800 20 rados->read ofs=0 len=0 2024-09-12T01:28:44.734 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.735+0000 7fabf4139800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:28:44.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.735+0000 7fabf4139800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:28:44.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.735+0000 7fabf4139800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T01:28:44.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.735+0000 7fabf4139800 20 INFO: main: starting shard=0 2024-09-12T01:28:44.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.735+0000 7fabf4139800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.782.0 2024-09-12T01:28:44.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.736+0000 7fabf4139800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:28:44.735 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.736+0000 7fabf4139800 20 INFO: main: done 2024-09-12T01:28:44.736 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.737+0000 7faaa5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:28:44.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.739+0000 7fabf4139800 20 remove_watcher() i=0 2024-09-12T01:28:44.738 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.739+0000 7fabf4139800 2 removed watcher, disabling cache 2024-09-12T01:28:44.739 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.740+0000 7fabf4139800 20 remove_watcher() i=1 2024-09-12T01:28:44.740 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.741+0000 7fabf4139800 20 remove_watcher() i=2 2024-09-12T01:28:44.741 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.742+0000 7fabf4139800 20 remove_watcher() i=3 2024-09-12T01:28:44.742 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.743+0000 7fabf4139800 20 remove_watcher() i=4 2024-09-12T01:28:44.744 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.745+0000 7fabf4139800 20 remove_watcher() i=5 2024-09-12T01:28:44.745 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.746+0000 7fabf4139800 20 remove_watcher() i=6 2024-09-12T01:28:44.746 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.747+0000 7fabf4139800 20 remove_watcher() i=7 2024-09-12T01:28:44.759 INFO:tasks.workunit.client.0.smithi062.stderr:rados -p default.rgw.buckets.data ls | grep ea688f56-10b3-4c7d-95f2-e2ab12f121bd 2024-09-12T01:28:44.781 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:28:44.782 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:28:44.856 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:44.857+0000 7f76f1401640 0 -- 172.21.15.62:0/3472685598 >> [v2:172.21.15.77:6824/2669672722,v1:172.21.15.77:6825/2669672722] conn(0x7f76e402ea70 msgr2=0x7f76e402eef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:28:44.872 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T01:28:44.873 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T01:28:44.874 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:28:46.526 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:28:46.945 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:28:46.976 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:28:46.976 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:28:47.013 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.014+0000 7fc3b8d28800 20 rados->read ofs=0 len=0 2024-09-12T01:28:47.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.016+0000 7fc3b8d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:47.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.016+0000 7fc3b8d28800 20 realm 2024-09-12T01:28:47.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.016+0000 7fc3b8d28800 20 rados->read ofs=0 len=0 2024-09-12T01:28:47.015 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.016+0000 7fc3b8d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:47.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.016+0000 7fc3b8d28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:28:47.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.016+0000 7fc3b8d28800 20 rados->read ofs=0 len=0 2024-09-12T01:28:47.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.016+0000 7fc3b8d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:47.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.016+0000 7fc3b8d28800 20 rados->read ofs=0 len=0 2024-09-12T01:28:47.016 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.017+0000 7fc3b8d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:28:47.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.017+0000 7fc3b8d28800 20 rados->read ofs=0 len=0 2024-09-12T01:28:47.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.017+0000 7fc3b8d28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:28:47.017 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.017+0000 7fc3b8d28800 20 searching for the correct realm 2024-09-12T01:28:47.020 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.021+0000 7fc3b415c640 0 -- 172.21.15.62:0/806502023 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7fc3ac062b80 msgr2=0x7fc3ac0dd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:28:47.628 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.629+0000 7fc3b495d640 0 -- 172.21.15.62:0/806502023 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7fc3ac0a6a10 msgr2=0x7fc3ac0d66d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:28:47.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.636+0000 7fc3b8d28800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:28:47.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.636+0000 7fc3b8d28800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:28:47.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.636+0000 7fc3b8d28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:28:47.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.636+0000 7fc3b8d28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:28:47.635 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.636+0000 7fc3b8d28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:28:47.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.636+0000 7fc3b8d28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:28:47.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.636+0000 7fc3b8d28800 20 rados->read ofs=0 len=0 2024-09-12T01:28:47.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.636+0000 7fc3b8d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:47.636 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.636+0000 7fc3b8d28800 20 rados->read ofs=0 len=0 2024-09-12T01:28:47.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.636+0000 7fc3b8d28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:28:47.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.636+0000 7fc3b8d28800 20 rados->read ofs=0 len=0 2024-09-12T01:28:47.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.637+0000 7fc3b8d28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:28:47.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.637+0000 7fc3b8d28800 20 zone default found 2024-09-12T01:28:47.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.637+0000 7fc3b8d28800 4 Realm: () 2024-09-12T01:28:47.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.637+0000 7fc3b8d28800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:28:47.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.637+0000 7fc3b8d28800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:28:47.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.637+0000 7fc3b8d28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:28:47.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.637+0000 7fc3b8d28800 20 zonegroup default 2024-09-12T01:28:47.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.637+0000 7fc3b8d28800 20 rados->read ofs=0 len=0 2024-09-12T01:28:47.637 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.637+0000 7fc3b8d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:47.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.637+0000 7fc3b8d28800 20 rados->read ofs=0 len=0 2024-09-12T01:28:47.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.638+0000 7fc3b8d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:47.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.638+0000 7fc3b8d28800 20 rados->read ofs=0 len=0 2024-09-12T01:28:47.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.638+0000 7fc3b8d28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:47.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.638+0000 7fc3b8d28800 20 started sync module instance, tier type = 2024-09-12T01:28:47.638 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.638+0000 7fc3b8d28800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:28:47.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.649+0000 7fc3b8d28800 20 add_watcher() i=0 2024-09-12T01:28:47.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.649+0000 7fc3b8d28800 20 add_watcher() i=1 2024-09-12T01:28:47.648 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.649+0000 7fc3b8d28800 20 add_watcher() i=2 2024-09-12T01:28:47.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.649+0000 7fc3b8d28800 20 add_watcher() i=3 2024-09-12T01:28:47.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.649+0000 7fc3b8d28800 20 add_watcher() i=4 2024-09-12T01:28:47.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.649+0000 7fc3b8d28800 20 add_watcher() i=5 2024-09-12T01:28:47.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.649+0000 7fc3b8d28800 20 add_watcher() i=6 2024-09-12T01:28:47.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.650+0000 7fc3b8d28800 20 add_watcher() i=7 2024-09-12T01:28:47.649 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.650+0000 7fc3b8d28800 2 all 8 watchers are set, enabling cache 2024-09-12T01:28:47.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.652+0000 7fc26b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:28:47.651 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.652+0000 7fc3b8d28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:28:47.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.652+0000 7fc3b8d28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:28:47.652 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.652+0000 7fc3b8d28800 5 note: GC not initialized 2024-09-12T01:28:47.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.652+0000 7fc26a7e4640 20 reqs_thread_entry: start 2024-09-12T01:28:47.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.653+0000 7fc3b8d28800 20 init_complete bucket index max shards: 1 2024-09-12T01:28:47.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.653+0000 7fc3b8d28800 20 Filter name: none 2024-09-12T01:28:47.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.653+0000 7fc2637fe640 20 reqs_thread_entry: start 2024-09-12T01:28:47.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.653+0000 7fc3b8d28800 20 rados->read ofs=0 len=0 2024-09-12T01:28:47.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.653+0000 7fc3b8d28800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:28:47.653 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.653+0000 7fc3b8d28800 20 rados->read ofs=0 len=0 2024-09-12T01:28:47.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.654+0000 7fc3b8d28800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:28:47.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.654+0000 7fc3b8d28800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:28:47.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.654+0000 7fc3b8d28800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-12T01:28:47.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.654+0000 7fc3b8d28800 20 INFO: main: starting shard=0 2024-09-12T01:28:47.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.654+0000 7fc3b8d28800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.782.0 2024-09-12T01:28:47.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.655+0000 7fc3b8d28800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:28:47.654 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.655+0000 7fc3b8d28800 20 INFO: main: done 2024-09-12T01:28:47.655 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.656+0000 7fc26b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:28:47.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.658+0000 7fc3b8d28800 20 remove_watcher() i=0 2024-09-12T01:28:47.657 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.658+0000 7fc3b8d28800 2 removed watcher, disabling cache 2024-09-12T01:28:47.658 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.659+0000 7fc3b8d28800 20 remove_watcher() i=1 2024-09-12T01:28:47.660 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.660+0000 7fc3b8d28800 20 remove_watcher() i=2 2024-09-12T01:28:47.661 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.662+0000 7fc3b8d28800 20 remove_watcher() i=3 2024-09-12T01:28:47.662 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.663+0000 7fc3b8d28800 20 remove_watcher() i=4 2024-09-12T01:28:47.663 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.664+0000 7fc3b8d28800 20 remove_watcher() i=5 2024-09-12T01:28:47.665 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.665+0000 7fc3b8d28800 20 remove_watcher() i=6 2024-09-12T01:28:47.666 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.667+0000 7fc3b8d28800 20 remove_watcher() i=7 2024-09-12T01:28:47.680 INFO:tasks.workunit.client.0.smithi062.stderr:rados -p default.rgw.buckets.data ls | grep e1919f37-d807-4731-b63b-2ea45c051784 2024-09-12T01:28:47.706 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:28:47.706 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:28:47.786 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:47.786+0000 7ff667cc8640 0 -- 172.21.15.62:0/3601534922 >> [v2:172.21.15.77:6816/3177889521,v1:172.21.15.77:6817/3177889521] conn(0x7ff660068b80 msgr2=0x7ff66001f690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:28:47.801 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T01:28:47.802 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T01:28:47.920 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:28:49.435 INFO:tasks.workunit.client.0.smithi062.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T01:28:49.437 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:28:49.907 INFO:tasks.workunit.client.0.smithi062.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T01:28:49.907 INFO:tasks.workunit.client.0.smithi062.stderr: 2024-09-12T01:28:50.074 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T01:28:53.582 INFO:tasks.workunit.client.0.smithi062.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T01:28:53.997 INFO:tasks.workunit.client.0.smithi062.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T01:28:54.028 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:28:54.028 INFO:tasks.workunit.client.0.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:28:54.068 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.069+0000 7f4833898800 20 rados->read ofs=0 len=0 2024-09-12T01:28:54.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.071+0000 7f4833898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:54.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.071+0000 7f4833898800 20 realm 2024-09-12T01:28:54.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.071+0000 7f4833898800 20 rados->read ofs=0 len=0 2024-09-12T01:28:54.070 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.071+0000 7f4833898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:54.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.071+0000 7f4833898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:28:54.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.071+0000 7f4833898800 20 rados->read ofs=0 len=0 2024-09-12T01:28:54.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.071+0000 7f4833898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:54.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.071+0000 7f4833898800 20 rados->read ofs=0 len=0 2024-09-12T01:28:54.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.072+0000 7f4833898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:28:54.071 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.072+0000 7f4833898800 20 rados->read ofs=0 len=0 2024-09-12T01:28:54.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.072+0000 7f4833898800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:28:54.072 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.072+0000 7f4833898800 20 searching for the correct realm 2024-09-12T01:28:54.075 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.076+0000 7f4830b81640 0 -- 172.21.15.62:0/1906662131 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f482c009b70 msgr2=0x7f482c018930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:28:54.281 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.282+0000 7f4831b83640 0 -- 172.21.15.62:0/1906662131 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55b8f8efda90 msgr2=0x55b8f8efff30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:28:54.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.287+0000 7f4833898800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:28:54.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.287+0000 7f4833898800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:28:54.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.287+0000 7f4833898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:28:54.286 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.287+0000 7f4833898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:28:54.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.287+0000 7f4833898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:28:54.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.287+0000 7f4833898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:28:54.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.287+0000 7f4833898800 20 rados->read ofs=0 len=0 2024-09-12T01:28:54.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.287+0000 7f4833898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:54.287 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.287+0000 7f4833898800 20 rados->read ofs=0 len=0 2024-09-12T01:28:54.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.288+0000 7f4833898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:28:54.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.288+0000 7f4833898800 20 rados->read ofs=0 len=0 2024-09-12T01:28:54.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.288+0000 7f4833898800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:28:54.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.288+0000 7f4833898800 20 zone default found 2024-09-12T01:28:54.288 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.288+0000 7f4833898800 4 Realm: () 2024-09-12T01:28:54.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.288+0000 7f4833898800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:28:54.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.288+0000 7f4833898800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:28:54.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.288+0000 7f4833898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:28:54.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.288+0000 7f4833898800 20 zonegroup default 2024-09-12T01:28:54.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.288+0000 7f4833898800 20 rados->read ofs=0 len=0 2024-09-12T01:28:54.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.288+0000 7f4833898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:54.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.288+0000 7f4833898800 20 rados->read ofs=0 len=0 2024-09-12T01:28:54.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.288+0000 7f4833898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:54.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.288+0000 7f4833898800 20 rados->read ofs=0 len=0 2024-09-12T01:28:54.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.289+0000 7f4833898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:54.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.289+0000 7f4833898800 20 started sync module instance, tier type = 2024-09-12T01:28:54.289 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.289+0000 7f4833898800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:28:54.298 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.299+0000 7f4833898800 20 add_watcher() i=0 2024-09-12T01:28:54.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.299+0000 7f4833898800 20 add_watcher() i=1 2024-09-12T01:28:54.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.299+0000 7f4833898800 20 add_watcher() i=2 2024-09-12T01:28:54.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.299+0000 7f4833898800 20 add_watcher() i=3 2024-09-12T01:28:54.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.299+0000 7f4833898800 20 add_watcher() i=4 2024-09-12T01:28:54.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.299+0000 7f4833898800 20 add_watcher() i=5 2024-09-12T01:28:54.299 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.299+0000 7f4833898800 20 add_watcher() i=6 2024-09-12T01:28:54.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.301+0000 7f4833898800 20 add_watcher() i=7 2024-09-12T01:28:54.300 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.301+0000 7f4833898800 2 all 8 watchers are set, enabling cache 2024-09-12T01:28:54.302 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.302+0000 7f46e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:28:54.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.303+0000 7f4833898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:28:54.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.303+0000 7f4833898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:28:54.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.303+0000 7f4833898800 5 note: GC not initialized 2024-09-12T01:28:54.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.303+0000 7f46e67e4640 20 reqs_thread_entry: start 2024-09-12T01:28:54.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.303+0000 7f4833898800 20 init_complete bucket index max shards: 1 2024-09-12T01:28:54.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.303+0000 7f4833898800 20 Filter name: none 2024-09-12T01:28:54.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.303+0000 7f4657fff640 20 reqs_thread_entry: start 2024-09-12T01:28:54.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.303+0000 7f4833898800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T01:28:54.303 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.303+0000 7f4833898800 20 rados->read ofs=0 len=0 2024-09-12T01:28:54.304 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.304+0000 7f4833898800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:28:54.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.304+0000 7f4833898800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T01:28:54.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.304+0000 7f4833898800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T01:28:54.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.304+0000 7f4833898800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.782 : miss 2024-09-12T01:28:54.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.304+0000 7f4833898800 20 rados->read ofs=0 len=0 2024-09-12T01:28:54.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.305+0000 7f4833898800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:28:54.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.305+0000 7f4833898800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.782 info.flags=0x17 2024-09-12T01:28:54.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.305+0000 7f4833898800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.782 to cache LRU end 2024-09-12T01:28:54.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.305+0000 7f4833898800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:28:54.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.305+0000 7f4833898800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T01:28:54.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.305+0000 7f4833898800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.782 2024-09-12T01:28:54.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.305+0000 7f4833898800 20 bucket index object: :.dir.8f0c480c-ec81-4324-89bc-22952673ff0b.4656.782.0 2024-09-12T01:28:54.305 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.305+0000 7f4833898800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T01:28:54.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.305+0000 7f4833898800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T01:28:54.306 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.306+0000 7f46e77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:28:54.307 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.308+0000 7f4833898800 20 remove_watcher() i=0 2024-09-12T01:28:54.308 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.308+0000 7f4833898800 2 removed watcher, disabling cache 2024-09-12T01:28:54.309 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.310+0000 7f4833898800 20 remove_watcher() i=1 2024-09-12T01:28:54.310 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.311+0000 7f4833898800 20 remove_watcher() i=2 2024-09-12T01:28:54.311 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.312+0000 7f4833898800 20 remove_watcher() i=3 2024-09-12T01:28:54.312 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.313+0000 7f4833898800 20 remove_watcher() i=4 2024-09-12T01:28:54.313 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.314+0000 7f4833898800 20 remove_watcher() i=5 2024-09-12T01:28:54.314 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.315+0000 7f4833898800 20 remove_watcher() i=6 2024-09-12T01:28:54.315 INFO:tasks.workunit.client.0.smithi062.stderr:2024-09-12T01:28:54.316+0000 7f4833898800 20 remove_watcher() i=7 2024-09-12T01:28:54.327 INFO:tasks.workunit.client.0.smithi062.stderr:Deleting bucket versioning-bucket 2024-09-12T01:28:54.414 INFO:tasks.workunit.client.0.smithi062.stderr:Completed bucket versioning tests 2024-09-12T01:28:54.414 INFO:tasks.workunit.client.0.smithi062.stdout:connected to http://localhost:80 2024-09-12T01:28:54.473 INFO:tasks.workunit.client.0.smithi062.stderr:+ deactivate 2024-09-12T01:28:54.473 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T01:28:54.473 INFO:tasks.workunit.client.0.smithi062.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:28:54.473 INFO:tasks.workunit.client.0.smithi062.stderr:+ export PATH 2024-09-12T01:28:54.474 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T01:28:54.474 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -n '' ']' 2024-09-12T01:28:54.474 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:28:54.474 INFO:tasks.workunit.client.0.smithi062.stderr:+ hash -r 2024-09-12T01:28:54.474 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' -n '' ']' 2024-09-12T01:28:54.474 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset VIRTUAL_ENV 2024-09-12T01:28:54.474 INFO:tasks.workunit.client.0.smithi062.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T01:28:54.474 INFO:tasks.workunit.client.0.smithi062.stderr:+ unset -f deactivate 2024-09-12T01:28:54.474 INFO:tasks.workunit.client.0.smithi062.stderr:+ echo OK. 2024-09-12T01:28:54.475 INFO:tasks.workunit.client.0.smithi062.stdout:OK. 2024-09-12T01:28:54.475 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T01:28:54.476 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:28:54.556 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T01:28:54.557 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T01:28:54.966 DEBUG:teuthology.parallel:result is None 2024-09-12T01:28:54.967 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:28:55.006 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:28:55.007 DEBUG:teuthology.orchestra.run.smithi062:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:28:55.077 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:28:55.077 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T01:28:55.088 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T01:28:55.100 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T01:28:55.101 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T01:28:55.101 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T01:28:55.181 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T01:28:55.181 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T01:28:55.240 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:28:55.240 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:28:55.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.276+0000 7f292b91f800 20 rados->read ofs=0 len=0 2024-09-12T01:28:55.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.278+0000 7f292b91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:55.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.278+0000 7f292b91f800 20 realm 2024-09-12T01:28:55.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.278+0000 7f292b91f800 20 rados->read ofs=0 len=0 2024-09-12T01:28:55.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.278+0000 7f292b91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:55.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.278+0000 7f292b91f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:28:55.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.278+0000 7f292b91f800 20 rados->read ofs=0 len=0 2024-09-12T01:28:55.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.278+0000 7f292b91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:55.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.278+0000 7f292b91f800 20 rados->read ofs=0 len=0 2024-09-12T01:28:55.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.279+0000 7f292b91f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:28:55.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.279+0000 7f292b91f800 20 rados->read ofs=0 len=0 2024-09-12T01:28:55.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.280+0000 7f292b91f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:28:55.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.280+0000 7f292b91f800 20 searching for the correct realm 2024-09-12T01:28:55.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.283+0000 7f29276a9640 0 -- 172.21.15.62:0/4239631909 >> [v2:172.21.15.62:6800/3528810202,v1:172.21.15.62:6801/3528810202] conn(0x7f2920065040 msgr2=0x7f2920056470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:28:55.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.287+0000 7f29276a9640 0 -- 172.21.15.62:0/4239631909 >> [v2:172.21.15.62:6824/1212805223,v1:172.21.15.62:6825/1212805223] conn(0x7f2920077040 msgr2=0x7f2920079430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:28:55.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:28:55.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:28:55.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:28:55.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:28:55.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:28:55.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:28:55.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 20 rados->read ofs=0 len=0 2024-09-12T01:28:55.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:55.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 20 rados->read ofs=0 len=0 2024-09-12T01:28:55.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:28:55.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 20 rados->read ofs=0 len=0 2024-09-12T01:28:55.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:28:55.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 20 zone default found 2024-09-12T01:28:55.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 4 Realm: () 2024-09-12T01:28:55.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:28:55.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:28:55.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:28:55.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 20 zonegroup default 2024-09-12T01:28:55.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.291+0000 7f292b91f800 20 rados->read ofs=0 len=0 2024-09-12T01:28:55.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.292+0000 7f292b91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:55.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.292+0000 7f292b91f800 20 rados->read ofs=0 len=0 2024-09-12T01:28:55.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.292+0000 7f292b91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:55.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.292+0000 7f292b91f800 20 rados->read ofs=0 len=0 2024-09-12T01:28:55.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.292+0000 7f292b91f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:28:55.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.292+0000 7f292b91f800 20 started sync module instance, tier type = 2024-09-12T01:28:55.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.292+0000 7f292b91f800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:28:55.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.301+0000 7f292b91f800 20 add_watcher() i=0 2024-09-12T01:28:55.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.301+0000 7f292b91f800 20 add_watcher() i=1 2024-09-12T01:28:55.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.301+0000 7f292b91f800 20 add_watcher() i=2 2024-09-12T01:28:55.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.301+0000 7f292b91f800 20 add_watcher() i=3 2024-09-12T01:28:55.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.301+0000 7f292b91f800 20 add_watcher() i=4 2024-09-12T01:28:55.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.301+0000 7f292b91f800 20 add_watcher() i=5 2024-09-12T01:28:55.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.301+0000 7f292b91f800 20 add_watcher() i=6 2024-09-12T01:28:55.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.303+0000 7f292b91f800 20 add_watcher() i=7 2024-09-12T01:28:55.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.303+0000 7f292b91f800 2 all 8 watchers are set, enabling cache 2024-09-12T01:28:55.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.304+0000 7f27de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:28:55.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.304+0000 7f292b91f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:28:55.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.304+0000 7f292b91f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:28:55.340 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.340+0000 7f27dd7e2640 20 reqs_thread_entry: start 2024-09-12T01:28:55.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.340+0000 7f292b91f800 20 init_complete bucket index max shards: 1 2024-09-12T01:28:55.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.341+0000 7f292b91f800 20 Filter name: none 2024-09-12T01:28:55.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.341+0000 7f27d67fc640 20 reqs_thread_entry: start 2024-09-12T01:28:55.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.341+0000 7f292b91f800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T01:28:55.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.341+0000 7f292b91f800 20 rados->read ofs=0 len=0 2024-09-12T01:28:55.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.341+0000 7f292b91f800 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T01:28:55.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.341+0000 7f292b91f800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T01:28:55.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.341+0000 7f292b91f800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T01:28:55.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.341+0000 7f292b91f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:28:55.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.342+0000 7f292b91f800 10 removing key index: ABLQDWKLNJXYANIIEOZQ 2024-09-12T01:28:55.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.343+0000 7f292b91f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:ABLQDWKLNJXYANIIEOZQ, ofs0, ns] 2024-09-12T01:28:55.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.343+0000 7f280affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333704 cookie 94497590028352 notifier 8876 bl.length()=170 2024-09-12T01:28:55.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.345+0000 7f292b91f800 10 removing email index: tester.client.0_test@test.test 2024-09-12T01:28:55.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.346+0000 7f292b91f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T01:28:55.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.346+0000 7f280a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333705 cookie 94497590028352 notifier 8876 bl.length()=181 2024-09-12T01:28:55.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.347+0000 7f292b91f800 10 removing user buckets index 2024-09-12T01:28:55.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.348+0000 7f292b91f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T01:28:55.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.349+0000 7f280affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166335343 cookie 94497590037200 notifier 8876 bl.length()=172 2024-09-12T01:28:55.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.350+0000 7f292b91f800 10 removing user index: tester.client.0 2024-09-12T01:28:55.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.351+0000 7f292b91f800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T01:28:55.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.351+0000 7f292b91f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T01:28:55.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.351+0000 7f280affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166335344 cookie 94497590035456 notifier 8876 bl.length()=164 2024-09-12T01:28:55.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.353+0000 7f27de7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:28:55.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.355+0000 7f292b91f800 20 remove_watcher() i=0 2024-09-12T01:28:55.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.355+0000 7f292b91f800 2 removed watcher, disabling cache 2024-09-12T01:28:55.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.356+0000 7f292b91f800 20 remove_watcher() i=1 2024-09-12T01:28:55.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.357+0000 7f292b91f800 20 remove_watcher() i=2 2024-09-12T01:28:55.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.358+0000 7f292b91f800 20 remove_watcher() i=3 2024-09-12T01:28:55.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.359+0000 7f292b91f800 20 remove_watcher() i=4 2024-09-12T01:28:55.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.360+0000 7f292b91f800 20 remove_watcher() i=5 2024-09-12T01:28:55.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.361+0000 7f292b91f800 20 remove_watcher() i=6 2024-09-12T01:28:55.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:28:55.362+0000 7f292b91f800 20 remove_watcher() i=7 2024-09-12T01:28:55.374 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T01:28:55.383 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T01:28:55.392 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T01:28:55.451 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T01:28:55.461 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T01:28:55.461 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:28:55.469 INFO:tasks.rgw.client.0.smithi062.stdout:2024-09-12T01:28:55.467+0000 f874640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 45876) UID: 0 2024-09-12T01:28:55.471 INFO:tasks.rgw.client.0.smithi062.stdout:2024-09-12T01:28:55.471+0000 a1be240 -1 shutting down 2024-09-12T01:29:10.723 INFO:tasks.rgw.client.0.smithi062.stderr:==00:00:57:09.774 45879== could not unlink /tmp/vgdb-pipe-from-vgdb-to-45879-by-root-on-??? 2024-09-12T01:29:10.723 INFO:tasks.rgw.client.0.smithi062.stderr:==00:00:57:09.774 45879== could not unlink /tmp/vgdb-pipe-to-vgdb-from-45879-by-root-on-??? 2024-09-12T01:29:10.723 INFO:tasks.rgw.client.0.smithi062.stderr:==00:00:57:09.774 45879== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-45879-by-root-on-??? 2024-09-12T01:29:11.784 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-12T01:29:13.765 INFO:tasks.rgw.client.0:Stopped 2024-09-12T01:29:13.766 DEBUG:teuthology.orchestra.run.smithi062:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T01:29:13.802 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T01:29:13.889 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T01:29:13.932 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T01:29:13.932 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T01:29:13.933 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T01:29:14.034 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:29:14.034 INFO:teuthology.orchestra.run.smithi062.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:29:14.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.070+0000 7f4c33135800 20 rados->read ofs=0 len=0 2024-09-12T01:29:14.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.071+0000 7f4c33135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:29:14.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.071+0000 7f4c33135800 20 realm 2024-09-12T01:29:14.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.071+0000 7f4c33135800 20 rados->read ofs=0 len=0 2024-09-12T01:29:14.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.072+0000 7f4c33135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:29:14.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.072+0000 7f4c33135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:29:14.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.072+0000 7f4c33135800 20 rados->read ofs=0 len=0 2024-09-12T01:29:14.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.072+0000 7f4c33135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:29:14.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.072+0000 7f4c33135800 20 rados->read ofs=0 len=0 2024-09-12T01:29:14.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.073+0000 7f4c33135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:29:14.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.073+0000 7f4c33135800 20 rados->read ofs=0 len=0 2024-09-12T01:29:14.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.073+0000 7f4c33135800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:29:14.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.073+0000 7f4c33135800 20 searching for the correct realm 2024-09-12T01:29:14.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.077+0000 7f4c2e6e3640 0 -- 172.21.15.62:0/837013543 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f4c28061040 msgr2=0x7f4c280a7d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:29:14.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.282+0000 7f4c2e6e3640 0 -- 172.21.15.62:0/837013543 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x55cdb5f82580 msgr2=0x55cdb5f84a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:29:14.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.286+0000 7f4c33135800 20 RGWRados::pool_iterate: got zone_info.8f0c480c-ec81-4324-89bc-22952673ff0b 2024-09-12T01:29:14.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.286+0000 7f4c33135800 20 RGWRados::pool_iterate: got zonegroup_info.6e3d75b0-3d6e-4890-b5f7-e52113027b10 2024-09-12T01:29:14.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.286+0000 7f4c33135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:29:14.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.286+0000 7f4c33135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:29:14.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.286+0000 7f4c33135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:29:14.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.286+0000 7f4c33135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:29:14.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.286+0000 7f4c33135800 20 rados->read ofs=0 len=0 2024-09-12T01:29:14.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.287+0000 7f4c33135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:29:14.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.287+0000 7f4c33135800 20 rados->read ofs=0 len=0 2024-09-12T01:29:14.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.287+0000 7f4c33135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:29:14.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.287+0000 7f4c33135800 20 rados->read ofs=0 len=0 2024-09-12T01:29:14.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.287+0000 7f4c33135800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:29:14.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.287+0000 7f4c33135800 20 zone default found 2024-09-12T01:29:14.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.287+0000 7f4c33135800 4 Realm: () 2024-09-12T01:29:14.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.287+0000 7f4c33135800 4 ZoneGroup: default (6e3d75b0-3d6e-4890-b5f7-e52113027b10) 2024-09-12T01:29:14.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.287+0000 7f4c33135800 4 Zone: default (8f0c480c-ec81-4324-89bc-22952673ff0b) 2024-09-12T01:29:14.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.287+0000 7f4c33135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:29:14.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.287+0000 7f4c33135800 20 zonegroup default 2024-09-12T01:29:14.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.287+0000 7f4c33135800 20 rados->read ofs=0 len=0 2024-09-12T01:29:14.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.287+0000 7f4c33135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:29:14.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.287+0000 7f4c33135800 20 rados->read ofs=0 len=0 2024-09-12T01:29:14.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.288+0000 7f4c33135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:29:14.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.288+0000 7f4c33135800 20 rados->read ofs=0 len=0 2024-09-12T01:29:14.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.288+0000 7f4c33135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:29:14.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.288+0000 7f4c33135800 20 started sync module instance, tier type = 2024-09-12T01:29:14.291 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.288+0000 7f4c33135800 20 started zone id=8f0c480c-ec81-4324-89bc-22952673ff0b (name=default) with tier type = 2024-09-12T01:29:14.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.298+0000 7f4c33135800 20 add_watcher() i=0 2024-09-12T01:29:14.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.298+0000 7f4c33135800 20 add_watcher() i=1 2024-09-12T01:29:14.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.298+0000 7f4c33135800 20 add_watcher() i=2 2024-09-12T01:29:14.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.298+0000 7f4c33135800 20 add_watcher() i=3 2024-09-12T01:29:14.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.298+0000 7f4c33135800 20 add_watcher() i=4 2024-09-12T01:29:14.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.298+0000 7f4c33135800 20 add_watcher() i=5 2024-09-12T01:29:14.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.298+0000 7f4c33135800 20 add_watcher() i=6 2024-09-12T01:29:14.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.299+0000 7f4c33135800 20 add_watcher() i=7 2024-09-12T01:29:14.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.299+0000 7f4c33135800 2 all 8 watchers are set, enabling cache 2024-09-12T01:29:14.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.301+0000 7f4ae57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:29:14.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.301+0000 7f4c33135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:29:14.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.301+0000 7f4c33135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:29:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.341+0000 7f4a5ffff640 20 reqs_thread_entry: start 2024-09-12T01:29:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.341+0000 7f4c33135800 20 init_complete bucket index max shards: 1 2024-09-12T01:29:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.342+0000 7f4c33135800 20 Filter name: none 2024-09-12T01:29:14.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.342+0000 7f4a5dffb640 20 reqs_thread_entry: start 2024-09-12T01:29:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.342+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:29:14.343 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.343+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:14.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.344+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48858' 2024-09-12T01:29:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12450998827935094739', time=2024-09-12T03:08:56.838110+0000, chain.objs.size()=1 2024-09-12T01:29:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.234__shadow_.ox4U3LQmdG7Mx5eCOUykLabFXxE4C5v_0 2024-09-12T01:29:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16988468718920146176', time=2024-09-12T03:09:09.219087+0000, chain.objs.size()=1 2024-09-12T01:29:14.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.252__shadow_.6aDFEYCGzmQPQJHT-ti4o8c6gROTqs0_0 2024-09-12T01:29:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.563539032964084398', time=2024-09-12T03:09:11.181798+0000, chain.objs.size()=1 2024-09-12T01:29:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.255__shadow_.SvFsdrBmSrNvO15SNYeAOdHRlwDEWqV_0 2024-09-12T01:29:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2470758821515399720', time=2024-09-12T03:09:55.127308+0000, chain.objs.size()=1 2024-09-12T01:29:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.vg_P-KN4J_jcdAuRXi7ERP4Xj9FZQd2_0 2024-09-12T01:29:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12586958842573231975', time=2024-09-12T03:09:55.448702+0000, chain.objs.size()=1 2024-09-12T01:29:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.UPTF30yRGhrhF7hF3E7oZqIiTdQneVv_0 2024-09-12T01:29:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8375767991961913909', time=2024-09-12T03:09:56.630185+0000, chain.objs.size()=1 2024-09-12T01:29:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.pRBn-1KuzLDP-wRO9Hk8Q8-tlvnqdaQ_0 2024-09-12T01:29:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10012684301530589035', time=2024-09-12T03:09:56.946144+0000, chain.objs.size()=1 2024-09-12T01:29:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.h-qLMCxr8g86b4xoxRrXd6oKKQrOpll_0 2024-09-12T01:29:14.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18065178851802964179', time=2024-09-12T03:09:57.084550+0000, chain.objs.size()=1 2024-09-12T01:29:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.zNDtKtfgN6cp-FiW4n-2xQ7EMo8lw2w_0 2024-09-12T01:29:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11831223735332483714', time=2024-09-12T03:09:57.103798+0000, chain.objs.size()=1 2024-09-12T01:29:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RycMwQ0WJtqEUIN8dxaWD9LNxn25_LR_0 2024-09-12T01:29:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16757736758337240577', time=2024-09-12T03:09:58.111391+0000, chain.objs.size()=1 2024-09-12T01:29:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.JlJ7y1Z6kvUjiLfLaMyQvEoFYvKETGy_0 2024-09-12T01:29:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18138274035548845518', time=2024-09-12T03:09:58.267886+0000, chain.objs.size()=1 2024-09-12T01:29:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.OMTgD5bICzcms1vhQXM9vDsFcPt4sq4_0 2024-09-12T01:29:14.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10989739411743285741', time=2024-09-12T03:09:58.268744+0000, chain.objs.size()=1 2024-09-12T01:29:14.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.345+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.XZCiea7ZlY_uk_y8Y1EbN7blJUUX7Pa_0 2024-09-12T01:29:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.348+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13668813282726524450', time=2024-09-12T03:09:58.422877+0000, chain.objs.size()=1 2024-09-12T01:29:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.348+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.wfE83hZGjSRC0XmzyIMmJThgy_6d2Z2_0 2024-09-12T01:29:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.348+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1192208189820889838', time=2024-09-12T03:09:58.717023+0000, chain.objs.size()=1 2024-09-12T01:29:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.348+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1VIo45hdpWqd7ohl7-TAIeD_T5fTwiO_0 2024-09-12T01:29:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.348+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12244933274454405433', time=2024-09-12T03:09:58.956644+0000, chain.objs.size()=1 2024-09-12T01:29:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.348+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.2pibewXzkVpq7G1nsGHlw60zr3LZLz4_0 2024-09-12T01:29:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.349+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7780736816195369306', time=2024-09-12T03:09:59.507053+0000, chain.objs.size()=1 2024-09-12T01:29:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.349+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.x0dLrEI1SCG4lLkUc9m_K04tgYKRLzg_0 2024-09-12T01:29:14.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.349+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2072242339141769970', time=2024-09-12T03:09:59.763468+0000, chain.objs.size()=1 2024-09-12T01:29:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.349+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.yxtmNw2aeSjnqi_D-1jfOy1V-D3OfT__0 2024-09-12T01:29:14.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.349+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2581938940094864166', time=2024-09-12T03:10:00.451344+0000, chain.objs.size()=1 2024-09-12T01:29:14.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.349+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.J8hfnGYnMB0lil9lt3XOUwPHxKDmVtF_0 2024-09-12T01:29:14.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.349+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3488838045204346496', time=2024-09-12T03:10:01.208431+0000, chain.objs.size()=1 2024-09-12T01:29:14.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.349+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.7bGuEOZoaL7szVvT89Dt1s7gqcS8csg_0 2024-09-12T01:29:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.349+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13264051027215006586', time=2024-09-12T03:10:01.662680+0000, chain.objs.size()=1 2024-09-12T01:29:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.349+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.XeJg7yMJhxPhhT8QsqJrN95caBlaiEi_0 2024-09-12T01:29:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.349+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5003647981523068954', time=2024-09-12T03:10:02.062002+0000, chain.objs.size()=1 2024-09-12T01:29:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.349+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._xqDNyYnlf3R3LspnQ5T8nvYFFOfCX__0 2024-09-12T01:29:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.351+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13138293544562142983', time=2024-09-12T03:10:02.208511+0000, chain.objs.size()=1 2024-09-12T01:29:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.351+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0rs0FQBsLesl1GTE7eWNyOR_MtZY-hD_0 2024-09-12T01:29:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.351+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2163263443615089625', time=2024-09-12T03:10:03.315294+0000, chain.objs.size()=1 2024-09-12T01:29:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.351+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.rhlMsPiJ9Sna9jEAG-30rgkFDrxpcdD_0 2024-09-12T01:29:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.351+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17343739487861260643', time=2024-09-12T03:10:03.486545+0000, chain.objs.size()=1 2024-09-12T01:29:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.351+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.icsmPuQHCa23IB7JmSxBs_twvON3ehY_0 2024-09-12T01:29:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.354+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12223887729211219570', time=2024-09-12T03:10:03.783388+0000, chain.objs.size()=1 2024-09-12T01:29:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.354+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.-Fv0LKZp3anq5RSNJyQkq_tGdIbVNqs_0 2024-09-12T01:29:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.354+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17215925271009425896', time=2024-09-12T03:10:04.796867+0000, chain.objs.size()=1 2024-09-12T01:29:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.354+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._2KMAtWJO2DJ35CFy4ONUyYCSBNlxYf_0 2024-09-12T01:29:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.354+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3420189907544306906', time=2024-09-12T03:10:04.877121+0000, chain.objs.size()=1 2024-09-12T01:29:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.354+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.wgeKPc4ZXu5EE_1tRxnuyuvZda2qi4J_0 2024-09-12T01:29:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.354+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15169284551794715960', time=2024-09-12T03:10:05.402360+0000, chain.objs.size()=1 2024-09-12T01:29:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.354+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.fXvZ3_0CvWCIqzmtru94DIQTf7OJmL1_0 2024-09-12T01:29:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.354+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13689816563013294820', time=2024-09-12T03:10:05.724941+0000, chain.objs.size()=1 2024-09-12T01:29:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.354+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.kTkLW2kX4uAOMeV8E7owLS_bWp_W8Eb_0 2024-09-12T01:29:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.355+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15815044984000346771', time=2024-09-12T03:10:05.878694+0000, chain.objs.size()=1 2024-09-12T01:29:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.355+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.wEd0uQcB_7LYl67fGOgzFMj0K8yajif_0 2024-09-12T01:29:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.355+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18307953475231923616', time=2024-09-12T03:10:06.335743+0000, chain.objs.size()=1 2024-09-12T01:29:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.355+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.pqJ7AM7johIvYFeQ79tbrZ8TZFHix54_0 2024-09-12T01:29:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.355+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4665616796459581297', time=2024-09-12T03:10:06.336414+0000, chain.objs.size()=1 2024-09-12T01:29:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.355+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.uodZNT2bYfwJGziG3DFTJWVlfx2SCT8_0 2024-09-12T01:29:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.355+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15956780525012143287', time=2024-09-12T03:10:06.517257+0000, chain.objs.size()=1 2024-09-12T01:29:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.355+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dCUe1DfaC55L11sWzom0X9ts0QGzNln_0 2024-09-12T01:29:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.355+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17759225089315447765', time=2024-09-12T03:10:06.684296+0000, chain.objs.size()=1 2024-09-12T01:29:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.355+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.J4pkOsyvr5VTjbjBPmpQEWGh6J03KcR_0 2024-09-12T01:29:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.355+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5023780098186023114', time=2024-09-12T03:10:10.299932+0000, chain.objs.size()=1 2024-09-12T01:29:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.355+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.268__shadow_.zaz6lyrNYM2LC4jzdwikJHMQYAdul9B_0 2024-09-12T01:29:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.356+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16714220906527707906', time=2024-09-12T03:10:10.882883+0000, chain.objs.size()=1 2024-09-12T01:29:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.357+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.269__shadow_.LrUZSSPQKn-6pfxQ_S4ZZZUznU-_3rA_0 2024-09-12T01:29:14.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.358+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3889666857280897062', time=2024-09-12T03:10:16.441423+0000, chain.objs.size()=1 2024-09-12T01:29:14.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.358+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.278__shadow_.B7I5YuUHb5a9Wx4m1VcSD6i3pY4Ndgh_0 2024-09-12T01:29:14.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.358+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2974471253540822968', time=2024-09-12T03:10:20.435538+0000, chain.objs.size()=1 2024-09-12T01:29:14.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.358+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.284__shadow_.gN3MmMFTxCWz-e2zhYZQjb9tlwmgikB_0 2024-09-12T01:29:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.359+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10992815643864879970', time=2024-09-12T03:10:29.101828+0000, chain.objs.size()=1 2024-09-12T01:29:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.359+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_._6OXtlfVvNQOEYMJ7sHyXet99Ztb_hQ_0 2024-09-12T01:29:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.343821582877800768', time=2024-09-12T03:10:29.205470+0000, chain.objs.size()=1 2024-09-12T01:29:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.Gf5Tyd0hd_V1ofK1qXv8YJb4U2pg-n__0 2024-09-12T01:29:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16237174262508890630', time=2024-09-12T03:10:30.512085+0000, chain.objs.size()=1 2024-09-12T01:29:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.295__shadow_.Ct6NDmMCTojTj721c8-fgz6yyxJMVwQ_0 2024-09-12T01:29:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17432916626038007841', time=2024-09-12T03:10:38.006359+0000, chain.objs.size()=1 2024-09-12T01:29:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.306__shadow_.i9gOqu6yOIgHsQNS4yioIgiu3K_lt0Q_0 2024-09-12T01:29:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3069967497700927324', time=2024-09-12T03:11:29.415809+0000, chain.objs.size()=1 2024-09-12T01:29:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.LkQVTGNUCyZ9HcYHHAeTcr1lAHRegXm_0 2024-09-12T01:29:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8431338320017492371', time=2024-09-12T03:11:29.505540+0000, chain.objs.size()=1 2024-09-12T01:29:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.onS6nKZ4sLWf7FB9wUCeBqXAaGCWDf1_0 2024-09-12T01:29:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6783722392238669991', time=2024-09-12T03:11:29.506273+0000, chain.objs.size()=1 2024-09-12T01:29:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.3C7F8lMg8tm9iBeKZkjqKXnv389q9iJ_0 2024-09-12T01:29:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5825888362424217190', time=2024-09-12T03:11:29.678085+0000, chain.objs.size()=1 2024-09-12T01:29:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.VIRikjNavhppaylWc6y9g8cp_702dGP_0 2024-09-12T01:29:14.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7747540560915821010', time=2024-09-12T03:11:29.898152+0000, chain.objs.size()=1 2024-09-12T01:29:14.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.360+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.JF1ydVkKF0x6xTkY0iJqmUOcJBweC6M_0 2024-09-12T01:29:14.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.363+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5645266179562172736', time=2024-09-12T03:11:30.305437+0000, chain.objs.size()=1 2024-09-12T01:29:14.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.363+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tsZGlF9Jrmtn16SSQzVhq-nZZuSxmnd_0 2024-09-12T01:29:14.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.363+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2156733627034784560', time=2024-09-12T03:11:30.305993+0000, chain.objs.size()=1 2024-09-12T01:29:14.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.363+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.aA24XpEHxiQzycCSvSEMgvK3yei430o_0 2024-09-12T01:29:14.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3740261634365781746', time=2024-09-12T03:11:31.283296+0000, chain.objs.size()=1 2024-09-12T01:29:14.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.PbaZ4gIK5RbWc5QPREhEbMWzi81ws-p_0 2024-09-12T01:29:14.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14553218394339696995', time=2024-09-12T03:11:31.365540+0000, chain.objs.size()=1 2024-09-12T01:29:14.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.L4KOVWbSnpwSqLp50Cv_ow7GwCTWplR_0 2024-09-12T01:29:14.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9380498314179214650', time=2024-09-12T03:11:31.840327+0000, chain.objs.size()=1 2024-09-12T01:29:14.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.C8QYzhe-w5DFpA4H-dfIaMu3VuPKYhb_0 2024-09-12T01:29:14.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12265647786797762252', time=2024-09-12T03:11:32.289186+0000, chain.objs.size()=1 2024-09-12T01:29:14.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.g7Op2gNtSK9KENxLJ7LZsmXsA10El20_0 2024-09-12T01:29:14.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13116084672553477554', time=2024-09-12T03:11:33.604398+0000, chain.objs.size()=1 2024-09-12T01:29:14.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.NLKE29GhiF_rrH4pqNljX3OK7ezIysd_0 2024-09-12T01:29:14.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13264999681245168848', time=2024-09-12T03:11:34.519960+0000, chain.objs.size()=1 2024-09-12T01:29:14.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.t88DIvOZb32qNfUmt5mprZ0b52mXtbW_0 2024-09-12T01:29:14.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18153746632431138109', time=2024-09-12T03:11:34.739988+0000, chain.objs.size()=1 2024-09-12T01:29:14.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.EYkhv5ZU7-zFOVVMj66l-ggWIxGp9sU_0 2024-09-12T01:29:14.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14581987850167674426', time=2024-09-12T03:11:35.270357+0000, chain.objs.size()=1 2024-09-12T01:29:14.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tkOR-cdarjB4-hgDdaV8lYJRkYlg1YR_0 2024-09-12T01:29:14.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10319972391949656499', time=2024-09-12T03:11:36.076645+0000, chain.objs.size()=1 2024-09-12T01:29:14.367 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.365+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.DGMnsfwmSITZ1nHswalZl0_oe2YmbAk_0 2024-09-12T01:29:14.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.367+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2346475043868504579', time=2024-09-12T03:11:36.125723+0000, chain.objs.size()=1 2024-09-12T01:29:14.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.367+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.o_u4mVYnp4oh7YlSnxIVgS9S-9LtSvz_0 2024-09-12T01:29:14.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.368+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14376474565083515836', time=2024-09-12T03:11:38.218067+0000, chain.objs.size()=1 2024-09-12T01:29:14.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.368+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Z2FxTrg_mHbodPNjhKWcIm7e67ZfMXs_0 2024-09-12T01:29:14.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.368+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1431216501185137155', time=2024-09-12T03:11:38.218699+0000, chain.objs.size()=1 2024-09-12T01:29:14.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.368+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-9FnOvJVoPgol2-pWWE8B5vFUoVPnvf_0 2024-09-12T01:29:14.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.369+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1146493800062473527', time=2024-09-12T03:11:38.219697+0000, chain.objs.size()=1 2024-09-12T01:29:14.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.369+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.aSQLXAGxz-pd2S0N6KU6vhBB9INFkA5_0 2024-09-12T01:29:14.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.369+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17559284939424738664', time=2024-09-12T03:11:38.504886+0000, chain.objs.size()=1 2024-09-12T01:29:14.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.369+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.h18Ws5xcoJ4DzKYENz07CRHZCnT144a_0 2024-09-12T01:29:14.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.370+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8154896195957061965', time=2024-09-12T03:11:39.279876+0000, chain.objs.size()=1 2024-09-12T01:29:14.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.370+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mlIFydojRF6zKHJd_lMv4si7pQvh4sX_0 2024-09-12T01:29:14.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.370+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10690773508355228827', time=2024-09-12T03:11:39.352791+0000, chain.objs.size()=1 2024-09-12T01:29:14.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.370+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.L-0KqeFO8wzuJaKwI_8JAZWdWca_CtU_0 2024-09-12T01:29:14.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1102031362265714833', time=2024-09-12T03:11:40.235613+0000, chain.objs.size()=1 2024-09-12T01:29:14.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.zZok8IR2p3vXJOiu-H2tm3bXMu7mqRr_0 2024-09-12T01:29:14.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7843323060443825713', time=2024-09-12T03:11:41.167548+0000, chain.objs.size()=1 2024-09-12T01:29:14.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.WPcEeg3D3v8uBhiyi-eVXti8_zkgjKF_0 2024-09-12T01:29:14.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4966077415998022019', time=2024-09-12T03:12:21.867097+0000, chain.objs.size()=1 2024-09-12T01:29:14.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-XERqlg0GtBjh6kgXXGjr_zfU6W7pLA_0 2024-09-12T01:29:14.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4265828849935144359', time=2024-09-12T03:12:22.642384+0000, chain.objs.size()=1 2024-09-12T01:29:14.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.YedgukFs080AVKL1Rhz9ajjzLW6cju8_0 2024-09-12T01:29:14.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18193135276134796586', time=2024-09-12T03:12:23.592866+0000, chain.objs.size()=1 2024-09-12T01:29:14.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RQFFAwLLrqPQEatdGgrMDNFHyxVYyTI_0 2024-09-12T01:29:14.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9659190885569512224', time=2024-09-12T03:12:23.795312+0000, chain.objs.size()=1 2024-09-12T01:29:14.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.SEyoVwfGegAs5Zqvdi0UeRYsJ3W9Wtb_0 2024-09-12T01:29:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.374+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3779163856331799393', time=2024-09-12T03:12:24.655199+0000, chain.objs.size()=1 2024-09-12T01:29:14.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.374+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.t_h8RHiI1FHVK362IZIYXkoIHALIgSU_0 2024-09-12T01:29:14.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.374+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2110136082010005681', time=2024-09-12T03:12:24.709864+0000, chain.objs.size()=1 2024-09-12T01:29:14.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.374+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RQhB10P_UXCnzCLraCP1_9lgUp6dzNe_0 2024-09-12T01:29:14.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.374+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11081726081812851839', time=2024-09-12T03:12:25.364689+0000, chain.objs.size()=1 2024-09-12T01:29:14.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.374+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.lc5Su_ZEPgB7aVJIU3rPB_r94dpTE7K_0 2024-09-12T01:29:14.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.374+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18277740944196955668', time=2024-09-12T03:12:25.600712+0000, chain.objs.size()=1 2024-09-12T01:29:14.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.374+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.st-rYzD8PJ6wuvHfvkTlkDzBAdKiAx6_0 2024-09-12T01:29:14.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.374+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15051225720826315739', time=2024-09-12T03:12:25.718386+0000, chain.objs.size()=1 2024-09-12T01:29:14.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.374+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.prwP0SdGwim96aKKJ3Du0P0V78ih0D4_0 2024-09-12T01:29:14.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.375+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11462209891211524643', time=2024-09-12T03:12:25.925638+0000, chain.objs.size()=1 2024-09-12T01:29:14.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.375+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MntU7-gRfDwqHeQovY_EBEg6e_dRtWb_0 2024-09-12T01:29:14.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.375+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2563269690003075371', time=2024-09-12T03:12:27.368077+0000, chain.objs.size()=1 2024-09-12T01:29:14.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.375+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.6DOLgvAOyAKraWcRhFOc-_5Y1v-ZZu3_0 2024-09-12T01:29:14.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.376+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3410024434974350694', time=2024-09-12T03:12:27.414946+0000, chain.objs.size()=1 2024-09-12T01:29:14.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.376+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.np5R4lOr7KeOzHmr24h_7TVC_aB5nus_0 2024-09-12T01:29:14.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.376+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1691140513472697402', time=2024-09-12T03:12:27.563986+0000, chain.objs.size()=1 2024-09-12T01:29:14.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.376+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Sjhx5yGdmLrQYaugJxz__QlwIPRIO3H_0 2024-09-12T01:29:14.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.376+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5042586743209311202', time=2024-09-12T03:12:27.775442+0000, chain.objs.size()=1 2024-09-12T01:29:14.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.376+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.P7g2Rvoca_OPvnbkH8at9e9M_L4EEZA_0 2024-09-12T01:29:14.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.377+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11880650678776772196', time=2024-09-12T03:12:28.721190+0000, chain.objs.size()=1 2024-09-12T01:29:14.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.377+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.J27Y6yDCHvtTqD72MXHV14AUw77NQLP_0 2024-09-12T01:29:14.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.379+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12573118193562788057', time=2024-09-12T03:12:29.088035+0000, chain.objs.size()=1 2024-09-12T01:29:14.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.379+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xthXvVWzsjR-NfukS1rgv-AReesjobH_0 2024-09-12T01:29:14.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.379+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10349874132424048575', time=2024-09-12T03:12:29.251124+0000, chain.objs.size()=1 2024-09-12T01:29:14.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.379+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.6eZcYeorvkeqi4pBRqWAs2evCzx-Gb6_0 2024-09-12T01:29:14.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.379+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.41743989988170142', time=2024-09-12T03:12:29.688797+0000, chain.objs.size()=1 2024-09-12T01:29:14.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.379+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.M0G0Wd0ovA-zF6NK6Aktah9LC6OrIR2_0 2024-09-12T01:29:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16768872439399422618', time=2024-09-12T03:12:29.776495+0000, chain.objs.size()=1 2024-09-12T01:29:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._VsPHzRDtGR05UA0nZ5eJet3ViTOaxA_0 2024-09-12T01:29:14.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12297704818856932260', time=2024-09-12T03:12:29.903547+0000, chain.objs.size()=1 2024-09-12T01:29:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.sv5UM6dpDW4rNPDz_u-fnZyBjFRB9OZ_0 2024-09-12T01:29:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9348705800488359723', time=2024-09-12T03:12:30.869177+0000, chain.objs.size()=1 2024-09-12T01:29:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.sghRFy10xZVIMmmFKQinaJa4mtHhCTo_0 2024-09-12T01:29:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14680230073092191600', time=2024-09-12T03:12:31.246360+0000, chain.objs.size()=1 2024-09-12T01:29:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Tk1KRUKWzH6vBgW-r2oR2Nv62SKYQkb_0 2024-09-12T01:29:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15716529165223099685', time=2024-09-12T03:12:32.113651+0000, chain.objs.size()=1 2024-09-12T01:29:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ZnTNkJFsqSrKjTuUZuYIKPeZzzFtgQ2_0 2024-09-12T01:29:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5226266197911433542', time=2024-09-12T03:12:32.150002+0000, chain.objs.size()=1 2024-09-12T01:29:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.r6uLFgGxxdXXL6RZbE8KPHOZqgkyH2v_0 2024-09-12T01:29:14.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5014404190665170471', time=2024-09-12T03:12:32.199987+0000, chain.objs.size()=1 2024-09-12T01:29:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.p22CGCRQAaKH3KlG6kjZUIA0bYe6hNJ_0 2024-09-12T01:29:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5026439180492105740', time=2024-09-12T03:12:32.489174+0000, chain.objs.size()=1 2024-09-12T01:29:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RJJA_vYoMogth1HJd5YTnJFM0wLBX5c_0 2024-09-12T01:29:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16431801086105955088', time=2024-09-12T03:12:33.118929+0000, chain.objs.size()=1 2024-09-12T01:29:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.yBELIAOs8JWkUuN3TKgpmlH2a9cAUWu_0 2024-09-12T01:29:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7435798006944347135', time=2024-09-12T03:12:33.871957+0000, chain.objs.size()=1 2024-09-12T01:29:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.579+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Q0OV5obOY9ArpDk4T4MHcrgyYNIwB9q_0 2024-09-12T01:29:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.579+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11516115180560757349', time=2024-09-12T03:12:33.966296+0000, chain.objs.size()=1 2024-09-12T01:29:14.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.579+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Q0cmz1bQ1n-czTT9UhvVfkxMdaH21g8_0 2024-09-12T01:29:14.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.582+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6202092302204812936', time=2024-09-12T03:12:34.279264+0000, chain.objs.size()=1 2024-09-12T01:29:14.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.582+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.FRduY5yI9piYmWsIbKolr2mjiQYxfJj_0 2024-09-12T01:29:14.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.583+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17870060218389622314', time=2024-09-12T03:12:46.526442+0000, chain.objs.size()=1 2024-09-12T01:29:14.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.583+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.346__shadow_.KtRl-5jUZIXBCNuA0iaPi9nFXc7tpyv_0 2024-09-12T01:29:14.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.583+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1376837668658480260', time=2024-09-12T03:12:55.750980+0000, chain.objs.size()=1 2024-09-12T01:29:14.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.583+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.367__shadow_.Ep9gw001ADDggselYTLXHPMeqt0ZuHB_0 2024-09-12T01:29:14.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.583+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.659569081311824576', time=2024-09-12T03:13:03.694665+0000, chain.objs.size()=1 2024-09-12T01:29:14.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.583+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.379__shadow_.ISVFNS3NnyQ8YudNQPWMpIcpQmPDS1m_0 2024-09-12T01:29:14.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.586+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/48858 2024-09-12T01:29:14.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T01:29:14.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13190179706740337481', time=2024-09-12T03:13:05.580455+0000, chain.objs.size()=1 2024-09-12T01:29:14.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.382__shadow_.YX9nQsTPXahRJup2gOF-HNeB5g5vBnw_0 2024-09-12T01:29:14.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10046754089126953200', time=2024-09-12T03:13:55.933748+0000, chain.objs.size()=1 2024-09-12T01:29:14.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.464__shadow_.xTNXY_FsntHbzEiaFFyPL1n-XuEvniW_0 2024-09-12T01:29:14.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15232338107174281950', time=2024-09-12T03:14:05.139217+0000, chain.objs.size()=1 2024-09-12T01:29:14.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.483__shadow_.b8Nr0LwCLnKOpZQdUdl6CYMzbnjkKds_0 2024-09-12T01:29:14.589 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3375858997707809909', time=2024-09-12T03:14:15.064477+0000, chain.objs.size()=1 2024-09-12T01:29:14.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.496__shadow_.U5tHPx2JEnXCz3tJhMUIGe8Dayc6ox1_0 2024-09-12T01:29:14.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3766400769361243580', time=2024-09-12T03:14:59.894080+0000, chain.objs.size()=3 2024-09-12T01:29:14.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.521__multipart_mymultipart.2~pddIHVtQniLt8p83ZENj5dPzLGS7taU.1 2024-09-12T01:29:14.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.521__multipart_mymultipart.2~pddIHVtQniLt8p83ZENj5dPzLGS7taU.2 2024-09-12T01:29:14.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.521__multipart_mymultipart.2~pddIHVtQniLt8p83ZENj5dPzLGS7taU.3 2024-09-12T01:29:14.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14074413922414960739', time=2024-09-12T03:18:50.564844+0000, chain.objs.size()=1 2024-09-12T01:29:14.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.580__shadow:kkaVVB688oZx42XkZTWYr8--r8ju93._.3AyyCPJTj_96xrstLWEdhguHN3Mog3c_0 2024-09-12T01:29:14.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13021103364642028962', time=2024-09-12T03:18:54.385052+0000, chain.objs.size()=1 2024-09-12T01:29:14.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.585__shadow:W6-qynRpf202So9bt3TsouAB7qIaxmb_.ZCacQDCCib0UJu7mlrjtWRrJmPmd1SW_0 2024-09-12T01:29:14.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7984823295535969307', time=2024-09-12T03:18:56.969500+0000, chain.objs.size()=1 2024-09-12T01:29:14.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.587__shadow:HtS5KTSZK-VvQ6bTN28w3ddxw77QCHR_.tbbXrMYvQz_KZAlV9Bj77fxf8L5XLmP_0 2024-09-12T01:29:14.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17226459632617213442', time=2024-09-12T03:22:18.563530+0000, chain.objs.size()=1 2024-09-12T01:29:14.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.618__shadow_.T1mbDmZlFEVbxPFWoTo5A53uy38rvqy_0 2024-09-12T01:29:14.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11907446205875728904', time=2024-09-12T03:23:01.551542+0000, chain.objs.size()=1 2024-09-12T01:29:14.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.588+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.636__shadow_.m4a8PhzlgczsRkD2oiAiDkPltU_sU0r_0 2024-09-12T01:29:14.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.591+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11004870437940992805', time=2024-09-12T03:23:44.932988+0000, chain.objs.size()=1 2024-09-12T01:29:14.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.591+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.668__shadow_.0QckzYDEKcGViw5OZki3Vhs35PvfuM__0 2024-09-12T01:29:14.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.591+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16306776669912793883', time=2024-09-12T03:23:46.668892+0000, chain.objs.size()=1 2024-09-12T01:29:14.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.591+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.672__shadow_.9e4gSE3IgcYh6ipWxenTRoEqm3nV0B9_0 2024-09-12T01:29:14.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.594+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:14.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.597+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:29:14.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.598+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:14.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.599+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:14.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.599+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44314' 2024-09-12T01:29:14.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.599+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14792663198056036086', time=2024-09-12T03:07:08.577772+0000, chain.objs.size()=1 2024-09-12T01:29:14.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.599+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.181__shadow_.NojOnHGT5FQXcHsTx1khFlhAFs5hS0w_0 2024-09-12T01:29:14.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9793751917479943133', time=2024-09-12T03:07:11.893874+0000, chain.objs.size()=1 2024-09-12T01:29:14.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.188__shadow_.JACL40oBZkdVywAH7Iz3GZgEuiZKozN_0 2024-09-12T01:29:14.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7901340362185710379', time=2024-09-12T03:07:24.201328+0000, chain.objs.size()=1 2024-09-12T01:29:14.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.200__shadow_.FvTHUNKpcImza72gLEKrkg-3lqffyxn_0 2024-09-12T01:29:14.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9147146115278420288', time=2024-09-12T03:08:57.483963+0000, chain.objs.size()=1 2024-09-12T01:29:14.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.235__shadow_.wWlr_nOny34CHkI7OoVTb5GX1JYtuTA_0 2024-09-12T01:29:14.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10598264690730485791', time=2024-09-12T03:09:04.079612+0000, chain.objs.size()=1 2024-09-12T01:29:14.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.244__shadow_.AKTVAG_ZJdSo-qw3xMR7fn9ieO3oaOP_0 2024-09-12T01:29:14.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7471963535937927542', time=2024-09-12T03:09:05.357431+0000, chain.objs.size()=1 2024-09-12T01:29:14.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.246__shadow_.ZCmocn3HTB0hp4DZC78G7NXk4irLBSx_0 2024-09-12T01:29:14.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7863841587600824040', time=2024-09-12T03:09:08.585152+0000, chain.objs.size()=1 2024-09-12T01:29:14.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.251__shadow_.70U44kGUyamqiOTX2UQQaNSsFTzigze_0 2024-09-12T01:29:14.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15954997219160849915', time=2024-09-12T03:09:54.224639+0000, chain.objs.size()=1 2024-09-12T01:29:14.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.nVOS_45oXGFL3L0mPF5wT3j4yygUrTn_0 2024-09-12T01:29:14.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.180840478430609163', time=2024-09-12T03:09:54.248110+0000, chain.objs.size()=1 2024-09-12T01:29:14.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Um3l0SqMCYx5pOzfuUaNd2PvDILffnh_0 2024-09-12T01:29:14.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10119211664955802056', time=2024-09-12T03:09:54.980761+0000, chain.objs.size()=1 2024-09-12T01:29:14.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Pb_blrbrhRCS4-20utKmADiAxjYBatn_0 2024-09-12T01:29:14.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10478951957869999823', time=2024-09-12T03:09:55.126442+0000, chain.objs.size()=1 2024-09-12T01:29:14.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9IbFyQCl9rrpRtsK-SKroXVI8GqRMaX_0 2024-09-12T01:29:14.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8586071824419407022', time=2024-09-12T03:09:55.418064+0000, chain.objs.size()=1 2024-09-12T01:29:14.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.600+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Oj5MhN6SKpcoPXlirvhyULwZrU2miyJ_0 2024-09-12T01:29:14.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.602+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7205228861255802990', time=2024-09-12T03:09:55.484014+0000, chain.objs.size()=1 2024-09-12T01:29:14.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.602+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ebVxTgXJNMoBgUPd4eStmKLU7AhLPNu_0 2024-09-12T01:29:14.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.602+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10038326204271146443', time=2024-09-12T03:09:56.283097+0000, chain.objs.size()=1 2024-09-12T01:29:14.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.602+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.tMUr83Yg6TAYlgX3friZinw4Mm37OLw_0 2024-09-12T01:29:14.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.603+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10231716338192255949', time=2024-09-12T03:09:56.726833+0000, chain.objs.size()=1 2024-09-12T01:29:14.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.603+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.UxbD85CVM22j9_Q8vhNyKWUvHWnQocD_0 2024-09-12T01:29:14.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1572391020588556527', time=2024-09-12T03:09:57.122657+0000, chain.objs.size()=1 2024-09-12T01:29:14.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.UXL1W0HYHIVu6gqJ0jEAHwlFz-e5nJm_0 2024-09-12T01:29:14.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6014785863119868663', time=2024-09-12T03:09:57.235239+0000, chain.objs.size()=1 2024-09-12T01:29:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Kn-SrUfykH1TS9H6iRrEJuPc6A18Kx7_0 2024-09-12T01:29:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10204365207628565016', time=2024-09-12T03:09:57.994154+0000, chain.objs.size()=1 2024-09-12T01:29:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.FOFGEOskUlwcU1WzpOstLuez6GH09nM_0 2024-09-12T01:29:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17624781592252309999', time=2024-09-12T03:09:58.234379+0000, chain.objs.size()=1 2024-09-12T01:29:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.FM6iUbLsFtWeHBwSJzn_L7by-UIHaZ9_0 2024-09-12T01:29:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8648587248397924395', time=2024-09-12T03:09:58.551966+0000, chain.objs.size()=1 2024-09-12T01:29:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.GLtjeVtQSWLcpTiMtSAWk4m6F_icGPs_0 2024-09-12T01:29:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7108851849849839802', time=2024-09-12T03:09:58.597330+0000, chain.objs.size()=1 2024-09-12T01:29:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RI3BkBGXlEfTikiwrpU-Ej0aJqzcYkG_0 2024-09-12T01:29:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14259642502338960901', time=2024-09-12T03:09:58.799204+0000, chain.objs.size()=1 2024-09-12T01:29:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.7nt9AZ1S0J-SUqzPxXA5mDPEbDvA00J_0 2024-09-12T01:29:14.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15668040134011724365', time=2024-09-12T03:09:59.923337+0000, chain.objs.size()=1 2024-09-12T01:29:14.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.604+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.MZH2SQ0aneXTfbX09ivBfBPdJHWlMQt_0 2024-09-12T01:29:14.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.605+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8941246091132648222', time=2024-09-12T03:10:00.231156+0000, chain.objs.size()=1 2024-09-12T01:29:14.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.605+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.c6CfbM0YvU23-nY_POZPQYr3kwoZgYR_0 2024-09-12T01:29:14.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.606+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6993031350013734117', time=2024-09-12T03:10:00.247550+0000, chain.objs.size()=1 2024-09-12T01:29:14.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.606+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.TWL0RbfvMA0jTFmAE6UNr4hQamWige7_0 2024-09-12T01:29:14.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.607+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16390354662370588050', time=2024-09-12T03:10:00.638404+0000, chain.objs.size()=1 2024-09-12T01:29:14.607 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.607+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.3vqk8xO4nJi879AE-DZ513dYCmgtVun_0 2024-09-12T01:29:14.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.607+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3353021479301485560', time=2024-09-12T03:10:01.097266+0000, chain.objs.size()=1 2024-09-12T01:29:14.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.607+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.POZPO_QmWB575VoQoqkfSrro8IgNxAh_0 2024-09-12T01:29:14.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.608+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1434934801582221554', time=2024-09-12T03:10:01.574023+0000, chain.objs.size()=1 2024-09-12T01:29:14.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.608+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.huEbWv14gcH8VkrNGiC84Jltoi4rkO6_0 2024-09-12T01:29:14.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.608+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7246477835209502590', time=2024-09-12T03:10:02.206481+0000, chain.objs.size()=1 2024-09-12T01:29:14.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.608+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Dy8byvRrsEaG_zhfwh0owk-u9JyhZMP_0 2024-09-12T01:29:14.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.608+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4260501152568485046', time=2024-09-12T03:10:02.265231+0000, chain.objs.size()=1 2024-09-12T01:29:14.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.608+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.s1CTts923AOpRS58QKA7r0sjB_1P3uQ_0 2024-09-12T01:29:14.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.609+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5479836383428295721', time=2024-09-12T03:10:03.057881+0000, chain.objs.size()=1 2024-09-12T01:29:14.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.609+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._7yRolKwJ2FH_roonuGVUpaz17QLSNC_0 2024-09-12T01:29:14.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.610+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.804239430802883006', time=2024-09-12T03:10:03.167092+0000, chain.objs.size()=1 2024-09-12T01:29:14.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.610+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.FFmk09P3u___L8tAnrFu0uGdW2F2nMd_0 2024-09-12T01:29:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.610+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9737546841977935584', time=2024-09-12T03:10:03.178293+0000, chain.objs.size()=1 2024-09-12T01:29:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.610+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.l31SdVXFsz-XPS7QVSS296-RaDe7Bek_0 2024-09-12T01:29:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.610+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1153554714979860440', time=2024-09-12T03:10:03.314874+0000, chain.objs.size()=1 2024-09-12T01:29:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.610+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.CmfjkNN7KGYa0J-WoiM2Vjd88toyopi_0 2024-09-12T01:29:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.610+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15339319490850300937', time=2024-09-12T03:10:03.460287+0000, chain.objs.size()=1 2024-09-12T01:29:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.610+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.BYZ1RMwPcoK7e8yzVLFTr9BCc_2ufO6_0 2024-09-12T01:29:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.610+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11563298275944087538', time=2024-09-12T03:10:03.732451+0000, chain.objs.size()=1 2024-09-12T01:29:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.610+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.-nIWdIWzpcq4Ro_DZ8L2Hgn3mDpuGbV_0 2024-09-12T01:29:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.610+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3492944285115780792', time=2024-09-12T03:10:04.447124+0000, chain.objs.size()=1 2024-09-12T01:29:14.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.610+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.6OmjAeKnh0XzmMWyBpFurUJ5w_Rt4Jw_0 2024-09-12T01:29:14.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.611+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14418016651374062212', time=2024-09-12T03:10:04.644131+0000, chain.objs.size()=1 2024-09-12T01:29:14.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.611+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.aS9vEPpOh_6CcE2D3w7lMoWLVgIrVqW_0 2024-09-12T01:29:14.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.613+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10191945055005348773', time=2024-09-12T03:10:04.680644+0000, chain.objs.size()=1 2024-09-12T01:29:14.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.613+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.G4UzmDDg52UwV7kWaXNflWmVtL1Omwe_0 2024-09-12T01:29:14.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.613+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16957885537896958628', time=2024-09-12T03:10:04.682149+0000, chain.objs.size()=1 2024-09-12T01:29:14.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.613+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.YTjdkHiyMcPTnHH8yUn9IYwAgXYlF5M_0 2024-09-12T01:29:14.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.613+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8110606150906668299', time=2024-09-12T03:10:05.155123+0000, chain.objs.size()=1 2024-09-12T01:29:14.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.613+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.T3asDmFcwQJN-tf-kmvuAmAXXrzsBhM_0 2024-09-12T01:29:14.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.613+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13708976905656209720', time=2024-09-12T03:10:05.298989+0000, chain.objs.size()=1 2024-09-12T01:29:14.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.613+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.u7JszAwJEoqxL2I1CUp1eYUYIosLQmI_0 2024-09-12T01:29:14.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.614+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4545163897626001367', time=2024-09-12T03:10:05.879069+0000, chain.objs.size()=1 2024-09-12T01:29:14.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.614+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.cs6tyBFgGK0rZH0XnpUqqHgVAgW55f4_0 2024-09-12T01:29:14.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.615+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5444086288397381776', time=2024-09-12T03:10:05.913830+0000, chain.objs.size()=1 2024-09-12T01:29:14.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.615+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.m7UMon550PtCbLAbM8CQU4UBrnEu4dj_0 2024-09-12T01:29:14.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10288857049576696480', time=2024-09-12T03:10:06.460508+0000, chain.objs.size()=1 2024-09-12T01:29:14.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.BR6_mH_5l46AUh39MxHUVnLNrtwDbeC_0 2024-09-12T01:29:14.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5226984173885435903', time=2024-09-12T03:10:10.890557+0000, chain.objs.size()=1 2024-09-12T01:29:14.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.269__shadow_.dlsy3Tq1qP9gWVLYdOjOyBM_01K8DfI_0 2024-09-12T01:29:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11411521654178591188', time=2024-09-12T03:10:19.122897+0000, chain.objs.size()=1 2024-09-12T01:29:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.282__shadow_.Dr_a26kIeFiLBJ9jjNj89-qaveoTslv_0 2024-09-12T01:29:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16164020333888100670', time=2024-09-12T03:10:34.509798+0000, chain.objs.size()=1 2024-09-12T01:29:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.301__shadow_.i6lYqDAC3LZzKtxZ3Jxaoq-hT4R99AO_0 2024-09-12T01:29:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17962243178590611230', time=2024-09-12T03:10:35.836079+0000, chain.objs.size()=1 2024-09-12T01:29:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.303__shadow_.pa_4n36d4EPZi5-rokj2FEyLpnVtQPo_0 2024-09-12T01:29:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17161994645449831890', time=2024-09-12T03:10:39.116000+0000, chain.objs.size()=1 2024-09-12T01:29:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.307__shadow:X5Ng2KO19DlO9BHsZB8rvS7ss4sqr1t_.y15HEjAKcooRj1OrDil88T43Fihuot3_0 2024-09-12T01:29:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1933929630382214136', time=2024-09-12T03:10:46.940442+0000, chain.objs.size()=1 2024-09-12T01:29:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.319__shadow:puRPt5SATckt6NOgEKKKoxJHI08sWRh_.TMmjVJyOM8YrurJKmFaFr9jUfuKNYDO_0 2024-09-12T01:29:14.619 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12713125795579987253', time=2024-09-12T03:11:29.550398+0000, chain.objs.size()=1 2024-09-12T01:29:14.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.iAkKyo1w1KBAywzLdoU2jGN28R-Va8u_0 2024-09-12T01:29:14.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15346649494016950109', time=2024-09-12T03:11:30.121704+0000, chain.objs.size()=1 2024-09-12T01:29:14.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.XT1PIFgUtsF2Y-Hc32z1IQsQLKdSAky_0 2024-09-12T01:29:14.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3176808918034905230', time=2024-09-12T03:11:31.146301+0000, chain.objs.size()=1 2024-09-12T01:29:14.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5HaPCRo0IonXbIC9GWWs03qrvHZTP-d_0 2024-09-12T01:29:14.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3065422205616844472', time=2024-09-12T03:11:31.348530+0000, chain.objs.size()=1 2024-09-12T01:29:14.620 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.0-G6_KqwN4xORDF5oscRYSayKukxugg_0 2024-09-12T01:29:14.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.619+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11881227838851053635', time=2024-09-12T03:11:32.874528+0000, chain.objs.size()=1 2024-09-12T01:29:14.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.619+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.48D_QGHyC9PRn1_S--lA3OvJ8hS3DdE_0 2024-09-12T01:29:14.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.620+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7489754643029411071', time=2024-09-12T03:11:33.297194+0000, chain.objs.size()=1 2024-09-12T01:29:14.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.620+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.XFSkNeYau4lZoJ5ay-wXpS7ZY2pktAQ_0 2024-09-12T01:29:14.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.620+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11193391032979621895', time=2024-09-12T03:11:33.355380+0000, chain.objs.size()=1 2024-09-12T01:29:14.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.620+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.pGCtgYHX567Ixd7rKIvK6QSkL2u7WIu_0 2024-09-12T01:29:14.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.620+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.151031613055808431', time=2024-09-12T03:11:33.543466+0000, chain.objs.size()=1 2024-09-12T01:29:14.621 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.620+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.gbf6k5YkjKBPoZNIjEREYzToqdIUKWs_0 2024-09-12T01:29:14.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.620+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.427723394781419158', time=2024-09-12T03:11:35.169328+0000, chain.objs.size()=1 2024-09-12T01:29:14.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.620+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.l_p8sNLyJLkTzTQ9dISmn8XhSbmdWIA_0 2024-09-12T01:29:14.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.621+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16670253693072946889', time=2024-09-12T03:11:35.189387+0000, chain.objs.size()=1 2024-09-12T01:29:14.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.621+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xqkzN1zcX69SCqUl3nl5G0ttpEpOSXA_0 2024-09-12T01:29:14.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.621+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16812114643816197699', time=2024-09-12T03:11:36.109066+0000, chain.objs.size()=1 2024-09-12T01:29:14.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.621+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.lfwV3RgeDqlRsPV38_7K8b0RmbBZAtu_0 2024-09-12T01:29:14.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.623+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9863123749907691423', time=2024-09-12T03:11:36.173930+0000, chain.objs.size()=1 2024-09-12T01:29:14.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.623+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.nSuAddTxgBb1YzfaPXfgNY_pzSlPTbD_0 2024-09-12T01:29:14.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.623+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17258446834404153249', time=2024-09-12T03:11:36.244156+0000, chain.objs.size()=1 2024-09-12T01:29:14.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.623+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.54bbVsap7ifQlicDoeWAF2IaY-SVpGD_0 2024-09-12T01:29:14.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.623+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12499179654176456405', time=2024-09-12T03:11:36.455986+0000, chain.objs.size()=1 2024-09-12T01:29:14.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.623+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MVwi4FB68qStVzMTeDB2suOhXbY_x35_0 2024-09-12T01:29:14.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.623+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16982172634141645178', time=2024-09-12T03:11:36.665607+0000, chain.objs.size()=1 2024-09-12T01:29:14.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.623+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.G7tOorVcFYtHA2N3X0UQvxZuzr7LSxJ_0 2024-09-12T01:29:14.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.624+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8088083303594255199', time=2024-09-12T03:11:36.890717+0000, chain.objs.size()=1 2024-09-12T01:29:14.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.624+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.6VCcd2VEj6fFulypTF7FZB5-PwFTYxN_0 2024-09-12T01:29:14.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.625+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14577890305485574327', time=2024-09-12T03:11:36.891348+0000, chain.objs.size()=1 2024-09-12T01:29:14.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.625+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tmM4dopk0FnUt66L2bwbDVcY2biD7jt_0 2024-09-12T01:29:14.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.626+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8976489165601592967', time=2024-09-12T03:11:37.132033+0000, chain.objs.size()=1 2024-09-12T01:29:14.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.626+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.m4KDHSGplF6vF4wWqx9Juk5ZijCCq_k_0 2024-09-12T01:29:14.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.626+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3790511959548807188', time=2024-09-12T03:11:37.133448+0000, chain.objs.size()=1 2024-09-12T01:29:14.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.626+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.KPKJcu-AQ2dzPc4TK3TH9WBSxLIyV44_0 2024-09-12T01:29:14.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.626+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10262983212492197360', time=2024-09-12T03:11:37.673209+0000, chain.objs.size()=1 2024-09-12T01:29:14.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.626+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.dFYSIkVdTaX4scx5AVCQvgYvd2Io75M_0 2024-09-12T01:29:14.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.626+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14869895257954831025', time=2024-09-12T03:11:38.258090+0000, chain.objs.size()=1 2024-09-12T01:29:14.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.626+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ScIVTGJVU1dg4U9QFwGom6vIXakwau5_0 2024-09-12T01:29:14.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.626+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5634983919475081025', time=2024-09-12T03:11:38.547757+0000, chain.objs.size()=1 2024-09-12T01:29:14.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.626+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.52s9vfPcdvMQrAE9j51-oDJ8iPYkhLW_0 2024-09-12T01:29:14.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.628+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3107022592249705698', time=2024-09-12T03:11:39.230999+0000, chain.objs.size()=1 2024-09-12T01:29:14.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.628+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ZeqoHlmjtNDHQvg3a3_tjzesD5jTPQi_0 2024-09-12T01:29:14.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.629+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12183254658387473982', time=2024-09-12T03:11:39.611864+0000, chain.objs.size()=1 2024-09-12T01:29:14.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.629+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fuKgp_OX55nBplyQigY2FIYBMZ5vNrS_0 2024-09-12T01:29:14.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.629+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13824929064450104735', time=2024-09-12T03:11:39.812181+0000, chain.objs.size()=1 2024-09-12T01:29:14.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.629+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.clyJf34WME1XADcoKW4Mcxwyoi_OufK_0 2024-09-12T01:29:14.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.629+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.853002742919632745', time=2024-09-12T03:11:40.111006+0000, chain.objs.size()=1 2024-09-12T01:29:14.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.629+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.3Xbd0rc3kNhqjdFl0L25KPpkDLeGvxe_0 2024-09-12T01:29:14.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.629+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15953380056829636953', time=2024-09-12T03:11:40.281723+0000, chain.objs.size()=1 2024-09-12T01:29:14.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.629+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.IjcmJdhMXqbCV6Gn33RJ9E3qHQdxZh8_0 2024-09-12T01:29:14.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.629+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10784536657372148210', time=2024-09-12T03:11:40.725786+0000, chain.objs.size()=1 2024-09-12T01:29:14.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.629+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fo2-nevmnmGUZag3YtAq0MLBzNjGxs4_0 2024-09-12T01:29:14.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.630+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.167729045411538608', time=2024-09-12T03:11:40.727000+0000, chain.objs.size()=1 2024-09-12T01:29:14.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.630+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1Q4Zrxjv2if57KbDy0sBMBKUNjuwwh0_0 2024-09-12T01:29:14.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6915296152233789002', time=2024-09-12T03:11:40.854463+0000, chain.objs.size()=1 2024-09-12T01:29:14.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_._4eysleFOfI0-1hSvuR9A7fkRl3A52K_0 2024-09-12T01:29:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11511743007078209445', time=2024-09-12T03:11:40.859533+0000, chain.objs.size()=1 2024-09-12T01:29:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.AsgKx3BoOlw9oKGdRVlOAN07tVPxETp_0 2024-09-12T01:29:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14138684906538901918', time=2024-09-12T03:11:41.391017+0000, chain.objs.size()=1 2024-09-12T01:29:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.GSAlKvhTzwKbqpdu_k9oNduhcnSbo1V_0 2024-09-12T01:29:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18183657821907523385', time=2024-09-12T03:11:41.467056+0000, chain.objs.size()=1 2024-09-12T01:29:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.PnalA10VWS6xUj9dSZh_oAdI9uzHbad_0 2024-09-12T01:29:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4023986022657807940', time=2024-09-12T03:12:21.864993+0000, chain.objs.size()=1 2024-09-12T01:29:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.CRLkyt90ZJfz2GHXWPGQSSQ6M--vqGz_0 2024-09-12T01:29:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17223612867361540428', time=2024-09-12T03:12:22.096445+0000, chain.objs.size()=1 2024-09-12T01:29:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gEFBiwYnCvFaeQhI21TQlNRnolFqq6V_0 2024-09-12T01:29:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12090708665382372257', time=2024-09-12T03:12:22.097798+0000, chain.objs.size()=1 2024-09-12T01:29:14.634 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gxkDimoyfuwv8PHIksXd53PwgyT3XHz_0 2024-09-12T01:29:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9522363796148421290', time=2024-09-12T03:12:22.181103+0000, chain.objs.size()=1 2024-09-12T01:29:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.enkAfh79LFGWB0-lyxAd4Kv8v8hR0r3_0 2024-09-12T01:29:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10117683636778391312', time=2024-09-12T03:12:22.404108+0000, chain.objs.size()=1 2024-09-12T01:29:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.633+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.0lE4pMIvNa16W22A2spEt3xMY2U9nHw_0 2024-09-12T01:29:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.634+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.346391681355096080', time=2024-09-12T03:12:22.504935+0000, chain.objs.size()=1 2024-09-12T01:29:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.634+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.TIxEtSmqX1YHidM1vf4HxZvAjK7pN56_0 2024-09-12T01:29:14.635 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.635+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1951951007504788302', time=2024-09-12T03:12:22.693017+0000, chain.objs.size()=1 2024-09-12T01:29:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.635+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.2q4P8MLta4ATiGOZsJmo2g33jtWaXph_0 2024-09-12T01:29:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.636+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17003186353428134387', time=2024-09-12T03:12:22.998656+0000, chain.objs.size()=1 2024-09-12T01:29:14.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.636+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xQc15lO4OGR6e3eqdJQxHVZCeXRaLmC_0 2024-09-12T01:29:14.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.636+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14625437234690669488', time=2024-09-12T03:12:22.999838+0000, chain.objs.size()=1 2024-09-12T01:29:14.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.636+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mBCFm8cuioKt2XEsKkrkbWw-ZDyMNVj_0 2024-09-12T01:29:14.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.636+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12221619285827556262', time=2024-09-12T03:12:23.660538+0000, chain.objs.size()=1 2024-09-12T01:29:14.637 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.636+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.e68CXElf4MMlvpP5dncou3JDCU8zji6_0 2024-09-12T01:29:14.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.636+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1504315846786913214', time=2024-09-12T03:12:24.125591+0000, chain.objs.size()=1 2024-09-12T01:29:14.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.636+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hXmMu20LeMbLa400OlGCttkJ4UWB6w2_0 2024-09-12T01:29:14.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.637+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5527417945373213219', time=2024-09-12T03:12:24.192064+0000, chain.objs.size()=1 2024-09-12T01:29:14.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.637+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.9kycoctvUv-U46KXN2aqlw2o39hX6Yv_0 2024-09-12T01:29:14.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.637+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10956637773186196172', time=2024-09-12T03:12:24.822195+0000, chain.objs.size()=1 2024-09-12T01:29:14.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.637+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.bMtAgicQVMzbzxTsMT3ClUKauVSROOa_0 2024-09-12T01:29:14.638 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.638+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8973721643112635653', time=2024-09-12T03:12:25.345478+0000, chain.objs.size()=1 2024-09-12T01:29:14.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.638+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.yBE_L8rjB1yJR3ZQb3jJdpTOTp-qsjQ_0 2024-09-12T01:29:14.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.638+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1485346391164281384', time=2024-09-12T03:12:25.709762+0000, chain.objs.size()=1 2024-09-12T01:29:14.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.638+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.QwXkArfPnVpaGnp1kX2Fcy043z-UOKh_0 2024-09-12T01:29:14.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.638+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7186128618560565748', time=2024-09-12T03:12:25.902180+0000, chain.objs.size()=1 2024-09-12T01:29:14.639 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.638+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.vdEZdfQnlAP1Gp4T3pcqwY-rjfQBap1_0 2024-09-12T01:29:14.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.642+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/44314 2024-09-12T01:29:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T01:29:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7801425148360686796', time=2024-09-12T03:12:26.156646+0000, chain.objs.size()=1 2024-09-12T01:29:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.tHXWYPGdq2xx__UETgIb7QwzhrxrF3k_0 2024-09-12T01:29:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10036274602598241163', time=2024-09-12T03:12:27.612987+0000, chain.objs.size()=1 2024-09-12T01:29:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.2IoRsrE6-Hc0GC2-Hx1oAcwMTTFg9ZD_0 2024-09-12T01:29:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.658648398475062639', time=2024-09-12T03:12:29.256524+0000, chain.objs.size()=1 2024-09-12T01:29:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3rMZLb_Yb0Rd5inKf0wLWiVkpz3WcXa_0 2024-09-12T01:29:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15658857121424061541', time=2024-09-12T03:12:29.441226+0000, chain.objs.size()=1 2024-09-12T01:29:14.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.8llVlC36Hwp5rtFIcoenG86mXgJshNx_0 2024-09-12T01:29:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13279979403150959344', time=2024-09-12T03:12:29.780352+0000, chain.objs.size()=1 2024-09-12T01:29:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.E3y4hhJkIHBVaJw3OTSCzS8Xv6aELR__0 2024-09-12T01:29:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12056050267239311257', time=2024-09-12T03:12:30.393518+0000, chain.objs.size()=1 2024-09-12T01:29:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ywhQoYFcphXN8rQPM9cxOAhXPeqXqWM_0 2024-09-12T01:29:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3283794409879290806', time=2024-09-12T03:12:30.763578+0000, chain.objs.size()=1 2024-09-12T01:29:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.kKMNYJdm1Aa1Z8K2F_fYx2zTxUDjLKA_0 2024-09-12T01:29:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9731435508810923435', time=2024-09-12T03:12:30.799625+0000, chain.objs.size()=1 2024-09-12T01:29:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.UWyETZ1fxSfMu2SyU8DpN05HPKVBJNH_0 2024-09-12T01:29:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2124120366588248504', time=2024-09-12T03:12:31.144264+0000, chain.objs.size()=1 2024-09-12T01:29:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.yX3adx2PRQn19TJc6KexZpMERbyD85f_0 2024-09-12T01:29:14.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16043241779495826009', time=2024-09-12T03:12:32.404494+0000, chain.objs.size()=1 2024-09-12T01:29:14.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.QsF9w0TO9lKVY4DaHdLRY0f-B4dSZhE_0 2024-09-12T01:29:14.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.482755243540875617', time=2024-09-12T03:12:32.716548+0000, chain.objs.size()=1 2024-09-12T01:29:14.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.SKXJbwL6v6xR15WQi7OjAXkO3BXc4Wv_0 2024-09-12T01:29:14.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9081651006503674660', time=2024-09-12T03:12:33.129665+0000, chain.objs.size()=1 2024-09-12T01:29:14.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.644+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.EipP8h96OuDQhYOlFWXh8EoP8DhreIt_0 2024-09-12T01:29:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.647+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8485698881610295142', time=2024-09-12T03:12:33.615090+0000, chain.objs.size()=1 2024-09-12T01:29:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.647+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Kp5WtVdN8vKy7Qnhbe5kAVPnBHvnu9z_0 2024-09-12T01:29:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.647+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16383854955894117692', time=2024-09-12T03:12:33.736978+0000, chain.objs.size()=1 2024-09-12T01:29:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.647+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.40gJGbDVJAWHby8qsUr1npGoN_SPJE8_0 2024-09-12T01:29:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.647+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.129671197001169190', time=2024-09-12T03:12:33.769721+0000, chain.objs.size()=1 2024-09-12T01:29:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.647+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.E5dIcDtXVkK7dyY-SQJcUtPrUHUjJUh_0 2024-09-12T01:29:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.648+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.164190402754868542', time=2024-09-12T03:12:34.113221+0000, chain.objs.size()=1 2024-09-12T01:29:14.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.648+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.u0KiqCjnfUZ1e01DPmbR_e6eO_MSr4L_0 2024-09-12T01:29:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.649+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8856433315979301367', time=2024-09-12T03:12:34.536381+0000, chain.objs.size()=1 2024-09-12T01:29:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.649+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.vm7iMIc7NZpFcNOesED-UUF1sDHZFil_0 2024-09-12T01:29:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.649+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12072298872000330822', time=2024-09-12T03:14:05.110083+0000, chain.objs.size()=1 2024-09-12T01:29:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.649+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.483__shadow_.rrdZDhTubFVLMEi-JmwKFB49li4BhRA_0 2024-09-12T01:29:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.649+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6726624471948272744', time=2024-09-12T03:16:17.522129+0000, chain.objs.size()=2 2024-09-12T01:29:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.649+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.525__multipart_mymultipart.2~chtO7JcjYlqk-QNtkUFD94geNW-hsyr.1 2024-09-12T01:29:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.649+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.525__multipart_mymultipart.2~chtO7JcjYlqk-QNtkUFD94geNW-hsyr.2 2024-09-12T01:29:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.649+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7345614816345313085', time=2024-09-12T03:16:53.486345+0000, chain.objs.size()=1 2024-09-12T01:29:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.649+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.537__shadow_.5vg-Hd-4-8O9tgPgqIUXEwv1z6tojtJ_0 2024-09-12T01:29:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.649+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16404765889366424962', time=2024-09-12T03:17:25.083527+0000, chain.objs.size()=1 2024-09-12T01:29:14.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.649+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.557__shadow_.RTfNsBhukSCOmf26GNOb9yS93rwjuaR_0 2024-09-12T01:29:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.649+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6652239250320183027', time=2024-09-12T03:17:33.368274+0000, chain.objs.size()=1 2024-09-12T01:29:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.649+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.559__shadow_.bwzMTU5YZWgecUGYSyfFm7E7cqWOEkD_0 2024-09-12T01:29:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.651+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3835966806697458019', time=2024-09-12T03:17:59.915869+0000, chain.objs.size()=1 2024-09-12T01:29:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.651+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.573__shadow_.psNTU4e529TzpGxfXVtbJEjGMlMRn5c_0 2024-09-12T01:29:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.651+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10741852811663188553', time=2024-09-12T03:18:06.022507+0000, chain.objs.size()=1 2024-09-12T01:29:14.651 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.651+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.575__shadow_.Y_XkhYWEmp0gGkS_vIlpRHHexqi0Srv_0 2024-09-12T01:29:14.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.651+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13819611138210489766', time=2024-09-12T03:18:30.072168+0000, chain.objs.size()=1 2024-09-12T01:29:14.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.651+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:O-p93g2xJFkhxXPDFFYaszk5UJEOkkd_.AZpSy8tVIZbSx1jxsM9kga-nEZMsrD2_0 2024-09-12T01:29:14.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.651+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12747559103463050252', time=2024-09-12T03:18:48.535945+0000, chain.objs.size()=1 2024-09-12T01:29:14.652 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.652+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.579__shadow:DlA944Y9gk7bV.tbWsZOKK9PTqBekFP_.5AA5V_uJqPI1Bs-RHk9kuQF_MWeamjw_0 2024-09-12T01:29:14.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.653+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16864230335137826549', time=2024-09-12T03:20:07.888042+0000, chain.objs.size()=6 2024-09-12T01:29:14.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.653+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.614__multipart_multipart_enc.2~YHgnyPSfTx9ItFvHoiNHMtWvqx7I51V.1 2024-09-12T01:29:14.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.653+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.614__multipart_multipart_enc.2~YHgnyPSfTx9ItFvHoiNHMtWvqx7I51V.2 2024-09-12T01:29:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.654+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.614__multipart_multipart_enc.2~YHgnyPSfTx9ItFvHoiNHMtWvqx7I51V.3 2024-09-12T01:29:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.654+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.614__multipart_multipart_enc.2~YHgnyPSfTx9ItFvHoiNHMtWvqx7I51V.4 2024-09-12T01:29:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.654+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.614__multipart_multipart_enc.2~YHgnyPSfTx9ItFvHoiNHMtWvqx7I51V.5 2024-09-12T01:29:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.654+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.614__multipart_multipart_enc.2~YHgnyPSfTx9ItFvHoiNHMtWvqx7I51V.6 2024-09-12T01:29:14.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.654+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3056446302267903486', time=2024-09-12T03:20:15.670774+0000, chain.objs.size()=6 2024-09-12T01:29:14.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.654+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.615__multipart_multipart_enc.2~hUwd8gn53_HUTKp03RXxPY-mIcOpuI2.1 2024-09-12T01:29:14.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.655+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.615__multipart_multipart_enc.2~hUwd8gn53_HUTKp03RXxPY-mIcOpuI2.2 2024-09-12T01:29:14.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.656+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.615__multipart_multipart_enc.2~hUwd8gn53_HUTKp03RXxPY-mIcOpuI2.3 2024-09-12T01:29:14.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.656+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.615__multipart_multipart_enc.2~hUwd8gn53_HUTKp03RXxPY-mIcOpuI2.4 2024-09-12T01:29:14.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.656+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.615__multipart_multipart_enc.2~hUwd8gn53_HUTKp03RXxPY-mIcOpuI2.5 2024-09-12T01:29:14.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.656+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.615__multipart_multipart_enc.2~hUwd8gn53_HUTKp03RXxPY-mIcOpuI2.6 2024-09-12T01:29:14.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.656+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16456067093896193178', time=2024-09-12T03:24:02.618864+0000, chain.objs.size()=1 2024-09-12T01:29:14.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.656+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.701__shadow:cuagN-uPK7T4eRKNwD-J7JYy-C9LdW5_.zjZIUlxX2KAORKh2Wjl58fS4JuvKA7-_0 2024-09-12T01:29:14.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.659+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12553594717183255863', time=2024-09-12T03:24:04.136121+0000, chain.objs.size()=1 2024-09-12T01:29:14.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.659+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.703__shadow:7xVv2aLPU.R1LZUQYqso.G7Creq.ekE_.vIDUNZ-4vsjNsYBMRpWQYLluGLU_lMP_0 2024-09-12T01:29:14.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.664+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:14.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.667+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:29:14.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.668+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:14.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.668+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50365' 2024-09-12T01:29:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2527741766779043800', time=2024-09-12T03:07:01.656275+0000, chain.objs.size()=1 2024-09-12T01:29:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.170__shadow_.adQ7QHx0tbyPvZgc7GsYoiYwwfhf3UO_0 2024-09-12T01:29:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.818284912701534970', time=2024-09-12T03:07:27.675648+0000, chain.objs.size()=1 2024-09-12T01:29:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.203__shadow_.PWmuwfaXSNqcHrwFxp81aj9kyfNHaL4_0 2024-09-12T01:29:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1746194000446701483', time=2024-09-12T03:08:59.955818+0000, chain.objs.size()=1 2024-09-12T01:29:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.238__shadow_.5WWcC8PfCkBWFFG8hS5SF6QCBxC8IJ__0 2024-09-12T01:29:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16171193429934151397', time=2024-09-12T03:09:01.612228+0000, chain.objs.size()=1 2024-09-12T01:29:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.241__shadow_.ze70f7A52NPcB6F5QdGiKv2BAfkzZDW_0 2024-09-12T01:29:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17049341298609516354', time=2024-09-12T03:09:01.612979+0000, chain.objs.size()=1 2024-09-12T01:29:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.241__shadow_.TO87vlSTnm--73lBFPCY2z8Qp_CK2uL_0 2024-09-12T01:29:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15358895840838486444', time=2024-09-12T03:09:06.019638+0000, chain.objs.size()=1 2024-09-12T01:29:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.247__shadow_.AfseeYN5aciKU4SU7XC7laq6J6WsECk_0 2024-09-12T01:29:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7019146424414120539', time=2024-09-12T03:09:54.276231+0000, chain.objs.size()=1 2024-09-12T01:29:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.C2rX6qduuQ8CHMxZXLK-auzu7_EPi6s_0 2024-09-12T01:29:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16002746084276075637', time=2024-09-12T03:09:55.386842+0000, chain.objs.size()=1 2024-09-12T01:29:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.uKD7PKnpCp6uGtMPa_GBewHlwPOXRr7_0 2024-09-12T01:29:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.659556713856715749', time=2024-09-12T03:09:56.353223+0000, chain.objs.size()=1 2024-09-12T01:29:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.HWhBVf02xHWEHay6BG76bViawxiLg8e_0 2024-09-12T01:29:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5730935111606187043', time=2024-09-12T03:09:56.945427+0000, chain.objs.size()=1 2024-09-12T01:29:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lFxKC-P64qMjXWyRlBI3PGdtBk1gs7s_0 2024-09-12T01:29:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8949356631256513357', time=2024-09-12T03:09:57.118748+0000, chain.objs.size()=1 2024-09-12T01:29:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8AA5VelNGiL3soi4nGndXHepc9yIAki_0 2024-09-12T01:29:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14757906818057306508', time=2024-09-12T03:09:57.784565+0000, chain.objs.size()=1 2024-09-12T01:29:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.670+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.jGbT2XuNHZwbZv217V7RRTsTWplIyeM_0 2024-09-12T01:29:14.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.673+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.478483381951987796', time=2024-09-12T03:09:58.350216+0000, chain.objs.size()=1 2024-09-12T01:29:14.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.673+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.veEJVae5WkUGDP4CLTCU2JW4fxVHWND_0 2024-09-12T01:29:14.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.673+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1656801407844505701', time=2024-09-12T03:09:58.538941+0000, chain.objs.size()=1 2024-09-12T01:29:14.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.673+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.doBlmG9IdCF9HU_gSQxQC7DiAhPl3iE_0 2024-09-12T01:29:14.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.673+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14494422774008581121', time=2024-09-12T03:09:58.928550+0000, chain.objs.size()=1 2024-09-12T01:29:14.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.673+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8uba0fy-KmK0uVac3SstAYhV3LhBLtN_0 2024-09-12T01:29:14.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4093900244979986340', time=2024-09-12T03:09:59.425587+0000, chain.objs.size()=1 2024-09-12T01:29:14.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lXlSWStHP8WUgey0FHEH_He_oNzpLD-_0 2024-09-12T01:29:14.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4485441798354384103', time=2024-09-12T03:10:00.096220+0000, chain.objs.size()=1 2024-09-12T01:29:14.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.bvrdqu4N8C_QEjZRhSDJpDyFAxDprnY_0 2024-09-12T01:29:14.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17160483741441033368', time=2024-09-12T03:10:00.263562+0000, chain.objs.size()=1 2024-09-12T01:29:14.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.79Osae3h1FSQI4PVfEAQDxxY0ILhyY__0 2024-09-12T01:29:14.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4445840848460924334', time=2024-09-12T03:10:01.676831+0000, chain.objs.size()=1 2024-09-12T01:29:14.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.10XTxeRvw-W5TfpwRjXGerCDLz53LVa_0 2024-09-12T01:29:14.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4445739937414637864', time=2024-09-12T03:10:01.935496+0000, chain.objs.size()=1 2024-09-12T01:29:14.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dHKrpXxIbr2wiWQNPxXkgfzNRhKntlt_0 2024-09-12T01:29:14.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2990473112647276480', time=2024-09-12T03:10:02.025849+0000, chain.objs.size()=1 2024-09-12T01:29:14.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.jjeypS8K5o28va5Y3DsHllT_f2xUXeG_0 2024-09-12T01:29:14.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18127229326900870269', time=2024-09-12T03:10:02.234212+0000, chain.objs.size()=1 2024-09-12T01:29:14.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.xkMdLwt_t4laJ3-y3Rv1-IU0F7q904U_0 2024-09-12T01:29:14.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5848739828845966968', time=2024-09-12T03:10:03.164223+0000, chain.objs.size()=1 2024-09-12T01:29:14.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.674+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QrKBkUjJw9In0uwBOVbwwgkpXuU7E0A_0 2024-09-12T01:29:14.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.677+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2762204105301564664', time=2024-09-12T03:10:03.208030+0000, chain.objs.size()=1 2024-09-12T01:29:14.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.677+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.3o6dMsCIidM9_yV_59vijoYZRxhgqqL_0 2024-09-12T01:29:14.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.678+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1868019113414807482', time=2024-09-12T03:10:03.675628+0000, chain.objs.size()=1 2024-09-12T01:29:14.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.678+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.yOWzIwgdB-NHOoDBnyi0jx8KPw_CjML_0 2024-09-12T01:29:14.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9591319945503450570', time=2024-09-12T03:10:04.366207+0000, chain.objs.size()=1 2024-09-12T01:29:14.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.iiQR2YCvpNuJdDJ_TQpmIjFxx1OYQe5_0 2024-09-12T01:29:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5077559030756101753', time=2024-09-12T03:10:04.406171+0000, chain.objs.size()=1 2024-09-12T01:29:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.VMLH4kyLYSOkHbyvImrPdDRV-PhTAn9_0 2024-09-12T01:29:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18221008695988711161', time=2024-09-12T03:10:04.463438+0000, chain.objs.size()=1 2024-09-12T01:29:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.phAYfZtd-bR-18icXsyswNsvJXIJlHd_0 2024-09-12T01:29:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10926114058598069453', time=2024-09-12T03:10:04.464667+0000, chain.objs.size()=1 2024-09-12T01:29:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.WLLJ8QnPFaSheGHQv3RK6vKBxFv6fWk_0 2024-09-12T01:29:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8576189970086794873', time=2024-09-12T03:10:04.537652+0000, chain.objs.size()=1 2024-09-12T01:29:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.J4w8qNWCcalY2-46qwO8bAxjsggxsoA_0 2024-09-12T01:29:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10883458963625174560', time=2024-09-12T03:10:04.718997+0000, chain.objs.size()=1 2024-09-12T01:29:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.SJzfsEEAI9aQRP8GirdtW1_dGS9_5k-_0 2024-09-12T01:29:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18334221243357019697', time=2024-09-12T03:10:04.719794+0000, chain.objs.size()=1 2024-09-12T01:29:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.uY2GZPAfwnrLeHHWqiHHEVGHEzr_lN9_0 2024-09-12T01:29:14.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14925294075886713836', time=2024-09-12T03:10:05.245222+0000, chain.objs.size()=1 2024-09-12T01:29:14.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.hkUwJg7JtGFFjm0XLD6ACbFgFY7MyT-_0 2024-09-12T01:29:14.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.642447150394032630', time=2024-09-12T03:10:05.352368+0000, chain.objs.size()=1 2024-09-12T01:29:14.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.679+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.DSdC8bpzeP6QZ2RdTdzdmQSB-pYT8lL_0 2024-09-12T01:29:14.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.680+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8423363042357176700', time=2024-09-12T03:10:05.728854+0000, chain.objs.size()=1 2024-09-12T01:29:14.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.680+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.-vdQtz5rdDvOAbpXbYjj7f9CcTpQ7KF_0 2024-09-12T01:29:14.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.683+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10699584436424369447', time=2024-09-12T03:10:05.908624+0000, chain.objs.size()=1 2024-09-12T01:29:14.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.683+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.giRzWbMeohczAlpqGUmAib4Z57Hy2Kp_0 2024-09-12T01:29:14.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.683+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10949592794869687778', time=2024-09-12T03:10:06.387305+0000, chain.objs.size()=1 2024-09-12T01:29:14.684 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.683+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.NsU3drCN7karI5YZQXOphwr3eE7NiO7_0 2024-09-12T01:29:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10482140487085299134', time=2024-09-12T03:10:06.422534+0000, chain.objs.size()=1 2024-09-12T01:29:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8NSBivrLxC-BHoWa1Ne6_VJwmt-xHfJ_0 2024-09-12T01:29:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15049845251700031531', time=2024-09-12T03:10:06.634396+0000, chain.objs.size()=1 2024-09-12T01:29:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.srC54xMNDRWfGk_MXa3jt45VbbQcOR9_0 2024-09-12T01:29:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11074200267407380868', time=2024-09-12T03:10:06.682765+0000, chain.objs.size()=1 2024-09-12T01:29:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.qrZV5pBUmLaNpchQ_HYpQGa0vnHy-Un_0 2024-09-12T01:29:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.212888703590404612', time=2024-09-12T03:10:10.298744+0000, chain.objs.size()=1 2024-09-12T01:29:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.268__shadow_.sZIP1rJTkcz8635uPfO3M9zE8I1qaE1_0 2024-09-12T01:29:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6126345627566950326', time=2024-09-12T03:10:21.130137+0000, chain.objs.size()=1 2024-09-12T01:29:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.285__shadow_.zKmLdT53jyoi7Ewr3fmyMQoJGli3dXk_0 2024-09-12T01:29:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8625274387208813049', time=2024-09-12T03:10:27.186029+0000, chain.objs.size()=1 2024-09-12T01:29:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.1cwyVKuibCy8pfIdBctaHv3zyMSmdkk_0 2024-09-12T01:29:14.685 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3377374314830039346', time=2024-09-12T03:10:29.159361+0000, chain.objs.size()=1 2024-09-12T01:29:14.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.5TIqqNRUpC9IRPMrDY7oyxBpdQuosYB_0 2024-09-12T01:29:14.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11314629884766526641', time=2024-09-12T03:10:30.508117+0000, chain.objs.size()=1 2024-09-12T01:29:14.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.684+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.295__shadow_.Fu1K-ZV6GzInEVraVNbOb1pKJZzhru6_0 2024-09-12T01:29:14.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.685+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13604455539584265265', time=2024-09-12T03:10:33.233570+0000, chain.objs.size()=1 2024-09-12T01:29:14.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.685+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.299__shadow_.zipPsgfMw3DH7Xf1l_pa3hFz66PAZ2k_0 2024-09-12T01:29:14.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.685+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13512906727677079049', time=2024-09-12T03:11:29.805472+0000, chain.objs.size()=1 2024-09-12T01:29:14.686 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.685+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-wxDyG73AgdzWlq8qsP5x3VzudjLoMV_0 2024-09-12T01:29:14.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.687+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17825666837764930741', time=2024-09-12T03:11:30.026719+0000, chain.objs.size()=1 2024-09-12T01:29:14.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.687+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ZUlIGgg0_PFf1_o0DKmp8zr4ambLekD_0 2024-09-12T01:29:14.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.687+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14820554689126262656', time=2024-09-12T03:11:30.164816+0000, chain.objs.size()=1 2024-09-12T01:29:14.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.687+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.CQjZojDbWwUMoUde3ZQ8IhbH3AOc8Ix_0 2024-09-12T01:29:14.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.687+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4672515207870172441', time=2024-09-12T03:11:30.332725+0000, chain.objs.size()=1 2024-09-12T01:29:14.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.687+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Cv4wyrzq2s5r0k8cC5Oj_6lV3_YuCZf_0 2024-09-12T01:29:14.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.688+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16197325619913165035', time=2024-09-12T03:11:31.123218+0000, chain.objs.size()=1 2024-09-12T01:29:14.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.688+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.UpqJB8Vs7vcza0sp_DK3vyEiB-jC4Bs_0 2024-09-12T01:29:14.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.689+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13798970886432814493', time=2024-09-12T03:11:31.488229+0000, chain.objs.size()=1 2024-09-12T01:29:14.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.689+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.oPXROZ_m3_jBNIfnFocHdoaWylmn4vo_0 2024-09-12T01:29:14.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.689+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6886373074960889410', time=2024-09-12T03:11:31.798601+0000, chain.objs.size()=1 2024-09-12T01:29:14.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.689+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5tdSA4rwl8Rj4aiSgKOKb2heXIyE1W4_0 2024-09-12T01:29:14.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.690+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9215598293522106822', time=2024-09-12T03:11:31.988288+0000, chain.objs.size()=1 2024-09-12T01:29:14.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fnPbLzRjIUe4peMmt3qaThzvcWhwUxa_0 2024-09-12T01:29:14.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.690+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4302539921353836686', time=2024-09-12T03:11:32.247941+0000, chain.objs.size()=1 2024-09-12T01:29:14.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fNNAVKXfCYKagaFtL5oDHNqPJILNEAO_0 2024-09-12T01:29:14.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.690+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9894983630687756960', time=2024-09-12T03:11:32.329638+0000, chain.objs.size()=1 2024-09-12T01:29:14.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1-Uzu3SypjUY3hefKKgwSDR0FU-_hAa_0 2024-09-12T01:29:14.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.690+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12012991794371293044', time=2024-09-12T03:11:32.833468+0000, chain.objs.size()=1 2024-09-12T01:29:14.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.3ZiwD74bwR275ePQKgTTpa81lX6Stkq_0 2024-09-12T01:29:14.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.690+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9735049316130948954', time=2024-09-12T03:11:32.984795+0000, chain.objs.size()=1 2024-09-12T01:29:14.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.nbLXsKoX7xBA3wBLZke4HJ7nVhZsiv6_0 2024-09-12T01:29:14.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.690+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10123662224352401719', time=2024-09-12T03:11:33.476883+0000, chain.objs.size()=1 2024-09-12T01:29:14.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tbhx9MNPezYG51LsnYvc_5F-65R-Ois_0 2024-09-12T01:29:14.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.692+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1804227906662105551', time=2024-09-12T03:11:33.564022+0000, chain.objs.size()=1 2024-09-12T01:29:14.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.692+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.RB4ZGSmI_7tILeUdYtHnWlb6uGg4czQ_0 2024-09-12T01:29:14.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.692+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2755705290037782301', time=2024-09-12T03:11:33.650682+0000, chain.objs.size()=1 2024-09-12T01:29:14.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.692+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.RoQRcCVrXPsdJG9o5grs85EPXvyyIFI_0 2024-09-12T01:29:14.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.692+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15618293599549986811', time=2024-09-12T03:11:34.467086+0000, chain.objs.size()=1 2024-09-12T01:29:14.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.692+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.lzJB5PyzfHe50GEIxV3xeXUqpT1FYQt_0 2024-09-12T01:29:14.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.692+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18312854378358536903', time=2024-09-12T03:11:34.697077+0000, chain.objs.size()=1 2024-09-12T01:29:14.693 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.692+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.T2sW0lCQ1fJW8YdRmT1KYc3R5APAhFs_0 2024-09-12T01:29:14.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.694+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14189831319236001088', time=2024-09-12T03:11:34.740435+0000, chain.objs.size()=1 2024-09-12T01:29:14.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.694+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.uxSUuaa4E5QCWpNkbnRLu5LnzASfHZ8_0 2024-09-12T01:29:14.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.694+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13415450378248386737', time=2024-09-12T03:11:34.888768+0000, chain.objs.size()=1 2024-09-12T01:29:14.694 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.694+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.JZSCVL0MW5c6zWBpubUhOx30U104pIp_0 2024-09-12T01:29:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.694+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4966345636657118072', time=2024-09-12T03:11:35.441849+0000, chain.objs.size()=1 2024-09-12T01:29:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.694+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.KqmVfNjar4ZDnrC0Hy5xDbnMj0gt07J_0 2024-09-12T01:29:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.694+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11746468564731288131', time=2024-09-12T03:11:35.662544+0000, chain.objs.size()=1 2024-09-12T01:29:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.694+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.DXZ4gpc_rWdOWurztxJklzHa3wZi_4w_0 2024-09-12T01:29:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.694+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2741793475009843222', time=2024-09-12T03:11:36.224591+0000, chain.objs.size()=1 2024-09-12T01:29:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.694+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.BYAyzlsKCd8zrr0Anzk-QVXBOGA5I4b_0 2024-09-12T01:29:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.694+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7082116435583563470', time=2024-09-12T03:11:36.559519+0000, chain.objs.size()=1 2024-09-12T01:29:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.694+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.6_nA8OhaETRbS4Eyzzor3D4MXj6KUD2_0 2024-09-12T01:29:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.694+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.834746944647592293', time=2024-09-12T03:11:37.093325+0000, chain.objs.size()=1 2024-09-12T01:29:14.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.694+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.y6lWQCjwT9jS8lFlbZ-HnzM_10PjdOG_0 2024-09-12T01:29:14.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.696+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11902746517099077164', time=2024-09-12T03:11:37.133488+0000, chain.objs.size()=1 2024-09-12T01:29:14.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.696+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.s9jcAYCyUvNwPZBIuUHiGyJ9KA_vIGt_0 2024-09-12T01:29:14.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.696+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16575433840688073002', time=2024-09-12T03:11:37.275685+0000, chain.objs.size()=1 2024-09-12T01:29:14.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.696+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.DtG2j0b0tDUXP-SL_sVnBjKFQBMs9IF_0 2024-09-12T01:29:14.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.696+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.723698998278508638', time=2024-09-12T03:11:37.656150+0000, chain.objs.size()=1 2024-09-12T01:29:14.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.696+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.pGBc73a_oVUaxSyB6qrBiG4w0nmO0VI_0 2024-09-12T01:29:14.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.696+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3607591040661726214', time=2024-09-12T03:11:38.148600+0000, chain.objs.size()=1 2024-09-12T01:29:14.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.696+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.YAhubB_hL6wYjb9s60TqkAWIfXxYgmK_0 2024-09-12T01:29:14.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.697+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3147614003712163539', time=2024-09-12T03:11:38.508654+0000, chain.objs.size()=1 2024-09-12T01:29:14.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.697+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.dc0Zi2idtnVAG30WjoN8ES0fSjxUS2q_0 2024-09-12T01:29:14.697 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.697+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7450224358785857720', time=2024-09-12T03:11:38.765627+0000, chain.objs.size()=1 2024-09-12T01:29:14.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.697+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7ST-T3ukzWSrNe6gxl1ZVNXDARl38iw_0 2024-09-12T01:29:14.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.699+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13219629681839416047', time=2024-09-12T03:11:39.192521+0000, chain.objs.size()=1 2024-09-12T01:29:14.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.699+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.XmoMt_KbPykeo_SoNMGFUO9O6TApJCS_0 2024-09-12T01:29:14.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.699+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3427931230062754592', time=2024-09-12T03:11:39.538693+0000, chain.objs.size()=1 2024-09-12T01:29:14.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.699+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.BjwtVzYx39Ol1bi4THFP5YqCsyL55RS_0 2024-09-12T01:29:14.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.699+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15265916228836899059', time=2024-09-12T03:11:39.915825+0000, chain.objs.size()=1 2024-09-12T01:29:14.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.699+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.pJsc7N9Gr0Joclowcut0WCcZ-vj8gG-_0 2024-09-12T01:29:14.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.700+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15147900036489993153', time=2024-09-12T03:11:41.500265+0000, chain.objs.size()=1 2024-09-12T01:29:14.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.700+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.8_AN56T0luIn5LWumKmLWrXzJQOB95L_0 2024-09-12T01:29:14.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.700+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8015852469453252701', time=2024-09-12T03:11:41.540745+0000, chain.objs.size()=1 2024-09-12T01:29:14.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.700+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.UsWX-7nQPI9al3rqYb-tfar67DHgetf_0 2024-09-12T01:29:14.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.700+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10061612118624556739', time=2024-09-12T03:11:41.596285+0000, chain.objs.size()=1 2024-09-12T01:29:14.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.700+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mNrDIZjFNo6lae0OASRZndXFdHJwKFs_0 2024-09-12T01:29:14.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.700+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16720334468800207075', time=2024-09-12T03:12:23.032052+0000, chain.objs.size()=1 2024-09-12T01:29:14.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.700+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.DO6PfVhBkztj0gso7X4A_I4Y-ukdtJz_0 2024-09-12T01:29:14.701 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.701+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3914708106292200405', time=2024-09-12T03:12:23.878197+0000, chain.objs.size()=1 2024-09-12T01:29:14.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.701+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1fFEW9jQx8z_4g8eoVSviKgUYDfR3sD_0 2024-09-12T01:29:14.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.701+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16672598879532798605', time=2024-09-12T03:12:24.049495+0000, chain.objs.size()=1 2024-09-12T01:29:14.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.701+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hIZFh5LiBJf5M_xBrnRkKJb5vGOmT3o_0 2024-09-12T01:29:14.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.701+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6617380945654936357', time=2024-09-12T03:12:24.721534+0000, chain.objs.size()=1 2024-09-12T01:29:14.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.701+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.aataeyHzsHjhsBqN0twMneRfFfHiwBf_0 2024-09-12T01:29:14.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.701+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6787566128137214120', time=2024-09-12T03:12:24.814790+0000, chain.objs.size()=1 2024-09-12T01:29:14.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.701+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.4GhoJcLt24QRuUZ6UOfNeSpoRdm1J8H_0 2024-09-12T01:29:14.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.702+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12038224359902970057', time=2024-09-12T03:12:25.801080+0000, chain.objs.size()=1 2024-09-12T01:29:14.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.702+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.KwcOPGIQEaTGDdc2w8TYJnFoLY4xg3s_0 2024-09-12T01:29:14.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.703+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12058038766758888779', time=2024-09-12T03:12:26.005060+0000, chain.objs.size()=1 2024-09-12T01:29:14.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.703+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.LXoNOFf64NDl19C0Tx0WW1g2myhuIcs_0 2024-09-12T01:29:14.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.703+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13468215452232048675', time=2024-09-12T03:12:26.299082+0000, chain.objs.size()=1 2024-09-12T01:29:14.703 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.703+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.qCGxBmjqbWXaLsgHyZk8gGS11XZ6hAj_0 2024-09-12T01:29:14.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.705+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5675519358485731874', time=2024-09-12T03:12:27.370221+0000, chain.objs.size()=1 2024-09-12T01:29:14.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.705+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.2kawo7dbwuOfwlfpMBfgjm84A-mK2Sm_0 2024-09-12T01:29:14.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.705+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2219061007283618635', time=2024-09-12T03:12:27.821592+0000, chain.objs.size()=1 2024-09-12T01:29:14.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.705+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.7vhJ2Q2hC0cmqGlB8F7oHpC7xiYp_58_0 2024-09-12T01:29:14.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.705+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11131415230767467521', time=2024-09-12T03:12:28.142181+0000, chain.objs.size()=1 2024-09-12T01:29:14.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.705+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MdCtUDMwniavN-JTcR_oCi01fM6XVrl_0 2024-09-12T01:29:14.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.705+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8013721588506124020', time=2024-09-12T03:12:28.283704+0000, chain.objs.size()=1 2024-09-12T01:29:14.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.705+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.vepyV8A7hVG3zlkf-rroamuvAIYnDFs_0 2024-09-12T01:29:14.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.706+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3145856910251399485', time=2024-09-12T03:12:29.184280+0000, chain.objs.size()=1 2024-09-12T01:29:14.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.706+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.sSIGfNQfFDXoXvw5DVwxsO56NfUGrx1_0 2024-09-12T01:29:14.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.706+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17215635332678248654', time=2024-09-12T03:12:29.204502+0000, chain.objs.size()=1 2024-09-12T01:29:14.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.706+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.if_YF9JSsXFZBt-sHYFTqyZxWpMB5TJ_0 2024-09-12T01:29:14.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.706+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18128279177594896056', time=2024-09-12T03:12:29.336497+0000, chain.objs.size()=1 2024-09-12T01:29:14.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.706+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Sh6Z281pmn2XPgABzlTxOIHEoX6ywoX_0 2024-09-12T01:29:14.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.706+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4795601004536794761', time=2024-09-12T03:12:29.956714+0000, chain.objs.size()=1 2024-09-12T01:29:14.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.706+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.QaRQA50_AyV52e_JJIb_exLs0DYY03R_0 2024-09-12T01:29:14.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.706+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8336538224636769278', time=2024-09-12T03:12:30.418878+0000, chain.objs.size()=1 2024-09-12T01:29:14.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.706+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.wL72Mt5UmZOb6GrfWxEa_s7p35p33Cu_0 2024-09-12T01:29:14.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.706+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10709112537302343006', time=2024-09-12T03:12:30.604522+0000, chain.objs.size()=1 2024-09-12T01:29:14.707 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.706+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Zuas3qbfybAOaEaHxb8djjai_OTx57R_0 2024-09-12T01:29:14.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.711+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/50365 2024-09-12T01:29:14.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-12T01:29:14.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6291215445777653549', time=2024-09-12T03:12:30.801015+0000, chain.objs.size()=1 2024-09-12T01:29:14.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gyu8cOg-m0nHnm84ed5hgjapI864zNL_0 2024-09-12T01:29:14.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11232516124690185947', time=2024-09-12T03:12:31.991945+0000, chain.objs.size()=1 2024-09-12T01:29:14.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Rqqm1Sm6ihcVMeWBQc5q_I-_nmdh76g_0 2024-09-12T01:29:14.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9471963053591149563', time=2024-09-12T03:12:31.992687+0000, chain.objs.size()=1 2024-09-12T01:29:14.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.L0ZHzC5SOs2zg7GDWYLL--ekCbaIpaB_0 2024-09-12T01:29:14.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13125513309800469965', time=2024-09-12T03:12:32.517389+0000, chain.objs.size()=1 2024-09-12T01:29:14.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.2t47KMGRaDueI3osHvTmcu7ALkfCS3F_0 2024-09-12T01:29:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5697844268533874705', time=2024-09-12T03:12:32.756476+0000, chain.objs.size()=1 2024-09-12T01:29:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.0ek-z8PTY56IpVV895VIBGKVOuim-DM_0 2024-09-12T01:29:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12023708581847578840', time=2024-09-12T03:12:32.794029+0000, chain.objs.size()=1 2024-09-12T01:29:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.nRFyQ5LcVEtD9OEEAwD33UKfqIdseut_0 2024-09-12T01:29:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5549599992953720225', time=2024-09-12T03:12:33.067888+0000, chain.objs.size()=1 2024-09-12T01:29:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Wj6WGAUdwqNlUGqy6jH_KrvsJ40_Qez_0 2024-09-12T01:29:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2312284598959171803', time=2024-09-12T03:12:33.498992+0000, chain.objs.size()=1 2024-09-12T01:29:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.kPb5lE-uzBDu3AoeomNiGoJyYIcfwYs_0 2024-09-12T01:29:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8741984134770049657', time=2024-09-12T03:12:33.873883+0000, chain.objs.size()=1 2024-09-12T01:29:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.zKk09oEWQagfZpaVmtSw4YUWbL7JdZZ_0 2024-09-12T01:29:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13919335621782796961', time=2024-09-12T03:12:34.529062+0000, chain.objs.size()=1 2024-09-12T01:29:14.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.CnlLfRpSKlUMvHFUM4sbRHN0GQYsMHz_0 2024-09-12T01:29:14.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17047620674001445146', time=2024-09-12T03:14:16.088016+0000, chain.objs.size()=1 2024-09-12T01:29:14.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.497__shadow_.Us2NHrZ9jkEJ8ptx72veuiG6Eeo8XQR_0 2024-09-12T01:29:14.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.368800651013487496', time=2024-09-12T03:15:03.266479+0000, chain.objs.size()=3 2024-09-12T01:29:14.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.713+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.520__shadow:.6ROIgAeqaiXNvE4eKuBqrT5Mzy40sc_.K60sM_PNiAAFCh_Tc-rhprmd2qRMjl1_0 2024-09-12T01:29:14.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.716+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.520__shadow:.6ROIgAeqaiXNvE4eKuBqrT5Mzy40sc_.K60sM_PNiAAFCh_Tc-rhprmd2qRMjl1_1 2024-09-12T01:29:14.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.717+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.520__shadow:.6ROIgAeqaiXNvE4eKuBqrT5Mzy40sc_.K60sM_PNiAAFCh_Tc-rhprmd2qRMjl1_2 2024-09-12T01:29:14.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.717+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3993649456291658812', time=2024-09-12T03:17:15.241670+0000, chain.objs.size()=1 2024-09-12T01:29:14.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.717+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.552__shadow_.Rs4jnPXINGmgmT5Af9SnC-skvwl5ovZ_0 2024-09-12T01:29:14.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.717+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13861396486909884236', time=2024-09-12T03:17:43.429815+0000, chain.objs.size()=1 2024-09-12T01:29:14.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.717+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.566__shadow_.di9yjBEOK59J4HuxNw9LgJNehf4srpa_0 2024-09-12T01:29:14.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.717+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16725051674738053936', time=2024-09-12T03:17:52.555926+0000, chain.objs.size()=1 2024-09-12T01:29:14.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.717+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:7hoM9SeJ-CMBBkEG8Koozh1gNfGu86q_.TLOLjzHo-LakXoCYvVTJ6GCJuftkdth_0 2024-09-12T01:29:14.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.717+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13496535887190274724', time=2024-09-12T03:18:22.296045+0000, chain.objs.size()=1 2024-09-12T01:29:14.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.717+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:tQk4rhqhOa0a-3nOW2ePa6MaGFzbNML_.zfje_pr-ZsM61oU2WX0p1Mz4W30QzQh_0 2024-09-12T01:29:14.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.717+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13146058163165504813', time=2024-09-12T03:22:55.439643+0000, chain.objs.size()=1 2024-09-12T01:29:14.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.717+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.626__shadow_.Xy-jQZwSEa4Jq2s47gJZaZXltZKaHnM_0 2024-09-12T01:29:14.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.717+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1447384136589076808', time=2024-09-12T03:23:15.382689+0000, chain.objs.size()=1 2024-09-12T01:29:14.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.717+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.648__shadow_.aOh72dGWllsUHUa4bGLQKMBzb0ivWGJ_0 2024-09-12T01:29:14.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.718+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11077735349508299860', time=2024-09-12T03:23:40.947899+0000, chain.objs.size()=1 2024-09-12T01:29:14.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.718+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.663__shadow_.sXtirEP3w8J8ZRyYwyWc5vt0INhmIpW_0 2024-09-12T01:29:14.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.718+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8723850565781292606', time=2024-09-12T03:24:32.735120+0000, chain.objs.size()=1 2024-09-12T01:29:14.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.718+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.718__shadow_.wzTQV5EMCUZXqYNz2YbW0rEtHn4FD6e_0 2024-09-12T01:29:14.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.718+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3678539159897081870', time=2024-09-12T03:24:41.252006+0000, chain.objs.size()=1 2024-09-12T01:29:14.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.718+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.734__shadow_.JyCUMX_5og4mKeI8P_qOlmcoqRe_HC-_0 2024-09-12T01:29:14.723 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.723+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:14.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.725+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:29:14.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.727+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:14.727 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.727+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:14.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47509' 2024-09-12T01:29:14.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8180594440519487475', time=2024-09-12T03:06:38.197163+0000, chain.objs.size()=2 2024-09-12T01:29:14.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.158__shadow_.n1vmwl_9xH2LHQIJJl9OuiRgzAGZRta_0 2024-09-12T01:29:14.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.158__shadow_.n1vmwl_9xH2LHQIJJl9OuiRgzAGZRta_1 2024-09-12T01:29:14.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_iJVyMWEzN-DmCkQ5S3Vw1iGDKppJjGi', time=2024-09-12T03:06:46.906009+0000, chain.objs.size()=2 2024-09-12T01:29:14.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.160__shadow_.cLlsNpOfE0-uVuWoYcS6-7BH1XFrb1Y_0 2024-09-12T01:29:14.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.160__shadow_.cLlsNpOfE0-uVuWoYcS6-7BH1XFrb1Y_1 2024-09-12T01:29:14.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10710715753765630992', time=2024-09-12T03:06:48.642257+0000, chain.objs.size()=3 2024-09-12T01:29:14.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__multipart_foo-STANDARD.2~r5Xn6RS4BHdriweZSIOl5QJ141dS0W5.1 2024-09-12T01:29:14.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__multipart_foo-STANDARD.2~r5Xn6RS4BHdriweZSIOl5QJ141dS0W5.2 2024-09-12T01:29:14.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__multipart_foo-STANDARD.2~r5Xn6RS4BHdriweZSIOl5QJ141dS0W5.3 2024-09-12T01:29:14.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12507842750461912958', time=2024-09-12T03:08:56.205146+0000, chain.objs.size()=1 2024-09-12T01:29:14.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.233__shadow_.5fQAN0jZE6bLBVqhwPVyhBblKEVuABS_0 2024-09-12T01:29:14.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13765556803739800242', time=2024-09-12T03:09:00.455584+0000, chain.objs.size()=1 2024-09-12T01:29:14.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.239__shadow_.nq01P8Kn6SXdUekUrfjej72WSwPsBWK_0 2024-09-12T01:29:14.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10588379756882224040', time=2024-09-12T03:09:03.173667+0000, chain.objs.size()=1 2024-09-12T01:29:14.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.243__shadow_.gE86S-d101pBTzdIG-GldNeePalsAIN_0 2024-09-12T01:29:14.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8384852311871258212', time=2024-09-12T03:09:06.027983+0000, chain.objs.size()=1 2024-09-12T01:29:14.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.247__shadow_.buC99oG_8KhngmIBtYn_Oz7mSR07sRO_0 2024-09-12T01:29:14.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1466498617212317440', time=2024-09-12T03:09:54.224625+0000, chain.objs.size()=1 2024-09-12T01:29:14.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.cAlBK9dBeXSB8A7nfLYwJqCsICOsI8h_0 2024-09-12T01:29:14.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.732+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.89883195523235409', time=2024-09-12T03:09:54.234955+0000, chain.objs.size()=1 2024-09-12T01:29:14.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.732+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.oBBt9KEZhjnQuf7aM1bVL-q4Tr5e-1J_0 2024-09-12T01:29:14.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.732+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18422653304104064480', time=2024-09-12T03:09:54.532630+0000, chain.objs.size()=1 2024-09-12T01:29:14.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.732+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.2MkaDPj10kSwz_eJkXWsmNVFJzDTGhY_0 2024-09-12T01:29:14.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11248375726924114574', time=2024-09-12T03:09:55.001406+0000, chain.objs.size()=1 2024-09-12T01:29:14.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.OTEHwZjmnV6_4ntJegg_uLRHS0Fi2tx_0 2024-09-12T01:29:14.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6686240803237153570', time=2024-09-12T03:09:55.348314+0000, chain.objs.size()=1 2024-09-12T01:29:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.goEszMEhpzLDgkrERfP7y_UvrTzmx_G_0 2024-09-12T01:29:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6002311127477655325', time=2024-09-12T03:09:55.376318+0000, chain.objs.size()=1 2024-09-12T01:29:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.pbaRUCKzjhIvf5JvWQDgSox8EpDL3Aj_0 2024-09-12T01:29:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4796146622124422536', time=2024-09-12T03:09:55.418200+0000, chain.objs.size()=1 2024-09-12T01:29:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Z2Y9J2ZvcAUNUVhr9LOEFLKMxnATkYo_0 2024-09-12T01:29:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14536401593171286813', time=2024-09-12T03:09:57.276061+0000, chain.objs.size()=1 2024-09-12T01:29:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.VT7_bqFTzkbgT875IRZqlva5aqyJnTF_0 2024-09-12T01:29:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2554781097456945951', time=2024-09-12T03:09:57.932868+0000, chain.objs.size()=1 2024-09-12T01:29:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.t-qUbWQaF73WlgAjtm9PrOP-YNMAMkr_0 2024-09-12T01:29:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7630549583137744075', time=2024-09-12T03:09:58.111802+0000, chain.objs.size()=1 2024-09-12T01:29:14.734 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.4OfFo9EscJioMdFFswcrc6xlxyZ3z33_0 2024-09-12T01:29:14.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8518554324272934626', time=2024-09-12T03:09:58.112659+0000, chain.objs.size()=1 2024-09-12T01:29:14.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.S7tPRMP-qEF6Vu2ITfVXnwI0n18xm4x_0 2024-09-12T01:29:14.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14926464111443591768', time=2024-09-12T03:09:58.410070+0000, chain.objs.size()=1 2024-09-12T01:29:14.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.733+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.40WYAJeJiDXyxyx6MiaWf06xdsZAXix_0 2024-09-12T01:29:14.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.734+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1189947505356380025', time=2024-09-12T03:09:58.787033+0000, chain.objs.size()=1 2024-09-12T01:29:14.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.734+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RwQr0V8-WJE8cxpoPdzFOaCcw1aXuqi_0 2024-09-12T01:29:14.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.735+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17637065447316758432', time=2024-09-12T03:09:59.399370+0000, chain.objs.size()=1 2024-09-12T01:29:14.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.735+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.MRjMN48QEMtO6tNoGZvkIG7cIabHqZB_0 2024-09-12T01:29:14.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.736+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4013197543026382386', time=2024-09-12T03:09:59.668867+0000, chain.objs.size()=1 2024-09-12T01:29:14.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.736+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.JmYxe5DSjJCbF2o6SsZOYUvvZcXPuKl_0 2024-09-12T01:29:14.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.736+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5753736515497376485', time=2024-09-12T03:09:59.862126+0000, chain.objs.size()=1 2024-09-12T01:29:14.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.736+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.jdF7G5F_MvFgw1Nkou7ShshsiLdm0WB_0 2024-09-12T01:29:14.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.736+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7877052110585796921', time=2024-09-12T03:10:00.514665+0000, chain.objs.size()=1 2024-09-12T01:29:14.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.736+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.maQ5nBoNsdmNtuto1v00T3M5Ym28e4z_0 2024-09-12T01:29:14.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.738+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.716644822217543239', time=2024-09-12T03:10:00.631198+0000, chain.objs.size()=1 2024-09-12T01:29:14.738 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.738+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Xe88_i9fE_Ll7jH1zgQtEBWgutJeiAg_0 2024-09-12T01:29:14.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.738+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14420186174444342175', time=2024-09-12T03:10:01.209990+0000, chain.objs.size()=1 2024-09-12T01:29:14.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.738+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.d6jsf5fF-9yrGNIiFm_eLlEgle5m0T2_0 2024-09-12T01:29:14.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.738+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17668229787060054099', time=2024-09-12T03:10:01.734766+0000, chain.objs.size()=1 2024-09-12T01:29:14.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.738+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.wsiYoPR4oRntuAywUUQ4aT9Aa9KvANs_0 2024-09-12T01:29:14.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.738+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8858214601032668466', time=2024-09-12T03:10:01.775823+0000, chain.objs.size()=1 2024-09-12T01:29:14.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.738+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.YEptbM9kyjdFzoQCs2mElTTSyAP_FKx_0 2024-09-12T01:29:14.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.738+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8579817572949730464', time=2024-09-12T03:10:01.826169+0000, chain.objs.size()=1 2024-09-12T01:29:14.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.738+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ghyaxTFPFO3FRDC3W-vcfUIUGDh85B6_0 2024-09-12T01:29:14.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.738+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7408590350885921132', time=2024-09-12T03:10:02.102651+0000, chain.objs.size()=1 2024-09-12T01:29:14.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.739+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.yKGL5ch6RfK2OAD8_92AlVP4t-gILR4_0 2024-09-12T01:29:14.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.740+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8089209255261833947', time=2024-09-12T03:10:02.232371+0000, chain.objs.size()=1 2024-09-12T01:29:14.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.740+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.22gEwHc2dW_og7hCScjlf5hsoqW48wY_0 2024-09-12T01:29:14.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.740+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4667118839881527547', time=2024-09-12T03:10:02.638694+0000, chain.objs.size()=1 2024-09-12T01:29:14.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.740+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lhH2jMZfgN31UL4oukEjjwsawRgLEjL_0 2024-09-12T01:29:14.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.740+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12930165385616244031', time=2024-09-12T03:10:03.040009+0000, chain.objs.size()=1 2024-09-12T01:29:14.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.740+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ODqu7Scm8jgeDEA22k5WzneQT2WYrbQ_0 2024-09-12T01:29:14.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.740+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15810499271006191937', time=2024-09-12T03:10:03.154797+0000, chain.objs.size()=1 2024-09-12T01:29:14.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.740+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.MrUPNHUta4tFb3ykRWepvnrE1CtQW7j_0 2024-09-12T01:29:14.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.740+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10242435182973975719', time=2024-09-12T03:10:03.314898+0000, chain.objs.size()=1 2024-09-12T01:29:14.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.740+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.kj3qwLqa-HglcUgHGIKjbwK20dKPxw5_0 2024-09-12T01:29:14.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.742+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.288371370965059955', time=2024-09-12T03:10:03.508503+0000, chain.objs.size()=1 2024-09-12T01:29:14.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.742+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RR4C894HQjAOVvMXnNH3iUhXdqsaYhS_0 2024-09-12T01:29:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.742+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12690537103756167914', time=2024-09-12T03:10:04.253250+0000, chain.objs.size()=1 2024-09-12T01:29:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.742+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.UX2B2X41z2ulA7V20BjPgrlXhNG88iC_0 2024-09-12T01:29:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.742+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.736728746822831626', time=2024-09-12T03:10:04.682021+0000, chain.objs.size()=1 2024-09-12T01:29:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.742+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1yR4RXOCCdTt6tbwGIKfNc01bwx26ty_0 2024-09-12T01:29:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.742+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1223453565493796266', time=2024-09-12T03:10:05.726253+0000, chain.objs.size()=1 2024-09-12T01:29:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.742+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.odmoznLEq0-pxDrNbogtEbFzE7UP5am_0 2024-09-12T01:29:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.742+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15621344351578723001', time=2024-09-12T03:10:05.915169+0000, chain.objs.size()=1 2024-09-12T01:29:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.742+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1tSK51ip73ZdcCn5yYk4BCMqj9YNGxm_0 2024-09-12T01:29:14.743 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.743+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10194765723835533737', time=2024-09-12T03:10:06.384791+0000, chain.objs.size()=1 2024-09-12T01:29:14.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.743+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Kwk1t2IWUWLES8SgBMxaouitZ1i7B27_0 2024-09-12T01:29:14.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.743+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12273868345517335030', time=2024-09-12T03:10:06.460470+0000, chain.objs.size()=1 2024-09-12T01:29:14.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.743+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.jvj3cO3i2x6rytmN6E1oMwaLURyRM-4_0 2024-09-12T01:29:14.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.744+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1893618620201421764', time=2024-09-12T03:10:06.496923+0000, chain.objs.size()=1 2024-09-12T01:29:14.744 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.744+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.kt4js5rbERDWpxKpdhui2hyyO03rRiq_0 2024-09-12T01:29:14.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.745+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16484809547053457781', time=2024-09-12T03:10:07.308327+0000, chain.objs.size()=1 2024-09-12T01:29:14.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.745+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.263__shadow_.TIC2ZqSzKAwjA2M1o1SC1SeZ7STqWWn_0 2024-09-12T01:29:14.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.745+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2589918886421164659', time=2024-09-12T03:10:08.525560+0000, chain.objs.size()=1 2024-09-12T01:29:14.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.745+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.265__shadow_.KZ76bp8lvTlrSgiMhQr8Wqv2l0OCLpV_0 2024-09-12T01:29:14.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.745+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11531860797765658448', time=2024-09-12T03:10:15.814695+0000, chain.objs.size()=1 2024-09-12T01:29:14.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.745+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.277__shadow_.Qa6E46vJk5-EifChxt1ti0Zh7HVvJS-_0 2024-09-12T01:29:14.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.745+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17679476371488130419', time=2024-09-12T03:10:18.485931+0000, chain.objs.size()=1 2024-09-12T01:29:14.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.745+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.281__shadow_.PSNf6NIOZxoDMerLfaBCKd44DGY7yWn_0 2024-09-12T01:29:14.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.746+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15140335161198782565', time=2024-09-12T03:10:29.158996+0000, chain.objs.size()=1 2024-09-12T01:29:14.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.746+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.a1SUGjULddMZ-x1G9fPEPjbBPnb0SZ6_0 2024-09-12T01:29:14.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.747+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4061609212681455640', time=2024-09-12T03:10:34.509884+0000, chain.objs.size()=1 2024-09-12T01:29:14.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.747+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.301__shadow_.86eO8nJWH32VHp92f_hAnV0PTS16mdB_0 2024-09-12T01:29:14.748 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.748+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15655637479222199166', time=2024-09-12T03:10:47.052887+0000, chain.objs.size()=1 2024-09-12T01:29:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.748+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.319__shadow:CQiDpA0w68oZalhUR3g-NUCaTm1Ns56_.dbel6tKv_xq1MMKGbKuGIm1CN6dlvd__0 2024-09-12T01:29:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.748+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14346389301367894027', time=2024-09-12T03:10:48.159160+0000, chain.objs.size()=1 2024-09-12T01:29:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.748+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.321__shadow_.aqP56eNHNdSd3wro_kuJtYPBjPDhpi0_0 2024-09-12T01:29:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.748+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11900652287542196640', time=2024-09-12T03:11:29.639744+0000, chain.objs.size()=1 2024-09-12T01:29:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.748+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MIK1wjd1C5Hm9t1MLlB0SPlfKvEB6Q0_0 2024-09-12T01:29:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.748+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12129177347809437811', time=2024-09-12T03:11:29.744212+0000, chain.objs.size()=1 2024-09-12T01:29:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.748+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.wVblE0c3GWvXOVW40HJSKb8cjFrzRAd_0 2024-09-12T01:29:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.748+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17463176500867962627', time=2024-09-12T03:11:29.821838+0000, chain.objs.size()=1 2024-09-12T01:29:14.749 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.748+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.K_ZDkG31IFrBefNMckrlA2Vxr-S8bVz_0 2024-09-12T01:29:14.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.749+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12606760033711362935', time=2024-09-12T03:11:29.837762+0000, chain.objs.size()=1 2024-09-12T01:29:14.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.749+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.F722Gx2Ca6r27IANRw1WRE_325FSpZd_0 2024-09-12T01:29:14.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.749+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7254020760898583065', time=2024-09-12T03:11:31.294980+0000, chain.objs.size()=1 2024-09-12T01:29:14.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.749+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.CCZ61Qmr4IeGGWdo2bQMLe3inKGCQOH_0 2024-09-12T01:29:14.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.749+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5274722469003415153', time=2024-09-12T03:11:31.295771+0000, chain.objs.size()=1 2024-09-12T01:29:14.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.749+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ghTr8f7tuLdnd2qy2gbSIyh7YCcxRJ7_0 2024-09-12T01:29:14.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.750+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.421926990408355812', time=2024-09-12T03:11:31.296893+0000, chain.objs.size()=1 2024-09-12T01:29:14.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.750+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mv8vySn5GQSAH92cOpeKJ8-TXSN3bsw_0 2024-09-12T01:29:14.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.750+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11819101707312171549', time=2024-09-12T03:11:32.999720+0000, chain.objs.size()=1 2024-09-12T01:29:14.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.750+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Lgfi5SRaOUEEbUB0vmk7FbBwH7CCQcQ_0 2024-09-12T01:29:14.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.750+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11891245232674756879', time=2024-09-12T03:11:33.077825+0000, chain.objs.size()=1 2024-09-12T01:29:14.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.750+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.553ayDnqr_m4zl6nOg6Y_6_Es7aDTRF_0 2024-09-12T01:29:14.751 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.751+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15347763052459414594', time=2024-09-12T03:11:33.181411+0000, chain.objs.size()=1 2024-09-12T01:29:14.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.751+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.FbcPFBBxpObUAAG0_nCLWBnIio3O4ec_0 2024-09-12T01:29:14.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.752+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.142764140041339415', time=2024-09-12T03:11:33.727000+0000, chain.objs.size()=1 2024-09-12T01:29:14.752 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.752+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.jhXLdG1ZGyam5rphfpZjfG4wJ4nFFbW_0 2024-09-12T01:29:14.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.753+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.419766718770027373', time=2024-09-12T03:11:33.996630+0000, chain.objs.size()=1 2024-09-12T01:29:14.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.753+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.oOcYxvymPRc-CpRaEDXoVwNcSPFPcI__0 2024-09-12T01:29:14.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.753+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13511569049644838125', time=2024-09-12T03:11:34.515154+0000, chain.objs.size()=1 2024-09-12T01:29:14.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.753+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.YZOIIz2H9vi8GVXSXdtgHveA0j5O2_p_0 2024-09-12T01:29:14.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.753+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1581088925708855757', time=2024-09-12T03:11:34.516376+0000, chain.objs.size()=1 2024-09-12T01:29:14.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.753+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xJiYy2BQOqm1QIbUitcp5apeAziusa4_0 2024-09-12T01:29:14.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.755+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2675054201110082555', time=2024-09-12T03:11:35.023221+0000, chain.objs.size()=1 2024-09-12T01:29:14.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.755+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.oSC055rAKDpJKPy_uUKT3xbd39qM7yy_0 2024-09-12T01:29:14.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.755+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13767795708254715729', time=2024-09-12T03:11:35.069159+0000, chain.objs.size()=1 2024-09-12T01:29:14.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.755+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fS6cbKSIDEmOux69YW41arEjqFPEmml_0 2024-09-12T01:29:14.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.755+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9619810870522657095', time=2024-09-12T03:11:35.169328+0000, chain.objs.size()=1 2024-09-12T01:29:14.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.755+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xDfki0X7XjUpZCPOg25yKGFbWYsQz73_0 2024-09-12T01:29:14.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.755+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1820250959450529720', time=2024-09-12T03:11:35.371306+0000, chain.objs.size()=1 2024-09-12T01:29:14.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.755+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-ChIKRzj_BNwhKIr5y6vgT0N8wVV8-N_0 2024-09-12T01:29:14.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.755+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2894093567190795558', time=2024-09-12T03:11:35.630065+0000, chain.objs.size()=1 2024-09-12T01:29:14.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.755+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.KU5b71YXUS8ktUlKqKokLM7AwTD8Lbr_0 2024-09-12T01:29:14.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.755+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5581065173887993015', time=2024-09-12T03:11:35.660972+0000, chain.objs.size()=1 2024-09-12T01:29:14.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.755+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.8DuBZc57AGsyZwKxIyHlwt4rpAanGQc_0 2024-09-12T01:29:14.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.755+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12529924518361249870', time=2024-09-12T03:11:36.244144+0000, chain.objs.size()=1 2024-09-12T01:29:14.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.755+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.6u1oYXr_1-qmgLpGfeps-krPzqOX11y_0 2024-09-12T01:29:14.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.756+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3777222850932240419', time=2024-09-12T03:11:36.456001+0000, chain.objs.size()=1 2024-09-12T01:29:14.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.756+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.44Mzq11sDD2zuyNDzC08GOWpck-B53-_0 2024-09-12T01:29:14.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.757+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13054889128123463447', time=2024-09-12T03:11:37.031914+0000, chain.objs.size()=1 2024-09-12T01:29:14.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.757+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.e0I73cp780PcoEHHfCv1lC2G0bWogJ-_0 2024-09-12T01:29:14.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.757+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9931619256120534491', time=2024-09-12T03:11:37.673198+0000, chain.objs.size()=1 2024-09-12T01:29:14.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.757+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Q6wJyYLiqW7kN3pkjUAxJxPyVY0P35L_0 2024-09-12T01:29:14.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.757+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9516557543338280486', time=2024-09-12T03:11:37.880250+0000, chain.objs.size()=1 2024-09-12T01:29:14.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.757+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7X9YnLH8LjSzrckKFmLZ9n5RoaZ7vc1_0 2024-09-12T01:29:14.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.759+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1713949839493057961', time=2024-09-12T03:11:38.053236+0000, chain.objs.size()=1 2024-09-12T01:29:14.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.759+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.HyG_U8SMMWtJYOp2VeZyvTguZ9uyv2V_0 2024-09-12T01:29:14.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.759+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9356638390134670660', time=2024-09-12T03:11:38.148295+0000, chain.objs.size()=1 2024-09-12T01:29:14.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.759+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.gr75SNGIbCrYFHfG1KinkoMZg_U8At0_0 2024-09-12T01:29:14.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.759+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15705046037915126321', time=2024-09-12T03:11:38.176255+0000, chain.objs.size()=1 2024-09-12T01:29:14.760 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.759+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.c0INsLooeP29YfnX9cYL95Y1ZVxo7qD_0 2024-09-12T01:29:14.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.760+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13951995747131718836', time=2024-09-12T03:11:38.398569+0000, chain.objs.size()=1 2024-09-12T01:29:14.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.760+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Np7tpuaQOxogYTj1_-mHPJ9_oAaqqwe_0 2024-09-12T01:29:14.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.760+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16084529717697761647', time=2024-09-12T03:11:38.510195+0000, chain.objs.size()=1 2024-09-12T01:29:14.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.760+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.P7J3QSuh-G3vMKIS6B0ElGROiiPCBsy_0 2024-09-12T01:29:14.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.760+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.926339151096415474', time=2024-09-12T03:11:38.566799+0000, chain.objs.size()=1 2024-09-12T01:29:14.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.760+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.GdwL2QIcePVfH1woniuYPNdtt0IXYur_0 2024-09-12T01:29:14.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.760+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8248975835000742676', time=2024-09-12T03:11:39.231011+0000, chain.objs.size()=1 2024-09-12T01:29:14.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.760+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.j3WnRYaEFKw_GABPXrnux45R5QEZycS_0 2024-09-12T01:29:14.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.760+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10647577589015717255', time=2024-09-12T03:11:40.334138+0000, chain.objs.size()=1 2024-09-12T01:29:14.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.760+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.X_S7aFjA1W_AL3sjaQm3Ou3W1n-pYR4_0 2024-09-12T01:29:14.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.760+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13018676858782523495', time=2024-09-12T03:11:40.357474+0000, chain.objs.size()=1 2024-09-12T01:29:14.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.760+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.HQxSfx8kBFM4fXAiHXTiPdI9W4hjbWs_0 2024-09-12T01:29:14.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.761+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14256975641786237509', time=2024-09-12T03:11:40.652207+0000, chain.objs.size()=1 2024-09-12T01:29:14.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.761+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tky-CfWNSIKbxbyWwGgIGROanCwwW0Y_0 2024-09-12T01:29:14.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.761+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3282557423848290146', time=2024-09-12T03:11:40.970196+0000, chain.objs.size()=1 2024-09-12T01:29:14.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.761+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.F7JbTmIsV88-_8zOrI0HOSf9m821Iua_0 2024-09-12T01:29:14.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.763+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6179423588071613458', time=2024-09-12T03:11:41.176161+0000, chain.objs.size()=1 2024-09-12T01:29:14.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.763+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5dju4jvsFsq7I4CetU8ZEVhJkM-FmSc_0 2024-09-12T01:29:14.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.764+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4910036233435603330', time=2024-09-12T03:11:41.190263+0000, chain.objs.size()=1 2024-09-12T01:29:14.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.764+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.iS2cGByLAbyTEA-o29eh7klQ4kAq8L0_0 2024-09-12T01:29:14.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.764+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16302896544619056863', time=2024-09-12T03:12:22.000275+0000, chain.objs.size()=1 2024-09-12T01:29:14.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.764+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.yeePteqzykv2cvrzkhOURGloDGRUPib_0 2024-09-12T01:29:14.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16062168360271913694', time=2024-09-12T03:12:22.190333+0000, chain.objs.size()=1 2024-09-12T01:29:14.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.B44NEizrLA9Basy0bLMG4O5i9dwHyzA_0 2024-09-12T01:29:14.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12638578343177659298', time=2024-09-12T03:12:22.368047+0000, chain.objs.size()=1 2024-09-12T01:29:14.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.x0nD_hcjl64lvHwz3lk9ITJm7oTsZx9_0 2024-09-12T01:29:14.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11418251493246123191', time=2024-09-12T03:12:22.444730+0000, chain.objs.size()=1 2024-09-12T01:29:14.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mYzNqws2NgaiWyuH6pw9586jL28iXS2_0 2024-09-12T01:29:14.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9229763812106113287', time=2024-09-12T03:12:22.929198+0000, chain.objs.size()=1 2024-09-12T01:29:14.765 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ho5FpsOiHs6bA_kd57A-5t2j6RLFANl_0 2024-09-12T01:29:14.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6712495497379508593', time=2024-09-12T03:12:22.932653+0000, chain.objs.size()=1 2024-09-12T01:29:14.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.jqRAlt39mSlSYChb_3tT6qyAjG-Wbtm_0 2024-09-12T01:29:14.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17075813150145179190', time=2024-09-12T03:12:23.936628+0000, chain.objs.size()=1 2024-09-12T01:29:14.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.lWPuoitIf0g2td2Rb49Suky2UTEtnnD_0 2024-09-12T01:29:14.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9627995641147180628', time=2024-09-12T03:12:23.949291+0000, chain.objs.size()=1 2024-09-12T01:29:14.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.VE4GGSGjP_OOi4Id8sJpETpd038Lh2R_0 2024-09-12T01:29:14.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17399462840356618526', time=2024-09-12T03:12:23.949813+0000, chain.objs.size()=1 2024-09-12T01:29:14.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.765+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ihPEmEOChVZFUONe983lenWfctWkDs6_0 2024-09-12T01:29:14.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.766+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3411459530069657863', time=2024-09-12T03:12:24.355270+0000, chain.objs.size()=1 2024-09-12T01:29:14.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.766+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.fZ-v2PyTI-RBUWDpuIuWGLL6tqnn0B2_0 2024-09-12T01:29:14.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.769+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9370367027668969745', time=2024-09-12T03:12:24.618674+0000, chain.objs.size()=1 2024-09-12T01:29:14.769 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.769+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.FX0KnMTL4yvNodIBGDM5-A-sW5IxvQt_0 2024-09-12T01:29:14.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.771+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/47509 2024-09-12T01:29:14.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T01:29:14.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1747946006478892380', time=2024-09-12T03:12:25.692199+0000, chain.objs.size()=1 2024-09-12T01:29:14.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3E9K5GIJkTrj9sKCrHjc-DzkfsTiXTM_0 2024-09-12T01:29:14.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9139092301379021148', time=2024-09-12T03:12:26.428251+0000, chain.objs.size()=1 2024-09-12T01:29:14.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.sVEIEptFbeRgM91Po-vM7Sm4KDchH6f_0 2024-09-12T01:29:14.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12573553094617060964', time=2024-09-12T03:12:27.458548+0000, chain.objs.size()=1 2024-09-12T01:29:14.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.AND2iXn8XaXYeEtMTJkt3z5K6J_hntX_0 2024-09-12T01:29:14.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8790047576489133084', time=2024-09-12T03:12:28.005675+0000, chain.objs.size()=1 2024-09-12T01:29:14.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.T3XrZ6X008-Qqqvtf7sWcIkRSLAryyC_0 2024-09-12T01:29:14.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.594443714132606929', time=2024-09-12T03:12:28.283089+0000, chain.objs.size()=1 2024-09-12T01:29:14.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._BF2wa2_FtCEkimJdPeZonJtJVzd_oB_0 2024-09-12T01:29:14.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12750163665027632114', time=2024-09-12T03:12:28.751513+0000, chain.objs.size()=1 2024-09-12T01:29:14.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.SKDUB6-_mo7_wb3NtHxoHcJ5x3UcRDU_0 2024-09-12T01:29:14.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16492634106689480553', time=2024-09-12T03:12:29.441174+0000, chain.objs.size()=1 2024-09-12T01:29:14.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Q5w1-XE4JimXtZ89ada9PLtK30b3cEp_0 2024-09-12T01:29:14.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8499145541597596256', time=2024-09-12T03:12:29.908181+0000, chain.objs.size()=1 2024-09-12T01:29:14.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ySuAnxGcyMyFP6Q-xn1L1IcTfDmsCfK_0 2024-09-12T01:29:14.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6646494585675533810', time=2024-09-12T03:12:30.334643+0000, chain.objs.size()=1 2024-09-12T01:29:14.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.yoGULojOlbhQ0EMFlFUEOyR97GrBu3q_0 2024-09-12T01:29:14.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6294827861517402330', time=2024-09-12T03:12:30.393517+0000, chain.objs.size()=1 2024-09-12T01:29:14.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.qFbN3A01L3eg8pQGlqcVrfc_1m24vye_0 2024-09-12T01:29:14.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9018925728780873321', time=2024-09-12T03:12:30.574375+0000, chain.objs.size()=1 2024-09-12T01:29:14.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1d3ixWTAUYoDcYse3iAu3XgbjjUKPkd_0 2024-09-12T01:29:14.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10739444664785055783', time=2024-09-12T03:12:31.304147+0000, chain.objs.size()=1 2024-09-12T01:29:14.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.773+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.2dU-_uLe-gQ3Tz5J4RR5hDcSJx3tT2Z_0 2024-09-12T01:29:14.777 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.776+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17968413881555147017', time=2024-09-12T03:12:31.955393+0000, chain.objs.size()=1 2024-09-12T01:29:14.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.776+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.iiExQmaagz8LDz-fdkiJiHRbX28Qges_0 2024-09-12T01:29:14.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.776+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1745621513344128', time=2024-09-12T03:12:32.565667+0000, chain.objs.size()=1 2024-09-12T01:29:14.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.776+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-LkeeOqzg2PyDnQ8m31OYAsYxZVMj9u_0 2024-09-12T01:29:14.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.776+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3552368547549554680', time=2024-09-12T03:12:33.859677+0000, chain.objs.size()=1 2024-09-12T01:29:14.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.776+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.D1TlDSVsITp1iEf5UGwYpVeYGwvW593_0 2024-09-12T01:29:14.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.778+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2229869280426702684', time=2024-09-12T03:12:33.959620+0000, chain.objs.size()=1 2024-09-12T01:29:14.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.778+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Wsbvr7IUSkaLlUHHgS-09D4fwDsEkR4_0 2024-09-12T01:29:14.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.778+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3339752097624096855', time=2024-09-12T03:12:34.222712+0000, chain.objs.size()=1 2024-09-12T01:29:14.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.778+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ErVLYtrdjdtgYAX_s1KPVALEJqBgrns_0 2024-09-12T01:29:14.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.778+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1938238508436393512', time=2024-09-12T03:13:48.096650+0000, chain.objs.size()=1 2024-09-12T01:29:14.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.778+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.455__shadow_.dCZsUlwrriCGx8TKBUUdg-F9JxJuai-_0 2024-09-12T01:29:14.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.778+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15679430884440211481', time=2024-09-12T03:14:16.087334+0000, chain.objs.size()=1 2024-09-12T01:29:14.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.778+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.497__shadow_.Us2NHrZ9jkEJ8ptx72veuiG6Eeo8XQR_0 2024-09-12T01:29:14.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.778+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14087418530171480456', time=2024-09-12T03:15:38.194094+0000, chain.objs.size()=6 2024-09-12T01:29:14.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.778+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~QSBOaDXQK47WH7vaLIB9d6AmdudYiT6.1 2024-09-12T01:29:14.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.778+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~QSBOaDXQK47WH7vaLIB9d6AmdudYiT6.2 2024-09-12T01:29:14.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.778+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.kBvNCmkRqVvG3Qd8EMqQq6-EzhLNkbK4.3 2024-09-12T01:29:14.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.778+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~QSBOaDXQK47WH7vaLIB9d6AmdudYiT6.4 2024-09-12T01:29:14.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.778+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~QSBOaDXQK47WH7vaLIB9d6AmdudYiT6.5 2024-09-12T01:29:14.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.779+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~QSBOaDXQK47WH7vaLIB9d6AmdudYiT6.6 2024-09-12T01:29:14.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.779+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12857318581772756672', time=2024-09-12T03:17:34.318255+0000, chain.objs.size()=1 2024-09-12T01:29:14.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.779+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.560__shadow_.NYDaR3gWa4uEmISEqfIDyk5QK8Wdmmz_0 2024-09-12T01:29:14.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.781+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4280876361987734706', time=2024-09-12T03:17:48.219671+0000, chain.objs.size()=1 2024-09-12T01:29:14.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.781+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:HPHTUce4YiIaF-DfOgyCaxR.NM.8E73_.Z0HWxOMago19Cdwdr-vC1VPUb11mNaa_0 2024-09-12T01:29:14.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.781+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6323441795362556695', time=2024-09-12T03:17:53.854178+0000, chain.objs.size()=1 2024-09-12T01:29:14.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.781+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:Vj7lv6XzdAzNCBQQLvHC6uZnpzX-5X-_.UigYx5itx6uuGAw1q_hDzdOspDQ16wU_0 2024-09-12T01:29:14.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.781+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5056586899963402148', time=2024-09-12T03:17:57.137143+0000, chain.objs.size()=1 2024-09-12T01:29:14.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.781+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.570__shadow:3ks1Lmys4z9jXRRIFkg5jtDLNABTvuC_.gUGRqAueCKljn8W3qqbq_pgzMJdEXc__0 2024-09-12T01:29:14.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.782+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13195063019690740245', time=2024-09-12T03:18:16.412651+0000, chain.objs.size()=1 2024-09-12T01:29:14.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.782+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:Ze5aW79tjSwVIx-n5HsjybZWcbrLWhk_.Kx7A_jTPik_2chnHXe9KMMzIUeHo6jT_0 2024-09-12T01:29:14.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.782+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8162692281884561604', time=2024-09-12T03:18:48.383349+0000, chain.objs.size()=1 2024-09-12T01:29:14.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.782+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.579__shadow:3mvHoltDuoy1fU57PTdwJUsRWaYtZLH_.QIRhCs5bFCivW1VUiazVXxRdgU_zf7t_0 2024-09-12T01:29:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.783+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10444444780266354530', time=2024-09-12T03:18:56.911908+0000, chain.objs.size()=1 2024-09-12T01:29:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.783+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.587__shadow:1QVNlOQHEg0siaqbNw8pWl2TYWsGaNV_.c7Qa8qk6Fr7NVTwAl1thCm9V7_Q1diK_0 2024-09-12T01:29:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.783+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13404846680293473180', time=2024-09-12T03:18:56.935951+0000, chain.objs.size()=1 2024-09-12T01:29:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.783+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.587__shadow:011K9gNcMYJAIJKL-.pBqlwg3TjuqMP_.Y0QRBiNd3jqSE1a-NfEl9zbgmT5rKIg_0 2024-09-12T01:29:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.783+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3662493530436378506', time=2024-09-12T03:21:17.069644+0000, chain.objs.size()=1 2024-09-12T01:29:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.783+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.617__shadow_.nxK9Nf6ywukf2TVySCbCvaXlTG_E7xn_0 2024-09-12T01:29:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.783+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9051311055676811604', time=2024-09-12T03:22:56.037028+0000, chain.objs.size()=1 2024-09-12T01:29:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.783+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.627__shadow_.zm_5yhJwlOnH7IL8CQMRh75ZWdSzJiq_0 2024-09-12T01:29:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.783+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12069704880432995432', time=2024-09-12T03:24:08.537704+0000, chain.objs.size()=1 2024-09-12T01:29:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.783+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.710__shadow:mvy6J9sK8HUnTCdfiKz9Ix9yOTfyEgk_.jSko0jr2RHliQ7z-4MNRg-eUqDr7MW0_0 2024-09-12T01:29:14.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.783+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~EDTxRniJGaabGhkHUXcFG8n5uhwJc73', time=2024-09-12T03:24:53.700004+0000, chain.objs.size()=1 2024-09-12T01:29:14.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.783+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.742__multipart_mymultipart2.2~EDTxRniJGaabGhkHUXcFG8n5uhwJc73.1 2024-09-12T01:29:14.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.787+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:14.790 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.790+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:29:14.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.791+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:14.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.792+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.792+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/57470' 2024-09-12T01:29:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.792+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_pSMjYdzH15M2Am2nGufRkt-5PAr5Hvs', time=2024-09-12T03:06:46.934939+0000, chain.objs.size()=2 2024-09-12T01:29:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.792+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.160__shadow_.GllUFsNYGgJ4BPkwA8q8k8XvTqCLAL4_0 2024-09-12T01:29:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.792+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.160__shadow_.GllUFsNYGgJ4BPkwA8q8k8XvTqCLAL4_1 2024-09-12T01:29:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.792+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16254721115046350392', time=2024-09-12T03:06:59.261103+0000, chain.objs.size()=2 2024-09-12T01:29:14.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.792+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.164__multipart_foo.2~_IE7i42lJB99_HLNbPRD3bJ5CGb8leK.1 2024-09-12T01:29:14.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.792+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.164__multipart_foo.2~_IE7i42lJB99_HLNbPRD3bJ5CGb8leK.2 2024-09-12T01:29:14.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.792+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1440405204649000429', time=2024-09-12T03:07:23.319866+0000, chain.objs.size()=1 2024-09-12T01:29:14.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.792+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.199__shadow_.61MASl2JCJH1Y9RvzqV_c8uzDnvMoGb_0 2024-09-12T01:29:14.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.792+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2292530577668490988', time=2024-09-12T03:09:02.278959+0000, chain.objs.size()=1 2024-09-12T01:29:14.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.792+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.242__shadow_.Sb_IVFmJXUEc7pHQWlAMQ0dJerHRdaX_0 2024-09-12T01:29:14.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.792+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17619005230500974502', time=2024-09-12T03:09:06.655658+0000, chain.objs.size()=1 2024-09-12T01:29:14.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.792+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.248__shadow_.iE7Y6SjinqB9fwzqX2ip2kJWUWCkJAP_0 2024-09-12T01:29:14.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.793+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12847201464470500661', time=2024-09-12T03:09:08.588865+0000, chain.objs.size()=1 2024-09-12T01:29:14.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.793+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.251__shadow_.CDKukb1_FoPoA9Y8GEAWBw86LT4t7on_0 2024-09-12T01:29:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.793+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13151525647779168061', time=2024-09-12T03:09:11.832953+0000, chain.objs.size()=1 2024-09-12T01:29:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.793+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.256__shadow_.RA2sjNMWDSV04Sp0ZJVUH95JTiwyz-H_0 2024-09-12T01:29:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.793+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15367699164608522991', time=2024-09-12T03:09:54.640963+0000, chain.objs.size()=1 2024-09-12T01:29:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.793+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.NzBdwsn59OULFxi1drceYLSHk302Bpy_0 2024-09-12T01:29:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.793+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.683190308533500357', time=2024-09-12T03:09:54.650565+0000, chain.objs.size()=1 2024-09-12T01:29:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.793+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.exPamnk6jMc_mcRJ3IWUeX5BgxybhIH_0 2024-09-12T01:29:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.793+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9472042244817871197', time=2024-09-12T03:09:54.932324+0000, chain.objs.size()=1 2024-09-12T01:29:14.795 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.793+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.CpLb7R-KQmq9Spk0Kb9FhUIIpPrptqF_0 2024-09-12T01:29:14.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.795+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17133816329924101734', time=2024-09-12T03:09:54.969958+0000, chain.objs.size()=1 2024-09-12T01:29:14.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.795+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.MSbBmV6nw8zll8u0clZElYmT4kSP9k1_0 2024-09-12T01:29:14.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.795+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14415334180640545963', time=2024-09-12T03:09:55.476134+0000, chain.objs.size()=1 2024-09-12T01:29:14.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.795+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.W4ZEV8HIOWc_Wv2jpTct4JOv7tDxAi7_0 2024-09-12T01:29:14.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.795+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.138062643069306249', time=2024-09-12T03:09:56.534807+0000, chain.objs.size()=1 2024-09-12T01:29:14.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.795+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.rg_RxVbiRC_FvYvFxBbbyXHGoqy16Kb_0 2024-09-12T01:29:14.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.796+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8924745616780981746', time=2024-09-12T03:09:56.764352+0000, chain.objs.size()=1 2024-09-12T01:29:14.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.796+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Pr31C8PZhrPc6N16nv6UdNJWHah-e6r_0 2024-09-12T01:29:14.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.796+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14605678512521497056', time=2024-09-12T03:09:56.858552+0000, chain.objs.size()=1 2024-09-12T01:29:14.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.796+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.harw6nOt400Mlz5PeC1E9lviqW-FqKu_0 2024-09-12T01:29:14.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.796+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10259382850672508074', time=2024-09-12T03:09:56.932366+0000, chain.objs.size()=1 2024-09-12T01:29:14.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.796+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Xk7qjNDvM02oDIrADSZgkxLd6fk8qzv_0 2024-09-12T01:29:14.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.796+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1806872931430222839', time=2024-09-12T03:09:57.272653+0000, chain.objs.size()=1 2024-09-12T01:29:14.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.796+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.6fLfFTg3iUvZHqetwUKTaXmog3Ces9N_0 2024-09-12T01:29:14.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.798+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14845915977982609748', time=2024-09-12T03:09:58.410045+0000, chain.objs.size()=1 2024-09-12T01:29:14.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.798+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8bK3zpSw5Z62Y1HSmFwzXBJ_CbilRdJ_0 2024-09-12T01:29:14.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.798+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4976842346139463169', time=2024-09-12T03:09:58.717222+0000, chain.objs.size()=1 2024-09-12T01:29:14.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.798+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.kZPf-n3pNzymxOxKWQUsrTyCBcL5rZx_0 2024-09-12T01:29:14.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.798+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13758483858524875623', time=2024-09-12T03:09:58.903222+0000, chain.objs.size()=1 2024-09-12T01:29:14.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.798+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.g0q4w8o3D0hIYadFAFiupprSdSke8PA_0 2024-09-12T01:29:14.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.798+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16261646754615185123', time=2024-09-12T03:09:59.408831+0000, chain.objs.size()=1 2024-09-12T01:29:14.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.798+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.kuVIWl8WguxbawZ_upWrFwPcAXQKX8J_0 2024-09-12T01:29:14.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.798+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3507239467629622137', time=2024-09-12T03:09:59.509436+0000, chain.objs.size()=1 2024-09-12T01:29:14.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.798+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.g_XqcNdNug-z5vYQNea0rxfC_QmJl3Q_0 2024-09-12T01:29:14.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.798+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7407018483634246040', time=2024-09-12T03:09:59.667978+0000, chain.objs.size()=1 2024-09-12T01:29:14.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.798+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0Zmc-EjK6Myz923_v3_brVMGvChk4G1_0 2024-09-12T01:29:14.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.799+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14438189677920662828', time=2024-09-12T03:09:59.968952+0000, chain.objs.size()=1 2024-09-12T01:29:14.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.800+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9Zn5fn18K4XTqqWJxsGQjoOCeRluHwH_0 2024-09-12T01:29:14.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.800+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16613722803097194280', time=2024-09-12T03:10:00.538219+0000, chain.objs.size()=1 2024-09-12T01:29:14.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.800+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.DN6Xle14E4g6Bk--j3uPoDU4lGCGZ0m_0 2024-09-12T01:29:14.800 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.800+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5220029815793043203', time=2024-09-12T03:10:00.622984+0000, chain.objs.size()=1 2024-09-12T01:29:14.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.800+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9VRRnf0Op8q6x85WzjnHKUEGyR4xlf__0 2024-09-12T01:29:14.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.800+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1773014833691013149', time=2024-09-12T03:10:01.646785+0000, chain.objs.size()=1 2024-09-12T01:29:14.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.800+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.3fUv2nC-438bup6gP06KUrfjVzvgxFB_0 2024-09-12T01:29:14.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.802+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14550840286697900789', time=2024-09-12T03:10:02.206592+0000, chain.objs.size()=1 2024-09-12T01:29:14.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.802+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.MR-XVYLfpEJUyotSwR1MdIikldLdY39_0 2024-09-12T01:29:14.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.802+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.996078485276719266', time=2024-09-12T03:10:02.765139+0000, chain.objs.size()=1 2024-09-12T01:29:14.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.802+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0sPlbIyrwSI65HX3FiYWnsHyxB-kHCN_0 2024-09-12T01:29:14.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.802+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16800596241665766551', time=2024-09-12T03:10:02.893759+0000, chain.objs.size()=1 2024-09-12T01:29:14.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.802+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.IqPbAD6bee1AU2gOPubb6veXDP8dzY6_0 2024-09-12T01:29:14.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.802+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.786543945464053402', time=2024-09-12T03:10:03.112593+0000, chain.objs.size()=1 2024-09-12T01:29:14.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.802+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.pO-_hLQNROjgJ56yQRpI5n8D2Lw-PgE_0 2024-09-12T01:29:14.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.802+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2520294920260230545', time=2024-09-12T03:10:03.240570+0000, chain.objs.size()=1 2024-09-12T01:29:14.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.802+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.UcniCA1vVTF0DhnajRLxUAAU9eEsjrA_0 2024-09-12T01:29:14.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.802+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8694872302041751820', time=2024-09-12T03:10:03.462719+0000, chain.objs.size()=1 2024-09-12T01:29:14.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.802+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.5wtCNaM2wccHToa7yfvso4E1SErnTGn_0 2024-09-12T01:29:14.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.802+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15341198725546829819', time=2024-09-12T03:10:03.620179+0000, chain.objs.size()=1 2024-09-12T01:29:14.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.802+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.L7mPj97-kT9wgHXyKswq6uqbbDXC4os_0 2024-09-12T01:29:14.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.804+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.46320053606227225', time=2024-09-12T03:10:04.678690+0000, chain.objs.size()=1 2024-09-12T01:29:14.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.804+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.gPuqs-A8xHaNMNk-fPqekPvAKQUxXdz_0 2024-09-12T01:29:14.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.804+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.90427286238041101', time=2024-09-12T03:10:05.220137+0000, chain.objs.size()=1 2024-09-12T01:29:14.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.804+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.eUPJsjuzhC8p4rHtrWhjiG4k2E6BINK_0 2024-09-12T01:29:14.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.804+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3622842636124883316', time=2024-09-12T03:10:05.724436+0000, chain.objs.size()=1 2024-09-12T01:29:14.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.804+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lke4Zy0pbhAx4peJZPAAnyufRLbrrDi_0 2024-09-12T01:29:14.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.804+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.555138981861648974', time=2024-09-12T03:10:05.725787+0000, chain.objs.size()=1 2024-09-12T01:29:14.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.804+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.bpRlOyPZOCH_d4Vp_L1i__NrwrIjdxZ_0 2024-09-12T01:29:14.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.807+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5434027512239932416', time=2024-09-12T03:10:05.890474+0000, chain.objs.size()=1 2024-09-12T01:29:14.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.807+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.W0EWhjP1E8FrvXbu_cwHUkPWzK23d-2_0 2024-09-12T01:29:14.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.807+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8378699446045468237', time=2024-09-12T03:10:06.067438+0000, chain.objs.size()=1 2024-09-12T01:29:14.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.807+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dh0neNVTfHFacEe95H9HxHRzeN5c9dx_0 2024-09-12T01:29:14.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.807+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16026894913704078976', time=2024-09-12T03:10:06.088673+0000, chain.objs.size()=1 2024-09-12T01:29:14.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.807+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8mfjFc5Ttuulf7JK5YykGJhMZqMjg10_0 2024-09-12T01:29:14.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.807+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8164059593275570281', time=2024-09-12T03:10:06.250405+0000, chain.objs.size()=1 2024-09-12T01:29:14.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.807+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.I76G3tsw_oSeu_VXc_ihtiQvZXUPgB8_0 2024-09-12T01:29:14.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.807+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12922043281202439491', time=2024-09-12T03:10:09.714494+0000, chain.objs.size()=1 2024-09-12T01:29:14.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.807+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.267__shadow_.7Py561vPDhz7QsTC11m9Yl3LI1BQws-_0 2024-09-12T01:29:14.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.808+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16107040234062573621', time=2024-09-12T03:10:10.299552+0000, chain.objs.size()=1 2024-09-12T01:29:14.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.808+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.268__shadow_.oo1w1pHfVAWcdPJrC-eiy1F7OMBT1_o_0 2024-09-12T01:29:14.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.808+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8462669913538585843', time=2024-09-12T03:10:17.079311+0000, chain.objs.size()=1 2024-09-12T01:29:14.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.808+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.279__shadow_.pZK9iUf00XlKwYBqmts9CHzW3jpxu69_0 2024-09-12T01:29:14.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.808+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4464631161743267357', time=2024-09-12T03:10:21.840755+0000, chain.objs.size()=1 2024-09-12T01:29:14.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.808+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.286__shadow_.Akw-5EoksHMpkVF_Cdvdt0BYy_s37fY_0 2024-09-12T01:29:14.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.809+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14759622009489214820', time=2024-09-12T03:10:23.111783+0000, chain.objs.size()=1 2024-09-12T01:29:14.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.809+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.288__shadow_.3_d_sM7ewRTxlMKXG1Qmi306D9AVRid_0 2024-09-12T01:29:14.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.809+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8057309534053364354', time=2024-09-12T03:10:27.185597+0000, chain.objs.size()=1 2024-09-12T01:29:14.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.809+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.UG4WP1o6e1b_NZSbhYT59rI3_akI8uk_0 2024-09-12T01:29:14.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.809+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7337142070205026352', time=2024-09-12T03:10:48.163832+0000, chain.objs.size()=1 2024-09-12T01:29:14.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.809+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.321__shadow_.2a0yU4o8FpO_CR_f8BwUpTKDs1x6f3i_0 2024-09-12T01:29:14.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.810+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14268549092963280859', time=2024-09-12T03:10:48.924867+0000, chain.objs.size()=1 2024-09-12T01:29:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.810+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.322__shadow_.gugCPsxskSiHmVpjt-RMMg2sCMhI_92_0 2024-09-12T01:29:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.811+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17154694413081962657', time=2024-09-12T03:11:29.302978+0000, chain.objs.size()=1 2024-09-12T01:29:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.811+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xzSOi9T5R8IABzOBp4dhnZ0slv8jFGa_0 2024-09-12T01:29:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.811+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14063351765325804865', time=2024-09-12T03:11:29.890683+0000, chain.objs.size()=1 2024-09-12T01:29:14.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.811+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fK3EmJ7k7_oWEZO7rCFAumG-i-9Fzps_0 2024-09-12T01:29:14.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.812+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6562556371491719811', time=2024-09-12T03:11:30.026969+0000, chain.objs.size()=1 2024-09-12T01:29:14.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.812+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.vclLwkKjou--6PLpNKe05-Zhruv5os8_0 2024-09-12T01:29:14.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.812+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1199484550573740329', time=2024-09-12T03:11:30.247634+0000, chain.objs.size()=1 2024-09-12T01:29:14.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.812+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.L8V2rffAv-KVDHEm3kSWvryfldntx-T_0 2024-09-12T01:29:14.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.812+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10584261722898301868', time=2024-09-12T03:11:31.325360+0000, chain.objs.size()=1 2024-09-12T01:29:14.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.812+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7vGQcNJJeHcWTh52PTPcI-voGVNvITd_0 2024-09-12T01:29:14.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.812+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15382469342010094753', time=2024-09-12T03:11:31.498503+0000, chain.objs.size()=1 2024-09-12T01:29:14.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.812+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.wJ0dnqfNF-kMkclQ0cf9A0OicsCzL0I_0 2024-09-12T01:29:14.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.812+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13542181226219125273', time=2024-09-12T03:11:31.755827+0000, chain.objs.size()=1 2024-09-12T01:29:14.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.812+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.BAafqMCseefSUvU97Y3nED-uq7m_CyT_0 2024-09-12T01:29:14.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.813+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5228583245672849599', time=2024-09-12T03:11:32.307800+0000, chain.objs.size()=1 2024-09-12T01:29:14.813 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.813+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.uGYyA-UIuFhBJ9LkLo16U10jtWq6L_H_0 2024-09-12T01:29:14.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.813+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17685767650160617603', time=2024-09-12T03:11:32.957426+0000, chain.objs.size()=1 2024-09-12T01:29:14.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.813+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Wj1b4IRYeKgsbHVFflPCLtnA_7iw-tn_0 2024-09-12T01:29:14.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.813+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9517080178376060255', time=2024-09-12T03:11:33.061343+0000, chain.objs.size()=1 2024-09-12T01:29:14.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.813+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-nFxKXwJlhGs9AIUK_HLk1h-sRWoXCq_0 2024-09-12T01:29:14.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.814+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13698329536132067149', time=2024-09-12T03:11:33.066343+0000, chain.objs.size()=1 2024-09-12T01:29:14.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.814+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.XmWsfpxLzZKAjnf6XruIKgXrjHlYYa-_0 2024-09-12T01:29:14.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.814+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4126615161655482863', time=2024-09-12T03:11:33.318356+0000, chain.objs.size()=1 2024-09-12T01:29:14.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.814+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Ny0p4zZh2RuCubhRPeZBf7PkEiKAL-c_0 2024-09-12T01:29:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.815+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6375614530738718584', time=2024-09-12T03:11:33.459751+0000, chain.objs.size()=1 2024-09-12T01:29:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.815+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ozkMAer4y4E3blL3n3pFjvRQIixeLID_0 2024-09-12T01:29:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.816+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12352236750985884431', time=2024-09-12T03:11:33.502786+0000, chain.objs.size()=1 2024-09-12T01:29:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.816+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.H9hPtOPIw6AXYii9e-aHDZDoqmF1ZBL_0 2024-09-12T01:29:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.816+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11970946430612050241', time=2024-09-12T03:11:34.697304+0000, chain.objs.size()=1 2024-09-12T01:29:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.816+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2ai-ea0WYm3aOAHH5TiknH8ntH9TSS0_0 2024-09-12T01:29:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.816+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10490164437843382050', time=2024-09-12T03:11:35.399554+0000, chain.objs.size()=1 2024-09-12T01:29:14.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.816+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.KJtM3B_4FT6rPU1YoY9p1l0BCCV_k_G_0 2024-09-12T01:29:14.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.816+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6288096968027147904', time=2024-09-12T03:11:36.374337+0000, chain.objs.size()=1 2024-09-12T01:29:14.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.816+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Tcx6m6Feu0LE589vqzhwKY25OoCJs5f_0 2024-09-12T01:29:14.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.816+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14803096747402558000', time=2024-09-12T03:11:36.950419+0000, chain.objs.size()=1 2024-09-12T01:29:14.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.816+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.nXcjQkxUJpmyeLZBpqHZYeqKMvBJkge_0 2024-09-12T01:29:14.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.816+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4714259786273449899', time=2024-09-12T03:11:37.160956+0000, chain.objs.size()=1 2024-09-12T01:29:14.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.816+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.8cZACJ2Hs6JPijvQOjba6FHam_1I53G_0 2024-09-12T01:29:14.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.816+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16092634356490365132', time=2024-09-12T03:11:37.760039+0000, chain.objs.size()=1 2024-09-12T01:29:14.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.816+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.CEHFroo0RIsC6-LiX1BK9KrQUixkPEQ_0 2024-09-12T01:29:14.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.817+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17521186041543210151', time=2024-09-12T03:11:38.255606+0000, chain.objs.size()=1 2024-09-12T01:29:14.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.817+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.46j4qc5lrwWusYXRNSlz66HjVk-cMua_0 2024-09-12T01:29:14.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.817+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2402144431824979025', time=2024-09-12T03:11:38.726628+0000, chain.objs.size()=1 2024-09-12T01:29:14.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.817+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.hCjSJMtVPf8vxb7jMSF72QnHIRbttyZ_0 2024-09-12T01:29:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.818+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5202970729328491043', time=2024-09-12T03:11:39.343725+0000, chain.objs.size()=1 2024-09-12T01:29:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.818+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xgG_320adxMpPAlTzz65DCwNSCV0o3o_0 2024-09-12T01:29:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.820+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.279160846749110554', time=2024-09-12T03:11:39.643652+0000, chain.objs.size()=1 2024-09-12T01:29:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.820+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.DzeCi89i7dcf7BjQfHepgJr7uyd-GLu_0 2024-09-12T01:29:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.820+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13893034524450653514', time=2024-09-12T03:11:39.722855+0000, chain.objs.size()=1 2024-09-12T01:29:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.820+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fRxNBziz-lpJlNAKL53_BADkAfBIbez_0 2024-09-12T01:29:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.820+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.833609542507598149', time=2024-09-12T03:11:40.077586+0000, chain.objs.size()=1 2024-09-12T01:29:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.820+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.JDt_Pz1SzYnGPhEgewDusyAOBY58HYo_0 2024-09-12T01:29:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15531595011906223535', time=2024-09-12T03:11:41.166717+0000, chain.objs.size()=1 2024-09-12T01:29:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-HEP3E8JfsUDFGulDJYwWxoWkVE4bMe_0 2024-09-12T01:29:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2251966250481763189', time=2024-09-12T03:11:41.378156+0000, chain.objs.size()=1 2024-09-12T01:29:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.88cZSFDrnIQ2lMXHbP8dx_Z7K5Id5mC_0 2024-09-12T01:29:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6404895237704574431', time=2024-09-12T03:12:22.047347+0000, chain.objs.size()=1 2024-09-12T01:29:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.BaMlBT3pSu4mRU0zHImW9JsVDeSKval_0 2024-09-12T01:29:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16808155224215750913', time=2024-09-12T03:12:22.314333+0000, chain.objs.size()=1 2024-09-12T01:29:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gQsWyfqWiXKOed70k1geehXTw6V4nB-_0 2024-09-12T01:29:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18087204722413009954', time=2024-09-12T03:12:22.427730+0000, chain.objs.size()=1 2024-09-12T01:29:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.rB6rwFLWMf7bu05Cr8IqR4Nuy7o9imR_0 2024-09-12T01:29:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9931708267866810888', time=2024-09-12T03:12:22.468308+0000, chain.objs.size()=1 2024-09-12T01:29:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MYjrfFt_2LlYa1kkxrxGbdVOTP4iqoP_0 2024-09-12T01:29:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9436312059263657015', time=2024-09-12T03:12:22.506933+0000, chain.objs.size()=1 2024-09-12T01:29:14.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.2cMv9aefBb1y7HfnpwhrFWmNvP35Ow2_0 2024-09-12T01:29:14.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8565248865450674156', time=2024-09-12T03:12:23.803568+0000, chain.objs.size()=1 2024-09-12T01:29:14.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.821+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MwobGRrz_D7QDbnvj0nGTwY5XzIzst5_0 2024-09-12T01:29:14.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.823+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7499501861968622838', time=2024-09-12T03:12:24.134509+0000, chain.objs.size()=1 2024-09-12T01:29:14.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.823+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.fguOVM0dERBI6NKQkn80v5lfo_1fEo6_0 2024-09-12T01:29:14.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.823+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14368696221804742077', time=2024-09-12T03:12:24.410108+0000, chain.objs.size()=1 2024-09-12T01:29:14.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.823+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.UX66pu5GAYgLgp8Sc1yhZ5Nkda1Anv1_0 2024-09-12T01:29:14.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.823+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12796969957833944858', time=2024-09-12T03:12:24.812467+0000, chain.objs.size()=1 2024-09-12T01:29:14.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.823+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1SNI995Nr8InXEXvlTmW4Vd5VKkp2LU_0 2024-09-12T01:29:14.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.824+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8318071305595177590', time=2024-09-12T03:12:24.812965+0000, chain.objs.size()=1 2024-09-12T01:29:14.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.824+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.pNC_ER3qtvWErzYk0RMBPtx6wzjhSIp_0 2024-09-12T01:29:14.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.824+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18251099553942996229', time=2024-09-12T03:12:25.624509+0000, chain.objs.size()=1 2024-09-12T01:29:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.824+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Ed331g9Jh55GeWQAYx96Uk2ITLxUy1l_0 2024-09-12T01:29:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.824+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11668292837298382796', time=2024-09-12T03:12:25.690833+0000, chain.objs.size()=1 2024-09-12T01:29:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.824+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.JP2v9Jjqzv6oyYPvyONAed9Ayl97Wdq_0 2024-09-12T01:29:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.825+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13344165730659526004', time=2024-09-12T03:12:26.135535+0000, chain.objs.size()=1 2024-09-12T01:29:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.825+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.75hZcNp3DT-SFEFiMexIntAcuVoJoMB_0 2024-09-12T01:29:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.825+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14563274161848994896', time=2024-09-12T03:12:26.376511+0000, chain.objs.size()=1 2024-09-12T01:29:14.826 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.825+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.qUp5jmosFieMUvAsQzheRlVbVuDlN9Y_0 2024-09-12T01:29:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.826+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4657114565138074874', time=2024-09-12T03:12:26.404207+0000, chain.objs.size()=1 2024-09-12T01:29:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.P4Eg26UQb_RiA1_MOwieIaCwPA09gJw_0 2024-09-12T01:29:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.826+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15973477109105194529', time=2024-09-12T03:12:27.183072+0000, chain.objs.size()=1 2024-09-12T01:29:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Xd576eWO8dxGrVSSL7cSrWX-1194tp4_0 2024-09-12T01:29:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.826+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9224515986723802403', time=2024-09-12T03:12:27.183644+0000, chain.objs.size()=1 2024-09-12T01:29:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._RzYjYbPE8pF4aIBW11PsIN_ftGJjC2_0 2024-09-12T01:29:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.826+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16455976875254645389', time=2024-09-12T03:12:27.184129+0000, chain.objs.size()=1 2024-09-12T01:29:14.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.TKBiBAdAy0RYa2Gf9_275tFhMrh5gub_0 2024-09-12T01:29:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.827+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13109067442090322373', time=2024-09-12T03:12:27.611697+0000, chain.objs.size()=1 2024-09-12T01:29:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.827+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.EBMGFio9VCvOfDurhTxBdNYKfDgls14_0 2024-09-12T01:29:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.827+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6081649473000873930', time=2024-09-12T03:12:27.612284+0000, chain.objs.size()=1 2024-09-12T01:29:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.827+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.JB-1NC7RKXhYF6v6nm2PNIKU3ULNSh9_0 2024-09-12T01:29:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.827+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10412055014487837', time=2024-09-12T03:12:28.069677+0000, chain.objs.size()=1 2024-09-12T01:29:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.827+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-xExrtzIUBtTbMp_q2jUs-YLuI19pLT_0 2024-09-12T01:29:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.827+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1544841660700533717', time=2024-09-12T03:12:28.132555+0000, chain.objs.size()=1 2024-09-12T01:29:14.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.827+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.rVjLjQbrAHCUf_sYbqfQKeD6dmyaMCY_0 2024-09-12T01:29:14.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.831+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/57470 2024-09-12T01:29:14.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-09-12T01:29:14.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9074746150444224063', time=2024-09-12T03:12:28.184143+0000, chain.objs.size()=1 2024-09-12T01:29:14.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-7nt6wJD5YC7B2YPKBhfog1f99QJctg_0 2024-09-12T01:29:14.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17133437319716618605', time=2024-09-12T03:12:28.747322+0000, chain.objs.size()=1 2024-09-12T01:29:14.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.76sXtspvnLg4kYimsEOn_hWj7kiZUPD_0 2024-09-12T01:29:14.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17644000125714999840', time=2024-09-12T03:12:29.852133+0000, chain.objs.size()=1 2024-09-12T01:29:14.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.quV4d0SRfAd1MJu67phZpSS-9YOWbDV_0 2024-09-12T01:29:14.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4171497130845755537', time=2024-09-12T03:12:29.907021+0000, chain.objs.size()=1 2024-09-12T01:29:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.XXUQ1V8PtYZ4MjAwjPf5TqeppT8Bgjf_0 2024-09-12T01:29:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6722091869444383475', time=2024-09-12T03:12:30.403642+0000, chain.objs.size()=1 2024-09-12T01:29:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.okdLVkTcNEX_x-Y-dZXlVZFA8uwUCXi_0 2024-09-12T01:29:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13275707255944511274', time=2024-09-12T03:12:30.591462+0000, chain.objs.size()=1 2024-09-12T01:29:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.aSEhAoqpcUKHhYYz38TgfWyJEkrl2CR_0 2024-09-12T01:29:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6349819947158454235', time=2024-09-12T03:12:30.739381+0000, chain.objs.size()=1 2024-09-12T01:29:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.kOOrcU488srLEBK3GJhSY4Nu4lud8X__0 2024-09-12T01:29:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14914807421001489685', time=2024-09-12T03:12:30.880896+0000, chain.objs.size()=1 2024-09-12T01:29:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.35N7RcSBTvv-TsjPEGhFLgD9tUi715__0 2024-09-12T01:29:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11685692751412330133', time=2024-09-12T03:12:31.530576+0000, chain.objs.size()=1 2024-09-12T01:29:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.KxG8KV5dr5c1diCp0m3ealBTUaAvCni_0 2024-09-12T01:29:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8654800875601514746', time=2024-09-12T03:12:31.959149+0000, chain.objs.size()=1 2024-09-12T01:29:14.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.2LkaJEk1qzS-ojo8sTBns3C6MyMDgoz_0 2024-09-12T01:29:14.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6639350525983108096', time=2024-09-12T03:12:31.959697+0000, chain.objs.size()=1 2024-09-12T01:29:14.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.aVJGnWxX0Fx49asylJbluUsTLPFMNdF_0 2024-09-12T01:29:14.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.833+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11625427463376114243', time=2024-09-12T03:12:32.117608+0000, chain.objs.size()=1 2024-09-12T01:29:14.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.834+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.sB8ZFhJF2mUuzdRG4xUSoXasb-_n4Sg_0 2024-09-12T01:29:14.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3227969609462533203', time=2024-09-12T03:12:32.151839+0000, chain.objs.size()=1 2024-09-12T01:29:14.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.f6eHWCBO_d8J5AR30nlNHdKswAr77bn_0 2024-09-12T01:29:14.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5480763586076449772', time=2024-09-12T03:12:32.357990+0000, chain.objs.size()=1 2024-09-12T01:29:14.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.2r5n5I8eUQ4SX_QmJBjxZ7tEpYBoXWW_0 2024-09-12T01:29:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11015250982681333773', time=2024-09-12T03:12:32.623436+0000, chain.objs.size()=1 2024-09-12T01:29:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.50iWmYq3mqvREDJk43ZfHRo-inXMQp9_0 2024-09-12T01:29:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4145454173805581761', time=2024-09-12T03:12:32.691187+0000, chain.objs.size()=1 2024-09-12T01:29:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.lu1E4zr3ID5u0jHtludsvtrUybOZ07t_0 2024-09-12T01:29:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7934238548697366375', time=2024-09-12T03:12:32.820948+0000, chain.objs.size()=1 2024-09-12T01:29:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.jRqSB8j8QwAcnQBcJWCmeX_0SF6OpJm_0 2024-09-12T01:29:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12053031802879902728', time=2024-09-12T03:12:33.185220+0000, chain.objs.size()=1 2024-09-12T01:29:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.YoMXSpnZj2spjvovGf0k3CVGSJi4SLh_0 2024-09-12T01:29:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3460249595747067882', time=2024-09-12T03:13:34.981593+0000, chain.objs.size()=1 2024-09-12T01:29:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.434__shadow_.0AL9m3qUgtH6c48BwAi23VgabpEPp8J_0 2024-09-12T01:29:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3659578648613836785', time=2024-09-12T03:13:50.687178+0000, chain.objs.size()=1 2024-09-12T01:29:14.838 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.458__shadow_.SIJK2CTOD_w9dIcqBgu47FfxaMYvHLt_0 2024-09-12T01:29:14.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15511764951919502896', time=2024-09-12T03:13:57.436492+0000, chain.objs.size()=1 2024-09-12T01:29:14.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.837+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.466__shadow_.L9T-kYalm6qMtH7GlsXvagVT2OXiJ_7_0 2024-09-12T01:29:14.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.838+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~uNIJXkdGJob8R8rfGPs8D9zCBjiRFoz', time=2024-09-12T03:16:18.541102+0000, chain.objs.size()=10 2024-09-12T01:29:14.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.838+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.526__multipart_mymultipart.2~uNIJXkdGJob8R8rfGPs8D9zCBjiRFoz.1 2024-09-12T01:29:14.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.838+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.526__multipart_mymultipart.2~uNIJXkdGJob8R8rfGPs8D9zCBjiRFoz.2 2024-09-12T01:29:14.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.840+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.526__multipart_mymultipart.2~uNIJXkdGJob8R8rfGPs8D9zCBjiRFoz.3 2024-09-12T01:29:14.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.840+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.526__multipart_mymultipart.2~uNIJXkdGJob8R8rfGPs8D9zCBjiRFoz.4 2024-09-12T01:29:14.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.842+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.526__multipart_mymultipart.2~uNIJXkdGJob8R8rfGPs8D9zCBjiRFoz.5 2024-09-12T01:29:14.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.842+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.526__multipart_mymultipart.2~uNIJXkdGJob8R8rfGPs8D9zCBjiRFoz.6 2024-09-12T01:29:14.842 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.842+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.526__multipart_mymultipart.2~uNIJXkdGJob8R8rfGPs8D9zCBjiRFoz.7 2024-09-12T01:29:14.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.842+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.526__multipart_mymultipart.2~uNIJXkdGJob8R8rfGPs8D9zCBjiRFoz.8 2024-09-12T01:29:14.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.842+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.526__multipart_mymultipart.2~uNIJXkdGJob8R8rfGPs8D9zCBjiRFoz.9 2024-09-12T01:29:14.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.842+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.526__multipart_mymultipart.2~uNIJXkdGJob8R8rfGPs8D9zCBjiRFoz.10 2024-09-12T01:29:14.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.842+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17058023372356459262', time=2024-09-12T03:17:10.261313+0000, chain.objs.size()=1 2024-09-12T01:29:14.843 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.842+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.550__shadow_.tL6pawhWpzE86rDjXISdDp6iKhKwfGK_0 2024-09-12T01:29:14.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.844+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11101106053622112761', time=2024-09-12T03:17:12.021849+0000, chain.objs.size()=1 2024-09-12T01:29:14.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.844+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.551__shadow_.mux6_R5Glr0zY1bndu10pHS8y7yZEbc_0 2024-09-12T01:29:14.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.844+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7665796967640081185', time=2024-09-12T03:17:41.728131+0000, chain.objs.size()=2 2024-09-12T01:29:14.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.844+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.563__shadow_.7WuNXlLu3VUeu6w-lMOaa1TX5oh1Bek_0 2024-09-12T01:29:14.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.844+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.563__shadow_.7WuNXlLu3VUeu6w-lMOaa1TX5oh1Bek_1 2024-09-12T01:29:14.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.844+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2882918883225386131', time=2024-09-12T03:17:47.379483+0000, chain.objs.size()=1 2024-09-12T01:29:14.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.844+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:sukt6zAzqS9AXEL9tPkIK4PbPhg2XvA_.y-qNVQvH3Vp0Lt2f3SNLYGa9AaT7OxN_0 2024-09-12T01:29:14.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.845+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4549541699707236584', time=2024-09-12T03:17:58.977547+0000, chain.objs.size()=1 2024-09-12T01:29:14.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.845+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.572__shadow:fajzwIQRf.uC.sIr-nc9L.ywkMlA6gh_.xYvRvZpt82uTCefIe0ZQnI2bAYmUg-1_0 2024-09-12T01:29:14.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.846+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2664833750381012284', time=2024-09-12T03:18:04.060153+0000, chain.objs.size()=1 2024-09-12T01:29:14.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.846+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.574__shadow:awLnFxn5P-TNLr0horYLsjRksgDEjUP_.qtjvUNcJRbEmMD2ZM7J5OFl4XxAjt1g_0 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.846+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14084110917761061389', time=2024-09-12T03:18:05.906881+0000, chain.objs.size()=1 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.846+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.575__shadow_.Y_XkhYWEmp0gGkS_vIlpRHHexqi0Srv_0 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.846+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14580552856004871742', time=2024-09-12T03:18:15.304276+0000, chain.objs.size()=1 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.846+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:T62dlFlfT6-vaha9yJVF53l4r9zjHNa_.uc3F44RNjHl-IZUfc839RlsBTBose8B_0 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.846+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7279863298163979710', time=2024-09-12T03:19:04.834412+0000, chain.objs.size()=1 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.846+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.603__shadow_.bk8hE_2nKJINkSnMP2GOytnC1Va20DW_0 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.846+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4668535122872866436', time=2024-09-12T03:19:06.218344+0000, chain.objs.size()=1 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.846+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.605__shadow_.HP9GL0UB2zaw5JSDT7KKw9beRJXD1gp_0 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.846+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10065200767976775363', time=2024-09-12T03:23:42.825482+0000, chain.objs.size()=1 2024-09-12T01:29:14.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.846+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.665__shadow_.f8yjMSFTu9kRvwNNo5-Z-mL3B6EzOGm_0 2024-09-12T01:29:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.848+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18377310590839050691', time=2024-09-12T03:23:45.705809+0000, chain.objs.size()=1 2024-09-12T01:29:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.848+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.670__shadow_.2FZ51ckr-a8Rp1bkuTOmXeFrsY55l0Q_0 2024-09-12T01:29:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.848+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1946062350807264982', time=2024-09-12T03:24:01.357918+0000, chain.objs.size()=1 2024-09-12T01:29:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.848+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.699__shadow:vF373LeJjHnYWkIN.9meCYhNbnHNL0O_.JWxZh9oeuk55B7QrfpTKJfYQqCQV6iH_0 2024-09-12T01:29:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.848+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8792409101132431224', time=2024-09-12T03:24:33.374077+0000, chain.objs.size()=1 2024-09-12T01:29:14.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.848+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.719__shadow_.SCZLt-hNin6rB2VBFTuXdlVtBxAeuii_0 2024-09-12T01:29:14.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.852+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:14.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.855+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:29:14.856 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.856+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:14.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.857+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46556' 2024-09-12T01:29:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18291351430551314793', time=2024-09-12T03:06:38.225209+0000, chain.objs.size()=2 2024-09-12T01:29:14.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.158__shadow_.PRNKk93D21nJdaJiJi2aaEjgEb9tj3X_0 2024-09-12T01:29:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.158__shadow_.PRNKk93D21nJdaJiJi2aaEjgEb9tj3X_1 2024-09-12T01:29:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_nbebrBcSF7ZtiZAKoEalEPbqpExrzht', time=2024-09-12T03:06:44.881698+0000, chain.objs.size()=2 2024-09-12T01:29:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.160__shadow_.4SLqAcNpULKhjYnuMII-us-8oTlKmgH_0 2024-09-12T01:29:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.160__shadow_.4SLqAcNpULKhjYnuMII-us-8oTlKmgH_1 2024-09-12T01:29:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_mApJ3BiFcPHVfo53uu8nBm34UTpcfrv', time=2024-09-12T03:06:46.578392+0000, chain.objs.size()=2 2024-09-12T01:29:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.160__shadow_.5FxSY132wudJcQHHRePXV7SC81FvoCK_0 2024-09-12T01:29:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.160__shadow_.5FxSY132wudJcQHHRePXV7SC81FvoCK_1 2024-09-12T01:29:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.99132926654972037', time=2024-09-12T03:07:22.238354+0000, chain.objs.size()=1 2024-09-12T01:29:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.197__shadow_.BHgqlJa6nbOtFONLssWfeWxfBs42WBm_0 2024-09-12T01:29:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9698305168910279521', time=2024-09-12T03:09:00.966350+0000, chain.objs.size()=1 2024-09-12T01:29:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.240__shadow_.9HGnltSmeZAVFREtzrGTW0CIK1Y4SSM_0 2024-09-12T01:29:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12990324333725028267', time=2024-09-12T03:09:04.722838+0000, chain.objs.size()=1 2024-09-12T01:29:14.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.245__shadow_.rClE7tdwUFTwCPXy81WA9fldH2bOYjC_0 2024-09-12T01:29:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4458158378479976260', time=2024-09-12T03:09:06.027966+0000, chain.objs.size()=1 2024-09-12T01:29:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.247__shadow_.PQzvx0hAlDR_aKBJDTrcc-sfbACNlxe_0 2024-09-12T01:29:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9644932526245938470', time=2024-09-12T03:09:14.286035+0000, chain.objs.size()=1 2024-09-12T01:29:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.260__shadow_.zDmBKRcEZP8lahWxnTGUoPGstXwgkSk_0 2024-09-12T01:29:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5674568692247628345', time=2024-09-12T03:09:54.694597+0000, chain.objs.size()=1 2024-09-12T01:29:14.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.858+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.i4XDg5F-_yw6W1WQY4chzD3DTat1sSU_0 2024-09-12T01:29:14.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8109485031115108801', time=2024-09-12T03:09:54.846047+0000, chain.objs.size()=1 2024-09-12T01:29:14.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RLcRlwxJQ9SshaIGqyqsY-nsA-y2ouP_0 2024-09-12T01:29:14.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9388413573496869877', time=2024-09-12T03:09:55.418213+0000, chain.objs.size()=1 2024-09-12T01:29:14.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.APXg_F1tAHEBNo-aJR8B9msH9YN_RwI_0 2024-09-12T01:29:14.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15201327421088398433', time=2024-09-12T03:09:55.981411+0000, chain.objs.size()=1 2024-09-12T01:29:14.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.XSgY52bExGwKml_TG6hsmr6T2qnRZ0t_0 2024-09-12T01:29:14.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5154623849762101605', time=2024-09-12T03:09:56.423884+0000, chain.objs.size()=1 2024-09-12T01:29:14.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.WKIOTLOsvf4IHQQd3hY2orOzT6YbTHC_0 2024-09-12T01:29:14.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10503475932004670891', time=2024-09-12T03:09:56.453046+0000, chain.objs.size()=1 2024-09-12T01:29:14.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RezNkXM287fidmWeo1IWFIC3k_V0lkj_0 2024-09-12T01:29:14.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10173474925450579850', time=2024-09-12T03:09:57.122645+0000, chain.objs.size()=1 2024-09-12T01:29:14.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QVDEBAopvCWvhIR7nxRi8OMbclVQbNK_0 2024-09-12T01:29:14.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3857654626376177540', time=2024-09-12T03:09:57.275644+0000, chain.objs.size()=1 2024-09-12T01:29:14.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.iLWSEL_c-oBC1Clug4GwdL8Hs15OzP7_0 2024-09-12T01:29:14.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6094870007632958697', time=2024-09-12T03:09:57.773630+0000, chain.objs.size()=1 2024-09-12T01:29:14.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.NwvcPAwHwwzf2V6khZgwkCyAz3tS_t6_0 2024-09-12T01:29:14.863 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.863+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17861912569457929339', time=2024-09-12T03:09:58.045324+0000, chain.objs.size()=1 2024-09-12T01:29:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.863+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.cvsFqu36mhu8k9W5PWZ0m1IHBM3ag27_0 2024-09-12T01:29:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.863+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11325699409929736758', time=2024-09-12T03:09:58.098966+0000, chain.objs.size()=1 2024-09-12T01:29:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.863+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.IZCAY78Sna3H6wVchKbOCd8ufyC1W9X_0 2024-09-12T01:29:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.863+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11946403412443361969', time=2024-09-12T03:09:58.427570+0000, chain.objs.size()=1 2024-09-12T01:29:14.864 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.863+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.5JzfvlsrLMtjkBjwCJLG_hWF9jUDsWk_0 2024-09-12T01:29:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.865+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12326037896150325120', time=2024-09-12T03:09:58.558025+0000, chain.objs.size()=1 2024-09-12T01:29:14.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.865+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dfe5XWnxFKaJzuGQAnmMt0VpqDfKRG4_0 2024-09-12T01:29:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.866+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4994463364752584545', time=2024-09-12T03:09:58.623789+0000, chain.objs.size()=1 2024-09-12T01:29:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.866+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.bSAVsqEE429pFboVpYW7UkohbPAljyl_0 2024-09-12T01:29:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.866+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4390752492522048086', time=2024-09-12T03:09:58.927992+0000, chain.objs.size()=1 2024-09-12T01:29:14.866 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.866+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.uvJJBAk6JqA7AE0APGr8Dt7CVQfNPc3_0 2024-09-12T01:29:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.867+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16332330617477280964', time=2024-09-12T03:09:59.408613+0000, chain.objs.size()=1 2024-09-12T01:29:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.867+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.w_c3vWZR3uRHIzNp2fuJNdLp7oAescr_0 2024-09-12T01:29:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.867+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2031759730789763374', time=2024-09-12T03:09:59.883322+0000, chain.objs.size()=1 2024-09-12T01:29:14.867 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.867+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PQ-V-YlnnM-0iiTzpvxTGsBs5c52wUp_0 2024-09-12T01:29:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.867+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3843493641165660971', time=2024-09-12T03:10:00.000797+0000, chain.objs.size()=1 2024-09-12T01:29:14.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.867+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.uNwv-FEyoVKdMB3QqpR9YfObLVAUTtH_0 2024-09-12T01:29:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1347693033763844658', time=2024-09-12T03:10:00.294125+0000, chain.objs.size()=1 2024-09-12T01:29:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.3pd1oxQ5AwTHjY3oMDlPo1NWLMBClJx_0 2024-09-12T01:29:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14512751855733580198', time=2024-09-12T03:10:00.436788+0000, chain.objs.size()=1 2024-09-12T01:29:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.JxO5y4URzDDNRheSNqBEibje8z9q_eG_0 2024-09-12T01:29:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14478114689927498009', time=2024-09-12T03:10:01.063570+0000, chain.objs.size()=1 2024-09-12T01:29:14.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1Be2X67ifa1pC8v9t5lMFDRslNxJ4tC_0 2024-09-12T01:29:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16253709857082965468', time=2024-09-12T03:10:01.646589+0000, chain.objs.size()=1 2024-09-12T01:29:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.D3OK4xdDT-IubrshO6nm46QXf2XNU7p_0 2024-09-12T01:29:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2046083225949577071', time=2024-09-12T03:10:01.965107+0000, chain.objs.size()=1 2024-09-12T01:29:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.sUnrzBJo0RJ4LPOazfaoxvRAI5GvvGZ_0 2024-09-12T01:29:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11989187836336054687', time=2024-09-12T03:10:02.845702+0000, chain.objs.size()=1 2024-09-12T01:29:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.m7f9Uqyo26GwngnK33Z7bH4N0qB8hNg_0 2024-09-12T01:29:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13926627545471413537', time=2024-09-12T03:10:03.477156+0000, chain.objs.size()=1 2024-09-12T01:29:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Eb_9Cg40QU6z-T3nZxWFFqLm8hE8zbm_0 2024-09-12T01:29:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4035225406516865351', time=2024-09-12T03:10:03.647812+0000, chain.objs.size()=1 2024-09-12T01:29:14.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.869+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.GMgXWTFnuWwcDo2Kv4iGRpHaPVSKuOc_0 2024-09-12T01:29:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.871+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14447860424368726459', time=2024-09-12T03:10:04.207064+0000, chain.objs.size()=1 2024-09-12T01:29:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.872+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.tlsy9JTwP6qGh10XZrBhtsNCagBTeiF_0 2024-09-12T01:29:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.872+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7604825708157395204', time=2024-09-12T03:10:04.365585+0000, chain.objs.size()=1 2024-09-12T01:29:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.872+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.zjle9MJfIRRQbd63cojPb6hPmdkmx4Q_0 2024-09-12T01:29:14.872 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.872+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10488502431407692736', time=2024-09-12T03:10:04.447117+0000, chain.objs.size()=1 2024-09-12T01:29:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.872+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ztfa9deu22d8MMMSFpesEilDoZA9yFS_0 2024-09-12T01:29:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.872+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12821773510757607896', time=2024-09-12T03:10:05.056066+0000, chain.objs.size()=1 2024-09-12T01:29:14.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.872+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.kW4fDB7Z4EVMkuhfwhSyMoCN3Bi0FCm_0 2024-09-12T01:29:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.873+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11649640672720198069', time=2024-09-12T03:10:05.329867+0000, chain.objs.size()=1 2024-09-12T01:29:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.873+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.sttiO6ZfMWgUJgB_cp0qeXug-6mG7Ou_0 2024-09-12T01:29:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.873+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12170388476362654192', time=2024-09-12T03:10:05.915168+0000, chain.objs.size()=1 2024-09-12T01:29:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.873+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.LcMW2KcmAbP4ZRhOSa2LJ-uqpk4tevo_0 2024-09-12T01:29:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.873+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.779589044054046093', time=2024-09-12T03:10:06.620846+0000, chain.objs.size()=1 2024-09-12T01:29:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.873+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.JmX3xqvs_f3o9pStkXCcH-7KN-v2Z7O_0 2024-09-12T01:29:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.873+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10429711505512567120', time=2024-09-12T03:10:13.272581+0000, chain.objs.size()=1 2024-09-12T01:29:14.874 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.873+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.273__shadow_.xUhUPhRKVGvvalypi_po7PFfa1mG6CT_0 2024-09-12T01:29:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.874+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18011664126213634936', time=2024-09-12T03:10:13.273331+0000, chain.objs.size()=1 2024-09-12T01:29:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.874+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.273__shadow_.sJiQb_5qOqSiMZEZfcsYdymOGmzf-M1_0 2024-09-12T01:29:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.874+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9273623425050676739', time=2024-09-12T03:10:13.864791+0000, chain.objs.size()=1 2024-09-12T01:29:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.874+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.274__shadow_.pNgdn-4jYruk9EDxGJbssR9q6ohVM8y_0 2024-09-12T01:29:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.874+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4993692345517393084', time=2024-09-12T03:10:27.180779+0000, chain.objs.size()=1 2024-09-12T01:29:14.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.874+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.nI4DBjl5D4szu8rBoSOIzumRwOCNvlc_0 2024-09-12T01:29:14.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.875+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1995099903026897339', time=2024-09-12T03:11:29.330009+0000, chain.objs.size()=1 2024-09-12T01:29:14.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.875+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.GABxUgDP0_ymzgT416NIcJLOTdk-853_0 2024-09-12T01:29:14.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.875+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5235013517017156302', time=2024-09-12T03:11:29.444962+0000, chain.objs.size()=1 2024-09-12T01:29:14.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.875+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5sHuOMbgV-IOALi5axnBNF3CKxPxCvk_0 2024-09-12T01:29:14.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.875+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14714611667016845906', time=2024-09-12T03:11:29.639692+0000, chain.objs.size()=1 2024-09-12T01:29:14.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.875+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.TYFXPJVk_jotoQSOwkEyy4IM4v_OoDH_0 2024-09-12T01:29:14.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.875+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13408688277281566121', time=2024-09-12T03:11:29.821333+0000, chain.objs.size()=1 2024-09-12T01:29:14.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.875+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.HdtA4xCJWwkQcH4RS2_zJ45FX8Zy8e5_0 2024-09-12T01:29:14.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.876+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11281724660895886164', time=2024-09-12T03:11:30.120993+0000, chain.objs.size()=1 2024-09-12T01:29:14.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.876+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.H6RKtzXenCv2C6kfhb3rr1zXH1LS0iR_0 2024-09-12T01:29:14.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.878+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18282684692105106758', time=2024-09-12T03:11:30.181234+0000, chain.objs.size()=1 2024-09-12T01:29:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.878+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.n1m-h0pcDnPzHJ18BWWQKPuxKLeGnoW_0 2024-09-12T01:29:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.878+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6355860853048110249', time=2024-09-12T03:11:30.211631+0000, chain.objs.size()=1 2024-09-12T01:29:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.878+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.NBCwyAIkCj9yDKyLONGmY3t-3U5JWO7_0 2024-09-12T01:29:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.878+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1544044959507424829', time=2024-09-12T03:11:31.589082+0000, chain.objs.size()=1 2024-09-12T01:29:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.878+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.m7lU2aZO2zd0esDrPVZO1zVJeAFek9T_0 2024-09-12T01:29:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.878+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1247050860970423815', time=2024-09-12T03:11:31.759560+0000, chain.objs.size()=1 2024-09-12T01:29:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.878+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.oeHPn7ut2dCCJUAyajcOa2PJEreGdTC_0 2024-09-12T01:29:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.878+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9143488885499218303', time=2024-09-12T03:11:32.875778+0000, chain.objs.size()=1 2024-09-12T01:29:14.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.878+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.vNkExh3gmnwEANsV2dEqCkHuCHMt058_0 2024-09-12T01:29:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.878+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17809236099195474534', time=2024-09-12T03:11:32.877013+0000, chain.objs.size()=1 2024-09-12T01:29:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.878+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.SUs64hXk3Ikf_72YzxxG-aManqqj6-k_0 2024-09-12T01:29:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.879+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3248874952991144508', time=2024-09-12T03:11:33.077913+0000, chain.objs.size()=1 2024-09-12T01:29:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.879+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mN33HC8zNUuN1VF9UIPkYNRII4Cx6b8_0 2024-09-12T01:29:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.879+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.975875786716359549', time=2024-09-12T03:11:33.181504+0000, chain.objs.size()=1 2024-09-12T01:29:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.879+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.uPjJc5t-kYHOyqomUpefWMX-m3U0m1q_0 2024-09-12T01:29:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.879+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8356106207963206703', time=2024-09-12T03:11:33.298688+0000, chain.objs.size()=1 2024-09-12T01:29:14.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.879+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mx6dChFvrZvdZ0PtTlJ19T7ufPJ7Uwk_0 2024-09-12T01:29:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.879+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8850177898416878830', time=2024-09-12T03:11:33.726900+0000, chain.objs.size()=1 2024-09-12T01:29:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.879+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1Y9rz_LW6zhObv_yfA-Z8GY4zAp9e2__0 2024-09-12T01:29:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.879+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5594640711819996824', time=2024-09-12T03:11:34.516377+0000, chain.objs.size()=1 2024-09-12T01:29:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.879+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Yk6QS3i2F1pH_qhhOxJrJ9DJF_lE1vI_0 2024-09-12T01:29:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.881+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10057119753836655331', time=2024-09-12T03:11:34.687982+0000, chain.objs.size()=1 2024-09-12T01:29:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.881+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.pIrIixxrGcucKip7vZVNfntOq_DkThi_0 2024-09-12T01:29:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.881+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9444691253841692903', time=2024-09-12T03:11:34.773179+0000, chain.objs.size()=1 2024-09-12T01:29:14.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.881+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.UkCdBRI1_kYXVGFe1o1aYJ_72maS7Xt_0 2024-09-12T01:29:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.882+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1614133105743808052', time=2024-09-12T03:11:34.844153+0000, chain.objs.size()=1 2024-09-12T01:29:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.882+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.UoM4u2e4tbMOeIc3h3OjSNT3Xb2URCQ_0 2024-09-12T01:29:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6231624893793802059', time=2024-09-12T03:11:35.082185+0000, chain.objs.size()=1 2024-09-12T01:29:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.pdfDcCNsHawTiEbMNBUFtggeCzZXSGv_0 2024-09-12T01:29:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15371863395622190099', time=2024-09-12T03:11:35.189426+0000, chain.objs.size()=1 2024-09-12T01:29:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MIwHi256104C5zvOSAXB25JvNnilPlX_0 2024-09-12T01:29:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7524250404520665022', time=2024-09-12T03:11:35.449299+0000, chain.objs.size()=1 2024-09-12T01:29:14.883 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.m-kUj4Fz1GB21jUb1KjXVFR7wM6OHnQ_0 2024-09-12T01:29:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8785430197109843928', time=2024-09-12T03:11:36.665627+0000, chain.objs.size()=1 2024-09-12T01:29:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.cQ26z8En-BvYZYQzv2fSjTxtYS80RyB_0 2024-09-12T01:29:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5197802007125383220', time=2024-09-12T03:11:36.891004+0000, chain.objs.size()=1 2024-09-12T01:29:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Ace5-00Yxore3J1zMjejrVIjXqQNofX_0 2024-09-12T01:29:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4262772054840150233', time=2024-09-12T03:11:36.990769+0000, chain.objs.size()=1 2024-09-12T01:29:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.jttpYIFmDPQu8kL3Oypatrc6k2X2veX_0 2024-09-12T01:29:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9019065977740474651', time=2024-09-12T03:11:37.133468+0000, chain.objs.size()=1 2024-09-12T01:29:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.SRfoMvJWVGp4xubQSqpAg941wI3gY0__0 2024-09-12T01:29:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11455467622411370676', time=2024-09-12T03:11:37.258528+0000, chain.objs.size()=1 2024-09-12T01:29:14.884 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.883+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.GHYYN0fJewulPn5v_5Cy_u82MpEXoEp_0 2024-09-12T01:29:14.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.885+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1124198087430489684', time=2024-09-12T03:11:37.275267+0000, chain.objs.size()=1 2024-09-12T01:29:14.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.885+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.EGXhg875uoCAj5w1DCXh6THrAl8O7oa_0 2024-09-12T01:29:14.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.885+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13567441357066616994', time=2024-09-12T03:11:38.054333+0000, chain.objs.size()=1 2024-09-12T01:29:14.885 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.885+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.esYhfZbFq8GBzPUZTVfdQtYL3Oqfvmq_0 2024-09-12T01:29:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.885+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12425161275018266313', time=2024-09-12T03:11:38.328444+0000, chain.objs.size()=1 2024-09-12T01:29:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.885+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.6_rYpzDEdrxB1BhBWIVHmY56onEv_5e_0 2024-09-12T01:29:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.885+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16616249253627782367', time=2024-09-12T03:11:38.397108+0000, chain.objs.size()=1 2024-09-12T01:29:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.885+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.20hV56NsUBcg51TkEEh3QcUvCIcoGxT_0 2024-09-12T01:29:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.885+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4208482837507397028', time=2024-09-12T03:11:38.547501+0000, chain.objs.size()=1 2024-09-12T01:29:14.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.885+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.aojU75_BsjRWC35mY5rzpU2MSuqBblF_0 2024-09-12T01:29:14.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.888+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4151446269157441538', time=2024-09-12T03:11:38.589153+0000, chain.objs.size()=1 2024-09-12T01:29:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.888+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.lH1bInCUZkMCtkZpB9XVe_4J60Q3dQF_0 2024-09-12T01:29:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.888+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2273375451304193231', time=2024-09-12T03:11:38.589733+0000, chain.objs.size()=1 2024-09-12T01:29:14.889 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.888+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.GOA540RBH8FzldUmDVOVxzkmVE2G-C2_0 2024-09-12T01:29:14.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15676374538172812032', time=2024-09-12T03:11:38.735030+0000, chain.objs.size()=1 2024-09-12T01:29:14.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.oANtqevXgJNvrFiWf-JCv_Ngs-tDv_i_0 2024-09-12T01:29:14.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11040677899151524545', time=2024-09-12T03:11:39.396750+0000, chain.objs.size()=1 2024-09-12T01:29:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.sC6txgZJl6h2UOQb-GAeCHVxcHTI4AX_0 2024-09-12T01:29:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2685436755910830725', time=2024-09-12T03:11:39.941166+0000, chain.objs.size()=1 2024-09-12T01:29:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7-v9c3jeckX_P0FMCpUSWUsZQv1MTMP_0 2024-09-12T01:29:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16393197433275418484', time=2024-09-12T03:11:39.941688+0000, chain.objs.size()=1 2024-09-12T01:29:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.DeNH0iYtY2IkmVLDF-gXoHXFRD-AS5X_0 2024-09-12T01:29:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1362652053765268234', time=2024-09-12T03:11:40.072396+0000, chain.objs.size()=1 2024-09-12T01:29:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.YtLCN5JgffT4s8MavPs9PegfDgLvySX_0 2024-09-12T01:29:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11104930382559063129', time=2024-09-12T03:11:40.249266+0000, chain.objs.size()=1 2024-09-12T01:29:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ehcHYD5jASpreP2Co2F2fFyVzSFYXzl_0 2024-09-12T01:29:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17743485927496925190', time=2024-09-12T03:11:41.292477+0000, chain.objs.size()=1 2024-09-12T01:29:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.roOKeEHTV8swcqaPBVQVDL6Mh8Dj3Ku_0 2024-09-12T01:29:14.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15480684854323977513', time=2024-09-12T03:11:41.390988+0000, chain.objs.size()=1 2024-09-12T01:29:14.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Em4iZ13O4cWJm7I604sR3zXTJRtgvw__0 2024-09-12T01:29:14.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7823591486975380107', time=2024-09-12T03:11:41.610592+0000, chain.objs.size()=1 2024-09-12T01:29:14.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.890+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.dUdQ8sklpJ4mBQPcMpoAKLRrYNdA91K_0 2024-09-12T01:29:14.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.892+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.22021567019154769', time=2024-09-12T03:12:22.691540+0000, chain.objs.size()=1 2024-09-12T01:29:14.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.892+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.SUQZ1EHvjQDimQnl7jInuItHw_X8Gdm_0 2024-09-12T01:29:14.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.892+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3392092591440663004', time=2024-09-12T03:12:22.694672+0000, chain.objs.size()=1 2024-09-12T01:29:14.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.892+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.4GEExCVfkWZLOOPGMMUmZz81_ej74Uf_0 2024-09-12T01:29:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.894+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10679400098992899686', time=2024-09-12T03:12:24.490889+0000, chain.objs.size()=1 2024-09-12T01:29:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.894+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mErCnab_X_y6cg-t1LHZayqoZ0Fsouh_0 2024-09-12T01:29:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.894+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11666145031900184022', time=2024-09-12T03:12:24.521605+0000, chain.objs.size()=1 2024-09-12T01:29:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.894+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.fVncrtG_m4czN2phhi7VtiYlQuoEPog_0 2024-09-12T01:29:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.894+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1075647768703669391', time=2024-09-12T03:12:25.980363+0000, chain.objs.size()=1 2024-09-12T01:29:14.894 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.894+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gs4ewp9gRNDbRLYqJlIx5xx5R4jWh71_0 2024-09-12T01:29:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.894+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.432089222400128447', time=2024-09-12T03:12:26.349445+0000, chain.objs.size()=1 2024-09-12T01:29:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.894+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.HwQgA0mCb1J4GBFBClX4B6q8U5g4upF_0 2024-09-12T01:29:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.894+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4097261489066735435', time=2024-09-12T03:12:26.533926+0000, chain.objs.size()=1 2024-09-12T01:29:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.894+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.538jTjtCzvwMpQVHBQ7z3dnOnRSRnUX_0 2024-09-12T01:29:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.894+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.679081225331466289', time=2024-09-12T03:12:27.023737+0000, chain.objs.size()=1 2024-09-12T01:29:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.894+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.KYcsBUaY8aaYqKgjycYnm6pKBVFLPpM_0 2024-09-12T01:29:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.894+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7037447421128212088', time=2024-09-12T03:12:27.088439+0000, chain.objs.size()=1 2024-09-12T01:29:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.894+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.BY-NdXrpe0yxv2ITz63FTWCxq8L3Edd_0 2024-09-12T01:29:14.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.895+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9534976463597247171', time=2024-09-12T03:12:27.088992+0000, chain.objs.size()=1 2024-09-12T01:29:14.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.895+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RleigBg_u3J2qUZ5aAQVq3H7Us_snjj_0 2024-09-12T01:29:14.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.895+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.948392142489698992', time=2024-09-12T03:12:27.499401+0000, chain.objs.size()=1 2024-09-12T01:29:14.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.895+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ma6y3-b_op5srWpU3b3EHhPeFUnMPO6_0 2024-09-12T01:29:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.896+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15620210430536946364', time=2024-09-12T03:12:27.612953+0000, chain.objs.size()=1 2024-09-12T01:29:14.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.896+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.LHVwEsTQE5AuviEcqdcqrzJRLFfMBz4_0 2024-09-12T01:29:14.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.901+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/46556 2024-09-12T01:29:14.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-12T01:29:14.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7355176723175417770', time=2024-09-12T03:12:29.091102+0000, chain.objs.size()=1 2024-09-12T01:29:14.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Ik6MocXAxMeEdPYUHXQW9r9pumM3sS1_0 2024-09-12T01:29:14.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9837542587069963473', time=2024-09-12T03:12:29.133895+0000, chain.objs.size()=1 2024-09-12T01:29:14.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xbYqPTyBcFX2zyW1BB_T1lcROSefpF-_0 2024-09-12T01:29:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9404939899458989567', time=2024-09-12T03:12:29.290925+0000, chain.objs.size()=1 2024-09-12T01:29:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.bbmlW2LDNqvPlAVXx2dDJOJ2abJFiV2_0 2024-09-12T01:29:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5087287261496308094', time=2024-09-12T03:12:29.695215+0000, chain.objs.size()=1 2024-09-12T01:29:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1EWS3R5ecKm3-_jeIi7boa0aIYN8CwX_0 2024-09-12T01:29:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10866572933484644211', time=2024-09-12T03:12:29.713214+0000, chain.objs.size()=1 2024-09-12T01:29:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.AfOG_Wxvge-uimXXxPiQUoIGpgyIaZt_0 2024-09-12T01:29:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15122828335922266270', time=2024-09-12T03:12:30.403757+0000, chain.objs.size()=1 2024-09-12T01:29:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Im7RgiNcfPl9PHIZFdeTSLuYPn7tPE5_0 2024-09-12T01:29:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4694328241857821839', time=2024-09-12T03:12:30.956581+0000, chain.objs.size()=1 2024-09-12T01:29:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.XytdXaGXZq_zNOEfK8ySE29dcUJJ2DQ_0 2024-09-12T01:29:14.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9231611847916060985', time=2024-09-12T03:12:31.015670+0000, chain.objs.size()=1 2024-09-12T01:29:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.w_pdYzwT1LLbdlodGh5pdd7hf3Iun4l_0 2024-09-12T01:29:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2585828336148039981', time=2024-09-12T03:12:31.040570+0000, chain.objs.size()=1 2024-09-12T01:29:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.KgTrcNK-sV8g-EgPvcWOGw_seN1l7Q0_0 2024-09-12T01:29:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12732146554988441253', time=2024-09-12T03:12:31.105646+0000, chain.objs.size()=1 2024-09-12T01:29:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ZJ7WLDa-nBH4WJjmgoPh8h0i4BQs-bk_0 2024-09-12T01:29:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11691744777059331781', time=2024-09-12T03:12:31.610909+0000, chain.objs.size()=1 2024-09-12T01:29:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hfYQISCEu3vfBd73xSqA3RIHjVlvKLD_0 2024-09-12T01:29:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10170390253652205331', time=2024-09-12T03:12:32.138812+0000, chain.objs.size()=1 2024-09-12T01:29:14.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.903+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Tix_DL48X5nRB4hnPcpXwQgn3Espg1b_0 2024-09-12T01:29:14.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.906+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7059282915823099413', time=2024-09-12T03:12:32.267621+0000, chain.objs.size()=1 2024-09-12T01:29:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.906+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.q95iF5zWKGA7WsQ8DhPYUQ7wKfD6Fet_0 2024-09-12T01:29:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.906+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7774069978348643770', time=2024-09-12T03:12:32.408530+0000, chain.objs.size()=1 2024-09-12T01:29:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.906+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.y6-QYkfwqMrhXCvEvR6RqCDU0on8I4I_0 2024-09-12T01:29:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.906+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.713649634615544777', time=2024-09-12T03:12:33.129684+0000, chain.objs.size()=1 2024-09-12T01:29:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.906+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.kPVRTUonqWOqcbGptU8hVqvPVPdMPb5_0 2024-09-12T01:29:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.906+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8347461363284100197', time=2024-09-12T03:12:33.200083+0000, chain.objs.size()=1 2024-09-12T01:29:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.906+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RMqhO_JTBIQSne-k21_cGsGmKnJlEwp_0 2024-09-12T01:29:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.906+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12177493019899244253', time=2024-09-12T03:14:40.114679+0000, chain.objs.size()=1 2024-09-12T01:29:14.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.906+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.518__multipart_mymultipart.2~bZOVWY06Rb8g-1JXg17-jvfRRNUjsRh.1 2024-09-12T01:29:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.906+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1070527646583296605', time=2024-09-12T03:15:03.481275+0000, chain.objs.size()=3 2024-09-12T01:29:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.906+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.521__multipart_mymultipart.2~2h08ZFwu7ioo2I47G4CdGtg3NnN_BIm.1 2024-09-12T01:29:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.907+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.521__multipart_mymultipart.2~2h08ZFwu7ioo2I47G4CdGtg3NnN_BIm.2 2024-09-12T01:29:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.907+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.521__multipart_mymultipart.2~2h08ZFwu7ioo2I47G4CdGtg3NnN_BIm.3 2024-09-12T01:29:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.907+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~NhbeVrVi_qil0LEY6c11SiRqKCMmDNj', time=2024-09-12T03:16:30.785419+0000, chain.objs.size()=2 2024-09-12T01:29:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.907+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.531__multipart_mymultipart.2~NhbeVrVi_qil0LEY6c11SiRqKCMmDNj.1 2024-09-12T01:29:14.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.907+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.531__multipart_mymultipart.2~NhbeVrVi_qil0LEY6c11SiRqKCMmDNj.2 2024-09-12T01:29:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.908+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7335076584941709233', time=2024-09-12T03:17:51.982636+0000, chain.objs.size()=1 2024-09-12T01:29:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.908+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:6mLjAGc70y2Yslf0TBHUN1HPce4yFWK_.Gy8sgyLYyrj9PWL0NtU8FAbBWn57QTB_0 2024-09-12T01:29:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.909+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4926884340865617346', time=2024-09-12T03:18:44.301082+0000, chain.objs.size()=4 2024-09-12T01:29:14.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.909+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.578__multipart_testobj.2~neX_eax-7sZ5nNWlCvBwcCJrHq_uzZW.1 2024-09-12T01:29:14.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.910+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.578__multipart_testobj.2~neX_eax-7sZ5nNWlCvBwcCJrHq_uzZW.2 2024-09-12T01:29:14.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.910+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.578__multipart_testobj.2~neX_eax-7sZ5nNWlCvBwcCJrHq_uzZW.3 2024-09-12T01:29:14.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.910+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.578__multipart_testobj.2~neX_eax-7sZ5nNWlCvBwcCJrHq_uzZW.4 2024-09-12T01:29:14.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.910+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7869309353537046631', time=2024-09-12T03:18:50.835912+0000, chain.objs.size()=1 2024-09-12T01:29:14.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.910+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.580__shadow:qBjm8H6GQVkifIdHZzda0fx6yJ5oPVA_.EdKAH6RD_uXevISjCs_sAFmq9cxyJHv_0 2024-09-12T01:29:14.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.910+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10062679971814880025', time=2024-09-12T03:19:01.482849+0000, chain.objs.size()=1 2024-09-12T01:29:14.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.910+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.596__shadow_.ngENLDBYa7mrpzzCDfz28sEhppG74SL_0 2024-09-12T01:29:14.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.911+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.393828042204367630', time=2024-09-12T03:21:17.211014+0000, chain.objs.size()=1 2024-09-12T01:29:14.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.911+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.617__shadow_.52g_b3-DB37jz2YzDQS5K-i94iycc6a_0 2024-09-12T01:29:14.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.911+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6660019133356781587', time=2024-09-12T03:22:41.270360+0000, chain.objs.size()=6 2024-09-12T01:29:14.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.911+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.623__multipart_multipart_enc.2~8UW_HPFnygDE6oCi2ep4tHKQYvu8yX0.1 2024-09-12T01:29:14.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.911+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.623__multipart_multipart_enc.2~8UW_HPFnygDE6oCi2ep4tHKQYvu8yX0.2 2024-09-12T01:29:14.912 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.911+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.623__multipart_multipart_enc.2~8UW_HPFnygDE6oCi2ep4tHKQYvu8yX0.3 2024-09-12T01:29:14.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.912+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.623__multipart_multipart_enc.2~8UW_HPFnygDE6oCi2ep4tHKQYvu8yX0.4 2024-09-12T01:29:14.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.913+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.623__multipart_multipart_enc.2~8UW_HPFnygDE6oCi2ep4tHKQYvu8yX0.5 2024-09-12T01:29:14.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.914+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.623__multipart_multipart_enc.2~8UW_HPFnygDE6oCi2ep4tHKQYvu8yX0.6 2024-09-12T01:29:14.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.914+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5928090823146853743', time=2024-09-12T03:23:12.479954+0000, chain.objs.size()=2 2024-09-12T01:29:14.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.914+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.646__shadow_.DXsGMnZsTkQWlyG-SYyYN41Q2NIp61v_0 2024-09-12T01:29:14.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.914+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.646__shadow_.DXsGMnZsTkQWlyG-SYyYN41Q2NIp61v_1 2024-09-12T01:29:14.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.915+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8731483211891815774', time=2024-09-12T03:23:44.036946+0000, chain.objs.size()=1 2024-09-12T01:29:14.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.915+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.666__shadow_.LVUYFWP-ewWs2oEdnJEWvQTmQrIA0JR_0 2024-09-12T01:29:14.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.915+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14703153289651576561', time=2024-09-12T03:23:44.932056+0000, chain.objs.size()=1 2024-09-12T01:29:14.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.915+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.668__shadow_.ARXbivFJQkXHVwWW3w5yLu6kEE4N9co_0 2024-09-12T01:29:14.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.915+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9051423896088131295', time=2024-09-12T03:23:57.589150+0000, chain.objs.size()=1 2024-09-12T01:29:14.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.915+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.693__shadow:WqWBYvti6n0QQIqm5m.Ud25EB.ZkR8d_.F4Me0n62uqCLef91cWtQ-Q_b3xjIDXi_0 2024-09-12T01:29:14.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.915+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2866711345115529285', time=2024-09-12T03:24:05.464458+0000, chain.objs.size()=1 2024-09-12T01:29:14.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.915+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.705__shadow:pJKYjIuv8I6mMoSbc0pSoWBrDlS6Poa_.o8osT-6aPwH0sZRIxFHs2qUUSxTDf-T_0 2024-09-12T01:29:14.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.915+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~rxmCuml6MJp39w6ojSoFW85GyWj4cFt', time=2024-09-12T03:24:53.685899+0000, chain.objs.size()=1 2024-09-12T01:29:14.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.915+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.742__multipart_mymultipart.2~rxmCuml6MJp39w6ojSoFW85GyWj4cFt.1 2024-09-12T01:29:14.920 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.920+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:14.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.923+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:29:14.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.925+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:14.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.925+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:14.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44378' 2024-09-12T01:29:14.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1796628237568538651', time=2024-09-12T03:06:35.367760+0000, chain.objs.size()=1 2024-09-12T01:29:14.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.157__shadow:lGblokkfHAgc6MEhHvYSqa7dW0KrEqW_.Y0Cb18FpT3C7L5_ghAOTKBcIEf-Lkc6_0 2024-09-12T01:29:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1418502798134998530', time=2024-09-12T03:07:07.625514+0000, chain.objs.size()=1 2024-09-12T01:29:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.179__shadow_.XLrXpfANfI-qOToDfthTGcMHMNds7TC_0 2024-09-12T01:29:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4658286432512839215', time=2024-09-12T03:09:07.292223+0000, chain.objs.size()=1 2024-09-12T01:29:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.249__shadow_.8ANJx8tZXh-nsbVXbiRxl5rB8JdmHyw_0 2024-09-12T01:29:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10731120841358683241', time=2024-09-12T03:09:54.427295+0000, chain.objs.size()=1 2024-09-12T01:29:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.HYPIp3yq612_2jMiUb5HNmwzxEI63q0_0 2024-09-12T01:29:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.153493425970261671', time=2024-09-12T03:09:54.693199+0000, chain.objs.size()=1 2024-09-12T01:29:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.oaQ2V2oyIlEB9c-CfffgVslTJoRNPQ3_0 2024-09-12T01:29:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8061790471991355349', time=2024-09-12T03:09:54.693870+0000, chain.objs.size()=1 2024-09-12T01:29:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Xetko0TZexqCKb3-yRpFNC7PmkEAyAn_0 2024-09-12T01:29:14.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14860683035066006495', time=2024-09-12T03:09:54.789683+0000, chain.objs.size()=1 2024-09-12T01:29:14.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.73noG6df2Zj9_RU7Juzb5eOtlB2I-Nd_0 2024-09-12T01:29:14.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9940482559578223328', time=2024-09-12T03:09:54.983656+0000, chain.objs.size()=1 2024-09-12T01:29:14.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ZEVbeyjvWwJxTiDK14bhBhJugiCDxYX_0 2024-09-12T01:29:14.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1922181705530849995', time=2024-09-12T03:09:55.186803+0000, chain.objs.size()=1 2024-09-12T01:29:14.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.nFzaSMHImeG4_8tHBH3sUpoh9yoMEsh_0 2024-09-12T01:29:14.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12860628438321149124', time=2024-09-12T03:09:55.327850+0000, chain.objs.size()=1 2024-09-12T01:29:14.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.J2D3G7t_fIHWeSTcKDCIyDRk-LY4lKJ_0 2024-09-12T01:29:14.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2310334823167762777', time=2024-09-12T03:09:56.050326+0000, chain.objs.size()=1 2024-09-12T01:29:14.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.TfytZJsJQP-7tk44siOaMLDLDKLRuHj_0 2024-09-12T01:29:14.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9770564470317303793', time=2024-09-12T03:09:57.172964+0000, chain.objs.size()=1 2024-09-12T01:29:14.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.926+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.LSlm12uJepcsy0Now8WGd1fLqaLZJiw_0 2024-09-12T01:29:14.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2255840044944147959', time=2024-09-12T03:09:58.183349+0000, chain.objs.size()=1 2024-09-12T01:29:14.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.jj7iO7um3gDMNRHNibDExYp1wIFc3OA_0 2024-09-12T01:29:14.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11208063928610672757', time=2024-09-12T03:09:58.451208+0000, chain.objs.size()=1 2024-09-12T01:29:14.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.GR-tnvpKJHWhE56G0nXD5Nj02gE0mtn_0 2024-09-12T01:29:14.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7751032220557580342', time=2024-09-12T03:09:58.575256+0000, chain.objs.size()=1 2024-09-12T01:29:14.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.5_3XoZAnXU0bs0u2tcBfbuYdsDk9bkD_0 2024-09-12T01:29:14.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11778724234139859280', time=2024-09-12T03:09:58.753717+0000, chain.objs.size()=1 2024-09-12T01:29:14.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dE9Bq1WJ_ztoH277T4nNCxMprUHsaX9_0 2024-09-12T01:29:14.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6784121032747793993', time=2024-09-12T03:09:58.754647+0000, chain.objs.size()=1 2024-09-12T01:29:14.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8cmL-fjMB_3DjhwT3VnIEmTFaCQiojO_0 2024-09-12T01:29:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.313202433369525923', time=2024-09-12T03:09:59.411820+0000, chain.objs.size()=1 2024-09-12T01:29:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0PXw8Bo790av5ChYNzgDSW1s29VbtqN_0 2024-09-12T01:29:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4511200282452033522', time=2024-09-12T03:09:59.834284+0000, chain.objs.size()=1 2024-09-12T01:29:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.2VUX9y4MlErb2apNS5ZgR5GS1JCzthM_0 2024-09-12T01:29:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1809177731996538631', time=2024-09-12T03:09:59.902811+0000, chain.objs.size()=1 2024-09-12T01:29:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.heECVigLTtwwkF_B_GsRFk53345UbAZ_0 2024-09-12T01:29:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7102085958544719641', time=2024-09-12T03:10:00.369900+0000, chain.objs.size()=1 2024-09-12T01:29:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.r4UjbmR-wHRVCcJQx9rT91zIP_A32b4_0 2024-09-12T01:29:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2877371144372293820', time=2024-09-12T03:10:00.411961+0000, chain.objs.size()=1 2024-09-12T01:29:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.vvKBwmRfHn2zpB44VwtceDhlPFZxflU_0 2024-09-12T01:29:14.932 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8225876439651677242', time=2024-09-12T03:10:00.497912+0000, chain.objs.size()=1 2024-09-12T01:29:14.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.930+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lsr-q_DkGAWuguDk-0oRJ52OLdQSWYU_0 2024-09-12T01:29:14.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13420847448469696568', time=2024-09-12T03:10:00.648270+0000, chain.objs.size()=1 2024-09-12T01:29:14.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.cWuQ02Avqdzh2bc4DSJf4cnd9GZTQFL_0 2024-09-12T01:29:14.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3485241106500379292', time=2024-09-12T03:10:02.855820+0000, chain.objs.size()=1 2024-09-12T01:29:14.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.aOjwYp9XUs6u3n7-OTuJCcvRWig0o6I_0 2024-09-12T01:29:14.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9444108937618823811', time=2024-09-12T03:10:03.058358+0000, chain.objs.size()=1 2024-09-12T01:29:14.934 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.W1lb0a7ruBgIC_lVw9DHxE2jqqgCA0a_0 2024-09-12T01:29:14.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12639047279966611802', time=2024-09-12T03:10:03.105761+0000, chain.objs.size()=1 2024-09-12T01:29:14.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.GE0Ap3AmuNoQJ21Xg7D9z5AvacXCN-Y_0 2024-09-12T01:29:14.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2142739740982016374', time=2024-09-12T03:10:03.542434+0000, chain.objs.size()=1 2024-09-12T01:29:14.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.pRCRpsWe-OcYqlXDq3NBBbjyQegIPxI_0 2024-09-12T01:29:14.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17185227651834598431', time=2024-09-12T03:10:03.735964+0000, chain.objs.size()=1 2024-09-12T01:29:14.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.tdIqkfHGdv_mcx5cgRqV-QLbHz0mjY5_0 2024-09-12T01:29:14.935 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15889699671837812087', time=2024-09-12T03:10:03.824817+0000, chain.objs.size()=1 2024-09-12T01:29:14.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.VPVi3zFQfohZXCIc6anAVQolAI4chyJ_0 2024-09-12T01:29:14.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6758199937768326155', time=2024-09-12T03:10:04.366287+0000, chain.objs.size()=1 2024-09-12T01:29:14.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.43csvyJcjQDBrfGTIjkBAuFe-qPnhKT_0 2024-09-12T01:29:14.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6069510632199515228', time=2024-09-12T03:10:04.827950+0000, chain.objs.size()=1 2024-09-12T01:29:14.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.cpYrzVw-g8cWEnlASKpM_m1do8vWtO3_0 2024-09-12T01:29:14.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17381413794838191102', time=2024-09-12T03:10:04.902744+0000, chain.objs.size()=1 2024-09-12T01:29:14.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.934+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.6Aifq7WtrsaPtSTzeftQpH01EpJUV14_0 2024-09-12T01:29:14.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.935+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8792611805847707153', time=2024-09-12T03:10:05.728837+0000, chain.objs.size()=1 2024-09-12T01:29:14.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.935+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.eueKpHPgHcY0wO5FCvr6fpwqjZtycuJ_0 2024-09-12T01:29:14.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.937+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7743014100263210515', time=2024-09-12T03:10:05.862600+0000, chain.objs.size()=1 2024-09-12T01:29:14.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.937+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.UdAr1Q4RzCAQQgapkyxHW4hsy5xyVUz_0 2024-09-12T01:29:14.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.938+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4914521547979517539', time=2024-09-12T03:10:05.908651+0000, chain.objs.size()=1 2024-09-12T01:29:14.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.938+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.JweKliRM_L0LkJqNChJ0UgZikIjmQxv_0 2024-09-12T01:29:14.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.938+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1696032495882428927', time=2024-09-12T03:10:06.103149+0000, chain.objs.size()=1 2024-09-12T01:29:14.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.938+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.6LfujFVRwkqsc2gkcoLJf6qGbwQQFfJ_0 2024-09-12T01:29:14.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.938+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3963352440441369391', time=2024-09-12T03:10:06.306006+0000, chain.objs.size()=1 2024-09-12T01:29:14.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.938+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QgYyRR-fPTNStQSyeEdCxqSO3lZ_qZb_0 2024-09-12T01:29:14.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.938+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8817178315523833986', time=2024-09-12T03:10:06.387304+0000, chain.objs.size()=1 2024-09-12T01:29:14.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.938+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.KKwSKptzJFAXHwcHHUCaSRxeq26ApJ2_0 2024-09-12T01:29:14.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.938+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5129127315622225479', time=2024-09-12T03:10:06.422523+0000, chain.objs.size()=1 2024-09-12T01:29:14.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.938+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._LNqRK3xx9FaQFguxm3Dj2wXudxR03y_0 2024-09-12T01:29:14.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.939+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16974888617549679742', time=2024-09-12T03:10:06.588630+0000, chain.objs.size()=1 2024-09-12T01:29:14.939 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.939+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.6yRS7tVl7P9JIcqcoOJculRUvckhdrV_0 2024-09-12T01:29:14.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.939+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8945492474776161651', time=2024-09-12T03:10:06.589669+0000, chain.objs.size()=1 2024-09-12T01:29:14.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.939+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.sYS687NEbfjAtVfE5BOnX5aL4vH6YX8_0 2024-09-12T01:29:14.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.939+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14648647363753110220', time=2024-09-12T03:10:13.274913+0000, chain.objs.size()=1 2024-09-12T01:29:14.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.939+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.273__shadow_.3rDtE5LUkmXFZmyqU2kgqthGOyqg-kC_0 2024-09-12T01:29:14.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.940+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14777434746205277771', time=2024-09-12T03:10:16.447516+0000, chain.objs.size()=1 2024-09-12T01:29:14.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.940+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.278__shadow_.Of1q7V0tMZjXA2HIlzGs7dJ5hY6V1Jq_0 2024-09-12T01:29:14.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.940+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9380015526012340296', time=2024-09-12T03:10:27.036467+0000, chain.objs.size()=1 2024-09-12T01:29:14.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.940+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.D5b31kQ18b6ZXak7-CZ2hhj45msJpBn_0 2024-09-12T01:29:14.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.940+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10086548666251274067', time=2024-09-12T03:10:29.105581+0000, chain.objs.size()=1 2024-09-12T01:29:14.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.940+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.CQmp1heFbDW1A6ngGXTg8ov45nAuLQx_0 2024-09-12T01:29:14.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.941+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13446193941047905684', time=2024-09-12T03:10:31.830488+0000, chain.objs.size()=1 2024-09-12T01:29:14.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.941+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.297__shadow_.Hnh-PY6Z0nrSXHFXsxo9LbPSqRwCv2W_0 2024-09-12T01:29:14.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.941+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17476273869906566485', time=2024-09-12T03:11:29.299793+0000, chain.objs.size()=1 2024-09-12T01:29:14.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.941+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.cGpxUVNBaQ0xc1sO4GwDkm62gCPqTd__0 2024-09-12T01:29:14.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.942+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6479971329555931937', time=2024-09-12T03:11:29.435524+0000, chain.objs.size()=1 2024-09-12T01:29:14.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.942+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.IpUiOOz_W6XwA_AIPWI-gO92CV3EZMH_0 2024-09-12T01:29:14.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.942+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11829633354479403309', time=2024-09-12T03:11:29.655513+0000, chain.objs.size()=1 2024-09-12T01:29:14.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.942+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.9nPNSsVw03Dy9giFVAP0dPdVIjlkwW3_0 2024-09-12T01:29:14.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.942+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12174096662032588155', time=2024-09-12T03:11:29.805477+0000, chain.objs.size()=1 2024-09-12T01:29:14.942 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.942+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.A42LAwxKLFItUsslVrqoVY5cBnLwf0k_0 2024-09-12T01:29:14.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.943+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12299942937386681949', time=2024-09-12T03:11:29.806810+0000, chain.objs.size()=1 2024-09-12T01:29:14.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.943+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.vNRdGJkLp35vfDXp1XnRvguw4BQq_ht_0 2024-09-12T01:29:14.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.943+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2102147195639319349', time=2024-09-12T03:11:31.107760+0000, chain.objs.size()=1 2024-09-12T01:29:14.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.943+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.R1ug3GqWH12n2ezxY6zTWdAvNjdKQOO_0 2024-09-12T01:29:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.943+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10752634168035594700', time=2024-09-12T03:11:31.655681+0000, chain.objs.size()=1 2024-09-12T01:29:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.943+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.RNshJWIjJVbZj2eeEmZq_c-jgg_E20k_0 2024-09-12T01:29:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.944+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12346037123337747187', time=2024-09-12T03:11:31.909094+0000, chain.objs.size()=1 2024-09-12T01:29:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.944+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.L6b31GW0xLy3O5IBcCSySOM4g0lT-n6_0 2024-09-12T01:29:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.944+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10695973352134918332', time=2024-09-12T03:11:32.340041+0000, chain.objs.size()=1 2024-09-12T01:29:14.944 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.944+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.y4-rrrT4jBXJuKgES1YJr77wKBRoar__0 2024-09-12T01:29:14.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.944+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8540284808343153898', time=2024-09-12T03:11:32.865208+0000, chain.objs.size()=1 2024-09-12T01:29:14.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.944+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mrcHvhTx9T16iqpuutKFQRWkLBgMwAS_0 2024-09-12T01:29:14.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.944+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10540418110979613719', time=2024-09-12T03:11:33.498657+0000, chain.objs.size()=1 2024-09-12T01:29:14.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.944+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Zmw89fwN57azVeQJu997GIeTFu0NQ_7_0 2024-09-12T01:29:14.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.944+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1778597817321540096', time=2024-09-12T03:11:33.699534+0000, chain.objs.size()=1 2024-09-12T01:29:14.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.944+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.yNUQSY88Ofw0YULL4PvhZ5Qc60_P_oo_0 2024-09-12T01:29:14.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.945+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3611007303710081169', time=2024-09-12T03:11:33.769470+0000, chain.objs.size()=1 2024-09-12T01:29:14.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.945+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.KECegI1WpOUEI5DE2_-Tbyfyky83roG_0 2024-09-12T01:29:14.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.945+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8325824585396147580', time=2024-09-12T03:11:33.888159+0000, chain.objs.size()=1 2024-09-12T01:29:14.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.945+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-vT0ioiljIVpoXf203LSXseOsWHEjqc_0 2024-09-12T01:29:14.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.945+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.756255231850515279', time=2024-09-12T03:11:34.947706+0000, chain.objs.size()=1 2024-09-12T01:29:14.946 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.945+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qf1DwWkZFzgTvgYkk4zqjEOZTejOVLx_0 2024-09-12T01:29:14.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.947+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2948777188014262190', time=2024-09-12T03:11:35.273207+0000, chain.objs.size()=1 2024-09-12T01:29:14.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.947+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.HB01uwgBMDjzK89uH0dGA6rCA5hhbl2_0 2024-09-12T01:29:14.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.947+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6528110028280907102', time=2024-09-12T03:11:36.436738+0000, chain.objs.size()=1 2024-09-12T01:29:14.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.947+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.hJH70WuZBXKV7o2I3OaxBEzEvSH7WiJ_0 2024-09-12T01:29:14.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.948+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18078659757979989284', time=2024-09-12T03:11:36.769622+0000, chain.objs.size()=1 2024-09-12T01:29:14.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.948+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mS14xoap5As-slvpSgnLQ4Y9ki2NdVk_0 2024-09-12T01:29:14.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.948+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6278889804649407448', time=2024-09-12T03:11:37.672679+0000, chain.objs.size()=1 2024-09-12T01:29:14.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.948+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.LXgzjNz_Dgfby7gPrN1RnKsV8SCvUDm_0 2024-09-12T01:29:14.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.948+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2134624139199583518', time=2024-09-12T03:11:37.945975+0000, chain.objs.size()=1 2024-09-12T01:29:14.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.948+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.lHqBnkqI00LIwQyhi0fxL_JIuBOdurF_0 2024-09-12T01:29:14.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.948+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13324846803698158866', time=2024-09-12T03:11:38.169341+0000, chain.objs.size()=1 2024-09-12T01:29:14.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.948+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.oiFpqoAQVWxszEw43exII9oStU3MgWf_0 2024-09-12T01:29:14.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.948+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12306271743629585308', time=2024-09-12T03:11:38.344942+0000, chain.objs.size()=1 2024-09-12T01:29:14.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.948+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.bVTLuLwtPwWPfGaIzaXdIPfZNB58DNM_0 2024-09-12T01:29:14.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.948+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11483617354706088208', time=2024-09-12T03:11:38.423801+0000, chain.objs.size()=1 2024-09-12T01:29:14.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.948+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.dlKfpEWOGms14K_I9rFhpc5dOlksZ4u_0 2024-09-12T01:29:14.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.948+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13761439044635936054', time=2024-09-12T03:11:38.558368+0000, chain.objs.size()=1 2024-09-12T01:29:14.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.948+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fstluffnc_iAvaWB0sqxtMCNsNRmVq2_0 2024-09-12T01:29:14.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.950+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10706385177366857698', time=2024-09-12T03:11:38.589776+0000, chain.objs.size()=1 2024-09-12T01:29:14.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.950+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.3SePHKqaMuj-fqC5zNbSrY9_FOGbqmP_0 2024-09-12T01:29:14.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.950+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8599728986696128908', time=2024-09-12T03:11:39.192647+0000, chain.objs.size()=1 2024-09-12T01:29:14.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.950+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.KtqCavkjdeQI2hVnZCibUnbtUfPa205_0 2024-09-12T01:29:14.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.950+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6904582424945648731', time=2024-09-12T03:11:39.344207+0000, chain.objs.size()=1 2024-09-12T01:29:14.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.950+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.HOB-X7glV1XQHnP1YvEkF_pM0JfRuyp_0 2024-09-12T01:29:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.952+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3962348707319571779', time=2024-09-12T03:11:39.508980+0000, chain.objs.size()=1 2024-09-12T01:29:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.952+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qpyIcyAwMSPkiKZCfPsYxzzpj9Xc-VK_0 2024-09-12T01:29:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.952+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8454502627862750636', time=2024-09-12T03:11:40.000719+0000, chain.objs.size()=1 2024-09-12T01:29:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.952+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.lP2fDENUsxqSzI380NMIyx6_G2dyBj-_0 2024-09-12T01:29:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.952+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4345050513168749662', time=2024-09-12T03:11:41.168017+0000, chain.objs.size()=1 2024-09-12T01:29:14.952 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.952+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.FQi62jOl_FFrgeH9PjDL9M9mLY-pqKo_0 2024-09-12T01:29:14.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.953+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1740750393890591948', time=2024-09-12T03:11:41.341029+0000, chain.objs.size()=1 2024-09-12T01:29:14.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.953+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.YAnunwEcYlb995Kk423AMl_UqUTvsqQ_0 2024-09-12T01:29:14.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.953+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17148069702751623622', time=2024-09-12T03:11:41.342005+0000, chain.objs.size()=1 2024-09-12T01:29:14.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.953+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.YCTBAE2Dzme2NwJxOuVzldDYXJOhxlz_0 2024-09-12T01:29:14.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.953+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11844262703096251431', time=2024-09-12T03:12:21.917692+0000, chain.objs.size()=1 2024-09-12T01:29:14.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.953+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.yXmQcdHkxLIw4Azqb-OqNhfs2SlzID4_0 2024-09-12T01:29:14.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.953+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2343682636144297901', time=2024-09-12T03:12:22.579652+0000, chain.objs.size()=1 2024-09-12T01:29:14.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.953+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.BhiDemWE3Gh8kGnYh5oaaze5Ujab8h3_0 2024-09-12T01:29:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.954+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8211770628022799149', time=2024-09-12T03:12:24.193556+0000, chain.objs.size()=1 2024-09-12T01:29:14.955 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.954+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.PM5oTcUf-B06XP9uaFV9gSF4DDqroZY_0 2024-09-12T01:29:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.955+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1745183414650975154', time=2024-09-12T03:12:24.291829+0000, chain.objs.size()=1 2024-09-12T01:29:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.955+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ukrl1cvaDcdDGnKInsbRI22-KpTRoQx_0 2024-09-12T01:29:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.955+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6871798968645694260', time=2024-09-12T03:12:24.550321+0000, chain.objs.size()=1 2024-09-12T01:29:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.955+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.lEpZzuIWZxutN9lx7tx166YGoCCNexn_0 2024-09-12T01:29:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.955+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11818051467920580575', time=2024-09-12T03:12:24.634315+0000, chain.objs.size()=1 2024-09-12T01:29:14.956 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.955+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.QXEXXz84sENvR9SAMChFNt3-SmTvtvR_0 2024-09-12T01:29:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.956+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5288673903267228435', time=2024-09-12T03:12:25.417364+0000, chain.objs.size()=1 2024-09-12T01:29:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.956+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.oaj_dnDke_7bZOdWPc3NGMCmpbuBa1B_0 2024-09-12T01:29:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.956+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15571887295883065747', time=2024-09-12T03:12:25.827163+0000, chain.objs.size()=1 2024-09-12T01:29:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.956+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.HRcAkntam25i6kohPiAcSvK3zpQs6aU_0 2024-09-12T01:29:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.956+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17979461978958853906', time=2024-09-12T03:12:26.537152+0000, chain.objs.size()=1 2024-09-12T01:29:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.956+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.FygezsKLQu7rVbsFBSmlHIov_ecdaP4_0 2024-09-12T01:29:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.956+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10688567492809751035', time=2024-09-12T03:12:26.570433+0000, chain.objs.size()=1 2024-09-12T01:29:14.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.956+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RMKI7Sv2tRjnzlGhEtaQQPAkbZMWnwf_0 2024-09-12T01:29:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.956+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11413187300627548337', time=2024-09-12T03:12:28.790316+0000, chain.objs.size()=1 2024-09-12T01:29:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.956+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Ly5vTZD5g7EUu-I72sn3K443W2iTGDz_0 2024-09-12T01:29:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.957+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7713488303365654684', time=2024-09-12T03:12:29.914102+0000, chain.objs.size()=1 2024-09-12T01:29:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.957+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Mfl4uD9qagyu2FGMiyM3D8Yr6_vMLP-_0 2024-09-12T01:29:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.957+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11249098285664083637', time=2024-09-12T03:12:30.351429+0000, chain.objs.size()=1 2024-09-12T01:29:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.957+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ora9SSaHyKIW01MWEGEZsXgNfBs2WCp_0 2024-09-12T01:29:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.957+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2446342364138425356', time=2024-09-12T03:12:31.061128+0000, chain.objs.size()=1 2024-09-12T01:29:14.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.957+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gC45RnJcIRAAk1MEHPCGKQhgr6-OtXj_0 2024-09-12T01:29:14.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.959+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5324180531876768058', time=2024-09-12T03:12:31.286560+0000, chain.objs.size()=1 2024-09-12T01:29:14.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.959+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.LQ5UDa32z1jJbvJq7A-CwvmpM1Osliq_0 2024-09-12T01:29:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.959+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10292462017784857451', time=2024-09-12T03:12:31.528186+0000, chain.objs.size()=1 2024-09-12T01:29:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.959+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.iWO2expktvVZpk7Z_QZI8beEHqRYSGN_0 2024-09-12T01:29:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.959+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11115258498223327749', time=2024-09-12T03:12:31.991758+0000, chain.objs.size()=1 2024-09-12T01:29:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.959+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mxQJo78ZHJQF0jl9_ZoEM4GeMaMeSqA_0 2024-09-12T01:29:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.959+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12913615460771629518', time=2024-09-12T03:12:32.637660+0000, chain.objs.size()=1 2024-09-12T01:29:14.960 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.959+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.V-duMO_7VVic1Q3zi8g3rtpHSciULli_0 2024-09-12T01:29:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.961+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9345043674408141704', time=2024-09-12T03:12:32.756613+0000, chain.objs.size()=1 2024-09-12T01:29:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.961+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.C9GSZCWvflkvtZaHvirlNFwJTgYB40X_0 2024-09-12T01:29:14.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.962+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3011512883261761032', time=2024-09-12T03:12:33.013009+0000, chain.objs.size()=1 2024-09-12T01:29:14.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.962+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.lvYl65fXDDK7h2p-r0UZcjsuPzApgLn_0 2024-09-12T01:29:14.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.962+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7212454869565515184', time=2024-09-12T03:12:34.165027+0000, chain.objs.size()=1 2024-09-12T01:29:14.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.962+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.YXqsjAEDMpc4Jin1WkbZS2dclRuIIeg_0 2024-09-12T01:29:14.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.964+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/44378 2024-09-12T01:29:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-12T01:29:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1860798143141158026', time=2024-09-12T03:12:34.291481+0000, chain.objs.size()=1 2024-09-12T01:29:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.yS4MpplATmUOH7ZxPvQJwUI7m9TPhdJ_0 2024-09-12T01:29:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9032896456188756355', time=2024-09-12T03:12:34.326102+0000, chain.objs.size()=1 2024-09-12T01:29:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.EuqKZgVoiz1DEZMjoPafpuvnaNfGZjm_0 2024-09-12T01:29:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17303538103283593015', time=2024-09-12T03:12:38.736236+0000, chain.objs.size()=1 2024-09-12T01:29:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.332__shadow_.fXBIAt60JlP36G-HcIbn8kerLI4OCZ__0 2024-09-12T01:29:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8197080028398013755', time=2024-09-12T03:12:56.745192+0000, chain.objs.size()=1 2024-09-12T01:29:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.369__shadow_.UgQPS8poFm0-LmbSkaGx0l3Av6pGUbL_0 2024-09-12T01:29:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4993664187491453348', time=2024-09-12T03:12:57.814125+0000, chain.objs.size()=1 2024-09-12T01:29:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.371__shadow_.l0bowPWZUt1QyLgqduxLxPYLDLLxNnx_0 2024-09-12T01:29:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7826667873717006952', time=2024-09-12T03:12:58.930323+0000, chain.objs.size()=1 2024-09-12T01:29:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.373__shadow_.lO8Q8er-rENnEepC9dxmhWKnqfcjMCq_0 2024-09-12T01:29:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1542761192326539211', time=2024-09-12T03:13:01.647544+0000, chain.objs.size()=1 2024-09-12T01:29:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.376__shadow_.tBQkQJd4bSaJepgin3Bo_MbOAnmfYQ3_0 2024-09-12T01:29:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1800431789438606244', time=2024-09-12T03:13:03.495149+0000, chain.objs.size()=1 2024-09-12T01:29:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.379__shadow_.fiqkFrQOfY7zhYQ5Zo4ZP79EHEOTjGH_0 2024-09-12T01:29:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.392287150499226610', time=2024-09-12T03:13:48.092944+0000, chain.objs.size()=1 2024-09-12T01:29:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.455__shadow_.X833Eg5HgPmxyOyX5rX39cSzeQDTBpJ_0 2024-09-12T01:29:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10643848746538909079', time=2024-09-12T03:14:14.340824+0000, chain.objs.size()=1 2024-09-12T01:29:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.495__shadow_.tpywbIngLAObbeuIR3AAZsAJdh6GTLP_0 2024-09-12T01:29:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15167931310826675339', time=2024-09-12T03:14:29.289212+0000, chain.objs.size()=6 2024-09-12T01:29:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.1 2024-09-12T01:29:14.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.968+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.2 2024-09-12T01:29:14.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.971+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.3 2024-09-12T01:29:14.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.971+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.4 2024-09-12T01:29:14.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.971+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.5 2024-09-12T01:29:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.971+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.6 2024-09-12T01:29:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.971+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10300167878628324748', time=2024-09-12T03:14:40.462648+0000, chain.objs.size()=2 2024-09-12T01:29:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.971+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.517__shadow_.beUKyIgUL6QtIKAxQrnEJjXF4Tjw3Hv_0 2024-09-12T01:29:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.971+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.517__shadow_.beUKyIgUL6QtIKAxQrnEJjXF4Tjw3Hv_1 2024-09-12T01:29:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.971+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12974553644452338393', time=2024-09-12T03:16:01.331206+0000, chain.objs.size()=3 2024-09-12T01:29:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.971+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.523__multipart_mymultipart.2~DUFMqwbRwnU0zqXaN14wqelGJcRdr1F.1 2024-09-12T01:29:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.973+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.523__multipart_mymultipart.2~DUFMqwbRwnU0zqXaN14wqelGJcRdr1F.2 2024-09-12T01:29:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.973+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.523__multipart_mymultipart.2~DUFMqwbRwnU0zqXaN14wqelGJcRdr1F.3 2024-09-12T01:29:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.973+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16257893632498255329', time=2024-09-12T03:16:17.333480+0000, chain.objs.size()=1 2024-09-12T01:29:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.973+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.524__shadow_.wHEhUxzfRqFKCFdakw2H8mU0nApQfsi_0 2024-09-12T01:29:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.973+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18428378125844527977', time=2024-09-12T03:17:57.422979+0000, chain.objs.size()=1 2024-09-12T01:29:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.973+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.570__shadow:HKdzwh1obEipp6RNWxVzsVrjNZqTxpD_.LFz3K-nH1u25erjbGK14ke379TZQspY_0 2024-09-12T01:29:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.975+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9735464881091143049', time=2024-09-12T03:18:23.914445+0000, chain.objs.size()=1 2024-09-12T01:29:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.975+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:xaiBYoRop3.9DreggUiF7BBB2BeEKWe_.GmWHVFs7Aw1Qzp9UNFneWAlxx2W4O0G_0 2024-09-12T01:29:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.975+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9397601076507963118', time=2024-09-12T03:18:26.082422+0000, chain.objs.size()=1 2024-09-12T01:29:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.975+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:pgiwNRBwPvtgRF5xyGfZNDYBsjzmyz6_.7o4-3U2dmx0VAeRuKBUwlEZvRS2MIec_0 2024-09-12T01:29:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.975+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1298965698722167222', time=2024-09-12T03:22:19.913453+0000, chain.objs.size()=1 2024-09-12T01:29:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.975+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.620__shadow_.auV3lVztNpSnWxkoecE9LxKdwrBP6HF_0 2024-09-12T01:29:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.976+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6845394784849305454', time=2024-09-12T03:22:57.463594+0000, chain.objs.size()=1 2024-09-12T01:29:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.976+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.629__shadow_.tTYmKh6fsZfs6YEPkzhyILrRKle_p7P_0 2024-09-12T01:29:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.976+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9037506248448945062', time=2024-09-12T03:22:59.127006+0000, chain.objs.size()=1 2024-09-12T01:29:14.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.976+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.632__shadow_.oe5n7hv9y36GkxlTV6eHhbsNIlFE8Ao_0 2024-09-12T01:29:14.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.977+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16564470245279708016', time=2024-09-12T03:24:06.641029+0000, chain.objs.size()=1 2024-09-12T01:29:14.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.977+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.707__shadow:nNHVk06-smwR1-jKiUHA4vNBy54Mtww_.C_SF5osofQZqhEnxwj_ntah_oJ147Y8_0 2024-09-12T01:29:14.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.977+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16124235860753411168', time=2024-09-12T03:28:50.023176+0000, chain.objs.size()=1 2024-09-12T01:29:14.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.977+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.782__shadow_.4HmmpqRSLCqTcwdrW2UkGlroHko8POD_0 2024-09-12T01:29:14.981 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.981+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:14.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.983+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:29:14.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.985+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:14.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.985+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:14.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46353' 2024-09-12T01:29:14.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3917926127131220765', time=2024-09-12T03:07:09.550718+0000, chain.objs.size()=1 2024-09-12T01:29:14.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.183__shadow_.FEsrn_oZhfvXStsDzztD9Uxf9oaX6QF_0 2024-09-12T01:29:14.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13067987132822201393', time=2024-09-12T03:09:04.079663+0000, chain.objs.size()=1 2024-09-12T01:29:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.244__shadow_.XVAAlxWOXWEFXYFJrcrJQ4K-eDDgMhu_0 2024-09-12T01:29:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1009522089370875761', time=2024-09-12T03:09:06.657131+0000, chain.objs.size()=1 2024-09-12T01:29:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.248__shadow_.ToIK9Nvf28j--aXsas7pjDMLRt2EOfx_0 2024-09-12T01:29:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16964916119370446916', time=2024-09-12T03:09:10.551029+0000, chain.objs.size()=1 2024-09-12T01:29:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.254__shadow_.izEnJwtXoUG7fXfH95JO6HyPixzEtpR_0 2024-09-12T01:29:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3068083575010909543', time=2024-09-12T03:09:10.555741+0000, chain.objs.size()=1 2024-09-12T01:29:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.254__shadow_.UEnVTP98U8Hh8EtdCb1-tHvtrkhFwdv_0 2024-09-12T01:29:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6830234990735530002', time=2024-09-12T03:09:54.574912+0000, chain.objs.size()=1 2024-09-12T01:29:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Jg_-BqkusDO9_DlaHJRU4ZHwqQdgwX-_0 2024-09-12T01:29:14.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1414308744782540611', time=2024-09-12T03:09:54.704164+0000, chain.objs.size()=1 2024-09-12T01:29:14.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dvi8goHeM9Zq41om1bwyLwhJg_D72NI_0 2024-09-12T01:29:14.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6699342162331599102', time=2024-09-12T03:09:55.107023+0000, chain.objs.size()=1 2024-09-12T01:29:14.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.76PhgOectLQECsmXM4yDce5c688un1e_0 2024-09-12T01:29:14.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6128723157531107869', time=2024-09-12T03:09:55.464817+0000, chain.objs.size()=1 2024-09-12T01:29:14.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.sHEo3G7VM3d-EpTwVjI40E1WBh_8z8P_0 2024-09-12T01:29:14.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15890021726038263944', time=2024-09-12T03:09:56.205564+0000, chain.objs.size()=1 2024-09-12T01:29:14.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dHpePHoCOSP7wO1cYF6cosl-OPsIs0L_0 2024-09-12T01:29:14.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13584501375546348950', time=2024-09-12T03:09:56.489303+0000, chain.objs.size()=1 2024-09-12T01:29:14.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dRrcUQJqpdcGjI-KRHWqaJNIGKRvS9I_0 2024-09-12T01:29:14.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13513659052920827145', time=2024-09-12T03:09:56.724703+0000, chain.objs.size()=1 2024-09-12T01:29:14.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.986+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.f8QKmTDt9NHoPtvJurg0Bm3g0plSSVr_0 2024-09-12T01:29:14.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.989+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10174760150784273055', time=2024-09-12T03:09:56.758029+0000, chain.objs.size()=1 2024-09-12T01:29:14.990 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.989+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.I3wNQd_tQByMkYCBBK0NiDdEHQ7FZcC_0 2024-09-12T01:29:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16878341442502838546', time=2024-09-12T03:09:56.963088+0000, chain.objs.size()=1 2024-09-12T01:29:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.n4dzbquTj3IjZp77ap1S_GJADtu3pn9_0 2024-09-12T01:29:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.267794715265799824', time=2024-09-12T03:09:57.274330+0000, chain.objs.size()=1 2024-09-12T01:29:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.gBaW0IXXR1e1HS0xvRqPijdwo0g0SuJ_0 2024-09-12T01:29:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9759985883085170359', time=2024-09-12T03:09:57.773642+0000, chain.objs.size()=1 2024-09-12T01:29:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.bDoqt1C39TDjWe63XmGqKB1UptAmvjG_0 2024-09-12T01:29:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16164107204576442232', time=2024-09-12T03:09:57.813092+0000, chain.objs.size()=1 2024-09-12T01:29:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.sg-cnKW_ioT1zVr5h2Yb0eSRV2TBfat_0 2024-09-12T01:29:14.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15505715301408002266', time=2024-09-12T03:09:57.932918+0000, chain.objs.size()=1 2024-09-12T01:29:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.b6DI1gVf31kiF-eLUkWz8yLtBGlxE9Z_0 2024-09-12T01:29:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1895920865242198486', time=2024-09-12T03:09:58.527174+0000, chain.objs.size()=1 2024-09-12T01:29:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.p-xhe7KLwQYiZw2sDTjOUp56WINZ0Pu_0 2024-09-12T01:29:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10260028181001186351', time=2024-09-12T03:09:59.508873+0000, chain.objs.size()=1 2024-09-12T01:29:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.2UI9w8lRJgUr-CFk_oXgsOfusV4J7mv_0 2024-09-12T01:29:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5862745296368678183', time=2024-09-12T03:09:59.892497+0000, chain.objs.size()=1 2024-09-12T01:29:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.g6A0oGK-89aL2ZX4j9HvZrqQg96kwvF_0 2024-09-12T01:29:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.57828925149647959', time=2024-09-12T03:09:59.965008+0000, chain.objs.size()=1 2024-09-12T01:29:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ZGLtyjglXhtcB9pepuOv8BnodJ6oFL5_0 2024-09-12T01:29:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12760500364251207375', time=2024-09-12T03:10:00.247523+0000, chain.objs.size()=1 2024-09-12T01:29:14.992 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.990+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.yjgZNJwQzjQlquEVwEomZg-QsZf4SJd_0 2024-09-12T01:29:14.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.993+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7290224515400226872', time=2024-09-12T03:10:01.572550+0000, chain.objs.size()=1 2024-09-12T01:29:14.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.993+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PM2w-ChGiSqpBiNe1m1sQkEhW7Yk_-B_0 2024-09-12T01:29:14.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.993+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16996826170056095439', time=2024-09-12T03:10:01.574105+0000, chain.objs.size()=1 2024-09-12T01:29:14.993 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.993+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.qm5cxxc7YBc1YC5Qr8k9tNngpLMBLTC_0 2024-09-12T01:29:14.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2895821089570304996', time=2024-09-12T03:10:01.688046+0000, chain.objs.size()=1 2024-09-12T01:29:14.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Nb-b-KBRIXreLcA9ZEPhMGmJ-c8PgtC_0 2024-09-12T01:29:14.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.628427339715795828', time=2024-09-12T03:10:01.885088+0000, chain.objs.size()=1 2024-09-12T01:29:14.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.pKvFAnADrYzilT0euah5fzBxpbOkXMz_0 2024-09-12T01:29:14.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5206925795945536404', time=2024-09-12T03:10:01.901590+0000, chain.objs.size()=1 2024-09-12T01:29:14.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.MRc5fPNzpAbWoUHO6cYT7BUJnkF_0U7_0 2024-09-12T01:29:14.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10154010724378551362', time=2024-09-12T03:10:02.029549+0000, chain.objs.size()=1 2024-09-12T01:29:14.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.G15oFB8_pxaboq4AojD8z7E-HwZ_S6g_0 2024-09-12T01:29:14.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5220427043246852325', time=2024-09-12T03:10:02.213653+0000, chain.objs.size()=1 2024-09-12T01:29:14.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0pb8zipR1dlMuC0OUX-IIinSIqqfjng_0 2024-09-12T01:29:14.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11512997600465441058', time=2024-09-12T03:10:02.657408+0000, chain.objs.size()=1 2024-09-12T01:29:14.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.kcmmST1sToX7gf6Cw2PN9cMNDjjXt-t_0 2024-09-12T01:29:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11192192940329325518', time=2024-09-12T03:10:02.964180+0000, chain.objs.size()=1 2024-09-12T01:29:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PKmA2yuS8_OCWJ5MRugZ320vbEvonAP_0 2024-09-12T01:29:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.995+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15976391136222555956', time=2024-09-12T03:10:03.313617+0000, chain.objs.size()=1 2024-09-12T01:29:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.995+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.wB_NMG9Olwp030gvSvUNIzhDF4R8hzD_0 2024-09-12T01:29:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.995+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5387946303634121463', time=2024-09-12T03:10:03.361935+0000, chain.objs.size()=1 2024-09-12T01:29:14.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.995+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.52wuF1MlocVmWmJa6BE0CINe5dqS-P0_0 2024-09-12T01:29:14.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.996+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12623749998578817578', time=2024-09-12T03:10:03.460286+0000, chain.objs.size()=1 2024-09-12T01:29:14.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.996+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.m1sYU9eKHLqo6YW5Hv1aWoxjfaYr0qb_0 2024-09-12T01:29:14.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.997+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3687710380559740465', time=2024-09-12T03:10:04.430483+0000, chain.objs.size()=1 2024-09-12T01:29:14.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.997+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.xR9Nz1M1e2WOKVBsWOCCBBaOKI_Ss3k_0 2024-09-12T01:29:14.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.998+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8738386895416019033', time=2024-09-12T03:10:04.681918+0000, chain.objs.size()=1 2024-09-12T01:29:14.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.998+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.R9VnVPLw9dYrCmE81ScYGDYBPDMhpRE_0 2024-09-12T01:29:14.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.998+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3302722193255632171', time=2024-09-12T03:10:04.787297+0000, chain.objs.size()=1 2024-09-12T01:29:14.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.998+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.4j0z3xd_nxdp3szT9rJvcL--uEYY610_0 2024-09-12T01:29:14.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.998+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15122282237294537023', time=2024-09-12T03:10:04.995239+0000, chain.objs.size()=1 2024-09-12T01:29:14.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.998+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lERjB3C3jBqj3hEdUb0WTWxSKESrIjG_0 2024-09-12T01:29:14.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.998+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.307775553694427999', time=2024-09-12T03:10:05.401419+0000, chain.objs.size()=1 2024-09-12T01:29:14.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.998+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.X_zikXHP3BhGMrsbR5MfZRpw-vUPLKW_0 2024-09-12T01:29:15.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.998+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16970314280521986871', time=2024-09-12T03:10:05.402034+0000, chain.objs.size()=1 2024-09-12T01:29:15.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.998+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.43FRpH1eD2JmmzxtpDpEiMS7kw3Wt8l_0 2024-09-12T01:29:15.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.998+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3767181613411007516', time=2024-09-12T03:10:05.402735+0000, chain.objs.size()=1 2024-09-12T01:29:15.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.998+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.KU6UODdxm_5q4ZzICA-q19zGD_G8T6F_0 2024-09-12T01:29:15.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.998+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15182400591202258200', time=2024-09-12T03:10:06.015850+0000, chain.objs.size()=1 2024-09-12T01:29:15.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:14.998+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.rnSMZJ205b0w8ZxvHGMCKpq78j2XkLV_0 2024-09-12T01:29:15.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.001+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9729620604637964621', time=2024-09-12T03:10:06.496999+0000, chain.objs.size()=1 2024-09-12T01:29:15.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.001+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.S4I0xW8J4kkZUE7t7boTeoMt-WGpdSw_0 2024-09-12T01:29:15.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.001+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13834731890766029678', time=2024-09-12T03:10:09.118561+0000, chain.objs.size()=1 2024-09-12T01:29:15.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.001+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.266__shadow_.9n7f2bgaQtiLHBmk80V0N2trDup3efz_0 2024-09-12T01:29:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.001+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.805437443995662622', time=2024-09-12T03:10:11.468565+0000, chain.objs.size()=1 2024-09-12T01:29:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.001+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.270__shadow_.B7sIlVsWkeYtHMktio4KeUtLk0vSate_0 2024-09-12T01:29:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.001+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10818160619579451863', time=2024-09-12T03:10:12.096017+0000, chain.objs.size()=1 2024-09-12T01:29:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.001+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.271__shadow_.pk22bBYuPCWHLGNEBDSaeMJguXd7aZ1_0 2024-09-12T01:29:15.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.002+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14544858016160613487', time=2024-09-12T03:10:13.857030+0000, chain.objs.size()=1 2024-09-12T01:29:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.002+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.274__shadow_.jSh9OTu5sEdaK1ImNSZnx9BDSPmWr-h_0 2024-09-12T01:29:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.002+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9489375564942771004', time=2024-09-12T03:10:15.814650+0000, chain.objs.size()=1 2024-09-12T01:29:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.002+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.277__shadow_.6KZV5mUjoY4Se3JBhD9UzoibyB8Da-w_0 2024-09-12T01:29:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.002+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.531828115700458465', time=2024-09-12T03:10:23.748804+0000, chain.objs.size()=1 2024-09-12T01:29:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.002+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.289__shadow_.cgWG27Y7Co1rZKeKBYdznl_O4oUIF3W_0 2024-09-12T01:29:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.002+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14479313293682902200', time=2024-09-12T03:10:27.060275+0000, chain.objs.size()=1 2024-09-12T01:29:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.002+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.TjCd10ptEn5UQqVMV7xaEPUIz0mcqSN_0 2024-09-12T01:29:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.002+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.363099709478061359', time=2024-09-12T03:10:27.124885+0000, chain.objs.size()=1 2024-09-12T01:29:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.002+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.tKjUL6WGZCWhE3Hm-6Sd8pE5LMAPx19_0 2024-09-12T01:29:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.002+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2414541215348248916', time=2024-09-12T03:10:33.221995+0000, chain.objs.size()=1 2024-09-12T01:29:15.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.002+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.299__shadow_.2_4KUZVaU02O1x-klLLUTueFHKd8X5v_0 2024-09-12T01:29:15.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.002+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12541768329107840461', time=2024-09-12T03:10:36.472611+0000, chain.objs.size()=1 2024-09-12T01:29:15.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.002+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.304__shadow_.4Oh08usTsf2c8A7S1R6isLUfAJUrT21_0 2024-09-12T01:29:15.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.004+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17494181994297750790', time=2024-09-12T03:11:29.444944+0000, chain.objs.size()=1 2024-09-12T01:29:15.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.004+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.9xl-vPu55uUqhLfcmJ9oMawaHdAj_hP_0 2024-09-12T01:29:15.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.004+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16510456885117661732', time=2024-09-12T03:11:30.407394+0000, chain.objs.size()=1 2024-09-12T01:29:15.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.004+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.74WsM1zNMseDW6a14ZiBTrW8vN0OCbR_0 2024-09-12T01:29:15.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.004+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13560978177425368519', time=2024-09-12T03:11:31.519533+0000, chain.objs.size()=1 2024-09-12T01:29:15.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.004+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2EX14JG4YQNspi49oCW0NWt979kNUGQ_0 2024-09-12T01:29:15.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.004+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8115397067650080738', time=2024-09-12T03:11:33.435846+0000, chain.objs.size()=1 2024-09-12T01:29:15.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.004+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.J_cL17CjRu1CZaiPi9nEcSzE6caYjnJ_0 2024-09-12T01:29:15.005 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.005+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18119906599465739055', time=2024-09-12T03:11:34.014110+0000, chain.objs.size()=1 2024-09-12T01:29:15.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.005+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.59_4XPgjRD0j6e4FBWHYy3SKuS2NEca_0 2024-09-12T01:29:15.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.006+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1282580177922266189', time=2024-09-12T03:11:34.774422+0000, chain.objs.size()=1 2024-09-12T01:29:15.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.006+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.p4fZeOYCCs9i4pG5CkMr7-VXPV1tMmK_0 2024-09-12T01:29:15.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.006+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2813636689614063320', time=2024-09-12T03:11:34.962357+0000, chain.objs.size()=1 2024-09-12T01:29:15.006 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.006+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-2GF8CmNBuDua0URyP0UEFGiPkDxHMu_0 2024-09-12T01:29:15.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1672218582035090462', time=2024-09-12T03:11:35.069780+0000, chain.objs.size()=1 2024-09-12T01:29:15.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.kEZtHCbNJrj5mCxg93NK2B3kABp8RDq_0 2024-09-12T01:29:15.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8660477960554408506', time=2024-09-12T03:11:35.572528+0000, chain.objs.size()=1 2024-09-12T01:29:15.008 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.kPEFePBBHvw-0nyGlUhOggl3BGW4O56_0 2024-09-12T01:29:15.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17463206903031875748', time=2024-09-12T03:11:35.577950+0000, chain.objs.size()=1 2024-09-12T01:29:15.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MadeL4OuFR_E22YeuIFAzo4tC64Kjjg_0 2024-09-12T01:29:15.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10057962136659400435', time=2024-09-12T03:11:35.673249+0000, chain.objs.size()=1 2024-09-12T01:29:15.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.PGHPqRkwOEC6jiVXY0aoeID4o6-Otw2_0 2024-09-12T01:29:15.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3568211298347445422', time=2024-09-12T03:11:36.358706+0000, chain.objs.size()=1 2024-09-12T01:29:15.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.FvT_xUPynJ5m7Vj6wUGToL4WywhY-vf_0 2024-09-12T01:29:15.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16765637867774410987', time=2024-09-12T03:11:36.359202+0000, chain.objs.size()=1 2024-09-12T01:29:15.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.CNfdr_7ollsC1LOa6Pnt_HczMvOBdGB_0 2024-09-12T01:29:15.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17218313751078410092', time=2024-09-12T03:11:36.890964+0000, chain.objs.size()=1 2024-09-12T01:29:15.009 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Ez7n8jXFAaDZ6nAR7rPoPh0XGat6Q2d_0 2024-09-12T01:29:15.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16743732787622345103', time=2024-09-12T03:11:37.228094+0000, chain.objs.size()=1 2024-09-12T01:29:15.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.008+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.kFzT-bWl5J_5vJhvCfc3mV0P7wmMPdL_0 2024-09-12T01:29:15.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.009+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13643872620488939174', time=2024-09-12T03:11:37.973291+0000, chain.objs.size()=1 2024-09-12T01:29:15.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.009+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mSXXGtI1FbJ_P0YN4FIh8q7vqDW3Ezi_0 2024-09-12T01:29:15.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.010+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7172979322961008350', time=2024-09-12T03:11:38.102990+0000, chain.objs.size()=1 2024-09-12T01:29:15.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.010+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.d_tlAwEVHGLh5xaPLkUcyGDA2lYFhZO_0 2024-09-12T01:29:15.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.010+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17004359736938218546', time=2024-09-12T03:11:38.771689+0000, chain.objs.size()=1 2024-09-12T01:29:15.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.010+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Q9yZzXlHKDAidMipJniCWqM8wMoMEad_0 2024-09-12T01:29:15.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.012+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7620256347175820275', time=2024-09-12T03:11:39.396280+0000, chain.objs.size()=1 2024-09-12T01:29:15.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.jYgLQ4I3kJqkqOyFmXMHLY5hy0Phi6v_0 2024-09-12T01:29:15.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.012+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12675809386733569674', time=2024-09-12T03:11:39.746756+0000, chain.objs.size()=1 2024-09-12T01:29:15.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5bXzML9LRmVSK3Wkb1dlDx4VmEXGU5O_0 2024-09-12T01:29:15.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.012+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12754218766510762315', time=2024-09-12T03:11:40.380430+0000, chain.objs.size()=1 2024-09-12T01:29:15.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-kHuIcWriuNw9EQrPD29UVHG2-z8gXB_0 2024-09-12T01:29:15.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.012+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1469778544046896431', time=2024-09-12T03:11:40.853266+0000, chain.objs.size()=1 2024-09-12T01:29:15.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ziI4LUAZ01jGjGqhbBPAdFq6sakhX4v_0 2024-09-12T01:29:15.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.013+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3003633429219158674', time=2024-09-12T03:11:41.039649+0000, chain.objs.size()=1 2024-09-12T01:29:15.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.013+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.b-MrwoVj2lKZiTy0SAODwUS9omMnAnj_0 2024-09-12T01:29:15.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.013+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13914465599712697814', time=2024-09-12T03:11:41.119224+0000, chain.objs.size()=1 2024-09-12T01:29:15.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.013+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.phdnr2YKMed1XHevu8xJhP47hQUKYIy_0 2024-09-12T01:29:15.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.013+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5993973502065871352', time=2024-09-12T03:11:41.292460+0000, chain.objs.size()=1 2024-09-12T01:29:15.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.013+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.WEKJJxaxbHfDt9CmhHhrKGUauFLWr-U_0 2024-09-12T01:29:15.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.013+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5288655750445899226', time=2024-09-12T03:12:21.912447+0000, chain.objs.size()=1 2024-09-12T01:29:15.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.013+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hqd7hY_Wi-ydkwbO_LZfQrUx5xsAb1J_0 2024-09-12T01:29:15.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.013+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11598887293408523312', time=2024-09-12T03:12:22.096820+0000, chain.objs.size()=1 2024-09-12T01:29:15.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.013+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.N_jd6b2HUKgn17BPusP7B8t9BQ3rahF_0 2024-09-12T01:29:15.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.016+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8516528269265418234', time=2024-09-12T03:12:22.823216+0000, chain.objs.size()=1 2024-09-12T01:29:15.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.016+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hUqFB59lg07exDVpP_HWprO-vJeUm66_0 2024-09-12T01:29:15.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.016+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10603499500112551042', time=2024-09-12T03:12:22.974720+0000, chain.objs.size()=1 2024-09-12T01:29:15.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.016+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.aSQmao6IZ7mjlxNFjKTkCu3IDbP8r1P_0 2024-09-12T01:29:15.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.016+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16077611435465462088', time=2024-09-12T03:12:23.936193+0000, chain.objs.size()=1 2024-09-12T01:29:15.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.016+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.KRTDcPYp552VVKa3Qow38u2fZ9du1u3_0 2024-09-12T01:29:15.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.016+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13582090127677578854', time=2024-09-12T03:12:24.229704+0000, chain.objs.size()=1 2024-09-12T01:29:15.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.016+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.glGkT1lGirahqOR3rMsZP5VhHy766LL_0 2024-09-12T01:29:15.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.016+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2377082442254300608', time=2024-09-12T03:12:24.262041+0000, chain.objs.size()=1 2024-09-12T01:29:15.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.016+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.2_gTKqBMlmLihbU6Rp4g4mYVSkD4MAU_0 2024-09-12T01:29:15.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.016+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9101721036781032137', time=2024-09-12T03:12:24.398503+0000, chain.objs.size()=1 2024-09-12T01:29:15.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.017+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Kdx4TEKNeYwTB3PGQi-tgwHivnoFsXp_0 2024-09-12T01:29:15.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.017+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17945131779015023990', time=2024-09-12T03:12:24.503970+0000, chain.objs.size()=1 2024-09-12T01:29:15.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.017+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.wJs2oDHu9WGgibhgEydGvmQPl0TEbPI_0 2024-09-12T01:29:15.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.017+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14751164510602144387', time=2024-09-12T03:12:24.810665+0000, chain.objs.size()=1 2024-09-12T01:29:15.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.017+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.H2L1ykhGjM-ujnpsuqNhb0Q1kHl2T2-_0 2024-09-12T01:29:15.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.017+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14764920228117155802', time=2024-09-12T03:12:26.270856+0000, chain.objs.size()=1 2024-09-12T01:29:15.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.017+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.4pUo4CbR6fEqv1zd5e9bHVoxVQzqswp_0 2024-09-12T01:29:15.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.018+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10578293595798998024', time=2024-09-12T03:12:26.271396+0000, chain.objs.size()=1 2024-09-12T01:29:15.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.018+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.s9iudQbutBhtjUERvgU-ddI-gXmHuy9_0 2024-09-12T01:29:15.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.018+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17815423481796045578', time=2024-09-12T03:12:27.271192+0000, chain.objs.size()=1 2024-09-12T01:29:15.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.018+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ueMYQAlO6ikyfbd-NHhaLCj629n-ZaM_0 2024-09-12T01:29:15.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.018+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9816002262017356898', time=2024-09-12T03:12:27.353870+0000, chain.objs.size()=1 2024-09-12T01:29:15.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.018+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.AQrvui-F_mI2nELbDGOVTQ8oW5UQMcM_0 2024-09-12T01:29:15.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.019+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1273263627313934466', time=2024-09-12T03:12:27.802932+0000, chain.objs.size()=1 2024-09-12T01:29:15.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.019+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.8iaVnoOy7KF1cAaJANfrSltgBaxOIVN_0 2024-09-12T01:29:15.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.019+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12543333395225580902', time=2024-09-12T03:12:28.005667+0000, chain.objs.size()=1 2024-09-12T01:29:15.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.019+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.SFTcBGnYJVlB2UglajYRM2bVEMsRTVJ_0 2024-09-12T01:29:15.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.019+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15917883828564774403', time=2024-09-12T03:12:28.097843+0000, chain.objs.size()=1 2024-09-12T01:29:15.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.019+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.YSMCbDJh-KlV-g5eYRI2OCSQufWNi4s_0 2024-09-12T01:29:15.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.020+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2523806897403758904', time=2024-09-12T03:12:28.157500+0000, chain.objs.size()=1 2024-09-12T01:29:15.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.020+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.YUSBjfzXehSS3_66j_7tIACaVzNc6cs_0 2024-09-12T01:29:15.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.020+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16041032939987252522', time=2024-09-12T03:12:28.700420+0000, chain.objs.size()=1 2024-09-12T01:29:15.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.020+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Mo-rlwrrha3wAmWWVVLzk87bHIvgqA5_0 2024-09-12T01:29:15.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.020+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7387932098759432007', time=2024-09-12T03:12:29.224934+0000, chain.objs.size()=1 2024-09-12T01:29:15.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.020+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.76JoYO9sYT1ag87VIoyguFr_93UZ1Vs_0 2024-09-12T01:29:15.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.021+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1321599129422923910', time=2024-09-12T03:12:29.440984+0000, chain.objs.size()=1 2024-09-12T01:29:15.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.021+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.KJbIyKA_gl5k1p7ARYkQW18ssaWxGIy_0 2024-09-12T01:29:15.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.024+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/46353 2024-09-12T01:29:15.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T01:29:15.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15142101132426402515', time=2024-09-12T03:12:29.851371+0000, chain.objs.size()=1 2024-09-12T01:29:15.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.q62nNDZfaSwQ-JBGVNj11aXGnN13r-Z_0 2024-09-12T01:29:15.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.133354819560938545', time=2024-09-12T03:12:31.955418+0000, chain.objs.size()=1 2024-09-12T01:29:15.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.fh-vpVdjIxBkZU-oMKEtXmjPX_q0duk_0 2024-09-12T01:29:15.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5313178262132744995', time=2024-09-12T03:12:32.302110+0000, chain.objs.size()=1 2024-09-12T01:29:15.028 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hZEaH6GR2ENKhqvdkmwV_ELN1zuNKR8_0 2024-09-12T01:29:15.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8741918693988745388', time=2024-09-12T03:12:32.489876+0000, chain.objs.size()=1 2024-09-12T01:29:15.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.jo4cTGT7sM5PD9id_zDp3ExcbjZxDEv_0 2024-09-12T01:29:15.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6838306199388581636', time=2024-09-12T03:12:32.790888+0000, chain.objs.size()=1 2024-09-12T01:29:15.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.W4Y8uphbnsmeyMw-drh0h7JOzVFCBYr_0 2024-09-12T01:29:15.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7216058055348300165', time=2024-09-12T03:12:32.970326+0000, chain.objs.size()=1 2024-09-12T01:29:15.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.HkU559H09U3S6Dzd52ciYmYtBEW6dWc_0 2024-09-12T01:29:15.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9575921510401818687', time=2024-09-12T03:12:33.768542+0000, chain.objs.size()=1 2024-09-12T01:29:15.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.vbvGP3KsMEaqzTAHjL-ThR4bR8rJGCU_0 2024-09-12T01:29:15.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16597441459691768730', time=2024-09-12T03:12:33.960016+0000, chain.objs.size()=1 2024-09-12T01:29:15.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._MexARG2dZcGMV6AtU2CJQO8IunFXwn_0 2024-09-12T01:29:15.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2621329445681432200', time=2024-09-12T03:12:34.040885+0000, chain.objs.size()=1 2024-09-12T01:29:15.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.SNsgED-lg0vy2TbmJLGSX0Cua1eQ_Fg_0 2024-09-12T01:29:15.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15195674012327998998', time=2024-09-12T03:12:34.277623+0000, chain.objs.size()=1 2024-09-12T01:29:15.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.BSrvtEdnR5upnyv-7-AMK_oH_mX_isC_0 2024-09-12T01:29:15.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5007989428569135334', time=2024-09-12T03:12:57.296133+0000, chain.objs.size()=1 2024-09-12T01:29:15.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.370__shadow_.pcz-9bTDSoK0D_BeeLBgQEnbmJb5gUO_0 2024-09-12T01:29:15.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13235373162281349605', time=2024-09-12T03:13:56.449084+0000, chain.objs.size()=1 2024-09-12T01:29:15.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.027+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.465__shadow_.gSauBVdoxfu4V4Qk_fMYzHfRhdUnnyX_0 2024-09-12T01:29:15.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.030+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12293371100664996227', time=2024-09-12T03:14:05.109989+0000, chain.objs.size()=1 2024-09-12T01:29:15.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.030+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.483__shadow_.Dsh2g-3fY-NAy7hbzxGncMVQE9U8nZw_0 2024-09-12T01:29:15.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.030+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2314787764142364817', time=2024-09-12T03:14:19.838035+0000, chain.objs.size()=1 2024-09-12T01:29:15.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.030+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.503__shadow:Dp2Xh3PCmOVDZq0qVeIVb0wIZKi8rqS_.nA7nRfHdVh5iLsyVm5W5cePiSTckNJe_0 2024-09-12T01:29:15.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.030+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9845741700850012593', time=2024-09-12T03:15:57.450315+0000, chain.objs.size()=1 2024-09-12T01:29:15.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.030+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.523__multipart_mymultipart.2~bm6v3Wb0FM1V2Pz3rm4fcyrBBSZhwcf.1 2024-09-12T01:29:15.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.030+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15970487431989358465', time=2024-09-12T03:17:25.973759+0000, chain.objs.size()=1 2024-09-12T01:29:15.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.030+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.557__shadow_.lb8qateWhEpE1GXHtWCDccVOl3pXyf0_0 2024-09-12T01:29:15.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.030+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4200527308261247145', time=2024-09-12T03:17:45.933586+0000, chain.objs.size()=1 2024-09-12T01:29:15.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.030+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:803Vd070DjcWwEGXI1EFSg1-RbnjSVt_.mYUDGhM5Ca8QKl3mRMRc78I9wLGW9j5_0 2024-09-12T01:29:15.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.031+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4261275846176934784', time=2024-09-12T03:17:57.474210+0000, chain.objs.size()=1 2024-09-12T01:29:15.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.031+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.570__shadow:owxn5RESmddZym-PcPhAZClRPPqKeCw_.zxXRHSQwVUD-8G-VeQrQnUmj1qEyC2u_0 2024-09-12T01:29:15.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.032+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15522107689914368799', time=2024-09-12T03:18:26.668296+0000, chain.objs.size()=1 2024-09-12T01:29:15.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.032+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:XewQ1w-OVD32-l2dL5wo-0V5zHy4M0F_.RuiOpZt0PzNTzXat-SN40Va4GNgOxqw_0 2024-09-12T01:29:15.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.032+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9422423536025614368', time=2024-09-12T03:18:51.398662+0000, chain.objs.size()=1 2024-09-12T01:29:15.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.032+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.582__shadow:W4SIjZiJ4txR7REVXYXI9giv5BAO.Ss_.QbBayv-P1LZmUhCD5mf-9Qfc6Bz8E9z_0 2024-09-12T01:29:15.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.032+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3029082089131436071', time=2024-09-12T03:19:01.482817+0000, chain.objs.size()=1 2024-09-12T01:29:15.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.032+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.596__shadow_.VKWa77azlbAfWG8ByNWUNHxPPHjnpKI_0 2024-09-12T01:29:15.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.032+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17649886649944573331', time=2024-09-12T03:23:01.000537+0000, chain.objs.size()=1 2024-09-12T01:29:15.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.032+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.635__shadow_.gF7M7GXRIyd_HIhtd_T290BW_gyHJfm_0 2024-09-12T01:29:15.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.032+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3791946575751513338', time=2024-09-12T03:23:04.036545+0000, chain.objs.size()=1 2024-09-12T01:29:15.033 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.032+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.641__shadow_.eqbzghrRP3rCtpuX9rqTl-NlHz4tyBm_0 2024-09-12T01:29:15.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.034+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1933863848148321034', time=2024-09-12T03:23:59.376222+0000, chain.objs.size()=1 2024-09-12T01:29:15.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.034+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.696__shadow:YQSoBKllR3.9mO7tOqihk297RnBiL77_.CpgD346hCgjh1sYaA_tHXkYL9UN8VdE_0 2024-09-12T01:29:15.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.035+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9935376239443261973', time=2024-09-12T03:24:02.006237+0000, chain.objs.size()=1 2024-09-12T01:29:15.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.035+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.700__shadow:1fRnOz7UkciU8XDMw8ng7gMLGmMr3NF_.FRjloY4PxidNUf8wp-39cnQVEii7Lp7_0 2024-09-12T01:29:15.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.035+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13504044963977215013', time=2024-09-12T03:25:08.117716+0000, chain.objs.size()=1 2024-09-12T01:29:15.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.035+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.745__shadow_.JmjPXOXWWfc9XeoamSdxRbkYyH9IuO1_0 2024-09-12T01:29:15.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.037+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.040+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:29:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.041+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.041+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/42978' 2024-09-12T01:29:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12558718260271850278', time=2024-09-12T03:06:59.796248+0000, chain.objs.size()=1 2024-09-12T01:29:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.166__shadow_.qc4VGQKZQ1s7u2H6clXunul3M_829WC_0 2024-09-12T01:29:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11353130597162831884', time=2024-09-12T03:08:57.483047+0000, chain.objs.size()=1 2024-09-12T01:29:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.235__shadow_.vFyVFlYf1G5-TtmvvrZfhLldvmWlHTb_0 2024-09-12T01:29:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2968500570915980054', time=2024-09-12T03:09:10.554452+0000, chain.objs.size()=1 2024-09-12T01:29:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.254__shadow_.XI3ePldfIBFPJvH1zUl9J3GHZdoiXuc_0 2024-09-12T01:29:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10393337318932455068', time=2024-09-12T03:09:54.428074+0000, chain.objs.size()=1 2024-09-12T01:29:15.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9gJj_kC1RuUK1UuWTonTpyBcXB0DBwr_0 2024-09-12T01:29:15.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17899619625816784854', time=2024-09-12T03:09:56.101279+0000, chain.objs.size()=1 2024-09-12T01:29:15.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.F3rv_jxi2tr5Hh5Vl7SJ00_xZa5INbM_0 2024-09-12T01:29:15.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17596238854489673943', time=2024-09-12T03:09:56.102005+0000, chain.objs.size()=1 2024-09-12T01:29:15.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.uIfPRtETsA-irOrmwDo6PMILAB9mOeP_0 2024-09-12T01:29:15.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8308813607236760332', time=2024-09-12T03:09:56.604182+0000, chain.objs.size()=1 2024-09-12T01:29:15.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._Za5A2o86o7sptRFyzvfWBC-XZJCWEM_0 2024-09-12T01:29:15.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5705031366282878992', time=2024-09-12T03:09:56.856043+0000, chain.objs.size()=1 2024-09-12T01:29:15.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.yDR-mY_Zms5w_GloTKzss1b-8qsR4sg_0 2024-09-12T01:29:15.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9884439558082920948', time=2024-09-12T03:09:57.785487+0000, chain.objs.size()=1 2024-09-12T01:29:15.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.T9PmYtzqXaL1Dl3AWMcqZ0PxZQVYw_r_0 2024-09-12T01:29:15.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2423320158545642554', time=2024-09-12T03:09:58.350292+0000, chain.objs.size()=1 2024-09-12T01:29:15.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.NSMslP6A3LrYOfqRAkxy9ZAxwtTVPFZ_0 2024-09-12T01:29:15.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4402939538266075279', time=2024-09-12T03:09:59.514398+0000, chain.objs.size()=1 2024-09-12T01:29:15.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PWVjZe5hkYs6nUgwt8IIQMcB7wYVcta_0 2024-09-12T01:29:15.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14014444285061110265', time=2024-09-12T03:09:59.604922+0000, chain.objs.size()=1 2024-09-12T01:29:15.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.042+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.64OGSs9aYyTJKUEKY54zCuGSrhcxbZk_0 2024-09-12T01:29:15.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.045+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1169273853504159243', time=2024-09-12T03:10:00.555692+0000, chain.objs.size()=1 2024-09-12T01:29:15.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.045+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.s8iKWeoGgBeUmyU2zKtgdTZ9YJGfQlm_0 2024-09-12T01:29:15.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.046+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11596921602491257103', time=2024-09-12T03:10:01.104539+0000, chain.objs.size()=1 2024-09-12T01:29:15.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.046+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.THUOdhcsnHw-hZIj5JtLv5UWqyYKnVm_0 2024-09-12T01:29:15.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.046+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15390382956342402982', time=2024-09-12T03:10:01.936089+0000, chain.objs.size()=1 2024-09-12T01:29:15.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.046+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.pc-B8tTHzzVS4fZnpQ33eFuVO7rzxHS_0 2024-09-12T01:29:15.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.046+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2707438112803222311', time=2024-09-12T03:10:02.771083+0000, chain.objs.size()=1 2024-09-12T01:29:15.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.046+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.hqO_GSGM8TqhOze0PCc5rT_lnDMbnyC_0 2024-09-12T01:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.046+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11263050280425515152', time=2024-09-12T03:10:03.008820+0000, chain.objs.size()=1 2024-09-12T01:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.046+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Lsvqta7XbJS3gYKfcRaSS0xcwNoSZXx_0 2024-09-12T01:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.046+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10867245756114104988', time=2024-09-12T03:10:03.009523+0000, chain.objs.size()=1 2024-09-12T01:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.046+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.KS14z9tmhxhqHxXYas9rrVRoXE92F5K_0 2024-09-12T01:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.047+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6397972409213832677', time=2024-09-12T03:10:03.279216+0000, chain.objs.size()=1 2024-09-12T01:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.047+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.sS1nUw2ejglcXv00Jvmds81L7aXox1Z_0 2024-09-12T01:29:15.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.047+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14620517573147599246', time=2024-09-12T03:10:03.382875+0000, chain.objs.size()=1 2024-09-12T01:29:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.047+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.puPlByGOjrTXDSpdi9mfj_04QpW6Mjf_0 2024-09-12T01:29:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.047+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1529949329178177603', time=2024-09-12T03:10:03.824849+0000, chain.objs.size()=1 2024-09-12T01:29:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.047+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.yBiCkSHtKkR-UusTyVO6updnZeKMKY-_0 2024-09-12T01:29:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.047+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14232656470474801757', time=2024-09-12T03:10:04.205363+0000, chain.objs.size()=1 2024-09-12T01:29:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.047+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9CXZyld1c_fG4Hhj-FWoRFSz_r6jqZu_0 2024-09-12T01:29:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.047+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1088042713966551514', time=2024-09-12T03:10:04.463441+0000, chain.objs.size()=1 2024-09-12T01:29:15.048 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.047+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.KProcD034xr9osswCWtZGjMgjEnc2OS_0 2024-09-12T01:29:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4643898967609531554', time=2024-09-12T03:10:04.537557+0000, chain.objs.size()=1 2024-09-12T01:29:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.jYT9zltBFjOIpC7fD5svL0zdvStyldF_0 2024-09-12T01:29:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3868594247089485234', time=2024-09-12T03:10:04.719889+0000, chain.objs.size()=1 2024-09-12T01:29:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.T1hBoNE1miTrPn9viq8_-9YnwDPTN69_0 2024-09-12T01:29:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1939471190876503166', time=2024-09-12T03:10:05.122132+0000, chain.objs.size()=1 2024-09-12T01:29:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.yUmqZ1XGv-S8a9pc_k77wU2bcagYahM_0 2024-09-12T01:29:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6703620002561731269', time=2024-09-12T03:10:05.245169+0000, chain.objs.size()=1 2024-09-12T01:29:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.HlUtUWHXPLW31v9-HU03aO2P3keMoWG_0 2024-09-12T01:29:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6300831130314102260', time=2024-09-12T03:10:05.406287+0000, chain.objs.size()=1 2024-09-12T01:29:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.jMdvmMZVjEt1AGQ6voDNtVCmn5p_6Qu_0 2024-09-12T01:29:15.052 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5347456445320585539', time=2024-09-12T03:10:05.909537+0000, chain.objs.size()=1 2024-09-12T01:29:15.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.mP8O2c8SmQYCEy6S4zu61cUx5aSfdI0_0 2024-09-12T01:29:15.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.77465566213068247', time=2024-09-12T03:10:06.264258+0000, chain.objs.size()=1 2024-09-12T01:29:15.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.faD9GEo2sh5GgW1dTa_kPbaoyuFtmxV_0 2024-09-12T01:29:15.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5955590494169395039', time=2024-09-12T03:10:07.932601+0000, chain.objs.size()=1 2024-09-12T01:29:15.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.264__shadow_.Ho1DB4t_KdEJBNrqvkgOsZhxFC6yQSs_0 2024-09-12T01:29:15.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9696079604668178070', time=2024-09-12T03:10:17.842597+0000, chain.objs.size()=1 2024-09-12T01:29:15.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.280__shadow_.YL5RtHn4piTwiWmz1gmV53zTH4tXAnC_0 2024-09-12T01:29:15.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.836516238058413034', time=2024-09-12T03:10:21.841343+0000, chain.objs.size()=1 2024-09-12T01:29:15.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.286__shadow_.cLgZhMy0-IS1HpxWjUHWFOVpaM90uIo_0 2024-09-12T01:29:15.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18296379985399872112', time=2024-09-12T03:10:22.470281+0000, chain.objs.size()=1 2024-09-12T01:29:15.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.051+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.287__shadow_.AydQA1VP7Jp2p-c0EpooMWCDzYvwYHT_0 2024-09-12T01:29:15.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8162868288874205837', time=2024-09-12T03:10:27.096595+0000, chain.objs.size()=1 2024-09-12T01:29:15.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.rpbPmkZ0yKa8ndVKxcwO7oFLuiYO7DQ_0 2024-09-12T01:29:15.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13482748627188609645', time=2024-09-12T03:10:32.527349+0000, chain.objs.size()=1 2024-09-12T01:29:15.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.298__shadow_.fwsfgBoB6mbJulY98tl2PNnTKqDhaF0_0 2024-09-12T01:29:15.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1992736583073220491', time=2024-09-12T03:10:37.105468+0000, chain.objs.size()=1 2024-09-12T01:29:15.055 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.305__shadow_.Up6dRqICRoYEXxjNS5Pwwa4Q_lwd0zB_0 2024-09-12T01:29:15.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2868165342509823760', time=2024-09-12T03:11:29.656329+0000, chain.objs.size()=1 2024-09-12T01:29:15.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MOyNXYd81aSemfzshPbsqUr-Pt9xweD_0 2024-09-12T01:29:15.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.056+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18256227735632569124', time=2024-09-12T03:11:30.391701+0000, chain.objs.size()=1 2024-09-12T01:29:15.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.056+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Js3fknK92kz4I_Nyv7FD4CruUDLSYj7_0 2024-09-12T01:29:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.056+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17146085369382908114', time=2024-09-12T03:11:30.398952+0000, chain.objs.size()=1 2024-09-12T01:29:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.056+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.pD9x70AVxybpIxz4SXljb2bhLFDPaGg_0 2024-09-12T01:29:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.056+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13585911871023983810', time=2024-09-12T03:11:30.430246+0000, chain.objs.size()=1 2024-09-12T01:29:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.056+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1gdq1BCYcF1aJglkcauJXu5Bj5SaMPH_0 2024-09-12T01:29:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.056+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1670518133193791995', time=2024-09-12T03:11:30.510996+0000, chain.objs.size()=1 2024-09-12T01:29:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.056+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.QUi7BSkuLNN1c8TtVOxluzbVSZuiUcB_0 2024-09-12T01:29:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.056+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11676874167504074568', time=2024-09-12T03:11:31.504678+0000, chain.objs.size()=1 2024-09-12T01:29:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.056+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MQMl4YD0jZpintfBTUeLDRnSouD01JL_0 2024-09-12T01:29:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.056+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5452315125731200869', time=2024-09-12T03:11:31.988234+0000, chain.objs.size()=1 2024-09-12T01:29:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.056+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.HaH7gvGlU2v8xCr8gP-9VbaOdVJYFTx_0 2024-09-12T01:29:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.056+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17136921959179397080', time=2024-09-12T03:11:32.192185+0000, chain.objs.size()=1 2024-09-12T01:29:15.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.056+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7jWz_V0k5F5gSRfUTiQZezbBAEGijB7_0 2024-09-12T01:29:15.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.058+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17743022307919094314', time=2024-09-12T03:11:32.865245+0000, chain.objs.size()=1 2024-09-12T01:29:15.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.058+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.uIno6E9SyvxyvFhWYa8BIwA91qCCJmS_0 2024-09-12T01:29:15.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.058+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16948453090984179401', time=2024-09-12T03:11:32.984864+0000, chain.objs.size()=1 2024-09-12T01:29:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.058+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.On2TUikFD1xMHvCNl7xLGkzXgdV6w6o_0 2024-09-12T01:29:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.058+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9569740956852704989', time=2024-09-12T03:11:33.149477+0000, chain.objs.size()=1 2024-09-12T01:29:15.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.058+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.QZyHjyQC_AaffXZpf3Np2RjU4PlOd7r_0 2024-09-12T01:29:15.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14081076003548182880', time=2024-09-12T03:11:33.223379+0000, chain.objs.size()=1 2024-09-12T01:29:15.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.OmVyF-wHBeOovRJhprMVBixy9KifEhe_0 2024-09-12T01:29:15.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17159942405969308875', time=2024-09-12T03:11:34.024288+0000, chain.objs.size()=1 2024-09-12T01:29:15.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.O9YLCKDv9WHg78EPQPXJVZ9yC4n_MKU_0 2024-09-12T01:29:15.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7040191617467248916', time=2024-09-12T03:11:34.947721+0000, chain.objs.size()=1 2024-09-12T01:29:15.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Iilx3Mn4jWJ2F2bpBCaNBsKCT-IPGUj_0 2024-09-12T01:29:15.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18117625455764413511', time=2024-09-12T03:11:34.971339+0000, chain.objs.size()=1 2024-09-12T01:29:15.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Es-xS9cNDv-ZzcNxoQISuSeULI305-p_0 2024-09-12T01:29:15.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6827334961026104423', time=2024-09-12T03:11:35.562111+0000, chain.objs.size()=1 2024-09-12T01:29:15.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_._shONmQj_Qs36N-z6dRNEPCxJzyHV7C_0 2024-09-12T01:29:15.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.86340637973239524', time=2024-09-12T03:11:35.579373+0000, chain.objs.size()=1 2024-09-12T01:29:15.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.wqwmplau5Eu_VOu0D8knFkxxgejvUid_0 2024-09-12T01:29:15.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3283046330243938291', time=2024-09-12T03:11:36.533819+0000, chain.objs.size()=1 2024-09-12T01:29:15.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_._NaUqTT3Uv4xRAvo21a5-FJnHUXNx7t_0 2024-09-12T01:29:15.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5275305676438972240', time=2024-09-12T03:11:36.534362+0000, chain.objs.size()=1 2024-09-12T01:29:15.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.060+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.vO8m8vETNhofBPfDwW6ECKJ5iUGPpeH_0 2024-09-12T01:29:15.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.061+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.349170231258879549', time=2024-09-12T03:11:37.275664+0000, chain.objs.size()=1 2024-09-12T01:29:15.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.061+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.XaivuKRWWWarh87k2V5FIm7TpNMWjbr_0 2024-09-12T01:29:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.062+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15831301072800461847', time=2024-09-12T03:11:37.673567+0000, chain.objs.size()=1 2024-09-12T01:29:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.063+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.TxsXj-yYF01nonhUX8eVDBe-ZKVsf5b_0 2024-09-12T01:29:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.063+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.145833895301567396', time=2024-09-12T03:11:37.717753+0000, chain.objs.size()=1 2024-09-12T01:29:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.063+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.UoGGnRf0PVssm60fs_8t43r4twrLaZn_0 2024-09-12T01:29:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.063+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15706429107664459112', time=2024-09-12T03:11:38.363987+0000, chain.objs.size()=1 2024-09-12T01:29:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.063+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xq7VaWCS9pMd8RKkrl68gqoR7VH-tG0_0 2024-09-12T01:29:15.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.063+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16748546886633147677', time=2024-09-12T03:11:38.547521+0000, chain.objs.size()=1 2024-09-12T01:29:15.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.063+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.lv1QY3-VY-RruhanApRCvMFbNklqc-M_0 2024-09-12T01:29:15.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.064+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10060740967885743247', time=2024-09-12T03:11:38.628352+0000, chain.objs.size()=1 2024-09-12T01:29:15.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.064+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.328eLb-TkOkj5oWfHL1tVeqLFW2g8ZR_0 2024-09-12T01:29:15.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.064+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13227173586788703090', time=2024-09-12T03:11:38.797963+0000, chain.objs.size()=1 2024-09-12T01:29:15.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.064+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qs9sW8AwnluR_UoT14nCBhGex5gUKN2_0 2024-09-12T01:29:15.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.064+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5715034258036039933', time=2024-09-12T03:11:38.805133+0000, chain.objs.size()=1 2024-09-12T01:29:15.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.064+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.yci1K_Q-XVao62vcvH5hd2auCwN6n-i_0 2024-09-12T01:29:15.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.064+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14878397066218748207', time=2024-09-12T03:11:39.376588+0000, chain.objs.size()=1 2024-09-12T01:29:15.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.064+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tYqEJ1-cSfC-ROk7Y_WezQZdxvJd8IB_0 2024-09-12T01:29:15.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.065+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5442574100183312360', time=2024-09-12T03:11:39.702960+0000, chain.objs.size()=1 2024-09-12T01:29:15.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.065+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.p6vGl27KX3QJq2qkPUdIs64nGngHYCt_0 2024-09-12T01:29:15.065 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.065+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13785724382077751597', time=2024-09-12T03:11:39.799454+0000, chain.objs.size()=1 2024-09-12T01:29:15.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.065+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tk_DRE7iLJslqDmufPumP5tOhsr2AkE_0 2024-09-12T01:29:15.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.065+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16185533840955050181', time=2024-09-12T03:11:39.966769+0000, chain.objs.size()=1 2024-09-12T01:29:15.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.065+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.YZzXQdmZTa8nxCEKsa8HmcZgfDkb6PA_0 2024-09-12T01:29:15.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.067+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7314678019307515939', time=2024-09-12T03:11:40.069339+0000, chain.objs.size()=1 2024-09-12T01:29:15.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.067+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.V2eTk1Pmgu6plnkF6JJQAtX8L8p86tu_0 2024-09-12T01:29:15.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.067+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15573164206095004936', time=2024-09-12T03:11:40.696842+0000, chain.objs.size()=1 2024-09-12T01:29:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.067+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.aVYjfos-hGMISasUbF8lHTwea_eaPxw_0 2024-09-12T01:29:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.067+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5942462321390041', time=2024-09-12T03:11:40.901034+0000, chain.objs.size()=1 2024-09-12T01:29:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.067+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.wq5E3bIAFDn9ob6xvDWkbakdQwktLzj_0 2024-09-12T01:29:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.067+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5200347662752522486', time=2024-09-12T03:11:40.994647+0000, chain.objs.size()=1 2024-09-12T01:29:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.067+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.gI4WQj3MWqlfjV8j4-9E-4nKzxyMLCx_0 2024-09-12T01:29:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.067+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13160662637284622642', time=2024-09-12T03:11:41.030190+0000, chain.objs.size()=1 2024-09-12T01:29:15.068 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.067+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.U0Xtph8p7VLEGC-9i0jqbU9eZXx6bWt_0 2024-09-12T01:29:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.068+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13455942998247505219', time=2024-09-12T03:11:41.132250+0000, chain.objs.size()=1 2024-09-12T01:29:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.068+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.eBeEC2h9qnJOtpf18YjzrMI_4vfF5RM_0 2024-09-12T01:29:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.069+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.854916071333353455', time=2024-09-12T03:11:41.209636+0000, chain.objs.size()=1 2024-09-12T01:29:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.069+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.RjGMs1j_LRnqkHopkt9pAnDfFLdusTq_0 2024-09-12T01:29:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.069+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16325766604099745521', time=2024-09-12T03:11:41.341029+0000, chain.objs.size()=1 2024-09-12T01:29:15.069 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.069+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.oYoayWo3HdCMSy0iP1MZrs03Ple-erd_0 2024-09-12T01:29:15.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.069+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8722461611880718595', time=2024-09-12T03:12:21.868690+0000, chain.objs.size()=1 2024-09-12T01:29:15.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.069+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-zc9D_PgJUBxGF6dAy6Kx1g6d4bhrpy_0 2024-09-12T01:29:15.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.070+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3211479576258069213', time=2024-09-12T03:12:22.212865+0000, chain.objs.size()=1 2024-09-12T01:29:15.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.070+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3oxFJxP6NmJueuh_QittnNWAYog1ON4_0 2024-09-12T01:29:15.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.070+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11014149044363820471', time=2024-09-12T03:12:22.521617+0000, chain.objs.size()=1 2024-09-12T01:29:15.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.070+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ZV4Pl_wEjTqVSopsvFQBLjg4TpI9G1b_0 2024-09-12T01:29:15.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.071+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11347096393622089683', time=2024-09-12T03:12:22.579390+0000, chain.objs.size()=1 2024-09-12T01:29:15.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.071+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.PpAsIAL95s9Tsy8XjjV-qa50u0f6T2u_0 2024-09-12T01:29:15.071 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.071+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13726681124879381675', time=2024-09-12T03:12:23.031794+0000, chain.objs.size()=1 2024-09-12T01:29:15.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.071+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mpHEni-TvR44Azv5bXj5AGYUFAlRXvx_0 2024-09-12T01:29:15.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.071+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5137266387437109172', time=2024-09-12T03:12:23.034196+0000, chain.objs.size()=1 2024-09-12T01:29:15.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.071+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.H2Yr9-iW2cxkTzCiatyJQyrrxaj3m8L_0 2024-09-12T01:29:15.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.071+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15236757463389282717', time=2024-09-12T03:12:24.049576+0000, chain.objs.size()=1 2024-09-12T01:29:15.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.071+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.udbhEKikDx1HygXZiRxmZTzx2f_sppW_0 2024-09-12T01:29:15.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.071+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12977141880718476549', time=2024-09-12T03:12:24.109207+0000, chain.objs.size()=1 2024-09-12T01:29:15.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.071+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ct3vc4THziPYglq3vcdUWAb-QhC0PWh_0 2024-09-12T01:29:15.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.073+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4689145801421803446', time=2024-09-12T03:12:25.417324+0000, chain.objs.size()=1 2024-09-12T01:29:15.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.073+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.u7EHrU5cHAIKiH9bfXgipIlOKT15OAx_0 2024-09-12T01:29:15.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.073+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16243970708450472881', time=2024-09-12T03:12:25.723099+0000, chain.objs.size()=1 2024-09-12T01:29:15.073 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.073+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.JC4NennJcBE8leiogK_8VTpf_ivr9--_0 2024-09-12T01:29:15.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.073+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16025789118475735280', time=2024-09-12T03:12:26.463142+0000, chain.objs.size()=1 2024-09-12T01:29:15.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.073+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.yaUGllCPNbI5mWY5_EQaAluoEvV8KrD_0 2024-09-12T01:29:15.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.073+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4859088339975380386', time=2024-09-12T03:12:27.039228+0000, chain.objs.size()=1 2024-09-12T01:29:15.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.073+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.4JZoHbtZREI2p0GmVh7ybtWMfefJPc8_0 2024-09-12T01:29:15.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.075+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7187554339816395572', time=2024-09-12T03:12:27.101152+0000, chain.objs.size()=1 2024-09-12T01:29:15.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.075+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.SnvrtETg-sGcpg128Hq-EAzUG3NgUZK_0 2024-09-12T01:29:15.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.075+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16848936582093276604', time=2024-09-12T03:12:27.195181+0000, chain.objs.size()=1 2024-09-12T01:29:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.075+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.fym_9aIa0UhQPD7qvN_KmAkt1COfK-e_0 2024-09-12T01:29:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.076+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15970393889017126238', time=2024-09-12T03:12:27.611561+0000, chain.objs.size()=1 2024-09-12T01:29:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.076+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.WiyQ-QJpzNLh0b5MImgYJ8lOxj14jOo_0 2024-09-12T01:29:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.076+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16141969771317846301', time=2024-09-12T03:12:27.612242+0000, chain.objs.size()=1 2024-09-12T01:29:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.076+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.adRGsTjWxZnuh1fZzeC8DstrdYpDFWc_0 2024-09-12T01:29:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.076+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1899719394108706512', time=2024-09-12T03:12:27.919430+0000, chain.objs.size()=1 2024-09-12T01:29:15.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.076+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.92m5XOqQYXU1Jqn3kh1G-6jAOS_qymM_0 2024-09-12T01:29:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.076+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.632311306887826459', time=2024-09-12T03:12:28.083194+0000, chain.objs.size()=1 2024-09-12T01:29:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.076+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.pfALNup7eZesSI7WJgv3NG3WXsXnsZX_0 2024-09-12T01:29:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.076+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4636190226967956784', time=2024-09-12T03:12:28.827899+0000, chain.objs.size()=1 2024-09-12T01:29:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.076+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.vtCpS_T4qmicVli9OJo4i7bEwBgrKqi_0 2024-09-12T01:29:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.077+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4505749279904347049', time=2024-09-12T03:12:28.888422+0000, chain.objs.size()=1 2024-09-12T01:29:15.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.077+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.pPU9vNi8Ib73v5F0qrzUnyLZxiNCvTx_0 2024-09-12T01:29:15.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.077+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12564460936331080017', time=2024-09-12T03:12:29.465235+0000, chain.objs.size()=1 2024-09-12T01:29:15.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.077+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.HWfK1AKNNc8vs7ohX6CbpxobGWl_wR4_0 2024-09-12T01:29:15.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.079+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12516937657548473745', time=2024-09-12T03:12:29.550753+0000, chain.objs.size()=1 2024-09-12T01:29:15.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.079+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.9LlSOnBrgw86Q4Krvf0P6L5KjjF28VJ_0 2024-09-12T01:29:15.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.079+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8139447543704820324', time=2024-09-12T03:12:29.866829+0000, chain.objs.size()=1 2024-09-12T01:29:15.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.079+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Uern5sTm2P-mWUexKouUane33dWL6EB_0 2024-09-12T01:29:15.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.080+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8455180647443324479', time=2024-09-12T03:12:30.893532+0000, chain.objs.size()=1 2024-09-12T01:29:15.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.080+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.CsmEpLOu9YngsNKPHKe12fyDtfehd-F_0 2024-09-12T01:29:15.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.083+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/42978 2024-09-12T01:29:15.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T01:29:15.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3897886711620321256', time=2024-09-12T03:12:31.992794+0000, chain.objs.size()=1 2024-09-12T01:29:15.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.bg8jokOU4ELakG6-2MUVj-L8L6R9Ua-_0 2024-09-12T01:29:15.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14472514768960898251', time=2024-09-12T03:12:33.628784+0000, chain.objs.size()=1 2024-09-12T01:29:15.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hHY6W3GlHzip4FKNv1RA-8cnRong9a7_0 2024-09-12T01:29:15.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10920875521155217794', time=2024-09-12T03:12:34.098068+0000, chain.objs.size()=1 2024-09-12T01:29:15.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.w_dWqoJIbIBGXbHqagVabuVTqVx0tM5_0 2024-09-12T01:29:15.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17015467330841958994', time=2024-09-12T03:12:34.165102+0000, chain.objs.size()=1 2024-09-12T01:29:15.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MMBtO0s-vkTxMosizdXfzdai9idAyqH_0 2024-09-12T01:29:15.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15848727729737550393', time=2024-09-12T03:12:38.301521+0000, chain.objs.size()=1 2024-09-12T01:29:15.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.331__shadow_.4nMowcwi1ZZQZNpA4d26LWfnZid9zF5_0 2024-09-12T01:29:15.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16420350345252296611', time=2024-09-12T03:12:45.435189+0000, chain.objs.size()=1 2024-09-12T01:29:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.344__shadow_.rsL8f2_IHhm0FefnL49FFEP3-X_D2ge_0 2024-09-12T01:29:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7111980511047510379', time=2024-09-12T03:13:09.996295+0000, chain.objs.size()=1 2024-09-12T01:29:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.390__shadow_.kxnoqM0lnSpbdguKYF4SGJSgRk7azBM_0 2024-09-12T01:29:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4488527951928087998', time=2024-09-12T03:13:20.632046+0000, chain.objs.size()=1 2024-09-12T01:29:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.407__shadow_.4UgRy4Ypeps10zoA-V5siq1KLRcHGR1_0 2024-09-12T01:29:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3899262269413069453', time=2024-09-12T03:13:38.172456+0000, chain.objs.size()=1 2024-09-12T01:29:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.439__shadow_.hzqXCotTdLEVcjpr4NlcwgJ6PvVeXu6_0 2024-09-12T01:29:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4982161356866806903', time=2024-09-12T03:13:43.373745+0000, chain.objs.size()=1 2024-09-12T01:29:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.447__shadow_.KmQ9_PSy6cF0rFh8R6JXIZcbH0PLY74_0 2024-09-12T01:29:15.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17541354504651348142', time=2024-09-12T03:14:10.789006+0000, chain.objs.size()=1 2024-09-12T01:29:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.488__shadow_.O2whTIZuCLNfromiiCbSxxsSyGf8Afq_0 2024-09-12T01:29:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3737593962057887120', time=2024-09-12T03:15:55.514054+0000, chain.objs.size()=6 2024-09-12T01:29:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.086+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.dGEditzEpn1r3AkrWZraXizB6Dp__Fz2.1 2024-09-12T01:29:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.JA14az0B_TNcUiGiuTIVCXoCxUTlMlMw.2 2024-09-12T01:29:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.Na3oGoefUeRK7nGY4cx4TGdTrr-AXyni.3 2024-09-12T01:29:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.SoZB1qWeTUfeLK7T7Edk5mj6CI-JCKIc.4 2024-09-12T01:29:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.VglvtKatv33pwF62YNieq5zmmscr1z6h.5 2024-09-12T01:29:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.Zwa83o39zFK2t9AgiPVzTbofvdV9C6Xv.6 2024-09-12T01:29:15.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10564151648179997300', time=2024-09-12T03:16:07.920020+0000, chain.objs.size()=1 2024-09-12T01:29:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.525__multipart_mymultipart.2~YZSDSpHDzHLZlrAg6sqoZq9goBfMWZA.1 2024-09-12T01:29:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~pftBUAuwnP6z9AoR-npBU6esFk54eAj', time=2024-09-12T03:16:30.748812+0000, chain.objs.size()=1 2024-09-12T01:29:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.531__multipart_mymultipart.2~pftBUAuwnP6z9AoR-npBU6esFk54eAj.1 2024-09-12T01:29:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16935897113252311814', time=2024-09-12T03:17:23.578822+0000, chain.objs.size()=1 2024-09-12T01:29:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.556__shadow_.OP-p9fB0NhTOuNUVp6u00Lh6Ik8_b66_0 2024-09-12T01:29:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6770334752006335482', time=2024-09-12T03:17:58.098941+0000, chain.objs.size()=1 2024-09-12T01:29:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.571__shadow_.0h16ac5TmkAp9WZEyxpAeo_SnmcXOLA_0 2024-09-12T01:29:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5331973087313539771', time=2024-09-12T03:18:01.338029+0000, chain.objs.size()=1 2024-09-12T01:29:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.574__shadow_.PkJkBEzGh1Rk-VJvBDkvL3Dsrd6kO06_0 2024-09-12T01:29:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8869611723094999633', time=2024-09-12T03:18:48.582712+0000, chain.objs.size()=1 2024-09-12T01:29:15.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.089+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.579__shadow:L5l5OKPA5kv-Y7HXkRT3czOxime5KYb_.qFMvY7vmTiOqYgV6orybwH0PTLGbeu6_0 2024-09-12T01:29:15.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.092+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14564908072536257611', time=2024-09-12T03:18:48.606299+0000, chain.objs.size()=1 2024-09-12T01:29:15.092 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.092+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.579__shadow:MxqiUCjJ8kwILbYuvbL-24LP7uKbB3r_.2-YAal32FQvnma7RvGBziZOJygO4ohe_0 2024-09-12T01:29:15.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.093+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8628383171142273852', time=2024-09-12T03:18:56.880793+0000, chain.objs.size()=1 2024-09-12T01:29:15.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.093+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.587__shadow:i3ah3jlmre.StaVHRATs7IhIEQ.gCfn_.kixLGzZV5QtobEyRoHwsJa2cYt6p3TO_0 2024-09-12T01:29:15.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.093+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3724618341262481997', time=2024-09-12T03:23:18.499703+0000, chain.objs.size()=1 2024-09-12T01:29:15.093 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.093+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.650__shadow_.grk-2PF0MaZxTrh6rJroDVZVhMoM81d_0 2024-09-12T01:29:15.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.094+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.645148328003994962', time=2024-09-12T03:23:46.482881+0000, chain.objs.size()=1 2024-09-12T01:29:15.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.094+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.671__shadow_.VUTY9r7WYPpOkfHbwf0m1iembLuPvj__0 2024-09-12T01:29:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.094+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1099955431560177516', time=2024-09-12T03:23:57.074250+0000, chain.objs.size()=1 2024-09-12T01:29:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.094+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.692__shadow:k7tRydgqAuSkpfIVIT8cb6yGEcft3E-_.ZfIxe5NvZFfo7M5_XSKK9RPu882R4tR_0 2024-09-12T01:29:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.094+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14160210353708353303', time=2024-09-12T03:24:00.073540+0000, chain.objs.size()=1 2024-09-12T01:29:15.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.094+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.697__shadow:ZKDoulu0OcLEfwIf6PAJnswIN1PlXOy_.cD0ZgmYX3m27Uqynhs1arwqxXu35Lp3_0 2024-09-12T01:29:15.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.098+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.100+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:29:15.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.102+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.102+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43464' 2024-09-12T01:29:15.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16583004494903002613', time=2024-09-12T03:06:29.467366+0000, chain.objs.size()=1 2024-09-12T01:29:15.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.148__shadow_.TulZik8trKQAnqd6AL043G2HYY5IID0_0 2024-09-12T01:29:15.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_S7y1LQ73K5SMzH1fdWfT-liKfLvL9sM', time=2024-09-12T03:06:53.990338+0000, chain.objs.size()=2 2024-09-12T01:29:15.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__shadow_._LoAeROUh2dBo5myzMBA_HEzac864oN_0 2024-09-12T01:29:15.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__shadow_._LoAeROUh2dBo5myzMBA_HEzac864oN_1 2024-09-12T01:29:15.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_JUjraAMNHiI_-qjMI_-ANHlQwPX1f2G', time=2024-09-12T03:06:56.573165+0000, chain.objs.size()=1 2024-09-12T01:29:15.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.163__shadow_.PTxiMeiH0ocOUQTUJPQor5h9ugjWFzX_0 2024-09-12T01:29:15.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6390607760422358450', time=2024-09-12T03:08:56.197053+0000, chain.objs.size()=1 2024-09-12T01:29:15.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.233__shadow_.RbC1lBSAXS0zxOHWSxMQYC-FnwFQ13__0 2024-09-12T01:29:15.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14596373002212994206', time=2024-09-12T03:08:56.843760+0000, chain.objs.size()=1 2024-09-12T01:29:15.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.234__shadow_.oQfsWQaQUzBJlM7e-Yg_roMsOGY7knQ_0 2024-09-12T01:29:15.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3978218909615753220', time=2024-09-12T03:08:59.051638+0000, chain.objs.size()=1 2024-09-12T01:29:15.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.237__shadow_.wXaKkSFFNCG0oq4YMSf3Zwsb1W9o33x_0 2024-09-12T01:29:15.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8701800402646122495', time=2024-09-12T03:08:59.955114+0000, chain.objs.size()=1 2024-09-12T01:29:15.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.238__shadow_.761syT19zXlBgs0iogTIOkQcllI3xsP_0 2024-09-12T01:29:15.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1202485124106874915', time=2024-09-12T03:09:03.178587+0000, chain.objs.size()=1 2024-09-12T01:29:15.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.243__shadow_.kkqJiOkyBBZgqRmgsS-G2QZnKFnFMV7_0 2024-09-12T01:29:15.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18417798404732155359', time=2024-09-12T03:09:04.723820+0000, chain.objs.size()=1 2024-09-12T01:29:15.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.245__shadow_.RO5MwHPMl8dZZ9aXQdVLPTMJQ2U-Z0t_0 2024-09-12T01:29:15.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9461090797819568832', time=2024-09-12T03:09:05.357913+0000, chain.objs.size()=1 2024-09-12T01:29:15.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.246__shadow_.63a7oUjriaMh4Pf3YBOxH-7WIiQkaUa_0 2024-09-12T01:29:15.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11498374859707486817', time=2024-09-12T03:09:09.914869+0000, chain.objs.size()=1 2024-09-12T01:29:15.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.103+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.253__shadow_.wgb0OnRvnkD1tO67GEMIV6ipCAytqPP_0 2024-09-12T01:29:15.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.106+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3255889129708655523', time=2024-09-12T03:09:54.482420+0000, chain.objs.size()=1 2024-09-12T01:29:15.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.106+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.IE1IYtpjwx-Y1L1RT7XF-Idq1Bqs7qu_0 2024-09-12T01:29:15.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.106+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14011525851272819282', time=2024-09-12T03:09:54.586734+0000, chain.objs.size()=1 2024-09-12T01:29:15.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.106+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.XVt4HVSbvSwRilGb83_fLqHjFGUBvHJ_0 2024-09-12T01:29:15.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.107+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12141176089976210087', time=2024-09-12T03:09:54.970196+0000, chain.objs.size()=1 2024-09-12T01:29:15.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.107+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Jrx7F7ceScvmZiwhpFdRQtNVt-DSeYU_0 2024-09-12T01:29:15.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.107+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14763081016386586287', time=2024-09-12T03:09:55.140528+0000, chain.objs.size()=1 2024-09-12T01:29:15.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.107+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.qsedvbcKFIFLi1g0Qthxsz3B_bXw9RM_0 2024-09-12T01:29:15.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.107+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12996417533398215284', time=2024-09-12T03:09:55.387403+0000, chain.objs.size()=1 2024-09-12T01:29:15.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.107+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.M8_YEwTgt-oIy-mt2W-S8mutLF9AQmH_0 2024-09-12T01:29:15.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.107+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15821103795748796705', time=2024-09-12T03:09:56.095148+0000, chain.objs.size()=1 2024-09-12T01:29:15.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.107+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.s-mrfcpSIYMYbbKN8lkGhoHrRIFkXYi_0 2024-09-12T01:29:15.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.108+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1517315199609824440', time=2024-09-12T03:09:56.159161+0000, chain.objs.size()=1 2024-09-12T01:29:15.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.108+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1nH5vP_z5H-1rY7C8Fw50wgF-X6A6Vz_0 2024-09-12T01:29:15.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.108+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7305903688941095345', time=2024-09-12T03:09:56.961999+0000, chain.objs.size()=1 2024-09-12T01:29:15.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.108+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.tmdcvNX_BEGDDjRizEUYh15T4xsS61d_0 2024-09-12T01:29:15.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.108+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15867887640732874240', time=2024-09-12T03:09:57.242205+0000, chain.objs.size()=1 2024-09-12T01:29:15.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.108+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.h4D574ySRsRtsHrEoCvMx4CL-OrNfCr_0 2024-09-12T01:29:15.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.108+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14199792893080446309', time=2024-09-12T03:09:57.933808+0000, chain.objs.size()=1 2024-09-12T01:29:15.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.108+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.gXxLwkIvHTHHdr9ad1NujMJGxMUNH0s_0 2024-09-12T01:29:15.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.108+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8417205793482962152', time=2024-09-12T03:09:57.996206+0000, chain.objs.size()=1 2024-09-12T01:29:15.109 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.108+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.G6D3qxWGfi_f93C9lTiqzqcfxWeWx8h_0 2024-09-12T01:29:15.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.109+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11026568413149354563', time=2024-09-12T03:09:58.266155+0000, chain.objs.size()=1 2024-09-12T01:29:15.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.109+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.x5Qqb6M_iKYH3rdHWMuzzWEw4QeNsnC_0 2024-09-12T01:29:15.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.110+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16731382836788954236', time=2024-09-12T03:09:58.722212+0000, chain.objs.size()=1 2024-09-12T01:29:15.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.110+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RS1vK1oE57NkCYIjVxMcLZI5vWa1TKK_0 2024-09-12T01:29:15.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.110+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16037023004733633011', time=2024-09-12T03:09:59.734160+0000, chain.objs.size()=1 2024-09-12T01:29:15.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.110+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.F5BOVbdBr-Pxw3pbfXhcR7wYsFZVub2_0 2024-09-12T01:29:15.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8273942424011297021', time=2024-09-12T03:09:59.734725+0000, chain.objs.size()=1 2024-09-12T01:29:15.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.EzGbNc_isa80yd-kPAxt9BgFGI3eehW_0 2024-09-12T01:29:15.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10005035798276720915', time=2024-09-12T03:10:00.085371+0000, chain.objs.size()=1 2024-09-12T01:29:15.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.6Gn3LkK-ja2xDK0njkXCVACfFfGZap2_0 2024-09-12T01:29:15.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7159944016685496192', time=2024-09-12T03:10:00.264299+0000, chain.objs.size()=1 2024-09-12T01:29:15.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Q68KVfpl407uRFyZj6mBxSngZP885Au_0 2024-09-12T01:29:15.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7956290698270472317', time=2024-09-12T03:10:01.570387+0000, chain.objs.size()=1 2024-09-12T01:29:15.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PLinXQ8kpLBcbgQSNdcxSFE_ofMV5ju_0 2024-09-12T01:29:15.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9002752121178173875', time=2024-09-12T03:10:01.630512+0000, chain.objs.size()=1 2024-09-12T01:29:15.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RPgrF9HNehM4G5eCm2MSTb3VI5jEvY4_0 2024-09-12T01:29:15.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13751736156548592372', time=2024-09-12T03:10:02.215249+0000, chain.objs.size()=1 2024-09-12T01:29:15.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.pT5I61tsauzDAMB9XTuCt8pNJkwwffF_0 2024-09-12T01:29:15.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9645484027984807465', time=2024-09-12T03:10:02.656190+0000, chain.objs.size()=1 2024-09-12T01:29:15.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Vhjeq68muAeW76RP8KmL9CYG2Xsz-A1_0 2024-09-12T01:29:15.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5637576440004606110', time=2024-09-12T03:10:03.132458+0000, chain.objs.size()=1 2024-09-12T01:29:15.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.112+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.y8ek7wd1WKUpfMLdvC1eaOWSMal6nPW_0 2024-09-12T01:29:15.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.114+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11675887743235944942', time=2024-09-12T03:10:03.746549+0000, chain.objs.size()=1 2024-09-12T01:29:15.114 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.114+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.SRjj-AIgMK3f056TCO6uYv-ZWINz2Py_0 2024-09-12T01:29:15.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5885123187400496977', time=2024-09-12T03:10:03.824817+0000, chain.objs.size()=1 2024-09-12T01:29:15.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.jeMwJYcskGYMKjuxD1qkrvH3dRCU0lO_0 2024-09-12T01:29:15.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4710468180948419151', time=2024-09-12T03:10:04.990517+0000, chain.objs.size()=1 2024-09-12T01:29:15.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.3QY65sp9Y8tB1kr7FUYg88O1RKU3xi__0 2024-09-12T01:29:15.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3277985114061008101', time=2024-09-12T03:10:05.235234+0000, chain.objs.size()=1 2024-09-12T01:29:15.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.z6CnU_dQb1MbmbVRZaTTKst68LePsny_0 2024-09-12T01:29:15.117 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17470174028014461533', time=2024-09-12T03:10:05.398789+0000, chain.objs.size()=1 2024-09-12T01:29:15.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.WdK07ldIwhx9qEvZKKnhYYn0eP6qaDb_0 2024-09-12T01:29:15.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4233130537733167238', time=2024-09-12T03:10:06.039494+0000, chain.objs.size()=1 2024-09-12T01:29:15.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.mMre68LbiP9FNpge_DWm3SwKSt7AFHO_0 2024-09-12T01:29:15.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1358366933508583591', time=2024-09-12T03:10:06.462722+0000, chain.objs.size()=1 2024-09-12T01:29:15.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.w66Tfzv-LSodGJN2TEpHpkIVjWrD9R4_0 2024-09-12T01:29:15.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11713279928783347079', time=2024-09-12T03:10:23.107373+0000, chain.objs.size()=1 2024-09-12T01:29:15.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.288__shadow_.htsc1ZzrSC6ekrQLIsic0AqaW6MvjOD_0 2024-09-12T01:29:15.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10649742780577583517', time=2024-09-12T03:10:23.744287+0000, chain.objs.size()=1 2024-09-12T01:29:15.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.289__shadow_.WP1PPnZSE2V0vQQRsiEuGNTF1da4_io_0 2024-09-12T01:29:15.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13772894211488028164', time=2024-09-12T03:10:27.125447+0000, chain.objs.size()=1 2024-09-12T01:29:15.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.0QPAxCkpMczODm19LboB-FpoLTyueiO_0 2024-09-12T01:29:15.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7934392468644851503', time=2024-09-12T03:10:29.089971+0000, chain.objs.size()=1 2024-09-12T01:29:15.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.nnwsffFsh93KhycmWlO0H7KFYg8tDYJ_0 2024-09-12T01:29:15.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.118+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16764885450188143412', time=2024-09-12T03:10:29.145605+0000, chain.objs.size()=1 2024-09-12T01:29:15.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.118+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.35XDvHzp_jwP4PEtB55vtiLrb2jBxqe_0 2024-09-12T01:29:15.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.119+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.107233171661648684', time=2024-09-12T03:10:34.519299+0000, chain.objs.size()=1 2024-09-12T01:29:15.120 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.119+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.301__shadow_.gXtJHUeqLjT8-BT5HGRt_31saxLA2Da_0 2024-09-12T01:29:15.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.121+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14006847811448234235', time=2024-09-12T03:10:37.109168+0000, chain.objs.size()=1 2024-09-12T01:29:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.121+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.305__shadow_.mlWdIbK_9R5Y2ITfyIAnSUPYS5FIFHi_0 2024-09-12T01:29:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.121+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4057331361713804402', time=2024-09-12T03:11:29.307979+0000, chain.objs.size()=1 2024-09-12T01:29:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.121+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-P5VAQKvRl5TsxoRXg-UFpF_8CEJau4_0 2024-09-12T01:29:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.121+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8757173807057627698', time=2024-09-12T03:11:29.552038+0000, chain.objs.size()=1 2024-09-12T01:29:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.121+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xHK3tlYA0dZ_-AEExLF9doW4PSyF72u_0 2024-09-12T01:29:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.121+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1804408986047819770', time=2024-09-12T03:11:30.133729+0000, chain.objs.size()=1 2024-09-12T01:29:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.121+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.VHApqef8UhdmgX3g2taG3PA8X9RWILV_0 2024-09-12T01:29:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.121+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18314074476445975171', time=2024-09-12T03:11:30.422990+0000, chain.objs.size()=1 2024-09-12T01:29:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.121+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Gys4a_8tUPstV6m_KoztnAgNqZ4t7qJ_0 2024-09-12T01:29:15.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.121+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8641769993176952574', time=2024-09-12T03:11:31.103228+0000, chain.objs.size()=1 2024-09-12T01:29:15.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.121+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.XUrBZNOUIdSUiC7f89jX8bZmfxQihLm_0 2024-09-12T01:29:15.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.122+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10265957000252181677', time=2024-09-12T03:11:31.104376+0000, chain.objs.size()=1 2024-09-12T01:29:15.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.122+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.BPQSag_wZ3o2HMHfCnHb7YVDQ7XLVKV_0 2024-09-12T01:29:15.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.122+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11762674887355888579', time=2024-09-12T03:11:31.444765+0000, chain.objs.size()=1 2024-09-12T01:29:15.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.122+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Dz4nxjGCwqPAcWLJkANYveWTYlCbShz_0 2024-09-12T01:29:15.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.123+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10857758015359661917', time=2024-09-12T03:11:31.713619+0000, chain.objs.size()=1 2024-09-12T01:29:15.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.123+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ZrT_-fduWvQUJ3Bsh1vKMwSPFXTMYwA_0 2024-09-12T01:29:15.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.123+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11272476325639443986', time=2024-09-12T03:11:32.344799+0000, chain.objs.size()=1 2024-09-12T01:29:15.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.123+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Dpj8pISg3_sWEguho30vTJrBwnGqj0P_0 2024-09-12T01:29:15.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.123+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17119155926303185973', time=2024-09-12T03:11:32.883770+0000, chain.objs.size()=1 2024-09-12T01:29:15.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.123+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.zrlH4PV1ChN4URMCM81kGmXEyLAD7V3_0 2024-09-12T01:29:15.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.124+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13993457866947896851', time=2024-09-12T03:11:32.999853+0000, chain.objs.size()=1 2024-09-12T01:29:15.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.124+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MyVvf7FBR7XOK5or8qAzr5eD7yyUx52_0 2024-09-12T01:29:15.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.124+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.201502048445281367', time=2024-09-12T03:11:33.179148+0000, chain.objs.size()=1 2024-09-12T01:29:15.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.124+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fkViPeBUAlNgKbLZT1OwPjvfuTTkQPx_0 2024-09-12T01:29:15.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9435590666616433931', time=2024-09-12T03:11:33.306640+0000, chain.objs.size()=1 2024-09-12T01:29:15.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.KnjUP7kRH0VG8ewCrQ3mC0DuBxLjIGa_0 2024-09-12T01:29:15.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14925945790734222076', time=2024-09-12T03:11:33.618026+0000, chain.objs.size()=1 2024-09-12T01:29:15.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.E6_fYIJVzG1kgobd3lYI1yZZd-ZPI9h_0 2024-09-12T01:29:15.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9224349810991232004', time=2024-09-12T03:11:33.820335+0000, chain.objs.size()=1 2024-09-12T01:29:15.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-RLqz83G-M6VNRe0x4ycHvBSFhBPFxQ_0 2024-09-12T01:29:15.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4144806734631475444', time=2024-09-12T03:11:33.927025+0000, chain.objs.size()=1 2024-09-12T01:29:15.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.9O6UWWDSuRyx8jO_DOK3NAQmlS6WkaZ_0 2024-09-12T01:29:15.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12917879286413822213', time=2024-09-12T03:11:33.998326+0000, chain.objs.size()=1 2024-09-12T01:29:15.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.R8S0TFQ6e5RnTV4JlNxjSTJ1pIc0gTn_0 2024-09-12T01:29:15.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7077705413817820796', time=2024-09-12T03:11:34.555176+0000, chain.objs.size()=1 2024-09-12T01:29:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.o_VWfmquk517ox96pip6vpFHIK-xwr-_0 2024-09-12T01:29:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.126+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16421609152035417010', time=2024-09-12T03:11:35.005352+0000, chain.objs.size()=1 2024-09-12T01:29:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.126+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7iu-xChAJpJkRv7Ng6WSVeWvsqOl4yP_0 2024-09-12T01:29:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.127+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8351171436606949153', time=2024-09-12T03:11:35.367739+0000, chain.objs.size()=1 2024-09-12T01:29:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.127+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.TJOEj4szZQOSlzwxZ2g08Th7jF53GcT_0 2024-09-12T01:29:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.127+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4188410762809608295', time=2024-09-12T03:11:35.671406+0000, chain.objs.size()=1 2024-09-12T01:29:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.127+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.yrWlJgDNf9-5kZyCewsF0zJpLJ_eO6v_0 2024-09-12T01:29:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.128+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16900627536480293402', time=2024-09-12T03:11:36.171072+0000, chain.objs.size()=1 2024-09-12T01:29:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.128+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.iqpSEUbEDM1xa2Bl9D0I16wC0mCnPr6_0 2024-09-12T01:29:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.128+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8805563028890465743', time=2024-09-12T03:11:36.263563+0000, chain.objs.size()=1 2024-09-12T01:29:15.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.128+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.PFYPglxzh_2E6FRVDjW78VHvb3wABqP_0 2024-09-12T01:29:15.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.129+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8229693413399576085', time=2024-09-12T03:11:37.972945+0000, chain.objs.size()=1 2024-09-12T01:29:15.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.129+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.dbRfN5wPdiLyvibQgx0bLQ2NoE8T7NO_0 2024-09-12T01:29:15.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.129+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13421623391923426758', time=2024-09-12T03:11:38.272015+0000, chain.objs.size()=1 2024-09-12T01:29:15.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.129+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.6p-8HddVhV0npDW72OpBq_GMeEt1D1n_0 2024-09-12T01:29:15.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.129+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5166438443765029131', time=2024-09-12T03:11:38.806450+0000, chain.objs.size()=1 2024-09-12T01:29:15.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.129+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.6w0h_9E2OX7AAwSqiVYMihsg8b1WaEz_0 2024-09-12T01:29:15.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.129+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11987429649797576862', time=2024-09-12T03:11:39.376944+0000, chain.objs.size()=1 2024-09-12T01:29:15.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.129+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qVqqBaVHEhEJblsp42zIpRJY7Kt72oH_0 2024-09-12T01:29:15.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.130+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10070724360334790948', time=2024-09-12T03:11:39.701616+0000, chain.objs.size()=1 2024-09-12T01:29:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.130+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.cgOd57taanIxeRjJpkb3obrLNi9HHL5_0 2024-09-12T01:29:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.130+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11299114943470301796', time=2024-09-12T03:11:40.356097+0000, chain.objs.size()=1 2024-09-12T01:29:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.130+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.rh9JSqRzUTpst7GNNlEeb0plKUnVHhn_0 2024-09-12T01:29:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.130+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16486818074162276787', time=2024-09-12T03:11:40.990240+0000, chain.objs.size()=1 2024-09-12T01:29:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.130+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.neobe3-NwsQsrTlx0dEKHTv0TzS9ZOW_0 2024-09-12T01:29:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.130+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.548321876965708863', time=2024-09-12T03:11:41.172008+0000, chain.objs.size()=1 2024-09-12T01:29:15.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.130+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_._modByov_QFskUqpWrvPUwITk2ePmZ6_0 2024-09-12T01:29:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.132+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11824598936954626106', time=2024-09-12T03:11:41.611209+0000, chain.objs.size()=1 2024-09-12T01:29:15.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.132+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mZIUKkT4vnVRma27ZvT05YJll_BpPoA_0 2024-09-12T01:29:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.132+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17814096914931131670', time=2024-09-12T03:12:23.727703+0000, chain.objs.size()=1 2024-09-12T01:29:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.132+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.dUAoSByIQBqAwmtQc-liOQLEEozc3Jr_0 2024-09-12T01:29:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.132+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.382695702652890457', time=2024-09-12T03:12:23.793035+0000, chain.objs.size()=1 2024-09-12T01:29:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.132+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.qBcoyAwaEq_qPkoXEMXSHrKM1ncItsH_0 2024-09-12T01:29:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.132+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14830867909727402074', time=2024-09-12T03:12:23.793754+0000, chain.objs.size()=1 2024-09-12T01:29:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.132+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.froysRK0Q95H0yeizRX3pUIWJ5klME4_0 2024-09-12T01:29:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.132+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13578625567344035929', time=2024-09-12T03:12:24.193933+0000, chain.objs.size()=1 2024-09-12T01:29:15.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.132+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RgzA1-F1Px1wkm2_Y-bkhhDT7bEQRcQ_0 2024-09-12T01:29:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.134+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14701724937707691812', time=2024-09-12T03:12:24.315199+0000, chain.objs.size()=1 2024-09-12T01:29:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.134+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.7s8vwD3t2j-xgd-CY8-MqtwMpHysNdL_0 2024-09-12T01:29:15.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.134+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3285461396368530627', time=2024-09-12T03:12:24.710035+0000, chain.objs.size()=1 2024-09-12T01:29:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.134+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.sMpWUll8ac8gM7b9CgRicpimwwVlCKJ_0 2024-09-12T01:29:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.134+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3034638791651419204', time=2024-09-12T03:12:26.195829+0000, chain.objs.size()=1 2024-09-12T01:29:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.134+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Na1TQOKgl4xH5mNxwOh6RMsyZ4GJlpz_0 2024-09-12T01:29:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.134+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1926467856587735272', time=2024-09-12T03:12:26.379214+0000, chain.objs.size()=1 2024-09-12T01:29:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.134+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.QmkSUBR7kQnHPk2kD6VLXogRtzBtyuI_0 2024-09-12T01:29:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.134+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1835776112111408580', time=2024-09-12T03:12:26.515124+0000, chain.objs.size()=1 2024-09-12T01:29:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.134+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.FUs0WX9KqbcVqNypUnoDcfHJc-aAfW8_0 2024-09-12T01:29:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.134+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5370361745283691121', time=2024-09-12T03:12:27.037518+0000, chain.objs.size()=1 2024-09-12T01:29:15.135 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.134+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.5OCHDweaIPVS3NYFBMYKfZbbBUxnamm_0 2024-09-12T01:29:15.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.136+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16093783683700374785', time=2024-09-12T03:12:27.480158+0000, chain.objs.size()=1 2024-09-12T01:29:15.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.136+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gwak9xk3lF3IgEpWPEiulurnGR2t6MM_0 2024-09-12T01:29:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.136+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10553832193385042823', time=2024-09-12T03:12:27.651577+0000, chain.objs.size()=1 2024-09-12T01:29:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.136+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.lhKqbhYcPuBjNkZTcX6HNs9lwrnXSuj_0 2024-09-12T01:29:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.136+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13760965793518573473', time=2024-09-12T03:12:28.103439+0000, chain.objs.size()=1 2024-09-12T01:29:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.136+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gt89qSd0uxG-YiRElniG98brUcG6p5s_0 2024-09-12T01:29:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.136+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7888059160665828362', time=2024-09-12T03:12:29.186804+0000, chain.objs.size()=1 2024-09-12T01:29:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.136+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.7ytoIp36d749u7eQijrn8qDgv8DMyD6_0 2024-09-12T01:29:15.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.136+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9088003282779028856', time=2024-09-12T03:12:29.511605+0000, chain.objs.size()=1 2024-09-12T01:29:15.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.136+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.C8GyogDlXbDx9u7N_e72wkguy8bTAdZ_0 2024-09-12T01:29:15.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.137+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15823708853385966404', time=2024-09-12T03:12:29.717014+0000, chain.objs.size()=1 2024-09-12T01:29:15.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.137+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.wk7JJsfhS8RXf1BEmgmqF9GZZmLBXIZ_0 2024-09-12T01:29:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.138+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10894713208187366731', time=2024-09-12T03:12:30.332318+0000, chain.objs.size()=1 2024-09-12T01:29:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.138+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mKUMoWcSYrvUvL4SO3t0YKqi5ZYswxr_0 2024-09-12T01:29:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.138+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18224419381978372869', time=2024-09-12T03:12:30.589361+0000, chain.objs.size()=1 2024-09-12T01:29:15.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.138+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-JmghvV7lRLO34CMX8Q0eS5RmJ87NUO_0 2024-09-12T01:29:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.139+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10659246896022980713', time=2024-09-12T03:12:30.704498+0000, chain.objs.size()=1 2024-09-12T01:29:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.139+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.NzwusBrSySkutefV8HQXZWsu_zZt7di_0 2024-09-12T01:29:15.140 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.139+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13838800837184613983', time=2024-09-12T03:12:30.779828+0000, chain.objs.size()=1 2024-09-12T01:29:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.139+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.nmNFOlItbkfrdUxhkMgqOkKEFWqXCiR_0 2024-09-12T01:29:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.140+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12298387159208400733', time=2024-09-12T03:12:31.955955+0000, chain.objs.size()=1 2024-09-12T01:29:15.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.140+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.tRsJTx3T69osaZwNdSdn6JV3llQvt3e_0 2024-09-12T01:29:15.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.142+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/43464 2024-09-12T01:29:15.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.144+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-12T01:29:15.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.144+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8228980196286594378', time=2024-09-12T03:12:32.297549+0000, chain.objs.size()=1 2024-09-12T01:29:15.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.144+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.YwkPBJiN2rfpRs7huEEi3k0f8SDU3lE_0 2024-09-12T01:29:15.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.144+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10393366404678590500', time=2024-09-12T03:12:32.738654+0000, chain.objs.size()=1 2024-09-12T01:29:15.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.144+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.AMOmLGU7PW1rsXhpIRjCUxK3IObNtl-_0 2024-09-12T01:29:15.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.144+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.898352950961210698', time=2024-09-12T03:12:32.963576+0000, chain.objs.size()=1 2024-09-12T01:29:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.144+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.0EXgyGp0TR7Ofh7UUTDOYH4XohYmOiv_0 2024-09-12T01:29:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.144+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12632251924955259675', time=2024-09-12T03:12:32.996975+0000, chain.objs.size()=1 2024-09-12T01:29:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.144+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Ko9_VGPVCTaFMrliKaADx2Utwa4MY78_0 2024-09-12T01:29:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14368508738572693818', time=2024-09-12T03:12:33.227942+0000, chain.objs.size()=1 2024-09-12T01:29:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Gr8tNdskU8VP2SMAVb4R77otS1u9-J0_0 2024-09-12T01:29:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3449724086136147602', time=2024-09-12T03:12:33.554371+0000, chain.objs.size()=1 2024-09-12T01:29:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3vqERx18daemcgdkfrqm11xm37Z4lvS_0 2024-09-12T01:29:15.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15311753726206300854', time=2024-09-12T03:12:33.765645+0000, chain.objs.size()=1 2024-09-12T01:29:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.purdClOz5qQrIs8KKNaHBcJYvWL3MuN_0 2024-09-12T01:29:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17184539796701949848', time=2024-09-12T03:12:34.094418+0000, chain.objs.size()=1 2024-09-12T01:29:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xenM6lnn12tU1hV4eYv6t6Ilk5j-bN-_0 2024-09-12T01:29:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.868211152148680017', time=2024-09-12T03:12:34.470011+0000, chain.objs.size()=1 2024-09-12T01:29:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hSYoZ_Wi5-4UL0EHamFJIkAcfPXjqbh_0 2024-09-12T01:29:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17011176343614053561', time=2024-09-12T03:12:34.470688+0000, chain.objs.size()=1 2024-09-12T01:29:15.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.eWBqb4HxMOdbwCxom7ClrVrTnwlrJuK_0 2024-09-12T01:29:15.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18308282841671417938', time=2024-09-12T03:12:37.744786+0000, chain.objs.size()=1 2024-09-12T01:29:15.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.330__shadow_.z3sYw5oQvgA_Z0A1KCwq5r0Q5Crurjn_0 2024-09-12T01:29:15.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6668692735214437410', time=2024-09-12T03:14:02.892132+0000, chain.objs.size()=1 2024-09-12T01:29:15.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.145+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.481__shadow_.SQr6NFobSVlZr-qMDP3_URli_3dY0Qy_0 2024-09-12T01:29:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.148+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1070974079715002122', time=2024-09-12T03:14:10.783213+0000, chain.objs.size()=1 2024-09-12T01:29:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.148+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.488__shadow_.O2whTIZuCLNfromiiCbSxxsSyGf8Afq_0 2024-09-12T01:29:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.148+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3910341980170928149', time=2024-09-12T03:14:13.469899+0000, chain.objs.size()=1 2024-09-12T01:29:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.148+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.493__shadow_.dJGFzr9iZD25IlHWTUVuRkGHldT8Q5A_0 2024-09-12T01:29:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.148+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17777371979249514775', time=2024-09-12T03:14:14.340291+0000, chain.objs.size()=1 2024-09-12T01:29:15.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.148+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.495__shadow_.tpywbIngLAObbeuIR3AAZsAJdh6GTLP_0 2024-09-12T01:29:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.149+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17723199628891430636', time=2024-09-12T03:14:33.446546+0000, chain.objs.size()=1 2024-09-12T01:29:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.149+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.514__shadow_.ZFGk0HwIrOXPe5_lcBi2u5AXG1hf485_0 2024-09-12T01:29:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.149+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18017914007519889639', time=2024-09-12T03:15:03.296886+0000, chain.objs.size()=1 2024-09-12T01:29:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.149+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.520__shadow:tg-IwlgzixYKpnYln8Ryp.NrZXenSn2_.I3a7kmZzhZLqS7vuapCYG4-BF7RpPkJ_0 2024-09-12T01:29:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8974057106305916042', time=2024-09-12T03:17:46.346528+0000, chain.objs.size()=1 2024-09-12T01:29:15.152 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:6TxXZ3slIc-0H1GlfrAHmOqY-4-9kF8_.kjfselXM4f4T8NoUy3spxEnd5zEkD62_0 2024-09-12T01:29:15.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4894875056331536146', time=2024-09-12T03:17:46.665278+0000, chain.objs.size()=1 2024-09-12T01:29:15.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:XjO94AdsVPQmtTQALymb76H9Vyr8b13_.F1zb69JgW1a3fdOb2ZwuIl2IbvdA4oc_0 2024-09-12T01:29:15.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9372613736200531434', time=2024-09-12T03:18:07.252179+0000, chain.objs.size()=1 2024-09-12T01:29:15.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.576__shadow:mE67jF2F8CVrT8pTGC0ufJFmVdtgpde_.9-5kwXWZDUiFRF6ECbmjaPrjjdgkVqV_0 2024-09-12T01:29:15.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5493241551559344422', time=2024-09-12T03:18:13.121404+0000, chain.objs.size()=1 2024-09-12T01:29:15.153 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:Hml2hf.e.zYlRz4KgBD1gUDpW1QqCw3_.DT4FkVI86XeXXEZpmnB16Dw4RLU1XyQ_0 2024-09-12T01:29:15.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16905444412209164899', time=2024-09-12T03:18:30.794183+0000, chain.objs.size()=1 2024-09-12T01:29:15.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:Uf5kRxuytnpdKgjjBT.qjKiPsjVRpQE_.bIv2VrKKWiEx9Yyf13oUyVGjwMdKkEZ_0 2024-09-12T01:29:15.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3757475886328048162', time=2024-09-12T03:18:48.488945+0000, chain.objs.size()=1 2024-09-12T01:29:15.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.579__shadow:goZh7MpyJES92gjJQ8h2jvY81hfABMH_.npIo5jNitfuW0HMWQVhdc71G-ENDvvW_0 2024-09-12T01:29:15.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10313838505732886944', time=2024-09-12T03:23:41.914375+0000, chain.objs.size()=1 2024-09-12T01:29:15.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.664__shadow_.9V6trvHJsLj8DE-UnLY7bXhB4p3jLHd_0 2024-09-12T01:29:15.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2720694111257787920', time=2024-09-12T03:23:58.156593+0000, chain.objs.size()=1 2024-09-12T01:29:15.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.150+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.694__shadow:FMqQ73xHwQukRQdHaeaoUwR2snn2cWw_.3q_4vDLtb7wiBHNcYrwptBtWEBJqWJL_0 2024-09-12T01:29:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.151+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6781198211616060725', time=2024-09-12T03:24:06.008677+0000, chain.objs.size()=1 2024-09-12T01:29:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.151+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.706__shadow_.eSaxWxiN2_6TOr1PugHIYiQeNSoyfq0_0 2024-09-12T01:29:15.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.155+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.157+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:29:15.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.159+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.159+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.160+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47816' 2024-09-12T01:29:15.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.160+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_qu8paZpwxXXshy-BWuax-A44wtoFJWB', time=2024-09-12T03:06:54.018673+0000, chain.objs.size()=2 2024-09-12T01:29:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.160+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__shadow_.hapv2D9aWl0eCswWjTXR1xaocnheU9j_0 2024-09-12T01:29:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.160+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__shadow_.hapv2D9aWl0eCswWjTXR1xaocnheU9j_1 2024-09-12T01:29:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_8aJvLHzchO40ZNKLPp5pVju3NVHGvAD', time=2024-09-12T03:06:54.046692+0000, chain.objs.size()=1 2024-09-12T01:29:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__shadow_.Yuw44SqdmOaAJeNdYAxO66aBDedR5qa_0 2024-09-12T01:29:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1521761111815427005', time=2024-09-12T03:06:56.437192+0000, chain.objs.size()=1 2024-09-12T01:29:15.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.162__shadow_.kczSVUqeUrZwk59IAmXCKULhckKuI3P_0 2024-09-12T01:29:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11500962780291041576', time=2024-09-12T03:08:59.052003+0000, chain.objs.size()=1 2024-09-12T01:29:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.237__shadow_.621rNqQfVYPQtKKXOPHql7K0ON4RkPU_0 2024-09-12T01:29:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3881292382908856868', time=2024-09-12T03:09:02.284103+0000, chain.objs.size()=1 2024-09-12T01:29:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.242__shadow_.Nb17CTBihILtwXv2mu9TwSeNdacPt6x_0 2024-09-12T01:29:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3037553246121387584', time=2024-09-12T03:09:03.163868+0000, chain.objs.size()=1 2024-09-12T01:29:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.243__shadow_.d3YqK6OAsp9J-_OH-uUdhP5wPPqIUNv_0 2024-09-12T01:29:15.164 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16047872741815480390', time=2024-09-12T03:09:14.939648+0000, chain.objs.size()=1 2024-09-12T01:29:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.261__shadow_.QCLwwn9AnKM-WkmcLhW8JM2BCJ3vf7I_0 2024-09-12T01:29:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6734780038714135930', time=2024-09-12T03:09:54.248323+0000, chain.objs.size()=1 2024-09-12T01:29:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8HUsdvDJ16QHVn1Vbl1rbUunespo_XC_0 2024-09-12T01:29:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15014429528932167851', time=2024-09-12T03:09:54.389330+0000, chain.objs.size()=1 2024-09-12T01:29:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.fsdIqWtwH-Vl3_-NSyxWYo3Z0T5xs14_0 2024-09-12T01:29:15.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3217741958164444023', time=2024-09-12T03:09:54.420938+0000, chain.objs.size()=1 2024-09-12T01:29:15.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ZM2YFDPyZj1qG-r9h3bCzZib4Q0d3pb_0 2024-09-12T01:29:15.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4225108912718074921', time=2024-09-12T03:09:54.421629+0000, chain.objs.size()=1 2024-09-12T01:29:15.166 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.161+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9jekvGXmrim5CKE9MlHq-FlKPCZirjW_0 2024-09-12T01:29:15.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10542325087086994455', time=2024-09-12T03:09:55.179823+0000, chain.objs.size()=1 2024-09-12T01:29:15.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.zuJWsChHHMmOW_3UxzeBZt4XPYrId2f_0 2024-09-12T01:29:15.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10201000085155997803', time=2024-09-12T03:09:56.411787+0000, chain.objs.size()=1 2024-09-12T01:29:15.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9u5y-MUOsgb57pKLih4lVTYEVP1qBX0_0 2024-09-12T01:29:15.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1827380607267415351', time=2024-09-12T03:09:56.692619+0000, chain.objs.size()=1 2024-09-12T01:29:15.167 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1w6NdEsXlEGWMyo2fuYZmR2GU0IQSHj_0 2024-09-12T01:29:15.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10242432807838474701', time=2024-09-12T03:09:57.121419+0000, chain.objs.size()=1 2024-09-12T01:29:15.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8dXyqxwxJ7ZTwSrNeRw2CRgQ0sV-azC_0 2024-09-12T01:29:15.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2509539797753341440', time=2024-09-12T03:09:58.304782+0000, chain.objs.size()=1 2024-09-12T01:29:15.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.SwGaPyjE__dKSjMkUMCzQ_ClVtKW9vZ_0 2024-09-12T01:29:15.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8881888882253035612', time=2024-09-12T03:09:58.426955+0000, chain.objs.size()=1 2024-09-12T01:29:15.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.A8Fbqwedhc87ztI3FBst3Wm-lN-FZ7D_0 2024-09-12T01:29:15.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7050762443632745208', time=2024-09-12T03:09:58.495282+0000, chain.objs.size()=1 2024-09-12T01:29:15.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QXfLU6RSGC_-elShpz0f4Tn_SZkdQ7m_0 2024-09-12T01:29:15.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10606122064173430403', time=2024-09-12T03:09:58.552186+0000, chain.objs.size()=1 2024-09-12T01:29:15.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.XE-JARgfXWtiOc2g5bjoN2a87fiSYCk_0 2024-09-12T01:29:15.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2478951409041572173', time=2024-09-12T03:09:59.596049+0000, chain.objs.size()=1 2024-09-12T01:29:15.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Et47q_nv284l-vZ_fNi6CeAKN6lFWDG_0 2024-09-12T01:29:15.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16846700881649036993', time=2024-09-12T03:09:59.596680+0000, chain.objs.size()=1 2024-09-12T01:29:15.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dIlVOGK_u3r2v-H7idn_B8YrCJpwyGi_0 2024-09-12T01:29:15.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10774358742184567316', time=2024-09-12T03:09:59.666548+0000, chain.objs.size()=1 2024-09-12T01:29:15.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.165+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.pnDshcelyVh_fSpMhaXgoA1iiXUbeO2_0 2024-09-12T01:29:15.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.167+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13002443670927256017', time=2024-09-12T03:10:00.086367+0000, chain.objs.size()=1 2024-09-12T01:29:15.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.167+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.tFXhy7QP17FJhDGzOZC1OfVrQuugQMa_0 2024-09-12T01:29:15.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.167+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16396391666251920963', time=2024-09-12T03:10:00.087419+0000, chain.objs.size()=1 2024-09-12T01:29:15.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.167+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.B5dcX3BfRvt5Xs--XgSgKZNueI__pM5_0 2024-09-12T01:29:15.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.168+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14954722159366157714', time=2024-09-12T03:10:01.265805+0000, chain.objs.size()=1 2024-09-12T01:29:15.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.nsgJqahV-l-vfIGEf2gz2_f0wHMiKv3_0 2024-09-12T01:29:15.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.168+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6561783273476106652', time=2024-09-12T03:10:01.329365+0000, chain.objs.size()=1 2024-09-12T01:29:15.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Lxkxqo9bRXQktrUwgjTnpAWzZTFhgxj_0 2024-09-12T01:29:15.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.168+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15598446503442172523', time=2024-09-12T03:10:01.551974+0000, chain.objs.size()=1 2024-09-12T01:29:15.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.c8Z45mwA6n7k7IYiXEMJUoxbx_IzgQu_0 2024-09-12T01:29:15.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.168+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13979945884291816383', time=2024-09-12T03:10:01.901495+0000, chain.objs.size()=1 2024-09-12T01:29:15.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.elzbSH-ZZHrNq-NEwfc-9eWAaHP54BL_0 2024-09-12T01:29:15.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.169+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.712546143655203956', time=2024-09-12T03:10:02.666421+0000, chain.objs.size()=1 2024-09-12T01:29:15.174 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.169+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dKBn3vwVZFmCQz7VoMA-HpyvWuoL5AH_0 2024-09-12T01:29:15.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.169+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6260807513676467131', time=2024-09-12T03:10:03.051953+0000, chain.objs.size()=1 2024-09-12T01:29:15.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.169+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.3hKI0_QnAnbTF5Ztm9O0o4RZxCcHss6_0 2024-09-12T01:29:15.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.169+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15799743373251656105', time=2024-09-12T03:10:03.615742+0000, chain.objs.size()=1 2024-09-12T01:29:15.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.169+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.qb3xQNRaaRnNB9r0ThviykDAVj68KBQ_0 2024-09-12T01:29:15.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.169+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5436456485577458380', time=2024-09-12T03:10:04.247945+0000, chain.objs.size()=1 2024-09-12T01:29:15.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.169+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.SR7nwVdC3ZM741CPBC72s8zapWkUAn9_0 2024-09-12T01:29:15.175 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.169+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15103040708396996458', time=2024-09-12T03:10:04.570574+0000, chain.objs.size()=1 2024-09-12T01:29:15.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.169+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9bkNZcfWETznCsYmL17U_NQBsDJFwfq_0 2024-09-12T01:29:15.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.171+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10774640876499098356', time=2024-09-12T03:10:04.999149+0000, chain.objs.size()=1 2024-09-12T01:29:15.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.171+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.sVrU3HF76Qnq9jUR7jzIN3u8wO_4d2C_0 2024-09-12T01:29:15.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.172+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16439970298089696636', time=2024-09-12T03:10:05.328724+0000, chain.objs.size()=1 2024-09-12T01:29:15.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.172+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.qBQPIP_WBWOK3Ae--HzyIpUgij2Tg1x_0 2024-09-12T01:29:15.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.173+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11391532455818284631', time=2024-09-12T03:10:05.329491+0000, chain.objs.size()=1 2024-09-12T01:29:15.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.173+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ya1eNPmDnBAlL-kkUjdc-qPB-x6dLah_0 2024-09-12T01:29:15.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.173+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9022028551253093402', time=2024-09-12T03:10:06.029964+0000, chain.objs.size()=1 2024-09-12T01:29:15.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.173+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PO5Y6bAKNFUfyDb38Aihm0DPj7SbNZp_0 2024-09-12T01:29:15.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.173+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1258800093649563833', time=2024-09-12T03:10:06.557630+0000, chain.objs.size()=1 2024-09-12T01:29:15.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.173+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.DD_K_qH5BltpX-Yno5bbTufx8ewHAd2_0 2024-09-12T01:29:15.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.173+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6234032965509418974', time=2024-09-12T03:10:06.587572+0000, chain.objs.size()=1 2024-09-12T01:29:15.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.173+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.bqgqgi7-zZ5OEkeHimrP9xxQe4Im0oa_0 2024-09-12T01:29:15.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.175+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4522156404558822068', time=2024-09-12T03:10:09.112006+0000, chain.objs.size()=1 2024-09-12T01:29:15.179 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.175+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.266__shadow_.DyJG8iK-6pyYqhbMRiS6bILd7OyUz0V_0 2024-09-12T01:29:15.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.175+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12581639786748378728', time=2024-09-12T03:10:27.046505+0000, chain.objs.size()=1 2024-09-12T01:29:15.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.175+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.Nwh3zk4NPTz0dDereDUwH-LNghgj-ct_0 2024-09-12T01:29:15.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.175+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17597067808992086438', time=2024-09-12T03:10:29.060173+0000, chain.objs.size()=1 2024-09-12T01:29:15.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.175+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.5WM1f0pfORbk9RzT_IDDZjgm0j4e7_H_0 2024-09-12T01:29:15.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.175+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5446490297042141615', time=2024-09-12T03:10:29.086874+0000, chain.objs.size()=1 2024-09-12T01:29:15.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.175+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.mTLtQMaYmy11jVUlLh7rdbKluVdmoyj_0 2024-09-12T01:29:15.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.175+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5466266422554985159', time=2024-09-12T03:10:32.537166+0000, chain.objs.size()=1 2024-09-12T01:29:15.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.175+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.298__shadow_.LnAA76yYwal2M7WHR4AFj5po22ubTBx_0 2024-09-12T01:29:15.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.177+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9898245250080974126', time=2024-09-12T03:10:36.473499+0000, chain.objs.size()=1 2024-09-12T01:29:15.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.177+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.304__shadow_.JNbE-dNhW8C7kHpXcZb6_DIHveV4SWj_0 2024-09-12T01:29:15.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.177+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7108665612168054283', time=2024-09-12T03:10:37.998165+0000, chain.objs.size()=1 2024-09-12T01:29:15.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.177+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.306__shadow_.jiFFyfz2gySkKJ--T3hYAzDmlPjCUL2_0 2024-09-12T01:29:15.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.177+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7057633751440119039', time=2024-09-12T03:10:39.120389+0000, chain.objs.size()=1 2024-09-12T01:29:15.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.177+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.307__shadow:oBV5MU27A6DMDmqFN012mUYMv7C2D0D_.zbhNk09mzCde6We-Bu_GSFyl4ccxX_O_0 2024-09-12T01:29:15.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.177+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10320819089100811680', time=2024-09-12T03:11:29.499008+0000, chain.objs.size()=1 2024-09-12T01:29:15.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.177+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.NcPFK6o6Ne-XZK35zP_P3rhuE4Hl7Xg_0 2024-09-12T01:29:15.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.177+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.944096319090756597', time=2024-09-12T03:11:29.626980+0000, chain.objs.size()=1 2024-09-12T01:29:15.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.177+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ixtrAgoJT0PtcbzOyGMEBS0SrJD0XOt_0 2024-09-12T01:29:15.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.177+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12364549610191451082', time=2024-09-12T03:11:29.627508+0000, chain.objs.size()=1 2024-09-12T01:29:15.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.177+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.QII2wUySW60buo3VMXRqFT_RR4s8VtB_0 2024-09-12T01:29:15.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.177+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14442023887507197449', time=2024-09-12T03:11:30.527664+0000, chain.objs.size()=1 2024-09-12T01:29:15.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.177+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.dab3p8DOPgMiJl82IncNd5isnK4MRBk_0 2024-09-12T01:29:15.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.178+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.990661548528718732', time=2024-09-12T03:11:31.097312+0000, chain.objs.size()=1 2024-09-12T01:29:15.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.178+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.kW30ZBbMBYCtjFMwR6qSmi8_MvaJYkG_0 2024-09-12T01:29:15.184 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.178+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18308775841202946307', time=2024-09-12T03:11:31.381248+0000, chain.objs.size()=1 2024-09-12T01:29:15.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.178+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xKWq3CCKnYW8kitiRYeuj_eGRabRRsS_0 2024-09-12T01:29:15.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.178+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1418493359870507595', time=2024-09-12T03:11:31.841179+0000, chain.objs.size()=1 2024-09-12T01:29:15.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.178+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.o5ugYE7clrch-kd0YAPQkkEX8ancMhz_0 2024-09-12T01:29:15.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.179+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8336787538701877119', time=2024-09-12T03:11:31.985254+0000, chain.objs.size()=1 2024-09-12T01:29:15.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.179+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.90Jfc1zVZJZhpPmwyHDNUFjN6WhkowC_0 2024-09-12T01:29:15.185 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4320887091475168188', time=2024-09-12T03:11:32.028614+0000, chain.objs.size()=1 2024-09-12T01:29:15.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.jdJvRiTUz_KF-IYPVJMIR67V3WdRapK_0 2024-09-12T01:29:15.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14218476512097766127', time=2024-09-12T03:11:32.048818+0000, chain.objs.size()=1 2024-09-12T01:29:15.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MHBnoB2Utibt6ud4Z3NQAaFmCR5aem1_0 2024-09-12T01:29:15.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8962000280694374669', time=2024-09-12T03:11:33.254545+0000, chain.objs.size()=1 2024-09-12T01:29:15.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.0O5ZqKIVnoPz1kV-Mo2wz8M1ipYDKEE_0 2024-09-12T01:29:15.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.888579822429050292', time=2024-09-12T03:11:33.266827+0000, chain.objs.size()=1 2024-09-12T01:29:15.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ZvRzu5bkg9Tjb3FR6qn4l_-KUzL9y7h_0 2024-09-12T01:29:15.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14324018600167575071', time=2024-09-12T03:11:34.429270+0000, chain.objs.size()=1 2024-09-12T01:29:15.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.yRjt-JqaGPxeQDdbrd5gupUWFITvqMo_0 2024-09-12T01:29:15.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2828278362736011209', time=2024-09-12T03:11:34.484443+0000, chain.objs.size()=1 2024-09-12T01:29:15.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.NxF7sYGNEpMmR3u-2YwF_4Q2IoKFPIx_0 2024-09-12T01:29:15.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13993760011671648945', time=2024-09-12T03:11:34.553547+0000, chain.objs.size()=1 2024-09-12T01:29:15.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.uq5eN1yYtHM_UTrRrKAfZPfWf_G8GiN_0 2024-09-12T01:29:15.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5344738117772005549', time=2024-09-12T03:11:34.682111+0000, chain.objs.size()=1 2024-09-12T01:29:15.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-OKu4ocIuw8zrzazsjiFyK7ce3wimTh_0 2024-09-12T01:29:15.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11693566905423814487', time=2024-09-12T03:11:35.491587+0000, chain.objs.size()=1 2024-09-12T01:29:15.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.DiMgcch2FZQejHYNWp5tJTSBiq7t35R_0 2024-09-12T01:29:15.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14047227803638577873', time=2024-09-12T03:11:36.085232+0000, chain.objs.size()=1 2024-09-12T01:29:15.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.8VNt8bEEq6pE2eqn1wt9HwewgKfVDdK_0 2024-09-12T01:29:15.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17711726128827971265', time=2024-09-12T03:11:36.227236+0000, chain.objs.size()=1 2024-09-12T01:29:15.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.183+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.iWGNPdPx8iu7FaLXIGIeDeem_CbseHE_0 2024-09-12T01:29:15.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6045644804676225941', time=2024-09-12T03:11:36.991936+0000, chain.objs.size()=1 2024-09-12T01:29:15.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.V-rtPUscHtpuPRN7WpF9jhLg3Phja2L_0 2024-09-12T01:29:15.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15906966305631128079', time=2024-09-12T03:11:37.102922+0000, chain.objs.size()=1 2024-09-12T01:29:15.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.yK970FXwJW2SQo7C5_Y12U1wfgMktd3_0 2024-09-12T01:29:15.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6319539731204208633', time=2024-09-12T03:11:37.161631+0000, chain.objs.size()=1 2024-09-12T01:29:15.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.WMaP8fMN1G_kUPx3ArwGb7-Tcda_GRO_0 2024-09-12T01:29:15.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3780007035877212560', time=2024-09-12T03:11:37.670091+0000, chain.objs.size()=1 2024-09-12T01:29:15.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xDJOyUfKRPMOCj6HaUfi_VtMSXBiGxG_0 2024-09-12T01:29:15.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11220826884583700937', time=2024-09-12T03:11:38.215439+0000, chain.objs.size()=1 2024-09-12T01:29:15.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2HClebLbDk6YD4RqipdN7nXLOVzX_dV_0 2024-09-12T01:29:15.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17543944413820322379', time=2024-09-12T03:11:39.350216+0000, chain.objs.size()=1 2024-09-12T01:29:15.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.U9UQzVxnq5TE1DY75jFlF3qJrtuwR0N_0 2024-09-12T01:29:15.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12779849160796392096', time=2024-09-12T03:11:40.120975+0000, chain.objs.size()=1 2024-09-12T01:29:15.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.A8B6fgmn0zhuQC6YWzoJYPl4H3msm1F_0 2024-09-12T01:29:15.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1764064713232510881', time=2024-09-12T03:11:40.267611+0000, chain.objs.size()=1 2024-09-12T01:29:15.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.186+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xIac3Fz2HC8QEyr9XI9JDvHdurZa23X_0 2024-09-12T01:29:15.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.187+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8686127755359130689', time=2024-09-12T03:11:40.695648+0000, chain.objs.size()=1 2024-09-12T01:29:15.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.187+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Z4Zz497-iWMXBGuzs8pYGhd3GBnM0mr_0 2024-09-12T01:29:15.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.188+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14561509068949060223', time=2024-09-12T03:11:40.844883+0000, chain.objs.size()=1 2024-09-12T01:29:15.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.188+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fxuLLx2QxNS0fN5ubDxFvfLYbbQmjN__0 2024-09-12T01:29:15.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.188+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3384519409617683406', time=2024-09-12T03:11:40.895746+0000, chain.objs.size()=1 2024-09-12T01:29:15.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.188+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.BlpLFyDIC6ftDv3xm52AMnNtkq_o3WI_0 2024-09-12T01:29:15.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.190+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7039479587922000912', time=2024-09-12T03:11:41.022064+0000, chain.objs.size()=1 2024-09-12T01:29:15.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.190+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.K08xFRRDe07_fKYKCfFl8x-t62bYR0j_0 2024-09-12T01:29:15.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.191+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3563392479130647154', time=2024-09-12T03:11:41.507248+0000, chain.objs.size()=1 2024-09-12T01:29:15.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.191+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.BqTs1tidFR95vsBwj8rxgsQzEde_W4B_0 2024-09-12T01:29:15.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.191+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11001635286490858864', time=2024-09-12T03:11:41.609995+0000, chain.objs.size()=1 2024-09-12T01:29:15.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.191+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.DOYTFyaCGC7x_S1TKEutZ43JOnzXM7j_0 2024-09-12T01:29:15.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.191+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16157179061022062497', time=2024-09-12T03:12:21.823922+0000, chain.objs.size()=1 2024-09-12T01:29:15.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.191+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MzsAqsNNANKCTfC7yLqG6WRbdR7inIK_0 2024-09-12T01:29:15.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.191+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11060323158134245916', time=2024-09-12T03:12:22.357677+0000, chain.objs.size()=1 2024-09-12T01:29:15.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.191+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.VIzTyGwn_11pZOrJRkmlsGTtL4Vv83L_0 2024-09-12T01:29:15.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.192+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10675969705391563991', time=2024-09-12T03:12:22.470190+0000, chain.objs.size()=1 2024-09-12T01:29:15.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.192+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.SVkAvaYohFw4LOSq5L3ZY7uWU-ty5WE_0 2024-09-12T01:29:15.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.192+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8592051601708668391', time=2024-09-12T03:12:22.484698+0000, chain.objs.size()=1 2024-09-12T01:29:15.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.192+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-hJnAmh12eYVXw-Xyy0FpPZ_j823psh_0 2024-09-12T01:29:15.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.192+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17718616098414281666', time=2024-09-12T03:12:22.643141+0000, chain.objs.size()=1 2024-09-12T01:29:15.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.192+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.cRYfQlqvRv8SzEYDvzIs8bWAWjDSEDS_0 2024-09-12T01:29:15.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.192+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18340722869698895037', time=2024-09-12T03:12:22.809064+0000, chain.objs.size()=1 2024-09-12T01:29:15.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.192+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1XxkbRtgaZGJVHZU78T1fK2Yo6EPiGF_0 2024-09-12T01:29:15.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.192+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8150485195666307015', time=2024-09-12T03:12:24.187317+0000, chain.objs.size()=1 2024-09-12T01:29:15.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.192+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.So-JWmKNY863t0MsrnT3bRaxXGeDnGM_0 2024-09-12T01:29:15.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.192+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7525695137598005255', time=2024-09-12T03:12:24.193875+0000, chain.objs.size()=1 2024-09-12T01:29:15.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.192+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.E24XDkZQ2ShMfSnC2r0js79qVKrYIPk_0 2024-09-12T01:29:15.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.193+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10244429482892293600', time=2024-09-12T03:12:24.800820+0000, chain.objs.size()=1 2024-09-12T01:29:15.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.193+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.S9HKrIxA97Hm4X6MIBld5A1zdmlquFu_0 2024-09-12T01:29:15.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.195+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1443678880109760737', time=2024-09-12T03:12:26.042869+0000, chain.objs.size()=1 2024-09-12T01:29:15.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.195+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mp25_uTha6xpcQgH23aa8IEinagAP1k_0 2024-09-12T01:29:15.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16911283427286233477', time=2024-09-12T03:12:26.195349+0000, chain.objs.size()=1 2024-09-12T01:29:15.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.cqXJV1Y9LLQBffcgnCz2HV3XuDvqnva_0 2024-09-12T01:29:15.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2126854839045234148', time=2024-09-12T03:12:27.085389+0000, chain.objs.size()=1 2024-09-12T01:29:15.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.kRMcWYoqHZk42p1n4TL-dP-5wYG0jYg_0 2024-09-12T01:29:15.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9745322223853584656', time=2024-09-12T03:12:27.086026+0000, chain.objs.size()=1 2024-09-12T01:29:15.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ICfQPL-Sf7Fvda3zoSzGQ0KMl9Na1Xt_0 2024-09-12T01:29:15.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12409692380426771500', time=2024-09-12T03:12:27.634160+0000, chain.objs.size()=1 2024-09-12T01:29:15.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.NdXjlOChrRzCKlUAoM5gQWsdnS0m4a8_0 2024-09-12T01:29:15.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10402312041156163710', time=2024-09-12T03:12:28.102519+0000, chain.objs.size()=1 2024-09-12T01:29:15.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.IhjWF3NDXi2c5ncomvGR5J9vAl104d5_0 2024-09-12T01:29:15.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4742383198802615463', time=2024-09-12T03:12:28.729300+0000, chain.objs.size()=1 2024-09-12T01:29:15.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.se21atFxERCZy9F61njj2ndAIsoOTpU_0 2024-09-12T01:29:15.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15436906073296464981', time=2024-09-12T03:12:28.754879+0000, chain.objs.size()=1 2024-09-12T01:29:15.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.q86sDfP3-ar2t5ZHy3gxkHu1oQZSNTy_0 2024-09-12T01:29:15.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12197474757842960282', time=2024-09-12T03:12:28.926095+0000, chain.objs.size()=1 2024-09-12T01:29:15.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.sejj6WMKDkKdorg-nGUeS7asTeIb3WP_0 2024-09-12T01:29:15.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15046854745649020609', time=2024-09-12T03:12:31.349852+0000, chain.objs.size()=1 2024-09-12T01:29:15.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.rQweZV0RuqF_QavqbdQU7fefrlJQHQE_0 2024-09-12T01:29:15.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7978118919381308525', time=2024-09-12T03:12:31.504538+0000, chain.objs.size()=1 2024-09-12T01:29:15.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.196+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.tfMTz5njzcLphhZEMNzzTDpg6_SNjom_0 2024-09-12T01:29:15.202 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.202+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/47816 2024-09-12T01:29:15.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T01:29:15.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9438716643438521452', time=2024-09-12T03:12:32.143476+0000, chain.objs.size()=1 2024-09-12T01:29:15.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-8SnM5nmI4RC7t8EmJsCPJJG-7AIQG7_0 2024-09-12T01:29:15.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8205844697159896302', time=2024-09-12T03:12:32.354824+0000, chain.objs.size()=1 2024-09-12T01:29:15.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.JimVD1Gd6ph3BIWgf9XvrJwQnt7lwHM_0 2024-09-12T01:29:15.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11384336675724948865', time=2024-09-12T03:12:32.735683+0000, chain.objs.size()=1 2024-09-12T01:29:15.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Vvwvofgkl_eDkfYXgl8XkT6jdYqcS36_0 2024-09-12T01:29:15.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4341812114697930785', time=2024-09-12T03:12:32.962649+0000, chain.objs.size()=1 2024-09-12T01:29:15.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.39NoCzz0zGl0BI-q0n-mP68wgjnt2N9_0 2024-09-12T01:29:15.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11858171187351004713', time=2024-09-12T03:12:33.226744+0000, chain.objs.size()=1 2024-09-12T01:29:15.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.HatbeOvOYtPMiSSz6iSaiUEc9A91Xer_0 2024-09-12T01:29:15.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15353862795566498708', time=2024-09-12T03:12:34.018149+0000, chain.objs.size()=1 2024-09-12T01:29:15.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.IARBTCBYgSk1fPi7M7r8ApCdgPtGWZc_0 2024-09-12T01:29:15.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8946996770926066292', time=2024-09-12T03:13:47.242013+0000, chain.objs.size()=1 2024-09-12T01:29:15.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.454__shadow_.W7FPcUwavqfjgF-EZRBYAuHPuuwqEtE_0 2024-09-12T01:29:15.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14410169942418367198', time=2024-09-12T03:13:55.558059+0000, chain.objs.size()=1 2024-09-12T01:29:15.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.464__shadow_.TmZRSSRF0R3c65jXT4gBwr6_e-dlJBb_0 2024-09-12T01:29:15.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8134033119532349800', time=2024-09-12T03:13:56.559534+0000, chain.objs.size()=1 2024-09-12T01:29:15.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.465__shadow_.4sufb8_-YyrAsjUJjyrwfaelnFSpnAI_0 2024-09-12T01:29:15.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2387464211069882980', time=2024-09-12T03:14:11.825410+0000, chain.objs.size()=1 2024-09-12T01:29:15.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.490__shadow_.9MgGH_aasQgnYZDpgOMhEJOGij7HHKp_0 2024-09-12T01:29:15.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2387464211069882980', time=2024-09-12T03:14:12.023469+0000, chain.objs.size()=1 2024-09-12T01:29:15.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.490__shadow_.9MgGH_aasQgnYZDpgOMhEJOGij7HHKp_0 2024-09-12T01:29:15.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9305921258483142090', time=2024-09-12T03:14:19.827126+0000, chain.objs.size()=1 2024-09-12T01:29:15.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.204+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.503__shadow:Dp2Xh3PCmOVDZq0qVeIVb0wIZKi8rqS_.nA7nRfHdVh5iLsyVm5W5cePiSTckNJe_0 2024-09-12T01:29:15.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.207+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17081743425401498456', time=2024-09-12T03:14:19.830896+0000, chain.objs.size()=1 2024-09-12T01:29:15.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.207+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.503__shadow:Dp2Xh3PCmOVDZq0qVeIVb0wIZKi8rqS_.nA7nRfHdVh5iLsyVm5W5cePiSTckNJe_0 2024-09-12T01:29:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.207+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~wONJy2CuUjug1bGpCPt46PUWSMvpwGl', time=2024-09-12T03:15:08.524129+0000, chain.objs.size()=1 2024-09-12T01:29:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.207+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~wONJy2CuUjug1bGpCPt46PUWSMvpwGl.1 2024-09-12T01:29:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.207+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7504512190980818740', time=2024-09-12T03:17:53.012775+0000, chain.objs.size()=1 2024-09-12T01:29:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.207+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:aYuBZZu2nhU6HNRvxKHYviEKI4ngANt_.0nyYs1Nv5KGYFoxdAEdrXxpUR0OvEqJ_0 2024-09-12T01:29:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.207+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15023163155574985477', time=2024-09-12T03:18:06.120772+0000, chain.objs.size()=1 2024-09-12T01:29:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.207+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.575__shadow:ue.lAhRMZk6wcPabbfVkcropzaGh50g_.qTIqq8exi2soHLvGfp1Lu5u7wK1jRJm_0 2024-09-12T01:29:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5370558477800207257', time=2024-09-12T03:18:25.425959+0000, chain.objs.size()=1 2024-09-12T01:29:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:IMZLurZ8Zf-NlSMjlW97dbyBigYqLSg_.2bQJWyPjz1J1C6n8VbQ-RflV1wYZAZA_0 2024-09-12T01:29:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1061772609360945763', time=2024-09-12T03:18:27.649774+0000, chain.objs.size()=1 2024-09-12T01:29:15.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:9oXs0KQQJZluPodDwNCqpQ.89E5h58o_.j4MItFyZWiZSNm9hjWgMrT5qMkJHKIV_0 2024-09-12T01:29:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4347604466737639320', time=2024-09-12T03:18:31.454222+0000, chain.objs.size()=1 2024-09-12T01:29:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:x.nRTm7NmUyZWtjEvf-13vRkD.Or1eW_.ziOHsE9bmvlHIra7bWALtg0srJF3aQ7_0 2024-09-12T01:29:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8680353654925772201', time=2024-09-12T03:18:48.433416+0000, chain.objs.size()=1 2024-09-12T01:29:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.579__shadow:RGXviG8Eyo4tL3b.qOgAD-FLwWxZuhL_._w2yvIWSbBhaQ925RKMDfhPanBUSUig_0 2024-09-12T01:29:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2278341509594550538', time=2024-09-12T03:22:59.681128+0000, chain.objs.size()=1 2024-09-12T01:29:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.633__shadow_.sBBmnCAlw4zjBiPriCnLddGH1oDlbv9_0 2024-09-12T01:29:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14467202546482486450', time=2024-09-12T03:23:23.224864+0000, chain.objs.size()=1 2024-09-12T01:29:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.655__shadow_.14gODeM9lOE_f1gdD6ib1Vp99fWVfnk_0 2024-09-12T01:29:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3936124078183558756', time=2024-09-12T03:23:41.909538+0000, chain.objs.size()=1 2024-09-12T01:29:15.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.664__shadow_.vGqxd7JAjnBhQ6Wmli0Cmxce7Z47vAB_0 2024-09-12T01:29:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.210+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4506477273967962655', time=2024-09-12T03:23:43.859588+0000, chain.objs.size()=1 2024-09-12T01:29:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.210+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.666__shadow_.LVUYFWP-ewWs2oEdnJEWvQTmQrIA0JR_0 2024-09-12T01:29:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.211+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17809328102409881960', time=2024-09-12T03:23:44.041316+0000, chain.objs.size()=1 2024-09-12T01:29:15.211 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.211+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.666__shadow_.o2gwzeKkn8xyZMI29HrcIaUG2-kNHqh_0 2024-09-12T01:29:15.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.213+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.215+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:29:15.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.216+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.217+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45185' 2024-09-12T01:29:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4723327783031834143', time=2024-09-12T03:06:53.189888+0000, chain.objs.size()=3 2024-09-12T01:29:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__multipart_foo-FROZEN.2~qCa0jsQNHwCSCEYeZcyTBSGrpcJV68F.1 2024-09-12T01:29:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__multipart_foo-FROZEN.2~qCa0jsQNHwCSCEYeZcyTBSGrpcJV68F.2 2024-09-12T01:29:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__multipart_foo-FROZEN.2~qCa0jsQNHwCSCEYeZcyTBSGrpcJV68F.3 2024-09-12T01:29:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12074493978243507374', time=2024-09-12T03:07:12.437654+0000, chain.objs.size()=1 2024-09-12T01:29:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.189__shadow_.NvSeD4YADOlsImJyAeAJOWGpoUa75ee_0 2024-09-12T01:29:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8000268464542459376', time=2024-09-12T03:08:58.145341+0000, chain.objs.size()=1 2024-09-12T01:29:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.236__shadow_.hX7iw7-UFcCosfPm7Bs5vuhYxAaCWoL_0 2024-09-12T01:29:15.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18341658475516321677', time=2024-09-12T03:09:07.934584+0000, chain.objs.size()=1 2024-09-12T01:29:15.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.250__shadow_.gLSOJzibYNFtig4M2EkZ5D4uVv8IQj3_0 2024-09-12T01:29:15.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9123421754347472376', time=2024-09-12T03:09:08.595507+0000, chain.objs.size()=1 2024-09-12T01:29:15.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.251__shadow_.V68dGRbf0dLSCvyf0JOA0P-EdrrSQNc_0 2024-09-12T01:29:15.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7212583326600112285', time=2024-09-12T03:09:09.225703+0000, chain.objs.size()=1 2024-09-12T01:29:15.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.252__shadow_.ars0i5qO18QWQYFRmI3pHMnTvXF_Mr6_0 2024-09-12T01:29:15.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16576778081481715100', time=2024-09-12T03:09:11.828101+0000, chain.objs.size()=1 2024-09-12T01:29:15.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.256__shadow_.qPGshjKFmUj8JGpPOd4jJXoS4fPCBgu_0 2024-09-12T01:29:15.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10881807142784133825', time=2024-09-12T03:09:14.282017+0000, chain.objs.size()=1 2024-09-12T01:29:15.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.260__shadow_.SbnliFqpBBOrX57xxgklrF-ASh90T0__0 2024-09-12T01:29:15.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2618405166396891345', time=2024-09-12T03:09:54.840695+0000, chain.objs.size()=1 2024-09-12T01:29:15.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.zXTcj8UBOvxueCshZha67KpyoFZrtP9_0 2024-09-12T01:29:15.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2766343738845043110', time=2024-09-12T03:09:54.858285+0000, chain.objs.size()=1 2024-09-12T01:29:15.221 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.a3RmJf-HjKeznFL6LgN6cQq4aZ0eeit_0 2024-09-12T01:29:15.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.222+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3970099992092620932', time=2024-09-12T03:09:55.267858+0000, chain.objs.size()=1 2024-09-12T01:29:15.222 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.222+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.-VZqYQ3MIkqQqf3ZFZCef_L1fj3sJbB_0 2024-09-12T01:29:15.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18331939625058094040', time=2024-09-12T03:09:55.466234+0000, chain.objs.size()=1 2024-09-12T01:29:15.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.K48qsAkYGnCpetbfrVP2lalpnsTWyCj_0 2024-09-12T01:29:15.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12373725647697642562', time=2024-09-12T03:09:56.065667+0000, chain.objs.size()=1 2024-09-12T01:29:15.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.4AzQZnqM-I8E4fLGvN_2ljo2HB1b4na_0 2024-09-12T01:29:15.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2785507216838619390', time=2024-09-12T03:09:56.283670+0000, chain.objs.size()=1 2024-09-12T01:29:15.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1Fa4t1LV_EpDwZwZGxregoqYcvxe_y0_0 2024-09-12T01:29:15.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18391909088464407821', time=2024-09-12T03:09:56.754594+0000, chain.objs.size()=1 2024-09-12T01:29:15.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.zJcCRouu0r_FBBS60lAitER5YONKBRX_0 2024-09-12T01:29:15.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5213073333822685680', time=2024-09-12T03:09:56.961494+0000, chain.objs.size()=1 2024-09-12T01:29:15.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.AO37EMw6ASFjswqfvhw8wl88f2S1yYW_0 2024-09-12T01:29:15.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.467746334956428398', time=2024-09-12T03:09:58.100009+0000, chain.objs.size()=1 2024-09-12T01:29:15.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.b3SAxZcIdSVNG2XZJjzn8QlC79ttJtY_0 2024-09-12T01:29:15.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8123349448660566523', time=2024-09-12T03:09:58.717036+0000, chain.objs.size()=1 2024-09-12T01:29:15.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.29dk7crLRznYf2JNPibh_pjgUj_jH0T_0 2024-09-12T01:29:15.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1228420832826908612', time=2024-09-12T03:09:59.507076+0000, chain.objs.size()=1 2024-09-12T01:29:15.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.KtIPke6mA01qtVLv_mQFkGWwkAX3bIf_0 2024-09-12T01:29:15.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8889745695198361991', time=2024-09-12T03:09:59.802049+0000, chain.objs.size()=1 2024-09-12T01:29:15.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.B5f9Fyg8TNyBkm0NjnyFII-aTPAepsb_0 2024-09-12T01:29:15.224 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13263030114089584974', time=2024-09-12T03:10:00.089065+0000, chain.objs.size()=1 2024-09-12T01:29:15.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.223+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.VqRA0FXNQekSAnaEsZd7dUegOF0FM7__0 2024-09-12T01:29:15.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.225+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1002521890733796517', time=2024-09-12T03:10:00.089872+0000, chain.objs.size()=1 2024-09-12T01:29:15.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.225+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.3kaRpUOXM0OOnW0BueQ5Np11hpyYZ40_0 2024-09-12T01:29:15.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.226+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11751053063731124598', time=2024-09-12T03:10:00.578114+0000, chain.objs.size()=1 2024-09-12T01:29:15.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.226+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.YUFz4Q75OJFMWmHTkNXMV20qtNF48g9_0 2024-09-12T01:29:15.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.226+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6098540710829985998', time=2024-09-12T03:10:01.208440+0000, chain.objs.size()=1 2024-09-12T01:29:15.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.226+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.SDHsfxnd1sNweKvaXiMKVs1xuxGEBMP_0 2024-09-12T01:29:15.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.226+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9069120218952120763', time=2024-09-12T03:10:01.528829+0000, chain.objs.size()=1 2024-09-12T01:29:15.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.226+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.cM1tpJrMTj3MnfwRqjY1Z59T4cxG9ma_0 2024-09-12T01:29:15.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.227+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11594746163057229125', time=2024-09-12T03:10:01.708211+0000, chain.objs.size()=1 2024-09-12T01:29:15.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.227+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.AXnOzPI5eM7THVe_XHiZ0JP9XI-0XbD_0 2024-09-12T01:29:15.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.227+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18192152504764937513', time=2024-09-12T03:10:02.213774+0000, chain.objs.size()=1 2024-09-12T01:29:15.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.227+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.nociBFUl90p51jXKxez3K0kov6RN42B_0 2024-09-12T01:29:15.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.227+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.629454323824998071', time=2024-09-12T03:10:02.273231+0000, chain.objs.size()=1 2024-09-12T01:29:15.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.227+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0VWjcg8LcIfmFZvnxTFLZsZG_GTP8U5_0 2024-09-12T01:29:15.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.229+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3315903604724464184', time=2024-09-12T03:10:02.814691+0000, chain.objs.size()=1 2024-09-12T01:29:15.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.229+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.AQOB9moc2dityo3gXNUR6w4-cHDpeEK_0 2024-09-12T01:29:15.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.229+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13839150083035801726', time=2024-09-12T03:10:03.178035+0000, chain.objs.size()=1 2024-09-12T01:29:15.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.229+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0Fmp1yj6B9gx03XTrMZnlfKNJBMEXef_0 2024-09-12T01:29:15.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.229+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1446489925990399002', time=2024-09-12T03:10:03.315318+0000, chain.objs.size()=1 2024-09-12T01:29:15.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.229+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.KYahdNkLomkzxRi3M5SOjUKzkN1gr6l_0 2024-09-12T01:29:15.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.229+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10553711153817010384', time=2024-09-12T03:10:03.467819+0000, chain.objs.size()=1 2024-09-12T01:29:15.231 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.229+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.jPYgoXgqmKxRxrNeY5-g8wZMEqDsiLK_0 2024-09-12T01:29:15.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.229+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9499223164495657350', time=2024-09-12T03:10:04.355458+0000, chain.objs.size()=1 2024-09-12T01:29:15.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.229+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Y6Voe5sh1geYNGzxMlm6VvkhWxOZweO_0 2024-09-12T01:29:15.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.230+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12572220536225883186', time=2024-09-12T03:10:04.877176+0000, chain.objs.size()=1 2024-09-12T01:29:15.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.230+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.NvIPOES24d_fewBnj4zGp9mfO7O_Wyr_0 2024-09-12T01:29:15.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.230+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2648012765881719658', time=2024-09-12T03:10:04.878099+0000, chain.objs.size()=1 2024-09-12T01:29:15.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.230+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.bLAcAvK-6-nQsXWdOtacB7SCLTYLjWH_0 2024-09-12T01:29:15.232 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.231+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14189891228056155235', time=2024-09-12T03:10:05.040620+0000, chain.objs.size()=1 2024-09-12T01:29:15.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.231+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.MSZfXRY6QPJHRgBtOue7GcEDTnMQ6eW_0 2024-09-12T01:29:15.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.231+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9771483029276117713', time=2024-09-12T03:10:05.396706+0000, chain.objs.size()=1 2024-09-12T01:29:15.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.231+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Eob2sbgPJqvYIKuSCgM1lnxgci2rKcr_0 2024-09-12T01:29:15.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.232+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4234008676438454792', time=2024-09-12T03:10:05.995011+0000, chain.objs.size()=1 2024-09-12T01:29:15.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.232+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QlrOILZkD5TRgfMGQMiTBYgef1L-yyd_0 2024-09-12T01:29:15.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.233+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16183472708675134487', time=2024-09-12T03:10:19.122402+0000, chain.objs.size()=1 2024-09-12T01:29:15.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.233+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.282__shadow_.GU5KTFNDrst4dTs0_EknyjXTFJfuqwH_0 2024-09-12T01:29:15.233 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.233+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.842758308905520176', time=2024-09-12T03:10:24.384734+0000, chain.objs.size()=1 2024-09-12T01:29:15.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.233+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.290__shadow_.YL3uaBkm0mFZM0iG6HMl5-O19J-8FMV_0 2024-09-12T01:29:15.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.233+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13242451637309940699', time=2024-09-12T03:10:27.178843+0000, chain.objs.size()=1 2024-09-12T01:29:15.234 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.233+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.gX8e9djP368i_BebQDavE1DGQ0w5r4m_0 2024-09-12T01:29:15.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14992594309117338510', time=2024-09-12T03:10:27.201851+0000, chain.objs.size()=1 2024-09-12T01:29:15.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.PfBhcs9rLAihegIQgsZP83Q8WdcSO_q_0 2024-09-12T01:29:15.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.852619822113841509', time=2024-09-12T03:10:29.201885+0000, chain.objs.size()=1 2024-09-12T01:29:15.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.6qIQMT2W0LheLCLOjo5_Yyra_HvH6LZ_0 2024-09-12T01:29:15.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9387329270453076611', time=2024-09-12T03:10:31.178883+0000, chain.objs.size()=1 2024-09-12T01:29:15.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.296__shadow_.F24eyRx13TWNSpekUukwVERQxEUntUc_0 2024-09-12T01:29:15.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2016499094349715948', time=2024-09-12T03:10:48.932202+0000, chain.objs.size()=1 2024-09-12T01:29:15.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.322__shadow_.Uv1yALwgpfG0dz5cjv_xvPI10TDU4Yg_0 2024-09-12T01:29:15.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11839381548383803932', time=2024-09-12T03:11:29.505563+0000, chain.objs.size()=1 2024-09-12T01:29:15.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Ov3GNilWKaV-Hm-xs-0oPBVmlkYG55X_0 2024-09-12T01:29:15.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16605712143219414981', time=2024-09-12T03:11:29.965108+0000, chain.objs.size()=1 2024-09-12T01:29:15.236 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.SNNG1Cf2DGTYDdeX7zxd6-tIcPM2dzq_0 2024-09-12T01:29:15.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12547287897049990318', time=2024-09-12T03:11:30.159876+0000, chain.objs.size()=1 2024-09-12T01:29:15.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Uq3pAUJuiakNvYmeG-gdEy95h6S7DKb_0 2024-09-12T01:29:15.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8906442156883870606', time=2024-09-12T03:11:30.531498+0000, chain.objs.size()=1 2024-09-12T01:29:15.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Mzb3ymFDvWGqm_Ss9ehx6TgSXekQcCC_0 2024-09-12T01:29:15.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2354985616081770454', time=2024-09-12T03:11:31.097159+0000, chain.objs.size()=1 2024-09-12T01:29:15.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.235+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_._JKEVWHKGXPXHWJWBla90gxt1TXbMGt_0 2024-09-12T01:29:15.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.238+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6501177787008094702', time=2024-09-12T03:11:31.564832+0000, chain.objs.size()=1 2024-09-12T01:29:15.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.238+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Gf3yFSnhi2eOayjM_smsbaMThmlqGpP_0 2024-09-12T01:29:15.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.238+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10965216912941442690', time=2024-09-12T03:11:32.816098+0000, chain.objs.size()=1 2024-09-12T01:29:15.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.238+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xWajlVeI95lPREwLDGapHBqKQ6NadTF_0 2024-09-12T01:29:15.238 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.238+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1809814386423369982', time=2024-09-12T03:11:33.019787+0000, chain.objs.size()=1 2024-09-12T01:29:15.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.238+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5VspeRcXzPAsGpdQX3UlXXGLV1555G__0 2024-09-12T01:29:15.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5254969656755489377', time=2024-09-12T03:11:33.509006+0000, chain.objs.size()=1 2024-09-12T01:29:15.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.eiVqELndmHseg9WcCKD02UG8EMr34lY_0 2024-09-12T01:29:15.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14113005976595533884', time=2024-09-12T03:11:33.696777+0000, chain.objs.size()=1 2024-09-12T01:29:15.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.jm1S0_EOSHo3ivaI6ldt82XzrEZ4-Nr_0 2024-09-12T01:29:15.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18422703435354639312', time=2024-09-12T03:11:34.695471+0000, chain.objs.size()=1 2024-09-12T01:29:15.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.HyAiwAbwkRJ_ioKDgXHCu3X3InGxBYY_0 2024-09-12T01:29:15.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3009859204832828452', time=2024-09-12T03:11:35.486335+0000, chain.objs.size()=1 2024-09-12T01:29:15.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qqss-5OtlvOWNo6fbUArbBVnLT8Kh9F_0 2024-09-12T01:29:15.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17793585182465566635', time=2024-09-12T03:11:36.104945+0000, chain.objs.size()=1 2024-09-12T01:29:15.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.3d0rBGT_hehVdcxJvMLrSy4Av421zrC_0 2024-09-12T01:29:15.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5400057100227047632', time=2024-09-12T03:11:36.328987+0000, chain.objs.size()=1 2024-09-12T01:29:15.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.533ExlQynuskFGU8RErWl83hepS5_TE_0 2024-09-12T01:29:15.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2207637425868189249', time=2024-09-12T03:11:36.531540+0000, chain.objs.size()=1 2024-09-12T01:29:15.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mLVIkx2aW4TYi65ni0PYOlNxuw2RMKC_0 2024-09-12T01:29:15.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5005112774402140660', time=2024-09-12T03:11:36.779456+0000, chain.objs.size()=1 2024-09-12T01:29:15.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5rWjlZIxV2y4AjfyKLwabdbAXGKHuNN_0 2024-09-12T01:29:15.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10642848589005382518', time=2024-09-12T03:11:36.838424+0000, chain.objs.size()=1 2024-09-12T01:29:15.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xWyZgvxtzo9lOGsjakG_Fz9DncPnxbU_0 2024-09-12T01:29:15.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.242+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2906216638896311075', time=2024-09-12T03:11:37.786240+0000, chain.objs.size()=1 2024-09-12T01:29:15.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.242+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.22dDfyh8xyxiQNLmktXWJosGomlJH_I_0 2024-09-12T01:29:15.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.243+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12635297486475384158', time=2024-09-12T03:11:37.840544+0000, chain.objs.size()=1 2024-09-12T01:29:15.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.243+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.zpDWA6AO3DEMMPgqTSzr9Ygu2W5KF-F_0 2024-09-12T01:29:15.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11108402669599219142', time=2024-09-12T03:11:37.907080+0000, chain.objs.size()=1 2024-09-12T01:29:15.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Wg6UNrw0pBy1LXhK6e9SKD9_FHXri7p_0 2024-09-12T01:29:15.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12897308839138371705', time=2024-09-12T03:11:37.961280+0000, chain.objs.size()=1 2024-09-12T01:29:15.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.N7jkfag3uTzEn2WWqzozlfaznpb4-9M_0 2024-09-12T01:29:15.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7841581257186303825', time=2024-09-12T03:11:38.029827+0000, chain.objs.size()=1 2024-09-12T01:29:15.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.KwBNa05gTPuFqeogtMUHxJzZUgkrHWf_0 2024-09-12T01:29:15.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11103093941104061178', time=2024-09-12T03:11:38.115737+0000, chain.objs.size()=1 2024-09-12T01:29:15.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.L-nhevt0UnjirrNhrYMXWb9mQGicW1e_0 2024-09-12T01:29:15.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11210547167137145578', time=2024-09-12T03:11:38.116512+0000, chain.objs.size()=1 2024-09-12T01:29:15.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.BKZsNkH358GLMkALKON8gj_3hkSsiOQ_0 2024-09-12T01:29:15.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11911982789845474841', time=2024-09-12T03:11:38.512201+0000, chain.objs.size()=1 2024-09-12T01:29:15.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.bNW6psDsNBP5_nXlYzLFOVbDYssDu04_0 2024-09-12T01:29:15.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10604979413542329127', time=2024-09-12T03:11:38.640983+0000, chain.objs.size()=1 2024-09-12T01:29:15.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.huVlVxV6h-CJNEiq4QNbxymHdt70VsQ_0 2024-09-12T01:29:15.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5549097368325161510', time=2024-09-12T03:11:38.835363+0000, chain.objs.size()=1 2024-09-12T01:29:15.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5O8ro_COipwa68WkGWKNE-3M6bUDs39_0 2024-09-12T01:29:15.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10386355563029282994', time=2024-09-12T03:11:39.645991+0000, chain.objs.size()=1 2024-09-12T01:29:15.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tlDwtwsFKxTMg9ym4CnYEJsot6kD6aA_0 2024-09-12T01:29:15.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.247+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4809879236829560577', time=2024-09-12T03:11:40.061490+0000, chain.objs.size()=1 2024-09-12T01:29:15.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.247+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5nOMBheb79ZVgOFebn-7zNaQu9R5YZo_0 2024-09-12T01:29:15.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.247+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4463182938977674193', time=2024-09-12T03:11:40.153154+0000, chain.objs.size()=1 2024-09-12T01:29:15.247 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.247+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.B_N7XZI5XOFCFinuFP9JzmPhzeLU8Ed_0 2024-09-12T01:29:15.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.248+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4252549443725641050', time=2024-09-12T03:11:40.153819+0000, chain.objs.size()=1 2024-09-12T01:29:15.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.248+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.myz99X9utuFHkcoSrtPuChH-eE6CpRP_0 2024-09-12T01:29:15.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.248+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17240036074646907964', time=2024-09-12T03:11:40.192377+0000, chain.objs.size()=1 2024-09-12T01:29:15.248 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.248+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Tj4NNCPiq2RJWfwR4D4PKDurEi2WV9y_0 2024-09-12T01:29:15.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.248+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6494589792493000608', time=2024-09-12T03:11:40.367169+0000, chain.objs.size()=1 2024-09-12T01:29:15.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.248+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.rCsc-CyEVDHsfK2uJGaOb3Hni_p6_dR_0 2024-09-12T01:29:15.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.248+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9208406932984703330', time=2024-09-12T03:11:41.038670+0000, chain.objs.size()=1 2024-09-12T01:29:15.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.248+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.zOwITZ9xs2jw0fGL3k7H5x0JOzW_Ern_0 2024-09-12T01:29:15.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.249+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15897725067863699872', time=2024-09-12T03:11:41.167458+0000, chain.objs.size()=1 2024-09-12T01:29:15.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.249+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.4Paxt_6DnNugmZy6PaYL6gO2qZ1mZxJ_0 2024-09-12T01:29:15.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.249+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9448170326983297202', time=2024-09-12T03:11:41.168392+0000, chain.objs.size()=1 2024-09-12T01:29:15.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.249+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Ya8k1TvIZXO_gLlog19gIqh8SX4556R_0 2024-09-12T01:29:15.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.249+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3695489535593668652', time=2024-09-12T03:11:41.319020+0000, chain.objs.size()=1 2024-09-12T01:29:15.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.249+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.PLeHw2gddXDweFyjAHXwDaYNeiR970r_0 2024-09-12T01:29:15.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.249+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17714638478747478899', time=2024-09-12T03:11:41.459037+0000, chain.objs.size()=1 2024-09-12T01:29:15.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.249+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.QUvKbmqbBze3QL1oDBrzKwXv50nrY-g_0 2024-09-12T01:29:15.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.250+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292363441162410959', time=2024-09-12T03:11:41.544480+0000, chain.objs.size()=1 2024-09-12T01:29:15.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.250+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.EkEcfVgoE1dN8n5pVAcarz3UvbbW5eG_0 2024-09-12T01:29:15.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.252+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7454020025034261897', time=2024-09-12T03:12:22.253056+0000, chain.objs.size()=1 2024-09-12T01:29:15.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.252+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.8SxN51ETmZ4phTWtvO6utQXb1lN9kXz_0 2024-09-12T01:29:15.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.252+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12333653634989781819', time=2024-09-12T03:12:22.804663+0000, chain.objs.size()=1 2024-09-12T01:29:15.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.252+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.e89hWFIivOAJyNjp4ISwCKlp4Ot_Zf7_0 2024-09-12T01:29:15.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.253+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18107579384219644099', time=2024-09-12T03:12:23.056375+0000, chain.objs.size()=1 2024-09-12T01:29:15.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.253+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.0GgYCJWLVHK17hgdKcnk7PFNkz3ukA4_0 2024-09-12T01:29:15.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.253+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6317259916805646690', time=2024-09-12T03:12:23.080303+0000, chain.objs.size()=1 2024-09-12T01:29:15.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.253+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xlmlgoe6y6J6uo3CXOVISvJphggPZyN_0 2024-09-12T01:29:15.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.253+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18417419841204783260', time=2024-09-12T03:12:23.627124+0000, chain.objs.size()=1 2024-09-12T01:29:15.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.253+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Fm-HprMcV7E0L2_dKDA5q15887dGQP8_0 2024-09-12T01:29:15.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.253+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15548930000638992129', time=2024-09-12T03:12:23.780036+0000, chain.objs.size()=1 2024-09-12T01:29:15.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.253+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.wQcDLT0faIdZ2JCgZbUAZRDgVBygdyP_0 2024-09-12T01:29:15.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.253+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13126696460142614368', time=2024-09-12T03:12:24.045595+0000, chain.objs.size()=1 2024-09-12T01:29:15.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.253+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.TJ-o2U7DulwrzcpzJ7W9lC7WbjpuYdn_0 2024-09-12T01:29:15.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.253+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6513281471079520535', time=2024-09-12T03:12:24.757946+0000, chain.objs.size()=1 2024-09-12T01:29:15.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.253+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.tZgNZHbYXlZaOlO2qG3q5vOTUgusxqt_0 2024-09-12T01:29:15.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.254+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4422893760286487019', time=2024-09-12T03:12:25.776311+0000, chain.objs.size()=1 2024-09-12T01:29:15.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.254+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.24AJm9weYOebbpeKwmb5En5Cbcjcts-_0 2024-09-12T01:29:15.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.254+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2245528151498288495', time=2024-09-12T03:12:26.076546+0000, chain.objs.size()=1 2024-09-12T01:29:15.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.254+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3fUwgUpLeXy2KjnE6u4nZThBYtkhktJ_0 2024-09-12T01:29:15.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.254+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9314067891647120796', time=2024-09-12T03:12:26.195773+0000, chain.objs.size()=1 2024-09-12T01:29:15.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.254+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.asllVXSceaceDkkFI0gPncPMsB52FHr_0 2024-09-12T01:29:15.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.256+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6018582933833569102', time=2024-09-12T03:12:26.240423+0000, chain.objs.size()=1 2024-09-12T01:29:15.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.256+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Hmg5Zib0_EGHJYahMmgHYNpqs92r5On_0 2024-09-12T01:29:15.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.256+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8409988400945067394', time=2024-09-12T03:12:26.396102+0000, chain.objs.size()=1 2024-09-12T01:29:15.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.256+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.zv8T5i5AW-c3SRKiS21RRw501ru2eyT_0 2024-09-12T01:29:15.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.256+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8027768092614991612', time=2024-09-12T03:12:27.042420+0000, chain.objs.size()=1 2024-09-12T01:29:15.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.256+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.5QEyB80DhtFWAbWkbVMwrqThxjXWS4G_0 2024-09-12T01:29:15.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.258+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3055850044472076712', time=2024-09-12T03:12:27.043244+0000, chain.objs.size()=1 2024-09-12T01:29:15.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.258+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RWVtHeJj20PsF428LfVL_1D9xmh_L20_0 2024-09-12T01:29:15.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.258+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14447934081486763906', time=2024-09-12T03:12:27.477418+0000, chain.objs.size()=1 2024-09-12T01:29:15.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.258+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.nwZutZr6I5FDnLP29RIzn00xVrrkp4c_0 2024-09-12T01:29:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.261+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/45185 2024-09-12T01:29:15.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.263+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T01:29:15.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10039468225684614990', time=2024-09-12T03:12:27.956715+0000, chain.objs.size()=1 2024-09-12T01:29:15.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.S-PbF-8rA1tp0ntJtxWBEtA_EcjevaC_0 2024-09-12T01:29:15.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4824771957049481878', time=2024-09-12T03:12:28.235861+0000, chain.objs.size()=1 2024-09-12T01:29:15.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.WiOVHTbh4SbYkPolXaxx2-FNzbHAF-r_0 2024-09-12T01:29:15.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16583452972455139386', time=2024-09-12T03:12:28.752466+0000, chain.objs.size()=1 2024-09-12T01:29:15.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.bm_1OXQDJjbf1ghiQexTU2tB7eneopZ_0 2024-09-12T01:29:15.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10629220656357326415', time=2024-09-12T03:12:29.167383+0000, chain.objs.size()=1 2024-09-12T01:29:15.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.8UJ6tqJJW_kRRty6_NewC4c4RyZ2YSA_0 2024-09-12T01:29:15.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.224471298824393642', time=2024-09-12T03:12:30.360013+0000, chain.objs.size()=1 2024-09-12T01:29:15.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.qKoHP0nAnhEY6OzRsHKHlVZZJ8OajMq_0 2024-09-12T01:29:15.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7671216633861157482', time=2024-09-12T03:12:31.309284+0000, chain.objs.size()=1 2024-09-12T01:29:15.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Q7aPFwPIsN9tFuwFgFoo03PTxT_W7nZ_0 2024-09-12T01:29:15.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13550696636750911757', time=2024-09-12T03:12:32.150014+0000, chain.objs.size()=1 2024-09-12T01:29:15.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.o2qdVCFzhsACsbbGtYn6j_NShrM6qUk_0 2024-09-12T01:29:15.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3911790114889002740', time=2024-09-12T03:12:32.437463+0000, chain.objs.size()=1 2024-09-12T01:29:15.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.a3pYHJWd9iDNM6MdUfF-l8OgsrHdF-M_0 2024-09-12T01:29:15.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16045123284100333712', time=2024-09-12T03:12:32.606377+0000, chain.objs.size()=1 2024-09-12T01:29:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.v0Ppf1iv4Knw8vBQXpf5XkzT4FGDqa6_0 2024-09-12T01:29:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11314294876843342288', time=2024-09-12T03:12:32.828441+0000, chain.objs.size()=1 2024-09-12T01:29:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Qi4evPBNQZDkCczrVB5lCy2zNgOgEVw_0 2024-09-12T01:29:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9905592046701182564', time=2024-09-12T03:12:33.702833+0000, chain.objs.size()=1 2024-09-12T01:29:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.i-EB3TAvCbjskbBe8cIrzNer6ifHvHl_0 2024-09-12T01:29:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2251052787541507432', time=2024-09-12T03:12:34.388469+0000, chain.objs.size()=1 2024-09-12T01:29:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.264+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.fDy8242Tc_uxSrjrPDI0CSym85Ayjgv_0 2024-09-12T01:29:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.267+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12074615103711574739', time=2024-09-12T03:12:34.513562+0000, chain.objs.size()=1 2024-09-12T01:29:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.267+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.QbyJ47zDKIuBnTcDv3k-_Co1rUgC9da_0 2024-09-12T01:29:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.267+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18144604911982185569', time=2024-09-12T03:12:34.529089+0000, chain.objs.size()=1 2024-09-12T01:29:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.267+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Byyh7Xay6A7DkFLZDhODHRmECFEH5RN_0 2024-09-12T01:29:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.267+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7994662554197096201', time=2024-09-12T03:13:33.464125+0000, chain.objs.size()=1 2024-09-12T01:29:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.267+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.431__shadow_.t3X8vTMlLt24SuBv061Fsh3HI2BisE4_0 2024-09-12T01:29:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.267+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4233141670375515590', time=2024-09-12T03:13:45.618130+0000, chain.objs.size()=1 2024-09-12T01:29:15.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.267+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.451__shadow_.FLPNXJZBT0MJHrfQXDFAcfMee3F3yUP_0 2024-09-12T01:29:15.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.267+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11429141266178899043', time=2024-09-12T03:13:48.934194+0000, chain.objs.size()=1 2024-09-12T01:29:15.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.267+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.456__shadow_.czaPQGZtj2Sg_YjUtNtvFmH4euzr2Ar_0 2024-09-12T01:29:15.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.268+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7838927436256331049', time=2024-09-12T03:13:52.408106+0000, chain.objs.size()=1 2024-09-12T01:29:15.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.268+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.460__shadow_.xLmTSAqtDULZnDjuNFcwJbEWVILz1i7_0 2024-09-12T01:29:15.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.268+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9782426165447666968', time=2024-09-12T03:14:05.129736+0000, chain.objs.size()=1 2024-09-12T01:29:15.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.268+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.483__shadow_.9glqi7H0jSsCdmsSWHg3NjKglxlHUIF_0 2024-09-12T01:29:15.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.268+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3361474683187649993', time=2024-09-12T03:14:10.121456+0000, chain.objs.size()=1 2024-09-12T01:29:15.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.268+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.487__shadow_.MpQzhKwf9ceftsMULn8_TTIDqmzynAs_0 2024-09-12T01:29:15.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.268+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.644582083674516122', time=2024-09-12T03:17:32.150644+0000, chain.objs.size()=2 2024-09-12T01:29:15.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.268+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.558__shadow_.Sm1Q2l3SF6RBYkA9mCub-ahSV64Az64_0 2024-09-12T01:29:15.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.268+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.558__shadow_.Sm1Q2l3SF6RBYkA9mCub-ahSV64Az64_1 2024-09-12T01:29:15.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.268+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14709500259453311394', time=2024-09-12T03:17:55.726684+0000, chain.objs.size()=1 2024-09-12T01:29:15.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.268+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:VxHbzg3Z.WpTYPC5DPSexGTylRElCuu_.KVyamgFIl15KqVsxsv28iXIzwqL32ve_0 2024-09-12T01:29:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.271+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9941695377639125926', time=2024-09-12T03:18:03.091007+0000, chain.objs.size()=1 2024-09-12T01:29:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.271+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.574__shadow:JN80UG.rpVjwtTd.30UghXvk1PqYefL_.mHxMWw2sqjIAxFCm7-X8qiH-3kftKJV_0 2024-09-12T01:29:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.271+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15180412609230289851', time=2024-09-12T03:18:32.044195+0000, chain.objs.size()=1 2024-09-12T01:29:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.271+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:yZwIy4hVsAjgUORl5arrpu7PYst5YuR_.oQSpVc06k4Hj5oNhq-N68zJKx52PCwA_0 2024-09-12T01:29:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.271+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18206613528001261783', time=2024-09-12T03:18:54.362638+0000, chain.objs.size()=1 2024-09-12T01:29:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.271+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.585__shadow:EnEGSShtTl9isQYMAslHKYXWwcW8IE5_.-TWMeIsGU-IGOCKO7rGKnrigltncNvr_0 2024-09-12T01:29:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.271+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18309985068643091489', time=2024-09-12T03:23:21.735568+0000, chain.objs.size()=1 2024-09-12T01:29:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.271+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.654__shadow_.aWljIv6UIcu3aT9u8BseCAMCoRaUEtM_0 2024-09-12T01:29:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.271+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7676368498185726061', time=2024-09-12T03:23:43.863831+0000, chain.objs.size()=1 2024-09-12T01:29:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.271+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.666__shadow_.o2gwzeKkn8xyZMI29HrcIaUG2-kNHqh_0 2024-09-12T01:29:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.271+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1473600654615878850', time=2024-09-12T03:24:32.089280+0000, chain.objs.size()=1 2024-09-12T01:29:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.271+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.717__shadow:3.vdFbLjUsBQUaXVLREX8siUkZtci8x_.UEq5fa8omVgAUjvyP7qN_ZsYKJJnA15_0 2024-09-12T01:29:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.275+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.277+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:29:15.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.278+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.279 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.279+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44628' 2024-09-12T01:29:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9577370697395115248', time=2024-09-12T03:09:04.070125+0000, chain.objs.size()=1 2024-09-12T01:29:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.244__shadow_.Sy9KYf-vZOABW6KlhsZJtb80f9HGoJQ_0 2024-09-12T01:29:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16875353848462441892', time=2024-09-12T03:09:09.223347+0000, chain.objs.size()=1 2024-09-12T01:29:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.252__shadow_.LbfU9fOMiXIovfyIFCXufoXzeDNjTFx_0 2024-09-12T01:29:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5947434794258520573', time=2024-09-12T03:09:13.010211+0000, chain.objs.size()=1 2024-09-12T01:29:15.281 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.258__shadow_._IXh_WlF-cGh5PlDFY3bKII0Wm36yyE_0 2024-09-12T01:29:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5003701205174296106', time=2024-09-12T03:09:54.234707+0000, chain.objs.size()=1 2024-09-12T01:29:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.VMhfyHJcY1w_Kjtj-u9WIyxwBjRJajg_0 2024-09-12T01:29:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11796563020036417121', time=2024-09-12T03:09:54.779693+0000, chain.objs.size()=1 2024-09-12T01:29:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dLXHFUa-3eShihFD9IcmDkraFfPFpyb_0 2024-09-12T01:29:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10044214435763580069', time=2024-09-12T03:09:55.137146+0000, chain.objs.size()=1 2024-09-12T01:29:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.yzYAZmUZ1ScP2Nf5DQbWMUMkE3jiqt0_0 2024-09-12T01:29:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9799763836408484553', time=2024-09-12T03:09:55.139978+0000, chain.objs.size()=1 2024-09-12T01:29:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.qoD-l4ehSryLpcWzjiPqGVlSObKYlBd_0 2024-09-12T01:29:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18077546100752503961', time=2024-09-12T03:09:56.064737+0000, chain.objs.size()=1 2024-09-12T01:29:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.sWNk0WBQXRsru-wcBFVL-Tlvrj6NWqX_0 2024-09-12T01:29:15.282 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3035953826438900502', time=2024-09-12T03:09:56.377401+0000, chain.objs.size()=1 2024-09-12T01:29:15.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.xUQKsw5Jd280CpACBcuJ64raUkn1fuz_0 2024-09-12T01:29:15.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11012245877922243357', time=2024-09-12T03:09:56.488384+0000, chain.objs.size()=1 2024-09-12T01:29:15.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._NlOeRyWZEdfI0THMpj-mXtdOLU1nL0_0 2024-09-12T01:29:15.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14084037322920537079', time=2024-09-12T03:09:56.830075+0000, chain.objs.size()=1 2024-09-12T01:29:15.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.gFxwn522aTue0mnGvKQFwBPaXpXvLbe_0 2024-09-12T01:29:15.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16993478618432251478', time=2024-09-12T03:09:57.775976+0000, chain.objs.size()=1 2024-09-12T01:29:15.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.280+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.mkbi45WAksg_rd09UIriBjugKKU0Ylc_0 2024-09-12T01:29:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.283+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8233237671769930746', time=2024-09-12T03:09:57.930375+0000, chain.objs.size()=1 2024-09-12T01:29:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.283+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.B9JphTW8_6Rz3TwAzSB_z3Xv7bjpuO9_0 2024-09-12T01:29:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.283+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2250550605298042035', time=2024-09-12T03:09:58.024560+0000, chain.objs.size()=1 2024-09-12T01:29:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.283+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.5F2-PBz6tD3frK8GTW5K6WOSqcRmL1P_0 2024-09-12T01:29:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.283+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13591784019885524919', time=2024-09-12T03:10:00.086017+0000, chain.objs.size()=1 2024-09-12T01:29:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.283+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RZN_EQGoHc8SXhBLduKxhnqZSc7aKJc_0 2024-09-12T01:29:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.284+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12349902551138367069', time=2024-09-12T03:10:00.264189+0000, chain.objs.size()=1 2024-09-12T01:29:15.284 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.284+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.-Zf_PJzAK9Hf1WJczjRLZdGekfVLgvB_0 2024-09-12T01:29:15.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.284+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13268214448621002913', time=2024-09-12T03:10:00.366245+0000, chain.objs.size()=1 2024-09-12T01:29:15.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.284+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.tvdtm4HtAp-W1tTDF7VGi9rtkR1XOGl_0 2024-09-12T01:29:15.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.284+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11970180902535517101', time=2024-09-12T03:10:00.405284+0000, chain.objs.size()=1 2024-09-12T01:29:15.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.284+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lh1TgeffstE3yAAkwqt3N7QiWZsxD9K_0 2024-09-12T01:29:15.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.285+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5195440027211989044', time=2024-09-12T03:10:01.511829+0000, chain.objs.size()=1 2024-09-12T01:29:15.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ub-FfASzJvw4XFoOyQIrsj3YASQgZLH_0 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.285+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17909734838286122248', time=2024-09-12T03:10:01.674848+0000, chain.objs.size()=1 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.uKTMLxNmi9QzLNaN_o99CyZDCL2vXCs_0 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.285+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16924304012446123514', time=2024-09-12T03:10:02.683218+0000, chain.objs.size()=1 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9YZT-W1RbnUEGRlzA2CeieX-gARs19k_0 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.285+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15121355814189047411', time=2024-09-12T03:10:02.683839+0000, chain.objs.size()=1 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dE3yVMf5cj-IH5GsSzjMd7np05Scg5O_0 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.285+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15301374465671230780', time=2024-09-12T03:10:02.847558+0000, chain.objs.size()=1 2024-09-12T01:29:15.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PJX7LD1tRq9A0GTzT-XwcZbudR-PDu1_0 2024-09-12T01:29:15.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.287+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3637468563773509809', time=2024-09-12T03:10:03.408461+0000, chain.objs.size()=1 2024-09-12T01:29:15.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.287+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Vn7Wgggj2UkCLnVevH7Qt9a7m0TAMKb_0 2024-09-12T01:29:15.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.287+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8962437973499236476', time=2024-09-12T03:10:03.540128+0000, chain.objs.size()=1 2024-09-12T01:29:15.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.287+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.m4qbiH3YT-D0bz_CoTiAtROSgh7kFFT_0 2024-09-12T01:29:15.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.287+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3271891852110307947', time=2024-09-12T03:10:03.719995+0000, chain.objs.size()=1 2024-09-12T01:29:15.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.287+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.i7QDyDgTY5F9l8BfIn9uT1_Kxe6_6Cn_0 2024-09-12T01:29:15.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.287+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17333090915736864392', time=2024-09-12T03:10:03.819361+0000, chain.objs.size()=1 2024-09-12T01:29:15.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.287+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.89ccNXdQ0baT7l_8lG-ZDo4h4OsX0Ab_0 2024-09-12T01:29:15.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.288+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15122755048174289933', time=2024-09-12T03:10:04.207785+0000, chain.objs.size()=1 2024-09-12T01:29:15.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.288+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8sNHOADRivICRPbDZUwoqWh9ygx75yy_0 2024-09-12T01:29:15.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.289+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11299104109330516411', time=2024-09-12T03:10:04.208555+0000, chain.objs.size()=1 2024-09-12T01:29:15.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.289+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.HvuUc4jUBG0UjpQsfWtA4iNQGnvlzsv_0 2024-09-12T01:29:15.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.289+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13643462946122487658', time=2024-09-12T03:10:04.490790+0000, chain.objs.size()=1 2024-09-12T01:29:15.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.289+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.FPWgDXzcuAzugiVF1_iqfyC-lIUSITF_0 2024-09-12T01:29:15.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.289+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12225597317814446005', time=2024-09-12T03:10:05.905191+0000, chain.objs.size()=1 2024-09-12T01:29:15.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.289+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.YOInlwdHD1bzUffWrFiH4d3lYJBSpEX_0 2024-09-12T01:29:15.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.291+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4462007736534706343', time=2024-09-12T03:10:06.068663+0000, chain.objs.size()=1 2024-09-12T01:29:15.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.291+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.kVSzh1f_KYW-_-98Kn5kEk4L_pk07-E_0 2024-09-12T01:29:15.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.291+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7551863545172158738', time=2024-09-12T03:10:06.137940+0000, chain.objs.size()=1 2024-09-12T01:29:15.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.291+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.UN38X--_C_UYItD089SuNIg9uztzHGi_0 2024-09-12T01:29:15.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.292+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16302897959821855390', time=2024-09-12T03:10:06.203343+0000, chain.objs.size()=1 2024-09-12T01:29:15.292 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.292+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.TRIWDFsPsNFMMD8c3ll14cqAHQq8Knp_0 2024-09-12T01:29:15.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.292+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3463659978939182523', time=2024-09-12T03:10:06.334640+0000, chain.objs.size()=1 2024-09-12T01:29:15.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.292+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.axgR-Odjo3CKjyYerjJ2XzYPLW4CLk-_0 2024-09-12T01:29:15.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.292+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1945341295317613019', time=2024-09-12T03:10:06.546092+0000, chain.objs.size()=1 2024-09-12T01:29:15.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.292+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Ma_es3JhwE__kAFO3PivWswEXi8BdNC_0 2024-09-12T01:29:15.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.292+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2708963841007647892', time=2024-09-12T03:10:08.525323+0000, chain.objs.size()=1 2024-09-12T01:29:15.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.292+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.265__shadow_.5MDxHl9qG9CWPhm1fxxpffemUWxFiCf_0 2024-09-12T01:29:15.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.292+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4907109093680459079', time=2024-09-12T03:10:17.851000+0000, chain.objs.size()=1 2024-09-12T01:29:15.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.292+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.280__shadow_.9oD_l3-scbbPvR9CxTt9CHuEUEVq5Oc_0 2024-09-12T01:29:15.294 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.292+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12935551211525165148', time=2024-09-12T03:10:20.434084+0000, chain.objs.size()=1 2024-09-12T01:29:15.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.292+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.284__shadow_.mwerzwGDROf5pspjhmqJHYUV7bpygV2_0 2024-09-12T01:29:15.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.292+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5027161938949616932', time=2024-09-12T03:10:27.119107+0000, chain.objs.size()=1 2024-09-12T01:29:15.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.292+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.e7NrC8JKm7rBwlUxZJ5OaJ3WL_KYVOp_0 2024-09-12T01:29:15.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.293+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9800836813534888697', time=2024-09-12T03:10:29.061095+0000, chain.objs.size()=1 2024-09-12T01:29:15.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.293+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.oaAQJzTzKJ4WL1bhaIaCCjeiy7v6MLs_0 2024-09-12T01:29:15.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.293+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17310250457402436692', time=2024-09-12T03:10:30.508844+0000, chain.objs.size()=1 2024-09-12T01:29:15.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.293+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.295__shadow_.JNzuuDBlXYNFy8fi1StFKVD6VqZ0RYc_0 2024-09-12T01:29:15.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.295+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1175311323393090457', time=2024-09-12T03:10:31.175065+0000, chain.objs.size()=1 2024-09-12T01:29:15.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.295+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.296__shadow_.6qTvOGn2RV6LI6JsNGw8JLhZbA8WQTl_0 2024-09-12T01:29:15.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.295+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13594711503240741650', time=2024-09-12T03:10:31.183644+0000, chain.objs.size()=1 2024-09-12T01:29:15.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.295+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.296__shadow_.G_U43aKOvi9eGR2W403lRkEZOBHlBQ0_0 2024-09-12T01:29:15.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11716813097461362448', time=2024-09-12T03:10:31.828586+0000, chain.objs.size()=1 2024-09-12T01:29:15.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.297__shadow_.6B8v--cT9xhVQWv6H_iI3A-LO7msfEg_0 2024-09-12T01:29:15.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9515082034431948310', time=2024-09-12T03:10:33.227618+0000, chain.objs.size()=1 2024-09-12T01:29:15.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.299__shadow_.EPQ2SnFocE4W0-Xgqk_Zup9nC6Ys4MD_0 2024-09-12T01:29:15.298 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5929797450346955491', time=2024-09-12T03:11:29.271880+0000, chain.objs.size()=1 2024-09-12T01:29:15.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.evxTVTWurJk-jCuheiM1aVWKmEjYH0C_0 2024-09-12T01:29:15.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.238766717563284817', time=2024-09-12T03:11:29.296429+0000, chain.objs.size()=1 2024-09-12T01:29:15.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.kwv7IAkr4DKiGDji5CiyYY-ZvDBj8-Y_0 2024-09-12T01:29:15.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1771622046502130533', time=2024-09-12T03:11:29.431721+0000, chain.objs.size()=1 2024-09-12T01:29:15.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-AlOOCqXovG9GscEARlmmsTabaCJRT-_0 2024-09-12T01:29:15.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2134372374836458804', time=2024-09-12T03:11:29.798695+0000, chain.objs.size()=1 2024-09-12T01:29:15.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.c0kDhXXZDc0QnhDtWTrUMU-cBg51HjX_0 2024-09-12T01:29:15.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1696729031211891730', time=2024-09-12T03:11:31.076952+0000, chain.objs.size()=1 2024-09-12T01:29:15.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Fi0KmfsBoFjDzIYOJUbxiiz3ixtEy3m_0 2024-09-12T01:29:15.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7718500466343237448', time=2024-09-12T03:11:31.335074+0000, chain.objs.size()=1 2024-09-12T01:29:15.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.RTXET0ZPPYak5WBvtI0uwVsiBHChtEi_0 2024-09-12T01:29:15.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17200905897655271208', time=2024-09-12T03:11:31.892360+0000, chain.objs.size()=1 2024-09-12T01:29:15.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.sxPHaJ6Oi_6gTUsSTFtTJCAVeJuM7bp_0 2024-09-12T01:29:15.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5299537936259574629', time=2024-09-12T03:11:32.006432+0000, chain.objs.size()=1 2024-09-12T01:29:15.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_._CWCBfnf_4Yyxxzt3QPXM6FjJ8rwTI__0 2024-09-12T01:29:15.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.300+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11403793613950445307', time=2024-09-12T03:11:33.177780+0000, chain.objs.size()=1 2024-09-12T01:29:15.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.300+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-BoDaMtauAiGjkBBrcoQnAhAbwdeerN_0 2024-09-12T01:29:15.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.300+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15285397790302589599', time=2024-09-12T03:11:33.684246+0000, chain.objs.size()=1 2024-09-12T01:29:15.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.300+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Km3x7XYpKxdMfThFXW0H8srFoG-bzgO_0 2024-09-12T01:29:15.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.301+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3678138743405083237', time=2024-09-12T03:11:33.907534+0000, chain.objs.size()=1 2024-09-12T01:29:15.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.301+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.GPDGdglKddnLQxXkbmy6DiPgaTQxrb-_0 2024-09-12T01:29:15.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.303+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2248538966461083438', time=2024-09-12T03:11:33.990151+0000, chain.objs.size()=1 2024-09-12T01:29:15.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.303+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.8gOeDuK6HOzhl6NdpKeGYBYpjGRWrIU_0 2024-09-12T01:29:15.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.304+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4995769687130711216', time=2024-09-12T03:11:35.061713+0000, chain.objs.size()=1 2024-09-12T01:29:15.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.304+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1QDQVGXTaim-rdPDPal9egQQAUr5JKo_0 2024-09-12T01:29:15.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.304+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10330082940048026783', time=2024-09-12T03:11:35.147641+0000, chain.objs.size()=1 2024-09-12T01:29:15.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.304+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fAvH_4l5YEploFbVu61gwxBaJyOYniA_0 2024-09-12T01:29:15.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11805641552432023783', time=2024-09-12T03:11:35.216565+0000, chain.objs.size()=1 2024-09-12T01:29:15.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.0qrFSVecXDXEoeIVrTzYIj5LtjVAuuF_0 2024-09-12T01:29:15.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15879956597574474610', time=2024-09-12T03:11:35.322843+0000, chain.objs.size()=1 2024-09-12T01:29:15.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qtgdnmMu-aivh7peXVVMLFDUac1PZ7J_0 2024-09-12T01:29:15.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5039241130778376300', time=2024-09-12T03:11:35.440127+0000, chain.objs.size()=1 2024-09-12T01:29:15.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2IYQ8OxlFG5BTKID26RJ16XlAMrPlcs_0 2024-09-12T01:29:15.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9691643448557133484', time=2024-09-12T03:11:36.446864+0000, chain.objs.size()=1 2024-09-12T01:29:15.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.11EzcsfivVVHB7zl2bdSxsNuy82FUmf_0 2024-09-12T01:29:15.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14546807854229535650', time=2024-09-12T03:11:36.729700+0000, chain.objs.size()=1 2024-09-12T01:29:15.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xHoIKOt97wbhhNwLeO0ywcOaySQPTb6_0 2024-09-12T01:29:15.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17007611606679379092', time=2024-09-12T03:11:37.091578+0000, chain.objs.size()=1 2024-09-12T01:29:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qY4ID9zuerWOk7DX47TLi5rKH9QbzGK_0 2024-09-12T01:29:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17618540002445304329', time=2024-09-12T03:11:37.094745+0000, chain.objs.size()=1 2024-09-12T01:29:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mxcQcH98e7NI8uzvToTNGuBzBJjrE7P_0 2024-09-12T01:29:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8571527527557999965', time=2024-09-12T03:11:37.234325+0000, chain.objs.size()=1 2024-09-12T01:29:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.T68TMt5xCkJS4J48zLyd_oBoXinIidM_0 2024-09-12T01:29:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1743471085837153885', time=2024-09-12T03:11:37.236335+0000, chain.objs.size()=1 2024-09-12T01:29:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.zIk-zF6alYNTWaHDV87s8Pw70O-N6or_0 2024-09-12T01:29:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10110789185358635500', time=2024-09-12T03:11:37.813931+0000, chain.objs.size()=1 2024-09-12T01:29:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Q4P0zM2iXm8BM6Mn4uzVJmDXimqJo-0_0 2024-09-12T01:29:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13690158984108042929', time=2024-09-12T03:11:38.046520+0000, chain.objs.size()=1 2024-09-12T01:29:15.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.306+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fczUjc5ew4uvZ0bN9z99_MXoJhY-DTI_0 2024-09-12T01:29:15.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.309+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14919895042849989963', time=2024-09-12T03:11:38.696450+0000, chain.objs.size()=1 2024-09-12T01:29:15.310 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.309+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.iPtUVmxwOOPkkO4AZ3jyV6JracTl0jk_0 2024-09-12T01:29:15.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1120703311765573049', time=2024-09-12T03:11:39.539625+0000, chain.objs.size()=1 2024-09-12T01:29:15.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.YqmrbJeaP1h0O-ghXFyaFPD1EKEa3Op_0 2024-09-12T01:29:15.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13225325220263685630', time=2024-09-12T03:11:39.652838+0000, chain.objs.size()=1 2024-09-12T01:29:15.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2nAxn5WE6RP1bh4NKYAz01Y5jDjOJbV_0 2024-09-12T01:29:15.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2793177338979547861', time=2024-09-12T03:11:39.792986+0000, chain.objs.size()=1 2024-09-12T01:29:15.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.whbcQM2wqUjsGoPXgM8FZDnoq7m5hLM_0 2024-09-12T01:29:15.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7362369007138016052', time=2024-09-12T03:11:40.230248+0000, chain.objs.size()=1 2024-09-12T01:29:15.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7jwpQ9zdC-a1boYW75XdIPaw72M1xFh_0 2024-09-12T01:29:15.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10117739684392714159', time=2024-09-12T03:11:40.697075+0000, chain.objs.size()=1 2024-09-12T01:29:15.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.4YoWvTn-EidNg0_JaiiAEB-YzHe5tGh_0 2024-09-12T01:29:15.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11640005091592052313', time=2024-09-12T03:12:22.313220+0000, chain.objs.size()=1 2024-09-12T01:29:15.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.FKHnkHDVHKB-t7fQccq-elakKmCsGOL_0 2024-09-12T01:29:15.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9016079730182862028', time=2024-09-12T03:12:23.070600+0000, chain.objs.size()=1 2024-09-12T01:29:15.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ad9S19BY9EDdVdQ4VT-Rxez9Z0YPYax_0 2024-09-12T01:29:15.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15054125391903148861', time=2024-09-12T03:12:23.802267+0000, chain.objs.size()=1 2024-09-12T01:29:15.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.OOErAkNr07F68JYsBrlYpJjeVplzBYP_0 2024-09-12T01:29:15.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17303017190541176552', time=2024-09-12T03:12:24.364336+0000, chain.objs.size()=1 2024-09-12T01:29:15.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.crLtX_L9DZIYlQZGK235hcVYv8sDQqJ_0 2024-09-12T01:29:15.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11023548975972240825', time=2024-09-12T03:12:24.745924+0000, chain.objs.size()=1 2024-09-12T01:29:15.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.311+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.czHAkc-gISwHUuatuHJ0c6G-BBMmOLI_0 2024-09-12T01:29:15.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.313+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11605241208226723147', time=2024-09-12T03:12:25.317374+0000, chain.objs.size()=1 2024-09-12T01:29:15.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.313+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Ilv1k7xkjY6oc4bS2G0jbnoGz8m9ap__0 2024-09-12T01:29:15.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1595547118539582973', time=2024-09-12T03:12:25.506979+0000, chain.objs.size()=1 2024-09-12T01:29:15.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.SQOrZOevOJ06HLX4nw9RxyTUvY9Zi1Z_0 2024-09-12T01:29:15.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.921392995840256571', time=2024-09-12T03:12:26.004567+0000, chain.objs.size()=1 2024-09-12T01:29:15.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.TlYBqA1B21OoZQoeS2X6p51j882GncP_0 2024-09-12T01:29:15.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1740633975743517559', time=2024-09-12T03:12:26.076179+0000, chain.objs.size()=1 2024-09-12T01:29:15.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.GPDynze1-mJdC1EPcynY1yzc9dACf44_0 2024-09-12T01:29:15.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4998210411590715996', time=2024-09-12T03:12:26.196500+0000, chain.objs.size()=1 2024-09-12T01:29:15.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.E33cW8S3B-C9ZAn-w02dm24yIurQjU__0 2024-09-12T01:29:15.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8794597956001789093', time=2024-09-12T03:12:26.535094+0000, chain.objs.size()=1 2024-09-12T01:29:15.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.B9f7Zj6-MnEqDnYhHEc5JKJRJrn1ktd_0 2024-09-12T01:29:15.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1306709177331086526', time=2024-09-12T03:12:27.953885+0000, chain.objs.size()=1 2024-09-12T01:29:15.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.5bFY_LS3uC2VwYCphscGR2vwlB_FqHA_0 2024-09-12T01:29:15.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12865895511750020247', time=2024-09-12T03:12:27.954619+0000, chain.objs.size()=1 2024-09-12T01:29:15.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.bwtYRYdVBI6Efkd6NVdoRGJohJ5z-R-_0 2024-09-12T01:29:15.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4894903824247604534', time=2024-09-12T03:12:28.184220+0000, chain.objs.size()=1 2024-09-12T01:29:15.316 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.315+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.QVAfOox_RP-gpGNoWpQXH2JxWOTN7L0_0 2024-09-12T01:29:15.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.316+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11342746786074301903', time=2024-09-12T03:12:29.810519+0000, chain.objs.size()=1 2024-09-12T01:29:15.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.316+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.rWE23sLJEiUZcD5pn4DkSCKulArw5rL_0 2024-09-12T01:29:15.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.316+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6711131901164283606', time=2024-09-12T03:12:29.903166+0000, chain.objs.size()=1 2024-09-12T01:29:15.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.316+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.8hzmXD0SXHOvHmpPylGQBYgDiy7CrGl_0 2024-09-12T01:29:15.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.316+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17915378366396937430', time=2024-09-12T03:12:30.403642+0000, chain.objs.size()=1 2024-09-12T01:29:15.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.316+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hSkNTuB9SBkBoxt-4EZ_57czICqbOMa_0 2024-09-12T01:29:15.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.319+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14964854025701524929', time=2024-09-12T03:12:31.149282+0000, chain.objs.size()=1 2024-09-12T01:29:15.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.319+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.b8TfNYFhOxH7CGc4Hn8YT98kurGuoNY_0 2024-09-12T01:29:15.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.319+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6652775442528322585', time=2024-09-12T03:12:31.173588+0000, chain.objs.size()=1 2024-09-12T01:29:15.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.319+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.POlNgdheM6Fu-mHjYNhR8OSI_T7Gz7x_0 2024-09-12T01:29:15.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.319+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6437053842240170433', time=2024-09-12T03:12:31.457083+0000, chain.objs.size()=1 2024-09-12T01:29:15.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.319+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.nMGggL4EMcwbfVmJEjtW07i_S3py3mP_0 2024-09-12T01:29:15.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.319+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6372359014541788844', time=2024-09-12T03:12:32.031291+0000, chain.objs.size()=1 2024-09-12T01:29:15.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.319+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.etWxXbRoMFTXwh2uABQMrGm39LGesPh_0 2024-09-12T01:29:15.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.319+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5612883663744327430', time=2024-09-12T03:12:32.691174+0000, chain.objs.size()=1 2024-09-12T01:29:15.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.319+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.GZHjjGHXNRbbeo96CXWrsnjyl1rSlJy_0 2024-09-12T01:29:15.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.319+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4803194716464088233', time=2024-09-12T03:12:32.715613+0000, chain.objs.size()=1 2024-09-12T01:29:15.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.319+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.XEqkZK3XxrBtmJdDqJHpp6mMr0C1-aV_0 2024-09-12T01:29:15.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.323+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/44628 2024-09-12T01:29:15.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=20, truncated=0, next_marker='' 2024-09-12T01:29:15.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4645579156931556419', time=2024-09-12T03:12:32.864870+0000, chain.objs.size()=1 2024-09-12T01:29:15.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.M_uBjDW1s8rFRSzvGzaNKiS6lUN8ZXo_0 2024-09-12T01:29:15.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14581428741982200905', time=2024-09-12T03:12:33.616795+0000, chain.objs.size()=1 2024-09-12T01:29:15.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.2870Q-J8KkTbgbOWCWOml4hFn1e1s1H_0 2024-09-12T01:29:15.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12200931209214792679', time=2024-09-12T03:12:34.071641+0000, chain.objs.size()=1 2024-09-12T01:29:15.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.7S3-Vxo3gAfy7i4OqZsPjJFanUwBXgv_0 2024-09-12T01:29:15.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5378697319832542479', time=2024-09-12T03:12:34.164508+0000, chain.objs.size()=1 2024-09-12T01:29:15.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.aGwvXhOGGfen8jGV4CbJly8T_iynADA_0 2024-09-12T01:29:15.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4472094769503116277', time=2024-09-12T03:12:34.472464+0000, chain.objs.size()=1 2024-09-12T01:29:15.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.C7u65hjUIOQah3eCVIHMWj-xsf5n-Iv_0 2024-09-12T01:29:15.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12046647554617804268', time=2024-09-12T03:12:34.508758+0000, chain.objs.size()=1 2024-09-12T01:29:15.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.brMRLoPJXIZpdj4s63H8926NaRv_Btf_0 2024-09-12T01:29:15.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15939269185689674786', time=2024-09-12T03:12:49.501584+0000, chain.objs.size()=1 2024-09-12T01:29:15.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.353__shadow_.T5Kp8J3LXwjW-pgrTE2m_xrZ8B2XRye_0 2024-09-12T01:29:15.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13833961112050905759', time=2024-09-12T03:13:21.691880+0000, chain.objs.size()=1 2024-09-12T01:29:15.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.409__shadow_.ijfDhg_qJP0WBZzlLvSvObbZf0RMNbB_0 2024-09-12T01:29:15.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.74083076904337623', time=2024-09-12T03:13:55.925459+0000, chain.objs.size()=1 2024-09-12T01:29:15.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.464__shadow_.r5v24DyPtEHhNXa64W9eczzyv2aQyWz_0 2024-09-12T01:29:15.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4254465009834833786', time=2024-09-12T03:13:57.692781+0000, chain.objs.size()=1 2024-09-12T01:29:15.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.466__shadow_.gYs5ZCTon8ukJwYtQVBV4KQOiCnlgtA_0 2024-09-12T01:29:15.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1773827095672404475', time=2024-09-12T03:14:05.859051+0000, chain.objs.size()=1 2024-09-12T01:29:15.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.484__shadow_.GFr99JnC55fFMSmraXVDesV0GP6fsN1_0 2024-09-12T01:29:15.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9526627454285578651', time=2024-09-12T03:14:16.270031+0000, chain.objs.size()=1 2024-09-12T01:29:15.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.498__shadow_.NNxg2wqh13Y_4np5ESWt0FHk_TS7Se2_0 2024-09-12T01:29:15.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.328+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7425142932188579200', time=2024-09-12T03:15:03.282044+0000, chain.objs.size()=1 2024-09-12T01:29:15.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.328+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.520__shadow:1IsdcvS8zBykjZP6Xo7HjlYfbnEblvU_.qDGvkl7ytJDuSJsnHLkISRL15qF4-Pe_0 2024-09-12T01:29:15.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.329+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8145158720227405459', time=2024-09-12T03:15:59.801168+0000, chain.objs.size()=2 2024-09-12T01:29:15.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.329+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.523__multipart_mymultipart.2~kK6Y4AEny1SrVMho6FUCfse_Rjzp97z.1 2024-09-12T01:29:15.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.330+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.523__multipart_mymultipart.2~kK6Y4AEny1SrVMho6FUCfse_Rjzp97z.2 2024-09-12T01:29:15.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.330+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18176030986933226035', time=2024-09-12T03:17:23.240640+0000, chain.objs.size()=1 2024-09-12T01:29:15.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.330+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.556__shadow_.xr3SKg-ydZACKlcSURe8e7-P2cPQrIH_0 2024-09-12T01:29:15.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.330+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14406496378750736501', time=2024-09-12T03:17:35.905866+0000, chain.objs.size()=1 2024-09-12T01:29:15.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.330+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.562__shadow_.oFOFgRMbFeY6qIlSWRn0dGwcZqPiP71_0 2024-09-12T01:29:15.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.330+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11320853160689669127', time=2024-09-12T03:17:57.371998+0000, chain.objs.size()=1 2024-09-12T01:29:15.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.330+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.570__shadow:jdBzZJaLlIAnWRtXeWnYfcj3vJJiwKJ_.sgqTbhmGLUsnsnR3RSGm-f_YIVjeal1_0 2024-09-12T01:29:15.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.330+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13834704106405168764', time=2024-09-12T03:18:48.536519+0000, chain.objs.size()=1 2024-09-12T01:29:15.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.330+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.579__shadow:DvkoUnYohMLfB8CtrOiWyijFO947ONH_.-kdFKAxw3txGHiqmSC_kBwCv81jSjHk_0 2024-09-12T01:29:15.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.330+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8011578071666329887', time=2024-09-12T03:23:50.366184+0000, chain.objs.size()=1 2024-09-12T01:29:15.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.330+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.679__shadow_.dypf-AeR3iD6GKA4q7_Yf3n8eb9mcrK_0 2024-09-12T01:29:15.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.330+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2700203080696589805', time=2024-09-12T03:24:48.481292+0000, chain.objs.size()=10 2024-09-12T01:29:15.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.330+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.735__multipart_foo.2~H7kF851OjadohkbnmjtOygP-wCkv_md.1 2024-09-12T01:29:15.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.331+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.735__multipart_foo.2~H7kF851OjadohkbnmjtOygP-wCkv_md.2 2024-09-12T01:29:15.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.331+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.735__multipart_foo.2~H7kF851OjadohkbnmjtOygP-wCkv_md.3 2024-09-12T01:29:15.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.333+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.735__multipart_foo.2~H7kF851OjadohkbnmjtOygP-wCkv_md.4 2024-09-12T01:29:15.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.333+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.735__multipart_foo.2~H7kF851OjadohkbnmjtOygP-wCkv_md.5 2024-09-12T01:29:15.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.333+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.735__multipart_foo.2~H7kF851OjadohkbnmjtOygP-wCkv_md.6 2024-09-12T01:29:15.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.334+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.735__multipart_foo.2~H7kF851OjadohkbnmjtOygP-wCkv_md.7 2024-09-12T01:29:15.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.334+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.735__multipart_foo.2~H7kF851OjadohkbnmjtOygP-wCkv_md.8 2024-09-12T01:29:15.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.334+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.735__multipart_foo.2~H7kF851OjadohkbnmjtOygP-wCkv_md.9 2024-09-12T01:29:15.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.334+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.735__multipart_foo.2~H7kF851OjadohkbnmjtOygP-wCkv_md.10 2024-09-12T01:29:15.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.338+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.340+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:29:15.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.342+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.342 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.342+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50064' 2024-09-12T01:29:15.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2692072678341051679', time=2024-09-12T03:09:04.723245+0000, chain.objs.size()=1 2024-09-12T01:29:15.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.245__shadow_.7MLZJHa_ySEZ8icF24nDKXAKxbb0j3q_0 2024-09-12T01:29:15.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6960103485045817661', time=2024-09-12T03:09:07.944619+0000, chain.objs.size()=1 2024-09-12T01:29:15.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.250__shadow_.2Sq_22Lpk7JULAQScYJv65ipjm0G-9D_0 2024-09-12T01:29:15.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1138172319559095208', time=2024-09-12T03:09:14.284987+0000, chain.objs.size()=1 2024-09-12T01:29:15.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.260__shadow_.RI9oRoXwlRjtknYge-CmrVpb90ng4ta_0 2024-09-12T01:29:15.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18207989740781648145', time=2024-09-12T03:09:55.138663+0000, chain.objs.size()=1 2024-09-12T01:29:15.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.3gDvzMb9xerPzSvVKkSDtYBarjvZjvk_0 2024-09-12T01:29:15.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15052801760671354204', time=2024-09-12T03:09:55.139190+0000, chain.objs.size()=1 2024-09-12T01:29:15.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.iLeQob6gbRjn646WepbF3ZXY2cS7NIe_0 2024-09-12T01:29:15.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.825465838534237335', time=2024-09-12T03:09:55.301437+0000, chain.objs.size()=1 2024-09-12T01:29:15.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.qZniMEuhjOVC_JJ-PfCJbHvk2vCymDE_0 2024-09-12T01:29:15.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17133304279916054802', time=2024-09-12T03:09:55.308349+0000, chain.objs.size()=1 2024-09-12T01:29:15.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.kjZrXrTrLFXayaPOkZEkxO3SLGNDdNy_0 2024-09-12T01:29:15.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17672441997528858939', time=2024-09-12T03:09:55.462730+0000, chain.objs.size()=1 2024-09-12T01:29:15.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.UiYwnMSz_G7Y8bsT7p6hGMAaM0mD8LF_0 2024-09-12T01:29:15.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15791694490013297053', time=2024-09-12T03:09:55.463243+0000, chain.objs.size()=1 2024-09-12T01:29:15.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.MM-obnl1TEgxKxTeFhMtlzXx8OtU2Fp_0 2024-09-12T01:29:15.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13798213780853058019', time=2024-09-12T03:09:57.252432+0000, chain.objs.size()=1 2024-09-12T01:29:15.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lbTcWr5oH6F6Rf4OUwLWwuti6CcvTZU_0 2024-09-12T01:29:15.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.557071191099352460', time=2024-09-12T03:09:57.272735+0000, chain.objs.size()=1 2024-09-12T01:29:15.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._g-fMKBqtvrH8_vHQrOEmzM7qoSjikE_0 2024-09-12T01:29:15.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16572750229631816210', time=2024-09-12T03:09:57.776003+0000, chain.objs.size()=1 2024-09-12T01:29:15.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.shZZDLJQATanb9PgX92a7-OffIf4iVp_0 2024-09-12T01:29:15.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.346+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16071634217996757501', time=2024-09-12T03:09:59.667981+0000, chain.objs.size()=1 2024-09-12T01:29:15.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.346+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.bRERPZWZmkUgVhWXBORP_wIXTwzvfuh_0 2024-09-12T01:29:15.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.346+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11743989348473163779', time=2024-09-12T03:10:00.366313+0000, chain.objs.size()=1 2024-09-12T01:29:15.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.346+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.AKKEzPnMewGtloxzG4Zuoc_8KdnqAny_0 2024-09-12T01:29:15.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.346+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6289538771913870245', time=2024-09-12T03:10:00.631245+0000, chain.objs.size()=1 2024-09-12T01:29:15.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.346+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.q8DhFlsan-38u5QwJeUAHJXM0er1zsP_0 2024-09-12T01:29:15.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.346+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1080458603513766599', time=2024-09-12T03:10:01.056676+0000, chain.objs.size()=1 2024-09-12T01:29:15.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.346+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.rjC-kQJryfTKdnMIk8EwCRRNEWJHiN7_0 2024-09-12T01:29:15.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.346+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5570982850388093316', time=2024-09-12T03:10:01.097851+0000, chain.objs.size()=1 2024-09-12T01:29:15.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.346+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.gIKPKe42Yu6HSJcthzBYWyUX_0r35og_0 2024-09-12T01:29:15.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.347+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18326845489840719813', time=2024-09-12T03:10:01.227488+0000, chain.objs.size()=1 2024-09-12T01:29:15.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.347+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.k-UdsV4mGpGT7OVxeTNHndijAONcQcJ_0 2024-09-12T01:29:15.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.347+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12928644049050228029', time=2024-09-12T03:10:01.338275+0000, chain.objs.size()=1 2024-09-12T01:29:15.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.347+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.GCC1OLbYJfl1ieCquieDMWwUJntB45z_0 2024-09-12T01:29:15.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.347+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14198905247390653324', time=2024-09-12T03:10:01.400076+0000, chain.objs.size()=1 2024-09-12T01:29:15.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.347+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Z9Rpp1FQCOWDQqIT49aOLmomeSHc9Nq_0 2024-09-12T01:29:15.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.349+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16528592000306744943', time=2024-09-12T03:10:01.776258+0000, chain.objs.size()=1 2024-09-12T01:29:15.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.349+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.t2EW3nlRkUQcn8X9DP1xVpJDu7JuN_b_0 2024-09-12T01:29:15.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.349+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5386500481774034753', time=2024-09-12T03:10:02.050835+0000, chain.objs.size()=1 2024-09-12T01:29:15.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.349+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9C2M3f-TH5pnvcp098ltvfPeaXB9cXQ_0 2024-09-12T01:29:15.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.349+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14662212999560508440', time=2024-09-12T03:10:03.318958+0000, chain.objs.size()=1 2024-09-12T01:29:15.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.349+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.KxlYqyILbvj7cXIXe4BCTYULii1KRAA_0 2024-09-12T01:29:15.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.349+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2389435079610758178', time=2024-09-12T03:10:05.049147+0000, chain.objs.size()=1 2024-09-12T01:29:15.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.349+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.n4h757DIx4YH-rFUimSHgD0xDJoNIPQ_0 2024-09-12T01:29:15.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.351+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10506698784719710501', time=2024-09-12T03:10:05.328504+0000, chain.objs.size()=1 2024-09-12T01:29:15.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.351+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.BAucT4_wxWEaEpgRjyOyqXXexILXXV2_0 2024-09-12T01:29:15.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.351+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3007741677043516525', time=2024-09-12T03:10:05.725744+0000, chain.objs.size()=1 2024-09-12T01:29:15.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.351+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.pjT4TyVR2XEUzf_kqt3y-7Hgrp2y6Qi_0 2024-09-12T01:29:15.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.351+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1874079797783635626', time=2024-09-12T03:10:05.849781+0000, chain.objs.size()=1 2024-09-12T01:29:15.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.351+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ooaP6wKcdAcAuHGC1bdI80It9tRpvtX_0 2024-09-12T01:29:15.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.351+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1589943402939682764', time=2024-09-12T03:10:06.137972+0000, chain.objs.size()=1 2024-09-12T01:29:15.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.351+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._aIVUfv0ifqdxmzsr4c_L_9m2z4pflp_0 2024-09-12T01:29:15.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.351+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3101529672640677118', time=2024-09-12T03:10:06.547884+0000, chain.objs.size()=1 2024-09-12T01:29:15.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.351+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9oiP5_6UHuevMKBA06PUC4i0b79y3L8_0 2024-09-12T01:29:15.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.351+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18196272353386742470', time=2024-09-12T03:10:18.482492+0000, chain.objs.size()=1 2024-09-12T01:29:15.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.351+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.281__shadow_.kcBq1xO-WkJSFiSxH6494dGmYukcF2C_0 2024-09-12T01:29:15.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.351+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12280083525363752900', time=2024-09-12T03:10:21.134193+0000, chain.objs.size()=1 2024-09-12T01:29:15.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.351+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.285__shadow_.seK9yZE0VJhRIfnqg07P2szkqWfHmY__0 2024-09-12T01:29:15.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.353+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13237987623823019797', time=2024-09-12T03:10:21.134763+0000, chain.objs.size()=1 2024-09-12T01:29:15.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.353+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.285__shadow_.GSE4Nb8bJhlO4ICT2a3kahxsTifrFkm_0 2024-09-12T01:29:15.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.353+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10453075376279938575', time=2024-09-12T03:10:27.100169+0000, chain.objs.size()=1 2024-09-12T01:29:15.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.353+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.Xg_Prn2ZcWuzxWjvGQIYFC-fUHH5vdv_0 2024-09-12T01:29:15.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.354+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1229412778318719707', time=2024-09-12T03:10:29.061158+0000, chain.objs.size()=1 2024-09-12T01:29:15.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.354+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.O324OeiXp0prZUyRZNdaLPQ1iAN_ZeN_0 2024-09-12T01:29:15.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.354+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7804014475557055076', time=2024-09-12T03:10:33.867199+0000, chain.objs.size()=1 2024-09-12T01:29:15.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.354+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.300__shadow_.Vnm3U2kKrxiRZNjmVLThBJnow5U7Jyz_0 2024-09-12T01:29:15.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.355+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7959940175573022166', time=2024-09-12T03:11:29.607634+0000, chain.objs.size()=1 2024-09-12T01:29:15.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.355+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.jny51bAl81imHTg6sDROcZiDnOdJSVq_0 2024-09-12T01:29:15.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.355+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2435497972185222300', time=2024-09-12T03:11:29.846007+0000, chain.objs.size()=1 2024-09-12T01:29:15.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.355+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.a8M6ebPGddCdh5PsvnoWdaFbo1Bu2e9_0 2024-09-12T01:29:15.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.355+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7938565888812956998', time=2024-09-12T03:11:29.964578+0000, chain.objs.size()=1 2024-09-12T01:29:15.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.355+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.879McZrzU1f24Cw3qyML1Qigu5S7U22_0 2024-09-12T01:29:15.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.357+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4995203859416320258', time=2024-09-12T03:11:30.240502+0000, chain.objs.size()=1 2024-09-12T01:29:15.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.357+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.COpO6YpMWVGO7j4qlUYd6oav8Jx9KO3_0 2024-09-12T01:29:15.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.357+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17190390461968975951', time=2024-09-12T03:11:31.112265+0000, chain.objs.size()=1 2024-09-12T01:29:15.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.357+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.QsWhTtakpbw-TZQkKoN1_v_vusXvx2e_0 2024-09-12T01:29:15.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.357+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7619423065459994985', time=2024-09-12T03:11:31.667052+0000, chain.objs.size()=1 2024-09-12T01:29:15.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.357+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mWkyqMnVM6lPMaJ6VcxLAzmnqNTpx9D_0 2024-09-12T01:29:15.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.357+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13772754785021100333', time=2024-09-12T03:11:32.162921+0000, chain.objs.size()=1 2024-09-12T01:29:15.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.357+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.jBXVhQoauPsx5uAkZmh--f8zs8zzwbi_0 2024-09-12T01:29:15.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.357+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6779758615359804068', time=2024-09-12T03:11:33.649935+0000, chain.objs.size()=1 2024-09-12T01:29:15.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.357+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.y9vAkO-XCmHHXshE8lGqDy6FswSKIG1_0 2024-09-12T01:29:15.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.357+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10519588887752059452', time=2024-09-12T03:11:33.989183+0000, chain.objs.size()=1 2024-09-12T01:29:15.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.357+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.35eUEAgz-8m1Q_nLbJhOrALSi8mPBPb_0 2024-09-12T01:29:15.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.357+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9123047698423551124', time=2024-09-12T03:11:34.469015+0000, chain.objs.size()=1 2024-09-12T01:29:15.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.357+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.wRT9lwBQVHgEJqlYY-yoFIBpLk8qDJF_0 2024-09-12T01:29:15.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.358+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9769679676508095586', time=2024-09-12T03:11:34.694771+0000, chain.objs.size()=1 2024-09-12T01:29:15.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.358+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Nvj8EGSxp9lftlA60AO3hD_-bcPmSFa_0 2024-09-12T01:29:15.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.358+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8461568273723635508', time=2024-09-12T03:11:34.908223+0000, chain.objs.size()=1 2024-09-12T01:29:15.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.358+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.UUqsrq3ni1vhI3FgzSP_60KV0AsRR90_0 2024-09-12T01:29:15.359 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.359+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13394599473856258982', time=2024-09-12T03:11:35.144447+0000, chain.objs.size()=1 2024-09-12T01:29:15.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.359+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.bZoV_WFjoao3Ilg7vxEPClwkzqZqrmh_0 2024-09-12T01:29:15.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.359+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7380354931175628447', time=2024-09-12T03:11:35.397535+0000, chain.objs.size()=1 2024-09-12T01:29:15.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.359+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.DlRuck8B4dUIP-sGsdCf3MeQ0VJedmh_0 2024-09-12T01:29:15.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.359+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13981160609333121245', time=2024-09-12T03:11:36.506698+0000, chain.objs.size()=1 2024-09-12T01:29:15.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.359+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Uvspk_XTFeh4Ra0Nn7sBIkUlOs03Zdz_0 2024-09-12T01:29:15.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.359+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15671794467318892845', time=2024-09-12T03:11:36.593910+0000, chain.objs.size()=1 2024-09-12T01:29:15.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.359+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.krH42w2NBlTz-9Sa_zpJFvDT51wv8Oj_0 2024-09-12T01:29:15.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.361+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3669311189387435491', time=2024-09-12T03:11:36.601519+0000, chain.objs.size()=1 2024-09-12T01:29:15.361 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.361+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.49Y9SS_1USnT6pTGA8RibAyVF5gwJ2l_0 2024-09-12T01:29:15.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17765964250682429435', time=2024-09-12T03:11:37.015942+0000, chain.objs.size()=1 2024-09-12T01:29:15.363 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1uQ6LRdun7ciH0p4sej4lWrQmabW_V1_0 2024-09-12T01:29:15.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2656037365184939380', time=2024-09-12T03:11:37.090579+0000, chain.objs.size()=1 2024-09-12T01:29:15.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MCUnxOjgr4xWMNb9TItPxc_wAz3UX6Z_0 2024-09-12T01:29:15.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17981038867066571306', time=2024-09-12T03:11:37.889875+0000, chain.objs.size()=1 2024-09-12T01:29:15.364 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Bw0qVhPUCtI66QqD_onpfKTJU6OpqSZ_0 2024-09-12T01:29:15.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.421454868876231509', time=2024-09-12T03:11:38.221267+0000, chain.objs.size()=1 2024-09-12T01:29:15.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.43Bzpw571G1Ef6QS1vqAd4OxdUaHQxl_0 2024-09-12T01:29:15.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18240089853847405786', time=2024-09-12T03:11:38.629298+0000, chain.objs.size()=1 2024-09-12T01:29:15.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.94UzvBGp3644Vt1UxnIjFN5HOjsuOPi_0 2024-09-12T01:29:15.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8353725862625938471', time=2024-09-12T03:11:38.633863+0000, chain.objs.size()=1 2024-09-12T01:29:15.365 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-7ZaQ9XHNTrNWafv1UGlpS52F93Wmz1_0 2024-09-12T01:29:15.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17663501055487275987', time=2024-09-12T03:11:39.345007+0000, chain.objs.size()=1 2024-09-12T01:29:15.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.gJoa5iVWfKFT2oI-0EejcO_uhK5mEzy_0 2024-09-12T01:29:15.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7453210924173537387', time=2024-09-12T03:11:39.538230+0000, chain.objs.size()=1 2024-09-12T01:29:15.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.362+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.QvQXhSIbuvidzDa1yaSmtJ0WhFmWojc_0 2024-09-12T01:29:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.365+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16871060642866551704', time=2024-09-12T03:11:39.594366+0000, chain.objs.size()=1 2024-09-12T01:29:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.365+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1Kq4BgIttNXLXkj2sY8Q5SXN_o9jKp6_0 2024-09-12T01:29:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.365+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17467133141602823231', time=2024-09-12T03:11:39.653344+0000, chain.objs.size()=1 2024-09-12T01:29:15.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.365+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qD9s5A5_hO6m2U9dM5rlVJme38ZgAV4_0 2024-09-12T01:29:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.365+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6253571571029642553', time=2024-09-12T03:11:39.790925+0000, chain.objs.size()=1 2024-09-12T01:29:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.365+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.cnMS5Xm37cgq1unzM19ITOe66lLRAS-_0 2024-09-12T01:29:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.366+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.717371433290867113', time=2024-09-12T03:11:40.285632+0000, chain.objs.size()=1 2024-09-12T01:29:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.366+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.P2Kt2pMQEi3I3uyeqtu8EVWyPODEGf8_0 2024-09-12T01:29:15.369 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.366+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10666176310897628624', time=2024-09-12T03:11:40.676862+0000, chain.objs.size()=1 2024-09-12T01:29:15.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.366+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.p4JM9ApYJAJWMlrgQmjH-CfHPMQeiSU_0 2024-09-12T01:29:15.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.366+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1306304895338272493', time=2024-09-12T03:11:40.850503+0000, chain.objs.size()=1 2024-09-12T01:29:15.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.366+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.RH24yPcU_AN_3ln1sZIvzcp6JJ7bgpN_0 2024-09-12T01:29:15.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.366+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10499121999390970769', time=2024-09-12T03:11:41.017510+0000, chain.objs.size()=1 2024-09-12T01:29:15.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.366+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.C2N8bj_hzQhlnJ2-dMsz4vNSql4dwPo_0 2024-09-12T01:29:15.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.366+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16172691745295311239', time=2024-09-12T03:11:41.236165+0000, chain.objs.size()=1 2024-09-12T01:29:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.366+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.vwcv1y9p9LAd3YDXxKcFAxL8z0G7sKw_0 2024-09-12T01:29:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.367+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7338706114112551165', time=2024-09-12T03:11:41.369533+0000, chain.objs.size()=1 2024-09-12T01:29:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.367+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.3iCbLgN3morCaXqouLXV8e5ZDKwQ74J_0 2024-09-12T01:29:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.367+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2117258728975414532', time=2024-09-12T03:12:21.871728+0000, chain.objs.size()=1 2024-09-12T01:29:15.371 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.367+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.bgEr4f_hwTF0aUbnLZHr83xRjfA_z4D_0 2024-09-12T01:29:15.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.367+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5069750177938409029', time=2024-09-12T03:12:22.005212+0000, chain.objs.size()=1 2024-09-12T01:29:15.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.367+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.OFkZJqgiZFTbu0rirsEpT3XKVga6UBU_0 2024-09-12T01:29:15.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17005269437457663841', time=2024-09-12T03:12:22.313986+0000, chain.objs.size()=1 2024-09-12T01:29:15.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.AS0uTN8MSQOYnwt26yRNDzDT_ow0a8d_0 2024-09-12T01:29:15.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11076371929388112019', time=2024-09-12T03:12:23.072024+0000, chain.objs.size()=1 2024-09-12T01:29:15.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.yaWBetzvGAZ6Yx7U1VvQJkgHohK0rcM_0 2024-09-12T01:29:15.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14484647266045901985', time=2024-09-12T03:12:23.895712+0000, chain.objs.size()=1 2024-09-12T01:29:15.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.YEwVzM3SjckzirZ5aVPJQDxobcrnjQM_0 2024-09-12T01:29:15.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3615063551958453272', time=2024-09-12T03:12:24.538099+0000, chain.objs.size()=1 2024-09-12T01:29:15.374 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.cIZcvPsY1scCMxf0RQYyWDVNAEqTrq__0 2024-09-12T01:29:15.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14670216173251708581', time=2024-09-12T03:12:24.649924+0000, chain.objs.size()=1 2024-09-12T01:29:15.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.IxDOp4X42hjQqsSvoboyhgbOReXuTkk_0 2024-09-12T01:29:15.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17574631473735422443', time=2024-09-12T03:12:25.542091+0000, chain.objs.size()=1 2024-09-12T01:29:15.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.w0odHr_E4xTpAYlJi2k-HgBGA8Qozap_0 2024-09-12T01:29:15.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4909135535238057011', time=2024-09-12T03:12:25.597283+0000, chain.objs.size()=1 2024-09-12T01:29:15.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xWawm5O_KImK5GP7KddlaNQc-t7QlNN_0 2024-09-12T01:29:15.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1304554869301516068', time=2024-09-12T03:12:25.825368+0000, chain.objs.size()=1 2024-09-12T01:29:15.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.IW5efd1wvPUgyGoldQBq54qeImZ7-ju_0 2024-09-12T01:29:15.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4778352094064700572', time=2024-09-12T03:12:25.895728+0000, chain.objs.size()=1 2024-09-12T01:29:15.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ncFkJ0fV3BTBT_hPFy-ucYVfm-Q2TbO_0 2024-09-12T01:29:15.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11440351151971734046', time=2024-09-12T03:12:25.923503+0000, chain.objs.size()=1 2024-09-12T01:29:15.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Gja1G7M-aSbC9Jf6yY1wNm5hSs85a9T_0 2024-09-12T01:29:15.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1342303806214189183', time=2024-09-12T03:12:26.174157+0000, chain.objs.size()=1 2024-09-12T01:29:15.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.370+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.5INFEChBGaIhx7wE8QtebQwAQm0ZKCI_0 2024-09-12T01:29:15.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.373+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18036430845209511312', time=2024-09-12T03:12:26.263612+0000, chain.objs.size()=1 2024-09-12T01:29:15.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.373+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1y6lZyfud9Z7C57vX283wT6CwmI5gXU_0 2024-09-12T01:29:15.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.803587013722709829', time=2024-09-12T03:12:27.053582+0000, chain.objs.size()=1 2024-09-12T01:29:15.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.PZFn8SBi6YkIaYRRZf0oFf1O8nzsKJy_0 2024-09-12T01:29:15.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9916208498661286488', time=2024-09-12T03:12:27.237541+0000, chain.objs.size()=1 2024-09-12T01:29:15.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.65hsGuHC7YNSuq2xKOE_1Co5sZFp7EF_0 2024-09-12T01:29:15.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2222285051861392854', time=2024-09-12T03:12:27.499195+0000, chain.objs.size()=1 2024-09-12T01:29:15.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.pel9LIrFbxbP9R0wSVlzB-msDsBFrsJ_0 2024-09-12T01:29:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12679449500934144443', time=2024-09-12T03:12:27.668614+0000, chain.objs.size()=1 2024-09-12T01:29:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mCMIOmGeNjRzMNOyjFQBuoREfHzNWoO_0 2024-09-12T01:29:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12784000178239771895', time=2024-09-12T03:12:27.707293+0000, chain.objs.size()=1 2024-09-12T01:29:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.FZaOK0QM-ylmiemGW4N--S3QF19SAWH_0 2024-09-12T01:29:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9862258620760148143', time=2024-09-12T03:12:27.910670+0000, chain.objs.size()=1 2024-09-12T01:29:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Ss77_Yd9HZCD-Agf301KVJnz_tvyAYU_0 2024-09-12T01:29:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4375550364731842645', time=2024-09-12T03:12:27.965771+0000, chain.objs.size()=1 2024-09-12T01:29:15.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.CthhFRnkZhiuJWox2poVErF6HT55doV_0 2024-09-12T01:29:15.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15369022995557859777', time=2024-09-12T03:12:28.919515+0000, chain.objs.size()=1 2024-09-12T01:29:15.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.XBG9sm2LTTmOxSG_c7bBtQfKoKKCxW7_0 2024-09-12T01:29:15.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15562636409396102211', time=2024-09-12T03:12:28.973596+0000, chain.objs.size()=1 2024-09-12T01:29:15.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.374+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.IqUpgJZ_4wUQPBtXfFBVZloCKLFyRy1_0 2024-09-12T01:29:15.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.375+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8804798853739217993', time=2024-09-12T03:12:29.059190+0000, chain.objs.size()=1 2024-09-12T01:29:15.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.375+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.zq2UscaHEt_ofNMHuLQebtmCckxjUHW_0 2024-09-12T01:29:15.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.375+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9934912954875518571', time=2024-09-12T03:12:29.353465+0000, chain.objs.size()=1 2024-09-12T01:29:15.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.375+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.BwgE9H84yGu50k517kvSGOn8kuBVi1t_0 2024-09-12T01:29:15.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.378+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12692636429331640213', time=2024-09-12T03:12:29.542845+0000, chain.objs.size()=1 2024-09-12T01:29:15.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.378+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.OZ7jM0P-N53oBOEGEJS9JTNWr23dkJp_0 2024-09-12T01:29:15.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.378+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4705784370790100087', time=2024-09-12T03:12:29.668939+0000, chain.objs.size()=1 2024-09-12T01:29:15.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.378+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3Ds0ySJQH3iPJcdOLqsRfurCEz-BkWD_0 2024-09-12T01:29:15.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.378+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3794399916776679493', time=2024-09-12T03:12:29.904461+0000, chain.objs.size()=1 2024-09-12T01:29:15.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.378+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mNjXsIhOkM8Q_TYBcUbL7moGaVOk3RB_0 2024-09-12T01:29:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.380+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12256422453418672157', time=2024-09-12T03:12:30.592692+0000, chain.objs.size()=1 2024-09-12T01:29:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.380+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.jvFux63PUCcAo8_1a422SQ6Cbij2Z4v_0 2024-09-12T01:29:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.380+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.230789307435019317', time=2024-09-12T03:12:30.868795+0000, chain.objs.size()=1 2024-09-12T01:29:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.380+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.x5wjM5fe7Sd9_lvygyTJRN_Pgx16HEz_0 2024-09-12T01:29:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.380+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1049387626352665107', time=2024-09-12T03:12:31.090981+0000, chain.objs.size()=1 2024-09-12T01:29:15.383 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.380+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.eWlkpPDiQKHOUufHjaguDj0cvDB5LIH_0 2024-09-12T01:29:15.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.384+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/50064 2024-09-12T01:29:15.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-12T01:29:15.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7214919238005507494', time=2024-09-12T03:12:31.173681+0000, chain.objs.size()=1 2024-09-12T01:29:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Wbza2R7lOm6NU3eLmTcqtLl50C8diuE_0 2024-09-12T01:29:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11825277862780374309', time=2024-09-12T03:12:31.612237+0000, chain.objs.size()=1 2024-09-12T01:29:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.dVQh5eNQIUBmfKbIXGPPBF3qqmf4VPF_0 2024-09-12T01:29:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17827819730591702672', time=2024-09-12T03:12:32.146750+0000, chain.objs.size()=1 2024-09-12T01:29:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.PKRJrAvkQzJ5qCq1lY1Lz5ee1jo-tOA_0 2024-09-12T01:29:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2289434118240129952', time=2024-09-12T03:12:32.694529+0000, chain.objs.size()=1 2024-09-12T01:29:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gp6x_EKAPcOFn84gNAUbvBCRXa_eBNC_0 2024-09-12T01:29:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.394913874268483432', time=2024-09-12T03:12:33.081330+0000, chain.objs.size()=1 2024-09-12T01:29:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.sVt4B9LQJWjl6Wq6g2qsOkq6QFYI88r_0 2024-09-12T01:29:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17724158769166304897', time=2024-09-12T03:12:33.581843+0000, chain.objs.size()=1 2024-09-12T01:29:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.6I7sFUiqO5_FDIvEvEg7bOGlKZKaHOv_0 2024-09-12T01:29:15.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4032386217642773715', time=2024-09-12T03:12:33.961487+0000, chain.objs.size()=1 2024-09-12T01:29:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.cYOgizRC7O_BKFaoH-Gs5zXuEJfVfWU_0 2024-09-12T01:29:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1449128506109656837', time=2024-09-12T03:12:34.115342+0000, chain.objs.size()=1 2024-09-12T01:29:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.SwsRGH4qS4hzB_X2acWFYnvyX_mRPSB_0 2024-09-12T01:29:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15553619278333447725', time=2024-09-12T03:12:34.398573+0000, chain.objs.size()=1 2024-09-12T01:29:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.VfbzvUShIJ4KEoDdf7GP8Zukv-pFSrP_0 2024-09-12T01:29:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12784243084163527984', time=2024-09-12T03:12:34.489224+0000, chain.objs.size()=1 2024-09-12T01:29:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.K3tR63qsFAZFS3ENzY2H4TPYmHKCU9L_0 2024-09-12T01:29:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8136437164684617340', time=2024-09-12T03:13:56.806283+0000, chain.objs.size()=1 2024-09-12T01:29:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.465__shadow_.7KJs2f6AxIpHr9-uQbeX5Aty_ZLA7On_0 2024-09-12T01:29:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11340771358389981792', time=2024-09-12T03:13:56.809685+0000, chain.objs.size()=1 2024-09-12T01:29:15.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.386+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.465__shadow_.lMHL8tuj_oUd_SZWrJ-ZZJQ5U6L0AE3_0 2024-09-12T01:29:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.389+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7163045374562407327', time=2024-09-12T03:13:57.326482+0000, chain.objs.size()=1 2024-09-12T01:29:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.389+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.466__shadow_.xFeaDUFBQIob6Vh-4ay2qmqW_8BwSDN_0 2024-09-12T01:29:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.389+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14660383296961928003', time=2024-09-12T03:14:05.851515+0000, chain.objs.size()=1 2024-09-12T01:29:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.389+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.484__shadow_.q-7ipke2fBmzPLDXYqanceBp9lKlZj6_0 2024-09-12T01:29:15.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.389+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14937610145605457722', time=2024-09-12T03:14:40.457686+0000, chain.objs.size()=1 2024-09-12T01:29:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.389+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.517__shadow_.iG5VS1MfY086s7b-Zdwn8vmBVEzslFQ_0 2024-09-12T01:29:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.389+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16334313836293244559', time=2024-09-12T03:16:02.875192+0000, chain.objs.size()=2 2024-09-12T01:29:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.389+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.523__multipart_mymultipart.2~lXgZ-dPS-0xnFmGzMOhsYfb1GkAA63Y.1 2024-09-12T01:29:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.389+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.523__multipart_mymultipart.2~lXgZ-dPS-0xnFmGzMOhsYfb1GkAA63Y.2 2024-09-12T01:29:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.389+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7151955510422390041', time=2024-09-12T03:16:12.122307+0000, chain.objs.size()=2 2024-09-12T01:29:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.389+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.525__multipart_mymultipart.2~4AEm0ZwdyfrWsWyvT5AUpQ27S2czz77.1 2024-09-12T01:29:15.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.389+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.525__multipart_mymultipart.2~4AEm0ZwdyfrWsWyvT5AUpQ27S2czz77.2 2024-09-12T01:29:15.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.391+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10462911836747975210', time=2024-09-12T03:16:25.125955+0000, chain.objs.size()=1 2024-09-12T01:29:15.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.391+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.528__shadow_.6ufYg83ahzPBtTdf8c4lmyLU9TWyY-V_0 2024-09-12T01:29:15.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.391+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9829995100089904020', time=2024-09-12T03:17:29.463425+0000, chain.objs.size()=1 2024-09-12T01:29:15.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.391+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.558__shadow_.tY8VLFUCkMfy0xPwZfAKSaKW7bZDYgb_0 2024-09-12T01:29:15.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.391+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7969371724830612039', time=2024-09-12T03:17:31.357310+0000, chain.objs.size()=1 2024-09-12T01:29:15.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.391+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.558__shadow_.kk4UjEwadFGN2KwRrhh84nkEN0Z_sNt_0 2024-09-12T01:29:15.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.391+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8395242284138571044', time=2024-09-12T03:17:49.703078+0000, chain.objs.size()=1 2024-09-12T01:29:15.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.391+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:EJYVw.TBOVqrhlEfWNWrBx1ieJxghhZ_.XNUFZtS63vhxSp-plc68CZJnnMxGgg7_0 2024-09-12T01:29:15.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.393+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17833857219808137963', time=2024-09-12T03:18:21.283854+0000, chain.objs.size()=1 2024-09-12T01:29:15.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.393+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:uY8dSufIhuKj6cFwukCb68RH16RInSK_.Nf2PTnVOwncc3MdD9FpXdl8uPM7VGAf_0 2024-09-12T01:29:15.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.394+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5112916461771669201', time=2024-09-12T03:18:54.433437+0000, chain.objs.size()=1 2024-09-12T01:29:15.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.394+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.585__shadow:JmLFNyZ0w1x9DkYTQt8vYMeC0.H6jSX_.DJPXhguyt4qRYp2dRpDFaMqAcTUcqwQ_0 2024-09-12T01:29:15.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.394+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14671478078877982659', time=2024-09-12T03:19:07.928534+0000, chain.objs.size()=1 2024-09-12T01:29:15.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.394+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.608__shadow_.-1K67T7d_w4bVEQYk_iBBaljPN_UUP__0 2024-09-12T01:29:15.398 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.397+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.400 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.400+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:29:15.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.401+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.402+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.402+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45210' 2024-09-12T01:29:15.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.402+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_uVYRz62mF3RmOIZzCXgnt4lU7vQcCUx', time=2024-09-12T03:06:59.429174+0000, chain.objs.size()=1 2024-09-12T01:29:15.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.402+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.165__shadow_.Ku-o33NFhzhhJizXryLCfeF7q7_eawu_0 2024-09-12T01:29:15.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.402+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7376791465561222154', time=2024-09-12T03:09:04.077933+0000, chain.objs.size()=1 2024-09-12T01:29:15.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.244__shadow_.785fm8dnuKj0KtJWZBRyoeOLzpwseir_0 2024-09-12T01:29:15.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5493420756177163172', time=2024-09-12T03:09:07.297926+0000, chain.objs.size()=1 2024-09-12T01:29:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.249__shadow_.zpdd_3tza2AGLZDLYWqTc_4Y6dKvsY7_0 2024-09-12T01:29:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16725414821359673948', time=2024-09-12T03:09:11.191288+0000, chain.objs.size()=1 2024-09-12T01:29:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.255__shadow_.ng92f-ZNALokQktwmWqYyMuozHk0Kax_0 2024-09-12T01:29:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15426294096727305109', time=2024-09-12T03:09:54.841091+0000, chain.objs.size()=1 2024-09-12T01:29:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.cxDxDbbyo1KytPNyf55FU2v870nz_Cs_0 2024-09-12T01:29:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9557530597843760028', time=2024-09-12T03:09:55.026652+0000, chain.objs.size()=1 2024-09-12T01:29:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._1I2PuAPwDIspiXaaoWS7OE9riRQ71A_0 2024-09-12T01:29:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13009011779588155331', time=2024-09-12T03:09:55.093113+0000, chain.objs.size()=1 2024-09-12T01:29:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.gzszytnfBLdKyn3-uOXkIWM0UOQOEcx_0 2024-09-12T01:29:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11635514255824456635', time=2024-09-12T03:09:55.476873+0000, chain.objs.size()=1 2024-09-12T01:29:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._fkLItEVx0u5kpqlC_MoxZhCBNyGoLw_0 2024-09-12T01:29:15.404 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11225049662902218184', time=2024-09-12T03:09:56.283170+0000, chain.objs.size()=1 2024-09-12T01:29:15.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ALif0f1H_Zde3s0qtAjEsPtx-bT_5gd_0 2024-09-12T01:29:15.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17124141775957718128', time=2024-09-12T03:09:56.534028+0000, chain.objs.size()=1 2024-09-12T01:29:15.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9y_NXmA2OGdp_ti5TBLr-9fMc4UVQHh_0 2024-09-12T01:29:15.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11390753950396514012', time=2024-09-12T03:09:56.604565+0000, chain.objs.size()=1 2024-09-12T01:29:15.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.K2rSnf3TL1jXM-PU8kWm9S7WpMm3KhQ_0 2024-09-12T01:29:15.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1930185190609615821', time=2024-09-12T03:09:56.662167+0000, chain.objs.size()=1 2024-09-12T01:29:15.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.403+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.284l4oFiY0V4aDSNkGZjK6viKcWuzhN_0 2024-09-12T01:29:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.405+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8504895029528262911', time=2024-09-12T03:09:57.777314+0000, chain.objs.size()=1 2024-09-12T01:29:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.405+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.FpcoTEf9lsJAgF4_ZE1t3WsShOKjxlM_0 2024-09-12T01:29:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.405+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14939189078133606378', time=2024-09-12T03:09:58.166276+0000, chain.objs.size()=1 2024-09-12T01:29:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.405+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.l0j2YA6mDrhGdRvSo-zGzW5Sf6MpFJI_0 2024-09-12T01:29:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.406+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14464831879929776695', time=2024-09-12T03:09:58.304601+0000, chain.objs.size()=1 2024-09-12T01:29:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.406+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.IqcnQpX43c1ewadr2YnfV-Yw-IpAuSq_0 2024-09-12T01:29:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.406+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17120046950011191527', time=2024-09-12T03:09:58.825168+0000, chain.objs.size()=1 2024-09-12T01:29:15.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.406+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.aSd-zcasLddi0G4XtfE3UMqf0R77tH6_0 2024-09-12T01:29:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.407+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5447803661074270479', time=2024-09-12T03:09:58.970184+0000, chain.objs.size()=1 2024-09-12T01:29:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.407+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dnBCAxvr3YPom8koEVVZiFihuv5Yps7_0 2024-09-12T01:29:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.407+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6036663017176043735', time=2024-09-12T03:09:59.506565+0000, chain.objs.size()=1 2024-09-12T01:29:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.407+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.WEO6hJxqH8fHEAkGeHVbP23Dz0rcp4D_0 2024-09-12T01:29:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.407+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6087473236529708496', time=2024-09-12T03:09:59.633697+0000, chain.objs.size()=1 2024-09-12T01:29:15.407 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.407+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9gIgIvv7ikMCHRLIsXTrpxDVTvsfQda_0 2024-09-12T01:29:15.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.407+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14875818828714719219', time=2024-09-12T03:10:01.055257+0000, chain.objs.size()=1 2024-09-12T01:29:15.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.407+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1MLJIPIDbjTL3Dpez3dtoJlTUsaEuwA_0 2024-09-12T01:29:15.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.407+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3351451310722685597', time=2024-09-12T03:10:01.071508+0000, chain.objs.size()=1 2024-09-12T01:29:15.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.407+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.sHpnWu-nM180PnwhQ0ISp8DhKHTqZlh_0 2024-09-12T01:29:15.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.407+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2252416744536808523', time=2024-09-12T03:10:01.423939+0000, chain.objs.size()=1 2024-09-12T01:29:15.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.407+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.4nsFdQnkexumaTH6szP4wHcBTFpWsnY_0 2024-09-12T01:29:15.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.407+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9326948586480001960', time=2024-09-12T03:10:01.885154+0000, chain.objs.size()=1 2024-09-12T01:29:15.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.407+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.3HdFIUAtgNIyT5XBsYl4bNeGDvmdgXi_0 2024-09-12T01:29:15.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.408+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16765464835072894159', time=2024-09-12T03:10:02.067631+0000, chain.objs.size()=1 2024-09-12T01:29:15.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.408+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.7FZysQBdZ6hTGKSBCjwCx8WRVeecivD_0 2024-09-12T01:29:15.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.408+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14993373980631855108', time=2024-09-12T03:10:02.206851+0000, chain.objs.size()=1 2024-09-12T01:29:15.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.408+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.OMUKu8Hkv9j70nuhJ0y_wLWgwp4RLBW_0 2024-09-12T01:29:15.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.410+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6732450305667544002', time=2024-09-12T03:10:02.688747+0000, chain.objs.size()=1 2024-09-12T01:29:15.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.410+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.4Sa4KYgx73V8evXLFQVWiygHhKUnnTT_0 2024-09-12T01:29:15.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.410+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9636758357831151398', time=2024-09-12T03:10:02.801201+0000, chain.objs.size()=1 2024-09-12T01:29:15.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.410+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.hpTuE9phlsV3a0m0r908GEJulRJkrN9_0 2024-09-12T01:29:15.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.411+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1370655856674101104', time=2024-09-12T03:10:02.964245+0000, chain.objs.size()=1 2024-09-12T01:29:15.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.411+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QUq33vsn-D5ffZw0jMVkWhCeH9f_Dv-_0 2024-09-12T01:29:15.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.411+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13218555931612848823', time=2024-09-12T03:10:05.051331+0000, chain.objs.size()=1 2024-09-12T01:29:15.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.411+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.OnpoP0Qea5-grLEZ7MNz_fTfqsdb10L_0 2024-09-12T01:29:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.411+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9161948627594312871', time=2024-09-12T03:10:05.099074+0000, chain.objs.size()=1 2024-09-12T01:29:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.411+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.EbBgWtlKl56dYvV3-SPOU1yJrdQUbkz_0 2024-09-12T01:29:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.411+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7830733364807345573', time=2024-09-12T03:10:05.235151+0000, chain.objs.size()=1 2024-09-12T01:29:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.411+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.e44IhF2qOtTCtX3kQayW7cBS1cmiHI6_0 2024-09-12T01:29:15.413 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.411+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9774098437865487678', time=2024-09-12T03:10:05.305844+0000, chain.objs.size()=1 2024-09-12T01:29:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.411+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.BvyV3zsSLb3m_iaGnFWDYa8UimtXdHx_0 2024-09-12T01:29:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.411+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8783262903145050985', time=2024-09-12T03:10:05.393957+0000, chain.objs.size()=1 2024-09-12T01:29:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.411+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.7qPVdWZYpQy6B-6Ibw-hhMbUReG3r0Z_0 2024-09-12T01:29:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.411+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18330308744493970508', time=2024-09-12T03:10:05.395159+0000, chain.objs.size()=1 2024-09-12T01:29:15.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.411+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.zdZOXwXI44n1K96m2aDz3-YCDPt-aSD_0 2024-09-12T01:29:15.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.413+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16426676288877096121', time=2024-09-12T03:10:06.085495+0000, chain.objs.size()=1 2024-09-12T01:29:15.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.413+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.BJH2D0dsfP_J7PTmol7tzfHlCvhoWoq_0 2024-09-12T01:29:15.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.413+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16675085053692390677', time=2024-09-12T03:10:06.257994+0000, chain.objs.size()=1 2024-09-12T01:29:15.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.413+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1hHJfQgf_Gi7CfA_zJQy3M_eztAwaUk_0 2024-09-12T01:29:15.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.413+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14495238459105677723', time=2024-09-12T03:10:06.697369+0000, chain.objs.size()=1 2024-09-12T01:29:15.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.413+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.nbF_ldpCOBOXR4Fl3XsqN5PjoKX_INh_0 2024-09-12T01:29:15.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.413+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5735822640099962240', time=2024-09-12T03:10:12.095921+0000, chain.objs.size()=1 2024-09-12T01:29:15.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.413+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.271__shadow_.GZ0Nc1SUlqbCKFgOyzO3DxKU9MXH9Cu_0 2024-09-12T01:29:15.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.415+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17839417723403922906', time=2024-09-12T03:10:12.689723+0000, chain.objs.size()=1 2024-09-12T01:29:15.417 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.415+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.272__shadow_.9JckHelKb9d2GkuO8fLH3byzTz01mmx_0 2024-09-12T01:29:15.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.415+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15846952487750474842', time=2024-09-12T03:10:27.059759+0000, chain.objs.size()=1 2024-09-12T01:29:15.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.415+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.p9tgbMrrRWC4GhQhBQ5Th9A49DQz0is_0 2024-09-12T01:29:15.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.415+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16426230177870475360', time=2024-09-12T03:10:35.200549+0000, chain.objs.size()=1 2024-09-12T01:29:15.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.415+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.302__shadow_.kt-XltlXovQ2027rsk_vKLC-F2N3c_I_0 2024-09-12T01:29:15.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.415+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5166041340866246283', time=2024-09-12T03:10:35.825959+0000, chain.objs.size()=1 2024-09-12T01:29:15.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.415+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.303__shadow_.FkOjnJUiX5EXU1CJ4Tu_hJU6zL7NO8P_0 2024-09-12T01:29:15.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.415+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3845053688574842751', time=2024-09-12T03:10:48.929314+0000, chain.objs.size()=1 2024-09-12T01:29:15.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.415+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.322__shadow_.5fmavI2piyl6yt84HfNcc3LDBd_Ijyg_0 2024-09-12T01:29:15.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.415+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16848176070577818478', time=2024-09-12T03:11:29.686638+0000, chain.objs.size()=1 2024-09-12T01:29:15.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.415+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MpoMPSjKf252Pgn2km_OmBl21ccrhmQ_0 2024-09-12T01:29:15.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.415+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14495708237714807803', time=2024-09-12T03:11:30.063121+0000, chain.objs.size()=1 2024-09-12T01:29:15.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.415+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.oUjpd58SWjF4jWa1to44O2E6GwsxZ4O_0 2024-09-12T01:29:15.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.417+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10978271235333449357', time=2024-09-12T03:11:30.358741+0000, chain.objs.size()=1 2024-09-12T01:29:15.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.417+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.yYJTvPGlGtZijwcBkekem_f7uJwYhJT_0 2024-09-12T01:29:15.421 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.417+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1376895795053258417', time=2024-09-12T03:11:30.542036+0000, chain.objs.size()=1 2024-09-12T01:29:15.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.417+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.YchMpWlEm0QQHAUGIieWbqVRACYRn03_0 2024-09-12T01:29:15.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.417+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1766437424205651892', time=2024-09-12T03:11:31.558944+0000, chain.objs.size()=1 2024-09-12T01:29:15.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.417+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Knhk23Ktbg3r5N9FOxVJOJpEX1NppQD_0 2024-09-12T01:29:15.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.417+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6645275889905891351', time=2024-09-12T03:11:31.654053+0000, chain.objs.size()=1 2024-09-12T01:29:15.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.417+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qasGLPx-Jz0tiz8tfFkREEuUSj2JG-N_0 2024-09-12T01:29:15.422 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.419+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15708126178487545010', time=2024-09-12T03:11:32.184332+0000, chain.objs.size()=1 2024-09-12T01:29:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.419+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.SJD4XR0y9sWTTDsByw3CgPRxitoqmT4_0 2024-09-12T01:29:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.419+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12866091241383824832', time=2024-09-12T03:11:32.883774+0000, chain.objs.size()=1 2024-09-12T01:29:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.419+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.kHEDzjp512G51U4iK3oitwSB1yd4KLk_0 2024-09-12T01:29:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.420+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4724661101638172283', time=2024-09-12T03:11:33.077054+0000, chain.objs.size()=1 2024-09-12T01:29:15.423 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.420+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.k40VgtR8kSaULFXdIhZjJp8Ms7hVmje_0 2024-09-12T01:29:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.420+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8992781811301902656', time=2024-09-12T03:11:33.445294+0000, chain.objs.size()=1 2024-09-12T01:29:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.420+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.S_egJTWfpvzuPGGqTESE2-cuQfZJfaH_0 2024-09-12T01:29:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.421+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2533782410673644548', time=2024-09-12T03:11:33.617990+0000, chain.objs.size()=1 2024-09-12T01:29:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.421+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.wb1j4wt4g1Xh2jDGRAe7LVV64eWh4zZ_0 2024-09-12T01:29:15.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.421+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10563221716058767486', time=2024-09-12T03:11:33.964061+0000, chain.objs.size()=1 2024-09-12T01:29:15.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.421+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.wnxKrSAQe5VTo4CXyVgLlW-3PJ4UN2f_0 2024-09-12T01:29:15.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.421+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1622485018476105834', time=2024-09-12T03:11:34.492796+0000, chain.objs.size()=1 2024-09-12T01:29:15.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.421+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5eXqvdzVxRliYs4Uf5fyGztc7f-ySSL_0 2024-09-12T01:29:15.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.421+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17839329660852846735', time=2024-09-12T03:11:34.621933+0000, chain.objs.size()=1 2024-09-12T01:29:15.425 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.421+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Pjt-4LAHPRAMnqgns83FlFEZGGjNp3h_0 2024-09-12T01:29:15.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.421+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2276005368406606858', time=2024-09-12T03:11:34.841165+0000, chain.objs.size()=1 2024-09-12T01:29:15.427 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.421+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.wuYwVU7A10q5yYA_NoWMzFWclOwe0kI_0 2024-09-12T01:29:15.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.421+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17608054064825231480', time=2024-09-12T03:11:35.170374+0000, chain.objs.size()=1 2024-09-12T01:29:15.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.421+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.FFQZqGz5Wpl-w8QuAF5oU36mNqT5C9c_0 2024-09-12T01:29:15.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.421+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7440064770367142728', time=2024-09-12T03:11:35.220228+0000, chain.objs.size()=1 2024-09-12T01:29:15.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.421+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tEr54jXCqw-VuQ2WQT5c-OJc-nb-l77_0 2024-09-12T01:29:15.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.422+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7296903724997078947', time=2024-09-12T03:11:35.400543+0000, chain.objs.size()=1 2024-09-12T01:29:15.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.422+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.h1hF5IdMG3qUw-OLhC1pe0HgSelIDGB_0 2024-09-12T01:29:15.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.422+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9638598508019435680', time=2024-09-12T03:11:35.509536+0000, chain.objs.size()=1 2024-09-12T01:29:15.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.422+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.zlNwWp_eAnNjx4m-UNAyX3CZlS17P7i_0 2024-09-12T01:29:15.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17827507000838217741', time=2024-09-12T03:11:36.484124+0000, chain.objs.size()=1 2024-09-12T01:29:15.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.lfbb2dFd-rxRdxUZaUqmcSn9vOReqIQ_0 2024-09-12T01:29:15.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18148782556283698921', time=2024-09-12T03:11:36.604170+0000, chain.objs.size()=1 2024-09-12T01:29:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.3aoahnaVIxWGOohDGBa4hg2nTWJTpdN_0 2024-09-12T01:29:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10173251568223447420', time=2024-09-12T03:11:36.745158+0000, chain.objs.size()=1 2024-09-12T01:29:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ueCVXtKe4FrvdUg4Ayr9ffnmje55nl5_0 2024-09-12T01:29:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3176350164693117658', time=2024-09-12T03:11:36.765946+0000, chain.objs.size()=1 2024-09-12T01:29:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.nRSK_rot7O_s7dxJYMHCklkzn-MwwZ0_0 2024-09-12T01:29:15.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7126703041856514624', time=2024-09-12T03:11:37.016206+0000, chain.objs.size()=1 2024-09-12T01:29:15.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2v0HKt6UmEDpfxrycnGztWYKENswO7O_0 2024-09-12T01:29:15.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.784341295051785461', time=2024-09-12T03:11:37.264015+0000, chain.objs.size()=1 2024-09-12T01:29:15.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.jGWk0dC3vGTQ_3kQn5y3PuJH4nuBJrC_0 2024-09-12T01:29:15.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14886550618629186479', time=2024-09-12T03:11:37.674316+0000, chain.objs.size()=1 2024-09-12T01:29:15.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.XECCSJv3NEIo6UkwhNxut2DSV0mIFVe_0 2024-09-12T01:29:15.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11428354318932847681', time=2024-09-12T03:11:38.470705+0000, chain.objs.size()=1 2024-09-12T01:29:15.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.424+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.UaiBdlyA1lK5t63cK9uXmvb652remGD_0 2024-09-12T01:29:15.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.426+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8480475194133075978', time=2024-09-12T03:11:38.471231+0000, chain.objs.size()=1 2024-09-12T01:29:15.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.426+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.p6gfi83pvy2LAf3A2DtwZbEuNAQZxOS_0 2024-09-12T01:29:15.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.428+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2281673588477630634', time=2024-09-12T03:11:38.697006+0000, chain.objs.size()=1 2024-09-12T01:29:15.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.428+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xcfGJ56T37wZnFHeSitC2QaOkFyzUmB_0 2024-09-12T01:29:15.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.428+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12012097628870124751', time=2024-09-12T03:11:39.224991+0000, chain.objs.size()=1 2024-09-12T01:29:15.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.428+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.kNGSvb33sGQhYA48PdICsXnPoI9MK3o_0 2024-09-12T01:29:15.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.428+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5548444577579909511', time=2024-09-12T03:11:39.673148+0000, chain.objs.size()=1 2024-09-12T01:29:15.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.428+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.v3TBNJ3Jl0uSMSwUUX53bi59tG6JNd2_0 2024-09-12T01:29:15.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14106087836098281029', time=2024-09-12T03:11:39.948974+0000, chain.objs.size()=1 2024-09-12T01:29:15.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.wAYSOYb0qM4tUHvS2ZW7APAFUNzBx3R_0 2024-09-12T01:29:15.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5642669950299365320', time=2024-09-12T03:11:40.988811+0000, chain.objs.size()=1 2024-09-12T01:29:15.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.dkQlxsKaJ8hHdiUZ52QSvwZ4WzCnaRW_0 2024-09-12T01:29:15.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13781663093645799497', time=2024-09-12T03:11:41.297269+0000, chain.objs.size()=1 2024-09-12T01:29:15.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.rlZg7kDBd9hqjvdCRo_P4NSsPvPY4Or_0 2024-09-12T01:29:15.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18272730198569655078', time=2024-09-12T03:11:41.498070+0000, chain.objs.size()=1 2024-09-12T01:29:15.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.bx11g0HKvdT_9Ve5JVDk7yP37T4HDMW_0 2024-09-12T01:29:15.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9095629688253235606', time=2024-09-12T03:12:22.997581+0000, chain.objs.size()=1 2024-09-12T01:29:15.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-eLMCjZjkAosg6BvT0pGd3LLW37qYdI_0 2024-09-12T01:29:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14282562682332705320', time=2024-09-12T03:12:24.037409+0000, chain.objs.size()=1 2024-09-12T01:29:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.QDV-GcyW6nvpq0EnJRfX7crsB_E5Y4u_0 2024-09-12T01:29:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11927337203335320677', time=2024-09-12T03:12:24.228250+0000, chain.objs.size()=1 2024-09-12T01:29:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.9aAnS6znW1QiVYWzRNA2dLFU4uwJt_D_0 2024-09-12T01:29:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2293464319455524424', time=2024-09-12T03:12:24.261795+0000, chain.objs.size()=1 2024-09-12T01:29:15.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.429+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.zBFjuanRQw_6V_tPbEBKvqQzRezhFJ4_0 2024-09-12T01:29:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.431+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1739987672597150879', time=2024-09-12T03:12:24.400056+0000, chain.objs.size()=1 2024-09-12T01:29:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.431+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.WmczM4AXIs4FbQ62VmVp669lsh8XIRh_0 2024-09-12T01:29:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.431+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3322241125524205817', time=2024-09-12T03:12:24.487653+0000, chain.objs.size()=1 2024-09-12T01:29:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.431+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.n-PJuuOZZdEQBqkp8RUQ0ov3Y-pCDqe_0 2024-09-12T01:29:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.433+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2011015164177583626', time=2024-09-12T03:12:24.808766+0000, chain.objs.size()=1 2024-09-12T01:29:15.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.433+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ib_sLSZVv18l-27ada5oEbvaukXj0nv_0 2024-09-12T01:29:15.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.867935973588116244', time=2024-09-12T03:12:25.344882+0000, chain.objs.size()=1 2024-09-12T01:29:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.0_TQ-U7chkA0oXAdPwdOk1vKMzwkG3G_0 2024-09-12T01:29:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1590143588636927324', time=2024-09-12T03:12:25.483529+0000, chain.objs.size()=1 2024-09-12T01:29:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1xGrQT9bnabUasjnXIXmlm6g1d1aGQP_0 2024-09-12T01:29:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1633749306897916686', time=2024-09-12T03:12:25.570112+0000, chain.objs.size()=1 2024-09-12T01:29:15.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.6Cndldbww3QLyv1GrvvaITHo32hvmRM_0 2024-09-12T01:29:15.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1005624983791056870', time=2024-09-12T03:12:25.645960+0000, chain.objs.size()=1 2024-09-12T01:29:15.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Zq-GQDTwegQRt77YnGRqg6H_mgxXdhV_0 2024-09-12T01:29:15.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14791092924249713926', time=2024-09-12T03:12:25.867943+0000, chain.objs.size()=1 2024-09-12T01:29:15.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._9hPlo0t5-741WYx8-ExYUh3yQEsbnq_0 2024-09-12T01:29:15.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7225493375616685506', time=2024-09-12T03:12:25.992263+0000, chain.objs.size()=1 2024-09-12T01:29:15.440 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xu0c2rdTiaTE4Rqwfa-gbsYJI35Fm0f_0 2024-09-12T01:29:15.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16500199175255731911', time=2024-09-12T03:12:26.272239+0000, chain.objs.size()=1 2024-09-12T01:29:15.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.i9CQZSNMpEvgQprbKxxWaI0QQuDspSw_0 2024-09-12T01:29:15.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5683027481782471031', time=2024-09-12T03:12:26.376954+0000, chain.objs.size()=1 2024-09-12T01:29:15.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.434+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.VpRQbLyq8ly2aB-vrcUI-ua8QB7IahY_0 2024-09-12T01:29:15.441 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.436+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14528923324425828456', time=2024-09-12T03:12:26.379204+0000, chain.objs.size()=1 2024-09-12T01:29:15.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.436+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.kqt2YU0VFQpwmkzEXVyPgYEYkE4TDay_0 2024-09-12T01:29:15.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.436+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7371209862773469680', time=2024-09-12T03:12:26.427598+0000, chain.objs.size()=1 2024-09-12T01:29:15.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.436+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.k7GLHDDg5Gb3mfRSwSwa4AqllloutES_0 2024-09-12T01:29:15.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.436+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11495442937468833735', time=2024-09-12T03:12:26.566422+0000, chain.objs.size()=1 2024-09-12T01:29:15.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.436+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.5fppJKOQtG1TrU8im13nh1vsNo4lZqv_0 2024-09-12T01:29:15.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.436+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3795441744409012872', time=2024-09-12T03:12:27.239676+0000, chain.objs.size()=1 2024-09-12T01:29:15.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.436+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gsbZ5P89LB9cDBqrPZwHRq3GvD2wG99_0 2024-09-12T01:29:15.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.437+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4140691324893106838', time=2024-09-12T03:12:27.934860+0000, chain.objs.size()=1 2024-09-12T01:29:15.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.437+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Gjdw3weSu7ZF1QLbwG1U3GXW-tZ7_Hu_0 2024-09-12T01:29:15.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.439+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11912361851592952036', time=2024-09-12T03:12:28.006556+0000, chain.objs.size()=1 2024-09-12T01:29:15.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.439+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.awS-5AdEynDpAqo0xdV32BU92417kIZ_0 2024-09-12T01:29:15.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.439+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9567390577736757919', time=2024-09-12T03:12:28.236191+0000, chain.objs.size()=1 2024-09-12T01:29:15.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.439+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hWoJgAQan8i2BvVJTkYeT7ZgebqXWjV_0 2024-09-12T01:29:15.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.441+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/45210 2024-09-12T01:29:15.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=30, truncated=0, next_marker='' 2024-09-12T01:29:15.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3890591016920909212', time=2024-09-12T03:12:28.251586+0000, chain.objs.size()=1 2024-09-12T01:29:15.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1xiny9wYDWZzfSmlRfVG639LAi4TYiL_0 2024-09-12T01:29:15.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.760297012388335521', time=2024-09-12T03:12:28.885674+0000, chain.objs.size()=1 2024-09-12T01:29:15.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Fyh8PvxbO8ctRPgfrjJC9w4fwaT_J3H_0 2024-09-12T01:29:15.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8064854916482963061', time=2024-09-12T03:12:29.521647+0000, chain.objs.size()=1 2024-09-12T01:29:15.445 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.T4lH2K-PYEWK4TiU8tuZPlwb33cjiPx_0 2024-09-12T01:29:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17821443679338833313', time=2024-09-12T03:12:29.603783+0000, chain.objs.size()=1 2024-09-12T01:29:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._jc3SEpt41rJR9JrY1f8TtlwyWJyfX__0 2024-09-12T01:29:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10343574008197195484', time=2024-09-12T03:12:29.934728+0000, chain.objs.size()=1 2024-09-12T01:29:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Ipn-nNy12gr8B9EjnT9iqhcUhebfle1_0 2024-09-12T01:29:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3062366482124576393', time=2024-09-12T03:12:30.526456+0000, chain.objs.size()=1 2024-09-12T01:29:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.h0Ug5WrnUP_lVWiqGO70aPuzytHgC3V_0 2024-09-12T01:29:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10368566161053142341', time=2024-09-12T03:12:30.701698+0000, chain.objs.size()=1 2024-09-12T01:29:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.6Np80lAC3JP4srmwy1HoDth9aZr4u9I_0 2024-09-12T01:29:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13777270473811438580', time=2024-09-12T03:12:30.955359+0000, chain.objs.size()=1 2024-09-12T01:29:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.0yg1nNq0EaRr06i-iks7kmOegH6310B_0 2024-09-12T01:29:15.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1300766876072230460', time=2024-09-12T03:12:31.173723+0000, chain.objs.size()=1 2024-09-12T01:29:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.S0EC3S3veW0QWvO0lOOKqfwJ6e_3SjB_0 2024-09-12T01:29:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12257227383833516941', time=2024-09-12T03:12:31.504828+0000, chain.objs.size()=1 2024-09-12T01:29:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.wBoy0Xha3SWTta76TRVXepi7NGRiLp5_0 2024-09-12T01:29:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2256669467601659208', time=2024-09-12T03:12:31.505482+0000, chain.objs.size()=1 2024-09-12T01:29:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.60IG3JS97ztB-m9ftdq41Blf0PX0iYI_0 2024-09-12T01:29:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13421965351305577472', time=2024-09-12T03:12:32.104227+0000, chain.objs.size()=1 2024-09-12T01:29:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.444+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.S1teAt7VwxTfa929UwIDmHeqY56p9Ds_0 2024-09-12T01:29:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.446+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12797101560956722410', time=2024-09-12T03:12:32.300628+0000, chain.objs.size()=1 2024-09-12T01:29:15.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.446+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.jU4h7qS1xb2z2kjq4QktiKjqTqeJKOE_0 2024-09-12T01:29:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.447+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7475094230818510304', time=2024-09-12T03:12:32.567178+0000, chain.objs.size()=1 2024-09-12T01:29:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.L55QmloND2G5tOa-d81GVA3XHf0ciQJ_0 2024-09-12T01:29:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6489976403169553126', time=2024-09-12T03:12:32.849847+0000, chain.objs.size()=1 2024-09-12T01:29:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.CHp2e6SYza6Tr0_7xZTarfeeEv39gBW_0 2024-09-12T01:29:15.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17843000537997410729', time=2024-09-12T03:12:33.884878+0000, chain.objs.size()=1 2024-09-12T01:29:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.I-Pcqm1WNTqY1gPpHvDEXEyvFCocTIj_0 2024-09-12T01:29:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3059194020507683234', time=2024-09-12T03:12:33.958893+0000, chain.objs.size()=1 2024-09-12T01:29:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.slA1x4GBiJO6zNlSjQRe2Yn3iqN64y5_0 2024-09-12T01:29:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9745516952752161337', time=2024-09-12T03:12:34.293690+0000, chain.objs.size()=1 2024-09-12T01:29:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xI9RflnzFNK8oQIo2DIlJSf_GWUir6u_0 2024-09-12T01:29:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4656842043035571462', time=2024-09-12T03:12:34.470449+0000, chain.objs.size()=1 2024-09-12T01:29:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.p1ME7QcgIkbQYomHGps_j6OXM9jDl8w_0 2024-09-12T01:29:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17825287346517362946', time=2024-09-12T03:12:35.580682+0000, chain.objs.size()=1 2024-09-12T01:29:15.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.326__shadow_.2mIm6-YiDn6w57z2Ga8qIaVbddMYYH6_0 2024-09-12T01:29:15.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2985664352322616870', time=2024-09-12T03:13:04.688134+0000, chain.objs.size()=1 2024-09-12T01:29:15.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.381__shadow_.uS5kYkWamrJQQTqIPERzAhQ0ySgn5bk_0 2024-09-12T01:29:15.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8319472770833390779', time=2024-09-12T03:13:39.466844+0000, chain.objs.size()=1 2024-09-12T01:29:15.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.441__shadow_.TJQwpo7U2AhKpyjDBlUZLIu6Cn6F5gQ_0 2024-09-12T01:29:15.450 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14480592241872771286', time=2024-09-12T03:13:41.504625+0000, chain.objs.size()=1 2024-09-12T01:29:15.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.448+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.444__shadow_.wxzyxuD-a5PffyJtmtsHL4hhgKjzR94_0 2024-09-12T01:29:15.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.450+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8882754174610613320', time=2024-09-12T03:14:05.124172+0000, chain.objs.size()=1 2024-09-12T01:29:15.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.450+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.483__shadow_.cwyRDoTIAdJsq7bdyZyI9bz-lRB1DBv_0 2024-09-12T01:29:15.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.451+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9269438668227663051', time=2024-09-12T03:14:05.127952+0000, chain.objs.size()=1 2024-09-12T01:29:15.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.451+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.483__shadow_.qrJq6bCahVA3TxrrKbrAzaw5nPQp0DC_0 2024-09-12T01:29:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.452+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14550544251612937480', time=2024-09-12T03:18:01.276669+0000, chain.objs.size()=1 2024-09-12T01:29:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.452+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.574__shadow_.p2VJ8AWWTRttp0PRbGP_sW-B_n5kgzr_0 2024-09-12T01:29:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.452+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13672203745704420257', time=2024-09-12T03:18:05.022663+0000, chain.objs.size()=1 2024-09-12T01:29:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.452+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.574__shadow:60qKBqcmkr-pavsPNEJdye-Qn77LZc-_.OZKAeRX5NlFannC8foZvP9gJ52hXKVf_0 2024-09-12T01:29:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.452+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7277381970912893253', time=2024-09-12T03:18:22.684716+0000, chain.objs.size()=1 2024-09-12T01:29:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.452+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:UfcP63z8pMutxV45pdx8hs13T2GuS15_.fT3ocmHdXbvAjp5DIoNE8JOaMya6Uuh_0 2024-09-12T01:29:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.452+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14087229661801640012', time=2024-09-12T03:18:23.256164+0000, chain.objs.size()=1 2024-09-12T01:29:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.452+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:c7mKwPzZo1AeYdcLVRMo1dVlZt-dDPi_.qlzHeqy0DeCdtS_72tdKSx-zSj13OMT_0 2024-09-12T01:29:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.452+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3878325851552903238', time=2024-09-12T03:24:58.097581+0000, chain.objs.size()=1 2024-09-12T01:29:15.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.452+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.744__shadow_.gY6AsfBYzjcD32udWlIzuZgU3Tw1Hb2_0 2024-09-12T01:29:15.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.456+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.459 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.458+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:29:15.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.460+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.460+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52516' 2024-09-12T01:29:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6347471157192842385', time=2024-09-12T03:08:56.205822+0000, chain.objs.size()=1 2024-09-12T01:29:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.233__shadow_.bpU24_v2wEk2aWCvlUM-jdqcZvu0GJs_0 2024-09-12T01:29:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8485936919150524280', time=2024-09-12T03:08:59.942361+0000, chain.objs.size()=1 2024-09-12T01:29:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.238__shadow_.H5zAdk2xM1wZcIicMvqeUE_zC97AcAC_0 2024-09-12T01:29:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5784225644590707639', time=2024-09-12T03:09:54.783337+0000, chain.objs.size()=1 2024-09-12T01:29:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RXtplt7Iz9SY9W3fcNH0SRJQihaqhNA_0 2024-09-12T01:29:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14655247863163342133', time=2024-09-12T03:09:56.645195+0000, chain.objs.size()=1 2024-09-12T01:29:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.MelAiHaO9UQgCvbQXgSbk0auQ0_iFpz_0 2024-09-12T01:29:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11133350918955904867', time=2024-09-12T03:09:56.728805+0000, chain.objs.size()=1 2024-09-12T01:29:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.v8iXjM1YAyaVI1TQHd9k0Ei727Bze4B_0 2024-09-12T01:29:15.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11166731762636907584', time=2024-09-12T03:09:56.915750+0000, chain.objs.size()=1 2024-09-12T01:29:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PixDsGK8BpFC6Jv_IPtI19qoAz4sToz_0 2024-09-12T01:29:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3524072798109035866', time=2024-09-12T03:09:57.014100+0000, chain.objs.size()=1 2024-09-12T01:29:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QbA8C-Oj1o3404Sef-_ssSOAIGCLCE3_0 2024-09-12T01:29:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6439690968501621587', time=2024-09-12T03:09:57.131717+0000, chain.objs.size()=1 2024-09-12T01:29:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.tEtD_9w3Aqj7iPszFd2OT0Id9WGyPQn_0 2024-09-12T01:29:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3219167589225271627', time=2024-09-12T03:09:57.132255+0000, chain.objs.size()=1 2024-09-12T01:29:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.k2pr4ylsaqnZQeP_fDrz6JPF0UKgCjk_0 2024-09-12T01:29:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.264964101361033823', time=2024-09-12T03:09:57.256784+0000, chain.objs.size()=1 2024-09-12T01:29:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ZCn-M7Fwe3F2i0cCtc7yD2J7hHMuk1T_0 2024-09-12T01:29:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3236034184486685520', time=2024-09-12T03:09:57.767166+0000, chain.objs.size()=1 2024-09-12T01:29:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Mb8t_sMXq3-f-yYijLM-FgLj84EAAyK_0 2024-09-12T01:29:15.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2072574611149377201', time=2024-09-12T03:09:57.775807+0000, chain.objs.size()=1 2024-09-12T01:29:15.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.jxtTJZPuo2-4ks9d6QPqUo5j-oWDE5K_0 2024-09-12T01:29:15.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.464+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9917247483003020095', time=2024-09-12T03:09:57.776447+0000, chain.objs.size()=1 2024-09-12T01:29:15.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.464+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RGYG4pSQtVyiSXThpXpnTJDVUO9SRKN_0 2024-09-12T01:29:15.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.464+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10759249665588990365', time=2024-09-12T03:09:58.143387+0000, chain.objs.size()=1 2024-09-12T01:29:15.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.464+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.TlscUsbxNuiukN4jsK413XQUAQuv7FC_0 2024-09-12T01:29:15.465 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16077401485083674543', time=2024-09-12T03:09:58.717014+0000, chain.objs.size()=1 2024-09-12T01:29:15.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9ew459XSKubXb4whEhyU4e4XBptFoWf_0 2024-09-12T01:29:15.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.179202590572507492', time=2024-09-12T03:09:58.914283+0000, chain.objs.size()=1 2024-09-12T01:29:15.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.b-PbwM3tdhFcm5rLtxXlrz24Ry1VmXq_0 2024-09-12T01:29:15.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4993422198550390690', time=2024-09-12T03:09:59.595414+0000, chain.objs.size()=1 2024-09-12T01:29:15.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.iBniTTx7MC3VQ9hoyFeLM40la5DLRs7_0 2024-09-12T01:29:15.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3956724624825375318', time=2024-09-12T03:09:59.963899+0000, chain.objs.size()=1 2024-09-12T01:29:15.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8g3KFLdKQBVqDXXgZH6EpvnliVVUcdw_0 2024-09-12T01:29:15.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16095505107178614509', time=2024-09-12T03:10:00.002952+0000, chain.objs.size()=1 2024-09-12T01:29:15.466 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.6X0GUPBbsqszrQeJYYsZLCvnO4FR7QJ_0 2024-09-12T01:29:15.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17155713221656923523', time=2024-09-12T03:10:00.635195+0000, chain.objs.size()=1 2024-09-12T01:29:15.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.wUOVd_ltHaZ3u3frFOl1UGbOTIf9PFv_0 2024-09-12T01:29:15.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4519449297700109003', time=2024-09-12T03:10:01.420315+0000, chain.objs.size()=1 2024-09-12T01:29:15.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.n21ZDM_Nteo0ZqBgciiG0Xpew7gw8B__0 2024-09-12T01:29:15.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6032170618028118273', time=2024-09-12T03:10:01.528840+0000, chain.objs.size()=1 2024-09-12T01:29:15.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.GPLs98F1D7vmYBPtJbXp5ml_jHtucSu_0 2024-09-12T01:29:15.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2501685737903612613', time=2024-09-12T03:10:01.741103+0000, chain.objs.size()=1 2024-09-12T01:29:15.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.465+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.yBQgJJXGd1lNkzySfqa6bjyzp3QJfnJ_0 2024-09-12T01:29:15.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.468+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15143024572653746104', time=2024-09-12T03:10:02.231994+0000, chain.objs.size()=1 2024-09-12T01:29:15.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.468+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.14TBA7c8p6HZJPFknI3u0FFxc1UcNbv_0 2024-09-12T01:29:15.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.468+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16152741371595694469', time=2024-09-12T03:10:02.656527+0000, chain.objs.size()=1 2024-09-12T01:29:15.468 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.468+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.vAuzLoOVPKsdbn2Yy_MsmkBDfyHxozu_0 2024-09-12T01:29:15.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.468+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11660593708868835654', time=2024-09-12T03:10:02.674860+0000, chain.objs.size()=1 2024-09-12T01:29:15.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.468+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.76hHxKzjr4jzzPEN1Oz0WKgNr5bzUMB_0 2024-09-12T01:29:15.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.469+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1519233140854518194', time=2024-09-12T03:10:02.857600+0000, chain.objs.size()=1 2024-09-12T01:29:15.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.469+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Ag29FICNNXfn_DhyBs5Ioxym6C_FBYh_0 2024-09-12T01:29:15.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.469+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3616882551414775957', time=2024-09-12T03:10:02.890209+0000, chain.objs.size()=1 2024-09-12T01:29:15.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.469+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.AUzgg_1ZZ9m3xSWsnNb82v9Jt8l1aLn_0 2024-09-12T01:29:15.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.469+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3038925799561002034', time=2024-09-12T03:10:02.964472+0000, chain.objs.size()=1 2024-09-12T01:29:15.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.469+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ImdmmJxBbNB-cujpoFxTHcDqqkTufAn_0 2024-09-12T01:29:15.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.469+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1975394436721458854', time=2024-09-12T03:10:04.203903+0000, chain.objs.size()=1 2024-09-12T01:29:15.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.469+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lH0llnkSyBBHwHF1G-L8s3FP92ffD8X_0 2024-09-12T01:29:15.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.469+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9596060619326264621', time=2024-09-12T03:10:04.681057+0000, chain.objs.size()=1 2024-09-12T01:29:15.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.469+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.sa4TBBUkFK7ZsDhxCGMb1vJZQBHzm4O_0 2024-09-12T01:29:15.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.469+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1093782166627601300', time=2024-09-12T03:10:04.998131+0000, chain.objs.size()=1 2024-09-12T01:29:15.470 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.469+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.K_I_P4P35MSCrryp9yfUXW1YfK_ptP__0 2024-09-12T01:29:15.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.470+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6646540958800315892', time=2024-09-12T03:10:05.844668+0000, chain.objs.size()=1 2024-09-12T01:29:15.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.470+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.STUd-E71fJEtQjc9kaiSTMzkvL8vkbe_0 2024-09-12T01:29:15.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.470+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9492083917351746809', time=2024-09-12T03:10:06.061918+0000, chain.objs.size()=1 2024-09-12T01:29:15.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.470+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dbh3Npgo2rMr2Re4hrcu61xSNd30DAD_0 2024-09-12T01:29:15.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.471+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16923879793059120635', time=2024-09-12T03:10:06.391872+0000, chain.objs.size()=1 2024-09-12T01:29:15.471 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.471+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.yC-yvS9BglUQ-bER5ep6m_uQWZtrgTm_0 2024-09-12T01:29:15.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.471+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7346411244805864442', time=2024-09-12T03:10:06.402991+0000, chain.objs.size()=1 2024-09-12T01:29:15.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.471+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.YaDLlaTOJlJfyvSqOCvyWd7BIzi5bOp_0 2024-09-12T01:29:15.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.472+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17463196848434754802', time=2024-09-12T03:10:06.641383+0000, chain.objs.size()=1 2024-09-12T01:29:15.472 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.472+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.AycUHjw_ilUKGUhmx-ag12VGcZmEdnK_0 2024-09-12T01:29:15.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.474+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2836274647245758126', time=2024-09-12T03:10:06.642029+0000, chain.objs.size()=1 2024-09-12T01:29:15.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.474+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.oRNxMtHE4XuIEaf9q7n3nrTB4vPB5lu_0 2024-09-12T01:29:15.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.474+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5273489376390718976', time=2024-09-12T03:10:09.117108+0000, chain.objs.size()=1 2024-09-12T01:29:15.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.474+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.266__shadow_.uNsa40MlMnLNEkXH9-c1day79hAi9PB_0 2024-09-12T01:29:15.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.474+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11940410816723913449', time=2024-09-12T03:10:11.472570+0000, chain.objs.size()=1 2024-09-12T01:29:15.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.474+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.270__shadow_.wgTTj3Gh2z2WZz0A3O1G5h0T-dvMOjF_0 2024-09-12T01:29:15.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.474+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9426245534924573231', time=2024-09-12T03:10:12.690102+0000, chain.objs.size()=1 2024-09-12T01:29:15.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.474+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.272__shadow_.rzTcKJvAIb7nsPlvKu6RhBkWpXLnK1e_0 2024-09-12T01:29:15.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.474+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.93036005363499971', time=2024-09-12T03:10:23.749966+0000, chain.objs.size()=1 2024-09-12T01:29:15.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.474+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.289__shadow_.de-Ax9g-ATSMkdXL6ile0NP2cbUbE00_0 2024-09-12T01:29:15.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.474+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11241829327345311443', time=2024-09-12T03:10:24.384734+0000, chain.objs.size()=1 2024-09-12T01:29:15.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.474+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.290__shadow_.TYnyOg8I_A2FveazNtq1EEnsmCCW87V_0 2024-09-12T01:29:15.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.475+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6167806164675294480', time=2024-09-12T03:10:29.101833+0000, chain.objs.size()=1 2024-09-12T01:29:15.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.475+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.lIq9YLKJ5DyHD-Tddg6YmYCOJtwLlrK_0 2024-09-12T01:29:15.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.475+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10803430997723935006', time=2024-09-12T03:10:29.191138+0000, chain.objs.size()=1 2024-09-12T01:29:15.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.475+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.wS_W06Ak1blqkgxzpIWmOTVgRtDUV1p_0 2024-09-12T01:29:15.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.475+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8744171836431664265', time=2024-09-12T03:10:29.864976+0000, chain.objs.size()=1 2024-09-12T01:29:15.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.475+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.294__shadow_.X-yMD5yO0LL-y3G0Mb6AiEveV4qSZ8j_0 2024-09-12T01:29:15.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.475+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15838399594745781696', time=2024-09-12T03:10:29.873151+0000, chain.objs.size()=1 2024-09-12T01:29:15.476 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.475+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.294__shadow_.QnJI95bSwu2AlUTxr707qqkEjtgBlv4_0 2024-09-12T01:29:15.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.476+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8352593023924406952', time=2024-09-12T03:10:33.867119+0000, chain.objs.size()=1 2024-09-12T01:29:15.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.476+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.300__shadow_.b94f4jRFxq8DDUsu09_BljRJ2s3z3hz_0 2024-09-12T01:29:15.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13613322309107685244', time=2024-09-12T03:11:29.299609+0000, chain.objs.size()=1 2024-09-12T01:29:15.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.QlWqEWOKriDLgAyC_9x9qIi5KAFtpkU_0 2024-09-12T01:29:15.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6154599910921222163', time=2024-09-12T03:11:29.301394+0000, chain.objs.size()=1 2024-09-12T01:29:15.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ysc4fywprB1kuHu8H_68kz5tGp7TQg-_0 2024-09-12T01:29:15.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10765443084813317986', time=2024-09-12T03:11:30.205459+0000, chain.objs.size()=1 2024-09-12T01:29:15.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.FRgShTHUue4BrEVJrFvo3AD2Rfy2S0U_0 2024-09-12T01:29:15.480 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.730859333876867639', time=2024-09-12T03:11:30.531546+0000, chain.objs.size()=1 2024-09-12T01:29:15.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fECNlRRVar0s1pN4bJ0AQI5dvPCd8pQ_0 2024-09-12T01:29:15.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7930402380590418618', time=2024-09-12T03:11:31.049223+0000, chain.objs.size()=1 2024-09-12T01:29:15.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.IbONam5zrhmDbiARKj3cwQSvU0Asl5H_0 2024-09-12T01:29:15.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6041696579995640644', time=2024-09-12T03:11:31.942141+0000, chain.objs.size()=1 2024-09-12T01:29:15.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.G2Uj2g9-SULg8pVlZVJgO2QxPdYLxa8_0 2024-09-12T01:29:15.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4537899970900790552', time=2024-09-12T03:11:31.987803+0000, chain.objs.size()=1 2024-09-12T01:29:15.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.k7_ldDSHFZKp5RjWrgb8G_gdObPAbH1_0 2024-09-12T01:29:15.481 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14384298373094363252', time=2024-09-12T03:11:32.132409+0000, chain.objs.size()=1 2024-09-12T01:29:15.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.FxbZSqeSTjk_7iUi1J8IdjZ4o6W8C_q_0 2024-09-12T01:29:15.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4002932581055439590', time=2024-09-12T03:11:32.149940+0000, chain.objs.size()=1 2024-09-12T01:29:15.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Qt-4uLHOQNFpLoVjWX403bMMI0c7HcU_0 2024-09-12T01:29:15.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14093815972676378954', time=2024-09-12T03:11:32.174523+0000, chain.objs.size()=1 2024-09-12T01:29:15.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.8zgG-uRYzDdtx8dMANM0xB_COswMZY7_0 2024-09-12T01:29:15.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1330622194029330035', time=2024-09-12T03:11:33.644631+0000, chain.objs.size()=1 2024-09-12T01:29:15.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.479+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.I70EnT8iXbcD-Acgx7usQOe1Q-ewJz9_0 2024-09-12T01:29:15.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.483+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4101945488205077557', time=2024-09-12T03:11:33.706076+0000, chain.objs.size()=1 2024-09-12T01:29:15.483 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.483+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.YXkgSexT6fFR8vCF8aOKIL5KCxTTYaR_0 2024-09-12T01:29:15.484 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.483+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6540489021910424341', time=2024-09-12T03:11:33.801130+0000, chain.objs.size()=1 2024-09-12T01:29:15.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.483+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.8oXk9ofskdChXAwH9MjXUVR41nCLTh3_0 2024-09-12T01:29:15.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.483+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.852042275489478530', time=2024-09-12T03:11:33.905659+0000, chain.objs.size()=1 2024-09-12T01:29:15.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.483+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.gCYzlbVI_-s2K1a8NscykLv4S6nhfbH_0 2024-09-12T01:29:15.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.483+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14292477062707195413', time=2024-09-12T03:11:34.669833+0000, chain.objs.size()=1 2024-09-12T01:29:15.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.483+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.h10kKRkYyMJfon8BCteusMgRVGw731G_0 2024-09-12T01:29:15.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.483+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15366533329562531127', time=2024-09-12T03:11:34.739987+0000, chain.objs.size()=1 2024-09-12T01:29:15.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.483+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xrYRwq1hQh1olp3-PhTDmtoHx0eF6zx_0 2024-09-12T01:29:15.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.483+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13480040923324770646', time=2024-09-12T03:11:36.655774+0000, chain.objs.size()=1 2024-09-12T01:29:15.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.484+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.E8cVF67xde2_ntNQPNzgcixRluhmFmU_0 2024-09-12T01:29:15.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.484+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3375859135147838901', time=2024-09-12T03:11:36.806253+0000, chain.objs.size()=1 2024-09-12T01:29:15.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.484+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.m4X3ftOfpBjocrYhUcC9gkUWd5NXfnw_0 2024-09-12T01:29:15.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.484+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8034706935016611387', time=2024-09-12T03:11:38.102287+0000, chain.objs.size()=1 2024-09-12T01:29:15.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.484+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.SXR4CzmyQc7SAfWOvdbpqqXnvnu4Bup_0 2024-09-12T01:29:15.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.484+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11603042262252736631', time=2024-09-12T03:11:38.428976+0000, chain.objs.size()=1 2024-09-12T01:29:15.486 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.484+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.j6Uh98M4-A8E7BviUBWIRUH7dj7I-9S_0 2024-09-12T01:29:15.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.484+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.753044523250537384', time=2024-09-12T03:11:39.186950+0000, chain.objs.size()=1 2024-09-12T01:29:15.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.484+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.u8vE0jYMtZ74yS3GNXo20Gb3w5Y0prd_0 2024-09-12T01:29:15.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.486+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15939316649744686992', time=2024-09-12T03:11:39.187440+0000, chain.objs.size()=1 2024-09-12T01:29:15.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.486+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.LOBfxA4nJbMpVAKNCxvDseZPIV4RHcb_0 2024-09-12T01:29:15.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.488+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6915852865956257428', time=2024-09-12T03:11:39.395729+0000, chain.objs.size()=1 2024-09-12T01:29:15.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.488+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.u4f-dXrEQ5WIWlyfhv-BfaoOIuSvwwP_0 2024-09-12T01:29:15.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.488+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3966655699868370227', time=2024-09-12T03:11:39.542693+0000, chain.objs.size()=1 2024-09-12T01:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.488+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MRSMcPCdXS421qGrwIVSKfXxDpIiQU0_0 2024-09-12T01:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.488+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3164934992889462220', time=2024-09-12T03:11:41.087144+0000, chain.objs.size()=1 2024-09-12T01:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.488+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qqMPNbLuyDiFcW6yoUoO9mw8ojyngQZ_0 2024-09-12T01:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.488+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17511722438693858800', time=2024-09-12T03:12:21.842399+0000, chain.objs.size()=1 2024-09-12T01:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.488+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Jla3g5mR_B_XvQ6tyOQDWAN4zziWHfx_0 2024-09-12T01:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.488+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1312836550178982132', time=2024-09-12T03:12:22.182624+0000, chain.objs.size()=1 2024-09-12T01:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.488+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hjppIxdKcAAYc0Hdc1mSwo1pOM33aI6_0 2024-09-12T01:29:15.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.488+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9356539710341354857', time=2024-09-12T03:12:22.642348+0000, chain.objs.size()=1 2024-09-12T01:29:15.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.488+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.BYJ75493aKUEf0d9ZP7rsWhacs-1cM__0 2024-09-12T01:29:15.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.488+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15878747864059433618', time=2024-09-12T03:12:22.896210+0000, chain.objs.size()=1 2024-09-12T01:29:15.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.488+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.a4w0bsEZN2_T6GQcIow3YgfCN8mStsD_0 2024-09-12T01:29:15.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.489+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4394997130247693226', time=2024-09-12T03:12:23.797392+0000, chain.objs.size()=1 2024-09-12T01:29:15.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.489+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.KKqtQar3qnD6GjxPc6QouE-htftYRbD_0 2024-09-12T01:29:15.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.489+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6058346112353766656', time=2024-09-12T03:12:25.516748+0000, chain.objs.size()=1 2024-09-12T01:29:15.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.489+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.nl9fjb_2MX1mkqwjwrLkCaL8BnXxU5b_0 2024-09-12T01:29:15.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.489+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13025966261305625055', time=2024-09-12T03:12:25.600762+0000, chain.objs.size()=1 2024-09-12T01:29:15.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.489+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.nXnVldm5jURlNle2ggrTh-XfwNayFOR_0 2024-09-12T01:29:15.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.489+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10188397442239286526', time=2024-09-12T03:12:26.396116+0000, chain.objs.size()=1 2024-09-12T01:29:15.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.489+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.WR4zhw49OGqKlGwDchFytxm_QBKqJEk_0 2024-09-12T01:29:15.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.491+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14829062319263907921', time=2024-09-12T03:12:26.572324+0000, chain.objs.size()=1 2024-09-12T01:29:15.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.491+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.r89gZ8g_GUnAW624IQJPFxmj8R3Amdh_0 2024-09-12T01:29:15.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.492+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11428825063917181611', time=2024-09-12T03:12:27.414997+0000, chain.objs.size()=1 2024-09-12T01:29:15.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.492+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.EQo5R7P3hsoFKkgSDLfQLqxrSljEoIA_0 2024-09-12T01:29:15.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.492+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14582582682023183602', time=2024-09-12T03:12:27.415871+0000, chain.objs.size()=1 2024-09-12T01:29:15.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.492+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.646hoMKr66Rr9Q-5pX02pg-Yzsw8ooE_0 2024-09-12T01:29:15.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.494+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.632385949708571833', time=2024-09-12T03:12:27.517126+0000, chain.objs.size()=1 2024-09-12T01:29:15.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.494+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.U5-N-VhFsHNuF_8TGiI6CXgpk8w6N5m_0 2024-09-12T01:29:15.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.494+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9626761236411724474', time=2024-09-12T03:12:28.752466+0000, chain.objs.size()=1 2024-09-12T01:29:15.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.494+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MayMRjqDtJo_2ek-bFs6lfwjo_hhXay_0 2024-09-12T01:29:15.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.494+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9210972268305993888', time=2024-09-12T03:12:28.969011+0000, chain.objs.size()=1 2024-09-12T01:29:15.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.494+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ILZjlE1KutUP4tudC5BenyTLVHx7Enq_0 2024-09-12T01:29:15.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.494+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5111726933353179388', time=2024-09-12T03:12:31.309295+0000, chain.objs.size()=1 2024-09-12T01:29:15.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.494+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.K-7st7_pf9mqylo4Y5dGpKCXXUWe7IK_0 2024-09-12T01:29:15.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.494+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11022470612914700557', time=2024-09-12T03:12:31.457485+0000, chain.objs.size()=1 2024-09-12T01:29:15.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.494+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3AJUaEhj-D-0zPHHy_JKk3nDFpFwtE0_0 2024-09-12T01:29:15.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.494+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11641116049411468215', time=2024-09-12T03:12:33.550297+0000, chain.objs.size()=1 2024-09-12T01:29:15.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.494+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MWp-iMGdS0m6I2AcK9CTwbuUbyADeBE_0 2024-09-12T01:29:15.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.494+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8105560338744487478', time=2024-09-12T03:12:34.150723+0000, chain.objs.size()=1 2024-09-12T01:29:15.495 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.494+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.LSMZovdwVTnd97QiKsDZ7CKG8pmNVlb_0 2024-09-12T01:29:15.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.495+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17819293430085119025', time=2024-09-12T03:12:43.132577+0000, chain.objs.size()=1 2024-09-12T01:29:15.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.495+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.340__shadow_.mh0csw3zoSgkFKd9H1WkyR9RZhNkx9F_0 2024-09-12T01:29:15.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.495+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9962962787596646190', time=2024-09-12T03:13:06.882653+0000, chain.objs.size()=1 2024-09-12T01:29:15.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.495+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.384__shadow_.7Nhw3NJ4yMvdpSyDj95TffeMeHTckDl_0 2024-09-12T01:29:15.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.495+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9166502868312766568', time=2024-09-12T03:14:05.857306+0000, chain.objs.size()=1 2024-09-12T01:29:15.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.495+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.484__shadow_.pGQsHBRFjqdBsFfb6e6E5sDfJCsnK3z_0 2024-09-12T01:29:15.496 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.495+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9122279490266452640', time=2024-09-12T03:14:05.867664+0000, chain.objs.size()=1 2024-09-12T01:29:15.497 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.495+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.484__shadow_.JWoDnYopmU5JictfSCWdA1O1ks4DREc_0 2024-09-12T01:29:15.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.498+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1779900933481507244', time=2024-09-12T03:14:16.266856+0000, chain.objs.size()=1 2024-09-12T01:29:15.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.498+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.498__shadow_.NNxg2wqh13Y_4np5ESWt0FHk_TS7Se2_0 2024-09-12T01:29:15.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.498+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16668344560875111341', time=2024-09-12T03:14:17.262525+0000, chain.objs.size()=1 2024-09-12T01:29:15.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.498+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.499__shadow_.2FqvB3plZ-Hkar8eQ1rw7M-NxIhgRRm_0 2024-09-12T01:29:15.498 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.498+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~MUc_XaEUogoBNe7o4fX4lVz8BgesM05', time=2024-09-12T03:15:18.173140+0000, chain.objs.size()=1 2024-09-12T01:29:15.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.498+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~MUc_XaEUogoBNe7o4fX4lVz8BgesM05.2 2024-09-12T01:29:15.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.498+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~Ge39CWCzr98-uTuHEbWqqTunomxQFeu', time=2024-09-12T03:16:27.264338+0000, chain.objs.size()=2 2024-09-12T01:29:15.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.498+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.529__multipart_mymultipart.2~Ge39CWCzr98-uTuHEbWqqTunomxQFeu.1 2024-09-12T01:29:15.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.498+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.529__multipart_mymultipart.2~Ge39CWCzr98-uTuHEbWqqTunomxQFeu.2 2024-09-12T01:29:15.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.498+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10433270699748572396', time=2024-09-12T03:17:42.877976+0000, chain.objs.size()=1 2024-09-12T01:29:15.499 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.498+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.565__shadow_.q2Jj8hOI9PI1l5xbQFYwikKKU1D7Sq3_0 2024-09-12T01:29:15.501 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.501+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/52516 2024-09-12T01:29:15.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-12T01:29:15.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13266877139958823099', time=2024-09-12T03:17:51.117936+0000, chain.objs.size()=1 2024-09-12T01:29:15.504 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:e3iaLJsKLFcaSgSfYQnHpK4A4.4tKlF_.leXtX9w8StdmrEERYH1VmSbAGtbVwxs_0 2024-09-12T01:29:15.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3874532072957397248', time=2024-09-12T03:17:55.342107+0000, chain.objs.size()=1 2024-09-12T01:29:15.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:.lqtTjJWdN2pFHZ9NThpgb.JJh-HXAL_.LVvI-BsHmvzeNFLFLLciZG0Th2A0Chp_0 2024-09-12T01:29:15.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17670196437910022799', time=2024-09-12T03:18:24.702455+0000, chain.objs.size()=1 2024-09-12T01:29:15.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:ZxP0tCUIvy-ojfgCUbzyBnWByKLTltA_.QfX-TRmoIfBT2LetK4pciRJHYU5CQg__0 2024-09-12T01:29:15.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6530431055360645762', time=2024-09-12T03:18:33.412193+0000, chain.objs.size()=1 2024-09-12T01:29:15.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:vS6zCECr2NO37869SbnMQx-U8pgZCgq_.GpI86W5co2qn2eaLE4JESOv43as62OS_0 2024-09-12T01:29:15.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8778985606232516621', time=2024-09-12T03:18:33.980116+0000, chain.objs.size()=1 2024-09-12T01:29:15.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:xgMvNCfq3Na9c.YLmBEcOSfq6ly5PN._.wny6rHJSP_P_bhkZdaAsa-VXbE4h4NY_0 2024-09-12T01:29:15.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17859601783807851036', time=2024-09-12T03:18:56.715216+0000, chain.objs.size()=1 2024-09-12T01:29:15.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.587__shadow:Jl.eiA7Em7jTQ7Yhpx6dntoEz2VnLD0_.2V2o_yGI6TIdRtsUQ7NpUZObhmL4w0V_0 2024-09-12T01:29:15.505 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9599715063797362259', time=2024-09-12T03:19:05.657963+0000, chain.objs.size()=1 2024-09-12T01:29:15.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.604__shadow_.z5kClY_zqaxNqC3glLGu6LRNYNkq7Lq_0 2024-09-12T01:29:15.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2850486049324426582', time=2024-09-12T03:19:06.789798+0000, chain.objs.size()=1 2024-09-12T01:29:15.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.606__shadow_.2sNEW1BsvAelsBVPCGptKiRRkQIpJay_0 2024-09-12T01:29:15.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8697336109984125897', time=2024-09-12T03:22:19.347844+0000, chain.objs.size()=1 2024-09-12T01:29:15.506 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.619__shadow_.H4X4k5GKF5ePDen8mYTi5wIORGxnu7w_0 2024-09-12T01:29:15.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10260514942043881949', time=2024-09-12T03:22:58.022680+0000, chain.objs.size()=1 2024-09-12T01:29:15.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.630__shadow_.tJbdmkJUROU0qZpkr26oOu5Hf0LRVw0_0 2024-09-12T01:29:15.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10928046012283219032', time=2024-09-12T03:23:07.537037+0000, chain.objs.size()=1 2024-09-12T01:29:15.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.643__shadow_.6Vs2meSDLTrNVcC2dYVt-r93AXqo8KU_0 2024-09-12T01:29:15.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16354230300960691653', time=2024-09-12T03:24:04.730843+0000, chain.objs.size()=1 2024-09-12T01:29:15.507 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.504+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.704__shadow:cTOuySV7Hzhu4tTryZuJn1SKghg-O3D_.giJf1x7F26Wq2Ssvw7D15b8cFn45jsK_0 2024-09-12T01:29:15.509 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.509+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.511 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.511+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:29:15.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.512+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.513 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.513+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.514 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46657' 2024-09-12T01:29:15.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17562405420793183764', time=2024-09-12T03:08:53.406479+0000, chain.objs.size()=1 2024-09-12T01:29:15.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.228__shadow_.VtQcoQNWUab3MxAb-loZiP4f8HpCerW_0 2024-09-12T01:29:15.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8246666739433520884', time=2024-09-12T03:08:58.151022+0000, chain.objs.size()=1 2024-09-12T01:29:15.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.236__shadow_.dTN332aoCJ18Scab9iQ6fQOupjFs2p9_0 2024-09-12T01:29:15.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.397847892467561836', time=2024-09-12T03:09:01.616692+0000, chain.objs.size()=1 2024-09-12T01:29:15.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.241__shadow_.T_UrNvrWNy421WL1LSbbu2Lpde1cWjl_0 2024-09-12T01:29:15.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.175017981927025061', time=2024-09-12T03:09:14.937725+0000, chain.objs.size()=1 2024-09-12T01:29:15.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.261__shadow_.sm42csS9p06bkQKovHtt1IOqsUCGQM7_0 2024-09-12T01:29:15.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.678154819405997107', time=2024-09-12T03:09:54.640370+0000, chain.objs.size()=1 2024-09-12T01:29:15.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.LAHbGpIswulRJYl44irTfcHz_TkeHSd_0 2024-09-12T01:29:15.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12827432569591682368', time=2024-09-12T03:09:54.843261+0000, chain.objs.size()=1 2024-09-12T01:29:15.515 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.zgXwHej9OPzPyYCSYnyowLhGUdoNrRj_0 2024-09-12T01:29:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9557315884305967729', time=2024-09-12T03:09:56.204301+0000, chain.objs.size()=1 2024-09-12T01:29:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.l4Uh1ucfdtXPZW85o4G6w1Bl9RXAsVs_0 2024-09-12T01:29:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10980581668793470174', time=2024-09-12T03:09:56.433953+0000, chain.objs.size()=1 2024-09-12T01:29:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.HU6Xb63N0wYJ1xqdIjgz-DJvcJgh4p__0 2024-09-12T01:29:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10153272830337847426', time=2024-09-12T03:09:56.453520+0000, chain.objs.size()=1 2024-09-12T01:29:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ClHjhtapFdPk_kHVrKYXd4nQat9btEE_0 2024-09-12T01:29:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10273507878135456417', time=2024-09-12T03:09:56.535478+0000, chain.objs.size()=1 2024-09-12T01:29:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._A4e6M_aTZwpRS5HnG_jT0G4WfvtFQL_0 2024-09-12T01:29:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17858115518071732977', time=2024-09-12T03:09:57.122965+0000, chain.objs.size()=1 2024-09-12T01:29:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.hL5JhHAK3K9F0_RDXlBXuzD2-9G2cle_0 2024-09-12T01:29:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5788624679008921667', time=2024-09-12T03:09:57.931658+0000, chain.objs.size()=1 2024-09-12T01:29:15.516 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.514+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.rNl0ksoGKuQTKz9Z_OpXE4iO0tr6GPL_0 2024-09-12T01:29:15.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12970587810268038496', time=2024-09-12T03:09:58.166055+0000, chain.objs.size()=1 2024-09-12T01:29:15.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.m1DeU03GK_-StJqW7L3P-afw_KbaBYs_0 2024-09-12T01:29:15.518 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15997437557645943449', time=2024-09-12T03:09:58.329757+0000, chain.objs.size()=1 2024-09-12T01:29:15.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.l08HvY2Vq6qgjjVlhWy7WmT1VFJm3iz_0 2024-09-12T01:29:15.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12661087470109678181', time=2024-09-12T03:09:58.716646+0000, chain.objs.size()=1 2024-09-12T01:29:15.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.AIPiwbeNUV9IORFHmETa95CMlUJrJIn_0 2024-09-12T01:29:15.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16565361026320162381', time=2024-09-12T03:10:00.599147+0000, chain.objs.size()=1 2024-09-12T01:29:15.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.F5NXN2Q-9kd2LyXj-zXp6AW_yb7sP50_0 2024-09-12T01:29:15.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14682131319668363732', time=2024-09-12T03:10:01.424697+0000, chain.objs.size()=1 2024-09-12T01:29:15.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.saHs_ItLA1XswT7vznjvrmGUWA1IshX_0 2024-09-12T01:29:15.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9750276189568891120', time=2024-09-12T03:10:02.683729+0000, chain.objs.size()=1 2024-09-12T01:29:15.519 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.OLbn_cQxYNsLLE9eVpkC8eweTy7McbS_0 2024-09-12T01:29:15.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18438614307014399667', time=2024-09-12T03:10:03.152390+0000, chain.objs.size()=1 2024-09-12T01:29:15.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.84KLPRtvzvS7tJQAZJ8SGkVX1TbXOBK_0 2024-09-12T01:29:15.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15106323173577110895', time=2024-09-12T03:10:03.462240+0000, chain.objs.size()=1 2024-09-12T01:29:15.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.518+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Kt5t1gT9pz-7JMnAdAlu1aU8fSRfSp7_0 2024-09-12T01:29:15.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.519+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16147623635348341772', time=2024-09-12T03:10:03.576425+0000, chain.objs.size()=1 2024-09-12T01:29:15.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.519+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ABSwVbFrmGA42AeLgYNt-MjoKmvxpna_0 2024-09-12T01:29:15.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.520+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7728074577418416532', time=2024-09-12T03:10:03.647614+0000, chain.objs.size()=1 2024-09-12T01:29:15.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.520+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.MrRxe_afMxISq_8n28TgdD6Iepvl4At_0 2024-09-12T01:29:15.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.520+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9036785409856838852', time=2024-09-12T03:10:04.182652+0000, chain.objs.size()=1 2024-09-12T01:29:15.520 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.520+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.xzbph55X8v306woTcMSreVGi0HmQOZN_0 2024-09-12T01:29:15.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.521+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3457515011620058682', time=2024-09-12T03:10:04.353461+0000, chain.objs.size()=1 2024-09-12T01:29:15.521 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.521+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.AI4BEwOQKJ_u1d8z2P6CWcDKrxPtL-7_0 2024-09-12T01:29:15.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8582394390955943213', time=2024-09-12T03:10:04.689958+0000, chain.objs.size()=1 2024-09-12T01:29:15.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.jeBA3pc-alNpoRz1VN5VeyZWQs-5Lqk_0 2024-09-12T01:29:15.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6253632175639926666', time=2024-09-12T03:10:05.155518+0000, chain.objs.size()=1 2024-09-12T01:29:15.524 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.mkM9NA7cwWWtuYuFRA6daN9aJjtDKF7_0 2024-09-12T01:29:15.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7175843910322940811', time=2024-09-12T03:10:05.219414+0000, chain.objs.size()=1 2024-09-12T01:29:15.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.qrQED6XxaXA9ETyD9U8z964rf8ZeUoZ_0 2024-09-12T01:29:15.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7278311316766499398', time=2024-09-12T03:10:05.726340+0000, chain.objs.size()=1 2024-09-12T01:29:15.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.nu7DnTZXwdgL5PIVtv1sJ1LcJAt94cW_0 2024-09-12T01:29:15.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13065365135701441624', time=2024-09-12T03:10:06.462980+0000, chain.objs.size()=1 2024-09-12T01:29:15.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Pp4s9e2F4TeDWNenlFA2PTneHfst2qE_0 2024-09-12T01:29:15.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13988218762564925600', time=2024-09-12T03:10:21.841385+0000, chain.objs.size()=1 2024-09-12T01:29:15.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.286__shadow_.F1cSV56qPnWCmpDeLa-mM5g4r6gPwLS_0 2024-09-12T01:29:15.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9552044511581172894', time=2024-09-12T03:10:22.475032+0000, chain.objs.size()=1 2024-09-12T01:29:15.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.287__shadow_.qREFz8VtvUggsljdLjTRLkZWjAWs6nn_0 2024-09-12T01:29:15.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11686596415308018851', time=2024-09-12T03:10:29.168775+0000, chain.objs.size()=1 2024-09-12T01:29:15.525 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.EYr2lWW4ewwWUyEm48gGIjzE8rsCgs8_0 2024-09-12T01:29:15.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11458037886246217675', time=2024-09-12T03:10:42.061854+0000, chain.objs.size()=1 2024-09-12T01:29:15.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.313__shadow_.1OorL8Tc0xB5BARRt7_3PTYrR4GFWXL_0 2024-09-12T01:29:15.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16828851671785280290', time=2024-09-12T03:10:44.519620+0000, chain.objs.size()=1 2024-09-12T01:29:15.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.315__shadow_.zFG-h_8hzmP31GIBr1jzsJpPazyWRVK_0 2024-09-12T01:29:15.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15086050707022034114', time=2024-09-12T03:11:29.585530+0000, chain.objs.size()=1 2024-09-12T01:29:15.526 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.524+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fpvwJGmrL2FHzsA8QI3M8PhcxPKM5A7_0 2024-09-12T01:29:15.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.528+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5246411639814715373', time=2024-09-12T03:11:30.162726+0000, chain.objs.size()=1 2024-09-12T01:29:15.528 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.528+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.JvL0rZHsGRAIZJyLhjBpBx3-LOTq-aI_0 2024-09-12T01:29:15.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2570431221759186693', time=2024-09-12T03:11:31.130829+0000, chain.objs.size()=1 2024-09-12T01:29:15.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.r5SGPdbCCXHZwpvVtG8znsDRNnUmmrY_0 2024-09-12T01:29:15.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12454596883339297503', time=2024-09-12T03:11:31.489947+0000, chain.objs.size()=1 2024-09-12T01:29:15.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.wGpybLHa_v_4eZqqoMXVPx9QVYgpxTz_0 2024-09-12T01:29:15.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10919080970991552514', time=2024-09-12T03:11:32.146692+0000, chain.objs.size()=1 2024-09-12T01:29:15.529 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qgzphZ8KKl5PGR4n5RsxzPqtnLCN4cU_0 2024-09-12T01:29:15.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.134575516801003200', time=2024-09-12T03:11:32.152424+0000, chain.objs.size()=1 2024-09-12T01:29:15.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.GWPC5Clw8hbBM9-rqjNEuxmYqVIWOkY_0 2024-09-12T01:29:15.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16947685436882197791', time=2024-09-12T03:11:32.288715+0000, chain.objs.size()=1 2024-09-12T01:29:15.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.uNICmeKCBVaoF90i8lGyCqvm2qnzMgE_0 2024-09-12T01:29:15.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10317510087257599522', time=2024-09-12T03:11:32.863648+0000, chain.objs.size()=1 2024-09-12T01:29:15.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.z4cpqQ1NE46t5Sq-VveyrlaV65ZBqmQ_0 2024-09-12T01:29:15.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7931699095051535373', time=2024-09-12T03:11:33.509748+0000, chain.objs.size()=1 2024-09-12T01:29:15.530 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.VZXS6kI_rorVqU5qdL9yXTbR88uDX-q_0 2024-09-12T01:29:15.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1199451101106684401', time=2024-09-12T03:11:33.995284+0000, chain.objs.size()=1 2024-09-12T01:29:15.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.3TvE0k0xf-n8R3TuAyi-DR9qXWLr_5s_0 2024-09-12T01:29:15.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10160817201294749576', time=2024-09-12T03:11:34.464469+0000, chain.objs.size()=1 2024-09-12T01:29:15.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.cqmomIA81Au9m0APTjUcNEDG49C43AP_0 2024-09-12T01:29:15.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16291028503624855073', time=2024-09-12T03:11:34.607107+0000, chain.objs.size()=1 2024-09-12T01:29:15.531 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.529+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.E0vss52zaviwZAkwcd6Z0u9ome32woJ_0 2024-09-12T01:29:15.532 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.532+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3531403338150798288', time=2024-09-12T03:11:34.909784+0000, chain.objs.size()=1 2024-09-12T01:29:15.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.532+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.i_zojEcxkKlceD4aOOhXlN0dyE_Auh-_0 2024-09-12T01:29:15.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.532+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.611942542117436252', time=2024-09-12T03:11:34.913216+0000, chain.objs.size()=1 2024-09-12T01:29:15.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.532+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.N7N2JxvvIOUJsNYD2fcIuBOQ1osstbl_0 2024-09-12T01:29:15.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.533+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.614358383489675315', time=2024-09-12T03:11:35.566643+0000, chain.objs.size()=1 2024-09-12T01:29:15.533 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.533+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.QzFSAKJeKqUyVSbPDo0w2C4TIwAoOtu_0 2024-09-12T01:29:15.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8728022502026585078', time=2024-09-12T03:11:35.612535+0000, chain.objs.size()=1 2024-09-12T01:29:15.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MCTwvxNHG3MsfZn1ifFNGqpXulhx-K__0 2024-09-12T01:29:15.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16510686345541081588', time=2024-09-12T03:11:35.624837+0000, chain.objs.size()=1 2024-09-12T01:29:15.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.PzqtX2wNbUoJ0rovU2xZV1jFZCYlS-y_0 2024-09-12T01:29:15.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8817379293648745703', time=2024-09-12T03:11:36.400689+0000, chain.objs.size()=1 2024-09-12T01:29:15.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mxXb2fl2KdeIUVsZNf3ViybE2748ALa_0 2024-09-12T01:29:15.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4390065058299505097', time=2024-09-12T03:11:39.503824+0000, chain.objs.size()=1 2024-09-12T01:29:15.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.0UwmMEFtAcpKiUoOZaSxkbJPhY-ccNn_0 2024-09-12T01:29:15.535 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7039735398175979078', time=2024-09-12T03:11:39.660539+0000, chain.objs.size()=1 2024-09-12T01:29:15.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5j5QeljOZZ4IV54k9Bs85C58njuJfOe_0 2024-09-12T01:29:15.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13261024243438826329', time=2024-09-12T03:11:40.002187+0000, chain.objs.size()=1 2024-09-12T01:29:15.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.YiqiyGA18eKF5gifrfDQAJNa6KJyTii_0 2024-09-12T01:29:15.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9003121643728655650', time=2024-09-12T03:11:40.016805+0000, chain.objs.size()=1 2024-09-12T01:29:15.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.j0lMmsBEV7PP5YYZZRIzreTxe819Im__0 2024-09-12T01:29:15.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1058646795748892670', time=2024-09-12T03:11:40.703322+0000, chain.objs.size()=1 2024-09-12T01:29:15.536 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.534+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.EXUvibSae_u6LYdopfBWeYDecs4GFIn_0 2024-09-12T01:29:15.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.537+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1976616729554360088', time=2024-09-12T03:11:40.844691+0000, chain.objs.size()=1 2024-09-12T01:29:15.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.537+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.8dm8LBTdwaKP707fTzMRSw0uCv_5R0e_0 2024-09-12T01:29:15.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.537+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12994961678416028964', time=2024-09-12T03:11:41.021410+0000, chain.objs.size()=1 2024-09-12T01:29:15.537 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.537+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.8Wmy8uvXItEBAXY2EGDoNKIsVyCoQBu_0 2024-09-12T01:29:15.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.537+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17453855238643637022', time=2024-09-12T03:11:41.558238+0000, chain.objs.size()=1 2024-09-12T01:29:15.538 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.537+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.l91KhPm-qXDz_oJfXTDBaKrayivEUx6_0 2024-09-12T01:29:15.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.539+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14000499222431141034', time=2024-09-12T03:11:41.559673+0000, chain.objs.size()=1 2024-09-12T01:29:15.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.539+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.4lSDjJrqXC91dl0hRuSu81Q0pT_kIiT_0 2024-09-12T01:29:15.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.539+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1697545388476646927', time=2024-09-12T03:11:41.571135+0000, chain.objs.size()=1 2024-09-12T01:29:15.539 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.539+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.VWSXLGFEOmv8FN9KuCKb7q3BDoMMpK1_0 2024-09-12T01:29:15.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.539+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10756375566947534761', time=2024-09-12T03:12:21.871806+0000, chain.objs.size()=1 2024-09-12T01:29:15.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.539+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ZbOLxIrFlfDiRRy2E-Y1bmwLpOd3QLI_0 2024-09-12T01:29:15.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.539+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3955228229329620458', time=2024-09-12T03:12:22.312081+0000, chain.objs.size()=1 2024-09-12T01:29:15.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.540+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.aifzhYLm9v-em01MUdlOvKHsT52-zGy_0 2024-09-12T01:29:15.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.540+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5372444421288151311', time=2024-09-12T03:12:22.313189+0000, chain.objs.size()=1 2024-09-12T01:29:15.540 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.540+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.fQHO2JA4ldjwi4qS5VzHQR3-KDNLqAi_0 2024-09-12T01:29:15.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.540+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1324529037306152078', time=2024-09-12T03:12:22.467696+0000, chain.objs.size()=1 2024-09-12T01:29:15.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.540+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.YfezRGPr2OrazI0Vm1jipmw8SIcph7t_0 2024-09-12T01:29:15.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.540+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14394225035023927246', time=2024-09-12T03:12:23.664204+0000, chain.objs.size()=1 2024-09-12T01:29:15.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.540+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.0EgVmR-NSVaE_03qXi91SRcdfO3Dcwq_0 2024-09-12T01:29:15.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.540+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6218528587767939242', time=2024-09-12T03:12:23.802948+0000, chain.objs.size()=1 2024-09-12T01:29:15.541 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.540+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.j4g_1X_CYsnZe5vWLYS24SxUiu0HwbX_0 2024-09-12T01:29:15.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.541+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15535716761065929397', time=2024-09-12T03:12:24.049702+0000, chain.objs.size()=1 2024-09-12T01:29:15.542 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.541+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ndWxPCpE7_zT77G4g8QzCy9IUzXksnG_0 2024-09-12T01:29:15.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.543+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8649822069748468431', time=2024-09-12T03:12:24.085345+0000, chain.objs.size()=1 2024-09-12T01:29:15.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.543+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.2ilbriL01RAnnoq9B0S7HlBQRqgTQ16_0 2024-09-12T01:29:15.543 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.543+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9832201564462976489', time=2024-09-12T03:12:24.825525+0000, chain.objs.size()=1 2024-09-12T01:29:15.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.543+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Jn_xuFcycUW5WMvfULopiCDPjY-tIlY_0 2024-09-12T01:29:15.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.543+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16385292980180059559', time=2024-09-12T03:12:25.542097+0000, chain.objs.size()=1 2024-09-12T01:29:15.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.543+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.rc8m4VKZqPgpKUapnVSPBCEq8HW82xQ_0 2024-09-12T01:29:15.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.543+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1252025558655103541', time=2024-09-12T03:12:25.597239+0000, chain.objs.size()=1 2024-09-12T01:29:15.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.543+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.YeO2QC_89p1QscWcUuXtb4MXqJ-qWOq_0 2024-09-12T01:29:15.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.544+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3998246163831587390', time=2024-09-12T03:12:26.497407+0000, chain.objs.size()=1 2024-09-12T01:29:15.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.544+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.twcw4W4dxfWbBGXH1YEN1bUV0YxNIYb_0 2024-09-12T01:29:15.544 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.544+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14507689443392897687', time=2024-09-12T03:12:26.569872+0000, chain.objs.size()=1 2024-09-12T01:29:15.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.544+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.b8Xlz83YalgDheZVN8w03hM4wje9qaa_0 2024-09-12T01:29:15.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.544+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15480353767736620338', time=2024-09-12T03:12:27.037528+0000, chain.objs.size()=1 2024-09-12T01:29:15.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.544+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.sxWq6ErvWin7xrqFjPOLDYifo9UV57y_0 2024-09-12T01:29:15.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.544+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13961604100101621005', time=2024-09-12T03:12:27.659684+0000, chain.objs.size()=1 2024-09-12T01:29:15.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.544+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.d9T9cwbDKKH9mq1j7yBw3eBCuy_yrsy_0 2024-09-12T01:29:15.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.544+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4601371036875944249', time=2024-09-12T03:12:27.774869+0000, chain.objs.size()=1 2024-09-12T01:29:15.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.544+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ypu7psRXWh055OB611MOS9QbSikWUFV_0 2024-09-12T01:29:15.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.544+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18100781800102838564', time=2024-09-12T03:12:28.004613+0000, chain.objs.size()=1 2024-09-12T01:29:15.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.544+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RFSRGyFdhd2FiAltjmrtm8X8zBs24U1_0 2024-09-12T01:29:15.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.544+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9625112409186315221', time=2024-09-12T03:12:28.682445+0000, chain.objs.size()=1 2024-09-12T01:29:15.545 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.544+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.dEwp40P98rMY208eIlEtXQwGbZQHo5H_0 2024-09-12T01:29:15.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.546+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11668552143683098446', time=2024-09-12T03:12:28.839682+0000, chain.objs.size()=1 2024-09-12T01:29:15.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.546+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.jr1PTCG2Em3-XHbHNy3508ZlsRo2Ham_0 2024-09-12T01:29:15.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.546+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.788612039940437722', time=2024-09-12T03:12:28.925701+0000, chain.objs.size()=1 2024-09-12T01:29:15.546 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.546+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.T0k0_X_3nhIdT4-U2Em1hmJMkvVm-wA_0 2024-09-12T01:29:15.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.547+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8748641429124762061', time=2024-09-12T03:12:29.344056+0000, chain.objs.size()=1 2024-09-12T01:29:15.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.547+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.o0E1D0_qGUAp0u6ShYSBrbyIQKq_oYM_0 2024-09-12T01:29:15.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.547+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.540433714808769590', time=2024-09-12T03:12:29.425249+0000, chain.objs.size()=1 2024-09-12T01:29:15.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.547+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Eq1K-Dd1-voxbBnpdsysj7PKnJQBDis_0 2024-09-12T01:29:15.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.547+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3709053111948149251', time=2024-09-12T03:12:29.542786+0000, chain.objs.size()=1 2024-09-12T01:29:15.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.547+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MP0wb-O3qFzo2AGMPvP_5Yq_8EvQ1uk_0 2024-09-12T01:29:15.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.547+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1030695660001084478', time=2024-09-12T03:12:29.613337+0000, chain.objs.size()=1 2024-09-12T01:29:15.547 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.547+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.aLMjiII0hGMj3y6EANMBYY3fHKYKqPc_0 2024-09-12T01:29:15.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.547+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17587437257310001608', time=2024-09-12T03:12:29.905655+0000, chain.objs.size()=1 2024-09-12T01:29:15.548 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.547+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.BhHCi2uBnMOEgAp684oLnEfyteiRzS2_0 2024-09-12T01:29:15.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.549+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17043753854620531720', time=2024-09-12T03:12:30.958328+0000, chain.objs.size()=1 2024-09-12T01:29:15.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.549+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.yr8u3RFuh2ShONu93c7S6YvshN_Oozt_0 2024-09-12T01:29:15.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.549+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4917423100266764295', time=2024-09-12T03:12:31.207408+0000, chain.objs.size()=1 2024-09-12T01:29:15.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.549+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.syzJuHJ2np4AX1JgLf1FbpG6gOtehdl_0 2024-09-12T01:29:15.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.549+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17823591686602057863', time=2024-09-12T03:12:31.586883+0000, chain.objs.size()=1 2024-09-12T01:29:15.549 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.549+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.AiOT-_mTjrqgcZreCJYLnJ7THr_Uc1H_0 2024-09-12T01:29:15.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.550+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13818266611799287419', time=2024-09-12T03:12:32.145296+0000, chain.objs.size()=1 2024-09-12T01:29:15.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.550+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.fJTWWdactuWXA7rFfXiCtGB-96HKxEu_0 2024-09-12T01:29:15.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.550+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8596317755241335332', time=2024-09-12T03:12:32.153003+0000, chain.objs.size()=1 2024-09-12T01:29:15.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.550+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.8T85OvR-71_09nqTSGW8MnFfz4xtWIu_0 2024-09-12T01:29:15.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.550+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7061324246001321188', time=2024-09-12T03:12:32.296900+0000, chain.objs.size()=1 2024-09-12T01:29:15.550 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.550+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.OcHHF2IQ8D3fM_Lc4ZHCIJWRZhOJ_CA_0 2024-09-12T01:29:15.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.550+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12929653080055643192', time=2024-09-12T03:12:32.297419+0000, chain.objs.size()=1 2024-09-12T01:29:15.551 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.550+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.I1YvTYMqzN-rnZfOKbQDVAEMFSnSbTp_0 2024-09-12T01:29:15.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.551+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9195580552733279442', time=2024-09-12T03:12:32.963344+0000, chain.objs.size()=1 2024-09-12T01:29:15.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.551+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hCWeU_8UBmoNNJkby0CEbl_pHLj-RBV_0 2024-09-12T01:29:15.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.552+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13267873844311621236', time=2024-09-12T03:12:32.964096+0000, chain.objs.size()=1 2024-09-12T01:29:15.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.552+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ADFGgYDV0N8LDDGVSHqtO18kosBw6Oa_0 2024-09-12T01:29:15.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.552+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2720035728421356309', time=2024-09-12T03:12:33.210150+0000, chain.objs.size()=1 2024-09-12T01:29:15.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.552+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.FnbMeY78o8ltoNQgiCVzkYqi3Zx3fhf_0 2024-09-12T01:29:15.552 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.552+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15711539069960171949', time=2024-09-12T03:12:33.227260+0000, chain.objs.size()=1 2024-09-12T01:29:15.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.552+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._AQRyql2ZeHXya3ollYaLMgpWQDGnx4_0 2024-09-12T01:29:15.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.553+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14355226536317583897', time=2024-09-12T03:12:33.573484+0000, chain.objs.size()=1 2024-09-12T01:29:15.553 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.553+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ViLixZ9vXbicH0NHM-lh3dS41MXhlQd_0 2024-09-12T01:29:15.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.554+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6313576809646002861', time=2024-09-12T03:12:33.616838+0000, chain.objs.size()=1 2024-09-12T01:29:15.554 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.554+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.aRjv67Il6UX-A0vW8kA3eMwmMXCe-9C_0 2024-09-12T01:29:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.557+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/46657 2024-09-12T01:29:15.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T01:29:15.559 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11147819344626307434', time=2024-09-12T03:12:33.772743+0000, chain.objs.size()=1 2024-09-12T01:29:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.2C546pAEHACoe0L34Y9TNNy3sFTb60N_0 2024-09-12T01:29:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4923591851153388305', time=2024-09-12T03:12:33.961452+0000, chain.objs.size()=1 2024-09-12T01:29:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xKn4rZ29fl5TVDIL8HcBKUM4hB7LH3b_0 2024-09-12T01:29:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13708933493934552325', time=2024-09-12T03:12:34.279599+0000, chain.objs.size()=1 2024-09-12T01:29:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.rH9OAbl5CgPfCDmqvhVfTu2d2pn9M-p_0 2024-09-12T01:29:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12255194836932147936', time=2024-09-12T03:12:34.324142+0000, chain.objs.size()=1 2024-09-12T01:29:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.6klAUmYsIDtaMP-QbuzTaVWXOZ4N1jm_0 2024-09-12T01:29:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16663090533511492193', time=2024-09-12T03:12:58.369485+0000, chain.objs.size()=1 2024-09-12T01:29:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.372__shadow_.r7cKBh8-qdNfqS46ut64xUoOO8AjJZZ_0 2024-09-12T01:29:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5461137448437745107', time=2024-09-12T03:13:00.479801+0000, chain.objs.size()=1 2024-09-12T01:29:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.374__shadow_.k-5qlp9c19j3ge_6WHv3hTfSd66M99s_0 2024-09-12T01:29:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2827055427800474528', time=2024-09-12T03:13:49.831524+0000, chain.objs.size()=1 2024-09-12T01:29:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.457__shadow_.j7KL_3Pv0WQFH84bM_5mNMnY490OoSm_0 2024-09-12T01:29:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2798390834419617087', time=2024-09-12T03:13:50.687807+0000, chain.objs.size()=1 2024-09-12T01:29:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.458__shadow_.F1qoORElXD99VRioqkwT7UiwRSkQwE9_0 2024-09-12T01:29:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1584973623031040408', time=2024-09-12T03:14:02.892302+0000, chain.objs.size()=1 2024-09-12T01:29:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.481__shadow_.aRKOhP-1AH1zzR0kE_p_tXj4tqY6cyL_0 2024-09-12T01:29:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2945240209670443199', time=2024-09-12T03:14:05.090717+0000, chain.objs.size()=1 2024-09-12T01:29:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.483__shadow_.gn5hTm8u1zEcJG6dEoyB3bJqPCoo_y2_0 2024-09-12T01:29:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.148087024859483555', time=2024-09-12T03:14:17.430159+0000, chain.objs.size()=1 2024-09-12T01:29:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.500__shadow_.4wguvY4wQssF3Xjuh16oGPc1CGzDkmZ_0 2024-09-12T01:29:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12092450230267360668', time=2024-09-12T03:14:19.838477+0000, chain.objs.size()=1 2024-09-12T01:29:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.559+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.503__shadow:Dp2Xh3PCmOVDZq0qVeIVb0wIZKi8rqS_.nA7nRfHdVh5iLsyVm5W5cePiSTckNJe_0 2024-09-12T01:29:15.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.562+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8208761208935298656', time=2024-09-12T03:15:18.192983+0000, chain.objs.size()=6 2024-09-12T01:29:15.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.562+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.LamrS9JBMqnZrAQceZ8V9gASQ0ctdVyh.1 2024-09-12T01:29:15.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.563+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~wONJy2CuUjug1bGpCPt46PUWSMvpwGl.2 2024-09-12T01:29:15.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.563+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~wONJy2CuUjug1bGpCPt46PUWSMvpwGl.3 2024-09-12T01:29:15.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.563+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~wONJy2CuUjug1bGpCPt46PUWSMvpwGl.4 2024-09-12T01:29:15.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.563+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~wONJy2CuUjug1bGpCPt46PUWSMvpwGl.5 2024-09-12T01:29:15.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.563+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~wONJy2CuUjug1bGpCPt46PUWSMvpwGl.6 2024-09-12T01:29:15.563 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.563+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5845804285921550128', time=2024-09-12T03:16:14.923947+0000, chain.objs.size()=3 2024-09-12T01:29:15.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.563+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.525__multipart_mymultipart.2~lEPeuRZ67OWo_-HoPQ_cD-ReIQ9MUfF.1 2024-09-12T01:29:15.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.563+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.525__multipart_mymultipart.2~lEPeuRZ67OWo_-HoPQ_cD-ReIQ9MUfF.2 2024-09-12T01:29:15.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.563+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.525__multipart_mymultipart.2~lEPeuRZ67OWo_-HoPQ_cD-ReIQ9MUfF.3 2024-09-12T01:29:15.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.563+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14022312761081396887', time=2024-09-12T03:16:25.575863+0000, chain.objs.size()=2 2024-09-12T01:29:15.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.563+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.528__multipart_mymultipart.2~GrWIg535-TdweWb9YCOkrhPm3p3d4jy.1 2024-09-12T01:29:15.564 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.563+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.528__multipart_mymultipart.2~GrWIg535-TdweWb9YCOkrhPm3p3d4jy.2 2024-09-12T01:29:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.565+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~kMrFn3j_-xIsKlAe4evvsEa8X5Srcnj', time=2024-09-12T03:16:32.184254+0000, chain.objs.size()=1 2024-09-12T01:29:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.565+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.533__multipart_mymultipart.2~kMrFn3j_-xIsKlAe4evvsEa8X5Srcnj.1 2024-09-12T01:29:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.566+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15272093936947929338', time=2024-09-12T03:18:01.844347+0000, chain.objs.size()=1 2024-09-12T01:29:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.566+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.574__shadow:g77-FqpAEtm8j6xRFOw4zdfzEMfqyUT_.cAmwutPUwfdl4edFn0cp9IqbiRYeSsN_0 2024-09-12T01:29:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.567+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14579065808578605597', time=2024-09-12T03:18:03.609608+0000, chain.objs.size()=1 2024-09-12T01:29:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.567+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.574__shadow:YTHX-PfpFEjCOf9xYdq6eCKV61TYYKf_.ZceOYxyuAEit_B_ZCWquOq68GGOR4K1_0 2024-09-12T01:29:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.567+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3814125730648910153', time=2024-09-12T03:18:11.710149+0000, chain.objs.size()=1 2024-09-12T01:29:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.567+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.576__shadow:l1J7upgmhtsn4n-aYzeuxT-3QKLPxxQ_.swOSuV83-kCZvS2c4SOXl-SFm183Hn4_0 2024-09-12T01:29:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.568+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15727128349132077842', time=2024-09-12T03:18:14.643459+0000, chain.objs.size()=1 2024-09-12T01:29:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.568+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:iHpsnqhVRcUQ.767rzsgBAIX-AtxmAu_.n1mJa9BpJTD_xUDsMVc4yF6cLXZy60i_0 2024-09-12T01:29:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.568+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4476669351345860790', time=2024-09-12T03:18:17.851696+0000, chain.objs.size()=1 2024-09-12T01:29:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.568+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:ww7-gszb2iOsl-V6GalQA8uwVaaPzwu_.uSjQkUzuxwXVujScoD9Skt-wkvx2V1S_0 2024-09-12T01:29:15.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.568+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3106490407277411438', time=2024-09-12T03:18:20.695260+0000, chain.objs.size()=1 2024-09-12T01:29:15.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.568+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:S3UYnFkiIP7C.JdQfUSfpp-JGNKgtBV_.eVujvHxzMzYxHysfPEx7xznEmTWPmSX_0 2024-09-12T01:29:15.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.569+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11442349794135951087', time=2024-09-12T03:18:48.481708+0000, chain.objs.size()=1 2024-09-12T01:29:15.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.569+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.579__shadow:F0.Emx.kqKKlWuxPJUOy74UtCSDVCWP_.jHcAg-jYzhj62LwuhrpzP9eYfIi6-N__0 2024-09-12T01:29:15.569 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.569+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1436807224407313520', time=2024-09-12T03:18:50.556496+0000, chain.objs.size()=1 2024-09-12T01:29:15.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.569+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.580__shadow:kkaVVB688oZx42XkZTWYr8--r8ju93._.3AyyCPJTj_96xrstLWEdhguHN3Mog3c_0 2024-09-12T01:29:15.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.569+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5659955537931696296', time=2024-09-12T03:23:40.944133+0000, chain.objs.size()=1 2024-09-12T01:29:15.570 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.569+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.663__shadow_.OstGTlGC8wtz4BU2f9sc812_snARire_0 2024-09-12T01:29:15.572 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.572+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.576 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.576+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:29:15.577 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.577+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.578 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.577+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53280' 2024-09-12T01:29:15.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12945560429814660627', time=2024-09-12T03:06:30.323073+0000, chain.objs.size()=1 2024-09-12T01:29:15.579 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.151__shadow_.KNcHGIfkqJLeUDyHns3szQLBwloErwi_0 2024-09-12T01:29:15.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6429469725344884159', time=2024-09-12T03:06:46.176111+0000, chain.objs.size()=2 2024-09-12T01:29:15.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.160__shadow_.TPjbMBT09Mx6u6eTDfyAHmwUbHBiooB_0 2024-09-12T01:29:15.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.160__shadow_.TPjbMBT09Mx6u6eTDfyAHmwUbHBiooB_1 2024-09-12T01:29:15.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_mNVcCQ4mulnV8IIzKM6VNtA5W8Jpjnc', time=2024-09-12T03:06:51.282139+0000, chain.objs.size()=2 2024-09-12T01:29:15.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__shadow_.f4dzt3fQBocSKwQJFWa8umZEia3bLF7_0 2024-09-12T01:29:15.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__shadow_.f4dzt3fQBocSKwQJFWa8umZEia3bLF7_1 2024-09-12T01:29:15.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16894559359482384741', time=2024-09-12T03:07:06.018022+0000, chain.objs.size()=1 2024-09-12T01:29:15.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.176__shadow_.HAo0YJgQVqtH5jlACO-055mwVPzPfWk_0 2024-09-12T01:29:15.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14033901036454067296', time=2024-09-12T03:08:54.203422+0000, chain.objs.size()=1 2024-09-12T01:29:15.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.230__shadow_.bFNj-foR7wtiWndGGtbg7sGwxxRMmgr_0 2024-09-12T01:29:15.580 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14320843894412708527', time=2024-09-12T03:08:57.482761+0000, chain.objs.size()=1 2024-09-12T01:29:15.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.235__shadow_.Y5Q25qXp68D0-wjixLh11PXx19_wcS2_0 2024-09-12T01:29:15.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17812188562275960561', time=2024-09-12T03:09:01.606594+0000, chain.objs.size()=1 2024-09-12T01:29:15.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.241__shadow_.9GiclsyPlQPWseMEC6CjCwI-DlUDQHo_0 2024-09-12T01:29:15.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4674754760930224734', time=2024-09-12T03:09:04.722781+0000, chain.objs.size()=1 2024-09-12T01:29:15.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.245__shadow_.fjHhAgyT9RMLDK6LygBTse3bEZWLnp0_0 2024-09-12T01:29:15.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13347572050780783569', time=2024-09-12T03:09:11.833146+0000, chain.objs.size()=1 2024-09-12T01:29:15.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.256__shadow_.gd1S0WavWueOTjptBwm25CaQ0Q25-sQ_0 2024-09-12T01:29:15.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5590220359164785865', time=2024-09-12T03:09:13.599660+0000, chain.objs.size()=1 2024-09-12T01:29:15.581 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.578+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.259__shadow_.UekZwB9yPTTO5AVJHx_I1YbHpG4tqsi_0 2024-09-12T01:29:15.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.582+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14077076687684320260', time=2024-09-12T03:09:54.422673+0000, chain.objs.size()=1 2024-09-12T01:29:15.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.582+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.m_YQki951LgNgoFTXtmQjd6MKw7NSse_0 2024-09-12T01:29:15.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.582+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17047551934659445069', time=2024-09-12T03:09:54.865144+0000, chain.objs.size()=1 2024-09-12T01:29:15.582 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.582+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.3pCAeVF4IHt3VqY128lyULHDrjrRZRs_0 2024-09-12T01:29:15.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.582+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5955040195030779724', time=2024-09-12T03:09:56.124124+0000, chain.objs.size()=1 2024-09-12T01:29:15.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.582+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Gq-QlpgWyA-27g9kgS3F4nHdckgICbU_0 2024-09-12T01:29:15.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.582+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1187024220364565715', time=2024-09-12T03:09:56.124850+0000, chain.objs.size()=1 2024-09-12T01:29:15.583 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.582+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.kR5j7YCa6hCasCS3haiKGypyWWArZJD_0 2024-09-12T01:29:15.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.583+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7717531402468769874', time=2024-09-12T03:09:56.209560+0000, chain.objs.size()=1 2024-09-12T01:29:15.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.583+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lB3YLiXerUx8_pPmaD0ws_k8dxblHn-_0 2024-09-12T01:29:15.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.583+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17983793717155355467', time=2024-09-12T03:09:56.309233+0000, chain.objs.size()=1 2024-09-12T01:29:15.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.583+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.vCwwGZXG_zH3rZPmlXHHwgMkXedomXv_0 2024-09-12T01:29:15.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.583+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13663350909163939342', time=2024-09-12T03:09:56.549194+0000, chain.objs.size()=1 2024-09-12T01:29:15.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.583+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.uNzd96SaQeSiBKmfKPeKBNKPBbCMrp3_0 2024-09-12T01:29:15.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.583+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1927888524775015993', time=2024-09-12T03:09:56.550007+0000, chain.objs.size()=1 2024-09-12T01:29:15.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.583+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.sAuCmdR_lY8E1RclpETdP1P60S0CU5N_0 2024-09-12T01:29:15.584 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.583+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4137326294763075910', time=2024-09-12T03:10:00.408704+0000, chain.objs.size()=1 2024-09-12T01:29:15.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.583+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0xp6oMiKl3KRaVKsj-zLa1QOQGoAeRI_0 2024-09-12T01:29:15.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.583+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7630827897048969228', time=2024-09-12T03:10:00.437711+0000, chain.objs.size()=1 2024-09-12T01:29:15.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.583+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.uOJjCOoBmCmLsSGkbt--URjZHDWB3Lj_0 2024-09-12T01:29:15.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.583+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10018366211917000686', time=2024-09-12T03:10:00.461693+0000, chain.objs.size()=1 2024-09-12T01:29:15.585 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.583+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.h9rCkjT_VTh5iwXmEJprE6br4qmt2N2_0 2024-09-12T01:29:15.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.586+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3867603141270368068', time=2024-09-12T03:10:01.101697+0000, chain.objs.size()=1 2024-09-12T01:29:15.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.586+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.BjVgyhdAoHLeijvrT3u0oxLEWIlo5X7_0 2024-09-12T01:29:15.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.586+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9743016521337061798', time=2024-09-12T03:10:01.135451+0000, chain.objs.size()=1 2024-09-12T01:29:15.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.586+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PPdF4mlebMZbEZ77Zc149exbwJL1jPc_0 2024-09-12T01:29:15.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.586+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2600250983551285947', time=2024-09-12T03:10:01.270178+0000, chain.objs.size()=1 2024-09-12T01:29:15.586 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.586+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1YQuVkHKXDmWXVfjUyy-8idvnxqX8v__0 2024-09-12T01:29:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.586+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6856661186411562058', time=2024-09-12T03:10:02.077449+0000, chain.objs.size()=1 2024-09-12T01:29:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.586+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Dfkso8QOtXOkpaVDbg4kSwUYkpD0a8p_0 2024-09-12T01:29:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.586+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.763323068161845405', time=2024-09-12T03:10:03.098556+0000, chain.objs.size()=1 2024-09-12T01:29:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.586+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9lJYpRzoMH62fwLry6Y1hvHvFlJdMTI_0 2024-09-12T01:29:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.587+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14862740327615112225', time=2024-09-12T03:10:03.823390+0000, chain.objs.size()=1 2024-09-12T01:29:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.587+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.3K95AFlTL9RaU6S_waG_nVT0NSPx9Im_0 2024-09-12T01:29:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.587+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10690232958868670132', time=2024-09-12T03:10:04.353123+0000, chain.objs.size()=1 2024-09-12T01:29:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.587+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.OLI1xtmNRN_qMDEPGRcIT6HqvELQSx5_0 2024-09-12T01:29:15.587 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.587+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18161527009392824053', time=2024-09-12T03:10:06.185374+0000, chain.objs.size()=1 2024-09-12T01:29:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.587+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ojMVURPoJoQCYj4DmchN9Mflgx5k6Ua_0 2024-09-12T01:29:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.587+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7380162212337458968', time=2024-09-12T03:10:08.523859+0000, chain.objs.size()=1 2024-09-12T01:29:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.587+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.265__shadow_.80Tzg5BlYpn1uxJ5IWAuri3-bA_MvzH_0 2024-09-12T01:29:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.587+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12096618925934469563', time=2024-09-12T03:10:16.448360+0000, chain.objs.size()=1 2024-09-12T01:29:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.587+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.278__shadow_.CuqKK6Df12PC8tI0s5DXtdVGVCyytZ8_0 2024-09-12T01:29:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.587+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1909912487829489210', time=2024-09-12T03:10:17.083801+0000, chain.objs.size()=1 2024-09-12T01:29:15.588 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.587+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.279__shadow_.bgitBsI0d66TGZVjwLr9NJ3nybNyIxt_0 2024-09-12T01:29:15.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.590+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17667901872330866005', time=2024-09-12T03:10:17.084348+0000, chain.objs.size()=1 2024-09-12T01:29:15.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.590+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.279__shadow_.xjJO9Ix2AUAQMbtJmFlCjZgQ0D-bzzj_0 2024-09-12T01:29:15.590 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.590+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.953304639971258026', time=2024-09-12T03:10:19.120508+0000, chain.objs.size()=1 2024-09-12T01:29:15.591 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.590+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.282__shadow_.Ub66QMQmBevn3h7FVKrBYMfI61KamG8_0 2024-09-12T01:29:15.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16424644783513446821', time=2024-09-12T03:10:24.384543+0000, chain.objs.size()=1 2024-09-12T01:29:15.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.290__shadow_.gHbEkGSBG5qpvM60V_OsgRCdK0Es5Ks_0 2024-09-12T01:29:15.592 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3143290490442380162', time=2024-09-12T03:10:27.045888+0000, chain.objs.size()=1 2024-09-12T01:29:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.jtT1fboH51AcqCOksKSjqJpbW6GivIG_0 2024-09-12T01:29:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16329129177489258217', time=2024-09-12T03:10:29.178738+0000, chain.objs.size()=1 2024-09-12T01:29:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.C5lqpnmgSIvbIqWrSUBxdWfdDo3nOCF_0 2024-09-12T01:29:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6986061862780650032', time=2024-09-12T03:11:29.298485+0000, chain.objs.size()=1 2024-09-12T01:29:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.TQYSZETogRtUW87Tav4wWeFYHsTHdYP_0 2024-09-12T01:29:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1404634731986287967', time=2024-09-12T03:11:30.027463+0000, chain.objs.size()=1 2024-09-12T01:29:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.D90rNuVWJc_bIsstMEJ1xAhuC9SyoEa_0 2024-09-12T01:29:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1291035282346331527', time=2024-09-12T03:11:30.028246+0000, chain.objs.size()=1 2024-09-12T01:29:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.bQkvUmQTaWWldIITs54mPYcYKMKm6_g_0 2024-09-12T01:29:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16983632764797233421', time=2024-09-12T03:11:30.121216+0000, chain.objs.size()=1 2024-09-12T01:29:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.HFZ78ZAlYInwLu7NN5On6uxgsaU1OMJ_0 2024-09-12T01:29:15.593 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1588101201888465867', time=2024-09-12T03:11:30.215613+0000, chain.objs.size()=1 2024-09-12T01:29:15.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.JfsbsGFqQTGival2R8aJvmg5wv4bDoP_0 2024-09-12T01:29:15.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14404619630859732193', time=2024-09-12T03:11:30.514528+0000, chain.objs.size()=1 2024-09-12T01:29:15.594 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.592+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.m7r7gdjoVYy6lxxMtfcr-VsqKARj-ov_0 2024-09-12T01:29:15.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.595+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10812711678632200270', time=2024-09-12T03:11:31.294774+0000, chain.objs.size()=1 2024-09-12T01:29:15.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.595+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.a0dQfUM8Vscy5ZqpCfJn2XG-RBek9lW_0 2024-09-12T01:29:15.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.595+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2205723779624401495', time=2024-09-12T03:11:31.807604+0000, chain.objs.size()=1 2024-09-12T01:29:15.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.595+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.sZzUCT5TMFqPUeZP6P31pjJsKRJEXvJ_0 2024-09-12T01:29:15.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.595+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4977179858048192526', time=2024-09-12T03:11:33.148771+0000, chain.objs.size()=1 2024-09-12T01:29:15.595 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.595+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Y46iO7tT6mnfbXeZNnihAJ--KDv7WJI_0 2024-09-12T01:29:15.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.596+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14346304354839975159', time=2024-09-12T03:11:33.564298+0000, chain.objs.size()=1 2024-09-12T01:29:15.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.596+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.LZp-kk80Fy3yAcRXYaewNwXwpruYoju_0 2024-09-12T01:29:15.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.596+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3967940186461890794', time=2024-09-12T03:11:33.882022+0000, chain.objs.size()=1 2024-09-12T01:29:15.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.596+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.XgDBDeXh4hTgIH_F-XlK4D8DGT0YMS0_0 2024-09-12T01:29:15.596 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.596+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1793069122790050136', time=2024-09-12T03:11:33.907052+0000, chain.objs.size()=1 2024-09-12T01:29:15.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.596+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.gF7W30ClaJX3O5n6mW_AEapUKjiOuOc_0 2024-09-12T01:29:15.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.596+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7122036484716851768', time=2024-09-12T03:11:33.962744+0000, chain.objs.size()=1 2024-09-12T01:29:15.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.596+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.GQTw8hdXiZaKjzEjGT0rmFRIlwvu5tt_0 2024-09-12T01:29:15.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.596+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4926019005558030578', time=2024-09-12T03:11:34.595605+0000, chain.objs.size()=1 2024-09-12T01:29:15.597 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.596+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Rd-RYivpaRCrhnOp7wq-9pZ2YQzHQoo_0 2024-09-12T01:29:15.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.598+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17729642984955997468', time=2024-09-12T03:11:34.657718+0000, chain.objs.size()=1 2024-09-12T01:29:15.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.598+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.k_lDGUCLQzjF4u-wd2LzMoIth7XEBwe_0 2024-09-12T01:29:15.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.598+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4859256422688353049', time=2024-09-12T03:11:34.888080+0000, chain.objs.size()=1 2024-09-12T01:29:15.598 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.598+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.KokykH6OvpWdIyPnUpcdlpigS5LzhKn_0 2024-09-12T01:29:15.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.598+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10670301807445624971', time=2024-09-12T03:11:36.104722+0000, chain.objs.size()=1 2024-09-12T01:29:15.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.598+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.sIbJsYjA9rnEi8NjM-l2t7qrZuExxft_0 2024-09-12T01:29:15.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.598+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17713047060651696501', time=2024-09-12T03:11:36.328620+0000, chain.objs.size()=1 2024-09-12T01:29:15.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.598+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.G-v2uZJIYpGMGz9z8n3a_KNU4GIof-P_0 2024-09-12T01:29:15.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.598+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10721950413123691803', time=2024-09-12T03:11:36.395095+0000, chain.objs.size()=1 2024-09-12T01:29:15.599 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.598+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.UhP3cvYS4Vhxj6uDmZhF0UAi5s3nnF0_0 2024-09-12T01:29:15.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.600+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3286874282014152870', time=2024-09-12T03:11:37.090396+0000, chain.objs.size()=1 2024-09-12T01:29:15.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.600+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.sDBoAPGD6aX8HWQEapKEPcRpDm2Iv4e_0 2024-09-12T01:29:15.600 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.600+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4718133928630908055', time=2024-09-12T03:11:37.223494+0000, chain.objs.size()=1 2024-09-12T01:29:15.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.600+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2lu_-tLUeJyVOOV2S9Tc4guWXEMYkxK_0 2024-09-12T01:29:15.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.600+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8656901206207199049', time=2024-09-12T03:11:37.262407+0000, chain.objs.size()=1 2024-09-12T01:29:15.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.600+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.sE2j7MEzGsKrbXln9D62YzNXEfa8sYX_0 2024-09-12T01:29:15.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.601+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11754373041449168845', time=2024-09-12T03:11:37.894187+0000, chain.objs.size()=1 2024-09-12T01:29:15.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.601+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.emByePoBdFEegvw702i3Q9tqvOZkyf9_0 2024-09-12T01:29:15.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.601+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11576184025993035064', time=2024-09-12T03:11:38.216478+0000, chain.objs.size()=1 2024-09-12T01:29:15.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.601+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2sPxk-YsPQc6B7sw-L2OQJ6lDuVIA0f_0 2024-09-12T01:29:15.601 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.601+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3207000566775468206', time=2024-09-12T03:11:38.310642+0000, chain.objs.size()=1 2024-09-12T01:29:15.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.601+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.3QDUnM3x82WhBWPZdkloZmXm3zzwyx-_0 2024-09-12T01:29:15.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.602+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.965637859628619570', time=2024-09-12T03:11:38.641313+0000, chain.objs.size()=1 2024-09-12T01:29:15.602 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.602+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.732bbaJtIgJL2wE1wNXGVoqQrolxs-l_0 2024-09-12T01:29:15.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.602+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14518187686190566226', time=2024-09-12T03:11:38.753824+0000, chain.objs.size()=1 2024-09-12T01:29:15.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.602+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.PofV8-ZdeIteNSr3ceL6p2fZLth0cAW_0 2024-09-12T01:29:15.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.602+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4764102586737994084', time=2024-09-12T03:11:38.830381+0000, chain.objs.size()=1 2024-09-12T01:29:15.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.602+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.sLwh9YnDa3Z8Dn_k18lKVgriNpM0zZt_0 2024-09-12T01:29:15.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.603+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6483778710419307229', time=2024-09-12T03:11:39.404350+0000, chain.objs.size()=1 2024-09-12T01:29:15.603 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.603+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ML-ZCik6CUIe1RPbRAIeNm4Djvb4gfn_0 2024-09-12T01:29:15.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.603+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5899965469277295473', time=2024-09-12T03:11:39.854478+0000, chain.objs.size()=1 2024-09-12T01:29:15.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.603+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ZG4SUm_TwmFE-YitqR3rZjxq7d-liLn_0 2024-09-12T01:29:15.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.603+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10728493685941852172', time=2024-09-12T03:11:40.806705+0000, chain.objs.size()=1 2024-09-12T01:29:15.604 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.603+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.W_Mdz4BFGeKNaUIRBH6z1kylNkzGMbo_0 2024-09-12T01:29:15.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.604+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11041546307532259556', time=2024-09-12T03:11:41.558689+0000, chain.objs.size()=1 2024-09-12T01:29:15.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.604+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mc_iIpw48byKKM9Mj7_Gl7obJGmT1Bu_0 2024-09-12T01:29:15.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.604+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7896259852858710437', time=2024-09-12T03:12:22.287716+0000, chain.objs.size()=1 2024-09-12T01:29:15.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.604+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xlV5ykBGmuFjpomvOtp_zXcPruuo57R_0 2024-09-12T01:29:15.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.604+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14257340603045740306', time=2024-09-12T03:12:22.431715+0000, chain.objs.size()=1 2024-09-12T01:29:15.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.604+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mrvxZbVKN_EXWSmEDsUtQi44opAKHxU_0 2024-09-12T01:29:15.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.604+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8665243414384932918', time=2024-09-12T03:12:22.840690+0000, chain.objs.size()=1 2024-09-12T01:29:15.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.604+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.krPJFk9miX61D4wMSSgd49TI4E9HLTv_0 2024-09-12T01:29:15.605 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.604+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12059584035069953013', time=2024-09-12T03:12:24.316739+0000, chain.objs.size()=1 2024-09-12T01:29:15.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.604+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.iEOIkzy-VwF-CFu9Bf4hARsnRmmeCVa_0 2024-09-12T01:29:15.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.604+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15702754966319189752', time=2024-09-12T03:12:24.554513+0000, chain.objs.size()=1 2024-09-12T01:29:15.606 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.604+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.rvgWYDKruNxLrZaS0-5tL961O4vHi23_0 2024-09-12T01:29:15.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.608+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11552799790478867810', time=2024-09-12T03:12:24.669960+0000, chain.objs.size()=1 2024-09-12T01:29:15.608 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.608+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Y9RVjCjzvRJC9sUV-Z4miN7HT2Mw0hu_0 2024-09-12T01:29:15.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.608+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5999452432856949090', time=2024-09-12T03:12:26.006404+0000, chain.objs.size()=1 2024-09-12T01:29:15.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.608+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.tsULDAEuX82n5adZ8gERBoroJud67kS_0 2024-09-12T01:29:15.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.608+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15608687160002988265', time=2024-09-12T03:12:26.124379+0000, chain.objs.size()=1 2024-09-12T01:29:15.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.608+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.NtXdrwj8jnc63kBSfv5JbvoYSpVnXEx_0 2024-09-12T01:29:15.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.608+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11606177183414210897', time=2024-09-12T03:12:26.570781+0000, chain.objs.size()=1 2024-09-12T01:29:15.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.608+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3wQ4CHrWvL_AHanjXCvYxuC51hdEpR3_0 2024-09-12T01:29:15.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.608+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2753369713642474566', time=2024-09-12T03:12:27.303829+0000, chain.objs.size()=1 2024-09-12T01:29:15.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.608+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.nNRfbSyBSE_pT05l0YRB46zVEcs0HwW_0 2024-09-12T01:29:15.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.608+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11872857867787446576', time=2024-09-12T03:12:27.357002+0000, chain.objs.size()=1 2024-09-12T01:29:15.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.608+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.NNKaiPqeQxMQN7Cus2KHi_hVEHccc_9_0 2024-09-12T01:29:15.609 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.608+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1528155032419582583', time=2024-09-12T03:12:27.802153+0000, chain.objs.size()=1 2024-09-12T01:29:15.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.608+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.tBM7m9FQ7XeRi4RUKbdYo059PXD72D4_0 2024-09-12T01:29:15.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.609+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2268745262084701930', time=2024-09-12T03:12:28.044542+0000, chain.objs.size()=1 2024-09-12T01:29:15.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.609+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gZPCoRWihliftn33IRWfnWDsPH54pft_0 2024-09-12T01:29:15.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.609+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8386994091383169062', time=2024-09-12T03:12:28.266739+0000, chain.objs.size()=1 2024-09-12T01:29:15.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.609+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.FQJU1BWfiJueUHQcwyYMdGAzPmLtASc_0 2024-09-12T01:29:15.610 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.609+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8293923137597313775', time=2024-09-12T03:12:28.801387+0000, chain.objs.size()=1 2024-09-12T01:29:15.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.609+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3vI6jlt_ktpZTWVLWzEe5zs1e_TEa9V_0 2024-09-12T01:29:15.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.609+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10858928506186635885', time=2024-09-12T03:12:29.255316+0000, chain.objs.size()=1 2024-09-12T01:29:15.611 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.609+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.4UlHNFAD01Bh6sp87R4lT9PdzIDm2Se_0 2024-09-12T01:29:15.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.612+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8986320557968560522', time=2024-09-12T03:12:29.391953+0000, chain.objs.size()=1 2024-09-12T01:29:15.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.612+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._SPWy8mc3hHeugeMOCD6bC-evqqjn8j_0 2024-09-12T01:29:15.612 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.612+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16322206548716058592', time=2024-09-12T03:12:29.744984+0000, chain.objs.size()=1 2024-09-12T01:29:15.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.612+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.EOQ1UI_aCiIJ9XnZ_MsP2kk3gR75TeO_0 2024-09-12T01:29:15.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.612+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2258496977602260326', time=2024-09-12T03:12:30.419952+0000, chain.objs.size()=1 2024-09-12T01:29:15.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.612+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.5sVVRbPxcxNdoj1gquNzjFy9l4SvQHE_0 2024-09-12T01:29:15.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.612+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.941653668322845476', time=2024-09-12T03:12:30.995993+0000, chain.objs.size()=1 2024-09-12T01:29:15.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.612+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.bvgSVwwph40nhPOmIYqceocEw9RvH8j_0 2024-09-12T01:29:15.613 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.612+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12367643842661859163', time=2024-09-12T03:12:31.334902+0000, chain.objs.size()=1 2024-09-12T01:29:15.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.612+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.JT-LMgQjg42sDKekgodsFcDq2lyZ5ij_0 2024-09-12T01:29:15.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.612+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13800295303649774948', time=2024-09-12T03:12:31.335799+0000, chain.objs.size()=1 2024-09-12T01:29:15.614 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.612+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.fL8lgS95WuL-xzqG_BJsnupfjtMDhJo_0 2024-09-12T01:29:15.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.614+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14055472180285674874', time=2024-09-12T03:12:31.480337+0000, chain.objs.size()=1 2024-09-12T01:29:15.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.614+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.t5PejNvzenZRaugoRrLQ017p4ylGse1_0 2024-09-12T01:29:15.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.614+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4870616118112789332', time=2024-09-12T03:12:31.586384+0000, chain.objs.size()=1 2024-09-12T01:29:15.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.614+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ck-Zo29zTcnm2jEgrSMBcKi7Gq1UA0P_0 2024-09-12T01:29:15.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.614+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1824613744061097108', time=2024-09-12T03:12:32.034709+0000, chain.objs.size()=1 2024-09-12T01:29:15.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.614+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.uTaUSjxp6jKdKgRdaoTXKT6awh7Ga4m_0 2024-09-12T01:29:15.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.614+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2327398816670850042', time=2024-09-12T03:12:33.187138+0000, chain.objs.size()=1 2024-09-12T01:29:15.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.614+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.tnCD0_xMgDJE3xulnfVuIsjAcyqFeFU_0 2024-09-12T01:29:15.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.614+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6300323559992017092', time=2024-09-12T03:12:33.713850+0000, chain.objs.size()=1 2024-09-12T01:29:15.615 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.614+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.TEoTtlgjRSnP6Ve_I8smg8LH4Lrg6Pb_0 2024-09-12T01:29:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.617+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7829303872540720281', time=2024-09-12T03:12:33.714397+0000, chain.objs.size()=1 2024-09-12T01:29:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ch1eGR-WC5YsUxrCDuU_Q9dq2q7YiN__0 2024-09-12T01:29:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.617+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5982311930355239600', time=2024-09-12T03:13:21.137887+0000, chain.objs.size()=1 2024-09-12T01:29:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.408__shadow_.1miQKk2bTJVnil5readegBgbxxVTjyz_0 2024-09-12T01:29:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.617+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.756364689948604689', time=2024-09-12T03:14:06.273335+0000, chain.objs.size()=1 2024-09-12T01:29:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.485__shadow_.qCGnHSug5GUOIolczCMJM_KlVR3Zh5J_0 2024-09-12T01:29:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.617+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3959090397224552686', time=2024-09-12T03:14:29.094091+0000, chain.objs.size()=6 2024-09-12T01:29:15.617 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.1 2024-09-12T01:29:15.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.2 2024-09-12T01:29:15.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.3 2024-09-12T01:29:15.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.4 2024-09-12T01:29:15.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.5 2024-09-12T01:29:15.618 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.617+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.6 2024-09-12T01:29:15.622 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.621+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/53280 2024-09-12T01:29:15.624 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:29:15.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~iO4pAREtrsKb_7aSBS4AEwiWlppZvE6', time=2024-09-12T03:16:32.955986+0000, chain.objs.size()=1 2024-09-12T01:29:15.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.534__multipart_mymultipart.2~iO4pAREtrsKb_7aSBS4AEwiWlppZvE6.1 2024-09-12T01:29:15.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2143411354568722112', time=2024-09-12T03:17:18.991810+0000, chain.objs.size()=1 2024-09-12T01:29:15.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.554__shadow_.1qDu3YJUwoF3I85qugYvlwN6A-EehDe_0 2024-09-12T01:29:15.625 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2114323196788499957', time=2024-09-12T03:17:23.046494+0000, chain.objs.size()=1 2024-09-12T01:29:15.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.556__shadow_.5-wGWY_B5P8jVCbPySF3kX7caHCXAxw_0 2024-09-12T01:29:15.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1139786694434736982', time=2024-09-12T03:17:42.327901+0000, chain.objs.size()=1 2024-09-12T01:29:15.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.564__shadow_.TSaX_iGmvmP3oZUCSDYx4qXxNNFpaML_0 2024-09-12T01:29:15.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9844201257972466250', time=2024-09-12T03:17:50.091127+0000, chain.objs.size()=1 2024-09-12T01:29:15.626 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:8glZRm.k6AmTeVKdpnSAaSTZoMhnGsN_.dIxdDlq38et9ofgnUwEtRjs4jQZstox_0 2024-09-12T01:29:15.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13721944211329860827', time=2024-09-12T03:17:52.307674+0000, chain.objs.size()=1 2024-09-12T01:29:15.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:PClprvwysh0gGY9mQqX-elaOkx25x6v_.DUrndv68HtuX3rPoxUHqL70IeEunxO5_0 2024-09-12T01:29:15.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7014812386244633815', time=2024-09-12T03:18:01.472115+0000, chain.objs.size()=1 2024-09-12T01:29:15.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.574__shadow_.zPw263Qh7oGYcgpctDjFqPnk8SL5KPj_0 2024-09-12T01:29:15.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2457034453212001199', time=2024-09-12T03:18:11.959528+0000, chain.objs.size()=1 2024-09-12T01:29:15.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.576__shadow:v30AibyahbgPPLh0tGkj.RSDbefdX9O_.cRPkGpWr8VOTFDXyAy-xyXZWElpO8F9_0 2024-09-12T01:29:15.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14001534472269586874', time=2024-09-12T03:18:15.892649+0000, chain.objs.size()=1 2024-09-12T01:29:15.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:ozA1CmJ6MQxtT87sJqz5tRLJmDvtLcW_.0sjnKGEX0DX_kxT_WvxRXco0RIrlo3R_0 2024-09-12T01:29:15.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17597789981181973961', time=2024-09-12T03:18:16.884676+0000, chain.objs.size()=1 2024-09-12T01:29:15.627 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:h3YqSBLkHSR0YiY04umf8RQZ5CmvNUL_.swG-KFJKgpZ0xCSh-isk2ZpH9of_tGr_0 2024-09-12T01:29:15.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9594194686247541621', time=2024-09-12T03:18:21.835144+0000, chain.objs.size()=1 2024-09-12T01:29:15.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:m8r4.SNImb1cn-NAauSrvmo21qk4mwA_.1W0WA_NheO556nuoU1KMT46bXQT-Ezy_0 2024-09-12T01:29:15.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16773268332024473907', time=2024-09-12T03:18:45.979775+0000, chain.objs.size()=4 2024-09-12T01:29:15.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.624+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.578__multipart_testobj.2~I-tKVChFx0U3-KkNZ7zogbDpSIgXoxo.1 2024-09-12T01:29:15.628 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.627+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.578__multipart_testobj.2~I-tKVChFx0U3-KkNZ7zogbDpSIgXoxo.2 2024-09-12T01:29:15.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.627+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.578__multipart_testobj.2~I-tKVChFx0U3-KkNZ7zogbDpSIgXoxo.3 2024-09-12T01:29:15.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.628+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.578__multipart_testobj.2~I-tKVChFx0U3-KkNZ7zogbDpSIgXoxo.4 2024-09-12T01:29:15.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.628+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16063077156693668276', time=2024-09-12T03:18:55.407967+0000, chain.objs.size()=1 2024-09-12T01:29:15.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.628+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.586__shadow:1qOdYEge-ZCJ4V.tsmof3uKRD59uMrI_.bNkiEG1x4N0Guur6NITmpzY9pjlG6sI_0 2024-09-12T01:29:15.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.628+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8351621711616948281', time=2024-09-12T03:18:56.759785+0000, chain.objs.size()=1 2024-09-12T01:29:15.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.628+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.587__shadow:MeQGS04qYk82-oSVaJzEd07LZpxiIVb_.Y5W2v0vRDivkSHzqlyAJxxKt2ZEPwEB_0 2024-09-12T01:29:15.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.628+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11731673371096939372', time=2024-09-12T03:18:56.842204+0000, chain.objs.size()=1 2024-09-12T01:29:15.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.628+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.587__shadow:wWHk7e7btkqE-Jbd5eABMAMX8--p6tr_.sJ0Q4zlmmm908DDvoZhMXOhy499jbmp_0 2024-09-12T01:29:15.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.628+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4802153335511865884', time=2024-09-12T03:19:38.911306+0000, chain.objs.size()=6 2024-09-12T01:29:15.629 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.628+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.613__multipart_multipart_enc.2~JylLjGco2XjcYLJzxf8yCl6HWyVp6QW.1 2024-09-12T01:29:15.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.628+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.613__multipart_multipart_enc.2~JylLjGco2XjcYLJzxf8yCl6HWyVp6QW.2 2024-09-12T01:29:15.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.628+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.613__multipart_multipart_enc.2~JylLjGco2XjcYLJzxf8yCl6HWyVp6QW.3 2024-09-12T01:29:15.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.628+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.613__multipart_multipart_enc.2~JylLjGco2XjcYLJzxf8yCl6HWyVp6QW.4 2024-09-12T01:29:15.630 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.628+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.613__multipart_multipart_enc.2~JylLjGco2XjcYLJzxf8yCl6HWyVp6QW.5 2024-09-12T01:29:15.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.631+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.613__multipart_multipart_enc.2~JylLjGco2XjcYLJzxf8yCl6HWyVp6QW.6 2024-09-12T01:29:15.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.631+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2781291400716570769', time=2024-09-12T03:23:05.573599+0000, chain.objs.size()=1 2024-09-12T01:29:15.631 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.631+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.642__shadow_.8L2XQqSqNAubbRuXw0d318-mulc2qIN_0 2024-09-12T01:29:15.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.632+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14992539502758277497', time=2024-09-12T03:23:19.669093+0000, chain.objs.size()=1 2024-09-12T01:29:15.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.632+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.652__shadow_.l8MF3ubqAVeQkZmY3nqURQ5pV-soOeh_0 2024-09-12T01:29:15.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.632+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14553882912584906021', time=2024-09-12T03:23:50.365142+0000, chain.objs.size()=1 2024-09-12T01:29:15.633 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.632+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.679__shadow_.Obf600OC5jcKTizlkKcJiIuRwHIiqpu_0 2024-09-12T01:29:15.636 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.636+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.639+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:29:15.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.640+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.641 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49569' 2024-09-12T01:29:15.642 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~b2SOXuchpkPTIPxgtRuDMxIXcdgzB6s', time=2024-09-12T03:07:25.294326+0000, chain.objs.size()=1 2024-09-12T01:29:15.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.201__multipart_mymultipart.2~b2SOXuchpkPTIPxgtRuDMxIXcdgzB6s.1 2024-09-12T01:29:15.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1189381596036971853', time=2024-09-12T03:08:59.043016+0000, chain.objs.size()=1 2024-09-12T01:29:15.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.237__shadow_.glWwTIx5vrgG4ZTILklLcyjCRyWeXhs_0 2024-09-12T01:29:15.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7758842157863001831', time=2024-09-12T03:09:03.163397+0000, chain.objs.size()=1 2024-09-12T01:29:15.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.243__shadow_.E7wDifhVTX_gVSCGW7ZKw-mMbJfKNtY_0 2024-09-12T01:29:15.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13301675956714021216', time=2024-09-12T03:09:06.661418+0000, chain.objs.size()=1 2024-09-12T01:29:15.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.248__shadow_.B2kqIB79MdaZ9_I8zHsupIMdkflRisf_0 2024-09-12T01:29:15.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7553815365383999020', time=2024-09-12T03:09:13.016061+0000, chain.objs.size()=1 2024-09-12T01:29:15.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.258__shadow_.3BOTak818r2lhItj0V2sYoImV43qDLO_0 2024-09-12T01:29:15.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3820712166078675369', time=2024-09-12T03:09:13.601527+0000, chain.objs.size()=1 2024-09-12T01:29:15.643 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.259__shadow_.iEHcpiyKGDUvUVb2dr1AMan2rQ7ctRJ_0 2024-09-12T01:29:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15824278426341147394', time=2024-09-12T03:09:55.221132+0000, chain.objs.size()=1 2024-09-12T01:29:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.sjktXFJIuUztwtDjAgxq3iF6SSNtx48_0 2024-09-12T01:29:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5581133187374856784', time=2024-09-12T03:09:55.300461+0000, chain.objs.size()=1 2024-09-12T01:29:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ups_-hQhCWoy8bRTJ1yyZAvlbs3gYum_0 2024-09-12T01:29:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5011212193236656371', time=2024-09-12T03:09:56.094479+0000, chain.objs.size()=1 2024-09-12T01:29:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Oeq-5tyKNLmA6GN4iYoJjzpsR0KA2QJ_0 2024-09-12T01:29:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15282015380451392542', time=2024-09-12T03:09:56.283066+0000, chain.objs.size()=1 2024-09-12T01:29:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.iltkngpyJp_RH-Q-7X2Zu0l7w62IwJ0_0 2024-09-12T01:29:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3174771839907580395', time=2024-09-12T03:09:56.453047+0000, chain.objs.size()=1 2024-09-12T01:29:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.3NmsXI0LT_VyDTXnt53t_nMKTbb2wxM_0 2024-09-12T01:29:15.644 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6351404774575363182', time=2024-09-12T03:09:57.235263+0000, chain.objs.size()=1 2024-09-12T01:29:15.645 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.641+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.GGhMxDTCfpbRqyy-nQuIKXOX8wvUo3c_0 2024-09-12T01:29:15.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.645+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9615468201548832958', time=2024-09-12T03:09:58.185162+0000, chain.objs.size()=1 2024-09-12T01:29:15.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.645+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.rcuWdyM3-Z-ZZriaHi3ar4b8e-YJK0F_0 2024-09-12T01:29:15.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.645+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17473829020098191492', time=2024-09-12T03:09:58.496169+0000, chain.objs.size()=1 2024-09-12T01:29:15.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.645+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8H3a1hmjOcqtwXOQHL7Tm0q66H6XAjm_0 2024-09-12T01:29:15.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.645+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4720884434326275797', time=2024-09-12T03:09:58.838538+0000, chain.objs.size()=1 2024-09-12T01:29:15.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.645+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.w1DTUuUJNXg-hauLUhkX_rDbsChW5jz_0 2024-09-12T01:29:15.646 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.645+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15319284194245270282', time=2024-09-12T03:09:58.959233+0000, chain.objs.size()=1 2024-09-12T01:29:15.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.645+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.VyyTBmfmGeNJlc2cZqwY8X3kLzVPZJR_0 2024-09-12T01:29:15.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.645+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.225460534170616245', time=2024-09-12T03:10:00.122512+0000, chain.objs.size()=1 2024-09-12T01:29:15.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.645+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ZAmZYDBURa_-qsgGXylhbrRxvIWSD4w_0 2024-09-12T01:29:15.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.645+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13503278688570524229', time=2024-09-12T03:10:00.491230+0000, chain.objs.size()=1 2024-09-12T01:29:15.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.645+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.d2NXOO7BaZARL5wwzJPbSVX17hMB_Vs_0 2024-09-12T01:29:15.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.645+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2238099425588297654', time=2024-09-12T03:10:01.063618+0000, chain.objs.size()=1 2024-09-12T01:29:15.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.645+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PbzvV2tkW4qyyO4J4a0zgBDPDSWo__e_0 2024-09-12T01:29:15.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.646+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.296628069969773076', time=2024-09-12T03:10:01.793899+0000, chain.objs.size()=1 2024-09-12T01:29:15.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.646+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.xNa_SN-DkwkUdIRSfpyiBIRzYLGlCoj_0 2024-09-12T01:29:15.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.646+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10417882201131536544', time=2024-09-12T03:10:01.835365+0000, chain.objs.size()=1 2024-09-12T01:29:15.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.646+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.UcUQgAw0KRcvIb-zrSgjHGnJWGwAs73_0 2024-09-12T01:29:15.647 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.646+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12237709336335129931', time=2024-09-12T03:10:03.314827+0000, chain.objs.size()=1 2024-09-12T01:29:15.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.646+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.CDkxq3LFpmPseDSrh2Oz8x6NlAvzYkR_0 2024-09-12T01:29:15.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.646+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6489784706541599275', time=2024-09-12T03:10:03.482190+0000, chain.objs.size()=1 2024-09-12T01:29:15.648 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.646+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QrlVGxZ7rKMNEw8HHyQl7EvppEiiYnP_0 2024-09-12T01:29:15.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.649+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5640956210577763236', time=2024-09-12T03:10:04.835360+0000, chain.objs.size()=1 2024-09-12T01:29:15.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.649+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.DMLFTWeLqHTQ7mKX6RJ3pd67iSCXvVB_0 2024-09-12T01:29:15.649 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.649+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2990589730511892998', time=2024-09-12T03:10:05.056103+0000, chain.objs.size()=1 2024-09-12T01:29:15.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.649+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.hYnY0O4vQWsgxwFJxBgy0WAE7VDIOvB_0 2024-09-12T01:29:15.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.649+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10361801992043368680', time=2024-09-12T03:10:06.252971+0000, chain.objs.size()=1 2024-09-12T01:29:15.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.649+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.OyAquTJhE2cfsiEZ3IEBWBB9ugHH81c_0 2024-09-12T01:29:15.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.649+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12621400510675558503', time=2024-09-12T03:10:06.301168+0000, chain.objs.size()=1 2024-09-12T01:29:15.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.649+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.KFrJM5zXq_i8ep7IWP3IPVyxHVkeB7o_0 2024-09-12T01:29:15.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.649+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7992774087396119872', time=2024-09-12T03:10:06.475751+0000, chain.objs.size()=1 2024-09-12T01:29:15.650 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.649+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.YnnRB084NhC0nn99zp5g6c2FRYafgTc_0 2024-09-12T01:29:15.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.652+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10725359988855619310', time=2024-09-12T03:10:06.620817+0000, chain.objs.size()=1 2024-09-12T01:29:15.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.652+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.i0l8ZRXKh_fzDpWlmFlqLIL0qhdZUWt_0 2024-09-12T01:29:15.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.652+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1375675050568166990', time=2024-09-12T03:10:07.937212+0000, chain.objs.size()=1 2024-09-12T01:29:15.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.652+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.264__shadow_.WojARwB_82piFKyNYnFx5EqX-r8euik_0 2024-09-12T01:29:15.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.652+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3920590539533427737', time=2024-09-12T03:10:11.472926+0000, chain.objs.size()=1 2024-09-12T01:29:15.653 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.652+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.270__shadow_.wHq-UVM2LlvU-zgsir-2uE74p0CWdeP_0 2024-09-12T01:29:15.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.652+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17750619677039676051', time=2024-09-12T03:10:14.492276+0000, chain.objs.size()=1 2024-09-12T01:29:15.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.652+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.275__shadow_.mjz8pI_DCdSwWXFYJSUg4kJS6hOxsNF_0 2024-09-12T01:29:15.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.652+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16433155224729185063', time=2024-09-12T03:10:21.840327+0000, chain.objs.size()=1 2024-09-12T01:29:15.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.652+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.286__shadow_.RbUuImJHo-Qsr4_xrw4IB1gnftrkaJj_0 2024-09-12T01:29:15.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.652+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8943927851043514528', time=2024-09-12T03:10:22.479927+0000, chain.objs.size()=1 2024-09-12T01:29:15.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.652+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.287__shadow_.o6weBLnDzr0MVr4AxHU39YbshLbsYOb_0 2024-09-12T01:29:15.654 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.654+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6836451298019702503', time=2024-09-12T03:10:23.101281+0000, chain.objs.size()=1 2024-09-12T01:29:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.654+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.288__shadow_.v-0Iuw-LKX0_7jZlM5FLz3tETTlGGCy_0 2024-09-12T01:29:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.654+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7993141666458674876', time=2024-09-12T03:10:31.822791+0000, chain.objs.size()=1 2024-09-12T01:29:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.654+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.297__shadow_.t48DixSOqoJEK1o9xofI2SpNemvidYO_0 2024-09-12T01:29:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.654+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1919789523171084827', time=2024-09-12T03:11:29.739007+0000, chain.objs.size()=1 2024-09-12T01:29:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.654+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.d_RMlD_qX1CrsR9zba_N2huTqzSXOwj_0 2024-09-12T01:29:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.654+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11513232646537539167', time=2024-09-12T03:11:30.052318+0000, chain.objs.size()=1 2024-09-12T01:29:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.654+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.f4HNadWQ77YhP_SdoAsPNL0bChHG_BL_0 2024-09-12T01:29:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.654+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15561754207619940775', time=2024-09-12T03:11:30.362431+0000, chain.objs.size()=1 2024-09-12T01:29:15.655 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.654+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.vchYFv5mmQtg9BMVk7WiVydlAEAkoUD_0 2024-09-12T01:29:15.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.655+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9646984471518899424', time=2024-09-12T03:11:30.363059+0000, chain.objs.size()=1 2024-09-12T01:29:15.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.655+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.TQwV3s6Q_lchiD8bbTJl6Dq0OoV0Sug_0 2024-09-12T01:29:15.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.655+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2152090146934989642', time=2024-09-12T03:11:30.406793+0000, chain.objs.size()=1 2024-09-12T01:29:15.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.655+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.V4GQv0YjyomKJyYHPGUdzd_fGuF_ZeY_0 2024-09-12T01:29:15.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.655+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1269858853393003061', time=2024-09-12T03:11:31.295709+0000, chain.objs.size()=1 2024-09-12T01:29:15.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.655+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.sgFpHmEOvr25wAnASfDMxSZVuUiWGjE_0 2024-09-12T01:29:15.656 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.656+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2277685620006144860', time=2024-09-12T03:11:31.420018+0000, chain.objs.size()=1 2024-09-12T01:29:15.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.656+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ZZtKU5GIA8SjSw44TJKxUT4OUkFzaK9_0 2024-09-12T01:29:15.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.656+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15628061140285985317', time=2024-09-12T03:11:31.682925+0000, chain.objs.size()=1 2024-09-12T01:29:15.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.656+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.q5Xu3GMRAsS-PIHG7ncKZkKhowi1MK5_0 2024-09-12T01:29:15.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.656+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13405415001255890071', time=2024-09-12T03:11:31.874101+0000, chain.objs.size()=1 2024-09-12T01:29:15.657 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.656+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.uXhG0JHruysEVEdJA9dDShvt7AJqWi9_0 2024-09-12T01:29:15.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.658+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7113363892184408855', time=2024-09-12T03:11:32.065948+0000, chain.objs.size()=1 2024-09-12T01:29:15.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.658+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2R3d85nzKuw5dsnTHDz92wGd_KL3uhU_0 2024-09-12T01:29:15.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.658+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4714862327655602151', time=2024-09-12T03:11:32.115843+0000, chain.objs.size()=1 2024-09-12T01:29:15.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.658+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.G2RlFUsZoY115x9ST9HaTAQK4a7q7sx_0 2024-09-12T01:29:15.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.658+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10503337983018054724', time=2024-09-12T03:11:32.166396+0000, chain.objs.size()=1 2024-09-12T01:29:15.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.658+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.HIKEiKanNYD_5onKvTirgXEaZwlEWBS_0 2024-09-12T01:29:15.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.658+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1083294596907167365', time=2024-09-12T03:11:32.262066+0000, chain.objs.size()=1 2024-09-12T01:29:15.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.659+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.6ppY1bFXipInTmQf6HjXhc1Pkud50M2_0 2024-09-12T01:29:15.659 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.659+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6076583459301914932', time=2024-09-12T03:11:32.310073+0000, chain.objs.size()=1 2024-09-12T01:29:15.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.659+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.yHixmwTKMjB_3p8iHg_sqVk10-Vt2GR_0 2024-09-12T01:29:15.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.660+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8918276608823503829', time=2024-09-12T03:11:32.981429+0000, chain.objs.size()=1 2024-09-12T01:29:15.660 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.660+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ULvHi-ILBLRARB2MnNc5b4XqU0mwif9_0 2024-09-12T01:29:15.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.660+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4633781532477208499', time=2024-09-12T03:11:33.304926+0000, chain.objs.size()=1 2024-09-12T01:29:15.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.660+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.VNi_iRacfgIHdo4UmM9jagtBBjsNqyY_0 2024-09-12T01:29:15.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.660+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13873231419889618931', time=2024-09-12T03:11:33.851657+0000, chain.objs.size()=1 2024-09-12T01:29:15.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.660+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.EbvFBbT67rmlUXGJjcFMcQfAn2Lio7W_0 2024-09-12T01:29:15.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.660+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3258133224732182717', time=2024-09-12T03:11:33.853655+0000, chain.objs.size()=1 2024-09-12T01:29:15.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.660+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.d5uOFrBr_qn6bx4n7qJ68Ck7tzOLP7J_0 2024-09-12T01:29:15.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.660+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17029854445702709622', time=2024-09-12T03:11:34.019765+0000, chain.objs.size()=1 2024-09-12T01:29:15.661 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.660+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ngBcjhqE5CFI0oIXhPHIEuQeCDU9lS2_0 2024-09-12T01:29:15.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.662+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5256229975378911882', time=2024-09-12T03:11:35.371222+0000, chain.objs.size()=1 2024-09-12T01:29:15.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.663+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.8FJASDdvhy-xhBSZ3s_u_JpKsXdo0eq_0 2024-09-12T01:29:15.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.663+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4538521302911889748', time=2024-09-12T03:11:35.509485+0000, chain.objs.size()=1 2024-09-12T01:29:15.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.663+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.WQEAL-I4dhLY6YnSHdy6jhJ7cK-OPpa_0 2024-09-12T01:29:15.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.663+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11729645943836633513', time=2024-09-12T03:11:35.660972+0000, chain.objs.size()=1 2024-09-12T01:29:15.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.663+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.HOTiY368J3SyAMDoMy1CnGZdA5T97Af_0 2024-09-12T01:29:15.663 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.663+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6921616748582460542', time=2024-09-12T03:11:36.109035+0000, chain.objs.size()=1 2024-09-12T01:29:15.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.663+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.SK16N--kBjNZBvyxH47iWDbDXXt_HJA_0 2024-09-12T01:29:15.664 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.664+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1139512203074318169', time=2024-09-12T03:11:36.664554+0000, chain.objs.size()=1 2024-09-12T01:29:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.664+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.onUIsT51EXKLD7SfWAoDEq9Gv2LIqlB_0 2024-09-12T01:29:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.664+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15602673258931528726', time=2024-09-12T03:11:36.732072+0000, chain.objs.size()=1 2024-09-12T01:29:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.664+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.4evKB5k-cFSWg7DSMTWAoI-nfS-Bq0f_0 2024-09-12T01:29:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.664+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5206162050294379254', time=2024-09-12T03:11:36.971442+0000, chain.objs.size()=1 2024-09-12T01:29:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.664+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.dWF3FkdNlgIHVwwe2LTpQeFicX3u6do_0 2024-09-12T01:29:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.664+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14869076620044594742', time=2024-09-12T03:11:37.226541+0000, chain.objs.size()=1 2024-09-12T01:29:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.664+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Dj9Dkodo3-dk_lO3AbMeFUjz6utKzss_0 2024-09-12T01:29:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.664+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17463067074982380012', time=2024-09-12T03:11:37.227580+0000, chain.objs.size()=1 2024-09-12T01:29:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.664+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.sEFoHhZh-7fK_q7ElTGhQUMU6voXzBK_0 2024-09-12T01:29:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.664+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1250361894349064511', time=2024-09-12T03:11:38.055288+0000, chain.objs.size()=1 2024-09-12T01:29:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.664+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.E1LLN3ain5IC5oIZgXkL87ESZpGG6zg_0 2024-09-12T01:29:15.665 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.664+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16646472017502425666', time=2024-09-12T03:11:38.804762+0000, chain.objs.size()=1 2024-09-12T01:29:15.666 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.664+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.N18ux4FnvlQkGndlZ2wn4Zdv874MRep_0 2024-09-12T01:29:15.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.667+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7252397896953650582', time=2024-09-12T03:11:39.506301+0000, chain.objs.size()=1 2024-09-12T01:29:15.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.667+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.dX10VqJ2BL1Riu5pDnVxWCkoxgrAb0K_0 2024-09-12T01:29:15.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.667+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8306847274216858676', time=2024-09-12T03:11:39.939840+0000, chain.objs.size()=1 2024-09-12T01:29:15.667 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.667+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Tte75kWr4PTV0yzzRg9uvHMHPKz4pxV_0 2024-09-12T01:29:15.668 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.668+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15841258124008936244', time=2024-09-12T03:11:41.039016+0000, chain.objs.size()=1 2024-09-12T01:29:15.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.668+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-29Mgh5mrwWFesYiZfqU6ILsA9wiCac_0 2024-09-12T01:29:15.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.668+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4969315546031284271', time=2024-09-12T03:11:41.427107+0000, chain.objs.size()=1 2024-09-12T01:29:15.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.668+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.nQ8dqFmqkK4ShkVvy8xx68PuCSb2WeW_0 2024-09-12T01:29:15.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.668+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4425348267404399153', time=2024-09-12T03:11:41.543901+0000, chain.objs.size()=1 2024-09-12T01:29:15.669 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.668+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.j5syj10wesk4Hs7kZSkefwoUiOn5gbr_0 2024-09-12T01:29:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.669+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1076695325867194568', time=2024-09-12T03:12:21.864993+0000, chain.objs.size()=1 2024-09-12T01:29:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.669+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.KYatkUxVzx2EyJBRQ8DxeL-IVeI8dNH_0 2024-09-12T01:29:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.669+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7265182205523699747', time=2024-09-12T03:12:22.181158+0000, chain.objs.size()=1 2024-09-12T01:29:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.669+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ruA52oGCsO_xcLmCBPzfOweKAotLScL_0 2024-09-12T01:29:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.669+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9421847198444006428', time=2024-09-12T03:12:22.351611+0000, chain.objs.size()=1 2024-09-12T01:29:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.669+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.e-l6dNchtSVRLbKVh6X8ZRxq2M9-ZpN_0 2024-09-12T01:29:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.669+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5508422900135183441', time=2024-09-12T03:12:22.469409+0000, chain.objs.size()=1 2024-09-12T01:29:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.669+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._NjM5eHmiazBiAqcpq8bGeTSNzgrh-C_0 2024-09-12T01:29:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.669+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17939676172226383091', time=2024-09-12T03:12:22.644968+0000, chain.objs.size()=1 2024-09-12T01:29:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.669+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.LsnMSCi0D_3yPzn1JwaG3rB4_4NSGOA_0 2024-09-12T01:29:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.669+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1867617679007610933', time=2024-09-12T03:12:22.823818+0000, chain.objs.size()=1 2024-09-12T01:29:15.670 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.669+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.dG6C-SwW1a6pLNln5g_7X3vdSjFV_n0_0 2024-09-12T01:29:15.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.669+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18251622212603280981', time=2024-09-12T03:12:23.894828+0000, chain.objs.size()=1 2024-09-12T01:29:15.671 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.669+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.W2WvXrK-fsyfFblRLSEjcUdesB3eQx9_0 2024-09-12T01:29:15.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.672+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11128212461476681173', time=2024-09-12T03:12:24.005446+0000, chain.objs.size()=1 2024-09-12T01:29:15.672 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.672+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.wUsUmZFqJ1P3kMK_CiHG7OO-alNhs6r_0 2024-09-12T01:29:15.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.672+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10134313884582432578', time=2024-09-12T03:12:24.045047+0000, chain.objs.size()=1 2024-09-12T01:29:15.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.672+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.8jzi_VOOluc561774Ahv24CdevotRnq_0 2024-09-12T01:29:15.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.673+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15996830843670427824', time=2024-09-12T03:12:24.134347+0000, chain.objs.size()=1 2024-09-12T01:29:15.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.673+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Thna6DV_Op8DEcHUoY2M9lAJGHHcGkj_0 2024-09-12T01:29:15.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.673+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16007717715330108479', time=2024-09-12T03:12:24.309472+0000, chain.objs.size()=1 2024-09-12T01:29:15.673 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.673+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.e2eiFn2QoFnUF-L1aQswvs9NbgaIb4J_0 2024-09-12T01:29:15.674 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.674+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2245150367513580835', time=2024-09-12T03:12:25.819349+0000, chain.objs.size()=1 2024-09-12T01:29:15.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.674+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Y46a0tLKTZsu6Wxc4nhIrV-IM21vd_A_0 2024-09-12T01:29:15.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.674+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9879214878460492498', time=2024-09-12T03:12:26.197106+0000, chain.objs.size()=1 2024-09-12T01:29:15.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.674+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.YzeJsU251YBZjkyYnRszZsMpdJj3gSe_0 2024-09-12T01:29:15.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.674+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17655268702695215333', time=2024-09-12T03:12:26.584467+0000, chain.objs.size()=1 2024-09-12T01:29:15.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.674+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.bIGFeRfYsQTCtOOeQKtNDIXmLFjvDUA_0 2024-09-12T01:29:15.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.674+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5893417987358247224', time=2024-09-12T03:12:27.450512+0000, chain.objs.size()=1 2024-09-12T01:29:15.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.674+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.KJSz0cT7Rjlg-_9jkCU36rqu44HbTwm_0 2024-09-12T01:29:15.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.674+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15790906234939469814', time=2024-09-12T03:12:27.770705+0000, chain.objs.size()=1 2024-09-12T01:29:15.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.674+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.VPuhs5vLjcULNyM-s9XFu8N-78c2Y9O_0 2024-09-12T01:29:15.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.674+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1668122946480893080', time=2024-09-12T03:12:28.131513+0000, chain.objs.size()=1 2024-09-12T01:29:15.675 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.674+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.B0xYV7AIxQJsqG5Y4tThUI1U0nq5I8x_0 2024-09-12T01:29:15.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.675+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.894619549340957609', time=2024-09-12T03:12:28.271358+0000, chain.objs.size()=1 2024-09-12T01:29:15.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.675+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.rHiQJTFF42AN5rPUBHEasDpgeC8Q50j_0 2024-09-12T01:29:15.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.675+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4459853510110153099', time=2024-09-12T03:12:29.057572+0000, chain.objs.size()=1 2024-09-12T01:29:15.676 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.675+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.sG0SKw4sR81omDt6x3K_qIojip6LQcq_0 2024-09-12T01:29:15.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.677+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1145935291029626393', time=2024-09-12T03:12:29.224093+0000, chain.objs.size()=1 2024-09-12T01:29:15.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.677+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.DDJhj5kdvj8Z3FyDBcNZFVK_h9PG-Ta_0 2024-09-12T01:29:15.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.677+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2824604779740876435', time=2024-09-12T03:12:29.289729+0000, chain.objs.size()=1 2024-09-12T01:29:15.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.677+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.n7MKldpkCkPcEYnKO568Clf0nlQt6Ou_0 2024-09-12T01:29:15.677 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.677+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3564409552525258802', time=2024-09-12T03:12:29.544621+0000, chain.objs.size()=1 2024-09-12T01:29:15.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.677+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.c8rrSMOxmwl2gBJowBrkJMImqqGPvxJ_0 2024-09-12T01:29:15.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.677+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9374122157698823094', time=2024-09-12T03:12:29.609080+0000, chain.objs.size()=1 2024-09-12T01:29:15.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.677+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.qEAhJWUwtwxco1oxrL1V7A-LC1a_hcR_0 2024-09-12T01:29:15.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.677+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17475655576608591478', time=2024-09-12T03:12:29.752347+0000, chain.objs.size()=1 2024-09-12T01:29:15.678 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.677+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.j2Mhms7hdur-PL2zXgS0gZvnbIVTspK_0 2024-09-12T01:29:15.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.678+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.975580030806455130', time=2024-09-12T03:12:30.573380+0000, chain.objs.size()=1 2024-09-12T01:29:15.679 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.678+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MQN6-DiB-BGe5je_1Rg0KTv5zBI4xi9_0 2024-09-12T01:29:15.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.680+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6361729385518888506', time=2024-09-12T03:12:30.574110+0000, chain.objs.size()=1 2024-09-12T01:29:15.680 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.680+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.JebPUjSDABitjgC9N8gHyb1a72acj-__0 2024-09-12T01:29:15.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.680+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4972804450429962404', time=2024-09-12T03:12:30.763576+0000, chain.objs.size()=1 2024-09-12T01:29:15.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.680+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.n5xGxzIfZHh32Q6lUyGSyoGJkNEVqoc_0 2024-09-12T01:29:15.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.680+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10531565841379252396', time=2024-09-12T03:12:30.956579+0000, chain.objs.size()=1 2024-09-12T01:29:15.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.680+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.YtZ42djXDArzsfcNXxPcRLDmpvOehf9_0 2024-09-12T01:29:15.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.680+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4766966027334684643', time=2024-09-12T03:12:31.971558+0000, chain.objs.size()=1 2024-09-12T01:29:15.681 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.680+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.PGOFisXOq30soehRSX9hj1z3nH2nVBc_0 2024-09-12T01:29:15.683 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.683+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/49569 2024-09-12T01:29:15.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=32, truncated=0, next_marker='' 2024-09-12T01:29:15.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16106587828732108311', time=2024-09-12T03:12:32.277449+0000, chain.objs.size()=1 2024-09-12T01:29:15.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.17stEiz6GWVTh-PSsw5tuuOOPn2aKv-_0 2024-09-12T01:29:15.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7407852806887791035', time=2024-09-12T03:12:32.303314+0000, chain.objs.size()=1 2024-09-12T01:29:15.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.9o2FmTg06aNI8uyVv5iXfLd7jSx5YJk_0 2024-09-12T01:29:15.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7539103608584750670', time=2024-09-12T03:12:32.304218+0000, chain.objs.size()=1 2024-09-12T01:29:15.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.iT13deJ2MR7vvEI69wu7WX1idRbIE4r_0 2024-09-12T01:29:15.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1798807005628268779', time=2024-09-12T03:12:32.962014+0000, chain.objs.size()=1 2024-09-12T01:29:15.687 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.SwQhONFBpvuTxC5ehndx57g-UNv84mZ_0 2024-09-12T01:29:15.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7393015715519604246', time=2024-09-12T03:12:33.200110+0000, chain.objs.size()=1 2024-09-12T01:29:15.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.pfm03M1oxWduvIvx2mvde7k1iLDqAfV_0 2024-09-12T01:29:15.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8538963670359385174', time=2024-09-12T03:12:33.215382+0000, chain.objs.size()=1 2024-09-12T01:29:15.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.bUIMjTm5f1hUsSvcsqcyNN-NrgMMz-D_0 2024-09-12T01:29:15.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17424744602976173316', time=2024-09-12T03:12:33.551580+0000, chain.objs.size()=1 2024-09-12T01:29:15.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.6Yq0Fp0o6AIod1RfZ2uJarHocQCDEQg_0 2024-09-12T01:29:15.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3124425242279230157', time=2024-09-12T03:12:33.552062+0000, chain.objs.size()=1 2024-09-12T01:29:15.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.pGaLcDPXKDp-l8MH-Xj5IL0wT9nlBD3_0 2024-09-12T01:29:15.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15750284316085576655', time=2024-09-12T03:12:33.826899+0000, chain.objs.size()=1 2024-09-12T01:29:15.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._gwk11wvQHKJ_nwoJY-_o6vrC7oQ7J1_0 2024-09-12T01:29:15.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8393307706207867899', time=2024-09-12T03:12:33.919096+0000, chain.objs.size()=1 2024-09-12T01:29:15.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.EOWU71RflN8IH8r7I18N02muyRgE_SV_0 2024-09-12T01:29:15.688 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9811008818801222935', time=2024-09-12T03:12:34.076196+0000, chain.objs.size()=1 2024-09-12T01:29:15.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.kWySi80lOsAeR7PrXwDdfptNr9gsS_4_0 2024-09-12T01:29:15.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15992961314143942712', time=2024-09-12T03:12:34.093496+0000, chain.objs.size()=1 2024-09-12T01:29:15.690 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.686+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gJentmNZZfXC_vME0umxiUT-pCZLtbb_0 2024-09-12T01:29:15.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7364917542563262791', time=2024-09-12T03:12:34.235699+0000, chain.objs.size()=1 2024-09-12T01:29:15.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.HeaO6SqkHo2B80beO3y7vIcV0Apg3Rq_0 2024-09-12T01:29:15.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2563447977638200690', time=2024-09-12T03:12:34.278137+0000, chain.objs.size()=1 2024-09-12T01:29:15.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.tQATF64M5jajd0cUiywO3oodSgXDXhF_0 2024-09-12T01:29:15.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11521878208481780169', time=2024-09-12T03:12:34.521930+0000, chain.objs.size()=1 2024-09-12T01:29:15.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.fm3HHDkJGI1b0oidiJgQwrbrOpnK1bb_0 2024-09-12T01:29:15.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8653547403209536405', time=2024-09-12T03:12:37.154643+0000, chain.objs.size()=1 2024-09-12T01:29:15.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.329__shadow_.e_hg7uOR26ZUte--e7FbLiWvnH7cx_f_0 2024-09-12T01:29:15.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5296289414471620310', time=2024-09-12T03:12:39.300416+0000, chain.objs.size()=1 2024-09-12T01:29:15.691 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.333__shadow_.aGCU0rBGn45tnv6-OMTICA7alXpwcFx_0 2024-09-12T01:29:15.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10813530230642418433', time=2024-09-12T03:12:39.460098+0000, chain.objs.size()=1 2024-09-12T01:29:15.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.333__shadow_.NIfc1oJWwSf7e37AqTz5_xYe69qsrQQ_0 2024-09-12T01:29:15.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18028509950850667413', time=2024-09-12T03:13:51.557464+0000, chain.objs.size()=1 2024-09-12T01:29:15.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.459__shadow_.mTHZBqtDQCxhhvSPf66qmuywkHZUW2c_0 2024-09-12T01:29:15.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7365083263025737154', time=2024-09-12T03:13:55.928706+0000, chain.objs.size()=1 2024-09-12T01:29:15.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.464__shadow_.XSrxWEq1zKCH7KGUiY3Bn7kmv1uOjy1_0 2024-09-12T01:29:15.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8971664780063620523', time=2024-09-12T03:15:50.743394+0000, chain.objs.size()=6 2024-09-12T01:29:15.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~BI9Q73ix-Hq_6Z09_oMVNTQZixMSkOa.1 2024-09-12T01:29:15.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.m9r8qW-Od-x_Hvd4al_BV9oLbNT38GV7.2 2024-09-12T01:29:15.692 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.690+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.aGmrWPXCTKolgn7ySwiIlpqGO0dlqltw.3 2024-09-12T01:29:15.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.694+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~BI9Q73ix-Hq_6Z09_oMVNTQZixMSkOa.4 2024-09-12T01:29:15.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.694+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~BI9Q73ix-Hq_6Z09_oMVNTQZixMSkOa.5 2024-09-12T01:29:15.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.694+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~BI9Q73ix-Hq_6Z09_oMVNTQZixMSkOa.6 2024-09-12T01:29:15.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.694+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7821824804925110214', time=2024-09-12T03:16:21.909887+0000, chain.objs.size()=4 2024-09-12T01:29:15.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.694+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.527__multipart_mymultipart.2~IiSFutNYzVW0-X7OXVsyh0Nu7mx-3g_.1 2024-09-12T01:29:15.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.694+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.527__multipart_mymultipart.2~IiSFutNYzVW0-X7OXVsyh0Nu7mx-3g_.2 2024-09-12T01:29:15.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.695+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.527__multipart_mymultipart.2~IiSFutNYzVW0-X7OXVsyh0Nu7mx-3g_.3 2024-09-12T01:29:15.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.695+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.527__multipart_mymultipart.2~IiSFutNYzVW0-X7OXVsyh0Nu7mx-3g_.4 2024-09-12T01:29:15.695 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.695+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15137848920466659644', time=2024-09-12T03:17:54.173486+0000, chain.objs.size()=1 2024-09-12T01:29:15.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.695+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:sIph7py8-86KSAXHkzkeJjjiv6XnJC0_.UMxMkTUbI0SU6o94o0szLpnFzuLwOZI_0 2024-09-12T01:29:15.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.695+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14926618742213726839', time=2024-09-12T03:17:56.045078+0000, chain.objs.size()=1 2024-09-12T01:29:15.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.695+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:rhawxxLw2EJ1426HAI-DORTTW1UGfDJ_.jgR0u-YcRYhFYT3Llsyu8IXjI9uYo7G_0 2024-09-12T01:29:15.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.695+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.342649672553010561', time=2024-09-12T03:18:04.772950+0000, chain.objs.size()=1 2024-09-12T01:29:15.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.695+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.574__shadow:az5M7d79S8NANmdYN-PJQq7izPKObwz_.dHW7IU32u8H91n-G9Qe4MGIZzrXsaet_0 2024-09-12T01:29:15.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.695+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2761529818076794941', time=2024-09-12T03:18:08.042199+0000, chain.objs.size()=1 2024-09-12T01:29:15.696 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.695+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.576__shadow:oKJeE0cLp3xeYlaadRCjj3-VHzWlRZn_.UyPiqqAxkz8VoSuoaeVjVeRQDPncO7i_0 2024-09-12T01:29:15.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.698+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2031008565196259898', time=2024-09-12T03:18:13.914459+0000, chain.objs.size()=1 2024-09-12T01:29:15.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.698+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:QhFiUKtrR4cmKc4UL8jVWs3IWB15u2X_.xiTbhf_5-IzWbdQElhmj_Vy8U6b-_Pr_0 2024-09-12T01:29:15.698 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.698+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4417292144942029844', time=2024-09-12T03:18:27.196127+0000, chain.objs.size()=1 2024-09-12T01:29:15.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.698+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:IEimLYECIsyjxcbTZ8rHSmN8.qF3JEj_.eStzX40BFSOG0P_F51nXG3D4FRpyWUB_0 2024-09-12T01:29:15.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.699+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11325190465207344864', time=2024-09-12T03:18:50.835894+0000, chain.objs.size()=1 2024-09-12T01:29:15.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.699+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.580__shadow:zPKrhd9DoCsp9n4S-M4DJRwb81BYH0S_.iZDundv4rNUADtWjJI9UMTqZpkGDDee_0 2024-09-12T01:29:15.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.699+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4942375818571892713', time=2024-09-12T03:22:56.597221+0000, chain.objs.size()=1 2024-09-12T01:29:15.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.699+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.628__shadow_.pQQZjaiFmoIPlUYOxmWg-kpjEKNpGaB_0 2024-09-12T01:29:15.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.699+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17236622100834035907', time=2024-09-12T03:23:02.142785+0000, chain.objs.size()=1 2024-09-12T01:29:15.699 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.699+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.637__shadow_.ILqP4Gi__Zg4GWY8cDnhLNLq4GUfldo_0 2024-09-12T01:29:15.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.699+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12667234765319276268', time=2024-09-12T03:23:59.528745+0000, chain.objs.size()=1 2024-09-12T01:29:15.700 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.699+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.696__shadow:Vax4LtBq09ZhjLbPmGUgr3Coo-a18fp_.GKO2gWINY0IYsFo0lNW_GBAbW21MIGr_0 2024-09-12T01:29:15.702 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.702+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.705 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.705+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:29:15.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.706+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.706 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.706+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.708 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46739' 2024-09-12T01:29:15.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12449104058220288855', time=2024-09-12T03:06:43.158584+0000, chain.objs.size()=1 2024-09-12T01:29:15.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.160__shadow_.Wv6kOR2kfTP-Bm5i_m2lXi16FNigZNJ_0 2024-09-12T01:29:15.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_NzuDwQPHJfYkWb6C_7E1fNQH4mlcElz', time=2024-09-12T03:06:43.291321+0000, chain.objs.size()=1 2024-09-12T01:29:15.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.160__shadow_.6PPeukjeBugFFLh21j4erp7FeKDjopT_0 2024-09-12T01:29:15.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5305917189435636217', time=2024-09-12T03:07:06.553960+0000, chain.objs.size()=1 2024-09-12T01:29:15.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.177__shadow_._nb8bk4cm0yByItVoT8g3YQld8XbFNO_0 2024-09-12T01:29:15.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10133927504153411559', time=2024-09-12T03:07:07.087545+0000, chain.objs.size()=1 2024-09-12T01:29:15.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.178__shadow_.x1MeWduR9PEoIQgYKu205Ym1sxfh0Id_0 2024-09-12T01:29:15.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16870488295340785438', time=2024-09-12T03:07:28.413423+0000, chain.objs.size()=1 2024-09-12T01:29:15.709 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.204__shadow_.mjMryV-s1QEOuy358xfy3mth9TamqIl_0 2024-09-12T01:29:15.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.439342070170519041', time=2024-09-12T03:08:54.203644+0000, chain.objs.size()=1 2024-09-12T01:29:15.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.230__shadow_.leAgpUhn5Qd9m_kdZI2AQcI-_2JH3ir_0 2024-09-12T01:29:15.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16592455416762195805', time=2024-09-12T03:09:05.353107+0000, chain.objs.size()=1 2024-09-12T01:29:15.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.246__shadow_.OC9N4lgcSlTj8r0po3UB35sz4wKGhJk_0 2024-09-12T01:29:15.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15575724391710209200', time=2024-09-12T03:09:56.283675+0000, chain.objs.size()=1 2024-09-12T01:29:15.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.GmqOXaygOJshWBwDgG9oeyv5Y3v9Msb_0 2024-09-12T01:29:15.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8238101292141179500', time=2024-09-12T03:09:56.604503+0000, chain.objs.size()=1 2024-09-12T01:29:15.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.G0_LO6xAXMOt0GoIjG2kvUGANa9Z_-Y_0 2024-09-12T01:29:15.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7581966109151413109', time=2024-09-12T03:09:56.605243+0000, chain.objs.size()=1 2024-09-12T01:29:15.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.OMLcBCjewbU8WasW9vx0chvgbYlaA7x_0 2024-09-12T01:29:15.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10680945947129086230', time=2024-09-12T03:09:56.929745+0000, chain.objs.size()=1 2024-09-12T01:29:15.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.F8jD6uAuHi5yWOkMdmuNnqHNkLWdFke_0 2024-09-12T01:29:15.710 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9361644318918438365', time=2024-09-12T03:09:56.950596+0000, chain.objs.size()=1 2024-09-12T01:29:15.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.707+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.F1fgdfVA54MIKYPiILGnZOiJFXxRj_a_0 2024-09-12T01:29:15.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.709+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13467548341953776072', time=2024-09-12T03:09:56.961496+0000, chain.objs.size()=1 2024-09-12T01:29:15.711 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.709+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.jVWZ9FNgkHf0lmTlqPvtq5LA7fwNZzk_0 2024-09-12T01:29:15.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.709+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12286636049613864793', time=2024-09-12T03:09:57.274067+0000, chain.objs.size()=1 2024-09-12T01:29:15.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.709+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.KmMB4ykjonAYwLYGfOb8d4FjZGENOCq_0 2024-09-12T01:29:15.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.710+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5457113361156157132', time=2024-09-12T03:09:57.931458+0000, chain.objs.size()=1 2024-09-12T01:29:15.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.710+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.HYkdfMKJnfacuqL2EvkgvWH7nvEIhrc_0 2024-09-12T01:29:15.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.711+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2881786093916365031', time=2024-09-12T03:09:57.932033+0000, chain.objs.size()=1 2024-09-12T01:29:15.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.711+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.4TY1_60rFLzT3KMFi4OqdQNpvGHzaR6_0 2024-09-12T01:29:15.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.711+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7381910030743749709', time=2024-09-12T03:09:58.099408+0000, chain.objs.size()=1 2024-09-12T01:29:15.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.711+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ahBFWsKN8jGam909bfa-Ji62c6funUh_0 2024-09-12T01:29:15.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.711+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12568193676521193582', time=2024-09-12T03:09:58.267942+0000, chain.objs.size()=1 2024-09-12T01:29:15.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.711+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.SoZi_fOZySNuIjknP9K4hciNpo2mLCz_0 2024-09-12T01:29:15.712 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.711+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16674142996783603225', time=2024-09-12T03:09:58.268706+0000, chain.objs.size()=1 2024-09-12T01:29:15.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.711+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._Gqb7EJyRQKZubwGh0MPdWf3KOwIfbl_0 2024-09-12T01:29:15.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.711+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13031801314244341042', time=2024-09-12T03:09:58.825272+0000, chain.objs.size()=1 2024-09-12T01:29:15.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.711+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.T-g_NcrCCTyIt33XZ7b02kpUwaEyeif_0 2024-09-12T01:29:15.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.711+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3685709893692634297', time=2024-09-12T03:09:58.978015+0000, chain.objs.size()=1 2024-09-12T01:29:15.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.711+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.bD98Dss4Md61_tbg1LIFz907lg1E3Sf_0 2024-09-12T01:29:15.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.712+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2129849627212148352', time=2024-09-12T03:09:59.763426+0000, chain.objs.size()=1 2024-09-12T01:29:15.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.712+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.GVM_6x6QsbvfxAwVIIF_OmZYaIMdrlJ_0 2024-09-12T01:29:15.713 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.712+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10569971745925558595', time=2024-09-12T03:09:59.764045+0000, chain.objs.size()=1 2024-09-12T01:29:15.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.712+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.6kObLLdO8ZMkRDT-Hs1W7_tP5VFzBv8_0 2024-09-12T01:29:15.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.713+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4779794920161638541', time=2024-09-12T03:09:59.879391+0000, chain.objs.size()=1 2024-09-12T01:29:15.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.713+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0zeutf-Txxe65pK7hpivX7bSgekdpQz_0 2024-09-12T01:29:15.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.713+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9789784494145308016', time=2024-09-12T03:10:00.088987+0000, chain.objs.size()=1 2024-09-12T01:29:15.714 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.713+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.B3WOSS03WUai1MuQ83JjNIqFtD8BgG__0 2024-09-12T01:29:15.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.714+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8731212478657189711', time=2024-09-12T03:10:00.122992+0000, chain.objs.size()=1 2024-09-12T01:29:15.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.714+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.zPnp-VjvuKHvoWqxUlixJ7SR7_KPDnX_0 2024-09-12T01:29:15.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.714+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6716404536619327999', time=2024-09-12T03:10:00.243733+0000, chain.objs.size()=1 2024-09-12T01:29:15.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.714+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.UzzPId6aYEOSZais5bt-do5oS2ilYdc_0 2024-09-12T01:29:15.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.714+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17720617289661536418', time=2024-09-12T03:10:00.451298+0000, chain.objs.size()=1 2024-09-12T01:29:15.715 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.714+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.i0yWwGj1Fui2z_uUCEj3rcJDqoucKaY_0 2024-09-12T01:29:15.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.714+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7204452518366988542', time=2024-09-12T03:10:01.065425+0000, chain.objs.size()=1 2024-09-12T01:29:15.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.714+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.DXlwPcvZ46GL3nvOzvp0ksQfIideTU3_0 2024-09-12T01:29:15.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.715+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13074195279604652494', time=2024-09-12T03:10:01.315012+0000, chain.objs.size()=1 2024-09-12T01:29:15.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.715+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.fUPEm-61pC2_Pqpsm4t7a5Fm85agNK2_0 2024-09-12T01:29:15.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.715+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1959467705770853094', time=2024-09-12T03:10:02.265022+0000, chain.objs.size()=1 2024-09-12T01:29:15.716 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.715+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9Ez8o0L5Ye8CAecsURYgVwztmxgiQ7u_0 2024-09-12T01:29:15.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.716+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2881805374175432065', time=2024-09-12T03:10:02.674879+0000, chain.objs.size()=1 2024-09-12T01:29:15.717 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.716+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.R-ay6JVj8CXZ3Hz2QmpHj-FfrHuDb7r_0 2024-09-12T01:29:15.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.718+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17383547224868357494', time=2024-09-12T03:10:04.340552+0000, chain.objs.size()=1 2024-09-12T01:29:15.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.718+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.VFK7y5WxvilSK1v3NcdOyqw9syRdL4Z_0 2024-09-12T01:29:15.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.718+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13171093637548106845', time=2024-09-12T03:10:04.355458+0000, chain.objs.size()=1 2024-09-12T01:29:15.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.718+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.T1GXcGr1pjyeR2HemjYD8p2JobLRyju_0 2024-09-12T01:29:15.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.718+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7269600745688528374', time=2024-09-12T03:10:04.613598+0000, chain.objs.size()=1 2024-09-12T01:29:15.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.718+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ywhOeOgBjgHic5VSdXHtYDHCr6pPDUH_0 2024-09-12T01:29:15.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.718+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8650642161516511395', time=2024-09-12T03:10:04.869180+0000, chain.objs.size()=1 2024-09-12T01:29:15.718 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.718+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.5U4xG4ztE8xr93x4d6P3OyZwAXfuWRq_0 2024-09-12T01:29:15.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.719+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13956893502022668025', time=2024-09-12T03:10:06.248512+0000, chain.objs.size()=1 2024-09-12T01:29:15.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.719+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.olaM3PK11waedP4RswjijlWqr-Cm35w_0 2024-09-12T01:29:15.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.719+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6447145114374474589', time=2024-09-12T03:10:06.657847+0000, chain.objs.size()=1 2024-09-12T01:29:15.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.719+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.nie6OQmsEWtzoSCdiFJGSaWoNQ5rUyR_0 2024-09-12T01:29:15.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.719+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13941255689340524332', time=2024-09-12T03:10:10.889202+0000, chain.objs.size()=1 2024-09-12T01:29:15.719 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.719+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.269__shadow_.FpD7xO6U2PHKHFJhiTiAesXWg-DJlTu_0 2024-09-12T01:29:15.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5021051735367826255', time=2024-09-12T03:10:17.843709+0000, chain.objs.size()=1 2024-09-12T01:29:15.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.280__shadow_.IaU88_uCrbD0mhZT4Itk4bGyPCsBeuM_0 2024-09-12T01:29:15.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11357096953189758666', time=2024-09-12T03:10:27.201798+0000, chain.objs.size()=1 2024-09-12T01:29:15.724 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.s03OsNpdsTzmoiuV53jwG4rRkSbubQU_0 2024-09-12T01:29:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5678649286708652915', time=2024-09-12T03:10:34.513814+0000, chain.objs.size()=1 2024-09-12T01:29:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.301__shadow_.D6PugvJ4m3atJhrGEJ_uAH1cSMEKJFS_0 2024-09-12T01:29:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14998105791720282822', time=2024-09-12T03:11:29.442499+0000, chain.objs.size()=1 2024-09-12T01:29:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fF1C3MCkOssHrVcMxZ-RE39R8F9tRoU_0 2024-09-12T01:29:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15869045197164619789', time=2024-09-12T03:11:29.632287+0000, chain.objs.size()=1 2024-09-12T01:29:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.0aOG8bOKhCYxYp7qExW_utIxL7Lyvfm_0 2024-09-12T01:29:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7255107035347792185', time=2024-09-12T03:11:29.714476+0000, chain.objs.size()=1 2024-09-12T01:29:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.WqLOaEwFIytnT15M4qY0ARZ1jbm_OGI_0 2024-09-12T01:29:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1093894023483696711', time=2024-09-12T03:11:29.898147+0000, chain.objs.size()=1 2024-09-12T01:29:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.w-Hha67ykFF6WG94JnYPAGmLVrNen9D_0 2024-09-12T01:29:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1015981603228850965', time=2024-09-12T03:11:30.428929+0000, chain.objs.size()=1 2024-09-12T01:29:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qIggQBoVmpNy9mkGqXPUCFnJSbRJhzX_0 2024-09-12T01:29:15.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17872129126768661515', time=2024-09-12T03:11:30.452556+0000, chain.objs.size()=1 2024-09-12T01:29:15.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.0_X3vA07TTup0HFitMwHT91zjYe06gF_0 2024-09-12T01:29:15.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13921381335009443309', time=2024-09-12T03:11:30.546711+0000, chain.objs.size()=1 2024-09-12T01:29:15.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.AJXIbq4Zax7WgsWqPu4CpmqErvJoc3h_0 2024-09-12T01:29:15.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13709387612970379129', time=2024-09-12T03:11:31.418161+0000, chain.objs.size()=1 2024-09-12T01:29:15.726 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.724+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fqTXXQKovob63bZejnI9S4aEkXvGRYo_0 2024-09-12T01:29:15.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.728+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3667217836010722985', time=2024-09-12T03:11:31.506969+0000, chain.objs.size()=1 2024-09-12T01:29:15.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MxHm-SHfM5RM7vSsj_Kp4FgYmRzGbMt_0 2024-09-12T01:29:15.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.728+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9260677222863960457', time=2024-09-12T03:11:31.626999+0000, chain.objs.size()=1 2024-09-12T01:29:15.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2DGSx0eOAbCBWZgU61XOCdacoe71oUa_0 2024-09-12T01:29:15.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.728+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2697010640882982387', time=2024-09-12T03:11:31.866922+0000, chain.objs.size()=1 2024-09-12T01:29:15.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.F8qXdLCQ9zfR7JvWU_UCY3zXwb3rGDY_0 2024-09-12T01:29:15.728 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.728+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3645204631358349004', time=2024-09-12T03:11:32.002574+0000, chain.objs.size()=1 2024-09-12T01:29:15.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.i5c4loHIND8YdxU8ct9EVbNBVn32oSn_0 2024-09-12T01:29:15.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.728+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8890493403316119331', time=2024-09-12T03:11:32.848764+0000, chain.objs.size()=1 2024-09-12T01:29:15.729 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.728+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.PCVQ1vsoL1boSW66WuqGCYfzfnJUJKC_0 2024-09-12T01:29:15.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.729+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13851762426212059204', time=2024-09-12T03:11:33.148100+0000, chain.objs.size()=1 2024-09-12T01:29:15.730 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.729+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.m3mnRlO43S6q0w9ubYSLFUN9oJkZ4zV_0 2024-09-12T01:29:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.729+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6064862942998849236', time=2024-09-12T03:11:33.375143+0000, chain.objs.size()=1 2024-09-12T01:29:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.729+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xRq75A6JkKkb5PRPAgjzKQH9AbHvc7M_0 2024-09-12T01:29:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.729+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12011184543889965528', time=2024-09-12T03:11:33.526790+0000, chain.objs.size()=1 2024-09-12T01:29:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.729+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.OM5ehR_BkHCa00bLH-z1p5F-Wl8gw2v_0 2024-09-12T01:29:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.729+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13518234311226231159', time=2024-09-12T03:11:33.576636+0000, chain.objs.size()=1 2024-09-12T01:29:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.729+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.VhvbFYfybTIG3xefuyQpBAjr-siXxtA_0 2024-09-12T01:29:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.729+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1376525774282671546', time=2024-09-12T03:11:33.669190+0000, chain.objs.size()=1 2024-09-12T01:29:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.729+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7zLrAUudc-G03-5ADATprTkOlw_QWm9_0 2024-09-12T01:29:15.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.729+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17478463098441003176', time=2024-09-12T03:11:36.072579+0000, chain.objs.size()=1 2024-09-12T01:29:15.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.729+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.e80T8vHrpwK1y0tNQjqs5RQ84cbmsrD_0 2024-09-12T01:29:15.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.730+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17470581799695511691', time=2024-09-12T03:11:36.351661+0000, chain.objs.size()=1 2024-09-12T01:29:15.732 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.730+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.v4kW491GrcrvLT6yoyi1_uA9dhmd0HW_0 2024-09-12T01:29:15.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.730+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9471023002447802019', time=2024-09-12T03:11:37.051567+0000, chain.objs.size()=1 2024-09-12T01:29:15.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.730+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.m9rZqb8F1-dA2H_4lNaPuj_56ZV7BDw_0 2024-09-12T01:29:15.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.730+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9513021383192134088', time=2024-09-12T03:11:37.608996+0000, chain.objs.size()=1 2024-09-12T01:29:15.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.730+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.C9kS_7-YLlDCcMJQ22FtgW4a8vFsXns_0 2024-09-12T01:29:15.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.731+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8643877485696647632', time=2024-09-12T03:11:37.654306+0000, chain.objs.size()=1 2024-09-12T01:29:15.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.731+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.F6ONZ5L1xcOZ6LGAT2SAWsV3PgpQRvo_0 2024-09-12T01:29:15.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.731+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6816186510926245650', time=2024-09-12T03:11:37.654972+0000, chain.objs.size()=1 2024-09-12T01:29:15.733 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.731+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_._6S2tLLVVoS7keWZJAxGLVrfYkVsYRs_0 2024-09-12T01:29:15.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14010600748880108265', time=2024-09-12T03:11:37.840153+0000, chain.objs.size()=1 2024-09-12T01:29:15.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.BsVNXaFCEbWiVWbrYTZjQ2Lx6J4UTz7_0 2024-09-12T01:29:15.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11275736978657457302', time=2024-09-12T03:11:38.367277+0000, chain.objs.size()=1 2024-09-12T01:29:15.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.J80sWnlQHGHt2LTziD6B6o5eJaUGcIf_0 2024-09-12T01:29:15.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.156680690307794165', time=2024-09-12T03:11:39.160375+0000, chain.objs.size()=1 2024-09-12T01:29:15.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.e08NgpfGOOYvW5ZFcsqVqN0bGNI2Eli_0 2024-09-12T01:29:15.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1936285348184270558', time=2024-09-12T03:11:39.198760+0000, chain.objs.size()=1 2024-09-12T01:29:15.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mQM8T5022Dfobl7ZQRyIpyn4YJTK7OE_0 2024-09-12T01:29:15.735 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15587554812791475336', time=2024-09-12T03:11:39.352772+0000, chain.objs.size()=1 2024-09-12T01:29:15.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ggsIXpcTOxOjufixxJ6J1X_vOckl4OX_0 2024-09-12T01:29:15.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3015272815102610483', time=2024-09-12T03:11:39.518798+0000, chain.objs.size()=1 2024-09-12T01:29:15.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-waiLyOlfCCJbFvdylVNwja0hVbv8lG_0 2024-09-12T01:29:15.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17120684270163180114', time=2024-09-12T03:11:39.745840+0000, chain.objs.size()=1 2024-09-12T01:29:15.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ucWgR3thBD_dISCi_ZKeEZ53CPzYNVV_0 2024-09-12T01:29:15.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3079350717460822432', time=2024-09-12T03:11:39.775623+0000, chain.objs.size()=1 2024-09-12T01:29:15.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.734+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.GQ29J8hdnSWjYgf322hQu83FUOVZx1c_0 2024-09-12T01:29:15.736 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.735+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10576836344941517254', time=2024-09-12T03:11:39.790281+0000, chain.objs.size()=1 2024-09-12T01:29:15.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.735+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tara68NEfwlnc3l9wH8R5bg6xNg9jdX_0 2024-09-12T01:29:15.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.735+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16979312689675692103', time=2024-09-12T03:11:40.223630+0000, chain.objs.size()=1 2024-09-12T01:29:15.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.735+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.dcZaffxYzRY54OFcuo9uQscQx0GTSn-_0 2024-09-12T01:29:15.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.735+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3096433177320288238', time=2024-09-12T03:11:41.371019+0000, chain.objs.size()=1 2024-09-12T01:29:15.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.735+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2izc3qjsM6rG-ZXPXtq09X0_rdJUdkB_0 2024-09-12T01:29:15.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.737+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3499651652738572603', time=2024-09-12T03:11:41.602674+0000, chain.objs.size()=1 2024-09-12T01:29:15.737 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.737+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7EXogFulyP-VtERB3BWvNEynnU4LY2X_0 2024-09-12T01:29:15.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.738+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15592520883966835361', time=2024-09-12T03:11:41.610404+0000, chain.objs.size()=1 2024-09-12T01:29:15.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.738+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.kwhnooXORSGyBT8OSsY0Dsql60W2AdA_0 2024-09-12T01:29:15.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.738+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2592062783368538973', time=2024-09-12T03:12:21.991856+0000, chain.objs.size()=1 2024-09-12T01:29:15.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.738+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3_ickJcjj5EU_BEcsTQV3uSBxSo_bMQ_0 2024-09-12T01:29:15.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.738+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1441579971149376320', time=2024-09-12T03:12:22.097291+0000, chain.objs.size()=1 2024-09-12T01:29:15.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.738+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.x7_I1zOp80P3amFV8JGFpC2B3DTSs-W_0 2024-09-12T01:29:15.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.738+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17100861528858003299', time=2024-09-12T03:12:22.189203+0000, chain.objs.size()=1 2024-09-12T01:29:15.739 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.738+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.N8LsWHKOLOIEPXtTJmwQV-E6hUzF_4L_0 2024-09-12T01:29:15.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.739+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7158813832294524581', time=2024-09-12T03:12:23.954562+0000, chain.objs.size()=1 2024-09-12T01:29:15.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.739+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.iRp8GKGJ9wLUbFw7uGiSbqESep9ilZx_0 2024-09-12T01:29:15.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.739+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7448185633525685434', time=2024-09-12T03:12:24.095025+0000, chain.objs.size()=1 2024-09-12T01:29:15.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.739+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.GwMW8FQ4rlR6X4_UfPB8mC_be8soYau_0 2024-09-12T01:29:15.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.739+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16271365562123386894', time=2024-09-12T03:12:25.798868+0000, chain.objs.size()=1 2024-09-12T01:29:15.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.739+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.jOFkiUP7ViAaMoNFwBX0Cs190Cibody_0 2024-09-12T01:29:15.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.739+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8440357139015502915', time=2024-09-12T03:12:25.902066+0000, chain.objs.size()=1 2024-09-12T01:29:15.740 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.739+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.dRAUhZ3MoDwjKxUbSmkNjmlVYNAIaAa_0 2024-09-12T01:29:15.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.739+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8680179295068975419', time=2024-09-12T03:12:26.134924+0000, chain.objs.size()=1 2024-09-12T01:29:15.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.739+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.doBnaNYXecbLCZwczWWzap0p67Hf8r2_0 2024-09-12T01:29:15.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.739+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8111574770248558908', time=2024-09-12T03:12:26.354846+0000, chain.objs.size()=1 2024-09-12T01:29:15.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.739+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.u41tYnhDPSoVd4At69rpen0CSfdN2Et_0 2024-09-12T01:29:15.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.739+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.538318330224909757', time=2024-09-12T03:12:28.253277+0000, chain.objs.size()=1 2024-09-12T01:29:15.741 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.740+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.y9it9vFT3hIzyDyyPRoczfx6B4MtWeM_0 2024-09-12T01:29:15.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.742+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3126237633876658961', time=2024-09-12T03:12:29.063715+0000, chain.objs.size()=1 2024-09-12T01:29:15.742 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.742+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ISdMJNGrJBsQau4mYdNn-g1spUz_jRE_0 2024-09-12T01:29:15.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15880397932540104705', time=2024-09-12T03:12:29.952204+0000, chain.objs.size()=1 2024-09-12T01:29:15.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1E7MU-MVAIACPxrRaQ5VCave8MOjedi_0 2024-09-12T01:29:15.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2493181056284089317', time=2024-09-12T03:12:30.394951+0000, chain.objs.size()=1 2024-09-12T01:29:15.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.GNVfKYRCuBs6Dh7LAntO5SJF4mcFPEi_0 2024-09-12T01:29:15.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16918640834706163382', time=2024-09-12T03:12:30.569210+0000, chain.objs.size()=1 2024-09-12T01:29:15.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.g2pyS3-YQ-848Gn-7Rvl7PRqPVdw2ND_0 2024-09-12T01:29:15.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13546936438619989328', time=2024-09-12T03:12:30.764723+0000, chain.objs.size()=1 2024-09-12T01:29:15.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Hp3g4lYOhyiLbGfnZ2G5eUDfv_Ow1UT_0 2024-09-12T01:29:15.746 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6994721233152803824', time=2024-09-12T03:12:30.784603+0000, chain.objs.size()=1 2024-09-12T01:29:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.BWp5JLr1UVWT_ntUH1dFdR4QPrxeGT7_0 2024-09-12T01:29:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15068111903439361445', time=2024-09-12T03:12:30.785361+0000, chain.objs.size()=1 2024-09-12T01:29:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gB8O87UrYTEAaCP9pzD-yzqDM5bPqmV_0 2024-09-12T01:29:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3257382651848804269', time=2024-09-12T03:12:30.939337+0000, chain.objs.size()=1 2024-09-12T01:29:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.qRUEAjAfJHy62fQ4oH1cpm0StiAh9eF_0 2024-09-12T01:29:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10708595893790827107', time=2024-09-12T03:12:31.347089+0000, chain.objs.size()=1 2024-09-12T01:29:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.OY7suP2ssOBqgH7oPAt_fNTL97u9Z5o_0 2024-09-12T01:29:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13732138619320920761', time=2024-09-12T03:12:31.347777+0000, chain.objs.size()=1 2024-09-12T01:29:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.AinlUf8q4ePsh_y7gE9W244ciXpZIZB_0 2024-09-12T01:29:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13100272203659491371', time=2024-09-12T03:12:32.472835+0000, chain.objs.size()=1 2024-09-12T01:29:15.747 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.745+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.A26vzvDJozJ0JXWaMuR-C4E7xHlSbC0_0 2024-09-12T01:29:15.750 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.750+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/46739 2024-09-12T01:29:15.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-12T01:29:15.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12191193619667628970', time=2024-09-12T03:12:32.622184+0000, chain.objs.size()=1 2024-09-12T01:29:15.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ogqPhLgZGTiDGVUWWgtwD3vW4KMnJ2d_0 2024-09-12T01:29:15.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17482993819734495617', time=2024-09-12T03:12:32.736070+0000, chain.objs.size()=1 2024-09-12T01:29:15.753 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.szh0p5bO1DABSEybzP1C9KHpZCI5Rn__0 2024-09-12T01:29:15.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16855350742889201707', time=2024-09-12T03:12:32.971637+0000, chain.objs.size()=1 2024-09-12T01:29:15.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.q3yUmIgngsgONonknxDwxkIUj3ibGWK_0 2024-09-12T01:29:15.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7870005420711410680', time=2024-09-12T03:12:33.168455+0000, chain.objs.size()=1 2024-09-12T01:29:15.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.fWkgFEngPvgBLjEJPH_UgEJ_a3VVWde_0 2024-09-12T01:29:15.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1921229188147355980', time=2024-09-12T03:12:33.922865+0000, chain.objs.size()=1 2024-09-12T01:29:15.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.D76fnEfWmafUY1HuOCyheb1uMo7mJE__0 2024-09-12T01:29:15.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15986342550242358034', time=2024-09-12T03:12:36.594007+0000, chain.objs.size()=1 2024-09-12T01:29:15.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.328__shadow_.TIi-zCx-xEDzMWDK7kXHiXK9TAhfLjg_0 2024-09-12T01:29:15.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6476649462037505856', time=2024-09-12T03:12:43.929885+0000, chain.objs.size()=1 2024-09-12T01:29:15.754 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.341__shadow_.Zfr_dbRS_kRVihXem4rsYWBBPqxw2G2_0 2024-09-12T01:29:15.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9034617087239328922', time=2024-09-12T03:13:06.153791+0000, chain.objs.size()=1 2024-09-12T01:29:15.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.383__shadow_.hhghwMD0xVCcEf7SFuDv-4qbBQ1bley_0 2024-09-12T01:29:15.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15009428932392008139', time=2024-09-12T03:13:45.032198+0000, chain.objs.size()=1 2024-09-12T01:29:15.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.450__shadow_.RFQUaeEcAF2v391SOrIAzgAv8pPjxKz_0 2024-09-12T01:29:15.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4642863105733456609', time=2024-09-12T03:14:05.129704+0000, chain.objs.size()=1 2024-09-12T01:29:15.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.483__shadow_.Pi9MrxdbOdqZ4Fpo54mLHQVCyAZcPo1_0 2024-09-12T01:29:15.755 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8629366189474701826', time=2024-09-12T03:14:05.139228+0000, chain.objs.size()=1 2024-09-12T01:29:15.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.483__shadow_.6SFpmObV94VM-2-YL4XanRYUTILMBfX_0 2024-09-12T01:29:15.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6544998429261920757', time=2024-09-12T03:14:15.063207+0000, chain.objs.size()=1 2024-09-12T01:29:15.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.753+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.496__shadow_.U5tHPx2JEnXCz3tJhMUIGe8Dayc6ox1_0 2024-09-12T01:29:15.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.755+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1592333459273999462', time=2024-09-12T03:14:29.473025+0000, chain.objs.size()=6 2024-09-12T01:29:15.756 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.755+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.1 2024-09-12T01:29:15.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.755+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.2 2024-09-12T01:29:15.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.756+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.3 2024-09-12T01:29:15.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.756+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.4 2024-09-12T01:29:15.757 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.756+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.5 2024-09-12T01:29:15.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.757+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.6 2024-09-12T01:29:15.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.757+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9583573149006348187', time=2024-09-12T03:14:30.611734+0000, chain.objs.size()=1 2024-09-12T01:29:15.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.757+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.511__multipart_mymultipart.2~_rDIcIcYnZs841o-6Pw4qOlK4D1y8Nd.1 2024-09-12T01:29:15.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.757+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1227487943597571823', time=2024-09-12T03:14:40.463454+0000, chain.objs.size()=2 2024-09-12T01:29:15.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.757+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.517__shadow_.CAYS9w6fqxrICr5xiOVw4bZV5QKeihC_0 2024-09-12T01:29:15.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.757+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.517__shadow_.CAYS9w6fqxrICr5xiOVw4bZV5QKeihC_1 2024-09-12T01:29:15.758 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.757+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18160642206993630840', time=2024-09-12T03:15:02.586115+0000, chain.objs.size()=3 2024-09-12T01:29:15.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.757+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.521__multipart_mymultipart.2~cBTKddl8jibbVc96ZslNpMoJCThniWd.1 2024-09-12T01:29:15.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.757+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.521__multipart_mymultipart.2~cBTKddl8jibbVc96ZslNpMoJCThniWd.2 2024-09-12T01:29:15.759 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.759+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.521__multipart_mymultipart.2~cBTKddl8jibbVc96ZslNpMoJCThniWd.3 2024-09-12T01:29:15.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.760+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6088195166052044830', time=2024-09-12T03:16:52.866516+0000, chain.objs.size()=1 2024-09-12T01:29:15.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.760+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.536__multipart_mymultipart.2~sxQSiPkPaxx2nndB7MSoDtef_Oqh0jr.1 2024-09-12T01:29:15.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9260512634134241631', time=2024-09-12T03:17:15.580399+0000, chain.objs.size()=2 2024-09-12T01:29:15.761 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.552__shadow_.KO-GngN3OnZoQZorlLUIie1QB2fbMK5_0 2024-09-12T01:29:15.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.552__shadow_.KO-GngN3OnZoQZorlLUIie1QB2fbMK5_1 2024-09-12T01:29:15.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14541462128596573402', time=2024-09-12T03:17:47.833822+0000, chain.objs.size()=1 2024-09-12T01:29:15.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:N3iJLQUZcN79qORbkxj8arZIbO-unI5_.UgE-sEFaK7uccKeKfulBzr7fnZme76F_0 2024-09-12T01:29:15.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2191562102918739060', time=2024-09-12T03:17:54.426542+0000, chain.objs.size()=1 2024-09-12T01:29:15.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:jqaNQ40vQfpJPRPRLerdt0hz2pkq-xZ_.AAbXeTd0KtrSlbquaP9n1o8jdd-Xqw2_0 2024-09-12T01:29:15.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9465950365857462775', time=2024-09-12T03:17:59.097930+0000, chain.objs.size()=1 2024-09-12T01:29:15.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.572__shadow_.wGDhbwvsr-qTyUPJWrKdGvae1YxFb6v_0 2024-09-12T01:29:15.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9172275783325875000', time=2024-09-12T03:18:00.097279+0000, chain.objs.size()=1 2024-09-12T01:29:15.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.573__shadow_.vs28S1VwCKrglU2lOyofRGJt_rBIFQz_0 2024-09-12T01:29:15.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12033717520962015429', time=2024-09-12T03:18:09.415362+0000, chain.objs.size()=1 2024-09-12T01:29:15.762 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.576__shadow:8pgHUI7.Pcyi39v6n0cegRpb9-UFUaO_.VXZY77Lyze5c5iMsyDnYGCGdpjml64o_0 2024-09-12T01:29:15.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9029216907437363147', time=2024-09-12T03:18:55.427426+0000, chain.objs.size()=1 2024-09-12T01:29:15.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.586__shadow:43XvDfj5mTifua8Im3Scx4oaBoCZ4Qe_._hUfJQXA7Q729rb1F6RkPJJFYGRpwH-_0 2024-09-12T01:29:15.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11951981506215374241', time=2024-09-12T03:19:04.228875+0000, chain.objs.size()=1 2024-09-12T01:29:15.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.761+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.602__shadow_.Juwf1VIPhTYfgowTPFqKkg9eunHTbbQ_0 2024-09-12T01:29:15.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.762+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14569934396131844263', time=2024-09-12T03:23:03.854912+0000, chain.objs.size()=1 2024-09-12T01:29:15.763 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.762+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.640__shadow_.lparQbGr6h9Gl3tVMAGhOsUaDJAZ_xw_0 2024-09-12T01:29:15.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.763+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12013423809184957119', time=2024-09-12T03:23:39.888713+0000, chain.objs.size()=6 2024-09-12T01:29:15.764 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.764+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.661__multipart_baz.2~PBDFCir-uDyq-Bq3LWG8FO3Udm6hztn.1 2024-09-12T01:29:15.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.766+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.661__multipart_baz.2~PBDFCir-uDyq-Bq3LWG8FO3Udm6hztn.2 2024-09-12T01:29:15.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.766+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.661__multipart_baz.2~PBDFCir-uDyq-Bq3LWG8FO3Udm6hztn.3 2024-09-12T01:29:15.766 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.766+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.661__multipart_baz.2~PBDFCir-uDyq-Bq3LWG8FO3Udm6hztn.4 2024-09-12T01:29:15.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.766+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.661__multipart_baz.2~PBDFCir-uDyq-Bq3LWG8FO3Udm6hztn.5 2024-09-12T01:29:15.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.766+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.661__multipart_baz.2~PBDFCir-uDyq-Bq3LWG8FO3Udm6hztn.6 2024-09-12T01:29:15.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.766+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11146336169143358048', time=2024-09-12T03:24:52.516442+0000, chain.objs.size()=1 2024-09-12T01:29:15.767 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.766+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.741__shadow_.freCd2yj5uGRe5ruGOlWHMnl5VwCRZ0_0 2024-09-12T01:29:15.771 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.771+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.774 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.774+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:29:15.775 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.775+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.776 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.776+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47612' 2024-09-12T01:29:15.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6028616728118231907', time=2024-09-12T03:08:54.203859+0000, chain.objs.size()=1 2024-09-12T01:29:15.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.230__shadow_.jBbFP610FbX6LyRbJTdGFthPyJFRX1h_0 2024-09-12T01:29:15.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14204235519610355784', time=2024-09-12T03:09:14.927090+0000, chain.objs.size()=1 2024-09-12T01:29:15.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.261__shadow_.5Tz0BYzFQslFrBRgA56-7Jo0Y86sFwz_0 2024-09-12T01:29:15.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14998113795454471153', time=2024-09-12T03:09:54.320402+0000, chain.objs.size()=1 2024-09-12T01:29:15.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.kwzmmVHtHlYbsYc2r9sXLwLC9SsBAmR_0 2024-09-12T01:29:15.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9942876382628334588', time=2024-09-12T03:09:54.983671+0000, chain.objs.size()=1 2024-09-12T01:29:15.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.E83jphYG5ewrkCIAui7WHTcBUzJkay9_0 2024-09-12T01:29:15.778 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9166483250896128413', time=2024-09-12T03:09:55.032063+0000, chain.objs.size()=1 2024-09-12T01:29:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.hPASnXJJAoCD4aGGKDTqZskooVks67m_0 2024-09-12T01:29:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8203737458045271504', time=2024-09-12T03:09:55.327850+0000, chain.objs.size()=1 2024-09-12T01:29:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Qr1edqmMEQja_lQeq-DJP5aoBRD-yAX_0 2024-09-12T01:29:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9190728331294452018', time=2024-09-12T03:09:56.101400+0000, chain.objs.size()=1 2024-09-12T01:29:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.M21W4ziB91jtD1T1zRUBuc__8AFtfAS_0 2024-09-12T01:29:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7399198405831668679', time=2024-09-12T03:09:58.025216+0000, chain.objs.size()=1 2024-09-12T01:29:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.We-W_nHe_J0EnJVrP2gTMf_cdHdkDKs_0 2024-09-12T01:29:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15575657909391185226', time=2024-09-12T03:09:58.271652+0000, chain.objs.size()=1 2024-09-12T01:29:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.C_Sq8Ye4ng68NbTMeHztAO7DWjLQ496_0 2024-09-12T01:29:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3083111171144298768', time=2024-09-12T03:09:58.753637+0000, chain.objs.size()=1 2024-09-12T01:29:15.779 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.CVQgfHRZwCftRaOqYFRMklFX0EgPhFO_0 2024-09-12T01:29:15.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.778142026036207062', time=2024-09-12T03:09:58.754392+0000, chain.objs.size()=1 2024-09-12T01:29:15.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.k8FpS-xN82q71mD4rzyzb3Htf8wyv2I_0 2024-09-12T01:29:15.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18360211618848601768', time=2024-09-12T03:09:58.928471+0000, chain.objs.size()=1 2024-09-12T01:29:15.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.777+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.rbzXEvwpR7-o-breFud_bzqAUsGxEHW_0 2024-09-12T01:29:15.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.780+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1802895990373563220', time=2024-09-12T03:09:58.929252+0000, chain.objs.size()=1 2024-09-12T01:29:15.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.780+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.fhtFW_XzvoXhoQq1Qj2SE8iwl_TNk7r_0 2024-09-12T01:29:15.780 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.780+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14029274755685400455', time=2024-09-12T03:10:00.096139+0000, chain.objs.size()=1 2024-09-12T01:29:15.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.780+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8nNVCyZX8oLA9cLQw2upiGl-KZqnAPo_0 2024-09-12T01:29:15.781 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15940995541976438245', time=2024-09-12T03:10:01.262512+0000, chain.objs.size()=1 2024-09-12T01:29:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.X7O6Htm9zCuONOlmkqJ1C_WWBYvg2x-_0 2024-09-12T01:29:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5359289084769819624', time=2024-09-12T03:10:01.581931+0000, chain.objs.size()=1 2024-09-12T01:29:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.qcYE20BDJwzKiAAp9GDa2dI3CXmmLMC_0 2024-09-12T01:29:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8129929289116440576', time=2024-09-12T03:10:01.871017+0000, chain.objs.size()=1 2024-09-12T01:29:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.W3akEFh4ZPa2jrTYICHQtxM_L3FItFT_0 2024-09-12T01:29:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3007300778020478389', time=2024-09-12T03:10:02.022047+0000, chain.objs.size()=1 2024-09-12T01:29:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.YI1WsUT5TDYqMgV03BP0Mda6UKiU_lc_0 2024-09-12T01:29:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17460344334320369107', time=2024-09-12T03:10:02.100255+0000, chain.objs.size()=1 2024-09-12T01:29:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.LfhCnYX3JIlDyFst4VAyrDBWU7dZI4e_0 2024-09-12T01:29:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13040712253557095131', time=2024-09-12T03:10:02.234307+0000, chain.objs.size()=1 2024-09-12T01:29:15.782 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.TYNqUwDgN9oW13CIe7P20FbHWlJic-a_0 2024-09-12T01:29:15.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1462510558545829446', time=2024-09-12T03:10:02.274856+0000, chain.objs.size()=1 2024-09-12T01:29:15.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.tCronmrLxdgF7VVoPRziBIiv4NCBU3c_0 2024-09-12T01:29:15.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14854498854388627680', time=2024-09-12T03:10:03.542433+0000, chain.objs.size()=1 2024-09-12T01:29:15.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.24ZwvpAUz70R4i9k155MARidJo3xkNX_0 2024-09-12T01:29:15.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11810782612681813319', time=2024-09-12T03:10:03.675660+0000, chain.objs.size()=1 2024-09-12T01:29:15.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.781+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.IB6JmLPxH0Csi7LWM_D8o5TwzJBvnYS_0 2024-09-12T01:29:15.783 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.783+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15634450213981601668', time=2024-09-12T03:10:03.676469+0000, chain.objs.size()=1 2024-09-12T01:29:15.784 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.783+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0td1siIVG_pXj3y1oR5BkzrkqHnyf57_0 2024-09-12T01:29:15.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.784+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16074947757508426848', time=2024-09-12T03:10:03.845699+0000, chain.objs.size()=1 2024-09-12T01:29:15.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.784+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0QK_ouYYw_htf1CCdRxEtb2QLNnVGdq_0 2024-09-12T01:29:15.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.784+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17310560930132945520', time=2024-09-12T03:10:04.205359+0000, chain.objs.size()=1 2024-09-12T01:29:15.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.784+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.S7CeNiBSsaKRMyvibPO1xWX-a5sgUOO_0 2024-09-12T01:29:15.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.784+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6468892696843300647', time=2024-09-12T03:10:05.728840+0000, chain.objs.size()=1 2024-09-12T01:29:15.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.784+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.BOlTpxlkqkPOA1R4i2hQgYMiuMmNPpO_0 2024-09-12T01:29:15.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.785+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3564278853500171963', time=2024-09-12T03:10:15.144515+0000, chain.objs.size()=1 2024-09-12T01:29:15.785 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.785+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.276__shadow_.X-y8mrrbSY50mYiJM3J8RTzsYW7UMk__0 2024-09-12T01:29:15.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.785+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3176783646249574326', time=2024-09-12T03:10:19.762549+0000, chain.objs.size()=1 2024-09-12T01:29:15.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.785+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.283__shadow_.7R1ewqENG2lP0wH6Gt1MCjQ_X_GAZ8d_0 2024-09-12T01:29:15.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.785+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.480761145487617124', time=2024-09-12T03:10:19.765157+0000, chain.objs.size()=1 2024-09-12T01:29:15.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.785+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.283__shadow_.ySOKNmdDNGkhtl4UokZRV5Iju8bIv4e_0 2024-09-12T01:29:15.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.785+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6731457584928086180', time=2024-09-12T03:10:29.020515+0000, chain.objs.size()=1 2024-09-12T01:29:15.786 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.785+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.QoyHtj5D76NWqbx4QPFTim1yQP8QKid_0 2024-09-12T01:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.787+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15435727155677713441', time=2024-09-12T03:10:29.105504+0000, chain.objs.size()=1 2024-09-12T01:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.787+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.gyYAWklIW71l1_0CcBfkNbNMnqQm139_0 2024-09-12T01:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.787+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1193820831663666041', time=2024-09-12T03:10:29.106435+0000, chain.objs.size()=1 2024-09-12T01:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.787+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.HTduz-onKf_xwX2fkcjDrFyDKR691EV_0 2024-09-12T01:29:15.787 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.787+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6793543985561070507', time=2024-09-12T03:10:29.200671+0000, chain.objs.size()=1 2024-09-12T01:29:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.787+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.WNXsyilpAhWEEKz61CUfbG0jmqcnh-a_0 2024-09-12T01:29:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.787+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8200477958235001449', time=2024-09-12T03:10:29.873931+0000, chain.objs.size()=1 2024-09-12T01:29:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.787+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.294__shadow_.kZUAw-K0SRKCogbSTcrlGQzia2GnnTy_0 2024-09-12T01:29:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.787+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18368132526092448385', time=2024-09-12T03:10:33.226288+0000, chain.objs.size()=1 2024-09-12T01:29:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.787+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.299__shadow_.UaZFPP5MMQNexavdE-pPNnVW5o37HPZ_0 2024-09-12T01:29:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.787+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3435712154637072857', time=2024-09-12T03:10:35.837767+0000, chain.objs.size()=1 2024-09-12T01:29:15.788 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.787+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.303__shadow_.G07Gu4iVlynQBnBAHNnc2hG2qwZeQEM_0 2024-09-12T01:29:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.789+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5227485402638700168', time=2024-09-12T03:10:36.474045+0000, chain.objs.size()=1 2024-09-12T01:29:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.789+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.304__shadow_._euVDErsOpuG4z4QkSJ_-7IDy8xnOos_0 2024-09-12T01:29:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.789+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8311521661143173170', time=2024-09-12T03:11:29.425260+0000, chain.objs.size()=1 2024-09-12T01:29:15.789 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.789+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.EbhlmL0iyrL5NDY1dTqSsYkOxXNHbCt_0 2024-09-12T01:29:15.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.791+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.835808226486529399', time=2024-09-12T03:11:29.805529+0000, chain.objs.size()=1 2024-09-12T01:29:15.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.791+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.0u2hA7nh_KNAXku2c-vCZ-SGsa-wOak_0 2024-09-12T01:29:15.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.791+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3061685194048329890', time=2024-09-12T03:11:30.026644+0000, chain.objs.size()=1 2024-09-12T01:29:15.791 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.791+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1HjvTsunbCl3JP0TGLzqihEkiBrC9tU_0 2024-09-12T01:29:15.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.791+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2130392708601741134', time=2024-09-12T03:11:30.069318+0000, chain.objs.size()=1 2024-09-12T01:29:15.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.791+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ZStC-mn5LH8DNmwI0o1BCvt33Nxy3-7_0 2024-09-12T01:29:15.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.791+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5548749000801659044', time=2024-09-12T03:11:30.200428+0000, chain.objs.size()=1 2024-09-12T01:29:15.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.791+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qQKI3DMIts3X6EMgBgU0lxe2gwMh48A_0 2024-09-12T01:29:15.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.791+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1794808961084674335', time=2024-09-12T03:11:30.280766+0000, chain.objs.size()=1 2024-09-12T01:29:15.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.791+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.vd0eSK7-MJ1B0riYzOg1rrfulhe6W65_0 2024-09-12T01:29:15.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.791+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18442922884418532429', time=2024-09-12T03:11:30.332712+0000, chain.objs.size()=1 2024-09-12T01:29:15.792 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.791+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xK7nNtYNKgzdz5ctMUhQNsLNAEeNBfX_0 2024-09-12T01:29:15.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.792+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17728093771686601073', time=2024-09-12T03:11:32.329648+0000, chain.objs.size()=1 2024-09-12T01:29:15.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.792+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.doiCk7Fgkp18tLMAfzGMAG8uApasocv_0 2024-09-12T01:29:15.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.792+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14007519749307508376', time=2024-09-12T03:11:33.498640+0000, chain.objs.size()=1 2024-09-12T01:29:15.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.792+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.DyNkMhDnSxGKAk1H-KxS0dfwTMWFUy3_0 2024-09-12T01:29:15.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.792+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8835567980384129452', time=2024-09-12T03:11:34.711617+0000, chain.objs.size()=1 2024-09-12T01:29:15.793 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.792+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.wfxBUR3KI7CG3raATkd1xx9eRfZ-iAU_0 2024-09-12T01:29:15.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.793+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6924869827366376127', time=2024-09-12T03:11:35.191236+0000, chain.objs.size()=1 2024-09-12T01:29:15.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.793+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.h9UhAWEdQbWxlG9SdKfo_d-f5XnNE39_0 2024-09-12T01:29:15.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.793+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3236412934846597030', time=2024-09-12T03:11:35.295897+0000, chain.objs.size()=1 2024-09-12T01:29:15.794 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.793+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.DWAGfoGYFpg3XLiZqHCCsOfKmFA_uJH_0 2024-09-12T01:29:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.795+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6177186921252169997', time=2024-09-12T03:11:35.333406+0000, chain.objs.size()=1 2024-09-12T01:29:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.795+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.LXy9BMFd6s_LHwRBoAOLc991M5gF3vq_0 2024-09-12T01:29:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.795+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2661828033584292763', time=2024-09-12T03:11:36.224605+0000, chain.objs.size()=1 2024-09-12T01:29:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.795+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ACbV-Ukf7X64W8t9h9IjDWiQcE_k26v_0 2024-09-12T01:29:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.795+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15355621529717592048', time=2024-09-12T03:11:36.237747+0000, chain.objs.size()=1 2024-09-12T01:29:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.795+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.kZmDXlGy5JnVr7_nheA2aJZ2Vv_7NO5_0 2024-09-12T01:29:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.795+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16140072800415076092', time=2024-09-12T03:11:36.658137+0000, chain.objs.size()=1 2024-09-12T01:29:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.795+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Vdibd1u3JrTOXwtBfOm-G-fUJRAsDrw_0 2024-09-12T01:29:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.795+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17747693795719797258', time=2024-09-12T03:11:36.949369+0000, chain.objs.size()=1 2024-09-12T01:29:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.795+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5EfOwgApcyEK2gPg962JO5Y7yErj_AT_0 2024-09-12T01:29:15.796 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.795+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16105461211339389133', time=2024-09-12T03:11:37.809296+0000, chain.objs.size()=1 2024-09-12T01:29:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.795+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tUgegX8z8LyF9nhp5iUZdnrZMKI77zJ_0 2024-09-12T01:29:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.796+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1798239887266105568', time=2024-09-12T03:11:39.350863+0000, chain.objs.size()=1 2024-09-12T01:29:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.796+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ydkNr-InsQLiopgo773-kk2CAPAX69I_0 2024-09-12T01:29:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.796+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8162882763027259057', time=2024-09-12T03:11:40.061289+0000, chain.objs.size()=1 2024-09-12T01:29:15.797 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.796+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.bD_KidnFcd1suuVJaKhY2scLRpxiIO__0 2024-09-12T01:29:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.798+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16303546792723772510', time=2024-09-12T03:11:40.164490+0000, chain.objs.size()=1 2024-09-12T01:29:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.798+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.rd5B3q3WGCQYD7lKokJIGxqrEA2U0-__0 2024-09-12T01:29:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.798+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13545386898930540883', time=2024-09-12T03:11:40.695897+0000, chain.objs.size()=1 2024-09-12T01:29:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.798+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.HVPXPDbov8reKAchnXO_cQ_Ry50QrC5_0 2024-09-12T01:29:15.798 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.798+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7136745915773109519', time=2024-09-12T03:12:21.917808+0000, chain.objs.size()=1 2024-09-12T01:29:15.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.798+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.vSAyOCVdDBC9ZyPPN5CwZPsiBuA6PXc_0 2024-09-12T01:29:15.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.799+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12170825512032360575', time=2024-09-12T03:12:22.870854+0000, chain.objs.size()=1 2024-09-12T01:29:15.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.799+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Ss1K3SW2CF0NaPQcrFV1jF8adsZecNK_0 2024-09-12T01:29:15.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.799+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15043572523136457361', time=2024-09-12T03:12:23.738208+0000, chain.objs.size()=1 2024-09-12T01:29:15.799 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.799+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.8Vvt6I0Dw66EN-u3ho3MbdeZ3xj09fl_0 2024-09-12T01:29:15.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10136399902097597636', time=2024-09-12T03:12:23.828402+0000, chain.objs.size()=1 2024-09-12T01:29:15.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.AkiVGiQjroV1gRSu9W4OtDDuKNwMn9H_0 2024-09-12T01:29:15.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7774718407520458920', time=2024-09-12T03:12:25.370268+0000, chain.objs.size()=1 2024-09-12T01:29:15.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mjGKHsj6MYvkJAzw2VMySJDCQmlhPbs_0 2024-09-12T01:29:15.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15456766982127209771', time=2024-09-12T03:12:25.503054+0000, chain.objs.size()=1 2024-09-12T01:29:15.801 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gugVfnUNqeGLL1gPG83Z2h4DH_aKPLk_0 2024-09-12T01:29:15.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7320123363191508757', time=2024-09-12T03:12:25.610426+0000, chain.objs.size()=1 2024-09-12T01:29:15.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.og56VzZVYzOeMHPLEX7KqC-e6iTMg0__0 2024-09-12T01:29:15.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7190198280096784095', time=2024-09-12T03:12:26.299448+0000, chain.objs.size()=1 2024-09-12T01:29:15.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.XuxvkjvHx1iJM6KmFfuABiYbCHKzFr7_0 2024-09-12T01:29:15.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6522099537440166927', time=2024-09-12T03:12:27.280183+0000, chain.objs.size()=1 2024-09-12T01:29:15.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.aJemk7hrzPIaU3zideFXL7yVay-5k7D_0 2024-09-12T01:29:15.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16324565159201225205', time=2024-09-12T03:12:28.790463+0000, chain.objs.size()=1 2024-09-12T01:29:15.802 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ucWK7ktF8weFce7acuBKcDT6sHBuFyZ_0 2024-09-12T01:29:15.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1214177864639081509', time=2024-09-12T03:12:28.983226+0000, chain.objs.size()=1 2024-09-12T01:29:15.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.801+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.4OiwcM52cWDrO0seYEySFB1HDWwc7b-_0 2024-09-12T01:29:15.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.802+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6221209452171099841', time=2024-09-12T03:12:29.938726+0000, chain.objs.size()=1 2024-09-12T01:29:15.803 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.802+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.PjbMT1Ktx-Iw0htcTJuK4ZGu0q1LJ6e_0 2024-09-12T01:29:15.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.803+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1755260650722301696', time=2024-09-12T03:12:29.947615+0000, chain.objs.size()=1 2024-09-12T01:29:15.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.803+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.T2GxBaVOM7R4Jt5rXuAWv9KpWIrzOuP_0 2024-09-12T01:29:15.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.804+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10609013076528437029', time=2024-09-12T03:12:30.502349+0000, chain.objs.size()=1 2024-09-12T01:29:15.804 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.804+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.lgVrUxPG2RAkxo8HKTtY-pEGnW1X_Jr_0 2024-09-12T01:29:15.805 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13335447881702536569', time=2024-09-12T03:12:30.604268+0000, chain.objs.size()=1 2024-09-12T01:29:15.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.QV1ZMjhYBA7RPL_1dCtmO23YWG_MrSj_0 2024-09-12T01:29:15.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13367232509771728080', time=2024-09-12T03:12:30.711778+0000, chain.objs.size()=1 2024-09-12T01:29:15.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.5Kx5USouNyfyibAx589RVBBWgS-i4kl_0 2024-09-12T01:29:15.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8293607826548284338', time=2024-09-12T03:12:31.106513+0000, chain.objs.size()=1 2024-09-12T01:29:15.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.BXGH2rTMi6Z6EcHGA24HLkeitjUFpes_0 2024-09-12T01:29:15.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3247838822677512938', time=2024-09-12T03:12:31.435944+0000, chain.objs.size()=1 2024-09-12T01:29:15.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.EmZucYborrBAl4Je8VnGIiT-j4J4G2E_0 2024-09-12T01:29:15.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4726628506260799986', time=2024-09-12T03:12:31.592346+0000, chain.objs.size()=1 2024-09-12T01:29:15.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.XEh4AGYbC8RHDqjElwyfmObe0dISwTs_0 2024-09-12T01:29:15.806 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13502832833116457375', time=2024-09-12T03:12:32.517216+0000, chain.objs.size()=1 2024-09-12T01:29:15.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mgKqB3rd4efN3IuXuSuL4AVtys17ogw_0 2024-09-12T01:29:15.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7147706906263425016', time=2024-09-12T03:12:32.518013+0000, chain.objs.size()=1 2024-09-12T01:29:15.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.5pQcHImggmeZAsRjhRQM4XaMf83QuU7_0 2024-09-12T01:29:15.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8818495856444343935', time=2024-09-12T03:12:33.013092+0000, chain.objs.size()=1 2024-09-12T01:29:15.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.rlnPbCEIM5IXiWqGa8_C4SnZjfu49HV_0 2024-09-12T01:29:15.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9234302947306380582', time=2024-09-12T03:12:33.093573+0000, chain.objs.size()=1 2024-09-12T01:29:15.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.805+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.zPKKbwufouYFL8rHernITPZ4mmyzu1L_0 2024-09-12T01:29:15.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.807+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7603069793674379847', time=2024-09-12T03:12:33.129331+0000, chain.objs.size()=1 2024-09-12T01:29:15.807 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.807+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.2VjAGO1qFmhg5_E_SQKnlwKRhJE9TEW_0 2024-09-12T01:29:15.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.807+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15818887135043556586', time=2024-09-12T03:12:33.186104+0000, chain.objs.size()=1 2024-09-12T01:29:15.808 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.807+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.XsGTB9eYZ3nO1_qqsoohFMEhwNc9Fh-_0 2024-09-12T01:29:15.809 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17666127416328956252', time=2024-09-12T03:12:33.628006+0000, chain.objs.size()=1 2024-09-12T01:29:15.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Mul0IaTLb0rEMCUCmptavrnswDVstAF_0 2024-09-12T01:29:15.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.489158971779583240', time=2024-09-12T03:12:33.771406+0000, chain.objs.size()=1 2024-09-12T01:29:15.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.oFUMN431b73rce8Fbhf0Wh8KKJm4tkZ_0 2024-09-12T01:29:15.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2674304781434447368', time=2024-09-12T03:12:34.165214+0000, chain.objs.size()=1 2024-09-12T01:29:15.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.a6QsMqAph6SOKGmyWyG_GR86kYnLe46_0 2024-09-12T01:29:15.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1721843823523725317', time=2024-09-12T03:12:37.054474+0000, chain.objs.size()=1 2024-09-12T01:29:15.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.329__shadow_.sgkS1k1dytLmOzHPQuVQ2vUV3Y_G6NF_0 2024-09-12T01:29:15.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3580573797025983168', time=2024-09-12T03:13:53.275409+0000, chain.objs.size()=1 2024-09-12T01:29:15.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.461__shadow_.48fdLKFRXrKzhGWb4Z78INfFnBcoigu_0 2024-09-12T01:29:15.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15606392944466405310', time=2024-09-12T03:13:55.666972+0000, chain.objs.size()=1 2024-09-12T01:29:15.810 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.464__shadow_.dzRwpVE3fUrECbCLwwRib6GuqK2PByP_0 2024-09-12T01:29:15.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5024435856776901159', time=2024-09-12T03:13:56.812921+0000, chain.objs.size()=1 2024-09-12T01:29:15.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.465__shadow_.YdY8seRlE4RrjiY4NiWTPHTJBEoobwh_0 2024-09-12T01:29:15.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4822482446686391446', time=2024-09-12T03:14:09.455180+0000, chain.objs.size()=1 2024-09-12T01:29:15.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.809+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.486__shadow_.h6pTigVh40UGjAxLefqtmuweVIyCjjK_0 2024-09-12T01:29:15.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.810+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~L3OZUrKfR4nJtUxUhYh5kT0JUjuef8j', time=2024-09-12T03:16:30.821860+0000, chain.objs.size()=1 2024-09-12T01:29:15.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.810+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.531__multipart_mymultipart2.2~L3OZUrKfR4nJtUxUhYh5kT0JUjuef8j.1 2024-09-12T01:29:15.811 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.810+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16513738446200085456', time=2024-09-12T03:17:27.061375+0000, chain.objs.size()=1 2024-09-12T01:29:15.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.810+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.557__shadow_.R10-zw2pnU6emw7shmfuOoN9MNM5aRF_0 2024-09-12T01:29:15.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.810+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10754163978638381434', time=2024-09-12T03:17:32.489490+0000, chain.objs.size()=1 2024-09-12T01:29:15.812 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.810+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.558__shadow_.dLVbQVr-QjLz0WQR93FD1evbldt2zw6_0 2024-09-12T01:29:15.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.814+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13829562921600352954', time=2024-09-12T03:17:35.318843+0000, chain.objs.size()=1 2024-09-12T01:29:15.814 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.814+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.561__multipart_mymultipart.oyQx2a781HLZ7vhNDJx8ybDgRvjtje6A.1 2024-09-12T01:29:15.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.815+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14123477044922486967', time=2024-09-12T03:17:50.408392+0000, chain.objs.size()=1 2024-09-12T01:29:15.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.815+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:qZKNwLL3eSSGzz2R2aaulCsWauNbLqg_.4etN6IBocdfIoZb8N_vUqK8Y73Pl3vs_0 2024-09-12T01:29:15.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.815+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9157177210155013672', time=2024-09-12T03:17:56.298153+0000, chain.objs.size()=1 2024-09-12T01:29:15.815 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.815+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:6iRHMLaiEFXWInmidYlyypeIUOhK3y4_.RC13G3scun5VRV9pAVRXBXUWdm2YpAb_0 2024-09-12T01:29:15.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.815+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10349149653818674530', time=2024-09-12T03:18:17.599879+0000, chain.objs.size()=1 2024-09-12T01:29:15.816 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.815+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:vGJ6j.LA9IPx8bTwK1-xlurIc.un61I_.IOAwk0fKuY0LhLDJmGEJy4b2xgpfi0G_0 2024-09-12T01:29:15.817 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.817+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/47612 2024-09-12T01:29:15.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.819+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:29:15.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.819+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9345731881730847773', time=2024-09-12T03:18:33.731134+0000, chain.objs.size()=1 2024-09-12T01:29:15.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.820+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:UpPSDdUdXhDJPzuh6bKnXehYfn2-0B5_.rOx-PpueFfZKLuok3TZhIWzH_RA_nS3_0 2024-09-12T01:29:15.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.820+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16566719024001706397', time=2024-09-12T03:24:10.424290+0000, chain.objs.size()=1 2024-09-12T01:29:15.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.820+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.713__shadow:nPuS-iC-Tp6RL.0PlSk2ztkG---T3sv_.ncmtzR_G4XnvpXbAzDgoeTISdNT1gCX_0 2024-09-12T01:29:15.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.820+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2037953764199237359', time=2024-09-12T03:24:50.540425+0000, chain.objs.size()=1 2024-09-12T01:29:15.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.820+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.739__shadow_.r4gcEQB03dxIYLvKeBF7I5MJQDr9LHj_0 2024-09-12T01:29:15.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.820+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6168994533443539673', time=2024-09-12T03:24:53.624540+0000, chain.objs.size()=1 2024-09-12T01:29:15.820 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.820+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.742__multipart_mymultipart3.2~cl4cxhl5BVigVmtkujYSQgCtwYyCWQ8.1 2024-09-12T01:29:15.821 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.821+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.824 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.824+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:29:15.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.825+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.825 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.825+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47787' 2024-09-12T01:29:15.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15810674429733157235', time=2024-09-12T03:06:50.785739+0000, chain.objs.size()=3 2024-09-12T01:29:15.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__multipart_foo-LUKEWARM.2~uS-HX3wTQ1yNzUAtbhMaaMXr3YzWvvS.1 2024-09-12T01:29:15.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__multipart_foo-LUKEWARM.2~uS-HX3wTQ1yNzUAtbhMaaMXr3YzWvvS.2 2024-09-12T01:29:15.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__multipart_foo-LUKEWARM.2~uS-HX3wTQ1yNzUAtbhMaaMXr3YzWvvS.3 2024-09-12T01:29:15.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_wC9hRO9Uh6P2PigtpVWecjgmgGW2BFl', time=2024-09-12T03:06:59.401447+0000, chain.objs.size()=1 2024-09-12T01:29:15.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.165__shadow_.CvstJygBP_lWVx8SpjkX78CdoEidvYr_0 2024-09-12T01:29:15.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5124535890933428087', time=2024-09-12T03:09:02.284438+0000, chain.objs.size()=1 2024-09-12T01:29:15.827 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.242__shadow_.0Ri7bfwlNEtQuSE3W842FsDxz1NbYms_0 2024-09-12T01:29:15.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13271882246249917305', time=2024-09-12T03:09:07.304112+0000, chain.objs.size()=1 2024-09-12T01:29:15.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.249__shadow_.YmiYKRwn5-vnomvh6JX5QYrP3mMoULY_0 2024-09-12T01:29:15.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5184032796865008800', time=2024-09-12T03:09:54.224651+0000, chain.objs.size()=1 2024-09-12T01:29:15.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1btuqP6KT0198EYCk8Q3Hw7Sqm7uAhf_0 2024-09-12T01:29:15.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10403930449037656218', time=2024-09-12T03:09:54.447764+0000, chain.objs.size()=1 2024-09-12T01:29:15.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.u69KiJ-G1SU9xl6piKhyygZZXD1b4W__0 2024-09-12T01:29:15.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7208151173429912091', time=2024-09-12T03:09:54.587100+0000, chain.objs.size()=1 2024-09-12T01:29:15.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.MNQm_EsUVMU6HOjS2Z8EY0Nz858Y00j_0 2024-09-12T01:29:15.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10072342493336225472', time=2024-09-12T03:09:54.804885+0000, chain.objs.size()=1 2024-09-12T01:29:15.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lHw63IniaZG4ofZUH66HLGFzW3nxUax_0 2024-09-12T01:29:15.828 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17191553054289283785', time=2024-09-12T03:09:55.267853+0000, chain.objs.size()=1 2024-09-12T01:29:15.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Nz-DEQXmF0HxSNpEkGI3TWyMwVbZF31_0 2024-09-12T01:29:15.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11096253890165780762', time=2024-09-12T03:09:56.202715+0000, chain.objs.size()=1 2024-09-12T01:29:15.829 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.826+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.D9CR8KzzdFlAP7060BrHO6wA2HxiYMI_0 2024-09-12T01:29:15.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.829+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.700869399853871759', time=2024-09-12T03:09:56.283675+0000, chain.objs.size()=1 2024-09-12T01:29:15.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.829+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.db5tYsfXBXWVC8vWpJkgmctfVnDwHAr_0 2024-09-12T01:29:15.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.829+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2901040189986556552', time=2024-09-12T03:09:56.365023+0000, chain.objs.size()=1 2024-09-12T01:29:15.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.829+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.vLjtzfe3MvvdROh_eRb6G75WEll62g3_0 2024-09-12T01:29:15.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.829+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3535096978800180888', time=2024-09-12T03:09:56.830722+0000, chain.objs.size()=1 2024-09-12T01:29:15.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.829+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._RXhVPl-rJkpd73r4GCQUxxU6VGNEJ-_0 2024-09-12T01:29:15.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.830+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7220218384353644172', time=2024-09-12T03:09:57.103798+0000, chain.objs.size()=1 2024-09-12T01:29:15.830 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.830+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.-dl2h5Za3d_OmJ0dXV6P7JeZFVZn7_N_0 2024-09-12T01:29:15.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.830+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6529966267542585260', time=2024-09-12T03:09:57.104658+0000, chain.objs.size()=1 2024-09-12T01:29:15.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.830+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.pb1ycSGnQ5TGh5qYmtNKtpxUpOjdXqV_0 2024-09-12T01:29:15.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.830+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17734228205516002949', time=2024-09-12T03:09:58.070262+0000, chain.objs.size()=1 2024-09-12T01:29:15.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.830+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.p18S-lwBaYTva2hcARtYgffnboTUmAS_0 2024-09-12T01:29:15.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.830+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4872952383855759286', time=2024-09-12T03:09:58.268649+0000, chain.objs.size()=1 2024-09-12T01:29:15.831 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.830+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.26MUqD4RWyQcWQ_afip1IgFKCwLFRdd_0 2024-09-12T01:29:15.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.831+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13196540261629937992', time=2024-09-12T03:09:58.595140+0000, chain.objs.size()=1 2024-09-12T01:29:15.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.831+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.flrBJBmmgMXLPnO3GPn8LhNfGLMt-SS_0 2024-09-12T01:29:15.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.831+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9857614249447665230', time=2024-09-12T03:09:58.652525+0000, chain.objs.size()=1 2024-09-12T01:29:15.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.831+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Fsdm0LDsHr0qprc8Q6y9yJfnmvxq7uy_0 2024-09-12T01:29:15.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.831+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16776224667048259887', time=2024-09-12T03:09:58.825272+0000, chain.objs.size()=1 2024-09-12T01:29:15.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.831+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.zmzmimxJJ0Im8SZ_xCI0lNwbtYbUaeF_0 2024-09-12T01:29:15.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.831+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3769341998866859964', time=2024-09-12T03:09:58.901970+0000, chain.objs.size()=1 2024-09-12T01:29:15.832 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.831+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.aoDOCaqZ1NvuLTkQAu9YdNfHXywdO-w_0 2024-09-12T01:29:15.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.833+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.191173206925846827', time=2024-09-12T03:09:58.902626+0000, chain.objs.size()=1 2024-09-12T01:29:15.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.833+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.pE6KT2SLr8e0u0kGq6tKbrRctP1wZHn_0 2024-09-12T01:29:15.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.833+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3519142646026252719', time=2024-09-12T03:09:58.963857+0000, chain.objs.size()=1 2024-09-12T01:29:15.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.833+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.qi9ri6Q51CuUN9nr98SE3QZNjU1R2bX_0 2024-09-12T01:29:15.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.833+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16108223747332294581', time=2024-09-12T03:09:59.409670+0000, chain.objs.size()=1 2024-09-12T01:29:15.833 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.833+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.aLXwDUARR3U8j5FMM2E9eXGdP912oMA_0 2024-09-12T01:29:15.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.834+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8981180120493902356', time=2024-09-12T03:09:59.445508+0000, chain.objs.size()=1 2024-09-12T01:29:15.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.834+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.h45jAoUETSerjC_mzKKC8gggQx5058l_0 2024-09-12T01:29:15.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.834+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16179943779163013340', time=2024-09-12T03:09:59.596123+0000, chain.objs.size()=1 2024-09-12T01:29:15.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.834+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9KTyPhSMpCQtquUHSvifAnem6cz1r4G_0 2024-09-12T01:29:15.834 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.834+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10262312279663135223', time=2024-09-12T03:09:59.666240+0000, chain.objs.size()=1 2024-09-12T01:29:15.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.834+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.OsYIgaptBD1CWmWGc_fJkEMfJfu4oTs_0 2024-09-12T01:29:15.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.834+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3158941675609844686', time=2024-09-12T03:10:00.122977+0000, chain.objs.size()=1 2024-09-12T01:29:15.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.834+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.f-oLMT4YOnR_LH6evs5ktIT1mowxJ2Q_0 2024-09-12T01:29:15.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.835+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13587419371244564327', time=2024-09-12T03:10:01.465684+0000, chain.objs.size()=1 2024-09-12T01:29:15.835 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.835+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.hsSDmG6YnJ9E6lUDsphOinZpcWxPif6_0 2024-09-12T01:29:15.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.836+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14739844681376117596', time=2024-09-12T03:10:01.910609+0000, chain.objs.size()=1 2024-09-12T01:29:15.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.836+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.wEDANZjXNmXdkh5Oe5pxll0EI2hRjnK_0 2024-09-12T01:29:15.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.836+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.710815292649992368', time=2024-09-12T03:10:02.039790+0000, chain.objs.size()=1 2024-09-12T01:29:15.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.836+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.WGiJQ90h2BxgFguUWTcsXGbODG3bZBw_0 2024-09-12T01:29:15.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.836+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7854346998467419546', time=2024-09-12T03:10:02.998332+0000, chain.objs.size()=1 2024-09-12T01:29:15.836 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.836+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.WZwRWS-F1tQdlKPn2ltfIDO5QT0aovV_0 2024-09-12T01:29:15.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.837+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8108031327928376387', time=2024-09-12T03:10:03.163235+0000, chain.objs.size()=1 2024-09-12T01:29:15.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.837+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dUCFTxFk_XggG7cgiMvT9-GUMxAhbhq_0 2024-09-12T01:29:15.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.837+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10136713205233703518', time=2024-09-12T03:10:04.275869+0000, chain.objs.size()=1 2024-09-12T01:29:15.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.837+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.MML18AUoYYzmS49rl8nuz912RUDOFpM_0 2024-09-12T01:29:15.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.837+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8667361479049358095', time=2024-09-12T03:10:04.796866+0000, chain.objs.size()=1 2024-09-12T01:29:15.837 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.837+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.g6cosTiZWmBAU9ZhghUUVDYEnWM_KIf_0 2024-09-12T01:29:15.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.839+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15818865990754096348', time=2024-09-12T03:10:06.262611+0000, chain.objs.size()=1 2024-09-12T01:29:15.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.839+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.rR2CSrX2L-2fJYYla_KAnQ1mevxe71O_0 2024-09-12T01:29:15.839 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.839+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15760036908070921828', time=2024-09-12T03:10:14.489056+0000, chain.objs.size()=1 2024-09-12T01:29:15.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.839+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.275__shadow_.juWCSshVF6ItEISqrwdKi3268Nv9Ih2_0 2024-09-12T01:29:15.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.839+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4456878208362349417', time=2024-09-12T03:10:14.497227+0000, chain.objs.size()=1 2024-09-12T01:29:15.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.839+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.275__shadow_.KmchKOUtW5RvxEQBjxO90sl2VMqkfKF_0 2024-09-12T01:29:15.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.839+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8630916023371712332', time=2024-09-12T03:10:15.142629+0000, chain.objs.size()=1 2024-09-12T01:29:15.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.839+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.276__shadow_.Tinw2yjyGADb-KDG2Y4Rvmqk0yaKLR5_0 2024-09-12T01:29:15.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.839+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2720497284251251852', time=2024-09-12T03:10:15.812868+0000, chain.objs.size()=1 2024-09-12T01:29:15.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.839+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.277__shadow_.C_EIyoVnCo_DiN66MKH3SH_u9Nsez8i_0 2024-09-12T01:29:15.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.839+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15664967357218342207', time=2024-09-12T03:10:16.444326+0000, chain.objs.size()=1 2024-09-12T01:29:15.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.839+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.278__shadow_.eh4A9vDiRdvLo7EjpmYL36527q1Jh68_0 2024-09-12T01:29:15.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.839+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5565949856656099646', time=2024-09-12T03:10:21.130781+0000, chain.objs.size()=1 2024-09-12T01:29:15.840 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.839+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.285__shadow_.v3i-3_qL7bYNJidkWvEvHCWFCXLMfwd_0 2024-09-12T01:29:15.841 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.840+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3798602573015952130', time=2024-09-12T03:10:22.481760+0000, chain.objs.size()=1 2024-09-12T01:29:15.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.840+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.287__shadow_.4A0GHIO2qwAVt3iRH_3eOEIJx5QrtSL_0 2024-09-12T01:29:15.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.840+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6611628526386151357', time=2024-09-12T03:10:27.057204+0000, chain.objs.size()=1 2024-09-12T01:29:15.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.840+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.P452m6npaDSDMizwRMk_h_wEISrOhOI_0 2024-09-12T01:29:15.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.840+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3847329770617600574', time=2024-09-12T03:10:27.097688+0000, chain.objs.size()=1 2024-09-12T01:29:15.844 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.840+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.qErcxQweCY7PrFX3cMPjf4H8Q5V8Xot_0 2024-09-12T01:29:15.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.841+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14191476955275737183', time=2024-09-12T03:10:29.068315+0000, chain.objs.size()=1 2024-09-12T01:29:15.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.841+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.uuIOrTc-aBVw1o0JZT2hgHNYzRAJIBw_0 2024-09-12T01:29:15.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.843+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12650272438782668541', time=2024-09-12T03:10:32.537123+0000, chain.objs.size()=1 2024-09-12T01:29:15.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.843+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.298__shadow_.5o8FuXyZk-Sj8nixPhAEDQIutvrhCCB_0 2024-09-12T01:29:15.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.843+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11843685991849564669', time=2024-09-12T03:10:36.463571+0000, chain.objs.size()=1 2024-09-12T01:29:15.845 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.843+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.304__shadow_.nWQgTobD3z7AICcLWv07yFtkqgU7lNp_0 2024-09-12T01:29:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10260268844934452702', time=2024-09-12T03:11:29.298736+0000, chain.objs.size()=1 2024-09-12T01:29:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.QyjMletKcOMA3krwWPSG1NggvYqhVrs_0 2024-09-12T01:29:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10169371689892279301', time=2024-09-12T03:11:29.898251+0000, chain.objs.size()=1 2024-09-12T01:29:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ud1QKDOp7i0SA45j3IIdURUnJV0nbd7_0 2024-09-12T01:29:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16406065079895547220', time=2024-09-12T03:11:33.375077+0000, chain.objs.size()=1 2024-09-12T01:29:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.jEPC2kMLjo-ECyr088cClTMNk9Y4K-C_0 2024-09-12T01:29:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4637444524000109077', time=2024-09-12T03:11:33.410394+0000, chain.objs.size()=1 2024-09-12T01:29:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.HgbhDl3-c7RPwbLTu_piGxFzwyoHgPE_0 2024-09-12T01:29:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5162260765103525337', time=2024-09-12T03:11:33.462767+0000, chain.objs.size()=1 2024-09-12T01:29:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.aCFweJS2_GgSMvvHVnYlOSnLgLi3MTg_0 2024-09-12T01:29:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13117713104967084666', time=2024-09-12T03:11:33.604353+0000, chain.objs.size()=1 2024-09-12T01:29:15.846 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.c9ItOF4G3qRSx_XQBiG_Z2W8_61wXGR_0 2024-09-12T01:29:15.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14999785332497170881', time=2024-09-12T03:11:33.994611+0000, chain.objs.size()=1 2024-09-12T01:29:15.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1fgJHCF8PwQmoZQKnpU7CnQHi6i0rFj_0 2024-09-12T01:29:15.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9634263524949732830', time=2024-09-12T03:11:34.013564+0000, chain.objs.size()=1 2024-09-12T01:29:15.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.CL9DHA9hQU0Et9KPIw7apxAFegqHT56_0 2024-09-12T01:29:15.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6708907303297386005', time=2024-09-12T03:11:34.461222+0000, chain.objs.size()=1 2024-09-12T01:29:15.847 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.844+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.eObqYr0xOh7TgPBBt6O3zltPRO7UjZ8_0 2024-09-12T01:29:15.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.847+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.917519364587906229', time=2024-09-12T03:11:34.668924+0000, chain.objs.size()=1 2024-09-12T01:29:15.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.847+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.P6WrnQyO2ILBkI9wO7lnCcx7DD1JlwQ_0 2024-09-12T01:29:15.848 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.848+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9901108922607713609', time=2024-09-12T03:11:34.839745+0000, chain.objs.size()=1 2024-09-12T01:29:15.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.848+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qvXo1bdl1cVP9oX8ML4s2bAiQep2peZ_0 2024-09-12T01:29:15.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.848+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4896367820404008177', time=2024-09-12T03:11:35.147841+0000, chain.objs.size()=1 2024-09-12T01:29:15.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.848+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.p8sqxfYB_vbCf8xh5Faec19oPutjPSi_0 2024-09-12T01:29:15.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.848+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14025065236034680030', time=2024-09-12T03:11:36.218261+0000, chain.objs.size()=1 2024-09-12T01:29:15.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.848+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7Qe9uYJPN5HgXd6i-rF6UoIWHOhxAQR_0 2024-09-12T01:29:15.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.849+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6916145909573089708', time=2024-09-12T03:11:36.878231+0000, chain.objs.size()=1 2024-09-12T01:29:15.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.849+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.YOueYdJMwBywgPthdtLo_Uh1ZewvLhS_0 2024-09-12T01:29:15.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.849+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10754121297066878059', time=2024-09-12T03:11:36.950927+0000, chain.objs.size()=1 2024-09-12T01:29:15.849 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.849+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.E7mIW6hq14bOq9TxC8qWZI-wcfzvzLG_0 2024-09-12T01:29:15.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.849+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1068121537683093732', time=2024-09-12T03:11:37.753242+0000, chain.objs.size()=1 2024-09-12T01:29:15.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.849+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.RgroosrPMp96BheXHD4ud5rbtVYTl5c_0 2024-09-12T01:29:15.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.849+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4139420449157440579', time=2024-09-12T03:11:38.050948+0000, chain.objs.size()=1 2024-09-12T01:29:15.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.849+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1oBuXBREj2UGgPeF3OmOLpthhj4s-4T_0 2024-09-12T01:29:15.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.849+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4288982815418220976', time=2024-09-12T03:11:38.367222+0000, chain.objs.size()=1 2024-09-12T01:29:15.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.849+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.nZqZRZJ6mCJflAQ0NfGt2obmKaZDRTQ_0 2024-09-12T01:29:15.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.849+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4142390577576652984', time=2024-09-12T03:11:38.367790+0000, chain.objs.size()=1 2024-09-12T01:29:15.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.849+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qoGRHEe4a1O4SPnOpOB-3qlhEOEWCgq_0 2024-09-12T01:29:15.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.849+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12912887844668110446', time=2024-09-12T03:11:39.186348+0000, chain.objs.size()=1 2024-09-12T01:29:15.850 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.849+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.hm2foVnLM83YsnPN-RwbIf9ukn2mmuu_0 2024-09-12T01:29:15.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.852+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12483512373493096646', time=2024-09-12T03:11:39.376691+0000, chain.objs.size()=1 2024-09-12T01:29:15.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.852+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5twOIMVqiZX6JsjCimHHhXAyc1IW8SD_0 2024-09-12T01:29:15.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.852+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10724693649530026140', time=2024-09-12T03:11:39.654257+0000, chain.objs.size()=1 2024-09-12T01:29:15.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.852+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.D454k66zMjnvBWnr5uV4WlHjgBr-0IA_0 2024-09-12T01:29:15.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.852+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17584313178878297733', time=2024-09-12T03:11:39.996259+0000, chain.objs.size()=1 2024-09-12T01:29:15.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.852+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5bKHLwsIxpEBskTnu0kHJxN1YJfF9cX_0 2024-09-12T01:29:15.852 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.852+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8092384126374252178', time=2024-09-12T03:11:40.671573+0000, chain.objs.size()=1 2024-09-12T01:29:15.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.852+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.JTqH7rFBNGPZS8fl3tY16E7M3wygcgJ_0 2024-09-12T01:29:15.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.853+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.904397563436665396', time=2024-09-12T03:11:41.190636+0000, chain.objs.size()=1 2024-09-12T01:29:15.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.853+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MqATSa_H9MuacdicLHx4WYAOyW86Oti_0 2024-09-12T01:29:15.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.853+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16029004570904213852', time=2024-09-12T03:11:41.371044+0000, chain.objs.size()=1 2024-09-12T01:29:15.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.853+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.rfXPrx8I4ntcJqX5DtIls2MqFJjnVbN_0 2024-09-12T01:29:15.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.853+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9025293125606933896', time=2024-09-12T03:12:22.043884+0000, chain.objs.size()=1 2024-09-12T01:29:15.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.853+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.aAlovIFfVFmsKA2Fs3LNvAY2Y7p33nj_0 2024-09-12T01:29:15.853 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.853+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2351811883144609119', time=2024-09-12T03:12:22.311403+0000, chain.objs.size()=1 2024-09-12T01:29:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.853+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.lmvmqiIZWtKe1mxhLVW7Bb6xijiEX1K_0 2024-09-12T01:29:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.853+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13961425769516486626', time=2024-09-12T03:12:22.833990+0000, chain.objs.size()=1 2024-09-12T01:29:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.853+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.6UmTz_Me0h_8q_X0DB0Tmv8DA5mt5fL_0 2024-09-12T01:29:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.853+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10056009841849960040', time=2024-09-12T03:12:23.652256+0000, chain.objs.size()=1 2024-09-12T01:29:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.853+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.b_PQhLn9n7Vh6Z_8J6h4MaWd8bsV6g5_0 2024-09-12T01:29:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.853+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6571312362204271785', time=2024-09-12T03:12:24.188291+0000, chain.objs.size()=1 2024-09-12T01:29:15.854 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.853+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3dQWbWqzHlp-eVi08U1SfdOc7wB0k0j_0 2024-09-12T01:29:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.855+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6997859631117528303', time=2024-09-12T03:12:24.486831+0000, chain.objs.size()=1 2024-09-12T01:29:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.855+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.2_Lrj_fGTn_HcCVtj2w0KrBnmX6DJGa_0 2024-09-12T01:29:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.855+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17575077395762020146', time=2024-09-12T03:12:24.709878+0000, chain.objs.size()=1 2024-09-12T01:29:15.855 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.855+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.PjkT2e0VxEjoQx6Y5yFKfPYQATXsJzt_0 2024-09-12T01:29:15.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.856+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.800218605574466332', time=2024-09-12T03:12:25.546873+0000, chain.objs.size()=1 2024-09-12T01:29:15.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.856+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.fdmU33q4-8pRMKRGFHvQ8rL34uljGNf_0 2024-09-12T01:29:15.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.856+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10564738813458889266', time=2024-09-12T03:12:25.718386+0000, chain.objs.size()=1 2024-09-12T01:29:15.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.856+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1tF1YyIX7vvVx-Zu4jxGADTsmO8Ihdq_0 2024-09-12T01:29:15.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.857+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9288634504758065135', time=2024-09-12T03:12:25.719034+0000, chain.objs.size()=1 2024-09-12T01:29:15.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.857+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.0D6nyt9BMk_yytyfz8w_dFuoUxIweyf_0 2024-09-12T01:29:15.857 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.857+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6521112322891853791', time=2024-09-12T03:12:26.534977+0000, chain.objs.size()=1 2024-09-12T01:29:15.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.857+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.GH1O44SfhqGtIeEucTXeBD3acz6Wafy_0 2024-09-12T01:29:15.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.857+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18437039697404646094', time=2024-09-12T03:12:27.043256+0000, chain.objs.size()=1 2024-09-12T01:29:15.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.857+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Vly4h6aGX-cJ3xNuQruRgQzs8C_I-kj_0 2024-09-12T01:29:15.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.857+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13617146807697171399', time=2024-09-12T03:12:27.516476+0000, chain.objs.size()=1 2024-09-12T01:29:15.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.857+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Br14JpZ247mXMRxYdaAElRwp5GtcM7z_0 2024-09-12T01:29:15.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.858+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5058525006237349572', time=2024-09-12T03:12:27.609298+0000, chain.objs.size()=1 2024-09-12T01:29:15.858 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.858+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.NG9vjKNCScGym5tE8k_DqDgIvZndsGf_0 2024-09-12T01:29:15.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.858+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16189068175725811529', time=2024-09-12T03:12:27.609969+0000, chain.objs.size()=1 2024-09-12T01:29:15.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.858+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.NhdZTIaJ3ux0S_dNucpneDglsJC4Bjb_0 2024-09-12T01:29:15.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.858+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12356792814932239531', time=2024-09-12T03:12:27.790660+0000, chain.objs.size()=1 2024-09-12T01:29:15.859 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.858+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.LBQLPArNwXhzKgNaIDUKlMcUeYt31BQ_0 2024-09-12T01:29:15.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.859+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3217364217129745423', time=2024-09-12T03:12:27.956799+0000, chain.objs.size()=1 2024-09-12T01:29:15.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.859+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.K4MuwHtsyPvfoEb9BcWgyqMHpYZ-7kB_0 2024-09-12T01:29:15.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.859+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7299492274798266435', time=2024-09-12T03:12:28.842063+0000, chain.objs.size()=1 2024-09-12T01:29:15.860 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.859+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.yeD80MvVPvQJmervbQcQKMahAHPaXFN_0 2024-09-12T01:29:15.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7121203533716096240', time=2024-09-12T03:12:28.957516+0000, chain.objs.size()=1 2024-09-12T01:29:15.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ZIy1rbdeUHk-jkXHhPmlkmjq_o0cT1A_0 2024-09-12T01:29:15.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.976540779559168688', time=2024-09-12T03:12:29.353939+0000, chain.objs.size()=1 2024-09-12T01:29:15.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.19G3kXKsyrX1cdVmdkI_TkJDKb2PCmC_0 2024-09-12T01:29:15.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17741049891030409309', time=2024-09-12T03:12:29.428285+0000, chain.objs.size()=1 2024-09-12T01:29:15.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.jxb5_RGfF7MPiSJnUkLV_6DfTJRyoXV_0 2024-09-12T01:29:15.861 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3632925732724946095', time=2024-09-12T03:12:29.549117+0000, chain.objs.size()=1 2024-09-12T01:29:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.84mUbcWGTNP0fQHScuzQsBdfgVxycwG_0 2024-09-12T01:29:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18441291385374278433', time=2024-09-12T03:12:29.903580+0000, chain.objs.size()=1 2024-09-12T01:29:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.6N9LkrfWgl51WGM_iOFOgdfz4sta26R_0 2024-09-12T01:29:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1210570508410416802', time=2024-09-12T03:12:29.905267+0000, chain.objs.size()=1 2024-09-12T01:29:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.4HvAVNe-hrHrTotpH6VSWVkcaohvgR8_0 2024-09-12T01:29:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4972922509267366079', time=2024-09-12T03:12:30.359956+0000, chain.objs.size()=1 2024-09-12T01:29:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.4ovbt7dG-guDDk4yMF_bNDq9PY982YQ_0 2024-09-12T01:29:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4330391144643052247', time=2024-09-12T03:12:30.961399+0000, chain.objs.size()=1 2024-09-12T01:29:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.861+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.7JRvuir4aAvE4-0nxD49TXRKKpOBffu_0 2024-09-12T01:29:15.865 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.865+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/47787 2024-09-12T01:29:15.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-12T01:29:15.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6126402753226500579', time=2024-09-12T03:12:30.963102+0000, chain.objs.size()=1 2024-09-12T01:29:15.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.NO8-bZo8WQwVMSwj3oB9dETE3Bx5-cZ_0 2024-09-12T01:29:15.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1625112161007934185', time=2024-09-12T03:12:30.963693+0000, chain.objs.size()=1 2024-09-12T01:29:15.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-623uEDnHWIWEqhSH0Quv97-O48_Io4_0 2024-09-12T01:29:15.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5067502202381580070', time=2024-09-12T03:12:31.504779+0000, chain.objs.size()=1 2024-09-12T01:29:15.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.aifiOoxvmY09iOet2vJO_IpKh22kwpv_0 2024-09-12T01:29:15.868 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8375116133231875318', time=2024-09-12T03:12:32.149870+0000, chain.objs.size()=1 2024-09-12T01:29:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ZiqQnCHINdsJT03SYFIoSFv3hh4Mo0P_0 2024-09-12T01:29:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2277810896592587874', time=2024-09-12T03:12:32.489174+0000, chain.objs.size()=1 2024-09-12T01:29:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1V1o7DhFtfEv8Toy6H6bfB-Hio4PnSw_0 2024-09-12T01:29:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12600760508007935778', time=2024-09-12T03:12:32.490282+0000, chain.objs.size()=1 2024-09-12T01:29:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.nJIRkzr9DMJfH9z1GUoEezBBDvF4Vgw_0 2024-09-12T01:29:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16302443488595971100', time=2024-09-12T03:12:44.935055+0000, chain.objs.size()=1 2024-09-12T01:29:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.343__shadow_.eARcj0QabN8-9uEjbfZl4gK-1vpCdmP_0 2024-09-12T01:29:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17194444195494334397', time=2024-09-12T03:13:38.821768+0000, chain.objs.size()=1 2024-09-12T01:29:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.440__shadow_.diJ4h5jTfsR4GlkT1hYo3ejZ2tsuDkO_0 2024-09-12T01:29:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.340334349234475069', time=2024-09-12T03:13:52.410659+0000, chain.objs.size()=1 2024-09-12T01:29:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.460__shadow_.LAen5f1df6oion0NwX7jZKM0klh5klp_0 2024-09-12T01:29:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8722066055182261907', time=2024-09-12T03:14:20.199882+0000, chain.objs.size()=1 2024-09-12T01:29:15.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.503__shadow:Dp2Xh3PCmOVDZq0qVeIVb0wIZKi8rqS_.nA7nRfHdVh5iLsyVm5W5cePiSTckNJe_0 2024-09-12T01:29:15.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13006316535521944638', time=2024-09-12T03:14:29.084448+0000, chain.objs.size()=6 2024-09-12T01:29:15.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.1 2024-09-12T01:29:15.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.867+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.2 2024-09-12T01:29:15.870 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.870+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.3 2024-09-12T01:29:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.870+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.4 2024-09-12T01:29:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.871+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.5 2024-09-12T01:29:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.871+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.6 2024-09-12T01:29:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.871+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2402784794985092707', time=2024-09-12T03:17:48.792599+0000, chain.objs.size()=1 2024-09-12T01:29:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.871+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:jXvxuuwm6yEk3uAHlE5FvEuqUnfgYin_.xAF2WFTi6fBv1UIsVnWYRPANa8fSmb-_0 2024-09-12T01:29:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.871+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10803921078802347748', time=2024-09-12T03:17:49.250241+0000, chain.objs.size()=1 2024-09-12T01:29:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.871+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:cPtFOXUR3aLdCFyDm.hmQtPxqjAhiAv_.3Jun7pQqgQj7PE6Unr7VvRtKScfZnug_0 2024-09-12T01:29:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.871+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15257703231466421294', time=2024-09-12T03:18:23.006118+0000, chain.objs.size()=1 2024-09-12T01:29:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.871+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:Fv3hoBrk4szd1SRHrtp0pmDyKUxvJjM_.qs6c6nGXYThvi7_jdXglbU8IsbciU2Z_0 2024-09-12T01:29:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.871+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.37344257632308889', time=2024-09-12T03:18:50.564993+0000, chain.objs.size()=1 2024-09-12T01:29:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.871+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.580__shadow:zPKrhd9DoCsp9n4S-M4DJRwb81BYH0S_.iZDundv4rNUADtWjJI9UMTqZpkGDDee_0 2024-09-12T01:29:15.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.873+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7758128049537332129', time=2024-09-12T03:18:50.597428+0000, chain.objs.size()=1 2024-09-12T01:29:15.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.873+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.580__shadow:zPKrhd9DoCsp9n4S-M4DJRwb81BYH0S_.iZDundv4rNUADtWjJI9UMTqZpkGDDee_0 2024-09-12T01:29:15.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.873+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16919092941534065725', time=2024-09-12T03:18:50.625846+0000, chain.objs.size()=1 2024-09-12T01:29:15.873 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.873+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.580__shadow:qBjm8H6GQVkifIdHZzda0fx6yJ5oPVA_.EdKAH6RD_uXevISjCs_sAFmq9cxyJHv_0 2024-09-12T01:29:15.875 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.875+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8309255994477612397', time=2024-09-12T03:18:55.381694+0000, chain.objs.size()=1 2024-09-12T01:29:15.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.875+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.586__shadow:8mFp9YLaKqimj0uEFONZwupdKSeTVIy_.nFhMO4Qh1hT51n9oMNiVryBv0Fx85mo_0 2024-09-12T01:29:15.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.875+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7152693797455676876', time=2024-09-12T03:18:56.821418+0000, chain.objs.size()=1 2024-09-12T01:29:15.876 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.875+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.587__shadow:U5NWXceQ-3F0NMJyevlRxTfjJmP0PeN_.7ZkPyKNhAj2bKPox1CWgGDeCm8DD8fp_0 2024-09-12T01:29:15.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.876+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~9GbsSFr55tzfhPIctZfD0ikEG27jDQg', time=2024-09-12T03:22:54.957586+0000, chain.objs.size()=6 2024-09-12T01:29:15.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.876+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.625__multipart_multipart_enc.2~9GbsSFr55tzfhPIctZfD0ikEG27jDQg.1 2024-09-12T01:29:15.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.876+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.625__multipart_multipart_enc.2~9GbsSFr55tzfhPIctZfD0ikEG27jDQg.2 2024-09-12T01:29:15.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.876+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.625__multipart_multipart_enc.2~9GbsSFr55tzfhPIctZfD0ikEG27jDQg.3 2024-09-12T01:29:15.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.876+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.625__multipart_multipart_enc.2~9GbsSFr55tzfhPIctZfD0ikEG27jDQg.4 2024-09-12T01:29:15.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.876+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.625__multipart_multipart_enc.2~9GbsSFr55tzfhPIctZfD0ikEG27jDQg.5 2024-09-12T01:29:15.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.876+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.625__multipart_multipart_enc.2~9GbsSFr55tzfhPIctZfD0ikEG27jDQg.6 2024-09-12T01:29:15.877 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.876+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11255848708523457645', time=2024-09-12T03:23:16.922746+0000, chain.objs.size()=1 2024-09-12T01:29:15.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.876+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.649__shadow_.CSmh4t73a3t2X-Gt26YNJVLNfjo5Mdt_0 2024-09-12T01:29:15.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.876+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10563475879179898201', time=2024-09-12T03:23:39.716601+0000, chain.objs.size()=6 2024-09-12T01:29:15.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.876+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.660__multipart_bar.2~BGq0WL9eyA3W4YcdRMO7zp4ZCPgRJOJ.1 2024-09-12T01:29:15.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.877+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.660__multipart_bar.2~BGq0WL9eyA3W4YcdRMO7zp4ZCPgRJOJ.2 2024-09-12T01:29:15.878 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.878+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.660__multipart_bar.2~BGq0WL9eyA3W4YcdRMO7zp4ZCPgRJOJ.3 2024-09-12T01:29:15.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.878+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.660__multipart_bar.2~BGq0WL9eyA3W4YcdRMO7zp4ZCPgRJOJ.4 2024-09-12T01:29:15.879 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.879+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.660__multipart_bar.2~BGq0WL9eyA3W4YcdRMO7zp4ZCPgRJOJ.5 2024-09-12T01:29:15.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.880+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.660__multipart_bar.2~BGq0WL9eyA3W4YcdRMO7zp4ZCPgRJOJ.6 2024-09-12T01:29:15.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.880+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.984568748290615973', time=2024-09-12T03:23:42.828813+0000, chain.objs.size()=1 2024-09-12T01:29:15.880 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.880+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.665__shadow_.cNpr5R80lcfGdWq5sCTE8UVZ2Kyw2cp_0 2024-09-12T01:29:15.881 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.881+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16135468082698457824', time=2024-09-12T03:24:03.355299+0000, chain.objs.size()=1 2024-09-12T01:29:15.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.881+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.702__multipart_file1.2~Q9qGgKYW85cNOC6kJK0aPbHNrFrQck1.1 2024-09-12T01:29:15.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.881+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5643852222313824446', time=2024-09-12T03:24:57.092088+0000, chain.objs.size()=3 2024-09-12T01:29:15.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.881+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.743__multipart_mymultipart3.2~C0eDG1Caq62JxOZAc7xDFjdMnuBMcq6.1 2024-09-12T01:29:15.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.881+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.743__multipart_mymultipart3.2~C0eDG1Caq62JxOZAc7xDFjdMnuBMcq6.2 2024-09-12T01:29:15.882 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.881+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.743__multipart_mymultipart3.2~C0eDG1Caq62JxOZAc7xDFjdMnuBMcq6.3 2024-09-12T01:29:15.886 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.886+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.888 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.888+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:29:15.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.890+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.890 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.890+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.891 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49464' 2024-09-12T01:29:15.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4626150625842052261', time=2024-09-12T03:06:42.242924+0000, chain.objs.size()=3 2024-09-12T01:29:15.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.159__multipart_mymultipart-LUKEWARM.2~tUTIifPtR3bB-YT2kSqnGhKsuvGHbjG.1 2024-09-12T01:29:15.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.159__multipart_mymultipart-LUKEWARM.2~tUTIifPtR3bB-YT2kSqnGhKsuvGHbjG.2 2024-09-12T01:29:15.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.159__multipart_mymultipart-LUKEWARM.2~tUTIifPtR3bB-YT2kSqnGhKsuvGHbjG.3 2024-09-12T01:29:15.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12280251702566745495', time=2024-09-12T03:07:02.001187+0000, chain.objs.size()=1 2024-09-12T01:29:15.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.171__shadow_.wlqA1ZmBJ5GVU1NO8uPw8N8O0uOu5jX_0 2024-09-12T01:29:15.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2646275513177657677', time=2024-09-12T03:08:56.837283+0000, chain.objs.size()=1 2024-09-12T01:29:15.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.234__shadow_.atZ9sWaKLIqkWvl4CXZXASPA4wXRsUh_0 2024-09-12T01:29:15.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8557904725288526079', time=2024-09-12T03:09:12.423418+0000, chain.objs.size()=1 2024-09-12T01:29:15.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.257__shadow_.hDI24lGrb9ptuMBae7JtN85fZxWA3HP_0 2024-09-12T01:29:15.892 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15030353334987156625', time=2024-09-12T03:09:54.926011+0000, chain.objs.size()=1 2024-09-12T01:29:15.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.BlJUrNGUM4BOoTe3hJ5ZNyOGmzvBgcu_0 2024-09-12T01:29:15.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11150508796883796386', time=2024-09-12T03:09:56.095131+0000, chain.objs.size()=1 2024-09-12T01:29:15.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.n6VGoOLmvhNZ726Huu9ZmpSypSeYMTL_0 2024-09-12T01:29:15.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6361693442803806645', time=2024-09-12T03:09:56.319194+0000, chain.objs.size()=1 2024-09-12T01:29:15.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QMtcDRTA26wOP0FSv1bKeJ5sBqIJBsa_0 2024-09-12T01:29:15.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16814428798894503565', time=2024-09-12T03:09:56.795951+0000, chain.objs.size()=1 2024-09-12T01:29:15.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.2tB_AKJl97On-UXCmzvhoIT75-u0akT_0 2024-09-12T01:29:15.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15392648927953028081', time=2024-09-12T03:09:56.857268+0000, chain.objs.size()=1 2024-09-12T01:29:15.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.n35BtjybG6cyEuEqPgr8esGVzRrbCc__0 2024-09-12T01:29:15.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15715903757256140695', time=2024-09-12T03:09:56.920746+0000, chain.objs.size()=1 2024-09-12T01:29:15.893 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.891+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.o9cqERhTVqLSDwFZbFN9dTuzU4DSM8e_0 2024-09-12T01:29:15.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17145401126346038283', time=2024-09-12T03:09:57.267152+0000, chain.objs.size()=1 2024-09-12T01:29:15.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.L_imkn-cEr9QxXXWYAjH5X-MeSxOL-t_0 2024-09-12T01:29:15.895 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7982648354322046425', time=2024-09-12T03:09:58.575470+0000, chain.objs.size()=1 2024-09-12T01:29:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Bf7lhGR1ZHfEcMED3w6wxZrxlsYdFsZ_0 2024-09-12T01:29:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16932940808293532176', time=2024-09-12T03:09:58.595275+0000, chain.objs.size()=1 2024-09-12T01:29:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.E_z1v0Me5rv1kQHPIeFJyqNRkq99w3Q_0 2024-09-12T01:29:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.968121327937640862', time=2024-09-12T03:09:58.722188+0000, chain.objs.size()=1 2024-09-12T01:29:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.wejSKPjuViR2XS_XxRa0C_-fSARIbuG_0 2024-09-12T01:29:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6103300570421847151', time=2024-09-12T03:09:59.535314+0000, chain.objs.size()=1 2024-09-12T01:29:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.iavMQ6NYjnsFSKS__azamXzSpiqGYnp_0 2024-09-12T01:29:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18240084156528703977', time=2024-09-12T03:09:59.671429+0000, chain.objs.size()=1 2024-09-12T01:29:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.KGyck-rF8qCfgFlX1JBsZuLCalltPpy_0 2024-09-12T01:29:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1497511253228612281', time=2024-09-12T03:10:00.228685+0000, chain.objs.size()=1 2024-09-12T01:29:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.XolFbDmg9TsplosTAgsvMx0-N9JShdR_0 2024-09-12T01:29:15.896 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13146940139454118684', time=2024-09-12T03:10:01.054161+0000, chain.objs.size()=1 2024-09-12T01:29:15.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.tgXX2ggPoNH7-h4LzhmnQC98UlZHwYx_0 2024-09-12T01:29:15.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9069104093371219186', time=2024-09-12T03:10:01.227325+0000, chain.objs.size()=1 2024-09-12T01:29:15.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Gcryd8qvzbUuAjT-xxY46tjcL4w2jnS_0 2024-09-12T01:29:15.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.946575367843845615', time=2024-09-12T03:10:01.794200+0000, chain.objs.size()=1 2024-09-12T01:29:15.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QIVjYLyMmYad6yO-jTP-GGmGPQsRQPk_0 2024-09-12T01:29:15.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10915509651967989600', time=2024-09-12T03:10:02.036925+0000, chain.objs.size()=1 2024-09-12T01:29:15.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.895+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.JlIPlrvR-Vd6RmexBEV5x71kxpv5kE9_0 2024-09-12T01:29:15.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.897+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16752144568372271619', time=2024-09-12T03:10:02.656189+0000, chain.objs.size()=1 2024-09-12T01:29:15.897 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.897+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.LjIHVjlbBxiLekcvslCQuV-2mtl58Ku_0 2024-09-12T01:29:15.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.898+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14671082180726937138', time=2024-09-12T03:10:02.999143+0000, chain.objs.size()=1 2024-09-12T01:29:15.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.898+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.DF5j3oZZDJlE43PSd2c13ODQGDoWqwx_0 2024-09-12T01:29:15.898 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.898+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18437197712635495093', time=2024-09-12T03:10:03.000322+0000, chain.objs.size()=1 2024-09-12T01:29:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.898+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.h3HBCZMrHhLW0qVN_8zrfN7spwNKjf6_0 2024-09-12T01:29:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.898+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13928262652316428573', time=2024-09-12T03:10:03.316083+0000, chain.objs.size()=1 2024-09-12T01:29:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.898+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.gF6_2OpgwQTI1esuj2Hz9_-PlRV5f3A_0 2024-09-12T01:29:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.898+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17854481064682352316', time=2024-09-12T03:10:03.639133+0000, chain.objs.size()=1 2024-09-12T01:29:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.898+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.acazZfnIp0hORj68DA4Ajn3cu201KYz_0 2024-09-12T01:29:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.898+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14140804448683638759', time=2024-09-12T03:10:03.724215+0000, chain.objs.size()=1 2024-09-12T01:29:15.899 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.898+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.fj3z0-6WFKfvbX8vlNRjxRlP1-Ybgy0_0 2024-09-12T01:29:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.899+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6380163488606074707', time=2024-09-12T03:10:03.803002+0000, chain.objs.size()=1 2024-09-12T01:29:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.899+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.EFy5VTywAh5mJd2cImMIm8LsY_aE4-Z_0 2024-09-12T01:29:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.899+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4782090424198510102', time=2024-09-12T03:10:03.845284+0000, chain.objs.size()=1 2024-09-12T01:29:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.899+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.du5hHG-4k9wfPvRFd-0Gll-cnfG3kba_0 2024-09-12T01:29:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.899+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16572508165528237697', time=2024-09-12T03:10:03.858878+0000, chain.objs.size()=1 2024-09-12T01:29:15.900 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.899+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.N7SkQoyJv3dqq_YNHeSTg9Idee-LhRH_0 2024-09-12T01:29:15.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.899+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8206550593443850538', time=2024-09-12T03:10:04.868823+0000, chain.objs.size()=1 2024-09-12T01:29:15.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.899+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.fb9USBYnt72OQCNEgxDrvh8h1Y58o5n_0 2024-09-12T01:29:15.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.901+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4042705129120113583', time=2024-09-12T03:10:05.197818+0000, chain.objs.size()=1 2024-09-12T01:29:15.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.901+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.xCwCVmOS5OUTKU4bPabCAtWPxDRn_HZ_0 2024-09-12T01:29:15.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.901+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1868017842094539306', time=2024-09-12T03:10:05.397092+0000, chain.objs.size()=1 2024-09-12T01:29:15.901 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.901+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PXDIMR0ol2-N865ttWtIlwB9NDGUGJ7_0 2024-09-12T01:29:15.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.903+0000 7f4c2e6e3640 0 -- 172.21.15.62:0/837013543 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x7f4af8087480 msgr2=0x7f4af80898b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:29:15.904 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13218690573448750564', time=2024-09-12T03:10:05.722162+0000, chain.objs.size()=1 2024-09-12T01:29:15.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lvlxoTQANsxu4L0fOYL6te7qjWZF3K1_0 2024-09-12T01:29:15.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8960355136432242311', time=2024-09-12T03:10:05.919936+0000, chain.objs.size()=1 2024-09-12T01:29:15.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.h3RkOlGLzxFo7MABeEqfs-nZz-uL1r7_0 2024-09-12T01:29:15.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7233001067265850416', time=2024-09-12T03:10:06.028628+0000, chain.objs.size()=1 2024-09-12T01:29:15.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.raTIif_ZNFXlX0tSg9uJUMeIFT970n8_0 2024-09-12T01:29:15.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13796327326260006151', time=2024-09-12T03:10:06.257999+0000, chain.objs.size()=1 2024-09-12T01:29:15.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._N1qH3Ku-y7CGBxwtg6f6Vg88KlORFB_0 2024-09-12T01:29:15.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13728930489869003725', time=2024-09-12T03:10:06.696376+0000, chain.objs.size()=1 2024-09-12T01:29:15.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Xu5S9dYRFfg9NoStFyBnmzzKs6U7-cR_0 2024-09-12T01:29:15.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5352972796307056802', time=2024-09-12T03:10:12.689737+0000, chain.objs.size()=1 2024-09-12T01:29:15.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.272__shadow_.geM_94Y3OKqOCKRb7WZZLKisUMfI2UW_0 2024-09-12T01:29:15.905 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16836790302350365516', time=2024-09-12T03:10:15.140356+0000, chain.objs.size()=1 2024-09-12T01:29:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.276__shadow_.NsOH-Z4T0R0SclW7PSCSpufGQtCN-nb_0 2024-09-12T01:29:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14542400118139486066', time=2024-09-12T03:10:23.111866+0000, chain.objs.size()=1 2024-09-12T01:29:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.288__shadow_.zNTQp4MwMkCUz-4_kgR550VY_7OQjz6_0 2024-09-12T01:29:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8556781305523981418', time=2024-09-12T03:10:27.125424+0000, chain.objs.size()=1 2024-09-12T01:29:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.904+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.FNUn4pTTmu46Bu-gIMVulohndat6oxB_0 2024-09-12T01:29:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.905+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9804394723565623079', time=2024-09-12T03:10:27.186616+0000, chain.objs.size()=1 2024-09-12T01:29:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.905+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.CgkLf6GbZ6qBdSruMrX_Py0ceIExE8U_0 2024-09-12T01:29:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.905+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6066169520929529814', time=2024-09-12T03:10:29.192986+0000, chain.objs.size()=1 2024-09-12T01:29:15.906 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.905+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.RoTbTVBd0j0P74XTR3Hy5RXqF5Mp52k_0 2024-09-12T01:29:15.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.907+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15753957566218158020', time=2024-09-12T03:10:29.202632+0000, chain.objs.size()=1 2024-09-12T01:29:15.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.907+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.lo_cC-S8tlttswgcTsXR9PbYcBs8_go_0 2024-09-12T01:29:15.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.907+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12586345638851347384', time=2024-09-12T03:10:30.507579+0000, chain.objs.size()=1 2024-09-12T01:29:15.907 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.907+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.295__shadow_.5olJwAvVM9D-22hKkvdJqAtKLKdatAa_0 2024-09-12T01:29:15.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.907+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6996849184909314613', time=2024-09-12T03:10:35.200517+0000, chain.objs.size()=1 2024-09-12T01:29:15.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.907+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.302__shadow_.F7V3_q0DGbO4xompzqca0-LM-Q9_8sc_0 2024-09-12T01:29:15.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.907+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.342442277696762086', time=2024-09-12T03:11:29.463771+0000, chain.objs.size()=1 2024-09-12T01:29:15.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.907+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.LUeuLbGuYeipKIdz8gLLR33Ly-V9rv5_0 2024-09-12T01:29:15.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.907+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14534162091651228586', time=2024-09-12T03:11:29.744196+0000, chain.objs.size()=1 2024-09-12T01:29:15.908 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.907+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.44V_o2CYNUPTWhlOyBdKOZqbaorx68q_0 2024-09-12T01:29:15.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.909+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16890237778963009064', time=2024-09-12T03:11:29.815798+0000, chain.objs.size()=1 2024-09-12T01:29:15.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.909+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_._Kks7SF61SUkinsbF_jGsiI14u1Pofo_0 2024-09-12T01:29:15.909 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.909+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.317011983208358745', time=2024-09-12T03:11:30.409225+0000, chain.objs.size()=1 2024-09-12T01:29:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.909+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.vsose0jPupsIq9DGeu_xoqsVPB1mUvR_0 2024-09-12T01:29:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.909+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.89723296934489129', time=2024-09-12T03:11:30.532801+0000, chain.objs.size()=1 2024-09-12T01:29:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.909+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.LpUJlWIXVFSE374Lf160Gj3FjuQwNGf_0 2024-09-12T01:29:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.910+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12939081388735049488', time=2024-09-12T03:11:31.301639+0000, chain.objs.size()=1 2024-09-12T01:29:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.910+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.eoBu78vVkn_9t1CUQW56UgxYIV769B7_0 2024-09-12T01:29:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.910+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13283845161666648988', time=2024-09-12T03:11:31.798561+0000, chain.objs.size()=1 2024-09-12T01:29:15.910 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.910+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Y-j8Nhl5zGLPd_T2MQeWHMRrEetm8G7_0 2024-09-12T01:29:15.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.910+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16043321028705043068', time=2024-09-12T03:11:32.883655+0000, chain.objs.size()=1 2024-09-12T01:29:15.911 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.910+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.pqI9chS8qCfNtLMo1Yfj0g8PcskZ2yU_0 2024-09-12T01:29:15.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.911+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16284334336687364659', time=2024-09-12T03:11:34.621837+0000, chain.objs.size()=1 2024-09-12T01:29:15.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.911+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.iePpd8L6eaOryj5N7v6jHkZakt9FLL4_0 2024-09-12T01:29:15.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.911+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17859368627536151567', time=2024-09-12T03:11:34.899102+0000, chain.objs.size()=1 2024-09-12T01:29:15.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.911+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.L-uU48Ywo1BmMtlHpS8NW9DaPrnt4A2_0 2024-09-12T01:29:15.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.911+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10606603849457593206', time=2024-09-12T03:11:35.134609+0000, chain.objs.size()=1 2024-09-12T01:29:15.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.911+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.yTehicZgxZ4j9AiecfxqueIL7MhHU0w_0 2024-09-12T01:29:15.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.911+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4149467843562489039', time=2024-09-12T03:11:35.220132+0000, chain.objs.size()=1 2024-09-12T01:29:15.913 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.911+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.sBeSxs7s1Cs2ThQ3sTEofaMuzDHbC4n_0 2024-09-12T01:29:15.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.914+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3775057790367901790', time=2024-09-12T03:11:35.400564+0000, chain.objs.size()=1 2024-09-12T01:29:15.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.914+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.M0aProqg2Hv-4-wBKjsShl5L6JXJVuo_0 2024-09-12T01:29:15.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.914+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16557560241661654772', time=2024-09-12T03:11:35.568878+0000, chain.objs.size()=1 2024-09-12T01:29:15.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.914+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MX2SZvVMN1ihCoRryPUdacTts6WmwjB_0 2024-09-12T01:29:15.914 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.914+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12283900138331575639', time=2024-09-12T03:11:35.671409+0000, chain.objs.size()=1 2024-09-12T01:29:15.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.914+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.skL-Iag78cOqk2mYhUWFs72L12UjjQm_0 2024-09-12T01:29:15.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.914+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8054002340405533622', time=2024-09-12T03:11:36.086927+0000, chain.objs.size()=1 2024-09-12T01:29:15.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.914+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.kfxq4Mzmjt-awf-m4yQSgggJdedC2fq_0 2024-09-12T01:29:15.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.914+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2823972491182449227', time=2024-09-12T03:11:36.668716+0000, chain.objs.size()=1 2024-09-12T01:29:15.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.914+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xWnf90t_52etmMdAb5xBudRgLLgP2k4_0 2024-09-12T01:29:15.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.914+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5897422364880677565', time=2024-09-12T03:11:36.830681+0000, chain.objs.size()=1 2024-09-12T01:29:15.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.914+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tuTve6xoXoDZi_KfN4ViSM-3znCTDQY_0 2024-09-12T01:29:15.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.914+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10574940703341527452', time=2024-09-12T03:11:37.674630+0000, chain.objs.size()=1 2024-09-12T01:29:15.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.914+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.gDggyDRlp-vSTDOdqFGUjcaotTdsLPd_0 2024-09-12T01:29:15.915 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.914+0000 7f4c2f6e5640 0 -- 172.21.15.62:0/837013543 >> [v2:172.21.15.77:6816/3177889521,v1:172.21.15.77:6817/3177889521] conn(0x55cdb5f8ef90 msgr2=0x55cdb5f91450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:29:15.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.916+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8704163413359717305', time=2024-09-12T03:11:37.896696+0000, chain.objs.size()=1 2024-09-12T01:29:15.916 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.916+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Kf2ixKNGEZ__IcY9c3ORIDdPes87eHZ_0 2024-09-12T01:29:15.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.918+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11323067199296839327', time=2024-09-12T03:11:38.013285+0000, chain.objs.size()=1 2024-09-12T01:29:15.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.918+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.FY0imSSgxlFnzk5u1MpVRThhVGRG5fU_0 2024-09-12T01:29:15.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.918+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16481741655823623004', time=2024-09-12T03:11:38.055997+0000, chain.objs.size()=1 2024-09-12T01:29:15.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.918+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.uaeBz46OHywg4UT4fN_HoXZVuaWg8kt_0 2024-09-12T01:29:15.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.918+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2842748059726681952', time=2024-09-12T03:11:39.550229+0000, chain.objs.size()=1 2024-09-12T01:29:15.918 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.918+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ZJDLByUVqClo_ssnZpbiLK0bq5Xg2a1_0 2024-09-12T01:29:15.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.918+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4432652842018201158', time=2024-09-12T03:11:40.041360+0000, chain.objs.size()=1 2024-09-12T01:29:15.919 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.918+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ti5cS2_Lig1viaCSJwvXW8ahcox8ZHw_0 2024-09-12T01:29:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.920+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8630341874093065999', time=2024-09-12T03:11:40.890548+0000, chain.objs.size()=1 2024-09-12T01:29:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.920+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ccbizUl-YJuwh2tHKjYRYIzaHCzMwYz_0 2024-09-12T01:29:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.920+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8069379437942664497', time=2024-09-12T03:12:22.467960+0000, chain.objs.size()=1 2024-09-12T01:29:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.920+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.74p7K10Rfr3jt3qod7rU8NkpmhcydEF_0 2024-09-12T01:29:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.920+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8678967857850847294', time=2024-09-12T03:12:22.468783+0000, chain.objs.size()=1 2024-09-12T01:29:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.920+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.JYjlvdh3FFqklzqOOhXjU7qb1ViqJ2E_0 2024-09-12T01:29:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.920+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6695276615406248703', time=2024-09-12T03:12:22.642777+0000, chain.objs.size()=1 2024-09-12T01:29:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.920+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.b19RoKDxI7LmTvZ8joxLMWAYVO0vYjb_0 2024-09-12T01:29:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.920+0000 7f4c2e6e3640 0 -- 172.21.15.62:0/837013543 >> [v2:172.21.15.77:6800/200143849,v1:172.21.15.77:6801/200143849] conn(0x7f4c28061040 msgr2=0x7f4c280a7d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:29:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.920+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11769567002295151527', time=2024-09-12T03:12:22.739362+0000, chain.objs.size()=1 2024-09-12T01:29:15.921 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.920+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MQXW6MZFz2qDQaZw5nE8efAxIGeG6Qu_0 2024-09-12T01:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.920+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1955770107278135615', time=2024-09-12T03:12:22.833648+0000, chain.objs.size()=1 2024-09-12T01:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.920+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.q0OWrL299MWqTS3uhC4feLq290lq7tM_0 2024-09-12T01:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.920+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7387923882422698829', time=2024-09-12T03:12:22.997371+0000, chain.objs.size()=1 2024-09-12T01:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.920+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.kH8unql8Z0iUblgvLLiKdSc8QLVXVxY_0 2024-09-12T01:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.922+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8366477402486575309', time=2024-09-12T03:12:22.998047+0000, chain.objs.size()=1 2024-09-12T01:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.922+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RE4Kmuka-OI4gCLKvSH0v1d9eq3KZ-3_0 2024-09-12T01:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.922+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6383485175734462736', time=2024-09-12T03:12:23.065813+0000, chain.objs.size()=1 2024-09-12T01:29:15.922 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.922+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.CvyaPVHoGPCwogiZg1M_laoqcx9M5Cn_0 2024-09-12T01:29:15.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.923+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.301054545148775538', time=2024-09-12T03:12:23.780472+0000, chain.objs.size()=1 2024-09-12T01:29:15.923 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.923+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.XhsKocAegp7CW3t4tdm2W57IY15gfz__0 2024-09-12T01:29:15.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.923+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10074448497638089795', time=2024-09-12T03:12:24.487697+0000, chain.objs.size()=1 2024-09-12T01:29:15.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.923+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RtCYcrU29ITc2_AIxPu8jVMCFlLXVwW_0 2024-09-12T01:29:15.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.923+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3734843200809965471', time=2024-09-12T03:12:24.715669+0000, chain.objs.size()=1 2024-09-12T01:29:15.924 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.923+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.c0dEV3FTmN4f0arZJi_uOhZvlxYHBJP_0 2024-09-12T01:29:15.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.925+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16499218179868747469', time=2024-09-12T03:12:24.763270+0000, chain.objs.size()=1 2024-09-12T01:29:15.925 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.925+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.5qO1uYmemOKip-MZMpI6_S-anRqBH9D_0 2024-09-12T01:29:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.925+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17897504303510438158', time=2024-09-12T03:12:26.075094+0000, chain.objs.size()=1 2024-09-12T01:29:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.925+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Au-pqS7oE4gSTStLnsRv5Nd0y1lWv_9_0 2024-09-12T01:29:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.925+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17262018752580342550', time=2024-09-12T03:12:27.090574+0000, chain.objs.size()=1 2024-09-12T01:29:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.925+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RKSi4BjVpzFg12puSEk_lY6Rix0jnlT_0 2024-09-12T01:29:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.925+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4086571169533532864', time=2024-09-12T03:12:27.499247+0000, chain.objs.size()=1 2024-09-12T01:29:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.925+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RByY_eAH-E62_UumBai3nsTOWxL4mTd_0 2024-09-12T01:29:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.925+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6274814140849422966', time=2024-09-12T03:12:29.343792+0000, chain.objs.size()=1 2024-09-12T01:29:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.925+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.VTnHOwCE_9wIj479bcs880VssPj8UbG_0 2024-09-12T01:29:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.925+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6432596928389747149', time=2024-09-12T03:12:29.549528+0000, chain.objs.size()=1 2024-09-12T01:29:15.926 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.925+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.19NoT0w6DukRn4s0v32YBb4ypCz3qag_0 2024-09-12T01:29:15.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.926+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.198623044912791111', time=2024-09-12T03:12:29.550114+0000, chain.objs.size()=1 2024-09-12T01:29:15.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.926+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ctPiq5EDMNTh-SAoo6OD85e5fpmZvl2_0 2024-09-12T01:29:15.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.927+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7335540206667023756', time=2024-09-12T03:12:29.559259+0000, chain.objs.size()=1 2024-09-12T01:29:15.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.927+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-ukDEJ8L5yItpKHSQe-TkjNol16GJK9_0 2024-09-12T01:29:15.927 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.927+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18269499821013044962', time=2024-09-12T03:12:29.603793+0000, chain.objs.size()=1 2024-09-12T01:29:15.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.927+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.IETzqYB660qyOLn4mplg_Jr0Wh7NrAJ_0 2024-09-12T01:29:15.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.928+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7088655439170823275', time=2024-09-12T03:12:31.065824+0000, chain.objs.size()=1 2024-09-12T01:29:15.928 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.928+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.63Rt648UnO6VdcVfkSeBl-7ystC4_nS_0 2024-09-12T01:29:15.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.928+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6821556784636886141', time=2024-09-12T03:12:31.334070+0000, chain.objs.size()=1 2024-09-12T01:29:15.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.928+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.cA2tb5NSLPZK0I62LyQjz-2mCxYJf-Y_0 2024-09-12T01:29:15.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.928+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4957265072726082872', time=2024-09-12T03:12:32.476529+0000, chain.objs.size()=1 2024-09-12T01:29:15.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.928+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xEzv0wPBMsutsV_mXmHcgZct4B23LjW_0 2024-09-12T01:29:15.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.928+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10848701370288672231', time=2024-09-12T03:12:32.477259+0000, chain.objs.size()=1 2024-09-12T01:29:15.929 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.928+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.djRiLEx7o0g-Nk9-eeinRU9GjmNVQnm_0 2024-09-12T01:29:15.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.930+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10708351759496811902', time=2024-09-12T03:12:32.849794+0000, chain.objs.size()=1 2024-09-12T01:29:15.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.930+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1DqGAnel1jA2BWmjZ0bgnGBr23rnDXk_0 2024-09-12T01:29:15.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.930+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5248437074194584042', time=2024-09-12T03:12:32.865591+0000, chain.objs.size()=1 2024-09-12T01:29:15.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.930+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.NmZ4otQWaZlSYaExf0kxKfQPTP9A52-_0 2024-09-12T01:29:15.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.930+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14052673128195066614', time=2024-09-12T03:12:33.617500+0000, chain.objs.size()=1 2024-09-12T01:29:15.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.930+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xGalVqapiC9MLKvX6Wj8YGSutt9xJlr_0 2024-09-12T01:29:15.930 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.930+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8446538177899718991', time=2024-09-12T03:12:33.702329+0000, chain.objs.size()=1 2024-09-12T01:29:15.931 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.930+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.PaAEcrRPserqjMfbeKr2R_7xzEXqon9_0 2024-09-12T01:29:15.933 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.933+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/49464 2024-09-12T01:29:15.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-12T01:29:15.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8746520407352229909', time=2024-09-12T03:12:33.764375+0000, chain.objs.size()=1 2024-09-12T01:29:15.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.loV4xzOqUrWZ0rWGnhvFKgtaVQXZKE4_0 2024-09-12T01:29:15.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3861543921496848870', time=2024-09-12T03:12:34.079982+0000, chain.objs.size()=1 2024-09-12T01:29:15.936 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.vryuJrrShDSCYdANbNeoN68cdBkzrXR_0 2024-09-12T01:29:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2411073199686493920', time=2024-09-12T03:12:34.370881+0000, chain.objs.size()=1 2024-09-12T01:29:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.wRzh3R97JxGL9wNRforLCbqTxdU3rzk_0 2024-09-12T01:29:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16566343791247520095', time=2024-09-12T03:12:34.470534+0000, chain.objs.size()=1 2024-09-12T01:29:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.yOGICuyipireiF9tbVVeSMTVjMfPOSA_0 2024-09-12T01:29:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1708908964434418587', time=2024-09-12T03:12:41.733542+0000, chain.objs.size()=1 2024-09-12T01:29:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.337__shadow_.5O6hwNlqilkblF4Lc43UDMMBC2HhVSW_0 2024-09-12T01:29:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4349892703632961123', time=2024-09-12T03:14:05.859705+0000, chain.objs.size()=1 2024-09-12T01:29:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.484__shadow_.PAnX-vbI8LfuCnVFMsMQIpDy_CoPuHD_0 2024-09-12T01:29:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7209419500082540639', time=2024-09-12T03:14:29.092784+0000, chain.objs.size()=6 2024-09-12T01:29:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.1 2024-09-12T01:29:15.937 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.2 2024-09-12T01:29:15.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.3 2024-09-12T01:29:15.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.4 2024-09-12T01:29:15.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.5 2024-09-12T01:29:15.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.935+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.6 2024-09-12T01:29:15.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.937+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1569162122659741722', time=2024-09-12T03:14:40.461887+0000, chain.objs.size()=1 2024-09-12T01:29:15.938 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.937+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.517__shadow_.BO81mXms74Wg8MvEgQBekELOmuqvqca_0 2024-09-12T01:29:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12735428283575900311', time=2024-09-12T03:18:19.312106+0000, chain.objs.size()=1 2024-09-12T01:29:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:3fTT2wAefvSkC10tYpWIKtbYRe91BrN_.HTfX6O0Df1KcRIsMOE52Qp3D39x-60W_0 2024-09-12T01:29:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17916454173928938628', time=2024-09-12T03:18:33.020057+0000, chain.objs.size()=1 2024-09-12T01:29:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:gUldAhKtKwKs5fSjVr9OV9VoYhW4pri_.yti7R-P1Lj1OlGD3TFrDBXouUK5SCDk_0 2024-09-12T01:29:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14718124894005654717', time=2024-09-12T03:18:56.671234+0000, chain.objs.size()=1 2024-09-12T01:29:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.587__shadow:Ynd7CSekdeeZWGGpAs3wXCsOwNtfRNI_.K0UofLMmE6u9uJvbqdnuzRo_PQ_m49G_0 2024-09-12T01:29:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13869216895427531359', time=2024-09-12T03:20:16.197785+0000, chain.objs.size()=1 2024-09-12T01:29:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.616__shadow_.gIUIJx3HwJgJ2d45Xi03PwaW4RC7sBD_0 2024-09-12T01:29:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4016083878125419184', time=2024-09-12T03:23:03.089698+0000, chain.objs.size()=1 2024-09-12T01:29:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.639__shadow_.2Ck6vknA0B9YqTz-b8gfnevtAdSAQTO_0 2024-09-12T01:29:15.940 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13646608737931271816', time=2024-09-12T03:23:43.857955+0000, chain.objs.size()=1 2024-09-12T01:29:15.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.666__shadow_.ZGfRXV2bWg-DXrKQeLQcWsubTES5aCj_0 2024-09-12T01:29:15.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12983283540886885964', time=2024-09-12T03:24:04.789825+0000, chain.objs.size()=1 2024-09-12T01:29:15.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.704__shadow:36blnZ1jp0.S0k1dNdd9QQBsv-STeEt_.f4YL26XTRLhueYMVDGL9Q-fFFGmYSfg_0 2024-09-12T01:29:15.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9382213262943571773', time=2024-09-12T03:24:09.344805+0000, chain.objs.size()=1 2024-09-12T01:29:15.941 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.939+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.711__multipart_file1.2~sXRUN8SITRyopVu8SJoGMAf1x8gUIxH.1 2024-09-12T01:29:15.943 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.943+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:15.945 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.945+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:29:15.947 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.947+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:15.948 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.948+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:15.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.948+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/53613' 2024-09-12T01:29:15.949 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.948+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.250620445466967362', time=2024-09-12T03:06:42.271168+0000, chain.objs.size()=3 2024-09-12T01:29:15.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.948+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.159__multipart_mymultipart-STANDARD.2~AFv1P0DIM33SdMyu8hxsNTbMKsTzYC8.1 2024-09-12T01:29:15.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.948+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.159__multipart_mymultipart-STANDARD.2~AFv1P0DIM33SdMyu8hxsNTbMKsTzYC8.2 2024-09-12T01:29:15.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.948+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.159__multipart_mymultipart-STANDARD.2~AFv1P0DIM33SdMyu8hxsNTbMKsTzYC8.3 2024-09-12T01:29:15.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.948+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_KzWpJkapjofejbT-FUrabHiibdzT1al', time=2024-09-12T03:06:48.905576+0000, chain.objs.size()=1 2024-09-12T01:29:15.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.948+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__shadow_.slhxxKmWPfym6tuArtgV2MnLVAHMKCh_0 2024-09-12T01:29:15.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11732979897487625884', time=2024-09-12T03:08:54.874745+0000, chain.objs.size()=1 2024-09-12T01:29:15.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.231__shadow_.EjPnwgzWx9Y7Kbx_ZXCg67vTeKP_S7N_0 2024-09-12T01:29:15.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8040506771095415433', time=2024-09-12T03:08:59.051949+0000, chain.objs.size()=1 2024-09-12T01:29:15.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.237__shadow_.evO9rpzz1IhjpQZiqMGPXuiV9p96D75_0 2024-09-12T01:29:15.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2957258786151416189', time=2024-09-12T03:09:06.026895+0000, chain.objs.size()=1 2024-09-12T01:29:15.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.247__shadow_._mg7yAUUNNX7_GzS0KiuseedpOyRJPx_0 2024-09-12T01:29:15.950 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7739202710016506278', time=2024-09-12T03:09:09.906438+0000, chain.objs.size()=1 2024-09-12T01:29:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.253__shadow_.RDpZQOrxCNO1T7yGprfLRBQ6dbqOwgm_0 2024-09-12T01:29:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12560772924280384730', time=2024-09-12T03:09:54.278295+0000, chain.objs.size()=1 2024-09-12T01:29:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ZmZjjrKVIJKQA5Xc_IH8IXBuAJNIOeh_0 2024-09-12T01:29:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8354026044534276523', time=2024-09-12T03:09:54.639393+0000, chain.objs.size()=1 2024-09-12T01:29:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lL47tlHbFQMOzyM3nWQEuaiOOURYyzp_0 2024-09-12T01:29:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14023855372934400760', time=2024-09-12T03:09:55.230188+0000, chain.objs.size()=1 2024-09-12T01:29:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.n1xEatIwbSot91ky37IPscyDM1_FeUv_0 2024-09-12T01:29:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7659557533923530327', time=2024-09-12T03:09:55.423436+0000, chain.objs.size()=1 2024-09-12T01:29:15.951 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.949+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.3DnjT4qjTpQbNfrwsLFew-uzbx4z-8T_0 2024-09-12T01:29:15.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8064217718738517101', time=2024-09-12T03:09:56.101592+0000, chain.objs.size()=1 2024-09-12T01:29:15.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.BWB87qusYW4s515TrMbLBYupc_Cs6Vk_0 2024-09-12T01:29:15.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5284141352303333232', time=2024-09-12T03:09:56.214520+0000, chain.objs.size()=1 2024-09-12T01:29:15.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.hRpDKbaHbmqiaB3gBFPSu15AkyZn5qm_0 2024-09-12T01:29:15.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6907106225460677816', time=2024-09-12T03:09:56.314398+0000, chain.objs.size()=1 2024-09-12T01:29:15.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QQ2UjTNzgfaOsGkbCZjMvxTuEcYtgA7_0 2024-09-12T01:29:15.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2945250040927517033', time=2024-09-12T03:09:56.397820+0000, chain.objs.size()=1 2024-09-12T01:29:15.953 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.MQiwjRTnc4yNG952Y70lRKf8zk1pAOq_0 2024-09-12T01:29:15.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17779854874175915116', time=2024-09-12T03:09:56.652731+0000, chain.objs.size()=1 2024-09-12T01:29:15.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Diuv3hXkLNxTeZ3ufN6n7kkG2I72o6M_0 2024-09-12T01:29:15.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10571370511755702363', time=2024-09-12T03:09:56.841737+0000, chain.objs.size()=1 2024-09-12T01:29:15.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.MVsnCWAM2PN5xmF6BIV-Wy69-QSA4QR_0 2024-09-12T01:29:15.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9361808044352991891', time=2024-09-12T03:09:57.093217+0000, chain.objs.size()=1 2024-09-12T01:29:15.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.w7IgRcDsLPOuuqw16Flf2Fy0GoJRnMK_0 2024-09-12T01:29:15.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15998040002390558510', time=2024-09-12T03:09:57.781621+0000, chain.objs.size()=1 2024-09-12T01:29:15.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.SKc4aBKVkZggZNA5DYH_3d8lMGA6uFq_0 2024-09-12T01:29:15.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2051593561787279481', time=2024-09-12T03:09:58.805123+0000, chain.objs.size()=1 2024-09-12T01:29:15.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Lmgc4nKP-BWxw_PAVO_bSghFJaxk-Gk_0 2024-09-12T01:29:15.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17981761799471619191', time=2024-09-12T03:09:58.850234+0000, chain.objs.size()=1 2024-09-12T01:29:15.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.952+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.hd6SaoFwTp_VYdhmJn3x_GP0-wKz-G8_0 2024-09-12T01:29:15.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.953+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13550867206269408994', time=2024-09-12T03:09:58.930143+0000, chain.objs.size()=1 2024-09-12T01:29:15.954 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.953+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8ppm6lhAtJy6130fwvYitqfz-wzRwTk_0 2024-09-12T01:29:15.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.956+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4818132596471052477', time=2024-09-12T03:09:59.679678+0000, chain.objs.size()=1 2024-09-12T01:29:15.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.956+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PSc3gz4mKE0mwYO6hWtg1b3mdXZZIxq_0 2024-09-12T01:29:15.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.956+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1353454354422007343', time=2024-09-12T03:09:59.680543+0000, chain.objs.size()=1 2024-09-12T01:29:15.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.956+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.CIxFaOe7bdBuzm-3zWnpf-s9QzjxgLT_0 2024-09-12T01:29:15.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.956+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3978581459232247298', time=2024-09-12T03:09:59.952756+0000, chain.objs.size()=1 2024-09-12T01:29:15.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.956+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0PAkJxMyJPhImLpy_plSrmmO5CA7U_6_0 2024-09-12T01:29:15.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.956+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16817056927129039843', time=2024-09-12T03:10:00.101491+0000, chain.objs.size()=1 2024-09-12T01:29:15.957 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.956+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.qv4LcfE9NxhrJ_WolXRD7ZV7Zf5AqAx_0 2024-09-12T01:29:15.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.957+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2719804476982575457', time=2024-09-12T03:10:00.102354+0000, chain.objs.size()=1 2024-09-12T01:29:15.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.957+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.rEa2KxDFbYxAFokSCTvp6Ako6DkQMH2_0 2024-09-12T01:29:15.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.957+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.802217297131193792', time=2024-09-12T03:10:00.199096+0000, chain.objs.size()=1 2024-09-12T01:29:15.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.957+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QzoHOeItoJOGrXeUX4YvhH4oq9xckXC_0 2024-09-12T01:29:15.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.957+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15417753577620222149', time=2024-09-12T03:10:00.199786+0000, chain.objs.size()=1 2024-09-12T01:29:15.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.957+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9wsJqmk9POmCAW6441DAr-HMGKYSMSh_0 2024-09-12T01:29:15.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.957+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15865417381699139351', time=2024-09-12T03:10:00.553184+0000, chain.objs.size()=1 2024-09-12T01:29:15.958 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.957+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.uk4e9NWx3Cg37_7OHl4wwX78mQIAQC1_0 2024-09-12T01:29:15.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.957+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3436665427940709522', time=2024-09-12T03:10:01.848996+0000, chain.objs.size()=1 2024-09-12T01:29:15.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.957+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.q5ry71eYc6pw9uuBuVJUbZCnHvTIldH_0 2024-09-12T01:29:15.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.957+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.798067059230478432', time=2024-09-12T03:10:01.849916+0000, chain.objs.size()=1 2024-09-12T01:29:15.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.957+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0t-U0PjX_oz4HWjPDOS7IAmjhHvgKqN_0 2024-09-12T01:29:15.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.957+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15419999296154075005', time=2024-09-12T03:10:01.875035+0000, chain.objs.size()=1 2024-09-12T01:29:15.959 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.957+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.JuHDM4c8fiFny_eSq0unbf-TsALZeBG_0 2024-09-12T01:29:15.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.961+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7283315125967319992', time=2024-09-12T03:10:02.083008+0000, chain.objs.size()=1 2024-09-12T01:29:15.961 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.961+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.TcQ9F5r58nuomEzxz7-9TVitUpjQWWJ_0 2024-09-12T01:29:15.962 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18187216468530913146', time=2024-09-12T03:10:03.278748+0000, chain.objs.size()=1 2024-09-12T01:29:15.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PnEyia-9Tb_Lf39IFqUEELJZ7v0XRV1_0 2024-09-12T01:29:15.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17532647056039035780', time=2024-09-12T03:10:03.336438+0000, chain.objs.size()=1 2024-09-12T01:29:15.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RVFdJwvJJBNeYwnp1NDTvobcg18nOw0_0 2024-09-12T01:29:15.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11010334400653913133', time=2024-09-12T03:10:03.825349+0000, chain.objs.size()=1 2024-09-12T01:29:15.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RKU8fyKz7Cz8w1izveq2nPBAgngK2fh_0 2024-09-12T01:29:15.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7796680589709570074', time=2024-09-12T03:10:04.431295+0000, chain.objs.size()=1 2024-09-12T01:29:15.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ZcgBhaEsWZy-xsEqm-E1XSR7QOrwum3_0 2024-09-12T01:29:15.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4006234463934650053', time=2024-09-12T03:10:04.591478+0000, chain.objs.size()=1 2024-09-12T01:29:15.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.xN8MvHg95nsBn22wi8_pZf4ld5XV_yR_0 2024-09-12T01:29:15.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7747289015597742502', time=2024-09-12T03:10:04.969545+0000, chain.objs.size()=1 2024-09-12T01:29:15.963 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.b0dMPLItpbs1g9tWcvsf24kQjiaJyL1_0 2024-09-12T01:29:15.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4646004439331300339', time=2024-09-12T03:10:04.970393+0000, chain.objs.size()=1 2024-09-12T01:29:15.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.qlR8225WYB_0cSWGhFiTFB2nKbKrZs3_0 2024-09-12T01:29:15.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3842933461377461403', time=2024-09-12T03:10:05.762772+0000, chain.objs.size()=1 2024-09-12T01:29:15.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ss7OEJdO9tI0VA24YLaEvANs4bg7wUV_0 2024-09-12T01:29:15.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3868218438805194334', time=2024-09-12T03:10:06.641819+0000, chain.objs.size()=1 2024-09-12T01:29:15.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._HsV49GQjKai_UlYy-y_iEmzjTkSqLN_0 2024-09-12T01:29:15.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13834990286610553256', time=2024-09-12T03:10:13.859109+0000, chain.objs.size()=1 2024-09-12T01:29:15.964 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.962+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.274__shadow_.htdC7XHnVJeF7HeiI52vUM5xgvvOJHM_0 2024-09-12T01:29:15.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.964+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1269851528268957878', time=2024-09-12T03:10:20.440289+0000, chain.objs.size()=1 2024-09-12T01:29:15.965 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.964+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.284__shadow_.nPDdjlxfQQNlAlNMaHoeP1VMHx6WH6p_0 2024-09-12T01:29:15.966 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8191729067158947093', time=2024-09-12T03:10:24.384282+0000, chain.objs.size()=1 2024-09-12T01:29:15.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.290__shadow_.NDa9e7igCpEMTJx6dwNR6lZG7N-i6nl_0 2024-09-12T01:29:15.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8112266155871935417', time=2024-09-12T03:10:29.874173+0000, chain.objs.size()=1 2024-09-12T01:29:15.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.294__shadow_._QRYrxvnDBqpGUoscKaadRrFULXJ76s_0 2024-09-12T01:29:15.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17617388605044857984', time=2024-09-12T03:10:32.527914+0000, chain.objs.size()=1 2024-09-12T01:29:15.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.298__shadow_.C6fBZ7LH1eoCSM0_CljRw6LSlfVh0Y5_0 2024-09-12T01:29:15.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12736446142955677757', time=2024-09-12T03:11:29.300786+0000, chain.objs.size()=1 2024-09-12T01:29:15.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.6cemuQ0HJDgzRIC-j4ujj0rpr0kRmiA_0 2024-09-12T01:29:15.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16945619053963691318', time=2024-09-12T03:11:29.611196+0000, chain.objs.size()=1 2024-09-12T01:29:15.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.McA4TBu4Q51mNXuw16NuQQIg9pF786M_0 2024-09-12T01:29:15.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15053742758862418327', time=2024-09-12T03:11:30.028722+0000, chain.objs.size()=1 2024-09-12T01:29:15.967 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.nTS3iFIZUaXXrLW6NMejailLL-UfqYc_0 2024-09-12T01:29:15.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9915314208605091921', time=2024-09-12T03:11:30.449852+0000, chain.objs.size()=1 2024-09-12T01:29:15.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.TmiKsLYOzLHKMEV8AESrGbkPohRB_te_0 2024-09-12T01:29:15.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1503610306988034176', time=2024-09-12T03:11:30.505216+0000, chain.objs.size()=1 2024-09-12T01:29:15.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.EvJVLBTpXg_ieJWNGup9KCS9yOqaE_S_0 2024-09-12T01:29:15.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11868210672511867968', time=2024-09-12T03:11:31.519283+0000, chain.objs.size()=1 2024-09-12T01:29:15.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.NAG7n2aYSGvpbRDhpKmOVDrTtN1aQT0_0 2024-09-12T01:29:15.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5427498629822324406', time=2024-09-12T03:11:31.584704+0000, chain.objs.size()=1 2024-09-12T01:29:15.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.966+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fTdN1DwpP-vJROHQqf5LSpQ3L0u110B_0 2024-09-12T01:29:15.968 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.967+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13172496517989118561', time=2024-09-12T03:11:31.666730+0000, chain.objs.size()=1 2024-09-12T01:29:15.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.967+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7bpy6hSBZJXrzTRaHcTsqJ_0xXuWIeW_0 2024-09-12T01:29:15.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.969+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13881819619949259850', time=2024-09-12T03:11:31.712059+0000, chain.objs.size()=1 2024-09-12T01:29:15.969 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.969+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.HXazgxdPGXB8mKK5cW2hjBhaNtsU4N2_0 2024-09-12T01:29:15.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.970+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8943595323483353390', time=2024-09-12T03:11:32.148027+0000, chain.objs.size()=1 2024-09-12T01:29:15.970 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.970+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.AqcmD9R0vMllCOG2SiZsDXJaOXj_62O_0 2024-09-12T01:29:15.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.971+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.169606068182600900', time=2024-09-12T03:11:32.235185+0000, chain.objs.size()=1 2024-09-12T01:29:15.971 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.971+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.PDFJnQU0-poYEO_QRLXJB-abC0dz6Zw_0 2024-09-12T01:29:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.971+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10978407444844698594', time=2024-09-12T03:11:32.871174+0000, chain.objs.size()=1 2024-09-12T01:29:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.971+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mpYjJ_b3LmqWqOqiQu8iSTiepVjneoy_0 2024-09-12T01:29:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.971+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14009102985426581650', time=2024-09-12T03:11:33.029243+0000, chain.objs.size()=1 2024-09-12T01:29:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.971+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.spHZrmkQ_lXp0wzO2mPG_OWZpVmVd8m_0 2024-09-12T01:29:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.971+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7330814180944816424', time=2024-09-12T03:11:33.815510+0000, chain.objs.size()=1 2024-09-12T01:29:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.971+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.j2QYB_O4LPBB-nkCXpz7NHicypep6jb_0 2024-09-12T01:29:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.972+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9636909964920648645', time=2024-09-12T03:11:34.847413+0000, chain.objs.size()=1 2024-09-12T01:29:15.972 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.972+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ak29a4bYKvW_X-WRt6GUnrsxoxcVUSL_0 2024-09-12T01:29:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.972+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15876425411039377360', time=2024-09-12T03:11:35.579596+0000, chain.objs.size()=1 2024-09-12T01:29:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.972+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.niyC82HE65erLDI-zWptlAVNA9KrxCu_0 2024-09-12T01:29:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.972+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.166295352634027248', time=2024-09-12T03:11:36.329292+0000, chain.objs.size()=1 2024-09-12T01:29:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.972+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.YS92d8bXMNvi0RCgdHOlLxCTcFLRdDq_0 2024-09-12T01:29:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.973+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3947011136675778822', time=2024-09-12T03:11:36.891440+0000, chain.objs.size()=1 2024-09-12T01:29:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.973+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.WlDnVOVRDIeeZtYG1q6_Mn_BcQ30ZhZ_0 2024-09-12T01:29:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.973+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16341981327746118105', time=2024-09-12T03:11:38.051679+0000, chain.objs.size()=1 2024-09-12T01:29:15.973 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.973+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.QNp9_LGcI-vgXnB1nPIKu3f10mXkVlC_0 2024-09-12T01:29:15.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.974+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9389032300589919584', time=2024-09-12T03:11:38.313047+0000, chain.objs.size()=1 2024-09-12T01:29:15.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.974+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.aM9ZjNhCBAILtmVOizahTBVq2VFYij2_0 2024-09-12T01:29:15.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.974+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4093458409646767502', time=2024-09-12T03:11:38.721058+0000, chain.objs.size()=1 2024-09-12T01:29:15.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.974+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.lzuSkYZK1bVhQIggK4aHrwaRW2nNzBy_0 2024-09-12T01:29:15.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.974+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18265687964758725618', time=2024-09-12T03:11:39.193402+0000, chain.objs.size()=1 2024-09-12T01:29:15.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.974+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2oJsvJZL5gikizzlWqa2Oh4m-FrUbqp_0 2024-09-12T01:29:15.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.974+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12299601233557085142', time=2024-09-12T03:11:40.225001+0000, chain.objs.size()=1 2024-09-12T01:29:15.975 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.975+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1P9kPWlrZ6qeBcic3Q7FQmYqKuV6y2y_0 2024-09-12T01:29:15.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.976+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6200011477345743232', time=2024-09-12T03:11:40.696983+0000, chain.objs.size()=1 2024-09-12T01:29:15.976 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.976+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.93bG-9sIjPiRPMgYludb5aCMYcrYndf_0 2024-09-12T01:29:15.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.977+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9335086885194722573', time=2024-09-12T03:11:40.826722+0000, chain.objs.size()=1 2024-09-12T01:29:15.977 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.977+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.4Uk0Ei-jwchgWP-3vLXHATKEJw0A-F9_0 2024-09-12T01:29:15.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.978+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13206575980075023491', time=2024-09-12T03:12:21.841469+0000, chain.objs.size()=1 2024-09-12T01:29:15.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.978+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.kiieFZu7cGP3VRRxV3aR4UhoFwMrWOC_0 2024-09-12T01:29:15.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.978+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6467708829236004942', time=2024-09-12T03:12:21.893712+0000, chain.objs.size()=1 2024-09-12T01:29:15.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.978+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.zPtKCmJjHrseBC20NrSa34xsQkvVIqp_0 2024-09-12T01:29:15.978 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.978+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9834534314747704882', time=2024-09-12T03:12:22.099196+0000, chain.objs.size()=1 2024-09-12T01:29:15.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.978+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.BEo5pMd1toy5MO9Bs7UADTQZDUe22RT_0 2024-09-12T01:29:15.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.978+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10395177164175675024', time=2024-09-12T03:12:23.660226+0000, chain.objs.size()=1 2024-09-12T01:29:15.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.978+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.X-KP--BKYHwXnkfF1sGnTcOkeBEx9BB_0 2024-09-12T01:29:15.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.978+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15733049323563935165', time=2024-09-12T03:12:23.981438+0000, chain.objs.size()=1 2024-09-12T01:29:15.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.978+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.8n1BzVPQ1xvWL7nUbOx0QCIqHOcz5Zu_0 2024-09-12T01:29:15.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.979+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16979984490094937252', time=2024-09-12T03:12:24.370980+0000, chain.objs.size()=1 2024-09-12T01:29:15.979 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.979+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.R8EdApVsT7lmrQt1vdwaQwVVJIW0u_d_0 2024-09-12T01:29:15.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.979+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10008275294120271275', time=2024-09-12T03:12:24.412662+0000, chain.objs.size()=1 2024-09-12T01:29:15.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.979+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.7mGc0PS3PlaHZtLyfOIG_XWQ1_Txg9W_0 2024-09-12T01:29:15.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.979+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12160611808749730436', time=2024-09-12T03:12:24.552616+0000, chain.objs.size()=1 2024-09-12T01:29:15.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.979+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RofRTxr2aniHeJVrzvfX4cwqbM0B6eH_0 2024-09-12T01:29:15.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.980+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4022012978698973853', time=2024-09-12T03:12:24.553314+0000, chain.objs.size()=1 2024-09-12T01:29:15.980 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.980+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mZBnhVAYrUTL6dkcrYnxS0Ybhr8eUzZ_0 2024-09-12T01:29:15.982 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.982+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11655176336178243161', time=2024-09-12T03:12:24.823984+0000, chain.objs.size()=1 2024-09-12T01:29:15.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.982+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.X_iSFkKq4jbFpN56T6wZYSlH_eYP8zu_0 2024-09-12T01:29:15.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.982+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15769670421156131345', time=2024-09-12T03:12:25.318612+0000, chain.objs.size()=1 2024-09-12T01:29:15.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.982+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._75O7QtxijrF-5HHgmVNEQxPMugvUwb_0 2024-09-12T01:29:15.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.982+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12172759054867845374', time=2024-09-12T03:12:25.434950+0000, chain.objs.size()=1 2024-09-12T01:29:15.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.982+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.iHkauChOymPilbe_E-TkPA4Fi3Rxm5U_0 2024-09-12T01:29:15.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.982+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7681913574138256652', time=2024-09-12T03:12:25.880566+0000, chain.objs.size()=1 2024-09-12T01:29:15.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.982+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ewjx4bmgJ3uqHdqmpGtkqP2HIhjxZjy_0 2024-09-12T01:29:15.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.982+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16777470395553621516', time=2024-09-12T03:12:25.881352+0000, chain.objs.size()=1 2024-09-12T01:29:15.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.982+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.jUNJHz8vIFqXUPlhXI9NrXFtm4Q-0GT_0 2024-09-12T01:29:15.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.982+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8307784046127031295', time=2024-09-12T03:12:25.882147+0000, chain.objs.size()=1 2024-09-12T01:29:15.983 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.982+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.G2kEWvJMJwdAiGqZOM_qqcM2s7sD2Iu_0 2024-09-12T01:29:15.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.983+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.536160150252039346', time=2024-09-12T03:12:26.067995+0000, chain.objs.size()=1 2024-09-12T01:29:15.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.983+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.NZHst2MEHDqygKSfi1LiKvGBrhHoBj9_0 2024-09-12T01:29:15.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.983+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12845366841948399207', time=2024-09-12T03:12:26.388785+0000, chain.objs.size()=1 2024-09-12T01:29:15.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.983+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ysb4Ti4Xw99E7tDgsNIfya1joZ-ddEF_0 2024-09-12T01:29:15.984 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.984+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15983344227289698192', time=2024-09-12T03:12:27.196977+0000, chain.objs.size()=1 2024-09-12T01:29:15.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.984+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.uYBhpVl6HuM7c93BOxmVGn7rV7dABOr_0 2024-09-12T01:29:15.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.984+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11530266426856736369', time=2024-09-12T03:12:27.964153+0000, chain.objs.size()=1 2024-09-12T01:29:15.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.984+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.7LebbKjsZhdQpAblpwclngKaClQ2qiK_0 2024-09-12T01:29:15.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.984+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8790246104316027928', time=2024-09-12T03:12:28.702411+0000, chain.objs.size()=1 2024-09-12T01:29:15.985 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.984+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mNs_8SfS3kS3pEgY81OGRJepOAb1PPy_0 2024-09-12T01:29:15.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12338826076663691044', time=2024-09-12T03:12:28.829003+0000, chain.objs.size()=1 2024-09-12T01:29:15.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.BzOvvmeElS3JgkhC6WlmDVl8TXV9TUP_0 2024-09-12T01:29:15.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6559640162513898136', time=2024-09-12T03:12:29.020882+0000, chain.objs.size()=1 2024-09-12T01:29:15.987 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.g_7c8JSbxBfiq3JeYd3Tk3tJl3LuG5-_0 2024-09-12T01:29:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1963845819239653996', time=2024-09-12T03:12:29.096336+0000, chain.objs.size()=1 2024-09-12T01:29:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.CFePgYSObL2J7dUvLYHiI97yOl8iahZ_0 2024-09-12T01:29:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4253158109779068452', time=2024-09-12T03:12:30.608009+0000, chain.objs.size()=1 2024-09-12T01:29:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.kz6QvcBldBwqS-vs2Ptyb_q0sCWLQZO_0 2024-09-12T01:29:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5409900829984117672', time=2024-09-12T03:12:31.483046+0000, chain.objs.size()=1 2024-09-12T01:29:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-YIOFmA9P4i8ezqggiqzv9neDuXOsSN_0 2024-09-12T01:29:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5318166424645265031', time=2024-09-12T03:12:31.576006+0000, chain.objs.size()=1 2024-09-12T01:29:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.LCmufbzpZ4_j6I0UHVPxrvwKG2LFig0_0 2024-09-12T01:29:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17266122698961293042', time=2024-09-12T03:12:32.546946+0000, chain.objs.size()=1 2024-09-12T01:29:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hZASGBUCPze7XD7aw8PB8yWgRCfSIzw_0 2024-09-12T01:29:15.988 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7663138520994132647', time=2024-09-12T03:13:03.029345+0000, chain.objs.size()=1 2024-09-12T01:29:15.989 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.987+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.378__shadow_.knLPk3nN-07wbNRTbEi-EMhBZIg22-l_0 2024-09-12T01:29:15.991 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.991+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/53613 2024-09-12T01:29:15.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-12T01:29:15.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10305320333515517902', time=2024-09-12T03:13:14.012447+0000, chain.objs.size()=1 2024-09-12T01:29:15.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.394__shadow:MT8rMqn7aVM5dmSn2vd162104jjoJBh_.7EVCW7HxOUYzonjz4DiJUBfXdcm26yf_0 2024-09-12T01:29:15.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11747188052545592598', time=2024-09-12T03:13:54.180227+0000, chain.objs.size()=1 2024-09-12T01:29:15.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.462__shadow_.6MGTCIU1_cCFZ2SWFd_-yPPbK4AAz9u_0 2024-09-12T01:29:15.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3692377953467117590', time=2024-09-12T03:14:05.120188+0000, chain.objs.size()=1 2024-09-12T01:29:15.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.483__shadow_.hxBV-Bz3Iaj1JG75tmWvd0jZhlPH0Es_0 2024-09-12T01:29:15.995 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3873381704209667890', time=2024-09-12T03:14:10.121875+0000, chain.objs.size()=1 2024-09-12T01:29:15.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.487__shadow_.MpQzhKwf9ceftsMULn8_TTIDqmzynAs_0 2024-09-12T01:29:15.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17336443808194334964', time=2024-09-12T03:14:12.913989+0000, chain.objs.size()=1 2024-09-12T01:29:15.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.491__shadow_.mmv31G_BMxnt6QNT4oetltfT75_uQ1b_0 2024-09-12T01:29:15.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15838573104192382284', time=2024-09-12T03:14:20.033564+0000, chain.objs.size()=1 2024-09-12T01:29:15.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.503__shadow:Dp2Xh3PCmOVDZq0qVeIVb0wIZKi8rqS_.nA7nRfHdVh5iLsyVm5W5cePiSTckNJe_0 2024-09-12T01:29:15.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14930067228506362253', time=2024-09-12T03:14:32.492230+0000, chain.objs.size()=1 2024-09-12T01:29:15.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.512__shadow_.5Y3jTiHofE2S57nCqc55mjGI55c9Ond_0 2024-09-12T01:29:15.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9678521462720836887', time=2024-09-12T03:14:34.568142+0000, chain.objs.size()=1 2024-09-12T01:29:15.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.516__multipart_mymultipartcopy.2~7ygxD66fImp9MxUPgKM84bSTEo-nFdR.1 2024-09-12T01:29:15.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6615890320492915514', time=2024-09-12T03:14:48.529012+0000, chain.objs.size()=6 2024-09-12T01:29:15.996 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.519__multipart_mymultipart.2~DPnGE8a56jCNlk8U-zDUVmpGE5MSl1n.1 2024-09-12T01:29:15.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.519__multipart_mymultipart.2~DPnGE8a56jCNlk8U-zDUVmpGE5MSl1n.2 2024-09-12T01:29:15.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.519__multipart_mymultipart.2~DPnGE8a56jCNlk8U-zDUVmpGE5MSl1n.3 2024-09-12T01:29:15.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.994+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.519__multipart_mymultipart.2~DPnGE8a56jCNlk8U-zDUVmpGE5MSl1n.4 2024-09-12T01:29:15.997 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.997+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.519__multipart_mymultipart.2~DPnGE8a56jCNlk8U-zDUVmpGE5MSl1n.5 2024-09-12T01:29:15.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.997+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.519__multipart_mymultipart.2~DPnGE8a56jCNlk8U-zDUVmpGE5MSl1n.6 2024-09-12T01:29:15.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.997+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15527833939742633541', time=2024-09-12T03:16:02.734936+0000, chain.objs.size()=3 2024-09-12T01:29:15.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.997+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.523__multipart_mymultipart.2~futFeHWs4uU2lAeg1u8zoz7Pj7O6_S4.1 2024-09-12T01:29:15.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.997+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.523__multipart_mymultipart.2~futFeHWs4uU2lAeg1u8zoz7Pj7O6_S4.2 2024-09-12T01:29:15.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.998+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.523__multipart_mymultipart.2~futFeHWs4uU2lAeg1u8zoz7Pj7O6_S4.3 2024-09-12T01:29:15.998 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.998+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12551045320610327471', time=2024-09-12T03:17:10.050406+0000, chain.objs.size()=1 2024-09-12T01:29:15.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.998+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.550__shadow_.KFkx9632gvGcH9ZU8ZNqnSYcjmztv11_0 2024-09-12T01:29:15.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.998+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1277649383736847595', time=2024-09-12T03:17:16.683234+0000, chain.objs.size()=1 2024-09-12T01:29:15.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.998+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.553__shadow_.s0G5QAw1_rO7M0Djnkb58-B8bN39bFY_0 2024-09-12T01:29:15.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.998+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3194406599760587049', time=2024-09-12T03:17:22.073772+0000, chain.objs.size()=1 2024-09-12T01:29:15.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.998+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.555__shadow_.IIZslZOpuJQExrEdkDzCZsC12yIhTNQ_0 2024-09-12T01:29:15.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.998+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16734925443731460540', time=2024-09-12T03:18:20.037926+0000, chain.objs.size()=1 2024-09-12T01:29:15.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.998+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:ZNulfOXYniUk1H5AVfNagrBa5dhY4iH_.JWk8F--MMqyLzzpPFWmionDUJCy3bXW_0 2024-09-12T01:29:15.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.998+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14621376618426359177', time=2024-09-12T03:18:52.369551+0000, chain.objs.size()=1 2024-09-12T01:29:15.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.998+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.583__shadow:QdsVHGDFelgjrD1O.SQcrnHoWu0LCrm_.0UI2VyTMqTPLovuvPKSCJ_XrWS8prRj_0 2024-09-12T01:29:15.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.998+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14645530509512930237', time=2024-09-12T03:23:00.323280+0000, chain.objs.size()=1 2024-09-12T01:29:15.999 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:15.998+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.634__shadow_.6PBvrtSzdNw0nFh3_bXHxda6KFH0Uk3_0 2024-09-12T01:29:16.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.000+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2232927920224585937', time=2024-09-12T03:23:40.084332+0000, chain.objs.size()=6 2024-09-12T01:29:16.000 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.000+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.662__multipart_foo.2~3po6FmeGx98KLTcBmoRH3MS6_u7P6wc.1 2024-09-12T01:29:16.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.001+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.662__multipart_foo.2~3po6FmeGx98KLTcBmoRH3MS6_u7P6wc.2 2024-09-12T01:29:16.001 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.001+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.662__multipart_foo.2~3po6FmeGx98KLTcBmoRH3MS6_u7P6wc.3 2024-09-12T01:29:16.002 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.002+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.662__multipart_foo.2~3po6FmeGx98KLTcBmoRH3MS6_u7P6wc.4 2024-09-12T01:29:16.003 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.003+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.662__multipart_foo.2~3po6FmeGx98KLTcBmoRH3MS6_u7P6wc.5 2024-09-12T01:29:16.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.003+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.662__multipart_foo.2~3po6FmeGx98KLTcBmoRH3MS6_u7P6wc.6 2024-09-12T01:29:16.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.003+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10541001116550145030', time=2024-09-12T03:23:42.832622+0000, chain.objs.size()=1 2024-09-12T01:29:16.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.003+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.665__shadow_.s9UWMONQqCuj5VteRNnORfFLiwzDbFZ_0 2024-09-12T01:29:16.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.003+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12586752072639598517', time=2024-09-12T03:24:51.914176+0000, chain.objs.size()=1 2024-09-12T01:29:16.004 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.003+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.740__shadow_.aCIVyIisTjCGFz6N7MmbX0anLLYIm3I_0 2024-09-12T01:29:16.007 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.007+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:16.010 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.010+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:29:16.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.011+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:16.011 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.011+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:16.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45472' 2024-09-12T01:29:16.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_d-4VUpFw-oGHGhbqbYO8CEDZkZFTxnH', time=2024-09-12T03:06:46.962327+0000, chain.objs.size()=1 2024-09-12T01:29:16.013 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.160__shadow_.NiA9RbfCda-6hLg0Mq0QlsHGcIfEthJ_0 2024-09-12T01:29:16.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_RKkVvrg2HKZaiv83fdZINXjB0HSMYSS', time=2024-09-12T03:06:53.625392+0000, chain.objs.size()=2 2024-09-12T01:29:16.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__shadow_.fPD_IG1wzlD2kO5uvAQ10bzOLhPeq5G_0 2024-09-12T01:29:16.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.161__shadow_.fPD_IG1wzlD2kO5uvAQ10bzOLhPeq5G_1 2024-09-12T01:29:16.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8314946619420862322', time=2024-09-12T03:08:54.876693+0000, chain.objs.size()=1 2024-09-12T01:29:16.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.231__shadow_.z0b2JBeznPVU3uxsqB92rX0iCfFpuh__0 2024-09-12T01:29:16.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4849921669866181698', time=2024-09-12T03:09:02.287232+0000, chain.objs.size()=1 2024-09-12T01:29:16.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.242__shadow_.1V1YWYFzSiYrcEjfU6qbmDqJsF6uphC_0 2024-09-12T01:29:16.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9891242624768399798', time=2024-09-12T03:09:08.594944+0000, chain.objs.size()=1 2024-09-12T01:29:16.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.251__shadow_.JM8qMXsu3gcsEWcMyg5zxMEHzKi7zFu_0 2024-09-12T01:29:16.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16103495795302180908', time=2024-09-12T03:09:09.918844+0000, chain.objs.size()=1 2024-09-12T01:29:16.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.253__shadow_.BBuRps3CnE6cLBTMkFE-XLTtoVGQfyD_0 2024-09-12T01:29:16.014 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13204535921217069892', time=2024-09-12T03:09:10.551171+0000, chain.objs.size()=1 2024-09-12T01:29:16.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.254__shadow_.9jwJM2Xvwqi4P67aETMbtLDwv2h08VE_0 2024-09-12T01:29:16.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2339851660693445498', time=2024-09-12T03:09:12.416581+0000, chain.objs.size()=1 2024-09-12T01:29:16.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.257__shadow_.VkINKDMhkfn9weKkiNqtbubHzNzWC3E_0 2024-09-12T01:29:16.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1153955749951972731', time=2024-09-12T03:09:13.011742+0000, chain.objs.size()=1 2024-09-12T01:29:16.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.258__shadow_.RLDE_mcvn2Jx95IxV04zjk9UHbFgUje_0 2024-09-12T01:29:16.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14951738261174040673', time=2024-09-12T03:09:14.285702+0000, chain.objs.size()=1 2024-09-12T01:29:16.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.260__shadow_.pBwgxd9O8ZOr3YzysX6X31dKC4jqt_Y_0 2024-09-12T01:29:16.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4973773875084506082', time=2024-09-12T03:09:54.557602+0000, chain.objs.size()=1 2024-09-12T01:29:16.015 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.012+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.7fYtpEm3StjE68foXUsim7ExKucUuUx_0 2024-09-12T01:29:16.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.014+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14362994088406581331', time=2024-09-12T03:09:54.638696+0000, chain.objs.size()=1 2024-09-12T01:29:16.016 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.014+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8sCycxtdPDBlvn2kLQ4UbbIfK6TJRtg_0 2024-09-12T01:29:16.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13463219760582923615', time=2024-09-12T03:09:54.857996+0000, chain.objs.size()=1 2024-09-12T01:29:16.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.m6zfmJ7si6B6Re4QVsA6__EDyusBan1_0 2024-09-12T01:29:16.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8563304905090491854', time=2024-09-12T03:09:55.349262+0000, chain.objs.size()=1 2024-09-12T01:29:16.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.hj8AeSi-ekeDGY2hKytSKaR9NCIfg_p_0 2024-09-12T01:29:16.017 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5488375317680061173', time=2024-09-12T03:09:57.777304+0000, chain.objs.size()=1 2024-09-12T01:29:16.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.JJkRQS6JTpKMg-4gcjsh04Uch4HnSwA_0 2024-09-12T01:29:16.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9645164273757340771', time=2024-09-12T03:09:57.856371+0000, chain.objs.size()=1 2024-09-12T01:29:16.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.HVKGkqwjNtc1TZh6bFYalLa2sGQZnvw_0 2024-09-12T01:29:16.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6404041385081909854', time=2024-09-12T03:09:58.329609+0000, chain.objs.size()=1 2024-09-12T01:29:16.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0-2pUpVh2mMkk_a0cOaJDEYDz-JM72o_0 2024-09-12T01:29:16.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3044362405265634789', time=2024-09-12T03:10:00.540213+0000, chain.objs.size()=1 2024-09-12T01:29:16.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.y-WO0QbZHWB4c88AEhwE0y-WrLFDRkG_0 2024-09-12T01:29:16.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14782969411075612218', time=2024-09-12T03:10:00.593138+0000, chain.objs.size()=1 2024-09-12T01:29:16.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.HObFCIFsvkyn0r7tZCYBl5BN2rm9ArJ_0 2024-09-12T01:29:16.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14447719445258971109', time=2024-09-12T03:10:01.054129+0000, chain.objs.size()=1 2024-09-12T01:29:16.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.98LUNwsVL5QggZGq7vrUlolKkK0v4V6_0 2024-09-12T01:29:16.018 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7644842521513612035', time=2024-09-12T03:10:01.405114+0000, chain.objs.size()=1 2024-09-12T01:29:16.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RSqMVSLzUjntK43PPN8DKwaC8hMtaVJ_0 2024-09-12T01:29:16.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7526886079071809948', time=2024-09-12T03:10:01.529117+0000, chain.objs.size()=1 2024-09-12T01:29:16.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.HyQBhuwsHGZgJ_uDI3OwKzLMhpGMCT1_0 2024-09-12T01:29:16.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14955507478806865702', time=2024-09-12T03:10:01.912354+0000, chain.objs.size()=1 2024-09-12T01:29:16.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.017+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.cwRnqNDr3THvoCCMGuzOnzzJ1lPb-eA_0 2024-09-12T01:29:16.019 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.019+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6469652894823709441', time=2024-09-12T03:10:02.036970+0000, chain.objs.size()=1 2024-09-12T01:29:16.020 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.019+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.iZBT8anzDzgI1nIg3Ikx759juCJtvDr_0 2024-09-12T01:29:16.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.021+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7199140295888576741', time=2024-09-12T03:10:02.821797+0000, chain.objs.size()=1 2024-09-12T01:29:16.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.021+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.5szqwjuW948RkpVafO8xpVE9S2E9XIx_0 2024-09-12T01:29:16.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.021+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11182394368211781162', time=2024-09-12T03:10:03.156982+0000, chain.objs.size()=1 2024-09-12T01:29:16.021 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.021+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.g-5U7q6cJQ_BKGPh4kiOFArPj5Wa8w0_0 2024-09-12T01:29:16.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.021+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18156992343140999451', time=2024-09-12T03:10:03.731972+0000, chain.objs.size()=1 2024-09-12T01:29:16.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.021+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ZCs1nl7X7luN5KLPzaa9D4mGPlCXgQl_0 2024-09-12T01:29:16.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.021+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.69840563056657306', time=2024-09-12T03:10:03.747144+0000, chain.objs.size()=1 2024-09-12T01:29:16.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.021+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Y4gUDeKuRDvN5wq_x-XuQallUyOl7RR_0 2024-09-12T01:29:16.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.021+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5514382351332640359', time=2024-09-12T03:10:04.198620+0000, chain.objs.size()=1 2024-09-12T01:29:16.022 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.021+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.zWqJqRPrGtANitFUyg2t1LsmQkJLWLg_0 2024-09-12T01:29:16.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.021+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1927356745680307350', time=2024-09-12T03:10:04.246171+0000, chain.objs.size()=1 2024-09-12T01:29:16.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.022+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.KF23ym6d_4bL0ZgDEJ8rqVm8nZIqSTy_0 2024-09-12T01:29:16.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.022+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.682851042116917705', time=2024-09-12T03:10:04.246937+0000, chain.objs.size()=1 2024-09-12T01:29:16.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.022+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.qz4N-zlfJlgrz58eKKaRaJQQFGodoFF_0 2024-09-12T01:29:16.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.022+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11980125324293827405', time=2024-09-12T03:10:04.831589+0000, chain.objs.size()=1 2024-09-12T01:29:16.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.022+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.7bkuydR30GNkJMtuq3yGxxlahC_ixfi_0 2024-09-12T01:29:16.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.022+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10769518873168328742', time=2024-09-12T03:10:04.834230+0000, chain.objs.size()=1 2024-09-12T01:29:16.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.022+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ZCVW1PlmK26WpdIARXF8eQBrlIsiOin_0 2024-09-12T01:29:16.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.022+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12691236342788717850', time=2024-09-12T03:10:05.051341+0000, chain.objs.size()=1 2024-09-12T01:29:16.023 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.022+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1yUabd-yJvj_OHGz6h7gKCDIfJ98Mk3_0 2024-09-12T01:29:16.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.024+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10112454625647549161', time=2024-09-12T03:10:05.398226+0000, chain.objs.size()=1 2024-09-12T01:29:16.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.024+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QvIlUYU40XbLNmgwV5TRG-iTo1xLK0M_0 2024-09-12T01:29:16.024 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.024+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8595549216369167086', time=2024-09-12T03:10:05.683880+0000, chain.objs.size()=1 2024-09-12T01:29:16.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.024+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.erQ3G3VzrP-MUTRFiA7yQE_1EjqIQjm_0 2024-09-12T01:29:16.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.024+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15362418755201838738', time=2024-09-12T03:10:05.720228+0000, chain.objs.size()=1 2024-09-12T01:29:16.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.024+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.XORMSHd5T9VbCmyDmfMp8tHMzvD3J2F_0 2024-09-12T01:29:16.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.024+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13778432187804061137', time=2024-09-12T03:10:05.721451+0000, chain.objs.size()=1 2024-09-12T01:29:16.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.024+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.JdVpXoIqpplzm00hAzX7jE5qFygjIAt_0 2024-09-12T01:29:16.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.024+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6964752056869186642', time=2024-09-12T03:10:06.178053+0000, chain.objs.size()=1 2024-09-12T01:29:16.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.024+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.LElqDGfw9yTjV7Nb4PpUPUxSRnR4Z8D_0 2024-09-12T01:29:16.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.024+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11842309523516624400', time=2024-09-12T03:10:06.696392+0000, chain.objs.size()=1 2024-09-12T01:29:16.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.024+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.pGzMzhfGLXhwzMXcszWkbKF56Jm2OpC_0 2024-09-12T01:29:16.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.024+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17880253979983045895', time=2024-09-12T03:10:15.143119+0000, chain.objs.size()=1 2024-09-12T01:29:16.025 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.024+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.276__shadow_.ezPgTX3GFKOEgHgeTo1skC64Ie5UwLF_0 2024-09-12T01:29:16.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.025+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8479744343893857882', time=2024-09-12T03:10:27.204332+0000, chain.objs.size()=1 2024-09-12T01:29:16.026 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.025+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.bzn0eD_eA45LHx2GcOr423IyP8aV8yL_0 2024-09-12T01:29:16.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.027+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4878628055753338166', time=2024-09-12T03:11:29.463750+0000, chain.objs.size()=1 2024-09-12T01:29:16.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.027+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.pp6kLDiku0b_tFeyTqJiJyv-CvyxE_S_0 2024-09-12T01:29:16.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.027+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11020437705233255448', time=2024-09-12T03:11:29.551234+0000, chain.objs.size()=1 2024-09-12T01:29:16.027 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.027+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Iq5vduyjcV3VE75t5IYAZFDTauN6UiH_0 2024-09-12T01:29:16.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17788408727113310753', time=2024-09-12T03:11:30.062714+0000, chain.objs.size()=1 2024-09-12T01:29:16.029 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.oSyKAGCtg1l74jqTXY3JrbaRaIpFbvL_0 2024-09-12T01:29:16.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10104092252440544816', time=2024-09-12T03:11:31.104823+0000, chain.objs.size()=1 2024-09-12T01:29:16.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.rZBdyx5FI_aKhBh39WXM-E5otMYUX7z_0 2024-09-12T01:29:16.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.428688964672666507', time=2024-09-12T03:11:31.108892+0000, chain.objs.size()=1 2024-09-12T01:29:16.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ORdLxWHsfa1kzuxMlLA4mWlyycaj4fj_0 2024-09-12T01:29:16.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10304485213539304844', time=2024-09-12T03:11:31.109556+0000, chain.objs.size()=1 2024-09-12T01:29:16.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xLXqnXPI7RGYUHXoeM_GK4TVYBeiGFN_0 2024-09-12T01:29:16.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14259295569345761039', time=2024-09-12T03:11:31.444237+0000, chain.objs.size()=1 2024-09-12T01:29:16.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.SObnxdzGVIbIIXs7lSkqxCdw63IJ2BC_0 2024-09-12T01:29:16.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3756902428544547695', time=2024-09-12T03:11:31.856471+0000, chain.objs.size()=1 2024-09-12T01:29:16.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.XjDIsg5gKmb2WWfzwbSe2ZFXiMptYu4_0 2024-09-12T01:29:16.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13912321734977830295', time=2024-09-12T03:11:32.006724+0000, chain.objs.size()=1 2024-09-12T01:29:16.030 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.JWdxj0BGioWM3Ggs69hCvOvftm8xxBJ_0 2024-09-12T01:29:16.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3423233978699117007', time=2024-09-12T03:11:32.247411+0000, chain.objs.size()=1 2024-09-12T01:29:16.031 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.029+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1-QdAtZ57ZvTjeBon0V83httD5GW3zj_0 2024-09-12T01:29:16.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.031+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9049543400808836502', time=2024-09-12T03:11:32.316502+0000, chain.objs.size()=1 2024-09-12T01:29:16.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.031+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.H7lL5r1lcStJW6V6uvAVRYJoNasukkk_0 2024-09-12T01:29:16.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.031+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6323314972575787521', time=2024-09-12T03:11:32.884645+0000, chain.objs.size()=1 2024-09-12T01:29:16.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.031+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.QHRqjPFV_fe9_UvnxzapaTnsrWIePpJ_0 2024-09-12T01:29:16.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.031+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13324242058980558642', time=2024-09-12T03:11:33.234594+0000, chain.objs.size()=1 2024-09-12T01:29:16.032 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.031+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.JdvIkej4k3k6-d78bpD4dRprImMlY8T_0 2024-09-12T01:29:16.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.033+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4055720770733960814', time=2024-09-12T03:11:33.819247+0000, chain.objs.size()=1 2024-09-12T01:29:16.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.033+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.wMZyUaxQx8-56brLjimmV4RmwXAar2b_0 2024-09-12T01:29:16.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.033+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17462867007397660367', time=2024-09-12T03:11:33.997564+0000, chain.objs.size()=1 2024-09-12T01:29:16.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.033+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.80rEpVZ-zc6N2Uci0VfONtSoW03EGMi_0 2024-09-12T01:29:16.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.033+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1139649316683258119', time=2024-09-12T03:11:34.492776+0000, chain.objs.size()=1 2024-09-12T01:29:16.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.033+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.6qNwj-FWHyrSHhr9ynu0UFXwvJR8auD_0 2024-09-12T01:29:16.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.034+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15489234362867956731', time=2024-09-12T03:11:34.840027+0000, chain.objs.size()=1 2024-09-12T01:29:16.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.034+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.39ofkD3zjBK22mQ2U6IFjQhffBqiSKH_0 2024-09-12T01:29:16.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.034+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7433718142017979922', time=2024-09-12T03:11:35.527503+0000, chain.objs.size()=1 2024-09-12T01:29:16.034 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.034+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.NfUn4qMiAdrgFqEmze-320MLDHnWYVw_0 2024-09-12T01:29:16.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.034+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16977674690147566876', time=2024-09-12T03:11:36.333318+0000, chain.objs.size()=1 2024-09-12T01:29:16.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.034+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.yaE5G_F9nGy06LNzJ39r0HCm8vcxLcM_0 2024-09-12T01:29:16.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.034+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12048539843969586937', time=2024-09-12T03:11:36.897123+0000, chain.objs.size()=1 2024-09-12T01:29:16.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.034+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.y18Nk1t87nmCTbLHsPmOBIj7Y-uDa1I_0 2024-09-12T01:29:16.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.034+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3834002730700532466', time=2024-09-12T03:11:37.077638+0000, chain.objs.size()=1 2024-09-12T01:29:16.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.034+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.EyUjBBDD5jeugBhZVpZVQpH_CSAEPm0_0 2024-09-12T01:29:16.035 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.035+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11207728716674928563', time=2024-09-12T03:11:37.674651+0000, chain.objs.size()=1 2024-09-12T01:29:16.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.035+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.y457d6k2bjsVI776LRmJjIgSNZTAsWq_0 2024-09-12T01:29:16.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.035+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4503090189008279417', time=2024-09-12T03:11:37.971699+0000, chain.objs.size()=1 2024-09-12T01:29:16.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.035+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5_IzwZWXyDA7GRoZGX9uifMPtIlMZ1e_0 2024-09-12T01:29:16.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.035+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17247169188529524737', time=2024-09-12T03:11:37.972407+0000, chain.objs.size()=1 2024-09-12T01:29:16.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.035+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.WlDvjS31WRrVH5kO3wM1mMreNYEAHSg_0 2024-09-12T01:29:16.036 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.036+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13770834949681007033', time=2024-09-12T03:11:38.185809+0000, chain.objs.size()=1 2024-09-12T01:29:16.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.036+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.KsHEtwcioh-goyLsuXRLiIUL2jbYIem_0 2024-09-12T01:29:16.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.037+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16509681302444007646', time=2024-09-12T03:11:38.408122+0000, chain.objs.size()=1 2024-09-12T01:29:16.037 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.037+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.v55YzyEVtDgxPXBRiVaVMt7C9XHQb-Z_0 2024-09-12T01:29:16.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.037+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3751597385160167079', time=2024-09-12T03:11:38.730970+0000, chain.objs.size()=1 2024-09-12T01:29:16.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.037+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.dsjHKxP-gSVicYNPSccWkX3z0TTaotr_0 2024-09-12T01:29:16.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.037+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4262801671018897556', time=2024-09-12T03:11:39.377727+0000, chain.objs.size()=1 2024-09-12T01:29:16.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.037+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1KTmM1-oLUH2o0_-cCgEMigDAGN5YZG_0 2024-09-12T01:29:16.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.037+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5992199638774086627', time=2024-09-12T03:11:39.486287+0000, chain.objs.size()=1 2024-09-12T01:29:16.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.037+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_._1Llrfds1gBWEEamr5Z6HoJxoNoWknt_0 2024-09-12T01:29:16.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.037+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5625863029780539391', time=2024-09-12T03:11:40.230415+0000, chain.objs.size()=1 2024-09-12T01:29:16.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.037+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.S_oR7HaFBBwwBxgjLW9xLIVRwPDpXrn_0 2024-09-12T01:29:16.038 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.037+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10815675162685011093', time=2024-09-12T03:11:40.375165+0000, chain.objs.size()=1 2024-09-12T01:29:16.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.037+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.UU_Xp7xCJlubogxZG2vI-n6ZR44kcLp_0 2024-09-12T01:29:16.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.038+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3978770705562184276', time=2024-09-12T03:11:40.380680+0000, chain.objs.size()=1 2024-09-12T01:29:16.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.038+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_._tlBb-TNk21xUgBp-rRMUT3O0kE9XUW_0 2024-09-12T01:29:16.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.038+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4842348848823278204', time=2024-09-12T03:11:40.987645+0000, chain.objs.size()=1 2024-09-12T01:29:16.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.038+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Fdait_vci7NtJpUGxLNL8EL26y622yF_0 2024-09-12T01:29:16.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.038+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2309627971246123762', time=2024-09-12T03:11:41.297270+0000, chain.objs.size()=1 2024-09-12T01:29:16.039 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.038+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.T73ZJB8jYcElPMsLhcyEI-NBR0FYDbr_0 2024-09-12T01:29:16.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.039+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10270495317254793185', time=2024-09-12T03:11:41.498017+0000, chain.objs.size()=1 2024-09-12T01:29:16.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.039+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.sF7JwNxkOEXuaC2t-33SIlH4L5zfww0_0 2024-09-12T01:29:16.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.039+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16887869365138257700', time=2024-09-12T03:12:21.999293+0000, chain.objs.size()=1 2024-09-12T01:29:16.040 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.039+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MtMqn0Kc7v5wpjMgC0HH-0neePJm0BZ_0 2024-09-12T01:29:16.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.041+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2049305329186958584', time=2024-09-12T03:12:22.805852+0000, chain.objs.size()=1 2024-09-12T01:29:16.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.041+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.77czhFcEmTHZ835m1-LMsWmqTfpVbin_0 2024-09-12T01:29:16.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.041+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15425698362921588867', time=2024-09-12T03:12:23.633735+0000, chain.objs.size()=1 2024-09-12T01:29:16.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.041+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.5LCkROUl_rnLM2s13oZJmdu7aXA9cl0_0 2024-09-12T01:29:16.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.041+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2253199980902077101', time=2024-09-12T03:12:24.042784+0000, chain.objs.size()=1 2024-09-12T01:29:16.041 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.041+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.7o3h4-Iw72uUMLQrPB4yyO6f4mGvi9v_0 2024-09-12T01:29:16.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.041+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13029934627392959039', time=2024-09-12T03:12:24.357173+0000, chain.objs.size()=1 2024-09-12T01:29:16.042 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.041+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.tRBiGGt4E_E7rONO47sI-ok7dfjvDHe_0 2024-09-12T01:29:16.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.043+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11874329004382873250', time=2024-09-12T03:12:25.527585+0000, chain.objs.size()=1 2024-09-12T01:29:16.043 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.043+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.CvKOlikZcgqarYgAiQlXDRiWa8ZjbjS_0 2024-09-12T01:29:16.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.044+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13673893454895953271', time=2024-09-12T03:12:25.570098+0000, chain.objs.size()=1 2024-09-12T01:29:16.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.044+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.tMQDMpdOLCjWb4PA3wmikrjTgF3zyAM_0 2024-09-12T01:29:16.044 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.044+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12615614635497216216', time=2024-09-12T03:12:25.783873+0000, chain.objs.size()=1 2024-09-12T01:29:16.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.044+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.m6BUMvxcewDk0jwWVGgkGgAqpndeOoY_0 2024-09-12T01:29:16.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.044+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4812740875673371069', time=2024-09-12T03:12:26.057659+0000, chain.objs.size()=1 2024-09-12T01:29:16.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.044+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.4bL9uOoNQEeubkCQ1ekFwCGXhU6dlUd_0 2024-09-12T01:29:16.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.044+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8753367341029462190', time=2024-09-12T03:12:26.115186+0000, chain.objs.size()=1 2024-09-12T01:29:16.045 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.044+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.BNFmwdKlsXWLYOyiCnf_NA9kkK0kQ26_0 2024-09-12T01:29:16.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.045+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16312751606736017384', time=2024-09-12T03:12:26.593890+0000, chain.objs.size()=1 2024-09-12T01:29:16.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.045+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xxdyMq9MywQdGVGX7C3S26JQf4ucOTd_0 2024-09-12T01:29:16.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.045+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1434997394777925145', time=2024-09-12T03:12:27.191406+0000, chain.objs.size()=1 2024-09-12T01:29:16.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.045+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.JKt0e4Buq7qpK-IWgRJijsLA2vQgHBK_0 2024-09-12T01:29:16.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.045+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7411712668367236741', time=2024-09-12T03:12:27.240459+0000, chain.objs.size()=1 2024-09-12T01:29:16.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.045+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.SWVrkvx5esh30t1shvZGP19RUqRZN7a_0 2024-09-12T01:29:16.046 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.045+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.316648679819205664', time=2024-09-12T03:12:27.359262+0000, chain.objs.size()=1 2024-09-12T01:29:16.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.045+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.NKzcE8Ku2ycd02oI_MZvj-uNt0Gvxmd_0 2024-09-12T01:29:16.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.045+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5140010652496160496', time=2024-09-12T03:12:27.359789+0000, chain.objs.size()=1 2024-09-12T01:29:16.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.045+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.T1WLBEMbIiF-pKxLf9P5cx6XSsw5JLU_0 2024-09-12T01:29:16.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.045+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7615509675384257801', time=2024-09-12T03:12:28.192608+0000, chain.objs.size()=1 2024-09-12T01:29:16.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.045+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.XycT5eTMXNquVOhETWLxWXOy8JAUaRq_0 2024-09-12T01:29:16.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.045+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17357080263191209333', time=2024-09-12T03:12:29.259838+0000, chain.objs.size()=1 2024-09-12T01:29:16.047 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.045+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RkIGp-zPzNsQ4vpaMF8ViRrWwZMIX_C_0 2024-09-12T01:29:16.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.049+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2937696199493633959', time=2024-09-12T03:12:29.407819+0000, chain.objs.size()=1 2024-09-12T01:29:16.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.049+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-tb0lLm1U4J8RGgD7jQ443zkss0kcDs_0 2024-09-12T01:29:16.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.049+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9673502013274217094', time=2024-09-12T03:12:29.616992+0000, chain.objs.size()=1 2024-09-12T01:29:16.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.049+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.jNycdqP5Zv0mT1bggpeNO6pJXA2CsIJ_0 2024-09-12T01:29:16.049 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.049+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1111899128995355302', time=2024-09-12T03:12:29.782959+0000, chain.objs.size()=1 2024-09-12T01:29:16.050 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.049+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.0iycNmz9iJ4pgUTBc79QBShy_j0lpwd_0 2024-09-12T01:29:16.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.050+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10113324685456132529', time=2024-09-12T03:12:30.955360+0000, chain.objs.size()=1 2024-09-12T01:29:16.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.050+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.kYcJkz6qY8QFS_rUByiy2BIB4SAdS2J_0 2024-09-12T01:29:16.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.050+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15568316275362065800', time=2024-09-12T03:12:31.105070+0000, chain.objs.size()=1 2024-09-12T01:29:16.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.050+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.XOIS_SZJ_WQsvBj8o4So5lziovSS0Pd_0 2024-09-12T01:29:16.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.050+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7693495890197169986', time=2024-09-12T03:12:31.334003+0000, chain.objs.size()=1 2024-09-12T01:29:16.051 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.050+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MLNmjlgAtDssLDE7jxBUMW2dzEh7Ns3_0 2024-09-12T01:29:16.053 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.053+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/45472 2024-09-12T01:29:16.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=29, truncated=0, next_marker='' 2024-09-12T01:29:16.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1619944757370087698', time=2024-09-12T03:12:31.423380+0000, chain.objs.size()=1 2024-09-12T01:29:16.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.K7CZlIn9Sb0WwFVnw2fMzOsf3QYo8nO_0 2024-09-12T01:29:16.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8591873127241003661', time=2024-09-12T03:12:31.957243+0000, chain.objs.size()=1 2024-09-12T01:29:16.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1c9JJMaHsvPW9JOZzQzK8CKTE2EnaqH_0 2024-09-12T01:29:16.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2655703596369516408', time=2024-09-12T03:12:32.298796+0000, chain.objs.size()=1 2024-09-12T01:29:16.056 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._vHYvtcM8W71TBvFWFnjljDTi1VT984_0 2024-09-12T01:29:16.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17014837582776584491', time=2024-09-12T03:12:33.766773+0000, chain.objs.size()=1 2024-09-12T01:29:16.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.EGwW2SnR_8-xtwKnrD5VboWKjf_SA2y_0 2024-09-12T01:29:16.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5695954959912720800', time=2024-09-12T03:12:34.154601+0000, chain.objs.size()=1 2024-09-12T01:29:16.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1AgGPcKCbjVVa14CMYBqRHIrQFJRapo_0 2024-09-12T01:29:16.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5326598035414374549', time=2024-09-12T03:12:45.951273+0000, chain.objs.size()=1 2024-09-12T01:29:16.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.345__shadow_.7XI98gbKbhOEMXrk3jlvYAvWTIauTc6_0 2024-09-12T01:29:16.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17655341406323051648', time=2024-09-12T03:13:09.988620+0000, chain.objs.size()=1 2024-09-12T01:29:16.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.390__shadow_.sBN0rDyzNyiDiibLix2arDENFY9GOgW_0 2024-09-12T01:29:16.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5991365908230666660', time=2024-09-12T03:13:09.992540+0000, chain.objs.size()=1 2024-09-12T01:29:16.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.390__shadow_.mr6Tg1m3tclT2WfyKR1AEGd2TPXV6VW_0 2024-09-12T01:29:16.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7557878150623766861', time=2024-09-12T03:13:37.103930+0000, chain.objs.size()=1 2024-09-12T01:29:16.057 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.437__shadow_.Od1DrEtT81LW6EEFcxmZkz8gaE80TJN_0 2024-09-12T01:29:16.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13005044150093476726', time=2024-09-12T03:13:51.556584+0000, chain.objs.size()=1 2024-09-12T01:29:16.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.459__shadow_.3vdn2r_HMUQMTbVurg0wyEjgmnWEQnu_0 2024-09-12T01:29:16.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12591775256589506077', time=2024-09-12T03:13:53.277575+0000, chain.objs.size()=1 2024-09-12T01:29:16.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.461__shadow_.R061gm8ikF8eUCuFUZktIIp3tNSNAP__0 2024-09-12T01:29:16.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~q5IUvKN41FQ2dFPeFsQcY4tlAsuTD9x', time=2024-09-12T03:15:50.703620+0000, chain.objs.size()=1 2024-09-12T01:29:16.058 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.055+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~q5IUvKN41FQ2dFPeFsQcY4tlAsuTD9x.1 2024-09-12T01:29:16.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.058+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~q5IUvKN41FQ2dFPeFsQcY4tlAsuTD9x', time=2024-09-12T03:15:50.707685+0000, chain.objs.size()=1 2024-09-12T01:29:16.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.059+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~q5IUvKN41FQ2dFPeFsQcY4tlAsuTD9x.2 2024-09-12T01:29:16.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.059+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~q5IUvKN41FQ2dFPeFsQcY4tlAsuTD9x', time=2024-09-12T03:15:50.711451+0000, chain.objs.size()=1 2024-09-12T01:29:16.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.059+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~q5IUvKN41FQ2dFPeFsQcY4tlAsuTD9x.3 2024-09-12T01:29:16.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.059+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~q5IUvKN41FQ2dFPeFsQcY4tlAsuTD9x', time=2024-09-12T03:15:50.715792+0000, chain.objs.size()=1 2024-09-12T01:29:16.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.059+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~q5IUvKN41FQ2dFPeFsQcY4tlAsuTD9x.4 2024-09-12T01:29:16.059 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.059+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~q5IUvKN41FQ2dFPeFsQcY4tlAsuTD9x', time=2024-09-12T03:15:50.719736+0000, chain.objs.size()=1 2024-09-12T01:29:16.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.059+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~q5IUvKN41FQ2dFPeFsQcY4tlAsuTD9x.5 2024-09-12T01:29:16.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.059+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~q5IUvKN41FQ2dFPeFsQcY4tlAsuTD9x', time=2024-09-12T03:15:50.723563+0000, chain.objs.size()=1 2024-09-12T01:29:16.060 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.059+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~q5IUvKN41FQ2dFPeFsQcY4tlAsuTD9x.6 2024-09-12T01:29:16.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.060+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6695715506516363284', time=2024-09-12T03:17:18.759389+0000, chain.objs.size()=1 2024-09-12T01:29:16.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.060+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.554__shadow_.aWbfLq7NMNJbJLNZkfp3zMmZu6fEFe1_0 2024-09-12T01:29:16.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.060+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7843105724807963495', time=2024-09-12T03:17:46.917574+0000, chain.objs.size()=1 2024-09-12T01:29:16.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.060+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:0x.oeF33E3JRUPNSt5yOsinF0ENBUuW_._eU8b3SLyPiRcqNLeuCWRnNhXVwG1Jw_0 2024-09-12T01:29:16.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.060+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17670045576003199549', time=2024-09-12T03:17:54.887328+0000, chain.objs.size()=1 2024-09-12T01:29:16.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.060+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:mOgqNg1gko-NDkR.lhhMJ4alFa35rWK_.WJNk5sOKRDuSNWBAbNPwzyaS-QYP3Xj_0 2024-09-12T01:29:16.061 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.060+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11403776191279270118', time=2024-09-12T03:18:08.763407+0000, chain.objs.size()=1 2024-09-12T01:29:16.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.060+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.576__shadow:WDgMRJLDtYBHjX95LIq0o6L6HD-Y-XY_.HxHMo09hxUZuqEEmS-R1Qdr8vBeQBJn_0 2024-09-12T01:29:16.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.060+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.666892021349500637', time=2024-09-12T03:18:11.364197+0000, chain.objs.size()=1 2024-09-12T01:29:16.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.060+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.576__shadow:QcylRQwqVpZi.pCS.UnYRLS9RqpQU98_.Ieww_PMMyCwhak1yA82vrPa5R86BsfI_0 2024-09-12T01:29:16.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.060+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2377019372313479645', time=2024-09-12T03:18:50.563641+0000, chain.objs.size()=1 2024-09-12T01:29:16.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.060+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.580__shadow:qBjm8H6GQVkifIdHZzda0fx6yJ5oPVA_.EdKAH6RD_uXevISjCs_sAFmq9cxyJHv_0 2024-09-12T01:29:16.062 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.060+0000 7f4c2e6e3640 0 -- 172.21.15.62:0/837013543 >> [v2:172.21.15.77:6808/1500154120,v1:172.21.15.77:6809/1500154120] conn(0x7f4af8098dc0 msgr2=0x7f4af8097550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:29:16.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.063+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12618744237300085207', time=2024-09-12T03:22:58.570710+0000, chain.objs.size()=1 2024-09-12T01:29:16.063 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.063+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.631__shadow_.JDKSFMJ5JwBiytO1t0J9IOfpfCNHFHU_0 2024-09-12T01:29:16.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.064+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1323266191074679586', time=2024-09-12T03:23:10.983206+0000, chain.objs.size()=1 2024-09-12T01:29:16.064 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.064+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.645__shadow_.ckD3cYTY6hAgCYV9otOkkBa4iTc05nj_0 2024-09-12T01:29:16.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.066+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13302307218767215084', time=2024-09-12T03:23:25.287412+0000, chain.objs.size()=1 2024-09-12T01:29:16.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.066+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.656__shadow_.ZTTxB5DTjLnCiYtk89Te2mG_ssyo4KT_0 2024-09-12T01:29:16.066 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.066+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2298724974005541530', time=2024-09-12T03:23:50.365601+0000, chain.objs.size()=1 2024-09-12T01:29:16.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.066+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.679__shadow_.ioH4S_ZXE6ON3C7rSINj38wFqNLItI__0 2024-09-12T01:29:16.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.066+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17246885039859568783', time=2024-09-12T03:24:07.353120+0000, chain.objs.size()=1 2024-09-12T01:29:16.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.066+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.708__shadow:xHx-2BZRPfdG80SjXXrJYG.0PMaHoyX_.1BkMbFioLX3wMhYGSgerV_E13L2o3fr_0 2024-09-12T01:29:16.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.066+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9007612743638790241', time=2024-09-12T03:24:07.889911+0000, chain.objs.size()=1 2024-09-12T01:29:16.067 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.066+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.709__shadow_.GtBAaFUnFaPL8XZAQP5OrxJqwxzqqA6_0 2024-09-12T01:29:16.070 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.070+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:16.072 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.072+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:29:16.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.074+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:16.074 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.074+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:16.075 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50620' 2024-09-12T01:29:16.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3576412944030528629', time=2024-09-12T03:09:11.191918+0000, chain.objs.size()=1 2024-09-12T01:29:16.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.255__shadow_.qKk9b6o-QuJ2AMCXIoyF3U16vxTXWqR_0 2024-09-12T01:29:16.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4767248554641798582', time=2024-09-12T03:09:54.389666+0000, chain.objs.size()=1 2024-09-12T01:29:16.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.7MTfgjXlfZk0p-OCFWdb5CR4EleI15y_0 2024-09-12T01:29:16.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5944985187736642185', time=2024-09-12T03:09:55.023929+0000, chain.objs.size()=1 2024-09-12T01:29:16.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.3Gz5w8Tf17QHEqKgW-BkrU7lxJLQmDs_0 2024-09-12T01:29:16.076 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6365596950082475929', time=2024-09-12T03:09:55.282877+0000, chain.objs.size()=1 2024-09-12T01:29:16.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.T3Aj_6rDnRfDAfMVt-jZyh46WIWXOKD_0 2024-09-12T01:29:16.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8392712724027327013', time=2024-09-12T03:09:56.053840+0000, chain.objs.size()=1 2024-09-12T01:29:16.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8WCJeMM7mBL4CdS_yHc86-9J5wtF1yj_0 2024-09-12T01:29:16.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8886188276945231346', time=2024-09-12T03:09:56.377183+0000, chain.objs.size()=1 2024-09-12T01:29:16.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.HmduvQyksJ6LIHHQWsgPNOAu3X-zmGA_0 2024-09-12T01:29:16.077 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3959208636452011219', time=2024-09-12T03:09:56.579892+0000, chain.objs.size()=1 2024-09-12T01:29:16.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0sIKZjdJ19mGlKlOQYOLZ8MiX4SVOFa_0 2024-09-12T01:29:16.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6708669347362174081', time=2024-09-12T03:09:57.935617+0000, chain.objs.size()=1 2024-09-12T01:29:16.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.94nv5HnDUuDA-bf1SpkkSG7fVjhjwz-_0 2024-09-12T01:29:16.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.213644756894939116', time=2024-09-12T03:09:58.097666+0000, chain.objs.size()=1 2024-09-12T01:29:16.078 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.t8xA-ht52JJvMLyYG2U94vzlaEq3_Cx_0 2024-09-12T01:29:16.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12442236740468756698', time=2024-09-12T03:09:59.408998+0000, chain.objs.size()=1 2024-09-12T01:29:16.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PKiEJhnzZeA7i-3bFEgCiNHotpY7z1c_0 2024-09-12T01:29:16.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16821164494195754093', time=2024-09-12T03:09:59.507167+0000, chain.objs.size()=1 2024-09-12T01:29:16.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.vTlBZq8Trwpk4FG9Op-QZP9mTi9D633_0 2024-09-12T01:29:16.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9040755874052132223', time=2024-09-12T03:09:59.919180+0000, chain.objs.size()=1 2024-09-12T01:29:16.079 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.075+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.rK0YQJ429tnEHT2ubJEQF864jtEfrQP_0 2024-09-12T01:29:16.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.078+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5687164808910462955', time=2024-09-12T03:09:59.919780+0000, chain.objs.size()=1 2024-09-12T01:29:16.080 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.078+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.l2XoKzoiYO-d4Cb7edY0hgDKkD3oYOm_0 2024-09-12T01:29:16.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.078+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6926203899745373270', time=2024-09-12T03:10:00.405095+0000, chain.objs.size()=1 2024-09-12T01:29:16.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.078+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.WNHKmcrVyDfhLvGiM3ejSXFoFpVpx-S_0 2024-09-12T01:29:16.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.078+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2053985207271931399', time=2024-09-12T03:10:00.513585+0000, chain.objs.size()=1 2024-09-12T01:29:16.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.078+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lA-sfHEG5TpzahhOz5o_F97k9L1KE7y_0 2024-09-12T01:29:16.081 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.078+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17730026603699435929', time=2024-09-12T03:10:01.405069+0000, chain.objs.size()=1 2024-09-12T01:29:16.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.078+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Yxyh4okPKqLPQmUUMNOJXitTPOpN8yH_0 2024-09-12T01:29:16.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.078+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3341184519081340039', time=2024-09-12T03:10:02.787405+0000, chain.objs.size()=1 2024-09-12T01:29:16.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.078+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.JJzHu4NU8tCwgev38bRg1cfkrgS43S-_0 2024-09-12T01:29:16.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.079+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.419008376230026777', time=2024-09-12T03:10:02.864718+0000, chain.objs.size()=1 2024-09-12T01:29:16.082 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.079+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.uJgpbCi557Wu6tzFl9vWBE0d_7m4SEv_0 2024-09-12T01:29:16.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.079+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10395437948040702338', time=2024-09-12T03:10:02.899840+0000, chain.objs.size()=1 2024-09-12T01:29:16.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.079+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.DdG7cHUVJMvtNu3jvEFN69BJ8rdHCm4_0 2024-09-12T01:29:16.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.079+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13430384326182021538', time=2024-09-12T03:10:03.000290+0000, chain.objs.size()=1 2024-09-12T01:29:16.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.079+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.my0CsN5_GsuWggKGyu4haOJVhI7Mthw_0 2024-09-12T01:29:16.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.079+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17523278011929630925', time=2024-09-12T03:10:03.624813+0000, chain.objs.size()=1 2024-09-12T01:29:16.083 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.079+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.m8ndIrRv4M_M5hLMRm7QiC5oOgnXvnE_0 2024-09-12T01:29:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.079+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6058323235031440847', time=2024-09-12T03:10:03.639133+0000, chain.objs.size()=1 2024-09-12T01:29:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.079+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.BQNPSftmYQ9crBJ9ltegsxpSisW2xvA_0 2024-09-12T01:29:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.079+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6918056955193828879', time=2024-09-12T03:10:04.831723+0000, chain.objs.size()=1 2024-09-12T01:29:16.084 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.079+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dYZmJEGOhrU0hp1SRJIrAoYdAiqiqc__0 2024-09-12T01:29:16.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.082+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2647696864270065646', time=2024-09-12T03:10:06.621687+0000, chain.objs.size()=1 2024-09-12T01:29:16.086 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.082+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Qk8whb3sBwnDdEcJ4rUcyjrFhFxRwkf_0 2024-09-12T01:29:16.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.082+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1022645767437512516', time=2024-09-12T03:10:06.695109+0000, chain.objs.size()=1 2024-09-12T01:29:16.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.082+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.qD2g9n9gV6iMP8Ppp60FJz6OooeJdCY_0 2024-09-12T01:29:16.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.082+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16945212497767897558', time=2024-09-12T03:10:07.308256+0000, chain.objs.size()=1 2024-09-12T01:29:16.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.082+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.263__shadow_.KSBwNApgge1gU9Pg8gpBtKSZe_0-Yra_0 2024-09-12T01:29:16.087 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.082+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5480134362001185801', time=2024-09-12T03:10:09.715012+0000, chain.objs.size()=1 2024-09-12T01:29:16.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.082+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.267__shadow_.8x048s8tyYVsTlJjAFUmCIZooMrUegY_0 2024-09-12T01:29:16.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.082+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6759122957085597762', time=2024-09-12T03:10:29.168527+0000, chain.objs.size()=1 2024-09-12T01:29:16.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.082+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.rxmWje8w6sluTrXM7ELFK4_gwZd4ad7_0 2024-09-12T01:29:16.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.082+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18136092082745943591', time=2024-09-12T03:10:31.183876+0000, chain.objs.size()=1 2024-09-12T01:29:16.088 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.082+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.296__shadow_.OdPyeGx9I5N_O01TxAlTtNauwkFmhAZ_0 2024-09-12T01:29:16.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.083+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4322196873476524642', time=2024-09-12T03:10:39.115700+0000, chain.objs.size()=1 2024-09-12T01:29:16.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.083+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.307__shadow:CfpJkSXASJ4OezdRD4Tzv512wxXV.2a_.ALmOtIHeLv1F7dF1r-9iRR6L2KyQe-t_0 2024-09-12T01:29:16.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.083+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1527759671143650312', time=2024-09-12T03:11:29.307507+0000, chain.objs.size()=1 2024-09-12T01:29:16.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.083+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.NHmCuPCWZsNjtwPLASSGryVisit6UsE_0 2024-09-12T01:29:16.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.083+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14867905867222565508', time=2024-09-12T03:11:29.308207+0000, chain.objs.size()=1 2024-09-12T01:29:16.089 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.083+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.GOnCJnQpmhnG5glMDmaodoyvt3nc7fI_0 2024-09-12T01:29:16.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.083+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1958882909184960787', time=2024-09-12T03:11:29.489685+0000, chain.objs.size()=1 2024-09-12T01:29:16.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.083+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.IeNyBNFL503s3ZSDZi1JSLiNxxslzX4_0 2024-09-12T01:29:16.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.083+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8033317506518437263', time=2024-09-12T03:11:30.061638+0000, chain.objs.size()=1 2024-09-12T01:29:16.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.083+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.saUzTtPTt8efE6aOIXcBpTxFIkVxA70_0 2024-09-12T01:29:16.090 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.084+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2765713741669616059', time=2024-09-12T03:11:31.108218+0000, chain.objs.size()=1 2024-09-12T01:29:16.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.084+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.UhKf8l9eoDt31DsmshMo_hHI2sbCilR_0 2024-09-12T01:29:16.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.085+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1559919587802039903', time=2024-09-12T03:11:31.254431+0000, chain.objs.size()=1 2024-09-12T01:29:16.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.085+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.4eM-ocBb0_Cw5yWcz2bvoEnc2tEY-yA_0 2024-09-12T01:29:16.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.085+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16253293611365144578', time=2024-09-12T03:11:31.352432+0000, chain.objs.size()=1 2024-09-12T01:29:16.091 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.085+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.LSSUQQqGTFdSJt1FrY5fo-Vx5Qf8_03_0 2024-09-12T01:29:16.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.087+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2778216852235331692', time=2024-09-12T03:11:31.443957+0000, chain.objs.size()=1 2024-09-12T01:29:16.094 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.087+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.NHVwwUAkD-zZ4cCxXAx4WOBzW__NG8g_0 2024-09-12T01:29:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.087+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16100721321354257233', time=2024-09-12T03:11:31.600402+0000, chain.objs.size()=1 2024-09-12T01:29:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.087+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.QX16hOWtZOF-Rn5nnw2Osvf-uwk6eDX_0 2024-09-12T01:29:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.087+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7884781445756715961', time=2024-09-12T03:11:31.713677+0000, chain.objs.size()=1 2024-09-12T01:29:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.087+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.8DyqybqEdXA4f4LdyCM8bazwFIPMeS1_0 2024-09-12T01:29:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.087+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4079367250413463422', time=2024-09-12T03:11:31.847214+0000, chain.objs.size()=1 2024-09-12T01:29:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.087+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.6Ci02-_F6tBpjzZmjyW-FUztV9mV3fp_0 2024-09-12T01:29:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.087+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7712862745073663984', time=2024-09-12T03:11:31.847850+0000, chain.objs.size()=1 2024-09-12T01:29:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.087+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.iU97jQCQT6LZ5kB8io78Luk0aFX1nUt_0 2024-09-12T01:29:16.095 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.088+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1049189714858400274', time=2024-09-12T03:11:32.080338+0000, chain.objs.size()=1 2024-09-12T01:29:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.088+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.BNNUswB2wSzKqRKfvN1Equba4pzb1eR_0 2024-09-12T01:29:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.088+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11527237328075084584', time=2024-09-12T03:11:32.805703+0000, chain.objs.size()=1 2024-09-12T01:29:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.088+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.cInAjx7LpUyPQGVzG6oOCDrClVDdzUh_0 2024-09-12T01:29:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.088+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13870781313000134994', time=2024-09-12T03:11:33.445871+0000, chain.objs.size()=1 2024-09-12T01:29:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.088+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tMg2F_FDWNbh879sbQi28TVX5UzNw19_0 2024-09-12T01:29:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.089+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4001877999417915844', time=2024-09-12T03:11:33.651733+0000, chain.objs.size()=1 2024-09-12T01:29:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.089+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.gKatBuB0LkNrRC7UBT2fPtePobP0yjr_0 2024-09-12T01:29:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.089+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4055269909456338017', time=2024-09-12T03:11:33.927025+0000, chain.objs.size()=1 2024-09-12T01:29:16.096 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.089+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.w3iB5ouM2-heHKYooiB3FpfT8-PIBNk_0 2024-09-12T01:29:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.090+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14955485561417242384', time=2024-09-12T03:11:35.004112+0000, chain.objs.size()=1 2024-09-12T01:29:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.090+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.TBq17bTxCOJn4w3ydD-WguJSGj_D7BI_0 2024-09-12T01:29:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.091+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14190858771500302085', time=2024-09-12T03:11:35.006333+0000, chain.objs.size()=1 2024-09-12T01:29:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.091+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.57TL7PTjPUQvUNOCHes6xEPEuHSNwQz_0 2024-09-12T01:29:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.091+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10863655367286519434', time=2024-09-12T03:11:35.006795+0000, chain.objs.size()=1 2024-09-12T01:29:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.091+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1mMydehaagAhV2VsB-GCKImTpiRgp6d_0 2024-09-12T01:29:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.091+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13146109776191409021', time=2024-09-12T03:11:35.219649+0000, chain.objs.size()=1 2024-09-12T01:29:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.091+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.6Pn1OlnpiwvvZ6EaMvF_9dnkGb_xehv_0 2024-09-12T01:29:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.091+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.255323656144362022', time=2024-09-12T03:11:35.568926+0000, chain.objs.size()=1 2024-09-12T01:29:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.091+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.f1KhsN61yJBMk5DRsZ94rl99YBr_fH1_0 2024-09-12T01:29:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.092+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10062134334899748173', time=2024-09-12T03:11:35.670787+0000, chain.objs.size()=1 2024-09-12T01:29:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.092+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.EsqOC73888d5CWj5abKSNUjpQrNtZBx_0 2024-09-12T01:29:16.097 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.092+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7688290490833808570', time=2024-09-12T03:11:35.671309+0000, chain.objs.size()=1 2024-09-12T01:29:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.092+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.WItNr5PC1uahRof7wfhlVGL9QOMP2lI_0 2024-09-12T01:29:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.092+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12284462237985180189', time=2024-09-12T03:11:36.171015+0000, chain.objs.size()=1 2024-09-12T01:29:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.092+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.4pt5A7xpSuqRL79POEuhLKO_f60CX_L_0 2024-09-12T01:29:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.092+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13257774091698044989', time=2024-09-12T03:11:36.333292+0000, chain.objs.size()=1 2024-09-12T01:29:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.092+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.gu3B03hy5yv3gqp2Vxl2grFe_BTMz9z_0 2024-09-12T01:29:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.092+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17402399259461203384', time=2024-09-12T03:11:36.939707+0000, chain.objs.size()=1 2024-09-12T01:29:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.092+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.duixtErRU3NrYtBCzR3SbPRtrj4l59A_0 2024-09-12T01:29:16.098 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.092+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6970670078487921090', time=2024-09-12T03:11:37.829461+0000, chain.objs.size()=1 2024-09-12T01:29:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.092+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.4q9Qa0WGAaE6_ZgbxLR0Gw4M0ncHkZw_0 2024-09-12T01:29:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.093+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16064452072383781026', time=2024-09-12T03:11:39.226372+0000, chain.objs.size()=1 2024-09-12T01:29:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.093+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ga488nzJ3DJ8Mx2cYwdmb66jamee5X6_0 2024-09-12T01:29:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.094+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3471370233568576658', time=2024-09-12T03:11:39.226860+0000, chain.objs.size()=1 2024-09-12T01:29:16.099 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.094+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.GEo2ClprJuPOnDTNcxesui-8WseKyHm_0 2024-09-12T01:29:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.094+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2994950466407011418', time=2024-09-12T03:11:39.755954+0000, chain.objs.size()=1 2024-09-12T01:29:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.094+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.CxJHwrXoXZP0PJg_gWDuoku28BcHVZH_0 2024-09-12T01:29:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.094+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12664471325228680107', time=2024-09-12T03:11:39.865849+0000, chain.objs.size()=1 2024-09-12T01:29:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.094+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.H5QXVDAlfkbC71b5a7R0V9FjK2hcGtN_0 2024-09-12T01:29:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.094+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8932560184097396709', time=2024-09-12T03:11:40.311539+0000, chain.objs.size()=1 2024-09-12T01:29:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.094+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-zcGJjkVs3oeYM5COB0QRMScZV6mRgO_0 2024-09-12T01:29:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.097+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9151615576973990451', time=2024-09-12T03:11:40.356707+0000, chain.objs.size()=1 2024-09-12T01:29:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.097+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.uZ75i8N3OTNVDrSu4xJCthqyCLI3hDe_0 2024-09-12T01:29:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.097+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11288954689326446374', time=2024-09-12T03:11:40.926439+0000, chain.objs.size()=1 2024-09-12T01:29:16.100 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.097+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MiRVdv79il07qo2UsfHB8pk-NAWxhAn_0 2024-09-12T01:29:16.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.097+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7052096163821651253', time=2024-09-12T03:11:41.171923+0000, chain.objs.size()=1 2024-09-12T01:29:16.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.097+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.a5-8lJWmp_esLHM2yY37NqPyQQl0-gM_0 2024-09-12T01:29:16.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10221109403954159721', time=2024-09-12T03:11:41.611294+0000, chain.objs.size()=1 2024-09-12T01:29:16.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mXvXYMjHZonBvECViAJkDdXIbRiznT0_0 2024-09-12T01:29:16.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4431652493357117474', time=2024-09-12T03:12:23.654049+0000, chain.objs.size()=1 2024-09-12T01:29:16.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Jk_7QMU4iC_BdxQ3VNDdkwtk3-cL2md_0 2024-09-12T01:29:16.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3638853029398137050', time=2024-09-12T03:12:24.357216+0000, chain.objs.size()=1 2024-09-12T01:29:16.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.fWb7c9W_PkI8IYPywtYqStRVGziBxp5_0 2024-09-12T01:29:16.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18298646543278120880', time=2024-09-12T03:12:24.533834+0000, chain.objs.size()=1 2024-09-12T01:29:16.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ucCGV-_kGXWmYlrR4OFGRWfH1kUxoSR_0 2024-09-12T01:29:16.101 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12396499866380597477', time=2024-09-12T03:12:24.616970+0000, chain.objs.size()=1 2024-09-12T01:29:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.wz9q5zhxcGhWcHhVxK-7ZrYetLozucz_0 2024-09-12T01:29:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16765679608740715948', time=2024-09-12T03:12:24.809446+0000, chain.objs.size()=1 2024-09-12T01:29:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1G80-srB3_MROxB8d6yCpfiXHDyN5Nm_0 2024-09-12T01:29:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11893847382596330022', time=2024-09-12T03:12:25.707314+0000, chain.objs.size()=1 2024-09-12T01:29:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.SAg2y1E7ofPDtbLLgZh7ccj9_J45N76_0 2024-09-12T01:29:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3630031372416733242', time=2024-09-12T03:12:25.868526+0000, chain.objs.size()=1 2024-09-12T01:29:16.102 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.099+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.vrg8rO2qriTQXsLQ9i41uB6QwiEySat_0 2024-09-12T01:29:16.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.101+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15580935855614849888', time=2024-09-12T03:12:26.378311+0000, chain.objs.size()=1 2024-09-12T01:29:16.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.101+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.7pVQJB7uVF_ghcaHFD-AnbARrBOXmo9_0 2024-09-12T01:29:16.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.101+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11444095067754221829', time=2024-09-12T03:12:27.708182+0000, chain.objs.size()=1 2024-09-12T01:29:16.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.101+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.nfKLe4KtcLrpQgqncpIbPl1e7dkeA3v_0 2024-09-12T01:29:16.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.102+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9101978934405450619', time=2024-09-12T03:12:27.854037+0000, chain.objs.size()=1 2024-09-12T01:29:16.103 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.102+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ID51CX82rR2F2v8DVUrTqjSlTlZ4lQ2_0 2024-09-12T01:29:16.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.103+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1116196979634708523', time=2024-09-12T03:12:29.439850+0000, chain.objs.size()=1 2024-09-12T01:29:16.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.103+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.p0iR-UCuRBXBPOCLLQ-3OPj20PahUiO_0 2024-09-12T01:29:16.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.103+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.239537745388461284', time=2024-09-12T03:12:29.440615+0000, chain.objs.size()=1 2024-09-12T01:29:16.104 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.103+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.AFwn0FGiSKrfrEVbdDUrXBIKtUq5lcG_0 2024-09-12T01:29:16.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.104+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14981675888528502832', time=2024-09-12T03:12:29.704265+0000, chain.objs.size()=1 2024-09-12T01:29:16.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.104+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.9LL1XDX58DFi_gCFKzHHUs6Ic42ldjf_0 2024-09-12T01:29:16.105 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.104+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9205757681935694538', time=2024-09-12T03:12:30.588879+0000, chain.objs.size()=1 2024-09-12T01:29:16.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.104+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.29oTa_p01e2lrhA1k8WIYjJ-QFi3y1-_0 2024-09-12T01:29:16.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.104+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3691296130786347539', time=2024-09-12T03:12:31.152003+0000, chain.objs.size()=1 2024-09-12T01:29:16.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.104+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.D10kD0HFtuBva_5pr2JkBMVsQd7xSY1_0 2024-09-12T01:29:16.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.104+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9090743708107270216', time=2024-09-12T03:12:31.304899+0000, chain.objs.size()=1 2024-09-12T01:29:16.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.104+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.uNRJTplX0wT0rnhqJSbL0yHxnkKA7T6_0 2024-09-12T01:29:16.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.104+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8044620653960961956', time=2024-09-12T03:12:31.577920+0000, chain.objs.size()=1 2024-09-12T01:29:16.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.104+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.EKH0v_zJz1Vn4qM1NZRTbHIynvr66Fn_0 2024-09-12T01:29:16.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.104+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14823985413442668113', time=2024-09-12T03:12:32.108123+0000, chain.objs.size()=1 2024-09-12T01:29:16.106 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.104+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.dPDXYiJ5Blmw9fMcODI-vYha3boC4kQ_0 2024-09-12T01:29:16.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.105+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15174774709718161982', time=2024-09-12T03:12:32.298759+0000, chain.objs.size()=1 2024-09-12T01:29:16.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.105+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.jSlQECgUNoqns5uOgoYsc4MLBHC45cs_0 2024-09-12T01:29:16.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.105+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6936853839827541276', time=2024-09-12T03:12:32.310703+0000, chain.objs.size()=1 2024-09-12T01:29:16.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.105+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.PBHtuu8gHwKni7ceFnmDhkrvAIYrqJL_0 2024-09-12T01:29:16.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.105+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18110277862421537010', time=2024-09-12T03:12:32.477081+0000, chain.objs.size()=1 2024-09-12T01:29:16.107 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.105+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.uQz6qRA6VRFOS3zltMahvRRip0X9B1A_0 2024-09-12T01:29:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.107+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.335027574964712529', time=2024-09-12T03:12:32.864989+0000, chain.objs.size()=1 2024-09-12T01:29:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.107+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ydpkmU2C2CeSrdr4uMT3QYYYFQ3dh_d_0 2024-09-12T01:29:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.108+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14829799633479489547', time=2024-09-12T03:12:33.767857+0000, chain.objs.size()=1 2024-09-12T01:29:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.108+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.XDVAvu6gJrtxoFmf2HDvHrKSOMjqOQM_0 2024-09-12T01:29:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.108+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5168451276612256402', time=2024-09-12T03:12:33.860689+0000, chain.objs.size()=1 2024-09-12T01:29:16.108 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.108+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.dw41sh4mdWtC7O8eJmax2IeQlQk5xgN_0 2024-09-12T01:29:16.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10630191781832245675', time=2024-09-12T03:12:34.121870+0000, chain.objs.size()=1 2024-09-12T01:29:16.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.KH2DDQeXkAq6KOEGwJ7dsNaILYe9_9v_0 2024-09-12T01:29:16.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8194168445136167842', time=2024-09-12T03:12:34.281283+0000, chain.objs.size()=1 2024-09-12T01:29:16.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.kiebEx4VDflosRaIIaTA9zSLTSs6ajP_0 2024-09-12T01:29:16.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18063214432205966146', time=2024-09-12T03:12:34.398988+0000, chain.objs.size()=1 2024-09-12T01:29:16.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Dvlvparm2TbAYP_SrpZY5Wa4WcAgsMS_0 2024-09-12T01:29:16.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5223547634137803722', time=2024-09-12T03:13:57.693335+0000, chain.objs.size()=1 2024-09-12T01:29:16.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.466__shadow_.CkEbc9pGq-CE_PktCDB9w7JpL7TLngr_0 2024-09-12T01:29:16.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12552370062099856329', time=2024-09-12T03:14:05.123641+0000, chain.objs.size()=1 2024-09-12T01:29:16.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.483__shadow_.TWybQ95Q_F7EWW5fCQCv3xtiIYiTsZH_0 2024-09-12T01:29:16.110 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4822040832545702461', time=2024-09-12T03:14:17.259958+0000, chain.objs.size()=1 2024-09-12T01:29:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.499__shadow_.2FqvB3plZ-Hkar8eQ1rw7M-NxIhgRRm_0 2024-09-12T01:29:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17218565042991418340', time=2024-09-12T03:14:34.387725+0000, chain.objs.size()=1 2024-09-12T01:29:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.515__shadow_.q74aEbNDNKChAu-xSSCroIOSVJ8MoiN_0 2024-09-12T01:29:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12038447117977476100', time=2024-09-12T03:15:58.311478+0000, chain.objs.size()=2 2024-09-12T01:29:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.109+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.523__multipart_mymultipart.2~KtXw4ExSFG4G2kUzpaXNxA_fAKcTqGK.1 2024-09-12T01:29:16.111 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.111+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.523__multipart_mymultipart.2~KtXw4ExSFG4G2kUzpaXNxA_fAKcTqGK.2 2024-09-12T01:29:16.112 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.112+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~ATeUP0FjmByqbRnWgeQIxnDT8YW0fTV', time=2024-09-12T03:16:36.147535+0000, chain.objs.size()=1 2024-09-12T01:29:16.113 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.112+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.535__multipart_mymultipart.2~ATeUP0FjmByqbRnWgeQIxnDT8YW0fTV.3 2024-09-12T01:29:16.115 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.115+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/50620 2024-09-12T01:29:16.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T01:29:16.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.429652331228432272', time=2024-09-12T03:17:26.764211+0000, chain.objs.size()=1 2024-09-12T01:29:16.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.557__shadow_.47sOs1b8Z1oq4VaIWIY5kbrdjh2X-v__0 2024-09-12T01:29:16.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7632435784325725683', time=2024-09-12T03:17:45.480185+0000, chain.objs.size()=1 2024-09-12T01:29:16.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:C2yuf00g3LciNGmTmiHy-3euM0L3f2B_.B3J8dh_pByJCLeL8sYrrSc07tVFSK7U_0 2024-09-12T01:29:16.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15367628518286120650', time=2024-09-12T03:18:28.612529+0000, chain.objs.size()=1 2024-09-12T01:29:16.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:qmdekDMgZLclJX95KRmftkW0wSE08QB_._94OmC315hjdsyAQMs1RTWaFYK4oM9G_0 2024-09-12T01:29:16.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14013240587434631558', time=2024-09-12T03:18:29.279092+0000, chain.objs.size()=1 2024-09-12T01:29:16.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:f9iaEC.q--QHhfWYIVSxF1ofUpFYIvC_.R5jx66PwFmvm3uYlcId2JyQE-zBvM8u_0 2024-09-12T01:29:16.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13342468996994011227', time=2024-09-12T03:18:48.390416+0000, chain.objs.size()=1 2024-09-12T01:29:16.118 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.579__shadow:IocHFshARvx6tux8WH6lMT855spXp6h_.vFYxFq_DqObDlMe9rjPeKR9_JnSJJel_0 2024-09-12T01:29:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5246704896034092500', time=2024-09-12T03:18:48.434093+0000, chain.objs.size()=1 2024-09-12T01:29:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.579__shadow:A66NbVNxGWVI.ojxBMVqCrjgX-ALB8h_.uBkcsYsmNBfLXAjp3yEgrqFwydLzey2_0 2024-09-12T01:29:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13981752786878070513', time=2024-09-12T03:23:09.548034+0000, chain.objs.size()=1 2024-09-12T01:29:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.644__shadow_.MLixHMcYCx_z95H6ZNQUunWxmY4tYEY_0 2024-09-12T01:29:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.852975688708925851', time=2024-09-12T03:24:09.787314+0000, chain.objs.size()=1 2024-09-12T01:29:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.712__shadow:z4N7AH2u2XRdzv2ApSxTVtR9mI.Gq0p_.2deJgjYTdi8RNZQfyNmHlOKUtYKVk80_0 2024-09-12T01:29:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13462506556354944626', time=2024-09-12T03:24:33.374376+0000, chain.objs.size()=1 2024-09-12T01:29:16.119 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.117+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.719__shadow_.SCZLt-hNin6rB2VBFTuXdlVtBxAeuii_0 2024-09-12T01:29:16.121 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.121+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:16.123 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.123+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:29:16.124 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.124+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:16.125 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:16.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46650' 2024-09-12T01:29:16.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~MVcX06Loghms3sL0CISPImnaopKsIoU', time=2024-09-12T03:07:26.963856+0000, chain.objs.size()=1 2024-09-12T01:29:16.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.202__multipart_mymultipart.2~MVcX06Loghms3sL0CISPImnaopKsIoU.1 2024-09-12T01:29:16.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15107422425371557494', time=2024-09-12T03:08:58.144196+0000, chain.objs.size()=1 2024-09-12T01:29:16.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.236__shadow_.-hi857oCUEKjHTUDxSWG7eSOVRPgEJk_0 2024-09-12T01:29:16.126 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1331457320448044452', time=2024-09-12T03:08:58.156855+0000, chain.objs.size()=1 2024-09-12T01:29:16.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.236__shadow_.ORn2Y2aC_jz37farNj294Qlhdc7Y0rA_0 2024-09-12T01:29:16.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8561146078719968284', time=2024-09-12T03:08:59.936637+0000, chain.objs.size()=1 2024-09-12T01:29:16.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.238__shadow_.osPMckZX3FtQ3O1bLTxpgG4nYIG5pyY_0 2024-09-12T01:29:16.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12746203019204409859', time=2024-09-12T03:09:06.655207+0000, chain.objs.size()=1 2024-09-12T01:29:16.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.248__shadow_.XfiueO3uPTS4IV-TQnq-C-MSBO3pguE_0 2024-09-12T01:29:16.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6482029693707763714', time=2024-09-12T03:09:07.303292+0000, chain.objs.size()=1 2024-09-12T01:29:16.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.249__shadow_.zlQTn32c60vS2hSrRWNxG26Dt2xghwp_0 2024-09-12T01:29:16.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15528699337327733446', time=2024-09-12T03:09:12.422098+0000, chain.objs.size()=1 2024-09-12T01:29:16.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.257__shadow_.doT0Px0GmKucU9XiL7WHy-QdO3d4uOL_0 2024-09-12T01:29:16.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13434373787166305341', time=2024-09-12T03:09:54.321069+0000, chain.objs.size()=1 2024-09-12T01:29:16.127 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.IUN9reG_acVQyo-cXNUNb740EI3Q1V5_0 2024-09-12T01:29:16.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17891210911697505222', time=2024-09-12T03:09:54.880948+0000, chain.objs.size()=1 2024-09-12T01:29:16.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.m3xFA5aka_b79DUAT1NBv_eFXwUJo9A_0 2024-09-12T01:29:16.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1690537881895542930', time=2024-09-12T03:09:55.428557+0000, chain.objs.size()=1 2024-09-12T01:29:16.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.XxOql_DTQ4B9CgLw6fVXN8qn2wqlxxh_0 2024-09-12T01:29:16.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10868011425925668026', time=2024-09-12T03:09:56.353200+0000, chain.objs.size()=1 2024-09-12T01:29:16.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.7DljCe6LXTXLEitWnYqWvPJvLAwH9Sd_0 2024-09-12T01:29:16.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18162369591933111286', time=2024-09-12T03:09:57.245687+0000, chain.objs.size()=1 2024-09-12T01:29:16.128 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.125+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.5LF5Mdr721_jFkIwPUwcC1liO-dQ5qM_0 2024-09-12T01:29:16.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.128+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6400422941308389502', time=2024-09-12T03:09:57.784587+0000, chain.objs.size()=1 2024-09-12T01:29:16.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.128+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.YvIGaEKQcGeFSw3RNq4Do_5FvKIamX1_0 2024-09-12T01:29:16.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.129+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1459459020531927458', time=2024-09-12T03:09:57.935934+0000, chain.objs.size()=1 2024-09-12T01:29:16.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.129+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.zIHNuBj0URdSDnCJBrPsPhgY91Vc_fd_0 2024-09-12T01:29:16.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.129+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16174669361282592957', time=2024-09-12T03:09:58.451188+0000, chain.objs.size()=1 2024-09-12T01:29:16.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.129+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.GQrQ77hpBvwCj60SrLqf7OPyLFIQVC9_0 2024-09-12T01:29:16.129 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.129+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17929606156051562729', time=2024-09-12T03:09:58.451938+0000, chain.objs.size()=1 2024-09-12T01:29:16.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.129+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1z-4Rz-h0v9dcUUV4iZAkpnDEdh0TJQ_0 2024-09-12T01:29:16.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.129+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11965208567101335675', time=2024-09-12T03:09:59.757560+0000, chain.objs.size()=1 2024-09-12T01:29:16.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.129+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.nHgwXOakK_SgwYFp8Zw000HMsr3lN0L_0 2024-09-12T01:29:16.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.129+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4040810627842864324', time=2024-09-12T03:10:00.017758+0000, chain.objs.size()=1 2024-09-12T01:29:16.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.129+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.9TWlB9mB74LvK0PawQBzXGzD-L75hqX_0 2024-09-12T01:29:16.130 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.129+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18026765005799982786', time=2024-09-12T03:10:00.263587+0000, chain.objs.size()=1 2024-09-12T01:29:16.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.129+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.BbZeSYzYezrPcZBxQqOx-f8lB4wH-H9_0 2024-09-12T01:29:16.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.130+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13743396244048825954', time=2024-09-12T03:10:01.105208+0000, chain.objs.size()=1 2024-09-12T01:29:16.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.130+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.KWpSGkKXCMRLkChZcvkn967QHHK6hlU_0 2024-09-12T01:29:16.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.130+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6519893259899633869', time=2024-09-12T03:10:01.253728+0000, chain.objs.size()=1 2024-09-12T01:29:16.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.130+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.SKapwEE6iyyZb_cjfj3bzy-xuAHB3_G_0 2024-09-12T01:29:16.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.130+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7460512638316735996', time=2024-09-12T03:10:02.234229+0000, chain.objs.size()=1 2024-09-12T01:29:16.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.130+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PwUvgtRRgGacaIfPDB8ARP_SrQV5Ixp_0 2024-09-12T01:29:16.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.130+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10003251032125136309', time=2024-09-12T03:10:02.805240+0000, chain.objs.size()=1 2024-09-12T01:29:16.131 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.131+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.CzTvaOQb5kmjlwRG-aOeZIY852qK2qd_0 2024-09-12T01:29:16.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.132+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2713977082030458062', time=2024-09-12T03:10:02.855822+0000, chain.objs.size()=1 2024-09-12T01:29:16.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.132+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.eXhL-v_2ixn7znB6bQ86W_shnVN0mdO_0 2024-09-12T01:29:16.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.132+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16861049309289126826', time=2024-09-12T03:10:03.859965+0000, chain.objs.size()=1 2024-09-12T01:29:16.132 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.132+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Hkn6NmjEvHOyZ66YpbR1kqUbbbNPBTt_0 2024-09-12T01:29:16.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.133+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17477086849153109113', time=2024-09-12T03:10:03.860473+0000, chain.objs.size()=1 2024-09-12T01:29:16.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.133+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dDKqnDmsBOJaMHl_biPH-8ft4dHI54Q_0 2024-09-12T01:29:16.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.133+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3143244853910253459', time=2024-09-12T03:10:04.719008+0000, chain.objs.size()=1 2024-09-12T01:29:16.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.133+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Cy2uezkMt6hX0HO7L9GZT3xPZSvpxyO_0 2024-09-12T01:29:16.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.133+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8457633644868418154', time=2024-09-12T03:10:04.902704+0000, chain.objs.size()=1 2024-09-12T01:29:16.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.133+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.bp19r0N7aZZhy4NVapMWyx4c-Dg8m00_0 2024-09-12T01:29:16.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.133+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.79329865043946514', time=2024-09-12T03:10:04.903404+0000, chain.objs.size()=1 2024-09-12T01:29:16.133 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.133+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.rxIHZlR8eyS3wYV2qoOcJh7lwjHWZHY_0 2024-09-12T01:29:16.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.133+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11204226259400908353', time=2024-09-12T03:10:05.048666+0000, chain.objs.size()=1 2024-09-12T01:29:16.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.133+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.LpvOCCPD0ipdXCuJhPLr8SBHb0qxM0Q_0 2024-09-12T01:29:16.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.134+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1776169314286630145', time=2024-09-12T03:10:05.352316+0000, chain.objs.size()=1 2024-09-12T01:29:16.134 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.134+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.SENV8Zdzl7oSwhN-Oxz_lLFdltwIJXT_0 2024-09-12T01:29:16.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.136+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5309212932611051553', time=2024-09-12T03:10:05.728769+0000, chain.objs.size()=1 2024-09-12T01:29:16.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.136+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lqMQjnSHpzi3YaFpoGbn9QYrHCo3DbH_0 2024-09-12T01:29:16.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.136+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2389966678315428769', time=2024-09-12T03:10:05.908651+0000, chain.objs.size()=1 2024-09-12T01:29:16.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.136+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.VldbyrtlbiTXYEHFeJzv4SGf7ARsh8x_0 2024-09-12T01:29:16.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.136+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14904465836214367043', time=2024-09-12T03:10:06.103131+0000, chain.objs.size()=1 2024-09-12T01:29:16.136 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.136+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.U_OWgDvL4_dK3NJhvl9hoT4s4qvoEEh_0 2024-09-12T01:29:16.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.136+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7886502199214797543', time=2024-09-12T03:10:06.168598+0000, chain.objs.size()=1 2024-09-12T01:29:16.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.136+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.oa85VkZn90s2Ujyfm0IfDuyz5jY7m9P_0 2024-09-12T01:29:16.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.136+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8511966061320283907', time=2024-09-12T03:10:06.201771+0000, chain.objs.size()=1 2024-09-12T01:29:16.137 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.136+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Wp-Z_ksowfIxkZ7IzccB3F6RKXsy5Wk_0 2024-09-12T01:29:16.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.138+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6798722367221232730', time=2024-09-12T03:10:07.936495+0000, chain.objs.size()=1 2024-09-12T01:29:16.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.138+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.264__shadow_.UubSGjJX2zXfqBbxUirJa_LKL8orQ0L_0 2024-09-12T01:29:16.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.138+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11240324764905333824', time=2024-09-12T03:10:15.806708+0000, chain.objs.size()=1 2024-09-12T01:29:16.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.138+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.277__shadow_.ddZsPY2EHPl-noLHrGWfgGJt5YY8S3k_0 2024-09-12T01:29:16.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.138+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7151851676627987038', time=2024-09-12T03:10:23.739642+0000, chain.objs.size()=1 2024-09-12T01:29:16.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.138+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.289__shadow_.uf5l9Icv6uBveIP7w3Uq96E8qHhI8is_0 2024-09-12T01:29:16.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.138+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6517797381062388635', time=2024-09-12T03:10:27.173502+0000, chain.objs.size()=1 2024-09-12T01:29:16.138 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.138+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.Yu7cbWFmN8jQqUgXNfTHZbeXO_GGcri_0 2024-09-12T01:29:16.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.138+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16244755351428521368', time=2024-09-12T03:10:48.161359+0000, chain.objs.size()=1 2024-09-12T01:29:16.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.138+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.321__shadow_.0g5v0PCSHcRlCL7ADN4EGyH470D_VV6_0 2024-09-12T01:29:16.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.138+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17313764609963923940', time=2024-09-12T03:11:29.655515+0000, chain.objs.size()=1 2024-09-12T01:29:16.139 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.138+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tls_ryMsiT5XQipcd6CdI6V0-csv2rl_0 2024-09-12T01:29:16.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.141+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12228157928634739963', time=2024-09-12T03:11:30.521412+0000, chain.objs.size()=1 2024-09-12T01:29:16.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.141+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tHpo_l8CnnJH09ABxYsi7LPWsybAA39_0 2024-09-12T01:29:16.141 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.141+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12050425942077563607', time=2024-09-12T03:11:31.419828+0000, chain.objs.size()=1 2024-09-12T01:29:16.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.141+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.DSRYByXruso44Vm8Cr5ksPNWPsAiIXQ_0 2024-09-12T01:29:16.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.141+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3253687215889042961', time=2024-09-12T03:11:31.655699+0000, chain.objs.size()=1 2024-09-12T01:29:16.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.141+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.E4TXxCT12vCXjpsUi0cMhUz5IwTYgmL_0 2024-09-12T01:29:16.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.141+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.606371262364361349', time=2024-09-12T03:11:32.221054+0000, chain.objs.size()=1 2024-09-12T01:29:16.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.141+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.pjVtKjocYf8f9p1xKv_De9Y_R1JPmly_0 2024-09-12T01:29:16.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.141+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5636603660954354846', time=2024-09-12T03:11:32.303913+0000, chain.objs.size()=1 2024-09-12T01:29:16.142 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.141+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.EUCjOMghlhPd80HchOOM_FLdOtOa7SR_0 2024-09-12T01:29:16.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.142+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4877632206105720323', time=2024-09-12T03:11:32.340045+0000, chain.objs.size()=1 2024-09-12T01:29:16.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.142+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qkda9Fp7NG4KBmOLT2vh9jX3F1vyzgx_0 2024-09-12T01:29:16.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.142+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15451056578704787716', time=2024-09-12T03:11:33.025641+0000, chain.objs.size()=1 2024-09-12T01:29:16.143 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.142+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7WhCZ2SWEmOonbvVxkGLqDlY9Av_stt_0 2024-09-12T01:29:16.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.142+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1394119858945094590', time=2024-09-12T03:11:33.026344+0000, chain.objs.size()=1 2024-09-12T01:29:16.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.142+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.sviJjXjZbHnD4MXcwvDX17_bKNIc5Eg_0 2024-09-12T01:29:16.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.142+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12299061414220680467', time=2024-09-12T03:11:33.147916+0000, chain.objs.size()=1 2024-09-12T01:29:16.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.142+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.dBaQDDmF07Cxngq3hzC-eJxADZRI7P0_0 2024-09-12T01:29:16.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.142+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6854927455608242997', time=2024-09-12T03:11:33.148579+0000, chain.objs.size()=1 2024-09-12T01:29:16.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.142+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.0n_yWe3YGRKAHLGlfa-lSJFw9v254Dc_0 2024-09-12T01:29:16.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.142+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11360463342687576343', time=2024-09-12T03:11:33.354796+0000, chain.objs.size()=1 2024-09-12T01:29:16.144 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.142+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.GKw5Q9d9JPGu8UV9ND7yZWQX5GzCYXL_0 2024-09-12T01:29:16.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.144+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9108852591578320032', time=2024-09-12T03:11:33.680379+0000, chain.objs.size()=1 2024-09-12T01:29:16.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.144+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.nl9OKjbgmcWNcITWM9z9nY1zfO_C7OB_0 2024-09-12T01:29:16.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.144+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15605144441390458405', time=2024-09-12T03:11:34.599471+0000, chain.objs.size()=1 2024-09-12T01:29:16.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.144+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Eyhb32Y_Bq2blzACi8-f3yssve-MlTf_0 2024-09-12T01:29:16.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.144+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10508787278302881062', time=2024-09-12T03:11:34.600308+0000, chain.objs.size()=1 2024-09-12T01:29:16.145 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.144+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.mFSrcJugEdEnEDQyxCYnlXyh5XOCPEr_0 2024-09-12T01:29:16.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.146+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.115211646950138872', time=2024-09-12T03:11:35.342165+0000, chain.objs.size()=1 2024-09-12T01:29:16.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.146+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.eMJgsL1eVeA9IrShcluL2Cb3-1HX5GJ_0 2024-09-12T01:29:16.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.146+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11882685925086210622', time=2024-09-12T03:11:36.084882+0000, chain.objs.size()=1 2024-09-12T01:29:16.146 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.146+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.8UGIK0683YOl1NgtFahvEihTTIxkfhU_0 2024-09-12T01:29:16.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.146+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10499183456558934723', time=2024-09-12T03:11:36.805250+0000, chain.objs.size()=1 2024-09-12T01:29:16.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.146+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Z0Q4fePJ9--Yta189F2CbmLocT0mTFS_0 2024-09-12T01:29:16.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.146+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11589241357033193190', time=2024-09-12T03:11:37.133486+0000, chain.objs.size()=1 2024-09-12T01:29:16.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.146+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.u5kbBWebL_5cPZ4pdbYWz536I7EkFcd_0 2024-09-12T01:29:16.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.146+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13822719776113936571', time=2024-09-12T03:11:37.672652+0000, chain.objs.size()=1 2024-09-12T01:29:16.147 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.146+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1k9tQhiKqlxscoQKh4EBtKv4vium7E2_0 2024-09-12T01:29:16.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.148+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1703528975431711918', time=2024-09-12T03:11:38.829821+0000, chain.objs.size()=1 2024-09-12T01:29:16.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.148+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ehJehO3ovF0TtieIq80B4tAo8gLaF7u_0 2024-09-12T01:29:16.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.148+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12388318392169269299', time=2024-09-12T03:11:39.193453+0000, chain.objs.size()=1 2024-09-12T01:29:16.148 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.148+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.r61pXZP4KkS0-5G9P_uP9hXEfkcftU5_0 2024-09-12T01:29:16.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.148+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12064146408372639027', time=2024-09-12T03:11:39.194164+0000, chain.objs.size()=1 2024-09-12T01:29:16.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.148+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.N8upGunxb-VrrKKWTmFsm0QQQmcxlWI_0 2024-09-12T01:29:16.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.148+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9445977482058097659', time=2024-09-12T03:11:40.000736+0000, chain.objs.size()=1 2024-09-12T01:29:16.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.148+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.4xQCLNusewHB-YLkr5K6EiBbwbtSI-k_0 2024-09-12T01:29:16.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.148+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9883461201973976437', time=2024-09-12T03:11:40.101246+0000, chain.objs.size()=1 2024-09-12T01:29:16.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.148+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.GX66-ALvq4QPrBQFFYy1DOYSrWgi5Z2_0 2024-09-12T01:29:16.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.148+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4292476912472994463', time=2024-09-12T03:11:40.133794+0000, chain.objs.size()=1 2024-09-12T01:29:16.149 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.148+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xQl_Puh6esh_-Y7MyxECYqpP9A8yeSu_0 2024-09-12T01:29:16.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.149+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8106249555392406457', time=2024-09-12T03:11:40.164484+0000, chain.objs.size()=1 2024-09-12T01:29:16.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.149+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.b-UbyPROWEYtLwCzIdSjaDctoYlwDdz_0 2024-09-12T01:29:16.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.149+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.228621311237561437', time=2024-09-12T03:11:40.808297+0000, chain.objs.size()=1 2024-09-12T01:29:16.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.149+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.4cU1UDmth9nfVeHuea-TUXRaHUQzSD0_0 2024-09-12T01:29:16.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.150+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6147014099648078472', time=2024-09-12T03:11:40.968611+0000, chain.objs.size()=1 2024-09-12T01:29:16.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.150+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.wme2NwjLd497ZS7G8RR-gmOH129iNYz_0 2024-09-12T01:29:16.150 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.150+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5266382915136241192', time=2024-09-12T03:11:41.456517+0000, chain.objs.size()=1 2024-09-12T01:29:16.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.150+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ocaEAvwnRzZO86xW4prfdIlYSL0g-vF_0 2024-09-12T01:29:16.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.150+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8041975242642763128', time=2024-09-12T03:11:41.500197+0000, chain.objs.size()=1 2024-09-12T01:29:16.151 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.150+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.9Lij-qd1dnbmPM8Gmf28hHMoGlrvzQz_0 2024-09-12T01:29:16.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.223275924909653957', time=2024-09-12T03:12:21.867884+0000, chain.objs.size()=1 2024-09-12T01:29:16.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.KxF3AjdfMzTnG-FplJhhTCwsG2cq2bx_0 2024-09-12T01:29:16.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17969469491845387750', time=2024-09-12T03:12:22.268942+0000, chain.objs.size()=1 2024-09-12T01:29:16.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.0U0UDV69dnAaVNcMba2N3VmJEFcmOX0_0 2024-09-12T01:29:16.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1080344689352237214', time=2024-09-12T03:12:22.643127+0000, chain.objs.size()=1 2024-09-12T01:29:16.154 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.A2ZeHQUYa07hZUBkeDVGPCx-F6m3C3R_0 2024-09-12T01:29:16.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12346412214356886785', time=2024-09-12T03:12:22.751511+0000, chain.objs.size()=1 2024-09-12T01:29:16.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._EPQ9QZM7O9rhBzuC3UMSKkCt3F6z_j_0 2024-09-12T01:29:16.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13461827478056647454', time=2024-09-12T03:12:22.813415+0000, chain.objs.size()=1 2024-09-12T01:29:16.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.n_vFN8I2r7ek6L9wJkue5VCCuYQXO8v_0 2024-09-12T01:29:16.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18363174297588742716', time=2024-09-12T03:12:23.032434+0000, chain.objs.size()=1 2024-09-12T01:29:16.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.JkunGYiEGQe5lQCgxMGlLNUKHSM3AJD_0 2024-09-12T01:29:16.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9018472977702851884', time=2024-09-12T03:12:23.033165+0000, chain.objs.size()=1 2024-09-12T01:29:16.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gh6JzKY6g03c4GCnXcx2EaA3qqyBvfl_0 2024-09-12T01:29:16.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1665855677779994369', time=2024-09-12T03:12:23.648150+0000, chain.objs.size()=1 2024-09-12T01:29:16.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.rUSchiQnu5BLkUVYF8wf8ObVs54C0z__0 2024-09-12T01:29:16.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13052059392546382723', time=2024-09-12T03:12:24.359003+0000, chain.objs.size()=1 2024-09-12T01:29:16.155 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.GVGx_k6qwuCJKL2RbdmRBvli8x31ixQ_0 2024-09-12T01:29:16.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11377719707133742895', time=2024-09-12T03:12:24.449185+0000, chain.objs.size()=1 2024-09-12T01:29:16.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.LS8zUJtqf9LW5ntvVhg5k76EGC3-bz0_0 2024-09-12T01:29:16.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1927398057146521711', time=2024-09-12T03:12:24.773067+0000, chain.objs.size()=1 2024-09-12T01:29:16.156 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.154+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.UT-JmEY7InwMkDpvxD_9-bY395s9sIM_0 2024-09-12T01:29:16.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.156+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8817085034546657025', time=2024-09-12T03:12:25.347744+0000, chain.objs.size()=1 2024-09-12T01:29:16.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.156+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.wV8GGnaKal6LvVH0I283pXR833zGm42_0 2024-09-12T01:29:16.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.156+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3506738986206532322', time=2024-09-12T03:12:25.370295+0000, chain.objs.size()=1 2024-09-12T01:29:16.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.156+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.qgJTIIFzlVHBwhRnsw7luZOie-heoNQ_0 2024-09-12T01:29:16.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.157+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1253079897625076098', time=2024-09-12T03:12:25.931395+0000, chain.objs.size()=1 2024-09-12T01:29:16.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.157+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.9vztABVHVfWuiRqjAdFfA8aX8uOaD1D_0 2024-09-12T01:29:16.157 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.157+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13753665443038179325', time=2024-09-12T03:12:26.005437+0000, chain.objs.size()=1 2024-09-12T01:29:16.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.157+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.73A2I4VYDtrhXFYB3U7u82__Cvj13ce_0 2024-09-12T01:29:16.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.158+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7570984055976654588', time=2024-09-12T03:12:27.370808+0000, chain.objs.size()=1 2024-09-12T01:29:16.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.158+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.lzrQyNCIJzjCTZgLvyFJqlqV9xKofWp_0 2024-09-12T01:29:16.158 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.158+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10798406398571228919', time=2024-09-12T03:12:28.141558+0000, chain.objs.size()=1 2024-09-12T01:29:16.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.158+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.srO4f60JUvGPu7d4heIPqAbhZ-SG5Z9_0 2024-09-12T01:29:16.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.158+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1255992743617205181', time=2024-09-12T03:12:28.255499+0000, chain.objs.size()=1 2024-09-12T01:29:16.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.158+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.8jLNzi_j3D_FJ-bRcSQ-y8fOLe9eSLw_0 2024-09-12T01:29:16.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.158+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4598998826270391981', time=2024-09-12T03:12:28.256269+0000, chain.objs.size()=1 2024-09-12T01:29:16.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.158+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.qaIqTu-gnDmFxiDvRXAiFjRgqZ_7yvu_0 2024-09-12T01:29:16.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.158+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4616188008312403688', time=2024-09-12T03:12:28.887626+0000, chain.objs.size()=1 2024-09-12T01:29:16.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.158+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ZrVm8IA5lVFleN2K7-j2MFSUuHdLxnU_0 2024-09-12T01:29:16.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.158+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10091433755184551462', time=2024-09-12T03:12:29.087987+0000, chain.objs.size()=1 2024-09-12T01:29:16.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.158+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.6GIhMM69BEB7QXYzAX0x9XOiYR8aY_x_0 2024-09-12T01:29:16.159 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.158+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12240649717578067380', time=2024-09-12T03:12:29.707805+0000, chain.objs.size()=1 2024-09-12T01:29:16.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.158+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.vlQkYYPYVfi0jqoyeMP-2xfQKl1Jfkl_0 2024-09-12T01:29:16.160 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.160+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5353842426615549570', time=2024-09-12T03:12:30.351522+0000, chain.objs.size()=1 2024-09-12T01:29:16.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.160+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.C9RsdK5hgAqmrp4LLBMcZqRBSnP9VDq_0 2024-09-12T01:29:16.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.160+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17557538229128681671', time=2024-09-12T03:12:30.418984+0000, chain.objs.size()=1 2024-09-12T01:29:16.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.160+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Jbz8GKcfB5nNRvJ87fQQIwETcU6Bhtr_0 2024-09-12T01:29:16.161 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.161+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.359380704700828376', time=2024-09-12T03:12:30.604299+0000, chain.objs.size()=1 2024-09-12T01:29:16.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.161+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.vsfnIc75z5BHsFMqm_KyvERsIO77XlL_0 2024-09-12T01:29:16.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.161+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2632265295383944426', time=2024-09-12T03:12:30.892749+0000, chain.objs.size()=1 2024-09-12T01:29:16.162 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.161+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.jxlj6FrbVTSgSYJOQNW1AJ21yEFzHDn_0 2024-09-12T01:29:16.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.162+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16969506942759134274', time=2024-09-12T03:12:31.305913+0000, chain.objs.size()=1 2024-09-12T01:29:16.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.162+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Tc9u-kWBiUiUwE4FZj07FFMVdNbpLF6_0 2024-09-12T01:29:16.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.162+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6827313479579073064', time=2024-09-12T03:12:31.992018+0000, chain.objs.size()=1 2024-09-12T01:29:16.163 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.162+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.QR6xRdrYX78EeqogWOVCqT3Mb0HyPQN_0 2024-09-12T01:29:16.165 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.165+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/46650 2024-09-12T01:29:16.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T01:29:16.168 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15144084727054945385', time=2024-09-12T03:12:32.756145+0000, chain.objs.size()=1 2024-09-12T01:29:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.yDg1MiP2MqA2WzXTs2c2boe8x9DhNXw_0 2024-09-12T01:29:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7128014728690789695', time=2024-09-12T03:12:33.067236+0000, chain.objs.size()=1 2024-09-12T01:29:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.0aRb5Mx82xaaJV17Ft1Pk7hffeWpk7c_0 2024-09-12T01:29:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17934661219645695074', time=2024-09-12T03:12:33.523258+0000, chain.objs.size()=1 2024-09-12T01:29:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.9NRYmwYF2GflXRmuqDJ1oT4CAthgpfY_0 2024-09-12T01:29:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3493315684581658489', time=2024-09-12T03:12:34.389238+0000, chain.objs.size()=1 2024-09-12T01:29:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.XzDuY8AigzgbF0IU_pyNEiPwW7of6As_0 2024-09-12T01:29:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14048324212142424700', time=2024-09-12T03:12:34.477330+0000, chain.objs.size()=1 2024-09-12T01:29:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.FLVArHV0XH8YqvXxda4shdzv3STp1b1_0 2024-09-12T01:29:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10213299288406183827', time=2024-09-12T03:12:40.604961+0000, chain.objs.size()=1 2024-09-12T01:29:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.335__shadow_.53gcpBFvL3T9cpO5YVgoaXEgQv2PbAP_0 2024-09-12T01:29:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1219572652067409801', time=2024-09-12T03:12:41.224972+0000, chain.objs.size()=1 2024-09-12T01:29:16.169 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.336__shadow_.l3Tu6UrR368bQf2cSQ0qUa8dm9edQIo_0 2024-09-12T01:29:16.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3225426298905871807', time=2024-09-12T03:13:36.495518+0000, chain.objs.size()=1 2024-09-12T01:29:16.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.436__shadow_.0vBBkIXQX_8Aue1PWu0cKmEMafV3oSC_0 2024-09-12T01:29:16.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13638489483250568407', time=2024-09-12T03:16:09.575536+0000, chain.objs.size()=2 2024-09-12T01:29:16.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.525__multipart_mymultipart.2~SvsH_FAa4mXi71561wVMBXqUYQvfA-x.1 2024-09-12T01:29:16.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.525__multipart_mymultipart.2~SvsH_FAa4mXi71561wVMBXqUYQvfA-x.2 2024-09-12T01:29:16.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13438575704665438952', time=2024-09-12T03:16:16.696209+0000, chain.objs.size()=3 2024-09-12T01:29:16.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.525__multipart_mymultipart.2~HyamXpul32EHyjhF0r6fTHGEQDKHSVw.1 2024-09-12T01:29:16.170 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.168+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.525__multipart_mymultipart.2~HyamXpul32EHyjhF0r6fTHGEQDKHSVw.2 2024-09-12T01:29:16.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.170+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.525__multipart_mymultipart.2~HyamXpul32EHyjhF0r6fTHGEQDKHSVw.3 2024-09-12T01:29:16.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.170+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1278684702295307931', time=2024-09-12T03:18:04.449928+0000, chain.objs.size()=1 2024-09-12T01:29:16.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.170+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.574__shadow:UR0T-KGHl6Q4vxYX4-t9DIZvF4..Pbk_.9q2MRvEYhrMtmJoLNmDjLOEppJJhKkJ_0 2024-09-12T01:29:16.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.171+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16328874421658002474', time=2024-09-12T03:18:18.518956+0000, chain.objs.size()=1 2024-09-12T01:29:16.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.171+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:p6nlAsSWqzoiIvl5auTgO8RNHvVbWBL_.ZA4n7vPyswY6ZZpzguffkHLvegayNZL_0 2024-09-12T01:29:16.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.171+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4878076004254353203', time=2024-09-12T03:18:50.835060+0000, chain.objs.size()=1 2024-09-12T01:29:16.171 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.171+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.580__shadow:qBjm8H6GQVkifIdHZzda0fx6yJ5oPVA_.EdKAH6RD_uXevISjCs_sAFmq9cxyJHv_0 2024-09-12T01:29:16.172 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.172+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18077081800417029484', time=2024-09-12T03:18:52.391951+0000, chain.objs.size()=1 2024-09-12T01:29:16.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.172+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.583__shadow:xNVfrRhf4llTOXNgs-lWSFFy2UdHfYR_.Gvf5ZM8u7AqHXBYhb3ZdTQSRzM_c_MI_0 2024-09-12T01:29:16.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.172+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11442598990088534013', time=2024-09-12T03:19:07.373346+0000, chain.objs.size()=1 2024-09-12T01:29:16.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.172+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.607__shadow_.zXYsdi6WVWGmPUQ2GT0deDX8RrtEP1l_0 2024-09-12T01:29:16.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.172+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17440466988521157055', time=2024-09-12T03:23:19.147589+0000, chain.objs.size()=1 2024-09-12T01:29:16.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.172+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.651__shadow_.jMnjEn_lCPO1Cb1GWEPOVosP-P51lqR_0 2024-09-12T01:29:16.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.172+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2314547370794138738', time=2024-09-12T03:23:45.108779+0000, chain.objs.size()=1 2024-09-12T01:29:16.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.172+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.668__shadow_.0QckzYDEKcGViw5OZki3Vhs35PvfuM__0 2024-09-12T01:29:16.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.172+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15174916262210538283', time=2024-09-12T03:24:22.091884+0000, chain.objs.size()=1 2024-09-12T01:29:16.173 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.172+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.716__shadow:1r6M4Hbmfp1PFi1kxxFZlsQNvXrQUOo_.7I3JQSeqKNMlYXVx-SbuqPK-kgJH-Y7_0 2024-09-12T01:29:16.176 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.176+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:16.178 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.178+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:29:16.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.180+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:16.180 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.180+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:16.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43366' 2024-09-12T01:29:16.181 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4198264291611245374', time=2024-09-12T03:08:54.870822+0000, chain.objs.size()=1 2024-09-12T01:29:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.231__shadow_.YiEfl4WfH0N0AR45cHDfgUmpx00W-2J_0 2024-09-12T01:29:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4582947752896057068', time=2024-09-12T03:09:09.232936+0000, chain.objs.size()=1 2024-09-12T01:29:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.252__shadow_.Cl54CI308SZcbbiodbfppwrPSD_uoag_0 2024-09-12T01:29:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2705755599885690494', time=2024-09-12T03:09:54.223982+0000, chain.objs.size()=1 2024-09-12T01:29:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.wZPrdilX6xRgbp_--9US0qh2oYkegnR_0 2024-09-12T01:29:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9315926974199398726', time=2024-09-12T03:09:54.373184+0000, chain.objs.size()=1 2024-09-12T01:29:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.sJtmpR7VnqjsPwGvhwyfv0QVEEGGDA6_0 2024-09-12T01:29:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16578484358639243009', time=2024-09-12T03:09:54.447129+0000, chain.objs.size()=1 2024-09-12T01:29:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.GGWkLq-HDhJMKE0IJM5GfCV60RBjhrD_0 2024-09-12T01:29:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14747733273033147469', time=2024-09-12T03:09:54.525034+0000, chain.objs.size()=1 2024-09-12T01:29:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.7DF51MzEswXwxIG_L50PS8RLHJ_tKzd_0 2024-09-12T01:29:16.182 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11668307193338911101', time=2024-09-12T03:09:54.643429+0000, chain.objs.size()=1 2024-09-12T01:29:16.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.IpQPfVJXNd9rSLIWzcqBLuI-xQgibMa_0 2024-09-12T01:29:16.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15385589733183504021', time=2024-09-12T03:09:54.698384+0000, chain.objs.size()=1 2024-09-12T01:29:16.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.iskSnleOsgpxzsnjIZxDnZJG3B_vLfQ_0 2024-09-12T01:29:16.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15036864732456076309', time=2024-09-12T03:09:55.127274+0000, chain.objs.size()=1 2024-09-12T01:29:16.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.vaH-Xy2bJCiBI6mMD7-gyA7n4WzrtNf_0 2024-09-12T01:29:16.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6623067013602225016', time=2024-09-12T03:09:56.173944+0000, chain.objs.size()=1 2024-09-12T01:29:16.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.7wtxKuSzmhlgw-eVguwJHCBpUDsQRfG_0 2024-09-12T01:29:16.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4319949441237310292', time=2024-09-12T03:09:56.292712+0000, chain.objs.size()=1 2024-09-12T01:29:16.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.wTJdtYL1LxYAQqEqGMyJF3xnTQxGxxX_0 2024-09-12T01:29:16.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10125334921045346067', time=2024-09-12T03:09:56.461408+0000, chain.objs.size()=1 2024-09-12T01:29:16.183 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.181+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.rSBYHK1_sgvvRzq7L5NNCVrtomDecod_0 2024-09-12T01:29:16.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16983201557443756480', time=2024-09-12T03:09:56.604533+0000, chain.objs.size()=1 2024-09-12T01:29:16.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.h8sVlhyEX2Q932fZ8PDd9ohaE3qLEeu_0 2024-09-12T01:29:16.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17240369955132354492', time=2024-09-12T03:09:58.267848+0000, chain.objs.size()=1 2024-09-12T01:29:16.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.MUeMVko9nxCV3WUeMEVc-BvEXovQRGC_0 2024-09-12T01:29:16.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4272996603000068022', time=2024-09-12T03:09:58.908506+0000, chain.objs.size()=1 2024-09-12T01:29:16.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.e1OK7gNBT1L-0ssn0bDZ1kjXfLGLBYP_0 2024-09-12T01:29:16.186 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17741431589908442788', time=2024-09-12T03:09:59.596785+0000, chain.objs.size()=1 2024-09-12T01:29:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.tT-TdtUJhq2HHbDARYp1FUpnIxD_V1L_0 2024-09-12T01:29:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15336488460330430248', time=2024-09-12T03:09:59.879451+0000, chain.objs.size()=1 2024-09-12T01:29:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.OnKX3xaWI-1BYg2hakvE5xC3UzfgTwN_0 2024-09-12T01:29:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10984561697955764401', time=2024-09-12T03:10:00.405882+0000, chain.objs.size()=1 2024-09-12T01:29:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ipg_VLR0yEeQWh9QeQDO84wVreRQOBr_0 2024-09-12T01:29:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13044170794446851491', time=2024-09-12T03:10:00.633903+0000, chain.objs.size()=1 2024-09-12T01:29:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._NHxNII2j0yCoCR7HHYrWUzHfQjmuXj_0 2024-09-12T01:29:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10692206949875203992', time=2024-09-12T03:10:01.054530+0000, chain.objs.size()=1 2024-09-12T01:29:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.fLWJU9H8aUFRwtpVBS9G4KGalG7OoNf_0 2024-09-12T01:29:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15612129379889318631', time=2024-09-12T03:10:01.208924+0000, chain.objs.size()=1 2024-09-12T01:29:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.kPvGa9I5MtCunWbPupG2y7Of9I0SOJX_0 2024-09-12T01:29:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11958618783718364232', time=2024-09-12T03:10:01.228001+0000, chain.objs.size()=1 2024-09-12T01:29:16.187 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.j5w-Cbov3EHsi-__Blckccby45aBcgm_0 2024-09-12T01:29:16.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5571246159713653358', time=2024-09-12T03:10:01.228709+0000, chain.objs.size()=1 2024-09-12T01:29:16.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.185+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.A8Ge5HMI99JymRYQGAuhY1T0QAPs1oP_0 2024-09-12T01:29:16.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.188+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15857510774660809261', time=2024-09-12T03:10:01.337992+0000, chain.objs.size()=1 2024-09-12T01:29:16.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.188+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.eqss8UPqOkJkOHvcMtfBEcbSFwpi2uc_0 2024-09-12T01:29:16.188 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.188+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4500627983101243278', time=2024-09-12T03:10:01.733234+0000, chain.objs.size()=1 2024-09-12T01:29:16.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.188+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.XoiV2H8l4Fa1F9SR22en6yvloZeFXSa_0 2024-09-12T01:29:16.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.189+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12304241840301273946', time=2024-09-12T03:10:02.208539+0000, chain.objs.size()=1 2024-09-12T01:29:16.189 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.189+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.SWy3YElvWU1oNPCAGoTGplFGmGEx41o_0 2024-09-12T01:29:16.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13528728645573075238', time=2024-09-12T03:10:03.315317+0000, chain.objs.size()=1 2024-09-12T01:29:16.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.KwNi6KEavaz73aesGz-MAlar8iRcOJb_0 2024-09-12T01:29:16.190 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1887767761659354891', time=2024-09-12T03:10:03.316164+0000, chain.objs.size()=1 2024-09-12T01:29:16.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.L_pMcckalkcN9hfL65ZyxGBtJLMYHZL_0 2024-09-12T01:29:16.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1580901805404367249', time=2024-09-12T03:10:03.463530+0000, chain.objs.size()=1 2024-09-12T01:29:16.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.zYZWV4cDlUzSc3KrtRHLGL5612RPJ1n_0 2024-09-12T01:29:16.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.132796207448052861', time=2024-09-12T03:10:03.803690+0000, chain.objs.size()=1 2024-09-12T01:29:16.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.5timhKxSVzqbmNj6GiLVZ-kOWnQvnTP_0 2024-09-12T01:29:16.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11809872420384764287', time=2024-09-12T03:10:04.491333+0000, chain.objs.size()=1 2024-09-12T01:29:16.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.qBHdTUEkbrZPh07K9XXS9ZO8_OaE25U_0 2024-09-12T01:29:16.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1820198122349384108', time=2024-09-12T03:10:04.589928+0000, chain.objs.size()=1 2024-09-12T01:29:16.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ulMDEqtX7PbAmTKyY7Ij9YMuZDzznxg_0 2024-09-12T01:29:16.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12276049394222546244', time=2024-09-12T03:10:04.681755+0000, chain.objs.size()=1 2024-09-12T01:29:16.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ZkncAxL1h4qvRljOFV3NXDMcHf4qWsf_0 2024-09-12T01:29:16.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6247628284068095366', time=2024-09-12T03:10:04.888270+0000, chain.objs.size()=1 2024-09-12T01:29:16.191 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.64-uxyJ9h5yHGC7-1oiPLhtBnrjN2E-_0 2024-09-12T01:29:16.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1725198144068997134', time=2024-09-12T03:10:05.154508+0000, chain.objs.size()=1 2024-09-12T01:29:16.192 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.190+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.DqQFCR-lSuAMbsDW6Sse9RA-Og1McDk_0 2024-09-12T01:29:16.193 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.193+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15342519665960540061', time=2024-09-12T03:10:05.242091+0000, chain.objs.size()=1 2024-09-12T01:29:16.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.193+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.OjReU2rHISFei8sxIlCGBCsZY38JCgX_0 2024-09-12T01:29:16.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.193+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15620488967788218629', time=2024-09-12T03:10:06.391034+0000, chain.objs.size()=1 2024-09-12T01:29:16.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.193+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8Z2nreLnOeKIuEIFMvduUh9_EJIgxT-_0 2024-09-12T01:29:16.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.193+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14122724028183593005', time=2024-09-12T03:10:06.558300+0000, chain.objs.size()=1 2024-09-12T01:29:16.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.193+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Q47cdxFZmxaEO1BORuHBc8nSxLbK3Gm_0 2024-09-12T01:29:16.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.193+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12269465471368311038', time=2024-09-12T03:10:09.714935+0000, chain.objs.size()=1 2024-09-12T01:29:16.194 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.193+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.267__shadow_.xPV0fnc76dgqOAjxnDbC9Jl5PRaGUkb_0 2024-09-12T01:29:16.195 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.195+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10262024609092436349', time=2024-09-12T03:10:17.072540+0000, chain.objs.size()=1 2024-09-12T01:29:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.195+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.279__shadow_.WgVpTzdBlHYvNzKehxlp1uX6BICnz-k_0 2024-09-12T01:29:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.195+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3197517769567067941', time=2024-09-12T03:10:27.097099+0000, chain.objs.size()=1 2024-09-12T01:29:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.195+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.PxqGAaE3WqKjcMvJjj9U48xBrgae8JU_0 2024-09-12T01:29:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.195+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15167430500835999409', time=2024-09-12T03:10:37.103890+0000, chain.objs.size()=1 2024-09-12T01:29:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.195+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.305__shadow_.Z5TXhKzEoFMTMtTnErp-xF51a8Xf6KJ_0 2024-09-12T01:29:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.195+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15326062085782921807', time=2024-09-12T03:10:46.935235+0000, chain.objs.size()=1 2024-09-12T01:29:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.195+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.319__shadow:nuGfIMMzZm6F8SlGrfZIGs3kUbSo3G6_.JOYMdJ4_kzLGNUmifpyfCoGG4oNHO1O_0 2024-09-12T01:29:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.195+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3395900558571661965', time=2024-09-12T03:11:29.300433+0000, chain.objs.size()=1 2024-09-12T01:29:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.195+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.NYw53xEPhfX6aFo6YD5TvnI0hIhEkj2_0 2024-09-12T01:29:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.195+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12581319970243398897', time=2024-09-12T03:11:29.714465+0000, chain.objs.size()=1 2024-09-12T01:29:16.196 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.195+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.NfigygdYITN7gyurxl_WYvt2eiiyCfD_0 2024-09-12T01:29:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.196+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4872330031781928109', time=2024-09-12T03:11:31.235030+0000, chain.objs.size()=1 2024-09-12T01:29:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.196+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.0zH0JG_fWn3p1ENgtG5Jpd8SH2hPDGH_0 2024-09-12T01:29:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.197+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2954478702932309278', time=2024-09-12T03:11:31.235740+0000, chain.objs.size()=1 2024-09-12T01:29:16.197 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.197+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_._3SnQUcBAYxonruUPBtbmfJFmXxZuLb_0 2024-09-12T01:29:16.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.198+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12371050545038180556', time=2024-09-12T03:11:31.383017+0000, chain.objs.size()=1 2024-09-12T01:29:16.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.198+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.naq7Qi9K3CJgT0h486nd4tfw-4Hbgox_0 2024-09-12T01:29:16.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.198+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15280602900683355916', time=2024-09-12T03:11:31.715586+0000, chain.objs.size()=1 2024-09-12T01:29:16.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.198+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Wb-nEIapFSEYYtaeWbV8Y1TZMVKxWBU_0 2024-09-12T01:29:16.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.198+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8889249884588740645', time=2024-09-12T03:11:31.973859+0000, chain.objs.size()=1 2024-09-12T01:29:16.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.198+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.J-NoxgcUMwyWVVxHWGhH1wtwGTL1B-x_0 2024-09-12T01:29:16.198 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.198+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13899448270778974382', time=2024-09-12T03:11:32.077567+0000, chain.objs.size()=1 2024-09-12T01:29:16.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.198+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.hsovffh4UrC0rIlzTrkENxi92zEr-eq_0 2024-09-12T01:29:16.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.199+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7476880678462966415', time=2024-09-12T03:11:32.149293+0000, chain.objs.size()=1 2024-09-12T01:29:16.199 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.199+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.oufyqSMJCG87pRuGgU6KZ9Jfzk2pTUo_0 2024-09-12T01:29:16.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.200+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12203464198884260151', time=2024-09-12T03:11:32.839045+0000, chain.objs.size()=1 2024-09-12T01:29:16.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.200+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.JnA_9gdectzas0bE_vO0yl_s6qFz75-_0 2024-09-12T01:29:16.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.200+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11678797494679904446', time=2024-09-12T03:11:33.255741+0000, chain.objs.size()=1 2024-09-12T01:29:16.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.200+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_._-t0mbo2CbJ8riQPitDgEImP41UplyM_0 2024-09-12T01:29:16.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.200+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5821095233755338161', time=2024-09-12T03:11:34.961139+0000, chain.objs.size()=1 2024-09-12T01:29:16.200 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.200+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.AeA-xQR1tCGDplmSY3d5JG9xpdKFefp_0 2024-09-12T01:29:16.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.200+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2807524192501788839', time=2024-09-12T03:11:36.507171+0000, chain.objs.size()=1 2024-09-12T01:29:16.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.200+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Vbm43s5TbRRJ1_abKEkfkElBuk1gSAd_0 2024-09-12T01:29:16.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.200+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12674850405373712129', time=2024-09-12T03:11:36.615704+0000, chain.objs.size()=1 2024-09-12T01:29:16.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.200+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.eJQVsrcPXutuufyplwSqGrn36UWrudL_0 2024-09-12T01:29:16.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.200+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13748758299275249620', time=2024-09-12T03:11:36.698957+0000, chain.objs.size()=1 2024-09-12T01:29:16.201 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.200+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.bNSVVH7Y2HPJRMmzx_REkKQIN0zXABC_0 2024-09-12T01:29:16.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14812415080436265713', time=2024-09-12T03:11:36.993412+0000, chain.objs.size()=1 2024-09-12T01:29:16.203 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.oakP4JrlxdwtGK16jWnTKpkfhBMlSD-_0 2024-09-12T01:29:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8195221495605851793', time=2024-09-12T03:11:37.231460+0000, chain.objs.size()=1 2024-09-12T01:29:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.kKEWfH98556sghdvV9zhVUUQ0F_W1Bk_0 2024-09-12T01:29:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6706960918409192266', time=2024-09-12T03:11:38.404013+0000, chain.objs.size()=1 2024-09-12T01:29:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.6AwebxSgOf-mU518oS87zl3TWCLvEwT_0 2024-09-12T01:29:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10322475366005292390', time=2024-09-12T03:11:38.404646+0000, chain.objs.size()=1 2024-09-12T01:29:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.lyuF4HDXkPeDVB29ABNCp_SweMu1G9C_0 2024-09-12T01:29:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11933189891547756700', time=2024-09-12T03:11:38.696476+0000, chain.objs.size()=1 2024-09-12T01:29:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Z7hjv9wccQ-O43KRAzlf85biMU-DGvY_0 2024-09-12T01:29:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11628502398407434860', time=2024-09-12T03:11:38.835394+0000, chain.objs.size()=1 2024-09-12T01:29:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1Aq9acDleSz1nGKwriSMwA1WT2cRwCq_0 2024-09-12T01:29:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17603473620306233471', time=2024-09-12T03:11:39.854089+0000, chain.objs.size()=1 2024-09-12T01:29:16.204 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.n7L8STovS6WziTraYA_KXj9QPLhbjD5_0 2024-09-12T01:29:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8443353243600194808', time=2024-09-12T03:11:40.357964+0000, chain.objs.size()=1 2024-09-12T01:29:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.203+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.JxEhmDarR67fUnS3W0volq1Kx-ZZzUq_0 2024-09-12T01:29:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.205+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6142877165512669447', time=2024-09-12T03:11:41.207330+0000, chain.objs.size()=1 2024-09-12T01:29:16.205 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.205+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.uxifr-FxEWWFE1VaUJP-c8wJqHt8nXs_0 2024-09-12T01:29:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.205+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12613173911037211436', time=2024-09-12T03:11:41.459010+0000, chain.objs.size()=1 2024-09-12T01:29:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.205+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.WAAj0v-6yTIaQGy5aEeMShsKqft1abI_0 2024-09-12T01:29:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.205+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.286489215667931799', time=2024-09-12T03:11:41.597490+0000, chain.objs.size()=1 2024-09-12T01:29:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.205+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.y5YpYCDSbqWRz25lz4xMCnymYhAd0f1_0 2024-09-12T01:29:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.206+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18241431936403092619', time=2024-09-12T03:12:21.867085+0000, chain.objs.size()=1 2024-09-12T01:29:16.206 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.206+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.6O0hSTbcQ2aknC-Bjz5DJp5PO0zjIGv_0 2024-09-12T01:29:16.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.207+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8381372783459557877', time=2024-09-12T03:12:21.991749+0000, chain.objs.size()=1 2024-09-12T01:29:16.207 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.207+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.lGjAYdZZNNSrsLJnt1FGE4_QgeWGNgJ_0 2024-09-12T01:29:16.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10696680083796548785', time=2024-09-12T03:12:22.181762+0000, chain.objs.size()=1 2024-09-12T01:29:16.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1E3mHzm4dnCzaJamJ8HP2yBtvy80nBW_0 2024-09-12T01:29:16.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5120069160858417334', time=2024-09-12T03:12:22.183400+0000, chain.objs.size()=1 2024-09-12T01:29:16.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Vv_A1zwJF6FOKZLz_ed7tnUuZj4ZQ1G_0 2024-09-12T01:29:16.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11693812972468237392', time=2024-09-12T03:12:22.577595+0000, chain.objs.size()=1 2024-09-12T01:29:16.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.l0bi_lnAUo9odY6bms_YhfH9IBtLD8g_0 2024-09-12T01:29:16.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13863796911376388018', time=2024-09-12T03:12:22.823043+0000, chain.objs.size()=1 2024-09-12T01:29:16.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.WW8aBLUfJRT_UgF6SVijOFto8x-w1ux_0 2024-09-12T01:29:16.208 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8714802697544654331', time=2024-09-12T03:12:22.876869+0000, chain.objs.size()=1 2024-09-12T01:29:16.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.0BFeertxSRqkW8znf6vq4h684z3ZBse_0 2024-09-12T01:29:16.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13569692616151638590', time=2024-09-12T03:12:22.983801+0000, chain.objs.size()=1 2024-09-12T01:29:16.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.6A9FGbCMlGGvQlmO1kkW12VngLLtbnd_0 2024-09-12T01:29:16.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2089807056735498239', time=2024-09-12T03:12:24.233694+0000, chain.objs.size()=1 2024-09-12T01:29:16.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.kuLOx60pNzWhRDRhhOV97ntZZDLh-9Z_0 2024-09-12T01:29:16.209 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18017023421901959691', time=2024-09-12T03:12:24.288675+0000, chain.objs.size()=1 2024-09-12T01:29:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.w8gcywGxFf1DizX48qZAw3BhpEFgeZH_0 2024-09-12T01:29:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12431579563310062082', time=2024-09-12T03:12:24.840800+0000, chain.objs.size()=1 2024-09-12T01:29:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.208+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.VbH6ISrIJo785LhAPGsfFj6MH9b4pgM_0 2024-09-12T01:29:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.210+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9712849098549109115', time=2024-09-12T03:12:25.776283+0000, chain.objs.size()=1 2024-09-12T01:29:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.210+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.57gaN11inkktmIwxUXbrzwSICRjfy2G_0 2024-09-12T01:29:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.210+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12468462978082609018', time=2024-09-12T03:12:26.041532+0000, chain.objs.size()=1 2024-09-12T01:29:16.210 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.210+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ROm-LY2ro3cm2WQubv4vd_RqZlmjHKB_0 2024-09-12T01:29:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.211+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11104867679840819629', time=2024-09-12T03:12:26.559657+0000, chain.objs.size()=1 2024-09-12T01:29:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.212+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Gp-OH-zRShs5AXuZw5uZ8YDcly4jTgj_0 2024-09-12T01:29:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.212+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.409503090396865890', time=2024-09-12T03:12:27.042403+0000, chain.objs.size()=1 2024-09-12T01:29:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.212+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.z9flISXpradLsj6GIKMKuykDRTjNTCb_0 2024-09-12T01:29:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.212+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13922332175195083531', time=2024-09-12T03:12:27.368079+0000, chain.objs.size()=1 2024-09-12T01:29:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.212+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.6Ibc-NZq228S1swzZh5qetqf2tN86G0_0 2024-09-12T01:29:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.212+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6268897465713472549', time=2024-09-12T03:12:27.791228+0000, chain.objs.size()=1 2024-09-12T01:29:16.212 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.212+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MtRbb3GNB5a6kko1graZqcEHZNX6x6h_0 2024-09-12T01:29:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.212+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8714991943874591309', time=2024-09-12T03:12:27.791757+0000, chain.objs.size()=1 2024-09-12T01:29:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.212+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.98-KiDV9Q7AWtVvRItEB6RNZU4WE5OQ_0 2024-09-12T01:29:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.212+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3523406510323436762', time=2024-09-12T03:12:27.816991+0000, chain.objs.size()=1 2024-09-12T01:29:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.212+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.BhbVqrbcJV5CpA_hRBHc8hX7YKJYbMm_0 2024-09-12T01:29:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.212+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15467768852436148576', time=2024-09-12T03:12:28.099193+0000, chain.objs.size()=1 2024-09-12T01:29:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.212+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.DTxkoU18xBRp3V-7xdKrkljE4zj9Qn0_0 2024-09-12T01:29:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.212+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10366919084040602283', time=2024-09-12T03:12:28.263418+0000, chain.objs.size()=1 2024-09-12T01:29:16.213 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.212+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._9Cs7uc4a4eDshBRpojy7GjqbDORklf_0 2024-09-12T01:29:16.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.213+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8987494078918673673', time=2024-09-12T03:12:29.904537+0000, chain.objs.size()=1 2024-09-12T01:29:16.214 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.213+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3V7AP2KglYknnfmwomgLCWKN-8hFSHv_0 2024-09-12T01:29:16.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.215+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14539927058765160465', time=2024-09-12T03:12:30.492889+0000, chain.objs.size()=1 2024-09-12T01:29:16.215 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.215+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.a5SRSQp8h7BL9mzHsoqgPMDafbMQS5B_0 2024-09-12T01:29:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.215+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11258662260537124561', time=2024-09-12T03:12:30.496831+0000, chain.objs.size()=1 2024-09-12T01:29:16.216 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.215+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.oG4wayFcgFz-kXoNyC4y_V_nDP4tdhy_0 2024-09-12T01:29:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.217+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1115406403112908397', time=2024-09-12T03:12:30.764772+0000, chain.objs.size()=1 2024-09-12T01:29:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.217+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.L3_vtWBta3J8lA_Gr5WK2Wgc_KEqgCS_0 2024-09-12T01:29:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.217+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4178504416234329681', time=2024-09-12T03:12:31.556820+0000, chain.objs.size()=1 2024-09-12T01:29:16.217 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.217+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-XEuNSGq4lCR5dtknjlTTWS13H1Ylke_0 2024-09-12T01:29:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.218+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15439569761991019292', time=2024-09-12T03:12:32.150669+0000, chain.objs.size()=1 2024-09-12T01:29:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xZxB2ZMr3kB3Fx123SDP8iOpcDXIYim_0 2024-09-12T01:29:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.218+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10583610630825924998', time=2024-09-12T03:12:33.118945+0000, chain.objs.size()=1 2024-09-12T01:29:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.wG0w2VYbZGi96oeEPpQy3-FzSJW9RuI_0 2024-09-12T01:29:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.218+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10622632281734652140', time=2024-09-12T03:12:36.087000+0000, chain.objs.size()=1 2024-09-12T01:29:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.327__shadow_.IOZ99XPnpRncDqOQgb6ExFODWig0Ok0_0 2024-09-12T01:29:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.218+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18230864705153371455', time=2024-09-12T03:13:22.239748+0000, chain.objs.size()=1 2024-09-12T01:29:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.218+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.410__shadow_.sabHKtWprt-Z_NKyOQ6P0RRz82enkxs_0 2024-09-12T01:29:16.219 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.219+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8796112313191316039', time=2024-09-12T03:13:32.261130+0000, chain.objs.size()=1 2024-09-12T01:29:16.220 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.219+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.429__shadow_.Y4B0sRa7YQiX-kmInVyL4Bjp526U4AB_0 2024-09-12T01:29:16.223 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.223+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/43366 2024-09-12T01:29:16.225 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-12T01:29:16.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15015410947376741534', time=2024-09-12T03:13:34.565944+0000, chain.objs.size()=1 2024-09-12T01:29:16.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.433__shadow_.t34OS6qmDIloKmipRiOXGF8FoPyTs4o_0 2024-09-12T01:29:16.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1676394858378798447', time=2024-09-12T03:13:48.936420+0000, chain.objs.size()=1 2024-09-12T01:29:16.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.456__shadow_.at5vLwRIISKvtQ_s4-bVursNj9B1CY0_0 2024-09-12T01:29:16.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1198871958889484843', time=2024-09-12T03:13:54.175271+0000, chain.objs.size()=1 2024-09-12T01:29:16.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.462__shadow_.TrW199YxhWZrhQ-hRbDj6vrG97W2MP9_0 2024-09-12T01:29:16.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10251410927407899989', time=2024-09-12T03:14:11.381139+0000, chain.objs.size()=1 2024-09-12T01:29:16.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.489__shadow_.0dRRmqna27_PaDv0GhN835NaxAPA2TQ_0 2024-09-12T01:29:16.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15270290358692359646', time=2024-09-12T03:14:17.432969+0000, chain.objs.size()=1 2024-09-12T01:29:16.226 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.500__shadow_.4wguvY4wQssF3Xjuh16oGPc1CGzDkmZ_0 2024-09-12T01:29:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4153690952596076048', time=2024-09-12T03:14:32.672838+0000, chain.objs.size()=1 2024-09-12T01:29:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.513__multipart_mymultipart.2~reeMnPhlxQIQNEgg9_CUbw30XPlsQzy.1 2024-09-12T01:29:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10819616167469073404', time=2024-09-12T03:14:37.351130+0000, chain.objs.size()=1 2024-09-12T01:29:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.518__multipart_mymultipart.2~PCcY5kUNdUUvgXW7k3-KNjCRCc5ektz.1 2024-09-12T01:29:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15207330425742559450', time=2024-09-12T03:14:38.747901+0000, chain.objs.size()=1 2024-09-12T01:29:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.518__multipart_mymultipart.2~Mzbc4X-Vod-5zCSKCFFhkkHZhA_Tr-o.1 2024-09-12T01:29:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~QSBOaDXQK47WH7vaLIB9d6AmdudYiT6', time=2024-09-12T03:15:27.759367+0000, chain.objs.size()=1 2024-09-12T01:29:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~QSBOaDXQK47WH7vaLIB9d6AmdudYiT6.3 2024-09-12T01:29:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5348639277832662898', time=2024-09-12T03:17:22.292650+0000, chain.objs.size()=1 2024-09-12T01:29:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.555__shadow_.ZT6ZwD50mFuDsQnLH-Wl2-BBsFAZMNF_0 2024-09-12T01:29:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6658388276415163038', time=2024-09-12T03:17:33.594469+0000, chain.objs.size()=1 2024-09-12T01:29:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.559__shadow_.MV1FWgjsw5_yt1ZquIYzcQYAjJ1faFZ_0 2024-09-12T01:29:16.227 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1182267414518348728', time=2024-09-12T03:17:53.467444+0000, chain.objs.size()=1 2024-09-12T01:29:16.228 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.225+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:9UOdLQK6og3-WtB8RQnWJ4hggDPLB1g_.Xc_PSXy6fBPvrJbbsVxGpF21uWRNQeA_0 2024-09-12T01:29:16.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.228+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17582817341732677459', time=2024-09-12T03:18:28.039943+0000, chain.objs.size()=1 2024-09-12T01:29:16.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.228+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:JFafdjHT3O.FeMiGr2eEiA7XIASUqeA_.e6_ihT5y-MutbNtCEF8fojmRz5H7aZF_0 2024-09-12T01:29:16.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.228+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16598351078606196811', time=2024-09-12T03:18:45.223231+0000, chain.objs.size()=4 2024-09-12T01:29:16.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.228+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.578__multipart_testobj.2~ZZwDeSfyZNOSGieDDGrgkJ0TqI5-uNy.1 2024-09-12T01:29:16.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.228+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.578__multipart_testobj.2~ZZwDeSfyZNOSGieDDGrgkJ0TqI5-uNy.2 2024-09-12T01:29:16.229 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.228+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.578__multipart_testobj.2~ZZwDeSfyZNOSGieDDGrgkJ0TqI5-uNy.3 2024-09-12T01:29:16.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.229+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.578__multipart_testobj.2~ZZwDeSfyZNOSGieDDGrgkJ0TqI5-uNy.4 2024-09-12T01:29:16.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.229+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.656684938810767097', time=2024-09-12T03:23:13.942846+0000, chain.objs.size()=1 2024-09-12T01:29:16.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.229+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.647__shadow_.8IQygWucDlm9dejzFvfiMJGXoQgNv_a_0 2024-09-12T01:29:16.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.229+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.751873484810947901', time=2024-09-12T03:23:20.292268+0000, chain.objs.size()=1 2024-09-12T01:29:16.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.229+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.653__shadow_.j4nGD1oYJBL5gg1jQlJX6YlLd_UzAxw_0 2024-09-12T01:29:16.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.230+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15503052733717037', time=2024-09-12T03:23:40.948566+0000, chain.objs.size()=1 2024-09-12T01:29:16.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.230+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.663__shadow_.4jHtrSTZcu95Q81gMjoGc5A8EdWPX2F_0 2024-09-12T01:29:16.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.230+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14684048992475500861', time=2024-09-12T03:24:10.991512+0000, chain.objs.size()=1 2024-09-12T01:29:16.230 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.230+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.714__shadow:bRUzMO0RatafRnzmKV8wlk3kpopGMnO_.vSLQb-q00kHl602audr3A-AfdS8-fBS_0 2024-09-12T01:29:16.235 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.235+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:16.237 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.237+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:29:16.239 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.238+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:16.240 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.239+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.239+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45599' 2024-09-12T01:29:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.239+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8265017519503113879', time=2024-09-12T03:06:38.252576+0000, chain.objs.size()=1 2024-09-12T01:29:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.239+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.158__shadow_.hqZX7RkhJuNGUba8kcIt6YDdx5H6JkM_0 2024-09-12T01:29:16.241 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.239+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1865411581857115927', time=2024-09-12T03:06:44.463199+0000, chain.objs.size()=2 2024-09-12T01:29:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.239+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.160__shadow_.pHeQxJfDNmktIB_a20rzNHnmXrD1hMX_0 2024-09-12T01:29:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.239+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.160__shadow_.pHeQxJfDNmktIB_a20rzNHnmXrD1hMX_1 2024-09-12T01:29:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.239+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2785591501936398734', time=2024-09-12T03:08:56.838524+0000, chain.objs.size()=1 2024-09-12T01:29:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.239+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.234__shadow_.UPN1Q4w3T_a3lPXCx-hvNfK6kh_UceK_0 2024-09-12T01:29:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.239+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6463212689142290354', time=2024-09-12T03:09:03.178480+0000, chain.objs.size()=1 2024-09-12T01:29:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.239+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.243__shadow_.oQtIN-mYHglnW6ToidfKhHCvWozkBSz_0 2024-09-12T01:29:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17580017789274463650', time=2024-09-12T03:09:54.314700+0000, chain.objs.size()=1 2024-09-12T01:29:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.26-Sfndebn5mV4BQbvfhva10PDEACtN_0 2024-09-12T01:29:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15286926875050240025', time=2024-09-12T03:09:54.394793+0000, chain.objs.size()=1 2024-09-12T01:29:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.eOw4pfStia92NKJYWxGBxFVWoyTVk0U_0 2024-09-12T01:29:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.757836195914092473', time=2024-09-12T03:09:54.554814+0000, chain.objs.size()=1 2024-09-12T01:29:16.242 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.s4iDvQV0XwVjP4R-ybj13gEyTFFWMjF_0 2024-09-12T01:29:16.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2535825074449647636', time=2024-09-12T03:09:54.695674+0000, chain.objs.size()=1 2024-09-12T01:29:16.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dTwXleCKhfnStq7_Xh5Wxctrd0oxrBB_0 2024-09-12T01:29:16.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17655286413131451224', time=2024-09-12T03:09:54.932243+0000, chain.objs.size()=1 2024-09-12T01:29:16.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.b-Ri9RsMTLPjbXAPVgNgrFxTlyR-Cfm_0 2024-09-12T01:29:16.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4226886104635561796', time=2024-09-12T03:09:55.033648+0000, chain.objs.size()=1 2024-09-12T01:29:16.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0W1OcMPka2Pn0t-ZqN6x4BdeJSGdseP_0 2024-09-12T01:29:16.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.240+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1015073317912204197', time=2024-09-12T03:09:55.182874+0000, chain.objs.size()=1 2024-09-12T01:29:16.243 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.240+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.vVzXGxRz27aWdqmHEICbUeViRHx5haW_0 2024-09-12T01:29:16.244 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1133460974149984584', time=2024-09-12T03:09:56.203797+0000, chain.objs.size()=1 2024-09-12T01:29:16.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QwoiU0bz44vh6FYPbJOzsywevPCIvcg_0 2024-09-12T01:29:16.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13967122632948552516', time=2024-09-12T03:09:56.757230+0000, chain.objs.size()=1 2024-09-12T01:29:16.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.bhZhbRrbaxdCYPZ4hY7TJs9wnOMK0eO_0 2024-09-12T01:29:16.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16298512390231481672', time=2024-09-12T03:09:56.815993+0000, chain.objs.size()=1 2024-09-12T01:29:16.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.LQ9o7U8yRqRP46FeSfxDipnS3fkm-SD_0 2024-09-12T01:29:16.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3066982010358475063', time=2024-09-12T03:09:56.830049+0000, chain.objs.size()=1 2024-09-12T01:29:16.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.JywqBYc_VfFOiBAC6unUK70aJapus6v_0 2024-09-12T01:29:16.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8428123640689176879', time=2024-09-12T03:09:57.035664+0000, chain.objs.size()=1 2024-09-12T01:29:16.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.nIM6EZkYAxagtBWHCnsL3zFzGP5QcCN_0 2024-09-12T01:29:16.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8253756572592007895', time=2024-09-12T03:09:57.095977+0000, chain.objs.size()=1 2024-09-12T01:29:16.245 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Jp2WE9dpJJtP7_v-ug6TmEhETNbtHhv_0 2024-09-12T01:29:16.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16373629510079010549', time=2024-09-12T03:09:57.203492+0000, chain.objs.size()=1 2024-09-12T01:29:16.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Pfk4N5jZ3NHHERD0jesRWXmVOUbRIa__0 2024-09-12T01:29:16.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5630530901190479483', time=2024-09-12T03:09:57.222869+0000, chain.objs.size()=1 2024-09-12T01:29:16.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ACJtK0jo3850X3w-lG4UypR0i_3CwXg_0 2024-09-12T01:29:16.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8430666581875760359', time=2024-09-12T03:09:57.931821+0000, chain.objs.size()=1 2024-09-12T01:29:16.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.gI5QchzU-lK5bUw4Z3A_f4Ng9fVgyWT_0 2024-09-12T01:29:16.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16251488289339207050', time=2024-09-12T03:09:58.576216+0000, chain.objs.size()=1 2024-09-12T01:29:16.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.dfcbhgQFLZKL8OeKeNuNbqxC0OtNIq6_0 2024-09-12T01:29:16.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10612639556248652507', time=2024-09-12T03:09:58.596083+0000, chain.objs.size()=1 2024-09-12T01:29:16.246 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.244+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Co6ChnWecpVmDmaW09ytTtIP7zbKnz3_0 2024-09-12T01:29:16.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.763335641776997720', time=2024-09-12T03:09:58.915503+0000, chain.objs.size()=1 2024-09-12T01:29:16.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.xF24RFnVFPkPAa6Z3g9vDeQw-MV8Ahr_0 2024-09-12T01:29:16.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8992168184522428824', time=2024-09-12T03:09:59.667732+0000, chain.objs.size()=1 2024-09-12T01:29:16.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.D-eAMzTSiLtU8otuHPOoRSHEJ318tVs_0 2024-09-12T01:29:16.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1437400958890091213', time=2024-09-12T03:09:59.779572+0000, chain.objs.size()=1 2024-09-12T01:29:16.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8CGVxGRED2gQvHuRGVtnTpGcMGK6Z_W_0 2024-09-12T01:29:16.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7238002370333642359', time=2024-09-12T03:10:00.228618+0000, chain.objs.size()=1 2024-09-12T01:29:16.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.kUW79cEYIW2h3Bd2popRHNyVKUIucpA_0 2024-09-12T01:29:16.249 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5612807575655777187', time=2024-09-12T03:10:00.602665+0000, chain.objs.size()=1 2024-09-12T01:29:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.q_c5G6d2nzM1nJwzx1Vm1JHug9l-iYb_0 2024-09-12T01:29:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13828481552042195292', time=2024-09-12T03:10:00.603182+0000, chain.objs.size()=1 2024-09-12T01:29:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PWM7y2to-LAX1JFfwPuA8f_Z5_NKT-h_0 2024-09-12T01:29:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9297201987880852769', time=2024-09-12T03:10:00.621401+0000, chain.objs.size()=1 2024-09-12T01:29:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Rml7QNwF0F3LwRVsBIs-vDniy7wSb1c_0 2024-09-12T01:29:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15877624693404941505', time=2024-09-12T03:10:01.500488+0000, chain.objs.size()=1 2024-09-12T01:29:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.j7T5vnNUs6amIsmIGBV6Y2tPdhe-oQD_0 2024-09-12T01:29:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1881312798354839594', time=2024-09-12T03:10:02.942208+0000, chain.objs.size()=1 2024-09-12T01:29:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.2UGiZ5tZINdGlS223-8JpP2bmqncYtL_0 2024-09-12T01:29:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4214463830281914795', time=2024-09-12T03:10:03.003496+0000, chain.objs.size()=1 2024-09-12T01:29:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.O8gsR2KcOYiOKs4lGeqVptnfBHMJr26_0 2024-09-12T01:29:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17332364442103569510', time=2024-09-12T03:10:03.242600+0000, chain.objs.size()=1 2024-09-12T01:29:16.250 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.248+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.otkEyyMmPPagATeRyTXVddS09XA7vbr_0 2024-09-12T01:29:16.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16330961454940881801', time=2024-09-12T03:10:03.606264+0000, chain.objs.size()=1 2024-09-12T01:29:16.252 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.S49BrWhm_fbQMyaKjpi-9eblS30cvkT_0 2024-09-12T01:29:16.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18350995322151434703', time=2024-09-12T03:10:03.647581+0000, chain.objs.size()=1 2024-09-12T01:29:16.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.__jBWJwHHoP-56Hz6z6XK-gbaIBvXTQ_0 2024-09-12T01:29:16.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15684374812738400623', time=2024-09-12T03:10:04.645580+0000, chain.objs.size()=1 2024-09-12T01:29:16.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1hGZuEo6sl5ti0AKP1h4qQKtoIeQS4P_0 2024-09-12T01:29:16.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1479740968301504234', time=2024-09-12T03:10:06.024322+0000, chain.objs.size()=1 2024-09-12T01:29:16.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QsWV-vesI8IFz2_gCgTXVqlhD2Wa6r7_0 2024-09-12T01:29:16.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18248212787196385184', time=2024-09-12T03:10:06.068943+0000, chain.objs.size()=1 2024-09-12T01:29:16.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.XD-ztvGSC4TyPfuvnvhIj-xCeahgieT_0 2024-09-12T01:29:16.253 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17527596637488383274', time=2024-09-12T03:10:12.096322+0000, chain.objs.size()=1 2024-09-12T01:29:16.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.271__shadow_.fuUUZF5skT4RDiYJxLF8tQcZ4BDSpcP_0 2024-09-12T01:29:16.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1708760043867988043', time=2024-09-12T03:10:19.768880+0000, chain.objs.size()=1 2024-09-12T01:29:16.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.283__shadow_.CGJn-WjW-sqe9E0VFH_YuY2W9VzGAVH_0 2024-09-12T01:29:16.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3589980523325836814', time=2024-09-12T03:10:27.117621+0000, chain.objs.size()=1 2024-09-12T01:29:16.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.GK2q5X5xbLr0xD7DadtNXtZhvC3GEPX_0 2024-09-12T01:29:16.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14277370936777224078', time=2024-09-12T03:10:35.190291+0000, chain.objs.size()=1 2024-09-12T01:29:16.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.252+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.302__shadow_.t6EJBcC7WLGx5ZgrQpW-7wyRjWXd0y3_0 2024-09-12T01:29:16.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.254+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11262066282832880610', time=2024-09-12T03:11:29.241330+0000, chain.objs.size()=1 2024-09-12T01:29:16.254 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.254+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.9ATUrSqCbVp4LpnXbHIMZs6XaaaAvV7_0 2024-09-12T01:29:16.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.254+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1991288072542583431', time=2024-09-12T03:11:29.586983+0000, chain.objs.size()=1 2024-09-12T01:29:16.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.254+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7M1oxViTHJbtc2ciN_HO47fzXLDCtMs_0 2024-09-12T01:29:16.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.255+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5717035885225886644', time=2024-09-12T03:11:31.507088+0000, chain.objs.size()=1 2024-09-12T01:29:16.255 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.255+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.cM5vxPOCfc4yhyprxv2W2tsUgYEzjwj_0 2024-09-12T01:29:16.256 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.256+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11961848617957376545', time=2024-09-12T03:11:31.659791+0000, chain.objs.size()=1 2024-09-12T01:29:16.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.256+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7VopSlLBjA_3zKObYrQqw9R12VsM-xX_0 2024-09-12T01:29:16.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.256+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15799494488686638864', time=2024-09-12T03:11:33.314315+0000, chain.objs.size()=1 2024-09-12T01:29:16.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.256+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ksKg8SbOjAR7jPCzI0udRS2utGIXoxw_0 2024-09-12T01:29:16.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.256+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12577216672407585211', time=2024-09-12T03:11:33.316008+0000, chain.objs.size()=1 2024-09-12T01:29:16.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.256+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.NB8blKQQ28WBS5EwvcebAd2-FkTJffn_0 2024-09-12T01:29:16.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.256+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5844442173629138164', time=2024-09-12T03:11:33.434010+0000, chain.objs.size()=1 2024-09-12T01:29:16.257 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.256+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.YkfkOjTbR1Ff9k_645uV5fYvyD3ZemC_0 2024-09-12T01:29:16.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.257+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18028387109529754907', time=2024-09-12T03:11:33.846859+0000, chain.objs.size()=1 2024-09-12T01:29:16.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.257+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.X2Qbl4a7-Je3f8BwibAi-euUdYZLR0__0 2024-09-12T01:29:16.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.257+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1306234904003508317', time=2024-09-12T03:11:35.398800+0000, chain.objs.size()=1 2024-09-12T01:29:16.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.257+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5tGRPVs1jWmRo9frTfmbpOSOOeaHzsC_0 2024-09-12T01:29:16.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.258+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8259464289491363247', time=2024-09-12T03:11:35.561164+0000, chain.objs.size()=1 2024-09-12T01:29:16.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.258+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.6x0c_Fb5ZlafLOTBXSB0QlJUN_QgSeI_0 2024-09-12T01:29:16.258 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.258+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1903914233446330229', time=2024-09-12T03:11:35.562106+0000, chain.objs.size()=1 2024-09-12T01:29:16.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.258+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Fq3BtuWYxfsJvdMugrO8XgTfQK2vIPR_0 2024-09-12T01:29:16.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.258+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.714369618502470693', time=2024-09-12T03:11:36.234649+0000, chain.objs.size()=1 2024-09-12T01:29:16.259 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.258+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.cewR43pn3bjqyfD0hbUzWZRWOiU6Jjn_0 2024-09-12T01:29:16.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.261+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10960056903147655882', time=2024-09-12T03:11:36.445436+0000, chain.objs.size()=1 2024-09-12T01:29:16.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.261+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.QV_75eLZ4IDtLgevNjF55mpg1jirKHm_0 2024-09-12T01:29:16.261 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.261+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12995878130676898491', time=2024-09-12T03:11:36.493520+0000, chain.objs.size()=1 2024-09-12T01:29:16.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.261+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2csjtWe47tlv7HvOd87DQ7Yv2CpwVZW_0 2024-09-12T01:29:16.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.261+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1165708300519312634', time=2024-09-12T03:11:36.657552+0000, chain.objs.size()=1 2024-09-12T01:29:16.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1YQKApJMS3gKjWalO0MYFSW0SOpFhCT_0 2024-09-12T01:29:16.262 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15441548331468502142', time=2024-09-12T03:11:36.703372+0000, chain.objs.size()=1 2024-09-12T01:29:16.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5BIcGSA5KPY1PGBTCSSjJKBqr_kGSM0_0 2024-09-12T01:29:16.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12120783101400710040', time=2024-09-12T03:11:36.819043+0000, chain.objs.size()=1 2024-09-12T01:29:16.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.nMp90ib1HTJ1HEYXyX9TMcwJ_QaIdEf_0 2024-09-12T01:29:16.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6215982878453271845', time=2024-09-12T03:11:37.829448+0000, chain.objs.size()=1 2024-09-12T01:29:16.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.j7HzEALXJ1fQaQgd9BHWY8N6Ot8l9vh_0 2024-09-12T01:29:16.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9363021397141507286', time=2024-09-12T03:11:39.644716+0000, chain.objs.size()=1 2024-09-12T01:29:16.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.74TelPETe9_k9n6Xx4RyJjC18qiuhJj_0 2024-09-12T01:29:16.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16463111522452585604', time=2024-09-12T03:11:39.851537+0000, chain.objs.size()=1 2024-09-12T01:29:16.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.F4six-JXeoeL9323EMbL8FlDRZ0SP7W_0 2024-09-12T01:29:16.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7305056381899811512', time=2024-09-12T03:11:40.312205+0000, chain.objs.size()=1 2024-09-12T01:29:16.263 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.44YDqe617xv7fHNQC1C5qwBxRiG8-_Z_0 2024-09-12T01:29:16.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6984879324476117928', time=2024-09-12T03:11:40.834258+0000, chain.objs.size()=1 2024-09-12T01:29:16.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.uBUvMgxFRZy_L4nI5hkZYjRXenmsYOY_0 2024-09-12T01:29:16.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4508286274662176172', time=2024-09-12T03:11:41.045779+0000, chain.objs.size()=1 2024-09-12T01:29:16.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.262+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.VE2XrMBY7rGQQcQwMTvFblUecaUhGGn_0 2024-09-12T01:29:16.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.264+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17805916800087590241', time=2024-09-12T03:12:22.313273+0000, chain.objs.size()=1 2024-09-12T01:29:16.264 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.264+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.IxsnyAOAu51i9nDp769TAGhlVfuwsgq_0 2024-09-12T01:29:16.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.264+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3868103695708490091', time=2024-09-12T03:12:22.463312+0000, chain.objs.size()=1 2024-09-12T01:29:16.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.264+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ua6S1ztgeD1V49KKV7WM0pZW-MLiV8U_0 2024-09-12T01:29:16.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.264+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2774988246366578495', time=2024-09-12T03:12:22.464781+0000, chain.objs.size()=1 2024-09-12T01:29:16.265 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.264+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.DH97qLL26WDGUx8_L6VrhPCrhr2HwWI_0 2024-09-12T01:29:16.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.266+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9005101752963963301', time=2024-09-12T03:12:22.645258+0000, chain.objs.size()=1 2024-09-12T01:29:16.266 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.266+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.FxRiGWz7KObi6W-Q2xFo3dOzmkC8tzM_0 2024-09-12T01:29:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.266+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4847535253545132835', time=2024-09-12T03:12:22.861292+0000, chain.objs.size()=1 2024-09-12T01:29:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.266+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3CgSsfqaPs307snEX_JIjpZLsDRLTXr_0 2024-09-12T01:29:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.266+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9691495885211006042', time=2024-09-12T03:12:23.615794+0000, chain.objs.size()=1 2024-09-12T01:29:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.266+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xPxP54RQruVkmMBO9WPTy1nXMr2dpbY_0 2024-09-12T01:29:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.266+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13800995534827517364', time=2024-09-12T03:12:23.636747+0000, chain.objs.size()=1 2024-09-12T01:29:16.267 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.266+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.vRUIJRHLuFxQy4UQGZQA3ZX4FGqUtXt_0 2024-09-12T01:29:16.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.268+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7394520323057074572', time=2024-09-12T03:12:23.951358+0000, chain.objs.size()=1 2024-09-12T01:29:16.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.268+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.NIih5AFz6tJThFpBxLa2Y6Q1FnrGiHj_0 2024-09-12T01:29:16.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.268+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13759667412597121996', time=2024-09-12T03:12:24.449530+0000, chain.objs.size()=1 2024-09-12T01:29:16.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.268+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.NHSqexJc2ZVIJXklcmD4GZm6Lrd0qtC_0 2024-09-12T01:29:16.268 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.268+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3347336418531926164', time=2024-09-12T03:12:24.533853+0000, chain.objs.size()=1 2024-09-12T01:29:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.268+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.jiG1TP0sWkBkrgSTi-517hAcn8a1dDF_0 2024-09-12T01:29:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.268+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.696881195157336155', time=2024-09-12T03:12:24.618077+0000, chain.objs.size()=1 2024-09-12T01:29:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.268+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3fZcL6q-0aFdeUH6oVnCpVcTx18960K_0 2024-09-12T01:29:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.268+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11250169392317593218', time=2024-09-12T03:12:25.443991+0000, chain.objs.size()=1 2024-09-12T01:29:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.268+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1PKT577CnHAakWbwAZXbSoqUI4SNW2b_0 2024-09-12T01:29:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.268+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7869886045456229316', time=2024-09-12T03:12:26.093501+0000, chain.objs.size()=1 2024-09-12T01:29:16.269 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.268+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3-B4UId5LgUmpvc98i-HDBZKIOM4Ymz_0 2024-09-12T01:29:16.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.269+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3978600129601185680', time=2024-09-12T03:12:27.237426+0000, chain.objs.size()=1 2024-09-12T01:29:16.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.269+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.bth6-eA-UH5xgJPhW0-_AUcRWsqNwHO_0 2024-09-12T01:29:16.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.269+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11150219189267688906', time=2024-09-12T03:12:27.837660+0000, chain.objs.size()=1 2024-09-12T01:29:16.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.269+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.tfpPUu7wb0f9fSsU0Lud1FxTtsRrms0_0 2024-09-12T01:29:16.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.270+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7625688075906941073', time=2024-09-12T03:12:28.004670+0000, chain.objs.size()=1 2024-09-12T01:29:16.270 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.270+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hndQ8SumMrbfJWc5xnUfUTuV1MI1vxu_0 2024-09-12T01:29:16.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.271+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13695443654155642740', time=2024-09-12T03:12:28.708674+0000, chain.objs.size()=1 2024-09-12T01:29:16.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.271+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.LJ5ipzwd8x1l96iMykKJFEVEZsvn4at_0 2024-09-12T01:29:16.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.271+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11644665738810468513', time=2024-09-12T03:12:28.973610+0000, chain.objs.size()=1 2024-09-12T01:29:16.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.271+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.bTmVegcokyZ9UN98_n6VFTenGPTLRnZ_0 2024-09-12T01:29:16.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.271+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7572537744636995035', time=2024-09-12T03:12:29.181413+0000, chain.objs.size()=1 2024-09-12T01:29:16.271 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.271+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-GTbRWcjeQBHGR6xgYIc4Puwy35kVjk_0 2024-09-12T01:29:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.272+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9433613188069181205', time=2024-09-12T03:12:29.229124+0000, chain.objs.size()=1 2024-09-12T01:29:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.272+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.OeHVVB9PxnQu3koIDbyJRgk0Jc-Kgao_0 2024-09-12T01:29:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.272+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7285414346315270094', time=2024-09-12T03:12:29.229671+0000, chain.objs.size()=1 2024-09-12T01:29:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.272+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.nLWaMjR5wDrorF1zCak6x2b6dbwNSeI_0 2024-09-12T01:29:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.272+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1839329353476158140', time=2024-09-12T03:12:30.493326+0000, chain.objs.size()=1 2024-09-12T01:29:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.272+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.HP_x9GGo7Zm8BqwYExHscFk7dgHZsb2_0 2024-09-12T01:29:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.272+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2533343470171019548', time=2024-09-12T03:12:30.645362+0000, chain.objs.size()=1 2024-09-12T01:29:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.272+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.F_BWO3567kWBAjb-1LJp9dU1_JqrCcl_0 2024-09-12T01:29:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.272+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.168485590493676849', time=2024-09-12T03:12:30.686205+0000, chain.objs.size()=1 2024-09-12T01:29:16.273 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.272+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.wA9Ack4uPbX75bCY0RGUR-jSrjUNi8j_0 2024-09-12T01:29:16.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.273+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11181855096487992002', time=2024-09-12T03:12:31.149336+0000, chain.objs.size()=1 2024-09-12T01:29:16.274 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.273+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.6OzpCz1ewySdqE4GlhJ507E7ws_h7yJ_0 2024-09-12T01:29:16.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.275+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18098312357119275815', time=2024-09-12T03:12:31.530599+0000, chain.objs.size()=1 2024-09-12T01:29:16.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.275+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.8DvOJjKsH5o5ANwSMiBOoQhnFB-ZXaI_0 2024-09-12T01:29:16.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.275+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1785576472234074844', time=2024-09-12T03:12:31.599963+0000, chain.objs.size()=1 2024-09-12T01:29:16.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.275+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.NSkYPTpQeEHSI_YVstcWMLeZ3CwrCd3_0 2024-09-12T01:29:16.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.275+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4903554286787879282', time=2024-09-12T03:12:31.971477+0000, chain.objs.size()=1 2024-09-12T01:29:16.275 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.275+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gHY-moJpDomY0VZTSbn7Z74xype8RE1_0 2024-09-12T01:29:16.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.277+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7991869686907775775', time=2024-09-12T03:12:32.155927+0000, chain.objs.size()=1 2024-09-12T01:29:16.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.277+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.qOaR1mQh11X1G5YiW8KVpbNl6BtnT_q_0 2024-09-12T01:29:16.277 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.277+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7104470712700401076', time=2024-09-12T03:12:33.062108+0000, chain.objs.size()=1 2024-09-12T01:29:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.277+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.4418N2mWTyTKPZh9JVxs07UG8wF8vEv_0 2024-09-12T01:29:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.277+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2961841474808387583', time=2024-09-12T03:12:33.615445+0000, chain.objs.size()=1 2024-09-12T01:29:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.277+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.sxXV7yIW2M3fbe1cwvW7jjNMBKPUCfs_0 2024-09-12T01:29:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.277+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11906492719969547392', time=2024-09-12T03:12:33.772727+0000, chain.objs.size()=1 2024-09-12T01:29:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.277+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.WdGHHwyEYlkYLLnni1x_I2yJ3lQEemw_0 2024-09-12T01:29:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.277+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10731951941214048283', time=2024-09-12T03:12:34.279525+0000, chain.objs.size()=1 2024-09-12T01:29:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.277+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.RDZQvMipLs38wWa7Id8TgC4DgXmzJlk_0 2024-09-12T01:29:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.277+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13163699490690410210', time=2024-09-12T03:12:34.324187+0000, chain.objs.size()=1 2024-09-12T01:29:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.277+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.tQczCQ7eYpGbaNi4CnbDCDpFr_cCCF__0 2024-09-12T01:29:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.277+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11384705545435276122', time=2024-09-12T03:13:34.015710+0000, chain.objs.size()=1 2024-09-12T01:29:16.278 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.277+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.432__shadow_.CgwXBmSA72YFtgKNUYLgeGxuGb-81m0_0 2024-09-12T01:29:16.283 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.283+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/45599 2024-09-12T01:29:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-12T01:29:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11535715404311495663', time=2024-09-12T03:13:49.826193+0000, chain.objs.size()=1 2024-09-12T01:29:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.457__shadow_.YnCpW9qJOtBy1pRdQ5Lb0LVq5sYfCtJ_0 2024-09-12T01:29:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13696380078170725167', time=2024-09-12T03:13:55.034003+0000, chain.objs.size()=1 2024-09-12T01:29:16.285 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.463__shadow_.E_hwmrzOpDTnlFyhecqGmdquGK0zA1Q_0 2024-09-12T01:29:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13270272952360347329', time=2024-09-12T03:14:09.458249+0000, chain.objs.size()=1 2024-09-12T01:29:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.486__shadow_.h6pTigVh40UGjAxLefqtmuweVIyCjjK_0 2024-09-12T01:29:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9429413364382989269', time=2024-09-12T03:14:29.473734+0000, chain.objs.size()=6 2024-09-12T01:29:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.1 2024-09-12T01:29:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.2 2024-09-12T01:29:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.3 2024-09-12T01:29:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.4 2024-09-12T01:29:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.5 2024-09-12T01:29:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.507__multipart_srcmultipart.2~9JNt4LO7m2CTgwfq_pDyWOr8pNpPzoL.6 2024-09-12T01:29:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14293441412818168652', time=2024-09-12T03:17:23.380702+0000, chain.objs.size()=1 2024-09-12T01:29:16.286 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.556__shadow_.7HXcl4XzqCih8PqZSE02vDqPMt1mlhz_0 2024-09-12T01:29:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8529399008286199290', time=2024-09-12T03:17:34.837106+0000, chain.objs.size()=1 2024-09-12T01:29:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.561__multipart_mymultipart.2~0e6yVR3LnQLG9dTqYP3GhYufY9gaUJf.1 2024-09-12T01:29:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11627698677035345115', time=2024-09-12T03:18:02.504983+0000, chain.objs.size()=1 2024-09-12T01:29:16.287 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.285+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.574__shadow:1hYiwGNJvy5C5Af6DS6nSmWBTeaseWm_.sJiqb5GO6fvQsvUoUTIsYxijZzD7jdd_0 2024-09-12T01:29:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.288+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1257281074236553424', time=2024-09-12T03:18:10.526722+0000, chain.objs.size()=1 2024-09-12T01:29:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.288+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.576__shadow:l4XEsqr0o4IFu.RSlaRhjtszNAdmkY4_.U_0_l_nCweBQCKE0pj25_XZoOO5B8yb_0 2024-09-12T01:29:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.288+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17834262500388645835', time=2024-09-12T03:18:28.360222+0000, chain.objs.size()=1 2024-09-12T01:29:16.288 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.288+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:kbKZ58f0tpaKruwHMUtpIXQas7SQq3g_.Hn01vDFjuI4etA511xYrC1E9kSTUHjX_0 2024-09-12T01:29:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.288+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12879895924056665100', time=2024-09-12T03:18:32.567962+0000, chain.objs.size()=1 2024-09-12T01:29:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.288+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:xl5gw-BxFmOev2bmU8tBvkZXiqvoG1y_.hNYT0Mc90QsmOu13vUb5P5yc2Onnz5D_0 2024-09-12T01:29:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.288+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1318578122422979029', time=2024-09-12T03:22:18.704604+0000, chain.objs.size()=1 2024-09-12T01:29:16.289 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.288+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.618__shadow_.q67hlpkrYVHN2nK1fyHl_BurkebaMhT_0 2024-09-12T01:29:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.290+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3068735925518551871', time=2024-09-12T03:23:56.420576+0000, chain.objs.size()=1 2024-09-12T01:29:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.290+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.691__shadow_.aLHjQYIwlFFQFdGvdxqcohZBI6iP9OE_0 2024-09-12T01:29:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.290+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7190780059444539937', time=2024-09-12T03:24:32.733967+0000, chain.objs.size()=1 2024-09-12T01:29:16.290 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.290+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.718__shadow_.wzTQV5EMCUZXqYNz2YbW0rEtHn4FD6e_0 2024-09-12T01:29:16.293 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.293+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:16.295 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.295+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:29:16.296 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.296+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:16.297 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.297+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:16.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48295' 2024-09-12T01:29:16.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7233960656368319354', time=2024-09-12T03:07:00.176398+0000, chain.objs.size()=1 2024-09-12T01:29:16.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.166__shadow_.7pixZvjD3XwLqR_jqKHTut_bTqUEFB6_0 2024-09-12T01:29:16.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6118453376569148541', time=2024-09-12T03:08:59.949930+0000, chain.objs.size()=1 2024-09-12T01:29:16.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.238__shadow_.D1MNWmGN29XsToaD8IkbaY0g6Asqpi__0 2024-09-12T01:29:16.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7941516855085627284', time=2024-09-12T03:09:05.359748+0000, chain.objs.size()=1 2024-09-12T01:29:16.299 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.246__shadow_.tTwtFJUBja8s9Ilm3UKR46CEZddntxS_0 2024-09-12T01:29:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13367604042382617057', time=2024-09-12T03:09:07.936127+0000, chain.objs.size()=1 2024-09-12T01:29:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.250__shadow_.KCO05DXpAz1jagmso3wOyYaAKKrSDca_0 2024-09-12T01:29:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14095292510235428117', time=2024-09-12T03:09:07.942148+0000, chain.objs.size()=1 2024-09-12T01:29:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.250__shadow_.o-IXeHR6awta9BS9ggqqooPH4S0KY3-_0 2024-09-12T01:29:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13111303853357211927', time=2024-09-12T03:09:14.935262+0000, chain.objs.size()=1 2024-09-12T01:29:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.261__shadow_.LaE-iyCfEqROPdl7B5FfLMaHp0nEFCV_0 2024-09-12T01:29:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14142120449846323907', time=2024-09-12T03:09:54.865030+0000, chain.objs.size()=1 2024-09-12T01:29:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.rj2STyd0WIVczFUQgT-RV6Kv0zYy9gj_0 2024-09-12T01:29:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14937575094103063856', time=2024-09-12T03:09:55.266992+0000, chain.objs.size()=1 2024-09-12T01:29:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.iPOSYymjaCb2xiZkXqel5VhAan4wyNp_0 2024-09-12T01:29:16.300 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10430138467257648480', time=2024-09-12T03:09:55.353900+0000, chain.objs.size()=1 2024-09-12T01:29:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.JVE8oSBECLE64YyxuQyIAGcWUaEHV-K_0 2024-09-12T01:29:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11631460245271556558', time=2024-09-12T03:09:56.491443+0000, chain.objs.size()=1 2024-09-12T01:29:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Hs-QmBy-4VTQB9sRAmWAFVV3DFeE5l4_0 2024-09-12T01:29:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5976311762549176996', time=2024-09-12T03:09:56.652040+0000, chain.objs.size()=1 2024-09-12T01:29:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.mP3y2dGQiDdGTiROxlP5KG08BfsMmjv_0 2024-09-12T01:29:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14323025243767983161', time=2024-09-12T03:09:56.963439+0000, chain.objs.size()=1 2024-09-12T01:29:16.301 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.298+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0P43g_jmIPqA8xGfJD8hklBfG9rBXpt_0 2024-09-12T01:29:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.300+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9771245240845941123', time=2024-09-12T03:09:58.390514+0000, chain.objs.size()=1 2024-09-12T01:29:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.300+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8C5KSucVqNUk3ao3RFnremjlQZsdONF_0 2024-09-12T01:29:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.300+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2583634003005026509', time=2024-09-12T03:09:58.445964+0000, chain.objs.size()=1 2024-09-12T01:29:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.300+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.EJyg8NluwtKGDTreFq59HaXTSQ4qhWa_0 2024-09-12T01:29:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.300+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11224661238052765909', time=2024-09-12T03:09:58.446672+0000, chain.objs.size()=1 2024-09-12T01:29:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.300+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.yDEL6GgtR9nqGO6p_jgmZQ5ZL8FEX7W_0 2024-09-12T01:29:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.301+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12685207922466695578', time=2024-09-12T03:09:58.447247+0000, chain.objs.size()=1 2024-09-12T01:29:16.302 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.301+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._MZEXYpKQKKRi3D4BkMussiuw_11i0B_0 2024-09-12T01:29:16.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.301+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17636455469140537441', time=2024-09-12T03:09:58.961923+0000, chain.objs.size()=1 2024-09-12T01:29:16.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.301+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.mKnmjaCtidhulhqJxR-dJF4kkBmW72Y_0 2024-09-12T01:29:16.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.303+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18261017555003250080', time=2024-09-12T03:09:59.508019+0000, chain.objs.size()=1 2024-09-12T01:29:16.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.303+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.I2oqVxwBWuuKuMs7-xj8X1JuEX9_-JF_0 2024-09-12T01:29:16.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.303+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11043032588300863980', time=2024-09-12T03:09:59.802827+0000, chain.objs.size()=1 2024-09-12T01:29:16.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.303+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.aBlb9_r3h6cB3I2rVGV9A3y29Jv7zcp_0 2024-09-12T01:29:16.303 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.303+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2306278325809338126', time=2024-09-12T03:10:00.333275+0000, chain.objs.size()=1 2024-09-12T01:29:16.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.303+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.V0Q62YPi04XLin1oiwaMEv3mbCoEZ1P_0 2024-09-12T01:29:16.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.303+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4849484088731343447', time=2024-09-12T03:10:00.437636+0000, chain.objs.size()=1 2024-09-12T01:29:16.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.303+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.EOFgv8r5E7Eddg8XfJSCv1ZD0e7QGza_0 2024-09-12T01:29:16.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.303+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.665348279911258486', time=2024-09-12T03:10:00.582513+0000, chain.objs.size()=1 2024-09-12T01:29:16.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.303+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ZFQRsr-YEGtsunLDTY7QbUdqnz2ud_4_0 2024-09-12T01:29:16.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.303+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16969163737826720820', time=2024-09-12T03:10:01.320895+0000, chain.objs.size()=1 2024-09-12T01:29:16.304 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.303+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.TlDHDVQPogsPT6uAib2hVeoDYkqWXDR_0 2024-09-12T01:29:16.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.304+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12370943369733072685', time=2024-09-12T03:10:01.348101+0000, chain.objs.size()=1 2024-09-12T01:29:16.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.304+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.KrU6w-xo-8NihhIepLlRep-yyIdDaPc_0 2024-09-12T01:29:16.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.304+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.289465997043530792', time=2024-09-12T03:10:01.348586+0000, chain.objs.size()=1 2024-09-12T01:29:16.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.304+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.oKtHziFZULxv8P1mLsrImeRePkrVlIZ_0 2024-09-12T01:29:16.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.304+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6308235587321473748', time=2024-09-12T03:10:01.450092+0000, chain.objs.size()=1 2024-09-12T01:29:16.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.304+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.to5hgnx_ALTt3Xu_JEskY77x_py9pPR_0 2024-09-12T01:29:16.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.304+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7965554433252646152', time=2024-09-12T03:10:01.514741+0000, chain.objs.size()=1 2024-09-12T01:29:16.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.304+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.OWwTjVue53Jyt6wSQcBCwh46I8bNo3k_0 2024-09-12T01:29:16.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.304+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17073319002316405129', time=2024-09-12T03:10:01.515558+0000, chain.objs.size()=1 2024-09-12T01:29:16.305 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.304+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.SH0x6tbefnQtZik9Nk3Eeh0kiX4chHB_0 2024-09-12T01:29:16.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.306+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2549149322616126844', time=2024-09-12T03:10:01.676464+0000, chain.objs.size()=1 2024-09-12T01:29:16.306 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.306+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.wyJZkQGnh52l8f1ylju37iRXkulnYmR_0 2024-09-12T01:29:16.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.307+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8930852455229545766', time=2024-09-12T03:10:01.925520+0000, chain.objs.size()=1 2024-09-12T01:29:16.307 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.307+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Zblpm5anCqNbCngzL1dFABOqAK1V68L_0 2024-09-12T01:29:16.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.308+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8304463162163812688', time=2024-09-12T03:10:02.077359+0000, chain.objs.size()=1 2024-09-12T01:29:16.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.308+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.amU59P4wE8tYzw6QmSi9frrUgyhZvzG_0 2024-09-12T01:29:16.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.308+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9788058612456127864', time=2024-09-12T03:10:02.077928+0000, chain.objs.size()=1 2024-09-12T01:29:16.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.308+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Tl4Wg2d68MWbAuQR__d6RfdT_KPPLpG_0 2024-09-12T01:29:16.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.308+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12285365371448257016', time=2024-09-12T03:10:02.700015+0000, chain.objs.size()=1 2024-09-12T01:29:16.308 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.308+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.l_QApOBKxe5wL34oGITGazfYyo9Pl3s_0 2024-09-12T01:29:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.308+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3091166146841426175', time=2024-09-12T03:10:02.700699+0000, chain.objs.size()=1 2024-09-12T01:29:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.308+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0hnpI-0CgqkQLc9Oyfr7IrCjqgCeSdg_0 2024-09-12T01:29:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.308+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14233055929181581546', time=2024-09-12T03:10:03.119060+0000, chain.objs.size()=1 2024-09-12T01:29:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.308+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.6L5j9Rxkm0cGngPhMCDZQhmvfZcXzd1_0 2024-09-12T01:29:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.309+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5190040669902696768', time=2024-09-12T03:10:03.856502+0000, chain.objs.size()=1 2024-09-12T01:29:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.309+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.2-rxTi67Qv2zCvLLrKFn1EwEYHUVWCA_0 2024-09-12T01:29:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.309+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13034148757727168861', time=2024-09-12T03:10:04.284187+0000, chain.objs.size()=1 2024-09-12T01:29:16.309 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.309+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.2JkjcqMxTmrg_1BHxJUiaMexZnjn_AJ_0 2024-09-12T01:29:16.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.311+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9042344597034862912', time=2024-09-12T03:10:04.284883+0000, chain.objs.size()=1 2024-09-12T01:29:16.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.311+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.bzQX4J7iqnMxFplSwKi8F3FJ_LNhux3_0 2024-09-12T01:29:16.311 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.311+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11386519178287966760', time=2024-09-12T03:10:04.968934+0000, chain.objs.size()=1 2024-09-12T01:29:16.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.311+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.opGd8JDtaYoj6-ABkm6wOuEv5JyClFZ_0 2024-09-12T01:29:16.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.311+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12346949055110163149', time=2024-09-12T03:10:05.047343+0000, chain.objs.size()=1 2024-09-12T01:29:16.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.311+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.m5-UQ4x-P4-9vMagkJqADoVh4O16y_-_0 2024-09-12T01:29:16.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.311+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3859999956718559607', time=2024-09-12T03:10:05.048116+0000, chain.objs.size()=1 2024-09-12T01:29:16.312 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.311+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.B1Hs8kbBB3kRGnK_LeO2boRgytGISbL_0 2024-09-12T01:29:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.313+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5099180636553353925', time=2024-09-12T03:10:05.155037+0000, chain.objs.size()=1 2024-09-12T01:29:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.313+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.39cXbl9MQMU9f9tW-yU2QyVjSBy-3o-_0 2024-09-12T01:29:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.313+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1993176794896113667', time=2024-09-12T03:10:05.886894+0000, chain.objs.size()=1 2024-09-12T01:29:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.313+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.OuoEG5bxs8x7k9NLzzlCoZHXCItLIU9_0 2024-09-12T01:29:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.313+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17880290846123322546', time=2024-09-12T03:10:06.194869+0000, chain.objs.size()=1 2024-09-12T01:29:16.313 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.313+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.A5v0FyovY7bTAGz3ONKfnI_YZwvXNp__0 2024-09-12T01:29:16.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.314+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12853275514882148277', time=2024-09-12T03:10:06.698241+0000, chain.objs.size()=1 2024-09-12T01:29:16.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.314+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.oi_r9M2ftw6jY5kaBuS5uVlN_apy3PW_0 2024-09-12T01:29:16.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.314+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10046744083922342673', time=2024-09-12T03:10:19.116414+0000, chain.objs.size()=1 2024-09-12T01:29:16.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.314+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.282__shadow_.qs5WbhKObXTySWPTqrIP1m3_NDQU-V5_0 2024-09-12T01:29:16.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.314+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12143527005967270407', time=2024-09-12T03:10:20.434195+0000, chain.objs.size()=1 2024-09-12T01:29:16.314 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.314+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.284__shadow_.uhNQ1f65bmKDATst6zqfMpBLTAiT_mf_0 2024-09-12T01:29:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.314+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2257688834526754660', time=2024-09-12T03:10:27.045902+0000, chain.objs.size()=1 2024-09-12T01:29:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.314+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.AQBhVollhafJ3zFCEOH9MXunz5KM5TV_0 2024-09-12T01:29:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.315+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11376104503322926263', time=2024-09-12T03:10:29.050812+0000, chain.objs.size()=1 2024-09-12T01:29:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.315+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.z_82N6oeegUbEqhqIOb7WRYg5gMOL3u_0 2024-09-12T01:29:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.315+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.576021795963007856', time=2024-09-12T03:10:31.830692+0000, chain.objs.size()=1 2024-09-12T01:29:16.315 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.315+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.297__shadow_.iu4SkYp0Jxqd060ZOMD-c4BOKkl7jXE_0 2024-09-12T01:29:16.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.317+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12317464331306271396', time=2024-09-12T03:10:33.870508+0000, chain.objs.size()=1 2024-09-12T01:29:16.317 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.317+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.300__shadow_.O_vR3h5AirlU6-tEkOypQ55h1ZzjFi0_0 2024-09-12T01:29:16.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.319+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12615146718770995693', time=2024-09-12T03:10:37.106374+0000, chain.objs.size()=1 2024-09-12T01:29:16.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.319+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.305__shadow_.o-vWlOcKaOtjlHpOZpHaUR1JCSSwAja_0 2024-09-12T01:29:16.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.319+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2171919302824019568', time=2024-09-12T03:10:38.001109+0000, chain.objs.size()=1 2024-09-12T01:29:16.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.319+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.306__shadow_.H7ppG3GMOLnMeCAVSm992NflKvWlH9o_0 2024-09-12T01:29:16.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.319+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3643577309202476093', time=2024-09-12T03:11:29.904094+0000, chain.objs.size()=1 2024-09-12T01:29:16.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.319+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.vB2tnH62g9t90hhv1nHm9v7pRLBHknF_0 2024-09-12T01:29:16.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.319+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10750804173376952655', time=2024-09-12T03:11:30.299373+0000, chain.objs.size()=1 2024-09-12T01:29:16.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.319+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tcltNqrJEq_uGFgRtRRBhsCPAWBSMkp_0 2024-09-12T01:29:16.319 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.319+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9517021762068737749', time=2024-09-12T03:11:30.428661+0000, chain.objs.size()=1 2024-09-12T01:29:16.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.319+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2FbPgH1vwTzoEXevLj8pF4T1XnDctwk_0 2024-09-12T01:29:16.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.320+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12120062206973592052', time=2024-09-12T03:11:31.146190+0000, chain.objs.size()=1 2024-09-12T01:29:16.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.320+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.jqy4AW6PeM0mIpYHNPKs-ST9xEy7Arf_0 2024-09-12T01:29:16.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.320+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13063148672566259987', time=2024-09-12T03:11:31.386921+0000, chain.objs.size()=1 2024-09-12T01:29:16.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.320+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2Y3l84PbIgktv1Dr3iO1n9dtTsDgYvz_0 2024-09-12T01:29:16.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.320+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15129452217317430447', time=2024-09-12T03:11:31.990253+0000, chain.objs.size()=1 2024-09-12T01:29:16.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.320+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.PmH4Qc3y0DuDeQ3TEB_4P50ndxcbCUl_0 2024-09-12T01:29:16.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.320+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1483764525150497124', time=2024-09-12T03:11:32.328446+0000, chain.objs.size()=1 2024-09-12T01:29:16.320 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.320+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ReZAHkCmefAdMxrvrZrj6H_CjFa44qm_0 2024-09-12T01:29:16.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.320+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11323012081550212629', time=2024-09-12T03:11:33.253987+0000, chain.objs.size()=1 2024-09-12T01:29:16.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.320+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5zzN4b640dZObM2mcCS66OkmbVUWn2e_0 2024-09-12T01:29:16.321 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.321+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8201701447225655004', time=2024-09-12T03:11:33.814380+0000, chain.objs.size()=1 2024-09-12T01:29:16.322 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.321+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Idhs7pgfG6s8c5ZZc-_JXOLLlwZnFV0_0 2024-09-12T01:29:16.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.323+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16904141319671719540', time=2024-09-12T03:11:34.483986+0000, chain.objs.size()=1 2024-09-12T01:29:16.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.323+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.DBsZEaoE-oZSQz3Kz0wA9AlTbmbGqz6_0 2024-09-12T01:29:16.323 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.323+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5447732437074229475', time=2024-09-12T03:11:34.999347+0000, chain.objs.size()=1 2024-09-12T01:29:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.323+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.z3nD7J4A4l4jVmo17I1qhZEDHMHd2Dt_0 2024-09-12T01:29:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.323+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7502837724747501120', time=2024-09-12T03:11:35.190751+0000, chain.objs.size()=1 2024-09-12T01:29:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.323+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.kNZKCQtK7FYLs3YjCeYJRm0SVV1UYJj_0 2024-09-12T01:29:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.324+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6675338366494189571', time=2024-09-12T03:11:36.067273+0000, chain.objs.size()=1 2024-09-12T01:29:16.324 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.324+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.g_EOYzJfjrVpvXDQwn2XPj7_MwBohDU_0 2024-09-12T01:29:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.324+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11574270149966698839', time=2024-09-12T03:11:36.104675+0000, chain.objs.size()=1 2024-09-12T01:29:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.324+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.9CU80NSGtNCelK9F86gPk8TrREIaK2S_0 2024-09-12T01:29:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.324+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13585528490653078826', time=2024-09-12T03:11:36.282304+0000, chain.objs.size()=1 2024-09-12T01:29:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.324+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xcK30wEZo2s2clAPv2Z4tWwSG1lBJkq_0 2024-09-12T01:29:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.325+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11444102609775812765', time=2024-09-12T03:11:36.453043+0000, chain.objs.size()=1 2024-09-12T01:29:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.325+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.XH1NaU4-leQ2bk-yYxX-z_Wg7bjoZ8G_0 2024-09-12T01:29:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.325+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2854701390848875090', time=2024-09-12T03:11:36.534998+0000, chain.objs.size()=1 2024-09-12T01:29:16.325 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.325+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7trMsH2E3tAeFdlk5HUWhLAoXYYh6c3_0 2024-09-12T01:29:16.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4875009852499885356', time=2024-09-12T03:11:37.808154+0000, chain.objs.size()=1 2024-09-12T01:29:16.326 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.JZEUQAvVlFlgP8yilSP6-SFqRqJ3cPk_0 2024-09-12T01:29:16.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14554899936587007250', time=2024-09-12T03:11:37.881319+0000, chain.objs.size()=1 2024-09-12T01:29:16.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.JJaAgt9WeFfkIwFDpG0EhBhNaSo8iZe_0 2024-09-12T01:29:16.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11808231938346115392', time=2024-09-12T03:11:38.370628+0000, chain.objs.size()=1 2024-09-12T01:29:16.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.XgLWty_B9Qe7_v0zr7Jz7hpz-dbi3YQ_0 2024-09-12T01:29:16.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3977331463643502364', time=2024-09-12T03:11:38.718346+0000, chain.objs.size()=1 2024-09-12T01:29:16.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.xxbChBrwnkqaOcMdsU_wEvA9hxbM2-z_0 2024-09-12T01:29:16.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.326+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7238338134176986168', time=2024-09-12T03:11:38.735408+0000, chain.objs.size()=1 2024-09-12T01:29:16.327 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.326+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.bQ8K0sxOYjSq9GVeiPja99lLFG5ES7n_0 2024-09-12T01:29:16.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.327+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6674446930466097041', time=2024-09-12T03:11:38.822676+0000, chain.objs.size()=1 2024-09-12T01:29:16.328 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.327+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.yOEzRrtjc_bVY8Ex9zRC7WMwLEAh_DA_0 2024-09-12T01:29:16.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.329+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17786012266932660015', time=2024-09-12T03:11:39.484343+0000, chain.objs.size()=1 2024-09-12T01:29:16.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.329+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.s-dGBa6n9jMdz6yUhtqG8uxEVKPjaE5_0 2024-09-12T01:29:16.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.329+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5394767175245839330', time=2024-09-12T03:11:39.504626+0000, chain.objs.size()=1 2024-09-12T01:29:16.329 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.329+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.FyUVCxZzpe5WetNyin0tYQRTvinVQcg_0 2024-09-12T01:29:16.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.329+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7646593563318082729', time=2024-09-12T03:11:39.538981+0000, chain.objs.size()=1 2024-09-12T01:29:16.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.329+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.htyhSYNOGyWjCjJq4zVJGTChnv8lKB0_0 2024-09-12T01:29:16.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.330+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17285357227007356827', time=2024-09-12T03:11:39.743752+0000, chain.objs.size()=1 2024-09-12T01:29:16.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.330+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.muJf11ztmvSRNeUS034cGDq2bG9txwM_0 2024-09-12T01:29:16.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.330+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15347785959846763551', time=2024-09-12T03:11:39.847025+0000, chain.objs.size()=1 2024-09-12T01:29:16.330 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.330+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.4uz7UB3jzgEsAEIUienYV3lZgCeTuIJ_0 2024-09-12T01:29:16.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.330+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12467358284522014517', time=2024-09-12T03:11:40.001069+0000, chain.objs.size()=1 2024-09-12T01:29:16.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.330+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.zjZOSCLOcwzBQye8gclblx-fmSYDCAK_0 2024-09-12T01:29:16.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.330+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12363656716010550965', time=2024-09-12T03:11:40.154828+0000, chain.objs.size()=1 2024-09-12T01:29:16.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.330+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.V3SSgOdm-megmIZrdfG6WSbH1ySuTln_0 2024-09-12T01:29:16.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.331+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17597229898031277972', time=2024-09-12T03:11:40.224399+0000, chain.objs.size()=1 2024-09-12T01:29:16.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.331+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.j7_zyG7IvIwTfPUhPx9cX2Cs0HAbR98_0 2024-09-12T01:29:16.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.331+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9830486727368642922', time=2024-09-12T03:11:40.356647+0000, chain.objs.size()=1 2024-09-12T01:29:16.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.331+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Yp9XplR08MHYtxTzZJv2PDym0pEklPG_0 2024-09-12T01:29:16.331 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.331+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14259101461074798469', time=2024-09-12T03:11:40.357407+0000, chain.objs.size()=1 2024-09-12T01:29:16.332 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.331+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.JUE7_WE06RzI28yQkcENJx1R2pnolCH_0 2024-09-12T01:29:16.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.333+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9478928331723362574', time=2024-09-12T03:11:40.691903+0000, chain.objs.size()=1 2024-09-12T01:29:16.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.333+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.-cglKnbwBWbdxQT6h3FPY0fv5VVdzHk_0 2024-09-12T01:29:16.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.333+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4357506230546951232', time=2024-09-12T03:11:41.030328+0000, chain.objs.size()=1 2024-09-12T01:29:16.333 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.333+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.agPWc-iHvCNpRTkDeDsTh-zH0OoYibY_0 2024-09-12T01:29:16.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.334+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12250366244440788065', time=2024-09-12T03:12:21.938960+0000, chain.objs.size()=1 2024-09-12T01:29:16.334 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.334+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-By5De8p19B18z6ZHkwyUmq7v-uQbr8_0 2024-09-12T01:29:16.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18213073750534403283', time=2024-09-12T03:12:22.044824+0000, chain.objs.size()=1 2024-09-12T01:29:16.335 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.7G_d9UfRI1IRqsy6avU21tB9-ROQq04_0 2024-09-12T01:29:16.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5946969972080436017', time=2024-09-12T03:12:22.648245+0000, chain.objs.size()=1 2024-09-12T01:29:16.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.soHMQzr_ap_VwIXJA3-b3BvzXgL4hMy_0 2024-09-12T01:29:16.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4575420158212693754', time=2024-09-12T03:12:22.752380+0000, chain.objs.size()=1 2024-09-12T01:29:16.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Gwr-QCqWmNmlkKwYeQZqteB0PgPICAF_0 2024-09-12T01:29:16.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3174820536627852623', time=2024-09-12T03:12:23.069128+0000, chain.objs.size()=1 2024-09-12T01:29:16.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.j-eCRIGcd6Wq0MmRvUqXLDsJVKTwkr__0 2024-09-12T01:29:16.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15116752165927671543', time=2024-09-12T03:12:23.615266+0000, chain.objs.size()=1 2024-09-12T01:29:16.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.eDQmqU7IIlbf3dr6ugqKlBPCW1QzFWS_0 2024-09-12T01:29:16.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16811839795970703688', time=2024-09-12T03:12:23.675086+0000, chain.objs.size()=1 2024-09-12T01:29:16.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.4fPvlzb4Yhd0nROwNFgEL0ixnZAL6Eg_0 2024-09-12T01:29:16.336 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7320547790886072383', time=2024-09-12T03:12:23.675981+0000, chain.objs.size()=1 2024-09-12T01:29:16.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.aBPvkOj6TJI1kKUsLUpQNQMB11cOx8p_0 2024-09-12T01:29:16.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18390204183559652573', time=2024-09-12T03:12:23.899768+0000, chain.objs.size()=1 2024-09-12T01:29:16.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.335+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.9rodlKTyJ8PypbPNd4vHwz3jjJxH2ru_0 2024-09-12T01:29:16.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.336+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.746983140944062015', time=2024-09-12T03:12:24.554532+0000, chain.objs.size()=1 2024-09-12T01:29:16.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.336+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.PkYmVnR7mjpJSsO2hUCaYBcTzcP_22S_0 2024-09-12T01:29:16.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.336+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.391249705915317804', time=2024-09-12T03:12:24.822405+0000, chain.objs.size()=1 2024-09-12T01:29:16.337 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.336+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Q6ymowuD1bu6RomiWgjJ_SiFBahiowU_0 2024-09-12T01:29:16.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.338+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17761238025242679974', time=2024-09-12T03:12:25.433811+0000, chain.objs.size()=1 2024-09-12T01:29:16.338 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.338+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.kDSeYor83IYW7oVV42S96Ck4B-5CQqM_0 2024-09-12T01:29:16.341 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.341+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/48295 2024-09-12T01:29:16.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=43, truncated=0, next_marker='' 2024-09-12T01:29:16.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4739142094481225806', time=2024-09-12T03:12:26.538487+0000, chain.objs.size()=1 2024-09-12T01:29:16.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._D4psVMv4XYCHSvOWVdu2aj33Dlsed__0 2024-09-12T01:29:16.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7815332640470230792', time=2024-09-12T03:12:26.594641+0000, chain.objs.size()=1 2024-09-12T01:29:16.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.eiFKHFon8p-vrAvSV679x1dVQTCH5p2_0 2024-09-12T01:29:16.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1135227087112651238', time=2024-09-12T03:12:27.710498+0000, chain.objs.size()=1 2024-09-12T01:29:16.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.0amaVFpx5Do_NPP4sF8LWwQTD9__uol_0 2024-09-12T01:29:16.344 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14154605845680785937', time=2024-09-12T03:12:28.283882+0000, chain.objs.size()=1 2024-09-12T01:29:16.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.DZPI0WXevtvTFx4li5vHJo4DJ5zZmTZ_0 2024-09-12T01:29:16.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10122963764862516222', time=2024-09-12T03:12:28.986640+0000, chain.objs.size()=1 2024-09-12T01:29:16.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.XW7pCqDYS30IyFe7R7Lh8yBHjnpps5J_0 2024-09-12T01:29:16.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5916650778992951659', time=2024-09-12T03:12:29.088265+0000, chain.objs.size()=1 2024-09-12T01:29:16.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.6cqMiLNcMd7cfnctIAVnmLJrrkHGtkV_0 2024-09-12T01:29:16.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7338952941372134432', time=2024-09-12T03:12:29.744868+0000, chain.objs.size()=1 2024-09-12T01:29:16.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.0IgE6gJxp8MR5oF1VGO1I5acQsHLVVr_0 2024-09-12T01:29:16.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3784645772148506801', time=2024-09-12T03:12:29.902925+0000, chain.objs.size()=1 2024-09-12T01:29:16.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.IkU2Jr6ygrTuDq0ogZ2Z2erDtDK3UQ1_0 2024-09-12T01:29:16.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.376736440435456597', time=2024-09-12T03:12:30.730247+0000, chain.objs.size()=1 2024-09-12T01:29:16.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MoPXHFPy-Z_C79MJCxj7tvfOvtv8vtR_0 2024-09-12T01:29:16.345 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5328870539721377674', time=2024-09-12T03:12:30.822729+0000, chain.objs.size()=1 2024-09-12T01:29:16.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.QC80BNbt0-pg1ZnWi7_mHTtJ2fnBNy1_0 2024-09-12T01:29:16.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15660577393842041651', time=2024-09-12T03:12:30.995979+0000, chain.objs.size()=1 2024-09-12T01:29:16.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3JpEF59sU-gFDZwabAl6SW0V2XVeIpJ_0 2024-09-12T01:29:16.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14549804126319262877', time=2024-09-12T03:12:31.092980+0000, chain.objs.size()=1 2024-09-12T01:29:16.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.343+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.tAm4nsCz0CaJ_C1Zc8Hgn2Pi485OG06_0 2024-09-12T01:29:16.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.346+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4627952838287333845', time=2024-09-12T03:12:31.528274+0000, chain.objs.size()=1 2024-09-12T01:29:16.346 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.346+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.l9pKrcIqKOfP9iag_40w0Xtwrx3EQMx_0 2024-09-12T01:29:16.347 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.347+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9276081965174439607', time=2024-09-12T03:12:31.602686+0000, chain.objs.size()=1 2024-09-12T01:29:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.347+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.VJpf5cA9181tTJILgep2CgNEw-SOfar_0 2024-09-12T01:29:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.347+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9760831302473556005', time=2024-09-12T03:12:32.570952+0000, chain.objs.size()=1 2024-09-12T01:29:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.347+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.cYv4rqYs0XjTPylRnECl_BuO2C5a2Zd_0 2024-09-12T01:29:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.347+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6625964532883604232', time=2024-09-12T03:12:33.019320+0000, chain.objs.size()=1 2024-09-12T01:29:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.347+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.l5hKSHGPzYT0HldZj_6gxrY_85mtdDw_0 2024-09-12T01:29:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.347+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16699839162565607037', time=2024-09-12T03:12:33.020638+0000, chain.objs.size()=1 2024-09-12T01:29:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.347+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.v_Rxbrqh9z3Teab4nZmWmbzTMOBTUw0_0 2024-09-12T01:29:16.348 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.348+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14057761216051165193', time=2024-09-12T03:12:33.095898+0000, chain.objs.size()=1 2024-09-12T01:29:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.348+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.BwVRuZX5hCUUBnLSkHkVu17UQ6IRNpE_0 2024-09-12T01:29:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.348+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11239191490261210346', time=2024-09-12T03:12:33.130659+0000, chain.objs.size()=1 2024-09-12T01:29:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.348+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.XwdpHYLnlne5XOUnIiEocVS7RZQoQvN_0 2024-09-12T01:29:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.348+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.616827770638226286', time=2024-09-12T03:12:33.220694+0000, chain.objs.size()=1 2024-09-12T01:29:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.348+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.072e64iHV3KPtlpc5zAAffS5AWIVRwK_0 2024-09-12T01:29:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.348+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14072516751794648401', time=2024-09-12T03:12:33.566690+0000, chain.objs.size()=1 2024-09-12T01:29:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.348+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.NrMheC3O3KJ6X7N3W7FpNM_SbPZ_jyi_0 2024-09-12T01:29:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.348+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2917623862800789960', time=2024-09-12T03:12:33.785449+0000, chain.objs.size()=1 2024-09-12T01:29:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.348+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.wtM_TVylWuV0xDZDV_-dvC8J9RftPYJ_0 2024-09-12T01:29:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.348+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5199092253315118733', time=2024-09-12T03:12:34.257600+0000, chain.objs.size()=1 2024-09-12T01:29:16.349 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.348+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xFcTFee4gjtSnFiHDlLlf5ePMS5cFjt_0 2024-09-12T01:29:16.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.349+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9162628251357708299', time=2024-09-12T03:12:34.274298+0000, chain.objs.size()=1 2024-09-12T01:29:16.350 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.349+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.3KFywRvDBP3WmlsRCt9BGlyGA6RNdf8_0 2024-09-12T01:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.350+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.627432681930912594', time=2024-09-12T03:12:34.486447+0000, chain.objs.size()=1 2024-09-12T01:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.350+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.wa3VKubhClzgG1syp-SAfJ2aahrdMqh_0 2024-09-12T01:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.351+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1012921056450565448', time=2024-09-12T03:12:38.897740+0000, chain.objs.size()=1 2024-09-12T01:29:16.351 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.351+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.332__shadow_.Rzqm5fCHNG-7WE3zq_csNrkyXjtvyE1_0 2024-09-12T01:29:16.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.352+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17998159524516611429', time=2024-09-12T03:13:02.121579+0000, chain.objs.size()=1 2024-09-12T01:29:16.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.352+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.377__shadow_.mnWIGNIkp0Q-0c-MSiwrOWt1DjGKWym_0 2024-09-12T01:29:16.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.352+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1225358022583145633', time=2024-09-12T03:13:02.321667+0000, chain.objs.size()=1 2024-09-12T01:29:16.352 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.352+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.377__shadow_.ThL8XOAQvkCjOlOlRi5VVlVhJ8AjhOn_0 2024-09-12T01:29:16.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.352+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.202986490953498023', time=2024-09-12T03:13:40.118837+0000, chain.objs.size()=1 2024-09-12T01:29:16.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.352+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.442__shadow_.usaUav8zk8P4S7FvKhdW0Oli-16Eo4x_0 2024-09-12T01:29:16.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.352+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11469989402730528028', time=2024-09-12T03:13:40.819341+0000, chain.objs.size()=1 2024-09-12T01:29:16.353 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.352+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.443__shadow_.KOeTLhlaD0HIXoLTwfb7Bwqqn3l4tqV_0 2024-09-12T01:29:16.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.354+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9243764018252714652', time=2024-09-12T03:13:55.037829+0000, chain.objs.size()=1 2024-09-12T01:29:16.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.354+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.463__shadow_.iDTd8gkYCVYbsPylge-dzvFf0xvsL-B_0 2024-09-12T01:29:16.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.354+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16232679544060475928', time=2024-09-12T03:13:57.688407+0000, chain.objs.size()=1 2024-09-12T01:29:16.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.354+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.466__shadow_.eKVOL3hsoBkIbevLCyWEPmvKeMHORYM_0 2024-09-12T01:29:16.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.354+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~BI9Q73ix-Hq_6Z09_oMVNTQZixMSkOa', time=2024-09-12T03:15:38.170523+0000, chain.objs.size()=1 2024-09-12T01:29:16.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.354+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~BI9Q73ix-Hq_6Z09_oMVNTQZixMSkOa.2 2024-09-12T01:29:16.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.354+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~BI9Q73ix-Hq_6Z09_oMVNTQZixMSkOa', time=2024-09-12T03:15:38.174363+0000, chain.objs.size()=1 2024-09-12T01:29:16.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.354+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~BI9Q73ix-Hq_6Z09_oMVNTQZixMSkOa.3 2024-09-12T01:29:16.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.354+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8791960567745282673', time=2024-09-12T03:16:49.926414+0000, chain.objs.size()=4 2024-09-12T01:29:16.354 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.354+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.535__multipart_mymultipart.2~ATeUP0FjmByqbRnWgeQIxnDT8YW0fTV.1 2024-09-12T01:29:16.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.355+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.535__multipart_mymultipart.2~ATeUP0FjmByqbRnWgeQIxnDT8YW0fTV.2 2024-09-12T01:29:16.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.355+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.535__multipart_mymultipart._ku64XDEwyjrknzbwJD4U-BxGJwRwZJk.3 2024-09-12T01:29:16.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.355+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.535__multipart_mymultipart.2~ATeUP0FjmByqbRnWgeQIxnDT8YW0fTV.4 2024-09-12T01:29:16.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.355+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16229501434517391379', time=2024-09-12T03:17:11.785285+0000, chain.objs.size()=1 2024-09-12T01:29:16.355 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.355+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.551__shadow_.02Aa2zDByyJa46EcgVuzA3WOqfJ57Vn_0 2024-09-12T01:29:16.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.355+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14128092382028828514', time=2024-09-12T03:17:16.889631+0000, chain.objs.size()=1 2024-09-12T01:29:16.356 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.355+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.553__shadow_.x7cyohG8pUiSeo3Hhut4PGABpPcJYDL_0 2024-09-12T01:29:16.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.357+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3144825341228746893', time=2024-09-12T03:17:50.658690+0000, chain.objs.size()=1 2024-09-12T01:29:16.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.357+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:Dd.o-5InUmYiPgrNoWpyNz.XpH2UREd_.pVFAnycN4mNH3vElbUPBXwfRjxdf2i5_0 2024-09-12T01:29:16.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.357+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.244821655220900733', time=2024-09-12T03:18:10.003568+0000, chain.objs.size()=1 2024-09-12T01:29:16.357 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.357+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.576__shadow:jvXHq9XTvzTOU-uddJeE3mlJwDAJc0y_.emYcmNP4xzL2zUk6D9G4rfbUMXrX3ZD_0 2024-09-12T01:29:16.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.357+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~6FbsAyRnCF5Qj454vNtg_k8fRi7NjW_', time=2024-09-12T03:22:48.130490+0000, chain.objs.size()=6 2024-09-12T01:29:16.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.357+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.624__multipart_multipart_enc.2~6FbsAyRnCF5Qj454vNtg_k8fRi7NjW_.1 2024-09-12T01:29:16.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.358+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.624__multipart_multipart_enc.2~6FbsAyRnCF5Qj454vNtg_k8fRi7NjW_.2 2024-09-12T01:29:16.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.358+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.624__multipart_multipart_enc.2~6FbsAyRnCF5Qj454vNtg_k8fRi7NjW_.3 2024-09-12T01:29:16.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.358+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.624__multipart_multipart_enc.2~6FbsAyRnCF5Qj454vNtg_k8fRi7NjW_.4 2024-09-12T01:29:16.358 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.358+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.624__multipart_multipart_enc.2~6FbsAyRnCF5Qj454vNtg_k8fRi7NjW_.5 2024-09-12T01:29:16.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.360+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.624__multipart_multipart_enc.2~6FbsAyRnCF5Qj454vNtg_k8fRi7NjW_.6 2024-09-12T01:29:16.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.360+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3699674193631661502', time=2024-09-12T03:23:55.783481+0000, chain.objs.size()=1 2024-09-12T01:29:16.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.360+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.690__shadow:JKcXHRVvA9toFSswG2gd8Gv5TZasniM_.-XuMHY4OefTleISAHkuwg3yCxPRrZm6_0 2024-09-12T01:29:16.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.360+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.580695983171780221', time=2024-09-12T03:23:58.821415+0000, chain.objs.size()=1 2024-09-12T01:29:16.360 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.360+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.695__shadow_.jkNErek2DwY-He_xtM-VZpI0QWANhGg_0 2024-09-12T01:29:16.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.362+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12062388934804294792', time=2024-09-12T03:24:00.747936+0000, chain.objs.size()=1 2024-09-12T01:29:16.362 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.362+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.698__shadow:EStd3Nwwnl3rvdY90jEpH0NmfUe9ZMS_.8gz64mMGoSHFuP5WlvWQi-zCB9cdH45_0 2024-09-12T01:29:16.366 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.366+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:16.368 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.368+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:29:16.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.370+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:16.370 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.370+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:16.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/49186' 2024-09-12T01:29:16.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.919513932943780735', time=2024-09-12T03:06:29.173957+0000, chain.objs.size()=1 2024-09-12T01:29:16.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.147__shadow_.ZmzDOXVUJSj6IQoXLoVqdN1l367UkCJ_0 2024-09-12T01:29:16.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17763435238183800919', time=2024-09-12T03:06:42.214635+0000, chain.objs.size()=3 2024-09-12T01:29:16.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.159__multipart_mymultipart-FROZEN.2~BCTgNN9SGJEQ7b1nWc47Xqn2ZlXIgUi.1 2024-09-12T01:29:16.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.159__multipart_mymultipart-FROZEN.2~BCTgNN9SGJEQ7b1nWc47Xqn2ZlXIgUi.2 2024-09-12T01:29:16.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.159__multipart_mymultipart-FROZEN.2~BCTgNN9SGJEQ7b1nWc47Xqn2ZlXIgUi.3 2024-09-12T01:29:16.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='_FVzMCRsspnnEQd4R1UVpCN2q28vleBY', time=2024-09-12T03:06:56.599736+0000, chain.objs.size()=1 2024-09-12T01:29:16.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.163__shadow_.XtdU6qLhPU_20ScaU4AH_uKMc8hW00m_0 2024-09-12T01:29:16.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12879287234380732715', time=2024-09-12T03:08:56.201186+0000, chain.objs.size()=1 2024-09-12T01:29:16.372 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.233__shadow_.TGA8QZD205HNFBWcI2Q8lDDHRUidHFQ_0 2024-09-12T01:29:16.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17401113943932507959', time=2024-09-12T03:08:57.475686+0000, chain.objs.size()=1 2024-09-12T01:29:16.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.235__shadow_.pKEhek_e51uPyk6q0is7eHXYhPug9IT_0 2024-09-12T01:29:16.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7999062348830470591', time=2024-09-12T03:08:59.051657+0000, chain.objs.size()=1 2024-09-12T01:29:16.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.237__shadow_.UwzA45gfrocy79yHfgrGGq1al-D5uqm_0 2024-09-12T01:29:16.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.878419155965107894', time=2024-09-12T03:09:04.078460+0000, chain.objs.size()=1 2024-09-12T01:29:16.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.244__shadow_.MGDxOvrRlJTnNJVWh9PdHKT9Zw9zK2t_0 2024-09-12T01:29:16.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2263812885191449475', time=2024-09-12T03:09:11.822254+0000, chain.objs.size()=1 2024-09-12T01:29:16.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.256__shadow_.qO772P3ZcYTan5CEEH6xYiFesYx1Dd9_0 2024-09-12T01:29:16.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5713576491778433637', time=2024-09-12T03:09:54.638602+0000, chain.objs.size()=1 2024-09-12T01:29:16.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.VFT15c4oJ0SqBUOpDb0t6i6Qx642ACN_0 2024-09-12T01:29:16.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10808222814270020446', time=2024-09-12T03:09:55.025505+0000, chain.objs.size()=1 2024-09-12T01:29:16.373 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.371+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_._6-Bcn7_PUe_2i1b1YhSA8WhWWVBFza_0 2024-09-12T01:29:16.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.374+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.743432966209959339', time=2024-09-12T03:09:55.418516+0000, chain.objs.size()=1 2024-09-12T01:29:16.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.374+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.OV3gsNwR-jPvbQM2TmQXlmqsRdE6Suw_0 2024-09-12T01:29:16.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6350307616593858258', time=2024-09-12T03:09:56.646874+0000, chain.objs.size()=1 2024-09-12T01:29:16.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.A3YBkq7Bfq_1EgFODVvyKz5Xl3QMKY2_0 2024-09-12T01:29:16.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18030624362616822037', time=2024-09-12T03:09:56.757744+0000, chain.objs.size()=1 2024-09-12T01:29:16.375 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.CDbkb-wvUMl13GwPthIGeRShCzpI-RZ_0 2024-09-12T01:29:16.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11304004651677053594', time=2024-09-12T03:09:57.935009+0000, chain.objs.size()=1 2024-09-12T01:29:16.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.lwMQkedj22ucQjWa_Rrv4727OSckDlD_0 2024-09-12T01:29:16.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15734119309222208280', time=2024-09-12T03:09:57.936264+0000, chain.objs.size()=1 2024-09-12T01:29:16.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.NL-7w5OMV_c3BK7rRAjx2HA8IjIxGdX_0 2024-09-12T01:29:16.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14174998784863775565', time=2024-09-12T03:10:00.003405+0000, chain.objs.size()=1 2024-09-12T01:29:16.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Oo4bTaa1OTGF4G1cdKr0UBmiwln1JPp_0 2024-09-12T01:29:16.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2962533577696915394', time=2024-09-12T03:10:01.052839+0000, chain.objs.size()=1 2024-09-12T01:29:16.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.L66RNrNrMYr27XWIjoAjpIs5bgKBCAG_0 2024-09-12T01:29:16.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4945791858280183750', time=2024-09-12T03:10:01.403734+0000, chain.objs.size()=1 2024-09-12T01:29:16.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.OAtfV82FAV88rmL_DIps15wGi7xM5QH_0 2024-09-12T01:29:16.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14286282037152512142', time=2024-09-12T03:10:01.711663+0000, chain.objs.size()=1 2024-09-12T01:29:16.376 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.fz3TN-q3MPe36dmCE1YY34lfxsDfwI0_0 2024-09-12T01:29:16.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13936540231468029407', time=2024-09-12T03:10:01.744710+0000, chain.objs.size()=1 2024-09-12T01:29:16.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.jCkHtvj52HIZE20WZ8AWpGXxf_WKoP8_0 2024-09-12T01:29:16.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9905873276918022891', time=2024-09-12T03:10:02.100566+0000, chain.objs.size()=1 2024-09-12T01:29:16.377 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.375+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Mwn9RSSW57vvk2fqtq90-N-k--jWvbi_0 2024-09-12T01:29:16.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.378+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1114364644200589514', time=2024-09-12T03:10:02.281342+0000, chain.objs.size()=1 2024-09-12T01:29:16.378 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.378+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.KpeZZ5t3PyQBCL9es4A_WQpCCudpWbi_0 2024-09-12T01:29:16.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2125526133269869052', time=2024-09-12T03:10:02.787932+0000, chain.objs.size()=1 2024-09-12T01:29:16.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.5Uq9Dqbl00AIoW-tShEI5FpJMzC4qwG_0 2024-09-12T01:29:16.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18228827186788436949', time=2024-09-12T03:10:03.459293+0000, chain.objs.size()=1 2024-09-12T01:29:16.379 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.pg_ppR4NZMMs4LC32dxAzy4YmeMTnuW_0 2024-09-12T01:29:16.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2989084401414253658', time=2024-09-12T03:10:04.246356+0000, chain.objs.size()=1 2024-09-12T01:29:16.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.O1IG2eJz-rnELd8zE3dcSahaFqTrDSG_0 2024-09-12T01:29:16.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3932975928419294010', time=2024-09-12T03:10:04.490875+0000, chain.objs.size()=1 2024-09-12T01:29:16.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.4dmc5d_URq1uzgOsd75KqvmGHLUlRsV_0 2024-09-12T01:29:16.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5076038321260234833', time=2024-09-12T03:10:04.570643+0000, chain.objs.size()=1 2024-09-12T01:29:16.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QBaALfhpVqpUMbEvte70x1h1nT7aGL9_0 2024-09-12T01:29:16.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3028707062537293257', time=2024-09-12T03:10:04.682808+0000, chain.objs.size()=1 2024-09-12T01:29:16.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.8JJFyTX0yQj7ZPB9S2iGCldGDpOH6Dn_0 2024-09-12T01:29:16.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12118791155142905453', time=2024-09-12T03:10:05.721450+0000, chain.objs.size()=1 2024-09-12T01:29:16.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.t6Oks1qayDpokOQ86449_3q6WtwnUiv_0 2024-09-12T01:29:16.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4790584978205880244', time=2024-09-12T03:10:06.201597+0000, chain.objs.size()=1 2024-09-12T01:29:16.380 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.e0gY7o2vvSHSGyKynUkMYG1L93Ec5Sj_0 2024-09-12T01:29:16.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13520301666962442841', time=2024-09-12T03:10:06.334575+0000, chain.objs.size()=1 2024-09-12T01:29:16.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.2ckAffDtFk_3TrZixEJWHHX_JVuHaJD_0 2024-09-12T01:29:16.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5866011846422935437', time=2024-09-12T03:10:07.307617+0000, chain.objs.size()=1 2024-09-12T01:29:16.381 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.379+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.263__shadow_.tg76sFpGIZ0-CTJuTjHlq6ATy9HuwLs_0 2024-09-12T01:29:16.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.382+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16843258990330292742', time=2024-09-12T03:10:17.841766+0000, chain.objs.size()=1 2024-09-12T01:29:16.382 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.382+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.280__shadow_.zLb_i-nYopkQ4vsJXKeEblWwIg_tRzl_0 2024-09-12T01:29:16.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.384+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12874275320513202499', time=2024-09-12T03:10:46.951491+0000, chain.objs.size()=1 2024-09-12T01:29:16.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.384+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.319__shadow:jz6O2x5rSLG2XaMgt3xM7VvZMjKtMRi_.B4joFKSI3y_puFvDsDWf2sGfRaZ-IBe_0 2024-09-12T01:29:16.384 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.384+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3153704229097223151', time=2024-09-12T03:11:29.309026+0000, chain.objs.size()=1 2024-09-12T01:29:16.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.384+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.WkC-2AVmhU-P5fDzlgR8eTAu-gOcFCI_0 2024-09-12T01:29:16.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.384+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14818174592899046972', time=2024-09-12T03:11:29.907341+0000, chain.objs.size()=1 2024-09-12T01:29:16.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.384+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.WmPAe8YoIH59mRuhZtvRKpzk6xyrtyU_0 2024-09-12T01:29:16.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3028209267637270145', time=2024-09-12T03:11:30.249501+0000, chain.objs.size()=1 2024-09-12T01:29:16.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.7pS5WByw33SevlNerpdu9mLYapnhAY4_0 2024-09-12T01:29:16.385 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5426387446515360939', time=2024-09-12T03:11:30.408084+0000, chain.objs.size()=1 2024-09-12T01:29:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.F2f7NLuC8f8LPmqUvgnsddQ0cQfvIRj_0 2024-09-12T01:29:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.101099639782453874', time=2024-09-12T03:11:31.653482+0000, chain.objs.size()=1 2024-09-12T01:29:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.c_Uzz31L7WGA3NC_3sceBTr7xltuoo__0 2024-09-12T01:29:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8584856770810516045', time=2024-09-12T03:11:33.077801+0000, chain.objs.size()=1 2024-09-12T01:29:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.koPzFcqtepao7GF0UQAnTAzcvrHZTAC_0 2024-09-12T01:29:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16362552174456652871', time=2024-09-12T03:11:33.179161+0000, chain.objs.size()=1 2024-09-12T01:29:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.sk1r2btNI8eHx5BC9J6Y6iTFSFUXlUD_0 2024-09-12T01:29:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16915266192364104826', time=2024-09-12T03:11:33.375457+0000, chain.objs.size()=1 2024-09-12T01:29:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.pkdNbgQadOml1HxiBMhXOelp4yzUjWZ_0 2024-09-12T01:29:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.701841156693907395', time=2024-09-12T03:11:33.820381+0000, chain.objs.size()=1 2024-09-12T01:29:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.H31EIMgOdv5oA8cZb6arpaFHL_BrWfa_0 2024-09-12T01:29:16.386 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11483140581687982707', time=2024-09-12T03:11:34.771867+0000, chain.objs.size()=1 2024-09-12T01:29:16.387 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.385+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2o8_6yBFrsjHaPjQ6nBznrtp6ynE4Mu_0 2024-09-12T01:29:16.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.388+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5507315792784079768', time=2024-09-12T03:11:35.081842+0000, chain.objs.size()=1 2024-09-12T01:29:16.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.388+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.WH2PX4xiLAlcwPyJiodfsESpqHUu-XF_0 2024-09-12T01:29:16.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.388+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.122244685164145392', time=2024-09-12T03:11:35.323832+0000, chain.objs.size()=1 2024-09-12T01:29:16.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.388+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.SgJly6BjS4yc_1hrI2a6dmRC3XL--iJ_0 2024-09-12T01:29:16.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.388+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3710057929557675628', time=2024-09-12T03:11:35.638433+0000, chain.objs.size()=1 2024-09-12T01:29:16.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.388+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.tz46ja-JlmK0Qks2pQnAR8DyaTXTXBM_0 2024-09-12T01:29:16.388 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.388+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9990196082662980560', time=2024-09-12T03:11:36.544185+0000, chain.objs.size()=1 2024-09-12T01:29:16.389 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.388+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.3n9lRDMRQ9KORhU3WXznsVJjsqO9CBV_0 2024-09-12T01:29:16.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.390+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9507216506929783657', time=2024-09-12T03:11:36.668761+0000, chain.objs.size()=1 2024-09-12T01:29:16.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.390+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.XTsijKeE8wee6rf_bOUiOqDBz01W9bT_0 2024-09-12T01:29:16.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.390+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5365172533778761225', time=2024-09-12T03:11:36.744371+0000, chain.objs.size()=1 2024-09-12T01:29:16.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.390+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.aPvPZ1OH1NfltuXTBVkYBCkVvCvkLW0_0 2024-09-12T01:29:16.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.390+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6303964820957833763', time=2024-09-12T03:11:36.830419+0000, chain.objs.size()=1 2024-09-12T01:29:16.390 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.390+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Oy_ZbtNzFzbPdd58_TiyQk9xRCA-MLd_0 2024-09-12T01:29:16.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.390+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7112009036296027578', time=2024-09-12T03:11:37.264646+0000, chain.objs.size()=1 2024-09-12T01:29:16.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.390+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.WOYBtscza3fHsyCEzlnWI_RQvE1XfU5_0 2024-09-12T01:29:16.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.390+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3060140288664842213', time=2024-09-12T03:11:37.896717+0000, chain.objs.size()=1 2024-09-12T01:29:16.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.390+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.w48nEkYfYVz2o-Oh78HXIsmGNs4am-R_0 2024-09-12T01:29:16.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.390+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8113284968741913995', time=2024-09-12T03:11:38.806359+0000, chain.objs.size()=1 2024-09-12T01:29:16.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.390+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.74dfgEWfuFTUblxvyP6sdOTc_hX3H4A_0 2024-09-12T01:29:16.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.390+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4114668790582241092', time=2024-09-12T03:11:39.377103+0000, chain.objs.size()=1 2024-09-12T01:29:16.391 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.390+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.c4lJVi3sGSRVc-0L2T_2vmJtEYsqTeP_0 2024-09-12T01:29:16.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.392+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11976030579952318018', time=2024-09-12T03:11:40.041370+0000, chain.objs.size()=1 2024-09-12T01:29:16.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.392+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1NuYBWZCQ6xBLCdGHF5LYMe8lRNy2Dy_0 2024-09-12T01:29:16.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.393+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4612181625024533439', time=2024-09-12T03:11:40.356140+0000, chain.objs.size()=1 2024-09-12T01:29:16.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.393+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Pfnd7QFjANTmx_t_ln_NyljWO4rLTgn_0 2024-09-12T01:29:16.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.393+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11552713684300704322', time=2024-09-12T03:11:40.728996+0000, chain.objs.size()=1 2024-09-12T01:29:16.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.393+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.A66PmQ_zfBh1hYpqYaBmPIsD8Hmz8Vj_0 2024-09-12T01:29:16.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.393+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15010729349143905866', time=2024-09-12T03:11:41.579105+0000, chain.objs.size()=1 2024-09-12T01:29:16.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.393+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.fcdJpXEyf9kUHyPYoC5elbu1CFBsgRO_0 2024-09-12T01:29:16.393 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.393+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14311354081320311505', time=2024-09-12T03:12:21.999294+0000, chain.objs.size()=1 2024-09-12T01:29:16.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.393+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.GqfXwJcf0GWtMJHzN2yI7VWxLlW1dDN_0 2024-09-12T01:29:16.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.394+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13858569519460887429', time=2024-09-12T03:12:22.047921+0000, chain.objs.size()=1 2024-09-12T01:29:16.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.394+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.DYP1VcK52IzbM5OGAEOy712pmF5NWpG_0 2024-09-12T01:29:16.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.394+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15744154181552098491', time=2024-09-12T03:12:22.642746+0000, chain.objs.size()=1 2024-09-12T01:29:16.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.394+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.vb5oAQ0mi1XXjxhZcrQDn8TqvGrAnCO_0 2024-09-12T01:29:16.394 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.394+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.590194961796093841', time=2024-09-12T03:12:22.751914+0000, chain.objs.size()=1 2024-09-12T01:29:16.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.394+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.g-xnnsPilGOTTHIooNeqSfPusZuq4OX_0 2024-09-12T01:29:16.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.394+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18102813885291610174', time=2024-09-12T03:12:22.997031+0000, chain.objs.size()=1 2024-09-12T01:29:16.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.394+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-J8ocWoM4gt35HciXFxiMVBi6ZmfrJU_0 2024-09-12T01:29:16.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.394+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8903992073616908458', time=2024-09-12T03:12:23.022459+0000, chain.objs.size()=1 2024-09-12T01:29:16.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.394+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hihLIzDc3ug-XAz3sZnQiaymmwZdX9p_0 2024-09-12T01:29:16.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.394+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2752141012668221580', time=2024-09-12T03:12:23.793112+0000, chain.objs.size()=1 2024-09-12T01:29:16.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.394+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.nocIZd7E5YXqmPTM3uyCYy1F81fcT5T_0 2024-09-12T01:29:16.395 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.395+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5968639507940298696', time=2024-09-12T03:12:24.036067+0000, chain.objs.size()=1 2024-09-12T01:29:16.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.395+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.h7m6tOkp6CxPeA5TX4Wq0zO1g5-jQpe_0 2024-09-12T01:29:16.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.396+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8740055254158048321', time=2024-09-12T03:12:24.710034+0000, chain.objs.size()=1 2024-09-12T01:29:16.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.396+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.5n4FMBeEOzSIDpklgk_ecPgTwREJ6OS_0 2024-09-12T01:29:16.396 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.396+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2027228547783673538', time=2024-09-12T03:12:25.375764+0000, chain.objs.size()=1 2024-09-12T01:29:16.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.396+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.A_jJ7k-nV3nIiQOZWuMvN1rGRRjQ0lv_0 2024-09-12T01:29:16.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.397+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9730780265620170916', time=2024-09-12T03:12:25.376498+0000, chain.objs.size()=1 2024-09-12T01:29:16.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.397+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.wM1F8GpxqrAECnj1csvvg_wkHzTbnH-_0 2024-09-12T01:29:16.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.397+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13994067254561476461', time=2024-09-12T03:12:26.272900+0000, chain.objs.size()=1 2024-09-12T01:29:16.397 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.397+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.7xgieMVHkwqn2GEZ9QwhYoo4e6h0uI1_0 2024-09-12T01:29:16.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.399+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14094782143867736337', time=2024-09-12T03:12:27.037488+0000, chain.objs.size()=1 2024-09-12T01:29:16.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.399+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.fiscphvalwHs1QaIhCkN3BTluOvBlQu_0 2024-09-12T01:29:16.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.399+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17412343603909514186', time=2024-09-12T03:12:27.269694+0000, chain.objs.size()=1 2024-09-12T01:29:16.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.399+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.rDxi88mzHMSr1fat6najHiOL6r4CyiR_0 2024-09-12T01:29:16.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.399+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15611518115360343099', time=2024-09-12T03:12:27.270231+0000, chain.objs.size()=1 2024-09-12T01:29:16.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.399+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mCLb8Na0JfpLzzzJjsSrpKm61UybgrU_0 2024-09-12T01:29:16.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.399+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17455929560871335042', time=2024-09-12T03:12:27.778956+0000, chain.objs.size()=1 2024-09-12T01:29:16.399 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.399+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.fmGDG4ugg5d6lOaE6mQQOdJqdgp2ygW_0 2024-09-12T01:29:16.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.399+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13765172405453697342', time=2024-09-12T03:12:27.779502+0000, chain.objs.size()=1 2024-09-12T01:29:16.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.399+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.QopNWv337A3wZ69wgSOhmYPE_osrcBN_0 2024-09-12T01:29:16.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.399+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9301846030625749567', time=2024-09-12T03:12:28.139971+0000, chain.objs.size()=1 2024-09-12T01:29:16.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.399+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.tdA8ssAfJbJ1sR9olFU5to1KlHsByYi_0 2024-09-12T01:29:16.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.399+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7926872684420635750', time=2024-09-12T03:12:28.676036+0000, chain.objs.size()=1 2024-09-12T01:29:16.401 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.399+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.SyDx8wBsubw9tlsIqRM4KPw5A4VDp9Z_0 2024-09-12T01:29:16.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.402+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5887606292781958518', time=2024-09-12T03:12:28.750744+0000, chain.objs.size()=1 2024-09-12T01:29:16.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.402+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-9Lo6g68ACceOMTpYtITsm1oqEbOmg7_0 2024-09-12T01:29:16.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.402+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1854489514812511055', time=2024-09-12T03:12:29.062510+0000, chain.objs.size()=1 2024-09-12T01:29:16.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.402+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.dZaQu5m4jZQsCClSIU__oMoR4KyP2nR_0 2024-09-12T01:29:16.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.402+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12016841289866052119', time=2024-09-12T03:12:29.090895+0000, chain.objs.size()=1 2024-09-12T01:29:16.402 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.402+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.sGfFkg7sPZZR8MRDdxwasF-CdUEeU2o_0 2024-09-12T01:29:16.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.403+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9013157538268761489', time=2024-09-12T03:12:29.702250+0000, chain.objs.size()=1 2024-09-12T01:29:16.403 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.403+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.9E7MuzdIxSZNh3XKROuv5UNB18KsPpl_0 2024-09-12T01:29:16.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.405+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16407392046195545386', time=2024-09-12T03:12:29.703578+0000, chain.objs.size()=1 2024-09-12T01:29:16.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.405+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.wDcsUX-1j3XcyYEAKP7X_uiNUcHUSsb_0 2024-09-12T01:29:16.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.405+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9443736346290211505', time=2024-09-12T03:12:30.589610+0000, chain.objs.size()=1 2024-09-12T01:29:16.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.405+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.2xEDt3f01xsnfn3S7t0emju11RrqQbW_0 2024-09-12T01:29:16.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.405+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15956359967113395967', time=2024-09-12T03:12:31.151223+0000, chain.objs.size()=1 2024-09-12T01:29:16.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.405+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.L-26uAFNEa1rclAoqrkk0ZNDhLYl1pd_0 2024-09-12T01:29:16.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.405+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4907919285471413713', time=2024-09-12T03:12:31.246082+0000, chain.objs.size()=1 2024-09-12T01:29:16.405 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.405+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.pNGUgGU9FS7H9U7ZXEua6PhB1_O-Thc_0 2024-09-12T01:29:16.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.405+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15117923685407362498', time=2024-09-12T03:12:31.349656+0000, chain.objs.size()=1 2024-09-12T01:29:16.406 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.405+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.lmAvPkvlVJ3Z_3HgWendUxyAUj5ZSI9_0 2024-09-12T01:29:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.407+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2226963463203573076', time=2024-09-12T03:12:31.438103+0000, chain.objs.size()=1 2024-09-12T01:29:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.407+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hi7fcbWjCygYxI-QaZTIPUhbrMO2QtZ_0 2024-09-12T01:29:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.407+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16543562397765551707', time=2024-09-12T03:12:32.691387+0000, chain.objs.size()=1 2024-09-12T01:29:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.407+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.yOy9CogwZG_ATgNeSLwDlo4AkkZf8xR_0 2024-09-12T01:29:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.407+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4552370829689189562', time=2024-09-12T03:12:32.773228+0000, chain.objs.size()=1 2024-09-12T01:29:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.407+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.IsIvsi8JdzMWzSrbmPBBi2Cx_sKQtvf_0 2024-09-12T01:29:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.407+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16576705130891309884', time=2024-09-12T03:12:33.554374+0000, chain.objs.size()=1 2024-09-12T01:29:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.407+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.xQAsgKABvs_9Jyvku36xwNrjBkIOOtt_0 2024-09-12T01:29:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.407+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3863427303016752495', time=2024-09-12T03:12:33.900962+0000, chain.objs.size()=1 2024-09-12T01:29:16.408 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.407+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.o0Y2SUT7uAIwd0NVZxTncdRUJNOImSv_0 2024-09-12T01:29:16.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.407+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13537559420841402484', time=2024-09-12T03:12:33.960479+0000, chain.objs.size()=1 2024-09-12T01:29:16.409 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.407+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.zAVEjxhsTxB9STwZf0l_M5xCUrHEav-_0 2024-09-12T01:29:16.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.410+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9048066496027209876', time=2024-09-12T03:12:34.471208+0000, chain.objs.size()=1 2024-09-12T01:29:16.410 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.410+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.9B2ferZppOJUo_zngWooH3DAxRC3Il5_0 2024-09-12T01:29:16.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.410+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13990215403258720445', time=2024-09-12T03:12:34.509405+0000, chain.objs.size()=1 2024-09-12T01:29:16.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.410+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.sENexskiljV47UZctT7vCTmS7Q_KTxK_0 2024-09-12T01:29:16.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.410+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16421575509293320312', time=2024-09-12T03:12:40.016474+0000, chain.objs.size()=1 2024-09-12T01:29:16.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.410+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.334__shadow_.C7GH-lfTFfYHYlC-iAUCTKBbewjuxCZ_0 2024-09-12T01:29:16.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.410+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17157674963320873471', time=2024-09-12T03:12:42.622256+0000, chain.objs.size()=1 2024-09-12T01:29:16.411 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.410+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.339__shadow_.iinK9Wy2tdmk-km-K5Dm7IPMC48MzSW_0 2024-09-12T01:29:16.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.411+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15050033258922190322', time=2024-09-12T03:12:44.450137+0000, chain.objs.size()=1 2024-09-12T01:29:16.412 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.411+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.342__shadow_.PkH5YGeM5ElcKOgpXXbuq2RTVVtkIeh_0 2024-09-12T01:29:16.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.413+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16892624886779203793', time=2024-09-12T03:13:04.889304+0000, chain.objs.size()=1 2024-09-12T01:29:16.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.414+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.381__shadow_.hCYgXaqXgQ85BSdvIak-sywUyZhn__S_0 2024-09-12T01:29:16.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.414+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8007867373420865914', time=2024-09-12T03:13:32.813364+0000, chain.objs.size()=1 2024-09-12T01:29:16.414 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.414+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.430__shadow_.XaNnax3781-Uov7tpFHvWMYKWmhHd-Y_0 2024-09-12T01:29:16.416 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.416+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/49186 2024-09-12T01:29:16.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T01:29:16.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10316141530316328105', time=2024-09-12T03:14:05.110671+0000, chain.objs.size()=1 2024-09-12T01:29:16.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.483__shadow_.tXHQoOpUScVQzabS9XBQJrwamc2-jw1_0 2024-09-12T01:29:16.418 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15921888122334703883', time=2024-09-12T03:15:27.780009+0000, chain.objs.size()=6 2024-09-12T01:29:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~MUc_XaEUogoBNe7o4fX4lVz8BgesM05.1 2024-09-12T01:29:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.Jht4t71N3HjBUsafTjZevDL4xQxGm_B0.2 2024-09-12T01:29:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~MUc_XaEUogoBNe7o4fX4lVz8BgesM05.3 2024-09-12T01:29:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~MUc_XaEUogoBNe7o4fX4lVz8BgesM05.4 2024-09-12T01:29:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~MUc_XaEUogoBNe7o4fX4lVz8BgesM05.5 2024-09-12T01:29:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.522__multipart_mymultipart.2~MUc_XaEUogoBNe7o4fX4lVz8BgesM05.6 2024-09-12T01:29:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='2~LISXn2Jr9WlsfORdvDCxvdxA3o7ShU7', time=2024-09-12T03:17:35.035896+0000, chain.objs.size()=1 2024-09-12T01:29:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.561__multipart_mymultipart.2~LISXn2Jr9WlsfORdvDCxvdxA3o7ShU7.1 2024-09-12T01:29:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6131792575633764729', time=2024-09-12T03:17:48.539051+0000, chain.objs.size()=1 2024-09-12T01:29:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:USMOrl5VBKnHPKIoeyS.xZ-rhehJPGI_.SebJ8wUuFzd7DEfBvsrvySZR2kkWeph_0 2024-09-12T01:29:16.419 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1922039736423385812', time=2024-09-12T03:17:51.597514+0000, chain.objs.size()=1 2024-09-12T01:29:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.569__shadow:dUfM2l412qpfFa-ffsdxhux36cM2NTP_.-43P99Rga85EFwMq_cQPQzZPuL5Jku6_0 2024-09-12T01:29:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10594140416110247201', time=2024-09-12T03:17:57.528183+0000, chain.objs.size()=1 2024-09-12T01:29:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.570__shadow:WoXHk.GKfgtLgM3UCX8q9dZaajXgilf_.R9MZIU-krAaI_d_KiZbh50mciZPREpJ_0 2024-09-12T01:29:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18412810628769716863', time=2024-09-12T03:18:50.836098+0000, chain.objs.size()=1 2024-09-12T01:29:16.420 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.418+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.580__shadow:kkaVVB688oZx42XkZTWYr8--r8ju93._.3AyyCPJTj_96xrstLWEdhguHN3Mog3c_0 2024-09-12T01:29:16.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.424+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5295902722655033606', time=2024-09-12T03:24:21.471922+0000, chain.objs.size()=1 2024-09-12T01:29:16.424 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.424+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.715__shadow:zap5hPdqHj6Ui05ZRRKTvHf4eWPim-O_.0aNg32dNtyZgDExJq0Hg0cfCDoJ6eHp_0 2024-09-12T01:29:16.426 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.425+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:16.428 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.428+0000 7f4c33135800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:29:16.429 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.429+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:29:16.430 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:29:16.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45453' 2024-09-12T01:29:16.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17506435964745895275', time=2024-09-12T03:07:09.066572+0000, chain.objs.size()=1 2024-09-12T01:29:16.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.182__shadow_.XYesY_vVROAydAzX2L-Hfm2l2j-G7Nq_0 2024-09-12T01:29:16.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15117067762594261229', time=2024-09-12T03:09:09.920102+0000, chain.objs.size()=1 2024-09-12T01:29:16.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.253__shadow_.7KjalrFKQg4QckvXtItsgAsbmd2Ldz4_0 2024-09-12T01:29:16.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1846941196749793097', time=2024-09-12T03:09:11.190608+0000, chain.objs.size()=1 2024-09-12T01:29:16.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.255__shadow_.BKi5HlRuQER4MupXybL57cmJs08NXyU_0 2024-09-12T01:29:16.431 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5016688218459621200', time=2024-09-12T03:09:13.600192+0000, chain.objs.size()=1 2024-09-12T01:29:16.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.259__shadow_.cvrUt40O1nvkaFRUl5pJDvuiMQgfMXY_0 2024-09-12T01:29:16.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9753320198446188084', time=2024-09-12T03:09:54.276303+0000, chain.objs.size()=1 2024-09-12T01:29:16.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.En-kg0LLaGeCNlHs8BWpNk4WpN3PwN-_0 2024-09-12T01:29:16.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10536543506909558168', time=2024-09-12T03:09:54.277053+0000, chain.objs.size()=1 2024-09-12T01:29:16.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.z1oZOHcDQmAL2K4zVt3-gNsCNaysOvr_0 2024-09-12T01:29:16.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5731218598846003473', time=2024-09-12T03:09:54.320294+0000, chain.objs.size()=1 2024-09-12T01:29:16.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.fJDeMKW4tMHqwMihKppeCfw1298CgsO_0 2024-09-12T01:29:16.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14887886707511092183', time=2024-09-12T03:09:54.427274+0000, chain.objs.size()=1 2024-09-12T01:29:16.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.5g1P30jew1mkpa6NTOWQaH7__4mXAuL_0 2024-09-12T01:29:16.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8121507322771865481', time=2024-09-12T03:09:54.428877+0000, chain.objs.size()=1 2024-09-12T01:29:16.432 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.fGN7M2XD-FauGbWd-8PYM5N-QI2x2Gq_0 2024-09-12T01:29:16.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13845142010882626169', time=2024-09-12T03:09:54.523248+0000, chain.objs.size()=1 2024-09-12T01:29:16.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.g4CDmVklYE7OEH07pPEtGW55cPvXIVe_0 2024-09-12T01:29:16.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13454456202078775269', time=2024-09-12T03:09:54.693223+0000, chain.objs.size()=1 2024-09-12T01:29:16.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1xlQQSKFKECZQMv2wt313deh00IMqty_0 2024-09-12T01:29:16.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14543631696764362878', time=2024-09-12T03:09:54.722855+0000, chain.objs.size()=1 2024-09-12T01:29:16.433 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.430+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.bE8BU1R8wfQedeIAE_6QyEOyqwNgMJv_0 2024-09-12T01:29:16.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.433+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16187195286893121262', time=2024-09-12T03:09:54.881845+0000, chain.objs.size()=1 2024-09-12T01:29:16.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.433+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.p0BsnVheiA7tcuqzUlqg0EV-EUxVqWX_0 2024-09-12T01:29:16.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.433+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3418169603543020454', time=2024-09-12T03:09:54.882530+0000, chain.objs.size()=1 2024-09-12T01:29:16.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.433+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0b2jQrSI0yJp7CIo9wRuuQAufzwhG2N_0 2024-09-12T01:29:16.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.434+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14440275727648317875', time=2024-09-12T03:09:55.186803+0000, chain.objs.size()=1 2024-09-12T01:29:16.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.434+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RyKTRbMBzzHJzsvZbJUbpWnBMFnValG_0 2024-09-12T01:29:16.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.434+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2000971317443283522', time=2024-09-12T03:09:55.327873+0000, chain.objs.size()=1 2024-09-12T01:29:16.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.434+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.fFCBvNcWwfVgYr-kBxio4Qzz7aTdtUM_0 2024-09-12T01:29:16.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.434+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10640868743912613780', time=2024-09-12T03:09:56.735331+0000, chain.objs.size()=1 2024-09-12T01:29:16.434 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.434+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.6sir5l9kxSkqpcoqpz2g8edywmb9plr_0 2024-09-12T01:29:16.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.434+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3544778890103099666', time=2024-09-12T03:09:56.945349+0000, chain.objs.size()=1 2024-09-12T01:29:16.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.434+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.HBfYOiJl4bYSQ_hyZP94StXQmSPekMt_0 2024-09-12T01:29:16.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.435+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17679897640209527682', time=2024-09-12T03:09:57.843877+0000, chain.objs.size()=1 2024-09-12T01:29:16.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.435+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.0ElUJqeVqtK3QhPjZ4A_xpBNo4LV311_0 2024-09-12T01:29:16.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.435+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5715218225809846631', time=2024-09-12T03:09:58.100395+0000, chain.objs.size()=1 2024-09-12T01:29:16.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.435+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ermB5qWbBoCFuPuyMSyx98vG9WAwokd_0 2024-09-12T01:29:16.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.435+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9427149181640241519', time=2024-09-12T03:09:58.123335+0000, chain.objs.size()=1 2024-09-12T01:29:16.435 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.435+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.U47kQgV4-o6BbmMVOokgvktCpzi6Fby_0 2024-09-12T01:29:16.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.436+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2356003469019046541', time=2024-09-12T03:09:58.655680+0000, chain.objs.size()=1 2024-09-12T01:29:16.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.436+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.bI9pEUxg5Cmvubh7rpLmixSBIAzdbS2_0 2024-09-12T01:29:16.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.436+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16202647905578682788', time=2024-09-12T03:09:59.834248+0000, chain.objs.size()=1 2024-09-12T01:29:16.436 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.436+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.eGMJ4bO0bf8Z0AYGMZ3gzyBVo23Tzc-_0 2024-09-12T01:29:16.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.437+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1992794007235333711', time=2024-09-12T03:09:59.864264+0000, chain.objs.size()=1 2024-09-12T01:29:16.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.437+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.imrBcFe-szuCCi8Ac83wqmxTjBjgbok_0 2024-09-12T01:29:16.437 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.437+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.641685631700845241', time=2024-09-12T03:10:00.264409+0000, chain.objs.size()=1 2024-09-12T01:29:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.437+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.RFILi2W2gNLBT5ugGSq5Bfe9hBf7ItF_0 2024-09-12T01:29:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.437+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3181767084261097762', time=2024-09-12T03:10:00.265019+0000, chain.objs.size()=1 2024-09-12T01:29:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.437+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.k15NPbzhpNn-bpufQk-oGQDU5TMVt8M_0 2024-09-12T01:29:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.437+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3034707318390874434', time=2024-09-12T03:10:01.262545+0000, chain.objs.size()=1 2024-09-12T01:29:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.437+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.PcE-ASdAyifGOXgfC-TJMbMteSW0Y9L_0 2024-09-12T01:29:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.437+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15520795092539901656', time=2024-09-12T03:10:01.480905+0000, chain.objs.size()=1 2024-09-12T01:29:16.438 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.437+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.3dR4-bd7enyrI5a7XefqtU2s5jZ80xD_0 2024-09-12T01:29:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.439+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8602302145361569745', time=2024-09-12T03:10:01.935400+0000, chain.objs.size()=1 2024-09-12T01:29:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.439+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.UulEFGoFZdv8wT-xLzfnyC5EsgOCjAQ_0 2024-09-12T01:29:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.439+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2316731892007582453', time=2024-09-12T03:10:03.476405+0000, chain.objs.size()=1 2024-09-12T01:29:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.439+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.5O0C_8HhWainxbWXq21l6xQ2prWW0X3_0 2024-09-12T01:29:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.439+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4273869624211776077', time=2024-09-12T03:10:04.538243+0000, chain.objs.size()=1 2024-09-12T01:29:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.439+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.QyUybx5hsQlneq1Z4Gwqg72Q78hTVXK_0 2024-09-12T01:29:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.439+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7294876884004396757', time=2024-09-12T03:10:05.166330+0000, chain.objs.size()=1 2024-09-12T01:29:16.439 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.439+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.G7UcNmJBPCHIoYepaGoRTBuTnczu0D7_0 2024-09-12T01:29:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1919871059468284331', time=2024-09-12T03:10:05.166967+0000, chain.objs.size()=1 2024-09-12T01:29:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.Qxa7YNIYLoSDjgcAp8G6wGzBoZy35rT_0 2024-09-12T01:29:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10339250363929884474', time=2024-09-12T03:10:05.245974+0000, chain.objs.size()=1 2024-09-12T01:29:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.ScTR4pbjps7TJA-r7OiPJyH9ECVp6wZ_0 2024-09-12T01:29:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16892492654438793512', time=2024-09-12T03:10:05.246479+0000, chain.objs.size()=1 2024-09-12T01:29:16.442 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.1xFtnUbVN9M5z5kF0CxXataAg5irmPf_0 2024-09-12T01:29:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2755191842006957272', time=2024-09-12T03:10:06.634409+0000, chain.objs.size()=1 2024-09-12T01:29:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.tPFTguHPDf4aXmq8Uz0Lsi_PaxL3Xqr_0 2024-09-12T01:29:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.797850896129863552', time=2024-09-12T03:10:06.698332+0000, chain.objs.size()=1 2024-09-12T01:29:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.262__shadow_.alhZiYGDnwkhqCsWl2nisZ63Sp7OsCo_0 2024-09-12T01:29:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18077131777047571700', time=2024-09-12T03:10:14.501271+0000, chain.objs.size()=1 2024-09-12T01:29:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.275__shadow_.snVuODZwgA0PMRrNkJkEXVn9j7GBkR9_0 2024-09-12T01:29:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12764430633680521945', time=2024-09-12T03:10:18.480420+0000, chain.objs.size()=1 2024-09-12T01:29:16.443 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.281__shadow_.oUuzuKgit_TRtt60C-Q6E_brH7LyJFT_0 2024-09-12T01:29:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3876746803059713314', time=2024-09-12T03:10:18.488007+0000, chain.objs.size()=1 2024-09-12T01:29:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.281__shadow_.XOvgcSRUzcWGXmtH5ZU8vXFh3iJfT60_0 2024-09-12T01:29:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4927147605093667875', time=2024-09-12T03:10:19.758787+0000, chain.objs.size()=1 2024-09-12T01:29:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.283__shadow_.WJWgcj6sTnrJUkHwulQCvpevlXCPjRO_0 2024-09-12T01:29:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16945685336565173163', time=2024-09-12T03:10:25.201972+0000, chain.objs.size()=1 2024-09-12T01:29:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.291__shadow_.i0mJt0NL3Bv0IFMhBvavL3gSDrdJVa4_0 2024-09-12T01:29:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16733016947193759080', time=2024-09-12T03:10:27.194815+0000, chain.objs.size()=1 2024-09-12T01:29:16.444 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.442+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.292__shadow_.Y-NWJfoZpDMzydMhcLmTbQRnH6OY7ZJ_0 2024-09-12T01:29:16.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3500554146246497630', time=2024-09-12T03:10:29.064578+0000, chain.objs.size()=1 2024-09-12T01:29:16.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.293__shadow_.T3GGMPzU_EnpohVg8YKPJ3nMJn1v3Ob_0 2024-09-12T01:29:16.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7216118397963529012', time=2024-09-12T03:10:33.875385+0000, chain.objs.size()=1 2024-09-12T01:29:16.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.300__shadow_.fSrTfABwNjQbRBdciPXThAgZXZCcM52_0 2024-09-12T01:29:16.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11490854089780563137', time=2024-09-12T03:10:35.194473+0000, chain.objs.size()=1 2024-09-12T01:29:16.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.302__shadow_.5Qc_xC1m9HgPA3M6jGikBnfeJPHO6_B_0 2024-09-12T01:29:16.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4138887667180020385', time=2024-09-12T03:10:35.837767+0000, chain.objs.size()=1 2024-09-12T01:29:16.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.303__shadow_.Q_MlgB6dSd6-ycqCtwvX72XvPSzdTuu_0 2024-09-12T01:29:16.446 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7861615349043580347', time=2024-09-12T03:10:46.984459+0000, chain.objs.size()=1 2024-09-12T01:29:16.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.319__shadow:c6y5lSHHehald6b4iZyUsq6vWIzBghC_.2ojcR3jIrgigCUqaPYeTzOQnPXSQvaK_0 2024-09-12T01:29:16.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12383982711161919224', time=2024-09-12T03:11:30.332712+0000, chain.objs.size()=1 2024-09-12T01:29:16.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ddbsWBqzfZGINrUPLTlZG_HfsbCISVP_0 2024-09-12T01:29:16.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3629262043264398292', time=2024-09-12T03:11:31.097632+0000, chain.objs.size()=1 2024-09-12T01:29:16.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.T7X23Hb_3K5OxyhvPW7fgrbn1Jw8cN-_0 2024-09-12T01:29:16.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11198998450870319882', time=2024-09-12T03:11:31.717635+0000, chain.objs.size()=1 2024-09-12T01:29:16.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.K3U1BTzKKLG_2G21q-sBn3CsYvBj8-D_0 2024-09-12T01:29:16.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8335318201711846865', time=2024-09-12T03:11:31.835844+0000, chain.objs.size()=1 2024-09-12T01:29:16.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.2iRJbJUFkKaEGZ2ZWSgKx9-P_aKKxvP_0 2024-09-12T01:29:16.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15594823612195230814', time=2024-09-12T03:11:31.893632+0000, chain.objs.size()=1 2024-09-12T01:29:16.447 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.446+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qOPbiqr9COJqF-lVn5Im9-YeVueTEth_0 2024-09-12T01:29:16.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.447+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6583486241623021635', time=2024-09-12T03:11:33.261809+0000, chain.objs.size()=1 2024-09-12T01:29:16.448 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.447+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.kaDWBXaEjWsnyPXJHZqm_6Si1koM_VV_0 2024-09-12T01:29:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.449+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13095526886940697934', time=2024-09-12T03:11:33.790982+0000, chain.objs.size()=1 2024-09-12T01:29:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.449+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.sD0Croe9XGjvdgnLpSpHr1lG-3SW6jT_0 2024-09-12T01:29:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.449+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2937207314572973538', time=2024-09-12T03:11:33.791499+0000, chain.objs.size()=1 2024-09-12T01:29:16.449 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.449+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.FS_YaaknLUepopUb_gNzw8G6UYN4iqA_0 2024-09-12T01:29:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4880136956144230845', time=2024-09-12T03:11:33.974679+0000, chain.objs.size()=1 2024-09-12T01:29:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.lOLbB9VTgGzASORlw40h299tsyxpXrr_0 2024-09-12T01:29:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12052466305880581532', time=2024-09-12T03:11:34.467087+0000, chain.objs.size()=1 2024-09-12T01:29:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.5HjOzOUyC_ak-R3q_SDjjUG7jCtSgEK_0 2024-09-12T01:29:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10315375884127270050', time=2024-09-12T03:11:35.015925+0000, chain.objs.size()=1 2024-09-12T01:29:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.r_XvHXrZklggPWrGgr63GreRMP7_Dvo_0 2024-09-12T01:29:16.451 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15192828200562527116', time=2024-09-12T03:11:35.319755+0000, chain.objs.size()=1 2024-09-12T01:29:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.qXkMUq9qsdng7IuodiFJC2RIu6x_kQ2_0 2024-09-12T01:29:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11874590804015614833', time=2024-09-12T03:11:35.441860+0000, chain.objs.size()=1 2024-09-12T01:29:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.FTcRtCvtjfC6iteIvzwXpI5OE6IoCZU_0 2024-09-12T01:29:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1388376304558179574', time=2024-09-12T03:11:36.125090+0000, chain.objs.size()=1 2024-09-12T01:29:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.OdJfJURpRprPzCNv7_ERpmENiQDthih_0 2024-09-12T01:29:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17418696895952582651', time=2024-09-12T03:11:37.257110+0000, chain.objs.size()=1 2024-09-12T01:29:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.v-JQkXwbz2x9Hg9m2QUnRlescezIxfu_0 2024-09-12T01:29:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6751267971663156886', time=2024-09-12T03:11:37.650116+0000, chain.objs.size()=1 2024-09-12T01:29:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.MDbmEZy53mBU-AYY6HksQXJGGvtaRNi_0 2024-09-12T01:29:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.18043672049232445740', time=2024-09-12T03:11:37.809330+0000, chain.objs.size()=1 2024-09-12T01:29:16.452 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.450+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.BjHu4m1fPYcVlU1jkecjYoc10K2xj0n_0 2024-09-12T01:29:16.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.452+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2242049387596766234', time=2024-09-12T03:11:38.066247+0000, chain.objs.size()=1 2024-09-12T01:29:16.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.452+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.W_VOL00p_1hR-2YCxM7d5c-jxo7_gC2_0 2024-09-12T01:29:16.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.452+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7271094808998791276', time=2024-09-12T03:11:38.216652+0000, chain.objs.size()=1 2024-09-12T01:29:16.453 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.452+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.40buVWyOfonn2GzWgabfQXPSupMNRBD_0 2024-09-12T01:29:16.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.453+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13228206729929204537', time=2024-09-12T03:11:38.483991+0000, chain.objs.size()=1 2024-09-12T01:29:16.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.453+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.jOcWxRXz_uio_1rCmJwbUDPeCq8_mbi_0 2024-09-12T01:29:16.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.453+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3236001289074746466', time=2024-09-12T03:11:38.589760+0000, chain.objs.size()=1 2024-09-12T01:29:16.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.453+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.SGg9y4ZBUua5YL4cHpiLcfLLxax3G-4_0 2024-09-12T01:29:16.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.453+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.591996220751174293', time=2024-09-12T03:11:38.797221+0000, chain.objs.size()=1 2024-09-12T01:29:16.454 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.453+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.Vaxc_tkaZslD0I3yraHvee2reOLIRYp_0 2024-09-12T01:29:16.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.454+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11898214006937707374', time=2024-09-12T03:11:39.192554+0000, chain.objs.size()=1 2024-09-12T01:29:16.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.454+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.AFQlb07rmrXNjfAuL5dbRVBHAu8WMqN_0 2024-09-12T01:29:16.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.454+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.618233348339823776', time=2024-09-12T03:11:39.723865+0000, chain.objs.size()=1 2024-09-12T01:29:16.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.454+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.6fBhbE0g67c-x8sp6x2CcLE3pvZ0PZv_0 2024-09-12T01:29:16.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.454+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14651385675940905828', time=2024-09-12T03:11:40.661190+0000, chain.objs.size()=1 2024-09-12T01:29:16.455 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.454+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.ZfBhVJG86UC2BXOJtNjpl3l5Q6gGEfM_0 2024-09-12T01:29:16.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.456+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12225138409852609011', time=2024-09-12T03:11:40.666582+0000, chain.objs.size()=1 2024-09-12T01:29:16.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.456+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.PbVejVaEztSEdYlzXIwPblrcO_8iLmu_0 2024-09-12T01:29:16.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.456+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17698343382749152337', time=2024-09-12T03:11:40.695960+0000, chain.objs.size()=1 2024-09-12T01:29:16.456 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.456+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.6dkiCOzyizSvLTPoXnKBBlb-FJlMbM5_0 2024-09-12T01:29:16.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.456+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12654104492278748350', time=2024-09-12T03:11:40.808974+0000, chain.objs.size()=1 2024-09-12T01:29:16.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.456+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.1xBo8KZiiDFGt0D2VuDrWciGFqaVzrl_0 2024-09-12T01:29:16.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.457+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2045282839645690835', time=2024-09-12T03:11:40.901707+0000, chain.objs.size()=1 2024-09-12T01:29:16.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.457+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.GPOQ5VLtKPkauKm-nxq0OJiYER4ejPi_0 2024-09-12T01:29:16.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.457+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.4528146835597830770', time=2024-09-12T03:11:41.189898+0000, chain.objs.size()=1 2024-09-12T01:29:16.457 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.457+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.vKZgNo2nQ0Z3-fDywQag7NsIrWxwA4Z_0 2024-09-12T01:29:16.458 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.457+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15795342369575526676', time=2024-09-12T03:11:41.455945+0000, chain.objs.size()=1 2024-09-12T01:29:16.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.457+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.323__shadow_.yMk1Vjli4bHFUv5PZB_W5K6gXCT2vW-_0 2024-09-12T01:29:16.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.457+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2014356412887598032', time=2024-09-12T03:12:22.098635+0000, chain.objs.size()=1 2024-09-12T01:29:16.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.457+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.YYdtHqgvuBD4VvPOd_PX8R8SViEfksm_0 2024-09-12T01:29:16.460 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.459+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15390103970263536040', time=2024-09-12T03:12:22.213608+0000, chain.objs.size()=1 2024-09-12T01:29:16.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.459+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ewXzKuywTu_gIcuXGicbMmO8qIJ9QYb_0 2024-09-12T01:29:16.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.459+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13420629539451213399', time=2024-09-12T03:12:22.214402+0000, chain.objs.size()=1 2024-09-12T01:29:16.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.459+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.DFXGfQWof72MGSnpAhRzd51ASzuQPdt_0 2024-09-12T01:29:16.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.459+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13179148688407750107', time=2024-09-12T03:12:22.643915+0000, chain.objs.size()=1 2024-09-12T01:29:16.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.459+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-po_RNe8eYrQXBgcRp5Fx9ZH9pmDlxe_0 2024-09-12T01:29:16.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.459+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.16116633876654372740', time=2024-09-12T03:12:22.812657+0000, chain.objs.size()=1 2024-09-12T01:29:16.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.459+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gDTTkuo0uN03BMavknlqY3LhquQq2cz_0 2024-09-12T01:29:16.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.460+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12904157830121037960', time=2024-09-12T03:12:23.629961+0000, chain.objs.size()=1 2024-09-12T01:29:16.461 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.460+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.dgTZU4G1bcMoxtq5tHaehotrea6rrmS_0 2024-09-12T01:29:16.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11091223557186865165', time=2024-09-12T03:12:23.878181+0000, chain.objs.size()=1 2024-09-12T01:29:16.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.-0z0Fr6LiJnoOEZuH2HK4zhc28cqmlZ_0 2024-09-12T01:29:16.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1681708223327434438', time=2024-09-12T03:12:23.976487+0000, chain.objs.size()=1 2024-09-12T01:29:16.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.L9XvJFqy4NT_lMaCM30uQXR16oUrhr7_0 2024-09-12T01:29:16.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9845009493390508201', time=2024-09-12T03:12:24.235619+0000, chain.objs.size()=1 2024-09-12T01:29:16.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.uH6C2Vr0Wjhv11L7Us2rFy3VGplknVv_0 2024-09-12T01:29:16.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14671741654493598873', time=2024-09-12T03:12:25.418120+0000, chain.objs.size()=1 2024-09-12T01:29:16.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.vSnZp0ab4oayRaKJCYAbNoUQ0OKG_od_0 2024-09-12T01:29:16.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.609897367913386801', time=2024-09-12T03:12:25.418844+0000, chain.objs.size()=1 2024-09-12T01:29:16.462 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.IFsI8ad8V_ZaKwF3889TOrxTcTGgR8f_0 2024-09-12T01:29:16.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.461+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8928710164612527102', time=2024-09-12T03:12:25.610509+0000, chain.objs.size()=1 2024-09-12T01:29:16.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.461+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.KDRpuCGGkbtBE9SREv9utJbYeGrRH2F_0 2024-09-12T01:29:16.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.462+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15525415001674724446', time=2024-09-12T03:12:26.404434+0000, chain.objs.size()=1 2024-09-12T01:29:16.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.462+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.7eaAexG3xUHJuVLV0VGyxgCfTZBrmtZ_0 2024-09-12T01:29:16.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.463+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5247183451477573991', time=2024-09-12T03:12:26.499917+0000, chain.objs.size()=1 2024-09-12T01:29:16.463 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.463+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.g0wzRJAO5tHS4vXSbTxqQhk5qeHSwsx_0 2024-09-12T01:29:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.464+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3115339449184591902', time=2024-09-12T03:12:26.537181+0000, chain.objs.size()=1 2024-09-12T01:29:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.464+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mmRsXGUnRrmbBaEzdOybG1YMNfYiM7__0 2024-09-12T01:29:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.464+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13578900763084603326', time=2024-09-12T03:12:27.280081+0000, chain.objs.size()=1 2024-09-12T01:29:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.464+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.04gYCOMc7JQXq9nposVCoDc-3Oqsov7_0 2024-09-12T01:29:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.464+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9039313241230235024', time=2024-09-12T03:12:27.370057+0000, chain.objs.size()=1 2024-09-12T01:29:16.464 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.464+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.h9BwHdj_nO0qFyk9DE17dYiiHS2_jxt_0 2024-09-12T01:29:16.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.466+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.1271942751325221008', time=2024-09-12T03:12:27.610882+0000, chain.objs.size()=1 2024-09-12T01:29:16.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.466+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.Qk3fqdo0okZ_2HFm0r5VAz0LILA6gbA_0 2024-09-12T01:29:16.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.466+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3413256506908835033', time=2024-09-12T03:12:27.820227+0000, chain.objs.size()=1 2024-09-12T01:29:16.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.466+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.dZIpjlJHKpungvzlYJ1Ja8dGsKGv11F_0 2024-09-12T01:29:16.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.466+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7863631600711511988', time=2024-09-12T03:12:28.213902+0000, chain.objs.size()=1 2024-09-12T01:29:16.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.466+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.DyMS1yyhFZSOMHahzYlkuer1DbSD0l3_0 2024-09-12T01:29:16.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.466+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.15452821246399632695', time=2024-09-12T03:12:28.886614+0000, chain.objs.size()=1 2024-09-12T01:29:16.467 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.466+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.JlKmYHm_TLLUDhR1hKFxCWcUHwtI6yO_0 2024-09-12T01:29:16.469 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.469+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 0/45453 2024-09-12T01:29:16.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-12T01:29:16.473 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.987110295749388650', time=2024-09-12T03:12:28.983264+0000, chain.objs.size()=1 2024-09-12T01:29:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.YreKIjWYBgSpjgVnLuS2NqR9rKjSVds_0 2024-09-12T01:29:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12153376344995523683', time=2024-09-12T03:12:29.087292+0000, chain.objs.size()=1 2024-09-12T01:29:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.ucAw2An05Lm75wSieTZYfYEcsBT0j_h_0 2024-09-12T01:29:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.12365152757168731080', time=2024-09-12T03:12:29.363066+0000, chain.objs.size()=1 2024-09-12T01:29:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_._at7OnxKV32bwYs2J8Tq9gjmJoDHAkf_0 2024-09-12T01:29:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.8476922624935968207', time=2024-09-12T03:12:30.419841+0000, chain.objs.size()=1 2024-09-12T01:29:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.gOp5FBwYH4-1Uq0hUlFI0hEb-5-cLFc_0 2024-09-12T01:29:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.11954589486600660473', time=2024-09-12T03:12:30.988838+0000, chain.objs.size()=1 2024-09-12T01:29:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.8Tay3krJqCI4ilqCBSQNzdZsTpZ625w_0 2024-09-12T01:29:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.3652362866701264971', time=2024-09-12T03:12:31.222552+0000, chain.objs.size()=1 2024-09-12T01:29:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.NRBWLmfBP3Efjy5SDpl92RaOxL4JZ_s_0 2024-09-12T01:29:16.474 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.10326861377980759426', time=2024-09-12T03:12:31.993546+0000, chain.objs.size()=1 2024-09-12T01:29:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.jWXRg0rGdh_Kihx2miXEiUm9hid29XZ_0 2024-09-12T01:29:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14236633276238916031', time=2024-09-12T03:12:32.362539+0000, chain.objs.size()=1 2024-09-12T01:29:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.mZIWQi4JMTlUwI3ASYNolO_Ms6RFbMH_0 2024-09-12T01:29:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2769671965112310524', time=2024-09-12T03:12:32.875366+0000, chain.objs.size()=1 2024-09-12T01:29:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.1NYijg239yrgtcvdySQXsZOCz37Ihef_0 2024-09-12T01:29:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.540865772572442725', time=2024-09-12T03:12:33.627970+0000, chain.objs.size()=1 2024-09-12T01:29:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.MG2EtXKPzf-E3omDBVQKgUU1S7Ob-nA_0 2024-09-12T01:29:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13727043019508237588', time=2024-09-12T03:12:33.930422+0000, chain.objs.size()=1 2024-09-12T01:29:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.hW9PYreMLpBuSRw4ZNdpkToWnfJdU5G_0 2024-09-12T01:29:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13111519698627759763', time=2024-09-12T03:12:34.070699+0000, chain.objs.size()=1 2024-09-12T01:29:16.475 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.473+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.UqN9DLRfrCbBql-c-pH1RwCcaJtGbDB_0 2024-09-12T01:29:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.476+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.2723653635319763411', time=2024-09-12T03:12:34.477978+0000, chain.objs.size()=1 2024-09-12T01:29:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.476+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.324__shadow_.O4oQGzHXLcPuBbhCcSe-naimSTpS1RV_0 2024-09-12T01:29:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.476+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7607249252613775984', time=2024-09-12T03:13:01.052735+0000, chain.objs.size()=1 2024-09-12T01:29:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.476+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.375__shadow_.Cm-kBCLNSUBK_RggQJIWGjLairgOXU6_0 2024-09-12T01:29:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.476+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6160532838340584078', time=2024-09-12T03:13:35.638240+0000, chain.objs.size()=1 2024-09-12T01:29:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.476+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.435__shadow_.MiksPtBAb1gYQJ0u0jIOysB0E7vo05T_0 2024-09-12T01:29:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.476+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14323103271049442463', time=2024-09-12T03:14:12.735982+0000, chain.objs.size()=1 2024-09-12T01:29:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.476+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.491__shadow_.mmv31G_BMxnt6QNT4oetltfT75_uQ1b_0 2024-09-12T01:29:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.476+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.5053886662958638230', time=2024-09-12T03:14:14.853070+0000, chain.objs.size()=1 2024-09-12T01:29:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.476+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.496__shadow_.U5tHPx2JEnXCz3tJhMUIGe8Dayc6ox1_0 2024-09-12T01:29:16.477 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.476+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.13415848514094904284', time=2024-09-12T03:14:40.625349+0000, chain.objs.size()=1 2024-09-12T01:29:16.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.476+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.518__multipart_mymultipart.2~4tnOtdlUSHaVhKgrujwCKvqP2iCvQwK.1 2024-09-12T01:29:16.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.477+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.6961820808945675802', time=2024-09-12T03:18:10.979735+0000, chain.objs.size()=1 2024-09-12T01:29:16.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.477+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.576__shadow:bQ4w3T1UF5Um4blWRa28X1v3MJMbHNm_.kmkQTJ1f4BJbYhhio93dUp-uVKNwRbn_0 2024-09-12T01:29:16.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.477+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.17341858301086819984', time=2024-09-12T03:18:17.278766+0000, chain.objs.size()=1 2024-09-12T01:29:16.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.477+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.577__shadow:r5y1G40Ld2FUYdjd0.MzJDDL8Nmrw3M_.dutSpVxkwxNTXIfF8JMdctiksXVHp8j_0 2024-09-12T01:29:16.478 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.478+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.14464662188738964735', time=2024-09-12T03:18:51.413860+0000, chain.objs.size()=1 2024-09-12T01:29:16.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.478+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.582__shadow:DlDEFckxkNnkT5iNHsETCIZ3qpsOODx_.EI5eFJlvf57-y79K-iauhn_qy-eF_SI_0 2024-09-12T01:29:16.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.478+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.7649688446481111263', time=2024-09-12T03:23:02.904585+0000, chain.objs.size()=1 2024-09-12T01:29:16.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.478+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.638__shadow_.Nk8OEHkT0HBWNCu2yz5MXqdx8w48zag_0 2024-09-12T01:29:16.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.478+0000 7f4c33135800 20 garbage collection: RGWGC::process iterating over entry tag='8f0c480c-ec81-4324-89bc-22952673ff0b.4656.9352081082785570079', time=2024-09-12T03:23:41.909321+0000, chain.objs.size()=1 2024-09-12T01:29:16.479 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.478+0000 7f4c33135800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:8f0c480c-ec81-4324-89bc-22952673ff0b.4656.664__shadow_.vgwlv0RoKOtSiMzils5dcQuVYFUKYdg_0 2024-09-12T01:29:16.482 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.482+0000 7f4c33135800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:29:16.485 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.485+0000 7f4ae57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:29:16.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.487+0000 7f4c33135800 20 remove_watcher() i=0 2024-09-12T01:29:16.487 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.487+0000 7f4c33135800 2 removed watcher, disabling cache 2024-09-12T01:29:16.488 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.488+0000 7f4c33135800 20 remove_watcher() i=1 2024-09-12T01:29:16.489 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.489+0000 7f4c33135800 20 remove_watcher() i=2 2024-09-12T01:29:16.490 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.490+0000 7f4c33135800 20 remove_watcher() i=3 2024-09-12T01:29:16.491 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.491+0000 7f4c33135800 20 remove_watcher() i=4 2024-09-12T01:29:16.492 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.492+0000 7f4c33135800 20 remove_watcher() i=5 2024-09-12T01:29:16.493 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.493+0000 7f4c33135800 20 remove_watcher() i=6 2024-09-12T01:29:16.494 INFO:teuthology.orchestra.run.smithi062.stderr:2024-09-12T01:29:16.494+0000 7f4c33135800 20 remove_watcher() i=7 2024-09-12T01:29:16.507 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T01:29:16.518 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T01:29:16.528 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:29:16.528 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:29:16.887 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:29:16.899 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T01:29:16.902 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":1992,"stamp":"2024-09-12T01:29:15.847223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":549122398,"num_objects":4220,"num_object_clones":0,"num_object_copies":12279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4220,"num_whiteouts":0,"num_read":176708,"num_read_kb":2463795,"num_write":139178,"num_write_kb":2319559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13144,"ondisk_log_size":13144,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2325828,"kb_used_data":958712,"kb_used_omap":12,"kb_used_meta":1366643,"kb_avail":752648892,"statfs":{"total":773094113280,"available":770712465408,"internally_reserved":0,"allocated":981721088,"data_stored":965414167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1399442992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-87911644,"num_objects":-572,"num_object_clones":0,"num_object_copies":-1711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-572,"num_whiteouts":0,"num_read":693,"num_read_kb":1037,"num_write":621,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005146"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.506005+0000","last_change":"2024-09-12T01:04:13.467817+0000","last_active":"2024-09-12T01:26:44.506005+0000","last_peered":"2024-09-12T01:26:44.506005+0000","last_clean":"2024-09-12T01:26:44.506005+0000","last_became_active":"2024-09-12T01:04:13.467533+0000","last_became_peered":"2024-09-12T01:04:13.467533+0000","last_unstale":"2024-09-12T01:26:44.506005+0000","last_undegraded":"2024-09-12T01:26:44.506005+0000","last_fullsized":"2024-09-12T01:26:44.506005+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:07.938395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.606697+0000","last_change":"2024-09-12T00:48:45.303400+0000","last_active":"2024-09-12T01:26:14.606697+0000","last_peered":"2024-09-12T01:26:14.606697+0000","last_clean":"2024-09-12T01:26:14.606697+0000","last_became_active":"2024-09-12T00:48:45.303088+0000","last_became_peered":"2024-09-12T00:48:45.303088+0000","last_unstale":"2024-09-12T01:26:14.606697+0000","last_undegraded":"2024-09-12T01:26:14.606697+0000","last_fullsized":"2024-09-12T01:26:14.606697+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:39.588987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.784398+0000","last_change":"2024-09-12T00:48:42.290755+0000","last_active":"2024-09-12T01:26:15.784398+0000","last_peered":"2024-09-12T01:26:15.784398+0000","last_clean":"2024-09-12T01:26:15.784398+0000","last_became_active":"2024-09-12T00:48:42.290471+0000","last_became_peered":"2024-09-12T00:48:42.290471+0000","last_unstale":"2024-09-12T01:26:15.784398+0000","last_undegraded":"2024-09-12T01:26:15.784398+0000","last_fullsized":"2024-09-12T01:26:15.784398+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:55.297347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'15","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:38.496977+0000","last_change":"2024-09-12T00:46:03.918513+0000","last_active":"2024-09-12T01:25:38.496977+0000","last_peered":"2024-09-12T01:25:38.496977+0000","last_clean":"2024-09-12T01:25:38.496977+0000","last_became_active":"2024-09-12T00:46:03.918235+0000","last_became_peered":"2024-09-12T00:46:03.918235+0000","last_unstale":"2024-09-12T01:25:38.496977+0000","last_undegraded":"2024-09-12T01:25:38.496977+0000","last_fullsized":"2024-09-12T01:25:38.496977+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:35.498415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":51,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.643708+0000","last_change":"2024-09-12T01:04:13.463924+0000","last_active":"2024-09-12T01:26:45.643708+0000","last_peered":"2024-09-12T01:26:45.643708+0000","last_clean":"2024-09-12T01:26:45.643708+0000","last_became_active":"2024-09-12T01:04:13.463645+0000","last_became_peered":"2024-09-12T01:04:13.463645+0000","last_unstale":"2024-09-12T01:26:45.643708+0000","last_undegraded":"2024-09-12T01:26:45.643708+0000","last_fullsized":"2024-09-12T01:26:45.643708+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:54.509681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505992+0000","last_change":"2024-09-12T00:48:45.307402+0000","last_active":"2024-09-12T01:26:14.505992+0000","last_peered":"2024-09-12T01:26:14.505992+0000","last_clean":"2024-09-12T01:26:14.505992+0000","last_became_active":"2024-09-12T00:48:45.307070+0000","last_became_peered":"2024-09-12T00:48:45.307070+0000","last_unstale":"2024-09-12T01:26:14.505992+0000","last_undegraded":"2024-09-12T01:26:14.505992+0000","last_fullsized":"2024-09-12T01:26:14.505992+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:35.964072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:12.500496+0000","last_change":"2024-09-12T00:48:42.297130+0000","last_active":"2024-09-12T01:26:12.500496+0000","last_peered":"2024-09-12T01:26:12.500496+0000","last_clean":"2024-09-12T01:26:12.500496+0000","last_became_active":"2024-09-12T00:48:42.296820+0000","last_became_peered":"2024-09-12T00:48:42.296820+0000","last_unstale":"2024-09-12T01:26:12.500496+0000","last_undegraded":"2024-09-12T01:26:12.500496+0000","last_fullsized":"2024-09-12T01:26:12.500496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:03.334198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'17","reported_seq":98,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:18.502535+0000","last_change":"2024-09-12T00:46:03.920083+0000","last_active":"2024-09-12T01:26:18.502535+0000","last_peered":"2024-09-12T01:26:18.502535+0000","last_clean":"2024-09-12T01:26:18.502535+0000","last_became_active":"2024-09-12T00:46:03.919803+0000","last_became_peered":"2024-09-12T00:46:03.919803+0000","last_unstale":"2024-09-12T01:26:18.502535+0000","last_undegraded":"2024-09-12T01:26:18.502535+0000","last_fullsized":"2024-09-12T01:26:18.502535+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:54.982016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":60,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.605056+0000","last_change":"2024-09-12T01:04:13.470732+0000","last_active":"2024-09-12T01:25:59.605056+0000","last_peered":"2024-09-12T01:25:59.605056+0000","last_clean":"2024-09-12T01:25:59.605056+0000","last_became_active":"2024-09-12T01:04:13.470465+0000","last_became_peered":"2024-09-12T01:04:13.470465+0000","last_unstale":"2024-09-12T01:25:59.605056+0000","last_undegraded":"2024-09-12T01:25:59.605056+0000","last_fullsized":"2024-09-12T01:25:59.605056+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:03.442325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'7","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501342+0000","last_change":"2024-09-12T00:48:45.318707+0000","last_active":"2024-09-12T01:26:17.501342+0000","last_peered":"2024-09-12T01:26:17.501342+0000","last_clean":"2024-09-12T01:26:17.501342+0000","last_became_active":"2024-09-12T00:48:45.318423+0000","last_became_peered":"2024-09-12T00:48:45.318423+0000","last_unstale":"2024-09-12T01:26:17.501342+0000","last_undegraded":"2024-09-12T01:26:17.501342+0000","last_fullsized":"2024-09-12T01:26:17.501342+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:02.110177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:55.790545+0000","last_change":"2024-09-12T00:48:42.292914+0000","last_active":"2024-09-12T01:26:55.790545+0000","last_peered":"2024-09-12T01:26:55.790545+0000","last_clean":"2024-09-12T01:26:55.790545+0000","last_became_active":"2024-09-12T00:48:42.292607+0000","last_became_peered":"2024-09-12T00:48:42.292607+0000","last_unstale":"2024-09-12T01:26:55.790545+0000","last_undegraded":"2024-09-12T01:26:55.790545+0000","last_fullsized":"2024-09-12T01:26:55.790545+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:07.172445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'33","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.638048+0000","last_change":"2024-09-12T00:46:03.918495+0000","last_active":"2024-09-12T01:26:05.638048+0000","last_peered":"2024-09-12T01:26:05.638048+0000","last_clean":"2024-09-12T01:26:05.638048+0000","last_became_active":"2024-09-12T00:46:03.918204+0000","last_became_peered":"2024-09-12T00:46:03.918204+0000","last_unstale":"2024-09-12T01:26:05.638048+0000","last_undegraded":"2024-09-12T01:26:05.638048+0000","last_fullsized":"2024-09-12T01:26:05.638048+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:39.227048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":133,"num_write":46,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499343+0000","last_change":"2024-09-12T01:04:13.465355+0000","last_active":"2024-09-12T01:26:07.499343+0000","last_peered":"2024-09-12T01:26:07.499343+0000","last_clean":"2024-09-12T01:26:07.499343+0000","last_became_active":"2024-09-12T01:04:13.465081+0000","last_became_peered":"2024-09-12T01:04:13.465081+0000","last_unstale":"2024-09-12T01:26:07.499343+0000","last_undegraded":"2024-09-12T01:26:07.499343+0000","last_fullsized":"2024-09-12T01:26:07.499343+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:11.393872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:57.507200+0000","last_change":"2024-09-12T00:48:45.315792+0000","last_active":"2024-09-12T01:26:57.507200+0000","last_peered":"2024-09-12T01:26:57.507200+0000","last_clean":"2024-09-12T01:26:57.507200+0000","last_became_active":"2024-09-12T00:48:45.314837+0000","last_became_peered":"2024-09-12T00:48:45.314837+0000","last_unstale":"2024-09-12T01:26:57.507200+0000","last_undegraded":"2024-09-12T01:26:57.507200+0000","last_fullsized":"2024-09-12T01:26:57.507200+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:45.469413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'8","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.606727+0000","last_change":"2024-09-12T00:48:42.290832+0000","last_active":"2024-09-12T01:26:14.606727+0000","last_peered":"2024-09-12T01:26:14.606727+0000","last_clean":"2024-09-12T01:26:14.606727+0000","last_became_active":"2024-09-12T00:48:42.290570+0000","last_became_peered":"2024-09-12T00:48:42.290570+0000","last_unstale":"2024-09-12T01:26:14.606727+0000","last_undegraded":"2024-09-12T01:26:14.606727+0000","last_fullsized":"2024-09-12T01:26:14.606727+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.754613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":32770,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"262'57","reported_seq":245,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.638031+0000","last_change":"2024-09-12T00:46:03.912889+0000","last_active":"2024-09-12T01:26:05.638031+0000","last_peered":"2024-09-12T01:26:05.638031+0000","last_clean":"2024-09-12T01:26:05.638031+0000","last_became_active":"2024-09-12T00:46:03.912603+0000","last_became_peered":"2024-09-12T00:46:03.912603+0000","last_unstale":"2024-09-12T01:26:05.638031+0000","last_undegraded":"2024-09-12T01:26:05.638031+0000","last_fullsized":"2024-09-12T01:26:05.638031+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:41.505661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":263,"num_write":69,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:20.785335+0000","last_change":"2024-09-12T01:04:13.459054+0000","last_active":"2024-09-12T01:26:20.785335+0000","last_peered":"2024-09-12T01:26:20.785335+0000","last_clean":"2024-09-12T01:26:20.785335+0000","last_became_active":"2024-09-12T01:04:13.458781+0000","last_became_peered":"2024-09-12T01:04:13.458781+0000","last_unstale":"2024-09-12T01:26:20.785335+0000","last_undegraded":"2024-09-12T01:26:20.785335+0000","last_fullsized":"2024-09-12T01:26:20.785335+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:22.643443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'5","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:09.496309+0000","last_change":"2024-09-12T00:48:45.318968+0000","last_active":"2024-09-12T01:25:09.496309+0000","last_peered":"2024-09-12T01:25:09.496309+0000","last_clean":"2024-09-12T01:25:09.496309+0000","last_became_active":"2024-09-12T00:48:45.318608+0000","last_became_peered":"2024-09-12T00:48:45.318608+0000","last_unstale":"2024-09-12T01:25:09.496309+0000","last_undegraded":"2024-09-12T01:25:09.496309+0000","last_fullsized":"2024-09-12T01:25:09.496309+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:29.993435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"265'9","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:57.488448+0000","last_change":"2024-09-12T00:48:42.298222+0000","last_active":"2024-09-12T01:24:57.488448+0000","last_peered":"2024-09-12T01:24:57.488448+0000","last_clean":"2024-09-12T01:24:57.488448+0000","last_became_active":"2024-09-12T00:48:42.297952+0000","last_became_peered":"2024-09-12T00:48:42.297952+0000","last_unstale":"2024-09-12T01:24:57.488448+0000","last_undegraded":"2024-09-12T01:24:57.488448+0000","last_fullsized":"2024-09-12T01:24:57.488448+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:49.640614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339875,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":16432,"num_write":9,"num_write_kb":16432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'28","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.637984+0000","last_change":"2024-09-12T00:46:03.916594+0000","last_active":"2024-09-12T01:26:05.637984+0000","last_peered":"2024-09-12T01:26:05.637984+0000","last_clean":"2024-09-12T01:26:05.637984+0000","last_became_active":"2024-09-12T00:46:03.915917+0000","last_became_peered":"2024-09-12T00:46:03.915917+0000","last_unstale":"2024-09-12T01:26:05.637984+0000","last_undegraded":"2024-09-12T01:26:05.637984+0000","last_fullsized":"2024-09-12T01:26:05.637984+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:26.873454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:08.509445+0000","last_change":"2024-09-12T01:04:13.465500+0000","last_active":"2024-09-12T01:27:08.509445+0000","last_peered":"2024-09-12T01:27:08.509445+0000","last_clean":"2024-09-12T01:27:08.509445+0000","last_became_active":"2024-09-12T01:04:13.465173+0000","last_became_peered":"2024-09-12T01:04:13.465173+0000","last_unstale":"2024-09-12T01:27:08.509445+0000","last_undegraded":"2024-09-12T01:27:08.509445+0000","last_fullsized":"2024-09-12T01:27:08.509445+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:43.615029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.714047+0000","last_change":"2024-09-12T00:48:45.314920+0000","last_active":"2024-09-12T01:24:59.714047+0000","last_peered":"2024-09-12T01:24:59.714047+0000","last_clean":"2024-09-12T01:24:59.714047+0000","last_became_active":"2024-09-12T00:48:45.313443+0000","last_became_peered":"2024-09-12T00:48:45.313443+0000","last_unstale":"2024-09-12T01:24:59.714047+0000","last_undegraded":"2024-09-12T01:24:59.714047+0000","last_fullsized":"2024-09-12T01:24:59.714047+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:03.806002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'6","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714784+0000","last_change":"2024-09-12T00:48:42.293510+0000","last_active":"2024-09-12T01:25:04.714784+0000","last_peered":"2024-09-12T01:25:04.714784+0000","last_clean":"2024-09-12T01:25:04.714784+0000","last_became_active":"2024-09-12T00:48:42.293128+0000","last_became_peered":"2024-09-12T00:48:42.293128+0000","last_unstale":"2024-09-12T01:25:04.714784+0000","last_undegraded":"2024-09-12T01:25:04.714784+0000","last_fullsized":"2024-09-12T01:25:04.714784+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:35.032026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":20530,"num_write":6,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'40","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.504898+0000","last_change":"2024-09-12T00:46:03.923309+0000","last_active":"2024-09-12T01:26:04.504898+0000","last_peered":"2024-09-12T01:26:04.504898+0000","last_clean":"2024-09-12T01:26:04.504898+0000","last_became_active":"2024-09-12T00:46:03.923029+0000","last_became_peered":"2024-09-12T00:46:03.923029+0000","last_unstale":"2024-09-12T01:26:04.504898+0000","last_undegraded":"2024-09-12T01:26:04.504898+0000","last_fullsized":"2024-09-12T01:26:04.504898+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:20.804221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":145,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.508900+0000","last_change":"2024-09-12T01:04:13.472265+0000","last_active":"2024-09-12T01:26:44.508900+0000","last_peered":"2024-09-12T01:26:44.508900+0000","last_clean":"2024-09-12T01:26:44.508900+0000","last_became_active":"2024-09-12T01:04:13.468832+0000","last_became_peered":"2024-09-12T01:04:13.468832+0000","last_unstale":"2024-09-12T01:26:44.508900+0000","last_undegraded":"2024-09-12T01:26:44.508900+0000","last_fullsized":"2024-09-12T01:26:44.508900+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.832023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505982+0000","last_change":"2024-09-12T00:48:45.309486+0000","last_active":"2024-09-12T01:26:14.505982+0000","last_peered":"2024-09-12T01:26:14.505982+0000","last_clean":"2024-09-12T01:26:14.505982+0000","last_became_active":"2024-09-12T00:48:45.309166+0000","last_became_peered":"2024-09-12T00:48:45.309166+0000","last_unstale":"2024-09-12T01:26:14.505982+0000","last_undegraded":"2024-09-12T01:26:14.505982+0000","last_fullsized":"2024-09-12T01:26:14.505982+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:58.753867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.502933+0000","last_change":"2024-09-12T00:48:42.292429+0000","last_active":"2024-09-12T01:26:14.502933+0000","last_peered":"2024-09-12T01:26:14.502933+0000","last_clean":"2024-09-12T01:26:14.502933+0000","last_became_active":"2024-09-12T00:48:42.291800+0000","last_became_peered":"2024-09-12T00:48:42.291800+0000","last_unstale":"2024-09-12T01:26:14.502933+0000","last_undegraded":"2024-09-12T01:26:14.502933+0000","last_fullsized":"2024-09-12T01:26:14.502933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:58.520610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'17","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:55.771942+0000","last_change":"2024-09-12T00:46:03.913895+0000","last_active":"2024-09-12T01:24:55.771942+0000","last_peered":"2024-09-12T01:24:55.771942+0000","last_clean":"2024-09-12T01:24:55.771942+0000","last_became_active":"2024-09-12T00:46:03.913667+0000","last_became_peered":"2024-09-12T00:46:03.913667+0000","last_unstale":"2024-09-12T01:24:55.771942+0000","last_undegraded":"2024-09-12T01:24:55.771942+0000","last_fullsized":"2024-09-12T01:24:55.771942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:42.230323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":62,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.506059+0000","last_change":"2024-09-12T01:04:13.462929+0000","last_active":"2024-09-12T01:26:44.506059+0000","last_peered":"2024-09-12T01:26:44.506059+0000","last_clean":"2024-09-12T01:26:44.506059+0000","last_became_active":"2024-09-12T01:04:13.462605+0000","last_became_peered":"2024-09-12T01:04:13.462605+0000","last_unstale":"2024-09-12T01:26:44.506059+0000","last_undegraded":"2024-09-12T01:26:44.506059+0000","last_fullsized":"2024-09-12T01:26:44.506059+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:21.801378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:45.807311+0000","last_change":"2024-09-12T00:48:45.314426+0000","last_active":"2024-09-12T01:28:45.807311+0000","last_peered":"2024-09-12T01:28:45.807311+0000","last_clean":"2024-09-12T01:28:45.807311+0000","last_became_active":"2024-09-12T00:48:45.314128+0000","last_became_peered":"2024-09-12T00:48:45.314128+0000","last_unstale":"2024-09-12T01:28:45.807311+0000","last_undegraded":"2024-09-12T01:28:45.807311+0000","last_fullsized":"2024-09-12T01:28:45.807311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:59.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639662+0000","last_change":"2024-09-12T00:48:42.296184+0000","last_active":"2024-09-12T01:26:15.639662+0000","last_peered":"2024-09-12T01:26:15.639662+0000","last_clean":"2024-09-12T01:26:15.639662+0000","last_became_active":"2024-09-12T00:48:42.295886+0000","last_became_peered":"2024-09-12T00:48:42.295886+0000","last_unstale":"2024-09-12T01:26:15.639662+0000","last_undegraded":"2024-09-12T01:26:15.639662+0000","last_fullsized":"2024-09-12T01:26:15.639662+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:20.846127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'14","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:45.624687+0000","last_change":"2024-09-12T00:46:03.919616+0000","last_active":"2024-09-12T01:24:45.624687+0000","last_peered":"2024-09-12T01:24:45.624687+0000","last_clean":"2024-09-12T01:24:45.624687+0000","last_became_active":"2024-09-12T00:46:03.919334+0000","last_became_peered":"2024-09-12T00:46:03.919334+0000","last_unstale":"2024-09-12T01:24:45.624687+0000","last_undegraded":"2024-09-12T01:24:45.624687+0000","last_fullsized":"2024-09-12T01:24:45.624687+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:28.706224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:17.491559+0000","last_change":"2024-09-12T01:04:13.467497+0000","last_active":"2024-09-12T01:25:17.491559+0000","last_peered":"2024-09-12T01:25:17.491559+0000","last_clean":"2024-09-12T01:25:17.491559+0000","last_became_active":"2024-09-12T01:04:13.467230+0000","last_became_peered":"2024-09-12T01:04:13.467230+0000","last_unstale":"2024-09-12T01:25:17.491559+0000","last_undegraded":"2024-09-12T01:25:17.491559+0000","last_fullsized":"2024-09-12T01:25:17.491559+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:19.612980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.862267+0000","last_change":"2024-09-12T00:48:45.309898+0000","last_active":"2024-09-12T01:29:14.862267+0000","last_peered":"2024-09-12T01:29:14.862267+0000","last_clean":"2024-09-12T01:29:14.862267+0000","last_became_active":"2024-09-12T00:48:45.309604+0000","last_became_peered":"2024-09-12T00:48:45.309604+0000","last_unstale":"2024-09-12T01:29:14.862267+0000","last_undegraded":"2024-09-12T01:29:14.862267+0000","last_fullsized":"2024-09-12T01:29:14.862267+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:20.554961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.724362+0000","last_change":"2024-09-12T00:48:42.294022+0000","last_active":"2024-09-12T01:26:09.724362+0000","last_peered":"2024-09-12T01:26:09.724362+0000","last_clean":"2024-09-12T01:26:09.724362+0000","last_became_active":"2024-09-12T00:48:42.293705+0000","last_became_peered":"2024-09-12T00:48:42.293705+0000","last_unstale":"2024-09-12T01:26:09.724362+0000","last_undegraded":"2024-09-12T01:26:09.724362+0000","last_fullsized":"2024-09-12T01:26:09.724362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.053185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'6","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:43.489387+0000","last_change":"2024-09-12T00:46:03.917085+0000","last_active":"2024-09-12T01:24:43.489387+0000","last_peered":"2024-09-12T01:24:43.489387+0000","last_clean":"2024-09-12T01:24:43.489387+0000","last_became_active":"2024-09-12T00:46:03.916699+0000","last_became_peered":"2024-09-12T00:46:03.916699+0000","last_unstale":"2024-09-12T01:24:43.489387+0000","last_undegraded":"2024-09-12T01:24:43.489387+0000","last_fullsized":"2024-09-12T01:24:43.489387+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:46.585826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:15.630269+0000","last_change":"2024-09-12T01:04:13.468912+0000","last_active":"2024-09-12T01:25:15.630269+0000","last_peered":"2024-09-12T01:25:15.630269+0000","last_clean":"2024-09-12T01:25:15.630269+0000","last_became_active":"2024-09-12T01:04:13.468643+0000","last_became_peered":"2024-09-12T01:04:13.468643+0000","last_unstale":"2024-09-12T01:25:15.630269+0000","last_undegraded":"2024-09-12T01:25:15.630269+0000","last_fullsized":"2024-09-12T01:25:15.630269+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:52.505763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501282+0000","last_change":"2024-09-12T00:48:45.314936+0000","last_active":"2024-09-12T01:26:17.501282+0000","last_peered":"2024-09-12T01:26:17.501282+0000","last_clean":"2024-09-12T01:26:17.501282+0000","last_became_active":"2024-09-12T00:48:45.314212+0000","last_became_peered":"2024-09-12T00:48:45.314212+0000","last_unstale":"2024-09-12T01:26:17.501282+0000","last_undegraded":"2024-09-12T01:26:17.501282+0000","last_fullsized":"2024-09-12T01:26:17.501282+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:22.945070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"265'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.495235+0000","last_change":"2024-09-12T00:48:42.292169+0000","last_active":"2024-09-12T01:24:59.495235+0000","last_peered":"2024-09-12T01:24:59.495235+0000","last_clean":"2024-09-12T01:24:59.495235+0000","last_became_active":"2024-09-12T00:48:42.291818+0000","last_became_peered":"2024-09-12T00:48:42.291818+0000","last_unstale":"2024-09-12T01:24:59.495235+0000","last_undegraded":"2024-09-12T01:24:59.495235+0000","last_fullsized":"2024-09-12T01:24:59.495235+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.276296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'35","reported_seq":142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:43.489359+0000","last_change":"2024-09-12T00:46:03.921103+0000","last_active":"2024-09-12T01:24:43.489359+0000","last_peered":"2024-09-12T01:24:43.489359+0000","last_clean":"2024-09-12T01:24:43.489359+0000","last_became_active":"2024-09-12T00:46:03.920696+0000","last_became_peered":"2024-09-12T00:46:03.920696+0000","last_unstale":"2024-09-12T01:24:43.489359+0000","last_undegraded":"2024-09-12T01:24:43.489359+0000","last_fullsized":"2024-09-12T01:24:43.489359+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:00.908573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.499604+0000","last_change":"2024-09-12T01:04:13.472034+0000","last_active":"2024-09-12T01:25:14.499604+0000","last_peered":"2024-09-12T01:25:14.499604+0000","last_clean":"2024-09-12T01:25:14.499604+0000","last_became_active":"2024-09-12T01:04:13.471741+0000","last_became_peered":"2024-09-12T01:04:13.471741+0000","last_unstale":"2024-09-12T01:25:14.499604+0000","last_undegraded":"2024-09-12T01:25:14.499604+0000","last_fullsized":"2024-09-12T01:25:14.499604+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:37.939219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:00.772877+0000","last_change":"2024-09-12T00:48:45.317881+0000","last_active":"2024-09-12T01:25:00.772877+0000","last_peered":"2024-09-12T01:25:00.772877+0000","last_clean":"2024-09-12T01:25:00.772877+0000","last_became_active":"2024-09-12T00:48:45.317576+0000","last_became_peered":"2024-09-12T00:48:45.317576+0000","last_unstale":"2024-09-12T01:25:00.772877+0000","last_undegraded":"2024-09-12T01:25:00.772877+0000","last_fullsized":"2024-09-12T01:25:00.772877+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:56.133928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"262'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:00.772850+0000","last_change":"2024-09-12T00:48:42.291771+0000","last_active":"2024-09-12T01:25:00.772850+0000","last_peered":"2024-09-12T01:25:00.772850+0000","last_clean":"2024-09-12T01:25:00.772850+0000","last_became_active":"2024-09-12T00:48:42.291199+0000","last_became_peered":"2024-09-12T00:48:42.291199+0000","last_unstale":"2024-09-12T01:25:00.772850+0000","last_undegraded":"2024-09-12T01:25:00.772850+0000","last_fullsized":"2024-09-12T01:25:00.772850+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:37.299502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5165,"num_write":10,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'6","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:45.770639+0000","last_change":"2024-09-12T00:46:03.919765+0000","last_active":"2024-09-12T01:24:45.770639+0000","last_peered":"2024-09-12T01:24:45.770639+0000","last_clean":"2024-09-12T01:24:45.770639+0000","last_became_active":"2024-09-12T00:46:03.919481+0000","last_became_peered":"2024-09-12T00:46:03.919481+0000","last_unstale":"2024-09-12T01:24:45.770639+0000","last_undegraded":"2024-09-12T01:24:45.770639+0000","last_fullsized":"2024-09-12T01:24:45.770639+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:06.767562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.496856+0000","last_change":"2024-09-12T01:04:13.468963+0000","last_active":"2024-09-12T01:25:14.496856+0000","last_peered":"2024-09-12T01:25:14.496856+0000","last_clean":"2024-09-12T01:25:14.496856+0000","last_became_active":"2024-09-12T01:04:13.468317+0000","last_became_peered":"2024-09-12T01:04:13.468317+0000","last_unstale":"2024-09-12T01:25:14.496856+0000","last_undegraded":"2024-09-12T01:25:14.496856+0000","last_fullsized":"2024-09-12T01:25:14.496856+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:50.519451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.495267+0000","last_change":"2024-09-12T00:48:45.315823+0000","last_active":"2024-09-12T01:24:59.495267+0000","last_peered":"2024-09-12T01:24:59.495267+0000","last_clean":"2024-09-12T01:24:59.495267+0000","last_became_active":"2024-09-12T00:48:45.315546+0000","last_became_peered":"2024-09-12T00:48:45.315546+0000","last_unstale":"2024-09-12T01:24:59.495267+0000","last_undegraded":"2024-09-12T01:24:59.495267+0000","last_fullsized":"2024-09-12T01:24:59.495267+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:54.909978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:57.488625+0000","last_change":"2024-09-12T00:48:42.296841+0000","last_active":"2024-09-12T01:24:57.488625+0000","last_peered":"2024-09-12T01:24:57.488625+0000","last_clean":"2024-09-12T01:24:57.488625+0000","last_became_active":"2024-09-12T00:48:42.296509+0000","last_became_peered":"2024-09-12T00:48:42.296509+0000","last_unstale":"2024-09-12T01:24:57.488625+0000","last_undegraded":"2024-09-12T01:24:57.488625+0000","last_fullsized":"2024-09-12T01:24:57.488625+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:00.906884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":14336,"num_write":9,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'52","reported_seq":188,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721709+0000","last_change":"2024-09-12T00:46:03.920474+0000","last_active":"2024-09-12T01:25:49.721709+0000","last_peered":"2024-09-12T01:25:49.721709+0000","last_clean":"2024-09-12T01:25:49.721709+0000","last_became_active":"2024-09-12T00:46:03.920188+0000","last_became_peered":"2024-09-12T00:46:03.920188+0000","last_unstale":"2024-09-12T01:25:49.721709+0000","last_undegraded":"2024-09-12T01:25:49.721709+0000","last_fullsized":"2024-09-12T01:25:49.721709+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:42.736993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":182,"num_write":95,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498632+0000","last_change":"2024-09-12T01:04:13.462848+0000","last_active":"2024-09-12T01:26:02.498632+0000","last_peered":"2024-09-12T01:26:02.498632+0000","last_clean":"2024-09-12T01:26:02.498632+0000","last_became_active":"2024-09-12T01:04:13.462434+0000","last_became_peered":"2024-09-12T01:04:13.462434+0000","last_unstale":"2024-09-12T01:26:02.498632+0000","last_undegraded":"2024-09-12T01:26:02.498632+0000","last_fullsized":"2024-09-12T01:26:02.498632+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:42.830213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499355+0000","last_change":"2024-09-12T00:48:45.316725+0000","last_active":"2024-09-12T01:26:07.499355+0000","last_peered":"2024-09-12T01:26:07.499355+0000","last_clean":"2024-09-12T01:26:07.499355+0000","last_became_active":"2024-09-12T00:48:45.316432+0000","last_became_peered":"2024-09-12T00:48:45.316432+0000","last_unstale":"2024-09-12T01:26:07.499355+0000","last_undegraded":"2024-09-12T01:26:07.499355+0000","last_fullsized":"2024-09-12T01:26:07.499355+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:20.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605590+0000","last_change":"2024-09-12T00:48:42.290754+0000","last_active":"2024-09-12T01:26:04.605590+0000","last_peered":"2024-09-12T01:26:04.605590+0000","last_clean":"2024-09-12T01:26:04.605590+0000","last_became_active":"2024-09-12T00:48:42.290454+0000","last_became_peered":"2024-09-12T00:48:42.290454+0000","last_unstale":"2024-09-12T01:26:04.605590+0000","last_undegraded":"2024-09-12T01:26:04.605590+0000","last_fullsized":"2024-09-12T01:26:04.605590+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:16.245048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"262'7","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.719526+0000","last_change":"2024-09-12T00:46:03.917579+0000","last_active":"2024-09-12T01:25:44.719526+0000","last_peered":"2024-09-12T01:25:44.719526+0000","last_clean":"2024-09-12T01:25:44.719526+0000","last_became_active":"2024-09-12T00:46:03.917314+0000","last_became_peered":"2024-09-12T00:46:03.917314+0000","last_unstale":"2024-09-12T01:25:44.719526+0000","last_undegraded":"2024-09-12T01:25:44.719526+0000","last_fullsized":"2024-09-12T01:25:44.719526+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:21.892403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":13,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637319+0000","last_change":"2024-09-12T01:04:13.467571+0000","last_active":"2024-09-12T01:26:00.637319+0000","last_peered":"2024-09-12T01:26:00.637319+0000","last_clean":"2024-09-12T01:26:00.637319+0000","last_became_active":"2024-09-12T01:04:13.467119+0000","last_became_peered":"2024-09-12T01:04:13.467119+0000","last_unstale":"2024-09-12T01:26:00.637319+0000","last_undegraded":"2024-09-12T01:26:00.637319+0000","last_fullsized":"2024-09-12T01:26:00.637319+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:23.369147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499300+0000","last_change":"2024-09-12T00:48:45.314598+0000","last_active":"2024-09-12T01:26:07.499300+0000","last_peered":"2024-09-12T01:26:07.499300+0000","last_clean":"2024-09-12T01:26:07.499300+0000","last_became_active":"2024-09-12T00:48:45.314127+0000","last_became_peered":"2024-09-12T00:48:45.314127+0000","last_unstale":"2024-09-12T01:26:07.499300+0000","last_undegraded":"2024-09-12T01:26:07.499300+0000","last_fullsized":"2024-09-12T01:26:07.499300+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:00.050328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'5","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498548+0000","last_change":"2024-09-12T00:48:42.293860+0000","last_active":"2024-09-12T01:26:02.498548+0000","last_peered":"2024-09-12T01:26:02.498548+0000","last_clean":"2024-09-12T01:26:02.498548+0000","last_became_active":"2024-09-12T00:48:42.293153+0000","last_became_peered":"2024-09-12T00:48:42.293153+0000","last_unstale":"2024-09-12T01:26:02.498548+0000","last_undegraded":"2024-09-12T01:26:02.498548+0000","last_fullsized":"2024-09-12T01:26:02.498548+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:12.547450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'49","reported_seq":179,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:45.779451+0000","last_change":"2024-09-12T00:46:03.917417+0000","last_active":"2024-09-12T01:25:45.779451+0000","last_peered":"2024-09-12T01:25:45.779451+0000","last_clean":"2024-09-12T01:25:45.779451+0000","last_became_active":"2024-09-12T00:46:03.917142+0000","last_became_peered":"2024-09-12T00:46:03.917142+0000","last_unstale":"2024-09-12T01:25:45.779451+0000","last_undegraded":"2024-09-12T01:25:45.779451+0000","last_fullsized":"2024-09-12T01:25:45.779451+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:12.229825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":172,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:18.494068+0000","last_change":"2024-09-12T01:04:13.464064+0000","last_active":"2024-09-12T01:25:18.494068+0000","last_peered":"2024-09-12T01:25:18.494068+0000","last_clean":"2024-09-12T01:25:18.494068+0000","last_became_active":"2024-09-12T01:04:13.463766+0000","last_became_peered":"2024-09-12T01:04:13.463766+0000","last_unstale":"2024-09-12T01:25:18.494068+0000","last_undegraded":"2024-09-12T01:25:18.494068+0000","last_fullsized":"2024-09-12T01:25:18.494068+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:26.806464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782587+0000","last_change":"2024-09-12T00:48:45.307348+0000","last_active":"2024-09-12T01:26:05.782587+0000","last_peered":"2024-09-12T01:26:05.782587+0000","last_clean":"2024-09-12T01:26:05.782587+0000","last_became_active":"2024-09-12T00:48:45.307036+0000","last_became_peered":"2024-09-12T00:48:45.307036+0000","last_unstale":"2024-09-12T01:26:05.782587+0000","last_undegraded":"2024-09-12T01:26:05.782587+0000","last_fullsized":"2024-09-12T01:26:05.782587+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:21.417276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'4","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605655+0000","last_change":"2024-09-12T00:48:42.294916+0000","last_active":"2024-09-12T01:26:04.605655+0000","last_peered":"2024-09-12T01:26:04.605655+0000","last_clean":"2024-09-12T01:26:04.605655+0000","last_became_active":"2024-09-12T00:48:42.294608+0000","last_became_peered":"2024-09-12T00:48:42.294608+0000","last_unstale":"2024-09-12T01:26:04.605655+0000","last_undegraded":"2024-09-12T01:26:04.605655+0000","last_fullsized":"2024-09-12T01:26:04.605655+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:37.130170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5438,"num_write":4,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.502728+0000","last_change":"2024-09-12T00:46:03.922277+0000","last_active":"2024-09-12T01:25:44.502728+0000","last_peered":"2024-09-12T01:25:44.502728+0000","last_clean":"2024-09-12T01:25:44.502728+0000","last_became_active":"2024-09-12T00:46:03.921844+0000","last_became_peered":"2024-09-12T00:46:03.921844+0000","last_unstale":"2024-09-12T01:25:44.502728+0000","last_undegraded":"2024-09-12T01:25:44.502728+0000","last_fullsized":"2024-09-12T01:25:44.502728+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:57.617387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":67,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637276+0000","last_change":"2024-09-12T01:04:13.462719+0000","last_active":"2024-09-12T01:26:00.637276+0000","last_peered":"2024-09-12T01:26:00.637276+0000","last_clean":"2024-09-12T01:26:00.637276+0000","last_became_active":"2024-09-12T01:04:13.462441+0000","last_became_peered":"2024-09-12T01:04:13.462441+0000","last_unstale":"2024-09-12T01:26:00.637276+0000","last_undegraded":"2024-09-12T01:26:00.637276+0000","last_fullsized":"2024-09-12T01:26:00.637276+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:19.887695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'9","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723555+0000","last_change":"2024-09-12T00:48:45.312937+0000","last_active":"2024-09-12T01:26:04.723555+0000","last_peered":"2024-09-12T01:26:04.723555+0000","last_clean":"2024-09-12T01:26:04.723555+0000","last_became_active":"2024-09-12T00:48:45.312617+0000","last_became_peered":"2024-09-12T00:48:45.312617+0000","last_unstale":"2024-09-12T01:26:04.723555+0000","last_undegraded":"2024-09-12T01:26:04.723555+0000","last_fullsized":"2024-09-12T01:26:04.723555+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:28.386583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5291306,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":20528,"num_write":19,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605671+0000","last_change":"2024-09-12T00:48:42.292806+0000","last_active":"2024-09-12T01:26:04.605671+0000","last_peered":"2024-09-12T01:26:04.605671+0000","last_clean":"2024-09-12T01:26:04.605671+0000","last_became_active":"2024-09-12T00:48:42.292511+0000","last_became_peered":"2024-09-12T00:48:42.292511+0000","last_unstale":"2024-09-12T01:26:04.605671+0000","last_undegraded":"2024-09-12T01:26:04.605671+0000","last_fullsized":"2024-09-12T01:26:04.605671+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:34.992694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'10","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:45.779402+0000","last_change":"2024-09-12T00:46:03.913386+0000","last_active":"2024-09-12T01:25:45.779402+0000","last_peered":"2024-09-12T01:25:45.779402+0000","last_clean":"2024-09-12T01:25:45.779402+0000","last_became_active":"2024-09-12T00:46:03.913098+0000","last_became_peered":"2024-09-12T00:46:03.913098+0000","last_unstale":"2024-09-12T01:25:45.779402+0000","last_undegraded":"2024-09-12T01:25:45.779402+0000","last_fullsized":"2024-09-12T01:25:45.779402+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:03.725529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":36,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498570+0000","last_change":"2024-09-12T01:04:13.474135+0000","last_active":"2024-09-12T01:26:02.498570+0000","last_peered":"2024-09-12T01:26:02.498570+0000","last_clean":"2024-09-12T01:26:02.498570+0000","last_became_active":"2024-09-12T01:04:13.473901+0000","last_became_peered":"2024-09-12T01:04:13.473901+0000","last_unstale":"2024-09-12T01:26:02.498570+0000","last_undegraded":"2024-09-12T01:26:02.498570+0000","last_fullsized":"2024-09-12T01:26:02.498570+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:45.848297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.711540+0000","last_change":"2024-09-12T00:48:45.308960+0000","last_active":"2024-09-12T01:29:15.711540+0000","last_peered":"2024-09-12T01:29:15.711540+0000","last_clean":"2024-09-12T01:29:15.711540+0000","last_became_active":"2024-09-12T00:48:45.308676+0000","last_became_peered":"2024-09-12T00:48:45.308676+0000","last_unstale":"2024-09-12T01:29:15.711540+0000","last_undegraded":"2024-09-12T01:29:15.711540+0000","last_fullsized":"2024-09-12T01:29:15.711540+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:11.911720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":9,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:59.510461+0000","last_change":"2024-09-12T00:48:42.291979+0000","last_active":"2024-09-12T01:26:59.510461+0000","last_peered":"2024-09-12T01:26:59.510461+0000","last_clean":"2024-09-12T01:26:59.510461+0000","last_became_active":"2024-09-12T00:48:42.291569+0000","last_became_peered":"2024-09-12T00:48:42.291569+0000","last_unstale":"2024-09-12T01:26:59.510461+0000","last_undegraded":"2024-09-12T01:26:59.510461+0000","last_fullsized":"2024-09-12T01:26:59.510461+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:20.262872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'67","reported_seq":233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.789165+0000","last_change":"2024-09-12T00:46:03.920845+0000","last_active":"2024-09-12T01:26:45.789165+0000","last_peered":"2024-09-12T01:26:45.789165+0000","last_clean":"2024-09-12T01:26:45.789165+0000","last_became_active":"2024-09-12T00:46:03.920387+0000","last_became_peered":"2024-09-12T00:46:03.920387+0000","last_unstale":"2024-09-12T01:26:45.789165+0000","last_undegraded":"2024-09-12T01:26:45.789165+0000","last_fullsized":"2024-09-12T01:26:45.789165+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:02.972369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":242,"num_write":122,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.609771+0000","last_change":"2024-09-12T01:04:13.470050+0000","last_active":"2024-09-12T01:26:44.609771+0000","last_peered":"2024-09-12T01:26:44.609771+0000","last_clean":"2024-09-12T01:26:44.609771+0000","last_became_active":"2024-09-12T01:04:13.469544+0000","last_became_peered":"2024-09-12T01:04:13.469544+0000","last_unstale":"2024-09-12T01:26:44.609771+0000","last_undegraded":"2024-09-12T01:26:44.609771+0000","last_fullsized":"2024-09-12T01:26:44.609771+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:57.676504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.791316+0000","last_change":"2024-09-12T00:48:45.310714+0000","last_active":"2024-09-12T01:27:00.791316+0000","last_peered":"2024-09-12T01:27:00.791316+0000","last_clean":"2024-09-12T01:27:00.791316+0000","last_became_active":"2024-09-12T00:48:45.310425+0000","last_became_peered":"2024-09-12T00:48:45.310425+0000","last_unstale":"2024-09-12T01:27:00.791316+0000","last_undegraded":"2024-09-12T01:27:00.791316+0000","last_fullsized":"2024-09-12T01:27:00.791316+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:11.427037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646110+0000","last_change":"2024-09-12T00:48:42.289205+0000","last_active":"2024-09-12T01:27:00.646110+0000","last_peered":"2024-09-12T01:27:00.646110+0000","last_clean":"2024-09-12T01:27:00.646110+0000","last_became_active":"2024-09-12T00:48:42.288750+0000","last_became_peered":"2024-09-12T00:48:42.288750+0000","last_unstale":"2024-09-12T01:27:00.646110+0000","last_undegraded":"2024-09-12T01:27:00.646110+0000","last_fullsized":"2024-09-12T01:27:00.646110+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:03.592679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'39","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.727351+0000","last_change":"2024-09-12T00:46:03.918651+0000","last_active":"2024-09-12T01:26:34.727351+0000","last_peered":"2024-09-12T01:26:34.727351+0000","last_clean":"2024-09-12T01:26:34.727351+0000","last_became_active":"2024-09-12T00:46:03.918395+0000","last_became_peered":"2024-09-12T00:46:03.918395+0000","last_unstale":"2024-09-12T01:26:34.727351+0000","last_undegraded":"2024-09-12T01:26:34.727351+0000","last_fullsized":"2024-09-12T01:26:34.727351+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:06.038629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":130,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.722217+0000","last_change":"2024-09-12T01:04:13.468761+0000","last_active":"2024-09-12T01:25:54.722217+0000","last_peered":"2024-09-12T01:25:54.722217+0000","last_clean":"2024-09-12T01:25:54.722217+0000","last_became_active":"2024-09-12T01:04:13.468492+0000","last_became_peered":"2024-09-12T01:04:13.468492+0000","last_unstale":"2024-09-12T01:25:54.722217+0000","last_undegraded":"2024-09-12T01:25:54.722217+0000","last_fullsized":"2024-09-12T01:25:54.722217+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:23.228261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:55.772046+0000","last_change":"2024-09-12T00:48:45.306987+0000","last_active":"2024-09-12T01:24:55.772046+0000","last_peered":"2024-09-12T01:24:55.772046+0000","last_clean":"2024-09-12T01:24:55.772046+0000","last_became_active":"2024-09-12T00:48:45.306581+0000","last_became_peered":"2024-09-12T00:48:45.306581+0000","last_unstale":"2024-09-12T01:24:55.772046+0000","last_undegraded":"2024-09-12T01:24:55.772046+0000","last_fullsized":"2024-09-12T01:24:55.772046+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:18.025186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.791375+0000","last_change":"2024-09-12T00:48:42.291472+0000","last_active":"2024-09-12T01:27:00.791375+0000","last_peered":"2024-09-12T01:27:00.791375+0000","last_clean":"2024-09-12T01:27:00.791375+0000","last_became_active":"2024-09-12T00:48:42.290069+0000","last_became_peered":"2024-09-12T00:48:42.290069+0000","last_unstale":"2024-09-12T01:27:00.791375+0000","last_undegraded":"2024-09-12T01:27:00.791375+0000","last_fullsized":"2024-09-12T01:27:00.791375+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:06.334859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'22","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.608639+0000","last_change":"2024-09-12T00:46:03.917998+0000","last_active":"2024-09-12T01:26:34.608639+0000","last_peered":"2024-09-12T01:26:34.608639+0000","last_clean":"2024-09-12T01:26:34.608639+0000","last_became_active":"2024-09-12T00:46:03.917612+0000","last_became_peered":"2024-09-12T00:46:03.917612+0000","last_unstale":"2024-09-12T01:26:34.608639+0000","last_undegraded":"2024-09-12T01:26:34.608639+0000","last_fullsized":"2024-09-12T01:26:34.608639+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:25.331801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":67,"num_write":52,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.604479+0000","last_change":"2024-09-12T01:04:13.471829+0000","last_active":"2024-09-12T01:25:54.604479+0000","last_peered":"2024-09-12T01:25:54.604479+0000","last_clean":"2024-09-12T01:25:54.604479+0000","last_became_active":"2024-09-12T01:04:13.470494+0000","last_became_peered":"2024-09-12T01:04:13.470494+0000","last_unstale":"2024-09-12T01:25:54.604479+0000","last_undegraded":"2024-09-12T01:25:54.604479+0000","last_fullsized":"2024-09-12T01:25:54.604479+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:21.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:47.487156+0000","last_change":"2024-09-12T00:48:45.317979+0000","last_active":"2024-09-12T01:24:47.487156+0000","last_peered":"2024-09-12T01:24:47.487156+0000","last_clean":"2024-09-12T01:24:47.487156+0000","last_became_active":"2024-09-12T00:48:45.317637+0000","last_became_peered":"2024-09-12T00:48:45.317637+0000","last_unstale":"2024-09-12T01:24:47.487156+0000","last_undegraded":"2024-09-12T01:24:47.487156+0000","last_fullsized":"2024-09-12T01:24:47.487156+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:51.863153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:55.772057+0000","last_change":"2024-09-12T00:48:42.289582+0000","last_active":"2024-09-12T01:24:55.772057+0000","last_peered":"2024-09-12T01:24:55.772057+0000","last_clean":"2024-09-12T01:24:55.772057+0000","last_became_active":"2024-09-12T00:48:42.289304+0000","last_became_peered":"2024-09-12T00:48:42.289304+0000","last_unstale":"2024-09-12T01:24:55.772057+0000","last_undegraded":"2024-09-12T01:24:55.772057+0000","last_fullsized":"2024-09-12T01:24:55.772057+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:58.432324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":140,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.642226+0000","last_change":"2024-09-12T00:46:03.911642+0000","last_active":"2024-09-12T01:26:35.642226+0000","last_peered":"2024-09-12T01:26:35.642226+0000","last_clean":"2024-09-12T01:26:35.642226+0000","last_became_active":"2024-09-12T00:46:03.911316+0000","last_became_peered":"2024-09-12T00:46:03.911316+0000","last_unstale":"2024-09-12T01:26:35.642226+0000","last_undegraded":"2024-09-12T01:26:35.642226+0000","last_fullsized":"2024-09-12T01:26:35.642226+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:27.292826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":121,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:47.505723+0000","last_change":"2024-09-12T01:04:13.462688+0000","last_active":"2024-09-12T01:26:47.505723+0000","last_peered":"2024-09-12T01:26:47.505723+0000","last_clean":"2024-09-12T01:26:47.505723+0000","last_became_active":"2024-09-12T01:04:13.462150+0000","last_became_peered":"2024-09-12T01:04:13.462150+0000","last_unstale":"2024-09-12T01:26:47.505723+0000","last_undegraded":"2024-09-12T01:26:47.505723+0000","last_fullsized":"2024-09-12T01:26:47.505723+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:43.928057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718235+0000","last_change":"2024-09-12T00:48:45.312564+0000","last_active":"2024-09-12T01:25:34.718235+0000","last_peered":"2024-09-12T01:25:34.718235+0000","last_clean":"2024-09-12T01:25:34.718235+0000","last_became_active":"2024-09-12T00:48:45.312283+0000","last_became_peered":"2024-09-12T00:48:45.312283+0000","last_unstale":"2024-09-12T01:25:34.718235+0000","last_undegraded":"2024-09-12T01:25:34.718235+0000","last_fullsized":"2024-09-12T01:25:34.718235+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:08.027455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:45.797614+0000","last_change":"2024-09-12T00:48:42.290364+0000","last_active":"2024-09-12T01:27:45.797614+0000","last_peered":"2024-09-12T01:27:45.797614+0000","last_clean":"2024-09-12T01:27:45.797614+0000","last_became_active":"2024-09-12T00:48:42.290091+0000","last_became_peered":"2024-09-12T00:48:42.290091+0000","last_unstale":"2024-09-12T01:27:45.797614+0000","last_undegraded":"2024-09-12T01:27:45.797614+0000","last_fullsized":"2024-09-12T01:27:45.797614+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:37.718174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'27","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.642191+0000","last_change":"2024-09-12T00:46:03.917233+0000","last_active":"2024-09-12T01:26:35.642191+0000","last_peered":"2024-09-12T01:26:35.642191+0000","last_clean":"2024-09-12T01:26:35.642191+0000","last_became_active":"2024-09-12T00:46:03.916476+0000","last_became_peered":"2024-09-12T00:46:03.916476+0000","last_unstale":"2024-09-12T01:26:35.642191+0000","last_undegraded":"2024-09-12T01:26:35.642191+0000","last_fullsized":"2024-09-12T01:26:35.642191+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:29.196991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:54.509963+0000","last_change":"2024-09-12T01:04:13.467457+0000","last_active":"2024-09-12T01:26:54.509963+0000","last_peered":"2024-09-12T01:26:54.509963+0000","last_clean":"2024-09-12T01:26:54.509963+0000","last_became_active":"2024-09-12T01:04:13.467045+0000","last_became_peered":"2024-09-12T01:04:13.467045+0000","last_unstale":"2024-09-12T01:26:54.509963+0000","last_undegraded":"2024-09-12T01:26:54.509963+0000","last_fullsized":"2024-09-12T01:26:54.509963+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:17.297601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.501740+0000","last_change":"2024-09-12T00:48:45.309440+0000","last_active":"2024-09-12T01:25:34.501740+0000","last_peered":"2024-09-12T01:25:34.501740+0000","last_clean":"2024-09-12T01:25:34.501740+0000","last_became_active":"2024-09-12T00:48:45.309113+0000","last_became_peered":"2024-09-12T00:48:45.309113+0000","last_unstale":"2024-09-12T01:25:34.501740+0000","last_undegraded":"2024-09-12T01:25:34.501740+0000","last_fullsized":"2024-09-12T01:25:34.501740+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:40.821689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'1","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:32.494012+0000","last_change":"2024-09-12T00:48:42.293380+0000","last_active":"2024-09-12T01:25:32.494012+0000","last_peered":"2024-09-12T01:25:32.494012+0000","last_clean":"2024-09-12T01:25:32.494012+0000","last_became_active":"2024-09-12T00:48:42.292733+0000","last_became_peered":"2024-09-12T00:48:42.292733+0000","last_unstale":"2024-09-12T01:25:32.494012+0000","last_undegraded":"2024-09-12T01:25:32.494012+0000","last_fullsized":"2024-09-12T01:25:32.494012+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.445225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":698,"num_write":1,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"262'8","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:19.500204+0000","last_change":"2024-09-12T00:46:03.922414+0000","last_active":"2024-09-12T01:25:19.500204+0000","last_peered":"2024-09-12T01:25:19.500204+0000","last_clean":"2024-09-12T01:25:19.500204+0000","last_became_active":"2024-09-12T00:46:03.922008+0000","last_became_peered":"2024-09-12T00:46:03.922008+0000","last_unstale":"2024-09-12T01:25:19.500204+0000","last_undegraded":"2024-09-12T01:25:19.500204+0000","last_fullsized":"2024-09-12T01:25:19.500204+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:42.541731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.506044+0000","last_change":"2024-09-12T01:04:13.467753+0000","last_active":"2024-09-12T01:26:44.506044+0000","last_peered":"2024-09-12T01:26:44.506044+0000","last_clean":"2024-09-12T01:26:44.506044+0000","last_became_active":"2024-09-12T01:04:13.467476+0000","last_became_peered":"2024-09-12T01:04:13.467476+0000","last_unstale":"2024-09-12T01:26:44.506044+0000","last_undegraded":"2024-09-12T01:26:44.506044+0000","last_fullsized":"2024-09-12T01:26:44.506044+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:36.299465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646039+0000","last_change":"2024-09-12T00:48:45.311842+0000","last_active":"2024-09-12T01:27:00.646039+0000","last_peered":"2024-09-12T01:27:00.646039+0000","last_clean":"2024-09-12T01:27:00.646039+0000","last_became_active":"2024-09-12T00:48:45.311541+0000","last_became_peered":"2024-09-12T00:48:45.311541+0000","last_unstale":"2024-09-12T01:27:00.646039+0000","last_undegraded":"2024-09-12T01:27:00.646039+0000","last_fullsized":"2024-09-12T01:27:00.646039+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:32.767909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:45.779440+0000","last_change":"2024-09-12T00:48:42.281525+0000","last_active":"2024-09-12T01:25:45.779440+0000","last_peered":"2024-09-12T01:25:45.779440+0000","last_clean":"2024-09-12T01:25:45.779440+0000","last_became_active":"2024-09-12T00:48:42.281070+0000","last_became_peered":"2024-09-12T00:48:42.281070+0000","last_unstale":"2024-09-12T01:25:45.779440+0000","last_undegraded":"2024-09-12T01:25:45.779440+0000","last_fullsized":"2024-09-12T01:25:45.779440+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:50.751015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'44","reported_seq":173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:07.489887+0000","last_change":"2024-09-12T00:46:03.917910+0000","last_active":"2024-09-12T01:25:07.489887+0000","last_peered":"2024-09-12T01:25:07.489887+0000","last_clean":"2024-09-12T01:25:07.489887+0000","last_became_active":"2024-09-12T00:46:03.917626+0000","last_became_peered":"2024-09-12T00:46:03.917626+0000","last_unstale":"2024-09-12T01:25:07.489887+0000","last_undegraded":"2024-09-12T01:25:07.489887+0000","last_fullsized":"2024-09-12T01:25:07.489887+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:07.349450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":170,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.789110+0000","last_change":"2024-09-12T01:04:13.463528+0000","last_active":"2024-09-12T01:26:45.789110+0000","last_peered":"2024-09-12T01:26:45.789110+0000","last_clean":"2024-09-12T01:26:45.789110+0000","last_became_active":"2024-09-12T01:04:13.463216+0000","last_became_peered":"2024-09-12T01:04:13.463216+0000","last_unstale":"2024-09-12T01:26:45.789110+0000","last_undegraded":"2024-09-12T01:26:45.789110+0000","last_fullsized":"2024-09-12T01:26:45.789110+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:56.941035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.499853+0000","last_change":"2024-09-12T00:48:45.313761+0000","last_active":"2024-09-12T01:25:44.499853+0000","last_peered":"2024-09-12T01:25:44.499853+0000","last_clean":"2024-09-12T01:25:44.499853+0000","last_became_active":"2024-09-12T00:48:45.313386+0000","last_became_peered":"2024-09-12T00:48:45.313386+0000","last_unstale":"2024-09-12T01:25:44.499853+0000","last_undegraded":"2024-09-12T01:25:44.499853+0000","last_fullsized":"2024-09-12T01:25:44.499853+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:02.140152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:59.730452+0000","last_change":"2024-09-12T00:48:42.293797+0000","last_active":"2024-09-12T01:26:59.730452+0000","last_peered":"2024-09-12T01:26:59.730452+0000","last_clean":"2024-09-12T01:26:59.730452+0000","last_became_active":"2024-09-12T00:48:42.293460+0000","last_became_peered":"2024-09-12T00:48:42.293460+0000","last_unstale":"2024-09-12T01:26:59.730452+0000","last_undegraded":"2024-09-12T01:26:59.730452+0000","last_fullsized":"2024-09-12T01:26:59.730452+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:22.406867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'27","reported_seq":123,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.495705+0000","last_change":"2024-09-12T00:46:03.919193+0000","last_active":"2024-09-12T01:25:04.495705+0000","last_peered":"2024-09-12T01:25:04.495705+0000","last_clean":"2024-09-12T01:25:04.495705+0000","last_became_active":"2024-09-12T00:46:03.918921+0000","last_became_peered":"2024-09-12T00:46:03.918921+0000","last_unstale":"2024-09-12T01:25:04.495705+0000","last_undegraded":"2024-09-12T01:25:04.495705+0000","last_fullsized":"2024-09-12T01:25:04.495705+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:43.600527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.508427+0000","last_change":"2024-09-12T01:04:13.467161+0000","last_active":"2024-09-12T01:27:09.508427+0000","last_peered":"2024-09-12T01:27:09.508427+0000","last_clean":"2024-09-12T01:27:09.508427+0000","last_became_active":"2024-09-12T01:04:13.466854+0000","last_became_peered":"2024-09-12T01:04:13.466854+0000","last_unstale":"2024-09-12T01:27:09.508427+0000","last_undegraded":"2024-09-12T01:27:09.508427+0000","last_fullsized":"2024-09-12T01:27:09.508427+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:37.902119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:27.502721+0000","last_change":"2024-09-12T00:48:45.316511+0000","last_active":"2024-09-12T01:26:27.502721+0000","last_peered":"2024-09-12T01:26:27.502721+0000","last_clean":"2024-09-12T01:26:27.502721+0000","last_became_active":"2024-09-12T00:48:45.315966+0000","last_became_peered":"2024-09-12T00:48:45.315966+0000","last_unstale":"2024-09-12T01:26:27.502721+0000","last_undegraded":"2024-09-12T01:26:27.502721+0000","last_fullsized":"2024-09-12T01:26:27.502721+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:04.129604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1396,"num_write":1,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.725014+0000","last_change":"2024-09-12T00:48:42.294344+0000","last_active":"2024-09-12T01:26:14.725014+0000","last_peered":"2024-09-12T01:26:14.725014+0000","last_clean":"2024-09-12T01:26:14.725014+0000","last_became_active":"2024-09-12T00:48:42.293481+0000","last_became_peered":"2024-09-12T00:48:42.293481+0000","last_unstale":"2024-09-12T01:26:14.725014+0000","last_undegraded":"2024-09-12T01:26:14.725014+0000","last_fullsized":"2024-09-12T01:26:14.725014+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:01.378966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'25","reported_seq":117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:03.492017+0000","last_change":"2024-09-12T00:46:03.914527+0000","last_active":"2024-09-12T01:25:03.492017+0000","last_peered":"2024-09-12T01:25:03.492017+0000","last_clean":"2024-09-12T01:25:03.492017+0000","last_became_active":"2024-09-12T00:46:03.914207+0000","last_became_peered":"2024-09-12T00:46:03.914207+0000","last_unstale":"2024-09-12T01:25:03.492017+0000","last_undegraded":"2024-09-12T01:25:03.492017+0000","last_fullsized":"2024-09-12T01:25:03.492017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:53.077898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.508448+0000","last_change":"2024-09-12T01:04:13.466887+0000","last_active":"2024-09-12T01:27:09.508448+0000","last_peered":"2024-09-12T01:27:09.508448+0000","last_clean":"2024-09-12T01:27:09.508448+0000","last_became_active":"2024-09-12T01:04:13.466050+0000","last_became_peered":"2024-09-12T01:04:13.466050+0000","last_unstale":"2024-09-12T01:27:09.508448+0000","last_undegraded":"2024-09-12T01:27:09.508448+0000","last_fullsized":"2024-09-12T01:27:09.508448+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:39.634410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501296+0000","last_change":"2024-09-12T00:48:45.314649+0000","last_active":"2024-09-12T01:26:17.501296+0000","last_peered":"2024-09-12T01:26:17.501296+0000","last_clean":"2024-09-12T01:26:17.501296+0000","last_became_active":"2024-09-12T00:48:45.313692+0000","last_became_peered":"2024-09-12T00:48:45.313692+0000","last_unstale":"2024-09-12T01:26:17.501296+0000","last_undegraded":"2024-09-12T01:26:17.501296+0000","last_fullsized":"2024-09-12T01:26:17.501296+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:19.872019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:23.503219+0000","last_change":"2024-09-12T00:48:42.288243+0000","last_active":"2024-09-12T01:26:23.503219+0000","last_peered":"2024-09-12T01:26:23.503219+0000","last_clean":"2024-09-12T01:26:23.503219+0000","last_became_active":"2024-09-12T00:48:42.287949+0000","last_became_peered":"2024-09-12T00:48:42.287949+0000","last_unstale":"2024-09-12T01:26:23.503219+0000","last_undegraded":"2024-09-12T01:26:23.503219+0000","last_fullsized":"2024-09-12T01:26:23.503219+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:37.161356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'53","reported_seq":194,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714926+0000","last_change":"2024-09-12T00:46:03.918000+0000","last_active":"2024-09-12T01:25:04.714926+0000","last_peered":"2024-09-12T01:25:04.714926+0000","last_clean":"2024-09-12T01:25:04.714926+0000","last_became_active":"2024-09-12T00:46:03.917728+0000","last_became_peered":"2024-09-12T00:46:03.917728+0000","last_unstale":"2024-09-12T01:25:04.714926+0000","last_undegraded":"2024-09-12T01:25:04.714926+0000","last_fullsized":"2024-09-12T01:25:04.714926+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:11.732147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":191,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:22.501894+0000","last_change":"2024-09-12T01:04:13.466462+0000","last_active":"2024-09-12T01:26:22.501894+0000","last_peered":"2024-09-12T01:26:22.501894+0000","last_clean":"2024-09-12T01:26:22.501894+0000","last_became_active":"2024-09-12T01:04:13.466183+0000","last_became_peered":"2024-09-12T01:04:13.466183+0000","last_unstale":"2024-09-12T01:26:22.501894+0000","last_undegraded":"2024-09-12T01:26:22.501894+0000","last_fullsized":"2024-09-12T01:26:22.501894+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:33.706209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.498929+0000","last_change":"2024-09-12T00:48:45.311887+0000","last_active":"2024-09-12T01:25:34.498929+0000","last_peered":"2024-09-12T01:25:34.498929+0000","last_clean":"2024-09-12T01:25:34.498929+0000","last_became_active":"2024-09-12T00:48:45.311453+0000","last_became_peered":"2024-09-12T00:48:45.311453+0000","last_unstale":"2024-09-12T01:25:34.498929+0000","last_undegraded":"2024-09-12T01:25:34.498929+0000","last_fullsized":"2024-09-12T01:25:34.498929+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:34.715672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'1","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.501826+0000","last_change":"2024-09-12T00:48:42.295708+0000","last_active":"2024-09-12T01:25:34.501826+0000","last_peered":"2024-09-12T01:25:34.501826+0000","last_clean":"2024-09-12T01:25:34.501826+0000","last_became_active":"2024-09-12T00:48:42.295358+0000","last_became_peered":"2024-09-12T00:48:42.295358+0000","last_unstale":"2024-09-12T01:25:34.501826+0000","last_undegraded":"2024-09-12T01:25:34.501826+0000","last_fullsized":"2024-09-12T01:25:34.501826+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:21.788554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'81","reported_seq":278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.503935+0000","last_change":"2024-09-12T00:46:03.916339+0000","last_active":"2024-09-12T01:25:54.503935+0000","last_peered":"2024-09-12T01:25:54.503935+0000","last_clean":"2024-09-12T01:25:54.503935+0000","last_became_active":"2024-09-12T00:46:03.916021+0000","last_became_peered":"2024-09-12T00:46:03.916021+0000","last_unstale":"2024-09-12T01:25:54.503935+0000","last_undegraded":"2024-09-12T01:25:54.503935+0000","last_fullsized":"2024-09-12T01:25:54.503935+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:09.221542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":326,"num_write":133,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.731804+0000","last_change":"2024-09-12T01:04:13.466014+0000","last_active":"2024-09-12T01:27:09.731804+0000","last_peered":"2024-09-12T01:27:09.731804+0000","last_clean":"2024-09-12T01:27:09.731804+0000","last_became_active":"2024-09-12T01:04:13.465478+0000","last_became_peered":"2024-09-12T01:04:13.465478+0000","last_unstale":"2024-09-12T01:27:09.731804+0000","last_undegraded":"2024-09-12T01:27:09.731804+0000","last_fullsized":"2024-09-12T01:27:09.731804+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:45.735147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718359+0000","last_change":"2024-09-12T00:48:45.314296+0000","last_active":"2024-09-12T01:25:34.718359+0000","last_peered":"2024-09-12T01:25:34.718359+0000","last_clean":"2024-09-12T01:25:34.718359+0000","last_became_active":"2024-09-12T00:48:45.313057+0000","last_became_peered":"2024-09-12T00:48:45.313057+0000","last_unstale":"2024-09-12T01:25:34.718359+0000","last_undegraded":"2024-09-12T01:25:34.718359+0000","last_fullsized":"2024-09-12T01:25:34.718359+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:38.739439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718378+0000","last_change":"2024-09-12T00:48:42.297183+0000","last_active":"2024-09-12T01:25:34.718378+0000","last_peered":"2024-09-12T01:25:34.718378+0000","last_clean":"2024-09-12T01:25:34.718378+0000","last_became_active":"2024-09-12T00:48:42.296903+0000","last_became_peered":"2024-09-12T00:48:42.296903+0000","last_unstale":"2024-09-12T01:25:34.718378+0000","last_undegraded":"2024-09-12T01:25:34.718378+0000","last_fullsized":"2024-09-12T01:25:34.718378+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:11.352129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'58","reported_seq":244,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:40.778662+0000","last_change":"2024-09-12T00:46:03.917455+0000","last_active":"2024-09-12T01:25:40.778662+0000","last_peered":"2024-09-12T01:25:40.778662+0000","last_clean":"2024-09-12T01:25:40.778662+0000","last_became_active":"2024-09-12T00:46:03.917131+0000","last_became_peered":"2024-09-12T00:46:03.917131+0000","last_unstale":"2024-09-12T01:25:40.778662+0000","last_undegraded":"2024-09-12T01:25:40.778662+0000","last_fullsized":"2024-09-12T01:25:40.778662+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:05.329202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":270,"num_write":80,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.781081+0000","last_change":"2024-09-12T01:04:13.468499+0000","last_active":"2024-09-12T01:25:55.781081+0000","last_peered":"2024-09-12T01:25:55.781081+0000","last_clean":"2024-09-12T01:25:55.781081+0000","last_became_active":"2024-09-12T01:04:13.468116+0000","last_became_peered":"2024-09-12T01:04:13.468116+0000","last_unstale":"2024-09-12T01:25:55.781081+0000","last_undegraded":"2024-09-12T01:25:55.781081+0000","last_fullsized":"2024-09-12T01:25:55.781081+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:15.224566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:18.502441+0000","last_change":"2024-09-12T00:48:45.317145+0000","last_active":"2024-09-12T01:26:18.502441+0000","last_peered":"2024-09-12T01:26:18.502441+0000","last_clean":"2024-09-12T01:26:18.502441+0000","last_became_active":"2024-09-12T00:48:45.316713+0000","last_became_peered":"2024-09-12T00:48:45.316713+0000","last_unstale":"2024-09-12T01:26:18.502441+0000","last_undegraded":"2024-09-12T01:26:18.502441+0000","last_fullsized":"2024-09-12T01:26:18.502441+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:25.736540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096995,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2096,"num_write":8,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'1","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:59.510380+0000","last_change":"2024-09-12T00:48:42.293385+0000","last_active":"2024-09-12T01:26:59.510380+0000","last_peered":"2024-09-12T01:26:59.510380+0000","last_clean":"2024-09-12T01:26:59.510380+0000","last_became_active":"2024-09-12T00:48:42.293111+0000","last_became_peered":"2024-09-12T00:48:42.293111+0000","last_unstale":"2024-09-12T01:26:59.510380+0000","last_undegraded":"2024-09-12T01:26:59.510380+0000","last_fullsized":"2024-09-12T01:26:59.510380+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:17.021932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'34","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.502266+0000","last_change":"2024-09-12T00:46:03.914760+0000","last_active":"2024-09-12T01:25:39.502266+0000","last_peered":"2024-09-12T01:25:39.502266+0000","last_clean":"2024-09-12T01:25:39.502266+0000","last_became_active":"2024-09-12T00:46:03.914387+0000","last_became_peered":"2024-09-12T00:46:03.914387+0000","last_unstale":"2024-09-12T01:25:39.502266+0000","last_undegraded":"2024-09-12T01:25:39.502266+0000","last_fullsized":"2024-09-12T01:25:39.502266+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:56.621300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:53.499141+0000","last_change":"2024-09-12T01:04:13.470882+0000","last_active":"2024-09-12T01:25:53.499141+0000","last_peered":"2024-09-12T01:25:53.499141+0000","last_clean":"2024-09-12T01:25:53.499141+0000","last_became_active":"2024-09-12T01:04:13.470597+0000","last_became_peered":"2024-09-12T01:04:13.470597+0000","last_unstale":"2024-09-12T01:25:53.499141+0000","last_undegraded":"2024-09-12T01:25:53.499141+0000","last_fullsized":"2024-09-12T01:25:53.499141+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:44.301395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:49.729085+0000","last_change":"2024-09-12T00:48:45.316493+0000","last_active":"2024-09-12T01:26:49.729085+0000","last_peered":"2024-09-12T01:26:49.729085+0000","last_clean":"2024-09-12T01:26:49.729085+0000","last_became_active":"2024-09-12T00:48:45.316182+0000","last_became_peered":"2024-09-12T00:48:45.316182+0000","last_unstale":"2024-09-12T01:26:49.729085+0000","last_undegraded":"2024-09-12T01:26:49.729085+0000","last_fullsized":"2024-09-12T01:26:49.729085+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:51.175017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"265'2","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.724957+0000","last_change":"2024-09-12T00:48:42.294249+0000","last_active":"2024-09-12T01:26:14.724957+0000","last_peered":"2024-09-12T01:26:14.724957+0000","last_clean":"2024-09-12T01:26:14.724957+0000","last_became_active":"2024-09-12T00:48:42.293947+0000","last_became_peered":"2024-09-12T00:48:42.293947+0000","last_unstale":"2024-09-12T01:26:14.724957+0000","last_undegraded":"2024-09-12T01:26:14.724957+0000","last_fullsized":"2024-09-12T01:26:14.724957+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:38.623578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'54","reported_seq":194,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.718948+0000","last_change":"2024-09-12T00:46:03.919567+0000","last_active":"2024-09-12T01:25:39.718948+0000","last_peered":"2024-09-12T01:25:39.718948+0000","last_clean":"2024-09-12T01:25:39.718948+0000","last_became_active":"2024-09-12T00:46:03.919285+0000","last_became_peered":"2024-09-12T00:46:03.919285+0000","last_unstale":"2024-09-12T01:25:39.718948+0000","last_undegraded":"2024-09-12T01:25:39.718948+0000","last_fullsized":"2024-09-12T01:25:39.718948+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:47.685991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":102,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:07.489938+0000","last_change":"2024-09-12T01:04:13.467623+0000","last_active":"2024-09-12T01:25:07.489938+0000","last_peered":"2024-09-12T01:25:07.489938+0000","last_clean":"2024-09-12T01:25:07.489938+0000","last_became_active":"2024-09-12T01:04:13.467374+0000","last_became_peered":"2024-09-12T01:04:13.467374+0000","last_unstale":"2024-09-12T01:25:07.489938+0000","last_undegraded":"2024-09-12T01:25:07.489938+0000","last_fullsized":"2024-09-12T01:25:07.489938+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:34.421544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505968+0000","last_change":"2024-09-12T00:48:45.310759+0000","last_active":"2024-09-12T01:26:14.505968+0000","last_peered":"2024-09-12T01:26:14.505968+0000","last_clean":"2024-09-12T01:26:14.505968+0000","last_became_active":"2024-09-12T00:48:45.310423+0000","last_became_peered":"2024-09-12T00:48:45.310423+0000","last_unstale":"2024-09-12T01:26:14.505968+0000","last_undegraded":"2024-09-12T01:26:14.505968+0000","last_fullsized":"2024-09-12T01:26:14.505968+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:13.622431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639581+0000","last_change":"2024-09-12T00:48:42.296171+0000","last_active":"2024-09-12T01:26:15.639581+0000","last_peered":"2024-09-12T01:26:15.639581+0000","last_clean":"2024-09-12T01:26:15.639581+0000","last_became_active":"2024-09-12T00:48:42.295861+0000","last_became_peered":"2024-09-12T00:48:42.295861+0000","last_unstale":"2024-09-12T01:26:15.639581+0000","last_undegraded":"2024-09-12T01:26:15.639581+0000","last_fullsized":"2024-09-12T01:26:15.639581+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:57.732050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.718904+0000","last_change":"2024-09-12T00:46:03.919535+0000","last_active":"2024-09-12T01:25:39.718904+0000","last_peered":"2024-09-12T01:25:39.718904+0000","last_clean":"2024-09-12T01:25:39.718904+0000","last_became_active":"2024-09-12T00:46:03.917353+0000","last_became_peered":"2024-09-12T00:46:03.917353+0000","last_unstale":"2024-09-12T01:25:39.718904+0000","last_undegraded":"2024-09-12T01:25:39.718904+0000","last_fullsized":"2024-09-12T01:25:39.718904+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:22.130628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":151,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.731874+0000","last_change":"2024-09-12T01:04:13.467110+0000","last_active":"2024-09-12T01:27:09.731874+0000","last_peered":"2024-09-12T01:27:09.731874+0000","last_clean":"2024-09-12T01:27:09.731874+0000","last_became_active":"2024-09-12T01:04:13.466783+0000","last_became_peered":"2024-09-12T01:04:13.466783+0000","last_unstale":"2024-09-12T01:27:09.731874+0000","last_undegraded":"2024-09-12T01:27:09.731874+0000","last_fullsized":"2024-09-12T01:27:09.731874+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:53.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505931+0000","last_change":"2024-09-12T00:48:45.312610+0000","last_active":"2024-09-12T01:26:14.505931+0000","last_peered":"2024-09-12T01:26:14.505931+0000","last_clean":"2024-09-12T01:26:14.505931+0000","last_became_active":"2024-09-12T00:48:45.312329+0000","last_became_peered":"2024-09-12T00:48:45.312329+0000","last_unstale":"2024-09-12T01:26:14.505931+0000","last_undegraded":"2024-09-12T01:26:14.505931+0000","last_fullsized":"2024-09-12T01:26:14.505931+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:29.308504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'1","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.606674+0000","last_change":"2024-09-12T00:48:42.286718+0000","last_active":"2024-09-12T01:26:14.606674+0000","last_peered":"2024-09-12T01:26:14.606674+0000","last_clean":"2024-09-12T01:26:14.606674+0000","last_became_active":"2024-09-12T00:48:42.286427+0000","last_became_peered":"2024-09-12T00:48:42.286427+0000","last_unstale":"2024-09-12T01:26:14.606674+0000","last_undegraded":"2024-09-12T01:26:14.606674+0000","last_fullsized":"2024-09-12T01:26:14.606674+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:46.315650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'46","reported_seq":175,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:19.506448+0000","last_change":"2024-09-12T00:46:03.919531+0000","last_active":"2024-09-12T01:26:19.506448+0000","last_peered":"2024-09-12T01:26:19.506448+0000","last_clean":"2024-09-12T01:26:19.506448+0000","last_became_active":"2024-09-12T00:46:03.919259+0000","last_became_peered":"2024-09-12T00:46:03.919259+0000","last_unstale":"2024-09-12T01:26:19.506448+0000","last_undegraded":"2024-09-12T01:26:19.506448+0000","last_fullsized":"2024-09-12T01:26:19.506448+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:12.310694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":85,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'325","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.379242+0000","last_change":"2024-09-12T00:31:47.138230+0000","last_active":"2024-09-12T01:29:14.379242+0000","last_peered":"2024-09-12T01:29:14.379242+0000","last_clean":"2024-09-12T01:29:14.379242+0000","last_became_active":"2024-09-12T00:31:47.137895+0000","last_became_peered":"2024-09-12T00:31:47.137895+0000","last_unstale":"2024-09-12T01:29:14.379242+0000","last_undegraded":"2024-09-12T01:29:14.379242+0000","last_fullsized":"2024-09-12T01:29:14.379242+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:28.486538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10494761,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":695,"num_read_kb":31522,"num_write":1230,"num_write_kb":24718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'194","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:36.623263+0000","last_change":"2024-09-12T00:31:50.138500+0000","last_active":"2024-09-12T01:26:36.623263+0000","last_peered":"2024-09-12T01:26:36.623263+0000","last_clean":"2024-09-12T01:26:36.623263+0000","last_became_active":"2024-09-12T00:31:50.138226+0000","last_became_peered":"2024-09-12T00:31:50.138226+0000","last_unstale":"2024-09-12T01:26:36.623263+0000","last_undegraded":"2024-09-12T01:26:36.623263+0000","last_fullsized":"2024-09-12T01:26:36.623263+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:11.080078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":913,"num_read_kb":766,"num_write":296,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'253","reported_seq":880,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:37.685001+0000","last_change":"2024-09-12T00:31:47.134970+0000","last_active":"2024-09-12T01:26:37.685001+0000","last_peered":"2024-09-12T01:26:37.685001+0000","last_clean":"2024-09-12T01:26:37.685001+0000","last_became_active":"2024-09-12T00:31:47.134134+0000","last_became_peered":"2024-09-12T00:31:47.134134+0000","last_unstale":"2024-09-12T01:26:37.685001+0000","last_undegraded":"2024-09-12T01:26:37.685001+0000","last_fullsized":"2024-09-12T01:26:37.685001+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:05.214195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10692408,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":402,"num_read_kb":16965,"num_write":957,"num_write_kb":26995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'110","reported_seq":704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.740242+0000","last_change":"2024-09-12T00:31:50.132884+0000","last_active":"2024-09-12T01:25:44.740242+0000","last_peered":"2024-09-12T01:25:44.740242+0000","last_clean":"2024-09-12T01:25:44.740242+0000","last_became_active":"2024-09-12T00:31:50.132639+0000","last_became_peered":"2024-09-12T00:31:50.132639+0000","last_unstale":"2024-09-12T01:25:44.740242+0000","last_undegraded":"2024-09-12T01:25:44.740242+0000","last_fullsized":"2024-09-12T01:25:44.740242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:24.512638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":165,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'310","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:25.656621+0000","last_change":"2024-09-12T00:31:47.120188+0000","last_active":"2024-09-12T01:26:25.656621+0000","last_peered":"2024-09-12T01:26:25.656621+0000","last_clean":"2024-09-12T01:26:25.656621+0000","last_became_active":"2024-09-12T00:31:47.119865+0000","last_became_peered":"2024-09-12T00:31:47.119865+0000","last_unstale":"2024-09-12T01:26:25.656621+0000","last_undegraded":"2024-09-12T01:26:25.656621+0000","last_fullsized":"2024-09-12T01:26:25.656621+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:42.752369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5588563,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":782,"num_read_kb":4429,"num_write":1123,"num_write_kb":10543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'286","reported_seq":935,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:08.062655+0000","last_change":"2024-09-12T00:31:50.135767+0000","last_active":"2024-09-12T01:25:08.062655+0000","last_peered":"2024-09-12T01:25:08.062655+0000","last_clean":"2024-09-12T01:25:08.062655+0000","last_became_active":"2024-09-12T00:31:50.135413+0000","last_became_peered":"2024-09-12T00:31:50.135413+0000","last_unstale":"2024-09-12T01:25:08.062655+0000","last_undegraded":"2024-09-12T01:25:08.062655+0000","last_fullsized":"2024-09-12T01:25:08.062655+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:32.753854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1012,"num_write":455,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'263","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.358786+0000","last_change":"2024-09-12T00:31:47.133763+0000","last_active":"2024-09-12T01:29:14.358786+0000","last_peered":"2024-09-12T01:29:14.358786+0000","last_clean":"2024-09-12T01:29:14.358786+0000","last_became_active":"2024-09-12T00:31:47.133414+0000","last_became_peered":"2024-09-12T00:31:47.133414+0000","last_unstale":"2024-09-12T01:29:14.358786+0000","last_undegraded":"2024-09-12T01:29:14.358786+0000","last_fullsized":"2024-09-12T01:29:14.358786+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:03.831657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17529054,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":413,"num_read_kb":32236,"num_write":1002,"num_write_kb":37937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'183","reported_seq":785,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:17.241665+0000","last_change":"2024-09-12T00:31:50.135590+0000","last_active":"2024-09-12T01:27:17.241665+0000","last_peered":"2024-09-12T01:27:17.241665+0000","last_clean":"2024-09-12T01:27:17.241665+0000","last_became_active":"2024-09-12T00:31:50.135322+0000","last_became_peered":"2024-09-12T00:31:50.135322+0000","last_unstale":"2024-09-12T01:27:17.241665+0000","last_undegraded":"2024-09-12T01:27:17.241665+0000","last_fullsized":"2024-09-12T01:27:17.241665+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.974784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":591,"num_write":296,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'261","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:32.836957+0000","last_change":"2024-09-12T00:31:47.129759+0000","last_active":"2024-09-12T01:26:32.836957+0000","last_peered":"2024-09-12T01:26:32.836957+0000","last_clean":"2024-09-12T01:26:32.836957+0000","last_became_active":"2024-09-12T00:31:47.128016+0000","last_became_peered":"2024-09-12T00:31:47.128016+0000","last_unstale":"2024-09-12T01:26:32.836957+0000","last_undegraded":"2024-09-12T01:26:32.836957+0000","last_fullsized":"2024-09-12T01:26:32.836957+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:57.514060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506790,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":400,"num_read_kb":35042,"num_write":990,"num_write_kb":20184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'220","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.501392+0000","last_change":"2024-09-12T00:31:50.132960+0000","last_active":"2024-09-12T01:25:59.501392+0000","last_peered":"2024-09-12T01:25:59.501392+0000","last_clean":"2024-09-12T01:25:59.501392+0000","last_became_active":"2024-09-12T00:31:50.132674+0000","last_became_peered":"2024-09-12T00:31:50.132674+0000","last_unstale":"2024-09-12T01:25:59.501392+0000","last_undegraded":"2024-09-12T01:25:59.501392+0000","last_fullsized":"2024-09-12T01:25:59.501392+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:49.251283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":967,"num_read_kb":781,"num_write":356,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'300","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:01.812214+0000","last_change":"2024-09-12T00:31:47.135231+0000","last_active":"2024-09-12T01:27:01.812214+0000","last_peered":"2024-09-12T01:27:01.812214+0000","last_clean":"2024-09-12T01:27:01.812214+0000","last_became_active":"2024-09-12T00:31:47.134887+0000","last_became_peered":"2024-09-12T00:31:47.134887+0000","last_unstale":"2024-09-12T01:27:01.812214+0000","last_undegraded":"2024-09-12T01:27:01.812214+0000","last_fullsized":"2024-09-12T01:27:01.812214+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:00.830296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5598308,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":444,"num_read_kb":3274,"num_write":1158,"num_write_kb":38824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'275","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.501413+0000","last_change":"2024-09-12T00:31:50.140357+0000","last_active":"2024-09-12T01:25:59.501413+0000","last_peered":"2024-09-12T01:25:59.501413+0000","last_clean":"2024-09-12T01:25:59.501413+0000","last_became_active":"2024-09-12T00:31:50.140087+0000","last_became_peered":"2024-09-12T00:31:50.140087+0000","last_unstale":"2024-09-12T01:25:59.501413+0000","last_undegraded":"2024-09-12T01:25:59.501413+0000","last_fullsized":"2024-09-12T01:25:59.501413+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:30.983237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1141,"num_read_kb":956,"num_write":415,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'354","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.645896+0000","last_change":"2024-09-12T00:32:23.831062+0000","last_active":"2024-09-12T01:29:15.645896+0000","last_peered":"2024-09-12T01:29:15.645896+0000","last_clean":"2024-09-12T01:29:15.645896+0000","last_became_active":"2024-09-12T00:32:23.830676+0000","last_became_peered":"2024-09-12T00:32:23.830676+0000","last_unstale":"2024-09-12T01:29:15.645896+0000","last_undegraded":"2024-09-12T01:29:15.645896+0000","last_fullsized":"2024-09-12T01:29:15.645896+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:35.456863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8561348,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":531,"num_read_kb":5769,"num_write":1218,"num_write_kb":23845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3e","version":"265'51","reported_seq":590,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:47.570442+0000","last_change":"2024-09-12T00:31:50.140487+0000","last_active":"2024-09-12T01:26:47.570442+0000","last_peered":"2024-09-12T01:26:47.570442+0000","last_clean":"2024-09-12T01:26:47.570442+0000","last_became_active":"2024-09-12T00:31:50.140207+0000","last_became_peered":"2024-09-12T00:31:50.140207+0000","last_unstale":"2024-09-12T01:26:47.570442+0000","last_undegraded":"2024-09-12T01:26:47.570442+0000","last_fullsized":"2024-09-12T01:26:47.570442+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:00.343009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":145,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'326","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:53.274186+0000","last_change":"2024-09-12T00:31:47.128251+0000","last_active":"2024-09-12T01:25:53.274186+0000","last_peered":"2024-09-12T01:25:53.274186+0000","last_clean":"2024-09-12T01:25:53.274186+0000","last_became_active":"2024-09-12T00:31:47.127930+0000","last_became_peered":"2024-09-12T00:31:47.127930+0000","last_unstale":"2024-09-12T01:25:53.274186+0000","last_undegraded":"2024-09-12T01:25:53.274186+0000","last_fullsized":"2024-09-12T01:25:53.274186+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:52.713325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7291840,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":578,"num_read_kb":6944,"num_write":1402,"num_write_kb":29009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'96","reported_seq":688,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498691+0000","last_change":"2024-09-12T00:31:50.142364+0000","last_active":"2024-09-12T01:26:02.498691+0000","last_peered":"2024-09-12T01:26:02.498691+0000","last_clean":"2024-09-12T01:26:02.498691+0000","last_became_active":"2024-09-12T00:31:50.142071+0000","last_became_peered":"2024-09-12T00:31:50.142071+0000","last_unstale":"2024-09-12T01:26:02.498691+0000","last_undegraded":"2024-09-12T01:26:02.498691+0000","last_fullsized":"2024-09-12T01:26:02.498691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:46.856124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":364,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'86","reported_seq":690,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:29.717727+0000","last_change":"2024-09-12T00:31:50.132450+0000","last_active":"2024-09-12T01:25:29.717727+0000","last_peered":"2024-09-12T01:25:29.717727+0000","last_clean":"2024-09-12T01:25:29.717727+0000","last_became_active":"2024-09-12T00:31:50.132178+0000","last_became_peered":"2024-09-12T00:31:50.132178+0000","last_unstale":"2024-09-12T01:25:29.717727+0000","last_undegraded":"2024-09-12T01:25:29.717727+0000","last_fullsized":"2024-09-12T01:25:29.717727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:34.527456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":346,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'277","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:34.516236+0000","last_change":"2024-09-12T00:31:47.124269+0000","last_active":"2024-09-12T01:27:34.516236+0000","last_peered":"2024-09-12T01:27:34.516236+0000","last_clean":"2024-09-12T01:27:34.516236+0000","last_became_active":"2024-09-12T00:31:47.123956+0000","last_became_peered":"2024-09-12T00:31:47.123956+0000","last_unstale":"2024-09-12T01:27:34.516236+0000","last_undegraded":"2024-09-12T01:27:34.516236+0000","last_fullsized":"2024-09-12T01:27:34.516236+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:27.189976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5878961,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":427,"num_read_kb":32458,"num_write":1071,"num_write_kb":22794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'162","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.544138+0000","last_change":"2024-09-12T00:31:50.131280+0000","last_active":"2024-09-12T01:27:47.544138+0000","last_peered":"2024-09-12T01:27:47.544138+0000","last_clean":"2024-09-12T01:27:47.544138+0000","last_became_active":"2024-09-12T00:31:50.130844+0000","last_became_peered":"2024-09-12T00:31:50.130844+0000","last_unstale":"2024-09-12T01:27:47.544138+0000","last_undegraded":"2024-09-12T01:27:47.544138+0000","last_fullsized":"2024-09-12T01:27:47.544138+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:38.260983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":634,"num_write":246,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'208","reported_seq":801,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:25.023002+0000","last_change":"2024-09-12T00:31:47.128649+0000","last_active":"2024-09-12T01:27:25.023002+0000","last_peered":"2024-09-12T01:27:25.023002+0000","last_clean":"2024-09-12T01:27:25.023002+0000","last_became_active":"2024-09-12T00:31:47.127400+0000","last_became_peered":"2024-09-12T00:31:47.127400+0000","last_unstale":"2024-09-12T01:27:25.023002+0000","last_undegraded":"2024-09-12T01:27:25.023002+0000","last_fullsized":"2024-09-12T01:27:25.023002+0000","mapping_epoch":24,"log_start":"265'100","ondisk_log_start":"265'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:24.774467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14792923,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":268,"num_read_kb":20510,"num_write":744,"num_write_kb":47522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'404","reported_seq":1170,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.602445+0000","last_change":"2024-09-12T00:31:50.142651+0000","last_active":"2024-09-12T01:25:34.602445+0000","last_peered":"2024-09-12T01:25:34.602445+0000","last_clean":"2024-09-12T01:25:34.602445+0000","last_became_active":"2024-09-12T00:31:50.142337+0000","last_became_peered":"2024-09-12T00:31:50.142337+0000","last_unstale":"2024-09-12T01:25:34.602445+0000","last_undegraded":"2024-09-12T01:25:34.602445+0000","last_fullsized":"2024-09-12T01:25:34.602445+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.221186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1845,"num_write":683,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'266","reported_seq":882,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:24.510017+0000","last_change":"2024-09-12T00:31:47.139796+0000","last_active":"2024-09-12T01:27:24.510017+0000","last_peered":"2024-09-12T01:27:24.510017+0000","last_clean":"2024-09-12T01:27:24.510017+0000","last_became_active":"2024-09-12T00:31:47.139517+0000","last_became_peered":"2024-09-12T00:31:47.139517+0000","last_unstale":"2024-09-12T01:27:24.510017+0000","last_undegraded":"2024-09-12T01:27:24.510017+0000","last_fullsized":"2024-09-12T01:27:24.510017+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:34.384825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7088137,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":420,"num_read_kb":6586,"num_write":1040,"num_write_kb":25928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'147","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:00.628254+0000","last_change":"2024-09-12T00:31:50.142590+0000","last_active":"2024-09-12T01:25:00.628254+0000","last_peered":"2024-09-12T01:25:00.628254+0000","last_clean":"2024-09-12T01:25:00.628254+0000","last_became_active":"2024-09-12T00:31:50.142311+0000","last_became_peered":"2024-09-12T00:31:50.142311+0000","last_unstale":"2024-09-12T01:25:00.628254+0000","last_undegraded":"2024-09-12T01:25:00.628254+0000","last_fullsized":"2024-09-12T01:25:00.628254+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:15.132325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":237,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'198","reported_seq":818,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:24.509970+0000","last_change":"2024-09-12T00:31:47.130745+0000","last_active":"2024-09-12T01:27:24.509970+0000","last_peered":"2024-09-12T01:27:24.509970+0000","last_clean":"2024-09-12T01:27:24.509970+0000","last_became_active":"2024-09-12T00:31:47.130329+0000","last_became_peered":"2024-09-12T00:31:47.130329+0000","last_unstale":"2024-09-12T01:27:24.509970+0000","last_undegraded":"2024-09-12T01:27:24.509970+0000","last_fullsized":"2024-09-12T01:27:24.509970+0000","mapping_epoch":24,"log_start":"265'100","ondisk_log_start":"265'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:26.579124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18157375,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":334,"num_read_kb":37642,"num_write":701,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'112","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:33.595038+0000","last_change":"2024-09-12T00:31:50.136264+0000","last_active":"2024-09-12T01:26:33.595038+0000","last_peered":"2024-09-12T01:26:33.595038+0000","last_clean":"2024-09-12T01:26:33.595038+0000","last_became_active":"2024-09-12T00:31:50.135595+0000","last_became_peered":"2024-09-12T00:31:50.135595+0000","last_unstale":"2024-09-12T01:26:33.595038+0000","last_undegraded":"2024-09-12T01:26:33.595038+0000","last_fullsized":"2024-09-12T01:26:33.595038+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:16.754941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":410,"num_write":180,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'294","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.637796+0000","last_change":"2024-09-12T00:31:47.133955+0000","last_active":"2024-09-12T01:29:15.637796+0000","last_peered":"2024-09-12T01:29:15.637796+0000","last_clean":"2024-09-12T01:29:15.637796+0000","last_became_active":"2024-09-12T00:31:47.133592+0000","last_became_peered":"2024-09-12T00:31:47.133592+0000","last_unstale":"2024-09-12T01:29:15.637796+0000","last_undegraded":"2024-09-12T01:29:15.637796+0000","last_fullsized":"2024-09-12T01:29:15.637796+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:40.772744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1790643,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":759,"num_read_kb":29951,"num_write":1057,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'73","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.598762+0000","last_change":"2024-09-12T00:31:50.136540+0000","last_active":"2024-09-12T01:24:59.598762+0000","last_peered":"2024-09-12T01:24:59.598762+0000","last_clean":"2024-09-12T01:24:59.598762+0000","last_became_active":"2024-09-12T00:31:50.135972+0000","last_became_peered":"2024-09-12T00:31:50.135972+0000","last_unstale":"2024-09-12T01:24:59.598762+0000","last_undegraded":"2024-09-12T01:24:59.598762+0000","last_fullsized":"2024-09-12T01:24:59.598762+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:26.791352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":249,"num_write":116,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'286","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.618013+0000","last_change":"2024-09-12T00:31:47.118600+0000","last_active":"2024-09-12T01:29:15.618013+0000","last_peered":"2024-09-12T01:29:15.618013+0000","last_clean":"2024-09-12T01:29:15.618013+0000","last_became_active":"2024-09-12T00:31:47.118260+0000","last_became_peered":"2024-09-12T00:31:47.118260+0000","last_unstale":"2024-09-12T01:29:15.618013+0000","last_undegraded":"2024-09-12T01:29:15.618013+0000","last_fullsized":"2024-09-12T01:29:15.618013+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:15.699024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244189,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":420,"num_read_kb":15045,"num_write":955,"num_write_kb":26498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'123","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.422976+0000","last_change":"2024-09-12T00:31:58.184465+0000","last_active":"2024-09-12T01:27:48.422976+0000","last_peered":"2024-09-12T01:27:48.422976+0000","last_clean":"2024-09-12T01:27:48.422976+0000","last_became_active":"2024-09-12T00:31:58.183784+0000","last_became_peered":"2024-09-12T00:31:58.183784+0000","last_unstale":"2024-09-12T01:27:48.422976+0000","last_undegraded":"2024-09-12T01:27:48.422976+0000","last_fullsized":"2024-09-12T01:27:48.422976+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:03.783137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":134,"num_write":297,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'229","reported_seq":832,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:53.682612+0000","last_change":"2024-09-12T00:31:50.140765+0000","last_active":"2024-09-12T01:25:53.682612+0000","last_peered":"2024-09-12T01:25:53.682612+0000","last_clean":"2024-09-12T01:25:53.682612+0000","last_became_active":"2024-09-12T00:31:50.140510+0000","last_became_peered":"2024-09-12T00:31:50.140510+0000","last_unstale":"2024-09-12T01:25:53.682612+0000","last_undegraded":"2024-09-12T01:25:53.682612+0000","last_fullsized":"2024-09-12T01:25:53.682612+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:35.280733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":944,"num_read_kb":762,"num_write":358,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'276","reported_seq":888,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.724174+0000","last_change":"2024-09-12T00:31:47.132262+0000","last_active":"2024-09-12T01:29:14.724174+0000","last_peered":"2024-09-12T01:29:14.724174+0000","last_clean":"2024-09-12T01:29:14.724174+0000","last_became_active":"2024-09-12T00:31:47.131940+0000","last_became_peered":"2024-09-12T00:31:47.131940+0000","last_unstale":"2024-09-12T01:29:14.724174+0000","last_undegraded":"2024-09-12T01:29:14.724174+0000","last_fullsized":"2024-09-12T01:29:14.724174+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:02.642276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243583,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":409,"num_read_kb":415,"num_write":1007,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714895+0000","last_change":"2024-09-12T00:31:52.153386+0000","last_active":"2024-09-12T01:25:04.714895+0000","last_peered":"2024-09-12T01:25:04.714895+0000","last_clean":"2024-09-12T01:25:04.714895+0000","last_became_active":"2024-09-12T00:31:52.151351+0000","last_became_peered":"2024-09-12T00:31:52.151351+0000","last_unstale":"2024-09-12T01:25:04.714895+0000","last_undegraded":"2024-09-12T01:25:04.714895+0000","last_fullsized":"2024-09-12T01:25:04.714895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.711260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'336","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.322764+0000","last_change":"2024-09-12T00:31:54.168796+0000","last_active":"2024-09-12T01:27:48.322764+0000","last_peered":"2024-09-12T01:27:48.322764+0000","last_clean":"2024-09-12T01:27:48.322764+0000","last_became_active":"2024-09-12T00:31:54.168545+0000","last_became_peered":"2024-09-12T00:31:54.168545+0000","last_unstale":"2024-09-12T01:27:48.322764+0000","last_undegraded":"2024-09-12T01:27:48.322764+0000","last_fullsized":"2024-09-12T01:27:48.322764+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:43.289137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51574,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":533,"num_read_kb":986,"num_write":420,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:09.599902+0000","last_change":"2024-09-12T00:31:56.171140+0000","last_active":"2024-09-12T01:25:09.599902+0000","last_peered":"2024-09-12T01:25:09.599902+0000","last_clean":"2024-09-12T01:25:09.599902+0000","last_became_active":"2024-09-12T00:31:56.170837+0000","last_became_peered":"2024-09-12T00:31:56.170837+0000","last_unstale":"2024-09-12T01:25:09.599902+0000","last_undegraded":"2024-09-12T01:25:09.599902+0000","last_fullsized":"2024-09-12T01:25:09.599902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:56.785552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2464","reported_seq":4352,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.990962+0000","last_change":"2024-09-12T00:31:58.182713+0000","last_active":"2024-09-12T01:27:47.990962+0000","last_peered":"2024-09-12T01:27:47.990962+0000","last_clean":"2024-09-12T01:27:47.990962+0000","last_became_active":"2024-09-12T00:31:58.181552+0000","last_became_peered":"2024-09-12T00:31:58.181552+0000","last_unstale":"2024-09-12T01:27:47.990962+0000","last_undegraded":"2024-09-12T01:27:47.990962+0000","last_fullsized":"2024-09-12T01:27:47.990962+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":2400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:59.050279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":617,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6112,"num_read_kb":6115,"num_write":4931,"num_write_kb":1807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'4138","reported_seq":4750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:22.543653+0000","last_change":"2024-09-12T00:31:50.133655+0000","last_active":"2024-09-12T01:25:22.543653+0000","last_peered":"2024-09-12T01:25:22.543653+0000","last_clean":"2024-09-12T01:25:22.543653+0000","last_became_active":"2024-09-12T00:31:50.133357+0000","last_became_peered":"2024-09-12T00:31:50.133357+0000","last_unstale":"2024-09-12T01:25:22.543653+0000","last_undegraded":"2024-09-12T01:25:22.543653+0000","last_fullsized":"2024-09-12T01:25:22.543653+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":3000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:23.138805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16657,"num_read_kb":13895,"num_write":6209,"num_write_kb":3095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'271","reported_seq":878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.596431+0000","last_change":"2024-09-12T00:31:47.132203+0000","last_active":"2024-09-12T01:29:15.596431+0000","last_peered":"2024-09-12T01:29:15.596431+0000","last_clean":"2024-09-12T01:29:15.596431+0000","last_became_active":"2024-09-12T00:31:47.131849+0000","last_became_peered":"2024-09-12T00:31:47.131849+0000","last_unstale":"2024-09-12T01:29:15.596431+0000","last_undegraded":"2024-09-12T01:29:15.596431+0000","last_fullsized":"2024-09-12T01:29:15.596431+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:09.334142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244035,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":380,"num_read_kb":4533,"num_write":921,"num_write_kb":25027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:48.498477+0000","last_change":"2024-09-12T00:31:52.153157+0000","last_active":"2024-09-12T01:25:48.498477+0000","last_peered":"2024-09-12T01:25:48.498477+0000","last_clean":"2024-09-12T01:25:48.498477+0000","last_became_active":"2024-09-12T00:31:52.152244+0000","last_became_peered":"2024-09-12T00:31:52.152244+0000","last_unstale":"2024-09-12T01:25:48.498477+0000","last_undegraded":"2024-09-12T01:25:48.498477+0000","last_fullsized":"2024-09-12T01:25:48.498477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:13.492533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'94","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.599360+0000","last_change":"2024-09-12T00:31:54.167561+0000","last_active":"2024-09-12T01:25:04.599360+0000","last_peered":"2024-09-12T01:25:04.599360+0000","last_clean":"2024-09-12T01:25:04.599360+0000","last_became_active":"2024-09-12T00:31:54.167260+0000","last_became_peered":"2024-09-12T00:31:54.167260+0000","last_unstale":"2024-09-12T01:25:04.599360+0000","last_undegraded":"2024-09-12T01:25:04.599360+0000","last_fullsized":"2024-09-12T01:25:04.599360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:28.995792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":103,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:09.599867+0000","last_change":"2024-09-12T00:31:56.174756+0000","last_active":"2024-09-12T01:25:09.599867+0000","last_peered":"2024-09-12T01:25:09.599867+0000","last_clean":"2024-09-12T01:25:09.599867+0000","last_became_active":"2024-09-12T00:31:56.174452+0000","last_became_peered":"2024-09-12T00:31:56.174452+0000","last_unstale":"2024-09-12T01:25:09.599867+0000","last_undegraded":"2024-09-12T01:25:09.599867+0000","last_fullsized":"2024-09-12T01:25:09.599867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:05.497151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'144","reported_seq":638,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646008+0000","last_change":"2024-09-12T00:31:58.179079+0000","last_active":"2024-09-12T01:27:00.646008+0000","last_peered":"2024-09-12T01:27:00.646008+0000","last_clean":"2024-09-12T01:27:00.646008+0000","last_became_active":"2024-09-12T00:31:58.178748+0000","last_became_peered":"2024-09-12T00:31:58.178748+0000","last_unstale":"2024-09-12T01:27:00.646008+0000","last_undegraded":"2024-09-12T01:27:00.646008+0000","last_fullsized":"2024-09-12T01:27:00.646008+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:32.414870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":137,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'401","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:02.489318+0000","last_change":"2024-09-12T00:31:50.143909+0000","last_active":"2024-09-12T01:25:02.489318+0000","last_peered":"2024-09-12T01:25:02.489318+0000","last_clean":"2024-09-12T01:25:02.489318+0000","last_became_active":"2024-09-12T00:31:50.143399+0000","last_became_peered":"2024-09-12T00:31:50.143399+0000","last_unstale":"2024-09-12T01:25:02.489318+0000","last_undegraded":"2024-09-12T01:25:02.489318+0000","last_fullsized":"2024-09-12T01:25:02.489318+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:22.288197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1799,"num_read_kb":1492,"num_write":673,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'310","reported_seq":1090,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.597359+0000","last_change":"2024-09-12T00:32:23.831526+0000","last_active":"2024-09-12T01:29:15.597359+0000","last_peered":"2024-09-12T01:29:15.597359+0000","last_clean":"2024-09-12T01:29:15.597359+0000","last_became_active":"2024-09-12T00:32:23.830863+0000","last_became_peered":"2024-09-12T00:32:23.830863+0000","last_unstale":"2024-09-12T01:29:15.597359+0000","last_undegraded":"2024-09-12T01:29:15.597359+0000","last_fullsized":"2024-09-12T01:29:15.597359+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569571,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":845,"num_read_kb":9184,"num_write":1014,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:03.492033+0000","last_change":"2024-09-12T00:31:52.154402+0000","last_active":"2024-09-12T01:25:03.492033+0000","last_peered":"2024-09-12T01:25:03.492033+0000","last_clean":"2024-09-12T01:25:03.492033+0000","last_became_active":"2024-09-12T00:31:52.154077+0000","last_became_peered":"2024-09-12T00:31:52.154077+0000","last_unstale":"2024-09-12T01:25:03.492033+0000","last_undegraded":"2024-09-12T01:25:03.492033+0000","last_fullsized":"2024-09-12T01:25:03.492033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:27.520584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'119","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:48.498488+0000","last_change":"2024-09-12T00:31:54.164132+0000","last_active":"2024-09-12T01:25:48.498488+0000","last_peered":"2024-09-12T01:25:48.498488+0000","last_clean":"2024-09-12T01:25:48.498488+0000","last_became_active":"2024-09-12T00:31:54.163434+0000","last_became_peered":"2024-09-12T00:31:54.163434+0000","last_unstale":"2024-09-12T01:25:48.498488+0000","last_undegraded":"2024-09-12T01:25:48.498488+0000","last_fullsized":"2024-09-12T01:25:48.498488+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:14.391704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":152,"num_read_kb":145,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'781","reported_seq":4219,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.295304+0000","last_change":"2024-09-12T00:31:56.171437+0000","last_active":"2024-09-12T01:29:14.295304+0000","last_peered":"2024-09-12T01:29:14.295304+0000","last_clean":"2024-09-12T01:29:14.295304+0000","last_became_active":"2024-09-12T00:31:56.171157+0000","last_became_peered":"2024-09-12T00:31:56.171157+0000","last_unstale":"2024-09-12T01:29:14.295304+0000","last_undegraded":"2024-09-12T01:29:14.295304+0000","last_fullsized":"2024-09-12T01:29:14.295304+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:03.870161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'201","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.663408+0000","last_change":"2024-09-12T00:31:58.179919+0000","last_active":"2024-09-12T01:27:47.663408+0000","last_peered":"2024-09-12T01:27:47.663408+0000","last_clean":"2024-09-12T01:27:47.663408+0000","last_became_active":"2024-09-12T00:31:58.179576+0000","last_became_peered":"2024-09-12T00:31:58.179576+0000","last_unstale":"2024-09-12T01:27:47.663408+0000","last_undegraded":"2024-09-12T01:27:47.663408+0000","last_fullsized":"2024-09-12T01:27:47.663408+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:00.446809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":631,"num_write":454,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'417","reported_seq":1156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:25.005608+0000","last_change":"2024-09-12T00:31:50.140975+0000","last_active":"2024-09-12T01:27:25.005608+0000","last_peered":"2024-09-12T01:27:25.005608+0000","last_clean":"2024-09-12T01:27:25.005608+0000","last_became_active":"2024-09-12T00:31:50.140485+0000","last_became_peered":"2024-09-12T00:31:50.140485+0000","last_unstale":"2024-09-12T01:27:25.005608+0000","last_undegraded":"2024-09-12T01:27:25.005608+0000","last_fullsized":"2024-09-12T01:27:25.005608+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:37.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2003,"num_read_kb":1658,"num_write":744,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'255","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.354425+0000","last_change":"2024-09-12T00:31:47.125806+0000","last_active":"2024-09-12T01:29:14.354425+0000","last_peered":"2024-09-12T01:29:14.354425+0000","last_clean":"2024-09-12T01:29:14.354425+0000","last_became_active":"2024-09-12T00:31:47.125118+0000","last_became_peered":"2024-09-12T00:31:47.125118+0000","last_unstale":"2024-09-12T01:29:14.354425+0000","last_undegraded":"2024-09-12T01:29:14.354425+0000","last_fullsized":"2024-09-12T01:29:14.354425+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:30.278130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6598689,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":470,"num_read_kb":32878,"num_write":1012,"num_write_kb":23042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714949+0000","last_change":"2024-09-12T00:31:52.154490+0000","last_active":"2024-09-12T01:25:04.714949+0000","last_peered":"2024-09-12T01:25:04.714949+0000","last_clean":"2024-09-12T01:25:04.714949+0000","last_became_active":"2024-09-12T00:31:52.154189+0000","last_became_peered":"2024-09-12T00:31:52.154189+0000","last_unstale":"2024-09-12T01:25:04.714949+0000","last_undegraded":"2024-09-12T01:25:04.714949+0000","last_fullsized":"2024-09-12T01:25:04.714949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:46.021304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'272","reported_seq":841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.320951+0000","last_change":"2024-09-12T00:31:54.171678+0000","last_active":"2024-09-12T01:28:55.320951+0000","last_peered":"2024-09-12T01:28:55.320951+0000","last_clean":"2024-09-12T01:28:55.320951+0000","last_became_active":"2024-09-12T00:31:54.171354+0000","last_became_peered":"2024-09-12T00:31:54.171354+0000","last_unstale":"2024-09-12T01:28:55.320951+0000","last_undegraded":"2024-09-12T01:28:55.320951+0000","last_fullsized":"2024-09-12T01:28:55.320951+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:44.212575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63397,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":941,"num_write":366,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'780","reported_seq":2504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.362498+0000","last_change":"2024-09-12T00:31:56.176843+0000","last_active":"2024-09-12T01:28:55.362498+0000","last_peered":"2024-09-12T01:28:55.362498+0000","last_clean":"2024-09-12T01:28:55.362498+0000","last_became_active":"2024-09-12T00:31:56.176464+0000","last_became_peered":"2024-09-12T00:31:56.176464+0000","last_unstale":"2024-09-12T01:28:55.362498+0000","last_undegraded":"2024-09-12T01:28:55.362498+0000","last_fullsized":"2024-09-12T01:28:55.362498+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:39.501516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'324","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.722779+0000","last_change":"2024-09-12T00:31:50.138593+0000","last_active":"2024-09-12T01:25:59.722779+0000","last_peered":"2024-09-12T01:25:59.722779+0000","last_clean":"2024-09-12T01:25:59.722779+0000","last_became_active":"2024-09-12T00:31:50.138335+0000","last_became_peered":"2024-09-12T00:31:50.138335+0000","last_unstale":"2024-09-12T01:25:59.722779+0000","last_undegraded":"2024-09-12T01:25:59.722779+0000","last_fullsized":"2024-09-12T01:25:59.722779+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:08.736816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1108,"num_write":487,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'274","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.355892+0000","last_change":"2024-09-12T00:31:47.138476+0000","last_active":"2024-09-12T01:29:14.355892+0000","last_peered":"2024-09-12T01:29:14.355892+0000","last_clean":"2024-09-12T01:29:14.355892+0000","last_became_active":"2024-09-12T00:31:47.137951+0000","last_became_peered":"2024-09-12T00:31:47.137951+0000","last_unstale":"2024-09-12T01:29:14.355892+0000","last_undegraded":"2024-09-12T01:29:14.355892+0000","last_fullsized":"2024-09-12T01:29:14.355892+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:13.403628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7500437,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":415,"num_read_kb":21456,"num_write":1042,"num_write_kb":35236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605639+0000","last_change":"2024-09-12T00:31:52.155328+0000","last_active":"2024-09-12T01:26:04.605639+0000","last_peered":"2024-09-12T01:26:04.605639+0000","last_clean":"2024-09-12T01:26:04.605639+0000","last_became_active":"2024-09-12T00:31:52.155047+0000","last_became_peered":"2024-09-12T00:31:52.155047+0000","last_unstale":"2024-09-12T01:26:04.605639+0000","last_undegraded":"2024-09-12T01:26:04.605639+0000","last_fullsized":"2024-09-12T01:26:04.605639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:16.230836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'364","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.346006+0000","last_change":"2024-09-12T00:31:54.173591+0000","last_active":"2024-09-12T01:29:14.346006+0000","last_peered":"2024-09-12T01:29:14.346006+0000","last_clean":"2024-09-12T01:29:14.346006+0000","last_became_active":"2024-09-12T00:31:54.173363+0000","last_became_peered":"2024-09-12T00:31:54.173363+0000","last_unstale":"2024-09-12T01:29:14.346006+0000","last_undegraded":"2024-09-12T01:29:14.346006+0000","last_fullsized":"2024-09-12T01:29:14.346006+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:50.016365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53603,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":577,"num_read_kb":1083,"num_write":449,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.636308+0000","last_change":"2024-09-12T00:31:56.173079+0000","last_active":"2024-09-12T01:25:55.636308+0000","last_peered":"2024-09-12T01:25:55.636308+0000","last_clean":"2024-09-12T01:25:55.636308+0000","last_became_active":"2024-09-12T00:31:56.172791+0000","last_became_peered":"2024-09-12T00:31:56.172791+0000","last_unstale":"2024-09-12T01:25:55.636308+0000","last_undegraded":"2024-09-12T01:25:55.636308+0000","last_fullsized":"2024-09-12T01:25:55.636308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:18.460860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'542","reported_seq":1367,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.343041+0000","last_change":"2024-09-12T00:31:58.178597+0000","last_active":"2024-09-12T01:28:55.343041+0000","last_peered":"2024-09-12T01:28:55.343041+0000","last_clean":"2024-09-12T01:28:55.343041+0000","last_became_active":"2024-09-12T00:31:58.177828+0000","last_became_peered":"2024-09-12T00:31:58.177828+0000","last_unstale":"2024-09-12T01:28:55.343041+0000","last_undegraded":"2024-09-12T01:28:55.343041+0000","last_fullsized":"2024-09-12T01:28:55.343041+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:23.485365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1309,"num_read_kb":1288,"num_write":1113,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'199","reported_seq":826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.412983+0000","last_change":"2024-09-12T00:31:50.138558+0000","last_active":"2024-09-12T01:27:00.412983+0000","last_peered":"2024-09-12T01:27:00.412983+0000","last_clean":"2024-09-12T01:27:00.412983+0000","last_became_active":"2024-09-12T00:31:50.138261+0000","last_became_peered":"2024-09-12T00:31:50.138261+0000","last_unstale":"2024-09-12T01:27:00.412983+0000","last_undegraded":"2024-09-12T01:27:00.412983+0000","last_fullsized":"2024-09-12T01:27:00.412983+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:25.679935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":866,"num_read_kb":707,"num_write":323,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'322","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.517321+0000","last_change":"2024-09-12T00:31:47.137585+0000","last_active":"2024-09-12T01:28:04.517321+0000","last_peered":"2024-09-12T01:28:04.517321+0000","last_clean":"2024-09-12T01:28:04.517321+0000","last_became_active":"2024-09-12T00:31:47.137234+0000","last_became_peered":"2024-09-12T00:31:47.137234+0000","last_unstale":"2024-09-12T01:28:04.517321+0000","last_undegraded":"2024-09-12T01:28:04.517321+0000","last_fullsized":"2024-09-12T01:28:04.517321+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:35.306270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2307306,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":654,"num_read_kb":90780,"num_write":1215,"num_write_kb":21068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.637884+0000","last_change":"2024-09-12T00:31:52.148985+0000","last_active":"2024-09-12T01:26:05.637884+0000","last_peered":"2024-09-12T01:26:05.637884+0000","last_clean":"2024-09-12T01:26:05.637884+0000","last_became_active":"2024-09-12T00:31:52.148738+0000","last_became_peered":"2024-09-12T00:31:52.148738+0000","last_unstale":"2024-09-12T01:26:05.637884+0000","last_undegraded":"2024-09-12T01:26:05.637884+0000","last_fullsized":"2024-09-12T01:26:05.637884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:20.806375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'280","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:08.518925+0000","last_change":"2024-09-12T00:31:54.168598+0000","last_active":"2024-09-12T01:28:08.518925+0000","last_peered":"2024-09-12T01:28:08.518925+0000","last_clean":"2024-09-12T01:28:08.518925+0000","last_became_active":"2024-09-12T00:31:54.168247+0000","last_became_peered":"2024-09-12T00:31:54.168247+0000","last_unstale":"2024-09-12T01:28:08.518925+0000","last_undegraded":"2024-09-12T01:28:08.518925+0000","last_fullsized":"2024-09-12T01:28:08.518925+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:53.709459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58827,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":962,"num_write":376,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:23.503173+0000","last_change":"2024-09-12T00:31:56.173852+0000","last_active":"2024-09-12T01:26:23.503173+0000","last_peered":"2024-09-12T01:26:23.503173+0000","last_clean":"2024-09-12T01:26:23.503173+0000","last_became_active":"2024-09-12T00:31:56.173549+0000","last_became_peered":"2024-09-12T00:31:56.173549+0000","last_unstale":"2024-09-12T01:26:23.503173+0000","last_undegraded":"2024-09-12T01:26:23.503173+0000","last_fullsized":"2024-09-12T01:26:23.503173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:31.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'131","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:24.521745+0000","last_change":"2024-09-12T00:31:58.175490+0000","last_active":"2024-09-12T01:28:24.521745+0000","last_peered":"2024-09-12T01:28:24.521745+0000","last_clean":"2024-09-12T01:28:24.521745+0000","last_became_active":"2024-09-12T00:31:58.175195+0000","last_became_peered":"2024-09-12T00:31:58.175195+0000","last_unstale":"2024-09-12T01:28:24.521745+0000","last_undegraded":"2024-09-12T01:28:24.521745+0000","last_fullsized":"2024-09-12T01:28:24.521745+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:18.942923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":426,"num_read_kb":345,"num_write":330,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'360","reported_seq":951,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505956+0000","last_change":"2024-09-12T00:31:50.143092+0000","last_active":"2024-09-12T01:26:14.505956+0000","last_peered":"2024-09-12T01:26:14.505956+0000","last_clean":"2024-09-12T01:26:14.505956+0000","last_became_active":"2024-09-12T00:31:50.142818+0000","last_became_peered":"2024-09-12T00:31:50.142818+0000","last_unstale":"2024-09-12T01:26:14.505956+0000","last_undegraded":"2024-09-12T01:26:14.505956+0000","last_fullsized":"2024-09-12T01:26:14.505956+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:29.886696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1555,"num_read_kb":1227,"num_write":605,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'268","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.689763+0000","last_change":"2024-09-12T00:31:47.113555+0000","last_active":"2024-09-12T01:29:14.689763+0000","last_peered":"2024-09-12T01:29:14.689763+0000","last_clean":"2024-09-12T01:29:14.689763+0000","last_became_active":"2024-09-12T00:31:47.112306+0000","last_became_peered":"2024-09-12T00:31:47.112306+0000","last_unstale":"2024-09-12T01:29:14.689763+0000","last_undegraded":"2024-09-12T01:29:14.689763+0000","last_fullsized":"2024-09-12T01:29:14.689763+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:25.942485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8409984,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":393,"num_read_kb":55420,"num_write":994,"num_write_kb":24613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:52.497023+0000","last_change":"2024-09-12T00:31:52.154154+0000","last_active":"2024-09-12T01:25:52.497023+0000","last_peered":"2024-09-12T01:25:52.497023+0000","last_clean":"2024-09-12T01:25:52.497023+0000","last_became_active":"2024-09-12T00:31:52.153862+0000","last_became_peered":"2024-09-12T00:31:52.153862+0000","last_unstale":"2024-09-12T01:25:52.497023+0000","last_undegraded":"2024-09-12T01:25:52.497023+0000","last_fullsized":"2024-09-12T01:25:52.497023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:25.663441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'358","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.726954+0000","last_change":"2024-09-12T00:31:54.162856+0000","last_active":"2024-09-12T01:29:14.726954+0000","last_peered":"2024-09-12T01:29:14.726954+0000","last_clean":"2024-09-12T01:29:14.726954+0000","last_became_active":"2024-09-12T00:31:54.162228+0000","last_became_peered":"2024-09-12T00:31:54.162228+0000","last_unstale":"2024-09-12T01:29:14.726954+0000","last_undegraded":"2024-09-12T01:29:14.726954+0000","last_fullsized":"2024-09-12T01:29:14.726954+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:20.520023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50365,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":550,"num_read_kb":1150,"num_write":448,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'779","reported_seq":2595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.363532+0000","last_change":"2024-09-12T00:31:56.172797+0000","last_active":"2024-09-12T01:28:55.363532+0000","last_peered":"2024-09-12T01:28:55.363532+0000","last_clean":"2024-09-12T01:28:55.363532+0000","last_became_active":"2024-09-12T00:31:56.172503+0000","last_became_peered":"2024-09-12T00:31:56.172503+0000","last_unstale":"2024-09-12T01:28:55.363532+0000","last_undegraded":"2024-09-12T01:28:55.363532+0000","last_fullsized":"2024-09-12T01:28:55.363532+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:50.107192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'148","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.305098+0000","last_change":"2024-09-12T00:31:58.175440+0000","last_active":"2024-09-12T01:28:54.305098+0000","last_peered":"2024-09-12T01:28:54.305098+0000","last_clean":"2024-09-12T01:28:54.305098+0000","last_became_active":"2024-09-12T00:31:58.175027+0000","last_became_peered":"2024-09-12T00:31:58.175027+0000","last_unstale":"2024-09-12T01:28:54.305098+0000","last_undegraded":"2024-09-12T01:28:54.305098+0000","last_fullsized":"2024-09-12T01:28:54.305098+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:26.724138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":179,"num_read_kb":162,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'330","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:52.496996+0000","last_change":"2024-09-12T00:31:50.144275+0000","last_active":"2024-09-12T01:25:52.496996+0000","last_peered":"2024-09-12T01:25:52.496996+0000","last_clean":"2024-09-12T01:25:52.496996+0000","last_became_active":"2024-09-12T00:31:50.143814+0000","last_became_peered":"2024-09-12T00:31:50.143814+0000","last_unstale":"2024-09-12T01:25:52.496996+0000","last_undegraded":"2024-09-12T01:25:52.496996+0000","last_fullsized":"2024-09-12T01:25:52.496996+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:41.133905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1421,"num_read_kb":1140,"num_write":511,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'312","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:49.395214+0000","last_change":"2024-09-12T00:31:47.139001+0000","last_active":"2024-09-12T01:28:49.395214+0000","last_peered":"2024-09-12T01:28:49.395214+0000","last_clean":"2024-09-12T01:28:49.395214+0000","last_became_active":"2024-09-12T00:31:47.138687+0000","last_became_peered":"2024-09-12T00:31:47.138687+0000","last_unstale":"2024-09-12T01:28:49.395214+0000","last_undegraded":"2024-09-12T01:28:49.395214+0000","last_fullsized":"2024-09-12T01:28:49.395214+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:39.040881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927828,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":504,"num_read_kb":39444,"num_write":1135,"num_write_kb":53128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639608+0000","last_change":"2024-09-12T00:31:52.155135+0000","last_active":"2024-09-12T01:26:15.639608+0000","last_peered":"2024-09-12T01:26:15.639608+0000","last_clean":"2024-09-12T01:26:15.639608+0000","last_became_active":"2024-09-12T00:31:52.154863+0000","last_became_peered":"2024-09-12T00:31:52.154863+0000","last_unstale":"2024-09-12T01:26:15.639608+0000","last_undegraded":"2024-09-12T01:26:15.639608+0000","last_fullsized":"2024-09-12T01:26:15.639608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:40.280300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'502","reported_seq":1145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.312525+0000","last_change":"2024-09-12T00:31:54.169066+0000","last_active":"2024-09-12T01:28:55.312525+0000","last_peered":"2024-09-12T01:28:55.312525+0000","last_clean":"2024-09-12T01:28:55.312525+0000","last_became_active":"2024-09-12T00:31:54.168691+0000","last_became_peered":"2024-09-12T00:31:54.168691+0000","last_unstale":"2024-09-12T01:28:55.312525+0000","last_undegraded":"2024-09-12T01:28:55.312525+0000","last_fullsized":"2024-09-12T01:28:55.312525+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:06.873573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130121,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":883,"num_read_kb":1929,"num_write":742,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499328+0000","last_change":"2024-09-12T00:31:56.175805+0000","last_active":"2024-09-12T01:26:07.499328+0000","last_peered":"2024-09-12T01:26:07.499328+0000","last_clean":"2024-09-12T01:26:07.499328+0000","last_became_active":"2024-09-12T00:31:56.175412+0000","last_became_peered":"2024-09-12T00:31:56.175412+0000","last_unstale":"2024-09-12T01:26:07.499328+0000","last_undegraded":"2024-09-12T01:26:07.499328+0000","last_fullsized":"2024-09-12T01:26:07.499328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:32.829417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'133","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:10.783574+0000","last_change":"2024-09-12T00:31:58.178548+0000","last_active":"2024-09-12T01:26:10.783574+0000","last_peered":"2024-09-12T01:26:10.783574+0000","last_clean":"2024-09-12T01:26:10.783574+0000","last_became_active":"2024-09-12T00:31:58.178027+0000","last_became_peered":"2024-09-12T00:31:58.178027+0000","last_unstale":"2024-09-12T01:26:10.783574+0000","last_undegraded":"2024-09-12T01:26:10.783574+0000","last_fullsized":"2024-09-12T01:26:10.783574+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.407511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'162","reported_seq":791,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.500388+0000","last_change":"2024-09-12T00:31:50.127506+0000","last_active":"2024-09-12T01:25:49.500388+0000","last_peered":"2024-09-12T01:25:49.500388+0000","last_clean":"2024-09-12T01:25:49.500388+0000","last_became_active":"2024-09-12T00:31:50.127193+0000","last_became_peered":"2024-09-12T00:31:50.127193+0000","last_unstale":"2024-09-12T01:25:49.500388+0000","last_undegraded":"2024-09-12T01:25:49.500388+0000","last_fullsized":"2024-09-12T01:25:49.500388+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:52.691594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":547,"num_write":243,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'311","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.633333+0000","last_change":"2024-09-12T00:31:47.130530+0000","last_active":"2024-09-12T01:29:15.633333+0000","last_peered":"2024-09-12T01:29:15.633333+0000","last_clean":"2024-09-12T01:29:15.633333+0000","last_became_active":"2024-09-12T00:31:47.130136+0000","last_became_peered":"2024-09-12T00:31:47.130136+0000","last_unstale":"2024-09-12T01:29:15.633333+0000","last_undegraded":"2024-09-12T01:29:15.633333+0000","last_fullsized":"2024-09-12T01:29:15.633333+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:35.574448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263466,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":489,"num_read_kb":72156,"num_write":1129,"num_write_kb":60123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.781057+0000","last_change":"2024-09-12T00:31:52.155387+0000","last_active":"2024-09-12T01:25:55.781057+0000","last_peered":"2024-09-12T01:25:55.781057+0000","last_clean":"2024-09-12T01:25:55.781057+0000","last_became_active":"2024-09-12T00:31:52.155083+0000","last_became_peered":"2024-09-12T00:31:52.155083+0000","last_unstale":"2024-09-12T01:25:55.781057+0000","last_undegraded":"2024-09-12T01:25:55.781057+0000","last_fullsized":"2024-09-12T01:25:55.781057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:51.358822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'319","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.314003+0000","last_change":"2024-09-12T00:31:54.165545+0000","last_active":"2024-09-12T01:28:55.314003+0000","last_peered":"2024-09-12T01:28:55.314003+0000","last_clean":"2024-09-12T01:28:55.314003+0000","last_became_active":"2024-09-12T00:31:54.165221+0000","last_became_peered":"2024-09-12T00:31:54.165221+0000","last_unstale":"2024-09-12T01:28:55.314003+0000","last_undegraded":"2024-09-12T01:28:55.314003+0000","last_fullsized":"2024-09-12T01:28:55.314003+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:34.590028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62343,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":526,"num_read_kb":1039,"num_write":478,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782685+0000","last_change":"2024-09-12T00:31:56.173067+0000","last_active":"2024-09-12T01:26:05.782685+0000","last_peered":"2024-09-12T01:26:05.782685+0000","last_clean":"2024-09-12T01:26:05.782685+0000","last_became_active":"2024-09-12T00:31:56.172777+0000","last_became_peered":"2024-09-12T00:31:56.172777+0000","last_unstale":"2024-09-12T01:26:05.782685+0000","last_undegraded":"2024-09-12T01:26:05.782685+0000","last_fullsized":"2024-09-12T01:26:05.782685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:49.874762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'114","reported_seq":604,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:12.518829+0000","last_change":"2024-09-12T00:31:58.179957+0000","last_active":"2024-09-12T01:28:12.518829+0000","last_peered":"2024-09-12T01:28:12.518829+0000","last_clean":"2024-09-12T01:28:12.518829+0000","last_became_active":"2024-09-12T00:31:58.179667+0000","last_became_peered":"2024-09-12T00:31:58.179667+0000","last_unstale":"2024-09-12T01:28:12.518829+0000","last_undegraded":"2024-09-12T01:28:12.518829+0000","last_fullsized":"2024-09-12T01:28:12.518829+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:04.950082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":909,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":84,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'226","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721754+0000","last_change":"2024-09-12T00:31:50.131405+0000","last_active":"2024-09-12T01:25:49.721754+0000","last_peered":"2024-09-12T01:25:49.721754+0000","last_clean":"2024-09-12T01:25:49.721754+0000","last_became_active":"2024-09-12T00:31:50.130807+0000","last_became_peered":"2024-09-12T00:31:50.130807+0000","last_unstale":"2024-09-12T01:25:49.721754+0000","last_undegraded":"2024-09-12T01:25:49.721754+0000","last_fullsized":"2024-09-12T01:25:49.721754+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:43.848144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":940,"num_read_kb":756,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'334","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.689623+0000","last_change":"2024-09-12T00:31:47.113900+0000","last_active":"2024-09-12T01:29:14.689623+0000","last_peered":"2024-09-12T01:29:14.689623+0000","last_clean":"2024-09-12T01:29:14.689623+0000","last_became_active":"2024-09-12T00:31:47.113265+0000","last_became_peered":"2024-09-12T00:31:47.113265+0000","last_unstale":"2024-09-12T01:29:14.689623+0000","last_undegraded":"2024-09-12T01:29:14.689623+0000","last_fullsized":"2024-09-12T01:29:14.689623+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:24.211193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202787,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":531,"num_read_kb":11690,"num_write":1190,"num_write_kb":25282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:52.497051+0000","last_change":"2024-09-12T00:31:52.156164+0000","last_active":"2024-09-12T01:25:52.497051+0000","last_peered":"2024-09-12T01:25:52.497051+0000","last_clean":"2024-09-12T01:25:52.497051+0000","last_became_active":"2024-09-12T00:31:52.155877+0000","last_became_peered":"2024-09-12T00:31:52.155877+0000","last_unstale":"2024-09-12T01:25:52.497051+0000","last_undegraded":"2024-09-12T01:25:52.497051+0000","last_fullsized":"2024-09-12T01:25:52.497051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:38.312330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'305","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:27.521381+0000","last_change":"2024-09-12T00:31:54.165410+0000","last_active":"2024-09-12T01:28:27.521381+0000","last_peered":"2024-09-12T01:28:27.521381+0000","last_clean":"2024-09-12T01:28:27.521381+0000","last_became_active":"2024-09-12T00:31:54.165107+0000","last_became_peered":"2024-09-12T00:31:54.165107+0000","last_unstale":"2024-09-12T01:28:27.521381+0000","last_undegraded":"2024-09-12T01:28:27.521381+0000","last_fullsized":"2024-09-12T01:28:27.521381+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:41.442937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56639,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":996,"num_write":408,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'742","reported_seq":2475,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.295169+0000","last_change":"2024-09-12T00:31:56.170713+0000","last_active":"2024-09-12T01:29:14.295169+0000","last_peered":"2024-09-12T01:29:14.295169+0000","last_clean":"2024-09-12T01:29:14.295169+0000","last_became_active":"2024-09-12T00:31:56.170388+0000","last_became_peered":"2024-09-12T00:31:56.170388+0000","last_unstale":"2024-09-12T01:29:14.295169+0000","last_undegraded":"2024-09-12T01:29:14.295169+0000","last_fullsized":"2024-09-12T01:29:14.295169+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:46.492927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'162","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:46.479085+0000","last_change":"2024-09-12T00:31:58.172116+0000","last_active":"2024-09-12T01:27:46.479085+0000","last_peered":"2024-09-12T01:27:46.479085+0000","last_clean":"2024-09-12T01:27:46.479085+0000","last_became_active":"2024-09-12T00:31:58.171814+0000","last_became_peered":"2024-09-12T00:31:58.171814+0000","last_unstale":"2024-09-12T01:27:46.479085+0000","last_undegraded":"2024-09-12T01:27:46.479085+0000","last_fullsized":"2024-09-12T01:27:46.479085+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:12.214205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":379,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'117","reported_seq":721,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.318699+0000","last_change":"2024-09-12T00:31:50.142691+0000","last_active":"2024-09-12T01:27:48.318699+0000","last_peered":"2024-09-12T01:27:48.318699+0000","last_clean":"2024-09-12T01:27:48.318699+0000","last_became_active":"2024-09-12T00:31:50.142370+0000","last_became_peered":"2024-09-12T00:31:50.142370+0000","last_unstale":"2024-09-12T01:27:48.318699+0000","last_undegraded":"2024-09-12T01:27:48.318699+0000","last_fullsized":"2024-09-12T01:27:48.318699+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:28.025270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":572,"num_read_kb":482,"num_write":177,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'250","reported_seq":869,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.689763+0000","last_change":"2024-09-12T00:31:47.122868+0000","last_active":"2024-09-12T01:29:14.689763+0000","last_peered":"2024-09-12T01:29:14.689763+0000","last_clean":"2024-09-12T01:29:14.689763+0000","last_became_active":"2024-09-12T00:31:47.122110+0000","last_became_peered":"2024-09-12T00:31:47.122110+0000","last_unstale":"2024-09-12T01:29:14.689763+0000","last_undegraded":"2024-09-12T01:29:14.689763+0000","last_fullsized":"2024-09-12T01:29:14.689763+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:22.824588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16053943,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":343,"num_read_kb":34903,"num_write":862,"num_write_kb":39966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1454,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.074988+0000","last_change":"2024-09-12T00:31:52.155143+0000","last_active":"2024-09-12T01:29:14.074988+0000","last_peered":"2024-09-12T01:29:14.074988+0000","last_clean":"2024-09-12T01:29:14.074988+0000","last_became_active":"2024-09-12T00:31:52.154858+0000","last_became_peered":"2024-09-12T00:31:52.154858+0000","last_unstale":"2024-09-12T01:29:14.074988+0000","last_undegraded":"2024-09-12T01:29:14.074988+0000","last_fullsized":"2024-09-12T01:29:14.074988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:28.556319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'84","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.636359+0000","last_change":"2024-09-12T00:31:54.167692+0000","last_active":"2024-09-12T01:25:55.636359+0000","last_peered":"2024-09-12T01:25:55.636359+0000","last_clean":"2024-09-12T01:25:55.636359+0000","last_became_active":"2024-09-12T00:31:54.167362+0000","last_became_peered":"2024-09-12T00:31:54.167362+0000","last_unstale":"2024-09-12T01:25:55.636359+0000","last_undegraded":"2024-09-12T01:25:55.636359+0000","last_fullsized":"2024-09-12T01:25:55.636359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:15.421825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'770","reported_seq":2496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.296478+0000","last_change":"2024-09-12T00:31:56.173817+0000","last_active":"2024-09-12T01:29:14.296478+0000","last_peered":"2024-09-12T01:29:14.296478+0000","last_clean":"2024-09-12T01:29:14.296478+0000","last_became_active":"2024-09-12T00:31:56.173548+0000","last_became_peered":"2024-09-12T00:31:56.173548+0000","last_unstale":"2024-09-12T01:29:14.296478+0000","last_undegraded":"2024-09-12T01:29:14.296478+0000","last_fullsized":"2024-09-12T01:29:14.296478+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:34.709914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'124","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.453295+0000","last_change":"2024-09-12T00:31:58.175176+0000","last_active":"2024-09-12T01:27:48.453295+0000","last_peered":"2024-09-12T01:27:48.453295+0000","last_clean":"2024-09-12T01:27:48.453295+0000","last_became_active":"2024-09-12T00:31:58.174886+0000","last_became_peered":"2024-09-12T00:31:58.174886+0000","last_unstale":"2024-09-12T01:27:48.453295+0000","last_undegraded":"2024-09-12T01:27:48.453295+0000","last_fullsized":"2024-09-12T01:27:48.453295+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:21.010979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":123,"num_write":278,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'279","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:57.044069+0000","last_change":"2024-09-12T00:31:50.140192+0000","last_active":"2024-09-12T01:26:57.044069+0000","last_peered":"2024-09-12T01:26:57.044069+0000","last_clean":"2024-09-12T01:26:57.044069+0000","last_became_active":"2024-09-12T00:31:50.139923+0000","last_became_peered":"2024-09-12T00:31:50.139923+0000","last_unstale":"2024-09-12T01:26:57.044069+0000","last_undegraded":"2024-09-12T01:26:57.044069+0000","last_fullsized":"2024-09-12T01:26:57.044069+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:45.055920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":954,"num_write":459,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'306","reported_seq":1027,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:43.961087+0000","last_change":"2024-09-12T00:31:47.122785+0000","last_active":"2024-09-12T01:26:43.961087+0000","last_peered":"2024-09-12T01:26:43.961087+0000","last_clean":"2024-09-12T01:26:43.961087+0000","last_became_active":"2024-09-12T00:31:47.122007+0000","last_became_peered":"2024-09-12T00:31:47.122007+0000","last_unstale":"2024-09-12T01:26:43.961087+0000","last_undegraded":"2024-09-12T01:26:43.961087+0000","last_fullsized":"2024-09-12T01:26:43.961087+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:49.888568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5268542,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":591,"num_read_kb":69205,"num_write":1136,"num_write_kb":21863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.722337+0000","last_change":"2024-09-12T00:31:52.147230+0000","last_active":"2024-09-12T01:25:54.722337+0000","last_peered":"2024-09-12T01:25:54.722337+0000","last_clean":"2024-09-12T01:25:54.722337+0000","last_became_active":"2024-09-12T00:31:52.146894+0000","last_became_peered":"2024-09-12T00:31:52.146894+0000","last_unstale":"2024-09-12T01:25:54.722337+0000","last_undegraded":"2024-09-12T01:25:54.722337+0000","last_fullsized":"2024-09-12T01:25:54.722337+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:01.319728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'416","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.327097+0000","last_change":"2024-09-12T00:31:54.170886+0000","last_active":"2024-09-12T01:28:55.327097+0000","last_peered":"2024-09-12T01:28:55.327097+0000","last_clean":"2024-09-12T01:28:55.327097+0000","last_became_active":"2024-09-12T00:31:54.170522+0000","last_became_peered":"2024-09-12T00:31:54.170522+0000","last_unstale":"2024-09-12T01:28:55.327097+0000","last_undegraded":"2024-09-12T01:28:55.327097+0000","last_fullsized":"2024-09-12T01:28:55.327097+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:11.181608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65010,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1261,"num_read_kb":1830,"num_write":1796,"num_write_kb":1654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.504440+0000","last_change":"2024-09-12T00:31:56.168824+0000","last_active":"2024-09-12T01:25:59.504440+0000","last_peered":"2024-09-12T01:25:59.504440+0000","last_clean":"2024-09-12T01:25:59.504440+0000","last_became_active":"2024-09-12T00:31:56.168503+0000","last_became_peered":"2024-09-12T00:31:56.168503+0000","last_unstale":"2024-09-12T01:25:59.504440+0000","last_undegraded":"2024-09-12T01:25:59.504440+0000","last_fullsized":"2024-09-12T01:25:59.504440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:47.541247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'129","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:38.383006+0000","last_change":"2024-09-12T00:31:58.173064+0000","last_active":"2024-09-12T01:26:38.383006+0000","last_peered":"2024-09-12T01:26:38.383006+0000","last_clean":"2024-09-12T01:26:38.383006+0000","last_became_active":"2024-09-12T00:31:58.172778+0000","last_became_peered":"2024-09-12T00:31:58.172778+0000","last_unstale":"2024-09-12T01:26:38.383006+0000","last_undegraded":"2024-09-12T01:26:38.383006+0000","last_fullsized":"2024-09-12T01:26:38.383006+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:25.437723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":147,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'168","reported_seq":780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723659+0000","last_change":"2024-09-12T00:31:50.131714+0000","last_active":"2024-09-12T01:26:04.723659+0000","last_peered":"2024-09-12T01:26:04.723659+0000","last_clean":"2024-09-12T01:26:04.723659+0000","last_became_active":"2024-09-12T00:31:50.131152+0000","last_became_peered":"2024-09-12T00:31:50.131152+0000","last_unstale":"2024-09-12T01:26:04.723659+0000","last_undegraded":"2024-09-12T01:26:04.723659+0000","last_fullsized":"2024-09-12T01:26:04.723659+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:10.401016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":649,"num_write":266,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":618,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.602382+0000","last_change":"2024-09-12T00:31:29.750620+0000","last_active":"2024-09-12T01:25:34.602382+0000","last_peered":"2024-09-12T01:25:34.602382+0000","last_clean":"2024-09-12T01:25:34.602382+0000","last_became_active":"2024-09-12T00:31:29.750331+0000","last_became_peered":"2024-09-12T00:31:29.750331+0000","last_unstale":"2024-09-12T01:25:34.602382+0000","last_undegraded":"2024-09-12T01:25:34.602382+0000","last_fullsized":"2024-09-12T01:25:34.602382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:28.736382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:28.736382+0000","last_clean_scrub_stamp":"2024-09-12T00:31:28.736382+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:30.636870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721690+0000","last_change":"2024-09-12T00:31:38.792167+0000","last_active":"2024-09-12T01:25:49.721690+0000","last_peered":"2024-09-12T01:25:49.721690+0000","last_clean":"2024-09-12T01:25:49.721690+0000","last_became_active":"2024-09-12T00:31:36.970959+0000","last_became_peered":"2024-09-12T00:31:36.970959+0000","last_unstale":"2024-09-12T01:25:49.721690+0000","last_undegraded":"2024-09-12T01:25:49.721690+0000","last_fullsized":"2024-09-12T01:25:49.721690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:16.364886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098350799999999991,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'268","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:28.012307+0000","last_change":"2024-09-12T00:31:47.130441+0000","last_active":"2024-09-12T01:26:28.012307+0000","last_peered":"2024-09-12T01:26:28.012307+0000","last_clean":"2024-09-12T01:26:28.012307+0000","last_became_active":"2024-09-12T00:31:47.130015+0000","last_became_peered":"2024-09-12T00:31:47.130015+0000","last_unstale":"2024-09-12T01:26:28.012307+0000","last_undegraded":"2024-09-12T01:26:28.012307+0000","last_fullsized":"2024-09-12T01:26:28.012307+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:10.863669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10835095,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":459,"num_read_kb":117828,"num_write":998,"num_write_kb":35803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.501940+0000","last_change":"2024-09-12T00:31:52.148635+0000","last_active":"2024-09-12T01:26:04.501940+0000","last_peered":"2024-09-12T01:26:04.501940+0000","last_clean":"2024-09-12T01:26:04.501940+0000","last_became_active":"2024-09-12T00:31:52.148316+0000","last_became_peered":"2024-09-12T00:31:52.148316+0000","last_unstale":"2024-09-12T01:26:04.501940+0000","last_undegraded":"2024-09-12T01:26:04.501940+0000","last_fullsized":"2024-09-12T01:26:04.501940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:30.960630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'701","reported_seq":1398,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.330102+0000","last_change":"2024-09-12T00:31:54.163779+0000","last_active":"2024-09-12T01:29:14.330102+0000","last_peered":"2024-09-12T01:29:14.330102+0000","last_clean":"2024-09-12T01:29:14.330102+0000","last_became_active":"2024-09-12T00:31:54.163482+0000","last_became_peered":"2024-09-12T00:31:54.163482+0000","last_unstale":"2024-09-12T01:29:14.330102+0000","last_undegraded":"2024-09-12T01:29:14.330102+0000","last_fullsized":"2024-09-12T01:29:14.330102+0000","mapping_epoch":31,"log_start":"265'600","ondisk_log_start":"265'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:12.512568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159785,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1360,"num_read_kb":2777,"num_write":1290,"num_write_kb":1139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499503+0000","last_change":"2024-09-12T00:31:56.170852+0000","last_active":"2024-09-12T01:26:07.499503+0000","last_peered":"2024-09-12T01:26:07.499503+0000","last_clean":"2024-09-12T01:26:07.499503+0000","last_became_active":"2024-09-12T00:31:56.170545+0000","last_became_peered":"2024-09-12T00:31:56.170545+0000","last_unstale":"2024-09-12T01:26:07.499503+0000","last_undegraded":"2024-09-12T01:26:07.499503+0000","last_fullsized":"2024-09-12T01:26:07.499503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:42.166275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'197","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.343679+0000","last_change":"2024-09-12T00:31:58.185222+0000","last_active":"2024-09-12T01:27:48.343679+0000","last_peered":"2024-09-12T01:27:48.343679+0000","last_clean":"2024-09-12T01:27:48.343679+0000","last_became_active":"2024-09-12T00:31:58.184941+0000","last_became_peered":"2024-09-12T00:31:58.184941+0000","last_unstale":"2024-09-12T01:27:48.343679+0000","last_undegraded":"2024-09-12T01:27:48.343679+0000","last_fullsized":"2024-09-12T01:27:48.343679+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:18.883829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1234,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":433,"num_write":415,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'95","reported_seq":667,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498663+0000","last_change":"2024-09-12T00:31:50.138379+0000","last_active":"2024-09-12T01:26:02.498663+0000","last_peered":"2024-09-12T01:26:02.498663+0000","last_clean":"2024-09-12T01:26:02.498663+0000","last_became_active":"2024-09-12T00:31:50.137393+0000","last_became_peered":"2024-09-12T00:31:50.137393+0000","last_unstale":"2024-09-12T01:26:02.498663+0000","last_undegraded":"2024-09-12T01:26:02.498663+0000","last_fullsized":"2024-09-12T01:26:02.498663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:51.466639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":346,"num_write":149,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.719450+0000","last_change":"2024-09-12T00:31:38.791836+0000","last_active":"2024-09-12T01:25:44.719450+0000","last_peered":"2024-09-12T01:25:44.719450+0000","last_clean":"2024-09-12T01:25:44.719450+0000","last_became_active":"2024-09-12T00:31:36.772301+0000","last_became_peered":"2024-09-12T00:31:36.772301+0000","last_unstale":"2024-09-12T01:25:44.719450+0000","last_undegraded":"2024-09-12T01:25:44.719450+0000","last_fullsized":"2024-09-12T01:25:44.719450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:18.261088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070272599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'338","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.646130+0000","last_change":"2024-09-12T00:31:47.121968+0000","last_active":"2024-09-12T01:29:15.646130+0000","last_peered":"2024-09-12T01:29:15.646130+0000","last_clean":"2024-09-12T01:29:15.646130+0000","last_became_active":"2024-09-12T00:31:47.121537+0000","last_became_peered":"2024-09-12T00:31:47.121537+0000","last_unstale":"2024-09-12T01:29:15.646130+0000","last_undegraded":"2024-09-12T01:29:15.646130+0000","last_fullsized":"2024-09-12T01:29:15.646130+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:47.444435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":379440,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":554,"num_read_kb":9552,"num_write":1133,"num_write_kb":21951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723703+0000","last_change":"2024-09-12T00:31:52.147965+0000","last_active":"2024-09-12T01:26:04.723703+0000","last_peered":"2024-09-12T01:26:04.723703+0000","last_clean":"2024-09-12T01:26:04.723703+0000","last_became_active":"2024-09-12T00:31:52.147719+0000","last_became_peered":"2024-09-12T00:31:52.147719+0000","last_unstale":"2024-09-12T01:26:04.723703+0000","last_undegraded":"2024-09-12T01:26:04.723703+0000","last_fullsized":"2024-09-12T01:26:04.723703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:49.618183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1253","reported_seq":2877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.459747+0000","last_change":"2024-09-12T00:31:54.168423+0000","last_active":"2024-09-12T01:29:15.459747+0000","last_peered":"2024-09-12T01:29:15.459747+0000","last_clean":"2024-09-12T01:29:15.459747+0000","last_became_active":"2024-09-12T00:31:54.168085+0000","last_became_peered":"2024-09-12T00:31:54.168085+0000","last_unstale":"2024-09-12T01:29:15.459747+0000","last_undegraded":"2024-09-12T01:29:15.459747+0000","last_fullsized":"2024-09-12T01:29:15.459747+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":1200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:38.939256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152752,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2009,"num_read_kb":3538,"num_write":1124,"num_write_kb":948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.725043+0000","last_change":"2024-09-12T00:31:56.171482+0000","last_active":"2024-09-12T01:26:14.725043+0000","last_peered":"2024-09-12T01:26:14.725043+0000","last_clean":"2024-09-12T01:26:14.725043+0000","last_became_active":"2024-09-12T00:31:56.170725+0000","last_became_peered":"2024-09-12T00:31:56.170725+0000","last_unstale":"2024-09-12T01:26:14.725043+0000","last_undegraded":"2024-09-12T01:26:14.725043+0000","last_fullsized":"2024-09-12T01:26:14.725043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:54.802585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'205","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:46.476124+0000","last_change":"2024-09-12T00:31:58.182866+0000","last_active":"2024-09-12T01:27:46.476124+0000","last_peered":"2024-09-12T01:27:46.476124+0000","last_clean":"2024-09-12T01:27:46.476124+0000","last_became_active":"2024-09-12T00:31:58.182565+0000","last_became_peered":"2024-09-12T00:31:58.182565+0000","last_unstale":"2024-09-12T01:27:46.476124+0000","last_undegraded":"2024-09-12T01:27:46.476124+0000","last_fullsized":"2024-09-12T01:27:46.476124+0000","mapping_epoch":35,"log_start":"262'100","ondisk_log_start":"262'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:03.635481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":315,"num_read_kb":314,"num_write":438,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'335","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:28.356649+0000","last_change":"2024-09-12T00:31:50.136242+0000","last_active":"2024-09-12T01:26:28.356649+0000","last_peered":"2024-09-12T01:26:28.356649+0000","last_clean":"2024-09-12T01:26:28.356649+0000","last_became_active":"2024-09-12T00:31:50.135930+0000","last_became_peered":"2024-09-12T00:31:50.135930+0000","last_unstale":"2024-09-12T01:26:28.356649+0000","last_undegraded":"2024-09-12T01:26:28.356649+0000","last_fullsized":"2024-09-12T01:26:28.356649+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:16.203493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1457,"num_read_kb":1188,"num_write":528,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:50.780245+0000","last_change":"2024-09-12T00:31:38.791033+0000","last_active":"2024-09-12T01:25:50.780245+0000","last_peered":"2024-09-12T01:25:50.780245+0000","last_clean":"2024-09-12T01:25:50.780245+0000","last_became_active":"2024-09-12T00:31:36.774484+0000","last_became_peered":"2024-09-12T00:31:36.774484+0000","last_unstale":"2024-09-12T01:25:50.780245+0000","last_undegraded":"2024-09-12T01:25:50.780245+0000","last_fullsized":"2024-09-12T01:25:50.780245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:00.370174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040283499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'298","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:28.044047+0000","last_change":"2024-09-12T00:31:47.124224+0000","last_active":"2024-09-12T01:27:28.044047+0000","last_peered":"2024-09-12T01:27:28.044047+0000","last_clean":"2024-09-12T01:27:28.044047+0000","last_became_active":"2024-09-12T00:31:47.123249+0000","last_became_peered":"2024-09-12T00:31:47.123249+0000","last_unstale":"2024-09-12T01:27:28.044047+0000","last_undegraded":"2024-09-12T01:27:28.044047+0000","last_fullsized":"2024-09-12T01:27:28.044047+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:41.915420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534900,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":552,"num_read_kb":12898,"num_write":1111,"num_write_kb":44550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782647+0000","last_change":"2024-09-12T00:31:52.156266+0000","last_active":"2024-09-12T01:26:05.782647+0000","last_peered":"2024-09-12T01:26:05.782647+0000","last_clean":"2024-09-12T01:26:05.782647+0000","last_became_active":"2024-09-12T00:31:52.155926+0000","last_became_peered":"2024-09-12T00:31:52.155926+0000","last_unstale":"2024-09-12T01:26:05.782647+0000","last_undegraded":"2024-09-12T01:26:05.782647+0000","last_fullsized":"2024-09-12T01:26:05.782647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:04.589366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'249","reported_seq":1479,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.489792+0000","last_change":"2024-09-12T00:31:54.175219+0000","last_active":"2024-09-12T01:28:54.489792+0000","last_peered":"2024-09-12T01:28:54.489792+0000","last_clean":"2024-09-12T01:28:54.489792+0000","last_became_active":"2024-09-12T00:31:54.174937+0000","last_became_peered":"2024-09-12T00:31:54.174937+0000","last_unstale":"2024-09-12T01:28:54.489792+0000","last_undegraded":"2024-09-12T01:28:54.489792+0000","last_fullsized":"2024-09-12T01:28:54.489792+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:50.854821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":202,"num_write":187,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501136+0000","last_change":"2024-09-12T00:31:56.172150+0000","last_active":"2024-09-12T01:26:08.501136+0000","last_peered":"2024-09-12T01:26:08.501136+0000","last_clean":"2024-09-12T01:26:08.501136+0000","last_became_active":"2024-09-12T00:31:56.171071+0000","last_became_peered":"2024-09-12T00:31:56.171071+0000","last_unstale":"2024-09-12T01:26:08.501136+0000","last_undegraded":"2024-09-12T01:26:08.501136+0000","last_fullsized":"2024-09-12T01:26:08.501136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:43.038984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'239","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:13.519595+0000","last_change":"2024-09-12T00:31:58.177224+0000","last_active":"2024-09-12T01:28:13.519595+0000","last_peered":"2024-09-12T01:28:13.519595+0000","last_clean":"2024-09-12T01:28:13.519595+0000","last_became_active":"2024-09-12T00:31:58.176931+0000","last_became_peered":"2024-09-12T00:31:58.176931+0000","last_unstale":"2024-09-12T01:28:13.519595+0000","last_undegraded":"2024-09-12T01:28:13.519595+0000","last_fullsized":"2024-09-12T01:28:13.519595+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:05.868371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":495,"num_write":504,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'416","reported_seq":1066,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637259+0000","last_change":"2024-09-12T00:31:50.139895+0000","last_active":"2024-09-12T01:26:00.637259+0000","last_peered":"2024-09-12T01:26:00.637259+0000","last_clean":"2024-09-12T01:26:00.637259+0000","last_became_active":"2024-09-12T00:31:50.139625+0000","last_became_peered":"2024-09-12T00:31:50.139625+0000","last_unstale":"2024-09-12T01:26:00.637259+0000","last_undegraded":"2024-09-12T01:26:00.637259+0000","last_fullsized":"2024-09-12T01:26:00.637259+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:20.853631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1805,"num_read_kb":1431,"num_write":644,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721663+0000","last_change":"2024-09-12T00:31:38.792511+0000","last_active":"2024-09-12T01:25:49.721663+0000","last_peered":"2024-09-12T01:25:49.721663+0000","last_clean":"2024-09-12T01:25:49.721663+0000","last_became_active":"2024-09-12T00:31:37.736683+0000","last_became_peered":"2024-09-12T00:31:37.736683+0000","last_unstale":"2024-09-12T01:25:49.721663+0000","last_undegraded":"2024-09-12T01:25:49.721663+0000","last_fullsized":"2024-09-12T01:25:49.721663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:32.835722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001295757,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'253","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.514779+0000","last_change":"2024-09-12T00:31:47.137770+0000","last_active":"2024-09-12T01:28:04.514779+0000","last_peered":"2024-09-12T01:28:04.514779+0000","last_clean":"2024-09-12T01:28:04.514779+0000","last_became_active":"2024-09-12T00:31:47.136714+0000","last_became_peered":"2024-09-12T00:31:47.136714+0000","last_unstale":"2024-09-12T01:28:04.514779+0000","last_undegraded":"2024-09-12T01:28:04.514779+0000","last_fullsized":"2024-09-12T01:28:04.514779+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:36.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10811741,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":826,"num_read_kb":29268,"num_write":995,"num_write_kb":35686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.784440+0000","last_change":"2024-09-12T00:31:52.149396+0000","last_active":"2024-09-12T01:26:15.784440+0000","last_peered":"2024-09-12T01:26:15.784440+0000","last_clean":"2024-09-12T01:26:15.784440+0000","last_became_active":"2024-09-12T00:31:52.148995+0000","last_became_peered":"2024-09-12T00:31:52.148995+0000","last_unstale":"2024-09-12T01:26:15.784440+0000","last_undegraded":"2024-09-12T01:26:15.784440+0000","last_fullsized":"2024-09-12T01:26:15.784440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:57.905127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'137","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:17.519817+0000","last_change":"2024-09-12T00:31:54.168174+0000","last_active":"2024-09-12T01:28:17.519817+0000","last_peered":"2024-09-12T01:28:17.519817+0000","last_clean":"2024-09-12T01:28:17.519817+0000","last_became_active":"2024-09-12T00:31:54.167813+0000","last_became_peered":"2024-09-12T00:31:54.167813+0000","last_unstale":"2024-09-12T01:28:17.519817+0000","last_undegraded":"2024-09-12T01:28:17.519817+0000","last_fullsized":"2024-09-12T01:28:17.519817+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:55.058242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":166,"num_read_kb":157,"num_write":122,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.724455+0000","last_change":"2024-09-12T00:31:56.173128+0000","last_active":"2024-09-12T01:26:09.724455+0000","last_peered":"2024-09-12T01:26:09.724455+0000","last_clean":"2024-09-12T01:26:09.724455+0000","last_became_active":"2024-09-12T00:31:56.172693+0000","last_became_peered":"2024-09-12T00:31:56.172693+0000","last_unstale":"2024-09-12T01:26:09.724455+0000","last_undegraded":"2024-09-12T01:26:09.724455+0000","last_fullsized":"2024-09-12T01:26:09.724455+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:48.948020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'163","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.606163+0000","last_change":"2024-09-12T00:31:58.177617+0000","last_active":"2024-09-12T01:26:09.606163+0000","last_peered":"2024-09-12T01:26:09.606163+0000","last_clean":"2024-09-12T01:26:09.606163+0000","last_became_active":"2024-09-12T00:31:58.177206+0000","last_became_peered":"2024-09-12T00:31:58.177206+0000","last_unstale":"2024-09-12T01:26:09.606163+0000","last_undegraded":"2024-09-12T01:26:09.606163+0000","last_fullsized":"2024-09-12T01:26:09.606163+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:23.709095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":267,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'249","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637190+0000","last_change":"2024-09-12T00:31:50.135626+0000","last_active":"2024-09-12T01:26:00.637190+0000","last_peered":"2024-09-12T01:26:00.637190+0000","last_clean":"2024-09-12T01:26:00.637190+0000","last_became_active":"2024-09-12T00:31:50.135333+0000","last_became_peered":"2024-09-12T00:31:50.135333+0000","last_unstale":"2024-09-12T01:26:00.637190+0000","last_undegraded":"2024-09-12T01:26:00.637190+0000","last_fullsized":"2024-09-12T01:26:00.637190+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:41.887040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1106,"num_read_kb":893,"num_write":406,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'246","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:27.899313+0000","last_change":"2024-09-12T00:31:47.132263+0000","last_active":"2024-09-12T01:27:27.899313+0000","last_peered":"2024-09-12T01:27:27.899313+0000","last_clean":"2024-09-12T01:27:27.899313+0000","last_became_active":"2024-09-12T00:31:47.131943+0000","last_became_peered":"2024-09-12T00:31:47.131943+0000","last_unstale":"2024-09-12T01:27:27.899313+0000","last_undegraded":"2024-09-12T01:27:27.899313+0000","last_fullsized":"2024-09-12T01:27:27.899313+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:25.947785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19519350,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":331,"num_read_kb":39412,"num_write":921,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:47.496403+0000","last_change":"2024-09-12T00:31:38.786719+0000","last_active":"2024-09-12T01:25:47.496403+0000","last_peered":"2024-09-12T01:25:47.496403+0000","last_clean":"2024-09-12T01:25:47.496403+0000","last_became_active":"2024-09-12T00:31:37.736507+0000","last_became_peered":"2024-09-12T00:31:37.736507+0000","last_unstale":"2024-09-12T01:25:47.496403+0000","last_undegraded":"2024-09-12T01:25:47.496403+0000","last_fullsized":"2024-09-12T01:25:47.496403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:48.124334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050928200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:03.500363+0000","last_change":"2024-09-12T00:31:52.154383+0000","last_active":"2024-09-12T01:26:03.500363+0000","last_peered":"2024-09-12T01:26:03.500363+0000","last_clean":"2024-09-12T01:26:03.500363+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:26:03.500363+0000","last_undegraded":"2024-09-12T01:26:03.500363+0000","last_fullsized":"2024-09-12T01:26:03.500363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:37.921158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'599","reported_seq":1283,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.158815+0000","last_change":"2024-09-12T00:31:54.162920+0000","last_active":"2024-09-12T01:29:15.158815+0000","last_peered":"2024-09-12T01:29:15.158815+0000","last_clean":"2024-09-12T01:29:15.158815+0000","last_became_active":"2024-09-12T00:31:54.162596+0000","last_became_peered":"2024-09-12T00:31:54.162596+0000","last_unstale":"2024-09-12T01:29:15.158815+0000","last_undegraded":"2024-09-12T01:29:15.158815+0000","last_fullsized":"2024-09-12T01:29:15.158815+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:38.618701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98974,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1014,"num_read_kb":2093,"num_write":884,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.505411+0000","last_change":"2024-09-12T00:31:56.170603+0000","last_active":"2024-09-12T01:26:09.505411+0000","last_peered":"2024-09-12T01:26:09.505411+0000","last_clean":"2024-09-12T01:26:09.505411+0000","last_became_active":"2024-09-12T00:31:56.170246+0000","last_became_peered":"2024-09-12T00:31:56.170246+0000","last_unstale":"2024-09-12T01:26:09.505411+0000","last_undegraded":"2024-09-12T01:26:09.505411+0000","last_fullsized":"2024-09-12T01:26:09.505411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:58.101767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'137","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.305820+0000","last_change":"2024-09-12T00:31:58.183531+0000","last_active":"2024-09-12T01:28:54.305820+0000","last_peered":"2024-09-12T01:28:54.305820+0000","last_clean":"2024-09-12T01:28:54.305820+0000","last_became_active":"2024-09-12T00:31:58.183206+0000","last_became_peered":"2024-09-12T00:31:58.183206+0000","last_unstale":"2024-09-12T01:28:54.305820+0000","last_undegraded":"2024-09-12T01:28:54.305820+0000","last_fullsized":"2024-09-12T01:28:54.305820+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:12.094595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":155,"num_write":341,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'131","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637220+0000","last_change":"2024-09-12T00:31:50.135481+0000","last_active":"2024-09-12T01:26:00.637220+0000","last_peered":"2024-09-12T01:26:00.637220+0000","last_clean":"2024-09-12T01:26:00.637220+0000","last_became_active":"2024-09-12T00:31:50.135197+0000","last_became_peered":"2024-09-12T00:31:50.135197+0000","last_unstale":"2024-09-12T01:26:00.637220+0000","last_undegraded":"2024-09-12T01:26:00.637220+0000","last_fullsized":"2024-09-12T01:26:00.637220+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:37.204019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":577,"num_read_kb":479,"num_write":210,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'277","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.629230+0000","last_change":"2024-09-12T00:31:47.121755+0000","last_active":"2024-09-12T01:29:15.629230+0000","last_peered":"2024-09-12T01:29:15.629230+0000","last_clean":"2024-09-12T01:29:15.629230+0000","last_became_active":"2024-09-12T00:31:47.121355+0000","last_became_peered":"2024-09-12T00:31:47.121355+0000","last_unstale":"2024-09-12T01:29:15.629230+0000","last_undegraded":"2024-09-12T01:29:15.629230+0000","last_fullsized":"2024-09-12T01:29:15.629230+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:07.246376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":866,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":426,"num_read_kb":443,"num_write":978,"num_write_kb":5362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.722299+0000","last_change":"2024-09-12T00:31:38.791827+0000","last_active":"2024-09-12T01:25:54.722299+0000","last_peered":"2024-09-12T01:25:54.722299+0000","last_clean":"2024-09-12T01:25:54.722299+0000","last_became_active":"2024-09-12T00:31:36.774289+0000","last_became_peered":"2024-09-12T00:31:36.774289+0000","last_unstale":"2024-09-12T01:25:54.722299+0000","last_undegraded":"2024-09-12T01:25:54.722299+0000","last_fullsized":"2024-09-12T01:25:54.722299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:55.526735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063853100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"37'8","reported_seq":1459,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.075671+0000","last_change":"2024-09-12T00:31:52.148172+0000","last_active":"2024-09-12T01:29:14.075671+0000","last_peered":"2024-09-12T01:29:14.075671+0000","last_clean":"2024-09-12T01:29:14.075671+0000","last_became_active":"2024-09-12T00:31:52.147856+0000","last_became_peered":"2024-09-12T00:31:52.147856+0000","last_unstale":"2024-09-12T01:29:14.075671+0000","last_undegraded":"2024-09-12T01:29:14.075671+0000","last_fullsized":"2024-09-12T01:29:14.075671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:28.451170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1609,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1450,"num_read_kb":1911,"num_write":16,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'176","reported_seq":746,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.637935+0000","last_change":"2024-09-12T00:31:54.170295+0000","last_active":"2024-09-12T01:26:05.637935+0000","last_peered":"2024-09-12T01:26:05.637935+0000","last_clean":"2024-09-12T01:26:05.637935+0000","last_became_active":"2024-09-12T00:31:54.169958+0000","last_became_peered":"2024-09-12T00:31:54.169958+0000","last_unstale":"2024-09-12T01:26:05.637935+0000","last_undegraded":"2024-09-12T01:26:05.637935+0000","last_fullsized":"2024-09-12T01:26:05.637935+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:37.410716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":229,"num_read_kb":218,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'771","reported_seq":2818,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.292960+0000","last_change":"2024-09-12T00:31:56.174875+0000","last_active":"2024-09-12T01:29:14.292960+0000","last_peered":"2024-09-12T01:29:14.292960+0000","last_clean":"2024-09-12T01:29:14.292960+0000","last_became_active":"2024-09-12T00:31:56.174535+0000","last_became_peered":"2024-09-12T00:31:56.174535+0000","last_unstale":"2024-09-12T01:29:14.292960+0000","last_undegraded":"2024-09-12T01:29:14.292960+0000","last_fullsized":"2024-09-12T01:29:14.292960+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:30.561634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'114","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:25.804418+0000","last_change":"2024-09-12T00:31:58.174504+0000","last_active":"2024-09-12T01:28:25.804418+0000","last_peered":"2024-09-12T01:28:25.804418+0000","last_clean":"2024-09-12T01:28:25.804418+0000","last_became_active":"2024-09-12T00:31:58.174086+0000","last_became_peered":"2024-09-12T00:31:58.174086+0000","last_unstale":"2024-09-12T01:28:25.804418+0000","last_undegraded":"2024-09-12T01:28:25.804418+0000","last_fullsized":"2024-09-12T01:28:25.804418+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:34.431865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":255,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'4367","reported_seq":5119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501053+0000","last_change":"2024-09-12T00:31:50.133031+0000","last_active":"2024-09-12T01:26:08.501053+0000","last_peered":"2024-09-12T01:26:08.501053+0000","last_clean":"2024-09-12T01:26:08.501053+0000","last_became_active":"2024-09-12T00:31:50.132703+0000","last_became_peered":"2024-09-12T00:31:50.132703+0000","last_unstale":"2024-09-12T01:26:08.501053+0000","last_undegraded":"2024-09-12T01:26:08.501053+0000","last_fullsized":"2024-09-12T01:26:08.501053+0000","mapping_epoch":27,"log_start":"265'4300","ondisk_log_start":"265'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":3000,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:18.582172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17817,"num_read_kb":14914,"num_write":6561,"num_write_kb":3320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'252","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:06.847147+0000","last_change":"2024-09-12T00:31:47.116552+0000","last_active":"2024-09-12T01:27:06.847147+0000","last_peered":"2024-09-12T01:27:06.847147+0000","last_clean":"2024-09-12T01:27:06.847147+0000","last_became_active":"2024-09-12T00:31:47.116205+0000","last_became_peered":"2024-09-12T00:31:47.116205+0000","last_unstale":"2024-09-12T01:27:06.847147+0000","last_undegraded":"2024-09-12T01:27:06.847147+0000","last_fullsized":"2024-09-12T01:27:06.847147+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:23.401827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11552390,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":424,"num_read_kb":46756,"num_write":1023,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:48.498503+0000","last_change":"2024-09-12T00:31:38.828567+0000","last_active":"2024-09-12T01:25:48.498503+0000","last_peered":"2024-09-12T01:25:48.498503+0000","last_clean":"2024-09-12T01:25:48.498503+0000","last_became_active":"2024-09-12T00:31:37.434707+0000","last_became_peered":"2024-09-12T00:31:37.434707+0000","last_unstale":"2024-09-12T01:25:48.498503+0000","last_undegraded":"2024-09-12T01:25:48.498503+0000","last_fullsized":"2024-09-12T01:25:48.498503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:44.992055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041578299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723540+0000","last_change":"2024-09-12T00:31:52.147221+0000","last_active":"2024-09-12T01:26:04.723540+0000","last_peered":"2024-09-12T01:26:04.723540+0000","last_clean":"2024-09-12T01:26:04.723540+0000","last_became_active":"2024-09-12T00:31:52.146927+0000","last_became_peered":"2024-09-12T00:31:52.146927+0000","last_unstale":"2024-09-12T01:26:04.723540+0000","last_undegraded":"2024-09-12T01:26:04.723540+0000","last_fullsized":"2024-09-12T01:26:04.723540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:07.292280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'129","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723596+0000","last_change":"2024-09-12T00:31:54.166886+0000","last_active":"2024-09-12T01:26:04.723596+0000","last_peered":"2024-09-12T01:26:04.723596+0000","last_clean":"2024-09-12T01:26:04.723596+0000","last_became_active":"2024-09-12T00:31:54.166612+0000","last_became_peered":"2024-09-12T00:31:54.166612+0000","last_unstale":"2024-09-12T01:26:04.723596+0000","last_undegraded":"2024-09-12T01:26:04.723596+0000","last_fullsized":"2024-09-12T01:26:04.723596+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:22.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":151,"num_read_kb":143,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'780","reported_seq":4656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.361508+0000","last_change":"2024-09-12T00:31:56.170683+0000","last_active":"2024-09-12T01:28:55.361508+0000","last_peered":"2024-09-12T01:28:55.361508+0000","last_clean":"2024-09-12T01:28:55.361508+0000","last_became_active":"2024-09-12T00:31:56.170358+0000","last_became_peered":"2024-09-12T00:31:56.170358+0000","last_unstale":"2024-09-12T01:28:55.361508+0000","last_undegraded":"2024-09-12T01:28:55.361508+0000","last_fullsized":"2024-09-12T01:28:55.361508+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:23.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'175","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:57.497649+0000","last_change":"2024-09-12T00:31:58.178681+0000","last_active":"2024-09-12T01:25:57.497649+0000","last_peered":"2024-09-12T01:25:57.497649+0000","last_clean":"2024-09-12T01:25:57.497649+0000","last_became_active":"2024-09-12T00:31:58.178148+0000","last_became_peered":"2024-09-12T00:31:58.178148+0000","last_unstale":"2024-09-12T01:25:57.497649+0000","last_undegraded":"2024-09-12T01:25:57.497649+0000","last_fullsized":"2024-09-12T01:25:57.497649+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:28.683801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":405,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'112","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:06.005883+0000","last_change":"2024-09-12T00:31:50.143058+0000","last_active":"2024-09-12T01:27:06.005883+0000","last_peered":"2024-09-12T01:27:06.005883+0000","last_clean":"2024-09-12T01:27:06.005883+0000","last_became_active":"2024-09-12T00:31:50.142769+0000","last_became_peered":"2024-09-12T00:31:50.142769+0000","last_unstale":"2024-09-12T01:27:06.005883+0000","last_undegraded":"2024-09-12T01:27:06.005883+0000","last_fullsized":"2024-09-12T01:27:06.005883+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:22.259280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":521,"num_read_kb":437,"num_write":174,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'318","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:58.499776+0000","last_change":"2024-09-12T00:31:47.116325+0000","last_active":"2024-09-12T01:25:58.499776+0000","last_peered":"2024-09-12T01:25:58.499776+0000","last_clean":"2024-09-12T01:25:58.499776+0000","last_became_active":"2024-09-12T00:31:47.115974+0000","last_became_peered":"2024-09-12T00:31:47.115974+0000","last_unstale":"2024-09-12T01:25:58.499776+0000","last_undegraded":"2024-09-12T01:25:58.499776+0000","last_fullsized":"2024-09-12T01:25:58.499776+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:40.653497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2942072,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":602,"num_read_kb":6022,"num_write":1033,"num_write_kb":14780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721781+0000","last_change":"2024-09-12T00:31:38.792390+0000","last_active":"2024-09-12T01:25:49.721781+0000","last_peered":"2024-09-12T01:25:49.721781+0000","last_clean":"2024-09-12T01:25:49.721781+0000","last_became_active":"2024-09-12T00:31:37.434487+0000","last_became_peered":"2024-09-12T00:31:37.434487+0000","last_unstale":"2024-09-12T01:25:49.721781+0000","last_undegraded":"2024-09-12T01:25:49.721781+0000","last_fullsized":"2024-09-12T01:25:49.721781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.146992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501076+0000","last_change":"2024-09-12T00:31:52.152659+0000","last_active":"2024-09-12T01:26:08.501076+0000","last_peered":"2024-09-12T01:26:08.501076+0000","last_clean":"2024-09-12T01:26:08.501076+0000","last_became_active":"2024-09-12T00:31:52.152173+0000","last_became_peered":"2024-09-12T00:31:52.152173+0000","last_unstale":"2024-09-12T01:26:08.501076+0000","last_undegraded":"2024-09-12T01:26:08.501076+0000","last_fullsized":"2024-09-12T01:26:08.501076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:41.559045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'724","reported_seq":1439,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.317168+0000","last_change":"2024-09-12T00:31:54.170238+0000","last_active":"2024-09-12T01:29:14.317168+0000","last_peered":"2024-09-12T01:29:14.317168+0000","last_clean":"2024-09-12T01:29:14.317168+0000","last_became_active":"2024-09-12T00:31:54.169994+0000","last_became_peered":"2024-09-12T00:31:54.169994+0000","last_unstale":"2024-09-12T01:29:14.317168+0000","last_undegraded":"2024-09-12T01:29:14.317168+0000","last_fullsized":"2024-09-12T01:29:14.317168+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:49.480724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168605,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1273,"num_read_kb":2692,"num_write":1046,"num_write_kb":860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501108+0000","last_change":"2024-09-12T00:31:56.172717+0000","last_active":"2024-09-12T01:26:08.501108+0000","last_peered":"2024-09-12T01:26:08.501108+0000","last_clean":"2024-09-12T01:26:08.501108+0000","last_became_active":"2024-09-12T00:31:56.172417+0000","last_became_peered":"2024-09-12T00:31:56.172417+0000","last_unstale":"2024-09-12T01:26:08.501108+0000","last_undegraded":"2024-09-12T01:26:08.501108+0000","last_fullsized":"2024-09-12T01:26:08.501108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:19.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'150","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.504454+0000","last_change":"2024-09-12T00:31:58.180306+0000","last_active":"2024-09-12T01:25:59.504454+0000","last_peered":"2024-09-12T01:25:59.504454+0000","last_clean":"2024-09-12T01:25:59.504454+0000","last_became_active":"2024-09-12T00:31:58.179998+0000","last_became_peered":"2024-09-12T00:31:58.179998+0000","last_unstale":"2024-09-12T01:25:59.504454+0000","last_undegraded":"2024-09-12T01:25:59.504454+0000","last_fullsized":"2024-09-12T01:25:59.504454+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:19.517308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":177,"num_read_kb":166,"num_write":377,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'158","reported_seq":722,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.538025+0000","last_change":"2024-09-12T00:31:58.178240+0000","last_active":"2024-09-12T01:27:48.538025+0000","last_peered":"2024-09-12T01:27:48.538025+0000","last_clean":"2024-09-12T01:27:48.538025+0000","last_became_active":"2024-09-12T00:31:58.177936+0000","last_became_peered":"2024-09-12T00:31:58.177936+0000","last_unstale":"2024-09-12T01:27:48.538025+0000","last_undegraded":"2024-09-12T01:27:48.538025+0000","last_fullsized":"2024-09-12T01:27:48.538025+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:52.216144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":226,"num_read_kb":224,"num_write":377,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'98","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:19.340107+0000","last_change":"2024-09-12T00:31:50.142477+0000","last_active":"2024-09-12T01:26:19.340107+0000","last_peered":"2024-09-12T01:26:19.340107+0000","last_clean":"2024-09-12T01:26:19.340107+0000","last_became_active":"2024-09-12T00:31:50.142206+0000","last_became_peered":"2024-09-12T00:31:50.142206+0000","last_unstale":"2024-09-12T01:26:19.340107+0000","last_undegraded":"2024-09-12T01:26:19.340107+0000","last_fullsized":"2024-09-12T01:26:19.340107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:15.569454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":133,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'252","reported_seq":857,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.654974+0000","last_change":"2024-09-12T00:31:47.128769+0000","last_active":"2024-09-12T01:29:14.654974+0000","last_peered":"2024-09-12T01:29:14.654974+0000","last_clean":"2024-09-12T01:29:14.654974+0000","last_became_active":"2024-09-12T00:31:47.128005+0000","last_became_peered":"2024-09-12T00:31:47.128005+0000","last_unstale":"2024-09-12T01:29:14.654974+0000","last_undegraded":"2024-09-12T01:29:14.654974+0000","last_fullsized":"2024-09-12T01:29:14.654974+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:09.592563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5487134,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":329,"num_read_kb":1002,"num_write":913,"num_write_kb":27047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:35.633125+0000","last_change":"2024-09-12T00:31:52.154225+0000","last_active":"2024-09-12T01:25:35.633125+0000","last_peered":"2024-09-12T01:25:35.633125+0000","last_clean":"2024-09-12T01:25:35.633125+0000","last_became_active":"2024-09-12T00:31:52.153927+0000","last_became_peered":"2024-09-12T00:31:52.153927+0000","last_unstale":"2024-09-12T01:25:35.633125+0000","last_undegraded":"2024-09-12T01:25:35.633125+0000","last_fullsized":"2024-09-12T01:25:35.633125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:05.731540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'289","reported_seq":867,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.667897+0000","last_change":"2024-09-12T00:31:54.167788+0000","last_active":"2024-09-12T01:29:14.667897+0000","last_peered":"2024-09-12T01:29:14.667897+0000","last_clean":"2024-09-12T01:29:14.667897+0000","last_became_active":"2024-09-12T00:31:54.167414+0000","last_became_peered":"2024-09-12T00:31:54.167414+0000","last_unstale":"2024-09-12T01:29:14.667897+0000","last_undegraded":"2024-09-12T01:29:14.667897+0000","last_fullsized":"2024-09-12T01:29:14.667897+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.633567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44314,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":1087,"num_write":386,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:35.777825+0000","last_change":"2024-09-12T00:31:56.173722+0000","last_active":"2024-09-12T01:25:35.777825+0000","last_peered":"2024-09-12T01:25:35.777825+0000","last_clean":"2024-09-12T01:25:35.777825+0000","last_became_active":"2024-09-12T00:31:56.173412+0000","last_became_peered":"2024-09-12T00:31:56.173412+0000","last_unstale":"2024-09-12T01:25:35.777825+0000","last_undegraded":"2024-09-12T01:25:35.777825+0000","last_fullsized":"2024-09-12T01:25:35.777825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:12.092104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'129","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:47.573025+0000","last_change":"2024-09-12T00:31:58.176621+0000","last_active":"2024-09-12T01:26:47.573025+0000","last_peered":"2024-09-12T01:26:47.573025+0000","last_clean":"2024-09-12T01:26:47.573025+0000","last_became_active":"2024-09-12T00:31:58.176322+0000","last_became_peered":"2024-09-12T00:31:58.176322+0000","last_unstale":"2024-09-12T01:26:47.573025+0000","last_undegraded":"2024-09-12T01:26:47.573025+0000","last_fullsized":"2024-09-12T01:26:47.573025+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:12.568369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":158,"num_write":327,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'158","reported_seq":806,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:33.496218+0000","last_change":"2024-09-12T00:31:50.128018+0000","last_active":"2024-09-12T01:25:33.496218+0000","last_peered":"2024-09-12T01:25:33.496218+0000","last_clean":"2024-09-12T01:25:33.496218+0000","last_became_active":"2024-09-12T00:31:50.127724+0000","last_became_peered":"2024-09-12T00:31:50.127724+0000","last_unstale":"2024-09-12T01:25:33.496218+0000","last_undegraded":"2024-09-12T01:25:33.496218+0000","last_fullsized":"2024-09-12T01:25:33.496218+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:22.239207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":587,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'300","reported_seq":1063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.495244+0000","last_change":"2024-09-12T00:31:47.138921+0000","last_active":"2024-09-12T01:24:59.495244+0000","last_peered":"2024-09-12T01:24:59.495244+0000","last_clean":"2024-09-12T01:24:59.495244+0000","last_became_active":"2024-09-12T00:31:47.138565+0000","last_became_peered":"2024-09-12T00:31:47.138565+0000","last_unstale":"2024-09-12T01:24:59.495244+0000","last_undegraded":"2024-09-12T01:24:59.495244+0000","last_fullsized":"2024-09-12T01:24:59.495244+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:02.222341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19350540,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":711,"num_read_kb":53412,"num_write":1069,"num_write_kb":60803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:33.496242+0000","last_change":"2024-09-12T00:31:52.155188+0000","last_active":"2024-09-12T01:25:33.496242+0000","last_peered":"2024-09-12T01:25:33.496242+0000","last_clean":"2024-09-12T01:25:33.496242+0000","last_became_active":"2024-09-12T00:31:52.154829+0000","last_became_peered":"2024-09-12T00:31:52.154829+0000","last_unstale":"2024-09-12T01:25:33.496242+0000","last_undegraded":"2024-09-12T01:25:33.496242+0000","last_fullsized":"2024-09-12T01:25:33.496242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:05.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'40","reported_seq":551,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:33.496173+0000","last_change":"2024-09-12T00:31:54.162972+0000","last_active":"2024-09-12T01:25:33.496173+0000","last_peered":"2024-09-12T01:25:33.496173+0000","last_clean":"2024-09-12T01:25:33.496173+0000","last_became_active":"2024-09-12T00:31:54.162657+0000","last_became_peered":"2024-09-12T00:31:54.162657+0000","last_unstale":"2024-09-12T01:25:33.496173+0000","last_undegraded":"2024-09-12T01:25:33.496173+0000","last_fullsized":"2024-09-12T01:25:33.496173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:24.360783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.502236+0000","last_change":"2024-09-12T00:31:56.170942+0000","last_active":"2024-09-12T01:25:39.502236+0000","last_peered":"2024-09-12T01:25:39.502236+0000","last_clean":"2024-09-12T01:25:39.502236+0000","last_became_active":"2024-09-12T00:31:56.170648+0000","last_became_peered":"2024-09-12T00:31:56.170648+0000","last_unstale":"2024-09-12T01:25:39.502236+0000","last_undegraded":"2024-09-12T01:25:39.502236+0000","last_fullsized":"2024-09-12T01:25:39.502236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:28.565117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'217","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.527288+0000","last_change":"2024-09-12T00:31:58.172827+0000","last_active":"2024-09-12T01:27:47.527288+0000","last_peered":"2024-09-12T01:27:47.527288+0000","last_clean":"2024-09-12T01:27:47.527288+0000","last_became_active":"2024-09-12T00:31:58.172511+0000","last_became_peered":"2024-09-12T00:31:58.172511+0000","last_unstale":"2024-09-12T01:27:47.527288+0000","last_undegraded":"2024-09-12T01:27:47.527288+0000","last_fullsized":"2024-09-12T01:27:47.527288+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:38.476612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":356,"num_read_kb":339,"num_write":509,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'63","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:27.801294+0000","last_change":"2024-09-12T00:31:50.125425+0000","last_active":"2024-09-12T01:26:27.801294+0000","last_peered":"2024-09-12T01:26:27.801294+0000","last_clean":"2024-09-12T01:26:27.801294+0000","last_became_active":"2024-09-12T00:31:50.124994+0000","last_became_peered":"2024-09-12T00:31:50.124994+0000","last_unstale":"2024-09-12T01:26:27.801294+0000","last_undegraded":"2024-09-12T01:26:27.801294+0000","last_fullsized":"2024-09-12T01:26:27.801294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:16.366629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":221,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'267","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.498188+0000","last_change":"2024-09-12T00:31:47.134711+0000","last_active":"2024-09-12T01:24:59.498188+0000","last_peered":"2024-09-12T01:24:59.498188+0000","last_clean":"2024-09-12T01:24:59.498188+0000","last_became_active":"2024-09-12T00:31:47.134398+0000","last_became_peered":"2024-09-12T00:31:47.134398+0000","last_unstale":"2024-09-12T01:24:59.498188+0000","last_undegraded":"2024-09-12T01:24:59.498188+0000","last_fullsized":"2024-09-12T01:24:59.498188+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:31.067474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6059902,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":403,"num_read_kb":102266,"num_write":999,"num_write_kb":44150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.501767+0000","last_change":"2024-09-12T00:31:52.152133+0000","last_active":"2024-09-12T01:25:34.501767+0000","last_peered":"2024-09-12T01:25:34.501767+0000","last_clean":"2024-09-12T01:25:34.501767+0000","last_became_active":"2024-09-12T00:31:52.151826+0000","last_became_peered":"2024-09-12T00:31:52.151826+0000","last_unstale":"2024-09-12T01:25:34.501767+0000","last_undegraded":"2024-09-12T01:25:34.501767+0000","last_fullsized":"2024-09-12T01:25:34.501767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:53.712859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'297","reported_seq":893,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.319654+0000","last_change":"2024-09-12T00:31:54.162484+0000","last_active":"2024-09-12T01:28:55.319654+0000","last_peered":"2024-09-12T01:28:55.319654+0000","last_clean":"2024-09-12T01:28:55.319654+0000","last_became_active":"2024-09-12T00:31:54.162188+0000","last_became_peered":"2024-09-12T00:31:54.162188+0000","last_unstale":"2024-09-12T01:28:55.319654+0000","last_undegraded":"2024-09-12T01:28:55.319654+0000","last_fullsized":"2024-09-12T01:28:55.319654+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:59.208178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56423,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":492,"num_read_kb":961,"num_write":392,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.603003+0000","last_change":"2024-09-12T00:31:56.168740+0000","last_active":"2024-09-12T01:25:39.603003+0000","last_peered":"2024-09-12T01:25:39.603003+0000","last_clean":"2024-09-12T01:25:39.603003+0000","last_became_active":"2024-09-12T00:31:56.168434+0000","last_became_peered":"2024-09-12T00:31:56.168434+0000","last_unstale":"2024-09-12T01:25:39.603003+0000","last_undegraded":"2024-09-12T01:25:39.603003+0000","last_fullsized":"2024-09-12T01:25:39.603003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:22.526791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'127","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.333302+0000","last_change":"2024-09-12T00:31:58.173821+0000","last_active":"2024-09-12T01:27:47.333302+0000","last_peered":"2024-09-12T01:27:47.333302+0000","last_clean":"2024-09-12T01:27:47.333302+0000","last_became_active":"2024-09-12T00:31:58.173552+0000","last_became_peered":"2024-09-12T00:31:58.173552+0000","last_unstale":"2024-09-12T01:27:47.333302+0000","last_undegraded":"2024-09-12T01:27:47.333302+0000","last_fullsized":"2024-09-12T01:27:47.333302+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:10.224892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":198,"num_write":331,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'107","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:30.776968+0000","last_change":"2024-09-12T00:31:50.133388+0000","last_active":"2024-09-12T01:25:30.776968+0000","last_peered":"2024-09-12T01:25:30.776968+0000","last_clean":"2024-09-12T01:25:30.776968+0000","last_became_active":"2024-09-12T00:31:50.133117+0000","last_became_peered":"2024-09-12T00:31:50.133117+0000","last_unstale":"2024-09-12T01:25:30.776968+0000","last_undegraded":"2024-09-12T01:25:30.776968+0000","last_fullsized":"2024-09-12T01:25:30.776968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:46.615971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":426,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'349","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:57.488614+0000","last_change":"2024-09-12T00:31:47.127969+0000","last_active":"2024-09-12T01:24:57.488614+0000","last_peered":"2024-09-12T01:24:57.488614+0000","last_clean":"2024-09-12T01:24:57.488614+0000","last_became_active":"2024-09-12T00:31:47.127603+0000","last_became_peered":"2024-09-12T00:31:47.127603+0000","last_unstale":"2024-09-12T01:24:57.488614+0000","last_undegraded":"2024-09-12T01:24:57.488614+0000","last_fullsized":"2024-09-12T01:24:57.488614+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:19.029593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12062135,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":758,"num_read_kb":29446,"num_write":1280,"num_write_kb":48637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718269+0000","last_change":"2024-09-12T00:31:52.152698+0000","last_active":"2024-09-12T01:25:34.718269+0000","last_peered":"2024-09-12T01:25:34.718269+0000","last_clean":"2024-09-12T01:25:34.718269+0000","last_became_active":"2024-09-12T00:31:52.152398+0000","last_became_peered":"2024-09-12T00:31:52.152398+0000","last_unstale":"2024-09-12T01:25:34.718269+0000","last_undegraded":"2024-09-12T01:25:34.718269+0000","last_fullsized":"2024-09-12T01:25:34.718269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:18.608839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'272","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.316191+0000","last_change":"2024-09-12T00:31:54.171666+0000","last_active":"2024-09-12T01:28:55.316191+0000","last_peered":"2024-09-12T01:28:55.316191+0000","last_clean":"2024-09-12T01:28:55.316191+0000","last_became_active":"2024-09-12T00:31:54.171386+0000","last_became_peered":"2024-09-12T00:31:54.171386+0000","last_unstale":"2024-09-12T01:28:55.316191+0000","last_undegraded":"2024-09-12T01:28:55.316191+0000","last_fullsized":"2024-09-12T01:28:55.316191+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:37.250983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":949,"num_write":370,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:35.777911+0000","last_change":"2024-09-12T00:31:56.167578+0000","last_active":"2024-09-12T01:25:35.777911+0000","last_peered":"2024-09-12T01:25:35.777911+0000","last_clean":"2024-09-12T01:25:35.777911+0000","last_became_active":"2024-09-12T00:31:56.167213+0000","last_became_peered":"2024-09-12T00:31:56.167213+0000","last_unstale":"2024-09-12T01:25:35.777911+0000","last_undegraded":"2024-09-12T01:25:35.777911+0000","last_fullsized":"2024-09-12T01:25:35.777911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:56.884166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'120","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.353194+0000","last_change":"2024-09-12T00:31:50.140157+0000","last_active":"2024-09-12T01:26:44.353194+0000","last_peered":"2024-09-12T01:26:44.353194+0000","last_clean":"2024-09-12T01:26:44.353194+0000","last_became_active":"2024-09-12T00:31:50.139863+0000","last_became_peered":"2024-09-12T00:31:50.139863+0000","last_unstale":"2024-09-12T01:26:44.353194+0000","last_undegraded":"2024-09-12T01:26:44.353194+0000","last_fullsized":"2024-09-12T01:26:44.353194+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:39.011610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":466,"num_write":169,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'378","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:47.860770+0000","last_change":"2024-09-12T00:31:47.133721+0000","last_active":"2024-09-12T01:28:47.860770+0000","last_peered":"2024-09-12T01:28:47.860770+0000","last_clean":"2024-09-12T01:28:47.860770+0000","last_became_active":"2024-09-12T00:31:47.133283+0000","last_became_peered":"2024-09-12T00:31:47.133283+0000","last_unstale":"2024-09-12T01:28:47.860770+0000","last_undegraded":"2024-09-12T01:28:47.860770+0000","last_fullsized":"2024-09-12T01:28:47.860770+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:13.162609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4280259,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":673,"num_read_kb":14924,"num_write":1380,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.638064+0000","last_change":"2024-09-12T00:31:52.152988+0000","last_active":"2024-09-12T01:26:05.638064+0000","last_peered":"2024-09-12T01:26:05.638064+0000","last_clean":"2024-09-12T01:26:05.638064+0000","last_became_active":"2024-09-12T00:31:52.152676+0000","last_became_peered":"2024-09-12T00:31:52.152676+0000","last_unstale":"2024-09-12T01:26:05.638064+0000","last_undegraded":"2024-09-12T01:26:05.638064+0000","last_fullsized":"2024-09-12T01:26:05.638064+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:00.660120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'505","reported_seq":1135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.642844+0000","last_change":"2024-09-12T00:31:54.171588+0000","last_active":"2024-09-12T01:29:15.642844+0000","last_peered":"2024-09-12T01:29:15.642844+0000","last_clean":"2024-09-12T01:29:15.642844+0000","last_became_active":"2024-09-12T00:31:54.171225+0000","last_became_peered":"2024-09-12T00:31:54.171225+0000","last_unstale":"2024-09-12T01:29:15.642844+0000","last_undegraded":"2024-09-12T01:29:15.642844+0000","last_fullsized":"2024-09-12T01:29:15.642844+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:56.460340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109241,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":916,"num_read_kb":2120,"num_write":791,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:29.494824+0000","last_change":"2024-09-12T00:31:56.176025+0000","last_active":"2024-09-12T01:24:29.494824+0000","last_peered":"2024-09-12T01:24:29.494824+0000","last_clean":"2024-09-12T01:24:29.494824+0000","last_became_active":"2024-09-12T00:31:56.175562+0000","last_became_peered":"2024-09-12T00:31:56.175562+0000","last_unstale":"2024-09-12T01:24:29.494824+0000","last_undegraded":"2024-09-12T01:24:29.494824+0000","last_fullsized":"2024-09-12T01:24:29.494824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:07.085146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'142","reported_seq":641,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.598076+0000","last_change":"2024-09-12T00:31:58.183054+0000","last_active":"2024-09-12T01:27:47.598076+0000","last_peered":"2024-09-12T01:27:47.598076+0000","last_clean":"2024-09-12T01:27:47.598076+0000","last_became_active":"2024-09-12T00:31:58.182602+0000","last_became_peered":"2024-09-12T00:31:58.182602+0000","last_unstale":"2024-09-12T01:27:47.598076+0000","last_undegraded":"2024-09-12T01:27:47.598076+0000","last_fullsized":"2024-09-12T01:27:47.598076+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:54.264038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":164,"num_write":296,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'135","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501163+0000","last_change":"2024-09-12T00:31:50.132346+0000","last_active":"2024-09-12T01:26:08.501163+0000","last_peered":"2024-09-12T01:26:08.501163+0000","last_clean":"2024-09-12T01:26:08.501163+0000","last_became_active":"2024-09-12T00:31:50.132053+0000","last_became_peered":"2024-09-12T00:31:50.132053+0000","last_unstale":"2024-09-12T01:26:08.501163+0000","last_undegraded":"2024-09-12T01:26:08.501163+0000","last_fullsized":"2024-09-12T01:26:08.501163+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:29.446981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":637,"num_read_kb":540,"num_write":205,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'272","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:36.007345+0000","last_change":"2024-09-12T00:31:47.115298+0000","last_active":"2024-09-12T01:26:36.007345+0000","last_peered":"2024-09-12T01:26:36.007345+0000","last_clean":"2024-09-12T01:26:36.007345+0000","last_became_active":"2024-09-12T00:31:47.114966+0000","last_became_peered":"2024-09-12T00:31:47.114966+0000","last_unstale":"2024-09-12T01:26:36.007345+0000","last_undegraded":"2024-09-12T01:26:36.007345+0000","last_fullsized":"2024-09-12T01:26:36.007345+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:38.967213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604511,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":443,"num_read_kb":26176,"num_write":1060,"num_write_kb":27429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.504979+0000","last_change":"2024-09-12T00:31:52.154420+0000","last_active":"2024-09-12T01:26:04.504979+0000","last_peered":"2024-09-12T01:26:04.504979+0000","last_clean":"2024-09-12T01:26:04.504979+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:26:04.504979+0000","last_undegraded":"2024-09-12T01:26:04.504979+0000","last_fullsized":"2024-09-12T01:26:04.504979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:52.675576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'289","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.317650+0000","last_change":"2024-09-12T00:31:54.166286+0000","last_active":"2024-09-12T01:28:55.317650+0000","last_peered":"2024-09-12T01:28:55.317650+0000","last_clean":"2024-09-12T01:28:55.317650+0000","last_became_active":"2024-09-12T00:31:54.165996+0000","last_became_peered":"2024-09-12T00:31:54.165996+0000","last_unstale":"2024-09-12T01:28:55.317650+0000","last_undegraded":"2024-09-12T01:28:55.317650+0000","last_fullsized":"2024-09-12T01:28:55.317650+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:34.576390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49103,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":905,"num_write":394,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:27.483919+0000","last_change":"2024-09-12T00:31:56.171294+0000","last_active":"2024-09-12T01:24:27.483919+0000","last_peered":"2024-09-12T01:24:27.483919+0000","last_clean":"2024-09-12T01:24:27.483919+0000","last_became_active":"2024-09-12T00:31:56.170994+0000","last_became_peered":"2024-09-12T00:31:56.170994+0000","last_unstale":"2024-09-12T01:24:27.483919+0000","last_undegraded":"2024-09-12T01:24:27.483919+0000","last_fullsized":"2024-09-12T01:24:27.483919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:36.423772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'162","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:06.007997+0000","last_change":"2024-09-12T00:31:58.183946+0000","last_active":"2024-09-12T01:27:06.007997+0000","last_peered":"2024-09-12T01:27:06.007997+0000","last_clean":"2024-09-12T01:27:06.007997+0000","last_became_active":"2024-09-12T00:31:58.183625+0000","last_became_peered":"2024-09-12T00:31:58.183625+0000","last_unstale":"2024-09-12T01:27:06.007997+0000","last_undegraded":"2024-09-12T01:27:06.007997+0000","last_fullsized":"2024-09-12T01:27:06.007997+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:34.434376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2035,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":465,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'119","reported_seq":695,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:20.765834+0000","last_change":"2024-09-12T00:31:50.143762+0000","last_active":"2024-09-12T01:24:20.765834+0000","last_peered":"2024-09-12T01:24:20.765834+0000","last_clean":"2024-09-12T01:24:20.765834+0000","last_became_active":"2024-09-12T00:31:50.143427+0000","last_became_peered":"2024-09-12T00:31:50.143427+0000","last_unstale":"2024-09-12T01:24:20.765834+0000","last_undegraded":"2024-09-12T01:24:20.765834+0000","last_fullsized":"2024-09-12T01:24:20.765834+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:04.603054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":539,"num_read_kb":443,"num_write":196,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'299","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:49.610261+0000","last_change":"2024-09-12T00:31:47.117996+0000","last_active":"2024-09-12T01:26:49.610261+0000","last_peered":"2024-09-12T01:26:49.610261+0000","last_clean":"2024-09-12T01:26:49.610261+0000","last_became_active":"2024-09-12T00:31:47.117631+0000","last_became_peered":"2024-09-12T00:31:47.117631+0000","last_unstale":"2024-09-12T01:26:49.610261+0000","last_undegraded":"2024-09-12T01:26:49.610261+0000","last_fullsized":"2024-09-12T01:26:49.610261+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:35.099357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31853,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":532,"num_read_kb":5850,"num_write":1155,"num_write_kb":26346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:24.494220+0000","last_change":"2024-09-12T00:31:52.152113+0000","last_active":"2024-09-12T01:24:24.494220+0000","last_peered":"2024-09-12T01:24:24.494220+0000","last_clean":"2024-09-12T01:24:24.494220+0000","last_became_active":"2024-09-12T00:31:52.151796+0000","last_became_peered":"2024-09-12T00:31:52.151796+0000","last_unstale":"2024-09-12T01:24:24.494220+0000","last_undegraded":"2024-09-12T01:24:24.494220+0000","last_fullsized":"2024-09-12T01:24:24.494220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:30.115077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'312","reported_seq":893,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.924627+0000","last_change":"2024-09-12T00:31:54.171225+0000","last_active":"2024-09-12T01:29:14.924627+0000","last_peered":"2024-09-12T01:29:14.924627+0000","last_clean":"2024-09-12T01:29:14.924627+0000","last_became_active":"2024-09-12T00:31:54.170965+0000","last_became_peered":"2024-09-12T00:31:54.170965+0000","last_unstale":"2024-09-12T01:29:14.924627+0000","last_undegraded":"2024-09-12T01:29:14.924627+0000","last_fullsized":"2024-09-12T01:29:14.924627+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:10.738478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":509,"num_read_kb":1155,"num_write":420,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782663+0000","last_change":"2024-09-12T00:31:56.172806+0000","last_active":"2024-09-12T01:26:05.782663+0000","last_peered":"2024-09-12T01:26:05.782663+0000","last_clean":"2024-09-12T01:26:05.782663+0000","last_became_active":"2024-09-12T00:31:56.172337+0000","last_became_peered":"2024-09-12T00:31:56.172337+0000","last_unstale":"2024-09-12T01:26:05.782663+0000","last_undegraded":"2024-09-12T01:26:05.782663+0000","last_fullsized":"2024-09-12T01:26:05.782663+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:10.789777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'133","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.342581+0000","last_change":"2024-09-12T00:31:58.178826+0000","last_active":"2024-09-12T01:28:55.342581+0000","last_peered":"2024-09-12T01:28:55.342581+0000","last_clean":"2024-09-12T01:28:55.342581+0000","last_became_active":"2024-09-12T00:31:58.178565+0000","last_became_peered":"2024-09-12T00:31:58.178565+0000","last_unstale":"2024-09-12T01:28:55.342581+0000","last_undegraded":"2024-09-12T01:28:55.342581+0000","last_fullsized":"2024-09-12T01:28:55.342581+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:10.421354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":335,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'510","reported_seq":1278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:38.996474+0000","last_change":"2024-09-12T00:31:50.138366+0000","last_active":"2024-09-12T01:24:38.996474+0000","last_peered":"2024-09-12T01:24:38.996474+0000","last_clean":"2024-09-12T01:24:38.996474+0000","last_became_active":"2024-09-12T00:31:50.137671+0000","last_became_peered":"2024-09-12T00:31:50.137671+0000","last_unstale":"2024-09-12T01:24:38.996474+0000","last_undegraded":"2024-09-12T01:24:38.996474+0000","last_fullsized":"2024-09-12T01:24:38.996474+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:54.842903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2432,"num_read_kb":2072,"num_write":871,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'394","reported_seq":1201,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:18.485370+0000","last_change":"2024-09-12T00:31:47.130554+0000","last_active":"2024-09-12T01:24:18.485370+0000","last_peered":"2024-09-12T01:24:18.485370+0000","last_clean":"2024-09-12T01:24:18.485370+0000","last_became_active":"2024-09-12T00:31:47.130035+0000","last_became_peered":"2024-09-12T00:31:47.130035+0000","last_unstale":"2024-09-12T01:24:18.485370+0000","last_undegraded":"2024-09-12T01:24:18.485370+0000","last_fullsized":"2024-09-12T01:24:18.485370+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:20.320045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16831379,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":1005,"num_read_kb":24732,"num_write":1235,"num_write_kb":48327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:23.486245+0000","last_change":"2024-09-12T00:31:52.156699+0000","last_active":"2024-09-12T01:24:23.486245+0000","last_peered":"2024-09-12T01:24:23.486245+0000","last_clean":"2024-09-12T01:24:23.486245+0000","last_became_active":"2024-09-12T00:31:52.155279+0000","last_became_peered":"2024-09-12T00:31:52.155279+0000","last_unstale":"2024-09-12T01:24:23.486245+0000","last_undegraded":"2024-09-12T01:24:23.486245+0000","last_fullsized":"2024-09-12T01:24:23.486245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:38.156587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'113","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.722904+0000","last_change":"2024-09-12T00:31:54.166092+0000","last_active":"2024-09-12T01:25:59.722904+0000","last_peered":"2024-09-12T01:25:59.722904+0000","last_clean":"2024-09-12T01:25:59.722904+0000","last_became_active":"2024-09-12T00:31:54.165779+0000","last_became_peered":"2024-09-12T00:31:54.165779+0000","last_unstale":"2024-09-12T01:25:59.722904+0000","last_undegraded":"2024-09-12T01:25:59.722904+0000","last_fullsized":"2024-09-12T01:25:59.722904+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:53.134965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":137,"num_write":154,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'759","reported_seq":2335,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.291733+0000","last_change":"2024-09-12T00:31:56.172869+0000","last_active":"2024-09-12T01:29:14.291733+0000","last_peered":"2024-09-12T01:29:14.291733+0000","last_clean":"2024-09-12T01:29:14.291733+0000","last_became_active":"2024-09-12T00:31:56.172551+0000","last_became_peered":"2024-09-12T00:31:56.172551+0000","last_unstale":"2024-09-12T01:29:14.291733+0000","last_undegraded":"2024-09-12T01:29:14.291733+0000","last_fullsized":"2024-09-12T01:29:14.291733+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:33.670974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'121","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:33.597265+0000","last_change":"2024-09-12T00:31:58.178960+0000","last_active":"2024-09-12T01:26:33.597265+0000","last_peered":"2024-09-12T01:26:33.597265+0000","last_clean":"2024-09-12T01:26:33.597265+0000","last_became_active":"2024-09-12T00:31:58.178671+0000","last_became_peered":"2024-09-12T00:31:58.178671+0000","last_unstale":"2024-09-12T01:26:33.597265+0000","last_undegraded":"2024-09-12T01:26:33.597265+0000","last_fullsized":"2024-09-12T01:26:33.597265+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:53.455583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'144","reported_seq":783,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:51.703973+0000","last_change":"2024-09-12T00:31:50.143687+0000","last_active":"2024-09-12T01:25:51.703973+0000","last_peered":"2024-09-12T01:25:51.703973+0000","last_clean":"2024-09-12T01:25:51.703973+0000","last_became_active":"2024-09-12T00:31:50.143377+0000","last_became_peered":"2024-09-12T00:31:50.143377+0000","last_unstale":"2024-09-12T01:25:51.703973+0000","last_undegraded":"2024-09-12T01:25:51.703973+0000","last_fullsized":"2024-09-12T01:25:51.703973+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:37.794802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":664,"num_read_kb":566,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'320","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.376450+0000","last_change":"2024-09-12T00:31:47.129018+0000","last_active":"2024-09-12T01:29:14.376450+0000","last_peered":"2024-09-12T01:29:14.376450+0000","last_clean":"2024-09-12T01:29:14.376450+0000","last_became_active":"2024-09-12T00:31:47.128555+0000","last_became_peered":"2024-09-12T00:31:47.128555+0000","last_unstale":"2024-09-12T01:29:14.376450+0000","last_undegraded":"2024-09-12T01:29:14.376450+0000","last_fullsized":"2024-09-12T01:29:14.376450+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:57.399019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2861896,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":676,"num_read_kb":10967,"num_write":1198,"num_write_kb":23618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:24.594787+0000","last_change":"2024-09-12T00:31:52.151155+0000","last_active":"2024-09-12T01:24:24.594787+0000","last_peered":"2024-09-12T01:24:24.594787+0000","last_clean":"2024-09-12T01:24:24.594787+0000","last_became_active":"2024-09-12T00:31:52.150825+0000","last_became_peered":"2024-09-12T00:31:52.150825+0000","last_unstale":"2024-09-12T01:24:24.594787+0000","last_undegraded":"2024-09-12T01:24:24.594787+0000","last_fullsized":"2024-09-12T01:24:24.594787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:11.561537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'340","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.306588+0000","last_change":"2024-09-12T00:31:54.169556+0000","last_active":"2024-09-12T01:28:55.306588+0000","last_peered":"2024-09-12T01:28:55.306588+0000","last_clean":"2024-09-12T01:28:55.306588+0000","last_became_active":"2024-09-12T00:31:54.169308+0000","last_became_peered":"2024-09-12T00:31:54.169308+0000","last_unstale":"2024-09-12T01:28:55.306588+0000","last_undegraded":"2024-09-12T01:28:55.306588+0000","last_fullsized":"2024-09-12T01:28:55.306588+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:17.921463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55044,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":545,"num_read_kb":1036,"num_write":440,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:08.492547+0000","last_change":"2024-09-12T00:31:56.173701+0000","last_active":"2024-09-12T01:25:08.492547+0000","last_peered":"2024-09-12T01:25:08.492547+0000","last_clean":"2024-09-12T01:25:08.492547+0000","last_became_active":"2024-09-12T00:31:56.173389+0000","last_became_peered":"2024-09-12T00:31:56.173389+0000","last_unstale":"2024-09-12T01:25:08.492547+0000","last_undegraded":"2024-09-12T01:25:08.492547+0000","last_fullsized":"2024-09-12T01:25:08.492547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:28.642695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'140","reported_seq":639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:34.516248+0000","last_change":"2024-09-12T00:31:58.183381+0000","last_active":"2024-09-12T01:27:34.516248+0000","last_peered":"2024-09-12T01:27:34.516248+0000","last_clean":"2024-09-12T01:27:34.516248+0000","last_became_active":"2024-09-12T00:31:58.183017+0000","last_became_peered":"2024-09-12T00:31:58.183017+0000","last_unstale":"2024-09-12T01:27:34.516248+0000","last_undegraded":"2024-09-12T01:27:34.516248+0000","last_fullsized":"2024-09-12T01:27:34.516248+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:38.690748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":129,"num_write":333,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'129","reported_seq":739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.390615+0000","last_change":"2024-09-12T00:31:50.137190+0000","last_active":"2024-09-12T01:28:54.390615+0000","last_peered":"2024-09-12T01:28:54.390615+0000","last_clean":"2024-09-12T01:28:54.390615+0000","last_became_active":"2024-09-12T00:31:50.136941+0000","last_became_peered":"2024-09-12T00:31:50.136941+0000","last_unstale":"2024-09-12T01:28:54.390615+0000","last_undegraded":"2024-09-12T01:28:54.390615+0000","last_fullsized":"2024-09-12T01:28:54.390615+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:49.870575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":653,"num_read_kb":587,"num_write":190,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'280","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.707659+0000","last_change":"2024-09-12T00:31:47.133016+0000","last_active":"2024-09-12T01:29:14.707659+0000","last_peered":"2024-09-12T01:29:14.707659+0000","last_clean":"2024-09-12T01:29:14.707659+0000","last_became_active":"2024-09-12T00:31:47.131600+0000","last_became_peered":"2024-09-12T00:31:47.131600+0000","last_unstale":"2024-09-12T01:29:14.707659+0000","last_undegraded":"2024-09-12T01:29:14.707659+0000","last_fullsized":"2024-09-12T01:29:14.707659+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:24.795534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10811612,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":434,"num_read_kb":43308,"num_write":1037,"num_write_kb":38822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:24.494193+0000","last_change":"2024-09-12T00:31:52.152831+0000","last_active":"2024-09-12T01:24:24.494193+0000","last_peered":"2024-09-12T01:24:24.494193+0000","last_clean":"2024-09-12T01:24:24.494193+0000","last_became_active":"2024-09-12T00:31:52.152537+0000","last_became_peered":"2024-09-12T00:31:52.152537+0000","last_unstale":"2024-09-12T01:24:24.494193+0000","last_undegraded":"2024-09-12T01:24:24.494193+0000","last_fullsized":"2024-09-12T01:24:24.494193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:58.263055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'276","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:28.512446+0000","last_change":"2024-09-12T00:31:54.164435+0000","last_active":"2024-09-12T01:27:28.512446+0000","last_peered":"2024-09-12T01:27:28.512446+0000","last_clean":"2024-09-12T01:27:28.512446+0000","last_became_active":"2024-09-12T00:31:54.163977+0000","last_became_peered":"2024-09-12T00:31:54.163977+0000","last_unstale":"2024-09-12T01:27:28.512446+0000","last_undegraded":"2024-09-12T01:27:28.512446+0000","last_fullsized":"2024-09-12T01:27:28.512446+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:06.747649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54013,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":902,"num_write":362,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.716184+0000","last_change":"2024-09-12T00:31:56.171991+0000","last_active":"2024-09-12T01:25:14.716184+0000","last_peered":"2024-09-12T01:25:14.716184+0000","last_clean":"2024-09-12T01:25:14.716184+0000","last_became_active":"2024-09-12T00:31:56.171306+0000","last_became_peered":"2024-09-12T00:31:56.171306+0000","last_unstale":"2024-09-12T01:25:14.716184+0000","last_undegraded":"2024-09-12T01:25:14.716184+0000","last_fullsized":"2024-09-12T01:25:14.716184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:32.961885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'124","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:53.708398+0000","last_change":"2024-09-12T00:31:58.183063+0000","last_active":"2024-09-12T01:26:53.708398+0000","last_peered":"2024-09-12T01:26:53.708398+0000","last_clean":"2024-09-12T01:26:53.708398+0000","last_became_active":"2024-09-12T00:31:58.182701+0000","last_became_peered":"2024-09-12T00:31:58.182701+0000","last_unstale":"2024-09-12T01:26:53.708398+0000","last_undegraded":"2024-09-12T01:26:53.708398+0000","last_fullsized":"2024-09-12T01:26:53.708398+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:26.910205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":215,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'42","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:10.774133+0000","last_change":"2024-09-12T00:31:50.137242+0000","last_active":"2024-09-12T01:25:10.774133+0000","last_peered":"2024-09-12T01:25:10.774133+0000","last_clean":"2024-09-12T01:25:10.774133+0000","last_became_active":"2024-09-12T00:31:50.136971+0000","last_became_peered":"2024-09-12T00:31:50.136971+0000","last_unstale":"2024-09-12T01:25:10.774133+0000","last_undegraded":"2024-09-12T01:25:10.774133+0000","last_fullsized":"2024-09-12T01:25:10.774133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:43.613753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":180,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'277","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:29.947548+0000","last_change":"2024-09-12T00:31:47.123731+0000","last_active":"2024-09-12T01:27:29.947548+0000","last_peered":"2024-09-12T01:27:29.947548+0000","last_clean":"2024-09-12T01:27:29.947548+0000","last_became_active":"2024-09-12T00:31:47.123001+0000","last_became_peered":"2024-09-12T00:31:47.123001+0000","last_unstale":"2024-09-12T01:27:29.947548+0000","last_undegraded":"2024-09-12T01:27:29.947548+0000","last_fullsized":"2024-09-12T01:27:29.947548+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:56.448580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15489161,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":440,"num_read_kb":39605,"num_write":1019,"num_write_kb":26742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.599267+0000","last_change":"2024-09-12T00:31:52.151290+0000","last_active":"2024-09-12T01:25:04.599267+0000","last_peered":"2024-09-12T01:25:04.599267+0000","last_clean":"2024-09-12T01:25:04.599267+0000","last_became_active":"2024-09-12T00:31:52.150969+0000","last_became_peered":"2024-09-12T00:31:52.150969+0000","last_unstale":"2024-09-12T01:25:04.599267+0000","last_undegraded":"2024-09-12T01:25:04.599267+0000","last_fullsized":"2024-09-12T01:25:04.599267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:12.373364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'257","reported_seq":815,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.791165+0000","last_change":"2024-09-12T00:31:54.170159+0000","last_active":"2024-09-12T01:29:14.791165+0000","last_peered":"2024-09-12T01:29:14.791165+0000","last_clean":"2024-09-12T01:29:14.791165+0000","last_became_active":"2024-09-12T00:31:54.169845+0000","last_became_peered":"2024-09-12T00:31:54.169845+0000","last_unstale":"2024-09-12T01:29:14.791165+0000","last_undegraded":"2024-09-12T01:29:14.791165+0000","last_fullsized":"2024-09-12T01:29:14.791165+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:44.500869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47509,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":435,"num_read_kb":1050,"num_write":360,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:29.710613+0000","last_change":"2024-09-12T00:31:56.171144+0000","last_active":"2024-09-12T01:24:29.710613+0000","last_peered":"2024-09-12T01:24:29.710613+0000","last_clean":"2024-09-12T01:24:29.710613+0000","last_became_active":"2024-09-12T00:31:56.170767+0000","last_became_peered":"2024-09-12T00:31:56.170767+0000","last_unstale":"2024-09-12T01:24:29.710613+0000","last_undegraded":"2024-09-12T01:24:29.710613+0000","last_fullsized":"2024-09-12T01:24:29.710613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:18.923254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'182","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:45.513528+0000","last_change":"2024-09-12T00:31:58.173318+0000","last_active":"2024-09-12T01:27:45.513528+0000","last_peered":"2024-09-12T01:27:45.513528+0000","last_clean":"2024-09-12T01:27:45.513528+0000","last_became_active":"2024-09-12T00:31:58.173049+0000","last_became_peered":"2024-09-12T00:31:58.173049+0000","last_unstale":"2024-09-12T01:27:45.513528+0000","last_undegraded":"2024-09-12T01:27:45.513528+0000","last_fullsized":"2024-09-12T01:27:45.513528+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:38.032229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1227,"num_read_kb":1215,"num_write":440,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'220","reported_seq":785,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:51.961896+0000","last_change":"2024-09-12T00:31:50.141286+0000","last_active":"2024-09-12T01:26:51.961896+0000","last_peered":"2024-09-12T01:26:51.961896+0000","last_clean":"2024-09-12T01:26:51.961896+0000","last_became_active":"2024-09-12T00:31:50.141009+0000","last_became_peered":"2024-09-12T00:31:50.141009+0000","last_unstale":"2024-09-12T01:26:51.961896+0000","last_undegraded":"2024-09-12T01:26:51.961896+0000","last_fullsized":"2024-09-12T01:26:51.961896+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:16.669109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":914,"num_read_kb":727,"num_write":339,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'323","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:57.497740+0000","last_change":"2024-09-12T00:31:47.118759+0000","last_active":"2024-09-12T01:25:57.497740+0000","last_peered":"2024-09-12T01:25:57.497740+0000","last_clean":"2024-09-12T01:25:57.497740+0000","last_became_active":"2024-09-12T00:31:47.118434+0000","last_became_peered":"2024-09-12T00:31:47.118434+0000","last_unstale":"2024-09-12T01:25:57.497740+0000","last_undegraded":"2024-09-12T01:25:57.497740+0000","last_fullsized":"2024-09-12T01:25:57.497740+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:02.477229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3404,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":551,"num_read_kb":10819,"num_write":1179,"num_write_kb":40782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:18.494021+0000","last_change":"2024-09-12T00:31:52.149493+0000","last_active":"2024-09-12T01:25:18.494021+0000","last_peered":"2024-09-12T01:25:18.494021+0000","last_clean":"2024-09-12T01:25:18.494021+0000","last_became_active":"2024-09-12T00:31:52.148440+0000","last_became_peered":"2024-09-12T00:31:52.148440+0000","last_unstale":"2024-09-12T01:25:18.494021+0000","last_undegraded":"2024-09-12T01:25:18.494021+0000","last_fullsized":"2024-09-12T01:25:18.494021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:59.545517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'306","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.336903+0000","last_change":"2024-09-12T00:31:54.168195+0000","last_active":"2024-09-12T01:28:55.336903+0000","last_peered":"2024-09-12T01:28:55.336903+0000","last_clean":"2024-09-12T01:28:55.336903+0000","last_became_active":"2024-09-12T00:31:54.167915+0000","last_became_peered":"2024-09-12T00:31:54.167915+0000","last_unstale":"2024-09-12T01:28:55.336903+0000","last_undegraded":"2024-09-12T01:28:55.336903+0000","last_fullsized":"2024-09-12T01:28:55.336903+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:50.298831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54102,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":979,"num_write":400,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:28.487167+0000","last_change":"2024-09-12T00:31:56.174946+0000","last_active":"2024-09-12T01:24:28.487167+0000","last_peered":"2024-09-12T01:24:28.487167+0000","last_clean":"2024-09-12T01:24:28.487167+0000","last_became_active":"2024-09-12T00:31:56.171654+0000","last_became_peered":"2024-09-12T00:31:56.171654+0000","last_unstale":"2024-09-12T01:24:28.487167+0000","last_undegraded":"2024-09-12T01:24:28.487167+0000","last_fullsized":"2024-09-12T01:24:28.487167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:00.032668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'130","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.389173+0000","last_change":"2024-09-12T00:31:58.182334+0000","last_active":"2024-09-12T01:28:54.389173+0000","last_peered":"2024-09-12T01:28:54.389173+0000","last_clean":"2024-09-12T01:28:54.389173+0000","last_became_active":"2024-09-12T00:31:58.181864+0000","last_became_peered":"2024-09-12T00:31:58.181864+0000","last_unstale":"2024-09-12T01:28:54.389173+0000","last_undegraded":"2024-09-12T01:28:54.389173+0000","last_fullsized":"2024-09-12T01:28:54.389173+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:46.609359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":169,"num_write":329,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'138","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:53.705713+0000","last_change":"2024-09-12T00:31:50.124123+0000","last_active":"2024-09-12T01:26:53.705713+0000","last_peered":"2024-09-12T01:26:53.705713+0000","last_clean":"2024-09-12T01:26:53.705713+0000","last_became_active":"2024-09-12T00:31:50.123862+0000","last_became_peered":"2024-09-12T00:31:50.123862+0000","last_unstale":"2024-09-12T01:26:53.705713+0000","last_undegraded":"2024-09-12T01:26:53.705713+0000","last_fullsized":"2024-09-12T01:26:53.705713+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:52.021145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":471,"num_write":227,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'289","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.504377+0000","last_change":"2024-09-12T00:31:47.132671+0000","last_active":"2024-09-12T01:25:59.504377+0000","last_peered":"2024-09-12T01:25:59.504377+0000","last_clean":"2024-09-12T01:25:59.504377+0000","last_became_active":"2024-09-12T00:31:47.132236+0000","last_became_peered":"2024-09-12T00:31:47.132236+0000","last_unstale":"2024-09-12T01:25:59.504377+0000","last_undegraded":"2024-09-12T01:25:59.504377+0000","last_fullsized":"2024-09-12T01:25:59.504377+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:26.659884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1244660,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":392,"num_read_kb":4332,"num_write":965,"num_write_kb":17381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'142","reported_seq":730,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.781778+0000","last_change":"2024-09-12T00:31:50.140955+0000","last_active":"2024-09-12T01:26:00.781778+0000","last_peered":"2024-09-12T01:26:00.781778+0000","last_clean":"2024-09-12T01:26:00.781778+0000","last_became_active":"2024-09-12T00:31:50.140649+0000","last_became_peered":"2024-09-12T00:31:50.140649+0000","last_unstale":"2024-09-12T01:26:00.781778+0000","last_undegraded":"2024-09-12T01:26:00.781778+0000","last_fullsized":"2024-09-12T01:26:00.781778+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:11.915558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":475,"num_write":199,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'300","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.715086+0000","last_change":"2024-09-12T00:31:47.126483+0000","last_active":"2024-09-12T01:29:15.715086+0000","last_peered":"2024-09-12T01:29:15.715086+0000","last_clean":"2024-09-12T01:29:15.715086+0000","last_became_active":"2024-09-12T00:31:47.126093+0000","last_became_peered":"2024-09-12T00:31:47.126093+0000","last_unstale":"2024-09-12T01:29:15.715086+0000","last_undegraded":"2024-09-12T01:29:15.715086+0000","last_fullsized":"2024-09-12T01:29:15.715086+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:39.767220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23966,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":428,"num_read_kb":13702,"num_write":963,"num_write_kb":29796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'259","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:37.319605+0000","last_change":"2024-09-12T00:31:50.133329+0000","last_active":"2024-09-12T01:26:37.319605+0000","last_peered":"2024-09-12T01:26:37.319605+0000","last_clean":"2024-09-12T01:26:37.319605+0000","last_became_active":"2024-09-12T00:31:50.132976+0000","last_became_peered":"2024-09-12T00:31:50.132976+0000","last_unstale":"2024-09-12T01:26:37.319605+0000","last_undegraded":"2024-09-12T01:26:37.319605+0000","last_fullsized":"2024-09-12T01:26:37.319605+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:59.147279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1108,"num_read_kb":908,"num_write":394,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'291","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.658143+0000","last_change":"2024-09-12T00:31:47.117320+0000","last_active":"2024-09-12T01:29:14.658143+0000","last_peered":"2024-09-12T01:29:14.658143+0000","last_clean":"2024-09-12T01:29:14.658143+0000","last_became_active":"2024-09-12T00:31:47.117000+0000","last_became_peered":"2024-09-12T00:31:47.117000+0000","last_unstale":"2024-09-12T01:29:14.658143+0000","last_undegraded":"2024-09-12T01:29:14.658143+0000","last_fullsized":"2024-09-12T01:29:14.658143+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:54.678203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505020,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":528,"num_read_kb":34961,"num_write":1098,"num_write_kb":18512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'188","reported_seq":833,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498610+0000","last_change":"2024-09-12T00:31:50.133892+0000","last_active":"2024-09-12T01:26:02.498610+0000","last_peered":"2024-09-12T01:26:02.498610+0000","last_clean":"2024-09-12T01:26:02.498610+0000","last_became_active":"2024-09-12T00:31:50.133634+0000","last_became_peered":"2024-09-12T00:31:50.133634+0000","last_unstale":"2024-09-12T01:26:02.498610+0000","last_undegraded":"2024-09-12T01:26:02.498610+0000","last_fullsized":"2024-09-12T01:26:02.498610+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:48.244378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":708,"num_write":275,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'283","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:53.571928+0000","last_change":"2024-09-12T00:31:47.134781+0000","last_active":"2024-09-12T01:28:53.571928+0000","last_peered":"2024-09-12T01:28:53.571928+0000","last_clean":"2024-09-12T01:28:53.571928+0000","last_became_active":"2024-09-12T00:31:47.132735+0000","last_became_peered":"2024-09-12T00:31:47.132735+0000","last_unstale":"2024-09-12T01:28:53.571928+0000","last_undegraded":"2024-09-12T01:28:53.571928+0000","last_fullsized":"2024-09-12T01:28:53.571928+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:17.832111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7449131,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":379,"num_read_kb":13725,"num_write":878,"num_write_kb":25593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'130","reported_seq":731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501249+0000","last_change":"2024-09-12T00:31:50.139504+0000","last_active":"2024-09-12T01:26:17.501249+0000","last_peered":"2024-09-12T01:26:17.501249+0000","last_clean":"2024-09-12T01:26:17.501249+0000","last_became_active":"2024-09-12T00:31:50.138349+0000","last_became_peered":"2024-09-12T00:31:50.138349+0000","last_unstale":"2024-09-12T01:26:17.501249+0000","last_undegraded":"2024-09-12T01:26:17.501249+0000","last_fullsized":"2024-09-12T01:26:17.501249+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:43.103359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":530,"num_write":219,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'297","reported_seq":935,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.592647+0000","last_change":"2024-09-12T00:31:47.133424+0000","last_active":"2024-09-12T01:29:15.592647+0000","last_peered":"2024-09-12T01:29:15.592647+0000","last_clean":"2024-09-12T01:29:15.592647+0000","last_became_active":"2024-09-12T00:31:47.132959+0000","last_became_peered":"2024-09-12T00:31:47.132959+0000","last_unstale":"2024-09-12T01:29:15.592647+0000","last_undegraded":"2024-09-12T01:29:15.592647+0000","last_fullsized":"2024-09-12T01:29:15.592647+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:33.239107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170482,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":457,"num_read_kb":44221,"num_write":1024,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'150","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.559726+0000","last_change":"2024-09-12T00:31:50.131220+0000","last_active":"2024-09-12T01:26:02.559726+0000","last_peered":"2024-09-12T01:26:02.559726+0000","last_clean":"2024-09-12T01:26:02.559726+0000","last_became_active":"2024-09-12T00:31:50.130915+0000","last_became_peered":"2024-09-12T00:31:50.130915+0000","last_unstale":"2024-09-12T01:26:02.559726+0000","last_undegraded":"2024-09-12T01:26:02.559726+0000","last_fullsized":"2024-09-12T01:26:02.559726+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:53.785801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":628,"num_read_kb":507,"num_write":231,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'308","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.470013+0000","last_change":"2024-09-12T00:31:47.122497+0000","last_active":"2024-09-12T01:29:15.470013+0000","last_peered":"2024-09-12T01:29:15.470013+0000","last_clean":"2024-09-12T01:29:15.470013+0000","last_became_active":"2024-09-12T00:31:47.122164+0000","last_became_peered":"2024-09-12T00:31:47.122164+0000","last_unstale":"2024-09-12T01:29:15.470013+0000","last_undegraded":"2024-09-12T01:29:15.470013+0000","last_fullsized":"2024-09-12T01:29:15.470013+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:50.399458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197518,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":475,"num_read_kb":2267,"num_write":1109,"num_write_kb":17589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'295","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637163+0000","last_change":"2024-09-12T00:31:50.142581+0000","last_active":"2024-09-12T01:26:00.637163+0000","last_peered":"2024-09-12T01:26:00.637163+0000","last_clean":"2024-09-12T01:26:00.637163+0000","last_became_active":"2024-09-12T00:31:50.142283+0000","last_became_peered":"2024-09-12T00:31:50.142283+0000","last_unstale":"2024-09-12T01:26:00.637163+0000","last_undegraded":"2024-09-12T01:26:00.637163+0000","last_fullsized":"2024-09-12T01:26:00.637163+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:05.162707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1272,"num_read_kb":1039,"num_write":466,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'307","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.360768+0000","last_change":"2024-09-12T00:31:47.137276+0000","last_active":"2024-09-12T01:29:14.360768+0000","last_peered":"2024-09-12T01:29:14.360768+0000","last_clean":"2024-09-12T01:29:14.360768+0000","last_became_active":"2024-09-12T00:31:47.136789+0000","last_became_peered":"2024-09-12T00:31:47.136789+0000","last_unstale":"2024-09-12T01:29:14.360768+0000","last_undegraded":"2024-09-12T01:29:14.360768+0000","last_fullsized":"2024-09-12T01:29:14.360768+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:38.463665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12606669,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":478,"num_read_kb":49646,"num_write":1047,"num_write_kb":37962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'129","reported_seq":747,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:02.423209+0000","last_change":"2024-09-12T00:31:50.141135+0000","last_active":"2024-09-12T01:27:02.423209+0000","last_peered":"2024-09-12T01:27:02.423209+0000","last_clean":"2024-09-12T01:27:02.423209+0000","last_became_active":"2024-09-12T00:31:50.140717+0000","last_became_peered":"2024-09-12T00:31:50.140717+0000","last_unstale":"2024-09-12T01:27:02.423209+0000","last_undegraded":"2024-09-12T01:27:02.423209+0000","last_fullsized":"2024-09-12T01:27:02.423209+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:42.301934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":623,"num_read_kb":519,"num_write":184,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'312","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:36.017298+0000","last_change":"2024-09-12T00:31:47.119263+0000","last_active":"2024-09-12T01:26:36.017298+0000","last_peered":"2024-09-12T01:26:36.017298+0000","last_clean":"2024-09-12T01:26:36.017298+0000","last_became_active":"2024-09-12T00:31:47.118928+0000","last_became_peered":"2024-09-12T00:31:47.118928+0000","last_unstale":"2024-09-12T01:26:36.017298+0000","last_undegraded":"2024-09-12T01:26:36.017298+0000","last_fullsized":"2024-09-12T01:26:36.017298+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:35.668011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213136,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":477,"num_read_kb":12199,"num_write":1146,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'133","reported_seq":731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:30.777076+0000","last_change":"2024-09-12T00:31:50.137312+0000","last_active":"2024-09-12T01:25:30.777076+0000","last_peered":"2024-09-12T01:25:30.777076+0000","last_clean":"2024-09-12T01:25:30.777076+0000","last_became_active":"2024-09-12T00:31:50.137034+0000","last_became_peered":"2024-09-12T00:31:50.137034+0000","last_unstale":"2024-09-12T01:25:30.777076+0000","last_undegraded":"2024-09-12T01:25:30.777076+0000","last_fullsized":"2024-09-12T01:25:30.777076+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:39.007332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":471,"num_write":187,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'339","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.697130+0000","last_change":"2024-09-12T00:31:47.119956+0000","last_active":"2024-09-12T01:29:14.697130+0000","last_peered":"2024-09-12T01:29:14.697130+0000","last_clean":"2024-09-12T01:29:14.697130+0000","last_became_active":"2024-09-12T00:31:47.119180+0000","last_became_peered":"2024-09-12T00:31:47.119180+0000","last_unstale":"2024-09-12T01:29:14.697130+0000","last_undegraded":"2024-09-12T01:29:14.697130+0000","last_fullsized":"2024-09-12T01:29:14.697130+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:45.605525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24817333,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":548,"num_read_kb":71015,"num_write":1270,"num_write_kb":54526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'230","reported_seq":877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.475928+0000","last_change":"2024-09-12T00:31:50.132875+0000","last_active":"2024-09-12T01:25:44.475928+0000","last_peered":"2024-09-12T01:25:44.475928+0000","last_clean":"2024-09-12T01:25:44.475928+0000","last_became_active":"2024-09-12T00:31:50.132605+0000","last_became_peered":"2024-09-12T00:31:50.132605+0000","last_unstale":"2024-09-12T01:25:44.475928+0000","last_undegraded":"2024-09-12T01:25:44.475928+0000","last_fullsized":"2024-09-12T01:25:44.475928+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:04.879402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":781,"num_write":348,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'273","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:46.316399+0000","last_change":"2024-09-12T00:31:47.132644+0000","last_active":"2024-09-12T01:28:46.316399+0000","last_peered":"2024-09-12T01:28:46.316399+0000","last_clean":"2024-09-12T01:28:46.316399+0000","last_became_active":"2024-09-12T00:31:47.131895+0000","last_became_peered":"2024-09-12T00:31:47.131895+0000","last_unstale":"2024-09-12T01:28:46.316399+0000","last_undegraded":"2024-09-12T01:28:46.316399+0000","last_fullsized":"2024-09-12T01:28:46.316399+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:28.078176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5674737,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":489,"num_read_kb":1443,"num_write":1041,"num_write_kb":20830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'184","reported_seq":814,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499443+0000","last_change":"2024-09-12T00:31:50.139015+0000","last_active":"2024-09-12T01:26:07.499443+0000","last_peered":"2024-09-12T01:26:07.499443+0000","last_clean":"2024-09-12T01:26:07.499443+0000","last_became_active":"2024-09-12T00:31:50.138649+0000","last_became_peered":"2024-09-12T00:31:50.138649+0000","last_unstale":"2024-09-12T01:26:07.499443+0000","last_undegraded":"2024-09-12T01:26:07.499443+0000","last_fullsized":"2024-09-12T01:26:07.499443+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:22.461723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":823,"num_read_kb":682,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'253","reported_seq":880,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.519215+0000","last_change":"2024-09-12T00:31:47.129430+0000","last_active":"2024-09-12T01:28:04.519215+0000","last_peered":"2024-09-12T01:28:04.519215+0000","last_clean":"2024-09-12T01:28:04.519215+0000","last_became_active":"2024-09-12T00:31:47.128598+0000","last_became_peered":"2024-09-12T00:31:47.128598+0000","last_unstale":"2024-09-12T01:28:04.519215+0000","last_undegraded":"2024-09-12T01:28:04.519215+0000","last_fullsized":"2024-09-12T01:28:04.519215+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:35.351098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116744,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":353,"num_read_kb":69389,"num_write":968,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'97","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.603987+0000","last_change":"2024-09-12T00:31:50.140136+0000","last_active":"2024-09-12T01:25:49.603987+0000","last_peered":"2024-09-12T01:25:49.603987+0000","last_clean":"2024-09-12T01:25:49.603987+0000","last_became_active":"2024-09-12T00:31:50.139830+0000","last_became_peered":"2024-09-12T00:31:50.139830+0000","last_unstale":"2024-09-12T01:25:49.603987+0000","last_undegraded":"2024-09-12T01:25:49.603987+0000","last_fullsized":"2024-09-12T01:25:49.603987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:35.900525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":425,"num_read_kb":351,"num_write":136,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'229","reported_seq":858,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:28.042033+0000","last_change":"2024-09-12T00:31:47.125635+0000","last_active":"2024-09-12T01:27:28.042033+0000","last_peered":"2024-09-12T01:27:28.042033+0000","last_clean":"2024-09-12T01:27:28.042033+0000","last_became_active":"2024-09-12T00:31:47.122486+0000","last_became_peered":"2024-09-12T00:31:47.122486+0000","last_unstale":"2024-09-12T01:27:28.042033+0000","last_undegraded":"2024-09-12T01:27:28.042033+0000","last_fullsized":"2024-09-12T01:27:28.042033+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:37.759045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13182903,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":312,"num_read_kb":24154,"num_write":810,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'114","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.603977+0000","last_change":"2024-09-12T00:31:50.139699+0000","last_active":"2024-09-12T01:25:49.603977+0000","last_peered":"2024-09-12T01:25:49.603977+0000","last_clean":"2024-09-12T01:25:49.603977+0000","last_became_active":"2024-09-12T00:31:50.139416+0000","last_became_peered":"2024-09-12T00:31:50.139416+0000","last_unstale":"2024-09-12T01:25:49.603977+0000","last_undegraded":"2024-09-12T01:25:49.603977+0000","last_fullsized":"2024-09-12T01:25:49.603977+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:19.143533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":414,"num_write":177,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'290","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.369149+0000","last_change":"2024-09-12T00:31:47.131206+0000","last_active":"2024-09-12T01:29:14.369149+0000","last_peered":"2024-09-12T01:29:14.369149+0000","last_clean":"2024-09-12T01:29:14.369149+0000","last_became_active":"2024-09-12T00:31:47.130353+0000","last_became_peered":"2024-09-12T00:31:47.130353+0000","last_unstale":"2024-09-12T01:29:14.369149+0000","last_undegraded":"2024-09-12T01:29:14.369149+0000","last_fullsized":"2024-09-12T01:29:14.369149+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:29.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5557023,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":489,"num_read_kb":8753,"num_write":1120,"num_write_kb":21611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'161","reported_seq":764,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:50.780274+0000","last_change":"2024-09-12T00:31:50.140996+0000","last_active":"2024-09-12T01:25:50.780274+0000","last_peered":"2024-09-12T01:25:50.780274+0000","last_clean":"2024-09-12T01:25:50.780274+0000","last_became_active":"2024-09-12T00:31:50.140705+0000","last_became_peered":"2024-09-12T00:31:50.140705+0000","last_unstale":"2024-09-12T01:25:50.780274+0000","last_undegraded":"2024-09-12T01:25:50.780274+0000","last_fullsized":"2024-09-12T01:25:50.780274+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:23.070768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":620,"num_write":277,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'324","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.658574+0000","last_change":"2024-09-12T00:31:47.120623+0000","last_active":"2024-09-12T01:29:14.658574+0000","last_peered":"2024-09-12T01:29:14.658574+0000","last_clean":"2024-09-12T01:29:14.658574+0000","last_became_active":"2024-09-12T00:31:47.120303+0000","last_became_peered":"2024-09-12T00:31:47.120303+0000","last_unstale":"2024-09-12T01:29:14.658574+0000","last_undegraded":"2024-09-12T01:29:14.658574+0000","last_fullsized":"2024-09-12T01:29:14.658574+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:03.740846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2673184,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":641,"num_read_kb":61137,"num_write":1069,"num_write_kb":48224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'210","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:38.380401+0000","last_change":"2024-09-12T00:31:50.134000+0000","last_active":"2024-09-12T01:26:38.380401+0000","last_peered":"2024-09-12T01:26:38.380401+0000","last_clean":"2024-09-12T01:26:38.380401+0000","last_became_active":"2024-09-12T00:31:50.133698+0000","last_became_peered":"2024-09-12T00:31:50.133698+0000","last_unstale":"2024-09-12T01:26:38.380401+0000","last_undegraded":"2024-09-12T01:26:38.380401+0000","last_fullsized":"2024-09-12T01:26:38.380401+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:03.963890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":883,"num_write":372,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'260","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.781779+0000","last_change":"2024-09-12T00:31:47.118141+0000","last_active":"2024-09-12T01:29:15.781779+0000","last_peered":"2024-09-12T01:29:15.781779+0000","last_clean":"2024-09-12T01:29:15.781779+0000","last_became_active":"2024-09-12T00:31:47.117753+0000","last_became_peered":"2024-09-12T00:31:47.117753+0000","last_unstale":"2024-09-12T01:29:15.781779+0000","last_undegraded":"2024-09-12T01:29:15.781779+0000","last_fullsized":"2024-09-12T01:29:15.781779+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:09.782299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2258,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":559,"num_read_kb":553,"num_write":984,"num_write_kb":11415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'4099","reported_seq":4699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605612+0000","last_change":"2024-09-12T00:31:50.145049+0000","last_active":"2024-09-12T01:26:04.605612+0000","last_peered":"2024-09-12T01:26:04.605612+0000","last_clean":"2024-09-12T01:26:04.605612+0000","last_became_active":"2024-09-12T00:31:50.144782+0000","last_became_peered":"2024-09-12T00:31:50.144782+0000","last_unstale":"2024-09-12T01:26:04.605612+0000","last_undegraded":"2024-09-12T01:26:04.605612+0000","last_fullsized":"2024-09-12T01:26:04.605612+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:19.062901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16473,"num_read_kb":13736,"num_write":6146,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'329","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.654496+0000","last_change":"2024-09-12T00:32:23.829074+0000","last_active":"2024-09-12T01:29:15.654496+0000","last_peered":"2024-09-12T01:29:15.654496+0000","last_clean":"2024-09-12T01:29:15.654496+0000","last_became_active":"2024-09-12T00:32:23.828547+0000","last_became_peered":"2024-09-12T00:32:23.828547+0000","last_unstale":"2024-09-12T01:29:15.654496+0000","last_undegraded":"2024-09-12T01:29:15.654496+0000","last_fullsized":"2024-09-12T01:29:15.654496+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:03.711044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2815656,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":632,"num_read_kb":184067,"num_write":1101,"num_write_kb":52781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"265'253","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.679141+0000","last_change":"2024-09-12T00:31:47.123419+0000","last_active":"2024-09-12T01:29:14.679141+0000","last_peered":"2024-09-12T01:29:14.679141+0000","last_clean":"2024-09-12T01:29:14.679141+0000","last_became_active":"2024-09-12T00:31:47.123083+0000","last_became_peered":"2024-09-12T00:31:47.123083+0000","last_unstale":"2024-09-12T01:29:14.679141+0000","last_undegraded":"2024-09-12T01:29:14.679141+0000","last_fullsized":"2024-09-12T01:29:14.679141+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:12.361365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1316039,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":372,"num_read_kb":16597,"num_write":933,"num_write_kb":37945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'178","reported_seq":753,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:18.494115+0000","last_change":"2024-09-12T00:31:50.145133+0000","last_active":"2024-09-12T01:25:18.494115+0000","last_peered":"2024-09-12T01:25:18.494115+0000","last_clean":"2024-09-12T01:25:18.494115+0000","last_became_active":"2024-09-12T00:31:50.144850+0000","last_became_peered":"2024-09-12T00:31:50.144850+0000","last_unstale":"2024-09-12T01:25:18.494115+0000","last_undegraded":"2024-09-12T01:25:18.494115+0000","last_fullsized":"2024-09-12T01:25:18.494115+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:11.930581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":724,"num_read_kb":585,"num_write":260,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'321","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:27.493243+0000","last_change":"2024-09-12T00:31:47.132633+0000","last_active":"2024-09-12T01:25:27.493243+0000","last_peered":"2024-09-12T01:25:27.493243+0000","last_clean":"2024-09-12T01:25:27.493243+0000","last_became_active":"2024-09-12T00:31:47.132149+0000","last_became_peered":"2024-09-12T00:31:47.132149+0000","last_unstale":"2024-09-12T01:25:27.493243+0000","last_undegraded":"2024-09-12T01:25:27.493243+0000","last_fullsized":"2024-09-12T01:25:27.493243+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:43.540773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327701,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":517,"num_read_kb":13770,"num_write":1222,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'126","reported_seq":749,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.598790+0000","last_change":"2024-09-12T00:31:50.137590+0000","last_active":"2024-09-12T01:24:59.598790+0000","last_peered":"2024-09-12T01:24:59.598790+0000","last_clean":"2024-09-12T01:24:59.598790+0000","last_became_active":"2024-09-12T00:31:50.137283+0000","last_became_peered":"2024-09-12T00:31:50.137283+0000","last_unstale":"2024-09-12T01:24:59.598790+0000","last_undegraded":"2024-09-12T01:24:59.598790+0000","last_fullsized":"2024-09-12T01:24:59.598790+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:36.135953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":583,"num_read_kb":491,"num_write":192,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5593,"num_read_kb":3949,"num_write":1897,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1068,"ondisk_log_size":1068,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15046,"num_read_kb":14700,"num_write":16713,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1460,"ondisk_log_size":1460,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":562,"ondisk_log_size":562,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1748465,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17923,"num_read_kb":34386,"num_write":15119,"num_write_kb":11674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2822144,"data_stored":2304957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2013,"ondisk_log_size":2013,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102878,"num_read_kb":85467,"num_write":37260,"num_write_kb":18832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3662,"ondisk_log_size":3662,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":438149271,"num_objects":3839,"num_object_clones":0,"num_object_copies":11517,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3839,"num_whiteouts":0,"num_read":32552,"num_read_kb":1971054,"num_write":67769,"num_write_kb":2047906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":674111488,"data_stored":674111488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4129,"ondisk_log_size":4129,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":51142718,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":120,"num_read_kb":176023,"num_write":140,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90800128,"data_stored":90791245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":57474319,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":115,"num_read_kb":175285,"num_write":137,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":104804352,"data_stored":104797229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477435,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265412,"kb_used_data":63444,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94106428,"statfs":{"total":96636764160,"available":96364982272,"internally_reserved":0,"allocated":64966656,"data_stored":62958487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719477434,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164208,"kb_used_data":74548,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94207632,"statfs":{"total":96636764160,"available":96468615168,"internally_reserved":0,"allocated":76337152,"data_stored":74324248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510140,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":355280,"kb_used_data":161664,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94016560,"statfs":{"total":96636764160,"available":96272957440,"internally_reserved":0,"allocated":165543936,"data_stored":163497980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510139,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243428,"kb_used_data":144212,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94128412,"statfs":{"total":96636764160,"available":96387493888,"internally_reserved":0,"allocated":147673088,"data_stored":145671556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510138,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368580,"kb_used_data":106932,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94003260,"statfs":{"total":96636764160,"available":96259338240,"internally_reserved":0,"allocated":109498368,"data_stored":107427465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510137,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243132,"kb_used_data":149484,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94128708,"statfs":{"total":96636764160,"available":96387796992,"internally_reserved":0,"allocated":153071616,"data_stored":151002207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542840,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308516,"kb_used_data":137172,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94063324,"statfs":{"total":96636764160,"available":96320843776,"internally_reserved":0,"allocated":140464128,"data_stored":138424784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575545,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":377272,"kb_used_data":121256,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93994568,"statfs":{"total":96636764160,"available":96250437632,"internally_reserved":0,"allocated":124166144,"data_stored":122107440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":136622080,"data_stored":136622080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69332992,"data_stored":69332992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102588416,"data_stored":102588416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":107413504,"data_stored":107413504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":115830784,"data_stored":115830784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81645568,"data_stored":81645568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":34283520,"data_stored":34283520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":26394624,"data_stored":26394624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":478346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":473115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":125735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":203127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":396385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":379669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":88273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":160307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23117824,"data_stored":23117098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34643968,"data_stored":34643153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12681216,"data_stored":12679757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15486976,"data_stored":15482853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11575296,"data_stored":11574481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5959680,"data_stored":5957105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11583488,"data_stored":11582762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18923520,"data_stored":18922787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21786624,"data_stored":21782590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:29:16.918 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:29:17.271 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:29:17.286 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T01:29:17.288 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":1992,"stamp":"2024-09-12T01:29:15.847223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":549122398,"num_objects":4220,"num_object_clones":0,"num_object_copies":12279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4220,"num_whiteouts":0,"num_read":176708,"num_read_kb":2463795,"num_write":139178,"num_write_kb":2319559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13144,"ondisk_log_size":13144,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2325828,"kb_used_data":958712,"kb_used_omap":12,"kb_used_meta":1366643,"kb_avail":752648892,"statfs":{"total":773094113280,"available":770712465408,"internally_reserved":0,"allocated":981721088,"data_stored":965414167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1399442992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-87911644,"num_objects":-572,"num_object_clones":0,"num_object_copies":-1711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-572,"num_whiteouts":0,"num_read":693,"num_read_kb":1037,"num_write":621,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005146"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.506005+0000","last_change":"2024-09-12T01:04:13.467817+0000","last_active":"2024-09-12T01:26:44.506005+0000","last_peered":"2024-09-12T01:26:44.506005+0000","last_clean":"2024-09-12T01:26:44.506005+0000","last_became_active":"2024-09-12T01:04:13.467533+0000","last_became_peered":"2024-09-12T01:04:13.467533+0000","last_unstale":"2024-09-12T01:26:44.506005+0000","last_undegraded":"2024-09-12T01:26:44.506005+0000","last_fullsized":"2024-09-12T01:26:44.506005+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:07.938395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.606697+0000","last_change":"2024-09-12T00:48:45.303400+0000","last_active":"2024-09-12T01:26:14.606697+0000","last_peered":"2024-09-12T01:26:14.606697+0000","last_clean":"2024-09-12T01:26:14.606697+0000","last_became_active":"2024-09-12T00:48:45.303088+0000","last_became_peered":"2024-09-12T00:48:45.303088+0000","last_unstale":"2024-09-12T01:26:14.606697+0000","last_undegraded":"2024-09-12T01:26:14.606697+0000","last_fullsized":"2024-09-12T01:26:14.606697+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:39.588987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.784398+0000","last_change":"2024-09-12T00:48:42.290755+0000","last_active":"2024-09-12T01:26:15.784398+0000","last_peered":"2024-09-12T01:26:15.784398+0000","last_clean":"2024-09-12T01:26:15.784398+0000","last_became_active":"2024-09-12T00:48:42.290471+0000","last_became_peered":"2024-09-12T00:48:42.290471+0000","last_unstale":"2024-09-12T01:26:15.784398+0000","last_undegraded":"2024-09-12T01:26:15.784398+0000","last_fullsized":"2024-09-12T01:26:15.784398+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:55.297347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'15","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:38.496977+0000","last_change":"2024-09-12T00:46:03.918513+0000","last_active":"2024-09-12T01:25:38.496977+0000","last_peered":"2024-09-12T01:25:38.496977+0000","last_clean":"2024-09-12T01:25:38.496977+0000","last_became_active":"2024-09-12T00:46:03.918235+0000","last_became_peered":"2024-09-12T00:46:03.918235+0000","last_unstale":"2024-09-12T01:25:38.496977+0000","last_undegraded":"2024-09-12T01:25:38.496977+0000","last_fullsized":"2024-09-12T01:25:38.496977+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:35.498415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":51,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.643708+0000","last_change":"2024-09-12T01:04:13.463924+0000","last_active":"2024-09-12T01:26:45.643708+0000","last_peered":"2024-09-12T01:26:45.643708+0000","last_clean":"2024-09-12T01:26:45.643708+0000","last_became_active":"2024-09-12T01:04:13.463645+0000","last_became_peered":"2024-09-12T01:04:13.463645+0000","last_unstale":"2024-09-12T01:26:45.643708+0000","last_undegraded":"2024-09-12T01:26:45.643708+0000","last_fullsized":"2024-09-12T01:26:45.643708+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:54.509681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505992+0000","last_change":"2024-09-12T00:48:45.307402+0000","last_active":"2024-09-12T01:26:14.505992+0000","last_peered":"2024-09-12T01:26:14.505992+0000","last_clean":"2024-09-12T01:26:14.505992+0000","last_became_active":"2024-09-12T00:48:45.307070+0000","last_became_peered":"2024-09-12T00:48:45.307070+0000","last_unstale":"2024-09-12T01:26:14.505992+0000","last_undegraded":"2024-09-12T01:26:14.505992+0000","last_fullsized":"2024-09-12T01:26:14.505992+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:35.964072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:12.500496+0000","last_change":"2024-09-12T00:48:42.297130+0000","last_active":"2024-09-12T01:26:12.500496+0000","last_peered":"2024-09-12T01:26:12.500496+0000","last_clean":"2024-09-12T01:26:12.500496+0000","last_became_active":"2024-09-12T00:48:42.296820+0000","last_became_peered":"2024-09-12T00:48:42.296820+0000","last_unstale":"2024-09-12T01:26:12.500496+0000","last_undegraded":"2024-09-12T01:26:12.500496+0000","last_fullsized":"2024-09-12T01:26:12.500496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:03.334198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'17","reported_seq":98,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:18.502535+0000","last_change":"2024-09-12T00:46:03.920083+0000","last_active":"2024-09-12T01:26:18.502535+0000","last_peered":"2024-09-12T01:26:18.502535+0000","last_clean":"2024-09-12T01:26:18.502535+0000","last_became_active":"2024-09-12T00:46:03.919803+0000","last_became_peered":"2024-09-12T00:46:03.919803+0000","last_unstale":"2024-09-12T01:26:18.502535+0000","last_undegraded":"2024-09-12T01:26:18.502535+0000","last_fullsized":"2024-09-12T01:26:18.502535+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:54.982016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":60,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.605056+0000","last_change":"2024-09-12T01:04:13.470732+0000","last_active":"2024-09-12T01:25:59.605056+0000","last_peered":"2024-09-12T01:25:59.605056+0000","last_clean":"2024-09-12T01:25:59.605056+0000","last_became_active":"2024-09-12T01:04:13.470465+0000","last_became_peered":"2024-09-12T01:04:13.470465+0000","last_unstale":"2024-09-12T01:25:59.605056+0000","last_undegraded":"2024-09-12T01:25:59.605056+0000","last_fullsized":"2024-09-12T01:25:59.605056+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:03.442325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'7","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501342+0000","last_change":"2024-09-12T00:48:45.318707+0000","last_active":"2024-09-12T01:26:17.501342+0000","last_peered":"2024-09-12T01:26:17.501342+0000","last_clean":"2024-09-12T01:26:17.501342+0000","last_became_active":"2024-09-12T00:48:45.318423+0000","last_became_peered":"2024-09-12T00:48:45.318423+0000","last_unstale":"2024-09-12T01:26:17.501342+0000","last_undegraded":"2024-09-12T01:26:17.501342+0000","last_fullsized":"2024-09-12T01:26:17.501342+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:02.110177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:55.790545+0000","last_change":"2024-09-12T00:48:42.292914+0000","last_active":"2024-09-12T01:26:55.790545+0000","last_peered":"2024-09-12T01:26:55.790545+0000","last_clean":"2024-09-12T01:26:55.790545+0000","last_became_active":"2024-09-12T00:48:42.292607+0000","last_became_peered":"2024-09-12T00:48:42.292607+0000","last_unstale":"2024-09-12T01:26:55.790545+0000","last_undegraded":"2024-09-12T01:26:55.790545+0000","last_fullsized":"2024-09-12T01:26:55.790545+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:07.172445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'33","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.638048+0000","last_change":"2024-09-12T00:46:03.918495+0000","last_active":"2024-09-12T01:26:05.638048+0000","last_peered":"2024-09-12T01:26:05.638048+0000","last_clean":"2024-09-12T01:26:05.638048+0000","last_became_active":"2024-09-12T00:46:03.918204+0000","last_became_peered":"2024-09-12T00:46:03.918204+0000","last_unstale":"2024-09-12T01:26:05.638048+0000","last_undegraded":"2024-09-12T01:26:05.638048+0000","last_fullsized":"2024-09-12T01:26:05.638048+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:39.227048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":133,"num_write":46,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499343+0000","last_change":"2024-09-12T01:04:13.465355+0000","last_active":"2024-09-12T01:26:07.499343+0000","last_peered":"2024-09-12T01:26:07.499343+0000","last_clean":"2024-09-12T01:26:07.499343+0000","last_became_active":"2024-09-12T01:04:13.465081+0000","last_became_peered":"2024-09-12T01:04:13.465081+0000","last_unstale":"2024-09-12T01:26:07.499343+0000","last_undegraded":"2024-09-12T01:26:07.499343+0000","last_fullsized":"2024-09-12T01:26:07.499343+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:11.393872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:57.507200+0000","last_change":"2024-09-12T00:48:45.315792+0000","last_active":"2024-09-12T01:26:57.507200+0000","last_peered":"2024-09-12T01:26:57.507200+0000","last_clean":"2024-09-12T01:26:57.507200+0000","last_became_active":"2024-09-12T00:48:45.314837+0000","last_became_peered":"2024-09-12T00:48:45.314837+0000","last_unstale":"2024-09-12T01:26:57.507200+0000","last_undegraded":"2024-09-12T01:26:57.507200+0000","last_fullsized":"2024-09-12T01:26:57.507200+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:45.469413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'8","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.606727+0000","last_change":"2024-09-12T00:48:42.290832+0000","last_active":"2024-09-12T01:26:14.606727+0000","last_peered":"2024-09-12T01:26:14.606727+0000","last_clean":"2024-09-12T01:26:14.606727+0000","last_became_active":"2024-09-12T00:48:42.290570+0000","last_became_peered":"2024-09-12T00:48:42.290570+0000","last_unstale":"2024-09-12T01:26:14.606727+0000","last_undegraded":"2024-09-12T01:26:14.606727+0000","last_fullsized":"2024-09-12T01:26:14.606727+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.754613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":32770,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"262'57","reported_seq":245,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.638031+0000","last_change":"2024-09-12T00:46:03.912889+0000","last_active":"2024-09-12T01:26:05.638031+0000","last_peered":"2024-09-12T01:26:05.638031+0000","last_clean":"2024-09-12T01:26:05.638031+0000","last_became_active":"2024-09-12T00:46:03.912603+0000","last_became_peered":"2024-09-12T00:46:03.912603+0000","last_unstale":"2024-09-12T01:26:05.638031+0000","last_undegraded":"2024-09-12T01:26:05.638031+0000","last_fullsized":"2024-09-12T01:26:05.638031+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:41.505661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":263,"num_write":69,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:20.785335+0000","last_change":"2024-09-12T01:04:13.459054+0000","last_active":"2024-09-12T01:26:20.785335+0000","last_peered":"2024-09-12T01:26:20.785335+0000","last_clean":"2024-09-12T01:26:20.785335+0000","last_became_active":"2024-09-12T01:04:13.458781+0000","last_became_peered":"2024-09-12T01:04:13.458781+0000","last_unstale":"2024-09-12T01:26:20.785335+0000","last_undegraded":"2024-09-12T01:26:20.785335+0000","last_fullsized":"2024-09-12T01:26:20.785335+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:22.643443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'5","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:09.496309+0000","last_change":"2024-09-12T00:48:45.318968+0000","last_active":"2024-09-12T01:25:09.496309+0000","last_peered":"2024-09-12T01:25:09.496309+0000","last_clean":"2024-09-12T01:25:09.496309+0000","last_became_active":"2024-09-12T00:48:45.318608+0000","last_became_peered":"2024-09-12T00:48:45.318608+0000","last_unstale":"2024-09-12T01:25:09.496309+0000","last_undegraded":"2024-09-12T01:25:09.496309+0000","last_fullsized":"2024-09-12T01:25:09.496309+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:29.993435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"265'9","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:57.488448+0000","last_change":"2024-09-12T00:48:42.298222+0000","last_active":"2024-09-12T01:24:57.488448+0000","last_peered":"2024-09-12T01:24:57.488448+0000","last_clean":"2024-09-12T01:24:57.488448+0000","last_became_active":"2024-09-12T00:48:42.297952+0000","last_became_peered":"2024-09-12T00:48:42.297952+0000","last_unstale":"2024-09-12T01:24:57.488448+0000","last_undegraded":"2024-09-12T01:24:57.488448+0000","last_fullsized":"2024-09-12T01:24:57.488448+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:49.640614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339875,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":16432,"num_write":9,"num_write_kb":16432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'28","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.637984+0000","last_change":"2024-09-12T00:46:03.916594+0000","last_active":"2024-09-12T01:26:05.637984+0000","last_peered":"2024-09-12T01:26:05.637984+0000","last_clean":"2024-09-12T01:26:05.637984+0000","last_became_active":"2024-09-12T00:46:03.915917+0000","last_became_peered":"2024-09-12T00:46:03.915917+0000","last_unstale":"2024-09-12T01:26:05.637984+0000","last_undegraded":"2024-09-12T01:26:05.637984+0000","last_fullsized":"2024-09-12T01:26:05.637984+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:26.873454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:08.509445+0000","last_change":"2024-09-12T01:04:13.465500+0000","last_active":"2024-09-12T01:27:08.509445+0000","last_peered":"2024-09-12T01:27:08.509445+0000","last_clean":"2024-09-12T01:27:08.509445+0000","last_became_active":"2024-09-12T01:04:13.465173+0000","last_became_peered":"2024-09-12T01:04:13.465173+0000","last_unstale":"2024-09-12T01:27:08.509445+0000","last_undegraded":"2024-09-12T01:27:08.509445+0000","last_fullsized":"2024-09-12T01:27:08.509445+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:43.615029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.714047+0000","last_change":"2024-09-12T00:48:45.314920+0000","last_active":"2024-09-12T01:24:59.714047+0000","last_peered":"2024-09-12T01:24:59.714047+0000","last_clean":"2024-09-12T01:24:59.714047+0000","last_became_active":"2024-09-12T00:48:45.313443+0000","last_became_peered":"2024-09-12T00:48:45.313443+0000","last_unstale":"2024-09-12T01:24:59.714047+0000","last_undegraded":"2024-09-12T01:24:59.714047+0000","last_fullsized":"2024-09-12T01:24:59.714047+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:03.806002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'6","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714784+0000","last_change":"2024-09-12T00:48:42.293510+0000","last_active":"2024-09-12T01:25:04.714784+0000","last_peered":"2024-09-12T01:25:04.714784+0000","last_clean":"2024-09-12T01:25:04.714784+0000","last_became_active":"2024-09-12T00:48:42.293128+0000","last_became_peered":"2024-09-12T00:48:42.293128+0000","last_unstale":"2024-09-12T01:25:04.714784+0000","last_undegraded":"2024-09-12T01:25:04.714784+0000","last_fullsized":"2024-09-12T01:25:04.714784+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:35.032026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":20530,"num_write":6,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'40","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.504898+0000","last_change":"2024-09-12T00:46:03.923309+0000","last_active":"2024-09-12T01:26:04.504898+0000","last_peered":"2024-09-12T01:26:04.504898+0000","last_clean":"2024-09-12T01:26:04.504898+0000","last_became_active":"2024-09-12T00:46:03.923029+0000","last_became_peered":"2024-09-12T00:46:03.923029+0000","last_unstale":"2024-09-12T01:26:04.504898+0000","last_undegraded":"2024-09-12T01:26:04.504898+0000","last_fullsized":"2024-09-12T01:26:04.504898+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:20.804221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":145,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.508900+0000","last_change":"2024-09-12T01:04:13.472265+0000","last_active":"2024-09-12T01:26:44.508900+0000","last_peered":"2024-09-12T01:26:44.508900+0000","last_clean":"2024-09-12T01:26:44.508900+0000","last_became_active":"2024-09-12T01:04:13.468832+0000","last_became_peered":"2024-09-12T01:04:13.468832+0000","last_unstale":"2024-09-12T01:26:44.508900+0000","last_undegraded":"2024-09-12T01:26:44.508900+0000","last_fullsized":"2024-09-12T01:26:44.508900+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.832023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505982+0000","last_change":"2024-09-12T00:48:45.309486+0000","last_active":"2024-09-12T01:26:14.505982+0000","last_peered":"2024-09-12T01:26:14.505982+0000","last_clean":"2024-09-12T01:26:14.505982+0000","last_became_active":"2024-09-12T00:48:45.309166+0000","last_became_peered":"2024-09-12T00:48:45.309166+0000","last_unstale":"2024-09-12T01:26:14.505982+0000","last_undegraded":"2024-09-12T01:26:14.505982+0000","last_fullsized":"2024-09-12T01:26:14.505982+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:58.753867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.502933+0000","last_change":"2024-09-12T00:48:42.292429+0000","last_active":"2024-09-12T01:26:14.502933+0000","last_peered":"2024-09-12T01:26:14.502933+0000","last_clean":"2024-09-12T01:26:14.502933+0000","last_became_active":"2024-09-12T00:48:42.291800+0000","last_became_peered":"2024-09-12T00:48:42.291800+0000","last_unstale":"2024-09-12T01:26:14.502933+0000","last_undegraded":"2024-09-12T01:26:14.502933+0000","last_fullsized":"2024-09-12T01:26:14.502933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:58.520610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'17","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:55.771942+0000","last_change":"2024-09-12T00:46:03.913895+0000","last_active":"2024-09-12T01:24:55.771942+0000","last_peered":"2024-09-12T01:24:55.771942+0000","last_clean":"2024-09-12T01:24:55.771942+0000","last_became_active":"2024-09-12T00:46:03.913667+0000","last_became_peered":"2024-09-12T00:46:03.913667+0000","last_unstale":"2024-09-12T01:24:55.771942+0000","last_undegraded":"2024-09-12T01:24:55.771942+0000","last_fullsized":"2024-09-12T01:24:55.771942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:42.230323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":62,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.506059+0000","last_change":"2024-09-12T01:04:13.462929+0000","last_active":"2024-09-12T01:26:44.506059+0000","last_peered":"2024-09-12T01:26:44.506059+0000","last_clean":"2024-09-12T01:26:44.506059+0000","last_became_active":"2024-09-12T01:04:13.462605+0000","last_became_peered":"2024-09-12T01:04:13.462605+0000","last_unstale":"2024-09-12T01:26:44.506059+0000","last_undegraded":"2024-09-12T01:26:44.506059+0000","last_fullsized":"2024-09-12T01:26:44.506059+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:21.801378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:45.807311+0000","last_change":"2024-09-12T00:48:45.314426+0000","last_active":"2024-09-12T01:28:45.807311+0000","last_peered":"2024-09-12T01:28:45.807311+0000","last_clean":"2024-09-12T01:28:45.807311+0000","last_became_active":"2024-09-12T00:48:45.314128+0000","last_became_peered":"2024-09-12T00:48:45.314128+0000","last_unstale":"2024-09-12T01:28:45.807311+0000","last_undegraded":"2024-09-12T01:28:45.807311+0000","last_fullsized":"2024-09-12T01:28:45.807311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:59.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639662+0000","last_change":"2024-09-12T00:48:42.296184+0000","last_active":"2024-09-12T01:26:15.639662+0000","last_peered":"2024-09-12T01:26:15.639662+0000","last_clean":"2024-09-12T01:26:15.639662+0000","last_became_active":"2024-09-12T00:48:42.295886+0000","last_became_peered":"2024-09-12T00:48:42.295886+0000","last_unstale":"2024-09-12T01:26:15.639662+0000","last_undegraded":"2024-09-12T01:26:15.639662+0000","last_fullsized":"2024-09-12T01:26:15.639662+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:20.846127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'14","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:45.624687+0000","last_change":"2024-09-12T00:46:03.919616+0000","last_active":"2024-09-12T01:24:45.624687+0000","last_peered":"2024-09-12T01:24:45.624687+0000","last_clean":"2024-09-12T01:24:45.624687+0000","last_became_active":"2024-09-12T00:46:03.919334+0000","last_became_peered":"2024-09-12T00:46:03.919334+0000","last_unstale":"2024-09-12T01:24:45.624687+0000","last_undegraded":"2024-09-12T01:24:45.624687+0000","last_fullsized":"2024-09-12T01:24:45.624687+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:28.706224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:17.491559+0000","last_change":"2024-09-12T01:04:13.467497+0000","last_active":"2024-09-12T01:25:17.491559+0000","last_peered":"2024-09-12T01:25:17.491559+0000","last_clean":"2024-09-12T01:25:17.491559+0000","last_became_active":"2024-09-12T01:04:13.467230+0000","last_became_peered":"2024-09-12T01:04:13.467230+0000","last_unstale":"2024-09-12T01:25:17.491559+0000","last_undegraded":"2024-09-12T01:25:17.491559+0000","last_fullsized":"2024-09-12T01:25:17.491559+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:19.612980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.862267+0000","last_change":"2024-09-12T00:48:45.309898+0000","last_active":"2024-09-12T01:29:14.862267+0000","last_peered":"2024-09-12T01:29:14.862267+0000","last_clean":"2024-09-12T01:29:14.862267+0000","last_became_active":"2024-09-12T00:48:45.309604+0000","last_became_peered":"2024-09-12T00:48:45.309604+0000","last_unstale":"2024-09-12T01:29:14.862267+0000","last_undegraded":"2024-09-12T01:29:14.862267+0000","last_fullsized":"2024-09-12T01:29:14.862267+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:20.554961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.724362+0000","last_change":"2024-09-12T00:48:42.294022+0000","last_active":"2024-09-12T01:26:09.724362+0000","last_peered":"2024-09-12T01:26:09.724362+0000","last_clean":"2024-09-12T01:26:09.724362+0000","last_became_active":"2024-09-12T00:48:42.293705+0000","last_became_peered":"2024-09-12T00:48:42.293705+0000","last_unstale":"2024-09-12T01:26:09.724362+0000","last_undegraded":"2024-09-12T01:26:09.724362+0000","last_fullsized":"2024-09-12T01:26:09.724362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.053185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'6","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:43.489387+0000","last_change":"2024-09-12T00:46:03.917085+0000","last_active":"2024-09-12T01:24:43.489387+0000","last_peered":"2024-09-12T01:24:43.489387+0000","last_clean":"2024-09-12T01:24:43.489387+0000","last_became_active":"2024-09-12T00:46:03.916699+0000","last_became_peered":"2024-09-12T00:46:03.916699+0000","last_unstale":"2024-09-12T01:24:43.489387+0000","last_undegraded":"2024-09-12T01:24:43.489387+0000","last_fullsized":"2024-09-12T01:24:43.489387+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:46.585826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:15.630269+0000","last_change":"2024-09-12T01:04:13.468912+0000","last_active":"2024-09-12T01:25:15.630269+0000","last_peered":"2024-09-12T01:25:15.630269+0000","last_clean":"2024-09-12T01:25:15.630269+0000","last_became_active":"2024-09-12T01:04:13.468643+0000","last_became_peered":"2024-09-12T01:04:13.468643+0000","last_unstale":"2024-09-12T01:25:15.630269+0000","last_undegraded":"2024-09-12T01:25:15.630269+0000","last_fullsized":"2024-09-12T01:25:15.630269+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:52.505763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501282+0000","last_change":"2024-09-12T00:48:45.314936+0000","last_active":"2024-09-12T01:26:17.501282+0000","last_peered":"2024-09-12T01:26:17.501282+0000","last_clean":"2024-09-12T01:26:17.501282+0000","last_became_active":"2024-09-12T00:48:45.314212+0000","last_became_peered":"2024-09-12T00:48:45.314212+0000","last_unstale":"2024-09-12T01:26:17.501282+0000","last_undegraded":"2024-09-12T01:26:17.501282+0000","last_fullsized":"2024-09-12T01:26:17.501282+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:22.945070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"265'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.495235+0000","last_change":"2024-09-12T00:48:42.292169+0000","last_active":"2024-09-12T01:24:59.495235+0000","last_peered":"2024-09-12T01:24:59.495235+0000","last_clean":"2024-09-12T01:24:59.495235+0000","last_became_active":"2024-09-12T00:48:42.291818+0000","last_became_peered":"2024-09-12T00:48:42.291818+0000","last_unstale":"2024-09-12T01:24:59.495235+0000","last_undegraded":"2024-09-12T01:24:59.495235+0000","last_fullsized":"2024-09-12T01:24:59.495235+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.276296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'35","reported_seq":142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:43.489359+0000","last_change":"2024-09-12T00:46:03.921103+0000","last_active":"2024-09-12T01:24:43.489359+0000","last_peered":"2024-09-12T01:24:43.489359+0000","last_clean":"2024-09-12T01:24:43.489359+0000","last_became_active":"2024-09-12T00:46:03.920696+0000","last_became_peered":"2024-09-12T00:46:03.920696+0000","last_unstale":"2024-09-12T01:24:43.489359+0000","last_undegraded":"2024-09-12T01:24:43.489359+0000","last_fullsized":"2024-09-12T01:24:43.489359+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:00.908573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.499604+0000","last_change":"2024-09-12T01:04:13.472034+0000","last_active":"2024-09-12T01:25:14.499604+0000","last_peered":"2024-09-12T01:25:14.499604+0000","last_clean":"2024-09-12T01:25:14.499604+0000","last_became_active":"2024-09-12T01:04:13.471741+0000","last_became_peered":"2024-09-12T01:04:13.471741+0000","last_unstale":"2024-09-12T01:25:14.499604+0000","last_undegraded":"2024-09-12T01:25:14.499604+0000","last_fullsized":"2024-09-12T01:25:14.499604+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:37.939219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:00.772877+0000","last_change":"2024-09-12T00:48:45.317881+0000","last_active":"2024-09-12T01:25:00.772877+0000","last_peered":"2024-09-12T01:25:00.772877+0000","last_clean":"2024-09-12T01:25:00.772877+0000","last_became_active":"2024-09-12T00:48:45.317576+0000","last_became_peered":"2024-09-12T00:48:45.317576+0000","last_unstale":"2024-09-12T01:25:00.772877+0000","last_undegraded":"2024-09-12T01:25:00.772877+0000","last_fullsized":"2024-09-12T01:25:00.772877+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:56.133928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"262'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:00.772850+0000","last_change":"2024-09-12T00:48:42.291771+0000","last_active":"2024-09-12T01:25:00.772850+0000","last_peered":"2024-09-12T01:25:00.772850+0000","last_clean":"2024-09-12T01:25:00.772850+0000","last_became_active":"2024-09-12T00:48:42.291199+0000","last_became_peered":"2024-09-12T00:48:42.291199+0000","last_unstale":"2024-09-12T01:25:00.772850+0000","last_undegraded":"2024-09-12T01:25:00.772850+0000","last_fullsized":"2024-09-12T01:25:00.772850+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:37.299502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5165,"num_write":10,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'6","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:45.770639+0000","last_change":"2024-09-12T00:46:03.919765+0000","last_active":"2024-09-12T01:24:45.770639+0000","last_peered":"2024-09-12T01:24:45.770639+0000","last_clean":"2024-09-12T01:24:45.770639+0000","last_became_active":"2024-09-12T00:46:03.919481+0000","last_became_peered":"2024-09-12T00:46:03.919481+0000","last_unstale":"2024-09-12T01:24:45.770639+0000","last_undegraded":"2024-09-12T01:24:45.770639+0000","last_fullsized":"2024-09-12T01:24:45.770639+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:06.767562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.496856+0000","last_change":"2024-09-12T01:04:13.468963+0000","last_active":"2024-09-12T01:25:14.496856+0000","last_peered":"2024-09-12T01:25:14.496856+0000","last_clean":"2024-09-12T01:25:14.496856+0000","last_became_active":"2024-09-12T01:04:13.468317+0000","last_became_peered":"2024-09-12T01:04:13.468317+0000","last_unstale":"2024-09-12T01:25:14.496856+0000","last_undegraded":"2024-09-12T01:25:14.496856+0000","last_fullsized":"2024-09-12T01:25:14.496856+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:50.519451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.495267+0000","last_change":"2024-09-12T00:48:45.315823+0000","last_active":"2024-09-12T01:24:59.495267+0000","last_peered":"2024-09-12T01:24:59.495267+0000","last_clean":"2024-09-12T01:24:59.495267+0000","last_became_active":"2024-09-12T00:48:45.315546+0000","last_became_peered":"2024-09-12T00:48:45.315546+0000","last_unstale":"2024-09-12T01:24:59.495267+0000","last_undegraded":"2024-09-12T01:24:59.495267+0000","last_fullsized":"2024-09-12T01:24:59.495267+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:54.909978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:57.488625+0000","last_change":"2024-09-12T00:48:42.296841+0000","last_active":"2024-09-12T01:24:57.488625+0000","last_peered":"2024-09-12T01:24:57.488625+0000","last_clean":"2024-09-12T01:24:57.488625+0000","last_became_active":"2024-09-12T00:48:42.296509+0000","last_became_peered":"2024-09-12T00:48:42.296509+0000","last_unstale":"2024-09-12T01:24:57.488625+0000","last_undegraded":"2024-09-12T01:24:57.488625+0000","last_fullsized":"2024-09-12T01:24:57.488625+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:00.906884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":14336,"num_write":9,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'52","reported_seq":188,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721709+0000","last_change":"2024-09-12T00:46:03.920474+0000","last_active":"2024-09-12T01:25:49.721709+0000","last_peered":"2024-09-12T01:25:49.721709+0000","last_clean":"2024-09-12T01:25:49.721709+0000","last_became_active":"2024-09-12T00:46:03.920188+0000","last_became_peered":"2024-09-12T00:46:03.920188+0000","last_unstale":"2024-09-12T01:25:49.721709+0000","last_undegraded":"2024-09-12T01:25:49.721709+0000","last_fullsized":"2024-09-12T01:25:49.721709+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:42.736993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":182,"num_write":95,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498632+0000","last_change":"2024-09-12T01:04:13.462848+0000","last_active":"2024-09-12T01:26:02.498632+0000","last_peered":"2024-09-12T01:26:02.498632+0000","last_clean":"2024-09-12T01:26:02.498632+0000","last_became_active":"2024-09-12T01:04:13.462434+0000","last_became_peered":"2024-09-12T01:04:13.462434+0000","last_unstale":"2024-09-12T01:26:02.498632+0000","last_undegraded":"2024-09-12T01:26:02.498632+0000","last_fullsized":"2024-09-12T01:26:02.498632+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:42.830213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499355+0000","last_change":"2024-09-12T00:48:45.316725+0000","last_active":"2024-09-12T01:26:07.499355+0000","last_peered":"2024-09-12T01:26:07.499355+0000","last_clean":"2024-09-12T01:26:07.499355+0000","last_became_active":"2024-09-12T00:48:45.316432+0000","last_became_peered":"2024-09-12T00:48:45.316432+0000","last_unstale":"2024-09-12T01:26:07.499355+0000","last_undegraded":"2024-09-12T01:26:07.499355+0000","last_fullsized":"2024-09-12T01:26:07.499355+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:20.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605590+0000","last_change":"2024-09-12T00:48:42.290754+0000","last_active":"2024-09-12T01:26:04.605590+0000","last_peered":"2024-09-12T01:26:04.605590+0000","last_clean":"2024-09-12T01:26:04.605590+0000","last_became_active":"2024-09-12T00:48:42.290454+0000","last_became_peered":"2024-09-12T00:48:42.290454+0000","last_unstale":"2024-09-12T01:26:04.605590+0000","last_undegraded":"2024-09-12T01:26:04.605590+0000","last_fullsized":"2024-09-12T01:26:04.605590+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:16.245048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"262'7","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.719526+0000","last_change":"2024-09-12T00:46:03.917579+0000","last_active":"2024-09-12T01:25:44.719526+0000","last_peered":"2024-09-12T01:25:44.719526+0000","last_clean":"2024-09-12T01:25:44.719526+0000","last_became_active":"2024-09-12T00:46:03.917314+0000","last_became_peered":"2024-09-12T00:46:03.917314+0000","last_unstale":"2024-09-12T01:25:44.719526+0000","last_undegraded":"2024-09-12T01:25:44.719526+0000","last_fullsized":"2024-09-12T01:25:44.719526+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:21.892403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":13,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637319+0000","last_change":"2024-09-12T01:04:13.467571+0000","last_active":"2024-09-12T01:26:00.637319+0000","last_peered":"2024-09-12T01:26:00.637319+0000","last_clean":"2024-09-12T01:26:00.637319+0000","last_became_active":"2024-09-12T01:04:13.467119+0000","last_became_peered":"2024-09-12T01:04:13.467119+0000","last_unstale":"2024-09-12T01:26:00.637319+0000","last_undegraded":"2024-09-12T01:26:00.637319+0000","last_fullsized":"2024-09-12T01:26:00.637319+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:23.369147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499300+0000","last_change":"2024-09-12T00:48:45.314598+0000","last_active":"2024-09-12T01:26:07.499300+0000","last_peered":"2024-09-12T01:26:07.499300+0000","last_clean":"2024-09-12T01:26:07.499300+0000","last_became_active":"2024-09-12T00:48:45.314127+0000","last_became_peered":"2024-09-12T00:48:45.314127+0000","last_unstale":"2024-09-12T01:26:07.499300+0000","last_undegraded":"2024-09-12T01:26:07.499300+0000","last_fullsized":"2024-09-12T01:26:07.499300+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:00.050328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'5","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498548+0000","last_change":"2024-09-12T00:48:42.293860+0000","last_active":"2024-09-12T01:26:02.498548+0000","last_peered":"2024-09-12T01:26:02.498548+0000","last_clean":"2024-09-12T01:26:02.498548+0000","last_became_active":"2024-09-12T00:48:42.293153+0000","last_became_peered":"2024-09-12T00:48:42.293153+0000","last_unstale":"2024-09-12T01:26:02.498548+0000","last_undegraded":"2024-09-12T01:26:02.498548+0000","last_fullsized":"2024-09-12T01:26:02.498548+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:12.547450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'49","reported_seq":179,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:45.779451+0000","last_change":"2024-09-12T00:46:03.917417+0000","last_active":"2024-09-12T01:25:45.779451+0000","last_peered":"2024-09-12T01:25:45.779451+0000","last_clean":"2024-09-12T01:25:45.779451+0000","last_became_active":"2024-09-12T00:46:03.917142+0000","last_became_peered":"2024-09-12T00:46:03.917142+0000","last_unstale":"2024-09-12T01:25:45.779451+0000","last_undegraded":"2024-09-12T01:25:45.779451+0000","last_fullsized":"2024-09-12T01:25:45.779451+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:12.229825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":172,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:18.494068+0000","last_change":"2024-09-12T01:04:13.464064+0000","last_active":"2024-09-12T01:25:18.494068+0000","last_peered":"2024-09-12T01:25:18.494068+0000","last_clean":"2024-09-12T01:25:18.494068+0000","last_became_active":"2024-09-12T01:04:13.463766+0000","last_became_peered":"2024-09-12T01:04:13.463766+0000","last_unstale":"2024-09-12T01:25:18.494068+0000","last_undegraded":"2024-09-12T01:25:18.494068+0000","last_fullsized":"2024-09-12T01:25:18.494068+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:26.806464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782587+0000","last_change":"2024-09-12T00:48:45.307348+0000","last_active":"2024-09-12T01:26:05.782587+0000","last_peered":"2024-09-12T01:26:05.782587+0000","last_clean":"2024-09-12T01:26:05.782587+0000","last_became_active":"2024-09-12T00:48:45.307036+0000","last_became_peered":"2024-09-12T00:48:45.307036+0000","last_unstale":"2024-09-12T01:26:05.782587+0000","last_undegraded":"2024-09-12T01:26:05.782587+0000","last_fullsized":"2024-09-12T01:26:05.782587+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:21.417276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'4","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605655+0000","last_change":"2024-09-12T00:48:42.294916+0000","last_active":"2024-09-12T01:26:04.605655+0000","last_peered":"2024-09-12T01:26:04.605655+0000","last_clean":"2024-09-12T01:26:04.605655+0000","last_became_active":"2024-09-12T00:48:42.294608+0000","last_became_peered":"2024-09-12T00:48:42.294608+0000","last_unstale":"2024-09-12T01:26:04.605655+0000","last_undegraded":"2024-09-12T01:26:04.605655+0000","last_fullsized":"2024-09-12T01:26:04.605655+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:37.130170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5438,"num_write":4,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.502728+0000","last_change":"2024-09-12T00:46:03.922277+0000","last_active":"2024-09-12T01:25:44.502728+0000","last_peered":"2024-09-12T01:25:44.502728+0000","last_clean":"2024-09-12T01:25:44.502728+0000","last_became_active":"2024-09-12T00:46:03.921844+0000","last_became_peered":"2024-09-12T00:46:03.921844+0000","last_unstale":"2024-09-12T01:25:44.502728+0000","last_undegraded":"2024-09-12T01:25:44.502728+0000","last_fullsized":"2024-09-12T01:25:44.502728+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:57.617387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":67,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637276+0000","last_change":"2024-09-12T01:04:13.462719+0000","last_active":"2024-09-12T01:26:00.637276+0000","last_peered":"2024-09-12T01:26:00.637276+0000","last_clean":"2024-09-12T01:26:00.637276+0000","last_became_active":"2024-09-12T01:04:13.462441+0000","last_became_peered":"2024-09-12T01:04:13.462441+0000","last_unstale":"2024-09-12T01:26:00.637276+0000","last_undegraded":"2024-09-12T01:26:00.637276+0000","last_fullsized":"2024-09-12T01:26:00.637276+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:19.887695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'9","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723555+0000","last_change":"2024-09-12T00:48:45.312937+0000","last_active":"2024-09-12T01:26:04.723555+0000","last_peered":"2024-09-12T01:26:04.723555+0000","last_clean":"2024-09-12T01:26:04.723555+0000","last_became_active":"2024-09-12T00:48:45.312617+0000","last_became_peered":"2024-09-12T00:48:45.312617+0000","last_unstale":"2024-09-12T01:26:04.723555+0000","last_undegraded":"2024-09-12T01:26:04.723555+0000","last_fullsized":"2024-09-12T01:26:04.723555+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:28.386583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5291306,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":20528,"num_write":19,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605671+0000","last_change":"2024-09-12T00:48:42.292806+0000","last_active":"2024-09-12T01:26:04.605671+0000","last_peered":"2024-09-12T01:26:04.605671+0000","last_clean":"2024-09-12T01:26:04.605671+0000","last_became_active":"2024-09-12T00:48:42.292511+0000","last_became_peered":"2024-09-12T00:48:42.292511+0000","last_unstale":"2024-09-12T01:26:04.605671+0000","last_undegraded":"2024-09-12T01:26:04.605671+0000","last_fullsized":"2024-09-12T01:26:04.605671+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:34.992694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'10","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:45.779402+0000","last_change":"2024-09-12T00:46:03.913386+0000","last_active":"2024-09-12T01:25:45.779402+0000","last_peered":"2024-09-12T01:25:45.779402+0000","last_clean":"2024-09-12T01:25:45.779402+0000","last_became_active":"2024-09-12T00:46:03.913098+0000","last_became_peered":"2024-09-12T00:46:03.913098+0000","last_unstale":"2024-09-12T01:25:45.779402+0000","last_undegraded":"2024-09-12T01:25:45.779402+0000","last_fullsized":"2024-09-12T01:25:45.779402+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:03.725529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":36,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498570+0000","last_change":"2024-09-12T01:04:13.474135+0000","last_active":"2024-09-12T01:26:02.498570+0000","last_peered":"2024-09-12T01:26:02.498570+0000","last_clean":"2024-09-12T01:26:02.498570+0000","last_became_active":"2024-09-12T01:04:13.473901+0000","last_became_peered":"2024-09-12T01:04:13.473901+0000","last_unstale":"2024-09-12T01:26:02.498570+0000","last_undegraded":"2024-09-12T01:26:02.498570+0000","last_fullsized":"2024-09-12T01:26:02.498570+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:45.848297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.711540+0000","last_change":"2024-09-12T00:48:45.308960+0000","last_active":"2024-09-12T01:29:15.711540+0000","last_peered":"2024-09-12T01:29:15.711540+0000","last_clean":"2024-09-12T01:29:15.711540+0000","last_became_active":"2024-09-12T00:48:45.308676+0000","last_became_peered":"2024-09-12T00:48:45.308676+0000","last_unstale":"2024-09-12T01:29:15.711540+0000","last_undegraded":"2024-09-12T01:29:15.711540+0000","last_fullsized":"2024-09-12T01:29:15.711540+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:11.911720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":9,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:59.510461+0000","last_change":"2024-09-12T00:48:42.291979+0000","last_active":"2024-09-12T01:26:59.510461+0000","last_peered":"2024-09-12T01:26:59.510461+0000","last_clean":"2024-09-12T01:26:59.510461+0000","last_became_active":"2024-09-12T00:48:42.291569+0000","last_became_peered":"2024-09-12T00:48:42.291569+0000","last_unstale":"2024-09-12T01:26:59.510461+0000","last_undegraded":"2024-09-12T01:26:59.510461+0000","last_fullsized":"2024-09-12T01:26:59.510461+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:20.262872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'67","reported_seq":233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.789165+0000","last_change":"2024-09-12T00:46:03.920845+0000","last_active":"2024-09-12T01:26:45.789165+0000","last_peered":"2024-09-12T01:26:45.789165+0000","last_clean":"2024-09-12T01:26:45.789165+0000","last_became_active":"2024-09-12T00:46:03.920387+0000","last_became_peered":"2024-09-12T00:46:03.920387+0000","last_unstale":"2024-09-12T01:26:45.789165+0000","last_undegraded":"2024-09-12T01:26:45.789165+0000","last_fullsized":"2024-09-12T01:26:45.789165+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:02.972369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":242,"num_write":122,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.609771+0000","last_change":"2024-09-12T01:04:13.470050+0000","last_active":"2024-09-12T01:26:44.609771+0000","last_peered":"2024-09-12T01:26:44.609771+0000","last_clean":"2024-09-12T01:26:44.609771+0000","last_became_active":"2024-09-12T01:04:13.469544+0000","last_became_peered":"2024-09-12T01:04:13.469544+0000","last_unstale":"2024-09-12T01:26:44.609771+0000","last_undegraded":"2024-09-12T01:26:44.609771+0000","last_fullsized":"2024-09-12T01:26:44.609771+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:57.676504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.791316+0000","last_change":"2024-09-12T00:48:45.310714+0000","last_active":"2024-09-12T01:27:00.791316+0000","last_peered":"2024-09-12T01:27:00.791316+0000","last_clean":"2024-09-12T01:27:00.791316+0000","last_became_active":"2024-09-12T00:48:45.310425+0000","last_became_peered":"2024-09-12T00:48:45.310425+0000","last_unstale":"2024-09-12T01:27:00.791316+0000","last_undegraded":"2024-09-12T01:27:00.791316+0000","last_fullsized":"2024-09-12T01:27:00.791316+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:11.427037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646110+0000","last_change":"2024-09-12T00:48:42.289205+0000","last_active":"2024-09-12T01:27:00.646110+0000","last_peered":"2024-09-12T01:27:00.646110+0000","last_clean":"2024-09-12T01:27:00.646110+0000","last_became_active":"2024-09-12T00:48:42.288750+0000","last_became_peered":"2024-09-12T00:48:42.288750+0000","last_unstale":"2024-09-12T01:27:00.646110+0000","last_undegraded":"2024-09-12T01:27:00.646110+0000","last_fullsized":"2024-09-12T01:27:00.646110+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:03.592679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'39","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.727351+0000","last_change":"2024-09-12T00:46:03.918651+0000","last_active":"2024-09-12T01:26:34.727351+0000","last_peered":"2024-09-12T01:26:34.727351+0000","last_clean":"2024-09-12T01:26:34.727351+0000","last_became_active":"2024-09-12T00:46:03.918395+0000","last_became_peered":"2024-09-12T00:46:03.918395+0000","last_unstale":"2024-09-12T01:26:34.727351+0000","last_undegraded":"2024-09-12T01:26:34.727351+0000","last_fullsized":"2024-09-12T01:26:34.727351+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:06.038629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":130,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.722217+0000","last_change":"2024-09-12T01:04:13.468761+0000","last_active":"2024-09-12T01:25:54.722217+0000","last_peered":"2024-09-12T01:25:54.722217+0000","last_clean":"2024-09-12T01:25:54.722217+0000","last_became_active":"2024-09-12T01:04:13.468492+0000","last_became_peered":"2024-09-12T01:04:13.468492+0000","last_unstale":"2024-09-12T01:25:54.722217+0000","last_undegraded":"2024-09-12T01:25:54.722217+0000","last_fullsized":"2024-09-12T01:25:54.722217+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:23.228261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:55.772046+0000","last_change":"2024-09-12T00:48:45.306987+0000","last_active":"2024-09-12T01:24:55.772046+0000","last_peered":"2024-09-12T01:24:55.772046+0000","last_clean":"2024-09-12T01:24:55.772046+0000","last_became_active":"2024-09-12T00:48:45.306581+0000","last_became_peered":"2024-09-12T00:48:45.306581+0000","last_unstale":"2024-09-12T01:24:55.772046+0000","last_undegraded":"2024-09-12T01:24:55.772046+0000","last_fullsized":"2024-09-12T01:24:55.772046+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:18.025186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.791375+0000","last_change":"2024-09-12T00:48:42.291472+0000","last_active":"2024-09-12T01:27:00.791375+0000","last_peered":"2024-09-12T01:27:00.791375+0000","last_clean":"2024-09-12T01:27:00.791375+0000","last_became_active":"2024-09-12T00:48:42.290069+0000","last_became_peered":"2024-09-12T00:48:42.290069+0000","last_unstale":"2024-09-12T01:27:00.791375+0000","last_undegraded":"2024-09-12T01:27:00.791375+0000","last_fullsized":"2024-09-12T01:27:00.791375+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:06.334859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'22","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.608639+0000","last_change":"2024-09-12T00:46:03.917998+0000","last_active":"2024-09-12T01:26:34.608639+0000","last_peered":"2024-09-12T01:26:34.608639+0000","last_clean":"2024-09-12T01:26:34.608639+0000","last_became_active":"2024-09-12T00:46:03.917612+0000","last_became_peered":"2024-09-12T00:46:03.917612+0000","last_unstale":"2024-09-12T01:26:34.608639+0000","last_undegraded":"2024-09-12T01:26:34.608639+0000","last_fullsized":"2024-09-12T01:26:34.608639+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:25.331801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":67,"num_write":52,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.604479+0000","last_change":"2024-09-12T01:04:13.471829+0000","last_active":"2024-09-12T01:25:54.604479+0000","last_peered":"2024-09-12T01:25:54.604479+0000","last_clean":"2024-09-12T01:25:54.604479+0000","last_became_active":"2024-09-12T01:04:13.470494+0000","last_became_peered":"2024-09-12T01:04:13.470494+0000","last_unstale":"2024-09-12T01:25:54.604479+0000","last_undegraded":"2024-09-12T01:25:54.604479+0000","last_fullsized":"2024-09-12T01:25:54.604479+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:21.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:47.487156+0000","last_change":"2024-09-12T00:48:45.317979+0000","last_active":"2024-09-12T01:24:47.487156+0000","last_peered":"2024-09-12T01:24:47.487156+0000","last_clean":"2024-09-12T01:24:47.487156+0000","last_became_active":"2024-09-12T00:48:45.317637+0000","last_became_peered":"2024-09-12T00:48:45.317637+0000","last_unstale":"2024-09-12T01:24:47.487156+0000","last_undegraded":"2024-09-12T01:24:47.487156+0000","last_fullsized":"2024-09-12T01:24:47.487156+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:51.863153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:55.772057+0000","last_change":"2024-09-12T00:48:42.289582+0000","last_active":"2024-09-12T01:24:55.772057+0000","last_peered":"2024-09-12T01:24:55.772057+0000","last_clean":"2024-09-12T01:24:55.772057+0000","last_became_active":"2024-09-12T00:48:42.289304+0000","last_became_peered":"2024-09-12T00:48:42.289304+0000","last_unstale":"2024-09-12T01:24:55.772057+0000","last_undegraded":"2024-09-12T01:24:55.772057+0000","last_fullsized":"2024-09-12T01:24:55.772057+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:58.432324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":140,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.642226+0000","last_change":"2024-09-12T00:46:03.911642+0000","last_active":"2024-09-12T01:26:35.642226+0000","last_peered":"2024-09-12T01:26:35.642226+0000","last_clean":"2024-09-12T01:26:35.642226+0000","last_became_active":"2024-09-12T00:46:03.911316+0000","last_became_peered":"2024-09-12T00:46:03.911316+0000","last_unstale":"2024-09-12T01:26:35.642226+0000","last_undegraded":"2024-09-12T01:26:35.642226+0000","last_fullsized":"2024-09-12T01:26:35.642226+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:27.292826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":121,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:47.505723+0000","last_change":"2024-09-12T01:04:13.462688+0000","last_active":"2024-09-12T01:26:47.505723+0000","last_peered":"2024-09-12T01:26:47.505723+0000","last_clean":"2024-09-12T01:26:47.505723+0000","last_became_active":"2024-09-12T01:04:13.462150+0000","last_became_peered":"2024-09-12T01:04:13.462150+0000","last_unstale":"2024-09-12T01:26:47.505723+0000","last_undegraded":"2024-09-12T01:26:47.505723+0000","last_fullsized":"2024-09-12T01:26:47.505723+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:43.928057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718235+0000","last_change":"2024-09-12T00:48:45.312564+0000","last_active":"2024-09-12T01:25:34.718235+0000","last_peered":"2024-09-12T01:25:34.718235+0000","last_clean":"2024-09-12T01:25:34.718235+0000","last_became_active":"2024-09-12T00:48:45.312283+0000","last_became_peered":"2024-09-12T00:48:45.312283+0000","last_unstale":"2024-09-12T01:25:34.718235+0000","last_undegraded":"2024-09-12T01:25:34.718235+0000","last_fullsized":"2024-09-12T01:25:34.718235+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:08.027455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:45.797614+0000","last_change":"2024-09-12T00:48:42.290364+0000","last_active":"2024-09-12T01:27:45.797614+0000","last_peered":"2024-09-12T01:27:45.797614+0000","last_clean":"2024-09-12T01:27:45.797614+0000","last_became_active":"2024-09-12T00:48:42.290091+0000","last_became_peered":"2024-09-12T00:48:42.290091+0000","last_unstale":"2024-09-12T01:27:45.797614+0000","last_undegraded":"2024-09-12T01:27:45.797614+0000","last_fullsized":"2024-09-12T01:27:45.797614+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:37.718174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'27","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.642191+0000","last_change":"2024-09-12T00:46:03.917233+0000","last_active":"2024-09-12T01:26:35.642191+0000","last_peered":"2024-09-12T01:26:35.642191+0000","last_clean":"2024-09-12T01:26:35.642191+0000","last_became_active":"2024-09-12T00:46:03.916476+0000","last_became_peered":"2024-09-12T00:46:03.916476+0000","last_unstale":"2024-09-12T01:26:35.642191+0000","last_undegraded":"2024-09-12T01:26:35.642191+0000","last_fullsized":"2024-09-12T01:26:35.642191+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:29.196991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:54.509963+0000","last_change":"2024-09-12T01:04:13.467457+0000","last_active":"2024-09-12T01:26:54.509963+0000","last_peered":"2024-09-12T01:26:54.509963+0000","last_clean":"2024-09-12T01:26:54.509963+0000","last_became_active":"2024-09-12T01:04:13.467045+0000","last_became_peered":"2024-09-12T01:04:13.467045+0000","last_unstale":"2024-09-12T01:26:54.509963+0000","last_undegraded":"2024-09-12T01:26:54.509963+0000","last_fullsized":"2024-09-12T01:26:54.509963+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:17.297601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.501740+0000","last_change":"2024-09-12T00:48:45.309440+0000","last_active":"2024-09-12T01:25:34.501740+0000","last_peered":"2024-09-12T01:25:34.501740+0000","last_clean":"2024-09-12T01:25:34.501740+0000","last_became_active":"2024-09-12T00:48:45.309113+0000","last_became_peered":"2024-09-12T00:48:45.309113+0000","last_unstale":"2024-09-12T01:25:34.501740+0000","last_undegraded":"2024-09-12T01:25:34.501740+0000","last_fullsized":"2024-09-12T01:25:34.501740+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:40.821689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'1","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:32.494012+0000","last_change":"2024-09-12T00:48:42.293380+0000","last_active":"2024-09-12T01:25:32.494012+0000","last_peered":"2024-09-12T01:25:32.494012+0000","last_clean":"2024-09-12T01:25:32.494012+0000","last_became_active":"2024-09-12T00:48:42.292733+0000","last_became_peered":"2024-09-12T00:48:42.292733+0000","last_unstale":"2024-09-12T01:25:32.494012+0000","last_undegraded":"2024-09-12T01:25:32.494012+0000","last_fullsized":"2024-09-12T01:25:32.494012+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.445225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":698,"num_write":1,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"262'8","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:19.500204+0000","last_change":"2024-09-12T00:46:03.922414+0000","last_active":"2024-09-12T01:25:19.500204+0000","last_peered":"2024-09-12T01:25:19.500204+0000","last_clean":"2024-09-12T01:25:19.500204+0000","last_became_active":"2024-09-12T00:46:03.922008+0000","last_became_peered":"2024-09-12T00:46:03.922008+0000","last_unstale":"2024-09-12T01:25:19.500204+0000","last_undegraded":"2024-09-12T01:25:19.500204+0000","last_fullsized":"2024-09-12T01:25:19.500204+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:42.541731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.506044+0000","last_change":"2024-09-12T01:04:13.467753+0000","last_active":"2024-09-12T01:26:44.506044+0000","last_peered":"2024-09-12T01:26:44.506044+0000","last_clean":"2024-09-12T01:26:44.506044+0000","last_became_active":"2024-09-12T01:04:13.467476+0000","last_became_peered":"2024-09-12T01:04:13.467476+0000","last_unstale":"2024-09-12T01:26:44.506044+0000","last_undegraded":"2024-09-12T01:26:44.506044+0000","last_fullsized":"2024-09-12T01:26:44.506044+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:36.299465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646039+0000","last_change":"2024-09-12T00:48:45.311842+0000","last_active":"2024-09-12T01:27:00.646039+0000","last_peered":"2024-09-12T01:27:00.646039+0000","last_clean":"2024-09-12T01:27:00.646039+0000","last_became_active":"2024-09-12T00:48:45.311541+0000","last_became_peered":"2024-09-12T00:48:45.311541+0000","last_unstale":"2024-09-12T01:27:00.646039+0000","last_undegraded":"2024-09-12T01:27:00.646039+0000","last_fullsized":"2024-09-12T01:27:00.646039+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:32.767909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:45.779440+0000","last_change":"2024-09-12T00:48:42.281525+0000","last_active":"2024-09-12T01:25:45.779440+0000","last_peered":"2024-09-12T01:25:45.779440+0000","last_clean":"2024-09-12T01:25:45.779440+0000","last_became_active":"2024-09-12T00:48:42.281070+0000","last_became_peered":"2024-09-12T00:48:42.281070+0000","last_unstale":"2024-09-12T01:25:45.779440+0000","last_undegraded":"2024-09-12T01:25:45.779440+0000","last_fullsized":"2024-09-12T01:25:45.779440+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:50.751015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'44","reported_seq":173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:07.489887+0000","last_change":"2024-09-12T00:46:03.917910+0000","last_active":"2024-09-12T01:25:07.489887+0000","last_peered":"2024-09-12T01:25:07.489887+0000","last_clean":"2024-09-12T01:25:07.489887+0000","last_became_active":"2024-09-12T00:46:03.917626+0000","last_became_peered":"2024-09-12T00:46:03.917626+0000","last_unstale":"2024-09-12T01:25:07.489887+0000","last_undegraded":"2024-09-12T01:25:07.489887+0000","last_fullsized":"2024-09-12T01:25:07.489887+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:07.349450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":170,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.789110+0000","last_change":"2024-09-12T01:04:13.463528+0000","last_active":"2024-09-12T01:26:45.789110+0000","last_peered":"2024-09-12T01:26:45.789110+0000","last_clean":"2024-09-12T01:26:45.789110+0000","last_became_active":"2024-09-12T01:04:13.463216+0000","last_became_peered":"2024-09-12T01:04:13.463216+0000","last_unstale":"2024-09-12T01:26:45.789110+0000","last_undegraded":"2024-09-12T01:26:45.789110+0000","last_fullsized":"2024-09-12T01:26:45.789110+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:56.941035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.499853+0000","last_change":"2024-09-12T00:48:45.313761+0000","last_active":"2024-09-12T01:25:44.499853+0000","last_peered":"2024-09-12T01:25:44.499853+0000","last_clean":"2024-09-12T01:25:44.499853+0000","last_became_active":"2024-09-12T00:48:45.313386+0000","last_became_peered":"2024-09-12T00:48:45.313386+0000","last_unstale":"2024-09-12T01:25:44.499853+0000","last_undegraded":"2024-09-12T01:25:44.499853+0000","last_fullsized":"2024-09-12T01:25:44.499853+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:02.140152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:59.730452+0000","last_change":"2024-09-12T00:48:42.293797+0000","last_active":"2024-09-12T01:26:59.730452+0000","last_peered":"2024-09-12T01:26:59.730452+0000","last_clean":"2024-09-12T01:26:59.730452+0000","last_became_active":"2024-09-12T00:48:42.293460+0000","last_became_peered":"2024-09-12T00:48:42.293460+0000","last_unstale":"2024-09-12T01:26:59.730452+0000","last_undegraded":"2024-09-12T01:26:59.730452+0000","last_fullsized":"2024-09-12T01:26:59.730452+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:22.406867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'27","reported_seq":123,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.495705+0000","last_change":"2024-09-12T00:46:03.919193+0000","last_active":"2024-09-12T01:25:04.495705+0000","last_peered":"2024-09-12T01:25:04.495705+0000","last_clean":"2024-09-12T01:25:04.495705+0000","last_became_active":"2024-09-12T00:46:03.918921+0000","last_became_peered":"2024-09-12T00:46:03.918921+0000","last_unstale":"2024-09-12T01:25:04.495705+0000","last_undegraded":"2024-09-12T01:25:04.495705+0000","last_fullsized":"2024-09-12T01:25:04.495705+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:43.600527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.508427+0000","last_change":"2024-09-12T01:04:13.467161+0000","last_active":"2024-09-12T01:27:09.508427+0000","last_peered":"2024-09-12T01:27:09.508427+0000","last_clean":"2024-09-12T01:27:09.508427+0000","last_became_active":"2024-09-12T01:04:13.466854+0000","last_became_peered":"2024-09-12T01:04:13.466854+0000","last_unstale":"2024-09-12T01:27:09.508427+0000","last_undegraded":"2024-09-12T01:27:09.508427+0000","last_fullsized":"2024-09-12T01:27:09.508427+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:37.902119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:27.502721+0000","last_change":"2024-09-12T00:48:45.316511+0000","last_active":"2024-09-12T01:26:27.502721+0000","last_peered":"2024-09-12T01:26:27.502721+0000","last_clean":"2024-09-12T01:26:27.502721+0000","last_became_active":"2024-09-12T00:48:45.315966+0000","last_became_peered":"2024-09-12T00:48:45.315966+0000","last_unstale":"2024-09-12T01:26:27.502721+0000","last_undegraded":"2024-09-12T01:26:27.502721+0000","last_fullsized":"2024-09-12T01:26:27.502721+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:04.129604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1396,"num_write":1,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.725014+0000","last_change":"2024-09-12T00:48:42.294344+0000","last_active":"2024-09-12T01:26:14.725014+0000","last_peered":"2024-09-12T01:26:14.725014+0000","last_clean":"2024-09-12T01:26:14.725014+0000","last_became_active":"2024-09-12T00:48:42.293481+0000","last_became_peered":"2024-09-12T00:48:42.293481+0000","last_unstale":"2024-09-12T01:26:14.725014+0000","last_undegraded":"2024-09-12T01:26:14.725014+0000","last_fullsized":"2024-09-12T01:26:14.725014+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:01.378966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'25","reported_seq":117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:03.492017+0000","last_change":"2024-09-12T00:46:03.914527+0000","last_active":"2024-09-12T01:25:03.492017+0000","last_peered":"2024-09-12T01:25:03.492017+0000","last_clean":"2024-09-12T01:25:03.492017+0000","last_became_active":"2024-09-12T00:46:03.914207+0000","last_became_peered":"2024-09-12T00:46:03.914207+0000","last_unstale":"2024-09-12T01:25:03.492017+0000","last_undegraded":"2024-09-12T01:25:03.492017+0000","last_fullsized":"2024-09-12T01:25:03.492017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:53.077898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.508448+0000","last_change":"2024-09-12T01:04:13.466887+0000","last_active":"2024-09-12T01:27:09.508448+0000","last_peered":"2024-09-12T01:27:09.508448+0000","last_clean":"2024-09-12T01:27:09.508448+0000","last_became_active":"2024-09-12T01:04:13.466050+0000","last_became_peered":"2024-09-12T01:04:13.466050+0000","last_unstale":"2024-09-12T01:27:09.508448+0000","last_undegraded":"2024-09-12T01:27:09.508448+0000","last_fullsized":"2024-09-12T01:27:09.508448+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:39.634410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501296+0000","last_change":"2024-09-12T00:48:45.314649+0000","last_active":"2024-09-12T01:26:17.501296+0000","last_peered":"2024-09-12T01:26:17.501296+0000","last_clean":"2024-09-12T01:26:17.501296+0000","last_became_active":"2024-09-12T00:48:45.313692+0000","last_became_peered":"2024-09-12T00:48:45.313692+0000","last_unstale":"2024-09-12T01:26:17.501296+0000","last_undegraded":"2024-09-12T01:26:17.501296+0000","last_fullsized":"2024-09-12T01:26:17.501296+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:19.872019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:23.503219+0000","last_change":"2024-09-12T00:48:42.288243+0000","last_active":"2024-09-12T01:26:23.503219+0000","last_peered":"2024-09-12T01:26:23.503219+0000","last_clean":"2024-09-12T01:26:23.503219+0000","last_became_active":"2024-09-12T00:48:42.287949+0000","last_became_peered":"2024-09-12T00:48:42.287949+0000","last_unstale":"2024-09-12T01:26:23.503219+0000","last_undegraded":"2024-09-12T01:26:23.503219+0000","last_fullsized":"2024-09-12T01:26:23.503219+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:37.161356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'53","reported_seq":194,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714926+0000","last_change":"2024-09-12T00:46:03.918000+0000","last_active":"2024-09-12T01:25:04.714926+0000","last_peered":"2024-09-12T01:25:04.714926+0000","last_clean":"2024-09-12T01:25:04.714926+0000","last_became_active":"2024-09-12T00:46:03.917728+0000","last_became_peered":"2024-09-12T00:46:03.917728+0000","last_unstale":"2024-09-12T01:25:04.714926+0000","last_undegraded":"2024-09-12T01:25:04.714926+0000","last_fullsized":"2024-09-12T01:25:04.714926+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:11.732147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":191,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:22.501894+0000","last_change":"2024-09-12T01:04:13.466462+0000","last_active":"2024-09-12T01:26:22.501894+0000","last_peered":"2024-09-12T01:26:22.501894+0000","last_clean":"2024-09-12T01:26:22.501894+0000","last_became_active":"2024-09-12T01:04:13.466183+0000","last_became_peered":"2024-09-12T01:04:13.466183+0000","last_unstale":"2024-09-12T01:26:22.501894+0000","last_undegraded":"2024-09-12T01:26:22.501894+0000","last_fullsized":"2024-09-12T01:26:22.501894+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:33.706209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.498929+0000","last_change":"2024-09-12T00:48:45.311887+0000","last_active":"2024-09-12T01:25:34.498929+0000","last_peered":"2024-09-12T01:25:34.498929+0000","last_clean":"2024-09-12T01:25:34.498929+0000","last_became_active":"2024-09-12T00:48:45.311453+0000","last_became_peered":"2024-09-12T00:48:45.311453+0000","last_unstale":"2024-09-12T01:25:34.498929+0000","last_undegraded":"2024-09-12T01:25:34.498929+0000","last_fullsized":"2024-09-12T01:25:34.498929+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:34.715672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'1","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.501826+0000","last_change":"2024-09-12T00:48:42.295708+0000","last_active":"2024-09-12T01:25:34.501826+0000","last_peered":"2024-09-12T01:25:34.501826+0000","last_clean":"2024-09-12T01:25:34.501826+0000","last_became_active":"2024-09-12T00:48:42.295358+0000","last_became_peered":"2024-09-12T00:48:42.295358+0000","last_unstale":"2024-09-12T01:25:34.501826+0000","last_undegraded":"2024-09-12T01:25:34.501826+0000","last_fullsized":"2024-09-12T01:25:34.501826+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:21.788554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'81","reported_seq":278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.503935+0000","last_change":"2024-09-12T00:46:03.916339+0000","last_active":"2024-09-12T01:25:54.503935+0000","last_peered":"2024-09-12T01:25:54.503935+0000","last_clean":"2024-09-12T01:25:54.503935+0000","last_became_active":"2024-09-12T00:46:03.916021+0000","last_became_peered":"2024-09-12T00:46:03.916021+0000","last_unstale":"2024-09-12T01:25:54.503935+0000","last_undegraded":"2024-09-12T01:25:54.503935+0000","last_fullsized":"2024-09-12T01:25:54.503935+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:09.221542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":326,"num_write":133,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.731804+0000","last_change":"2024-09-12T01:04:13.466014+0000","last_active":"2024-09-12T01:27:09.731804+0000","last_peered":"2024-09-12T01:27:09.731804+0000","last_clean":"2024-09-12T01:27:09.731804+0000","last_became_active":"2024-09-12T01:04:13.465478+0000","last_became_peered":"2024-09-12T01:04:13.465478+0000","last_unstale":"2024-09-12T01:27:09.731804+0000","last_undegraded":"2024-09-12T01:27:09.731804+0000","last_fullsized":"2024-09-12T01:27:09.731804+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:45.735147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718359+0000","last_change":"2024-09-12T00:48:45.314296+0000","last_active":"2024-09-12T01:25:34.718359+0000","last_peered":"2024-09-12T01:25:34.718359+0000","last_clean":"2024-09-12T01:25:34.718359+0000","last_became_active":"2024-09-12T00:48:45.313057+0000","last_became_peered":"2024-09-12T00:48:45.313057+0000","last_unstale":"2024-09-12T01:25:34.718359+0000","last_undegraded":"2024-09-12T01:25:34.718359+0000","last_fullsized":"2024-09-12T01:25:34.718359+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:38.739439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718378+0000","last_change":"2024-09-12T00:48:42.297183+0000","last_active":"2024-09-12T01:25:34.718378+0000","last_peered":"2024-09-12T01:25:34.718378+0000","last_clean":"2024-09-12T01:25:34.718378+0000","last_became_active":"2024-09-12T00:48:42.296903+0000","last_became_peered":"2024-09-12T00:48:42.296903+0000","last_unstale":"2024-09-12T01:25:34.718378+0000","last_undegraded":"2024-09-12T01:25:34.718378+0000","last_fullsized":"2024-09-12T01:25:34.718378+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:11.352129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'58","reported_seq":244,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:40.778662+0000","last_change":"2024-09-12T00:46:03.917455+0000","last_active":"2024-09-12T01:25:40.778662+0000","last_peered":"2024-09-12T01:25:40.778662+0000","last_clean":"2024-09-12T01:25:40.778662+0000","last_became_active":"2024-09-12T00:46:03.917131+0000","last_became_peered":"2024-09-12T00:46:03.917131+0000","last_unstale":"2024-09-12T01:25:40.778662+0000","last_undegraded":"2024-09-12T01:25:40.778662+0000","last_fullsized":"2024-09-12T01:25:40.778662+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:05.329202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":270,"num_write":80,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.781081+0000","last_change":"2024-09-12T01:04:13.468499+0000","last_active":"2024-09-12T01:25:55.781081+0000","last_peered":"2024-09-12T01:25:55.781081+0000","last_clean":"2024-09-12T01:25:55.781081+0000","last_became_active":"2024-09-12T01:04:13.468116+0000","last_became_peered":"2024-09-12T01:04:13.468116+0000","last_unstale":"2024-09-12T01:25:55.781081+0000","last_undegraded":"2024-09-12T01:25:55.781081+0000","last_fullsized":"2024-09-12T01:25:55.781081+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:15.224566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:18.502441+0000","last_change":"2024-09-12T00:48:45.317145+0000","last_active":"2024-09-12T01:26:18.502441+0000","last_peered":"2024-09-12T01:26:18.502441+0000","last_clean":"2024-09-12T01:26:18.502441+0000","last_became_active":"2024-09-12T00:48:45.316713+0000","last_became_peered":"2024-09-12T00:48:45.316713+0000","last_unstale":"2024-09-12T01:26:18.502441+0000","last_undegraded":"2024-09-12T01:26:18.502441+0000","last_fullsized":"2024-09-12T01:26:18.502441+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:25.736540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096995,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2096,"num_write":8,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'1","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:59.510380+0000","last_change":"2024-09-12T00:48:42.293385+0000","last_active":"2024-09-12T01:26:59.510380+0000","last_peered":"2024-09-12T01:26:59.510380+0000","last_clean":"2024-09-12T01:26:59.510380+0000","last_became_active":"2024-09-12T00:48:42.293111+0000","last_became_peered":"2024-09-12T00:48:42.293111+0000","last_unstale":"2024-09-12T01:26:59.510380+0000","last_undegraded":"2024-09-12T01:26:59.510380+0000","last_fullsized":"2024-09-12T01:26:59.510380+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:17.021932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'34","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.502266+0000","last_change":"2024-09-12T00:46:03.914760+0000","last_active":"2024-09-12T01:25:39.502266+0000","last_peered":"2024-09-12T01:25:39.502266+0000","last_clean":"2024-09-12T01:25:39.502266+0000","last_became_active":"2024-09-12T00:46:03.914387+0000","last_became_peered":"2024-09-12T00:46:03.914387+0000","last_unstale":"2024-09-12T01:25:39.502266+0000","last_undegraded":"2024-09-12T01:25:39.502266+0000","last_fullsized":"2024-09-12T01:25:39.502266+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:56.621300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:53.499141+0000","last_change":"2024-09-12T01:04:13.470882+0000","last_active":"2024-09-12T01:25:53.499141+0000","last_peered":"2024-09-12T01:25:53.499141+0000","last_clean":"2024-09-12T01:25:53.499141+0000","last_became_active":"2024-09-12T01:04:13.470597+0000","last_became_peered":"2024-09-12T01:04:13.470597+0000","last_unstale":"2024-09-12T01:25:53.499141+0000","last_undegraded":"2024-09-12T01:25:53.499141+0000","last_fullsized":"2024-09-12T01:25:53.499141+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:44.301395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:49.729085+0000","last_change":"2024-09-12T00:48:45.316493+0000","last_active":"2024-09-12T01:26:49.729085+0000","last_peered":"2024-09-12T01:26:49.729085+0000","last_clean":"2024-09-12T01:26:49.729085+0000","last_became_active":"2024-09-12T00:48:45.316182+0000","last_became_peered":"2024-09-12T00:48:45.316182+0000","last_unstale":"2024-09-12T01:26:49.729085+0000","last_undegraded":"2024-09-12T01:26:49.729085+0000","last_fullsized":"2024-09-12T01:26:49.729085+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:51.175017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"265'2","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.724957+0000","last_change":"2024-09-12T00:48:42.294249+0000","last_active":"2024-09-12T01:26:14.724957+0000","last_peered":"2024-09-12T01:26:14.724957+0000","last_clean":"2024-09-12T01:26:14.724957+0000","last_became_active":"2024-09-12T00:48:42.293947+0000","last_became_peered":"2024-09-12T00:48:42.293947+0000","last_unstale":"2024-09-12T01:26:14.724957+0000","last_undegraded":"2024-09-12T01:26:14.724957+0000","last_fullsized":"2024-09-12T01:26:14.724957+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:38.623578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'54","reported_seq":194,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.718948+0000","last_change":"2024-09-12T00:46:03.919567+0000","last_active":"2024-09-12T01:25:39.718948+0000","last_peered":"2024-09-12T01:25:39.718948+0000","last_clean":"2024-09-12T01:25:39.718948+0000","last_became_active":"2024-09-12T00:46:03.919285+0000","last_became_peered":"2024-09-12T00:46:03.919285+0000","last_unstale":"2024-09-12T01:25:39.718948+0000","last_undegraded":"2024-09-12T01:25:39.718948+0000","last_fullsized":"2024-09-12T01:25:39.718948+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:47.685991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":102,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:07.489938+0000","last_change":"2024-09-12T01:04:13.467623+0000","last_active":"2024-09-12T01:25:07.489938+0000","last_peered":"2024-09-12T01:25:07.489938+0000","last_clean":"2024-09-12T01:25:07.489938+0000","last_became_active":"2024-09-12T01:04:13.467374+0000","last_became_peered":"2024-09-12T01:04:13.467374+0000","last_unstale":"2024-09-12T01:25:07.489938+0000","last_undegraded":"2024-09-12T01:25:07.489938+0000","last_fullsized":"2024-09-12T01:25:07.489938+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:34.421544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505968+0000","last_change":"2024-09-12T00:48:45.310759+0000","last_active":"2024-09-12T01:26:14.505968+0000","last_peered":"2024-09-12T01:26:14.505968+0000","last_clean":"2024-09-12T01:26:14.505968+0000","last_became_active":"2024-09-12T00:48:45.310423+0000","last_became_peered":"2024-09-12T00:48:45.310423+0000","last_unstale":"2024-09-12T01:26:14.505968+0000","last_undegraded":"2024-09-12T01:26:14.505968+0000","last_fullsized":"2024-09-12T01:26:14.505968+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:13.622431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639581+0000","last_change":"2024-09-12T00:48:42.296171+0000","last_active":"2024-09-12T01:26:15.639581+0000","last_peered":"2024-09-12T01:26:15.639581+0000","last_clean":"2024-09-12T01:26:15.639581+0000","last_became_active":"2024-09-12T00:48:42.295861+0000","last_became_peered":"2024-09-12T00:48:42.295861+0000","last_unstale":"2024-09-12T01:26:15.639581+0000","last_undegraded":"2024-09-12T01:26:15.639581+0000","last_fullsized":"2024-09-12T01:26:15.639581+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:57.732050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.718904+0000","last_change":"2024-09-12T00:46:03.919535+0000","last_active":"2024-09-12T01:25:39.718904+0000","last_peered":"2024-09-12T01:25:39.718904+0000","last_clean":"2024-09-12T01:25:39.718904+0000","last_became_active":"2024-09-12T00:46:03.917353+0000","last_became_peered":"2024-09-12T00:46:03.917353+0000","last_unstale":"2024-09-12T01:25:39.718904+0000","last_undegraded":"2024-09-12T01:25:39.718904+0000","last_fullsized":"2024-09-12T01:25:39.718904+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:22.130628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":151,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.731874+0000","last_change":"2024-09-12T01:04:13.467110+0000","last_active":"2024-09-12T01:27:09.731874+0000","last_peered":"2024-09-12T01:27:09.731874+0000","last_clean":"2024-09-12T01:27:09.731874+0000","last_became_active":"2024-09-12T01:04:13.466783+0000","last_became_peered":"2024-09-12T01:04:13.466783+0000","last_unstale":"2024-09-12T01:27:09.731874+0000","last_undegraded":"2024-09-12T01:27:09.731874+0000","last_fullsized":"2024-09-12T01:27:09.731874+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:53.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505931+0000","last_change":"2024-09-12T00:48:45.312610+0000","last_active":"2024-09-12T01:26:14.505931+0000","last_peered":"2024-09-12T01:26:14.505931+0000","last_clean":"2024-09-12T01:26:14.505931+0000","last_became_active":"2024-09-12T00:48:45.312329+0000","last_became_peered":"2024-09-12T00:48:45.312329+0000","last_unstale":"2024-09-12T01:26:14.505931+0000","last_undegraded":"2024-09-12T01:26:14.505931+0000","last_fullsized":"2024-09-12T01:26:14.505931+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:29.308504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'1","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.606674+0000","last_change":"2024-09-12T00:48:42.286718+0000","last_active":"2024-09-12T01:26:14.606674+0000","last_peered":"2024-09-12T01:26:14.606674+0000","last_clean":"2024-09-12T01:26:14.606674+0000","last_became_active":"2024-09-12T00:48:42.286427+0000","last_became_peered":"2024-09-12T00:48:42.286427+0000","last_unstale":"2024-09-12T01:26:14.606674+0000","last_undegraded":"2024-09-12T01:26:14.606674+0000","last_fullsized":"2024-09-12T01:26:14.606674+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:46.315650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'46","reported_seq":175,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:19.506448+0000","last_change":"2024-09-12T00:46:03.919531+0000","last_active":"2024-09-12T01:26:19.506448+0000","last_peered":"2024-09-12T01:26:19.506448+0000","last_clean":"2024-09-12T01:26:19.506448+0000","last_became_active":"2024-09-12T00:46:03.919259+0000","last_became_peered":"2024-09-12T00:46:03.919259+0000","last_unstale":"2024-09-12T01:26:19.506448+0000","last_undegraded":"2024-09-12T01:26:19.506448+0000","last_fullsized":"2024-09-12T01:26:19.506448+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:12.310694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":85,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'325","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.379242+0000","last_change":"2024-09-12T00:31:47.138230+0000","last_active":"2024-09-12T01:29:14.379242+0000","last_peered":"2024-09-12T01:29:14.379242+0000","last_clean":"2024-09-12T01:29:14.379242+0000","last_became_active":"2024-09-12T00:31:47.137895+0000","last_became_peered":"2024-09-12T00:31:47.137895+0000","last_unstale":"2024-09-12T01:29:14.379242+0000","last_undegraded":"2024-09-12T01:29:14.379242+0000","last_fullsized":"2024-09-12T01:29:14.379242+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:28.486538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10494761,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":695,"num_read_kb":31522,"num_write":1230,"num_write_kb":24718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'194","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:36.623263+0000","last_change":"2024-09-12T00:31:50.138500+0000","last_active":"2024-09-12T01:26:36.623263+0000","last_peered":"2024-09-12T01:26:36.623263+0000","last_clean":"2024-09-12T01:26:36.623263+0000","last_became_active":"2024-09-12T00:31:50.138226+0000","last_became_peered":"2024-09-12T00:31:50.138226+0000","last_unstale":"2024-09-12T01:26:36.623263+0000","last_undegraded":"2024-09-12T01:26:36.623263+0000","last_fullsized":"2024-09-12T01:26:36.623263+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:11.080078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":913,"num_read_kb":766,"num_write":296,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'253","reported_seq":880,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:37.685001+0000","last_change":"2024-09-12T00:31:47.134970+0000","last_active":"2024-09-12T01:26:37.685001+0000","last_peered":"2024-09-12T01:26:37.685001+0000","last_clean":"2024-09-12T01:26:37.685001+0000","last_became_active":"2024-09-12T00:31:47.134134+0000","last_became_peered":"2024-09-12T00:31:47.134134+0000","last_unstale":"2024-09-12T01:26:37.685001+0000","last_undegraded":"2024-09-12T01:26:37.685001+0000","last_fullsized":"2024-09-12T01:26:37.685001+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:05.214195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10692408,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":402,"num_read_kb":16965,"num_write":957,"num_write_kb":26995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'110","reported_seq":704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.740242+0000","last_change":"2024-09-12T00:31:50.132884+0000","last_active":"2024-09-12T01:25:44.740242+0000","last_peered":"2024-09-12T01:25:44.740242+0000","last_clean":"2024-09-12T01:25:44.740242+0000","last_became_active":"2024-09-12T00:31:50.132639+0000","last_became_peered":"2024-09-12T00:31:50.132639+0000","last_unstale":"2024-09-12T01:25:44.740242+0000","last_undegraded":"2024-09-12T01:25:44.740242+0000","last_fullsized":"2024-09-12T01:25:44.740242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:24.512638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":165,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'310","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:25.656621+0000","last_change":"2024-09-12T00:31:47.120188+0000","last_active":"2024-09-12T01:26:25.656621+0000","last_peered":"2024-09-12T01:26:25.656621+0000","last_clean":"2024-09-12T01:26:25.656621+0000","last_became_active":"2024-09-12T00:31:47.119865+0000","last_became_peered":"2024-09-12T00:31:47.119865+0000","last_unstale":"2024-09-12T01:26:25.656621+0000","last_undegraded":"2024-09-12T01:26:25.656621+0000","last_fullsized":"2024-09-12T01:26:25.656621+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:42.752369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5588563,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":782,"num_read_kb":4429,"num_write":1123,"num_write_kb":10543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'286","reported_seq":935,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:08.062655+0000","last_change":"2024-09-12T00:31:50.135767+0000","last_active":"2024-09-12T01:25:08.062655+0000","last_peered":"2024-09-12T01:25:08.062655+0000","last_clean":"2024-09-12T01:25:08.062655+0000","last_became_active":"2024-09-12T00:31:50.135413+0000","last_became_peered":"2024-09-12T00:31:50.135413+0000","last_unstale":"2024-09-12T01:25:08.062655+0000","last_undegraded":"2024-09-12T01:25:08.062655+0000","last_fullsized":"2024-09-12T01:25:08.062655+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:32.753854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1012,"num_write":455,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'263","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.358786+0000","last_change":"2024-09-12T00:31:47.133763+0000","last_active":"2024-09-12T01:29:14.358786+0000","last_peered":"2024-09-12T01:29:14.358786+0000","last_clean":"2024-09-12T01:29:14.358786+0000","last_became_active":"2024-09-12T00:31:47.133414+0000","last_became_peered":"2024-09-12T00:31:47.133414+0000","last_unstale":"2024-09-12T01:29:14.358786+0000","last_undegraded":"2024-09-12T01:29:14.358786+0000","last_fullsized":"2024-09-12T01:29:14.358786+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:03.831657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17529054,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":413,"num_read_kb":32236,"num_write":1002,"num_write_kb":37937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'183","reported_seq":785,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:17.241665+0000","last_change":"2024-09-12T00:31:50.135590+0000","last_active":"2024-09-12T01:27:17.241665+0000","last_peered":"2024-09-12T01:27:17.241665+0000","last_clean":"2024-09-12T01:27:17.241665+0000","last_became_active":"2024-09-12T00:31:50.135322+0000","last_became_peered":"2024-09-12T00:31:50.135322+0000","last_unstale":"2024-09-12T01:27:17.241665+0000","last_undegraded":"2024-09-12T01:27:17.241665+0000","last_fullsized":"2024-09-12T01:27:17.241665+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.974784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":591,"num_write":296,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'261","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:32.836957+0000","last_change":"2024-09-12T00:31:47.129759+0000","last_active":"2024-09-12T01:26:32.836957+0000","last_peered":"2024-09-12T01:26:32.836957+0000","last_clean":"2024-09-12T01:26:32.836957+0000","last_became_active":"2024-09-12T00:31:47.128016+0000","last_became_peered":"2024-09-12T00:31:47.128016+0000","last_unstale":"2024-09-12T01:26:32.836957+0000","last_undegraded":"2024-09-12T01:26:32.836957+0000","last_fullsized":"2024-09-12T01:26:32.836957+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:57.514060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506790,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":400,"num_read_kb":35042,"num_write":990,"num_write_kb":20184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'220","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.501392+0000","last_change":"2024-09-12T00:31:50.132960+0000","last_active":"2024-09-12T01:25:59.501392+0000","last_peered":"2024-09-12T01:25:59.501392+0000","last_clean":"2024-09-12T01:25:59.501392+0000","last_became_active":"2024-09-12T00:31:50.132674+0000","last_became_peered":"2024-09-12T00:31:50.132674+0000","last_unstale":"2024-09-12T01:25:59.501392+0000","last_undegraded":"2024-09-12T01:25:59.501392+0000","last_fullsized":"2024-09-12T01:25:59.501392+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:49.251283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":967,"num_read_kb":781,"num_write":356,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'300","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:01.812214+0000","last_change":"2024-09-12T00:31:47.135231+0000","last_active":"2024-09-12T01:27:01.812214+0000","last_peered":"2024-09-12T01:27:01.812214+0000","last_clean":"2024-09-12T01:27:01.812214+0000","last_became_active":"2024-09-12T00:31:47.134887+0000","last_became_peered":"2024-09-12T00:31:47.134887+0000","last_unstale":"2024-09-12T01:27:01.812214+0000","last_undegraded":"2024-09-12T01:27:01.812214+0000","last_fullsized":"2024-09-12T01:27:01.812214+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:00.830296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5598308,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":444,"num_read_kb":3274,"num_write":1158,"num_write_kb":38824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'275","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.501413+0000","last_change":"2024-09-12T00:31:50.140357+0000","last_active":"2024-09-12T01:25:59.501413+0000","last_peered":"2024-09-12T01:25:59.501413+0000","last_clean":"2024-09-12T01:25:59.501413+0000","last_became_active":"2024-09-12T00:31:50.140087+0000","last_became_peered":"2024-09-12T00:31:50.140087+0000","last_unstale":"2024-09-12T01:25:59.501413+0000","last_undegraded":"2024-09-12T01:25:59.501413+0000","last_fullsized":"2024-09-12T01:25:59.501413+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:30.983237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1141,"num_read_kb":956,"num_write":415,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'354","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.645896+0000","last_change":"2024-09-12T00:32:23.831062+0000","last_active":"2024-09-12T01:29:15.645896+0000","last_peered":"2024-09-12T01:29:15.645896+0000","last_clean":"2024-09-12T01:29:15.645896+0000","last_became_active":"2024-09-12T00:32:23.830676+0000","last_became_peered":"2024-09-12T00:32:23.830676+0000","last_unstale":"2024-09-12T01:29:15.645896+0000","last_undegraded":"2024-09-12T01:29:15.645896+0000","last_fullsized":"2024-09-12T01:29:15.645896+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:35.456863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8561348,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":531,"num_read_kb":5769,"num_write":1218,"num_write_kb":23845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3e","version":"265'51","reported_seq":590,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:47.570442+0000","last_change":"2024-09-12T00:31:50.140487+0000","last_active":"2024-09-12T01:26:47.570442+0000","last_peered":"2024-09-12T01:26:47.570442+0000","last_clean":"2024-09-12T01:26:47.570442+0000","last_became_active":"2024-09-12T00:31:50.140207+0000","last_became_peered":"2024-09-12T00:31:50.140207+0000","last_unstale":"2024-09-12T01:26:47.570442+0000","last_undegraded":"2024-09-12T01:26:47.570442+0000","last_fullsized":"2024-09-12T01:26:47.570442+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:00.343009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":145,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'326","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:53.274186+0000","last_change":"2024-09-12T00:31:47.128251+0000","last_active":"2024-09-12T01:25:53.274186+0000","last_peered":"2024-09-12T01:25:53.274186+0000","last_clean":"2024-09-12T01:25:53.274186+0000","last_became_active":"2024-09-12T00:31:47.127930+0000","last_became_peered":"2024-09-12T00:31:47.127930+0000","last_unstale":"2024-09-12T01:25:53.274186+0000","last_undegraded":"2024-09-12T01:25:53.274186+0000","last_fullsized":"2024-09-12T01:25:53.274186+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:52.713325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7291840,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":578,"num_read_kb":6944,"num_write":1402,"num_write_kb":29009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'96","reported_seq":688,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498691+0000","last_change":"2024-09-12T00:31:50.142364+0000","last_active":"2024-09-12T01:26:02.498691+0000","last_peered":"2024-09-12T01:26:02.498691+0000","last_clean":"2024-09-12T01:26:02.498691+0000","last_became_active":"2024-09-12T00:31:50.142071+0000","last_became_peered":"2024-09-12T00:31:50.142071+0000","last_unstale":"2024-09-12T01:26:02.498691+0000","last_undegraded":"2024-09-12T01:26:02.498691+0000","last_fullsized":"2024-09-12T01:26:02.498691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:46.856124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":364,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'86","reported_seq":690,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:29.717727+0000","last_change":"2024-09-12T00:31:50.132450+0000","last_active":"2024-09-12T01:25:29.717727+0000","last_peered":"2024-09-12T01:25:29.717727+0000","last_clean":"2024-09-12T01:25:29.717727+0000","last_became_active":"2024-09-12T00:31:50.132178+0000","last_became_peered":"2024-09-12T00:31:50.132178+0000","last_unstale":"2024-09-12T01:25:29.717727+0000","last_undegraded":"2024-09-12T01:25:29.717727+0000","last_fullsized":"2024-09-12T01:25:29.717727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:34.527456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":346,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'277","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:34.516236+0000","last_change":"2024-09-12T00:31:47.124269+0000","last_active":"2024-09-12T01:27:34.516236+0000","last_peered":"2024-09-12T01:27:34.516236+0000","last_clean":"2024-09-12T01:27:34.516236+0000","last_became_active":"2024-09-12T00:31:47.123956+0000","last_became_peered":"2024-09-12T00:31:47.123956+0000","last_unstale":"2024-09-12T01:27:34.516236+0000","last_undegraded":"2024-09-12T01:27:34.516236+0000","last_fullsized":"2024-09-12T01:27:34.516236+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:27.189976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5878961,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":427,"num_read_kb":32458,"num_write":1071,"num_write_kb":22794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'162","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.544138+0000","last_change":"2024-09-12T00:31:50.131280+0000","last_active":"2024-09-12T01:27:47.544138+0000","last_peered":"2024-09-12T01:27:47.544138+0000","last_clean":"2024-09-12T01:27:47.544138+0000","last_became_active":"2024-09-12T00:31:50.130844+0000","last_became_peered":"2024-09-12T00:31:50.130844+0000","last_unstale":"2024-09-12T01:27:47.544138+0000","last_undegraded":"2024-09-12T01:27:47.544138+0000","last_fullsized":"2024-09-12T01:27:47.544138+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:38.260983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":634,"num_write":246,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'208","reported_seq":801,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:25.023002+0000","last_change":"2024-09-12T00:31:47.128649+0000","last_active":"2024-09-12T01:27:25.023002+0000","last_peered":"2024-09-12T01:27:25.023002+0000","last_clean":"2024-09-12T01:27:25.023002+0000","last_became_active":"2024-09-12T00:31:47.127400+0000","last_became_peered":"2024-09-12T00:31:47.127400+0000","last_unstale":"2024-09-12T01:27:25.023002+0000","last_undegraded":"2024-09-12T01:27:25.023002+0000","last_fullsized":"2024-09-12T01:27:25.023002+0000","mapping_epoch":24,"log_start":"265'100","ondisk_log_start":"265'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:24.774467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14792923,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":268,"num_read_kb":20510,"num_write":744,"num_write_kb":47522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'404","reported_seq":1170,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.602445+0000","last_change":"2024-09-12T00:31:50.142651+0000","last_active":"2024-09-12T01:25:34.602445+0000","last_peered":"2024-09-12T01:25:34.602445+0000","last_clean":"2024-09-12T01:25:34.602445+0000","last_became_active":"2024-09-12T00:31:50.142337+0000","last_became_peered":"2024-09-12T00:31:50.142337+0000","last_unstale":"2024-09-12T01:25:34.602445+0000","last_undegraded":"2024-09-12T01:25:34.602445+0000","last_fullsized":"2024-09-12T01:25:34.602445+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.221186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1845,"num_write":683,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'266","reported_seq":882,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:24.510017+0000","last_change":"2024-09-12T00:31:47.139796+0000","last_active":"2024-09-12T01:27:24.510017+0000","last_peered":"2024-09-12T01:27:24.510017+0000","last_clean":"2024-09-12T01:27:24.510017+0000","last_became_active":"2024-09-12T00:31:47.139517+0000","last_became_peered":"2024-09-12T00:31:47.139517+0000","last_unstale":"2024-09-12T01:27:24.510017+0000","last_undegraded":"2024-09-12T01:27:24.510017+0000","last_fullsized":"2024-09-12T01:27:24.510017+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:34.384825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7088137,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":420,"num_read_kb":6586,"num_write":1040,"num_write_kb":25928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'147","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:00.628254+0000","last_change":"2024-09-12T00:31:50.142590+0000","last_active":"2024-09-12T01:25:00.628254+0000","last_peered":"2024-09-12T01:25:00.628254+0000","last_clean":"2024-09-12T01:25:00.628254+0000","last_became_active":"2024-09-12T00:31:50.142311+0000","last_became_peered":"2024-09-12T00:31:50.142311+0000","last_unstale":"2024-09-12T01:25:00.628254+0000","last_undegraded":"2024-09-12T01:25:00.628254+0000","last_fullsized":"2024-09-12T01:25:00.628254+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:15.132325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":237,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'198","reported_seq":818,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:24.509970+0000","last_change":"2024-09-12T00:31:47.130745+0000","last_active":"2024-09-12T01:27:24.509970+0000","last_peered":"2024-09-12T01:27:24.509970+0000","last_clean":"2024-09-12T01:27:24.509970+0000","last_became_active":"2024-09-12T00:31:47.130329+0000","last_became_peered":"2024-09-12T00:31:47.130329+0000","last_unstale":"2024-09-12T01:27:24.509970+0000","last_undegraded":"2024-09-12T01:27:24.509970+0000","last_fullsized":"2024-09-12T01:27:24.509970+0000","mapping_epoch":24,"log_start":"265'100","ondisk_log_start":"265'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:26.579124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18157375,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":334,"num_read_kb":37642,"num_write":701,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'112","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:33.595038+0000","last_change":"2024-09-12T00:31:50.136264+0000","last_active":"2024-09-12T01:26:33.595038+0000","last_peered":"2024-09-12T01:26:33.595038+0000","last_clean":"2024-09-12T01:26:33.595038+0000","last_became_active":"2024-09-12T00:31:50.135595+0000","last_became_peered":"2024-09-12T00:31:50.135595+0000","last_unstale":"2024-09-12T01:26:33.595038+0000","last_undegraded":"2024-09-12T01:26:33.595038+0000","last_fullsized":"2024-09-12T01:26:33.595038+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:16.754941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":410,"num_write":180,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'294","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.637796+0000","last_change":"2024-09-12T00:31:47.133955+0000","last_active":"2024-09-12T01:29:15.637796+0000","last_peered":"2024-09-12T01:29:15.637796+0000","last_clean":"2024-09-12T01:29:15.637796+0000","last_became_active":"2024-09-12T00:31:47.133592+0000","last_became_peered":"2024-09-12T00:31:47.133592+0000","last_unstale":"2024-09-12T01:29:15.637796+0000","last_undegraded":"2024-09-12T01:29:15.637796+0000","last_fullsized":"2024-09-12T01:29:15.637796+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:40.772744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1790643,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":759,"num_read_kb":29951,"num_write":1057,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'73","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.598762+0000","last_change":"2024-09-12T00:31:50.136540+0000","last_active":"2024-09-12T01:24:59.598762+0000","last_peered":"2024-09-12T01:24:59.598762+0000","last_clean":"2024-09-12T01:24:59.598762+0000","last_became_active":"2024-09-12T00:31:50.135972+0000","last_became_peered":"2024-09-12T00:31:50.135972+0000","last_unstale":"2024-09-12T01:24:59.598762+0000","last_undegraded":"2024-09-12T01:24:59.598762+0000","last_fullsized":"2024-09-12T01:24:59.598762+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:26.791352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":249,"num_write":116,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'286","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.618013+0000","last_change":"2024-09-12T00:31:47.118600+0000","last_active":"2024-09-12T01:29:15.618013+0000","last_peered":"2024-09-12T01:29:15.618013+0000","last_clean":"2024-09-12T01:29:15.618013+0000","last_became_active":"2024-09-12T00:31:47.118260+0000","last_became_peered":"2024-09-12T00:31:47.118260+0000","last_unstale":"2024-09-12T01:29:15.618013+0000","last_undegraded":"2024-09-12T01:29:15.618013+0000","last_fullsized":"2024-09-12T01:29:15.618013+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:15.699024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244189,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":420,"num_read_kb":15045,"num_write":955,"num_write_kb":26498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'123","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.422976+0000","last_change":"2024-09-12T00:31:58.184465+0000","last_active":"2024-09-12T01:27:48.422976+0000","last_peered":"2024-09-12T01:27:48.422976+0000","last_clean":"2024-09-12T01:27:48.422976+0000","last_became_active":"2024-09-12T00:31:58.183784+0000","last_became_peered":"2024-09-12T00:31:58.183784+0000","last_unstale":"2024-09-12T01:27:48.422976+0000","last_undegraded":"2024-09-12T01:27:48.422976+0000","last_fullsized":"2024-09-12T01:27:48.422976+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:03.783137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":134,"num_write":297,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'229","reported_seq":832,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:53.682612+0000","last_change":"2024-09-12T00:31:50.140765+0000","last_active":"2024-09-12T01:25:53.682612+0000","last_peered":"2024-09-12T01:25:53.682612+0000","last_clean":"2024-09-12T01:25:53.682612+0000","last_became_active":"2024-09-12T00:31:50.140510+0000","last_became_peered":"2024-09-12T00:31:50.140510+0000","last_unstale":"2024-09-12T01:25:53.682612+0000","last_undegraded":"2024-09-12T01:25:53.682612+0000","last_fullsized":"2024-09-12T01:25:53.682612+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:35.280733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":944,"num_read_kb":762,"num_write":358,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'276","reported_seq":888,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.724174+0000","last_change":"2024-09-12T00:31:47.132262+0000","last_active":"2024-09-12T01:29:14.724174+0000","last_peered":"2024-09-12T01:29:14.724174+0000","last_clean":"2024-09-12T01:29:14.724174+0000","last_became_active":"2024-09-12T00:31:47.131940+0000","last_became_peered":"2024-09-12T00:31:47.131940+0000","last_unstale":"2024-09-12T01:29:14.724174+0000","last_undegraded":"2024-09-12T01:29:14.724174+0000","last_fullsized":"2024-09-12T01:29:14.724174+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:02.642276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243583,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":409,"num_read_kb":415,"num_write":1007,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714895+0000","last_change":"2024-09-12T00:31:52.153386+0000","last_active":"2024-09-12T01:25:04.714895+0000","last_peered":"2024-09-12T01:25:04.714895+0000","last_clean":"2024-09-12T01:25:04.714895+0000","last_became_active":"2024-09-12T00:31:52.151351+0000","last_became_peered":"2024-09-12T00:31:52.151351+0000","last_unstale":"2024-09-12T01:25:04.714895+0000","last_undegraded":"2024-09-12T01:25:04.714895+0000","last_fullsized":"2024-09-12T01:25:04.714895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.711260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'336","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.322764+0000","last_change":"2024-09-12T00:31:54.168796+0000","last_active":"2024-09-12T01:27:48.322764+0000","last_peered":"2024-09-12T01:27:48.322764+0000","last_clean":"2024-09-12T01:27:48.322764+0000","last_became_active":"2024-09-12T00:31:54.168545+0000","last_became_peered":"2024-09-12T00:31:54.168545+0000","last_unstale":"2024-09-12T01:27:48.322764+0000","last_undegraded":"2024-09-12T01:27:48.322764+0000","last_fullsized":"2024-09-12T01:27:48.322764+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:43.289137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51574,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":533,"num_read_kb":986,"num_write":420,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:09.599902+0000","last_change":"2024-09-12T00:31:56.171140+0000","last_active":"2024-09-12T01:25:09.599902+0000","last_peered":"2024-09-12T01:25:09.599902+0000","last_clean":"2024-09-12T01:25:09.599902+0000","last_became_active":"2024-09-12T00:31:56.170837+0000","last_became_peered":"2024-09-12T00:31:56.170837+0000","last_unstale":"2024-09-12T01:25:09.599902+0000","last_undegraded":"2024-09-12T01:25:09.599902+0000","last_fullsized":"2024-09-12T01:25:09.599902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:56.785552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2464","reported_seq":4352,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.990962+0000","last_change":"2024-09-12T00:31:58.182713+0000","last_active":"2024-09-12T01:27:47.990962+0000","last_peered":"2024-09-12T01:27:47.990962+0000","last_clean":"2024-09-12T01:27:47.990962+0000","last_became_active":"2024-09-12T00:31:58.181552+0000","last_became_peered":"2024-09-12T00:31:58.181552+0000","last_unstale":"2024-09-12T01:27:47.990962+0000","last_undegraded":"2024-09-12T01:27:47.990962+0000","last_fullsized":"2024-09-12T01:27:47.990962+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":2400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:59.050279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":617,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6112,"num_read_kb":6115,"num_write":4931,"num_write_kb":1807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'4138","reported_seq":4750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:22.543653+0000","last_change":"2024-09-12T00:31:50.133655+0000","last_active":"2024-09-12T01:25:22.543653+0000","last_peered":"2024-09-12T01:25:22.543653+0000","last_clean":"2024-09-12T01:25:22.543653+0000","last_became_active":"2024-09-12T00:31:50.133357+0000","last_became_peered":"2024-09-12T00:31:50.133357+0000","last_unstale":"2024-09-12T01:25:22.543653+0000","last_undegraded":"2024-09-12T01:25:22.543653+0000","last_fullsized":"2024-09-12T01:25:22.543653+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":3000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:23.138805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16657,"num_read_kb":13895,"num_write":6209,"num_write_kb":3095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'271","reported_seq":878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.596431+0000","last_change":"2024-09-12T00:31:47.132203+0000","last_active":"2024-09-12T01:29:15.596431+0000","last_peered":"2024-09-12T01:29:15.596431+0000","last_clean":"2024-09-12T01:29:15.596431+0000","last_became_active":"2024-09-12T00:31:47.131849+0000","last_became_peered":"2024-09-12T00:31:47.131849+0000","last_unstale":"2024-09-12T01:29:15.596431+0000","last_undegraded":"2024-09-12T01:29:15.596431+0000","last_fullsized":"2024-09-12T01:29:15.596431+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:09.334142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244035,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":380,"num_read_kb":4533,"num_write":921,"num_write_kb":25027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:48.498477+0000","last_change":"2024-09-12T00:31:52.153157+0000","last_active":"2024-09-12T01:25:48.498477+0000","last_peered":"2024-09-12T01:25:48.498477+0000","last_clean":"2024-09-12T01:25:48.498477+0000","last_became_active":"2024-09-12T00:31:52.152244+0000","last_became_peered":"2024-09-12T00:31:52.152244+0000","last_unstale":"2024-09-12T01:25:48.498477+0000","last_undegraded":"2024-09-12T01:25:48.498477+0000","last_fullsized":"2024-09-12T01:25:48.498477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:13.492533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'94","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.599360+0000","last_change":"2024-09-12T00:31:54.167561+0000","last_active":"2024-09-12T01:25:04.599360+0000","last_peered":"2024-09-12T01:25:04.599360+0000","last_clean":"2024-09-12T01:25:04.599360+0000","last_became_active":"2024-09-12T00:31:54.167260+0000","last_became_peered":"2024-09-12T00:31:54.167260+0000","last_unstale":"2024-09-12T01:25:04.599360+0000","last_undegraded":"2024-09-12T01:25:04.599360+0000","last_fullsized":"2024-09-12T01:25:04.599360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:28.995792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":103,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:09.599867+0000","last_change":"2024-09-12T00:31:56.174756+0000","last_active":"2024-09-12T01:25:09.599867+0000","last_peered":"2024-09-12T01:25:09.599867+0000","last_clean":"2024-09-12T01:25:09.599867+0000","last_became_active":"2024-09-12T00:31:56.174452+0000","last_became_peered":"2024-09-12T00:31:56.174452+0000","last_unstale":"2024-09-12T01:25:09.599867+0000","last_undegraded":"2024-09-12T01:25:09.599867+0000","last_fullsized":"2024-09-12T01:25:09.599867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:05.497151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'144","reported_seq":638,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646008+0000","last_change":"2024-09-12T00:31:58.179079+0000","last_active":"2024-09-12T01:27:00.646008+0000","last_peered":"2024-09-12T01:27:00.646008+0000","last_clean":"2024-09-12T01:27:00.646008+0000","last_became_active":"2024-09-12T00:31:58.178748+0000","last_became_peered":"2024-09-12T00:31:58.178748+0000","last_unstale":"2024-09-12T01:27:00.646008+0000","last_undegraded":"2024-09-12T01:27:00.646008+0000","last_fullsized":"2024-09-12T01:27:00.646008+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:32.414870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":137,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'401","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:02.489318+0000","last_change":"2024-09-12T00:31:50.143909+0000","last_active":"2024-09-12T01:25:02.489318+0000","last_peered":"2024-09-12T01:25:02.489318+0000","last_clean":"2024-09-12T01:25:02.489318+0000","last_became_active":"2024-09-12T00:31:50.143399+0000","last_became_peered":"2024-09-12T00:31:50.143399+0000","last_unstale":"2024-09-12T01:25:02.489318+0000","last_undegraded":"2024-09-12T01:25:02.489318+0000","last_fullsized":"2024-09-12T01:25:02.489318+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:22.288197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1799,"num_read_kb":1492,"num_write":673,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'310","reported_seq":1090,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.597359+0000","last_change":"2024-09-12T00:32:23.831526+0000","last_active":"2024-09-12T01:29:15.597359+0000","last_peered":"2024-09-12T01:29:15.597359+0000","last_clean":"2024-09-12T01:29:15.597359+0000","last_became_active":"2024-09-12T00:32:23.830863+0000","last_became_peered":"2024-09-12T00:32:23.830863+0000","last_unstale":"2024-09-12T01:29:15.597359+0000","last_undegraded":"2024-09-12T01:29:15.597359+0000","last_fullsized":"2024-09-12T01:29:15.597359+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569571,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":845,"num_read_kb":9184,"num_write":1014,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:03.492033+0000","last_change":"2024-09-12T00:31:52.154402+0000","last_active":"2024-09-12T01:25:03.492033+0000","last_peered":"2024-09-12T01:25:03.492033+0000","last_clean":"2024-09-12T01:25:03.492033+0000","last_became_active":"2024-09-12T00:31:52.154077+0000","last_became_peered":"2024-09-12T00:31:52.154077+0000","last_unstale":"2024-09-12T01:25:03.492033+0000","last_undegraded":"2024-09-12T01:25:03.492033+0000","last_fullsized":"2024-09-12T01:25:03.492033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:27.520584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'119","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:48.498488+0000","last_change":"2024-09-12T00:31:54.164132+0000","last_active":"2024-09-12T01:25:48.498488+0000","last_peered":"2024-09-12T01:25:48.498488+0000","last_clean":"2024-09-12T01:25:48.498488+0000","last_became_active":"2024-09-12T00:31:54.163434+0000","last_became_peered":"2024-09-12T00:31:54.163434+0000","last_unstale":"2024-09-12T01:25:48.498488+0000","last_undegraded":"2024-09-12T01:25:48.498488+0000","last_fullsized":"2024-09-12T01:25:48.498488+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:14.391704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":152,"num_read_kb":145,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'781","reported_seq":4219,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.295304+0000","last_change":"2024-09-12T00:31:56.171437+0000","last_active":"2024-09-12T01:29:14.295304+0000","last_peered":"2024-09-12T01:29:14.295304+0000","last_clean":"2024-09-12T01:29:14.295304+0000","last_became_active":"2024-09-12T00:31:56.171157+0000","last_became_peered":"2024-09-12T00:31:56.171157+0000","last_unstale":"2024-09-12T01:29:14.295304+0000","last_undegraded":"2024-09-12T01:29:14.295304+0000","last_fullsized":"2024-09-12T01:29:14.295304+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:03.870161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'201","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.663408+0000","last_change":"2024-09-12T00:31:58.179919+0000","last_active":"2024-09-12T01:27:47.663408+0000","last_peered":"2024-09-12T01:27:47.663408+0000","last_clean":"2024-09-12T01:27:47.663408+0000","last_became_active":"2024-09-12T00:31:58.179576+0000","last_became_peered":"2024-09-12T00:31:58.179576+0000","last_unstale":"2024-09-12T01:27:47.663408+0000","last_undegraded":"2024-09-12T01:27:47.663408+0000","last_fullsized":"2024-09-12T01:27:47.663408+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:00.446809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":631,"num_write":454,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'417","reported_seq":1156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:25.005608+0000","last_change":"2024-09-12T00:31:50.140975+0000","last_active":"2024-09-12T01:27:25.005608+0000","last_peered":"2024-09-12T01:27:25.005608+0000","last_clean":"2024-09-12T01:27:25.005608+0000","last_became_active":"2024-09-12T00:31:50.140485+0000","last_became_peered":"2024-09-12T00:31:50.140485+0000","last_unstale":"2024-09-12T01:27:25.005608+0000","last_undegraded":"2024-09-12T01:27:25.005608+0000","last_fullsized":"2024-09-12T01:27:25.005608+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:37.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2003,"num_read_kb":1658,"num_write":744,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'255","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.354425+0000","last_change":"2024-09-12T00:31:47.125806+0000","last_active":"2024-09-12T01:29:14.354425+0000","last_peered":"2024-09-12T01:29:14.354425+0000","last_clean":"2024-09-12T01:29:14.354425+0000","last_became_active":"2024-09-12T00:31:47.125118+0000","last_became_peered":"2024-09-12T00:31:47.125118+0000","last_unstale":"2024-09-12T01:29:14.354425+0000","last_undegraded":"2024-09-12T01:29:14.354425+0000","last_fullsized":"2024-09-12T01:29:14.354425+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:30.278130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6598689,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":470,"num_read_kb":32878,"num_write":1012,"num_write_kb":23042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714949+0000","last_change":"2024-09-12T00:31:52.154490+0000","last_active":"2024-09-12T01:25:04.714949+0000","last_peered":"2024-09-12T01:25:04.714949+0000","last_clean":"2024-09-12T01:25:04.714949+0000","last_became_active":"2024-09-12T00:31:52.154189+0000","last_became_peered":"2024-09-12T00:31:52.154189+0000","last_unstale":"2024-09-12T01:25:04.714949+0000","last_undegraded":"2024-09-12T01:25:04.714949+0000","last_fullsized":"2024-09-12T01:25:04.714949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:46.021304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'272","reported_seq":841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.320951+0000","last_change":"2024-09-12T00:31:54.171678+0000","last_active":"2024-09-12T01:28:55.320951+0000","last_peered":"2024-09-12T01:28:55.320951+0000","last_clean":"2024-09-12T01:28:55.320951+0000","last_became_active":"2024-09-12T00:31:54.171354+0000","last_became_peered":"2024-09-12T00:31:54.171354+0000","last_unstale":"2024-09-12T01:28:55.320951+0000","last_undegraded":"2024-09-12T01:28:55.320951+0000","last_fullsized":"2024-09-12T01:28:55.320951+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:44.212575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63397,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":941,"num_write":366,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'780","reported_seq":2504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.362498+0000","last_change":"2024-09-12T00:31:56.176843+0000","last_active":"2024-09-12T01:28:55.362498+0000","last_peered":"2024-09-12T01:28:55.362498+0000","last_clean":"2024-09-12T01:28:55.362498+0000","last_became_active":"2024-09-12T00:31:56.176464+0000","last_became_peered":"2024-09-12T00:31:56.176464+0000","last_unstale":"2024-09-12T01:28:55.362498+0000","last_undegraded":"2024-09-12T01:28:55.362498+0000","last_fullsized":"2024-09-12T01:28:55.362498+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:39.501516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'324","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.722779+0000","last_change":"2024-09-12T00:31:50.138593+0000","last_active":"2024-09-12T01:25:59.722779+0000","last_peered":"2024-09-12T01:25:59.722779+0000","last_clean":"2024-09-12T01:25:59.722779+0000","last_became_active":"2024-09-12T00:31:50.138335+0000","last_became_peered":"2024-09-12T00:31:50.138335+0000","last_unstale":"2024-09-12T01:25:59.722779+0000","last_undegraded":"2024-09-12T01:25:59.722779+0000","last_fullsized":"2024-09-12T01:25:59.722779+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:08.736816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1108,"num_write":487,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'274","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.355892+0000","last_change":"2024-09-12T00:31:47.138476+0000","last_active":"2024-09-12T01:29:14.355892+0000","last_peered":"2024-09-12T01:29:14.355892+0000","last_clean":"2024-09-12T01:29:14.355892+0000","last_became_active":"2024-09-12T00:31:47.137951+0000","last_became_peered":"2024-09-12T00:31:47.137951+0000","last_unstale":"2024-09-12T01:29:14.355892+0000","last_undegraded":"2024-09-12T01:29:14.355892+0000","last_fullsized":"2024-09-12T01:29:14.355892+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:13.403628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7500437,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":415,"num_read_kb":21456,"num_write":1042,"num_write_kb":35236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605639+0000","last_change":"2024-09-12T00:31:52.155328+0000","last_active":"2024-09-12T01:26:04.605639+0000","last_peered":"2024-09-12T01:26:04.605639+0000","last_clean":"2024-09-12T01:26:04.605639+0000","last_became_active":"2024-09-12T00:31:52.155047+0000","last_became_peered":"2024-09-12T00:31:52.155047+0000","last_unstale":"2024-09-12T01:26:04.605639+0000","last_undegraded":"2024-09-12T01:26:04.605639+0000","last_fullsized":"2024-09-12T01:26:04.605639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:16.230836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'364","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.346006+0000","last_change":"2024-09-12T00:31:54.173591+0000","last_active":"2024-09-12T01:29:14.346006+0000","last_peered":"2024-09-12T01:29:14.346006+0000","last_clean":"2024-09-12T01:29:14.346006+0000","last_became_active":"2024-09-12T00:31:54.173363+0000","last_became_peered":"2024-09-12T00:31:54.173363+0000","last_unstale":"2024-09-12T01:29:14.346006+0000","last_undegraded":"2024-09-12T01:29:14.346006+0000","last_fullsized":"2024-09-12T01:29:14.346006+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:50.016365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53603,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":577,"num_read_kb":1083,"num_write":449,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.636308+0000","last_change":"2024-09-12T00:31:56.173079+0000","last_active":"2024-09-12T01:25:55.636308+0000","last_peered":"2024-09-12T01:25:55.636308+0000","last_clean":"2024-09-12T01:25:55.636308+0000","last_became_active":"2024-09-12T00:31:56.172791+0000","last_became_peered":"2024-09-12T00:31:56.172791+0000","last_unstale":"2024-09-12T01:25:55.636308+0000","last_undegraded":"2024-09-12T01:25:55.636308+0000","last_fullsized":"2024-09-12T01:25:55.636308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:18.460860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'542","reported_seq":1367,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.343041+0000","last_change":"2024-09-12T00:31:58.178597+0000","last_active":"2024-09-12T01:28:55.343041+0000","last_peered":"2024-09-12T01:28:55.343041+0000","last_clean":"2024-09-12T01:28:55.343041+0000","last_became_active":"2024-09-12T00:31:58.177828+0000","last_became_peered":"2024-09-12T00:31:58.177828+0000","last_unstale":"2024-09-12T01:28:55.343041+0000","last_undegraded":"2024-09-12T01:28:55.343041+0000","last_fullsized":"2024-09-12T01:28:55.343041+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:23.485365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1309,"num_read_kb":1288,"num_write":1113,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'199","reported_seq":826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.412983+0000","last_change":"2024-09-12T00:31:50.138558+0000","last_active":"2024-09-12T01:27:00.412983+0000","last_peered":"2024-09-12T01:27:00.412983+0000","last_clean":"2024-09-12T01:27:00.412983+0000","last_became_active":"2024-09-12T00:31:50.138261+0000","last_became_peered":"2024-09-12T00:31:50.138261+0000","last_unstale":"2024-09-12T01:27:00.412983+0000","last_undegraded":"2024-09-12T01:27:00.412983+0000","last_fullsized":"2024-09-12T01:27:00.412983+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:25.679935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":866,"num_read_kb":707,"num_write":323,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'322","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.517321+0000","last_change":"2024-09-12T00:31:47.137585+0000","last_active":"2024-09-12T01:28:04.517321+0000","last_peered":"2024-09-12T01:28:04.517321+0000","last_clean":"2024-09-12T01:28:04.517321+0000","last_became_active":"2024-09-12T00:31:47.137234+0000","last_became_peered":"2024-09-12T00:31:47.137234+0000","last_unstale":"2024-09-12T01:28:04.517321+0000","last_undegraded":"2024-09-12T01:28:04.517321+0000","last_fullsized":"2024-09-12T01:28:04.517321+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:35.306270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2307306,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":654,"num_read_kb":90780,"num_write":1215,"num_write_kb":21068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.637884+0000","last_change":"2024-09-12T00:31:52.148985+0000","last_active":"2024-09-12T01:26:05.637884+0000","last_peered":"2024-09-12T01:26:05.637884+0000","last_clean":"2024-09-12T01:26:05.637884+0000","last_became_active":"2024-09-12T00:31:52.148738+0000","last_became_peered":"2024-09-12T00:31:52.148738+0000","last_unstale":"2024-09-12T01:26:05.637884+0000","last_undegraded":"2024-09-12T01:26:05.637884+0000","last_fullsized":"2024-09-12T01:26:05.637884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:20.806375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'280","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:08.518925+0000","last_change":"2024-09-12T00:31:54.168598+0000","last_active":"2024-09-12T01:28:08.518925+0000","last_peered":"2024-09-12T01:28:08.518925+0000","last_clean":"2024-09-12T01:28:08.518925+0000","last_became_active":"2024-09-12T00:31:54.168247+0000","last_became_peered":"2024-09-12T00:31:54.168247+0000","last_unstale":"2024-09-12T01:28:08.518925+0000","last_undegraded":"2024-09-12T01:28:08.518925+0000","last_fullsized":"2024-09-12T01:28:08.518925+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:53.709459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58827,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":962,"num_write":376,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:23.503173+0000","last_change":"2024-09-12T00:31:56.173852+0000","last_active":"2024-09-12T01:26:23.503173+0000","last_peered":"2024-09-12T01:26:23.503173+0000","last_clean":"2024-09-12T01:26:23.503173+0000","last_became_active":"2024-09-12T00:31:56.173549+0000","last_became_peered":"2024-09-12T00:31:56.173549+0000","last_unstale":"2024-09-12T01:26:23.503173+0000","last_undegraded":"2024-09-12T01:26:23.503173+0000","last_fullsized":"2024-09-12T01:26:23.503173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:31.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'131","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:24.521745+0000","last_change":"2024-09-12T00:31:58.175490+0000","last_active":"2024-09-12T01:28:24.521745+0000","last_peered":"2024-09-12T01:28:24.521745+0000","last_clean":"2024-09-12T01:28:24.521745+0000","last_became_active":"2024-09-12T00:31:58.175195+0000","last_became_peered":"2024-09-12T00:31:58.175195+0000","last_unstale":"2024-09-12T01:28:24.521745+0000","last_undegraded":"2024-09-12T01:28:24.521745+0000","last_fullsized":"2024-09-12T01:28:24.521745+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:18.942923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":426,"num_read_kb":345,"num_write":330,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'360","reported_seq":951,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505956+0000","last_change":"2024-09-12T00:31:50.143092+0000","last_active":"2024-09-12T01:26:14.505956+0000","last_peered":"2024-09-12T01:26:14.505956+0000","last_clean":"2024-09-12T01:26:14.505956+0000","last_became_active":"2024-09-12T00:31:50.142818+0000","last_became_peered":"2024-09-12T00:31:50.142818+0000","last_unstale":"2024-09-12T01:26:14.505956+0000","last_undegraded":"2024-09-12T01:26:14.505956+0000","last_fullsized":"2024-09-12T01:26:14.505956+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:29.886696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1555,"num_read_kb":1227,"num_write":605,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'268","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.689763+0000","last_change":"2024-09-12T00:31:47.113555+0000","last_active":"2024-09-12T01:29:14.689763+0000","last_peered":"2024-09-12T01:29:14.689763+0000","last_clean":"2024-09-12T01:29:14.689763+0000","last_became_active":"2024-09-12T00:31:47.112306+0000","last_became_peered":"2024-09-12T00:31:47.112306+0000","last_unstale":"2024-09-12T01:29:14.689763+0000","last_undegraded":"2024-09-12T01:29:14.689763+0000","last_fullsized":"2024-09-12T01:29:14.689763+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:25.942485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8409984,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":393,"num_read_kb":55420,"num_write":994,"num_write_kb":24613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:52.497023+0000","last_change":"2024-09-12T00:31:52.154154+0000","last_active":"2024-09-12T01:25:52.497023+0000","last_peered":"2024-09-12T01:25:52.497023+0000","last_clean":"2024-09-12T01:25:52.497023+0000","last_became_active":"2024-09-12T00:31:52.153862+0000","last_became_peered":"2024-09-12T00:31:52.153862+0000","last_unstale":"2024-09-12T01:25:52.497023+0000","last_undegraded":"2024-09-12T01:25:52.497023+0000","last_fullsized":"2024-09-12T01:25:52.497023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:25.663441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'358","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.726954+0000","last_change":"2024-09-12T00:31:54.162856+0000","last_active":"2024-09-12T01:29:14.726954+0000","last_peered":"2024-09-12T01:29:14.726954+0000","last_clean":"2024-09-12T01:29:14.726954+0000","last_became_active":"2024-09-12T00:31:54.162228+0000","last_became_peered":"2024-09-12T00:31:54.162228+0000","last_unstale":"2024-09-12T01:29:14.726954+0000","last_undegraded":"2024-09-12T01:29:14.726954+0000","last_fullsized":"2024-09-12T01:29:14.726954+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:20.520023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50365,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":550,"num_read_kb":1150,"num_write":448,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'779","reported_seq":2595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.363532+0000","last_change":"2024-09-12T00:31:56.172797+0000","last_active":"2024-09-12T01:28:55.363532+0000","last_peered":"2024-09-12T01:28:55.363532+0000","last_clean":"2024-09-12T01:28:55.363532+0000","last_became_active":"2024-09-12T00:31:56.172503+0000","last_became_peered":"2024-09-12T00:31:56.172503+0000","last_unstale":"2024-09-12T01:28:55.363532+0000","last_undegraded":"2024-09-12T01:28:55.363532+0000","last_fullsized":"2024-09-12T01:28:55.363532+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:50.107192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'148","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.305098+0000","last_change":"2024-09-12T00:31:58.175440+0000","last_active":"2024-09-12T01:28:54.305098+0000","last_peered":"2024-09-12T01:28:54.305098+0000","last_clean":"2024-09-12T01:28:54.305098+0000","last_became_active":"2024-09-12T00:31:58.175027+0000","last_became_peered":"2024-09-12T00:31:58.175027+0000","last_unstale":"2024-09-12T01:28:54.305098+0000","last_undegraded":"2024-09-12T01:28:54.305098+0000","last_fullsized":"2024-09-12T01:28:54.305098+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:26.724138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":179,"num_read_kb":162,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'330","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:52.496996+0000","last_change":"2024-09-12T00:31:50.144275+0000","last_active":"2024-09-12T01:25:52.496996+0000","last_peered":"2024-09-12T01:25:52.496996+0000","last_clean":"2024-09-12T01:25:52.496996+0000","last_became_active":"2024-09-12T00:31:50.143814+0000","last_became_peered":"2024-09-12T00:31:50.143814+0000","last_unstale":"2024-09-12T01:25:52.496996+0000","last_undegraded":"2024-09-12T01:25:52.496996+0000","last_fullsized":"2024-09-12T01:25:52.496996+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:41.133905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1421,"num_read_kb":1140,"num_write":511,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'312","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:49.395214+0000","last_change":"2024-09-12T00:31:47.139001+0000","last_active":"2024-09-12T01:28:49.395214+0000","last_peered":"2024-09-12T01:28:49.395214+0000","last_clean":"2024-09-12T01:28:49.395214+0000","last_became_active":"2024-09-12T00:31:47.138687+0000","last_became_peered":"2024-09-12T00:31:47.138687+0000","last_unstale":"2024-09-12T01:28:49.395214+0000","last_undegraded":"2024-09-12T01:28:49.395214+0000","last_fullsized":"2024-09-12T01:28:49.395214+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:39.040881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927828,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":504,"num_read_kb":39444,"num_write":1135,"num_write_kb":53128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639608+0000","last_change":"2024-09-12T00:31:52.155135+0000","last_active":"2024-09-12T01:26:15.639608+0000","last_peered":"2024-09-12T01:26:15.639608+0000","last_clean":"2024-09-12T01:26:15.639608+0000","last_became_active":"2024-09-12T00:31:52.154863+0000","last_became_peered":"2024-09-12T00:31:52.154863+0000","last_unstale":"2024-09-12T01:26:15.639608+0000","last_undegraded":"2024-09-12T01:26:15.639608+0000","last_fullsized":"2024-09-12T01:26:15.639608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:40.280300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'502","reported_seq":1145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.312525+0000","last_change":"2024-09-12T00:31:54.169066+0000","last_active":"2024-09-12T01:28:55.312525+0000","last_peered":"2024-09-12T01:28:55.312525+0000","last_clean":"2024-09-12T01:28:55.312525+0000","last_became_active":"2024-09-12T00:31:54.168691+0000","last_became_peered":"2024-09-12T00:31:54.168691+0000","last_unstale":"2024-09-12T01:28:55.312525+0000","last_undegraded":"2024-09-12T01:28:55.312525+0000","last_fullsized":"2024-09-12T01:28:55.312525+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:06.873573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130121,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":883,"num_read_kb":1929,"num_write":742,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499328+0000","last_change":"2024-09-12T00:31:56.175805+0000","last_active":"2024-09-12T01:26:07.499328+0000","last_peered":"2024-09-12T01:26:07.499328+0000","last_clean":"2024-09-12T01:26:07.499328+0000","last_became_active":"2024-09-12T00:31:56.175412+0000","last_became_peered":"2024-09-12T00:31:56.175412+0000","last_unstale":"2024-09-12T01:26:07.499328+0000","last_undegraded":"2024-09-12T01:26:07.499328+0000","last_fullsized":"2024-09-12T01:26:07.499328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:32.829417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'133","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:10.783574+0000","last_change":"2024-09-12T00:31:58.178548+0000","last_active":"2024-09-12T01:26:10.783574+0000","last_peered":"2024-09-12T01:26:10.783574+0000","last_clean":"2024-09-12T01:26:10.783574+0000","last_became_active":"2024-09-12T00:31:58.178027+0000","last_became_peered":"2024-09-12T00:31:58.178027+0000","last_unstale":"2024-09-12T01:26:10.783574+0000","last_undegraded":"2024-09-12T01:26:10.783574+0000","last_fullsized":"2024-09-12T01:26:10.783574+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.407511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'162","reported_seq":791,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.500388+0000","last_change":"2024-09-12T00:31:50.127506+0000","last_active":"2024-09-12T01:25:49.500388+0000","last_peered":"2024-09-12T01:25:49.500388+0000","last_clean":"2024-09-12T01:25:49.500388+0000","last_became_active":"2024-09-12T00:31:50.127193+0000","last_became_peered":"2024-09-12T00:31:50.127193+0000","last_unstale":"2024-09-12T01:25:49.500388+0000","last_undegraded":"2024-09-12T01:25:49.500388+0000","last_fullsized":"2024-09-12T01:25:49.500388+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:52.691594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":547,"num_write":243,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'311","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.633333+0000","last_change":"2024-09-12T00:31:47.130530+0000","last_active":"2024-09-12T01:29:15.633333+0000","last_peered":"2024-09-12T01:29:15.633333+0000","last_clean":"2024-09-12T01:29:15.633333+0000","last_became_active":"2024-09-12T00:31:47.130136+0000","last_became_peered":"2024-09-12T00:31:47.130136+0000","last_unstale":"2024-09-12T01:29:15.633333+0000","last_undegraded":"2024-09-12T01:29:15.633333+0000","last_fullsized":"2024-09-12T01:29:15.633333+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:35.574448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263466,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":489,"num_read_kb":72156,"num_write":1129,"num_write_kb":60123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.781057+0000","last_change":"2024-09-12T00:31:52.155387+0000","last_active":"2024-09-12T01:25:55.781057+0000","last_peered":"2024-09-12T01:25:55.781057+0000","last_clean":"2024-09-12T01:25:55.781057+0000","last_became_active":"2024-09-12T00:31:52.155083+0000","last_became_peered":"2024-09-12T00:31:52.155083+0000","last_unstale":"2024-09-12T01:25:55.781057+0000","last_undegraded":"2024-09-12T01:25:55.781057+0000","last_fullsized":"2024-09-12T01:25:55.781057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:51.358822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'319","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.314003+0000","last_change":"2024-09-12T00:31:54.165545+0000","last_active":"2024-09-12T01:28:55.314003+0000","last_peered":"2024-09-12T01:28:55.314003+0000","last_clean":"2024-09-12T01:28:55.314003+0000","last_became_active":"2024-09-12T00:31:54.165221+0000","last_became_peered":"2024-09-12T00:31:54.165221+0000","last_unstale":"2024-09-12T01:28:55.314003+0000","last_undegraded":"2024-09-12T01:28:55.314003+0000","last_fullsized":"2024-09-12T01:28:55.314003+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:34.590028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62343,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":526,"num_read_kb":1039,"num_write":478,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782685+0000","last_change":"2024-09-12T00:31:56.173067+0000","last_active":"2024-09-12T01:26:05.782685+0000","last_peered":"2024-09-12T01:26:05.782685+0000","last_clean":"2024-09-12T01:26:05.782685+0000","last_became_active":"2024-09-12T00:31:56.172777+0000","last_became_peered":"2024-09-12T00:31:56.172777+0000","last_unstale":"2024-09-12T01:26:05.782685+0000","last_undegraded":"2024-09-12T01:26:05.782685+0000","last_fullsized":"2024-09-12T01:26:05.782685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:49.874762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'114","reported_seq":604,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:12.518829+0000","last_change":"2024-09-12T00:31:58.179957+0000","last_active":"2024-09-12T01:28:12.518829+0000","last_peered":"2024-09-12T01:28:12.518829+0000","last_clean":"2024-09-12T01:28:12.518829+0000","last_became_active":"2024-09-12T00:31:58.179667+0000","last_became_peered":"2024-09-12T00:31:58.179667+0000","last_unstale":"2024-09-12T01:28:12.518829+0000","last_undegraded":"2024-09-12T01:28:12.518829+0000","last_fullsized":"2024-09-12T01:28:12.518829+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:04.950082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":909,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":84,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'226","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721754+0000","last_change":"2024-09-12T00:31:50.131405+0000","last_active":"2024-09-12T01:25:49.721754+0000","last_peered":"2024-09-12T01:25:49.721754+0000","last_clean":"2024-09-12T01:25:49.721754+0000","last_became_active":"2024-09-12T00:31:50.130807+0000","last_became_peered":"2024-09-12T00:31:50.130807+0000","last_unstale":"2024-09-12T01:25:49.721754+0000","last_undegraded":"2024-09-12T01:25:49.721754+0000","last_fullsized":"2024-09-12T01:25:49.721754+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:43.848144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":940,"num_read_kb":756,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'334","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.689623+0000","last_change":"2024-09-12T00:31:47.113900+0000","last_active":"2024-09-12T01:29:14.689623+0000","last_peered":"2024-09-12T01:29:14.689623+0000","last_clean":"2024-09-12T01:29:14.689623+0000","last_became_active":"2024-09-12T00:31:47.113265+0000","last_became_peered":"2024-09-12T00:31:47.113265+0000","last_unstale":"2024-09-12T01:29:14.689623+0000","last_undegraded":"2024-09-12T01:29:14.689623+0000","last_fullsized":"2024-09-12T01:29:14.689623+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:24.211193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202787,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":531,"num_read_kb":11690,"num_write":1190,"num_write_kb":25282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:52.497051+0000","last_change":"2024-09-12T00:31:52.156164+0000","last_active":"2024-09-12T01:25:52.497051+0000","last_peered":"2024-09-12T01:25:52.497051+0000","last_clean":"2024-09-12T01:25:52.497051+0000","last_became_active":"2024-09-12T00:31:52.155877+0000","last_became_peered":"2024-09-12T00:31:52.155877+0000","last_unstale":"2024-09-12T01:25:52.497051+0000","last_undegraded":"2024-09-12T01:25:52.497051+0000","last_fullsized":"2024-09-12T01:25:52.497051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:38.312330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'305","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:27.521381+0000","last_change":"2024-09-12T00:31:54.165410+0000","last_active":"2024-09-12T01:28:27.521381+0000","last_peered":"2024-09-12T01:28:27.521381+0000","last_clean":"2024-09-12T01:28:27.521381+0000","last_became_active":"2024-09-12T00:31:54.165107+0000","last_became_peered":"2024-09-12T00:31:54.165107+0000","last_unstale":"2024-09-12T01:28:27.521381+0000","last_undegraded":"2024-09-12T01:28:27.521381+0000","last_fullsized":"2024-09-12T01:28:27.521381+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:41.442937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56639,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":996,"num_write":408,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'742","reported_seq":2475,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.295169+0000","last_change":"2024-09-12T00:31:56.170713+0000","last_active":"2024-09-12T01:29:14.295169+0000","last_peered":"2024-09-12T01:29:14.295169+0000","last_clean":"2024-09-12T01:29:14.295169+0000","last_became_active":"2024-09-12T00:31:56.170388+0000","last_became_peered":"2024-09-12T00:31:56.170388+0000","last_unstale":"2024-09-12T01:29:14.295169+0000","last_undegraded":"2024-09-12T01:29:14.295169+0000","last_fullsized":"2024-09-12T01:29:14.295169+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:46.492927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'162","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:46.479085+0000","last_change":"2024-09-12T00:31:58.172116+0000","last_active":"2024-09-12T01:27:46.479085+0000","last_peered":"2024-09-12T01:27:46.479085+0000","last_clean":"2024-09-12T01:27:46.479085+0000","last_became_active":"2024-09-12T00:31:58.171814+0000","last_became_peered":"2024-09-12T00:31:58.171814+0000","last_unstale":"2024-09-12T01:27:46.479085+0000","last_undegraded":"2024-09-12T01:27:46.479085+0000","last_fullsized":"2024-09-12T01:27:46.479085+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:12.214205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":379,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'117","reported_seq":721,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.318699+0000","last_change":"2024-09-12T00:31:50.142691+0000","last_active":"2024-09-12T01:27:48.318699+0000","last_peered":"2024-09-12T01:27:48.318699+0000","last_clean":"2024-09-12T01:27:48.318699+0000","last_became_active":"2024-09-12T00:31:50.142370+0000","last_became_peered":"2024-09-12T00:31:50.142370+0000","last_unstale":"2024-09-12T01:27:48.318699+0000","last_undegraded":"2024-09-12T01:27:48.318699+0000","last_fullsized":"2024-09-12T01:27:48.318699+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:28.025270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":572,"num_read_kb":482,"num_write":177,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'250","reported_seq":869,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.689763+0000","last_change":"2024-09-12T00:31:47.122868+0000","last_active":"2024-09-12T01:29:14.689763+0000","last_peered":"2024-09-12T01:29:14.689763+0000","last_clean":"2024-09-12T01:29:14.689763+0000","last_became_active":"2024-09-12T00:31:47.122110+0000","last_became_peered":"2024-09-12T00:31:47.122110+0000","last_unstale":"2024-09-12T01:29:14.689763+0000","last_undegraded":"2024-09-12T01:29:14.689763+0000","last_fullsized":"2024-09-12T01:29:14.689763+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:22.824588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16053943,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":343,"num_read_kb":34903,"num_write":862,"num_write_kb":39966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1454,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.074988+0000","last_change":"2024-09-12T00:31:52.155143+0000","last_active":"2024-09-12T01:29:14.074988+0000","last_peered":"2024-09-12T01:29:14.074988+0000","last_clean":"2024-09-12T01:29:14.074988+0000","last_became_active":"2024-09-12T00:31:52.154858+0000","last_became_peered":"2024-09-12T00:31:52.154858+0000","last_unstale":"2024-09-12T01:29:14.074988+0000","last_undegraded":"2024-09-12T01:29:14.074988+0000","last_fullsized":"2024-09-12T01:29:14.074988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:28.556319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'84","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.636359+0000","last_change":"2024-09-12T00:31:54.167692+0000","last_active":"2024-09-12T01:25:55.636359+0000","last_peered":"2024-09-12T01:25:55.636359+0000","last_clean":"2024-09-12T01:25:55.636359+0000","last_became_active":"2024-09-12T00:31:54.167362+0000","last_became_peered":"2024-09-12T00:31:54.167362+0000","last_unstale":"2024-09-12T01:25:55.636359+0000","last_undegraded":"2024-09-12T01:25:55.636359+0000","last_fullsized":"2024-09-12T01:25:55.636359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:15.421825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'770","reported_seq":2496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.296478+0000","last_change":"2024-09-12T00:31:56.173817+0000","last_active":"2024-09-12T01:29:14.296478+0000","last_peered":"2024-09-12T01:29:14.296478+0000","last_clean":"2024-09-12T01:29:14.296478+0000","last_became_active":"2024-09-12T00:31:56.173548+0000","last_became_peered":"2024-09-12T00:31:56.173548+0000","last_unstale":"2024-09-12T01:29:14.296478+0000","last_undegraded":"2024-09-12T01:29:14.296478+0000","last_fullsized":"2024-09-12T01:29:14.296478+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:34.709914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'124","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.453295+0000","last_change":"2024-09-12T00:31:58.175176+0000","last_active":"2024-09-12T01:27:48.453295+0000","last_peered":"2024-09-12T01:27:48.453295+0000","last_clean":"2024-09-12T01:27:48.453295+0000","last_became_active":"2024-09-12T00:31:58.174886+0000","last_became_peered":"2024-09-12T00:31:58.174886+0000","last_unstale":"2024-09-12T01:27:48.453295+0000","last_undegraded":"2024-09-12T01:27:48.453295+0000","last_fullsized":"2024-09-12T01:27:48.453295+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:21.010979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":123,"num_write":278,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'279","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:57.044069+0000","last_change":"2024-09-12T00:31:50.140192+0000","last_active":"2024-09-12T01:26:57.044069+0000","last_peered":"2024-09-12T01:26:57.044069+0000","last_clean":"2024-09-12T01:26:57.044069+0000","last_became_active":"2024-09-12T00:31:50.139923+0000","last_became_peered":"2024-09-12T00:31:50.139923+0000","last_unstale":"2024-09-12T01:26:57.044069+0000","last_undegraded":"2024-09-12T01:26:57.044069+0000","last_fullsized":"2024-09-12T01:26:57.044069+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:45.055920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":954,"num_write":459,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'306","reported_seq":1027,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:43.961087+0000","last_change":"2024-09-12T00:31:47.122785+0000","last_active":"2024-09-12T01:26:43.961087+0000","last_peered":"2024-09-12T01:26:43.961087+0000","last_clean":"2024-09-12T01:26:43.961087+0000","last_became_active":"2024-09-12T00:31:47.122007+0000","last_became_peered":"2024-09-12T00:31:47.122007+0000","last_unstale":"2024-09-12T01:26:43.961087+0000","last_undegraded":"2024-09-12T01:26:43.961087+0000","last_fullsized":"2024-09-12T01:26:43.961087+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:49.888568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5268542,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":591,"num_read_kb":69205,"num_write":1136,"num_write_kb":21863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.722337+0000","last_change":"2024-09-12T00:31:52.147230+0000","last_active":"2024-09-12T01:25:54.722337+0000","last_peered":"2024-09-12T01:25:54.722337+0000","last_clean":"2024-09-12T01:25:54.722337+0000","last_became_active":"2024-09-12T00:31:52.146894+0000","last_became_peered":"2024-09-12T00:31:52.146894+0000","last_unstale":"2024-09-12T01:25:54.722337+0000","last_undegraded":"2024-09-12T01:25:54.722337+0000","last_fullsized":"2024-09-12T01:25:54.722337+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:01.319728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'416","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.327097+0000","last_change":"2024-09-12T00:31:54.170886+0000","last_active":"2024-09-12T01:28:55.327097+0000","last_peered":"2024-09-12T01:28:55.327097+0000","last_clean":"2024-09-12T01:28:55.327097+0000","last_became_active":"2024-09-12T00:31:54.170522+0000","last_became_peered":"2024-09-12T00:31:54.170522+0000","last_unstale":"2024-09-12T01:28:55.327097+0000","last_undegraded":"2024-09-12T01:28:55.327097+0000","last_fullsized":"2024-09-12T01:28:55.327097+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:11.181608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65010,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1261,"num_read_kb":1830,"num_write":1796,"num_write_kb":1654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.504440+0000","last_change":"2024-09-12T00:31:56.168824+0000","last_active":"2024-09-12T01:25:59.504440+0000","last_peered":"2024-09-12T01:25:59.504440+0000","last_clean":"2024-09-12T01:25:59.504440+0000","last_became_active":"2024-09-12T00:31:56.168503+0000","last_became_peered":"2024-09-12T00:31:56.168503+0000","last_unstale":"2024-09-12T01:25:59.504440+0000","last_undegraded":"2024-09-12T01:25:59.504440+0000","last_fullsized":"2024-09-12T01:25:59.504440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:47.541247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'129","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:38.383006+0000","last_change":"2024-09-12T00:31:58.173064+0000","last_active":"2024-09-12T01:26:38.383006+0000","last_peered":"2024-09-12T01:26:38.383006+0000","last_clean":"2024-09-12T01:26:38.383006+0000","last_became_active":"2024-09-12T00:31:58.172778+0000","last_became_peered":"2024-09-12T00:31:58.172778+0000","last_unstale":"2024-09-12T01:26:38.383006+0000","last_undegraded":"2024-09-12T01:26:38.383006+0000","last_fullsized":"2024-09-12T01:26:38.383006+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:25.437723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":147,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'168","reported_seq":780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723659+0000","last_change":"2024-09-12T00:31:50.131714+0000","last_active":"2024-09-12T01:26:04.723659+0000","last_peered":"2024-09-12T01:26:04.723659+0000","last_clean":"2024-09-12T01:26:04.723659+0000","last_became_active":"2024-09-12T00:31:50.131152+0000","last_became_peered":"2024-09-12T00:31:50.131152+0000","last_unstale":"2024-09-12T01:26:04.723659+0000","last_undegraded":"2024-09-12T01:26:04.723659+0000","last_fullsized":"2024-09-12T01:26:04.723659+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:10.401016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":649,"num_write":266,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":618,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.602382+0000","last_change":"2024-09-12T00:31:29.750620+0000","last_active":"2024-09-12T01:25:34.602382+0000","last_peered":"2024-09-12T01:25:34.602382+0000","last_clean":"2024-09-12T01:25:34.602382+0000","last_became_active":"2024-09-12T00:31:29.750331+0000","last_became_peered":"2024-09-12T00:31:29.750331+0000","last_unstale":"2024-09-12T01:25:34.602382+0000","last_undegraded":"2024-09-12T01:25:34.602382+0000","last_fullsized":"2024-09-12T01:25:34.602382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:28.736382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:28.736382+0000","last_clean_scrub_stamp":"2024-09-12T00:31:28.736382+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:30.636870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721690+0000","last_change":"2024-09-12T00:31:38.792167+0000","last_active":"2024-09-12T01:25:49.721690+0000","last_peered":"2024-09-12T01:25:49.721690+0000","last_clean":"2024-09-12T01:25:49.721690+0000","last_became_active":"2024-09-12T00:31:36.970959+0000","last_became_peered":"2024-09-12T00:31:36.970959+0000","last_unstale":"2024-09-12T01:25:49.721690+0000","last_undegraded":"2024-09-12T01:25:49.721690+0000","last_fullsized":"2024-09-12T01:25:49.721690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:16.364886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098350799999999991,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'268","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:28.012307+0000","last_change":"2024-09-12T00:31:47.130441+0000","last_active":"2024-09-12T01:26:28.012307+0000","last_peered":"2024-09-12T01:26:28.012307+0000","last_clean":"2024-09-12T01:26:28.012307+0000","last_became_active":"2024-09-12T00:31:47.130015+0000","last_became_peered":"2024-09-12T00:31:47.130015+0000","last_unstale":"2024-09-12T01:26:28.012307+0000","last_undegraded":"2024-09-12T01:26:28.012307+0000","last_fullsized":"2024-09-12T01:26:28.012307+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:10.863669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10835095,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":459,"num_read_kb":117828,"num_write":998,"num_write_kb":35803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.501940+0000","last_change":"2024-09-12T00:31:52.148635+0000","last_active":"2024-09-12T01:26:04.501940+0000","last_peered":"2024-09-12T01:26:04.501940+0000","last_clean":"2024-09-12T01:26:04.501940+0000","last_became_active":"2024-09-12T00:31:52.148316+0000","last_became_peered":"2024-09-12T00:31:52.148316+0000","last_unstale":"2024-09-12T01:26:04.501940+0000","last_undegraded":"2024-09-12T01:26:04.501940+0000","last_fullsized":"2024-09-12T01:26:04.501940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:30.960630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'701","reported_seq":1398,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.330102+0000","last_change":"2024-09-12T00:31:54.163779+0000","last_active":"2024-09-12T01:29:14.330102+0000","last_peered":"2024-09-12T01:29:14.330102+0000","last_clean":"2024-09-12T01:29:14.330102+0000","last_became_active":"2024-09-12T00:31:54.163482+0000","last_became_peered":"2024-09-12T00:31:54.163482+0000","last_unstale":"2024-09-12T01:29:14.330102+0000","last_undegraded":"2024-09-12T01:29:14.330102+0000","last_fullsized":"2024-09-12T01:29:14.330102+0000","mapping_epoch":31,"log_start":"265'600","ondisk_log_start":"265'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:12.512568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159785,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1360,"num_read_kb":2777,"num_write":1290,"num_write_kb":1139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499503+0000","last_change":"2024-09-12T00:31:56.170852+0000","last_active":"2024-09-12T01:26:07.499503+0000","last_peered":"2024-09-12T01:26:07.499503+0000","last_clean":"2024-09-12T01:26:07.499503+0000","last_became_active":"2024-09-12T00:31:56.170545+0000","last_became_peered":"2024-09-12T00:31:56.170545+0000","last_unstale":"2024-09-12T01:26:07.499503+0000","last_undegraded":"2024-09-12T01:26:07.499503+0000","last_fullsized":"2024-09-12T01:26:07.499503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:42.166275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'197","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.343679+0000","last_change":"2024-09-12T00:31:58.185222+0000","last_active":"2024-09-12T01:27:48.343679+0000","last_peered":"2024-09-12T01:27:48.343679+0000","last_clean":"2024-09-12T01:27:48.343679+0000","last_became_active":"2024-09-12T00:31:58.184941+0000","last_became_peered":"2024-09-12T00:31:58.184941+0000","last_unstale":"2024-09-12T01:27:48.343679+0000","last_undegraded":"2024-09-12T01:27:48.343679+0000","last_fullsized":"2024-09-12T01:27:48.343679+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:18.883829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1234,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":433,"num_write":415,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'95","reported_seq":667,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498663+0000","last_change":"2024-09-12T00:31:50.138379+0000","last_active":"2024-09-12T01:26:02.498663+0000","last_peered":"2024-09-12T01:26:02.498663+0000","last_clean":"2024-09-12T01:26:02.498663+0000","last_became_active":"2024-09-12T00:31:50.137393+0000","last_became_peered":"2024-09-12T00:31:50.137393+0000","last_unstale":"2024-09-12T01:26:02.498663+0000","last_undegraded":"2024-09-12T01:26:02.498663+0000","last_fullsized":"2024-09-12T01:26:02.498663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:51.466639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":346,"num_write":149,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.719450+0000","last_change":"2024-09-12T00:31:38.791836+0000","last_active":"2024-09-12T01:25:44.719450+0000","last_peered":"2024-09-12T01:25:44.719450+0000","last_clean":"2024-09-12T01:25:44.719450+0000","last_became_active":"2024-09-12T00:31:36.772301+0000","last_became_peered":"2024-09-12T00:31:36.772301+0000","last_unstale":"2024-09-12T01:25:44.719450+0000","last_undegraded":"2024-09-12T01:25:44.719450+0000","last_fullsized":"2024-09-12T01:25:44.719450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:18.261088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070272599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'338","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.646130+0000","last_change":"2024-09-12T00:31:47.121968+0000","last_active":"2024-09-12T01:29:15.646130+0000","last_peered":"2024-09-12T01:29:15.646130+0000","last_clean":"2024-09-12T01:29:15.646130+0000","last_became_active":"2024-09-12T00:31:47.121537+0000","last_became_peered":"2024-09-12T00:31:47.121537+0000","last_unstale":"2024-09-12T01:29:15.646130+0000","last_undegraded":"2024-09-12T01:29:15.646130+0000","last_fullsized":"2024-09-12T01:29:15.646130+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:47.444435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":379440,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":554,"num_read_kb":9552,"num_write":1133,"num_write_kb":21951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723703+0000","last_change":"2024-09-12T00:31:52.147965+0000","last_active":"2024-09-12T01:26:04.723703+0000","last_peered":"2024-09-12T01:26:04.723703+0000","last_clean":"2024-09-12T01:26:04.723703+0000","last_became_active":"2024-09-12T00:31:52.147719+0000","last_became_peered":"2024-09-12T00:31:52.147719+0000","last_unstale":"2024-09-12T01:26:04.723703+0000","last_undegraded":"2024-09-12T01:26:04.723703+0000","last_fullsized":"2024-09-12T01:26:04.723703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:49.618183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1253","reported_seq":2877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.459747+0000","last_change":"2024-09-12T00:31:54.168423+0000","last_active":"2024-09-12T01:29:15.459747+0000","last_peered":"2024-09-12T01:29:15.459747+0000","last_clean":"2024-09-12T01:29:15.459747+0000","last_became_active":"2024-09-12T00:31:54.168085+0000","last_became_peered":"2024-09-12T00:31:54.168085+0000","last_unstale":"2024-09-12T01:29:15.459747+0000","last_undegraded":"2024-09-12T01:29:15.459747+0000","last_fullsized":"2024-09-12T01:29:15.459747+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":1200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:38.939256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152752,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2009,"num_read_kb":3538,"num_write":1124,"num_write_kb":948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.725043+0000","last_change":"2024-09-12T00:31:56.171482+0000","last_active":"2024-09-12T01:26:14.725043+0000","last_peered":"2024-09-12T01:26:14.725043+0000","last_clean":"2024-09-12T01:26:14.725043+0000","last_became_active":"2024-09-12T00:31:56.170725+0000","last_became_peered":"2024-09-12T00:31:56.170725+0000","last_unstale":"2024-09-12T01:26:14.725043+0000","last_undegraded":"2024-09-12T01:26:14.725043+0000","last_fullsized":"2024-09-12T01:26:14.725043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:54.802585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'205","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:46.476124+0000","last_change":"2024-09-12T00:31:58.182866+0000","last_active":"2024-09-12T01:27:46.476124+0000","last_peered":"2024-09-12T01:27:46.476124+0000","last_clean":"2024-09-12T01:27:46.476124+0000","last_became_active":"2024-09-12T00:31:58.182565+0000","last_became_peered":"2024-09-12T00:31:58.182565+0000","last_unstale":"2024-09-12T01:27:46.476124+0000","last_undegraded":"2024-09-12T01:27:46.476124+0000","last_fullsized":"2024-09-12T01:27:46.476124+0000","mapping_epoch":35,"log_start":"262'100","ondisk_log_start":"262'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:03.635481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":315,"num_read_kb":314,"num_write":438,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'335","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:28.356649+0000","last_change":"2024-09-12T00:31:50.136242+0000","last_active":"2024-09-12T01:26:28.356649+0000","last_peered":"2024-09-12T01:26:28.356649+0000","last_clean":"2024-09-12T01:26:28.356649+0000","last_became_active":"2024-09-12T00:31:50.135930+0000","last_became_peered":"2024-09-12T00:31:50.135930+0000","last_unstale":"2024-09-12T01:26:28.356649+0000","last_undegraded":"2024-09-12T01:26:28.356649+0000","last_fullsized":"2024-09-12T01:26:28.356649+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:16.203493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1457,"num_read_kb":1188,"num_write":528,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:50.780245+0000","last_change":"2024-09-12T00:31:38.791033+0000","last_active":"2024-09-12T01:25:50.780245+0000","last_peered":"2024-09-12T01:25:50.780245+0000","last_clean":"2024-09-12T01:25:50.780245+0000","last_became_active":"2024-09-12T00:31:36.774484+0000","last_became_peered":"2024-09-12T00:31:36.774484+0000","last_unstale":"2024-09-12T01:25:50.780245+0000","last_undegraded":"2024-09-12T01:25:50.780245+0000","last_fullsized":"2024-09-12T01:25:50.780245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:00.370174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040283499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'298","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:28.044047+0000","last_change":"2024-09-12T00:31:47.124224+0000","last_active":"2024-09-12T01:27:28.044047+0000","last_peered":"2024-09-12T01:27:28.044047+0000","last_clean":"2024-09-12T01:27:28.044047+0000","last_became_active":"2024-09-12T00:31:47.123249+0000","last_became_peered":"2024-09-12T00:31:47.123249+0000","last_unstale":"2024-09-12T01:27:28.044047+0000","last_undegraded":"2024-09-12T01:27:28.044047+0000","last_fullsized":"2024-09-12T01:27:28.044047+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:41.915420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534900,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":552,"num_read_kb":12898,"num_write":1111,"num_write_kb":44550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782647+0000","last_change":"2024-09-12T00:31:52.156266+0000","last_active":"2024-09-12T01:26:05.782647+0000","last_peered":"2024-09-12T01:26:05.782647+0000","last_clean":"2024-09-12T01:26:05.782647+0000","last_became_active":"2024-09-12T00:31:52.155926+0000","last_became_peered":"2024-09-12T00:31:52.155926+0000","last_unstale":"2024-09-12T01:26:05.782647+0000","last_undegraded":"2024-09-12T01:26:05.782647+0000","last_fullsized":"2024-09-12T01:26:05.782647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:04.589366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'249","reported_seq":1479,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.489792+0000","last_change":"2024-09-12T00:31:54.175219+0000","last_active":"2024-09-12T01:28:54.489792+0000","last_peered":"2024-09-12T01:28:54.489792+0000","last_clean":"2024-09-12T01:28:54.489792+0000","last_became_active":"2024-09-12T00:31:54.174937+0000","last_became_peered":"2024-09-12T00:31:54.174937+0000","last_unstale":"2024-09-12T01:28:54.489792+0000","last_undegraded":"2024-09-12T01:28:54.489792+0000","last_fullsized":"2024-09-12T01:28:54.489792+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:50.854821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":202,"num_write":187,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501136+0000","last_change":"2024-09-12T00:31:56.172150+0000","last_active":"2024-09-12T01:26:08.501136+0000","last_peered":"2024-09-12T01:26:08.501136+0000","last_clean":"2024-09-12T01:26:08.501136+0000","last_became_active":"2024-09-12T00:31:56.171071+0000","last_became_peered":"2024-09-12T00:31:56.171071+0000","last_unstale":"2024-09-12T01:26:08.501136+0000","last_undegraded":"2024-09-12T01:26:08.501136+0000","last_fullsized":"2024-09-12T01:26:08.501136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:43.038984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'239","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:13.519595+0000","last_change":"2024-09-12T00:31:58.177224+0000","last_active":"2024-09-12T01:28:13.519595+0000","last_peered":"2024-09-12T01:28:13.519595+0000","last_clean":"2024-09-12T01:28:13.519595+0000","last_became_active":"2024-09-12T00:31:58.176931+0000","last_became_peered":"2024-09-12T00:31:58.176931+0000","last_unstale":"2024-09-12T01:28:13.519595+0000","last_undegraded":"2024-09-12T01:28:13.519595+0000","last_fullsized":"2024-09-12T01:28:13.519595+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:05.868371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":495,"num_write":504,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'416","reported_seq":1066,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637259+0000","last_change":"2024-09-12T00:31:50.139895+0000","last_active":"2024-09-12T01:26:00.637259+0000","last_peered":"2024-09-12T01:26:00.637259+0000","last_clean":"2024-09-12T01:26:00.637259+0000","last_became_active":"2024-09-12T00:31:50.139625+0000","last_became_peered":"2024-09-12T00:31:50.139625+0000","last_unstale":"2024-09-12T01:26:00.637259+0000","last_undegraded":"2024-09-12T01:26:00.637259+0000","last_fullsized":"2024-09-12T01:26:00.637259+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:20.853631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1805,"num_read_kb":1431,"num_write":644,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721663+0000","last_change":"2024-09-12T00:31:38.792511+0000","last_active":"2024-09-12T01:25:49.721663+0000","last_peered":"2024-09-12T01:25:49.721663+0000","last_clean":"2024-09-12T01:25:49.721663+0000","last_became_active":"2024-09-12T00:31:37.736683+0000","last_became_peered":"2024-09-12T00:31:37.736683+0000","last_unstale":"2024-09-12T01:25:49.721663+0000","last_undegraded":"2024-09-12T01:25:49.721663+0000","last_fullsized":"2024-09-12T01:25:49.721663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:32.835722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001295757,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'253","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.514779+0000","last_change":"2024-09-12T00:31:47.137770+0000","last_active":"2024-09-12T01:28:04.514779+0000","last_peered":"2024-09-12T01:28:04.514779+0000","last_clean":"2024-09-12T01:28:04.514779+0000","last_became_active":"2024-09-12T00:31:47.136714+0000","last_became_peered":"2024-09-12T00:31:47.136714+0000","last_unstale":"2024-09-12T01:28:04.514779+0000","last_undegraded":"2024-09-12T01:28:04.514779+0000","last_fullsized":"2024-09-12T01:28:04.514779+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:36.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10811741,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":826,"num_read_kb":29268,"num_write":995,"num_write_kb":35686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.784440+0000","last_change":"2024-09-12T00:31:52.149396+0000","last_active":"2024-09-12T01:26:15.784440+0000","last_peered":"2024-09-12T01:26:15.784440+0000","last_clean":"2024-09-12T01:26:15.784440+0000","last_became_active":"2024-09-12T00:31:52.148995+0000","last_became_peered":"2024-09-12T00:31:52.148995+0000","last_unstale":"2024-09-12T01:26:15.784440+0000","last_undegraded":"2024-09-12T01:26:15.784440+0000","last_fullsized":"2024-09-12T01:26:15.784440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:57.905127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'137","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:17.519817+0000","last_change":"2024-09-12T00:31:54.168174+0000","last_active":"2024-09-12T01:28:17.519817+0000","last_peered":"2024-09-12T01:28:17.519817+0000","last_clean":"2024-09-12T01:28:17.519817+0000","last_became_active":"2024-09-12T00:31:54.167813+0000","last_became_peered":"2024-09-12T00:31:54.167813+0000","last_unstale":"2024-09-12T01:28:17.519817+0000","last_undegraded":"2024-09-12T01:28:17.519817+0000","last_fullsized":"2024-09-12T01:28:17.519817+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:55.058242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":166,"num_read_kb":157,"num_write":122,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.724455+0000","last_change":"2024-09-12T00:31:56.173128+0000","last_active":"2024-09-12T01:26:09.724455+0000","last_peered":"2024-09-12T01:26:09.724455+0000","last_clean":"2024-09-12T01:26:09.724455+0000","last_became_active":"2024-09-12T00:31:56.172693+0000","last_became_peered":"2024-09-12T00:31:56.172693+0000","last_unstale":"2024-09-12T01:26:09.724455+0000","last_undegraded":"2024-09-12T01:26:09.724455+0000","last_fullsized":"2024-09-12T01:26:09.724455+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:48.948020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'163","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.606163+0000","last_change":"2024-09-12T00:31:58.177617+0000","last_active":"2024-09-12T01:26:09.606163+0000","last_peered":"2024-09-12T01:26:09.606163+0000","last_clean":"2024-09-12T01:26:09.606163+0000","last_became_active":"2024-09-12T00:31:58.177206+0000","last_became_peered":"2024-09-12T00:31:58.177206+0000","last_unstale":"2024-09-12T01:26:09.606163+0000","last_undegraded":"2024-09-12T01:26:09.606163+0000","last_fullsized":"2024-09-12T01:26:09.606163+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:23.709095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":267,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'249","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637190+0000","last_change":"2024-09-12T00:31:50.135626+0000","last_active":"2024-09-12T01:26:00.637190+0000","last_peered":"2024-09-12T01:26:00.637190+0000","last_clean":"2024-09-12T01:26:00.637190+0000","last_became_active":"2024-09-12T00:31:50.135333+0000","last_became_peered":"2024-09-12T00:31:50.135333+0000","last_unstale":"2024-09-12T01:26:00.637190+0000","last_undegraded":"2024-09-12T01:26:00.637190+0000","last_fullsized":"2024-09-12T01:26:00.637190+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:41.887040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1106,"num_read_kb":893,"num_write":406,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'246","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:27.899313+0000","last_change":"2024-09-12T00:31:47.132263+0000","last_active":"2024-09-12T01:27:27.899313+0000","last_peered":"2024-09-12T01:27:27.899313+0000","last_clean":"2024-09-12T01:27:27.899313+0000","last_became_active":"2024-09-12T00:31:47.131943+0000","last_became_peered":"2024-09-12T00:31:47.131943+0000","last_unstale":"2024-09-12T01:27:27.899313+0000","last_undegraded":"2024-09-12T01:27:27.899313+0000","last_fullsized":"2024-09-12T01:27:27.899313+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:25.947785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19519350,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":331,"num_read_kb":39412,"num_write":921,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:47.496403+0000","last_change":"2024-09-12T00:31:38.786719+0000","last_active":"2024-09-12T01:25:47.496403+0000","last_peered":"2024-09-12T01:25:47.496403+0000","last_clean":"2024-09-12T01:25:47.496403+0000","last_became_active":"2024-09-12T00:31:37.736507+0000","last_became_peered":"2024-09-12T00:31:37.736507+0000","last_unstale":"2024-09-12T01:25:47.496403+0000","last_undegraded":"2024-09-12T01:25:47.496403+0000","last_fullsized":"2024-09-12T01:25:47.496403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:48.124334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050928200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:03.500363+0000","last_change":"2024-09-12T00:31:52.154383+0000","last_active":"2024-09-12T01:26:03.500363+0000","last_peered":"2024-09-12T01:26:03.500363+0000","last_clean":"2024-09-12T01:26:03.500363+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:26:03.500363+0000","last_undegraded":"2024-09-12T01:26:03.500363+0000","last_fullsized":"2024-09-12T01:26:03.500363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:37.921158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'599","reported_seq":1283,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.158815+0000","last_change":"2024-09-12T00:31:54.162920+0000","last_active":"2024-09-12T01:29:15.158815+0000","last_peered":"2024-09-12T01:29:15.158815+0000","last_clean":"2024-09-12T01:29:15.158815+0000","last_became_active":"2024-09-12T00:31:54.162596+0000","last_became_peered":"2024-09-12T00:31:54.162596+0000","last_unstale":"2024-09-12T01:29:15.158815+0000","last_undegraded":"2024-09-12T01:29:15.158815+0000","last_fullsized":"2024-09-12T01:29:15.158815+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:38.618701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98974,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1014,"num_read_kb":2093,"num_write":884,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.505411+0000","last_change":"2024-09-12T00:31:56.170603+0000","last_active":"2024-09-12T01:26:09.505411+0000","last_peered":"2024-09-12T01:26:09.505411+0000","last_clean":"2024-09-12T01:26:09.505411+0000","last_became_active":"2024-09-12T00:31:56.170246+0000","last_became_peered":"2024-09-12T00:31:56.170246+0000","last_unstale":"2024-09-12T01:26:09.505411+0000","last_undegraded":"2024-09-12T01:26:09.505411+0000","last_fullsized":"2024-09-12T01:26:09.505411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:58.101767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'137","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.305820+0000","last_change":"2024-09-12T00:31:58.183531+0000","last_active":"2024-09-12T01:28:54.305820+0000","last_peered":"2024-09-12T01:28:54.305820+0000","last_clean":"2024-09-12T01:28:54.305820+0000","last_became_active":"2024-09-12T00:31:58.183206+0000","last_became_peered":"2024-09-12T00:31:58.183206+0000","last_unstale":"2024-09-12T01:28:54.305820+0000","last_undegraded":"2024-09-12T01:28:54.305820+0000","last_fullsized":"2024-09-12T01:28:54.305820+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:12.094595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":155,"num_write":341,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'131","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637220+0000","last_change":"2024-09-12T00:31:50.135481+0000","last_active":"2024-09-12T01:26:00.637220+0000","last_peered":"2024-09-12T01:26:00.637220+0000","last_clean":"2024-09-12T01:26:00.637220+0000","last_became_active":"2024-09-12T00:31:50.135197+0000","last_became_peered":"2024-09-12T00:31:50.135197+0000","last_unstale":"2024-09-12T01:26:00.637220+0000","last_undegraded":"2024-09-12T01:26:00.637220+0000","last_fullsized":"2024-09-12T01:26:00.637220+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:37.204019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":577,"num_read_kb":479,"num_write":210,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'277","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.629230+0000","last_change":"2024-09-12T00:31:47.121755+0000","last_active":"2024-09-12T01:29:15.629230+0000","last_peered":"2024-09-12T01:29:15.629230+0000","last_clean":"2024-09-12T01:29:15.629230+0000","last_became_active":"2024-09-12T00:31:47.121355+0000","last_became_peered":"2024-09-12T00:31:47.121355+0000","last_unstale":"2024-09-12T01:29:15.629230+0000","last_undegraded":"2024-09-12T01:29:15.629230+0000","last_fullsized":"2024-09-12T01:29:15.629230+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:07.246376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":866,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":426,"num_read_kb":443,"num_write":978,"num_write_kb":5362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.722299+0000","last_change":"2024-09-12T00:31:38.791827+0000","last_active":"2024-09-12T01:25:54.722299+0000","last_peered":"2024-09-12T01:25:54.722299+0000","last_clean":"2024-09-12T01:25:54.722299+0000","last_became_active":"2024-09-12T00:31:36.774289+0000","last_became_peered":"2024-09-12T00:31:36.774289+0000","last_unstale":"2024-09-12T01:25:54.722299+0000","last_undegraded":"2024-09-12T01:25:54.722299+0000","last_fullsized":"2024-09-12T01:25:54.722299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:55.526735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063853100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"37'8","reported_seq":1459,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.075671+0000","last_change":"2024-09-12T00:31:52.148172+0000","last_active":"2024-09-12T01:29:14.075671+0000","last_peered":"2024-09-12T01:29:14.075671+0000","last_clean":"2024-09-12T01:29:14.075671+0000","last_became_active":"2024-09-12T00:31:52.147856+0000","last_became_peered":"2024-09-12T00:31:52.147856+0000","last_unstale":"2024-09-12T01:29:14.075671+0000","last_undegraded":"2024-09-12T01:29:14.075671+0000","last_fullsized":"2024-09-12T01:29:14.075671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:28.451170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1609,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1450,"num_read_kb":1911,"num_write":16,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'176","reported_seq":746,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.637935+0000","last_change":"2024-09-12T00:31:54.170295+0000","last_active":"2024-09-12T01:26:05.637935+0000","last_peered":"2024-09-12T01:26:05.637935+0000","last_clean":"2024-09-12T01:26:05.637935+0000","last_became_active":"2024-09-12T00:31:54.169958+0000","last_became_peered":"2024-09-12T00:31:54.169958+0000","last_unstale":"2024-09-12T01:26:05.637935+0000","last_undegraded":"2024-09-12T01:26:05.637935+0000","last_fullsized":"2024-09-12T01:26:05.637935+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:37.410716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":229,"num_read_kb":218,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'771","reported_seq":2818,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.292960+0000","last_change":"2024-09-12T00:31:56.174875+0000","last_active":"2024-09-12T01:29:14.292960+0000","last_peered":"2024-09-12T01:29:14.292960+0000","last_clean":"2024-09-12T01:29:14.292960+0000","last_became_active":"2024-09-12T00:31:56.174535+0000","last_became_peered":"2024-09-12T00:31:56.174535+0000","last_unstale":"2024-09-12T01:29:14.292960+0000","last_undegraded":"2024-09-12T01:29:14.292960+0000","last_fullsized":"2024-09-12T01:29:14.292960+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:30.561634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'114","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:25.804418+0000","last_change":"2024-09-12T00:31:58.174504+0000","last_active":"2024-09-12T01:28:25.804418+0000","last_peered":"2024-09-12T01:28:25.804418+0000","last_clean":"2024-09-12T01:28:25.804418+0000","last_became_active":"2024-09-12T00:31:58.174086+0000","last_became_peered":"2024-09-12T00:31:58.174086+0000","last_unstale":"2024-09-12T01:28:25.804418+0000","last_undegraded":"2024-09-12T01:28:25.804418+0000","last_fullsized":"2024-09-12T01:28:25.804418+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:34.431865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":255,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'4367","reported_seq":5119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501053+0000","last_change":"2024-09-12T00:31:50.133031+0000","last_active":"2024-09-12T01:26:08.501053+0000","last_peered":"2024-09-12T01:26:08.501053+0000","last_clean":"2024-09-12T01:26:08.501053+0000","last_became_active":"2024-09-12T00:31:50.132703+0000","last_became_peered":"2024-09-12T00:31:50.132703+0000","last_unstale":"2024-09-12T01:26:08.501053+0000","last_undegraded":"2024-09-12T01:26:08.501053+0000","last_fullsized":"2024-09-12T01:26:08.501053+0000","mapping_epoch":27,"log_start":"265'4300","ondisk_log_start":"265'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":3000,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:18.582172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17817,"num_read_kb":14914,"num_write":6561,"num_write_kb":3320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'252","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:06.847147+0000","last_change":"2024-09-12T00:31:47.116552+0000","last_active":"2024-09-12T01:27:06.847147+0000","last_peered":"2024-09-12T01:27:06.847147+0000","last_clean":"2024-09-12T01:27:06.847147+0000","last_became_active":"2024-09-12T00:31:47.116205+0000","last_became_peered":"2024-09-12T00:31:47.116205+0000","last_unstale":"2024-09-12T01:27:06.847147+0000","last_undegraded":"2024-09-12T01:27:06.847147+0000","last_fullsized":"2024-09-12T01:27:06.847147+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:23.401827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11552390,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":424,"num_read_kb":46756,"num_write":1023,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:48.498503+0000","last_change":"2024-09-12T00:31:38.828567+0000","last_active":"2024-09-12T01:25:48.498503+0000","last_peered":"2024-09-12T01:25:48.498503+0000","last_clean":"2024-09-12T01:25:48.498503+0000","last_became_active":"2024-09-12T00:31:37.434707+0000","last_became_peered":"2024-09-12T00:31:37.434707+0000","last_unstale":"2024-09-12T01:25:48.498503+0000","last_undegraded":"2024-09-12T01:25:48.498503+0000","last_fullsized":"2024-09-12T01:25:48.498503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:44.992055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041578299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723540+0000","last_change":"2024-09-12T00:31:52.147221+0000","last_active":"2024-09-12T01:26:04.723540+0000","last_peered":"2024-09-12T01:26:04.723540+0000","last_clean":"2024-09-12T01:26:04.723540+0000","last_became_active":"2024-09-12T00:31:52.146927+0000","last_became_peered":"2024-09-12T00:31:52.146927+0000","last_unstale":"2024-09-12T01:26:04.723540+0000","last_undegraded":"2024-09-12T01:26:04.723540+0000","last_fullsized":"2024-09-12T01:26:04.723540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:07.292280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'129","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723596+0000","last_change":"2024-09-12T00:31:54.166886+0000","last_active":"2024-09-12T01:26:04.723596+0000","last_peered":"2024-09-12T01:26:04.723596+0000","last_clean":"2024-09-12T01:26:04.723596+0000","last_became_active":"2024-09-12T00:31:54.166612+0000","last_became_peered":"2024-09-12T00:31:54.166612+0000","last_unstale":"2024-09-12T01:26:04.723596+0000","last_undegraded":"2024-09-12T01:26:04.723596+0000","last_fullsized":"2024-09-12T01:26:04.723596+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:22.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":151,"num_read_kb":143,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'780","reported_seq":4656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.361508+0000","last_change":"2024-09-12T00:31:56.170683+0000","last_active":"2024-09-12T01:28:55.361508+0000","last_peered":"2024-09-12T01:28:55.361508+0000","last_clean":"2024-09-12T01:28:55.361508+0000","last_became_active":"2024-09-12T00:31:56.170358+0000","last_became_peered":"2024-09-12T00:31:56.170358+0000","last_unstale":"2024-09-12T01:28:55.361508+0000","last_undegraded":"2024-09-12T01:28:55.361508+0000","last_fullsized":"2024-09-12T01:28:55.361508+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:23.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'175","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:57.497649+0000","last_change":"2024-09-12T00:31:58.178681+0000","last_active":"2024-09-12T01:25:57.497649+0000","last_peered":"2024-09-12T01:25:57.497649+0000","last_clean":"2024-09-12T01:25:57.497649+0000","last_became_active":"2024-09-12T00:31:58.178148+0000","last_became_peered":"2024-09-12T00:31:58.178148+0000","last_unstale":"2024-09-12T01:25:57.497649+0000","last_undegraded":"2024-09-12T01:25:57.497649+0000","last_fullsized":"2024-09-12T01:25:57.497649+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:28.683801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":405,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'112","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:06.005883+0000","last_change":"2024-09-12T00:31:50.143058+0000","last_active":"2024-09-12T01:27:06.005883+0000","last_peered":"2024-09-12T01:27:06.005883+0000","last_clean":"2024-09-12T01:27:06.005883+0000","last_became_active":"2024-09-12T00:31:50.142769+0000","last_became_peered":"2024-09-12T00:31:50.142769+0000","last_unstale":"2024-09-12T01:27:06.005883+0000","last_undegraded":"2024-09-12T01:27:06.005883+0000","last_fullsized":"2024-09-12T01:27:06.005883+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:22.259280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":521,"num_read_kb":437,"num_write":174,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'318","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:58.499776+0000","last_change":"2024-09-12T00:31:47.116325+0000","last_active":"2024-09-12T01:25:58.499776+0000","last_peered":"2024-09-12T01:25:58.499776+0000","last_clean":"2024-09-12T01:25:58.499776+0000","last_became_active":"2024-09-12T00:31:47.115974+0000","last_became_peered":"2024-09-12T00:31:47.115974+0000","last_unstale":"2024-09-12T01:25:58.499776+0000","last_undegraded":"2024-09-12T01:25:58.499776+0000","last_fullsized":"2024-09-12T01:25:58.499776+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:40.653497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2942072,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":602,"num_read_kb":6022,"num_write":1033,"num_write_kb":14780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721781+0000","last_change":"2024-09-12T00:31:38.792390+0000","last_active":"2024-09-12T01:25:49.721781+0000","last_peered":"2024-09-12T01:25:49.721781+0000","last_clean":"2024-09-12T01:25:49.721781+0000","last_became_active":"2024-09-12T00:31:37.434487+0000","last_became_peered":"2024-09-12T00:31:37.434487+0000","last_unstale":"2024-09-12T01:25:49.721781+0000","last_undegraded":"2024-09-12T01:25:49.721781+0000","last_fullsized":"2024-09-12T01:25:49.721781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.146992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501076+0000","last_change":"2024-09-12T00:31:52.152659+0000","last_active":"2024-09-12T01:26:08.501076+0000","last_peered":"2024-09-12T01:26:08.501076+0000","last_clean":"2024-09-12T01:26:08.501076+0000","last_became_active":"2024-09-12T00:31:52.152173+0000","last_became_peered":"2024-09-12T00:31:52.152173+0000","last_unstale":"2024-09-12T01:26:08.501076+0000","last_undegraded":"2024-09-12T01:26:08.501076+0000","last_fullsized":"2024-09-12T01:26:08.501076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:41.559045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'724","reported_seq":1439,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.317168+0000","last_change":"2024-09-12T00:31:54.170238+0000","last_active":"2024-09-12T01:29:14.317168+0000","last_peered":"2024-09-12T01:29:14.317168+0000","last_clean":"2024-09-12T01:29:14.317168+0000","last_became_active":"2024-09-12T00:31:54.169994+0000","last_became_peered":"2024-09-12T00:31:54.169994+0000","last_unstale":"2024-09-12T01:29:14.317168+0000","last_undegraded":"2024-09-12T01:29:14.317168+0000","last_fullsized":"2024-09-12T01:29:14.317168+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:49.480724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168605,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1273,"num_read_kb":2692,"num_write":1046,"num_write_kb":860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501108+0000","last_change":"2024-09-12T00:31:56.172717+0000","last_active":"2024-09-12T01:26:08.501108+0000","last_peered":"2024-09-12T01:26:08.501108+0000","last_clean":"2024-09-12T01:26:08.501108+0000","last_became_active":"2024-09-12T00:31:56.172417+0000","last_became_peered":"2024-09-12T00:31:56.172417+0000","last_unstale":"2024-09-12T01:26:08.501108+0000","last_undegraded":"2024-09-12T01:26:08.501108+0000","last_fullsized":"2024-09-12T01:26:08.501108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:19.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'150","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.504454+0000","last_change":"2024-09-12T00:31:58.180306+0000","last_active":"2024-09-12T01:25:59.504454+0000","last_peered":"2024-09-12T01:25:59.504454+0000","last_clean":"2024-09-12T01:25:59.504454+0000","last_became_active":"2024-09-12T00:31:58.179998+0000","last_became_peered":"2024-09-12T00:31:58.179998+0000","last_unstale":"2024-09-12T01:25:59.504454+0000","last_undegraded":"2024-09-12T01:25:59.504454+0000","last_fullsized":"2024-09-12T01:25:59.504454+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:19.517308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":177,"num_read_kb":166,"num_write":377,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'158","reported_seq":722,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.538025+0000","last_change":"2024-09-12T00:31:58.178240+0000","last_active":"2024-09-12T01:27:48.538025+0000","last_peered":"2024-09-12T01:27:48.538025+0000","last_clean":"2024-09-12T01:27:48.538025+0000","last_became_active":"2024-09-12T00:31:58.177936+0000","last_became_peered":"2024-09-12T00:31:58.177936+0000","last_unstale":"2024-09-12T01:27:48.538025+0000","last_undegraded":"2024-09-12T01:27:48.538025+0000","last_fullsized":"2024-09-12T01:27:48.538025+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:52.216144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":226,"num_read_kb":224,"num_write":377,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'98","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:19.340107+0000","last_change":"2024-09-12T00:31:50.142477+0000","last_active":"2024-09-12T01:26:19.340107+0000","last_peered":"2024-09-12T01:26:19.340107+0000","last_clean":"2024-09-12T01:26:19.340107+0000","last_became_active":"2024-09-12T00:31:50.142206+0000","last_became_peered":"2024-09-12T00:31:50.142206+0000","last_unstale":"2024-09-12T01:26:19.340107+0000","last_undegraded":"2024-09-12T01:26:19.340107+0000","last_fullsized":"2024-09-12T01:26:19.340107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:15.569454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":133,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'252","reported_seq":857,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.654974+0000","last_change":"2024-09-12T00:31:47.128769+0000","last_active":"2024-09-12T01:29:14.654974+0000","last_peered":"2024-09-12T01:29:14.654974+0000","last_clean":"2024-09-12T01:29:14.654974+0000","last_became_active":"2024-09-12T00:31:47.128005+0000","last_became_peered":"2024-09-12T00:31:47.128005+0000","last_unstale":"2024-09-12T01:29:14.654974+0000","last_undegraded":"2024-09-12T01:29:14.654974+0000","last_fullsized":"2024-09-12T01:29:14.654974+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:09.592563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5487134,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":329,"num_read_kb":1002,"num_write":913,"num_write_kb":27047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:35.633125+0000","last_change":"2024-09-12T00:31:52.154225+0000","last_active":"2024-09-12T01:25:35.633125+0000","last_peered":"2024-09-12T01:25:35.633125+0000","last_clean":"2024-09-12T01:25:35.633125+0000","last_became_active":"2024-09-12T00:31:52.153927+0000","last_became_peered":"2024-09-12T00:31:52.153927+0000","last_unstale":"2024-09-12T01:25:35.633125+0000","last_undegraded":"2024-09-12T01:25:35.633125+0000","last_fullsized":"2024-09-12T01:25:35.633125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:05.731540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'289","reported_seq":867,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.667897+0000","last_change":"2024-09-12T00:31:54.167788+0000","last_active":"2024-09-12T01:29:14.667897+0000","last_peered":"2024-09-12T01:29:14.667897+0000","last_clean":"2024-09-12T01:29:14.667897+0000","last_became_active":"2024-09-12T00:31:54.167414+0000","last_became_peered":"2024-09-12T00:31:54.167414+0000","last_unstale":"2024-09-12T01:29:14.667897+0000","last_undegraded":"2024-09-12T01:29:14.667897+0000","last_fullsized":"2024-09-12T01:29:14.667897+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.633567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44314,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":1087,"num_write":386,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:35.777825+0000","last_change":"2024-09-12T00:31:56.173722+0000","last_active":"2024-09-12T01:25:35.777825+0000","last_peered":"2024-09-12T01:25:35.777825+0000","last_clean":"2024-09-12T01:25:35.777825+0000","last_became_active":"2024-09-12T00:31:56.173412+0000","last_became_peered":"2024-09-12T00:31:56.173412+0000","last_unstale":"2024-09-12T01:25:35.777825+0000","last_undegraded":"2024-09-12T01:25:35.777825+0000","last_fullsized":"2024-09-12T01:25:35.777825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:12.092104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'129","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:47.573025+0000","last_change":"2024-09-12T00:31:58.176621+0000","last_active":"2024-09-12T01:26:47.573025+0000","last_peered":"2024-09-12T01:26:47.573025+0000","last_clean":"2024-09-12T01:26:47.573025+0000","last_became_active":"2024-09-12T00:31:58.176322+0000","last_became_peered":"2024-09-12T00:31:58.176322+0000","last_unstale":"2024-09-12T01:26:47.573025+0000","last_undegraded":"2024-09-12T01:26:47.573025+0000","last_fullsized":"2024-09-12T01:26:47.573025+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:12.568369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":158,"num_write":327,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'158","reported_seq":806,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:33.496218+0000","last_change":"2024-09-12T00:31:50.128018+0000","last_active":"2024-09-12T01:25:33.496218+0000","last_peered":"2024-09-12T01:25:33.496218+0000","last_clean":"2024-09-12T01:25:33.496218+0000","last_became_active":"2024-09-12T00:31:50.127724+0000","last_became_peered":"2024-09-12T00:31:50.127724+0000","last_unstale":"2024-09-12T01:25:33.496218+0000","last_undegraded":"2024-09-12T01:25:33.496218+0000","last_fullsized":"2024-09-12T01:25:33.496218+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:22.239207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":587,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'300","reported_seq":1063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.495244+0000","last_change":"2024-09-12T00:31:47.138921+0000","last_active":"2024-09-12T01:24:59.495244+0000","last_peered":"2024-09-12T01:24:59.495244+0000","last_clean":"2024-09-12T01:24:59.495244+0000","last_became_active":"2024-09-12T00:31:47.138565+0000","last_became_peered":"2024-09-12T00:31:47.138565+0000","last_unstale":"2024-09-12T01:24:59.495244+0000","last_undegraded":"2024-09-12T01:24:59.495244+0000","last_fullsized":"2024-09-12T01:24:59.495244+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:02.222341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19350540,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":711,"num_read_kb":53412,"num_write":1069,"num_write_kb":60803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:33.496242+0000","last_change":"2024-09-12T00:31:52.155188+0000","last_active":"2024-09-12T01:25:33.496242+0000","last_peered":"2024-09-12T01:25:33.496242+0000","last_clean":"2024-09-12T01:25:33.496242+0000","last_became_active":"2024-09-12T00:31:52.154829+0000","last_became_peered":"2024-09-12T00:31:52.154829+0000","last_unstale":"2024-09-12T01:25:33.496242+0000","last_undegraded":"2024-09-12T01:25:33.496242+0000","last_fullsized":"2024-09-12T01:25:33.496242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:05.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'40","reported_seq":551,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:33.496173+0000","last_change":"2024-09-12T00:31:54.162972+0000","last_active":"2024-09-12T01:25:33.496173+0000","last_peered":"2024-09-12T01:25:33.496173+0000","last_clean":"2024-09-12T01:25:33.496173+0000","last_became_active":"2024-09-12T00:31:54.162657+0000","last_became_peered":"2024-09-12T00:31:54.162657+0000","last_unstale":"2024-09-12T01:25:33.496173+0000","last_undegraded":"2024-09-12T01:25:33.496173+0000","last_fullsized":"2024-09-12T01:25:33.496173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:24.360783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.502236+0000","last_change":"2024-09-12T00:31:56.170942+0000","last_active":"2024-09-12T01:25:39.502236+0000","last_peered":"2024-09-12T01:25:39.502236+0000","last_clean":"2024-09-12T01:25:39.502236+0000","last_became_active":"2024-09-12T00:31:56.170648+0000","last_became_peered":"2024-09-12T00:31:56.170648+0000","last_unstale":"2024-09-12T01:25:39.502236+0000","last_undegraded":"2024-09-12T01:25:39.502236+0000","last_fullsized":"2024-09-12T01:25:39.502236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:28.565117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'217","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.527288+0000","last_change":"2024-09-12T00:31:58.172827+0000","last_active":"2024-09-12T01:27:47.527288+0000","last_peered":"2024-09-12T01:27:47.527288+0000","last_clean":"2024-09-12T01:27:47.527288+0000","last_became_active":"2024-09-12T00:31:58.172511+0000","last_became_peered":"2024-09-12T00:31:58.172511+0000","last_unstale":"2024-09-12T01:27:47.527288+0000","last_undegraded":"2024-09-12T01:27:47.527288+0000","last_fullsized":"2024-09-12T01:27:47.527288+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:38.476612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":356,"num_read_kb":339,"num_write":509,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'63","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:27.801294+0000","last_change":"2024-09-12T00:31:50.125425+0000","last_active":"2024-09-12T01:26:27.801294+0000","last_peered":"2024-09-12T01:26:27.801294+0000","last_clean":"2024-09-12T01:26:27.801294+0000","last_became_active":"2024-09-12T00:31:50.124994+0000","last_became_peered":"2024-09-12T00:31:50.124994+0000","last_unstale":"2024-09-12T01:26:27.801294+0000","last_undegraded":"2024-09-12T01:26:27.801294+0000","last_fullsized":"2024-09-12T01:26:27.801294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:16.366629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":221,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'267","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.498188+0000","last_change":"2024-09-12T00:31:47.134711+0000","last_active":"2024-09-12T01:24:59.498188+0000","last_peered":"2024-09-12T01:24:59.498188+0000","last_clean":"2024-09-12T01:24:59.498188+0000","last_became_active":"2024-09-12T00:31:47.134398+0000","last_became_peered":"2024-09-12T00:31:47.134398+0000","last_unstale":"2024-09-12T01:24:59.498188+0000","last_undegraded":"2024-09-12T01:24:59.498188+0000","last_fullsized":"2024-09-12T01:24:59.498188+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:31.067474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6059902,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":403,"num_read_kb":102266,"num_write":999,"num_write_kb":44150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.501767+0000","last_change":"2024-09-12T00:31:52.152133+0000","last_active":"2024-09-12T01:25:34.501767+0000","last_peered":"2024-09-12T01:25:34.501767+0000","last_clean":"2024-09-12T01:25:34.501767+0000","last_became_active":"2024-09-12T00:31:52.151826+0000","last_became_peered":"2024-09-12T00:31:52.151826+0000","last_unstale":"2024-09-12T01:25:34.501767+0000","last_undegraded":"2024-09-12T01:25:34.501767+0000","last_fullsized":"2024-09-12T01:25:34.501767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:53.712859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'297","reported_seq":893,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.319654+0000","last_change":"2024-09-12T00:31:54.162484+0000","last_active":"2024-09-12T01:28:55.319654+0000","last_peered":"2024-09-12T01:28:55.319654+0000","last_clean":"2024-09-12T01:28:55.319654+0000","last_became_active":"2024-09-12T00:31:54.162188+0000","last_became_peered":"2024-09-12T00:31:54.162188+0000","last_unstale":"2024-09-12T01:28:55.319654+0000","last_undegraded":"2024-09-12T01:28:55.319654+0000","last_fullsized":"2024-09-12T01:28:55.319654+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:59.208178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56423,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":492,"num_read_kb":961,"num_write":392,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.603003+0000","last_change":"2024-09-12T00:31:56.168740+0000","last_active":"2024-09-12T01:25:39.603003+0000","last_peered":"2024-09-12T01:25:39.603003+0000","last_clean":"2024-09-12T01:25:39.603003+0000","last_became_active":"2024-09-12T00:31:56.168434+0000","last_became_peered":"2024-09-12T00:31:56.168434+0000","last_unstale":"2024-09-12T01:25:39.603003+0000","last_undegraded":"2024-09-12T01:25:39.603003+0000","last_fullsized":"2024-09-12T01:25:39.603003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:22.526791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'127","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.333302+0000","last_change":"2024-09-12T00:31:58.173821+0000","last_active":"2024-09-12T01:27:47.333302+0000","last_peered":"2024-09-12T01:27:47.333302+0000","last_clean":"2024-09-12T01:27:47.333302+0000","last_became_active":"2024-09-12T00:31:58.173552+0000","last_became_peered":"2024-09-12T00:31:58.173552+0000","last_unstale":"2024-09-12T01:27:47.333302+0000","last_undegraded":"2024-09-12T01:27:47.333302+0000","last_fullsized":"2024-09-12T01:27:47.333302+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:10.224892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":198,"num_write":331,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'107","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:30.776968+0000","last_change":"2024-09-12T00:31:50.133388+0000","last_active":"2024-09-12T01:25:30.776968+0000","last_peered":"2024-09-12T01:25:30.776968+0000","last_clean":"2024-09-12T01:25:30.776968+0000","last_became_active":"2024-09-12T00:31:50.133117+0000","last_became_peered":"2024-09-12T00:31:50.133117+0000","last_unstale":"2024-09-12T01:25:30.776968+0000","last_undegraded":"2024-09-12T01:25:30.776968+0000","last_fullsized":"2024-09-12T01:25:30.776968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:46.615971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":426,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'349","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:57.488614+0000","last_change":"2024-09-12T00:31:47.127969+0000","last_active":"2024-09-12T01:24:57.488614+0000","last_peered":"2024-09-12T01:24:57.488614+0000","last_clean":"2024-09-12T01:24:57.488614+0000","last_became_active":"2024-09-12T00:31:47.127603+0000","last_became_peered":"2024-09-12T00:31:47.127603+0000","last_unstale":"2024-09-12T01:24:57.488614+0000","last_undegraded":"2024-09-12T01:24:57.488614+0000","last_fullsized":"2024-09-12T01:24:57.488614+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:19.029593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12062135,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":758,"num_read_kb":29446,"num_write":1280,"num_write_kb":48637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718269+0000","last_change":"2024-09-12T00:31:52.152698+0000","last_active":"2024-09-12T01:25:34.718269+0000","last_peered":"2024-09-12T01:25:34.718269+0000","last_clean":"2024-09-12T01:25:34.718269+0000","last_became_active":"2024-09-12T00:31:52.152398+0000","last_became_peered":"2024-09-12T00:31:52.152398+0000","last_unstale":"2024-09-12T01:25:34.718269+0000","last_undegraded":"2024-09-12T01:25:34.718269+0000","last_fullsized":"2024-09-12T01:25:34.718269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:18.608839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'272","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.316191+0000","last_change":"2024-09-12T00:31:54.171666+0000","last_active":"2024-09-12T01:28:55.316191+0000","last_peered":"2024-09-12T01:28:55.316191+0000","last_clean":"2024-09-12T01:28:55.316191+0000","last_became_active":"2024-09-12T00:31:54.171386+0000","last_became_peered":"2024-09-12T00:31:54.171386+0000","last_unstale":"2024-09-12T01:28:55.316191+0000","last_undegraded":"2024-09-12T01:28:55.316191+0000","last_fullsized":"2024-09-12T01:28:55.316191+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:37.250983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":949,"num_write":370,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:35.777911+0000","last_change":"2024-09-12T00:31:56.167578+0000","last_active":"2024-09-12T01:25:35.777911+0000","last_peered":"2024-09-12T01:25:35.777911+0000","last_clean":"2024-09-12T01:25:35.777911+0000","last_became_active":"2024-09-12T00:31:56.167213+0000","last_became_peered":"2024-09-12T00:31:56.167213+0000","last_unstale":"2024-09-12T01:25:35.777911+0000","last_undegraded":"2024-09-12T01:25:35.777911+0000","last_fullsized":"2024-09-12T01:25:35.777911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:56.884166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'120","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.353194+0000","last_change":"2024-09-12T00:31:50.140157+0000","last_active":"2024-09-12T01:26:44.353194+0000","last_peered":"2024-09-12T01:26:44.353194+0000","last_clean":"2024-09-12T01:26:44.353194+0000","last_became_active":"2024-09-12T00:31:50.139863+0000","last_became_peered":"2024-09-12T00:31:50.139863+0000","last_unstale":"2024-09-12T01:26:44.353194+0000","last_undegraded":"2024-09-12T01:26:44.353194+0000","last_fullsized":"2024-09-12T01:26:44.353194+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:39.011610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":466,"num_write":169,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'378","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:47.860770+0000","last_change":"2024-09-12T00:31:47.133721+0000","last_active":"2024-09-12T01:28:47.860770+0000","last_peered":"2024-09-12T01:28:47.860770+0000","last_clean":"2024-09-12T01:28:47.860770+0000","last_became_active":"2024-09-12T00:31:47.133283+0000","last_became_peered":"2024-09-12T00:31:47.133283+0000","last_unstale":"2024-09-12T01:28:47.860770+0000","last_undegraded":"2024-09-12T01:28:47.860770+0000","last_fullsized":"2024-09-12T01:28:47.860770+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:13.162609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4280259,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":673,"num_read_kb":14924,"num_write":1380,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.638064+0000","last_change":"2024-09-12T00:31:52.152988+0000","last_active":"2024-09-12T01:26:05.638064+0000","last_peered":"2024-09-12T01:26:05.638064+0000","last_clean":"2024-09-12T01:26:05.638064+0000","last_became_active":"2024-09-12T00:31:52.152676+0000","last_became_peered":"2024-09-12T00:31:52.152676+0000","last_unstale":"2024-09-12T01:26:05.638064+0000","last_undegraded":"2024-09-12T01:26:05.638064+0000","last_fullsized":"2024-09-12T01:26:05.638064+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:00.660120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'505","reported_seq":1135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.642844+0000","last_change":"2024-09-12T00:31:54.171588+0000","last_active":"2024-09-12T01:29:15.642844+0000","last_peered":"2024-09-12T01:29:15.642844+0000","last_clean":"2024-09-12T01:29:15.642844+0000","last_became_active":"2024-09-12T00:31:54.171225+0000","last_became_peered":"2024-09-12T00:31:54.171225+0000","last_unstale":"2024-09-12T01:29:15.642844+0000","last_undegraded":"2024-09-12T01:29:15.642844+0000","last_fullsized":"2024-09-12T01:29:15.642844+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:56.460340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109241,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":916,"num_read_kb":2120,"num_write":791,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:29.494824+0000","last_change":"2024-09-12T00:31:56.176025+0000","last_active":"2024-09-12T01:24:29.494824+0000","last_peered":"2024-09-12T01:24:29.494824+0000","last_clean":"2024-09-12T01:24:29.494824+0000","last_became_active":"2024-09-12T00:31:56.175562+0000","last_became_peered":"2024-09-12T00:31:56.175562+0000","last_unstale":"2024-09-12T01:24:29.494824+0000","last_undegraded":"2024-09-12T01:24:29.494824+0000","last_fullsized":"2024-09-12T01:24:29.494824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:07.085146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'142","reported_seq":641,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.598076+0000","last_change":"2024-09-12T00:31:58.183054+0000","last_active":"2024-09-12T01:27:47.598076+0000","last_peered":"2024-09-12T01:27:47.598076+0000","last_clean":"2024-09-12T01:27:47.598076+0000","last_became_active":"2024-09-12T00:31:58.182602+0000","last_became_peered":"2024-09-12T00:31:58.182602+0000","last_unstale":"2024-09-12T01:27:47.598076+0000","last_undegraded":"2024-09-12T01:27:47.598076+0000","last_fullsized":"2024-09-12T01:27:47.598076+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:54.264038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":164,"num_write":296,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'135","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501163+0000","last_change":"2024-09-12T00:31:50.132346+0000","last_active":"2024-09-12T01:26:08.501163+0000","last_peered":"2024-09-12T01:26:08.501163+0000","last_clean":"2024-09-12T01:26:08.501163+0000","last_became_active":"2024-09-12T00:31:50.132053+0000","last_became_peered":"2024-09-12T00:31:50.132053+0000","last_unstale":"2024-09-12T01:26:08.501163+0000","last_undegraded":"2024-09-12T01:26:08.501163+0000","last_fullsized":"2024-09-12T01:26:08.501163+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:29.446981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":637,"num_read_kb":540,"num_write":205,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'272","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:36.007345+0000","last_change":"2024-09-12T00:31:47.115298+0000","last_active":"2024-09-12T01:26:36.007345+0000","last_peered":"2024-09-12T01:26:36.007345+0000","last_clean":"2024-09-12T01:26:36.007345+0000","last_became_active":"2024-09-12T00:31:47.114966+0000","last_became_peered":"2024-09-12T00:31:47.114966+0000","last_unstale":"2024-09-12T01:26:36.007345+0000","last_undegraded":"2024-09-12T01:26:36.007345+0000","last_fullsized":"2024-09-12T01:26:36.007345+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:38.967213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604511,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":443,"num_read_kb":26176,"num_write":1060,"num_write_kb":27429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.504979+0000","last_change":"2024-09-12T00:31:52.154420+0000","last_active":"2024-09-12T01:26:04.504979+0000","last_peered":"2024-09-12T01:26:04.504979+0000","last_clean":"2024-09-12T01:26:04.504979+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:26:04.504979+0000","last_undegraded":"2024-09-12T01:26:04.504979+0000","last_fullsized":"2024-09-12T01:26:04.504979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:52.675576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'289","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.317650+0000","last_change":"2024-09-12T00:31:54.166286+0000","last_active":"2024-09-12T01:28:55.317650+0000","last_peered":"2024-09-12T01:28:55.317650+0000","last_clean":"2024-09-12T01:28:55.317650+0000","last_became_active":"2024-09-12T00:31:54.165996+0000","last_became_peered":"2024-09-12T00:31:54.165996+0000","last_unstale":"2024-09-12T01:28:55.317650+0000","last_undegraded":"2024-09-12T01:28:55.317650+0000","last_fullsized":"2024-09-12T01:28:55.317650+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:34.576390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49103,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":905,"num_write":394,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:27.483919+0000","last_change":"2024-09-12T00:31:56.171294+0000","last_active":"2024-09-12T01:24:27.483919+0000","last_peered":"2024-09-12T01:24:27.483919+0000","last_clean":"2024-09-12T01:24:27.483919+0000","last_became_active":"2024-09-12T00:31:56.170994+0000","last_became_peered":"2024-09-12T00:31:56.170994+0000","last_unstale":"2024-09-12T01:24:27.483919+0000","last_undegraded":"2024-09-12T01:24:27.483919+0000","last_fullsized":"2024-09-12T01:24:27.483919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:36.423772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'162","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:06.007997+0000","last_change":"2024-09-12T00:31:58.183946+0000","last_active":"2024-09-12T01:27:06.007997+0000","last_peered":"2024-09-12T01:27:06.007997+0000","last_clean":"2024-09-12T01:27:06.007997+0000","last_became_active":"2024-09-12T00:31:58.183625+0000","last_became_peered":"2024-09-12T00:31:58.183625+0000","last_unstale":"2024-09-12T01:27:06.007997+0000","last_undegraded":"2024-09-12T01:27:06.007997+0000","last_fullsized":"2024-09-12T01:27:06.007997+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:34.434376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2035,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":465,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'119","reported_seq":695,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:20.765834+0000","last_change":"2024-09-12T00:31:50.143762+0000","last_active":"2024-09-12T01:24:20.765834+0000","last_peered":"2024-09-12T01:24:20.765834+0000","last_clean":"2024-09-12T01:24:20.765834+0000","last_became_active":"2024-09-12T00:31:50.143427+0000","last_became_peered":"2024-09-12T00:31:50.143427+0000","last_unstale":"2024-09-12T01:24:20.765834+0000","last_undegraded":"2024-09-12T01:24:20.765834+0000","last_fullsized":"2024-09-12T01:24:20.765834+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:04.603054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":539,"num_read_kb":443,"num_write":196,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'299","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:49.610261+0000","last_change":"2024-09-12T00:31:47.117996+0000","last_active":"2024-09-12T01:26:49.610261+0000","last_peered":"2024-09-12T01:26:49.610261+0000","last_clean":"2024-09-12T01:26:49.610261+0000","last_became_active":"2024-09-12T00:31:47.117631+0000","last_became_peered":"2024-09-12T00:31:47.117631+0000","last_unstale":"2024-09-12T01:26:49.610261+0000","last_undegraded":"2024-09-12T01:26:49.610261+0000","last_fullsized":"2024-09-12T01:26:49.610261+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:35.099357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31853,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":532,"num_read_kb":5850,"num_write":1155,"num_write_kb":26346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:24.494220+0000","last_change":"2024-09-12T00:31:52.152113+0000","last_active":"2024-09-12T01:24:24.494220+0000","last_peered":"2024-09-12T01:24:24.494220+0000","last_clean":"2024-09-12T01:24:24.494220+0000","last_became_active":"2024-09-12T00:31:52.151796+0000","last_became_peered":"2024-09-12T00:31:52.151796+0000","last_unstale":"2024-09-12T01:24:24.494220+0000","last_undegraded":"2024-09-12T01:24:24.494220+0000","last_fullsized":"2024-09-12T01:24:24.494220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:30.115077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'312","reported_seq":893,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.924627+0000","last_change":"2024-09-12T00:31:54.171225+0000","last_active":"2024-09-12T01:29:14.924627+0000","last_peered":"2024-09-12T01:29:14.924627+0000","last_clean":"2024-09-12T01:29:14.924627+0000","last_became_active":"2024-09-12T00:31:54.170965+0000","last_became_peered":"2024-09-12T00:31:54.170965+0000","last_unstale":"2024-09-12T01:29:14.924627+0000","last_undegraded":"2024-09-12T01:29:14.924627+0000","last_fullsized":"2024-09-12T01:29:14.924627+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:10.738478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":509,"num_read_kb":1155,"num_write":420,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782663+0000","last_change":"2024-09-12T00:31:56.172806+0000","last_active":"2024-09-12T01:26:05.782663+0000","last_peered":"2024-09-12T01:26:05.782663+0000","last_clean":"2024-09-12T01:26:05.782663+0000","last_became_active":"2024-09-12T00:31:56.172337+0000","last_became_peered":"2024-09-12T00:31:56.172337+0000","last_unstale":"2024-09-12T01:26:05.782663+0000","last_undegraded":"2024-09-12T01:26:05.782663+0000","last_fullsized":"2024-09-12T01:26:05.782663+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:10.789777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'133","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.342581+0000","last_change":"2024-09-12T00:31:58.178826+0000","last_active":"2024-09-12T01:28:55.342581+0000","last_peered":"2024-09-12T01:28:55.342581+0000","last_clean":"2024-09-12T01:28:55.342581+0000","last_became_active":"2024-09-12T00:31:58.178565+0000","last_became_peered":"2024-09-12T00:31:58.178565+0000","last_unstale":"2024-09-12T01:28:55.342581+0000","last_undegraded":"2024-09-12T01:28:55.342581+0000","last_fullsized":"2024-09-12T01:28:55.342581+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:10.421354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":335,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'510","reported_seq":1278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:38.996474+0000","last_change":"2024-09-12T00:31:50.138366+0000","last_active":"2024-09-12T01:24:38.996474+0000","last_peered":"2024-09-12T01:24:38.996474+0000","last_clean":"2024-09-12T01:24:38.996474+0000","last_became_active":"2024-09-12T00:31:50.137671+0000","last_became_peered":"2024-09-12T00:31:50.137671+0000","last_unstale":"2024-09-12T01:24:38.996474+0000","last_undegraded":"2024-09-12T01:24:38.996474+0000","last_fullsized":"2024-09-12T01:24:38.996474+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:54.842903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2432,"num_read_kb":2072,"num_write":871,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'394","reported_seq":1201,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:18.485370+0000","last_change":"2024-09-12T00:31:47.130554+0000","last_active":"2024-09-12T01:24:18.485370+0000","last_peered":"2024-09-12T01:24:18.485370+0000","last_clean":"2024-09-12T01:24:18.485370+0000","last_became_active":"2024-09-12T00:31:47.130035+0000","last_became_peered":"2024-09-12T00:31:47.130035+0000","last_unstale":"2024-09-12T01:24:18.485370+0000","last_undegraded":"2024-09-12T01:24:18.485370+0000","last_fullsized":"2024-09-12T01:24:18.485370+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:20.320045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16831379,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":1005,"num_read_kb":24732,"num_write":1235,"num_write_kb":48327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:23.486245+0000","last_change":"2024-09-12T00:31:52.156699+0000","last_active":"2024-09-12T01:24:23.486245+0000","last_peered":"2024-09-12T01:24:23.486245+0000","last_clean":"2024-09-12T01:24:23.486245+0000","last_became_active":"2024-09-12T00:31:52.155279+0000","last_became_peered":"2024-09-12T00:31:52.155279+0000","last_unstale":"2024-09-12T01:24:23.486245+0000","last_undegraded":"2024-09-12T01:24:23.486245+0000","last_fullsized":"2024-09-12T01:24:23.486245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:38.156587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'113","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.722904+0000","last_change":"2024-09-12T00:31:54.166092+0000","last_active":"2024-09-12T01:25:59.722904+0000","last_peered":"2024-09-12T01:25:59.722904+0000","last_clean":"2024-09-12T01:25:59.722904+0000","last_became_active":"2024-09-12T00:31:54.165779+0000","last_became_peered":"2024-09-12T00:31:54.165779+0000","last_unstale":"2024-09-12T01:25:59.722904+0000","last_undegraded":"2024-09-12T01:25:59.722904+0000","last_fullsized":"2024-09-12T01:25:59.722904+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:53.134965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":137,"num_write":154,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'759","reported_seq":2335,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.291733+0000","last_change":"2024-09-12T00:31:56.172869+0000","last_active":"2024-09-12T01:29:14.291733+0000","last_peered":"2024-09-12T01:29:14.291733+0000","last_clean":"2024-09-12T01:29:14.291733+0000","last_became_active":"2024-09-12T00:31:56.172551+0000","last_became_peered":"2024-09-12T00:31:56.172551+0000","last_unstale":"2024-09-12T01:29:14.291733+0000","last_undegraded":"2024-09-12T01:29:14.291733+0000","last_fullsized":"2024-09-12T01:29:14.291733+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:33.670974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'121","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:33.597265+0000","last_change":"2024-09-12T00:31:58.178960+0000","last_active":"2024-09-12T01:26:33.597265+0000","last_peered":"2024-09-12T01:26:33.597265+0000","last_clean":"2024-09-12T01:26:33.597265+0000","last_became_active":"2024-09-12T00:31:58.178671+0000","last_became_peered":"2024-09-12T00:31:58.178671+0000","last_unstale":"2024-09-12T01:26:33.597265+0000","last_undegraded":"2024-09-12T01:26:33.597265+0000","last_fullsized":"2024-09-12T01:26:33.597265+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:53.455583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'144","reported_seq":783,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:51.703973+0000","last_change":"2024-09-12T00:31:50.143687+0000","last_active":"2024-09-12T01:25:51.703973+0000","last_peered":"2024-09-12T01:25:51.703973+0000","last_clean":"2024-09-12T01:25:51.703973+0000","last_became_active":"2024-09-12T00:31:50.143377+0000","last_became_peered":"2024-09-12T00:31:50.143377+0000","last_unstale":"2024-09-12T01:25:51.703973+0000","last_undegraded":"2024-09-12T01:25:51.703973+0000","last_fullsized":"2024-09-12T01:25:51.703973+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:37.794802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":664,"num_read_kb":566,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'320","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.376450+0000","last_change":"2024-09-12T00:31:47.129018+0000","last_active":"2024-09-12T01:29:14.376450+0000","last_peered":"2024-09-12T01:29:14.376450+0000","last_clean":"2024-09-12T01:29:14.376450+0000","last_became_active":"2024-09-12T00:31:47.128555+0000","last_became_peered":"2024-09-12T00:31:47.128555+0000","last_unstale":"2024-09-12T01:29:14.376450+0000","last_undegraded":"2024-09-12T01:29:14.376450+0000","last_fullsized":"2024-09-12T01:29:14.376450+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:57.399019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2861896,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":676,"num_read_kb":10967,"num_write":1198,"num_write_kb":23618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:24.594787+0000","last_change":"2024-09-12T00:31:52.151155+0000","last_active":"2024-09-12T01:24:24.594787+0000","last_peered":"2024-09-12T01:24:24.594787+0000","last_clean":"2024-09-12T01:24:24.594787+0000","last_became_active":"2024-09-12T00:31:52.150825+0000","last_became_peered":"2024-09-12T00:31:52.150825+0000","last_unstale":"2024-09-12T01:24:24.594787+0000","last_undegraded":"2024-09-12T01:24:24.594787+0000","last_fullsized":"2024-09-12T01:24:24.594787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:11.561537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'340","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.306588+0000","last_change":"2024-09-12T00:31:54.169556+0000","last_active":"2024-09-12T01:28:55.306588+0000","last_peered":"2024-09-12T01:28:55.306588+0000","last_clean":"2024-09-12T01:28:55.306588+0000","last_became_active":"2024-09-12T00:31:54.169308+0000","last_became_peered":"2024-09-12T00:31:54.169308+0000","last_unstale":"2024-09-12T01:28:55.306588+0000","last_undegraded":"2024-09-12T01:28:55.306588+0000","last_fullsized":"2024-09-12T01:28:55.306588+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:17.921463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55044,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":545,"num_read_kb":1036,"num_write":440,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:08.492547+0000","last_change":"2024-09-12T00:31:56.173701+0000","last_active":"2024-09-12T01:25:08.492547+0000","last_peered":"2024-09-12T01:25:08.492547+0000","last_clean":"2024-09-12T01:25:08.492547+0000","last_became_active":"2024-09-12T00:31:56.173389+0000","last_became_peered":"2024-09-12T00:31:56.173389+0000","last_unstale":"2024-09-12T01:25:08.492547+0000","last_undegraded":"2024-09-12T01:25:08.492547+0000","last_fullsized":"2024-09-12T01:25:08.492547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:28.642695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'140","reported_seq":639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:34.516248+0000","last_change":"2024-09-12T00:31:58.183381+0000","last_active":"2024-09-12T01:27:34.516248+0000","last_peered":"2024-09-12T01:27:34.516248+0000","last_clean":"2024-09-12T01:27:34.516248+0000","last_became_active":"2024-09-12T00:31:58.183017+0000","last_became_peered":"2024-09-12T00:31:58.183017+0000","last_unstale":"2024-09-12T01:27:34.516248+0000","last_undegraded":"2024-09-12T01:27:34.516248+0000","last_fullsized":"2024-09-12T01:27:34.516248+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:38.690748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":129,"num_write":333,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'129","reported_seq":739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.390615+0000","last_change":"2024-09-12T00:31:50.137190+0000","last_active":"2024-09-12T01:28:54.390615+0000","last_peered":"2024-09-12T01:28:54.390615+0000","last_clean":"2024-09-12T01:28:54.390615+0000","last_became_active":"2024-09-12T00:31:50.136941+0000","last_became_peered":"2024-09-12T00:31:50.136941+0000","last_unstale":"2024-09-12T01:28:54.390615+0000","last_undegraded":"2024-09-12T01:28:54.390615+0000","last_fullsized":"2024-09-12T01:28:54.390615+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:49.870575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":653,"num_read_kb":587,"num_write":190,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'280","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.707659+0000","last_change":"2024-09-12T00:31:47.133016+0000","last_active":"2024-09-12T01:29:14.707659+0000","last_peered":"2024-09-12T01:29:14.707659+0000","last_clean":"2024-09-12T01:29:14.707659+0000","last_became_active":"2024-09-12T00:31:47.131600+0000","last_became_peered":"2024-09-12T00:31:47.131600+0000","last_unstale":"2024-09-12T01:29:14.707659+0000","last_undegraded":"2024-09-12T01:29:14.707659+0000","last_fullsized":"2024-09-12T01:29:14.707659+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:24.795534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10811612,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":434,"num_read_kb":43308,"num_write":1037,"num_write_kb":38822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:24.494193+0000","last_change":"2024-09-12T00:31:52.152831+0000","last_active":"2024-09-12T01:24:24.494193+0000","last_peered":"2024-09-12T01:24:24.494193+0000","last_clean":"2024-09-12T01:24:24.494193+0000","last_became_active":"2024-09-12T00:31:52.152537+0000","last_became_peered":"2024-09-12T00:31:52.152537+0000","last_unstale":"2024-09-12T01:24:24.494193+0000","last_undegraded":"2024-09-12T01:24:24.494193+0000","last_fullsized":"2024-09-12T01:24:24.494193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:58.263055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'276","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:28.512446+0000","last_change":"2024-09-12T00:31:54.164435+0000","last_active":"2024-09-12T01:27:28.512446+0000","last_peered":"2024-09-12T01:27:28.512446+0000","last_clean":"2024-09-12T01:27:28.512446+0000","last_became_active":"2024-09-12T00:31:54.163977+0000","last_became_peered":"2024-09-12T00:31:54.163977+0000","last_unstale":"2024-09-12T01:27:28.512446+0000","last_undegraded":"2024-09-12T01:27:28.512446+0000","last_fullsized":"2024-09-12T01:27:28.512446+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:06.747649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54013,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":902,"num_write":362,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.716184+0000","last_change":"2024-09-12T00:31:56.171991+0000","last_active":"2024-09-12T01:25:14.716184+0000","last_peered":"2024-09-12T01:25:14.716184+0000","last_clean":"2024-09-12T01:25:14.716184+0000","last_became_active":"2024-09-12T00:31:56.171306+0000","last_became_peered":"2024-09-12T00:31:56.171306+0000","last_unstale":"2024-09-12T01:25:14.716184+0000","last_undegraded":"2024-09-12T01:25:14.716184+0000","last_fullsized":"2024-09-12T01:25:14.716184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:32.961885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'124","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:53.708398+0000","last_change":"2024-09-12T00:31:58.183063+0000","last_active":"2024-09-12T01:26:53.708398+0000","last_peered":"2024-09-12T01:26:53.708398+0000","last_clean":"2024-09-12T01:26:53.708398+0000","last_became_active":"2024-09-12T00:31:58.182701+0000","last_became_peered":"2024-09-12T00:31:58.182701+0000","last_unstale":"2024-09-12T01:26:53.708398+0000","last_undegraded":"2024-09-12T01:26:53.708398+0000","last_fullsized":"2024-09-12T01:26:53.708398+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:26.910205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":215,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'42","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:10.774133+0000","last_change":"2024-09-12T00:31:50.137242+0000","last_active":"2024-09-12T01:25:10.774133+0000","last_peered":"2024-09-12T01:25:10.774133+0000","last_clean":"2024-09-12T01:25:10.774133+0000","last_became_active":"2024-09-12T00:31:50.136971+0000","last_became_peered":"2024-09-12T00:31:50.136971+0000","last_unstale":"2024-09-12T01:25:10.774133+0000","last_undegraded":"2024-09-12T01:25:10.774133+0000","last_fullsized":"2024-09-12T01:25:10.774133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:43.613753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":180,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'277","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:29.947548+0000","last_change":"2024-09-12T00:31:47.123731+0000","last_active":"2024-09-12T01:27:29.947548+0000","last_peered":"2024-09-12T01:27:29.947548+0000","last_clean":"2024-09-12T01:27:29.947548+0000","last_became_active":"2024-09-12T00:31:47.123001+0000","last_became_peered":"2024-09-12T00:31:47.123001+0000","last_unstale":"2024-09-12T01:27:29.947548+0000","last_undegraded":"2024-09-12T01:27:29.947548+0000","last_fullsized":"2024-09-12T01:27:29.947548+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:56.448580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15489161,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":440,"num_read_kb":39605,"num_write":1019,"num_write_kb":26742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.599267+0000","last_change":"2024-09-12T00:31:52.151290+0000","last_active":"2024-09-12T01:25:04.599267+0000","last_peered":"2024-09-12T01:25:04.599267+0000","last_clean":"2024-09-12T01:25:04.599267+0000","last_became_active":"2024-09-12T00:31:52.150969+0000","last_became_peered":"2024-09-12T00:31:52.150969+0000","last_unstale":"2024-09-12T01:25:04.599267+0000","last_undegraded":"2024-09-12T01:25:04.599267+0000","last_fullsized":"2024-09-12T01:25:04.599267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:12.373364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'257","reported_seq":815,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.791165+0000","last_change":"2024-09-12T00:31:54.170159+0000","last_active":"2024-09-12T01:29:14.791165+0000","last_peered":"2024-09-12T01:29:14.791165+0000","last_clean":"2024-09-12T01:29:14.791165+0000","last_became_active":"2024-09-12T00:31:54.169845+0000","last_became_peered":"2024-09-12T00:31:54.169845+0000","last_unstale":"2024-09-12T01:29:14.791165+0000","last_undegraded":"2024-09-12T01:29:14.791165+0000","last_fullsized":"2024-09-12T01:29:14.791165+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:44.500869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47509,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":435,"num_read_kb":1050,"num_write":360,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:29.710613+0000","last_change":"2024-09-12T00:31:56.171144+0000","last_active":"2024-09-12T01:24:29.710613+0000","last_peered":"2024-09-12T01:24:29.710613+0000","last_clean":"2024-09-12T01:24:29.710613+0000","last_became_active":"2024-09-12T00:31:56.170767+0000","last_became_peered":"2024-09-12T00:31:56.170767+0000","last_unstale":"2024-09-12T01:24:29.710613+0000","last_undegraded":"2024-09-12T01:24:29.710613+0000","last_fullsized":"2024-09-12T01:24:29.710613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:18.923254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'182","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:45.513528+0000","last_change":"2024-09-12T00:31:58.173318+0000","last_active":"2024-09-12T01:27:45.513528+0000","last_peered":"2024-09-12T01:27:45.513528+0000","last_clean":"2024-09-12T01:27:45.513528+0000","last_became_active":"2024-09-12T00:31:58.173049+0000","last_became_peered":"2024-09-12T00:31:58.173049+0000","last_unstale":"2024-09-12T01:27:45.513528+0000","last_undegraded":"2024-09-12T01:27:45.513528+0000","last_fullsized":"2024-09-12T01:27:45.513528+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:38.032229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1227,"num_read_kb":1215,"num_write":440,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'220","reported_seq":785,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:51.961896+0000","last_change":"2024-09-12T00:31:50.141286+0000","last_active":"2024-09-12T01:26:51.961896+0000","last_peered":"2024-09-12T01:26:51.961896+0000","last_clean":"2024-09-12T01:26:51.961896+0000","last_became_active":"2024-09-12T00:31:50.141009+0000","last_became_peered":"2024-09-12T00:31:50.141009+0000","last_unstale":"2024-09-12T01:26:51.961896+0000","last_undegraded":"2024-09-12T01:26:51.961896+0000","last_fullsized":"2024-09-12T01:26:51.961896+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:16.669109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":914,"num_read_kb":727,"num_write":339,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'323","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:57.497740+0000","last_change":"2024-09-12T00:31:47.118759+0000","last_active":"2024-09-12T01:25:57.497740+0000","last_peered":"2024-09-12T01:25:57.497740+0000","last_clean":"2024-09-12T01:25:57.497740+0000","last_became_active":"2024-09-12T00:31:47.118434+0000","last_became_peered":"2024-09-12T00:31:47.118434+0000","last_unstale":"2024-09-12T01:25:57.497740+0000","last_undegraded":"2024-09-12T01:25:57.497740+0000","last_fullsized":"2024-09-12T01:25:57.497740+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:02.477229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3404,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":551,"num_read_kb":10819,"num_write":1179,"num_write_kb":40782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:18.494021+0000","last_change":"2024-09-12T00:31:52.149493+0000","last_active":"2024-09-12T01:25:18.494021+0000","last_peered":"2024-09-12T01:25:18.494021+0000","last_clean":"2024-09-12T01:25:18.494021+0000","last_became_active":"2024-09-12T00:31:52.148440+0000","last_became_peered":"2024-09-12T00:31:52.148440+0000","last_unstale":"2024-09-12T01:25:18.494021+0000","last_undegraded":"2024-09-12T01:25:18.494021+0000","last_fullsized":"2024-09-12T01:25:18.494021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:59.545517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'306","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.336903+0000","last_change":"2024-09-12T00:31:54.168195+0000","last_active":"2024-09-12T01:28:55.336903+0000","last_peered":"2024-09-12T01:28:55.336903+0000","last_clean":"2024-09-12T01:28:55.336903+0000","last_became_active":"2024-09-12T00:31:54.167915+0000","last_became_peered":"2024-09-12T00:31:54.167915+0000","last_unstale":"2024-09-12T01:28:55.336903+0000","last_undegraded":"2024-09-12T01:28:55.336903+0000","last_fullsized":"2024-09-12T01:28:55.336903+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:50.298831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54102,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":979,"num_write":400,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:28.487167+0000","last_change":"2024-09-12T00:31:56.174946+0000","last_active":"2024-09-12T01:24:28.487167+0000","last_peered":"2024-09-12T01:24:28.487167+0000","last_clean":"2024-09-12T01:24:28.487167+0000","last_became_active":"2024-09-12T00:31:56.171654+0000","last_became_peered":"2024-09-12T00:31:56.171654+0000","last_unstale":"2024-09-12T01:24:28.487167+0000","last_undegraded":"2024-09-12T01:24:28.487167+0000","last_fullsized":"2024-09-12T01:24:28.487167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:00.032668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'130","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.389173+0000","last_change":"2024-09-12T00:31:58.182334+0000","last_active":"2024-09-12T01:28:54.389173+0000","last_peered":"2024-09-12T01:28:54.389173+0000","last_clean":"2024-09-12T01:28:54.389173+0000","last_became_active":"2024-09-12T00:31:58.181864+0000","last_became_peered":"2024-09-12T00:31:58.181864+0000","last_unstale":"2024-09-12T01:28:54.389173+0000","last_undegraded":"2024-09-12T01:28:54.389173+0000","last_fullsized":"2024-09-12T01:28:54.389173+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:46.609359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":169,"num_write":329,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'138","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:53.705713+0000","last_change":"2024-09-12T00:31:50.124123+0000","last_active":"2024-09-12T01:26:53.705713+0000","last_peered":"2024-09-12T01:26:53.705713+0000","last_clean":"2024-09-12T01:26:53.705713+0000","last_became_active":"2024-09-12T00:31:50.123862+0000","last_became_peered":"2024-09-12T00:31:50.123862+0000","last_unstale":"2024-09-12T01:26:53.705713+0000","last_undegraded":"2024-09-12T01:26:53.705713+0000","last_fullsized":"2024-09-12T01:26:53.705713+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:52.021145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":471,"num_write":227,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'289","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.504377+0000","last_change":"2024-09-12T00:31:47.132671+0000","last_active":"2024-09-12T01:25:59.504377+0000","last_peered":"2024-09-12T01:25:59.504377+0000","last_clean":"2024-09-12T01:25:59.504377+0000","last_became_active":"2024-09-12T00:31:47.132236+0000","last_became_peered":"2024-09-12T00:31:47.132236+0000","last_unstale":"2024-09-12T01:25:59.504377+0000","last_undegraded":"2024-09-12T01:25:59.504377+0000","last_fullsized":"2024-09-12T01:25:59.504377+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:26.659884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1244660,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":392,"num_read_kb":4332,"num_write":965,"num_write_kb":17381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'142","reported_seq":730,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.781778+0000","last_change":"2024-09-12T00:31:50.140955+0000","last_active":"2024-09-12T01:26:00.781778+0000","last_peered":"2024-09-12T01:26:00.781778+0000","last_clean":"2024-09-12T01:26:00.781778+0000","last_became_active":"2024-09-12T00:31:50.140649+0000","last_became_peered":"2024-09-12T00:31:50.140649+0000","last_unstale":"2024-09-12T01:26:00.781778+0000","last_undegraded":"2024-09-12T01:26:00.781778+0000","last_fullsized":"2024-09-12T01:26:00.781778+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:11.915558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":475,"num_write":199,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'300","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.715086+0000","last_change":"2024-09-12T00:31:47.126483+0000","last_active":"2024-09-12T01:29:15.715086+0000","last_peered":"2024-09-12T01:29:15.715086+0000","last_clean":"2024-09-12T01:29:15.715086+0000","last_became_active":"2024-09-12T00:31:47.126093+0000","last_became_peered":"2024-09-12T00:31:47.126093+0000","last_unstale":"2024-09-12T01:29:15.715086+0000","last_undegraded":"2024-09-12T01:29:15.715086+0000","last_fullsized":"2024-09-12T01:29:15.715086+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:39.767220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23966,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":428,"num_read_kb":13702,"num_write":963,"num_write_kb":29796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'259","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:37.319605+0000","last_change":"2024-09-12T00:31:50.133329+0000","last_active":"2024-09-12T01:26:37.319605+0000","last_peered":"2024-09-12T01:26:37.319605+0000","last_clean":"2024-09-12T01:26:37.319605+0000","last_became_active":"2024-09-12T00:31:50.132976+0000","last_became_peered":"2024-09-12T00:31:50.132976+0000","last_unstale":"2024-09-12T01:26:37.319605+0000","last_undegraded":"2024-09-12T01:26:37.319605+0000","last_fullsized":"2024-09-12T01:26:37.319605+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:59.147279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1108,"num_read_kb":908,"num_write":394,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'291","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.658143+0000","last_change":"2024-09-12T00:31:47.117320+0000","last_active":"2024-09-12T01:29:14.658143+0000","last_peered":"2024-09-12T01:29:14.658143+0000","last_clean":"2024-09-12T01:29:14.658143+0000","last_became_active":"2024-09-12T00:31:47.117000+0000","last_became_peered":"2024-09-12T00:31:47.117000+0000","last_unstale":"2024-09-12T01:29:14.658143+0000","last_undegraded":"2024-09-12T01:29:14.658143+0000","last_fullsized":"2024-09-12T01:29:14.658143+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:54.678203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505020,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":528,"num_read_kb":34961,"num_write":1098,"num_write_kb":18512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'188","reported_seq":833,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498610+0000","last_change":"2024-09-12T00:31:50.133892+0000","last_active":"2024-09-12T01:26:02.498610+0000","last_peered":"2024-09-12T01:26:02.498610+0000","last_clean":"2024-09-12T01:26:02.498610+0000","last_became_active":"2024-09-12T00:31:50.133634+0000","last_became_peered":"2024-09-12T00:31:50.133634+0000","last_unstale":"2024-09-12T01:26:02.498610+0000","last_undegraded":"2024-09-12T01:26:02.498610+0000","last_fullsized":"2024-09-12T01:26:02.498610+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:48.244378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":708,"num_write":275,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'283","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:53.571928+0000","last_change":"2024-09-12T00:31:47.134781+0000","last_active":"2024-09-12T01:28:53.571928+0000","last_peered":"2024-09-12T01:28:53.571928+0000","last_clean":"2024-09-12T01:28:53.571928+0000","last_became_active":"2024-09-12T00:31:47.132735+0000","last_became_peered":"2024-09-12T00:31:47.132735+0000","last_unstale":"2024-09-12T01:28:53.571928+0000","last_undegraded":"2024-09-12T01:28:53.571928+0000","last_fullsized":"2024-09-12T01:28:53.571928+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:17.832111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7449131,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":379,"num_read_kb":13725,"num_write":878,"num_write_kb":25593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'130","reported_seq":731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501249+0000","last_change":"2024-09-12T00:31:50.139504+0000","last_active":"2024-09-12T01:26:17.501249+0000","last_peered":"2024-09-12T01:26:17.501249+0000","last_clean":"2024-09-12T01:26:17.501249+0000","last_became_active":"2024-09-12T00:31:50.138349+0000","last_became_peered":"2024-09-12T00:31:50.138349+0000","last_unstale":"2024-09-12T01:26:17.501249+0000","last_undegraded":"2024-09-12T01:26:17.501249+0000","last_fullsized":"2024-09-12T01:26:17.501249+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:43.103359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":530,"num_write":219,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'297","reported_seq":935,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.592647+0000","last_change":"2024-09-12T00:31:47.133424+0000","last_active":"2024-09-12T01:29:15.592647+0000","last_peered":"2024-09-12T01:29:15.592647+0000","last_clean":"2024-09-12T01:29:15.592647+0000","last_became_active":"2024-09-12T00:31:47.132959+0000","last_became_peered":"2024-09-12T00:31:47.132959+0000","last_unstale":"2024-09-12T01:29:15.592647+0000","last_undegraded":"2024-09-12T01:29:15.592647+0000","last_fullsized":"2024-09-12T01:29:15.592647+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:33.239107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170482,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":457,"num_read_kb":44221,"num_write":1024,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'150","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.559726+0000","last_change":"2024-09-12T00:31:50.131220+0000","last_active":"2024-09-12T01:26:02.559726+0000","last_peered":"2024-09-12T01:26:02.559726+0000","last_clean":"2024-09-12T01:26:02.559726+0000","last_became_active":"2024-09-12T00:31:50.130915+0000","last_became_peered":"2024-09-12T00:31:50.130915+0000","last_unstale":"2024-09-12T01:26:02.559726+0000","last_undegraded":"2024-09-12T01:26:02.559726+0000","last_fullsized":"2024-09-12T01:26:02.559726+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:53.785801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":628,"num_read_kb":507,"num_write":231,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'308","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.470013+0000","last_change":"2024-09-12T00:31:47.122497+0000","last_active":"2024-09-12T01:29:15.470013+0000","last_peered":"2024-09-12T01:29:15.470013+0000","last_clean":"2024-09-12T01:29:15.470013+0000","last_became_active":"2024-09-12T00:31:47.122164+0000","last_became_peered":"2024-09-12T00:31:47.122164+0000","last_unstale":"2024-09-12T01:29:15.470013+0000","last_undegraded":"2024-09-12T01:29:15.470013+0000","last_fullsized":"2024-09-12T01:29:15.470013+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:50.399458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197518,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":475,"num_read_kb":2267,"num_write":1109,"num_write_kb":17589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'295","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637163+0000","last_change":"2024-09-12T00:31:50.142581+0000","last_active":"2024-09-12T01:26:00.637163+0000","last_peered":"2024-09-12T01:26:00.637163+0000","last_clean":"2024-09-12T01:26:00.637163+0000","last_became_active":"2024-09-12T00:31:50.142283+0000","last_became_peered":"2024-09-12T00:31:50.142283+0000","last_unstale":"2024-09-12T01:26:00.637163+0000","last_undegraded":"2024-09-12T01:26:00.637163+0000","last_fullsized":"2024-09-12T01:26:00.637163+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:05.162707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1272,"num_read_kb":1039,"num_write":466,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'307","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.360768+0000","last_change":"2024-09-12T00:31:47.137276+0000","last_active":"2024-09-12T01:29:14.360768+0000","last_peered":"2024-09-12T01:29:14.360768+0000","last_clean":"2024-09-12T01:29:14.360768+0000","last_became_active":"2024-09-12T00:31:47.136789+0000","last_became_peered":"2024-09-12T00:31:47.136789+0000","last_unstale":"2024-09-12T01:29:14.360768+0000","last_undegraded":"2024-09-12T01:29:14.360768+0000","last_fullsized":"2024-09-12T01:29:14.360768+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:38.463665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12606669,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":478,"num_read_kb":49646,"num_write":1047,"num_write_kb":37962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'129","reported_seq":747,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:02.423209+0000","last_change":"2024-09-12T00:31:50.141135+0000","last_active":"2024-09-12T01:27:02.423209+0000","last_peered":"2024-09-12T01:27:02.423209+0000","last_clean":"2024-09-12T01:27:02.423209+0000","last_became_active":"2024-09-12T00:31:50.140717+0000","last_became_peered":"2024-09-12T00:31:50.140717+0000","last_unstale":"2024-09-12T01:27:02.423209+0000","last_undegraded":"2024-09-12T01:27:02.423209+0000","last_fullsized":"2024-09-12T01:27:02.423209+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:42.301934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":623,"num_read_kb":519,"num_write":184,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'312","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:36.017298+0000","last_change":"2024-09-12T00:31:47.119263+0000","last_active":"2024-09-12T01:26:36.017298+0000","last_peered":"2024-09-12T01:26:36.017298+0000","last_clean":"2024-09-12T01:26:36.017298+0000","last_became_active":"2024-09-12T00:31:47.118928+0000","last_became_peered":"2024-09-12T00:31:47.118928+0000","last_unstale":"2024-09-12T01:26:36.017298+0000","last_undegraded":"2024-09-12T01:26:36.017298+0000","last_fullsized":"2024-09-12T01:26:36.017298+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:35.668011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213136,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":477,"num_read_kb":12199,"num_write":1146,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'133","reported_seq":731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:30.777076+0000","last_change":"2024-09-12T00:31:50.137312+0000","last_active":"2024-09-12T01:25:30.777076+0000","last_peered":"2024-09-12T01:25:30.777076+0000","last_clean":"2024-09-12T01:25:30.777076+0000","last_became_active":"2024-09-12T00:31:50.137034+0000","last_became_peered":"2024-09-12T00:31:50.137034+0000","last_unstale":"2024-09-12T01:25:30.777076+0000","last_undegraded":"2024-09-12T01:25:30.777076+0000","last_fullsized":"2024-09-12T01:25:30.777076+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:39.007332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":471,"num_write":187,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'339","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.697130+0000","last_change":"2024-09-12T00:31:47.119956+0000","last_active":"2024-09-12T01:29:14.697130+0000","last_peered":"2024-09-12T01:29:14.697130+0000","last_clean":"2024-09-12T01:29:14.697130+0000","last_became_active":"2024-09-12T00:31:47.119180+0000","last_became_peered":"2024-09-12T00:31:47.119180+0000","last_unstale":"2024-09-12T01:29:14.697130+0000","last_undegraded":"2024-09-12T01:29:14.697130+0000","last_fullsized":"2024-09-12T01:29:14.697130+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:45.605525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24817333,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":548,"num_read_kb":71015,"num_write":1270,"num_write_kb":54526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'230","reported_seq":877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.475928+0000","last_change":"2024-09-12T00:31:50.132875+0000","last_active":"2024-09-12T01:25:44.475928+0000","last_peered":"2024-09-12T01:25:44.475928+0000","last_clean":"2024-09-12T01:25:44.475928+0000","last_became_active":"2024-09-12T00:31:50.132605+0000","last_became_peered":"2024-09-12T00:31:50.132605+0000","last_unstale":"2024-09-12T01:25:44.475928+0000","last_undegraded":"2024-09-12T01:25:44.475928+0000","last_fullsized":"2024-09-12T01:25:44.475928+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:04.879402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":781,"num_write":348,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'273","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:46.316399+0000","last_change":"2024-09-12T00:31:47.132644+0000","last_active":"2024-09-12T01:28:46.316399+0000","last_peered":"2024-09-12T01:28:46.316399+0000","last_clean":"2024-09-12T01:28:46.316399+0000","last_became_active":"2024-09-12T00:31:47.131895+0000","last_became_peered":"2024-09-12T00:31:47.131895+0000","last_unstale":"2024-09-12T01:28:46.316399+0000","last_undegraded":"2024-09-12T01:28:46.316399+0000","last_fullsized":"2024-09-12T01:28:46.316399+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:28.078176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5674737,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":489,"num_read_kb":1443,"num_write":1041,"num_write_kb":20830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'184","reported_seq":814,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499443+0000","last_change":"2024-09-12T00:31:50.139015+0000","last_active":"2024-09-12T01:26:07.499443+0000","last_peered":"2024-09-12T01:26:07.499443+0000","last_clean":"2024-09-12T01:26:07.499443+0000","last_became_active":"2024-09-12T00:31:50.138649+0000","last_became_peered":"2024-09-12T00:31:50.138649+0000","last_unstale":"2024-09-12T01:26:07.499443+0000","last_undegraded":"2024-09-12T01:26:07.499443+0000","last_fullsized":"2024-09-12T01:26:07.499443+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:22.461723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":823,"num_read_kb":682,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'253","reported_seq":880,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.519215+0000","last_change":"2024-09-12T00:31:47.129430+0000","last_active":"2024-09-12T01:28:04.519215+0000","last_peered":"2024-09-12T01:28:04.519215+0000","last_clean":"2024-09-12T01:28:04.519215+0000","last_became_active":"2024-09-12T00:31:47.128598+0000","last_became_peered":"2024-09-12T00:31:47.128598+0000","last_unstale":"2024-09-12T01:28:04.519215+0000","last_undegraded":"2024-09-12T01:28:04.519215+0000","last_fullsized":"2024-09-12T01:28:04.519215+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:35.351098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116744,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":353,"num_read_kb":69389,"num_write":968,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'97","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.603987+0000","last_change":"2024-09-12T00:31:50.140136+0000","last_active":"2024-09-12T01:25:49.603987+0000","last_peered":"2024-09-12T01:25:49.603987+0000","last_clean":"2024-09-12T01:25:49.603987+0000","last_became_active":"2024-09-12T00:31:50.139830+0000","last_became_peered":"2024-09-12T00:31:50.139830+0000","last_unstale":"2024-09-12T01:25:49.603987+0000","last_undegraded":"2024-09-12T01:25:49.603987+0000","last_fullsized":"2024-09-12T01:25:49.603987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:35.900525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":425,"num_read_kb":351,"num_write":136,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'229","reported_seq":858,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:28.042033+0000","last_change":"2024-09-12T00:31:47.125635+0000","last_active":"2024-09-12T01:27:28.042033+0000","last_peered":"2024-09-12T01:27:28.042033+0000","last_clean":"2024-09-12T01:27:28.042033+0000","last_became_active":"2024-09-12T00:31:47.122486+0000","last_became_peered":"2024-09-12T00:31:47.122486+0000","last_unstale":"2024-09-12T01:27:28.042033+0000","last_undegraded":"2024-09-12T01:27:28.042033+0000","last_fullsized":"2024-09-12T01:27:28.042033+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:37.759045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13182903,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":312,"num_read_kb":24154,"num_write":810,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'114","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.603977+0000","last_change":"2024-09-12T00:31:50.139699+0000","last_active":"2024-09-12T01:25:49.603977+0000","last_peered":"2024-09-12T01:25:49.603977+0000","last_clean":"2024-09-12T01:25:49.603977+0000","last_became_active":"2024-09-12T00:31:50.139416+0000","last_became_peered":"2024-09-12T00:31:50.139416+0000","last_unstale":"2024-09-12T01:25:49.603977+0000","last_undegraded":"2024-09-12T01:25:49.603977+0000","last_fullsized":"2024-09-12T01:25:49.603977+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:19.143533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":414,"num_write":177,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'290","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.369149+0000","last_change":"2024-09-12T00:31:47.131206+0000","last_active":"2024-09-12T01:29:14.369149+0000","last_peered":"2024-09-12T01:29:14.369149+0000","last_clean":"2024-09-12T01:29:14.369149+0000","last_became_active":"2024-09-12T00:31:47.130353+0000","last_became_peered":"2024-09-12T00:31:47.130353+0000","last_unstale":"2024-09-12T01:29:14.369149+0000","last_undegraded":"2024-09-12T01:29:14.369149+0000","last_fullsized":"2024-09-12T01:29:14.369149+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:29.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5557023,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":489,"num_read_kb":8753,"num_write":1120,"num_write_kb":21611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'161","reported_seq":764,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:50.780274+0000","last_change":"2024-09-12T00:31:50.140996+0000","last_active":"2024-09-12T01:25:50.780274+0000","last_peered":"2024-09-12T01:25:50.780274+0000","last_clean":"2024-09-12T01:25:50.780274+0000","last_became_active":"2024-09-12T00:31:50.140705+0000","last_became_peered":"2024-09-12T00:31:50.140705+0000","last_unstale":"2024-09-12T01:25:50.780274+0000","last_undegraded":"2024-09-12T01:25:50.780274+0000","last_fullsized":"2024-09-12T01:25:50.780274+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:23.070768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":620,"num_write":277,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'324","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.658574+0000","last_change":"2024-09-12T00:31:47.120623+0000","last_active":"2024-09-12T01:29:14.658574+0000","last_peered":"2024-09-12T01:29:14.658574+0000","last_clean":"2024-09-12T01:29:14.658574+0000","last_became_active":"2024-09-12T00:31:47.120303+0000","last_became_peered":"2024-09-12T00:31:47.120303+0000","last_unstale":"2024-09-12T01:29:14.658574+0000","last_undegraded":"2024-09-12T01:29:14.658574+0000","last_fullsized":"2024-09-12T01:29:14.658574+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:03.740846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2673184,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":641,"num_read_kb":61137,"num_write":1069,"num_write_kb":48224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'210","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:38.380401+0000","last_change":"2024-09-12T00:31:50.134000+0000","last_active":"2024-09-12T01:26:38.380401+0000","last_peered":"2024-09-12T01:26:38.380401+0000","last_clean":"2024-09-12T01:26:38.380401+0000","last_became_active":"2024-09-12T00:31:50.133698+0000","last_became_peered":"2024-09-12T00:31:50.133698+0000","last_unstale":"2024-09-12T01:26:38.380401+0000","last_undegraded":"2024-09-12T01:26:38.380401+0000","last_fullsized":"2024-09-12T01:26:38.380401+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:03.963890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":883,"num_write":372,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'260","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.781779+0000","last_change":"2024-09-12T00:31:47.118141+0000","last_active":"2024-09-12T01:29:15.781779+0000","last_peered":"2024-09-12T01:29:15.781779+0000","last_clean":"2024-09-12T01:29:15.781779+0000","last_became_active":"2024-09-12T00:31:47.117753+0000","last_became_peered":"2024-09-12T00:31:47.117753+0000","last_unstale":"2024-09-12T01:29:15.781779+0000","last_undegraded":"2024-09-12T01:29:15.781779+0000","last_fullsized":"2024-09-12T01:29:15.781779+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:09.782299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2258,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":559,"num_read_kb":553,"num_write":984,"num_write_kb":11415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'4099","reported_seq":4699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605612+0000","last_change":"2024-09-12T00:31:50.145049+0000","last_active":"2024-09-12T01:26:04.605612+0000","last_peered":"2024-09-12T01:26:04.605612+0000","last_clean":"2024-09-12T01:26:04.605612+0000","last_became_active":"2024-09-12T00:31:50.144782+0000","last_became_peered":"2024-09-12T00:31:50.144782+0000","last_unstale":"2024-09-12T01:26:04.605612+0000","last_undegraded":"2024-09-12T01:26:04.605612+0000","last_fullsized":"2024-09-12T01:26:04.605612+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:19.062901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16473,"num_read_kb":13736,"num_write":6146,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'329","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.654496+0000","last_change":"2024-09-12T00:32:23.829074+0000","last_active":"2024-09-12T01:29:15.654496+0000","last_peered":"2024-09-12T01:29:15.654496+0000","last_clean":"2024-09-12T01:29:15.654496+0000","last_became_active":"2024-09-12T00:32:23.828547+0000","last_became_peered":"2024-09-12T00:32:23.828547+0000","last_unstale":"2024-09-12T01:29:15.654496+0000","last_undegraded":"2024-09-12T01:29:15.654496+0000","last_fullsized":"2024-09-12T01:29:15.654496+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:03.711044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2815656,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":632,"num_read_kb":184067,"num_write":1101,"num_write_kb":52781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"265'253","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.679141+0000","last_change":"2024-09-12T00:31:47.123419+0000","last_active":"2024-09-12T01:29:14.679141+0000","last_peered":"2024-09-12T01:29:14.679141+0000","last_clean":"2024-09-12T01:29:14.679141+0000","last_became_active":"2024-09-12T00:31:47.123083+0000","last_became_peered":"2024-09-12T00:31:47.123083+0000","last_unstale":"2024-09-12T01:29:14.679141+0000","last_undegraded":"2024-09-12T01:29:14.679141+0000","last_fullsized":"2024-09-12T01:29:14.679141+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:12.361365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1316039,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":372,"num_read_kb":16597,"num_write":933,"num_write_kb":37945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'178","reported_seq":753,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:18.494115+0000","last_change":"2024-09-12T00:31:50.145133+0000","last_active":"2024-09-12T01:25:18.494115+0000","last_peered":"2024-09-12T01:25:18.494115+0000","last_clean":"2024-09-12T01:25:18.494115+0000","last_became_active":"2024-09-12T00:31:50.144850+0000","last_became_peered":"2024-09-12T00:31:50.144850+0000","last_unstale":"2024-09-12T01:25:18.494115+0000","last_undegraded":"2024-09-12T01:25:18.494115+0000","last_fullsized":"2024-09-12T01:25:18.494115+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:11.930581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":724,"num_read_kb":585,"num_write":260,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'321","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:27.493243+0000","last_change":"2024-09-12T00:31:47.132633+0000","last_active":"2024-09-12T01:25:27.493243+0000","last_peered":"2024-09-12T01:25:27.493243+0000","last_clean":"2024-09-12T01:25:27.493243+0000","last_became_active":"2024-09-12T00:31:47.132149+0000","last_became_peered":"2024-09-12T00:31:47.132149+0000","last_unstale":"2024-09-12T01:25:27.493243+0000","last_undegraded":"2024-09-12T01:25:27.493243+0000","last_fullsized":"2024-09-12T01:25:27.493243+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:43.540773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327701,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":517,"num_read_kb":13770,"num_write":1222,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'126","reported_seq":749,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.598790+0000","last_change":"2024-09-12T00:31:50.137590+0000","last_active":"2024-09-12T01:24:59.598790+0000","last_peered":"2024-09-12T01:24:59.598790+0000","last_clean":"2024-09-12T01:24:59.598790+0000","last_became_active":"2024-09-12T00:31:50.137283+0000","last_became_peered":"2024-09-12T00:31:50.137283+0000","last_unstale":"2024-09-12T01:24:59.598790+0000","last_undegraded":"2024-09-12T01:24:59.598790+0000","last_fullsized":"2024-09-12T01:24:59.598790+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:36.135953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":583,"num_read_kb":491,"num_write":192,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5593,"num_read_kb":3949,"num_write":1897,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1068,"ondisk_log_size":1068,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15046,"num_read_kb":14700,"num_write":16713,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1460,"ondisk_log_size":1460,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":562,"ondisk_log_size":562,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1748465,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17923,"num_read_kb":34386,"num_write":15119,"num_write_kb":11674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2822144,"data_stored":2304957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2013,"ondisk_log_size":2013,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102878,"num_read_kb":85467,"num_write":37260,"num_write_kb":18832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3662,"ondisk_log_size":3662,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":438149271,"num_objects":3839,"num_object_clones":0,"num_object_copies":11517,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3839,"num_whiteouts":0,"num_read":32552,"num_read_kb":1971054,"num_write":67769,"num_write_kb":2047906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":674111488,"data_stored":674111488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4129,"ondisk_log_size":4129,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":51142718,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":120,"num_read_kb":176023,"num_write":140,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90800128,"data_stored":90791245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":57474319,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":115,"num_read_kb":175285,"num_write":137,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":104804352,"data_stored":104797229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477435,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265412,"kb_used_data":63444,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94106428,"statfs":{"total":96636764160,"available":96364982272,"internally_reserved":0,"allocated":64966656,"data_stored":62958487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719477434,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164208,"kb_used_data":74548,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94207632,"statfs":{"total":96636764160,"available":96468615168,"internally_reserved":0,"allocated":76337152,"data_stored":74324248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510140,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":355280,"kb_used_data":161664,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94016560,"statfs":{"total":96636764160,"available":96272957440,"internally_reserved":0,"allocated":165543936,"data_stored":163497980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510139,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243428,"kb_used_data":144212,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94128412,"statfs":{"total":96636764160,"available":96387493888,"internally_reserved":0,"allocated":147673088,"data_stored":145671556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510138,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368580,"kb_used_data":106932,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94003260,"statfs":{"total":96636764160,"available":96259338240,"internally_reserved":0,"allocated":109498368,"data_stored":107427465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510137,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243132,"kb_used_data":149484,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94128708,"statfs":{"total":96636764160,"available":96387796992,"internally_reserved":0,"allocated":153071616,"data_stored":151002207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542840,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308516,"kb_used_data":137172,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94063324,"statfs":{"total":96636764160,"available":96320843776,"internally_reserved":0,"allocated":140464128,"data_stored":138424784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575545,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":377272,"kb_used_data":121256,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93994568,"statfs":{"total":96636764160,"available":96250437632,"internally_reserved":0,"allocated":124166144,"data_stored":122107440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":136622080,"data_stored":136622080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69332992,"data_stored":69332992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102588416,"data_stored":102588416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":107413504,"data_stored":107413504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":115830784,"data_stored":115830784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81645568,"data_stored":81645568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":34283520,"data_stored":34283520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":26394624,"data_stored":26394624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":478346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":473115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":125735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":203127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":396385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":379669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":88273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":160307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23117824,"data_stored":23117098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34643968,"data_stored":34643153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12681216,"data_stored":12679757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15486976,"data_stored":15482853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11575296,"data_stored":11574481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5959680,"data_stored":5957105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11583488,"data_stored":11582762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18923520,"data_stored":18922787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21786624,"data_stored":21782590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:29:17.303 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:29:17.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:29:17.645 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:29:17.658 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T01:29:17.660 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":1992,"stamp":"2024-09-12T01:29:15.847223+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":549122398,"num_objects":4220,"num_object_clones":0,"num_object_copies":12279,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4220,"num_whiteouts":0,"num_read":176708,"num_read_kb":2463795,"num_write":139178,"num_write_kb":2319559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13144,"ondisk_log_size":13144,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2325828,"kb_used_data":958712,"kb_used_omap":12,"kb_used_meta":1366643,"kb_avail":752648892,"statfs":{"total":773094113280,"available":770712465408,"internally_reserved":0,"allocated":981721088,"data_stored":965414167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1399442992},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-87911644,"num_objects":-572,"num_object_clones":0,"num_object_copies":-1711,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-572,"num_whiteouts":0,"num_read":693,"num_read_kb":1037,"num_write":621,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005146"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.506005+0000","last_change":"2024-09-12T01:04:13.467817+0000","last_active":"2024-09-12T01:26:44.506005+0000","last_peered":"2024-09-12T01:26:44.506005+0000","last_clean":"2024-09-12T01:26:44.506005+0000","last_became_active":"2024-09-12T01:04:13.467533+0000","last_became_peered":"2024-09-12T01:04:13.467533+0000","last_unstale":"2024-09-12T01:26:44.506005+0000","last_undegraded":"2024-09-12T01:26:44.506005+0000","last_fullsized":"2024-09-12T01:26:44.506005+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:07.938395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.606697+0000","last_change":"2024-09-12T00:48:45.303400+0000","last_active":"2024-09-12T01:26:14.606697+0000","last_peered":"2024-09-12T01:26:14.606697+0000","last_clean":"2024-09-12T01:26:14.606697+0000","last_became_active":"2024-09-12T00:48:45.303088+0000","last_became_peered":"2024-09-12T00:48:45.303088+0000","last_unstale":"2024-09-12T01:26:14.606697+0000","last_undegraded":"2024-09-12T01:26:14.606697+0000","last_fullsized":"2024-09-12T01:26:14.606697+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:39.588987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.784398+0000","last_change":"2024-09-12T00:48:42.290755+0000","last_active":"2024-09-12T01:26:15.784398+0000","last_peered":"2024-09-12T01:26:15.784398+0000","last_clean":"2024-09-12T01:26:15.784398+0000","last_became_active":"2024-09-12T00:48:42.290471+0000","last_became_peered":"2024-09-12T00:48:42.290471+0000","last_unstale":"2024-09-12T01:26:15.784398+0000","last_undegraded":"2024-09-12T01:26:15.784398+0000","last_fullsized":"2024-09-12T01:26:15.784398+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:55.297347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'15","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:38.496977+0000","last_change":"2024-09-12T00:46:03.918513+0000","last_active":"2024-09-12T01:25:38.496977+0000","last_peered":"2024-09-12T01:25:38.496977+0000","last_clean":"2024-09-12T01:25:38.496977+0000","last_became_active":"2024-09-12T00:46:03.918235+0000","last_became_peered":"2024-09-12T00:46:03.918235+0000","last_unstale":"2024-09-12T01:25:38.496977+0000","last_undegraded":"2024-09-12T01:25:38.496977+0000","last_fullsized":"2024-09-12T01:25:38.496977+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:35.498415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":51,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.643708+0000","last_change":"2024-09-12T01:04:13.463924+0000","last_active":"2024-09-12T01:26:45.643708+0000","last_peered":"2024-09-12T01:26:45.643708+0000","last_clean":"2024-09-12T01:26:45.643708+0000","last_became_active":"2024-09-12T01:04:13.463645+0000","last_became_peered":"2024-09-12T01:04:13.463645+0000","last_unstale":"2024-09-12T01:26:45.643708+0000","last_undegraded":"2024-09-12T01:26:45.643708+0000","last_fullsized":"2024-09-12T01:26:45.643708+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:54.509681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505992+0000","last_change":"2024-09-12T00:48:45.307402+0000","last_active":"2024-09-12T01:26:14.505992+0000","last_peered":"2024-09-12T01:26:14.505992+0000","last_clean":"2024-09-12T01:26:14.505992+0000","last_became_active":"2024-09-12T00:48:45.307070+0000","last_became_peered":"2024-09-12T00:48:45.307070+0000","last_unstale":"2024-09-12T01:26:14.505992+0000","last_undegraded":"2024-09-12T01:26:14.505992+0000","last_fullsized":"2024-09-12T01:26:14.505992+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:35.964072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:12.500496+0000","last_change":"2024-09-12T00:48:42.297130+0000","last_active":"2024-09-12T01:26:12.500496+0000","last_peered":"2024-09-12T01:26:12.500496+0000","last_clean":"2024-09-12T01:26:12.500496+0000","last_became_active":"2024-09-12T00:48:42.296820+0000","last_became_peered":"2024-09-12T00:48:42.296820+0000","last_unstale":"2024-09-12T01:26:12.500496+0000","last_undegraded":"2024-09-12T01:26:12.500496+0000","last_fullsized":"2024-09-12T01:26:12.500496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:03.334198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'17","reported_seq":98,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:18.502535+0000","last_change":"2024-09-12T00:46:03.920083+0000","last_active":"2024-09-12T01:26:18.502535+0000","last_peered":"2024-09-12T01:26:18.502535+0000","last_clean":"2024-09-12T01:26:18.502535+0000","last_became_active":"2024-09-12T00:46:03.919803+0000","last_became_peered":"2024-09-12T00:46:03.919803+0000","last_unstale":"2024-09-12T01:26:18.502535+0000","last_undegraded":"2024-09-12T01:26:18.502535+0000","last_fullsized":"2024-09-12T01:26:18.502535+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:54.982016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":60,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.605056+0000","last_change":"2024-09-12T01:04:13.470732+0000","last_active":"2024-09-12T01:25:59.605056+0000","last_peered":"2024-09-12T01:25:59.605056+0000","last_clean":"2024-09-12T01:25:59.605056+0000","last_became_active":"2024-09-12T01:04:13.470465+0000","last_became_peered":"2024-09-12T01:04:13.470465+0000","last_unstale":"2024-09-12T01:25:59.605056+0000","last_undegraded":"2024-09-12T01:25:59.605056+0000","last_fullsized":"2024-09-12T01:25:59.605056+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:03.442325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'7","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501342+0000","last_change":"2024-09-12T00:48:45.318707+0000","last_active":"2024-09-12T01:26:17.501342+0000","last_peered":"2024-09-12T01:26:17.501342+0000","last_clean":"2024-09-12T01:26:17.501342+0000","last_became_active":"2024-09-12T00:48:45.318423+0000","last_became_peered":"2024-09-12T00:48:45.318423+0000","last_unstale":"2024-09-12T01:26:17.501342+0000","last_undegraded":"2024-09-12T01:26:17.501342+0000","last_fullsized":"2024-09-12T01:26:17.501342+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:02.110177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":17,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:55.790545+0000","last_change":"2024-09-12T00:48:42.292914+0000","last_active":"2024-09-12T01:26:55.790545+0000","last_peered":"2024-09-12T01:26:55.790545+0000","last_clean":"2024-09-12T01:26:55.790545+0000","last_became_active":"2024-09-12T00:48:42.292607+0000","last_became_peered":"2024-09-12T00:48:42.292607+0000","last_unstale":"2024-09-12T01:26:55.790545+0000","last_undegraded":"2024-09-12T01:26:55.790545+0000","last_fullsized":"2024-09-12T01:26:55.790545+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:07.172445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'33","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.638048+0000","last_change":"2024-09-12T00:46:03.918495+0000","last_active":"2024-09-12T01:26:05.638048+0000","last_peered":"2024-09-12T01:26:05.638048+0000","last_clean":"2024-09-12T01:26:05.638048+0000","last_became_active":"2024-09-12T00:46:03.918204+0000","last_became_peered":"2024-09-12T00:46:03.918204+0000","last_unstale":"2024-09-12T01:26:05.638048+0000","last_undegraded":"2024-09-12T01:26:05.638048+0000","last_fullsized":"2024-09-12T01:26:05.638048+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:39.227048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":133,"num_write":46,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499343+0000","last_change":"2024-09-12T01:04:13.465355+0000","last_active":"2024-09-12T01:26:07.499343+0000","last_peered":"2024-09-12T01:26:07.499343+0000","last_clean":"2024-09-12T01:26:07.499343+0000","last_became_active":"2024-09-12T01:04:13.465081+0000","last_became_peered":"2024-09-12T01:04:13.465081+0000","last_unstale":"2024-09-12T01:26:07.499343+0000","last_undegraded":"2024-09-12T01:26:07.499343+0000","last_fullsized":"2024-09-12T01:26:07.499343+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:11.393872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:57.507200+0000","last_change":"2024-09-12T00:48:45.315792+0000","last_active":"2024-09-12T01:26:57.507200+0000","last_peered":"2024-09-12T01:26:57.507200+0000","last_clean":"2024-09-12T01:26:57.507200+0000","last_became_active":"2024-09-12T00:48:45.314837+0000","last_became_peered":"2024-09-12T00:48:45.314837+0000","last_unstale":"2024-09-12T01:26:57.507200+0000","last_undegraded":"2024-09-12T01:26:57.507200+0000","last_fullsized":"2024-09-12T01:26:57.507200+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:45.469413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'8","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.606727+0000","last_change":"2024-09-12T00:48:42.290832+0000","last_active":"2024-09-12T01:26:14.606727+0000","last_peered":"2024-09-12T01:26:14.606727+0000","last_clean":"2024-09-12T01:26:14.606727+0000","last_became_active":"2024-09-12T00:48:42.290570+0000","last_became_peered":"2024-09-12T00:48:42.290570+0000","last_unstale":"2024-09-12T01:26:14.606727+0000","last_undegraded":"2024-09-12T01:26:14.606727+0000","last_fullsized":"2024-09-12T01:26:14.606727+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.754613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":32770,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"262'57","reported_seq":245,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.638031+0000","last_change":"2024-09-12T00:46:03.912889+0000","last_active":"2024-09-12T01:26:05.638031+0000","last_peered":"2024-09-12T01:26:05.638031+0000","last_clean":"2024-09-12T01:26:05.638031+0000","last_became_active":"2024-09-12T00:46:03.912603+0000","last_became_peered":"2024-09-12T00:46:03.912603+0000","last_unstale":"2024-09-12T01:26:05.638031+0000","last_undegraded":"2024-09-12T01:26:05.638031+0000","last_fullsized":"2024-09-12T01:26:05.638031+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:41.505661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":263,"num_write":69,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:20.785335+0000","last_change":"2024-09-12T01:04:13.459054+0000","last_active":"2024-09-12T01:26:20.785335+0000","last_peered":"2024-09-12T01:26:20.785335+0000","last_clean":"2024-09-12T01:26:20.785335+0000","last_became_active":"2024-09-12T01:04:13.458781+0000","last_became_peered":"2024-09-12T01:04:13.458781+0000","last_unstale":"2024-09-12T01:26:20.785335+0000","last_undegraded":"2024-09-12T01:26:20.785335+0000","last_fullsized":"2024-09-12T01:26:20.785335+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:22.643443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'5","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:09.496309+0000","last_change":"2024-09-12T00:48:45.318968+0000","last_active":"2024-09-12T01:25:09.496309+0000","last_peered":"2024-09-12T01:25:09.496309+0000","last_clean":"2024-09-12T01:25:09.496309+0000","last_became_active":"2024-09-12T00:48:45.318608+0000","last_became_peered":"2024-09-12T00:48:45.318608+0000","last_unstale":"2024-09-12T01:25:09.496309+0000","last_undegraded":"2024-09-12T01:25:09.496309+0000","last_fullsized":"2024-09-12T01:25:09.496309+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:29.993435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"265'9","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:57.488448+0000","last_change":"2024-09-12T00:48:42.298222+0000","last_active":"2024-09-12T01:24:57.488448+0000","last_peered":"2024-09-12T01:24:57.488448+0000","last_clean":"2024-09-12T01:24:57.488448+0000","last_became_active":"2024-09-12T00:48:42.297952+0000","last_became_peered":"2024-09-12T00:48:42.297952+0000","last_unstale":"2024-09-12T01:24:57.488448+0000","last_undegraded":"2024-09-12T01:24:57.488448+0000","last_fullsized":"2024-09-12T01:24:57.488448+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:49.640614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6339875,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":16432,"num_write":9,"num_write_kb":16432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'28","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.637984+0000","last_change":"2024-09-12T00:46:03.916594+0000","last_active":"2024-09-12T01:26:05.637984+0000","last_peered":"2024-09-12T01:26:05.637984+0000","last_clean":"2024-09-12T01:26:05.637984+0000","last_became_active":"2024-09-12T00:46:03.915917+0000","last_became_peered":"2024-09-12T00:46:03.915917+0000","last_unstale":"2024-09-12T01:26:05.637984+0000","last_undegraded":"2024-09-12T01:26:05.637984+0000","last_fullsized":"2024-09-12T01:26:05.637984+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:26.873454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:08.509445+0000","last_change":"2024-09-12T01:04:13.465500+0000","last_active":"2024-09-12T01:27:08.509445+0000","last_peered":"2024-09-12T01:27:08.509445+0000","last_clean":"2024-09-12T01:27:08.509445+0000","last_became_active":"2024-09-12T01:04:13.465173+0000","last_became_peered":"2024-09-12T01:04:13.465173+0000","last_unstale":"2024-09-12T01:27:08.509445+0000","last_undegraded":"2024-09-12T01:27:08.509445+0000","last_fullsized":"2024-09-12T01:27:08.509445+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:43.615029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.714047+0000","last_change":"2024-09-12T00:48:45.314920+0000","last_active":"2024-09-12T01:24:59.714047+0000","last_peered":"2024-09-12T01:24:59.714047+0000","last_clean":"2024-09-12T01:24:59.714047+0000","last_became_active":"2024-09-12T00:48:45.313443+0000","last_became_peered":"2024-09-12T00:48:45.313443+0000","last_unstale":"2024-09-12T01:24:59.714047+0000","last_undegraded":"2024-09-12T01:24:59.714047+0000","last_fullsized":"2024-09-12T01:24:59.714047+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:03.806002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'6","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714784+0000","last_change":"2024-09-12T00:48:42.293510+0000","last_active":"2024-09-12T01:25:04.714784+0000","last_peered":"2024-09-12T01:25:04.714784+0000","last_clean":"2024-09-12T01:25:04.714784+0000","last_became_active":"2024-09-12T00:48:42.293128+0000","last_became_peered":"2024-09-12T00:48:42.293128+0000","last_unstale":"2024-09-12T01:25:04.714784+0000","last_undegraded":"2024-09-12T01:25:04.714784+0000","last_fullsized":"2024-09-12T01:25:04.714784+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:35.032026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":20530,"num_write":6,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'40","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.504898+0000","last_change":"2024-09-12T00:46:03.923309+0000","last_active":"2024-09-12T01:26:04.504898+0000","last_peered":"2024-09-12T01:26:04.504898+0000","last_clean":"2024-09-12T01:26:04.504898+0000","last_became_active":"2024-09-12T00:46:03.923029+0000","last_became_peered":"2024-09-12T00:46:03.923029+0000","last_unstale":"2024-09-12T01:26:04.504898+0000","last_undegraded":"2024-09-12T01:26:04.504898+0000","last_fullsized":"2024-09-12T01:26:04.504898+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:20.804221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":145,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.508900+0000","last_change":"2024-09-12T01:04:13.472265+0000","last_active":"2024-09-12T01:26:44.508900+0000","last_peered":"2024-09-12T01:26:44.508900+0000","last_clean":"2024-09-12T01:26:44.508900+0000","last_became_active":"2024-09-12T01:04:13.468832+0000","last_became_peered":"2024-09-12T01:04:13.468832+0000","last_unstale":"2024-09-12T01:26:44.508900+0000","last_undegraded":"2024-09-12T01:26:44.508900+0000","last_fullsized":"2024-09-12T01:26:44.508900+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.832023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505982+0000","last_change":"2024-09-12T00:48:45.309486+0000","last_active":"2024-09-12T01:26:14.505982+0000","last_peered":"2024-09-12T01:26:14.505982+0000","last_clean":"2024-09-12T01:26:14.505982+0000","last_became_active":"2024-09-12T00:48:45.309166+0000","last_became_peered":"2024-09-12T00:48:45.309166+0000","last_unstale":"2024-09-12T01:26:14.505982+0000","last_undegraded":"2024-09-12T01:26:14.505982+0000","last_fullsized":"2024-09-12T01:26:14.505982+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:58.753867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.502933+0000","last_change":"2024-09-12T00:48:42.292429+0000","last_active":"2024-09-12T01:26:14.502933+0000","last_peered":"2024-09-12T01:26:14.502933+0000","last_clean":"2024-09-12T01:26:14.502933+0000","last_became_active":"2024-09-12T00:48:42.291800+0000","last_became_peered":"2024-09-12T00:48:42.291800+0000","last_unstale":"2024-09-12T01:26:14.502933+0000","last_undegraded":"2024-09-12T01:26:14.502933+0000","last_fullsized":"2024-09-12T01:26:14.502933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:58.520610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'17","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:55.771942+0000","last_change":"2024-09-12T00:46:03.913895+0000","last_active":"2024-09-12T01:24:55.771942+0000","last_peered":"2024-09-12T01:24:55.771942+0000","last_clean":"2024-09-12T01:24:55.771942+0000","last_became_active":"2024-09-12T00:46:03.913667+0000","last_became_peered":"2024-09-12T00:46:03.913667+0000","last_unstale":"2024-09-12T01:24:55.771942+0000","last_undegraded":"2024-09-12T01:24:55.771942+0000","last_fullsized":"2024-09-12T01:24:55.771942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:42.230323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":62,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.506059+0000","last_change":"2024-09-12T01:04:13.462929+0000","last_active":"2024-09-12T01:26:44.506059+0000","last_peered":"2024-09-12T01:26:44.506059+0000","last_clean":"2024-09-12T01:26:44.506059+0000","last_became_active":"2024-09-12T01:04:13.462605+0000","last_became_peered":"2024-09-12T01:04:13.462605+0000","last_unstale":"2024-09-12T01:26:44.506059+0000","last_undegraded":"2024-09-12T01:26:44.506059+0000","last_fullsized":"2024-09-12T01:26:44.506059+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:21.801378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:45.807311+0000","last_change":"2024-09-12T00:48:45.314426+0000","last_active":"2024-09-12T01:28:45.807311+0000","last_peered":"2024-09-12T01:28:45.807311+0000","last_clean":"2024-09-12T01:28:45.807311+0000","last_became_active":"2024-09-12T00:48:45.314128+0000","last_became_peered":"2024-09-12T00:48:45.314128+0000","last_unstale":"2024-09-12T01:28:45.807311+0000","last_undegraded":"2024-09-12T01:28:45.807311+0000","last_fullsized":"2024-09-12T01:28:45.807311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:59.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639662+0000","last_change":"2024-09-12T00:48:42.296184+0000","last_active":"2024-09-12T01:26:15.639662+0000","last_peered":"2024-09-12T01:26:15.639662+0000","last_clean":"2024-09-12T01:26:15.639662+0000","last_became_active":"2024-09-12T00:48:42.295886+0000","last_became_peered":"2024-09-12T00:48:42.295886+0000","last_unstale":"2024-09-12T01:26:15.639662+0000","last_undegraded":"2024-09-12T01:26:15.639662+0000","last_fullsized":"2024-09-12T01:26:15.639662+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:20.846127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'14","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:45.624687+0000","last_change":"2024-09-12T00:46:03.919616+0000","last_active":"2024-09-12T01:24:45.624687+0000","last_peered":"2024-09-12T01:24:45.624687+0000","last_clean":"2024-09-12T01:24:45.624687+0000","last_became_active":"2024-09-12T00:46:03.919334+0000","last_became_peered":"2024-09-12T00:46:03.919334+0000","last_unstale":"2024-09-12T01:24:45.624687+0000","last_undegraded":"2024-09-12T01:24:45.624687+0000","last_fullsized":"2024-09-12T01:24:45.624687+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:28.706224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:17.491559+0000","last_change":"2024-09-12T01:04:13.467497+0000","last_active":"2024-09-12T01:25:17.491559+0000","last_peered":"2024-09-12T01:25:17.491559+0000","last_clean":"2024-09-12T01:25:17.491559+0000","last_became_active":"2024-09-12T01:04:13.467230+0000","last_became_peered":"2024-09-12T01:04:13.467230+0000","last_unstale":"2024-09-12T01:25:17.491559+0000","last_undegraded":"2024-09-12T01:25:17.491559+0000","last_fullsized":"2024-09-12T01:25:17.491559+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:19.612980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.862267+0000","last_change":"2024-09-12T00:48:45.309898+0000","last_active":"2024-09-12T01:29:14.862267+0000","last_peered":"2024-09-12T01:29:14.862267+0000","last_clean":"2024-09-12T01:29:14.862267+0000","last_became_active":"2024-09-12T00:48:45.309604+0000","last_became_peered":"2024-09-12T00:48:45.309604+0000","last_unstale":"2024-09-12T01:29:14.862267+0000","last_undegraded":"2024-09-12T01:29:14.862267+0000","last_fullsized":"2024-09-12T01:29:14.862267+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:20.554961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.724362+0000","last_change":"2024-09-12T00:48:42.294022+0000","last_active":"2024-09-12T01:26:09.724362+0000","last_peered":"2024-09-12T01:26:09.724362+0000","last_clean":"2024-09-12T01:26:09.724362+0000","last_became_active":"2024-09-12T00:48:42.293705+0000","last_became_peered":"2024-09-12T00:48:42.293705+0000","last_unstale":"2024-09-12T01:26:09.724362+0000","last_undegraded":"2024-09-12T01:26:09.724362+0000","last_fullsized":"2024-09-12T01:26:09.724362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.053185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'6","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:43.489387+0000","last_change":"2024-09-12T00:46:03.917085+0000","last_active":"2024-09-12T01:24:43.489387+0000","last_peered":"2024-09-12T01:24:43.489387+0000","last_clean":"2024-09-12T01:24:43.489387+0000","last_became_active":"2024-09-12T00:46:03.916699+0000","last_became_peered":"2024-09-12T00:46:03.916699+0000","last_unstale":"2024-09-12T01:24:43.489387+0000","last_undegraded":"2024-09-12T01:24:43.489387+0000","last_fullsized":"2024-09-12T01:24:43.489387+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:46.585826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:15.630269+0000","last_change":"2024-09-12T01:04:13.468912+0000","last_active":"2024-09-12T01:25:15.630269+0000","last_peered":"2024-09-12T01:25:15.630269+0000","last_clean":"2024-09-12T01:25:15.630269+0000","last_became_active":"2024-09-12T01:04:13.468643+0000","last_became_peered":"2024-09-12T01:04:13.468643+0000","last_unstale":"2024-09-12T01:25:15.630269+0000","last_undegraded":"2024-09-12T01:25:15.630269+0000","last_fullsized":"2024-09-12T01:25:15.630269+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:52.505763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'2","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501282+0000","last_change":"2024-09-12T00:48:45.314936+0000","last_active":"2024-09-12T01:26:17.501282+0000","last_peered":"2024-09-12T01:26:17.501282+0000","last_clean":"2024-09-12T01:26:17.501282+0000","last_became_active":"2024-09-12T00:48:45.314212+0000","last_became_peered":"2024-09-12T00:48:45.314212+0000","last_unstale":"2024-09-12T01:26:17.501282+0000","last_undegraded":"2024-09-12T01:26:17.501282+0000","last_fullsized":"2024-09-12T01:26:17.501282+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:22.945070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"265'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.495235+0000","last_change":"2024-09-12T00:48:42.292169+0000","last_active":"2024-09-12T01:24:59.495235+0000","last_peered":"2024-09-12T01:24:59.495235+0000","last_clean":"2024-09-12T01:24:59.495235+0000","last_became_active":"2024-09-12T00:48:42.291818+0000","last_became_peered":"2024-09-12T00:48:42.291818+0000","last_unstale":"2024-09-12T01:24:59.495235+0000","last_undegraded":"2024-09-12T01:24:59.495235+0000","last_fullsized":"2024-09-12T01:24:59.495235+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.276296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'35","reported_seq":142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:43.489359+0000","last_change":"2024-09-12T00:46:03.921103+0000","last_active":"2024-09-12T01:24:43.489359+0000","last_peered":"2024-09-12T01:24:43.489359+0000","last_clean":"2024-09-12T01:24:43.489359+0000","last_became_active":"2024-09-12T00:46:03.920696+0000","last_became_peered":"2024-09-12T00:46:03.920696+0000","last_unstale":"2024-09-12T01:24:43.489359+0000","last_undegraded":"2024-09-12T01:24:43.489359+0000","last_fullsized":"2024-09-12T01:24:43.489359+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:00.908573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.499604+0000","last_change":"2024-09-12T01:04:13.472034+0000","last_active":"2024-09-12T01:25:14.499604+0000","last_peered":"2024-09-12T01:25:14.499604+0000","last_clean":"2024-09-12T01:25:14.499604+0000","last_became_active":"2024-09-12T01:04:13.471741+0000","last_became_peered":"2024-09-12T01:04:13.471741+0000","last_unstale":"2024-09-12T01:25:14.499604+0000","last_undegraded":"2024-09-12T01:25:14.499604+0000","last_fullsized":"2024-09-12T01:25:14.499604+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:37.939219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:00.772877+0000","last_change":"2024-09-12T00:48:45.317881+0000","last_active":"2024-09-12T01:25:00.772877+0000","last_peered":"2024-09-12T01:25:00.772877+0000","last_clean":"2024-09-12T01:25:00.772877+0000","last_became_active":"2024-09-12T00:48:45.317576+0000","last_became_peered":"2024-09-12T00:48:45.317576+0000","last_unstale":"2024-09-12T01:25:00.772877+0000","last_undegraded":"2024-09-12T01:25:00.772877+0000","last_fullsized":"2024-09-12T01:25:00.772877+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:56.133928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":26626,"num_write":6,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"262'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:00.772850+0000","last_change":"2024-09-12T00:48:42.291771+0000","last_active":"2024-09-12T01:25:00.772850+0000","last_peered":"2024-09-12T01:25:00.772850+0000","last_clean":"2024-09-12T01:25:00.772850+0000","last_became_active":"2024-09-12T00:48:42.291199+0000","last_became_peered":"2024-09-12T00:48:42.291199+0000","last_unstale":"2024-09-12T01:25:00.772850+0000","last_undegraded":"2024-09-12T01:25:00.772850+0000","last_fullsized":"2024-09-12T01:25:00.772850+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:37.299502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5165,"num_write":10,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'6","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:45.770639+0000","last_change":"2024-09-12T00:46:03.919765+0000","last_active":"2024-09-12T01:24:45.770639+0000","last_peered":"2024-09-12T01:24:45.770639+0000","last_clean":"2024-09-12T01:24:45.770639+0000","last_became_active":"2024-09-12T00:46:03.919481+0000","last_became_peered":"2024-09-12T00:46:03.919481+0000","last_unstale":"2024-09-12T01:24:45.770639+0000","last_undegraded":"2024-09-12T01:24:45.770639+0000","last_fullsized":"2024-09-12T01:24:45.770639+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:06.767562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.496856+0000","last_change":"2024-09-12T01:04:13.468963+0000","last_active":"2024-09-12T01:25:14.496856+0000","last_peered":"2024-09-12T01:25:14.496856+0000","last_clean":"2024-09-12T01:25:14.496856+0000","last_became_active":"2024-09-12T01:04:13.468317+0000","last_became_peered":"2024-09-12T01:04:13.468317+0000","last_unstale":"2024-09-12T01:25:14.496856+0000","last_undegraded":"2024-09-12T01:25:14.496856+0000","last_fullsized":"2024-09-12T01:25:14.496856+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:50.519451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.495267+0000","last_change":"2024-09-12T00:48:45.315823+0000","last_active":"2024-09-12T01:24:59.495267+0000","last_peered":"2024-09-12T01:24:59.495267+0000","last_clean":"2024-09-12T01:24:59.495267+0000","last_became_active":"2024-09-12T00:48:45.315546+0000","last_became_peered":"2024-09-12T00:48:45.315546+0000","last_unstale":"2024-09-12T01:24:59.495267+0000","last_undegraded":"2024-09-12T01:24:59.495267+0000","last_fullsized":"2024-09-12T01:24:59.495267+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:54.909978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:57.488625+0000","last_change":"2024-09-12T00:48:42.296841+0000","last_active":"2024-09-12T01:24:57.488625+0000","last_peered":"2024-09-12T01:24:57.488625+0000","last_clean":"2024-09-12T01:24:57.488625+0000","last_became_active":"2024-09-12T00:48:42.296509+0000","last_became_peered":"2024-09-12T00:48:42.296509+0000","last_unstale":"2024-09-12T01:24:57.488625+0000","last_undegraded":"2024-09-12T01:24:57.488625+0000","last_fullsized":"2024-09-12T01:24:57.488625+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:00.906884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":14336,"num_write":9,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'52","reported_seq":188,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721709+0000","last_change":"2024-09-12T00:46:03.920474+0000","last_active":"2024-09-12T01:25:49.721709+0000","last_peered":"2024-09-12T01:25:49.721709+0000","last_clean":"2024-09-12T01:25:49.721709+0000","last_became_active":"2024-09-12T00:46:03.920188+0000","last_became_peered":"2024-09-12T00:46:03.920188+0000","last_unstale":"2024-09-12T01:25:49.721709+0000","last_undegraded":"2024-09-12T01:25:49.721709+0000","last_fullsized":"2024-09-12T01:25:49.721709+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:42.736993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":182,"num_write":95,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498632+0000","last_change":"2024-09-12T01:04:13.462848+0000","last_active":"2024-09-12T01:26:02.498632+0000","last_peered":"2024-09-12T01:26:02.498632+0000","last_clean":"2024-09-12T01:26:02.498632+0000","last_became_active":"2024-09-12T01:04:13.462434+0000","last_became_peered":"2024-09-12T01:04:13.462434+0000","last_unstale":"2024-09-12T01:26:02.498632+0000","last_undegraded":"2024-09-12T01:26:02.498632+0000","last_fullsized":"2024-09-12T01:26:02.498632+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:42.830213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499355+0000","last_change":"2024-09-12T00:48:45.316725+0000","last_active":"2024-09-12T01:26:07.499355+0000","last_peered":"2024-09-12T01:26:07.499355+0000","last_clean":"2024-09-12T01:26:07.499355+0000","last_became_active":"2024-09-12T00:48:45.316432+0000","last_became_peered":"2024-09-12T00:48:45.316432+0000","last_unstale":"2024-09-12T01:26:07.499355+0000","last_undegraded":"2024-09-12T01:26:07.499355+0000","last_fullsized":"2024-09-12T01:26:07.499355+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:20.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605590+0000","last_change":"2024-09-12T00:48:42.290754+0000","last_active":"2024-09-12T01:26:04.605590+0000","last_peered":"2024-09-12T01:26:04.605590+0000","last_clean":"2024-09-12T01:26:04.605590+0000","last_became_active":"2024-09-12T00:48:42.290454+0000","last_became_peered":"2024-09-12T00:48:42.290454+0000","last_unstale":"2024-09-12T01:26:04.605590+0000","last_undegraded":"2024-09-12T01:26:04.605590+0000","last_fullsized":"2024-09-12T01:26:04.605590+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:16.245048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"262'7","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.719526+0000","last_change":"2024-09-12T00:46:03.917579+0000","last_active":"2024-09-12T01:25:44.719526+0000","last_peered":"2024-09-12T01:25:44.719526+0000","last_clean":"2024-09-12T01:25:44.719526+0000","last_became_active":"2024-09-12T00:46:03.917314+0000","last_became_peered":"2024-09-12T00:46:03.917314+0000","last_unstale":"2024-09-12T01:25:44.719526+0000","last_undegraded":"2024-09-12T01:25:44.719526+0000","last_fullsized":"2024-09-12T01:25:44.719526+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:21.892403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":13,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637319+0000","last_change":"2024-09-12T01:04:13.467571+0000","last_active":"2024-09-12T01:26:00.637319+0000","last_peered":"2024-09-12T01:26:00.637319+0000","last_clean":"2024-09-12T01:26:00.637319+0000","last_became_active":"2024-09-12T01:04:13.467119+0000","last_became_peered":"2024-09-12T01:04:13.467119+0000","last_unstale":"2024-09-12T01:26:00.637319+0000","last_undegraded":"2024-09-12T01:26:00.637319+0000","last_fullsized":"2024-09-12T01:26:00.637319+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:23.369147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499300+0000","last_change":"2024-09-12T00:48:45.314598+0000","last_active":"2024-09-12T01:26:07.499300+0000","last_peered":"2024-09-12T01:26:07.499300+0000","last_clean":"2024-09-12T01:26:07.499300+0000","last_became_active":"2024-09-12T00:48:45.314127+0000","last_became_peered":"2024-09-12T00:48:45.314127+0000","last_unstale":"2024-09-12T01:26:07.499300+0000","last_undegraded":"2024-09-12T01:26:07.499300+0000","last_fullsized":"2024-09-12T01:26:07.499300+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:00.050328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'5","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498548+0000","last_change":"2024-09-12T00:48:42.293860+0000","last_active":"2024-09-12T01:26:02.498548+0000","last_peered":"2024-09-12T01:26:02.498548+0000","last_clean":"2024-09-12T01:26:02.498548+0000","last_became_active":"2024-09-12T00:48:42.293153+0000","last_became_peered":"2024-09-12T00:48:42.293153+0000","last_unstale":"2024-09-12T01:26:02.498548+0000","last_undegraded":"2024-09-12T01:26:02.498548+0000","last_fullsized":"2024-09-12T01:26:02.498548+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:12.547450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'49","reported_seq":179,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:45.779451+0000","last_change":"2024-09-12T00:46:03.917417+0000","last_active":"2024-09-12T01:25:45.779451+0000","last_peered":"2024-09-12T01:25:45.779451+0000","last_clean":"2024-09-12T01:25:45.779451+0000","last_became_active":"2024-09-12T00:46:03.917142+0000","last_became_peered":"2024-09-12T00:46:03.917142+0000","last_unstale":"2024-09-12T01:25:45.779451+0000","last_undegraded":"2024-09-12T01:25:45.779451+0000","last_fullsized":"2024-09-12T01:25:45.779451+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:12.229825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":172,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:18.494068+0000","last_change":"2024-09-12T01:04:13.464064+0000","last_active":"2024-09-12T01:25:18.494068+0000","last_peered":"2024-09-12T01:25:18.494068+0000","last_clean":"2024-09-12T01:25:18.494068+0000","last_became_active":"2024-09-12T01:04:13.463766+0000","last_became_peered":"2024-09-12T01:04:13.463766+0000","last_unstale":"2024-09-12T01:25:18.494068+0000","last_undegraded":"2024-09-12T01:25:18.494068+0000","last_fullsized":"2024-09-12T01:25:18.494068+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:26.806464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782587+0000","last_change":"2024-09-12T00:48:45.307348+0000","last_active":"2024-09-12T01:26:05.782587+0000","last_peered":"2024-09-12T01:26:05.782587+0000","last_clean":"2024-09-12T01:26:05.782587+0000","last_became_active":"2024-09-12T00:48:45.307036+0000","last_became_peered":"2024-09-12T00:48:45.307036+0000","last_unstale":"2024-09-12T01:26:05.782587+0000","last_undegraded":"2024-09-12T01:26:05.782587+0000","last_fullsized":"2024-09-12T01:26:05.782587+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:21.417276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'4","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605655+0000","last_change":"2024-09-12T00:48:42.294916+0000","last_active":"2024-09-12T01:26:04.605655+0000","last_peered":"2024-09-12T01:26:04.605655+0000","last_clean":"2024-09-12T01:26:04.605655+0000","last_became_active":"2024-09-12T00:48:42.294608+0000","last_became_peered":"2024-09-12T00:48:42.294608+0000","last_unstale":"2024-09-12T01:26:04.605655+0000","last_undegraded":"2024-09-12T01:26:04.605655+0000","last_fullsized":"2024-09-12T01:26:04.605655+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:37.130170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5438,"num_write":4,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.502728+0000","last_change":"2024-09-12T00:46:03.922277+0000","last_active":"2024-09-12T01:25:44.502728+0000","last_peered":"2024-09-12T01:25:44.502728+0000","last_clean":"2024-09-12T01:25:44.502728+0000","last_became_active":"2024-09-12T00:46:03.921844+0000","last_became_peered":"2024-09-12T00:46:03.921844+0000","last_unstale":"2024-09-12T01:25:44.502728+0000","last_undegraded":"2024-09-12T01:25:44.502728+0000","last_fullsized":"2024-09-12T01:25:44.502728+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:57.617387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":67,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637276+0000","last_change":"2024-09-12T01:04:13.462719+0000","last_active":"2024-09-12T01:26:00.637276+0000","last_peered":"2024-09-12T01:26:00.637276+0000","last_clean":"2024-09-12T01:26:00.637276+0000","last_became_active":"2024-09-12T01:04:13.462441+0000","last_became_peered":"2024-09-12T01:04:13.462441+0000","last_unstale":"2024-09-12T01:26:00.637276+0000","last_undegraded":"2024-09-12T01:26:00.637276+0000","last_fullsized":"2024-09-12T01:26:00.637276+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:19.887695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'9","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723555+0000","last_change":"2024-09-12T00:48:45.312937+0000","last_active":"2024-09-12T01:26:04.723555+0000","last_peered":"2024-09-12T01:26:04.723555+0000","last_clean":"2024-09-12T01:26:04.723555+0000","last_became_active":"2024-09-12T00:48:45.312617+0000","last_became_peered":"2024-09-12T00:48:45.312617+0000","last_unstale":"2024-09-12T01:26:04.723555+0000","last_undegraded":"2024-09-12T01:26:04.723555+0000","last_fullsized":"2024-09-12T01:26:04.723555+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:28.386583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5291306,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":20528,"num_write":19,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605671+0000","last_change":"2024-09-12T00:48:42.292806+0000","last_active":"2024-09-12T01:26:04.605671+0000","last_peered":"2024-09-12T01:26:04.605671+0000","last_clean":"2024-09-12T01:26:04.605671+0000","last_became_active":"2024-09-12T00:48:42.292511+0000","last_became_peered":"2024-09-12T00:48:42.292511+0000","last_unstale":"2024-09-12T01:26:04.605671+0000","last_undegraded":"2024-09-12T01:26:04.605671+0000","last_fullsized":"2024-09-12T01:26:04.605671+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:34.992694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'10","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:45.779402+0000","last_change":"2024-09-12T00:46:03.913386+0000","last_active":"2024-09-12T01:25:45.779402+0000","last_peered":"2024-09-12T01:25:45.779402+0000","last_clean":"2024-09-12T01:25:45.779402+0000","last_became_active":"2024-09-12T00:46:03.913098+0000","last_became_peered":"2024-09-12T00:46:03.913098+0000","last_unstale":"2024-09-12T01:25:45.779402+0000","last_undegraded":"2024-09-12T01:25:45.779402+0000","last_fullsized":"2024-09-12T01:25:45.779402+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:03.725529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":36,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498570+0000","last_change":"2024-09-12T01:04:13.474135+0000","last_active":"2024-09-12T01:26:02.498570+0000","last_peered":"2024-09-12T01:26:02.498570+0000","last_clean":"2024-09-12T01:26:02.498570+0000","last_became_active":"2024-09-12T01:04:13.473901+0000","last_became_peered":"2024-09-12T01:04:13.473901+0000","last_unstale":"2024-09-12T01:26:02.498570+0000","last_undegraded":"2024-09-12T01:26:02.498570+0000","last_fullsized":"2024-09-12T01:26:02.498570+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:45.848297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'4","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.711540+0000","last_change":"2024-09-12T00:48:45.308960+0000","last_active":"2024-09-12T01:29:15.711540+0000","last_peered":"2024-09-12T01:29:15.711540+0000","last_clean":"2024-09-12T01:29:15.711540+0000","last_became_active":"2024-09-12T00:48:45.308676+0000","last_became_peered":"2024-09-12T00:48:45.308676+0000","last_unstale":"2024-09-12T01:29:15.711540+0000","last_undegraded":"2024-09-12T01:29:15.711540+0000","last_fullsized":"2024-09-12T01:29:15.711540+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:11.911720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":80,"num_write":9,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'4","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:59.510461+0000","last_change":"2024-09-12T00:48:42.291979+0000","last_active":"2024-09-12T01:26:59.510461+0000","last_peered":"2024-09-12T01:26:59.510461+0000","last_clean":"2024-09-12T01:26:59.510461+0000","last_became_active":"2024-09-12T00:48:42.291569+0000","last_became_peered":"2024-09-12T00:48:42.291569+0000","last_unstale":"2024-09-12T01:26:59.510461+0000","last_undegraded":"2024-09-12T01:26:59.510461+0000","last_fullsized":"2024-09-12T01:26:59.510461+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:20.262872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":9,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'67","reported_seq":233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.789165+0000","last_change":"2024-09-12T00:46:03.920845+0000","last_active":"2024-09-12T01:26:45.789165+0000","last_peered":"2024-09-12T01:26:45.789165+0000","last_clean":"2024-09-12T01:26:45.789165+0000","last_became_active":"2024-09-12T00:46:03.920387+0000","last_became_peered":"2024-09-12T00:46:03.920387+0000","last_unstale":"2024-09-12T01:26:45.789165+0000","last_undegraded":"2024-09-12T01:26:45.789165+0000","last_fullsized":"2024-09-12T01:26:45.789165+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:02.972369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":242,"num_write":122,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.609771+0000","last_change":"2024-09-12T01:04:13.470050+0000","last_active":"2024-09-12T01:26:44.609771+0000","last_peered":"2024-09-12T01:26:44.609771+0000","last_clean":"2024-09-12T01:26:44.609771+0000","last_became_active":"2024-09-12T01:04:13.469544+0000","last_became_peered":"2024-09-12T01:04:13.469544+0000","last_unstale":"2024-09-12T01:26:44.609771+0000","last_undegraded":"2024-09-12T01:26:44.609771+0000","last_fullsized":"2024-09-12T01:26:44.609771+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:57.676504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.791316+0000","last_change":"2024-09-12T00:48:45.310714+0000","last_active":"2024-09-12T01:27:00.791316+0000","last_peered":"2024-09-12T01:27:00.791316+0000","last_clean":"2024-09-12T01:27:00.791316+0000","last_became_active":"2024-09-12T00:48:45.310425+0000","last_became_peered":"2024-09-12T00:48:45.310425+0000","last_unstale":"2024-09-12T01:27:00.791316+0000","last_undegraded":"2024-09-12T01:27:00.791316+0000","last_fullsized":"2024-09-12T01:27:00.791316+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:11.427037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646110+0000","last_change":"2024-09-12T00:48:42.289205+0000","last_active":"2024-09-12T01:27:00.646110+0000","last_peered":"2024-09-12T01:27:00.646110+0000","last_clean":"2024-09-12T01:27:00.646110+0000","last_became_active":"2024-09-12T00:48:42.288750+0000","last_became_peered":"2024-09-12T00:48:42.288750+0000","last_unstale":"2024-09-12T01:27:00.646110+0000","last_undegraded":"2024-09-12T01:27:00.646110+0000","last_fullsized":"2024-09-12T01:27:00.646110+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:03.592679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'39","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.727351+0000","last_change":"2024-09-12T00:46:03.918651+0000","last_active":"2024-09-12T01:26:34.727351+0000","last_peered":"2024-09-12T01:26:34.727351+0000","last_clean":"2024-09-12T01:26:34.727351+0000","last_became_active":"2024-09-12T00:46:03.918395+0000","last_became_peered":"2024-09-12T00:46:03.918395+0000","last_unstale":"2024-09-12T01:26:34.727351+0000","last_undegraded":"2024-09-12T01:26:34.727351+0000","last_fullsized":"2024-09-12T01:26:34.727351+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:06.038629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":130,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.722217+0000","last_change":"2024-09-12T01:04:13.468761+0000","last_active":"2024-09-12T01:25:54.722217+0000","last_peered":"2024-09-12T01:25:54.722217+0000","last_clean":"2024-09-12T01:25:54.722217+0000","last_became_active":"2024-09-12T01:04:13.468492+0000","last_became_peered":"2024-09-12T01:04:13.468492+0000","last_unstale":"2024-09-12T01:25:54.722217+0000","last_undegraded":"2024-09-12T01:25:54.722217+0000","last_fullsized":"2024-09-12T01:25:54.722217+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:23.228261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:55.772046+0000","last_change":"2024-09-12T00:48:45.306987+0000","last_active":"2024-09-12T01:24:55.772046+0000","last_peered":"2024-09-12T01:24:55.772046+0000","last_clean":"2024-09-12T01:24:55.772046+0000","last_became_active":"2024-09-12T00:48:45.306581+0000","last_became_peered":"2024-09-12T00:48:45.306581+0000","last_unstale":"2024-09-12T01:24:55.772046+0000","last_undegraded":"2024-09-12T01:24:55.772046+0000","last_fullsized":"2024-09-12T01:24:55.772046+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:18.025186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.791375+0000","last_change":"2024-09-12T00:48:42.291472+0000","last_active":"2024-09-12T01:27:00.791375+0000","last_peered":"2024-09-12T01:27:00.791375+0000","last_clean":"2024-09-12T01:27:00.791375+0000","last_became_active":"2024-09-12T00:48:42.290069+0000","last_became_peered":"2024-09-12T00:48:42.290069+0000","last_unstale":"2024-09-12T01:27:00.791375+0000","last_undegraded":"2024-09-12T01:27:00.791375+0000","last_fullsized":"2024-09-12T01:27:00.791375+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:06.334859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'22","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.608639+0000","last_change":"2024-09-12T00:46:03.917998+0000","last_active":"2024-09-12T01:26:34.608639+0000","last_peered":"2024-09-12T01:26:34.608639+0000","last_clean":"2024-09-12T01:26:34.608639+0000","last_became_active":"2024-09-12T00:46:03.917612+0000","last_became_peered":"2024-09-12T00:46:03.917612+0000","last_unstale":"2024-09-12T01:26:34.608639+0000","last_undegraded":"2024-09-12T01:26:34.608639+0000","last_fullsized":"2024-09-12T01:26:34.608639+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:25.331801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":67,"num_write":52,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.604479+0000","last_change":"2024-09-12T01:04:13.471829+0000","last_active":"2024-09-12T01:25:54.604479+0000","last_peered":"2024-09-12T01:25:54.604479+0000","last_clean":"2024-09-12T01:25:54.604479+0000","last_became_active":"2024-09-12T01:04:13.470494+0000","last_became_peered":"2024-09-12T01:04:13.470494+0000","last_unstale":"2024-09-12T01:25:54.604479+0000","last_undegraded":"2024-09-12T01:25:54.604479+0000","last_fullsized":"2024-09-12T01:25:54.604479+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:21.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:47.487156+0000","last_change":"2024-09-12T00:48:45.317979+0000","last_active":"2024-09-12T01:24:47.487156+0000","last_peered":"2024-09-12T01:24:47.487156+0000","last_clean":"2024-09-12T01:24:47.487156+0000","last_became_active":"2024-09-12T00:48:45.317637+0000","last_became_peered":"2024-09-12T00:48:45.317637+0000","last_unstale":"2024-09-12T01:24:47.487156+0000","last_undegraded":"2024-09-12T01:24:47.487156+0000","last_fullsized":"2024-09-12T01:24:47.487156+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:51.863153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:55.772057+0000","last_change":"2024-09-12T00:48:42.289582+0000","last_active":"2024-09-12T01:24:55.772057+0000","last_peered":"2024-09-12T01:24:55.772057+0000","last_clean":"2024-09-12T01:24:55.772057+0000","last_became_active":"2024-09-12T00:48:42.289304+0000","last_became_peered":"2024-09-12T00:48:42.289304+0000","last_unstale":"2024-09-12T01:24:55.772057+0000","last_undegraded":"2024-09-12T01:24:55.772057+0000","last_fullsized":"2024-09-12T01:24:55.772057+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:58.432324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":140,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.642226+0000","last_change":"2024-09-12T00:46:03.911642+0000","last_active":"2024-09-12T01:26:35.642226+0000","last_peered":"2024-09-12T01:26:35.642226+0000","last_clean":"2024-09-12T01:26:35.642226+0000","last_became_active":"2024-09-12T00:46:03.911316+0000","last_became_peered":"2024-09-12T00:46:03.911316+0000","last_unstale":"2024-09-12T01:26:35.642226+0000","last_undegraded":"2024-09-12T01:26:35.642226+0000","last_fullsized":"2024-09-12T01:26:35.642226+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:27.292826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":121,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:47.505723+0000","last_change":"2024-09-12T01:04:13.462688+0000","last_active":"2024-09-12T01:26:47.505723+0000","last_peered":"2024-09-12T01:26:47.505723+0000","last_clean":"2024-09-12T01:26:47.505723+0000","last_became_active":"2024-09-12T01:04:13.462150+0000","last_became_peered":"2024-09-12T01:04:13.462150+0000","last_unstale":"2024-09-12T01:26:47.505723+0000","last_undegraded":"2024-09-12T01:26:47.505723+0000","last_fullsized":"2024-09-12T01:26:47.505723+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:43.928057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'2","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718235+0000","last_change":"2024-09-12T00:48:45.312564+0000","last_active":"2024-09-12T01:25:34.718235+0000","last_peered":"2024-09-12T01:25:34.718235+0000","last_clean":"2024-09-12T01:25:34.718235+0000","last_became_active":"2024-09-12T00:48:45.312283+0000","last_became_peered":"2024-09-12T00:48:45.312283+0000","last_unstale":"2024-09-12T01:25:34.718235+0000","last_undegraded":"2024-09-12T01:25:34.718235+0000","last_fullsized":"2024-09-12T01:25:34.718235+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:08.027455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:45.797614+0000","last_change":"2024-09-12T00:48:42.290364+0000","last_active":"2024-09-12T01:27:45.797614+0000","last_peered":"2024-09-12T01:27:45.797614+0000","last_clean":"2024-09-12T01:27:45.797614+0000","last_became_active":"2024-09-12T00:48:42.290091+0000","last_became_peered":"2024-09-12T00:48:42.290091+0000","last_unstale":"2024-09-12T01:27:45.797614+0000","last_undegraded":"2024-09-12T01:27:45.797614+0000","last_fullsized":"2024-09-12T01:27:45.797614+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:37.718174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'27","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.642191+0000","last_change":"2024-09-12T00:46:03.917233+0000","last_active":"2024-09-12T01:26:35.642191+0000","last_peered":"2024-09-12T01:26:35.642191+0000","last_clean":"2024-09-12T01:26:35.642191+0000","last_became_active":"2024-09-12T00:46:03.916476+0000","last_became_peered":"2024-09-12T00:46:03.916476+0000","last_unstale":"2024-09-12T01:26:35.642191+0000","last_undegraded":"2024-09-12T01:26:35.642191+0000","last_fullsized":"2024-09-12T01:26:35.642191+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:29.196991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:54.509963+0000","last_change":"2024-09-12T01:04:13.467457+0000","last_active":"2024-09-12T01:26:54.509963+0000","last_peered":"2024-09-12T01:26:54.509963+0000","last_clean":"2024-09-12T01:26:54.509963+0000","last_became_active":"2024-09-12T01:04:13.467045+0000","last_became_peered":"2024-09-12T01:04:13.467045+0000","last_unstale":"2024-09-12T01:26:54.509963+0000","last_undegraded":"2024-09-12T01:26:54.509963+0000","last_fullsized":"2024-09-12T01:26:54.509963+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:17.297601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'2","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.501740+0000","last_change":"2024-09-12T00:48:45.309440+0000","last_active":"2024-09-12T01:25:34.501740+0000","last_peered":"2024-09-12T01:25:34.501740+0000","last_clean":"2024-09-12T01:25:34.501740+0000","last_became_active":"2024-09-12T00:48:45.309113+0000","last_became_peered":"2024-09-12T00:48:45.309113+0000","last_unstale":"2024-09-12T01:25:34.501740+0000","last_undegraded":"2024-09-12T01:25:34.501740+0000","last_fullsized":"2024-09-12T01:25:34.501740+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:40.821689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'1","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:32.494012+0000","last_change":"2024-09-12T00:48:42.293380+0000","last_active":"2024-09-12T01:25:32.494012+0000","last_peered":"2024-09-12T01:25:32.494012+0000","last_clean":"2024-09-12T01:25:32.494012+0000","last_became_active":"2024-09-12T00:48:42.292733+0000","last_became_peered":"2024-09-12T00:48:42.292733+0000","last_unstale":"2024-09-12T01:25:32.494012+0000","last_undegraded":"2024-09-12T01:25:32.494012+0000","last_fullsized":"2024-09-12T01:25:32.494012+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.445225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":698,"num_write":1,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"262'8","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:19.500204+0000","last_change":"2024-09-12T00:46:03.922414+0000","last_active":"2024-09-12T01:25:19.500204+0000","last_peered":"2024-09-12T01:25:19.500204+0000","last_clean":"2024-09-12T01:25:19.500204+0000","last_became_active":"2024-09-12T00:46:03.922008+0000","last_became_peered":"2024-09-12T00:46:03.922008+0000","last_unstale":"2024-09-12T01:25:19.500204+0000","last_undegraded":"2024-09-12T01:25:19.500204+0000","last_fullsized":"2024-09-12T01:25:19.500204+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:42.541731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.506044+0000","last_change":"2024-09-12T01:04:13.467753+0000","last_active":"2024-09-12T01:26:44.506044+0000","last_peered":"2024-09-12T01:26:44.506044+0000","last_clean":"2024-09-12T01:26:44.506044+0000","last_became_active":"2024-09-12T01:04:13.467476+0000","last_became_peered":"2024-09-12T01:04:13.467476+0000","last_unstale":"2024-09-12T01:26:44.506044+0000","last_undegraded":"2024-09-12T01:26:44.506044+0000","last_fullsized":"2024-09-12T01:26:44.506044+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:36.299465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646039+0000","last_change":"2024-09-12T00:48:45.311842+0000","last_active":"2024-09-12T01:27:00.646039+0000","last_peered":"2024-09-12T01:27:00.646039+0000","last_clean":"2024-09-12T01:27:00.646039+0000","last_became_active":"2024-09-12T00:48:45.311541+0000","last_became_peered":"2024-09-12T00:48:45.311541+0000","last_unstale":"2024-09-12T01:27:00.646039+0000","last_undegraded":"2024-09-12T01:27:00.646039+0000","last_fullsized":"2024-09-12T01:27:00.646039+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:32.767909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:45.779440+0000","last_change":"2024-09-12T00:48:42.281525+0000","last_active":"2024-09-12T01:25:45.779440+0000","last_peered":"2024-09-12T01:25:45.779440+0000","last_clean":"2024-09-12T01:25:45.779440+0000","last_became_active":"2024-09-12T00:48:42.281070+0000","last_became_peered":"2024-09-12T00:48:42.281070+0000","last_unstale":"2024-09-12T01:25:45.779440+0000","last_undegraded":"2024-09-12T01:25:45.779440+0000","last_fullsized":"2024-09-12T01:25:45.779440+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:50.751015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'44","reported_seq":173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:07.489887+0000","last_change":"2024-09-12T00:46:03.917910+0000","last_active":"2024-09-12T01:25:07.489887+0000","last_peered":"2024-09-12T01:25:07.489887+0000","last_clean":"2024-09-12T01:25:07.489887+0000","last_became_active":"2024-09-12T00:46:03.917626+0000","last_became_peered":"2024-09-12T00:46:03.917626+0000","last_unstale":"2024-09-12T01:25:07.489887+0000","last_undegraded":"2024-09-12T01:25:07.489887+0000","last_fullsized":"2024-09-12T01:25:07.489887+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:07.349450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":170,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.789110+0000","last_change":"2024-09-12T01:04:13.463528+0000","last_active":"2024-09-12T01:26:45.789110+0000","last_peered":"2024-09-12T01:26:45.789110+0000","last_clean":"2024-09-12T01:26:45.789110+0000","last_became_active":"2024-09-12T01:04:13.463216+0000","last_became_peered":"2024-09-12T01:04:13.463216+0000","last_unstale":"2024-09-12T01:26:45.789110+0000","last_undegraded":"2024-09-12T01:26:45.789110+0000","last_fullsized":"2024-09-12T01:26:45.789110+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:56.941035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.499853+0000","last_change":"2024-09-12T00:48:45.313761+0000","last_active":"2024-09-12T01:25:44.499853+0000","last_peered":"2024-09-12T01:25:44.499853+0000","last_clean":"2024-09-12T01:25:44.499853+0000","last_became_active":"2024-09-12T00:48:45.313386+0000","last_became_peered":"2024-09-12T00:48:45.313386+0000","last_unstale":"2024-09-12T01:25:44.499853+0000","last_undegraded":"2024-09-12T01:25:44.499853+0000","last_fullsized":"2024-09-12T01:25:44.499853+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:02.140152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:59.730452+0000","last_change":"2024-09-12T00:48:42.293797+0000","last_active":"2024-09-12T01:26:59.730452+0000","last_peered":"2024-09-12T01:26:59.730452+0000","last_clean":"2024-09-12T01:26:59.730452+0000","last_became_active":"2024-09-12T00:48:42.293460+0000","last_became_peered":"2024-09-12T00:48:42.293460+0000","last_unstale":"2024-09-12T01:26:59.730452+0000","last_undegraded":"2024-09-12T01:26:59.730452+0000","last_fullsized":"2024-09-12T01:26:59.730452+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:22.406867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'27","reported_seq":123,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.495705+0000","last_change":"2024-09-12T00:46:03.919193+0000","last_active":"2024-09-12T01:25:04.495705+0000","last_peered":"2024-09-12T01:25:04.495705+0000","last_clean":"2024-09-12T01:25:04.495705+0000","last_became_active":"2024-09-12T00:46:03.918921+0000","last_became_peered":"2024-09-12T00:46:03.918921+0000","last_unstale":"2024-09-12T01:25:04.495705+0000","last_undegraded":"2024-09-12T01:25:04.495705+0000","last_fullsized":"2024-09-12T01:25:04.495705+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:43.600527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.508427+0000","last_change":"2024-09-12T01:04:13.467161+0000","last_active":"2024-09-12T01:27:09.508427+0000","last_peered":"2024-09-12T01:27:09.508427+0000","last_clean":"2024-09-12T01:27:09.508427+0000","last_became_active":"2024-09-12T01:04:13.466854+0000","last_became_peered":"2024-09-12T01:04:13.466854+0000","last_unstale":"2024-09-12T01:27:09.508427+0000","last_undegraded":"2024-09-12T01:27:09.508427+0000","last_fullsized":"2024-09-12T01:27:09.508427+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:37.902119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'1","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:27.502721+0000","last_change":"2024-09-12T00:48:45.316511+0000","last_active":"2024-09-12T01:26:27.502721+0000","last_peered":"2024-09-12T01:26:27.502721+0000","last_clean":"2024-09-12T01:26:27.502721+0000","last_became_active":"2024-09-12T00:48:45.315966+0000","last_became_peered":"2024-09-12T00:48:45.315966+0000","last_unstale":"2024-09-12T01:26:27.502721+0000","last_undegraded":"2024-09-12T01:26:27.502721+0000","last_fullsized":"2024-09-12T01:26:27.502721+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:04.129604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1396,"num_write":1,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.725014+0000","last_change":"2024-09-12T00:48:42.294344+0000","last_active":"2024-09-12T01:26:14.725014+0000","last_peered":"2024-09-12T01:26:14.725014+0000","last_clean":"2024-09-12T01:26:14.725014+0000","last_became_active":"2024-09-12T00:48:42.293481+0000","last_became_peered":"2024-09-12T00:48:42.293481+0000","last_unstale":"2024-09-12T01:26:14.725014+0000","last_undegraded":"2024-09-12T01:26:14.725014+0000","last_fullsized":"2024-09-12T01:26:14.725014+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:01.378966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'25","reported_seq":117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:03.492017+0000","last_change":"2024-09-12T00:46:03.914527+0000","last_active":"2024-09-12T01:25:03.492017+0000","last_peered":"2024-09-12T01:25:03.492017+0000","last_clean":"2024-09-12T01:25:03.492017+0000","last_became_active":"2024-09-12T00:46:03.914207+0000","last_became_peered":"2024-09-12T00:46:03.914207+0000","last_unstale":"2024-09-12T01:25:03.492017+0000","last_undegraded":"2024-09-12T01:25:03.492017+0000","last_fullsized":"2024-09-12T01:25:03.492017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:53.077898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.508448+0000","last_change":"2024-09-12T01:04:13.466887+0000","last_active":"2024-09-12T01:27:09.508448+0000","last_peered":"2024-09-12T01:27:09.508448+0000","last_clean":"2024-09-12T01:27:09.508448+0000","last_became_active":"2024-09-12T01:04:13.466050+0000","last_became_peered":"2024-09-12T01:04:13.466050+0000","last_unstale":"2024-09-12T01:27:09.508448+0000","last_undegraded":"2024-09-12T01:27:09.508448+0000","last_fullsized":"2024-09-12T01:27:09.508448+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:39.634410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501296+0000","last_change":"2024-09-12T00:48:45.314649+0000","last_active":"2024-09-12T01:26:17.501296+0000","last_peered":"2024-09-12T01:26:17.501296+0000","last_clean":"2024-09-12T01:26:17.501296+0000","last_became_active":"2024-09-12T00:48:45.313692+0000","last_became_peered":"2024-09-12T00:48:45.313692+0000","last_unstale":"2024-09-12T01:26:17.501296+0000","last_undegraded":"2024-09-12T01:26:17.501296+0000","last_fullsized":"2024-09-12T01:26:17.501296+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:19.872019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:23.503219+0000","last_change":"2024-09-12T00:48:42.288243+0000","last_active":"2024-09-12T01:26:23.503219+0000","last_peered":"2024-09-12T01:26:23.503219+0000","last_clean":"2024-09-12T01:26:23.503219+0000","last_became_active":"2024-09-12T00:48:42.287949+0000","last_became_peered":"2024-09-12T00:48:42.287949+0000","last_unstale":"2024-09-12T01:26:23.503219+0000","last_undegraded":"2024-09-12T01:26:23.503219+0000","last_fullsized":"2024-09-12T01:26:23.503219+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:37.161356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'53","reported_seq":194,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714926+0000","last_change":"2024-09-12T00:46:03.918000+0000","last_active":"2024-09-12T01:25:04.714926+0000","last_peered":"2024-09-12T01:25:04.714926+0000","last_clean":"2024-09-12T01:25:04.714926+0000","last_became_active":"2024-09-12T00:46:03.917728+0000","last_became_peered":"2024-09-12T00:46:03.917728+0000","last_unstale":"2024-09-12T01:25:04.714926+0000","last_undegraded":"2024-09-12T01:25:04.714926+0000","last_fullsized":"2024-09-12T01:25:04.714926+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:11.732147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":191,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:22.501894+0000","last_change":"2024-09-12T01:04:13.466462+0000","last_active":"2024-09-12T01:26:22.501894+0000","last_peered":"2024-09-12T01:26:22.501894+0000","last_clean":"2024-09-12T01:26:22.501894+0000","last_became_active":"2024-09-12T01:04:13.466183+0000","last_became_peered":"2024-09-12T01:04:13.466183+0000","last_unstale":"2024-09-12T01:26:22.501894+0000","last_undegraded":"2024-09-12T01:26:22.501894+0000","last_fullsized":"2024-09-12T01:26:22.501894+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:33.706209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.498929+0000","last_change":"2024-09-12T00:48:45.311887+0000","last_active":"2024-09-12T01:25:34.498929+0000","last_peered":"2024-09-12T01:25:34.498929+0000","last_clean":"2024-09-12T01:25:34.498929+0000","last_became_active":"2024-09-12T00:48:45.311453+0000","last_became_peered":"2024-09-12T00:48:45.311453+0000","last_unstale":"2024-09-12T01:25:34.498929+0000","last_undegraded":"2024-09-12T01:25:34.498929+0000","last_fullsized":"2024-09-12T01:25:34.498929+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:34.715672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'1","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.501826+0000","last_change":"2024-09-12T00:48:42.295708+0000","last_active":"2024-09-12T01:25:34.501826+0000","last_peered":"2024-09-12T01:25:34.501826+0000","last_clean":"2024-09-12T01:25:34.501826+0000","last_became_active":"2024-09-12T00:48:42.295358+0000","last_became_peered":"2024-09-12T00:48:42.295358+0000","last_unstale":"2024-09-12T01:25:34.501826+0000","last_undegraded":"2024-09-12T01:25:34.501826+0000","last_fullsized":"2024-09-12T01:25:34.501826+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:21.788554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":40,"num_write":1,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'81","reported_seq":278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.503935+0000","last_change":"2024-09-12T00:46:03.916339+0000","last_active":"2024-09-12T01:25:54.503935+0000","last_peered":"2024-09-12T01:25:54.503935+0000","last_clean":"2024-09-12T01:25:54.503935+0000","last_became_active":"2024-09-12T00:46:03.916021+0000","last_became_peered":"2024-09-12T00:46:03.916021+0000","last_unstale":"2024-09-12T01:25:54.503935+0000","last_undegraded":"2024-09-12T01:25:54.503935+0000","last_fullsized":"2024-09-12T01:25:54.503935+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:09.221542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":326,"num_write":133,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.731804+0000","last_change":"2024-09-12T01:04:13.466014+0000","last_active":"2024-09-12T01:27:09.731804+0000","last_peered":"2024-09-12T01:27:09.731804+0000","last_clean":"2024-09-12T01:27:09.731804+0000","last_became_active":"2024-09-12T01:04:13.465478+0000","last_became_peered":"2024-09-12T01:04:13.465478+0000","last_unstale":"2024-09-12T01:27:09.731804+0000","last_undegraded":"2024-09-12T01:27:09.731804+0000","last_fullsized":"2024-09-12T01:27:09.731804+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:45.735147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718359+0000","last_change":"2024-09-12T00:48:45.314296+0000","last_active":"2024-09-12T01:25:34.718359+0000","last_peered":"2024-09-12T01:25:34.718359+0000","last_clean":"2024-09-12T01:25:34.718359+0000","last_became_active":"2024-09-12T00:48:45.313057+0000","last_became_peered":"2024-09-12T00:48:45.313057+0000","last_unstale":"2024-09-12T01:25:34.718359+0000","last_undegraded":"2024-09-12T01:25:34.718359+0000","last_fullsized":"2024-09-12T01:25:34.718359+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:38.739439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718378+0000","last_change":"2024-09-12T00:48:42.297183+0000","last_active":"2024-09-12T01:25:34.718378+0000","last_peered":"2024-09-12T01:25:34.718378+0000","last_clean":"2024-09-12T01:25:34.718378+0000","last_became_active":"2024-09-12T00:48:42.296903+0000","last_became_peered":"2024-09-12T00:48:42.296903+0000","last_unstale":"2024-09-12T01:25:34.718378+0000","last_undegraded":"2024-09-12T01:25:34.718378+0000","last_fullsized":"2024-09-12T01:25:34.718378+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:11.352129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'58","reported_seq":244,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:40.778662+0000","last_change":"2024-09-12T00:46:03.917455+0000","last_active":"2024-09-12T01:25:40.778662+0000","last_peered":"2024-09-12T01:25:40.778662+0000","last_clean":"2024-09-12T01:25:40.778662+0000","last_became_active":"2024-09-12T00:46:03.917131+0000","last_became_peered":"2024-09-12T00:46:03.917131+0000","last_unstale":"2024-09-12T01:25:40.778662+0000","last_undegraded":"2024-09-12T01:25:40.778662+0000","last_fullsized":"2024-09-12T01:25:40.778662+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:05.329202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":270,"num_write":80,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.781081+0000","last_change":"2024-09-12T01:04:13.468499+0000","last_active":"2024-09-12T01:25:55.781081+0000","last_peered":"2024-09-12T01:25:55.781081+0000","last_clean":"2024-09-12T01:25:55.781081+0000","last_became_active":"2024-09-12T01:04:13.468116+0000","last_became_peered":"2024-09-12T01:04:13.468116+0000","last_unstale":"2024-09-12T01:25:55.781081+0000","last_undegraded":"2024-09-12T01:25:55.781081+0000","last_fullsized":"2024-09-12T01:25:55.781081+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:15.224566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:18.502441+0000","last_change":"2024-09-12T00:48:45.317145+0000","last_active":"2024-09-12T01:26:18.502441+0000","last_peered":"2024-09-12T01:26:18.502441+0000","last_clean":"2024-09-12T01:26:18.502441+0000","last_became_active":"2024-09-12T00:48:45.316713+0000","last_became_peered":"2024-09-12T00:48:45.316713+0000","last_unstale":"2024-09-12T01:26:18.502441+0000","last_undegraded":"2024-09-12T01:26:18.502441+0000","last_fullsized":"2024-09-12T01:26:18.502441+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:25.736540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1096995,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2096,"num_write":8,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'1","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:59.510380+0000","last_change":"2024-09-12T00:48:42.293385+0000","last_active":"2024-09-12T01:26:59.510380+0000","last_peered":"2024-09-12T01:26:59.510380+0000","last_clean":"2024-09-12T01:26:59.510380+0000","last_became_active":"2024-09-12T00:48:42.293111+0000","last_became_peered":"2024-09-12T00:48:42.293111+0000","last_unstale":"2024-09-12T01:26:59.510380+0000","last_undegraded":"2024-09-12T01:26:59.510380+0000","last_fullsized":"2024-09-12T01:26:59.510380+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:17.021932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'34","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.502266+0000","last_change":"2024-09-12T00:46:03.914760+0000","last_active":"2024-09-12T01:25:39.502266+0000","last_peered":"2024-09-12T01:25:39.502266+0000","last_clean":"2024-09-12T01:25:39.502266+0000","last_became_active":"2024-09-12T00:46:03.914387+0000","last_became_peered":"2024-09-12T00:46:03.914387+0000","last_unstale":"2024-09-12T01:25:39.502266+0000","last_undegraded":"2024-09-12T01:25:39.502266+0000","last_fullsized":"2024-09-12T01:25:39.502266+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:56.621300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:53.499141+0000","last_change":"2024-09-12T01:04:13.470882+0000","last_active":"2024-09-12T01:25:53.499141+0000","last_peered":"2024-09-12T01:25:53.499141+0000","last_clean":"2024-09-12T01:25:53.499141+0000","last_became_active":"2024-09-12T01:04:13.470597+0000","last_became_peered":"2024-09-12T01:04:13.470597+0000","last_unstale":"2024-09-12T01:25:53.499141+0000","last_undegraded":"2024-09-12T01:25:53.499141+0000","last_fullsized":"2024-09-12T01:25:53.499141+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:44.301395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:49.729085+0000","last_change":"2024-09-12T00:48:45.316493+0000","last_active":"2024-09-12T01:26:49.729085+0000","last_peered":"2024-09-12T01:26:49.729085+0000","last_clean":"2024-09-12T01:26:49.729085+0000","last_became_active":"2024-09-12T00:48:45.316182+0000","last_became_peered":"2024-09-12T00:48:45.316182+0000","last_unstale":"2024-09-12T01:26:49.729085+0000","last_undegraded":"2024-09-12T01:26:49.729085+0000","last_fullsized":"2024-09-12T01:26:49.729085+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:51.175017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"265'2","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.724957+0000","last_change":"2024-09-12T00:48:42.294249+0000","last_active":"2024-09-12T01:26:14.724957+0000","last_peered":"2024-09-12T01:26:14.724957+0000","last_clean":"2024-09-12T01:26:14.724957+0000","last_became_active":"2024-09-12T00:48:42.293947+0000","last_became_peered":"2024-09-12T00:48:42.293947+0000","last_unstale":"2024-09-12T01:26:14.724957+0000","last_undegraded":"2024-09-12T01:26:14.724957+0000","last_fullsized":"2024-09-12T01:26:14.724957+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:38.623578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'54","reported_seq":194,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.718948+0000","last_change":"2024-09-12T00:46:03.919567+0000","last_active":"2024-09-12T01:25:39.718948+0000","last_peered":"2024-09-12T01:25:39.718948+0000","last_clean":"2024-09-12T01:25:39.718948+0000","last_became_active":"2024-09-12T00:46:03.919285+0000","last_became_peered":"2024-09-12T00:46:03.919285+0000","last_unstale":"2024-09-12T01:25:39.718948+0000","last_undegraded":"2024-09-12T01:25:39.718948+0000","last_fullsized":"2024-09-12T01:25:39.718948+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:47.685991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":102,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:07.489938+0000","last_change":"2024-09-12T01:04:13.467623+0000","last_active":"2024-09-12T01:25:07.489938+0000","last_peered":"2024-09-12T01:25:07.489938+0000","last_clean":"2024-09-12T01:25:07.489938+0000","last_became_active":"2024-09-12T01:04:13.467374+0000","last_became_peered":"2024-09-12T01:04:13.467374+0000","last_unstale":"2024-09-12T01:25:07.489938+0000","last_undegraded":"2024-09-12T01:25:07.489938+0000","last_fullsized":"2024-09-12T01:25:07.489938+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:34.421544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505968+0000","last_change":"2024-09-12T00:48:45.310759+0000","last_active":"2024-09-12T01:26:14.505968+0000","last_peered":"2024-09-12T01:26:14.505968+0000","last_clean":"2024-09-12T01:26:14.505968+0000","last_became_active":"2024-09-12T00:48:45.310423+0000","last_became_peered":"2024-09-12T00:48:45.310423+0000","last_unstale":"2024-09-12T01:26:14.505968+0000","last_undegraded":"2024-09-12T01:26:14.505968+0000","last_fullsized":"2024-09-12T01:26:14.505968+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:13.622431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639581+0000","last_change":"2024-09-12T00:48:42.296171+0000","last_active":"2024-09-12T01:26:15.639581+0000","last_peered":"2024-09-12T01:26:15.639581+0000","last_clean":"2024-09-12T01:26:15.639581+0000","last_became_active":"2024-09-12T00:48:42.295861+0000","last_became_peered":"2024-09-12T00:48:42.295861+0000","last_unstale":"2024-09-12T01:26:15.639581+0000","last_undegraded":"2024-09-12T01:26:15.639581+0000","last_fullsized":"2024-09-12T01:26:15.639581+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:57.732050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.718904+0000","last_change":"2024-09-12T00:46:03.919535+0000","last_active":"2024-09-12T01:25:39.718904+0000","last_peered":"2024-09-12T01:25:39.718904+0000","last_clean":"2024-09-12T01:25:39.718904+0000","last_became_active":"2024-09-12T00:46:03.917353+0000","last_became_peered":"2024-09-12T00:46:03.917353+0000","last_unstale":"2024-09-12T01:25:39.718904+0000","last_undegraded":"2024-09-12T01:25:39.718904+0000","last_fullsized":"2024-09-12T01:25:39.718904+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:22.130628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":151,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.731874+0000","last_change":"2024-09-12T01:04:13.467110+0000","last_active":"2024-09-12T01:27:09.731874+0000","last_peered":"2024-09-12T01:27:09.731874+0000","last_clean":"2024-09-12T01:27:09.731874+0000","last_became_active":"2024-09-12T01:04:13.466783+0000","last_became_peered":"2024-09-12T01:04:13.466783+0000","last_unstale":"2024-09-12T01:27:09.731874+0000","last_undegraded":"2024-09-12T01:27:09.731874+0000","last_fullsized":"2024-09-12T01:27:09.731874+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:53.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505931+0000","last_change":"2024-09-12T00:48:45.312610+0000","last_active":"2024-09-12T01:26:14.505931+0000","last_peered":"2024-09-12T01:26:14.505931+0000","last_clean":"2024-09-12T01:26:14.505931+0000","last_became_active":"2024-09-12T00:48:45.312329+0000","last_became_peered":"2024-09-12T00:48:45.312329+0000","last_unstale":"2024-09-12T01:26:14.505931+0000","last_undegraded":"2024-09-12T01:26:14.505931+0000","last_fullsized":"2024-09-12T01:26:14.505931+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:29.308504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'1","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.606674+0000","last_change":"2024-09-12T00:48:42.286718+0000","last_active":"2024-09-12T01:26:14.606674+0000","last_peered":"2024-09-12T01:26:14.606674+0000","last_clean":"2024-09-12T01:26:14.606674+0000","last_became_active":"2024-09-12T00:48:42.286427+0000","last_became_peered":"2024-09-12T00:48:42.286427+0000","last_unstale":"2024-09-12T01:26:14.606674+0000","last_undegraded":"2024-09-12T01:26:14.606674+0000","last_fullsized":"2024-09-12T01:26:14.606674+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:46.315650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'46","reported_seq":175,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:19.506448+0000","last_change":"2024-09-12T00:46:03.919531+0000","last_active":"2024-09-12T01:26:19.506448+0000","last_peered":"2024-09-12T01:26:19.506448+0000","last_clean":"2024-09-12T01:26:19.506448+0000","last_became_active":"2024-09-12T00:46:03.919259+0000","last_became_peered":"2024-09-12T00:46:03.919259+0000","last_unstale":"2024-09-12T01:26:19.506448+0000","last_undegraded":"2024-09-12T01:26:19.506448+0000","last_fullsized":"2024-09-12T01:26:19.506448+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:12.310694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":85,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'325","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.379242+0000","last_change":"2024-09-12T00:31:47.138230+0000","last_active":"2024-09-12T01:29:14.379242+0000","last_peered":"2024-09-12T01:29:14.379242+0000","last_clean":"2024-09-12T01:29:14.379242+0000","last_became_active":"2024-09-12T00:31:47.137895+0000","last_became_peered":"2024-09-12T00:31:47.137895+0000","last_unstale":"2024-09-12T01:29:14.379242+0000","last_undegraded":"2024-09-12T01:29:14.379242+0000","last_fullsized":"2024-09-12T01:29:14.379242+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:28.486538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10494761,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":695,"num_read_kb":31522,"num_write":1230,"num_write_kb":24718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'194","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:36.623263+0000","last_change":"2024-09-12T00:31:50.138500+0000","last_active":"2024-09-12T01:26:36.623263+0000","last_peered":"2024-09-12T01:26:36.623263+0000","last_clean":"2024-09-12T01:26:36.623263+0000","last_became_active":"2024-09-12T00:31:50.138226+0000","last_became_peered":"2024-09-12T00:31:50.138226+0000","last_unstale":"2024-09-12T01:26:36.623263+0000","last_undegraded":"2024-09-12T01:26:36.623263+0000","last_fullsized":"2024-09-12T01:26:36.623263+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:11.080078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":913,"num_read_kb":766,"num_write":296,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'253","reported_seq":880,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:37.685001+0000","last_change":"2024-09-12T00:31:47.134970+0000","last_active":"2024-09-12T01:26:37.685001+0000","last_peered":"2024-09-12T01:26:37.685001+0000","last_clean":"2024-09-12T01:26:37.685001+0000","last_became_active":"2024-09-12T00:31:47.134134+0000","last_became_peered":"2024-09-12T00:31:47.134134+0000","last_unstale":"2024-09-12T01:26:37.685001+0000","last_undegraded":"2024-09-12T01:26:37.685001+0000","last_fullsized":"2024-09-12T01:26:37.685001+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:05.214195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10692408,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":402,"num_read_kb":16965,"num_write":957,"num_write_kb":26995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'110","reported_seq":704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.740242+0000","last_change":"2024-09-12T00:31:50.132884+0000","last_active":"2024-09-12T01:25:44.740242+0000","last_peered":"2024-09-12T01:25:44.740242+0000","last_clean":"2024-09-12T01:25:44.740242+0000","last_became_active":"2024-09-12T00:31:50.132639+0000","last_became_peered":"2024-09-12T00:31:50.132639+0000","last_unstale":"2024-09-12T01:25:44.740242+0000","last_undegraded":"2024-09-12T01:25:44.740242+0000","last_fullsized":"2024-09-12T01:25:44.740242+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:24.512638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":165,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'310","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:25.656621+0000","last_change":"2024-09-12T00:31:47.120188+0000","last_active":"2024-09-12T01:26:25.656621+0000","last_peered":"2024-09-12T01:26:25.656621+0000","last_clean":"2024-09-12T01:26:25.656621+0000","last_became_active":"2024-09-12T00:31:47.119865+0000","last_became_peered":"2024-09-12T00:31:47.119865+0000","last_unstale":"2024-09-12T01:26:25.656621+0000","last_undegraded":"2024-09-12T01:26:25.656621+0000","last_fullsized":"2024-09-12T01:26:25.656621+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:42.752369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5588563,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":782,"num_read_kb":4429,"num_write":1123,"num_write_kb":10543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'286","reported_seq":935,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:08.062655+0000","last_change":"2024-09-12T00:31:50.135767+0000","last_active":"2024-09-12T01:25:08.062655+0000","last_peered":"2024-09-12T01:25:08.062655+0000","last_clean":"2024-09-12T01:25:08.062655+0000","last_became_active":"2024-09-12T00:31:50.135413+0000","last_became_peered":"2024-09-12T00:31:50.135413+0000","last_unstale":"2024-09-12T01:25:08.062655+0000","last_undegraded":"2024-09-12T01:25:08.062655+0000","last_fullsized":"2024-09-12T01:25:08.062655+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:32.753854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1012,"num_write":455,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'263","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.358786+0000","last_change":"2024-09-12T00:31:47.133763+0000","last_active":"2024-09-12T01:29:14.358786+0000","last_peered":"2024-09-12T01:29:14.358786+0000","last_clean":"2024-09-12T01:29:14.358786+0000","last_became_active":"2024-09-12T00:31:47.133414+0000","last_became_peered":"2024-09-12T00:31:47.133414+0000","last_unstale":"2024-09-12T01:29:14.358786+0000","last_undegraded":"2024-09-12T01:29:14.358786+0000","last_fullsized":"2024-09-12T01:29:14.358786+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:03.831657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17529054,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":413,"num_read_kb":32236,"num_write":1002,"num_write_kb":37937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'183","reported_seq":785,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:17.241665+0000","last_change":"2024-09-12T00:31:50.135590+0000","last_active":"2024-09-12T01:27:17.241665+0000","last_peered":"2024-09-12T01:27:17.241665+0000","last_clean":"2024-09-12T01:27:17.241665+0000","last_became_active":"2024-09-12T00:31:50.135322+0000","last_became_peered":"2024-09-12T00:31:50.135322+0000","last_unstale":"2024-09-12T01:27:17.241665+0000","last_undegraded":"2024-09-12T01:27:17.241665+0000","last_fullsized":"2024-09-12T01:27:17.241665+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.974784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":591,"num_write":296,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'261","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:32.836957+0000","last_change":"2024-09-12T00:31:47.129759+0000","last_active":"2024-09-12T01:26:32.836957+0000","last_peered":"2024-09-12T01:26:32.836957+0000","last_clean":"2024-09-12T01:26:32.836957+0000","last_became_active":"2024-09-12T00:31:47.128016+0000","last_became_peered":"2024-09-12T00:31:47.128016+0000","last_unstale":"2024-09-12T01:26:32.836957+0000","last_undegraded":"2024-09-12T01:26:32.836957+0000","last_fullsized":"2024-09-12T01:26:32.836957+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:57.514060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5506790,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":400,"num_read_kb":35042,"num_write":990,"num_write_kb":20184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'220","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.501392+0000","last_change":"2024-09-12T00:31:50.132960+0000","last_active":"2024-09-12T01:25:59.501392+0000","last_peered":"2024-09-12T01:25:59.501392+0000","last_clean":"2024-09-12T01:25:59.501392+0000","last_became_active":"2024-09-12T00:31:50.132674+0000","last_became_peered":"2024-09-12T00:31:50.132674+0000","last_unstale":"2024-09-12T01:25:59.501392+0000","last_undegraded":"2024-09-12T01:25:59.501392+0000","last_fullsized":"2024-09-12T01:25:59.501392+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:49.251283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":967,"num_read_kb":781,"num_write":356,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'300","reported_seq":927,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:01.812214+0000","last_change":"2024-09-12T00:31:47.135231+0000","last_active":"2024-09-12T01:27:01.812214+0000","last_peered":"2024-09-12T01:27:01.812214+0000","last_clean":"2024-09-12T01:27:01.812214+0000","last_became_active":"2024-09-12T00:31:47.134887+0000","last_became_peered":"2024-09-12T00:31:47.134887+0000","last_unstale":"2024-09-12T01:27:01.812214+0000","last_undegraded":"2024-09-12T01:27:01.812214+0000","last_fullsized":"2024-09-12T01:27:01.812214+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:00.830296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5598308,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":444,"num_read_kb":3274,"num_write":1158,"num_write_kb":38824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'275","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.501413+0000","last_change":"2024-09-12T00:31:50.140357+0000","last_active":"2024-09-12T01:25:59.501413+0000","last_peered":"2024-09-12T01:25:59.501413+0000","last_clean":"2024-09-12T01:25:59.501413+0000","last_became_active":"2024-09-12T00:31:50.140087+0000","last_became_peered":"2024-09-12T00:31:50.140087+0000","last_unstale":"2024-09-12T01:25:59.501413+0000","last_undegraded":"2024-09-12T01:25:59.501413+0000","last_fullsized":"2024-09-12T01:25:59.501413+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:30.983237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1141,"num_read_kb":956,"num_write":415,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'354","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.645896+0000","last_change":"2024-09-12T00:32:23.831062+0000","last_active":"2024-09-12T01:29:15.645896+0000","last_peered":"2024-09-12T01:29:15.645896+0000","last_clean":"2024-09-12T01:29:15.645896+0000","last_became_active":"2024-09-12T00:32:23.830676+0000","last_became_peered":"2024-09-12T00:32:23.830676+0000","last_unstale":"2024-09-12T01:29:15.645896+0000","last_undegraded":"2024-09-12T01:29:15.645896+0000","last_fullsized":"2024-09-12T01:29:15.645896+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:35.456863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8561348,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":531,"num_read_kb":5769,"num_write":1218,"num_write_kb":23845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3e","version":"265'51","reported_seq":590,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:47.570442+0000","last_change":"2024-09-12T00:31:50.140487+0000","last_active":"2024-09-12T01:26:47.570442+0000","last_peered":"2024-09-12T01:26:47.570442+0000","last_clean":"2024-09-12T01:26:47.570442+0000","last_became_active":"2024-09-12T00:31:50.140207+0000","last_became_peered":"2024-09-12T00:31:50.140207+0000","last_unstale":"2024-09-12T01:26:47.570442+0000","last_undegraded":"2024-09-12T01:26:47.570442+0000","last_fullsized":"2024-09-12T01:26:47.570442+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:00.343009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":145,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'326","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:53.274186+0000","last_change":"2024-09-12T00:31:47.128251+0000","last_active":"2024-09-12T01:25:53.274186+0000","last_peered":"2024-09-12T01:25:53.274186+0000","last_clean":"2024-09-12T01:25:53.274186+0000","last_became_active":"2024-09-12T00:31:47.127930+0000","last_became_peered":"2024-09-12T00:31:47.127930+0000","last_unstale":"2024-09-12T01:25:53.274186+0000","last_undegraded":"2024-09-12T01:25:53.274186+0000","last_fullsized":"2024-09-12T01:25:53.274186+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:52.713325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7291840,"num_objects":67,"num_object_clones":0,"num_object_copies":201,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":578,"num_read_kb":6944,"num_write":1402,"num_write_kb":29009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'96","reported_seq":688,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498691+0000","last_change":"2024-09-12T00:31:50.142364+0000","last_active":"2024-09-12T01:26:02.498691+0000","last_peered":"2024-09-12T01:26:02.498691+0000","last_clean":"2024-09-12T01:26:02.498691+0000","last_became_active":"2024-09-12T00:31:50.142071+0000","last_became_peered":"2024-09-12T00:31:50.142071+0000","last_unstale":"2024-09-12T01:26:02.498691+0000","last_undegraded":"2024-09-12T01:26:02.498691+0000","last_fullsized":"2024-09-12T01:26:02.498691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:46.856124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":364,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'86","reported_seq":690,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:29.717727+0000","last_change":"2024-09-12T00:31:50.132450+0000","last_active":"2024-09-12T01:25:29.717727+0000","last_peered":"2024-09-12T01:25:29.717727+0000","last_clean":"2024-09-12T01:25:29.717727+0000","last_became_active":"2024-09-12T00:31:50.132178+0000","last_became_peered":"2024-09-12T00:31:50.132178+0000","last_unstale":"2024-09-12T01:25:29.717727+0000","last_undegraded":"2024-09-12T01:25:29.717727+0000","last_fullsized":"2024-09-12T01:25:29.717727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:34.527456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":346,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'277","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:34.516236+0000","last_change":"2024-09-12T00:31:47.124269+0000","last_active":"2024-09-12T01:27:34.516236+0000","last_peered":"2024-09-12T01:27:34.516236+0000","last_clean":"2024-09-12T01:27:34.516236+0000","last_became_active":"2024-09-12T00:31:47.123956+0000","last_became_peered":"2024-09-12T00:31:47.123956+0000","last_unstale":"2024-09-12T01:27:34.516236+0000","last_undegraded":"2024-09-12T01:27:34.516236+0000","last_fullsized":"2024-09-12T01:27:34.516236+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:27.189976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5878961,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":427,"num_read_kb":32458,"num_write":1071,"num_write_kb":22794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'162","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.544138+0000","last_change":"2024-09-12T00:31:50.131280+0000","last_active":"2024-09-12T01:27:47.544138+0000","last_peered":"2024-09-12T01:27:47.544138+0000","last_clean":"2024-09-12T01:27:47.544138+0000","last_became_active":"2024-09-12T00:31:50.130844+0000","last_became_peered":"2024-09-12T00:31:50.130844+0000","last_unstale":"2024-09-12T01:27:47.544138+0000","last_undegraded":"2024-09-12T01:27:47.544138+0000","last_fullsized":"2024-09-12T01:27:47.544138+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:38.260983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":634,"num_write":246,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'208","reported_seq":801,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:25.023002+0000","last_change":"2024-09-12T00:31:47.128649+0000","last_active":"2024-09-12T01:27:25.023002+0000","last_peered":"2024-09-12T01:27:25.023002+0000","last_clean":"2024-09-12T01:27:25.023002+0000","last_became_active":"2024-09-12T00:31:47.127400+0000","last_became_peered":"2024-09-12T00:31:47.127400+0000","last_unstale":"2024-09-12T01:27:25.023002+0000","last_undegraded":"2024-09-12T01:27:25.023002+0000","last_fullsized":"2024-09-12T01:27:25.023002+0000","mapping_epoch":24,"log_start":"265'100","ondisk_log_start":"265'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:24.774467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14792923,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":268,"num_read_kb":20510,"num_write":744,"num_write_kb":47522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'404","reported_seq":1170,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.602445+0000","last_change":"2024-09-12T00:31:50.142651+0000","last_active":"2024-09-12T01:25:34.602445+0000","last_peered":"2024-09-12T01:25:34.602445+0000","last_clean":"2024-09-12T01:25:34.602445+0000","last_became_active":"2024-09-12T00:31:50.142337+0000","last_became_peered":"2024-09-12T00:31:50.142337+0000","last_unstale":"2024-09-12T01:25:34.602445+0000","last_undegraded":"2024-09-12T01:25:34.602445+0000","last_fullsized":"2024-09-12T01:25:34.602445+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.221186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1845,"num_write":683,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'266","reported_seq":882,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:24.510017+0000","last_change":"2024-09-12T00:31:47.139796+0000","last_active":"2024-09-12T01:27:24.510017+0000","last_peered":"2024-09-12T01:27:24.510017+0000","last_clean":"2024-09-12T01:27:24.510017+0000","last_became_active":"2024-09-12T00:31:47.139517+0000","last_became_peered":"2024-09-12T00:31:47.139517+0000","last_unstale":"2024-09-12T01:27:24.510017+0000","last_undegraded":"2024-09-12T01:27:24.510017+0000","last_fullsized":"2024-09-12T01:27:24.510017+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:34.384825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7088137,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":420,"num_read_kb":6586,"num_write":1040,"num_write_kb":25928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'147","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:00.628254+0000","last_change":"2024-09-12T00:31:50.142590+0000","last_active":"2024-09-12T01:25:00.628254+0000","last_peered":"2024-09-12T01:25:00.628254+0000","last_clean":"2024-09-12T01:25:00.628254+0000","last_became_active":"2024-09-12T00:31:50.142311+0000","last_became_peered":"2024-09-12T00:31:50.142311+0000","last_unstale":"2024-09-12T01:25:00.628254+0000","last_undegraded":"2024-09-12T01:25:00.628254+0000","last_fullsized":"2024-09-12T01:25:00.628254+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:15.132325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":237,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'198","reported_seq":818,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:24.509970+0000","last_change":"2024-09-12T00:31:47.130745+0000","last_active":"2024-09-12T01:27:24.509970+0000","last_peered":"2024-09-12T01:27:24.509970+0000","last_clean":"2024-09-12T01:27:24.509970+0000","last_became_active":"2024-09-12T00:31:47.130329+0000","last_became_peered":"2024-09-12T00:31:47.130329+0000","last_unstale":"2024-09-12T01:27:24.509970+0000","last_undegraded":"2024-09-12T01:27:24.509970+0000","last_fullsized":"2024-09-12T01:27:24.509970+0000","mapping_epoch":24,"log_start":"265'100","ondisk_log_start":"265'100","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:26.579124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18157375,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":334,"num_read_kb":37642,"num_write":701,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'112","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:33.595038+0000","last_change":"2024-09-12T00:31:50.136264+0000","last_active":"2024-09-12T01:26:33.595038+0000","last_peered":"2024-09-12T01:26:33.595038+0000","last_clean":"2024-09-12T01:26:33.595038+0000","last_became_active":"2024-09-12T00:31:50.135595+0000","last_became_peered":"2024-09-12T00:31:50.135595+0000","last_unstale":"2024-09-12T01:26:33.595038+0000","last_undegraded":"2024-09-12T01:26:33.595038+0000","last_fullsized":"2024-09-12T01:26:33.595038+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:16.754941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":410,"num_write":180,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'294","reported_seq":1019,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.637796+0000","last_change":"2024-09-12T00:31:47.133955+0000","last_active":"2024-09-12T01:29:15.637796+0000","last_peered":"2024-09-12T01:29:15.637796+0000","last_clean":"2024-09-12T01:29:15.637796+0000","last_became_active":"2024-09-12T00:31:47.133592+0000","last_became_peered":"2024-09-12T00:31:47.133592+0000","last_unstale":"2024-09-12T01:29:15.637796+0000","last_undegraded":"2024-09-12T01:29:15.637796+0000","last_fullsized":"2024-09-12T01:29:15.637796+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:40.772744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1790643,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":759,"num_read_kb":29951,"num_write":1057,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'73","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.598762+0000","last_change":"2024-09-12T00:31:50.136540+0000","last_active":"2024-09-12T01:24:59.598762+0000","last_peered":"2024-09-12T01:24:59.598762+0000","last_clean":"2024-09-12T01:24:59.598762+0000","last_became_active":"2024-09-12T00:31:50.135972+0000","last_became_peered":"2024-09-12T00:31:50.135972+0000","last_unstale":"2024-09-12T01:24:59.598762+0000","last_undegraded":"2024-09-12T01:24:59.598762+0000","last_fullsized":"2024-09-12T01:24:59.598762+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:26.791352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":249,"num_write":116,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'286","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.618013+0000","last_change":"2024-09-12T00:31:47.118600+0000","last_active":"2024-09-12T01:29:15.618013+0000","last_peered":"2024-09-12T01:29:15.618013+0000","last_clean":"2024-09-12T01:29:15.618013+0000","last_became_active":"2024-09-12T00:31:47.118260+0000","last_became_peered":"2024-09-12T00:31:47.118260+0000","last_unstale":"2024-09-12T01:29:15.618013+0000","last_undegraded":"2024-09-12T01:29:15.618013+0000","last_fullsized":"2024-09-12T01:29:15.618013+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:15.699024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244189,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":420,"num_read_kb":15045,"num_write":955,"num_write_kb":26498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'123","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.422976+0000","last_change":"2024-09-12T00:31:58.184465+0000","last_active":"2024-09-12T01:27:48.422976+0000","last_peered":"2024-09-12T01:27:48.422976+0000","last_clean":"2024-09-12T01:27:48.422976+0000","last_became_active":"2024-09-12T00:31:58.183784+0000","last_became_peered":"2024-09-12T00:31:58.183784+0000","last_unstale":"2024-09-12T01:27:48.422976+0000","last_undegraded":"2024-09-12T01:27:48.422976+0000","last_fullsized":"2024-09-12T01:27:48.422976+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:03.783137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":134,"num_write":297,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'229","reported_seq":832,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:53.682612+0000","last_change":"2024-09-12T00:31:50.140765+0000","last_active":"2024-09-12T01:25:53.682612+0000","last_peered":"2024-09-12T01:25:53.682612+0000","last_clean":"2024-09-12T01:25:53.682612+0000","last_became_active":"2024-09-12T00:31:50.140510+0000","last_became_peered":"2024-09-12T00:31:50.140510+0000","last_unstale":"2024-09-12T01:25:53.682612+0000","last_undegraded":"2024-09-12T01:25:53.682612+0000","last_fullsized":"2024-09-12T01:25:53.682612+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:35.280733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":944,"num_read_kb":762,"num_write":358,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'276","reported_seq":888,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.724174+0000","last_change":"2024-09-12T00:31:47.132262+0000","last_active":"2024-09-12T01:29:14.724174+0000","last_peered":"2024-09-12T01:29:14.724174+0000","last_clean":"2024-09-12T01:29:14.724174+0000","last_became_active":"2024-09-12T00:31:47.131940+0000","last_became_peered":"2024-09-12T00:31:47.131940+0000","last_unstale":"2024-09-12T01:29:14.724174+0000","last_undegraded":"2024-09-12T01:29:14.724174+0000","last_fullsized":"2024-09-12T01:29:14.724174+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:02.642276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243583,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":409,"num_read_kb":415,"num_write":1007,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714895+0000","last_change":"2024-09-12T00:31:52.153386+0000","last_active":"2024-09-12T01:25:04.714895+0000","last_peered":"2024-09-12T01:25:04.714895+0000","last_clean":"2024-09-12T01:25:04.714895+0000","last_became_active":"2024-09-12T00:31:52.151351+0000","last_became_peered":"2024-09-12T00:31:52.151351+0000","last_unstale":"2024-09-12T01:25:04.714895+0000","last_undegraded":"2024-09-12T01:25:04.714895+0000","last_fullsized":"2024-09-12T01:25:04.714895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.711260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'336","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.322764+0000","last_change":"2024-09-12T00:31:54.168796+0000","last_active":"2024-09-12T01:27:48.322764+0000","last_peered":"2024-09-12T01:27:48.322764+0000","last_clean":"2024-09-12T01:27:48.322764+0000","last_became_active":"2024-09-12T00:31:54.168545+0000","last_became_peered":"2024-09-12T00:31:54.168545+0000","last_unstale":"2024-09-12T01:27:48.322764+0000","last_undegraded":"2024-09-12T01:27:48.322764+0000","last_fullsized":"2024-09-12T01:27:48.322764+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:43.289137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51574,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":533,"num_read_kb":986,"num_write":420,"num_write_kb":279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:09.599902+0000","last_change":"2024-09-12T00:31:56.171140+0000","last_active":"2024-09-12T01:25:09.599902+0000","last_peered":"2024-09-12T01:25:09.599902+0000","last_clean":"2024-09-12T01:25:09.599902+0000","last_became_active":"2024-09-12T00:31:56.170837+0000","last_became_peered":"2024-09-12T00:31:56.170837+0000","last_unstale":"2024-09-12T01:25:09.599902+0000","last_undegraded":"2024-09-12T01:25:09.599902+0000","last_fullsized":"2024-09-12T01:25:09.599902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:56.785552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2464","reported_seq":4352,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.990962+0000","last_change":"2024-09-12T00:31:58.182713+0000","last_active":"2024-09-12T01:27:47.990962+0000","last_peered":"2024-09-12T01:27:47.990962+0000","last_clean":"2024-09-12T01:27:47.990962+0000","last_became_active":"2024-09-12T00:31:58.181552+0000","last_became_peered":"2024-09-12T00:31:58.181552+0000","last_unstale":"2024-09-12T01:27:47.990962+0000","last_undegraded":"2024-09-12T01:27:47.990962+0000","last_fullsized":"2024-09-12T01:27:47.990962+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":2400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:59.050279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":617,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6112,"num_read_kb":6115,"num_write":4931,"num_write_kb":1807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'4138","reported_seq":4750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:22.543653+0000","last_change":"2024-09-12T00:31:50.133655+0000","last_active":"2024-09-12T01:25:22.543653+0000","last_peered":"2024-09-12T01:25:22.543653+0000","last_clean":"2024-09-12T01:25:22.543653+0000","last_became_active":"2024-09-12T00:31:50.133357+0000","last_became_peered":"2024-09-12T00:31:50.133357+0000","last_unstale":"2024-09-12T01:25:22.543653+0000","last_undegraded":"2024-09-12T01:25:22.543653+0000","last_fullsized":"2024-09-12T01:25:22.543653+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":3000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:23.138805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16657,"num_read_kb":13895,"num_write":6209,"num_write_kb":3095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'271","reported_seq":878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.596431+0000","last_change":"2024-09-12T00:31:47.132203+0000","last_active":"2024-09-12T01:29:15.596431+0000","last_peered":"2024-09-12T01:29:15.596431+0000","last_clean":"2024-09-12T01:29:15.596431+0000","last_became_active":"2024-09-12T00:31:47.131849+0000","last_became_peered":"2024-09-12T00:31:47.131849+0000","last_unstale":"2024-09-12T01:29:15.596431+0000","last_undegraded":"2024-09-12T01:29:15.596431+0000","last_fullsized":"2024-09-12T01:29:15.596431+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:09.334142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244035,"num_objects":26,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":380,"num_read_kb":4533,"num_write":921,"num_write_kb":25027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:48.498477+0000","last_change":"2024-09-12T00:31:52.153157+0000","last_active":"2024-09-12T01:25:48.498477+0000","last_peered":"2024-09-12T01:25:48.498477+0000","last_clean":"2024-09-12T01:25:48.498477+0000","last_became_active":"2024-09-12T00:31:52.152244+0000","last_became_peered":"2024-09-12T00:31:52.152244+0000","last_unstale":"2024-09-12T01:25:48.498477+0000","last_undegraded":"2024-09-12T01:25:48.498477+0000","last_fullsized":"2024-09-12T01:25:48.498477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:13.492533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'94","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.599360+0000","last_change":"2024-09-12T00:31:54.167561+0000","last_active":"2024-09-12T01:25:04.599360+0000","last_peered":"2024-09-12T01:25:04.599360+0000","last_clean":"2024-09-12T01:25:04.599360+0000","last_became_active":"2024-09-12T00:31:54.167260+0000","last_became_peered":"2024-09-12T00:31:54.167260+0000","last_unstale":"2024-09-12T01:25:04.599360+0000","last_undegraded":"2024-09-12T01:25:04.599360+0000","last_fullsized":"2024-09-12T01:25:04.599360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:28.995792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":103,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:09.599867+0000","last_change":"2024-09-12T00:31:56.174756+0000","last_active":"2024-09-12T01:25:09.599867+0000","last_peered":"2024-09-12T01:25:09.599867+0000","last_clean":"2024-09-12T01:25:09.599867+0000","last_became_active":"2024-09-12T00:31:56.174452+0000","last_became_peered":"2024-09-12T00:31:56.174452+0000","last_unstale":"2024-09-12T01:25:09.599867+0000","last_undegraded":"2024-09-12T01:25:09.599867+0000","last_fullsized":"2024-09-12T01:25:09.599867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:05.497151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'144","reported_seq":638,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646008+0000","last_change":"2024-09-12T00:31:58.179079+0000","last_active":"2024-09-12T01:27:00.646008+0000","last_peered":"2024-09-12T01:27:00.646008+0000","last_clean":"2024-09-12T01:27:00.646008+0000","last_became_active":"2024-09-12T00:31:58.178748+0000","last_became_peered":"2024-09-12T00:31:58.178748+0000","last_unstale":"2024-09-12T01:27:00.646008+0000","last_undegraded":"2024-09-12T01:27:00.646008+0000","last_fullsized":"2024-09-12T01:27:00.646008+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:32.414870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":137,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'401","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:02.489318+0000","last_change":"2024-09-12T00:31:50.143909+0000","last_active":"2024-09-12T01:25:02.489318+0000","last_peered":"2024-09-12T01:25:02.489318+0000","last_clean":"2024-09-12T01:25:02.489318+0000","last_became_active":"2024-09-12T00:31:50.143399+0000","last_became_peered":"2024-09-12T00:31:50.143399+0000","last_unstale":"2024-09-12T01:25:02.489318+0000","last_undegraded":"2024-09-12T01:25:02.489318+0000","last_fullsized":"2024-09-12T01:25:02.489318+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:22.288197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1799,"num_read_kb":1492,"num_write":673,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'310","reported_seq":1090,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.597359+0000","last_change":"2024-09-12T00:32:23.831526+0000","last_active":"2024-09-12T01:29:15.597359+0000","last_peered":"2024-09-12T01:29:15.597359+0000","last_clean":"2024-09-12T01:29:15.597359+0000","last_became_active":"2024-09-12T00:32:23.830863+0000","last_became_peered":"2024-09-12T00:32:23.830863+0000","last_unstale":"2024-09-12T01:29:15.597359+0000","last_undegraded":"2024-09-12T01:29:15.597359+0000","last_fullsized":"2024-09-12T01:29:15.597359+0000","mapping_epoch":38,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569571,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":845,"num_read_kb":9184,"num_write":1014,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:03.492033+0000","last_change":"2024-09-12T00:31:52.154402+0000","last_active":"2024-09-12T01:25:03.492033+0000","last_peered":"2024-09-12T01:25:03.492033+0000","last_clean":"2024-09-12T01:25:03.492033+0000","last_became_active":"2024-09-12T00:31:52.154077+0000","last_became_peered":"2024-09-12T00:31:52.154077+0000","last_unstale":"2024-09-12T01:25:03.492033+0000","last_undegraded":"2024-09-12T01:25:03.492033+0000","last_fullsized":"2024-09-12T01:25:03.492033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:27.520584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'119","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:48.498488+0000","last_change":"2024-09-12T00:31:54.164132+0000","last_active":"2024-09-12T01:25:48.498488+0000","last_peered":"2024-09-12T01:25:48.498488+0000","last_clean":"2024-09-12T01:25:48.498488+0000","last_became_active":"2024-09-12T00:31:54.163434+0000","last_became_peered":"2024-09-12T00:31:54.163434+0000","last_unstale":"2024-09-12T01:25:48.498488+0000","last_undegraded":"2024-09-12T01:25:48.498488+0000","last_fullsized":"2024-09-12T01:25:48.498488+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:14.391704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":152,"num_read_kb":145,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'781","reported_seq":4219,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.295304+0000","last_change":"2024-09-12T00:31:56.171437+0000","last_active":"2024-09-12T01:29:14.295304+0000","last_peered":"2024-09-12T01:29:14.295304+0000","last_clean":"2024-09-12T01:29:14.295304+0000","last_became_active":"2024-09-12T00:31:56.171157+0000","last_became_peered":"2024-09-12T00:31:56.171157+0000","last_unstale":"2024-09-12T01:29:14.295304+0000","last_undegraded":"2024-09-12T01:29:14.295304+0000","last_fullsized":"2024-09-12T01:29:14.295304+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":700,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:03.870161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'201","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.663408+0000","last_change":"2024-09-12T00:31:58.179919+0000","last_active":"2024-09-12T01:27:47.663408+0000","last_peered":"2024-09-12T01:27:47.663408+0000","last_clean":"2024-09-12T01:27:47.663408+0000","last_became_active":"2024-09-12T00:31:58.179576+0000","last_became_peered":"2024-09-12T00:31:58.179576+0000","last_unstale":"2024-09-12T01:27:47.663408+0000","last_undegraded":"2024-09-12T01:27:47.663408+0000","last_fullsized":"2024-09-12T01:27:47.663408+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:00.446809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":631,"num_write":454,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'417","reported_seq":1156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:25.005608+0000","last_change":"2024-09-12T00:31:50.140975+0000","last_active":"2024-09-12T01:27:25.005608+0000","last_peered":"2024-09-12T01:27:25.005608+0000","last_clean":"2024-09-12T01:27:25.005608+0000","last_became_active":"2024-09-12T00:31:50.140485+0000","last_became_peered":"2024-09-12T00:31:50.140485+0000","last_unstale":"2024-09-12T01:27:25.005608+0000","last_undegraded":"2024-09-12T01:27:25.005608+0000","last_fullsized":"2024-09-12T01:27:25.005608+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:37.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2003,"num_read_kb":1658,"num_write":744,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'255","reported_seq":937,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.354425+0000","last_change":"2024-09-12T00:31:47.125806+0000","last_active":"2024-09-12T01:29:14.354425+0000","last_peered":"2024-09-12T01:29:14.354425+0000","last_clean":"2024-09-12T01:29:14.354425+0000","last_became_active":"2024-09-12T00:31:47.125118+0000","last_became_peered":"2024-09-12T00:31:47.125118+0000","last_unstale":"2024-09-12T01:29:14.354425+0000","last_undegraded":"2024-09-12T01:29:14.354425+0000","last_fullsized":"2024-09-12T01:29:14.354425+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:30.278130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6598689,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":470,"num_read_kb":32878,"num_write":1012,"num_write_kb":23042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714949+0000","last_change":"2024-09-12T00:31:52.154490+0000","last_active":"2024-09-12T01:25:04.714949+0000","last_peered":"2024-09-12T01:25:04.714949+0000","last_clean":"2024-09-12T01:25:04.714949+0000","last_became_active":"2024-09-12T00:31:52.154189+0000","last_became_peered":"2024-09-12T00:31:52.154189+0000","last_unstale":"2024-09-12T01:25:04.714949+0000","last_undegraded":"2024-09-12T01:25:04.714949+0000","last_fullsized":"2024-09-12T01:25:04.714949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:46.021304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'272","reported_seq":841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.320951+0000","last_change":"2024-09-12T00:31:54.171678+0000","last_active":"2024-09-12T01:28:55.320951+0000","last_peered":"2024-09-12T01:28:55.320951+0000","last_clean":"2024-09-12T01:28:55.320951+0000","last_became_active":"2024-09-12T00:31:54.171354+0000","last_became_peered":"2024-09-12T00:31:54.171354+0000","last_unstale":"2024-09-12T01:28:55.320951+0000","last_undegraded":"2024-09-12T01:28:55.320951+0000","last_fullsized":"2024-09-12T01:28:55.320951+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:44.212575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63397,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":941,"num_write":366,"num_write_kb":301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'780","reported_seq":2504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.362498+0000","last_change":"2024-09-12T00:31:56.176843+0000","last_active":"2024-09-12T01:28:55.362498+0000","last_peered":"2024-09-12T01:28:55.362498+0000","last_clean":"2024-09-12T01:28:55.362498+0000","last_became_active":"2024-09-12T00:31:56.176464+0000","last_became_peered":"2024-09-12T00:31:56.176464+0000","last_unstale":"2024-09-12T01:28:55.362498+0000","last_undegraded":"2024-09-12T01:28:55.362498+0000","last_fullsized":"2024-09-12T01:28:55.362498+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:39.501516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'324","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.722779+0000","last_change":"2024-09-12T00:31:50.138593+0000","last_active":"2024-09-12T01:25:59.722779+0000","last_peered":"2024-09-12T01:25:59.722779+0000","last_clean":"2024-09-12T01:25:59.722779+0000","last_became_active":"2024-09-12T00:31:50.138335+0000","last_became_peered":"2024-09-12T00:31:50.138335+0000","last_unstale":"2024-09-12T01:25:59.722779+0000","last_undegraded":"2024-09-12T01:25:59.722779+0000","last_fullsized":"2024-09-12T01:25:59.722779+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:08.736816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1108,"num_write":487,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'274","reported_seq":921,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.355892+0000","last_change":"2024-09-12T00:31:47.138476+0000","last_active":"2024-09-12T01:29:14.355892+0000","last_peered":"2024-09-12T01:29:14.355892+0000","last_clean":"2024-09-12T01:29:14.355892+0000","last_became_active":"2024-09-12T00:31:47.137951+0000","last_became_peered":"2024-09-12T00:31:47.137951+0000","last_unstale":"2024-09-12T01:29:14.355892+0000","last_undegraded":"2024-09-12T01:29:14.355892+0000","last_fullsized":"2024-09-12T01:29:14.355892+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:13.403628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7500437,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":415,"num_read_kb":21456,"num_write":1042,"num_write_kb":35236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605639+0000","last_change":"2024-09-12T00:31:52.155328+0000","last_active":"2024-09-12T01:26:04.605639+0000","last_peered":"2024-09-12T01:26:04.605639+0000","last_clean":"2024-09-12T01:26:04.605639+0000","last_became_active":"2024-09-12T00:31:52.155047+0000","last_became_peered":"2024-09-12T00:31:52.155047+0000","last_unstale":"2024-09-12T01:26:04.605639+0000","last_undegraded":"2024-09-12T01:26:04.605639+0000","last_fullsized":"2024-09-12T01:26:04.605639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:16.230836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'364","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.346006+0000","last_change":"2024-09-12T00:31:54.173591+0000","last_active":"2024-09-12T01:29:14.346006+0000","last_peered":"2024-09-12T01:29:14.346006+0000","last_clean":"2024-09-12T01:29:14.346006+0000","last_became_active":"2024-09-12T00:31:54.173363+0000","last_became_peered":"2024-09-12T00:31:54.173363+0000","last_unstale":"2024-09-12T01:29:14.346006+0000","last_undegraded":"2024-09-12T01:29:14.346006+0000","last_fullsized":"2024-09-12T01:29:14.346006+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:50.016365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53603,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":577,"num_read_kb":1083,"num_write":449,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.636308+0000","last_change":"2024-09-12T00:31:56.173079+0000","last_active":"2024-09-12T01:25:55.636308+0000","last_peered":"2024-09-12T01:25:55.636308+0000","last_clean":"2024-09-12T01:25:55.636308+0000","last_became_active":"2024-09-12T00:31:56.172791+0000","last_became_peered":"2024-09-12T00:31:56.172791+0000","last_unstale":"2024-09-12T01:25:55.636308+0000","last_undegraded":"2024-09-12T01:25:55.636308+0000","last_fullsized":"2024-09-12T01:25:55.636308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:18.460860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'542","reported_seq":1367,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.343041+0000","last_change":"2024-09-12T00:31:58.178597+0000","last_active":"2024-09-12T01:28:55.343041+0000","last_peered":"2024-09-12T01:28:55.343041+0000","last_clean":"2024-09-12T01:28:55.343041+0000","last_became_active":"2024-09-12T00:31:58.177828+0000","last_became_peered":"2024-09-12T00:31:58.177828+0000","last_unstale":"2024-09-12T01:28:55.343041+0000","last_undegraded":"2024-09-12T01:28:55.343041+0000","last_fullsized":"2024-09-12T01:28:55.343041+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:23.485365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1309,"num_read_kb":1288,"num_write":1113,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'199","reported_seq":826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.412983+0000","last_change":"2024-09-12T00:31:50.138558+0000","last_active":"2024-09-12T01:27:00.412983+0000","last_peered":"2024-09-12T01:27:00.412983+0000","last_clean":"2024-09-12T01:27:00.412983+0000","last_became_active":"2024-09-12T00:31:50.138261+0000","last_became_peered":"2024-09-12T00:31:50.138261+0000","last_unstale":"2024-09-12T01:27:00.412983+0000","last_undegraded":"2024-09-12T01:27:00.412983+0000","last_fullsized":"2024-09-12T01:27:00.412983+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:25.679935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":866,"num_read_kb":707,"num_write":323,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'322","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.517321+0000","last_change":"2024-09-12T00:31:47.137585+0000","last_active":"2024-09-12T01:28:04.517321+0000","last_peered":"2024-09-12T01:28:04.517321+0000","last_clean":"2024-09-12T01:28:04.517321+0000","last_became_active":"2024-09-12T00:31:47.137234+0000","last_became_peered":"2024-09-12T00:31:47.137234+0000","last_unstale":"2024-09-12T01:28:04.517321+0000","last_undegraded":"2024-09-12T01:28:04.517321+0000","last_fullsized":"2024-09-12T01:28:04.517321+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:35.306270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2307306,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":654,"num_read_kb":90780,"num_write":1215,"num_write_kb":21068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.637884+0000","last_change":"2024-09-12T00:31:52.148985+0000","last_active":"2024-09-12T01:26:05.637884+0000","last_peered":"2024-09-12T01:26:05.637884+0000","last_clean":"2024-09-12T01:26:05.637884+0000","last_became_active":"2024-09-12T00:31:52.148738+0000","last_became_peered":"2024-09-12T00:31:52.148738+0000","last_unstale":"2024-09-12T01:26:05.637884+0000","last_undegraded":"2024-09-12T01:26:05.637884+0000","last_fullsized":"2024-09-12T01:26:05.637884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:20.806375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'280","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:08.518925+0000","last_change":"2024-09-12T00:31:54.168598+0000","last_active":"2024-09-12T01:28:08.518925+0000","last_peered":"2024-09-12T01:28:08.518925+0000","last_clean":"2024-09-12T01:28:08.518925+0000","last_became_active":"2024-09-12T00:31:54.168247+0000","last_became_peered":"2024-09-12T00:31:54.168247+0000","last_unstale":"2024-09-12T01:28:08.518925+0000","last_undegraded":"2024-09-12T01:28:08.518925+0000","last_fullsized":"2024-09-12T01:28:08.518925+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:53.709459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58827,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":962,"num_write":376,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:23.503173+0000","last_change":"2024-09-12T00:31:56.173852+0000","last_active":"2024-09-12T01:26:23.503173+0000","last_peered":"2024-09-12T01:26:23.503173+0000","last_clean":"2024-09-12T01:26:23.503173+0000","last_became_active":"2024-09-12T00:31:56.173549+0000","last_became_peered":"2024-09-12T00:31:56.173549+0000","last_unstale":"2024-09-12T01:26:23.503173+0000","last_undegraded":"2024-09-12T01:26:23.503173+0000","last_fullsized":"2024-09-12T01:26:23.503173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:31.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'131","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:24.521745+0000","last_change":"2024-09-12T00:31:58.175490+0000","last_active":"2024-09-12T01:28:24.521745+0000","last_peered":"2024-09-12T01:28:24.521745+0000","last_clean":"2024-09-12T01:28:24.521745+0000","last_became_active":"2024-09-12T00:31:58.175195+0000","last_became_peered":"2024-09-12T00:31:58.175195+0000","last_unstale":"2024-09-12T01:28:24.521745+0000","last_undegraded":"2024-09-12T01:28:24.521745+0000","last_fullsized":"2024-09-12T01:28:24.521745+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:18.942923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":426,"num_read_kb":345,"num_write":330,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'360","reported_seq":951,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505956+0000","last_change":"2024-09-12T00:31:50.143092+0000","last_active":"2024-09-12T01:26:14.505956+0000","last_peered":"2024-09-12T01:26:14.505956+0000","last_clean":"2024-09-12T01:26:14.505956+0000","last_became_active":"2024-09-12T00:31:50.142818+0000","last_became_peered":"2024-09-12T00:31:50.142818+0000","last_unstale":"2024-09-12T01:26:14.505956+0000","last_undegraded":"2024-09-12T01:26:14.505956+0000","last_fullsized":"2024-09-12T01:26:14.505956+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:29.886696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1555,"num_read_kb":1227,"num_write":605,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'268","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.689763+0000","last_change":"2024-09-12T00:31:47.113555+0000","last_active":"2024-09-12T01:29:14.689763+0000","last_peered":"2024-09-12T01:29:14.689763+0000","last_clean":"2024-09-12T01:29:14.689763+0000","last_became_active":"2024-09-12T00:31:47.112306+0000","last_became_peered":"2024-09-12T00:31:47.112306+0000","last_unstale":"2024-09-12T01:29:14.689763+0000","last_undegraded":"2024-09-12T01:29:14.689763+0000","last_fullsized":"2024-09-12T01:29:14.689763+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:25.942485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8409984,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":393,"num_read_kb":55420,"num_write":994,"num_write_kb":24613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:52.497023+0000","last_change":"2024-09-12T00:31:52.154154+0000","last_active":"2024-09-12T01:25:52.497023+0000","last_peered":"2024-09-12T01:25:52.497023+0000","last_clean":"2024-09-12T01:25:52.497023+0000","last_became_active":"2024-09-12T00:31:52.153862+0000","last_became_peered":"2024-09-12T00:31:52.153862+0000","last_unstale":"2024-09-12T01:25:52.497023+0000","last_undegraded":"2024-09-12T01:25:52.497023+0000","last_fullsized":"2024-09-12T01:25:52.497023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:25.663441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'358","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.726954+0000","last_change":"2024-09-12T00:31:54.162856+0000","last_active":"2024-09-12T01:29:14.726954+0000","last_peered":"2024-09-12T01:29:14.726954+0000","last_clean":"2024-09-12T01:29:14.726954+0000","last_became_active":"2024-09-12T00:31:54.162228+0000","last_became_peered":"2024-09-12T00:31:54.162228+0000","last_unstale":"2024-09-12T01:29:14.726954+0000","last_undegraded":"2024-09-12T01:29:14.726954+0000","last_fullsized":"2024-09-12T01:29:14.726954+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:20.520023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50365,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":550,"num_read_kb":1150,"num_write":448,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'779","reported_seq":2595,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.363532+0000","last_change":"2024-09-12T00:31:56.172797+0000","last_active":"2024-09-12T01:28:55.363532+0000","last_peered":"2024-09-12T01:28:55.363532+0000","last_clean":"2024-09-12T01:28:55.363532+0000","last_became_active":"2024-09-12T00:31:56.172503+0000","last_became_peered":"2024-09-12T00:31:56.172503+0000","last_unstale":"2024-09-12T01:28:55.363532+0000","last_undegraded":"2024-09-12T01:28:55.363532+0000","last_fullsized":"2024-09-12T01:28:55.363532+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:50.107192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'148","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.305098+0000","last_change":"2024-09-12T00:31:58.175440+0000","last_active":"2024-09-12T01:28:54.305098+0000","last_peered":"2024-09-12T01:28:54.305098+0000","last_clean":"2024-09-12T01:28:54.305098+0000","last_became_active":"2024-09-12T00:31:58.175027+0000","last_became_peered":"2024-09-12T00:31:58.175027+0000","last_unstale":"2024-09-12T01:28:54.305098+0000","last_undegraded":"2024-09-12T01:28:54.305098+0000","last_fullsized":"2024-09-12T01:28:54.305098+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:26.724138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":179,"num_read_kb":162,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'330","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:52.496996+0000","last_change":"2024-09-12T00:31:50.144275+0000","last_active":"2024-09-12T01:25:52.496996+0000","last_peered":"2024-09-12T01:25:52.496996+0000","last_clean":"2024-09-12T01:25:52.496996+0000","last_became_active":"2024-09-12T00:31:50.143814+0000","last_became_peered":"2024-09-12T00:31:50.143814+0000","last_unstale":"2024-09-12T01:25:52.496996+0000","last_undegraded":"2024-09-12T01:25:52.496996+0000","last_fullsized":"2024-09-12T01:25:52.496996+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:41.133905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1421,"num_read_kb":1140,"num_write":511,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'312","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:49.395214+0000","last_change":"2024-09-12T00:31:47.139001+0000","last_active":"2024-09-12T01:28:49.395214+0000","last_peered":"2024-09-12T01:28:49.395214+0000","last_clean":"2024-09-12T01:28:49.395214+0000","last_became_active":"2024-09-12T00:31:47.138687+0000","last_became_peered":"2024-09-12T00:31:47.138687+0000","last_unstale":"2024-09-12T01:28:49.395214+0000","last_undegraded":"2024-09-12T01:28:49.395214+0000","last_fullsized":"2024-09-12T01:28:49.395214+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:39.040881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11927828,"num_objects":65,"num_object_clones":0,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":504,"num_read_kb":39444,"num_write":1135,"num_write_kb":53128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639608+0000","last_change":"2024-09-12T00:31:52.155135+0000","last_active":"2024-09-12T01:26:15.639608+0000","last_peered":"2024-09-12T01:26:15.639608+0000","last_clean":"2024-09-12T01:26:15.639608+0000","last_became_active":"2024-09-12T00:31:52.154863+0000","last_became_peered":"2024-09-12T00:31:52.154863+0000","last_unstale":"2024-09-12T01:26:15.639608+0000","last_undegraded":"2024-09-12T01:26:15.639608+0000","last_fullsized":"2024-09-12T01:26:15.639608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:40.280300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'502","reported_seq":1145,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.312525+0000","last_change":"2024-09-12T00:31:54.169066+0000","last_active":"2024-09-12T01:28:55.312525+0000","last_peered":"2024-09-12T01:28:55.312525+0000","last_clean":"2024-09-12T01:28:55.312525+0000","last_became_active":"2024-09-12T00:31:54.168691+0000","last_became_peered":"2024-09-12T00:31:54.168691+0000","last_unstale":"2024-09-12T01:28:55.312525+0000","last_undegraded":"2024-09-12T01:28:55.312525+0000","last_fullsized":"2024-09-12T01:28:55.312525+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:06.873573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130121,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":883,"num_read_kb":1929,"num_write":742,"num_write_kb":638,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499328+0000","last_change":"2024-09-12T00:31:56.175805+0000","last_active":"2024-09-12T01:26:07.499328+0000","last_peered":"2024-09-12T01:26:07.499328+0000","last_clean":"2024-09-12T01:26:07.499328+0000","last_became_active":"2024-09-12T00:31:56.175412+0000","last_became_peered":"2024-09-12T00:31:56.175412+0000","last_unstale":"2024-09-12T01:26:07.499328+0000","last_undegraded":"2024-09-12T01:26:07.499328+0000","last_fullsized":"2024-09-12T01:26:07.499328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:32.829417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'133","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:10.783574+0000","last_change":"2024-09-12T00:31:58.178548+0000","last_active":"2024-09-12T01:26:10.783574+0000","last_peered":"2024-09-12T01:26:10.783574+0000","last_clean":"2024-09-12T01:26:10.783574+0000","last_became_active":"2024-09-12T00:31:58.178027+0000","last_became_peered":"2024-09-12T00:31:58.178027+0000","last_unstale":"2024-09-12T01:26:10.783574+0000","last_undegraded":"2024-09-12T01:26:10.783574+0000","last_fullsized":"2024-09-12T01:26:10.783574+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.407511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'162","reported_seq":791,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.500388+0000","last_change":"2024-09-12T00:31:50.127506+0000","last_active":"2024-09-12T01:25:49.500388+0000","last_peered":"2024-09-12T01:25:49.500388+0000","last_clean":"2024-09-12T01:25:49.500388+0000","last_became_active":"2024-09-12T00:31:50.127193+0000","last_became_peered":"2024-09-12T00:31:50.127193+0000","last_unstale":"2024-09-12T01:25:49.500388+0000","last_undegraded":"2024-09-12T01:25:49.500388+0000","last_fullsized":"2024-09-12T01:25:49.500388+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:52.691594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":547,"num_write":243,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'311","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.633333+0000","last_change":"2024-09-12T00:31:47.130530+0000","last_active":"2024-09-12T01:29:15.633333+0000","last_peered":"2024-09-12T01:29:15.633333+0000","last_clean":"2024-09-12T01:29:15.633333+0000","last_became_active":"2024-09-12T00:31:47.130136+0000","last_became_peered":"2024-09-12T00:31:47.130136+0000","last_unstale":"2024-09-12T01:29:15.633333+0000","last_undegraded":"2024-09-12T01:29:15.633333+0000","last_fullsized":"2024-09-12T01:29:15.633333+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:35.574448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263466,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":489,"num_read_kb":72156,"num_write":1129,"num_write_kb":60123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.781057+0000","last_change":"2024-09-12T00:31:52.155387+0000","last_active":"2024-09-12T01:25:55.781057+0000","last_peered":"2024-09-12T01:25:55.781057+0000","last_clean":"2024-09-12T01:25:55.781057+0000","last_became_active":"2024-09-12T00:31:52.155083+0000","last_became_peered":"2024-09-12T00:31:52.155083+0000","last_unstale":"2024-09-12T01:25:55.781057+0000","last_undegraded":"2024-09-12T01:25:55.781057+0000","last_fullsized":"2024-09-12T01:25:55.781057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:51.358822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'319","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.314003+0000","last_change":"2024-09-12T00:31:54.165545+0000","last_active":"2024-09-12T01:28:55.314003+0000","last_peered":"2024-09-12T01:28:55.314003+0000","last_clean":"2024-09-12T01:28:55.314003+0000","last_became_active":"2024-09-12T00:31:54.165221+0000","last_became_peered":"2024-09-12T00:31:54.165221+0000","last_unstale":"2024-09-12T01:28:55.314003+0000","last_undegraded":"2024-09-12T01:28:55.314003+0000","last_fullsized":"2024-09-12T01:28:55.314003+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:34.590028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62343,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":526,"num_read_kb":1039,"num_write":478,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782685+0000","last_change":"2024-09-12T00:31:56.173067+0000","last_active":"2024-09-12T01:26:05.782685+0000","last_peered":"2024-09-12T01:26:05.782685+0000","last_clean":"2024-09-12T01:26:05.782685+0000","last_became_active":"2024-09-12T00:31:56.172777+0000","last_became_peered":"2024-09-12T00:31:56.172777+0000","last_unstale":"2024-09-12T01:26:05.782685+0000","last_undegraded":"2024-09-12T01:26:05.782685+0000","last_fullsized":"2024-09-12T01:26:05.782685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:49.874762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'114","reported_seq":604,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:12.518829+0000","last_change":"2024-09-12T00:31:58.179957+0000","last_active":"2024-09-12T01:28:12.518829+0000","last_peered":"2024-09-12T01:28:12.518829+0000","last_clean":"2024-09-12T01:28:12.518829+0000","last_became_active":"2024-09-12T00:31:58.179667+0000","last_became_peered":"2024-09-12T00:31:58.179667+0000","last_unstale":"2024-09-12T01:28:12.518829+0000","last_undegraded":"2024-09-12T01:28:12.518829+0000","last_fullsized":"2024-09-12T01:28:12.518829+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:04.950082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":909,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":84,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'226","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721754+0000","last_change":"2024-09-12T00:31:50.131405+0000","last_active":"2024-09-12T01:25:49.721754+0000","last_peered":"2024-09-12T01:25:49.721754+0000","last_clean":"2024-09-12T01:25:49.721754+0000","last_became_active":"2024-09-12T00:31:50.130807+0000","last_became_peered":"2024-09-12T00:31:50.130807+0000","last_unstale":"2024-09-12T01:25:49.721754+0000","last_undegraded":"2024-09-12T01:25:49.721754+0000","last_fullsized":"2024-09-12T01:25:49.721754+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:43.848144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":940,"num_read_kb":756,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'334","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.689623+0000","last_change":"2024-09-12T00:31:47.113900+0000","last_active":"2024-09-12T01:29:14.689623+0000","last_peered":"2024-09-12T01:29:14.689623+0000","last_clean":"2024-09-12T01:29:14.689623+0000","last_became_active":"2024-09-12T00:31:47.113265+0000","last_became_peered":"2024-09-12T00:31:47.113265+0000","last_unstale":"2024-09-12T01:29:14.689623+0000","last_undegraded":"2024-09-12T01:29:14.689623+0000","last_fullsized":"2024-09-12T01:29:14.689623+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:24.211193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202787,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":531,"num_read_kb":11690,"num_write":1190,"num_write_kb":25282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:52.497051+0000","last_change":"2024-09-12T00:31:52.156164+0000","last_active":"2024-09-12T01:25:52.497051+0000","last_peered":"2024-09-12T01:25:52.497051+0000","last_clean":"2024-09-12T01:25:52.497051+0000","last_became_active":"2024-09-12T00:31:52.155877+0000","last_became_peered":"2024-09-12T00:31:52.155877+0000","last_unstale":"2024-09-12T01:25:52.497051+0000","last_undegraded":"2024-09-12T01:25:52.497051+0000","last_fullsized":"2024-09-12T01:25:52.497051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:38.312330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'305","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:27.521381+0000","last_change":"2024-09-12T00:31:54.165410+0000","last_active":"2024-09-12T01:28:27.521381+0000","last_peered":"2024-09-12T01:28:27.521381+0000","last_clean":"2024-09-12T01:28:27.521381+0000","last_became_active":"2024-09-12T00:31:54.165107+0000","last_became_peered":"2024-09-12T00:31:54.165107+0000","last_unstale":"2024-09-12T01:28:27.521381+0000","last_undegraded":"2024-09-12T01:28:27.521381+0000","last_fullsized":"2024-09-12T01:28:27.521381+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:41.442937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56639,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":503,"num_read_kb":996,"num_write":408,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'742","reported_seq":2475,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.295169+0000","last_change":"2024-09-12T00:31:56.170713+0000","last_active":"2024-09-12T01:29:14.295169+0000","last_peered":"2024-09-12T01:29:14.295169+0000","last_clean":"2024-09-12T01:29:14.295169+0000","last_became_active":"2024-09-12T00:31:56.170388+0000","last_became_peered":"2024-09-12T00:31:56.170388+0000","last_unstale":"2024-09-12T01:29:14.295169+0000","last_undegraded":"2024-09-12T01:29:14.295169+0000","last_fullsized":"2024-09-12T01:29:14.295169+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:46.492927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'162","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:46.479085+0000","last_change":"2024-09-12T00:31:58.172116+0000","last_active":"2024-09-12T01:27:46.479085+0000","last_peered":"2024-09-12T01:27:46.479085+0000","last_clean":"2024-09-12T01:27:46.479085+0000","last_became_active":"2024-09-12T00:31:58.171814+0000","last_became_peered":"2024-09-12T00:31:58.171814+0000","last_unstale":"2024-09-12T01:27:46.479085+0000","last_undegraded":"2024-09-12T01:27:46.479085+0000","last_fullsized":"2024-09-12T01:27:46.479085+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:12.214205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":379,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'117","reported_seq":721,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.318699+0000","last_change":"2024-09-12T00:31:50.142691+0000","last_active":"2024-09-12T01:27:48.318699+0000","last_peered":"2024-09-12T01:27:48.318699+0000","last_clean":"2024-09-12T01:27:48.318699+0000","last_became_active":"2024-09-12T00:31:50.142370+0000","last_became_peered":"2024-09-12T00:31:50.142370+0000","last_unstale":"2024-09-12T01:27:48.318699+0000","last_undegraded":"2024-09-12T01:27:48.318699+0000","last_fullsized":"2024-09-12T01:27:48.318699+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:28.025270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":572,"num_read_kb":482,"num_write":177,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'250","reported_seq":869,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.689763+0000","last_change":"2024-09-12T00:31:47.122868+0000","last_active":"2024-09-12T01:29:14.689763+0000","last_peered":"2024-09-12T01:29:14.689763+0000","last_clean":"2024-09-12T01:29:14.689763+0000","last_became_active":"2024-09-12T00:31:47.122110+0000","last_became_peered":"2024-09-12T00:31:47.122110+0000","last_unstale":"2024-09-12T01:29:14.689763+0000","last_undegraded":"2024-09-12T01:29:14.689763+0000","last_fullsized":"2024-09-12T01:29:14.689763+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:22.824588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16053943,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":343,"num_read_kb":34903,"num_write":862,"num_write_kb":39966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1454,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.074988+0000","last_change":"2024-09-12T00:31:52.155143+0000","last_active":"2024-09-12T01:29:14.074988+0000","last_peered":"2024-09-12T01:29:14.074988+0000","last_clean":"2024-09-12T01:29:14.074988+0000","last_became_active":"2024-09-12T00:31:52.154858+0000","last_became_peered":"2024-09-12T00:31:52.154858+0000","last_unstale":"2024-09-12T01:29:14.074988+0000","last_undegraded":"2024-09-12T01:29:14.074988+0000","last_fullsized":"2024-09-12T01:29:14.074988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:28.556319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'84","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.636359+0000","last_change":"2024-09-12T00:31:54.167692+0000","last_active":"2024-09-12T01:25:55.636359+0000","last_peered":"2024-09-12T01:25:55.636359+0000","last_clean":"2024-09-12T01:25:55.636359+0000","last_became_active":"2024-09-12T00:31:54.167362+0000","last_became_peered":"2024-09-12T00:31:54.167362+0000","last_unstale":"2024-09-12T01:25:55.636359+0000","last_undegraded":"2024-09-12T01:25:55.636359+0000","last_fullsized":"2024-09-12T01:25:55.636359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:15.421825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'770","reported_seq":2496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.296478+0000","last_change":"2024-09-12T00:31:56.173817+0000","last_active":"2024-09-12T01:29:14.296478+0000","last_peered":"2024-09-12T01:29:14.296478+0000","last_clean":"2024-09-12T01:29:14.296478+0000","last_became_active":"2024-09-12T00:31:56.173548+0000","last_became_peered":"2024-09-12T00:31:56.173548+0000","last_unstale":"2024-09-12T01:29:14.296478+0000","last_undegraded":"2024-09-12T01:29:14.296478+0000","last_fullsized":"2024-09-12T01:29:14.296478+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":700,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:34.709914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'124","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.453295+0000","last_change":"2024-09-12T00:31:58.175176+0000","last_active":"2024-09-12T01:27:48.453295+0000","last_peered":"2024-09-12T01:27:48.453295+0000","last_clean":"2024-09-12T01:27:48.453295+0000","last_became_active":"2024-09-12T00:31:58.174886+0000","last_became_peered":"2024-09-12T00:31:58.174886+0000","last_unstale":"2024-09-12T01:27:48.453295+0000","last_undegraded":"2024-09-12T01:27:48.453295+0000","last_fullsized":"2024-09-12T01:27:48.453295+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:21.010979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":123,"num_write":278,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'279","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:57.044069+0000","last_change":"2024-09-12T00:31:50.140192+0000","last_active":"2024-09-12T01:26:57.044069+0000","last_peered":"2024-09-12T01:26:57.044069+0000","last_clean":"2024-09-12T01:26:57.044069+0000","last_became_active":"2024-09-12T00:31:50.139923+0000","last_became_peered":"2024-09-12T00:31:50.139923+0000","last_unstale":"2024-09-12T01:26:57.044069+0000","last_undegraded":"2024-09-12T01:26:57.044069+0000","last_fullsized":"2024-09-12T01:26:57.044069+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:45.055920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":954,"num_write":459,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'306","reported_seq":1027,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:43.961087+0000","last_change":"2024-09-12T00:31:47.122785+0000","last_active":"2024-09-12T01:26:43.961087+0000","last_peered":"2024-09-12T01:26:43.961087+0000","last_clean":"2024-09-12T01:26:43.961087+0000","last_became_active":"2024-09-12T00:31:47.122007+0000","last_became_peered":"2024-09-12T00:31:47.122007+0000","last_unstale":"2024-09-12T01:26:43.961087+0000","last_undegraded":"2024-09-12T01:26:43.961087+0000","last_fullsized":"2024-09-12T01:26:43.961087+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:49.888568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5268542,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":591,"num_read_kb":69205,"num_write":1136,"num_write_kb":21863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.722337+0000","last_change":"2024-09-12T00:31:52.147230+0000","last_active":"2024-09-12T01:25:54.722337+0000","last_peered":"2024-09-12T01:25:54.722337+0000","last_clean":"2024-09-12T01:25:54.722337+0000","last_became_active":"2024-09-12T00:31:52.146894+0000","last_became_peered":"2024-09-12T00:31:52.146894+0000","last_unstale":"2024-09-12T01:25:54.722337+0000","last_undegraded":"2024-09-12T01:25:54.722337+0000","last_fullsized":"2024-09-12T01:25:54.722337+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:01.319728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'416","reported_seq":1025,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.327097+0000","last_change":"2024-09-12T00:31:54.170886+0000","last_active":"2024-09-12T01:28:55.327097+0000","last_peered":"2024-09-12T01:28:55.327097+0000","last_clean":"2024-09-12T01:28:55.327097+0000","last_became_active":"2024-09-12T00:31:54.170522+0000","last_became_peered":"2024-09-12T00:31:54.170522+0000","last_unstale":"2024-09-12T01:28:55.327097+0000","last_undegraded":"2024-09-12T01:28:55.327097+0000","last_fullsized":"2024-09-12T01:28:55.327097+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:11.181608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65010,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1261,"num_read_kb":1830,"num_write":1796,"num_write_kb":1654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.504440+0000","last_change":"2024-09-12T00:31:56.168824+0000","last_active":"2024-09-12T01:25:59.504440+0000","last_peered":"2024-09-12T01:25:59.504440+0000","last_clean":"2024-09-12T01:25:59.504440+0000","last_became_active":"2024-09-12T00:31:56.168503+0000","last_became_peered":"2024-09-12T00:31:56.168503+0000","last_unstale":"2024-09-12T01:25:59.504440+0000","last_undegraded":"2024-09-12T01:25:59.504440+0000","last_fullsized":"2024-09-12T01:25:59.504440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:47.541247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'129","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:38.383006+0000","last_change":"2024-09-12T00:31:58.173064+0000","last_active":"2024-09-12T01:26:38.383006+0000","last_peered":"2024-09-12T01:26:38.383006+0000","last_clean":"2024-09-12T01:26:38.383006+0000","last_became_active":"2024-09-12T00:31:58.172778+0000","last_became_peered":"2024-09-12T00:31:58.172778+0000","last_unstale":"2024-09-12T01:26:38.383006+0000","last_undegraded":"2024-09-12T01:26:38.383006+0000","last_fullsized":"2024-09-12T01:26:38.383006+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:25.437723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":147,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'168","reported_seq":780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723659+0000","last_change":"2024-09-12T00:31:50.131714+0000","last_active":"2024-09-12T01:26:04.723659+0000","last_peered":"2024-09-12T01:26:04.723659+0000","last_clean":"2024-09-12T01:26:04.723659+0000","last_became_active":"2024-09-12T00:31:50.131152+0000","last_became_peered":"2024-09-12T00:31:50.131152+0000","last_unstale":"2024-09-12T01:26:04.723659+0000","last_undegraded":"2024-09-12T01:26:04.723659+0000","last_fullsized":"2024-09-12T01:26:04.723659+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:10.401016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":649,"num_write":266,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":618,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.602382+0000","last_change":"2024-09-12T00:31:29.750620+0000","last_active":"2024-09-12T01:25:34.602382+0000","last_peered":"2024-09-12T01:25:34.602382+0000","last_clean":"2024-09-12T01:25:34.602382+0000","last_became_active":"2024-09-12T00:31:29.750331+0000","last_became_peered":"2024-09-12T00:31:29.750331+0000","last_unstale":"2024-09-12T01:25:34.602382+0000","last_undegraded":"2024-09-12T01:25:34.602382+0000","last_fullsized":"2024-09-12T01:25:34.602382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:28.736382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:28.736382+0000","last_clean_scrub_stamp":"2024-09-12T00:31:28.736382+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:30.636870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721690+0000","last_change":"2024-09-12T00:31:38.792167+0000","last_active":"2024-09-12T01:25:49.721690+0000","last_peered":"2024-09-12T01:25:49.721690+0000","last_clean":"2024-09-12T01:25:49.721690+0000","last_became_active":"2024-09-12T00:31:36.970959+0000","last_became_peered":"2024-09-12T00:31:36.970959+0000","last_unstale":"2024-09-12T01:25:49.721690+0000","last_undegraded":"2024-09-12T01:25:49.721690+0000","last_fullsized":"2024-09-12T01:25:49.721690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:16.364886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098350799999999991,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'268","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:28.012307+0000","last_change":"2024-09-12T00:31:47.130441+0000","last_active":"2024-09-12T01:26:28.012307+0000","last_peered":"2024-09-12T01:26:28.012307+0000","last_clean":"2024-09-12T01:26:28.012307+0000","last_became_active":"2024-09-12T00:31:47.130015+0000","last_became_peered":"2024-09-12T00:31:47.130015+0000","last_unstale":"2024-09-12T01:26:28.012307+0000","last_undegraded":"2024-09-12T01:26:28.012307+0000","last_fullsized":"2024-09-12T01:26:28.012307+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:10.863669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10835095,"num_objects":54,"num_object_clones":0,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":0,"num_read":459,"num_read_kb":117828,"num_write":998,"num_write_kb":35803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.501940+0000","last_change":"2024-09-12T00:31:52.148635+0000","last_active":"2024-09-12T01:26:04.501940+0000","last_peered":"2024-09-12T01:26:04.501940+0000","last_clean":"2024-09-12T01:26:04.501940+0000","last_became_active":"2024-09-12T00:31:52.148316+0000","last_became_peered":"2024-09-12T00:31:52.148316+0000","last_unstale":"2024-09-12T01:26:04.501940+0000","last_undegraded":"2024-09-12T01:26:04.501940+0000","last_fullsized":"2024-09-12T01:26:04.501940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:30.960630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'701","reported_seq":1398,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.330102+0000","last_change":"2024-09-12T00:31:54.163779+0000","last_active":"2024-09-12T01:29:14.330102+0000","last_peered":"2024-09-12T01:29:14.330102+0000","last_clean":"2024-09-12T01:29:14.330102+0000","last_became_active":"2024-09-12T00:31:54.163482+0000","last_became_peered":"2024-09-12T00:31:54.163482+0000","last_unstale":"2024-09-12T01:29:14.330102+0000","last_undegraded":"2024-09-12T01:29:14.330102+0000","last_fullsized":"2024-09-12T01:29:14.330102+0000","mapping_epoch":31,"log_start":"265'600","ondisk_log_start":"265'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":600,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:12.512568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159785,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1360,"num_read_kb":2777,"num_write":1290,"num_write_kb":1139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499503+0000","last_change":"2024-09-12T00:31:56.170852+0000","last_active":"2024-09-12T01:26:07.499503+0000","last_peered":"2024-09-12T01:26:07.499503+0000","last_clean":"2024-09-12T01:26:07.499503+0000","last_became_active":"2024-09-12T00:31:56.170545+0000","last_became_peered":"2024-09-12T00:31:56.170545+0000","last_unstale":"2024-09-12T01:26:07.499503+0000","last_undegraded":"2024-09-12T01:26:07.499503+0000","last_fullsized":"2024-09-12T01:26:07.499503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:42.166275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'197","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.343679+0000","last_change":"2024-09-12T00:31:58.185222+0000","last_active":"2024-09-12T01:27:48.343679+0000","last_peered":"2024-09-12T01:27:48.343679+0000","last_clean":"2024-09-12T01:27:48.343679+0000","last_became_active":"2024-09-12T00:31:58.184941+0000","last_became_peered":"2024-09-12T00:31:58.184941+0000","last_unstale":"2024-09-12T01:27:48.343679+0000","last_undegraded":"2024-09-12T01:27:48.343679+0000","last_fullsized":"2024-09-12T01:27:48.343679+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:18.883829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1234,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":433,"num_write":415,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'95","reported_seq":667,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498663+0000","last_change":"2024-09-12T00:31:50.138379+0000","last_active":"2024-09-12T01:26:02.498663+0000","last_peered":"2024-09-12T01:26:02.498663+0000","last_clean":"2024-09-12T01:26:02.498663+0000","last_became_active":"2024-09-12T00:31:50.137393+0000","last_became_peered":"2024-09-12T00:31:50.137393+0000","last_unstale":"2024-09-12T01:26:02.498663+0000","last_undegraded":"2024-09-12T01:26:02.498663+0000","last_fullsized":"2024-09-12T01:26:02.498663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:51.466639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":346,"num_write":149,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.719450+0000","last_change":"2024-09-12T00:31:38.791836+0000","last_active":"2024-09-12T01:25:44.719450+0000","last_peered":"2024-09-12T01:25:44.719450+0000","last_clean":"2024-09-12T01:25:44.719450+0000","last_became_active":"2024-09-12T00:31:36.772301+0000","last_became_peered":"2024-09-12T00:31:36.772301+0000","last_unstale":"2024-09-12T01:25:44.719450+0000","last_undegraded":"2024-09-12T01:25:44.719450+0000","last_fullsized":"2024-09-12T01:25:44.719450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:18.261088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070272599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'338","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.646130+0000","last_change":"2024-09-12T00:31:47.121968+0000","last_active":"2024-09-12T01:29:15.646130+0000","last_peered":"2024-09-12T01:29:15.646130+0000","last_clean":"2024-09-12T01:29:15.646130+0000","last_became_active":"2024-09-12T00:31:47.121537+0000","last_became_peered":"2024-09-12T00:31:47.121537+0000","last_unstale":"2024-09-12T01:29:15.646130+0000","last_undegraded":"2024-09-12T01:29:15.646130+0000","last_fullsized":"2024-09-12T01:29:15.646130+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":300,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:47.444435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":379440,"num_objects":39,"num_object_clones":0,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":0,"num_read":554,"num_read_kb":9552,"num_write":1133,"num_write_kb":21951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723703+0000","last_change":"2024-09-12T00:31:52.147965+0000","last_active":"2024-09-12T01:26:04.723703+0000","last_peered":"2024-09-12T01:26:04.723703+0000","last_clean":"2024-09-12T01:26:04.723703+0000","last_became_active":"2024-09-12T00:31:52.147719+0000","last_became_peered":"2024-09-12T00:31:52.147719+0000","last_unstale":"2024-09-12T01:26:04.723703+0000","last_undegraded":"2024-09-12T01:26:04.723703+0000","last_fullsized":"2024-09-12T01:26:04.723703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:49.618183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1253","reported_seq":2877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.459747+0000","last_change":"2024-09-12T00:31:54.168423+0000","last_active":"2024-09-12T01:29:15.459747+0000","last_peered":"2024-09-12T01:29:15.459747+0000","last_clean":"2024-09-12T01:29:15.459747+0000","last_became_active":"2024-09-12T00:31:54.168085+0000","last_became_peered":"2024-09-12T00:31:54.168085+0000","last_unstale":"2024-09-12T01:29:15.459747+0000","last_undegraded":"2024-09-12T01:29:15.459747+0000","last_fullsized":"2024-09-12T01:29:15.459747+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":1200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:38.939256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":152752,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2009,"num_read_kb":3538,"num_write":1124,"num_write_kb":948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.725043+0000","last_change":"2024-09-12T00:31:56.171482+0000","last_active":"2024-09-12T01:26:14.725043+0000","last_peered":"2024-09-12T01:26:14.725043+0000","last_clean":"2024-09-12T01:26:14.725043+0000","last_became_active":"2024-09-12T00:31:56.170725+0000","last_became_peered":"2024-09-12T00:31:56.170725+0000","last_unstale":"2024-09-12T01:26:14.725043+0000","last_undegraded":"2024-09-12T01:26:14.725043+0000","last_fullsized":"2024-09-12T01:26:14.725043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:54.802585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'205","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:46.476124+0000","last_change":"2024-09-12T00:31:58.182866+0000","last_active":"2024-09-12T01:27:46.476124+0000","last_peered":"2024-09-12T01:27:46.476124+0000","last_clean":"2024-09-12T01:27:46.476124+0000","last_became_active":"2024-09-12T00:31:58.182565+0000","last_became_peered":"2024-09-12T00:31:58.182565+0000","last_unstale":"2024-09-12T01:27:46.476124+0000","last_undegraded":"2024-09-12T01:27:46.476124+0000","last_fullsized":"2024-09-12T01:27:46.476124+0000","mapping_epoch":35,"log_start":"262'100","ondisk_log_start":"262'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:03.635481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":315,"num_read_kb":314,"num_write":438,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'335","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:28.356649+0000","last_change":"2024-09-12T00:31:50.136242+0000","last_active":"2024-09-12T01:26:28.356649+0000","last_peered":"2024-09-12T01:26:28.356649+0000","last_clean":"2024-09-12T01:26:28.356649+0000","last_became_active":"2024-09-12T00:31:50.135930+0000","last_became_peered":"2024-09-12T00:31:50.135930+0000","last_unstale":"2024-09-12T01:26:28.356649+0000","last_undegraded":"2024-09-12T01:26:28.356649+0000","last_fullsized":"2024-09-12T01:26:28.356649+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:16.203493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1457,"num_read_kb":1188,"num_write":528,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:50.780245+0000","last_change":"2024-09-12T00:31:38.791033+0000","last_active":"2024-09-12T01:25:50.780245+0000","last_peered":"2024-09-12T01:25:50.780245+0000","last_clean":"2024-09-12T01:25:50.780245+0000","last_became_active":"2024-09-12T00:31:36.774484+0000","last_became_peered":"2024-09-12T00:31:36.774484+0000","last_unstale":"2024-09-12T01:25:50.780245+0000","last_undegraded":"2024-09-12T01:25:50.780245+0000","last_fullsized":"2024-09-12T01:25:50.780245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:00.370174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040283499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'298","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:28.044047+0000","last_change":"2024-09-12T00:31:47.124224+0000","last_active":"2024-09-12T01:27:28.044047+0000","last_peered":"2024-09-12T01:27:28.044047+0000","last_clean":"2024-09-12T01:27:28.044047+0000","last_became_active":"2024-09-12T00:31:47.123249+0000","last_became_peered":"2024-09-12T00:31:47.123249+0000","last_unstale":"2024-09-12T01:27:28.044047+0000","last_undegraded":"2024-09-12T01:27:28.044047+0000","last_fullsized":"2024-09-12T01:27:28.044047+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:41.915420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534900,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":552,"num_read_kb":12898,"num_write":1111,"num_write_kb":44550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782647+0000","last_change":"2024-09-12T00:31:52.156266+0000","last_active":"2024-09-12T01:26:05.782647+0000","last_peered":"2024-09-12T01:26:05.782647+0000","last_clean":"2024-09-12T01:26:05.782647+0000","last_became_active":"2024-09-12T00:31:52.155926+0000","last_became_peered":"2024-09-12T00:31:52.155926+0000","last_unstale":"2024-09-12T01:26:05.782647+0000","last_undegraded":"2024-09-12T01:26:05.782647+0000","last_fullsized":"2024-09-12T01:26:05.782647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:04.589366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'249","reported_seq":1479,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.489792+0000","last_change":"2024-09-12T00:31:54.175219+0000","last_active":"2024-09-12T01:28:54.489792+0000","last_peered":"2024-09-12T01:28:54.489792+0000","last_clean":"2024-09-12T01:28:54.489792+0000","last_became_active":"2024-09-12T00:31:54.174937+0000","last_became_peered":"2024-09-12T00:31:54.174937+0000","last_unstale":"2024-09-12T01:28:54.489792+0000","last_undegraded":"2024-09-12T01:28:54.489792+0000","last_fullsized":"2024-09-12T01:28:54.489792+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:50.854821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":202,"num_write":187,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501136+0000","last_change":"2024-09-12T00:31:56.172150+0000","last_active":"2024-09-12T01:26:08.501136+0000","last_peered":"2024-09-12T01:26:08.501136+0000","last_clean":"2024-09-12T01:26:08.501136+0000","last_became_active":"2024-09-12T00:31:56.171071+0000","last_became_peered":"2024-09-12T00:31:56.171071+0000","last_unstale":"2024-09-12T01:26:08.501136+0000","last_undegraded":"2024-09-12T01:26:08.501136+0000","last_fullsized":"2024-09-12T01:26:08.501136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:43.038984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'239","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:13.519595+0000","last_change":"2024-09-12T00:31:58.177224+0000","last_active":"2024-09-12T01:28:13.519595+0000","last_peered":"2024-09-12T01:28:13.519595+0000","last_clean":"2024-09-12T01:28:13.519595+0000","last_became_active":"2024-09-12T00:31:58.176931+0000","last_became_peered":"2024-09-12T00:31:58.176931+0000","last_unstale":"2024-09-12T01:28:13.519595+0000","last_undegraded":"2024-09-12T01:28:13.519595+0000","last_fullsized":"2024-09-12T01:28:13.519595+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:05.868371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":495,"num_write":504,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'416","reported_seq":1066,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637259+0000","last_change":"2024-09-12T00:31:50.139895+0000","last_active":"2024-09-12T01:26:00.637259+0000","last_peered":"2024-09-12T01:26:00.637259+0000","last_clean":"2024-09-12T01:26:00.637259+0000","last_became_active":"2024-09-12T00:31:50.139625+0000","last_became_peered":"2024-09-12T00:31:50.139625+0000","last_unstale":"2024-09-12T01:26:00.637259+0000","last_undegraded":"2024-09-12T01:26:00.637259+0000","last_fullsized":"2024-09-12T01:26:00.637259+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:20.853631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1805,"num_read_kb":1431,"num_write":644,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721663+0000","last_change":"2024-09-12T00:31:38.792511+0000","last_active":"2024-09-12T01:25:49.721663+0000","last_peered":"2024-09-12T01:25:49.721663+0000","last_clean":"2024-09-12T01:25:49.721663+0000","last_became_active":"2024-09-12T00:31:37.736683+0000","last_became_peered":"2024-09-12T00:31:37.736683+0000","last_unstale":"2024-09-12T01:25:49.721663+0000","last_undegraded":"2024-09-12T01:25:49.721663+0000","last_fullsized":"2024-09-12T01:25:49.721663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:32.835722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001295757,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'253","reported_seq":1091,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.514779+0000","last_change":"2024-09-12T00:31:47.137770+0000","last_active":"2024-09-12T01:28:04.514779+0000","last_peered":"2024-09-12T01:28:04.514779+0000","last_clean":"2024-09-12T01:28:04.514779+0000","last_became_active":"2024-09-12T00:31:47.136714+0000","last_became_peered":"2024-09-12T00:31:47.136714+0000","last_unstale":"2024-09-12T01:28:04.514779+0000","last_undegraded":"2024-09-12T01:28:04.514779+0000","last_fullsized":"2024-09-12T01:28:04.514779+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:36.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10811741,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":826,"num_read_kb":29268,"num_write":995,"num_write_kb":35686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.784440+0000","last_change":"2024-09-12T00:31:52.149396+0000","last_active":"2024-09-12T01:26:15.784440+0000","last_peered":"2024-09-12T01:26:15.784440+0000","last_clean":"2024-09-12T01:26:15.784440+0000","last_became_active":"2024-09-12T00:31:52.148995+0000","last_became_peered":"2024-09-12T00:31:52.148995+0000","last_unstale":"2024-09-12T01:26:15.784440+0000","last_undegraded":"2024-09-12T01:26:15.784440+0000","last_fullsized":"2024-09-12T01:26:15.784440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:57.905127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'137","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:17.519817+0000","last_change":"2024-09-12T00:31:54.168174+0000","last_active":"2024-09-12T01:28:17.519817+0000","last_peered":"2024-09-12T01:28:17.519817+0000","last_clean":"2024-09-12T01:28:17.519817+0000","last_became_active":"2024-09-12T00:31:54.167813+0000","last_became_peered":"2024-09-12T00:31:54.167813+0000","last_unstale":"2024-09-12T01:28:17.519817+0000","last_undegraded":"2024-09-12T01:28:17.519817+0000","last_fullsized":"2024-09-12T01:28:17.519817+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:55.058242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":166,"num_read_kb":157,"num_write":122,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.724455+0000","last_change":"2024-09-12T00:31:56.173128+0000","last_active":"2024-09-12T01:26:09.724455+0000","last_peered":"2024-09-12T01:26:09.724455+0000","last_clean":"2024-09-12T01:26:09.724455+0000","last_became_active":"2024-09-12T00:31:56.172693+0000","last_became_peered":"2024-09-12T00:31:56.172693+0000","last_unstale":"2024-09-12T01:26:09.724455+0000","last_undegraded":"2024-09-12T01:26:09.724455+0000","last_fullsized":"2024-09-12T01:26:09.724455+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:48.948020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'163","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.606163+0000","last_change":"2024-09-12T00:31:58.177617+0000","last_active":"2024-09-12T01:26:09.606163+0000","last_peered":"2024-09-12T01:26:09.606163+0000","last_clean":"2024-09-12T01:26:09.606163+0000","last_became_active":"2024-09-12T00:31:58.177206+0000","last_became_peered":"2024-09-12T00:31:58.177206+0000","last_unstale":"2024-09-12T01:26:09.606163+0000","last_undegraded":"2024-09-12T01:26:09.606163+0000","last_fullsized":"2024-09-12T01:26:09.606163+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:23.709095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":267,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'249","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637190+0000","last_change":"2024-09-12T00:31:50.135626+0000","last_active":"2024-09-12T01:26:00.637190+0000","last_peered":"2024-09-12T01:26:00.637190+0000","last_clean":"2024-09-12T01:26:00.637190+0000","last_became_active":"2024-09-12T00:31:50.135333+0000","last_became_peered":"2024-09-12T00:31:50.135333+0000","last_unstale":"2024-09-12T01:26:00.637190+0000","last_undegraded":"2024-09-12T01:26:00.637190+0000","last_fullsized":"2024-09-12T01:26:00.637190+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:41.887040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1106,"num_read_kb":893,"num_write":406,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'246","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:27.899313+0000","last_change":"2024-09-12T00:31:47.132263+0000","last_active":"2024-09-12T01:27:27.899313+0000","last_peered":"2024-09-12T01:27:27.899313+0000","last_clean":"2024-09-12T01:27:27.899313+0000","last_became_active":"2024-09-12T00:31:47.131943+0000","last_became_peered":"2024-09-12T00:31:47.131943+0000","last_unstale":"2024-09-12T01:27:27.899313+0000","last_undegraded":"2024-09-12T01:27:27.899313+0000","last_fullsized":"2024-09-12T01:27:27.899313+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:25.947785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19519350,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":331,"num_read_kb":39412,"num_write":921,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:47.496403+0000","last_change":"2024-09-12T00:31:38.786719+0000","last_active":"2024-09-12T01:25:47.496403+0000","last_peered":"2024-09-12T01:25:47.496403+0000","last_clean":"2024-09-12T01:25:47.496403+0000","last_became_active":"2024-09-12T00:31:37.736507+0000","last_became_peered":"2024-09-12T00:31:37.736507+0000","last_unstale":"2024-09-12T01:25:47.496403+0000","last_undegraded":"2024-09-12T01:25:47.496403+0000","last_fullsized":"2024-09-12T01:25:47.496403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:48.124334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050928200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:03.500363+0000","last_change":"2024-09-12T00:31:52.154383+0000","last_active":"2024-09-12T01:26:03.500363+0000","last_peered":"2024-09-12T01:26:03.500363+0000","last_clean":"2024-09-12T01:26:03.500363+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:26:03.500363+0000","last_undegraded":"2024-09-12T01:26:03.500363+0000","last_fullsized":"2024-09-12T01:26:03.500363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:37.921158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'599","reported_seq":1283,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.158815+0000","last_change":"2024-09-12T00:31:54.162920+0000","last_active":"2024-09-12T01:29:15.158815+0000","last_peered":"2024-09-12T01:29:15.158815+0000","last_clean":"2024-09-12T01:29:15.158815+0000","last_became_active":"2024-09-12T00:31:54.162596+0000","last_became_peered":"2024-09-12T00:31:54.162596+0000","last_unstale":"2024-09-12T01:29:15.158815+0000","last_undegraded":"2024-09-12T01:29:15.158815+0000","last_fullsized":"2024-09-12T01:29:15.158815+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":500,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:38.618701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98974,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1014,"num_read_kb":2093,"num_write":884,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.505411+0000","last_change":"2024-09-12T00:31:56.170603+0000","last_active":"2024-09-12T01:26:09.505411+0000","last_peered":"2024-09-12T01:26:09.505411+0000","last_clean":"2024-09-12T01:26:09.505411+0000","last_became_active":"2024-09-12T00:31:56.170246+0000","last_became_peered":"2024-09-12T00:31:56.170246+0000","last_unstale":"2024-09-12T01:26:09.505411+0000","last_undegraded":"2024-09-12T01:26:09.505411+0000","last_fullsized":"2024-09-12T01:26:09.505411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:58.101767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'137","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.305820+0000","last_change":"2024-09-12T00:31:58.183531+0000","last_active":"2024-09-12T01:28:54.305820+0000","last_peered":"2024-09-12T01:28:54.305820+0000","last_clean":"2024-09-12T01:28:54.305820+0000","last_became_active":"2024-09-12T00:31:58.183206+0000","last_became_peered":"2024-09-12T00:31:58.183206+0000","last_unstale":"2024-09-12T01:28:54.305820+0000","last_undegraded":"2024-09-12T01:28:54.305820+0000","last_fullsized":"2024-09-12T01:28:54.305820+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:12.094595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":155,"num_write":341,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'131","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637220+0000","last_change":"2024-09-12T00:31:50.135481+0000","last_active":"2024-09-12T01:26:00.637220+0000","last_peered":"2024-09-12T01:26:00.637220+0000","last_clean":"2024-09-12T01:26:00.637220+0000","last_became_active":"2024-09-12T00:31:50.135197+0000","last_became_peered":"2024-09-12T00:31:50.135197+0000","last_unstale":"2024-09-12T01:26:00.637220+0000","last_undegraded":"2024-09-12T01:26:00.637220+0000","last_fullsized":"2024-09-12T01:26:00.637220+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:37.204019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":577,"num_read_kb":479,"num_write":210,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'277","reported_seq":900,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.629230+0000","last_change":"2024-09-12T00:31:47.121755+0000","last_active":"2024-09-12T01:29:15.629230+0000","last_peered":"2024-09-12T01:29:15.629230+0000","last_clean":"2024-09-12T01:29:15.629230+0000","last_became_active":"2024-09-12T00:31:47.121355+0000","last_became_peered":"2024-09-12T00:31:47.121355+0000","last_unstale":"2024-09-12T01:29:15.629230+0000","last_undegraded":"2024-09-12T01:29:15.629230+0000","last_fullsized":"2024-09-12T01:29:15.629230+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:07.246376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":866,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":426,"num_read_kb":443,"num_write":978,"num_write_kb":5362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.722299+0000","last_change":"2024-09-12T00:31:38.791827+0000","last_active":"2024-09-12T01:25:54.722299+0000","last_peered":"2024-09-12T01:25:54.722299+0000","last_clean":"2024-09-12T01:25:54.722299+0000","last_became_active":"2024-09-12T00:31:36.774289+0000","last_became_peered":"2024-09-12T00:31:36.774289+0000","last_unstale":"2024-09-12T01:25:54.722299+0000","last_undegraded":"2024-09-12T01:25:54.722299+0000","last_fullsized":"2024-09-12T01:25:54.722299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:55.526735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063853100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"37'8","reported_seq":1459,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.075671+0000","last_change":"2024-09-12T00:31:52.148172+0000","last_active":"2024-09-12T01:29:14.075671+0000","last_peered":"2024-09-12T01:29:14.075671+0000","last_clean":"2024-09-12T01:29:14.075671+0000","last_became_active":"2024-09-12T00:31:52.147856+0000","last_became_peered":"2024-09-12T00:31:52.147856+0000","last_unstale":"2024-09-12T01:29:14.075671+0000","last_undegraded":"2024-09-12T01:29:14.075671+0000","last_fullsized":"2024-09-12T01:29:14.075671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:28.451170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1609,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1450,"num_read_kb":1911,"num_write":16,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'176","reported_seq":746,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.637935+0000","last_change":"2024-09-12T00:31:54.170295+0000","last_active":"2024-09-12T01:26:05.637935+0000","last_peered":"2024-09-12T01:26:05.637935+0000","last_clean":"2024-09-12T01:26:05.637935+0000","last_became_active":"2024-09-12T00:31:54.169958+0000","last_became_peered":"2024-09-12T00:31:54.169958+0000","last_unstale":"2024-09-12T01:26:05.637935+0000","last_undegraded":"2024-09-12T01:26:05.637935+0000","last_fullsized":"2024-09-12T01:26:05.637935+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:37.410716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":229,"num_read_kb":218,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'771","reported_seq":2818,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.292960+0000","last_change":"2024-09-12T00:31:56.174875+0000","last_active":"2024-09-12T01:29:14.292960+0000","last_peered":"2024-09-12T01:29:14.292960+0000","last_clean":"2024-09-12T01:29:14.292960+0000","last_became_active":"2024-09-12T00:31:56.174535+0000","last_became_peered":"2024-09-12T00:31:56.174535+0000","last_unstale":"2024-09-12T01:29:14.292960+0000","last_undegraded":"2024-09-12T01:29:14.292960+0000","last_fullsized":"2024-09-12T01:29:14.292960+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:30.561634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'114","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:25.804418+0000","last_change":"2024-09-12T00:31:58.174504+0000","last_active":"2024-09-12T01:28:25.804418+0000","last_peered":"2024-09-12T01:28:25.804418+0000","last_clean":"2024-09-12T01:28:25.804418+0000","last_became_active":"2024-09-12T00:31:58.174086+0000","last_became_peered":"2024-09-12T00:31:58.174086+0000","last_unstale":"2024-09-12T01:28:25.804418+0000","last_undegraded":"2024-09-12T01:28:25.804418+0000","last_fullsized":"2024-09-12T01:28:25.804418+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:34.431865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":255,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'4367","reported_seq":5119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501053+0000","last_change":"2024-09-12T00:31:50.133031+0000","last_active":"2024-09-12T01:26:08.501053+0000","last_peered":"2024-09-12T01:26:08.501053+0000","last_clean":"2024-09-12T01:26:08.501053+0000","last_became_active":"2024-09-12T00:31:50.132703+0000","last_became_peered":"2024-09-12T00:31:50.132703+0000","last_unstale":"2024-09-12T01:26:08.501053+0000","last_undegraded":"2024-09-12T01:26:08.501053+0000","last_fullsized":"2024-09-12T01:26:08.501053+0000","mapping_epoch":27,"log_start":"265'4300","ondisk_log_start":"265'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":3000,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:18.582172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17817,"num_read_kb":14914,"num_write":6561,"num_write_kb":3320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'252","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:06.847147+0000","last_change":"2024-09-12T00:31:47.116552+0000","last_active":"2024-09-12T01:27:06.847147+0000","last_peered":"2024-09-12T01:27:06.847147+0000","last_clean":"2024-09-12T01:27:06.847147+0000","last_became_active":"2024-09-12T00:31:47.116205+0000","last_became_peered":"2024-09-12T00:31:47.116205+0000","last_unstale":"2024-09-12T01:27:06.847147+0000","last_undegraded":"2024-09-12T01:27:06.847147+0000","last_fullsized":"2024-09-12T01:27:06.847147+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:23.401827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11552390,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":424,"num_read_kb":46756,"num_write":1023,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:48.498503+0000","last_change":"2024-09-12T00:31:38.828567+0000","last_active":"2024-09-12T01:25:48.498503+0000","last_peered":"2024-09-12T01:25:48.498503+0000","last_clean":"2024-09-12T01:25:48.498503+0000","last_became_active":"2024-09-12T00:31:37.434707+0000","last_became_peered":"2024-09-12T00:31:37.434707+0000","last_unstale":"2024-09-12T01:25:48.498503+0000","last_undegraded":"2024-09-12T01:25:48.498503+0000","last_fullsized":"2024-09-12T01:25:48.498503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:44.992055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041578299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723540+0000","last_change":"2024-09-12T00:31:52.147221+0000","last_active":"2024-09-12T01:26:04.723540+0000","last_peered":"2024-09-12T01:26:04.723540+0000","last_clean":"2024-09-12T01:26:04.723540+0000","last_became_active":"2024-09-12T00:31:52.146927+0000","last_became_peered":"2024-09-12T00:31:52.146927+0000","last_unstale":"2024-09-12T01:26:04.723540+0000","last_undegraded":"2024-09-12T01:26:04.723540+0000","last_fullsized":"2024-09-12T01:26:04.723540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:07.292280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'129","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723596+0000","last_change":"2024-09-12T00:31:54.166886+0000","last_active":"2024-09-12T01:26:04.723596+0000","last_peered":"2024-09-12T01:26:04.723596+0000","last_clean":"2024-09-12T01:26:04.723596+0000","last_became_active":"2024-09-12T00:31:54.166612+0000","last_became_peered":"2024-09-12T00:31:54.166612+0000","last_unstale":"2024-09-12T01:26:04.723596+0000","last_undegraded":"2024-09-12T01:26:04.723596+0000","last_fullsized":"2024-09-12T01:26:04.723596+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:22.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":151,"num_read_kb":143,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'780","reported_seq":4656,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.361508+0000","last_change":"2024-09-12T00:31:56.170683+0000","last_active":"2024-09-12T01:28:55.361508+0000","last_peered":"2024-09-12T01:28:55.361508+0000","last_clean":"2024-09-12T01:28:55.361508+0000","last_became_active":"2024-09-12T00:31:56.170358+0000","last_became_peered":"2024-09-12T00:31:56.170358+0000","last_unstale":"2024-09-12T01:28:55.361508+0000","last_undegraded":"2024-09-12T01:28:55.361508+0000","last_fullsized":"2024-09-12T01:28:55.361508+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:23.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'175","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:57.497649+0000","last_change":"2024-09-12T00:31:58.178681+0000","last_active":"2024-09-12T01:25:57.497649+0000","last_peered":"2024-09-12T01:25:57.497649+0000","last_clean":"2024-09-12T01:25:57.497649+0000","last_became_active":"2024-09-12T00:31:58.178148+0000","last_became_peered":"2024-09-12T00:31:58.178148+0000","last_unstale":"2024-09-12T01:25:57.497649+0000","last_undegraded":"2024-09-12T01:25:57.497649+0000","last_fullsized":"2024-09-12T01:25:57.497649+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:28.683801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":405,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'112","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:06.005883+0000","last_change":"2024-09-12T00:31:50.143058+0000","last_active":"2024-09-12T01:27:06.005883+0000","last_peered":"2024-09-12T01:27:06.005883+0000","last_clean":"2024-09-12T01:27:06.005883+0000","last_became_active":"2024-09-12T00:31:50.142769+0000","last_became_peered":"2024-09-12T00:31:50.142769+0000","last_unstale":"2024-09-12T01:27:06.005883+0000","last_undegraded":"2024-09-12T01:27:06.005883+0000","last_fullsized":"2024-09-12T01:27:06.005883+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:22.259280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":521,"num_read_kb":437,"num_write":174,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'318","reported_seq":1004,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:58.499776+0000","last_change":"2024-09-12T00:31:47.116325+0000","last_active":"2024-09-12T01:25:58.499776+0000","last_peered":"2024-09-12T01:25:58.499776+0000","last_clean":"2024-09-12T01:25:58.499776+0000","last_became_active":"2024-09-12T00:31:47.115974+0000","last_became_peered":"2024-09-12T00:31:47.115974+0000","last_unstale":"2024-09-12T01:25:58.499776+0000","last_undegraded":"2024-09-12T01:25:58.499776+0000","last_fullsized":"2024-09-12T01:25:58.499776+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:40.653497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2942072,"num_objects":80,"num_object_clones":0,"num_object_copies":240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":0,"num_read":602,"num_read_kb":6022,"num_write":1033,"num_write_kb":14780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721781+0000","last_change":"2024-09-12T00:31:38.792390+0000","last_active":"2024-09-12T01:25:49.721781+0000","last_peered":"2024-09-12T01:25:49.721781+0000","last_clean":"2024-09-12T01:25:49.721781+0000","last_became_active":"2024-09-12T00:31:37.434487+0000","last_became_peered":"2024-09-12T00:31:37.434487+0000","last_unstale":"2024-09-12T01:25:49.721781+0000","last_undegraded":"2024-09-12T01:25:49.721781+0000","last_fullsized":"2024-09-12T01:25:49.721781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.146992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501076+0000","last_change":"2024-09-12T00:31:52.152659+0000","last_active":"2024-09-12T01:26:08.501076+0000","last_peered":"2024-09-12T01:26:08.501076+0000","last_clean":"2024-09-12T01:26:08.501076+0000","last_became_active":"2024-09-12T00:31:52.152173+0000","last_became_peered":"2024-09-12T00:31:52.152173+0000","last_unstale":"2024-09-12T01:26:08.501076+0000","last_undegraded":"2024-09-12T01:26:08.501076+0000","last_fullsized":"2024-09-12T01:26:08.501076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:41.559045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'724","reported_seq":1439,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.317168+0000","last_change":"2024-09-12T00:31:54.170238+0000","last_active":"2024-09-12T01:29:14.317168+0000","last_peered":"2024-09-12T01:29:14.317168+0000","last_clean":"2024-09-12T01:29:14.317168+0000","last_became_active":"2024-09-12T00:31:54.169994+0000","last_became_peered":"2024-09-12T00:31:54.169994+0000","last_unstale":"2024-09-12T01:29:14.317168+0000","last_undegraded":"2024-09-12T01:29:14.317168+0000","last_fullsized":"2024-09-12T01:29:14.317168+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":700,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:49.480724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168605,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1273,"num_read_kb":2692,"num_write":1046,"num_write_kb":860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501108+0000","last_change":"2024-09-12T00:31:56.172717+0000","last_active":"2024-09-12T01:26:08.501108+0000","last_peered":"2024-09-12T01:26:08.501108+0000","last_clean":"2024-09-12T01:26:08.501108+0000","last_became_active":"2024-09-12T00:31:56.172417+0000","last_became_peered":"2024-09-12T00:31:56.172417+0000","last_unstale":"2024-09-12T01:26:08.501108+0000","last_undegraded":"2024-09-12T01:26:08.501108+0000","last_fullsized":"2024-09-12T01:26:08.501108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:19.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'150","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.504454+0000","last_change":"2024-09-12T00:31:58.180306+0000","last_active":"2024-09-12T01:25:59.504454+0000","last_peered":"2024-09-12T01:25:59.504454+0000","last_clean":"2024-09-12T01:25:59.504454+0000","last_became_active":"2024-09-12T00:31:58.179998+0000","last_became_peered":"2024-09-12T00:31:58.179998+0000","last_unstale":"2024-09-12T01:25:59.504454+0000","last_undegraded":"2024-09-12T01:25:59.504454+0000","last_fullsized":"2024-09-12T01:25:59.504454+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:19.517308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":177,"num_read_kb":166,"num_write":377,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'158","reported_seq":722,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.538025+0000","last_change":"2024-09-12T00:31:58.178240+0000","last_active":"2024-09-12T01:27:48.538025+0000","last_peered":"2024-09-12T01:27:48.538025+0000","last_clean":"2024-09-12T01:27:48.538025+0000","last_became_active":"2024-09-12T00:31:58.177936+0000","last_became_peered":"2024-09-12T00:31:58.177936+0000","last_unstale":"2024-09-12T01:27:48.538025+0000","last_undegraded":"2024-09-12T01:27:48.538025+0000","last_fullsized":"2024-09-12T01:27:48.538025+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:52.216144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":226,"num_read_kb":224,"num_write":377,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'98","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:19.340107+0000","last_change":"2024-09-12T00:31:50.142477+0000","last_active":"2024-09-12T01:26:19.340107+0000","last_peered":"2024-09-12T01:26:19.340107+0000","last_clean":"2024-09-12T01:26:19.340107+0000","last_became_active":"2024-09-12T00:31:50.142206+0000","last_became_peered":"2024-09-12T00:31:50.142206+0000","last_unstale":"2024-09-12T01:26:19.340107+0000","last_undegraded":"2024-09-12T01:26:19.340107+0000","last_fullsized":"2024-09-12T01:26:19.340107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:15.569454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":133,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'252","reported_seq":857,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.654974+0000","last_change":"2024-09-12T00:31:47.128769+0000","last_active":"2024-09-12T01:29:14.654974+0000","last_peered":"2024-09-12T01:29:14.654974+0000","last_clean":"2024-09-12T01:29:14.654974+0000","last_became_active":"2024-09-12T00:31:47.128005+0000","last_became_peered":"2024-09-12T00:31:47.128005+0000","last_unstale":"2024-09-12T01:29:14.654974+0000","last_undegraded":"2024-09-12T01:29:14.654974+0000","last_fullsized":"2024-09-12T01:29:14.654974+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:09.592563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5487134,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":329,"num_read_kb":1002,"num_write":913,"num_write_kb":27047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:35.633125+0000","last_change":"2024-09-12T00:31:52.154225+0000","last_active":"2024-09-12T01:25:35.633125+0000","last_peered":"2024-09-12T01:25:35.633125+0000","last_clean":"2024-09-12T01:25:35.633125+0000","last_became_active":"2024-09-12T00:31:52.153927+0000","last_became_peered":"2024-09-12T00:31:52.153927+0000","last_unstale":"2024-09-12T01:25:35.633125+0000","last_undegraded":"2024-09-12T01:25:35.633125+0000","last_fullsized":"2024-09-12T01:25:35.633125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:05.731540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'289","reported_seq":867,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.667897+0000","last_change":"2024-09-12T00:31:54.167788+0000","last_active":"2024-09-12T01:29:14.667897+0000","last_peered":"2024-09-12T01:29:14.667897+0000","last_clean":"2024-09-12T01:29:14.667897+0000","last_became_active":"2024-09-12T00:31:54.167414+0000","last_became_peered":"2024-09-12T00:31:54.167414+0000","last_unstale":"2024-09-12T01:29:14.667897+0000","last_undegraded":"2024-09-12T01:29:14.667897+0000","last_fullsized":"2024-09-12T01:29:14.667897+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.633567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44314,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":1087,"num_write":386,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:35.777825+0000","last_change":"2024-09-12T00:31:56.173722+0000","last_active":"2024-09-12T01:25:35.777825+0000","last_peered":"2024-09-12T01:25:35.777825+0000","last_clean":"2024-09-12T01:25:35.777825+0000","last_became_active":"2024-09-12T00:31:56.173412+0000","last_became_peered":"2024-09-12T00:31:56.173412+0000","last_unstale":"2024-09-12T01:25:35.777825+0000","last_undegraded":"2024-09-12T01:25:35.777825+0000","last_fullsized":"2024-09-12T01:25:35.777825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:12.092104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'129","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:47.573025+0000","last_change":"2024-09-12T00:31:58.176621+0000","last_active":"2024-09-12T01:26:47.573025+0000","last_peered":"2024-09-12T01:26:47.573025+0000","last_clean":"2024-09-12T01:26:47.573025+0000","last_became_active":"2024-09-12T00:31:58.176322+0000","last_became_peered":"2024-09-12T00:31:58.176322+0000","last_unstale":"2024-09-12T01:26:47.573025+0000","last_undegraded":"2024-09-12T01:26:47.573025+0000","last_fullsized":"2024-09-12T01:26:47.573025+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:12.568369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":158,"num_write":327,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'158","reported_seq":806,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:33.496218+0000","last_change":"2024-09-12T00:31:50.128018+0000","last_active":"2024-09-12T01:25:33.496218+0000","last_peered":"2024-09-12T01:25:33.496218+0000","last_clean":"2024-09-12T01:25:33.496218+0000","last_became_active":"2024-09-12T00:31:50.127724+0000","last_became_peered":"2024-09-12T00:31:50.127724+0000","last_unstale":"2024-09-12T01:25:33.496218+0000","last_undegraded":"2024-09-12T01:25:33.496218+0000","last_fullsized":"2024-09-12T01:25:33.496218+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:22.239207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":587,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'300","reported_seq":1063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.495244+0000","last_change":"2024-09-12T00:31:47.138921+0000","last_active":"2024-09-12T01:24:59.495244+0000","last_peered":"2024-09-12T01:24:59.495244+0000","last_clean":"2024-09-12T01:24:59.495244+0000","last_became_active":"2024-09-12T00:31:47.138565+0000","last_became_peered":"2024-09-12T00:31:47.138565+0000","last_unstale":"2024-09-12T01:24:59.495244+0000","last_undegraded":"2024-09-12T01:24:59.495244+0000","last_fullsized":"2024-09-12T01:24:59.495244+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:02.222341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19350540,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":711,"num_read_kb":53412,"num_write":1069,"num_write_kb":60803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:33.496242+0000","last_change":"2024-09-12T00:31:52.155188+0000","last_active":"2024-09-12T01:25:33.496242+0000","last_peered":"2024-09-12T01:25:33.496242+0000","last_clean":"2024-09-12T01:25:33.496242+0000","last_became_active":"2024-09-12T00:31:52.154829+0000","last_became_peered":"2024-09-12T00:31:52.154829+0000","last_unstale":"2024-09-12T01:25:33.496242+0000","last_undegraded":"2024-09-12T01:25:33.496242+0000","last_fullsized":"2024-09-12T01:25:33.496242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:05.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'40","reported_seq":551,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:33.496173+0000","last_change":"2024-09-12T00:31:54.162972+0000","last_active":"2024-09-12T01:25:33.496173+0000","last_peered":"2024-09-12T01:25:33.496173+0000","last_clean":"2024-09-12T01:25:33.496173+0000","last_became_active":"2024-09-12T00:31:54.162657+0000","last_became_peered":"2024-09-12T00:31:54.162657+0000","last_unstale":"2024-09-12T01:25:33.496173+0000","last_undegraded":"2024-09-12T01:25:33.496173+0000","last_fullsized":"2024-09-12T01:25:33.496173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:24.360783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.502236+0000","last_change":"2024-09-12T00:31:56.170942+0000","last_active":"2024-09-12T01:25:39.502236+0000","last_peered":"2024-09-12T01:25:39.502236+0000","last_clean":"2024-09-12T01:25:39.502236+0000","last_became_active":"2024-09-12T00:31:56.170648+0000","last_became_peered":"2024-09-12T00:31:56.170648+0000","last_unstale":"2024-09-12T01:25:39.502236+0000","last_undegraded":"2024-09-12T01:25:39.502236+0000","last_fullsized":"2024-09-12T01:25:39.502236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:28.565117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'217","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.527288+0000","last_change":"2024-09-12T00:31:58.172827+0000","last_active":"2024-09-12T01:27:47.527288+0000","last_peered":"2024-09-12T01:27:47.527288+0000","last_clean":"2024-09-12T01:27:47.527288+0000","last_became_active":"2024-09-12T00:31:58.172511+0000","last_became_peered":"2024-09-12T00:31:58.172511+0000","last_unstale":"2024-09-12T01:27:47.527288+0000","last_undegraded":"2024-09-12T01:27:47.527288+0000","last_fullsized":"2024-09-12T01:27:47.527288+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:38.476612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":356,"num_read_kb":339,"num_write":509,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'63","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:27.801294+0000","last_change":"2024-09-12T00:31:50.125425+0000","last_active":"2024-09-12T01:26:27.801294+0000","last_peered":"2024-09-12T01:26:27.801294+0000","last_clean":"2024-09-12T01:26:27.801294+0000","last_became_active":"2024-09-12T00:31:50.124994+0000","last_became_peered":"2024-09-12T00:31:50.124994+0000","last_unstale":"2024-09-12T01:26:27.801294+0000","last_undegraded":"2024-09-12T01:26:27.801294+0000","last_fullsized":"2024-09-12T01:26:27.801294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:16.366629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":221,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'267","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.498188+0000","last_change":"2024-09-12T00:31:47.134711+0000","last_active":"2024-09-12T01:24:59.498188+0000","last_peered":"2024-09-12T01:24:59.498188+0000","last_clean":"2024-09-12T01:24:59.498188+0000","last_became_active":"2024-09-12T00:31:47.134398+0000","last_became_peered":"2024-09-12T00:31:47.134398+0000","last_unstale":"2024-09-12T01:24:59.498188+0000","last_undegraded":"2024-09-12T01:24:59.498188+0000","last_fullsized":"2024-09-12T01:24:59.498188+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:31.067474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6059902,"num_objects":75,"num_object_clones":0,"num_object_copies":225,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":403,"num_read_kb":102266,"num_write":999,"num_write_kb":44150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.501767+0000","last_change":"2024-09-12T00:31:52.152133+0000","last_active":"2024-09-12T01:25:34.501767+0000","last_peered":"2024-09-12T01:25:34.501767+0000","last_clean":"2024-09-12T01:25:34.501767+0000","last_became_active":"2024-09-12T00:31:52.151826+0000","last_became_peered":"2024-09-12T00:31:52.151826+0000","last_unstale":"2024-09-12T01:25:34.501767+0000","last_undegraded":"2024-09-12T01:25:34.501767+0000","last_fullsized":"2024-09-12T01:25:34.501767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:53.712859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'297","reported_seq":893,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.319654+0000","last_change":"2024-09-12T00:31:54.162484+0000","last_active":"2024-09-12T01:28:55.319654+0000","last_peered":"2024-09-12T01:28:55.319654+0000","last_clean":"2024-09-12T01:28:55.319654+0000","last_became_active":"2024-09-12T00:31:54.162188+0000","last_became_peered":"2024-09-12T00:31:54.162188+0000","last_unstale":"2024-09-12T01:28:55.319654+0000","last_undegraded":"2024-09-12T01:28:55.319654+0000","last_fullsized":"2024-09-12T01:28:55.319654+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:59.208178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56423,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":492,"num_read_kb":961,"num_write":392,"num_write_kb":284,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.603003+0000","last_change":"2024-09-12T00:31:56.168740+0000","last_active":"2024-09-12T01:25:39.603003+0000","last_peered":"2024-09-12T01:25:39.603003+0000","last_clean":"2024-09-12T01:25:39.603003+0000","last_became_active":"2024-09-12T00:31:56.168434+0000","last_became_peered":"2024-09-12T00:31:56.168434+0000","last_unstale":"2024-09-12T01:25:39.603003+0000","last_undegraded":"2024-09-12T01:25:39.603003+0000","last_fullsized":"2024-09-12T01:25:39.603003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:22.526791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'127","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.333302+0000","last_change":"2024-09-12T00:31:58.173821+0000","last_active":"2024-09-12T01:27:47.333302+0000","last_peered":"2024-09-12T01:27:47.333302+0000","last_clean":"2024-09-12T01:27:47.333302+0000","last_became_active":"2024-09-12T00:31:58.173552+0000","last_became_peered":"2024-09-12T00:31:58.173552+0000","last_unstale":"2024-09-12T01:27:47.333302+0000","last_undegraded":"2024-09-12T01:27:47.333302+0000","last_fullsized":"2024-09-12T01:27:47.333302+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:10.224892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":198,"num_write":331,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'107","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:30.776968+0000","last_change":"2024-09-12T00:31:50.133388+0000","last_active":"2024-09-12T01:25:30.776968+0000","last_peered":"2024-09-12T01:25:30.776968+0000","last_clean":"2024-09-12T01:25:30.776968+0000","last_became_active":"2024-09-12T00:31:50.133117+0000","last_became_peered":"2024-09-12T00:31:50.133117+0000","last_unstale":"2024-09-12T01:25:30.776968+0000","last_undegraded":"2024-09-12T01:25:30.776968+0000","last_fullsized":"2024-09-12T01:25:30.776968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:46.615971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":426,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'349","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:57.488614+0000","last_change":"2024-09-12T00:31:47.127969+0000","last_active":"2024-09-12T01:24:57.488614+0000","last_peered":"2024-09-12T01:24:57.488614+0000","last_clean":"2024-09-12T01:24:57.488614+0000","last_became_active":"2024-09-12T00:31:47.127603+0000","last_became_peered":"2024-09-12T00:31:47.127603+0000","last_unstale":"2024-09-12T01:24:57.488614+0000","last_undegraded":"2024-09-12T01:24:57.488614+0000","last_fullsized":"2024-09-12T01:24:57.488614+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:19.029593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12062135,"num_objects":79,"num_object_clones":0,"num_object_copies":237,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":0,"num_read":758,"num_read_kb":29446,"num_write":1280,"num_write_kb":48637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718269+0000","last_change":"2024-09-12T00:31:52.152698+0000","last_active":"2024-09-12T01:25:34.718269+0000","last_peered":"2024-09-12T01:25:34.718269+0000","last_clean":"2024-09-12T01:25:34.718269+0000","last_became_active":"2024-09-12T00:31:52.152398+0000","last_became_peered":"2024-09-12T00:31:52.152398+0000","last_unstale":"2024-09-12T01:25:34.718269+0000","last_undegraded":"2024-09-12T01:25:34.718269+0000","last_fullsized":"2024-09-12T01:25:34.718269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:18.608839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'272","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.316191+0000","last_change":"2024-09-12T00:31:54.171666+0000","last_active":"2024-09-12T01:28:55.316191+0000","last_peered":"2024-09-12T01:28:55.316191+0000","last_clean":"2024-09-12T01:28:55.316191+0000","last_became_active":"2024-09-12T00:31:54.171386+0000","last_became_peered":"2024-09-12T00:31:54.171386+0000","last_unstale":"2024-09-12T01:28:55.316191+0000","last_undegraded":"2024-09-12T01:28:55.316191+0000","last_fullsized":"2024-09-12T01:28:55.316191+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:37.250983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60011,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":449,"num_read_kb":949,"num_write":370,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:35.777911+0000","last_change":"2024-09-12T00:31:56.167578+0000","last_active":"2024-09-12T01:25:35.777911+0000","last_peered":"2024-09-12T01:25:35.777911+0000","last_clean":"2024-09-12T01:25:35.777911+0000","last_became_active":"2024-09-12T00:31:56.167213+0000","last_became_peered":"2024-09-12T00:31:56.167213+0000","last_unstale":"2024-09-12T01:25:35.777911+0000","last_undegraded":"2024-09-12T01:25:35.777911+0000","last_fullsized":"2024-09-12T01:25:35.777911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:56.884166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'120","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.353194+0000","last_change":"2024-09-12T00:31:50.140157+0000","last_active":"2024-09-12T01:26:44.353194+0000","last_peered":"2024-09-12T01:26:44.353194+0000","last_clean":"2024-09-12T01:26:44.353194+0000","last_became_active":"2024-09-12T00:31:50.139863+0000","last_became_peered":"2024-09-12T00:31:50.139863+0000","last_unstale":"2024-09-12T01:26:44.353194+0000","last_undegraded":"2024-09-12T01:26:44.353194+0000","last_fullsized":"2024-09-12T01:26:44.353194+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:39.011610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":466,"num_write":169,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'378","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:47.860770+0000","last_change":"2024-09-12T00:31:47.133721+0000","last_active":"2024-09-12T01:28:47.860770+0000","last_peered":"2024-09-12T01:28:47.860770+0000","last_clean":"2024-09-12T01:28:47.860770+0000","last_became_active":"2024-09-12T00:31:47.133283+0000","last_became_peered":"2024-09-12T00:31:47.133283+0000","last_unstale":"2024-09-12T01:28:47.860770+0000","last_undegraded":"2024-09-12T01:28:47.860770+0000","last_fullsized":"2024-09-12T01:28:47.860770+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:13.162609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4280259,"num_objects":77,"num_object_clones":0,"num_object_copies":231,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":0,"num_read":673,"num_read_kb":14924,"num_write":1380,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.638064+0000","last_change":"2024-09-12T00:31:52.152988+0000","last_active":"2024-09-12T01:26:05.638064+0000","last_peered":"2024-09-12T01:26:05.638064+0000","last_clean":"2024-09-12T01:26:05.638064+0000","last_became_active":"2024-09-12T00:31:52.152676+0000","last_became_peered":"2024-09-12T00:31:52.152676+0000","last_unstale":"2024-09-12T01:26:05.638064+0000","last_undegraded":"2024-09-12T01:26:05.638064+0000","last_fullsized":"2024-09-12T01:26:05.638064+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:00.660120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'505","reported_seq":1135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.642844+0000","last_change":"2024-09-12T00:31:54.171588+0000","last_active":"2024-09-12T01:29:15.642844+0000","last_peered":"2024-09-12T01:29:15.642844+0000","last_clean":"2024-09-12T01:29:15.642844+0000","last_became_active":"2024-09-12T00:31:54.171225+0000","last_became_peered":"2024-09-12T00:31:54.171225+0000","last_unstale":"2024-09-12T01:29:15.642844+0000","last_undegraded":"2024-09-12T01:29:15.642844+0000","last_fullsized":"2024-09-12T01:29:15.642844+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":400,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:56.460340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109241,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":916,"num_read_kb":2120,"num_write":791,"num_write_kb":705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:29.494824+0000","last_change":"2024-09-12T00:31:56.176025+0000","last_active":"2024-09-12T01:24:29.494824+0000","last_peered":"2024-09-12T01:24:29.494824+0000","last_clean":"2024-09-12T01:24:29.494824+0000","last_became_active":"2024-09-12T00:31:56.175562+0000","last_became_peered":"2024-09-12T00:31:56.175562+0000","last_unstale":"2024-09-12T01:24:29.494824+0000","last_undegraded":"2024-09-12T01:24:29.494824+0000","last_fullsized":"2024-09-12T01:24:29.494824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:07.085146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'142","reported_seq":641,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.598076+0000","last_change":"2024-09-12T00:31:58.183054+0000","last_active":"2024-09-12T01:27:47.598076+0000","last_peered":"2024-09-12T01:27:47.598076+0000","last_clean":"2024-09-12T01:27:47.598076+0000","last_became_active":"2024-09-12T00:31:58.182602+0000","last_became_peered":"2024-09-12T00:31:58.182602+0000","last_unstale":"2024-09-12T01:27:47.598076+0000","last_undegraded":"2024-09-12T01:27:47.598076+0000","last_fullsized":"2024-09-12T01:27:47.598076+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:54.264038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":164,"num_write":296,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'135","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501163+0000","last_change":"2024-09-12T00:31:50.132346+0000","last_active":"2024-09-12T01:26:08.501163+0000","last_peered":"2024-09-12T01:26:08.501163+0000","last_clean":"2024-09-12T01:26:08.501163+0000","last_became_active":"2024-09-12T00:31:50.132053+0000","last_became_peered":"2024-09-12T00:31:50.132053+0000","last_unstale":"2024-09-12T01:26:08.501163+0000","last_undegraded":"2024-09-12T01:26:08.501163+0000","last_fullsized":"2024-09-12T01:26:08.501163+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:29.446981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":637,"num_read_kb":540,"num_write":205,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'272","reported_seq":920,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:36.007345+0000","last_change":"2024-09-12T00:31:47.115298+0000","last_active":"2024-09-12T01:26:36.007345+0000","last_peered":"2024-09-12T01:26:36.007345+0000","last_clean":"2024-09-12T01:26:36.007345+0000","last_became_active":"2024-09-12T00:31:47.114966+0000","last_became_peered":"2024-09-12T00:31:47.114966+0000","last_unstale":"2024-09-12T01:26:36.007345+0000","last_undegraded":"2024-09-12T01:26:36.007345+0000","last_fullsized":"2024-09-12T01:26:36.007345+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:38.967213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1604511,"num_objects":53,"num_object_clones":0,"num_object_copies":159,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":443,"num_read_kb":26176,"num_write":1060,"num_write_kb":27429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.504979+0000","last_change":"2024-09-12T00:31:52.154420+0000","last_active":"2024-09-12T01:26:04.504979+0000","last_peered":"2024-09-12T01:26:04.504979+0000","last_clean":"2024-09-12T01:26:04.504979+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:26:04.504979+0000","last_undegraded":"2024-09-12T01:26:04.504979+0000","last_fullsized":"2024-09-12T01:26:04.504979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:52.675576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'289","reported_seq":872,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.317650+0000","last_change":"2024-09-12T00:31:54.166286+0000","last_active":"2024-09-12T01:28:55.317650+0000","last_peered":"2024-09-12T01:28:55.317650+0000","last_clean":"2024-09-12T01:28:55.317650+0000","last_became_active":"2024-09-12T00:31:54.165996+0000","last_became_peered":"2024-09-12T00:31:54.165996+0000","last_unstale":"2024-09-12T01:28:55.317650+0000","last_undegraded":"2024-09-12T01:28:55.317650+0000","last_fullsized":"2024-09-12T01:28:55.317650+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:34.576390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49103,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":475,"num_read_kb":905,"num_write":394,"num_write_kb":287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:27.483919+0000","last_change":"2024-09-12T00:31:56.171294+0000","last_active":"2024-09-12T01:24:27.483919+0000","last_peered":"2024-09-12T01:24:27.483919+0000","last_clean":"2024-09-12T01:24:27.483919+0000","last_became_active":"2024-09-12T00:31:56.170994+0000","last_became_peered":"2024-09-12T00:31:56.170994+0000","last_unstale":"2024-09-12T01:24:27.483919+0000","last_undegraded":"2024-09-12T01:24:27.483919+0000","last_fullsized":"2024-09-12T01:24:27.483919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:36.423772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'162","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:06.007997+0000","last_change":"2024-09-12T00:31:58.183946+0000","last_active":"2024-09-12T01:27:06.007997+0000","last_peered":"2024-09-12T01:27:06.007997+0000","last_clean":"2024-09-12T01:27:06.007997+0000","last_became_active":"2024-09-12T00:31:58.183625+0000","last_became_peered":"2024-09-12T00:31:58.183625+0000","last_unstale":"2024-09-12T01:27:06.007997+0000","last_undegraded":"2024-09-12T01:27:06.007997+0000","last_fullsized":"2024-09-12T01:27:06.007997+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:34.434376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2035,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":465,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'119","reported_seq":695,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:20.765834+0000","last_change":"2024-09-12T00:31:50.143762+0000","last_active":"2024-09-12T01:24:20.765834+0000","last_peered":"2024-09-12T01:24:20.765834+0000","last_clean":"2024-09-12T01:24:20.765834+0000","last_became_active":"2024-09-12T00:31:50.143427+0000","last_became_peered":"2024-09-12T00:31:50.143427+0000","last_unstale":"2024-09-12T01:24:20.765834+0000","last_undegraded":"2024-09-12T01:24:20.765834+0000","last_fullsized":"2024-09-12T01:24:20.765834+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:04.603054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":539,"num_read_kb":443,"num_write":196,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'299","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:49.610261+0000","last_change":"2024-09-12T00:31:47.117996+0000","last_active":"2024-09-12T01:26:49.610261+0000","last_peered":"2024-09-12T01:26:49.610261+0000","last_clean":"2024-09-12T01:26:49.610261+0000","last_became_active":"2024-09-12T00:31:47.117631+0000","last_became_peered":"2024-09-12T00:31:47.117631+0000","last_unstale":"2024-09-12T01:26:49.610261+0000","last_undegraded":"2024-09-12T01:26:49.610261+0000","last_fullsized":"2024-09-12T01:26:49.610261+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:35.099357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31853,"num_objects":72,"num_object_clones":0,"num_object_copies":216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":532,"num_read_kb":5850,"num_write":1155,"num_write_kb":26346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:24.494220+0000","last_change":"2024-09-12T00:31:52.152113+0000","last_active":"2024-09-12T01:24:24.494220+0000","last_peered":"2024-09-12T01:24:24.494220+0000","last_clean":"2024-09-12T01:24:24.494220+0000","last_became_active":"2024-09-12T00:31:52.151796+0000","last_became_peered":"2024-09-12T00:31:52.151796+0000","last_unstale":"2024-09-12T01:24:24.494220+0000","last_undegraded":"2024-09-12T01:24:24.494220+0000","last_fullsized":"2024-09-12T01:24:24.494220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:30.115077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'312","reported_seq":893,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.924627+0000","last_change":"2024-09-12T00:31:54.171225+0000","last_active":"2024-09-12T01:29:14.924627+0000","last_peered":"2024-09-12T01:29:14.924627+0000","last_clean":"2024-09-12T01:29:14.924627+0000","last_became_active":"2024-09-12T00:31:54.170965+0000","last_became_peered":"2024-09-12T00:31:54.170965+0000","last_unstale":"2024-09-12T01:29:14.924627+0000","last_undegraded":"2024-09-12T01:29:14.924627+0000","last_fullsized":"2024-09-12T01:29:14.924627+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:10.738478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":509,"num_read_kb":1155,"num_write":420,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782663+0000","last_change":"2024-09-12T00:31:56.172806+0000","last_active":"2024-09-12T01:26:05.782663+0000","last_peered":"2024-09-12T01:26:05.782663+0000","last_clean":"2024-09-12T01:26:05.782663+0000","last_became_active":"2024-09-12T00:31:56.172337+0000","last_became_peered":"2024-09-12T00:31:56.172337+0000","last_unstale":"2024-09-12T01:26:05.782663+0000","last_undegraded":"2024-09-12T01:26:05.782663+0000","last_fullsized":"2024-09-12T01:26:05.782663+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:10.789777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'133","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.342581+0000","last_change":"2024-09-12T00:31:58.178826+0000","last_active":"2024-09-12T01:28:55.342581+0000","last_peered":"2024-09-12T01:28:55.342581+0000","last_clean":"2024-09-12T01:28:55.342581+0000","last_became_active":"2024-09-12T00:31:58.178565+0000","last_became_peered":"2024-09-12T00:31:58.178565+0000","last_unstale":"2024-09-12T01:28:55.342581+0000","last_undegraded":"2024-09-12T01:28:55.342581+0000","last_fullsized":"2024-09-12T01:28:55.342581+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:10.421354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":335,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'510","reported_seq":1278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:38.996474+0000","last_change":"2024-09-12T00:31:50.138366+0000","last_active":"2024-09-12T01:24:38.996474+0000","last_peered":"2024-09-12T01:24:38.996474+0000","last_clean":"2024-09-12T01:24:38.996474+0000","last_became_active":"2024-09-12T00:31:50.137671+0000","last_became_peered":"2024-09-12T00:31:50.137671+0000","last_unstale":"2024-09-12T01:24:38.996474+0000","last_undegraded":"2024-09-12T01:24:38.996474+0000","last_fullsized":"2024-09-12T01:24:38.996474+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:54.842903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2432,"num_read_kb":2072,"num_write":871,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'394","reported_seq":1201,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:18.485370+0000","last_change":"2024-09-12T00:31:47.130554+0000","last_active":"2024-09-12T01:24:18.485370+0000","last_peered":"2024-09-12T01:24:18.485370+0000","last_clean":"2024-09-12T01:24:18.485370+0000","last_became_active":"2024-09-12T00:31:47.130035+0000","last_became_peered":"2024-09-12T00:31:47.130035+0000","last_unstale":"2024-09-12T01:24:18.485370+0000","last_undegraded":"2024-09-12T01:24:18.485370+0000","last_fullsized":"2024-09-12T01:24:18.485370+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:20.320045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16831379,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":1005,"num_read_kb":24732,"num_write":1235,"num_write_kb":48327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:23.486245+0000","last_change":"2024-09-12T00:31:52.156699+0000","last_active":"2024-09-12T01:24:23.486245+0000","last_peered":"2024-09-12T01:24:23.486245+0000","last_clean":"2024-09-12T01:24:23.486245+0000","last_became_active":"2024-09-12T00:31:52.155279+0000","last_became_peered":"2024-09-12T00:31:52.155279+0000","last_unstale":"2024-09-12T01:24:23.486245+0000","last_undegraded":"2024-09-12T01:24:23.486245+0000","last_fullsized":"2024-09-12T01:24:23.486245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:38.156587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'113","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.722904+0000","last_change":"2024-09-12T00:31:54.166092+0000","last_active":"2024-09-12T01:25:59.722904+0000","last_peered":"2024-09-12T01:25:59.722904+0000","last_clean":"2024-09-12T01:25:59.722904+0000","last_became_active":"2024-09-12T00:31:54.165779+0000","last_became_peered":"2024-09-12T00:31:54.165779+0000","last_unstale":"2024-09-12T01:25:59.722904+0000","last_undegraded":"2024-09-12T01:25:59.722904+0000","last_fullsized":"2024-09-12T01:25:59.722904+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:53.134965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":137,"num_write":154,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'759","reported_seq":2335,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.291733+0000","last_change":"2024-09-12T00:31:56.172869+0000","last_active":"2024-09-12T01:29:14.291733+0000","last_peered":"2024-09-12T01:29:14.291733+0000","last_clean":"2024-09-12T01:29:14.291733+0000","last_became_active":"2024-09-12T00:31:56.172551+0000","last_became_peered":"2024-09-12T00:31:56.172551+0000","last_unstale":"2024-09-12T01:29:14.291733+0000","last_undegraded":"2024-09-12T01:29:14.291733+0000","last_fullsized":"2024-09-12T01:29:14.291733+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:33.670974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'121","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:33.597265+0000","last_change":"2024-09-12T00:31:58.178960+0000","last_active":"2024-09-12T01:26:33.597265+0000","last_peered":"2024-09-12T01:26:33.597265+0000","last_clean":"2024-09-12T01:26:33.597265+0000","last_became_active":"2024-09-12T00:31:58.178671+0000","last_became_peered":"2024-09-12T00:31:58.178671+0000","last_unstale":"2024-09-12T01:26:33.597265+0000","last_undegraded":"2024-09-12T01:26:33.597265+0000","last_fullsized":"2024-09-12T01:26:33.597265+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:53.455583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'144","reported_seq":783,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:51.703973+0000","last_change":"2024-09-12T00:31:50.143687+0000","last_active":"2024-09-12T01:25:51.703973+0000","last_peered":"2024-09-12T01:25:51.703973+0000","last_clean":"2024-09-12T01:25:51.703973+0000","last_became_active":"2024-09-12T00:31:50.143377+0000","last_became_peered":"2024-09-12T00:31:50.143377+0000","last_unstale":"2024-09-12T01:25:51.703973+0000","last_undegraded":"2024-09-12T01:25:51.703973+0000","last_fullsized":"2024-09-12T01:25:51.703973+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:37.794802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":664,"num_read_kb":566,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'320","reported_seq":1036,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.376450+0000","last_change":"2024-09-12T00:31:47.129018+0000","last_active":"2024-09-12T01:29:14.376450+0000","last_peered":"2024-09-12T01:29:14.376450+0000","last_clean":"2024-09-12T01:29:14.376450+0000","last_became_active":"2024-09-12T00:31:47.128555+0000","last_became_peered":"2024-09-12T00:31:47.128555+0000","last_unstale":"2024-09-12T01:29:14.376450+0000","last_undegraded":"2024-09-12T01:29:14.376450+0000","last_fullsized":"2024-09-12T01:29:14.376450+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:57.399019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2861896,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":676,"num_read_kb":10967,"num_write":1198,"num_write_kb":23618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:24.594787+0000","last_change":"2024-09-12T00:31:52.151155+0000","last_active":"2024-09-12T01:24:24.594787+0000","last_peered":"2024-09-12T01:24:24.594787+0000","last_clean":"2024-09-12T01:24:24.594787+0000","last_became_active":"2024-09-12T00:31:52.150825+0000","last_became_peered":"2024-09-12T00:31:52.150825+0000","last_unstale":"2024-09-12T01:24:24.594787+0000","last_undegraded":"2024-09-12T01:24:24.594787+0000","last_fullsized":"2024-09-12T01:24:24.594787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:11.561537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'340","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.306588+0000","last_change":"2024-09-12T00:31:54.169556+0000","last_active":"2024-09-12T01:28:55.306588+0000","last_peered":"2024-09-12T01:28:55.306588+0000","last_clean":"2024-09-12T01:28:55.306588+0000","last_became_active":"2024-09-12T00:31:54.169308+0000","last_became_peered":"2024-09-12T00:31:54.169308+0000","last_unstale":"2024-09-12T01:28:55.306588+0000","last_undegraded":"2024-09-12T01:28:55.306588+0000","last_fullsized":"2024-09-12T01:28:55.306588+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:17.921463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55044,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":545,"num_read_kb":1036,"num_write":440,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:08.492547+0000","last_change":"2024-09-12T00:31:56.173701+0000","last_active":"2024-09-12T01:25:08.492547+0000","last_peered":"2024-09-12T01:25:08.492547+0000","last_clean":"2024-09-12T01:25:08.492547+0000","last_became_active":"2024-09-12T00:31:56.173389+0000","last_became_peered":"2024-09-12T00:31:56.173389+0000","last_unstale":"2024-09-12T01:25:08.492547+0000","last_undegraded":"2024-09-12T01:25:08.492547+0000","last_fullsized":"2024-09-12T01:25:08.492547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:28.642695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'140","reported_seq":639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:34.516248+0000","last_change":"2024-09-12T00:31:58.183381+0000","last_active":"2024-09-12T01:27:34.516248+0000","last_peered":"2024-09-12T01:27:34.516248+0000","last_clean":"2024-09-12T01:27:34.516248+0000","last_became_active":"2024-09-12T00:31:58.183017+0000","last_became_peered":"2024-09-12T00:31:58.183017+0000","last_unstale":"2024-09-12T01:27:34.516248+0000","last_undegraded":"2024-09-12T01:27:34.516248+0000","last_fullsized":"2024-09-12T01:27:34.516248+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:38.690748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":129,"num_write":333,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'129","reported_seq":739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.390615+0000","last_change":"2024-09-12T00:31:50.137190+0000","last_active":"2024-09-12T01:28:54.390615+0000","last_peered":"2024-09-12T01:28:54.390615+0000","last_clean":"2024-09-12T01:28:54.390615+0000","last_became_active":"2024-09-12T00:31:50.136941+0000","last_became_peered":"2024-09-12T00:31:50.136941+0000","last_unstale":"2024-09-12T01:28:54.390615+0000","last_undegraded":"2024-09-12T01:28:54.390615+0000","last_fullsized":"2024-09-12T01:28:54.390615+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:49.870575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":653,"num_read_kb":587,"num_write":190,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'280","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.707659+0000","last_change":"2024-09-12T00:31:47.133016+0000","last_active":"2024-09-12T01:29:14.707659+0000","last_peered":"2024-09-12T01:29:14.707659+0000","last_clean":"2024-09-12T01:29:14.707659+0000","last_became_active":"2024-09-12T00:31:47.131600+0000","last_became_peered":"2024-09-12T00:31:47.131600+0000","last_unstale":"2024-09-12T01:29:14.707659+0000","last_undegraded":"2024-09-12T01:29:14.707659+0000","last_fullsized":"2024-09-12T01:29:14.707659+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:24.795534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10811612,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":434,"num_read_kb":43308,"num_write":1037,"num_write_kb":38822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:24.494193+0000","last_change":"2024-09-12T00:31:52.152831+0000","last_active":"2024-09-12T01:24:24.494193+0000","last_peered":"2024-09-12T01:24:24.494193+0000","last_clean":"2024-09-12T01:24:24.494193+0000","last_became_active":"2024-09-12T00:31:52.152537+0000","last_became_peered":"2024-09-12T00:31:52.152537+0000","last_unstale":"2024-09-12T01:24:24.494193+0000","last_undegraded":"2024-09-12T01:24:24.494193+0000","last_fullsized":"2024-09-12T01:24:24.494193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:58.263055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'276","reported_seq":854,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:28.512446+0000","last_change":"2024-09-12T00:31:54.164435+0000","last_active":"2024-09-12T01:27:28.512446+0000","last_peered":"2024-09-12T01:27:28.512446+0000","last_clean":"2024-09-12T01:27:28.512446+0000","last_became_active":"2024-09-12T00:31:54.163977+0000","last_became_peered":"2024-09-12T00:31:54.163977+0000","last_unstale":"2024-09-12T01:27:28.512446+0000","last_undegraded":"2024-09-12T01:27:28.512446+0000","last_fullsized":"2024-09-12T01:27:28.512446+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:06.747649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54013,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":902,"num_write":362,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.716184+0000","last_change":"2024-09-12T00:31:56.171991+0000","last_active":"2024-09-12T01:25:14.716184+0000","last_peered":"2024-09-12T01:25:14.716184+0000","last_clean":"2024-09-12T01:25:14.716184+0000","last_became_active":"2024-09-12T00:31:56.171306+0000","last_became_peered":"2024-09-12T00:31:56.171306+0000","last_unstale":"2024-09-12T01:25:14.716184+0000","last_undegraded":"2024-09-12T01:25:14.716184+0000","last_fullsized":"2024-09-12T01:25:14.716184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:32.961885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'124","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:53.708398+0000","last_change":"2024-09-12T00:31:58.183063+0000","last_active":"2024-09-12T01:26:53.708398+0000","last_peered":"2024-09-12T01:26:53.708398+0000","last_clean":"2024-09-12T01:26:53.708398+0000","last_became_active":"2024-09-12T00:31:58.182701+0000","last_became_peered":"2024-09-12T00:31:58.182701+0000","last_unstale":"2024-09-12T01:26:53.708398+0000","last_undegraded":"2024-09-12T01:26:53.708398+0000","last_fullsized":"2024-09-12T01:26:53.708398+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:26.910205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":215,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'42","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:10.774133+0000","last_change":"2024-09-12T00:31:50.137242+0000","last_active":"2024-09-12T01:25:10.774133+0000","last_peered":"2024-09-12T01:25:10.774133+0000","last_clean":"2024-09-12T01:25:10.774133+0000","last_became_active":"2024-09-12T00:31:50.136971+0000","last_became_peered":"2024-09-12T00:31:50.136971+0000","last_unstale":"2024-09-12T01:25:10.774133+0000","last_undegraded":"2024-09-12T01:25:10.774133+0000","last_fullsized":"2024-09-12T01:25:10.774133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:43.613753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":180,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'277","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:29.947548+0000","last_change":"2024-09-12T00:31:47.123731+0000","last_active":"2024-09-12T01:27:29.947548+0000","last_peered":"2024-09-12T01:27:29.947548+0000","last_clean":"2024-09-12T01:27:29.947548+0000","last_became_active":"2024-09-12T00:31:47.123001+0000","last_became_peered":"2024-09-12T00:31:47.123001+0000","last_unstale":"2024-09-12T01:27:29.947548+0000","last_undegraded":"2024-09-12T01:27:29.947548+0000","last_fullsized":"2024-09-12T01:27:29.947548+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:56.448580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15489161,"num_objects":78,"num_object_clones":0,"num_object_copies":234,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":440,"num_read_kb":39605,"num_write":1019,"num_write_kb":26742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.599267+0000","last_change":"2024-09-12T00:31:52.151290+0000","last_active":"2024-09-12T01:25:04.599267+0000","last_peered":"2024-09-12T01:25:04.599267+0000","last_clean":"2024-09-12T01:25:04.599267+0000","last_became_active":"2024-09-12T00:31:52.150969+0000","last_became_peered":"2024-09-12T00:31:52.150969+0000","last_unstale":"2024-09-12T01:25:04.599267+0000","last_undegraded":"2024-09-12T01:25:04.599267+0000","last_fullsized":"2024-09-12T01:25:04.599267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:12.373364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'257","reported_seq":815,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.791165+0000","last_change":"2024-09-12T00:31:54.170159+0000","last_active":"2024-09-12T01:29:14.791165+0000","last_peered":"2024-09-12T01:29:14.791165+0000","last_clean":"2024-09-12T01:29:14.791165+0000","last_became_active":"2024-09-12T00:31:54.169845+0000","last_became_peered":"2024-09-12T00:31:54.169845+0000","last_unstale":"2024-09-12T01:29:14.791165+0000","last_undegraded":"2024-09-12T01:29:14.791165+0000","last_fullsized":"2024-09-12T01:29:14.791165+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:44.500869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47509,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":435,"num_read_kb":1050,"num_write":360,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:29.710613+0000","last_change":"2024-09-12T00:31:56.171144+0000","last_active":"2024-09-12T01:24:29.710613+0000","last_peered":"2024-09-12T01:24:29.710613+0000","last_clean":"2024-09-12T01:24:29.710613+0000","last_became_active":"2024-09-12T00:31:56.170767+0000","last_became_peered":"2024-09-12T00:31:56.170767+0000","last_unstale":"2024-09-12T01:24:29.710613+0000","last_undegraded":"2024-09-12T01:24:29.710613+0000","last_fullsized":"2024-09-12T01:24:29.710613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:18.923254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'182","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:45.513528+0000","last_change":"2024-09-12T00:31:58.173318+0000","last_active":"2024-09-12T01:27:45.513528+0000","last_peered":"2024-09-12T01:27:45.513528+0000","last_clean":"2024-09-12T01:27:45.513528+0000","last_became_active":"2024-09-12T00:31:58.173049+0000","last_became_peered":"2024-09-12T00:31:58.173049+0000","last_unstale":"2024-09-12T01:27:45.513528+0000","last_undegraded":"2024-09-12T01:27:45.513528+0000","last_fullsized":"2024-09-12T01:27:45.513528+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:38.032229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1227,"num_read_kb":1215,"num_write":440,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'220","reported_seq":785,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:51.961896+0000","last_change":"2024-09-12T00:31:50.141286+0000","last_active":"2024-09-12T01:26:51.961896+0000","last_peered":"2024-09-12T01:26:51.961896+0000","last_clean":"2024-09-12T01:26:51.961896+0000","last_became_active":"2024-09-12T00:31:50.141009+0000","last_became_peered":"2024-09-12T00:31:50.141009+0000","last_unstale":"2024-09-12T01:26:51.961896+0000","last_undegraded":"2024-09-12T01:26:51.961896+0000","last_fullsized":"2024-09-12T01:26:51.961896+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:16.669109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":914,"num_read_kb":727,"num_write":339,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'323","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:57.497740+0000","last_change":"2024-09-12T00:31:47.118759+0000","last_active":"2024-09-12T01:25:57.497740+0000","last_peered":"2024-09-12T01:25:57.497740+0000","last_clean":"2024-09-12T01:25:57.497740+0000","last_became_active":"2024-09-12T00:31:47.118434+0000","last_became_peered":"2024-09-12T00:31:47.118434+0000","last_unstale":"2024-09-12T01:25:57.497740+0000","last_undegraded":"2024-09-12T01:25:57.497740+0000","last_fullsized":"2024-09-12T01:25:57.497740+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:02.477229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3404,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":551,"num_read_kb":10819,"num_write":1179,"num_write_kb":40782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:18.494021+0000","last_change":"2024-09-12T00:31:52.149493+0000","last_active":"2024-09-12T01:25:18.494021+0000","last_peered":"2024-09-12T01:25:18.494021+0000","last_clean":"2024-09-12T01:25:18.494021+0000","last_became_active":"2024-09-12T00:31:52.148440+0000","last_became_peered":"2024-09-12T00:31:52.148440+0000","last_unstale":"2024-09-12T01:25:18.494021+0000","last_undegraded":"2024-09-12T01:25:18.494021+0000","last_fullsized":"2024-09-12T01:25:18.494021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:59.545517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'306","reported_seq":899,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.336903+0000","last_change":"2024-09-12T00:31:54.168195+0000","last_active":"2024-09-12T01:28:55.336903+0000","last_peered":"2024-09-12T01:28:55.336903+0000","last_clean":"2024-09-12T01:28:55.336903+0000","last_became_active":"2024-09-12T00:31:54.167915+0000","last_became_peered":"2024-09-12T00:31:54.167915+0000","last_unstale":"2024-09-12T01:28:55.336903+0000","last_undegraded":"2024-09-12T01:28:55.336903+0000","last_fullsized":"2024-09-12T01:28:55.336903+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:50.298831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54102,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":979,"num_write":400,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:28.487167+0000","last_change":"2024-09-12T00:31:56.174946+0000","last_active":"2024-09-12T01:24:28.487167+0000","last_peered":"2024-09-12T01:24:28.487167+0000","last_clean":"2024-09-12T01:24:28.487167+0000","last_became_active":"2024-09-12T00:31:56.171654+0000","last_became_peered":"2024-09-12T00:31:56.171654+0000","last_unstale":"2024-09-12T01:24:28.487167+0000","last_undegraded":"2024-09-12T01:24:28.487167+0000","last_fullsized":"2024-09-12T01:24:28.487167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:00.032668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'130","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.389173+0000","last_change":"2024-09-12T00:31:58.182334+0000","last_active":"2024-09-12T01:28:54.389173+0000","last_peered":"2024-09-12T01:28:54.389173+0000","last_clean":"2024-09-12T01:28:54.389173+0000","last_became_active":"2024-09-12T00:31:58.181864+0000","last_became_peered":"2024-09-12T00:31:58.181864+0000","last_unstale":"2024-09-12T01:28:54.389173+0000","last_undegraded":"2024-09-12T01:28:54.389173+0000","last_fullsized":"2024-09-12T01:28:54.389173+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:46.609359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":169,"num_write":329,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'138","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:53.705713+0000","last_change":"2024-09-12T00:31:50.124123+0000","last_active":"2024-09-12T01:26:53.705713+0000","last_peered":"2024-09-12T01:26:53.705713+0000","last_clean":"2024-09-12T01:26:53.705713+0000","last_became_active":"2024-09-12T00:31:50.123862+0000","last_became_peered":"2024-09-12T00:31:50.123862+0000","last_unstale":"2024-09-12T01:26:53.705713+0000","last_undegraded":"2024-09-12T01:26:53.705713+0000","last_fullsized":"2024-09-12T01:26:53.705713+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:52.021145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":471,"num_write":227,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'289","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.504377+0000","last_change":"2024-09-12T00:31:47.132671+0000","last_active":"2024-09-12T01:25:59.504377+0000","last_peered":"2024-09-12T01:25:59.504377+0000","last_clean":"2024-09-12T01:25:59.504377+0000","last_became_active":"2024-09-12T00:31:47.132236+0000","last_became_peered":"2024-09-12T00:31:47.132236+0000","last_unstale":"2024-09-12T01:25:59.504377+0000","last_undegraded":"2024-09-12T01:25:59.504377+0000","last_fullsized":"2024-09-12T01:25:59.504377+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:26.659884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1244660,"num_objects":68,"num_object_clones":0,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":392,"num_read_kb":4332,"num_write":965,"num_write_kb":17381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'142","reported_seq":730,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.781778+0000","last_change":"2024-09-12T00:31:50.140955+0000","last_active":"2024-09-12T01:26:00.781778+0000","last_peered":"2024-09-12T01:26:00.781778+0000","last_clean":"2024-09-12T01:26:00.781778+0000","last_became_active":"2024-09-12T00:31:50.140649+0000","last_became_peered":"2024-09-12T00:31:50.140649+0000","last_unstale":"2024-09-12T01:26:00.781778+0000","last_undegraded":"2024-09-12T01:26:00.781778+0000","last_fullsized":"2024-09-12T01:26:00.781778+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:11.915558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":475,"num_write":199,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'300","reported_seq":928,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.715086+0000","last_change":"2024-09-12T00:31:47.126483+0000","last_active":"2024-09-12T01:29:15.715086+0000","last_peered":"2024-09-12T01:29:15.715086+0000","last_clean":"2024-09-12T01:29:15.715086+0000","last_became_active":"2024-09-12T00:31:47.126093+0000","last_became_peered":"2024-09-12T00:31:47.126093+0000","last_unstale":"2024-09-12T01:29:15.715086+0000","last_undegraded":"2024-09-12T01:29:15.715086+0000","last_fullsized":"2024-09-12T01:29:15.715086+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:39.767220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23966,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":428,"num_read_kb":13702,"num_write":963,"num_write_kb":29796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'259","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:37.319605+0000","last_change":"2024-09-12T00:31:50.133329+0000","last_active":"2024-09-12T01:26:37.319605+0000","last_peered":"2024-09-12T01:26:37.319605+0000","last_clean":"2024-09-12T01:26:37.319605+0000","last_became_active":"2024-09-12T00:31:50.132976+0000","last_became_peered":"2024-09-12T00:31:50.132976+0000","last_unstale":"2024-09-12T01:26:37.319605+0000","last_undegraded":"2024-09-12T01:26:37.319605+0000","last_fullsized":"2024-09-12T01:26:37.319605+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:59.147279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1108,"num_read_kb":908,"num_write":394,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'291","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.658143+0000","last_change":"2024-09-12T00:31:47.117320+0000","last_active":"2024-09-12T01:29:14.658143+0000","last_peered":"2024-09-12T01:29:14.658143+0000","last_clean":"2024-09-12T01:29:14.658143+0000","last_became_active":"2024-09-12T00:31:47.117000+0000","last_became_peered":"2024-09-12T00:31:47.117000+0000","last_unstale":"2024-09-12T01:29:14.658143+0000","last_undegraded":"2024-09-12T01:29:14.658143+0000","last_fullsized":"2024-09-12T01:29:14.658143+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:54.678203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505020,"num_objects":63,"num_object_clones":0,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":528,"num_read_kb":34961,"num_write":1098,"num_write_kb":18512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'188","reported_seq":833,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498610+0000","last_change":"2024-09-12T00:31:50.133892+0000","last_active":"2024-09-12T01:26:02.498610+0000","last_peered":"2024-09-12T01:26:02.498610+0000","last_clean":"2024-09-12T01:26:02.498610+0000","last_became_active":"2024-09-12T00:31:50.133634+0000","last_became_peered":"2024-09-12T00:31:50.133634+0000","last_unstale":"2024-09-12T01:26:02.498610+0000","last_undegraded":"2024-09-12T01:26:02.498610+0000","last_fullsized":"2024-09-12T01:26:02.498610+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:48.244378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":708,"num_write":275,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'283","reported_seq":905,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:53.571928+0000","last_change":"2024-09-12T00:31:47.134781+0000","last_active":"2024-09-12T01:28:53.571928+0000","last_peered":"2024-09-12T01:28:53.571928+0000","last_clean":"2024-09-12T01:28:53.571928+0000","last_became_active":"2024-09-12T00:31:47.132735+0000","last_became_peered":"2024-09-12T00:31:47.132735+0000","last_unstale":"2024-09-12T01:28:53.571928+0000","last_undegraded":"2024-09-12T01:28:53.571928+0000","last_fullsized":"2024-09-12T01:28:53.571928+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:17.832111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7449131,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":379,"num_read_kb":13725,"num_write":878,"num_write_kb":25593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'130","reported_seq":731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501249+0000","last_change":"2024-09-12T00:31:50.139504+0000","last_active":"2024-09-12T01:26:17.501249+0000","last_peered":"2024-09-12T01:26:17.501249+0000","last_clean":"2024-09-12T01:26:17.501249+0000","last_became_active":"2024-09-12T00:31:50.138349+0000","last_became_peered":"2024-09-12T00:31:50.138349+0000","last_unstale":"2024-09-12T01:26:17.501249+0000","last_undegraded":"2024-09-12T01:26:17.501249+0000","last_fullsized":"2024-09-12T01:26:17.501249+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:43.103359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":530,"num_write":219,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'297","reported_seq":935,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.592647+0000","last_change":"2024-09-12T00:31:47.133424+0000","last_active":"2024-09-12T01:29:15.592647+0000","last_peered":"2024-09-12T01:29:15.592647+0000","last_clean":"2024-09-12T01:29:15.592647+0000","last_became_active":"2024-09-12T00:31:47.132959+0000","last_became_peered":"2024-09-12T00:31:47.132959+0000","last_unstale":"2024-09-12T01:29:15.592647+0000","last_undegraded":"2024-09-12T01:29:15.592647+0000","last_fullsized":"2024-09-12T01:29:15.592647+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:33.239107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170482,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":457,"num_read_kb":44221,"num_write":1024,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'150","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.559726+0000","last_change":"2024-09-12T00:31:50.131220+0000","last_active":"2024-09-12T01:26:02.559726+0000","last_peered":"2024-09-12T01:26:02.559726+0000","last_clean":"2024-09-12T01:26:02.559726+0000","last_became_active":"2024-09-12T00:31:50.130915+0000","last_became_peered":"2024-09-12T00:31:50.130915+0000","last_unstale":"2024-09-12T01:26:02.559726+0000","last_undegraded":"2024-09-12T01:26:02.559726+0000","last_fullsized":"2024-09-12T01:26:02.559726+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:53.785801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":628,"num_read_kb":507,"num_write":231,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'308","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.470013+0000","last_change":"2024-09-12T00:31:47.122497+0000","last_active":"2024-09-12T01:29:15.470013+0000","last_peered":"2024-09-12T01:29:15.470013+0000","last_clean":"2024-09-12T01:29:15.470013+0000","last_became_active":"2024-09-12T00:31:47.122164+0000","last_became_peered":"2024-09-12T00:31:47.122164+0000","last_unstale":"2024-09-12T01:29:15.470013+0000","last_undegraded":"2024-09-12T01:29:15.470013+0000","last_fullsized":"2024-09-12T01:29:15.470013+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:50.399458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":197518,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":475,"num_read_kb":2267,"num_write":1109,"num_write_kb":17589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'295","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637163+0000","last_change":"2024-09-12T00:31:50.142581+0000","last_active":"2024-09-12T01:26:00.637163+0000","last_peered":"2024-09-12T01:26:00.637163+0000","last_clean":"2024-09-12T01:26:00.637163+0000","last_became_active":"2024-09-12T00:31:50.142283+0000","last_became_peered":"2024-09-12T00:31:50.142283+0000","last_unstale":"2024-09-12T01:26:00.637163+0000","last_undegraded":"2024-09-12T01:26:00.637163+0000","last_fullsized":"2024-09-12T01:26:00.637163+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:05.162707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1272,"num_read_kb":1039,"num_write":466,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'307","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.360768+0000","last_change":"2024-09-12T00:31:47.137276+0000","last_active":"2024-09-12T01:29:14.360768+0000","last_peered":"2024-09-12T01:29:14.360768+0000","last_clean":"2024-09-12T01:29:14.360768+0000","last_became_active":"2024-09-12T00:31:47.136789+0000","last_became_peered":"2024-09-12T00:31:47.136789+0000","last_unstale":"2024-09-12T01:29:14.360768+0000","last_undegraded":"2024-09-12T01:29:14.360768+0000","last_fullsized":"2024-09-12T01:29:14.360768+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:38.463665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12606669,"num_objects":69,"num_object_clones":0,"num_object_copies":207,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":478,"num_read_kb":49646,"num_write":1047,"num_write_kb":37962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'129","reported_seq":747,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:02.423209+0000","last_change":"2024-09-12T00:31:50.141135+0000","last_active":"2024-09-12T01:27:02.423209+0000","last_peered":"2024-09-12T01:27:02.423209+0000","last_clean":"2024-09-12T01:27:02.423209+0000","last_became_active":"2024-09-12T00:31:50.140717+0000","last_became_peered":"2024-09-12T00:31:50.140717+0000","last_unstale":"2024-09-12T01:27:02.423209+0000","last_undegraded":"2024-09-12T01:27:02.423209+0000","last_fullsized":"2024-09-12T01:27:02.423209+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:42.301934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":623,"num_read_kb":519,"num_write":184,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'312","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:36.017298+0000","last_change":"2024-09-12T00:31:47.119263+0000","last_active":"2024-09-12T01:26:36.017298+0000","last_peered":"2024-09-12T01:26:36.017298+0000","last_clean":"2024-09-12T01:26:36.017298+0000","last_became_active":"2024-09-12T00:31:47.118928+0000","last_became_peered":"2024-09-12T00:31:47.118928+0000","last_unstale":"2024-09-12T01:26:36.017298+0000","last_undegraded":"2024-09-12T01:26:36.017298+0000","last_fullsized":"2024-09-12T01:26:36.017298+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:35.668011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213136,"num_objects":74,"num_object_clones":0,"num_object_copies":222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":477,"num_read_kb":12199,"num_write":1146,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'133","reported_seq":731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:30.777076+0000","last_change":"2024-09-12T00:31:50.137312+0000","last_active":"2024-09-12T01:25:30.777076+0000","last_peered":"2024-09-12T01:25:30.777076+0000","last_clean":"2024-09-12T01:25:30.777076+0000","last_became_active":"2024-09-12T00:31:50.137034+0000","last_became_peered":"2024-09-12T00:31:50.137034+0000","last_unstale":"2024-09-12T01:25:30.777076+0000","last_undegraded":"2024-09-12T01:25:30.777076+0000","last_fullsized":"2024-09-12T01:25:30.777076+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:39.007332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":471,"num_write":187,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'339","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.697130+0000","last_change":"2024-09-12T00:31:47.119956+0000","last_active":"2024-09-12T01:29:14.697130+0000","last_peered":"2024-09-12T01:29:14.697130+0000","last_clean":"2024-09-12T01:29:14.697130+0000","last_became_active":"2024-09-12T00:31:47.119180+0000","last_became_peered":"2024-09-12T00:31:47.119180+0000","last_unstale":"2024-09-12T01:29:14.697130+0000","last_undegraded":"2024-09-12T01:29:14.697130+0000","last_fullsized":"2024-09-12T01:29:14.697130+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:45.605525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24817333,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":548,"num_read_kb":71015,"num_write":1270,"num_write_kb":54526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'230","reported_seq":877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.475928+0000","last_change":"2024-09-12T00:31:50.132875+0000","last_active":"2024-09-12T01:25:44.475928+0000","last_peered":"2024-09-12T01:25:44.475928+0000","last_clean":"2024-09-12T01:25:44.475928+0000","last_became_active":"2024-09-12T00:31:50.132605+0000","last_became_peered":"2024-09-12T00:31:50.132605+0000","last_unstale":"2024-09-12T01:25:44.475928+0000","last_undegraded":"2024-09-12T01:25:44.475928+0000","last_fullsized":"2024-09-12T01:25:44.475928+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:04.879402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":781,"num_write":348,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'273","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:46.316399+0000","last_change":"2024-09-12T00:31:47.132644+0000","last_active":"2024-09-12T01:28:46.316399+0000","last_peered":"2024-09-12T01:28:46.316399+0000","last_clean":"2024-09-12T01:28:46.316399+0000","last_became_active":"2024-09-12T00:31:47.131895+0000","last_became_peered":"2024-09-12T00:31:47.131895+0000","last_unstale":"2024-09-12T01:28:46.316399+0000","last_undegraded":"2024-09-12T01:28:46.316399+0000","last_fullsized":"2024-09-12T01:28:46.316399+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:28.078176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5674737,"num_objects":73,"num_object_clones":0,"num_object_copies":219,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":489,"num_read_kb":1443,"num_write":1041,"num_write_kb":20830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'184","reported_seq":814,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499443+0000","last_change":"2024-09-12T00:31:50.139015+0000","last_active":"2024-09-12T01:26:07.499443+0000","last_peered":"2024-09-12T01:26:07.499443+0000","last_clean":"2024-09-12T01:26:07.499443+0000","last_became_active":"2024-09-12T00:31:50.138649+0000","last_became_peered":"2024-09-12T00:31:50.138649+0000","last_unstale":"2024-09-12T01:26:07.499443+0000","last_undegraded":"2024-09-12T01:26:07.499443+0000","last_fullsized":"2024-09-12T01:26:07.499443+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:22.461723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":823,"num_read_kb":682,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'253","reported_seq":880,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.519215+0000","last_change":"2024-09-12T00:31:47.129430+0000","last_active":"2024-09-12T01:28:04.519215+0000","last_peered":"2024-09-12T01:28:04.519215+0000","last_clean":"2024-09-12T01:28:04.519215+0000","last_became_active":"2024-09-12T00:31:47.128598+0000","last_became_peered":"2024-09-12T00:31:47.128598+0000","last_unstale":"2024-09-12T01:28:04.519215+0000","last_undegraded":"2024-09-12T01:28:04.519215+0000","last_fullsized":"2024-09-12T01:28:04.519215+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:35.351098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116744,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":353,"num_read_kb":69389,"num_write":968,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'97","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.603987+0000","last_change":"2024-09-12T00:31:50.140136+0000","last_active":"2024-09-12T01:25:49.603987+0000","last_peered":"2024-09-12T01:25:49.603987+0000","last_clean":"2024-09-12T01:25:49.603987+0000","last_became_active":"2024-09-12T00:31:50.139830+0000","last_became_peered":"2024-09-12T00:31:50.139830+0000","last_unstale":"2024-09-12T01:25:49.603987+0000","last_undegraded":"2024-09-12T01:25:49.603987+0000","last_fullsized":"2024-09-12T01:25:49.603987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:35.900525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":425,"num_read_kb":351,"num_write":136,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'229","reported_seq":858,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:28.042033+0000","last_change":"2024-09-12T00:31:47.125635+0000","last_active":"2024-09-12T01:27:28.042033+0000","last_peered":"2024-09-12T01:27:28.042033+0000","last_clean":"2024-09-12T01:27:28.042033+0000","last_became_active":"2024-09-12T00:31:47.122486+0000","last_became_peered":"2024-09-12T00:31:47.122486+0000","last_unstale":"2024-09-12T01:27:28.042033+0000","last_undegraded":"2024-09-12T01:27:28.042033+0000","last_fullsized":"2024-09-12T01:27:28.042033+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:37.759045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13182903,"num_objects":71,"num_object_clones":0,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":312,"num_read_kb":24154,"num_write":810,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'114","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.603977+0000","last_change":"2024-09-12T00:31:50.139699+0000","last_active":"2024-09-12T01:25:49.603977+0000","last_peered":"2024-09-12T01:25:49.603977+0000","last_clean":"2024-09-12T01:25:49.603977+0000","last_became_active":"2024-09-12T00:31:50.139416+0000","last_became_peered":"2024-09-12T00:31:50.139416+0000","last_unstale":"2024-09-12T01:25:49.603977+0000","last_undegraded":"2024-09-12T01:25:49.603977+0000","last_fullsized":"2024-09-12T01:25:49.603977+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:19.143533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":414,"num_write":177,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'290","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.369149+0000","last_change":"2024-09-12T00:31:47.131206+0000","last_active":"2024-09-12T01:29:14.369149+0000","last_peered":"2024-09-12T01:29:14.369149+0000","last_clean":"2024-09-12T01:29:14.369149+0000","last_became_active":"2024-09-12T00:31:47.130353+0000","last_became_peered":"2024-09-12T00:31:47.130353+0000","last_unstale":"2024-09-12T01:29:14.369149+0000","last_undegraded":"2024-09-12T01:29:14.369149+0000","last_fullsized":"2024-09-12T01:29:14.369149+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:29.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5557023,"num_objects":76,"num_object_clones":0,"num_object_copies":228,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":489,"num_read_kb":8753,"num_write":1120,"num_write_kb":21611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'161","reported_seq":764,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:50.780274+0000","last_change":"2024-09-12T00:31:50.140996+0000","last_active":"2024-09-12T01:25:50.780274+0000","last_peered":"2024-09-12T01:25:50.780274+0000","last_clean":"2024-09-12T01:25:50.780274+0000","last_became_active":"2024-09-12T00:31:50.140705+0000","last_became_peered":"2024-09-12T00:31:50.140705+0000","last_unstale":"2024-09-12T01:25:50.780274+0000","last_undegraded":"2024-09-12T01:25:50.780274+0000","last_fullsized":"2024-09-12T01:25:50.780274+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:23.070768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":620,"num_write":277,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'324","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.658574+0000","last_change":"2024-09-12T00:31:47.120623+0000","last_active":"2024-09-12T01:29:14.658574+0000","last_peered":"2024-09-12T01:29:14.658574+0000","last_clean":"2024-09-12T01:29:14.658574+0000","last_became_active":"2024-09-12T00:31:47.120303+0000","last_became_peered":"2024-09-12T00:31:47.120303+0000","last_unstale":"2024-09-12T01:29:14.658574+0000","last_undegraded":"2024-09-12T01:29:14.658574+0000","last_fullsized":"2024-09-12T01:29:14.658574+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:03.740846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2673184,"num_objects":70,"num_object_clones":0,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":641,"num_read_kb":61137,"num_write":1069,"num_write_kb":48224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'210","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:38.380401+0000","last_change":"2024-09-12T00:31:50.134000+0000","last_active":"2024-09-12T01:26:38.380401+0000","last_peered":"2024-09-12T01:26:38.380401+0000","last_clean":"2024-09-12T01:26:38.380401+0000","last_became_active":"2024-09-12T00:31:50.133698+0000","last_became_peered":"2024-09-12T00:31:50.133698+0000","last_unstale":"2024-09-12T01:26:38.380401+0000","last_undegraded":"2024-09-12T01:26:38.380401+0000","last_fullsized":"2024-09-12T01:26:38.380401+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:03.963890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":883,"num_write":372,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'260","reported_seq":953,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.781779+0000","last_change":"2024-09-12T00:31:47.118141+0000","last_active":"2024-09-12T01:29:15.781779+0000","last_peered":"2024-09-12T01:29:15.781779+0000","last_clean":"2024-09-12T01:29:15.781779+0000","last_became_active":"2024-09-12T00:31:47.117753+0000","last_became_peered":"2024-09-12T00:31:47.117753+0000","last_unstale":"2024-09-12T01:29:15.781779+0000","last_undegraded":"2024-09-12T01:29:15.781779+0000","last_fullsized":"2024-09-12T01:29:15.781779+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:09.782299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2258,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":559,"num_read_kb":553,"num_write":984,"num_write_kb":11415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'4099","reported_seq":4699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605612+0000","last_change":"2024-09-12T00:31:50.145049+0000","last_active":"2024-09-12T01:26:04.605612+0000","last_peered":"2024-09-12T01:26:04.605612+0000","last_clean":"2024-09-12T01:26:04.605612+0000","last_became_active":"2024-09-12T00:31:50.144782+0000","last_became_peered":"2024-09-12T00:31:50.144782+0000","last_unstale":"2024-09-12T01:26:04.605612+0000","last_undegraded":"2024-09-12T01:26:04.605612+0000","last_fullsized":"2024-09-12T01:26:04.605612+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:19.062901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16473,"num_read_kb":13736,"num_write":6146,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'329","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.654496+0000","last_change":"2024-09-12T00:32:23.829074+0000","last_active":"2024-09-12T01:29:15.654496+0000","last_peered":"2024-09-12T01:29:15.654496+0000","last_clean":"2024-09-12T01:29:15.654496+0000","last_became_active":"2024-09-12T00:32:23.828547+0000","last_became_peered":"2024-09-12T00:32:23.828547+0000","last_unstale":"2024-09-12T01:29:15.654496+0000","last_undegraded":"2024-09-12T01:29:15.654496+0000","last_fullsized":"2024-09-12T01:29:15.654496+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:03.711044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2815656,"num_objects":35,"num_object_clones":0,"num_object_copies":105,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":632,"num_read_kb":184067,"num_write":1101,"num_write_kb":52781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"265'253","reported_seq":887,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.679141+0000","last_change":"2024-09-12T00:31:47.123419+0000","last_active":"2024-09-12T01:29:14.679141+0000","last_peered":"2024-09-12T01:29:14.679141+0000","last_clean":"2024-09-12T01:29:14.679141+0000","last_became_active":"2024-09-12T00:31:47.123083+0000","last_became_peered":"2024-09-12T00:31:47.123083+0000","last_unstale":"2024-09-12T01:29:14.679141+0000","last_undegraded":"2024-09-12T01:29:14.679141+0000","last_fullsized":"2024-09-12T01:29:14.679141+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:12.361365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1316039,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":372,"num_read_kb":16597,"num_write":933,"num_write_kb":37945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'178","reported_seq":753,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:18.494115+0000","last_change":"2024-09-12T00:31:50.145133+0000","last_active":"2024-09-12T01:25:18.494115+0000","last_peered":"2024-09-12T01:25:18.494115+0000","last_clean":"2024-09-12T01:25:18.494115+0000","last_became_active":"2024-09-12T00:31:50.144850+0000","last_became_peered":"2024-09-12T00:31:50.144850+0000","last_unstale":"2024-09-12T01:25:18.494115+0000","last_undegraded":"2024-09-12T01:25:18.494115+0000","last_fullsized":"2024-09-12T01:25:18.494115+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:11.930581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":724,"num_read_kb":585,"num_write":260,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'321","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:27.493243+0000","last_change":"2024-09-12T00:31:47.132633+0000","last_active":"2024-09-12T01:25:27.493243+0000","last_peered":"2024-09-12T01:25:27.493243+0000","last_clean":"2024-09-12T01:25:27.493243+0000","last_became_active":"2024-09-12T00:31:47.132149+0000","last_became_peered":"2024-09-12T00:31:47.132149+0000","last_unstale":"2024-09-12T01:25:27.493243+0000","last_undegraded":"2024-09-12T01:25:27.493243+0000","last_fullsized":"2024-09-12T01:25:27.493243+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:43.540773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":327701,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":517,"num_read_kb":13770,"num_write":1222,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'126","reported_seq":749,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.598790+0000","last_change":"2024-09-12T00:31:50.137590+0000","last_active":"2024-09-12T01:24:59.598790+0000","last_peered":"2024-09-12T01:24:59.598790+0000","last_clean":"2024-09-12T01:24:59.598790+0000","last_became_active":"2024-09-12T00:31:50.137283+0000","last_became_peered":"2024-09-12T00:31:50.137283+0000","last_unstale":"2024-09-12T01:24:59.598790+0000","last_undegraded":"2024-09-12T01:24:59.598790+0000","last_fullsized":"2024-09-12T01:24:59.598790+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:36.135953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":583,"num_read_kb":491,"num_write":192,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5593,"num_read_kb":3949,"num_write":1897,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1068,"ondisk_log_size":1068,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15046,"num_read_kb":14700,"num_write":16713,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1460,"ondisk_log_size":1460,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":562,"ondisk_log_size":562,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1748465,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":17923,"num_read_kb":34386,"num_write":15119,"num_write_kb":11674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2822144,"data_stored":2304957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2013,"ondisk_log_size":2013,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102878,"num_read_kb":85467,"num_write":37260,"num_write_kb":18832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3662,"ondisk_log_size":3662,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":438149271,"num_objects":3839,"num_object_clones":0,"num_object_copies":11517,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3839,"num_whiteouts":0,"num_read":32552,"num_read_kb":1971054,"num_write":67769,"num_write_kb":2047906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":674111488,"data_stored":674111488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4129,"ondisk_log_size":4129,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":51142718,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":120,"num_read_kb":176023,"num_write":140,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90800128,"data_stored":90791245,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":57474319,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":115,"num_read_kb":175285,"num_write":137,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":104804352,"data_stored":104797229,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":77,"ondisk_log_size":77,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477435,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":265412,"kb_used_data":63444,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94106428,"statfs":{"total":96636764160,"available":96364982272,"internally_reserved":0,"allocated":64966656,"data_stored":62958487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719477434,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164208,"kb_used_data":74548,"kb_used_omap":1,"kb_used_meta":89406,"kb_avail":94207632,"statfs":{"total":96636764160,"available":96468615168,"internally_reserved":0,"allocated":76337152,"data_stored":74324248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91552198},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510140,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":355280,"kb_used_data":161664,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94016560,"statfs":{"total":96636764160,"available":96272957440,"internally_reserved":0,"allocated":165543936,"data_stored":163497980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510139,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243428,"kb_used_data":144212,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94128412,"statfs":{"total":96636764160,"available":96387493888,"internally_reserved":0,"allocated":147673088,"data_stored":145671556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510138,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368580,"kb_used_data":106932,"kb_used_omap":1,"kb_used_meta":261630,"kb_avail":94003260,"statfs":{"total":96636764160,"available":96259338240,"internally_reserved":0,"allocated":109498368,"data_stored":107427465,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":267909573},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510137,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":243132,"kb_used_data":149484,"kb_used_omap":1,"kb_used_meta":93630,"kb_avail":94128708,"statfs":{"total":96636764160,"available":96387796992,"internally_reserved":0,"allocated":153071616,"data_stored":151002207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95877573},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542840,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":308516,"kb_used_data":137172,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94063324,"statfs":{"total":96636764160,"available":96320843776,"internally_reserved":0,"allocated":140464128,"data_stored":138424784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575545,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":377272,"kb_used_data":121256,"kb_used_omap":1,"kb_used_meta":255998,"kb_avail":93994568,"statfs":{"total":96636764160,"available":96250437632,"internally_reserved":0,"allocated":124166144,"data_stored":122107440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":262142405},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":136622080,"data_stored":136622080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69332992,"data_stored":69332992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102588416,"data_stored":102588416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":107413504,"data_stored":107413504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":115830784,"data_stored":115830784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81645568,"data_stored":81645568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":34283520,"data_stored":34283520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":26394624,"data_stored":26394624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":478346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":473115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":125735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":203127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":471040,"data_stored":396385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":379669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":88273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":212992,"data_stored":160307,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":11534336,"data_stored":11534336,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":23117824,"data_stored":23117098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34643968,"data_stored":34643153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12681216,"data_stored":12679757,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":15486976,"data_stored":15482853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1048576,"data_stored":1048576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":11575296,"data_stored":11574481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5959680,"data_stored":5957105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":11583488,"data_stored":11582762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18923520,"data_stored":18922787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":21786624,"data_stored":21782590,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:29:17.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:29:18.009 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:29:18.009 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":265,"fsid":"96ca3065-0479-453c-a9a3-396e70051c3b","created":"2024-09-12T00:31:17.323087+0000","modified":"2024-09-12T01:04:14.457601+0000","last_up_change":"2024-09-12T00:31:29.740147+0000","last_in_change":"2024-09-12T00:31:19.681132+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":17,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:31:28.413017+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:31:35.753990+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:31:45.809777+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:31:48.446272+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:31:50.278801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:31:52.205755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:31:54.172339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:31:56.245896+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T00:46:02.152816+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T00:48:40.634330+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T00:48:44.052838+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"262","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T01:04:11.861014+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"265","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"6da28c6f-a13c-4f37-8ff1-8a4e33e22ca5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6808","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6809","nonce":741930476}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6810","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6811","nonce":741930476}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6814","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6815","nonce":741930476}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6812","nonce":741930476},{"type":"v1","addr":"172.21.15.62:6813","nonce":741930476}]},"public_addr":"172.21.15.62:6809/741930476","cluster_addr":"172.21.15.62:6811/741930476","heartbeat_back_addr":"172.21.15.62:6815/741930476","heartbeat_front_addr":"172.21.15.62:6813/741930476","state":["exists","up"]},{"osd":1,"uuid":"9d244f54-e9a7-4574-876f-faeb37483f71","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6817","nonce":3104025159}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6818","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6819","nonce":3104025159}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6822","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6823","nonce":3104025159}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":3104025159},{"type":"v1","addr":"172.21.15.62:6821","nonce":3104025159}]},"public_addr":"172.21.15.62:6817/3104025159","cluster_addr":"172.21.15.62:6819/3104025159","heartbeat_back_addr":"172.21.15.62:6823/3104025159","heartbeat_front_addr":"172.21.15.62:6821/3104025159","state":["exists","up"]},{"osd":2,"uuid":"f87e5588-6367-47e0-8786-7de4d746ca46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6801","nonce":3528810202}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6803","nonce":3528810202}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6807","nonce":3528810202}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":3528810202},{"type":"v1","addr":"172.21.15.62:6805","nonce":3528810202}]},"public_addr":"172.21.15.62:6801/3528810202","cluster_addr":"172.21.15.62:6803/3528810202","heartbeat_back_addr":"172.21.15.62:6807/3528810202","heartbeat_front_addr":"172.21.15.62:6805/3528810202","state":["exists","up"]},{"osd":3,"uuid":"8cd55f6b-48ff-4cb3-ab16-8f53ea750769","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6825","nonce":1212805223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6827","nonce":1212805223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6831","nonce":1212805223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":1212805223},{"type":"v1","addr":"172.21.15.62:6829","nonce":1212805223}]},"public_addr":"172.21.15.62:6825/1212805223","cluster_addr":"172.21.15.62:6827/1212805223","heartbeat_back_addr":"172.21.15.62:6831/1212805223","heartbeat_front_addr":"172.21.15.62:6829/1212805223","state":["exists","up"]},{"osd":4,"uuid":"65af27ce-105f-4dd8-b963-64061b9a3e14","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6816","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6817","nonce":3177889521}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6818","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6819","nonce":3177889521}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6822","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6823","nonce":3177889521}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6820","nonce":3177889521},{"type":"v1","addr":"172.21.15.77:6821","nonce":3177889521}]},"public_addr":"172.21.15.77:6817/3177889521","cluster_addr":"172.21.15.77:6819/3177889521","heartbeat_back_addr":"172.21.15.77:6823/3177889521","heartbeat_front_addr":"172.21.15.77:6821/3177889521","state":["exists","up"]},{"osd":5,"uuid":"60dbda0d-1c25-4821-b67e-1df8c03847cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6800","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6801","nonce":200143849}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6802","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6803","nonce":200143849}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6806","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6807","nonce":200143849}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6804","nonce":200143849},{"type":"v1","addr":"172.21.15.77:6805","nonce":200143849}]},"public_addr":"172.21.15.77:6801/200143849","cluster_addr":"172.21.15.77:6803/200143849","heartbeat_back_addr":"172.21.15.77:6807/200143849","heartbeat_front_addr":"172.21.15.77:6805/200143849","state":["exists","up"]},{"osd":6,"uuid":"7d93020d-ee02-41f4-970b-05c3ad20e318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6808","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6809","nonce":1500154120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6810","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6811","nonce":1500154120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6814","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6815","nonce":1500154120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6812","nonce":1500154120},{"type":"v1","addr":"172.21.15.77:6813","nonce":1500154120}]},"public_addr":"172.21.15.77:6809/1500154120","cluster_addr":"172.21.15.77:6811/1500154120","heartbeat_back_addr":"172.21.15.77:6815/1500154120","heartbeat_front_addr":"172.21.15.77:6813/1500154120","state":["exists","up"]},{"osd":7,"uuid":"e4ca495c-287b-4741-9b0d-53f121e90155","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":263,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6824","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6825","nonce":2669672722}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6826","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6827","nonce":2669672722}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6830","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6831","nonce":2669672722}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.77:6828","nonce":2669672722},{"type":"v1","addr":"172.21.15.77:6829","nonce":2669672722}]},"public_addr":"172.21.15.77:6825/2669672722","cluster_addr":"172.21.15.77:6827/2669672722","heartbeat_back_addr":"172.21.15.77:6831/2669672722","heartbeat_front_addr":"172.21.15.77:6829/2669672722","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.580166+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.958476+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.776070+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:26.260747+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.918923+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:25.299243+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:26.525427+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:31:26.516270+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":3,"to":6}]},{"pgid":"3.2f","mappings":[{"from":3,"to":6}]},{"pgid":"3.39","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:29:18.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-12T01:29:19.023 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T01:29:19.024 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:29:19.180 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:29:19.181 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:29:19.181 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:29:19.192 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T01:29:19.506 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T01:29:19.520 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T01:29:19.520 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:29:19.661 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:29:19.661 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:29:19.661 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:29:19.672 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T01:29:19.986 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T01:29:20.000 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T01:29:20.000 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:29:20.142 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:29:20.142 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:29:20.142 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:29:20.153 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T01:29:20.466 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T01:29:20.480 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T01:29:20.480 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:29:20.622 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:29:20.623 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:29:20.623 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:29:20.633 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T01:29:20.949 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T01:29:20.962 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T01:29:20.962 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:29:21.105 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:29:21.105 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:29:21.105 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:29:21.116 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T01:29:21.435 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T01:29:21.449 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T01:29:21.449 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:29:21.591 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:29:21.592 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:29:21.592 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:29:21.602 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T01:29:21.918 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T01:29:21.932 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T01:29:21.932 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:29:22.075 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:29:22.075 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:29:22.075 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:29:22.085 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T01:29:22.403 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T01:29:22.417 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T01:29:22.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:29:22.559 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2024-09-12T01:29:22.559 INFO:teuthology.orchestra.run.smithi062.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:29:22.559 INFO:teuthology.orchestra.run.smithi062.stdout:} 2024-09-12T01:29:22.569 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T01:29:22.886 INFO:teuthology.orchestra.run.smithi062.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T01:29:22.900 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:29:23.254 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:29:23.266 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T01:29:23.269 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":1995,"stamp":"2024-09-12T01:29:21.850267+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80381543,"num_objects":728,"num_object_clones":0,"num_object_copies":1834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":180567,"num_read_kb":2466850,"num_write":142872,"num_write_kb":2319609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12417,"ondisk_log_size":12417,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1637520,"kb_used_data":150692,"kb_used_omap":12,"kb_used_meta":1486003,"kb_avail":753337200,"statfs":{"total":773094113280,"available":771417292800,"internally_reserved":0,"allocated":154308608,"data_stored":138276318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1521667632},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,3],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-556652499,"num_objects":-4064,"num_object_clones":0,"num_object_copies":-12156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4064,"num_whiteouts":0,"num_read":4552,"num_read_kb":4092,"num_write":4315,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005647"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.506005+0000","last_change":"2024-09-12T01:04:13.467817+0000","last_active":"2024-09-12T01:26:44.506005+0000","last_peered":"2024-09-12T01:26:44.506005+0000","last_clean":"2024-09-12T01:26:44.506005+0000","last_became_active":"2024-09-12T01:04:13.467533+0000","last_became_peered":"2024-09-12T01:04:13.467533+0000","last_unstale":"2024-09-12T01:26:44.506005+0000","last_undegraded":"2024-09-12T01:26:44.506005+0000","last_fullsized":"2024-09-12T01:26:44.506005+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:07.938395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:44.523656+0000","last_change":"2024-09-12T00:48:45.303400+0000","last_active":"2024-09-12T01:28:44.523656+0000","last_peered":"2024-09-12T01:28:44.523656+0000","last_clean":"2024-09-12T01:28:44.523656+0000","last_became_active":"2024-09-12T00:48:45.303088+0000","last_became_peered":"2024-09-12T00:48:45.303088+0000","last_unstale":"2024-09-12T01:28:44.523656+0000","last_undegraded":"2024-09-12T01:28:44.523656+0000","last_fullsized":"2024-09-12T01:28:44.523656+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:39.588987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.784398+0000","last_change":"2024-09-12T00:48:42.290755+0000","last_active":"2024-09-12T01:26:15.784398+0000","last_peered":"2024-09-12T01:26:15.784398+0000","last_clean":"2024-09-12T01:26:15.784398+0000","last_became_active":"2024-09-12T00:48:42.290471+0000","last_became_peered":"2024-09-12T00:48:42.290471+0000","last_unstale":"2024-09-12T01:26:15.784398+0000","last_undegraded":"2024-09-12T01:26:15.784398+0000","last_fullsized":"2024-09-12T01:26:15.784398+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:55.297347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'15","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:38.496977+0000","last_change":"2024-09-12T00:46:03.918513+0000","last_active":"2024-09-12T01:25:38.496977+0000","last_peered":"2024-09-12T01:25:38.496977+0000","last_clean":"2024-09-12T01:25:38.496977+0000","last_became_active":"2024-09-12T00:46:03.918235+0000","last_became_peered":"2024-09-12T00:46:03.918235+0000","last_unstale":"2024-09-12T01:25:38.496977+0000","last_undegraded":"2024-09-12T01:25:38.496977+0000","last_fullsized":"2024-09-12T01:25:38.496977+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:35.498415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":51,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.643708+0000","last_change":"2024-09-12T01:04:13.463924+0000","last_active":"2024-09-12T01:26:45.643708+0000","last_peered":"2024-09-12T01:26:45.643708+0000","last_clean":"2024-09-12T01:26:45.643708+0000","last_became_active":"2024-09-12T01:04:13.463645+0000","last_became_peered":"2024-09-12T01:04:13.463645+0000","last_unstale":"2024-09-12T01:26:45.643708+0000","last_undegraded":"2024-09-12T01:26:45.643708+0000","last_fullsized":"2024-09-12T01:26:45.643708+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:54.509681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505992+0000","last_change":"2024-09-12T00:48:45.307402+0000","last_active":"2024-09-12T01:26:14.505992+0000","last_peered":"2024-09-12T01:26:14.505992+0000","last_clean":"2024-09-12T01:26:14.505992+0000","last_became_active":"2024-09-12T00:48:45.307070+0000","last_became_peered":"2024-09-12T00:48:45.307070+0000","last_unstale":"2024-09-12T01:26:14.505992+0000","last_undegraded":"2024-09-12T01:26:14.505992+0000","last_fullsized":"2024-09-12T01:26:14.505992+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:35.964072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:12.500496+0000","last_change":"2024-09-12T00:48:42.297130+0000","last_active":"2024-09-12T01:26:12.500496+0000","last_peered":"2024-09-12T01:26:12.500496+0000","last_clean":"2024-09-12T01:26:12.500496+0000","last_became_active":"2024-09-12T00:48:42.296820+0000","last_became_peered":"2024-09-12T00:48:42.296820+0000","last_unstale":"2024-09-12T01:26:12.500496+0000","last_undegraded":"2024-09-12T01:26:12.500496+0000","last_fullsized":"2024-09-12T01:26:12.500496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:03.334198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'17","reported_seq":98,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:18.502535+0000","last_change":"2024-09-12T00:46:03.920083+0000","last_active":"2024-09-12T01:26:18.502535+0000","last_peered":"2024-09-12T01:26:18.502535+0000","last_clean":"2024-09-12T01:26:18.502535+0000","last_became_active":"2024-09-12T00:46:03.919803+0000","last_became_peered":"2024-09-12T00:46:03.919803+0000","last_unstale":"2024-09-12T01:26:18.502535+0000","last_undegraded":"2024-09-12T01:26:18.502535+0000","last_fullsized":"2024-09-12T01:26:18.502535+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:54.982016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":60,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.605056+0000","last_change":"2024-09-12T01:04:13.470732+0000","last_active":"2024-09-12T01:25:59.605056+0000","last_peered":"2024-09-12T01:25:59.605056+0000","last_clean":"2024-09-12T01:25:59.605056+0000","last_became_active":"2024-09-12T01:04:13.470465+0000","last_became_peered":"2024-09-12T01:04:13.470465+0000","last_unstale":"2024-09-12T01:25:59.605056+0000","last_undegraded":"2024-09-12T01:25:59.605056+0000","last_fullsized":"2024-09-12T01:25:59.605056+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:03.442325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'8","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:22.520613+0000","last_change":"2024-09-12T00:48:45.318707+0000","last_active":"2024-09-12T01:28:22.520613+0000","last_peered":"2024-09-12T01:28:22.520613+0000","last_clean":"2024-09-12T01:28:22.520613+0000","last_became_active":"2024-09-12T00:48:45.318423+0000","last_became_peered":"2024-09-12T00:48:45.318423+0000","last_unstale":"2024-09-12T01:28:22.520613+0000","last_undegraded":"2024-09-12T01:28:22.520613+0000","last_fullsized":"2024-09-12T01:28:22.520613+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:02.110177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4098,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.808894+0000","last_change":"2024-09-12T00:48:42.292914+0000","last_active":"2024-09-12T01:28:55.808894+0000","last_peered":"2024-09-12T01:28:55.808894+0000","last_clean":"2024-09-12T01:28:55.808894+0000","last_became_active":"2024-09-12T00:48:42.292607+0000","last_became_peered":"2024-09-12T00:48:42.292607+0000","last_unstale":"2024-09-12T01:28:55.808894+0000","last_undegraded":"2024-09-12T01:28:55.808894+0000","last_fullsized":"2024-09-12T01:28:55.808894+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:07.172445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'33","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.638048+0000","last_change":"2024-09-12T00:46:03.918495+0000","last_active":"2024-09-12T01:26:05.638048+0000","last_peered":"2024-09-12T01:26:05.638048+0000","last_clean":"2024-09-12T01:26:05.638048+0000","last_became_active":"2024-09-12T00:46:03.918204+0000","last_became_peered":"2024-09-12T00:46:03.918204+0000","last_unstale":"2024-09-12T01:26:05.638048+0000","last_undegraded":"2024-09-12T01:26:05.638048+0000","last_fullsized":"2024-09-12T01:26:05.638048+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:39.227048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":133,"num_write":46,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499343+0000","last_change":"2024-09-12T01:04:13.465355+0000","last_active":"2024-09-12T01:26:07.499343+0000","last_peered":"2024-09-12T01:26:07.499343+0000","last_clean":"2024-09-12T01:26:07.499343+0000","last_became_active":"2024-09-12T01:04:13.465081+0000","last_became_peered":"2024-09-12T01:04:13.465081+0000","last_unstale":"2024-09-12T01:26:07.499343+0000","last_undegraded":"2024-09-12T01:26:07.499343+0000","last_fullsized":"2024-09-12T01:26:07.499343+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:11.393872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:57.507200+0000","last_change":"2024-09-12T00:48:45.315792+0000","last_active":"2024-09-12T01:26:57.507200+0000","last_peered":"2024-09-12T01:26:57.507200+0000","last_clean":"2024-09-12T01:26:57.507200+0000","last_became_active":"2024-09-12T00:48:45.314837+0000","last_became_peered":"2024-09-12T00:48:45.314837+0000","last_unstale":"2024-09-12T01:26:57.507200+0000","last_undegraded":"2024-09-12T01:26:57.507200+0000","last_fullsized":"2024-09-12T01:26:57.507200+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:45.469413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'10","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.734028+0000","last_change":"2024-09-12T00:48:42.290832+0000","last_active":"2024-09-12T01:29:14.734028+0000","last_peered":"2024-09-12T01:29:14.734028+0000","last_clean":"2024-09-12T01:29:14.734028+0000","last_became_active":"2024-09-12T00:48:42.290570+0000","last_became_peered":"2024-09-12T00:48:42.290570+0000","last_unstale":"2024-09-12T01:29:14.734028+0000","last_undegraded":"2024-09-12T01:29:14.734028+0000","last_fullsized":"2024-09-12T01:29:14.734028+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.754613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":15,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"262'57","reported_seq":245,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.638031+0000","last_change":"2024-09-12T00:46:03.912889+0000","last_active":"2024-09-12T01:26:05.638031+0000","last_peered":"2024-09-12T01:26:05.638031+0000","last_clean":"2024-09-12T01:26:05.638031+0000","last_became_active":"2024-09-12T00:46:03.912603+0000","last_became_peered":"2024-09-12T00:46:03.912603+0000","last_unstale":"2024-09-12T01:26:05.638031+0000","last_undegraded":"2024-09-12T01:26:05.638031+0000","last_fullsized":"2024-09-12T01:26:05.638031+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:41.505661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":263,"num_write":69,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:20.785335+0000","last_change":"2024-09-12T01:04:13.459054+0000","last_active":"2024-09-12T01:26:20.785335+0000","last_peered":"2024-09-12T01:26:20.785335+0000","last_clean":"2024-09-12T01:26:20.785335+0000","last_became_active":"2024-09-12T01:04:13.458781+0000","last_became_peered":"2024-09-12T01:04:13.458781+0000","last_unstale":"2024-09-12T01:26:20.785335+0000","last_undegraded":"2024-09-12T01:26:20.785335+0000","last_fullsized":"2024-09-12T01:26:20.785335+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:22.643443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'5","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:09.496309+0000","last_change":"2024-09-12T00:48:45.318968+0000","last_active":"2024-09-12T01:25:09.496309+0000","last_peered":"2024-09-12T01:25:09.496309+0000","last_clean":"2024-09-12T01:25:09.496309+0000","last_became_active":"2024-09-12T00:48:45.318608+0000","last_became_peered":"2024-09-12T00:48:45.318608+0000","last_unstale":"2024-09-12T01:25:09.496309+0000","last_undegraded":"2024-09-12T01:25:09.496309+0000","last_fullsized":"2024-09-12T01:25:09.496309+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:29.993435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"265'11","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.109667+0000","last_change":"2024-09-12T00:48:42.298222+0000","last_active":"2024-09-12T01:29:15.109667+0000","last_peered":"2024-09-12T01:29:15.109667+0000","last_clean":"2024-09-12T01:29:15.109667+0000","last_became_active":"2024-09-12T00:48:42.297952+0000","last_became_peered":"2024-09-12T00:48:42.297952+0000","last_unstale":"2024-09-12T01:29:15.109667+0000","last_undegraded":"2024-09-12T01:29:15.109667+0000","last_fullsized":"2024-09-12T01:29:15.109667+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:49.640614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16432,"num_write":11,"num_write_kb":16432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'28","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.637984+0000","last_change":"2024-09-12T00:46:03.916594+0000","last_active":"2024-09-12T01:26:05.637984+0000","last_peered":"2024-09-12T01:26:05.637984+0000","last_clean":"2024-09-12T01:26:05.637984+0000","last_became_active":"2024-09-12T00:46:03.915917+0000","last_became_peered":"2024-09-12T00:46:03.915917+0000","last_unstale":"2024-09-12T01:26:05.637984+0000","last_undegraded":"2024-09-12T01:26:05.637984+0000","last_fullsized":"2024-09-12T01:26:05.637984+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:26.873454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:08.509445+0000","last_change":"2024-09-12T01:04:13.465500+0000","last_active":"2024-09-12T01:27:08.509445+0000","last_peered":"2024-09-12T01:27:08.509445+0000","last_clean":"2024-09-12T01:27:08.509445+0000","last_became_active":"2024-09-12T01:04:13.465173+0000","last_became_peered":"2024-09-12T01:04:13.465173+0000","last_unstale":"2024-09-12T01:27:08.509445+0000","last_undegraded":"2024-09-12T01:27:08.509445+0000","last_fullsized":"2024-09-12T01:27:08.509445+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:43.615029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:24.733449+0000","last_change":"2024-09-12T00:48:45.314920+0000","last_active":"2024-09-12T01:27:24.733449+0000","last_peered":"2024-09-12T01:27:24.733449+0000","last_clean":"2024-09-12T01:27:24.733449+0000","last_became_active":"2024-09-12T00:48:45.313443+0000","last_became_peered":"2024-09-12T00:48:45.313443+0000","last_unstale":"2024-09-12T01:27:24.733449+0000","last_undegraded":"2024-09-12T01:27:24.733449+0000","last_fullsized":"2024-09-12T01:27:24.733449+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:03.806002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'7","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:29.734050+0000","last_change":"2024-09-12T00:48:42.293510+0000","last_active":"2024-09-12T01:27:29.734050+0000","last_peered":"2024-09-12T01:27:29.734050+0000","last_clean":"2024-09-12T01:27:29.734050+0000","last_became_active":"2024-09-12T00:48:42.293128+0000","last_became_peered":"2024-09-12T00:48:42.293128+0000","last_unstale":"2024-09-12T01:27:29.734050+0000","last_undegraded":"2024-09-12T01:27:29.734050+0000","last_fullsized":"2024-09-12T01:27:29.734050+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:35.032026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":20530,"num_write":7,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'40","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.504898+0000","last_change":"2024-09-12T00:46:03.923309+0000","last_active":"2024-09-12T01:26:04.504898+0000","last_peered":"2024-09-12T01:26:04.504898+0000","last_clean":"2024-09-12T01:26:04.504898+0000","last_became_active":"2024-09-12T00:46:03.923029+0000","last_became_peered":"2024-09-12T00:46:03.923029+0000","last_unstale":"2024-09-12T01:26:04.504898+0000","last_undegraded":"2024-09-12T01:26:04.504898+0000","last_fullsized":"2024-09-12T01:26:04.504898+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:20.804221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":145,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.508900+0000","last_change":"2024-09-12T01:04:13.472265+0000","last_active":"2024-09-12T01:26:44.508900+0000","last_peered":"2024-09-12T01:26:44.508900+0000","last_clean":"2024-09-12T01:26:44.508900+0000","last_became_active":"2024-09-12T01:04:13.468832+0000","last_became_peered":"2024-09-12T01:04:13.468832+0000","last_unstale":"2024-09-12T01:26:44.508900+0000","last_undegraded":"2024-09-12T01:26:44.508900+0000","last_fullsized":"2024-09-12T01:26:44.508900+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.832023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505982+0000","last_change":"2024-09-12T00:48:45.309486+0000","last_active":"2024-09-12T01:26:14.505982+0000","last_peered":"2024-09-12T01:26:14.505982+0000","last_clean":"2024-09-12T01:26:14.505982+0000","last_became_active":"2024-09-12T00:48:45.309166+0000","last_became_peered":"2024-09-12T00:48:45.309166+0000","last_unstale":"2024-09-12T01:26:14.505982+0000","last_undegraded":"2024-09-12T01:26:14.505982+0000","last_fullsized":"2024-09-12T01:26:14.505982+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:58.753867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.502933+0000","last_change":"2024-09-12T00:48:42.292429+0000","last_active":"2024-09-12T01:26:14.502933+0000","last_peered":"2024-09-12T01:26:14.502933+0000","last_clean":"2024-09-12T01:26:14.502933+0000","last_became_active":"2024-09-12T00:48:42.291800+0000","last_became_peered":"2024-09-12T00:48:42.291800+0000","last_unstale":"2024-09-12T01:26:14.502933+0000","last_undegraded":"2024-09-12T01:26:14.502933+0000","last_fullsized":"2024-09-12T01:26:14.502933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:58.520610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'17","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:55.771942+0000","last_change":"2024-09-12T00:46:03.913895+0000","last_active":"2024-09-12T01:24:55.771942+0000","last_peered":"2024-09-12T01:24:55.771942+0000","last_clean":"2024-09-12T01:24:55.771942+0000","last_became_active":"2024-09-12T00:46:03.913667+0000","last_became_peered":"2024-09-12T00:46:03.913667+0000","last_unstale":"2024-09-12T01:24:55.771942+0000","last_undegraded":"2024-09-12T01:24:55.771942+0000","last_fullsized":"2024-09-12T01:24:55.771942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:42.230323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":62,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.506059+0000","last_change":"2024-09-12T01:04:13.462929+0000","last_active":"2024-09-12T01:26:44.506059+0000","last_peered":"2024-09-12T01:26:44.506059+0000","last_clean":"2024-09-12T01:26:44.506059+0000","last_became_active":"2024-09-12T01:04:13.462605+0000","last_became_peered":"2024-09-12T01:04:13.462605+0000","last_unstale":"2024-09-12T01:26:44.506059+0000","last_undegraded":"2024-09-12T01:26:44.506059+0000","last_fullsized":"2024-09-12T01:26:44.506059+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:21.801378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:45.807311+0000","last_change":"2024-09-12T00:48:45.314426+0000","last_active":"2024-09-12T01:28:45.807311+0000","last_peered":"2024-09-12T01:28:45.807311+0000","last_clean":"2024-09-12T01:28:45.807311+0000","last_became_active":"2024-09-12T00:48:45.314128+0000","last_became_peered":"2024-09-12T00:48:45.314128+0000","last_unstale":"2024-09-12T01:28:45.807311+0000","last_undegraded":"2024-09-12T01:28:45.807311+0000","last_fullsized":"2024-09-12T01:28:45.807311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:59.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639662+0000","last_change":"2024-09-12T00:48:42.296184+0000","last_active":"2024-09-12T01:26:15.639662+0000","last_peered":"2024-09-12T01:26:15.639662+0000","last_clean":"2024-09-12T01:26:15.639662+0000","last_became_active":"2024-09-12T00:48:42.295886+0000","last_became_peered":"2024-09-12T00:48:42.295886+0000","last_unstale":"2024-09-12T01:26:15.639662+0000","last_undegraded":"2024-09-12T01:26:15.639662+0000","last_fullsized":"2024-09-12T01:26:15.639662+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:20.846127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'14","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:45.624687+0000","last_change":"2024-09-12T00:46:03.919616+0000","last_active":"2024-09-12T01:24:45.624687+0000","last_peered":"2024-09-12T01:24:45.624687+0000","last_clean":"2024-09-12T01:24:45.624687+0000","last_became_active":"2024-09-12T00:46:03.919334+0000","last_became_peered":"2024-09-12T00:46:03.919334+0000","last_unstale":"2024-09-12T01:24:45.624687+0000","last_undegraded":"2024-09-12T01:24:45.624687+0000","last_fullsized":"2024-09-12T01:24:45.624687+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:28.706224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:17.491559+0000","last_change":"2024-09-12T01:04:13.467497+0000","last_active":"2024-09-12T01:25:17.491559+0000","last_peered":"2024-09-12T01:25:17.491559+0000","last_clean":"2024-09-12T01:25:17.491559+0000","last_became_active":"2024-09-12T01:04:13.467230+0000","last_became_peered":"2024-09-12T01:04:13.467230+0000","last_unstale":"2024-09-12T01:25:17.491559+0000","last_undegraded":"2024-09-12T01:25:17.491559+0000","last_fullsized":"2024-09-12T01:25:17.491559+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:19.612980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.862267+0000","last_change":"2024-09-12T00:48:45.309898+0000","last_active":"2024-09-12T01:29:14.862267+0000","last_peered":"2024-09-12T01:29:14.862267+0000","last_clean":"2024-09-12T01:29:14.862267+0000","last_became_active":"2024-09-12T00:48:45.309604+0000","last_became_peered":"2024-09-12T00:48:45.309604+0000","last_unstale":"2024-09-12T01:29:14.862267+0000","last_undegraded":"2024-09-12T01:29:14.862267+0000","last_fullsized":"2024-09-12T01:29:14.862267+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:20.554961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.724362+0000","last_change":"2024-09-12T00:48:42.294022+0000","last_active":"2024-09-12T01:26:09.724362+0000","last_peered":"2024-09-12T01:26:09.724362+0000","last_clean":"2024-09-12T01:26:09.724362+0000","last_became_active":"2024-09-12T00:48:42.293705+0000","last_became_peered":"2024-09-12T00:48:42.293705+0000","last_unstale":"2024-09-12T01:26:09.724362+0000","last_undegraded":"2024-09-12T01:26:09.724362+0000","last_fullsized":"2024-09-12T01:26:09.724362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.053185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'6","reported_seq":64,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:43.489387+0000","last_change":"2024-09-12T00:46:03.917085+0000","last_active":"2024-09-12T01:24:43.489387+0000","last_peered":"2024-09-12T01:24:43.489387+0000","last_clean":"2024-09-12T01:24:43.489387+0000","last_became_active":"2024-09-12T00:46:03.916699+0000","last_became_peered":"2024-09-12T00:46:03.916699+0000","last_unstale":"2024-09-12T01:24:43.489387+0000","last_undegraded":"2024-09-12T01:24:43.489387+0000","last_fullsized":"2024-09-12T01:24:43.489387+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:45:46.585826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:15.630269+0000","last_change":"2024-09-12T01:04:13.468912+0000","last_active":"2024-09-12T01:25:15.630269+0000","last_peered":"2024-09-12T01:25:15.630269+0000","last_clean":"2024-09-12T01:25:15.630269+0000","last_became_active":"2024-09-12T01:04:13.468643+0000","last_became_peered":"2024-09-12T01:04:13.468643+0000","last_unstale":"2024-09-12T01:25:15.630269+0000","last_undegraded":"2024-09-12T01:25:15.630269+0000","last_fullsized":"2024-09-12T01:25:15.630269+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:52.505763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:37.523035+0000","last_change":"2024-09-12T00:48:45.314936+0000","last_active":"2024-09-12T01:28:37.523035+0000","last_peered":"2024-09-12T01:28:37.523035+0000","last_clean":"2024-09-12T01:28:37.523035+0000","last_became_active":"2024-09-12T00:48:45.314212+0000","last_became_peered":"2024-09-12T00:48:45.314212+0000","last_unstale":"2024-09-12T01:28:37.523035+0000","last_undegraded":"2024-09-12T01:28:37.523035+0000","last_fullsized":"2024-09-12T01:28:37.523035+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:22.945070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:24.509999+0000","last_change":"2024-09-12T00:48:42.292169+0000","last_active":"2024-09-12T01:27:24.509999+0000","last_peered":"2024-09-12T01:27:24.509999+0000","last_clean":"2024-09-12T01:27:24.509999+0000","last_became_active":"2024-09-12T00:48:42.291818+0000","last_became_peered":"2024-09-12T00:48:42.291818+0000","last_unstale":"2024-09-12T01:27:24.509999+0000","last_undegraded":"2024-09-12T01:27:24.509999+0000","last_fullsized":"2024-09-12T01:27:24.509999+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.276296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'35","reported_seq":142,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:43.489359+0000","last_change":"2024-09-12T00:46:03.921103+0000","last_active":"2024-09-12T01:24:43.489359+0000","last_peered":"2024-09-12T01:24:43.489359+0000","last_clean":"2024-09-12T01:24:43.489359+0000","last_became_active":"2024-09-12T00:46:03.920696+0000","last_became_peered":"2024-09-12T00:46:03.920696+0000","last_unstale":"2024-09-12T01:24:43.489359+0000","last_undegraded":"2024-09-12T01:24:43.489359+0000","last_fullsized":"2024-09-12T01:24:43.489359+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:00.908573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.499604+0000","last_change":"2024-09-12T01:04:13.472034+0000","last_active":"2024-09-12T01:25:14.499604+0000","last_peered":"2024-09-12T01:25:14.499604+0000","last_clean":"2024-09-12T01:25:14.499604+0000","last_became_active":"2024-09-12T01:04:13.471741+0000","last_became_peered":"2024-09-12T01:04:13.471741+0000","last_unstale":"2024-09-12T01:25:14.499604+0000","last_undegraded":"2024-09-12T01:25:14.499604+0000","last_fullsized":"2024-09-12T01:25:14.499604+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:37.939219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'7","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:25.794932+0000","last_change":"2024-09-12T00:48:45.317881+0000","last_active":"2024-09-12T01:27:25.794932+0000","last_peered":"2024-09-12T01:27:25.794932+0000","last_clean":"2024-09-12T01:27:25.794932+0000","last_became_active":"2024-09-12T00:48:45.317576+0000","last_became_peered":"2024-09-12T00:48:45.317576+0000","last_unstale":"2024-09-12T01:27:25.794932+0000","last_undegraded":"2024-09-12T01:27:25.794932+0000","last_fullsized":"2024-09-12T01:27:25.794932+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:56.133928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"262'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:00.772850+0000","last_change":"2024-09-12T00:48:42.291771+0000","last_active":"2024-09-12T01:25:00.772850+0000","last_peered":"2024-09-12T01:25:00.772850+0000","last_clean":"2024-09-12T01:25:00.772850+0000","last_became_active":"2024-09-12T00:48:42.291199+0000","last_became_peered":"2024-09-12T00:48:42.291199+0000","last_unstale":"2024-09-12T01:25:00.772850+0000","last_undegraded":"2024-09-12T01:25:00.772850+0000","last_fullsized":"2024-09-12T01:25:00.772850+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:37.299502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5165,"num_write":10,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'6","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:45.770639+0000","last_change":"2024-09-12T00:46:03.919765+0000","last_active":"2024-09-12T01:24:45.770639+0000","last_peered":"2024-09-12T01:24:45.770639+0000","last_clean":"2024-09-12T01:24:45.770639+0000","last_became_active":"2024-09-12T00:46:03.919481+0000","last_became_peered":"2024-09-12T00:46:03.919481+0000","last_unstale":"2024-09-12T01:24:45.770639+0000","last_undegraded":"2024-09-12T01:24:45.770639+0000","last_fullsized":"2024-09-12T01:24:45.770639+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:06.767562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.496856+0000","last_change":"2024-09-12T01:04:13.468963+0000","last_active":"2024-09-12T01:25:14.496856+0000","last_peered":"2024-09-12T01:25:14.496856+0000","last_clean":"2024-09-12T01:25:14.496856+0000","last_became_active":"2024-09-12T01:04:13.468317+0000","last_became_peered":"2024-09-12T01:04:13.468317+0000","last_unstale":"2024-09-12T01:25:14.496856+0000","last_undegraded":"2024-09-12T01:25:14.496856+0000","last_fullsized":"2024-09-12T01:25:14.496856+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:50.519451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.495267+0000","last_change":"2024-09-12T00:48:45.315823+0000","last_active":"2024-09-12T01:24:59.495267+0000","last_peered":"2024-09-12T01:24:59.495267+0000","last_clean":"2024-09-12T01:24:59.495267+0000","last_became_active":"2024-09-12T00:48:45.315546+0000","last_became_peered":"2024-09-12T00:48:45.315546+0000","last_unstale":"2024-09-12T01:24:59.495267+0000","last_undegraded":"2024-09-12T01:24:59.495267+0000","last_fullsized":"2024-09-12T01:24:59.495267+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:54.909978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:22.511246+0000","last_change":"2024-09-12T00:48:42.296841+0000","last_active":"2024-09-12T01:27:22.511246+0000","last_peered":"2024-09-12T01:27:22.511246+0000","last_clean":"2024-09-12T01:27:22.511246+0000","last_became_active":"2024-09-12T00:48:42.296509+0000","last_became_peered":"2024-09-12T00:48:42.296509+0000","last_unstale":"2024-09-12T01:27:22.511246+0000","last_undegraded":"2024-09-12T01:27:22.511246+0000","last_fullsized":"2024-09-12T01:27:22.511246+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:00.906884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'52","reported_seq":188,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721709+0000","last_change":"2024-09-12T00:46:03.920474+0000","last_active":"2024-09-12T01:25:49.721709+0000","last_peered":"2024-09-12T01:25:49.721709+0000","last_clean":"2024-09-12T01:25:49.721709+0000","last_became_active":"2024-09-12T00:46:03.920188+0000","last_became_peered":"2024-09-12T00:46:03.920188+0000","last_unstale":"2024-09-12T01:25:49.721709+0000","last_undegraded":"2024-09-12T01:25:49.721709+0000","last_fullsized":"2024-09-12T01:25:49.721709+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:42.736993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":182,"num_write":95,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498632+0000","last_change":"2024-09-12T01:04:13.462848+0000","last_active":"2024-09-12T01:26:02.498632+0000","last_peered":"2024-09-12T01:26:02.498632+0000","last_clean":"2024-09-12T01:26:02.498632+0000","last_became_active":"2024-09-12T01:04:13.462434+0000","last_became_peered":"2024-09-12T01:04:13.462434+0000","last_unstale":"2024-09-12T01:26:02.498632+0000","last_undegraded":"2024-09-12T01:26:02.498632+0000","last_fullsized":"2024-09-12T01:26:02.498632+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:42.830213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499355+0000","last_change":"2024-09-12T00:48:45.316725+0000","last_active":"2024-09-12T01:26:07.499355+0000","last_peered":"2024-09-12T01:26:07.499355+0000","last_clean":"2024-09-12T01:26:07.499355+0000","last_became_active":"2024-09-12T00:48:45.316432+0000","last_became_peered":"2024-09-12T00:48:45.316432+0000","last_unstale":"2024-09-12T01:26:07.499355+0000","last_undegraded":"2024-09-12T01:26:07.499355+0000","last_fullsized":"2024-09-12T01:26:07.499355+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:20.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605590+0000","last_change":"2024-09-12T00:48:42.290754+0000","last_active":"2024-09-12T01:26:04.605590+0000","last_peered":"2024-09-12T01:26:04.605590+0000","last_clean":"2024-09-12T01:26:04.605590+0000","last_became_active":"2024-09-12T00:48:42.290454+0000","last_became_peered":"2024-09-12T00:48:42.290454+0000","last_unstale":"2024-09-12T01:26:04.605590+0000","last_undegraded":"2024-09-12T01:26:04.605590+0000","last_fullsized":"2024-09-12T01:26:04.605590+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:16.245048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"262'7","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.719526+0000","last_change":"2024-09-12T00:46:03.917579+0000","last_active":"2024-09-12T01:25:44.719526+0000","last_peered":"2024-09-12T01:25:44.719526+0000","last_clean":"2024-09-12T01:25:44.719526+0000","last_became_active":"2024-09-12T00:46:03.917314+0000","last_became_peered":"2024-09-12T00:46:03.917314+0000","last_unstale":"2024-09-12T01:25:44.719526+0000","last_undegraded":"2024-09-12T01:25:44.719526+0000","last_fullsized":"2024-09-12T01:25:44.719526+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:21.892403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":13,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637319+0000","last_change":"2024-09-12T01:04:13.467571+0000","last_active":"2024-09-12T01:26:00.637319+0000","last_peered":"2024-09-12T01:26:00.637319+0000","last_clean":"2024-09-12T01:26:00.637319+0000","last_became_active":"2024-09-12T01:04:13.467119+0000","last_became_peered":"2024-09-12T01:04:13.467119+0000","last_unstale":"2024-09-12T01:26:00.637319+0000","last_undegraded":"2024-09-12T01:26:00.637319+0000","last_fullsized":"2024-09-12T01:26:00.637319+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:23.369147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499300+0000","last_change":"2024-09-12T00:48:45.314598+0000","last_active":"2024-09-12T01:26:07.499300+0000","last_peered":"2024-09-12T01:26:07.499300+0000","last_clean":"2024-09-12T01:26:07.499300+0000","last_became_active":"2024-09-12T00:48:45.314127+0000","last_became_peered":"2024-09-12T00:48:45.314127+0000","last_unstale":"2024-09-12T01:26:07.499300+0000","last_undegraded":"2024-09-12T01:26:07.499300+0000","last_fullsized":"2024-09-12T01:26:07.499300+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:00.050328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'5","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498548+0000","last_change":"2024-09-12T00:48:42.293860+0000","last_active":"2024-09-12T01:26:02.498548+0000","last_peered":"2024-09-12T01:26:02.498548+0000","last_clean":"2024-09-12T01:26:02.498548+0000","last_became_active":"2024-09-12T00:48:42.293153+0000","last_became_peered":"2024-09-12T00:48:42.293153+0000","last_unstale":"2024-09-12T01:26:02.498548+0000","last_undegraded":"2024-09-12T01:26:02.498548+0000","last_fullsized":"2024-09-12T01:26:02.498548+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:12.547450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'49","reported_seq":179,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:45.779451+0000","last_change":"2024-09-12T00:46:03.917417+0000","last_active":"2024-09-12T01:25:45.779451+0000","last_peered":"2024-09-12T01:25:45.779451+0000","last_clean":"2024-09-12T01:25:45.779451+0000","last_became_active":"2024-09-12T00:46:03.917142+0000","last_became_peered":"2024-09-12T00:46:03.917142+0000","last_unstale":"2024-09-12T01:25:45.779451+0000","last_undegraded":"2024-09-12T01:25:45.779451+0000","last_fullsized":"2024-09-12T01:25:45.779451+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:12.229825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":172,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:18.494068+0000","last_change":"2024-09-12T01:04:13.464064+0000","last_active":"2024-09-12T01:25:18.494068+0000","last_peered":"2024-09-12T01:25:18.494068+0000","last_clean":"2024-09-12T01:25:18.494068+0000","last_became_active":"2024-09-12T01:04:13.463766+0000","last_became_peered":"2024-09-12T01:04:13.463766+0000","last_unstale":"2024-09-12T01:25:18.494068+0000","last_undegraded":"2024-09-12T01:25:18.494068+0000","last_fullsized":"2024-09-12T01:25:18.494068+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:26.806464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782587+0000","last_change":"2024-09-12T00:48:45.307348+0000","last_active":"2024-09-12T01:26:05.782587+0000","last_peered":"2024-09-12T01:26:05.782587+0000","last_clean":"2024-09-12T01:26:05.782587+0000","last_became_active":"2024-09-12T00:48:45.307036+0000","last_became_peered":"2024-09-12T00:48:45.307036+0000","last_unstale":"2024-09-12T01:26:05.782587+0000","last_undegraded":"2024-09-12T01:26:05.782587+0000","last_fullsized":"2024-09-12T01:26:05.782587+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:21.417276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:24.521688+0000","last_change":"2024-09-12T00:48:42.294916+0000","last_active":"2024-09-12T01:28:24.521688+0000","last_peered":"2024-09-12T01:28:24.521688+0000","last_clean":"2024-09-12T01:28:24.521688+0000","last_became_active":"2024-09-12T00:48:42.294608+0000","last_became_peered":"2024-09-12T00:48:42.294608+0000","last_unstale":"2024-09-12T01:28:24.521688+0000","last_undegraded":"2024-09-12T01:28:24.521688+0000","last_fullsized":"2024-09-12T01:28:24.521688+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:37.130170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5438,"num_write":5,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.502728+0000","last_change":"2024-09-12T00:46:03.922277+0000","last_active":"2024-09-12T01:25:44.502728+0000","last_peered":"2024-09-12T01:25:44.502728+0000","last_clean":"2024-09-12T01:25:44.502728+0000","last_became_active":"2024-09-12T00:46:03.921844+0000","last_became_peered":"2024-09-12T00:46:03.921844+0000","last_unstale":"2024-09-12T01:25:44.502728+0000","last_undegraded":"2024-09-12T01:25:44.502728+0000","last_fullsized":"2024-09-12T01:25:44.502728+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:57.617387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":67,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637276+0000","last_change":"2024-09-12T01:04:13.462719+0000","last_active":"2024-09-12T01:26:00.637276+0000","last_peered":"2024-09-12T01:26:00.637276+0000","last_clean":"2024-09-12T01:26:00.637276+0000","last_became_active":"2024-09-12T01:04:13.462441+0000","last_became_peered":"2024-09-12T01:04:13.462441+0000","last_unstale":"2024-09-12T01:26:00.637276+0000","last_undegraded":"2024-09-12T01:26:00.637276+0000","last_fullsized":"2024-09-12T01:26:00.637276+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:19.887695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'11","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.407259+0000","last_change":"2024-09-12T00:48:45.312937+0000","last_active":"2024-09-12T01:29:15.407259+0000","last_peered":"2024-09-12T01:29:15.407259+0000","last_clean":"2024-09-12T01:29:15.407259+0000","last_became_active":"2024-09-12T00:48:45.312617+0000","last_became_peered":"2024-09-12T00:48:45.312617+0000","last_unstale":"2024-09-12T01:29:15.407259+0000","last_undegraded":"2024-09-12T01:29:15.407259+0000","last_fullsized":"2024-09-12T01:29:15.407259+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:28.386583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":20528,"num_write":21,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605671+0000","last_change":"2024-09-12T00:48:42.292806+0000","last_active":"2024-09-12T01:26:04.605671+0000","last_peered":"2024-09-12T01:26:04.605671+0000","last_clean":"2024-09-12T01:26:04.605671+0000","last_became_active":"2024-09-12T00:48:42.292511+0000","last_became_peered":"2024-09-12T00:48:42.292511+0000","last_unstale":"2024-09-12T01:26:04.605671+0000","last_undegraded":"2024-09-12T01:26:04.605671+0000","last_fullsized":"2024-09-12T01:26:04.605671+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:34.992694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'10","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:45.779402+0000","last_change":"2024-09-12T00:46:03.913386+0000","last_active":"2024-09-12T01:25:45.779402+0000","last_peered":"2024-09-12T01:25:45.779402+0000","last_clean":"2024-09-12T01:25:45.779402+0000","last_became_active":"2024-09-12T00:46:03.913098+0000","last_became_peered":"2024-09-12T00:46:03.913098+0000","last_unstale":"2024-09-12T01:25:45.779402+0000","last_undegraded":"2024-09-12T01:25:45.779402+0000","last_fullsized":"2024-09-12T01:25:45.779402+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:03.725529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":36,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498570+0000","last_change":"2024-09-12T01:04:13.474135+0000","last_active":"2024-09-12T01:26:02.498570+0000","last_peered":"2024-09-12T01:26:02.498570+0000","last_clean":"2024-09-12T01:26:02.498570+0000","last_became_active":"2024-09-12T01:04:13.473901+0000","last_became_peered":"2024-09-12T01:04:13.473901+0000","last_unstale":"2024-09-12T01:26:02.498570+0000","last_undegraded":"2024-09-12T01:26:02.498570+0000","last_fullsized":"2024-09-12T01:26:02.498570+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:45.848297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.811628+0000","last_change":"2024-09-12T00:48:45.308960+0000","last_active":"2024-09-12T01:29:15.811628+0000","last_peered":"2024-09-12T01:29:15.811628+0000","last_clean":"2024-09-12T01:29:15.811628+0000","last_became_active":"2024-09-12T00:48:45.308676+0000","last_became_peered":"2024-09-12T00:48:45.308676+0000","last_unstale":"2024-09-12T01:29:15.811628+0000","last_undegraded":"2024-09-12T01:29:15.811628+0000","last_fullsized":"2024-09-12T01:29:15.811628+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:11.911720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":80,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.584388+0000","last_change":"2024-09-12T00:48:42.291979+0000","last_active":"2024-09-12T01:29:15.584388+0000","last_peered":"2024-09-12T01:29:15.584388+0000","last_clean":"2024-09-12T01:29:15.584388+0000","last_became_active":"2024-09-12T00:48:42.291569+0000","last_became_peered":"2024-09-12T00:48:42.291569+0000","last_unstale":"2024-09-12T01:29:15.584388+0000","last_undegraded":"2024-09-12T01:29:15.584388+0000","last_fullsized":"2024-09-12T01:29:15.584388+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:20.262872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'67","reported_seq":233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.789165+0000","last_change":"2024-09-12T00:46:03.920845+0000","last_active":"2024-09-12T01:26:45.789165+0000","last_peered":"2024-09-12T01:26:45.789165+0000","last_clean":"2024-09-12T01:26:45.789165+0000","last_became_active":"2024-09-12T00:46:03.920387+0000","last_became_peered":"2024-09-12T00:46:03.920387+0000","last_unstale":"2024-09-12T01:26:45.789165+0000","last_undegraded":"2024-09-12T01:26:45.789165+0000","last_fullsized":"2024-09-12T01:26:45.789165+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:02.972369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":242,"num_write":122,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.609771+0000","last_change":"2024-09-12T01:04:13.470050+0000","last_active":"2024-09-12T01:26:44.609771+0000","last_peered":"2024-09-12T01:26:44.609771+0000","last_clean":"2024-09-12T01:26:44.609771+0000","last_became_active":"2024-09-12T01:04:13.469544+0000","last_became_peered":"2024-09-12T01:04:13.469544+0000","last_unstale":"2024-09-12T01:26:44.609771+0000","last_undegraded":"2024-09-12T01:26:44.609771+0000","last_fullsized":"2024-09-12T01:26:44.609771+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:57.676504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.791316+0000","last_change":"2024-09-12T00:48:45.310714+0000","last_active":"2024-09-12T01:27:00.791316+0000","last_peered":"2024-09-12T01:27:00.791316+0000","last_clean":"2024-09-12T01:27:00.791316+0000","last_became_active":"2024-09-12T00:48:45.310425+0000","last_became_peered":"2024-09-12T00:48:45.310425+0000","last_unstale":"2024-09-12T01:27:00.791316+0000","last_undegraded":"2024-09-12T01:27:00.791316+0000","last_fullsized":"2024-09-12T01:27:00.791316+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:11.427037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646110+0000","last_change":"2024-09-12T00:48:42.289205+0000","last_active":"2024-09-12T01:27:00.646110+0000","last_peered":"2024-09-12T01:27:00.646110+0000","last_clean":"2024-09-12T01:27:00.646110+0000","last_became_active":"2024-09-12T00:48:42.288750+0000","last_became_peered":"2024-09-12T00:48:42.288750+0000","last_unstale":"2024-09-12T01:27:00.646110+0000","last_undegraded":"2024-09-12T01:27:00.646110+0000","last_fullsized":"2024-09-12T01:27:00.646110+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:03.592679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'39","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.727351+0000","last_change":"2024-09-12T00:46:03.918651+0000","last_active":"2024-09-12T01:26:34.727351+0000","last_peered":"2024-09-12T01:26:34.727351+0000","last_clean":"2024-09-12T01:26:34.727351+0000","last_became_active":"2024-09-12T00:46:03.918395+0000","last_became_peered":"2024-09-12T00:46:03.918395+0000","last_unstale":"2024-09-12T01:26:34.727351+0000","last_undegraded":"2024-09-12T01:26:34.727351+0000","last_fullsized":"2024-09-12T01:26:34.727351+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:06.038629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":130,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.722217+0000","last_change":"2024-09-12T01:04:13.468761+0000","last_active":"2024-09-12T01:25:54.722217+0000","last_peered":"2024-09-12T01:25:54.722217+0000","last_clean":"2024-09-12T01:25:54.722217+0000","last_became_active":"2024-09-12T01:04:13.468492+0000","last_became_peered":"2024-09-12T01:04:13.468492+0000","last_unstale":"2024-09-12T01:25:54.722217+0000","last_undegraded":"2024-09-12T01:25:54.722217+0000","last_fullsized":"2024-09-12T01:25:54.722217+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:23.228261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'3","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:10.792664+0000","last_change":"2024-09-12T00:48:45.306987+0000","last_active":"2024-09-12T01:27:10.792664+0000","last_peered":"2024-09-12T01:27:10.792664+0000","last_clean":"2024-09-12T01:27:10.792664+0000","last_became_active":"2024-09-12T00:48:45.306581+0000","last_became_peered":"2024-09-12T00:48:45.306581+0000","last_unstale":"2024-09-12T01:27:10.792664+0000","last_undegraded":"2024-09-12T01:27:10.792664+0000","last_fullsized":"2024-09-12T01:27:10.792664+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:18.025186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.791375+0000","last_change":"2024-09-12T00:48:42.291472+0000","last_active":"2024-09-12T01:27:00.791375+0000","last_peered":"2024-09-12T01:27:00.791375+0000","last_clean":"2024-09-12T01:27:00.791375+0000","last_became_active":"2024-09-12T00:48:42.290069+0000","last_became_peered":"2024-09-12T00:48:42.290069+0000","last_unstale":"2024-09-12T01:27:00.791375+0000","last_undegraded":"2024-09-12T01:27:00.791375+0000","last_fullsized":"2024-09-12T01:27:00.791375+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:06.334859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'22","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.608639+0000","last_change":"2024-09-12T00:46:03.917998+0000","last_active":"2024-09-12T01:26:34.608639+0000","last_peered":"2024-09-12T01:26:34.608639+0000","last_clean":"2024-09-12T01:26:34.608639+0000","last_became_active":"2024-09-12T00:46:03.917612+0000","last_became_peered":"2024-09-12T00:46:03.917612+0000","last_unstale":"2024-09-12T01:26:34.608639+0000","last_undegraded":"2024-09-12T01:26:34.608639+0000","last_fullsized":"2024-09-12T01:26:34.608639+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:25.331801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":67,"num_write":52,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.604479+0000","last_change":"2024-09-12T01:04:13.471829+0000","last_active":"2024-09-12T01:25:54.604479+0000","last_peered":"2024-09-12T01:25:54.604479+0000","last_clean":"2024-09-12T01:25:54.604479+0000","last_became_active":"2024-09-12T01:04:13.470494+0000","last_became_peered":"2024-09-12T01:04:13.470494+0000","last_unstale":"2024-09-12T01:25:54.604479+0000","last_undegraded":"2024-09-12T01:25:54.604479+0000","last_fullsized":"2024-09-12T01:25:54.604479+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:21.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:02.508038+0000","last_change":"2024-09-12T00:48:45.317979+0000","last_active":"2024-09-12T01:27:02.508038+0000","last_peered":"2024-09-12T01:27:02.508038+0000","last_clean":"2024-09-12T01:27:02.508038+0000","last_became_active":"2024-09-12T00:48:45.317637+0000","last_became_peered":"2024-09-12T00:48:45.317637+0000","last_unstale":"2024-09-12T01:27:02.508038+0000","last_undegraded":"2024-09-12T01:27:02.508038+0000","last_fullsized":"2024-09-12T01:27:02.508038+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:51.863153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:55.772057+0000","last_change":"2024-09-12T00:48:42.289582+0000","last_active":"2024-09-12T01:24:55.772057+0000","last_peered":"2024-09-12T01:24:55.772057+0000","last_clean":"2024-09-12T01:24:55.772057+0000","last_became_active":"2024-09-12T00:48:42.289304+0000","last_became_peered":"2024-09-12T00:48:42.289304+0000","last_unstale":"2024-09-12T01:24:55.772057+0000","last_undegraded":"2024-09-12T01:24:55.772057+0000","last_fullsized":"2024-09-12T01:24:55.772057+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:58.432324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":140,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.642226+0000","last_change":"2024-09-12T00:46:03.911642+0000","last_active":"2024-09-12T01:26:35.642226+0000","last_peered":"2024-09-12T01:26:35.642226+0000","last_clean":"2024-09-12T01:26:35.642226+0000","last_became_active":"2024-09-12T00:46:03.911316+0000","last_became_peered":"2024-09-12T00:46:03.911316+0000","last_unstale":"2024-09-12T01:26:35.642226+0000","last_undegraded":"2024-09-12T01:26:35.642226+0000","last_fullsized":"2024-09-12T01:26:35.642226+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:27.292826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":121,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:47.505723+0000","last_change":"2024-09-12T01:04:13.462688+0000","last_active":"2024-09-12T01:26:47.505723+0000","last_peered":"2024-09-12T01:26:47.505723+0000","last_clean":"2024-09-12T01:26:47.505723+0000","last_became_active":"2024-09-12T01:04:13.462150+0000","last_became_peered":"2024-09-12T01:04:13.462150+0000","last_unstale":"2024-09-12T01:26:47.505723+0000","last_undegraded":"2024-09-12T01:26:47.505723+0000","last_fullsized":"2024-09-12T01:26:47.505723+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:43.928057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:44.735869+0000","last_change":"2024-09-12T00:48:45.312564+0000","last_active":"2024-09-12T01:27:44.735869+0000","last_peered":"2024-09-12T01:27:44.735869+0000","last_clean":"2024-09-12T01:27:44.735869+0000","last_became_active":"2024-09-12T00:48:45.312283+0000","last_became_peered":"2024-09-12T00:48:45.312283+0000","last_unstale":"2024-09-12T01:27:44.735869+0000","last_undegraded":"2024-09-12T01:27:44.735869+0000","last_fullsized":"2024-09-12T01:27:44.735869+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:08.027455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:45.797614+0000","last_change":"2024-09-12T00:48:42.290364+0000","last_active":"2024-09-12T01:27:45.797614+0000","last_peered":"2024-09-12T01:27:45.797614+0000","last_clean":"2024-09-12T01:27:45.797614+0000","last_became_active":"2024-09-12T00:48:42.290091+0000","last_became_peered":"2024-09-12T00:48:42.290091+0000","last_unstale":"2024-09-12T01:27:45.797614+0000","last_undegraded":"2024-09-12T01:27:45.797614+0000","last_fullsized":"2024-09-12T01:27:45.797614+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:37.718174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'27","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.642191+0000","last_change":"2024-09-12T00:46:03.917233+0000","last_active":"2024-09-12T01:26:35.642191+0000","last_peered":"2024-09-12T01:26:35.642191+0000","last_clean":"2024-09-12T01:26:35.642191+0000","last_became_active":"2024-09-12T00:46:03.916476+0000","last_became_peered":"2024-09-12T00:46:03.916476+0000","last_unstale":"2024-09-12T01:26:35.642191+0000","last_undegraded":"2024-09-12T01:26:35.642191+0000","last_fullsized":"2024-09-12T01:26:35.642191+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:29.196991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:54.509963+0000","last_change":"2024-09-12T01:04:13.467457+0000","last_active":"2024-09-12T01:26:54.509963+0000","last_peered":"2024-09-12T01:26:54.509963+0000","last_clean":"2024-09-12T01:26:54.509963+0000","last_became_active":"2024-09-12T01:04:13.467045+0000","last_became_peered":"2024-09-12T01:04:13.467045+0000","last_unstale":"2024-09-12T01:26:54.509963+0000","last_undegraded":"2024-09-12T01:26:54.509963+0000","last_fullsized":"2024-09-12T01:26:54.509963+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:17.297601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:44.515078+0000","last_change":"2024-09-12T00:48:45.309440+0000","last_active":"2024-09-12T01:27:44.515078+0000","last_peered":"2024-09-12T01:27:44.515078+0000","last_clean":"2024-09-12T01:27:44.515078+0000","last_became_active":"2024-09-12T00:48:45.309113+0000","last_became_peered":"2024-09-12T00:48:45.309113+0000","last_unstale":"2024-09-12T01:27:44.515078+0000","last_undegraded":"2024-09-12T01:27:44.515078+0000","last_fullsized":"2024-09-12T01:27:44.515078+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:40.821689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:42.514018+0000","last_change":"2024-09-12T00:48:42.293380+0000","last_active":"2024-09-12T01:27:42.514018+0000","last_peered":"2024-09-12T01:27:42.514018+0000","last_clean":"2024-09-12T01:27:42.514018+0000","last_became_active":"2024-09-12T00:48:42.292733+0000","last_became_peered":"2024-09-12T00:48:42.292733+0000","last_unstale":"2024-09-12T01:27:42.514018+0000","last_undegraded":"2024-09-12T01:27:42.514018+0000","last_fullsized":"2024-09-12T01:27:42.514018+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.445225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"262'8","reported_seq":71,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:19.500204+0000","last_change":"2024-09-12T00:46:03.922414+0000","last_active":"2024-09-12T01:25:19.500204+0000","last_peered":"2024-09-12T01:25:19.500204+0000","last_clean":"2024-09-12T01:25:19.500204+0000","last_became_active":"2024-09-12T00:46:03.922008+0000","last_became_peered":"2024-09-12T00:46:03.922008+0000","last_unstale":"2024-09-12T01:25:19.500204+0000","last_undegraded":"2024-09-12T01:25:19.500204+0000","last_fullsized":"2024-09-12T01:25:19.500204+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:42.541731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.506044+0000","last_change":"2024-09-12T01:04:13.467753+0000","last_active":"2024-09-12T01:26:44.506044+0000","last_peered":"2024-09-12T01:26:44.506044+0000","last_clean":"2024-09-12T01:26:44.506044+0000","last_became_active":"2024-09-12T01:04:13.467476+0000","last_became_peered":"2024-09-12T01:04:13.467476+0000","last_unstale":"2024-09-12T01:26:44.506044+0000","last_undegraded":"2024-09-12T01:26:44.506044+0000","last_fullsized":"2024-09-12T01:26:44.506044+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:36.299465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646039+0000","last_change":"2024-09-12T00:48:45.311842+0000","last_active":"2024-09-12T01:27:00.646039+0000","last_peered":"2024-09-12T01:27:00.646039+0000","last_clean":"2024-09-12T01:27:00.646039+0000","last_became_active":"2024-09-12T00:48:45.311541+0000","last_became_peered":"2024-09-12T00:48:45.311541+0000","last_unstale":"2024-09-12T01:27:00.646039+0000","last_undegraded":"2024-09-12T01:27:00.646039+0000","last_fullsized":"2024-09-12T01:27:00.646039+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:32.767909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:45.779440+0000","last_change":"2024-09-12T00:48:42.281525+0000","last_active":"2024-09-12T01:25:45.779440+0000","last_peered":"2024-09-12T01:25:45.779440+0000","last_clean":"2024-09-12T01:25:45.779440+0000","last_became_active":"2024-09-12T00:48:42.281070+0000","last_became_peered":"2024-09-12T00:48:42.281070+0000","last_unstale":"2024-09-12T01:25:45.779440+0000","last_undegraded":"2024-09-12T01:25:45.779440+0000","last_fullsized":"2024-09-12T01:25:45.779440+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:50.751015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'44","reported_seq":173,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:07.489887+0000","last_change":"2024-09-12T00:46:03.917910+0000","last_active":"2024-09-12T01:25:07.489887+0000","last_peered":"2024-09-12T01:25:07.489887+0000","last_clean":"2024-09-12T01:25:07.489887+0000","last_became_active":"2024-09-12T00:46:03.917626+0000","last_became_peered":"2024-09-12T00:46:03.917626+0000","last_unstale":"2024-09-12T01:25:07.489887+0000","last_undegraded":"2024-09-12T01:25:07.489887+0000","last_fullsized":"2024-09-12T01:25:07.489887+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:07.349450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":170,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.789110+0000","last_change":"2024-09-12T01:04:13.463528+0000","last_active":"2024-09-12T01:26:45.789110+0000","last_peered":"2024-09-12T01:26:45.789110+0000","last_clean":"2024-09-12T01:26:45.789110+0000","last_became_active":"2024-09-12T01:04:13.463216+0000","last_became_peered":"2024-09-12T01:04:13.463216+0000","last_unstale":"2024-09-12T01:26:45.789110+0000","last_undegraded":"2024-09-12T01:26:45.789110+0000","last_fullsized":"2024-09-12T01:26:45.789110+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:56.941035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.499853+0000","last_change":"2024-09-12T00:48:45.313761+0000","last_active":"2024-09-12T01:25:44.499853+0000","last_peered":"2024-09-12T01:25:44.499853+0000","last_clean":"2024-09-12T01:25:44.499853+0000","last_became_active":"2024-09-12T00:48:45.313386+0000","last_became_peered":"2024-09-12T00:48:45.313386+0000","last_unstale":"2024-09-12T01:25:44.499853+0000","last_undegraded":"2024-09-12T01:25:44.499853+0000","last_fullsized":"2024-09-12T01:25:44.499853+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:02.140152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:59.730452+0000","last_change":"2024-09-12T00:48:42.293797+0000","last_active":"2024-09-12T01:26:59.730452+0000","last_peered":"2024-09-12T01:26:59.730452+0000","last_clean":"2024-09-12T01:26:59.730452+0000","last_became_active":"2024-09-12T00:48:42.293460+0000","last_became_peered":"2024-09-12T00:48:42.293460+0000","last_unstale":"2024-09-12T01:26:59.730452+0000","last_undegraded":"2024-09-12T01:26:59.730452+0000","last_fullsized":"2024-09-12T01:26:59.730452+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:22.406867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'27","reported_seq":123,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.495705+0000","last_change":"2024-09-12T00:46:03.919193+0000","last_active":"2024-09-12T01:25:04.495705+0000","last_peered":"2024-09-12T01:25:04.495705+0000","last_clean":"2024-09-12T01:25:04.495705+0000","last_became_active":"2024-09-12T00:46:03.918921+0000","last_became_peered":"2024-09-12T00:46:03.918921+0000","last_unstale":"2024-09-12T01:25:04.495705+0000","last_undegraded":"2024-09-12T01:25:04.495705+0000","last_fullsized":"2024-09-12T01:25:04.495705+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:43.600527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.508427+0000","last_change":"2024-09-12T01:04:13.467161+0000","last_active":"2024-09-12T01:27:09.508427+0000","last_peered":"2024-09-12T01:27:09.508427+0000","last_clean":"2024-09-12T01:27:09.508427+0000","last_became_active":"2024-09-12T01:04:13.466854+0000","last_became_peered":"2024-09-12T01:04:13.466854+0000","last_unstale":"2024-09-12T01:27:09.508427+0000","last_undegraded":"2024-09-12T01:27:09.508427+0000","last_fullsized":"2024-09-12T01:27:09.508427+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:37.902119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:32.522238+0000","last_change":"2024-09-12T00:48:45.316511+0000","last_active":"2024-09-12T01:28:32.522238+0000","last_peered":"2024-09-12T01:28:32.522238+0000","last_clean":"2024-09-12T01:28:32.522238+0000","last_became_active":"2024-09-12T00:48:45.315966+0000","last_became_peered":"2024-09-12T00:48:45.315966+0000","last_unstale":"2024-09-12T01:28:32.522238+0000","last_undegraded":"2024-09-12T01:28:32.522238+0000","last_fullsized":"2024-09-12T01:28:32.522238+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:04.129604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1396,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:19.741022+0000","last_change":"2024-09-12T00:48:42.294344+0000","last_active":"2024-09-12T01:28:19.741022+0000","last_peered":"2024-09-12T01:28:19.741022+0000","last_clean":"2024-09-12T01:28:19.741022+0000","last_became_active":"2024-09-12T00:48:42.293481+0000","last_became_peered":"2024-09-12T00:48:42.293481+0000","last_unstale":"2024-09-12T01:28:19.741022+0000","last_undegraded":"2024-09-12T01:28:19.741022+0000","last_fullsized":"2024-09-12T01:28:19.741022+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:01.378966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'25","reported_seq":117,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:03.492017+0000","last_change":"2024-09-12T00:46:03.914527+0000","last_active":"2024-09-12T01:25:03.492017+0000","last_peered":"2024-09-12T01:25:03.492017+0000","last_clean":"2024-09-12T01:25:03.492017+0000","last_became_active":"2024-09-12T00:46:03.914207+0000","last_became_peered":"2024-09-12T00:46:03.914207+0000","last_unstale":"2024-09-12T01:25:03.492017+0000","last_undegraded":"2024-09-12T01:25:03.492017+0000","last_fullsized":"2024-09-12T01:25:03.492017+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:53.077898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.508448+0000","last_change":"2024-09-12T01:04:13.466887+0000","last_active":"2024-09-12T01:27:09.508448+0000","last_peered":"2024-09-12T01:27:09.508448+0000","last_clean":"2024-09-12T01:27:09.508448+0000","last_became_active":"2024-09-12T01:04:13.466050+0000","last_became_peered":"2024-09-12T01:04:13.466050+0000","last_unstale":"2024-09-12T01:27:09.508448+0000","last_undegraded":"2024-09-12T01:27:09.508448+0000","last_fullsized":"2024-09-12T01:27:09.508448+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:39.634410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501296+0000","last_change":"2024-09-12T00:48:45.314649+0000","last_active":"2024-09-12T01:26:17.501296+0000","last_peered":"2024-09-12T01:26:17.501296+0000","last_clean":"2024-09-12T01:26:17.501296+0000","last_became_active":"2024-09-12T00:48:45.313692+0000","last_became_peered":"2024-09-12T00:48:45.313692+0000","last_unstale":"2024-09-12T01:26:17.501296+0000","last_undegraded":"2024-09-12T01:26:17.501296+0000","last_fullsized":"2024-09-12T01:26:17.501296+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:19.872019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:23.503219+0000","last_change":"2024-09-12T00:48:42.288243+0000","last_active":"2024-09-12T01:26:23.503219+0000","last_peered":"2024-09-12T01:26:23.503219+0000","last_clean":"2024-09-12T01:26:23.503219+0000","last_became_active":"2024-09-12T00:48:42.287949+0000","last_became_peered":"2024-09-12T00:48:42.287949+0000","last_unstale":"2024-09-12T01:26:23.503219+0000","last_undegraded":"2024-09-12T01:26:23.503219+0000","last_fullsized":"2024-09-12T01:26:23.503219+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:37.161356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'53","reported_seq":194,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714926+0000","last_change":"2024-09-12T00:46:03.918000+0000","last_active":"2024-09-12T01:25:04.714926+0000","last_peered":"2024-09-12T01:25:04.714926+0000","last_clean":"2024-09-12T01:25:04.714926+0000","last_became_active":"2024-09-12T00:46:03.917728+0000","last_became_peered":"2024-09-12T00:46:03.917728+0000","last_unstale":"2024-09-12T01:25:04.714926+0000","last_undegraded":"2024-09-12T01:25:04.714926+0000","last_fullsized":"2024-09-12T01:25:04.714926+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:11.732147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":191,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:22.501894+0000","last_change":"2024-09-12T01:04:13.466462+0000","last_active":"2024-09-12T01:26:22.501894+0000","last_peered":"2024-09-12T01:26:22.501894+0000","last_clean":"2024-09-12T01:26:22.501894+0000","last_became_active":"2024-09-12T01:04:13.466183+0000","last_became_peered":"2024-09-12T01:04:13.466183+0000","last_unstale":"2024-09-12T01:26:22.501894+0000","last_undegraded":"2024-09-12T01:26:22.501894+0000","last_fullsized":"2024-09-12T01:26:22.501894+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:33.706209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.498929+0000","last_change":"2024-09-12T00:48:45.311887+0000","last_active":"2024-09-12T01:25:34.498929+0000","last_peered":"2024-09-12T01:25:34.498929+0000","last_clean":"2024-09-12T01:25:34.498929+0000","last_became_active":"2024-09-12T00:48:45.311453+0000","last_became_peered":"2024-09-12T00:48:45.311453+0000","last_unstale":"2024-09-12T01:25:34.498929+0000","last_undegraded":"2024-09-12T01:25:34.498929+0000","last_fullsized":"2024-09-12T01:25:34.498929+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:34.715672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:44.515176+0000","last_change":"2024-09-12T00:48:42.295708+0000","last_active":"2024-09-12T01:27:44.515176+0000","last_peered":"2024-09-12T01:27:44.515176+0000","last_clean":"2024-09-12T01:27:44.515176+0000","last_became_active":"2024-09-12T00:48:42.295358+0000","last_became_peered":"2024-09-12T00:48:42.295358+0000","last_unstale":"2024-09-12T01:27:44.515176+0000","last_undegraded":"2024-09-12T01:27:44.515176+0000","last_fullsized":"2024-09-12T01:27:44.515176+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:21.788554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'81","reported_seq":278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.503935+0000","last_change":"2024-09-12T00:46:03.916339+0000","last_active":"2024-09-12T01:25:54.503935+0000","last_peered":"2024-09-12T01:25:54.503935+0000","last_clean":"2024-09-12T01:25:54.503935+0000","last_became_active":"2024-09-12T00:46:03.916021+0000","last_became_peered":"2024-09-12T00:46:03.916021+0000","last_unstale":"2024-09-12T01:25:54.503935+0000","last_undegraded":"2024-09-12T01:25:54.503935+0000","last_fullsized":"2024-09-12T01:25:54.503935+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:09.221542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":326,"num_write":133,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.731804+0000","last_change":"2024-09-12T01:04:13.466014+0000","last_active":"2024-09-12T01:27:09.731804+0000","last_peered":"2024-09-12T01:27:09.731804+0000","last_clean":"2024-09-12T01:27:09.731804+0000","last_became_active":"2024-09-12T01:04:13.465478+0000","last_became_peered":"2024-09-12T01:04:13.465478+0000","last_unstale":"2024-09-12T01:27:09.731804+0000","last_undegraded":"2024-09-12T01:27:09.731804+0000","last_fullsized":"2024-09-12T01:27:09.731804+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:45.735147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718359+0000","last_change":"2024-09-12T00:48:45.314296+0000","last_active":"2024-09-12T01:25:34.718359+0000","last_peered":"2024-09-12T01:25:34.718359+0000","last_clean":"2024-09-12T01:25:34.718359+0000","last_became_active":"2024-09-12T00:48:45.313057+0000","last_became_peered":"2024-09-12T00:48:45.313057+0000","last_unstale":"2024-09-12T01:25:34.718359+0000","last_undegraded":"2024-09-12T01:25:34.718359+0000","last_fullsized":"2024-09-12T01:25:34.718359+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:38.739439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718378+0000","last_change":"2024-09-12T00:48:42.297183+0000","last_active":"2024-09-12T01:25:34.718378+0000","last_peered":"2024-09-12T01:25:34.718378+0000","last_clean":"2024-09-12T01:25:34.718378+0000","last_became_active":"2024-09-12T00:48:42.296903+0000","last_became_peered":"2024-09-12T00:48:42.296903+0000","last_unstale":"2024-09-12T01:25:34.718378+0000","last_undegraded":"2024-09-12T01:25:34.718378+0000","last_fullsized":"2024-09-12T01:25:34.718378+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:11.352129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'58","reported_seq":244,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:40.778662+0000","last_change":"2024-09-12T00:46:03.917455+0000","last_active":"2024-09-12T01:25:40.778662+0000","last_peered":"2024-09-12T01:25:40.778662+0000","last_clean":"2024-09-12T01:25:40.778662+0000","last_became_active":"2024-09-12T00:46:03.917131+0000","last_became_peered":"2024-09-12T00:46:03.917131+0000","last_unstale":"2024-09-12T01:25:40.778662+0000","last_undegraded":"2024-09-12T01:25:40.778662+0000","last_fullsized":"2024-09-12T01:25:40.778662+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:05.329202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":270,"num_write":80,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.781081+0000","last_change":"2024-09-12T01:04:13.468499+0000","last_active":"2024-09-12T01:25:55.781081+0000","last_peered":"2024-09-12T01:25:55.781081+0000","last_clean":"2024-09-12T01:25:55.781081+0000","last_became_active":"2024-09-12T01:04:13.468116+0000","last_became_peered":"2024-09-12T01:04:13.468116+0000","last_unstale":"2024-09-12T01:25:55.781081+0000","last_undegraded":"2024-09-12T01:25:55.781081+0000","last_fullsized":"2024-09-12T01:25:55.781081+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:15.224566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'5","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.831322+0000","last_change":"2024-09-12T00:48:45.317145+0000","last_active":"2024-09-12T01:29:15.831322+0000","last_peered":"2024-09-12T01:29:15.831322+0000","last_clean":"2024-09-12T01:29:15.831322+0000","last_became_active":"2024-09-12T00:48:45.316713+0000","last_became_peered":"2024-09-12T00:48:45.316713+0000","last_unstale":"2024-09-12T01:29:15.831322+0000","last_undegraded":"2024-09-12T01:29:15.831322+0000","last_fullsized":"2024-09-12T01:29:15.831322+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:25.736540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2096,"num_write":10,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:59.523481+0000","last_change":"2024-09-12T00:48:42.293385+0000","last_active":"2024-09-12T01:28:59.523481+0000","last_peered":"2024-09-12T01:28:59.523481+0000","last_clean":"2024-09-12T01:28:59.523481+0000","last_became_active":"2024-09-12T00:48:42.293111+0000","last_became_peered":"2024-09-12T00:48:42.293111+0000","last_unstale":"2024-09-12T01:28:59.523481+0000","last_undegraded":"2024-09-12T01:28:59.523481+0000","last_fullsized":"2024-09-12T01:28:59.523481+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:17.021932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'34","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.502266+0000","last_change":"2024-09-12T00:46:03.914760+0000","last_active":"2024-09-12T01:25:39.502266+0000","last_peered":"2024-09-12T01:25:39.502266+0000","last_clean":"2024-09-12T01:25:39.502266+0000","last_became_active":"2024-09-12T00:46:03.914387+0000","last_became_peered":"2024-09-12T00:46:03.914387+0000","last_unstale":"2024-09-12T01:25:39.502266+0000","last_undegraded":"2024-09-12T01:25:39.502266+0000","last_fullsized":"2024-09-12T01:25:39.502266+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:56.621300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:53.499141+0000","last_change":"2024-09-12T01:04:13.470882+0000","last_active":"2024-09-12T01:25:53.499141+0000","last_peered":"2024-09-12T01:25:53.499141+0000","last_clean":"2024-09-12T01:25:53.499141+0000","last_became_active":"2024-09-12T01:04:13.470597+0000","last_became_peered":"2024-09-12T01:04:13.470597+0000","last_unstale":"2024-09-12T01:25:53.499141+0000","last_undegraded":"2024-09-12T01:25:53.499141+0000","last_fullsized":"2024-09-12T01:25:53.499141+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:44.301395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:49.729085+0000","last_change":"2024-09-12T00:48:45.316493+0000","last_active":"2024-09-12T01:26:49.729085+0000","last_peered":"2024-09-12T01:26:49.729085+0000","last_clean":"2024-09-12T01:26:49.729085+0000","last_became_active":"2024-09-12T00:48:45.316182+0000","last_became_peered":"2024-09-12T00:48:45.316182+0000","last_unstale":"2024-09-12T01:26:49.729085+0000","last_undegraded":"2024-09-12T01:26:49.729085+0000","last_fullsized":"2024-09-12T01:26:49.729085+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:51.175017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:19.740938+0000","last_change":"2024-09-12T00:48:42.294249+0000","last_active":"2024-09-12T01:28:19.740938+0000","last_peered":"2024-09-12T01:28:19.740938+0000","last_clean":"2024-09-12T01:28:19.740938+0000","last_became_active":"2024-09-12T00:48:42.293947+0000","last_became_peered":"2024-09-12T00:48:42.293947+0000","last_unstale":"2024-09-12T01:28:19.740938+0000","last_undegraded":"2024-09-12T01:28:19.740938+0000","last_fullsized":"2024-09-12T01:28:19.740938+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:38.623578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'54","reported_seq":194,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.718948+0000","last_change":"2024-09-12T00:46:03.919567+0000","last_active":"2024-09-12T01:25:39.718948+0000","last_peered":"2024-09-12T01:25:39.718948+0000","last_clean":"2024-09-12T01:25:39.718948+0000","last_became_active":"2024-09-12T00:46:03.919285+0000","last_became_peered":"2024-09-12T00:46:03.919285+0000","last_unstale":"2024-09-12T01:25:39.718948+0000","last_undegraded":"2024-09-12T01:25:39.718948+0000","last_fullsized":"2024-09-12T01:25:39.718948+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:47.685991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":102,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:12.509455+0000","last_change":"2024-09-12T01:04:13.467623+0000","last_active":"2024-09-12T01:27:12.509455+0000","last_peered":"2024-09-12T01:27:12.509455+0000","last_clean":"2024-09-12T01:27:12.509455+0000","last_became_active":"2024-09-12T01:04:13.467374+0000","last_became_peered":"2024-09-12T01:04:13.467374+0000","last_unstale":"2024-09-12T01:27:12.509455+0000","last_undegraded":"2024-09-12T01:27:12.509455+0000","last_fullsized":"2024-09-12T01:27:12.509455+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:34.421544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505968+0000","last_change":"2024-09-12T00:48:45.310759+0000","last_active":"2024-09-12T01:26:14.505968+0000","last_peered":"2024-09-12T01:26:14.505968+0000","last_clean":"2024-09-12T01:26:14.505968+0000","last_became_active":"2024-09-12T00:48:45.310423+0000","last_became_peered":"2024-09-12T00:48:45.310423+0000","last_unstale":"2024-09-12T01:26:14.505968+0000","last_undegraded":"2024-09-12T01:26:14.505968+0000","last_fullsized":"2024-09-12T01:26:14.505968+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:13.622431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639581+0000","last_change":"2024-09-12T00:48:42.296171+0000","last_active":"2024-09-12T01:26:15.639581+0000","last_peered":"2024-09-12T01:26:15.639581+0000","last_clean":"2024-09-12T01:26:15.639581+0000","last_became_active":"2024-09-12T00:48:42.295861+0000","last_became_peered":"2024-09-12T00:48:42.295861+0000","last_unstale":"2024-09-12T01:26:15.639581+0000","last_undegraded":"2024-09-12T01:26:15.639581+0000","last_fullsized":"2024-09-12T01:26:15.639581+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:57.732050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.718904+0000","last_change":"2024-09-12T00:46:03.919535+0000","last_active":"2024-09-12T01:25:39.718904+0000","last_peered":"2024-09-12T01:25:39.718904+0000","last_clean":"2024-09-12T01:25:39.718904+0000","last_became_active":"2024-09-12T00:46:03.917353+0000","last_became_peered":"2024-09-12T00:46:03.917353+0000","last_unstale":"2024-09-12T01:25:39.718904+0000","last_undegraded":"2024-09-12T01:25:39.718904+0000","last_fullsized":"2024-09-12T01:25:39.718904+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:22.130628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":151,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.731874+0000","last_change":"2024-09-12T01:04:13.467110+0000","last_active":"2024-09-12T01:27:09.731874+0000","last_peered":"2024-09-12T01:27:09.731874+0000","last_clean":"2024-09-12T01:27:09.731874+0000","last_became_active":"2024-09-12T01:04:13.466783+0000","last_became_peered":"2024-09-12T01:04:13.466783+0000","last_unstale":"2024-09-12T01:27:09.731874+0000","last_undegraded":"2024-09-12T01:27:09.731874+0000","last_fullsized":"2024-09-12T01:27:09.731874+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:53.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505931+0000","last_change":"2024-09-12T00:48:45.312610+0000","last_active":"2024-09-12T01:26:14.505931+0000","last_peered":"2024-09-12T01:26:14.505931+0000","last_clean":"2024-09-12T01:26:14.505931+0000","last_became_active":"2024-09-12T00:48:45.312329+0000","last_became_peered":"2024-09-12T00:48:45.312329+0000","last_unstale":"2024-09-12T01:26:14.505931+0000","last_undegraded":"2024-09-12T01:26:14.505931+0000","last_fullsized":"2024-09-12T01:26:14.505931+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:29.308504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:19.520998+0000","last_change":"2024-09-12T00:48:42.286718+0000","last_active":"2024-09-12T01:28:19.520998+0000","last_peered":"2024-09-12T01:28:19.520998+0000","last_clean":"2024-09-12T01:28:19.520998+0000","last_became_active":"2024-09-12T00:48:42.286427+0000","last_became_peered":"2024-09-12T00:48:42.286427+0000","last_unstale":"2024-09-12T01:28:19.520998+0000","last_undegraded":"2024-09-12T01:28:19.520998+0000","last_fullsized":"2024-09-12T01:28:19.520998+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:46.315650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'46","reported_seq":175,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:19.506448+0000","last_change":"2024-09-12T00:46:03.919531+0000","last_active":"2024-09-12T01:26:19.506448+0000","last_peered":"2024-09-12T01:26:19.506448+0000","last_clean":"2024-09-12T01:26:19.506448+0000","last_became_active":"2024-09-12T00:46:03.919259+0000","last_became_peered":"2024-09-12T00:46:03.919259+0000","last_unstale":"2024-09-12T01:26:19.506448+0000","last_undegraded":"2024-09-12T01:26:19.506448+0000","last_fullsized":"2024-09-12T01:26:19.506448+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:12.310694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":85,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'380","reported_seq":1126,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.366270+0000","last_change":"2024-09-12T00:31:47.138230+0000","last_active":"2024-09-12T01:29:16.366270+0000","last_peered":"2024-09-12T01:29:16.366270+0000","last_clean":"2024-09-12T01:29:16.366270+0000","last_became_active":"2024-09-12T00:31:47.137895+0000","last_became_peered":"2024-09-12T00:31:47.137895+0000","last_unstale":"2024-09-12T01:29:16.366270+0000","last_undegraded":"2024-09-12T01:29:16.366270+0000","last_fullsized":"2024-09-12T01:29:16.366270+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:28.486538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":750,"num_read_kb":31522,"num_write":1285,"num_write_kb":24718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'194","reported_seq":855,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:49.610222+0000","last_change":"2024-09-12T00:31:50.138500+0000","last_active":"2024-09-12T01:26:49.610222+0000","last_peered":"2024-09-12T01:26:49.610222+0000","last_clean":"2024-09-12T01:26:49.610222+0000","last_became_active":"2024-09-12T00:31:50.138226+0000","last_became_peered":"2024-09-12T00:31:50.138226+0000","last_unstale":"2024-09-12T01:26:49.610222+0000","last_undegraded":"2024-09-12T01:26:49.610222+0000","last_fullsized":"2024-09-12T01:26:49.610222+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:11.080078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":913,"num_read_kb":766,"num_write":296,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'314","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.316063+0000","last_change":"2024-09-12T00:31:47.134970+0000","last_active":"2024-09-12T01:29:16.316063+0000","last_peered":"2024-09-12T01:29:16.316063+0000","last_clean":"2024-09-12T01:29:16.316063+0000","last_became_active":"2024-09-12T00:31:47.134134+0000","last_became_peered":"2024-09-12T00:31:47.134134+0000","last_unstale":"2024-09-12T01:29:16.316063+0000","last_undegraded":"2024-09-12T01:29:16.316063+0000","last_fullsized":"2024-09-12T01:29:16.316063+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:05.214195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":463,"num_read_kb":16965,"num_write":1018,"num_write_kb":26995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'110","reported_seq":705,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:49.729125+0000","last_change":"2024-09-12T00:31:50.132884+0000","last_active":"2024-09-12T01:26:49.729125+0000","last_peered":"2024-09-12T01:26:49.729125+0000","last_clean":"2024-09-12T01:26:49.729125+0000","last_became_active":"2024-09-12T00:31:50.132639+0000","last_became_peered":"2024-09-12T00:31:50.132639+0000","last_unstale":"2024-09-12T01:26:49.729125+0000","last_undegraded":"2024-09-12T01:26:49.729125+0000","last_fullsized":"2024-09-12T01:26:49.729125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:24.512638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":165,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'368","reported_seq":1107,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.351180+0000","last_change":"2024-09-12T00:31:47.120188+0000","last_active":"2024-09-12T01:29:16.351180+0000","last_peered":"2024-09-12T01:29:16.351180+0000","last_clean":"2024-09-12T01:29:16.351180+0000","last_became_active":"2024-09-12T00:31:47.119865+0000","last_became_peered":"2024-09-12T00:31:47.119865+0000","last_unstale":"2024-09-12T01:29:16.351180+0000","last_undegraded":"2024-09-12T01:29:16.351180+0000","last_fullsized":"2024-09-12T01:29:16.351180+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:42.752369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344922,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":840,"num_read_kb":4429,"num_write":1181,"num_write_kb":10543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'286","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:49.729160+0000","last_change":"2024-09-12T00:31:50.135767+0000","last_active":"2024-09-12T01:26:49.729160+0000","last_peered":"2024-09-12T01:26:49.729160+0000","last_clean":"2024-09-12T01:26:49.729160+0000","last_became_active":"2024-09-12T00:31:50.135413+0000","last_became_peered":"2024-09-12T00:31:50.135413+0000","last_unstale":"2024-09-12T01:26:49.729160+0000","last_undegraded":"2024-09-12T01:26:49.729160+0000","last_fullsized":"2024-09-12T01:26:49.729160+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:32.753854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1012,"num_write":455,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'315","reported_seq":957,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.411811+0000","last_change":"2024-09-12T00:31:47.133763+0000","last_active":"2024-09-12T01:29:16.411811+0000","last_peered":"2024-09-12T01:29:16.411811+0000","last_clean":"2024-09-12T01:29:16.411811+0000","last_became_active":"2024-09-12T00:31:47.133414+0000","last_became_peered":"2024-09-12T00:31:47.133414+0000","last_unstale":"2024-09-12T01:29:16.411811+0000","last_undegraded":"2024-09-12T01:29:16.411811+0000","last_fullsized":"2024-09-12T01:29:16.411811+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:38:03.831657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11933654,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":465,"num_read_kb":32236,"num_write":1054,"num_write_kb":37937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'183","reported_seq":785,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:17.241665+0000","last_change":"2024-09-12T00:31:50.135590+0000","last_active":"2024-09-12T01:27:17.241665+0000","last_peered":"2024-09-12T01:27:17.241665+0000","last_clean":"2024-09-12T01:27:17.241665+0000","last_became_active":"2024-09-12T00:31:50.135322+0000","last_became_peered":"2024-09-12T00:31:50.135322+0000","last_unstale":"2024-09-12T01:27:17.241665+0000","last_undegraded":"2024-09-12T01:27:17.241665+0000","last_fullsized":"2024-09-12T01:27:17.241665+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:03.974784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":591,"num_write":296,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'319","reported_seq":943,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.455525+0000","last_change":"2024-09-12T00:31:47.129759+0000","last_active":"2024-09-12T01:29:16.455525+0000","last_peered":"2024-09-12T01:29:16.455525+0000","last_clean":"2024-09-12T01:29:16.455525+0000","last_became_active":"2024-09-12T00:31:47.128016+0000","last_became_peered":"2024-09-12T00:31:47.128016+0000","last_unstale":"2024-09-12T01:29:16.455525+0000","last_undegraded":"2024-09-12T01:29:16.455525+0000","last_fullsized":"2024-09-12T01:29:16.455525+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":458,"num_read_kb":35042,"num_write":1048,"num_write_kb":20184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'220","reported_seq":839,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.501392+0000","last_change":"2024-09-12T00:31:50.132960+0000","last_active":"2024-09-12T01:25:59.501392+0000","last_peered":"2024-09-12T01:25:59.501392+0000","last_clean":"2024-09-12T01:25:59.501392+0000","last_became_active":"2024-09-12T00:31:50.132674+0000","last_became_peered":"2024-09-12T00:31:50.132674+0000","last_unstale":"2024-09-12T01:25:59.501392+0000","last_undegraded":"2024-09-12T01:25:59.501392+0000","last_fullsized":"2024-09-12T01:25:59.501392+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:49.251283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":967,"num_read_kb":781,"num_write":356,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'365","reported_seq":993,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.481733+0000","last_change":"2024-09-12T00:31:47.135231+0000","last_active":"2024-09-12T01:29:16.481733+0000","last_peered":"2024-09-12T01:29:16.481733+0000","last_clean":"2024-09-12T01:29:16.481733+0000","last_became_active":"2024-09-12T00:31:47.134887+0000","last_became_peered":"2024-09-12T00:31:47.134887+0000","last_unstale":"2024-09-12T01:29:16.481733+0000","last_undegraded":"2024-09-12T01:29:16.481733+0000","last_fullsized":"2024-09-12T01:29:16.481733+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:00.830296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396853,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":509,"num_read_kb":3274,"num_write":1223,"num_write_kb":38824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'275","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.501413+0000","last_change":"2024-09-12T00:31:50.140357+0000","last_active":"2024-09-12T01:25:59.501413+0000","last_peered":"2024-09-12T01:25:59.501413+0000","last_clean":"2024-09-12T01:25:59.501413+0000","last_became_active":"2024-09-12T00:31:50.140087+0000","last_became_peered":"2024-09-12T00:31:50.140087+0000","last_unstale":"2024-09-12T01:25:59.501413+0000","last_undegraded":"2024-09-12T01:25:59.501413+0000","last_fullsized":"2024-09-12T01:25:59.501413+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:30.983237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1141,"num_read_kb":956,"num_write":415,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'392","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.462923+0000","last_change":"2024-09-12T00:32:23.831062+0000","last_active":"2024-09-12T01:29:16.462923+0000","last_peered":"2024-09-12T01:29:16.462923+0000","last_clean":"2024-09-12T01:29:16.462923+0000","last_became_active":"2024-09-12T00:32:23.830676+0000","last_became_peered":"2024-09-12T00:32:23.830676+0000","last_unstale":"2024-09-12T01:29:16.462923+0000","last_undegraded":"2024-09-12T01:29:16.462923+0000","last_fullsized":"2024-09-12T01:29:16.462923+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:35.456863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170251,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":5774,"num_write":1256,"num_write_kb":23845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3e","version":"265'51","reported_seq":590,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:47.570442+0000","last_change":"2024-09-12T00:31:50.140487+0000","last_active":"2024-09-12T01:26:47.570442+0000","last_peered":"2024-09-12T01:26:47.570442+0000","last_clean":"2024-09-12T01:26:47.570442+0000","last_became_active":"2024-09-12T00:31:50.140207+0000","last_became_peered":"2024-09-12T00:31:50.140207+0000","last_unstale":"2024-09-12T01:26:47.570442+0000","last_undegraded":"2024-09-12T01:26:47.570442+0000","last_fullsized":"2024-09-12T01:26:47.570442+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:00.343009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":145,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'386","reported_seq":1065,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.478114+0000","last_change":"2024-09-12T00:31:47.128251+0000","last_active":"2024-09-12T01:29:16.478114+0000","last_peered":"2024-09-12T01:29:16.478114+0000","last_clean":"2024-09-12T01:29:16.478114+0000","last_became_active":"2024-09-12T00:31:47.127930+0000","last_became_peered":"2024-09-12T00:31:47.127930+0000","last_unstale":"2024-09-12T01:29:16.478114+0000","last_undegraded":"2024-09-12T01:29:16.478114+0000","last_fullsized":"2024-09-12T01:29:16.478114+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:52.713325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396864,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":638,"num_read_kb":6946,"num_write":1462,"num_write_kb":29009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'96","reported_seq":688,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498691+0000","last_change":"2024-09-12T00:31:50.142364+0000","last_active":"2024-09-12T01:26:02.498691+0000","last_peered":"2024-09-12T01:26:02.498691+0000","last_clean":"2024-09-12T01:26:02.498691+0000","last_became_active":"2024-09-12T00:31:50.142071+0000","last_became_peered":"2024-09-12T00:31:50.142071+0000","last_unstale":"2024-09-12T01:26:02.498691+0000","last_undegraded":"2024-09-12T01:26:02.498691+0000","last_fullsized":"2024-09-12T01:26:02.498691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:46.856124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":364,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'86","reported_seq":690,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:29.717727+0000","last_change":"2024-09-12T00:31:50.132450+0000","last_active":"2024-09-12T01:25:29.717727+0000","last_peered":"2024-09-12T01:25:29.717727+0000","last_clean":"2024-09-12T01:25:29.717727+0000","last_became_active":"2024-09-12T00:31:50.132178+0000","last_became_peered":"2024-09-12T00:31:50.132178+0000","last_unstale":"2024-09-12T01:25:29.717727+0000","last_undegraded":"2024-09-12T01:25:29.717727+0000","last_fullsized":"2024-09-12T01:25:29.717727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:34.527456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":346,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'333","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.443978+0000","last_change":"2024-09-12T00:31:47.124269+0000","last_active":"2024-09-12T01:29:16.443978+0000","last_peered":"2024-09-12T01:29:16.443978+0000","last_clean":"2024-09-12T01:29:16.443978+0000","last_became_active":"2024-09-12T00:31:47.123956+0000","last_became_peered":"2024-09-12T00:31:47.123956+0000","last_unstale":"2024-09-12T01:29:16.443978+0000","last_undegraded":"2024-09-12T01:29:16.443978+0000","last_fullsized":"2024-09-12T01:29:16.443978+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:27.189976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525329,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":483,"num_read_kb":32458,"num_write":1127,"num_write_kb":22794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'162","reported_seq":808,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.544138+0000","last_change":"2024-09-12T00:31:50.131280+0000","last_active":"2024-09-12T01:27:47.544138+0000","last_peered":"2024-09-12T01:27:47.544138+0000","last_clean":"2024-09-12T01:27:47.544138+0000","last_became_active":"2024-09-12T00:31:50.130844+0000","last_became_peered":"2024-09-12T00:31:50.130844+0000","last_unstale":"2024-09-12T01:27:47.544138+0000","last_undegraded":"2024-09-12T01:27:47.544138+0000","last_fullsized":"2024-09-12T01:27:47.544138+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:38.260983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":634,"num_write":246,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'260","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.386452+0000","last_change":"2024-09-12T00:31:47.128649+0000","last_active":"2024-09-12T01:29:16.386452+0000","last_peered":"2024-09-12T01:29:16.386452+0000","last_clean":"2024-09-12T01:29:16.386452+0000","last_became_active":"2024-09-12T00:31:47.127400+0000","last_became_peered":"2024-09-12T00:31:47.127400+0000","last_unstale":"2024-09-12T01:29:16.386452+0000","last_undegraded":"2024-09-12T01:29:16.386452+0000","last_fullsized":"2024-09-12T01:29:16.386452+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:24.774467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133724,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":320,"num_read_kb":20510,"num_write":796,"num_write_kb":47522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'404","reported_seq":1170,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.602445+0000","last_change":"2024-09-12T00:31:50.142651+0000","last_active":"2024-09-12T01:25:34.602445+0000","last_peered":"2024-09-12T01:25:34.602445+0000","last_clean":"2024-09-12T01:25:34.602445+0000","last_became_active":"2024-09-12T00:31:50.142337+0000","last_became_peered":"2024-09-12T00:31:50.142337+0000","last_unstale":"2024-09-12T01:25:34.602445+0000","last_undegraded":"2024-09-12T01:25:34.602445+0000","last_fullsized":"2024-09-12T01:25:34.602445+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:48.221186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1845,"num_write":683,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'316","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.444586+0000","last_change":"2024-09-12T00:31:47.139796+0000","last_active":"2024-09-12T01:29:16.444586+0000","last_peered":"2024-09-12T01:29:16.444586+0000","last_clean":"2024-09-12T01:29:16.444586+0000","last_became_active":"2024-09-12T00:31:47.139517+0000","last_became_peered":"2024-09-12T00:31:47.139517+0000","last_unstale":"2024-09-12T01:29:16.444586+0000","last_undegraded":"2024-09-12T01:29:16.444586+0000","last_fullsized":"2024-09-12T01:29:16.444586+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:34.384825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788540,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":6586,"num_write":1090,"num_write_kb":25928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'147","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:00.628254+0000","last_change":"2024-09-12T00:31:50.142590+0000","last_active":"2024-09-12T01:25:00.628254+0000","last_peered":"2024-09-12T01:25:00.628254+0000","last_clean":"2024-09-12T01:25:00.628254+0000","last_became_active":"2024-09-12T00:31:50.142311+0000","last_became_peered":"2024-09-12T00:31:50.142311+0000","last_unstale":"2024-09-12T01:25:00.628254+0000","last_undegraded":"2024-09-12T01:25:00.628254+0000","last_fullsized":"2024-09-12T01:25:00.628254+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:15.132325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":237,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'262","reported_seq":882,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.464275+0000","last_change":"2024-09-12T00:31:47.130745+0000","last_active":"2024-09-12T01:29:16.464275+0000","last_peered":"2024-09-12T01:29:16.464275+0000","last_clean":"2024-09-12T01:29:16.464275+0000","last_became_active":"2024-09-12T00:31:47.130329+0000","last_became_peered":"2024-09-12T00:31:47.130329+0000","last_unstale":"2024-09-12T01:29:16.464275+0000","last_undegraded":"2024-09-12T01:29:16.464275+0000","last_fullsized":"2024-09-12T01:29:16.464275+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:26.579124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287558,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":37644,"num_write":765,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'112","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:33.595038+0000","last_change":"2024-09-12T00:31:50.136264+0000","last_active":"2024-09-12T01:26:33.595038+0000","last_peered":"2024-09-12T01:26:33.595038+0000","last_clean":"2024-09-12T01:26:33.595038+0000","last_became_active":"2024-09-12T00:31:50.135595+0000","last_became_peered":"2024-09-12T00:31:50.135595+0000","last_unstale":"2024-09-12T01:26:33.595038+0000","last_undegraded":"2024-09-12T01:26:33.595038+0000","last_fullsized":"2024-09-12T01:26:33.595038+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:16.754941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":410,"num_write":180,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'318","reported_seq":1043,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.451314+0000","last_change":"2024-09-12T00:31:47.133955+0000","last_active":"2024-09-12T01:29:16.451314+0000","last_peered":"2024-09-12T01:29:16.451314+0000","last_clean":"2024-09-12T01:29:16.451314+0000","last_became_active":"2024-09-12T00:31:47.133592+0000","last_became_peered":"2024-09-12T00:31:47.133592+0000","last_unstale":"2024-09-12T01:29:16.451314+0000","last_undegraded":"2024-09-12T01:29:16.451314+0000","last_fullsized":"2024-09-12T01:29:16.451314+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:40.772744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396882,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":783,"num_read_kb":29951,"num_write":1081,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'73","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.598762+0000","last_change":"2024-09-12T00:31:50.136540+0000","last_active":"2024-09-12T01:24:59.598762+0000","last_peered":"2024-09-12T01:24:59.598762+0000","last_clean":"2024-09-12T01:24:59.598762+0000","last_became_active":"2024-09-12T00:31:50.135972+0000","last_became_peered":"2024-09-12T00:31:50.135972+0000","last_unstale":"2024-09-12T01:24:59.598762+0000","last_undegraded":"2024-09-12T01:24:59.598762+0000","last_fullsized":"2024-09-12T01:24:59.598762+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:26.791352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":249,"num_write":116,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'312","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.423588+0000","last_change":"2024-09-12T00:31:47.118600+0000","last_active":"2024-09-12T01:29:16.423588+0000","last_peered":"2024-09-12T01:29:16.423588+0000","last_clean":"2024-09-12T01:29:16.423588+0000","last_became_active":"2024-09-12T00:31:47.118260+0000","last_became_peered":"2024-09-12T00:31:47.118260+0000","last_unstale":"2024-09-12T01:29:16.423588+0000","last_undegraded":"2024-09-12T01:29:16.423588+0000","last_fullsized":"2024-09-12T01:29:16.423588+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:15.699024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":15045,"num_write":981,"num_write_kb":26498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'123","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.422976+0000","last_change":"2024-09-12T00:31:58.184465+0000","last_active":"2024-09-12T01:27:48.422976+0000","last_peered":"2024-09-12T01:27:48.422976+0000","last_clean":"2024-09-12T01:27:48.422976+0000","last_became_active":"2024-09-12T00:31:58.183784+0000","last_became_peered":"2024-09-12T00:31:58.183784+0000","last_unstale":"2024-09-12T01:27:48.422976+0000","last_undegraded":"2024-09-12T01:27:48.422976+0000","last_fullsized":"2024-09-12T01:27:48.422976+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:03.783137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":134,"num_write":297,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'229","reported_seq":832,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:53.682612+0000","last_change":"2024-09-12T00:31:50.140765+0000","last_active":"2024-09-12T01:25:53.682612+0000","last_peered":"2024-09-12T01:25:53.682612+0000","last_clean":"2024-09-12T01:25:53.682612+0000","last_became_active":"2024-09-12T00:31:50.140510+0000","last_became_peered":"2024-09-12T00:31:50.140510+0000","last_unstale":"2024-09-12T01:25:53.682612+0000","last_undegraded":"2024-09-12T01:25:53.682612+0000","last_fullsized":"2024-09-12T01:25:53.682612+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:35.280733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":944,"num_read_kb":762,"num_write":358,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'334","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.408593+0000","last_change":"2024-09-12T00:31:47.132262+0000","last_active":"2024-09-12T01:29:16.408593+0000","last_peered":"2024-09-12T01:29:16.408593+0000","last_clean":"2024-09-12T01:29:16.408593+0000","last_became_active":"2024-09-12T00:31:47.131940+0000","last_became_peered":"2024-09-12T00:31:47.131940+0000","last_unstale":"2024-09-12T01:29:16.408593+0000","last_undegraded":"2024-09-12T01:29:16.408593+0000","last_fullsized":"2024-09-12T01:29:16.408593+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:02.642276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":467,"num_read_kb":415,"num_write":1065,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714895+0000","last_change":"2024-09-12T00:31:52.153386+0000","last_active":"2024-09-12T01:25:04.714895+0000","last_peered":"2024-09-12T01:25:04.714895+0000","last_clean":"2024-09-12T01:25:04.714895+0000","last_became_active":"2024-09-12T00:31:52.151351+0000","last_became_peered":"2024-09-12T00:31:52.151351+0000","last_unstale":"2024-09-12T01:25:04.714895+0000","last_undegraded":"2024-09-12T01:25:04.714895+0000","last_fullsized":"2024-09-12T01:25:04.714895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.711260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'341","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.296259+0000","last_change":"2024-09-12T00:31:54.168796+0000","last_active":"2024-09-12T01:29:16.296259+0000","last_peered":"2024-09-12T01:29:16.296259+0000","last_clean":"2024-09-12T01:29:16.296259+0000","last_became_active":"2024-09-12T00:31:54.168545+0000","last_became_peered":"2024-09-12T00:31:54.168545+0000","last_unstale":"2024-09-12T01:29:16.296259+0000","last_undegraded":"2024-09-12T01:29:16.296259+0000","last_fullsized":"2024-09-12T01:29:16.296259+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:43.289137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45599,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":546,"num_read_kb":1097,"num_write":426,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:09.599902+0000","last_change":"2024-09-12T00:31:56.171140+0000","last_active":"2024-09-12T01:25:09.599902+0000","last_peered":"2024-09-12T01:25:09.599902+0000","last_clean":"2024-09-12T01:25:09.599902+0000","last_became_active":"2024-09-12T00:31:56.170837+0000","last_became_peered":"2024-09-12T00:31:56.170837+0000","last_unstale":"2024-09-12T01:25:09.599902+0000","last_undegraded":"2024-09-12T01:25:09.599902+0000","last_fullsized":"2024-09-12T01:25:09.599902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:56.785552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2464","reported_seq":4352,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.990962+0000","last_change":"2024-09-12T00:31:58.182713+0000","last_active":"2024-09-12T01:27:47.990962+0000","last_peered":"2024-09-12T01:27:47.990962+0000","last_clean":"2024-09-12T01:27:47.990962+0000","last_became_active":"2024-09-12T00:31:58.181552+0000","last_became_peered":"2024-09-12T00:31:58.181552+0000","last_unstale":"2024-09-12T01:27:47.990962+0000","last_undegraded":"2024-09-12T01:27:47.990962+0000","last_fullsized":"2024-09-12T01:27:47.990962+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":2400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:59.050279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":617,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6112,"num_read_kb":6115,"num_write":4931,"num_write_kb":1807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'4138","reported_seq":4750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:22.543653+0000","last_change":"2024-09-12T00:31:50.133655+0000","last_active":"2024-09-12T01:25:22.543653+0000","last_peered":"2024-09-12T01:25:22.543653+0000","last_clean":"2024-09-12T01:25:22.543653+0000","last_became_active":"2024-09-12T00:31:50.133357+0000","last_became_peered":"2024-09-12T00:31:50.133357+0000","last_unstale":"2024-09-12T01:25:22.543653+0000","last_undegraded":"2024-09-12T01:25:22.543653+0000","last_fullsized":"2024-09-12T01:25:22.543653+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":3000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:23.138805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16657,"num_read_kb":13895,"num_write":6209,"num_write_kb":3095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'296","reported_seq":903,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.314669+0000","last_change":"2024-09-12T00:31:47.132203+0000","last_active":"2024-09-12T01:29:16.314669+0000","last_peered":"2024-09-12T01:29:16.314669+0000","last_clean":"2024-09-12T01:29:16.314669+0000","last_became_active":"2024-09-12T00:31:47.131849+0000","last_became_peered":"2024-09-12T00:31:47.131849+0000","last_unstale":"2024-09-12T01:29:16.314669+0000","last_undegraded":"2024-09-12T01:29:16.314669+0000","last_fullsized":"2024-09-12T01:29:16.314669+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:09.334142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":405,"num_read_kb":4533,"num_write":946,"num_write_kb":25027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:48.498477+0000","last_change":"2024-09-12T00:31:52.153157+0000","last_active":"2024-09-12T01:25:48.498477+0000","last_peered":"2024-09-12T01:25:48.498477+0000","last_clean":"2024-09-12T01:25:48.498477+0000","last_became_active":"2024-09-12T00:31:52.152244+0000","last_became_peered":"2024-09-12T00:31:52.152244+0000","last_unstale":"2024-09-12T01:25:48.498477+0000","last_undegraded":"2024-09-12T01:25:48.498477+0000","last_fullsized":"2024-09-12T01:25:48.498477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:13.492533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'94","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.599360+0000","last_change":"2024-09-12T00:31:54.167561+0000","last_active":"2024-09-12T01:25:04.599360+0000","last_peered":"2024-09-12T01:25:04.599360+0000","last_clean":"2024-09-12T01:25:04.599360+0000","last_became_active":"2024-09-12T00:31:54.167260+0000","last_became_peered":"2024-09-12T00:31:54.167260+0000","last_unstale":"2024-09-12T01:25:04.599360+0000","last_undegraded":"2024-09-12T01:25:04.599360+0000","last_fullsized":"2024-09-12T01:25:04.599360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:28.995792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":103,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:09.599867+0000","last_change":"2024-09-12T00:31:56.174756+0000","last_active":"2024-09-12T01:25:09.599867+0000","last_peered":"2024-09-12T01:25:09.599867+0000","last_clean":"2024-09-12T01:25:09.599867+0000","last_became_active":"2024-09-12T00:31:56.174452+0000","last_became_peered":"2024-09-12T00:31:56.174452+0000","last_unstale":"2024-09-12T01:25:09.599867+0000","last_undegraded":"2024-09-12T01:25:09.599867+0000","last_fullsized":"2024-09-12T01:25:09.599867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:05.497151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'144","reported_seq":638,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646008+0000","last_change":"2024-09-12T00:31:58.179079+0000","last_active":"2024-09-12T01:27:00.646008+0000","last_peered":"2024-09-12T01:27:00.646008+0000","last_clean":"2024-09-12T01:27:00.646008+0000","last_became_active":"2024-09-12T00:31:58.178748+0000","last_became_peered":"2024-09-12T00:31:58.178748+0000","last_unstale":"2024-09-12T01:27:00.646008+0000","last_undegraded":"2024-09-12T01:27:00.646008+0000","last_fullsized":"2024-09-12T01:27:00.646008+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:32.414870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":137,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'401","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:02.489318+0000","last_change":"2024-09-12T00:31:50.143909+0000","last_active":"2024-09-12T01:25:02.489318+0000","last_peered":"2024-09-12T01:25:02.489318+0000","last_clean":"2024-09-12T01:25:02.489318+0000","last_became_active":"2024-09-12T00:31:50.143399+0000","last_became_peered":"2024-09-12T00:31:50.143399+0000","last_unstale":"2024-09-12T01:25:02.489318+0000","last_undegraded":"2024-09-12T01:25:02.489318+0000","last_fullsized":"2024-09-12T01:25:02.489318+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:22.288197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1799,"num_read_kb":1492,"num_write":673,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'331","reported_seq":1111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.376381+0000","last_change":"2024-09-12T00:32:23.831526+0000","last_active":"2024-09-12T01:29:16.376381+0000","last_peered":"2024-09-12T01:29:16.376381+0000","last_clean":"2024-09-12T01:29:16.376381+0000","last_became_active":"2024-09-12T00:32:23.830863+0000","last_became_peered":"2024-09-12T00:32:23.830863+0000","last_unstale":"2024-09-12T01:29:16.376381+0000","last_undegraded":"2024-09-12T01:29:16.376381+0000","last_fullsized":"2024-09-12T01:29:16.376381+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:36.335809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569327,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":866,"num_read_kb":9184,"num_write":1035,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:03.492033+0000","last_change":"2024-09-12T00:31:52.154402+0000","last_active":"2024-09-12T01:25:03.492033+0000","last_peered":"2024-09-12T01:25:03.492033+0000","last_clean":"2024-09-12T01:25:03.492033+0000","last_became_active":"2024-09-12T00:31:52.154077+0000","last_became_peered":"2024-09-12T00:31:52.154077+0000","last_unstale":"2024-09-12T01:25:03.492033+0000","last_undegraded":"2024-09-12T01:25:03.492033+0000","last_fullsized":"2024-09-12T01:25:03.492033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:27.520584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'119","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:48.498488+0000","last_change":"2024-09-12T00:31:54.164132+0000","last_active":"2024-09-12T01:25:48.498488+0000","last_peered":"2024-09-12T01:25:48.498488+0000","last_clean":"2024-09-12T01:25:48.498488+0000","last_became_active":"2024-09-12T00:31:54.163434+0000","last_became_peered":"2024-09-12T00:31:54.163434+0000","last_unstale":"2024-09-12T01:25:48.498488+0000","last_undegraded":"2024-09-12T01:25:48.498488+0000","last_fullsized":"2024-09-12T01:25:48.498488+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:14.391704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":152,"num_read_kb":145,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'782","reported_seq":4220,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.749785+0000","last_change":"2024-09-12T00:31:56.171437+0000","last_active":"2024-09-12T01:29:14.749785+0000","last_peered":"2024-09-12T01:29:14.749785+0000","last_clean":"2024-09-12T01:29:14.749785+0000","last_became_active":"2024-09-12T00:31:56.171157+0000","last_became_peered":"2024-09-12T00:31:56.171157+0000","last_unstale":"2024-09-12T01:29:14.749785+0000","last_undegraded":"2024-09-12T01:29:14.749785+0000","last_fullsized":"2024-09-12T01:29:14.749785+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:03.870161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'201","reported_seq":1030,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.663408+0000","last_change":"2024-09-12T00:31:58.179919+0000","last_active":"2024-09-12T01:27:47.663408+0000","last_peered":"2024-09-12T01:27:47.663408+0000","last_clean":"2024-09-12T01:27:47.663408+0000","last_became_active":"2024-09-12T00:31:58.179576+0000","last_became_peered":"2024-09-12T00:31:58.179576+0000","last_unstale":"2024-09-12T01:27:47.663408+0000","last_undegraded":"2024-09-12T01:27:47.663408+0000","last_fullsized":"2024-09-12T01:27:47.663408+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:00.446809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":631,"num_write":454,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'417","reported_seq":1156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:25.005608+0000","last_change":"2024-09-12T00:31:50.140975+0000","last_active":"2024-09-12T01:27:25.005608+0000","last_peered":"2024-09-12T01:27:25.005608+0000","last_clean":"2024-09-12T01:27:25.005608+0000","last_became_active":"2024-09-12T00:31:50.140485+0000","last_became_peered":"2024-09-12T00:31:50.140485+0000","last_unstale":"2024-09-12T01:27:25.005608+0000","last_undegraded":"2024-09-12T01:27:25.005608+0000","last_fullsized":"2024-09-12T01:27:25.005608+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:37.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2003,"num_read_kb":1658,"num_write":744,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'321","reported_seq":1003,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.415942+0000","last_change":"2024-09-12T00:31:47.125806+0000","last_active":"2024-09-12T01:29:16.415942+0000","last_peered":"2024-09-12T01:29:16.415942+0000","last_clean":"2024-09-12T01:29:16.415942+0000","last_became_active":"2024-09-12T00:31:47.125118+0000","last_became_peered":"2024-09-12T00:31:47.125118+0000","last_unstale":"2024-09-12T01:29:16.415942+0000","last_undegraded":"2024-09-12T01:29:16.415942+0000","last_fullsized":"2024-09-12T01:29:16.415942+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:30.278130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209058,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":536,"num_read_kb":32880,"num_write":1078,"num_write_kb":23042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714949+0000","last_change":"2024-09-12T00:31:52.154490+0000","last_active":"2024-09-12T01:25:04.714949+0000","last_peered":"2024-09-12T01:25:04.714949+0000","last_clean":"2024-09-12T01:25:04.714949+0000","last_became_active":"2024-09-12T00:31:52.154189+0000","last_became_peered":"2024-09-12T00:31:52.154189+0000","last_unstale":"2024-09-12T01:25:04.714949+0000","last_undegraded":"2024-09-12T01:25:04.714949+0000","last_fullsized":"2024-09-12T01:25:04.714949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:46.021304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'276","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.011104+0000","last_change":"2024-09-12T00:31:54.171678+0000","last_active":"2024-09-12T01:29:16.011104+0000","last_peered":"2024-09-12T01:29:16.011104+0000","last_clean":"2024-09-12T01:29:16.011104+0000","last_became_active":"2024-09-12T00:31:54.171354+0000","last_became_peered":"2024-09-12T00:31:54.171354+0000","last_unstale":"2024-09-12T01:29:16.011104+0000","last_undegraded":"2024-09-12T01:29:16.011104+0000","last_fullsized":"2024-09-12T01:29:16.011104+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:44.212575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53613,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":1068,"num_write":372,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'784","reported_seq":2508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.926018+0000","last_change":"2024-09-12T00:31:56.176843+0000","last_active":"2024-09-12T01:29:15.926018+0000","last_peered":"2024-09-12T01:29:15.926018+0000","last_clean":"2024-09-12T01:29:15.926018+0000","last_became_active":"2024-09-12T00:31:56.176464+0000","last_became_peered":"2024-09-12T00:31:56.176464+0000","last_unstale":"2024-09-12T01:29:15.926018+0000","last_undegraded":"2024-09-12T01:29:15.926018+0000","last_fullsized":"2024-09-12T01:29:15.926018+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:39.501516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'324","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.722779+0000","last_change":"2024-09-12T00:31:50.138593+0000","last_active":"2024-09-12T01:25:59.722779+0000","last_peered":"2024-09-12T01:25:59.722779+0000","last_clean":"2024-09-12T01:25:59.722779+0000","last_became_active":"2024-09-12T00:31:50.138335+0000","last_became_peered":"2024-09-12T00:31:50.138335+0000","last_unstale":"2024-09-12T01:25:59.722779+0000","last_undegraded":"2024-09-12T01:25:59.722779+0000","last_fullsized":"2024-09-12T01:25:59.722779+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:16:08.736816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1108,"num_write":487,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'344","reported_seq":991,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.359689+0000","last_change":"2024-09-12T00:31:47.138476+0000","last_active":"2024-09-12T01:29:16.359689+0000","last_peered":"2024-09-12T01:29:16.359689+0000","last_clean":"2024-09-12T01:29:16.359689+0000","last_became_active":"2024-09-12T00:31:47.137951+0000","last_became_peered":"2024-09-12T00:31:47.137951+0000","last_unstale":"2024-09-12T01:29:16.359689+0000","last_undegraded":"2024-09-12T01:29:16.359689+0000","last_fullsized":"2024-09-12T01:29:16.359689+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:13.403628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205367,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":21468,"num_write":1112,"num_write_kb":35236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605639+0000","last_change":"2024-09-12T00:31:52.155328+0000","last_active":"2024-09-12T01:26:04.605639+0000","last_peered":"2024-09-12T01:26:04.605639+0000","last_clean":"2024-09-12T01:26:04.605639+0000","last_became_active":"2024-09-12T00:31:52.155047+0000","last_became_peered":"2024-09-12T00:31:52.155047+0000","last_unstale":"2024-09-12T01:26:04.605639+0000","last_undegraded":"2024-09-12T01:26:04.605639+0000","last_fullsized":"2024-09-12T01:26:04.605639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:16.230836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'367","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.597835+0000","last_change":"2024-09-12T00:31:54.173591+0000","last_active":"2024-09-12T01:29:14.597835+0000","last_peered":"2024-09-12T01:29:14.597835+0000","last_clean":"2024-09-12T01:29:14.597835+0000","last_became_active":"2024-09-12T00:31:54.173363+0000","last_became_peered":"2024-09-12T00:31:54.173363+0000","last_unstale":"2024-09-12T01:29:14.597835+0000","last_undegraded":"2024-09-12T01:29:14.597835+0000","last_fullsized":"2024-09-12T01:29:14.597835+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:50.016365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48858,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":1144,"num_write":454,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.636308+0000","last_change":"2024-09-12T00:31:56.173079+0000","last_active":"2024-09-12T01:25:55.636308+0000","last_peered":"2024-09-12T01:25:55.636308+0000","last_clean":"2024-09-12T01:25:55.636308+0000","last_became_active":"2024-09-12T00:31:56.172791+0000","last_became_peered":"2024-09-12T00:31:56.172791+0000","last_unstale":"2024-09-12T01:25:55.636308+0000","last_undegraded":"2024-09-12T01:25:55.636308+0000","last_fullsized":"2024-09-12T01:25:55.636308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:18.460860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'542","reported_seq":1367,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.343041+0000","last_change":"2024-09-12T00:31:58.178597+0000","last_active":"2024-09-12T01:28:55.343041+0000","last_peered":"2024-09-12T01:28:55.343041+0000","last_clean":"2024-09-12T01:28:55.343041+0000","last_became_active":"2024-09-12T00:31:58.177828+0000","last_became_peered":"2024-09-12T00:31:58.177828+0000","last_unstale":"2024-09-12T01:28:55.343041+0000","last_undegraded":"2024-09-12T01:28:55.343041+0000","last_fullsized":"2024-09-12T01:28:55.343041+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:23.485365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1309,"num_read_kb":1288,"num_write":1113,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'199","reported_seq":826,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.412983+0000","last_change":"2024-09-12T00:31:50.138558+0000","last_active":"2024-09-12T01:27:00.412983+0000","last_peered":"2024-09-12T01:27:00.412983+0000","last_clean":"2024-09-12T01:27:00.412983+0000","last_became_active":"2024-09-12T00:31:50.138261+0000","last_became_peered":"2024-09-12T00:31:50.138261+0000","last_unstale":"2024-09-12T01:27:00.412983+0000","last_undegraded":"2024-09-12T01:27:00.412983+0000","last_fullsized":"2024-09-12T01:27:00.412983+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:25.679935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":866,"num_read_kb":707,"num_write":323,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'375","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.443116+0000","last_change":"2024-09-12T00:31:47.137585+0000","last_active":"2024-09-12T01:29:16.443116+0000","last_peered":"2024-09-12T01:29:16.443116+0000","last_clean":"2024-09-12T01:29:16.443116+0000","last_became_active":"2024-09-12T00:31:47.137234+0000","last_became_peered":"2024-09-12T00:31:47.137234+0000","last_unstale":"2024-09-12T01:29:16.443116+0000","last_undegraded":"2024-09-12T01:29:16.443116+0000","last_fullsized":"2024-09-12T01:29:16.443116+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:35.306270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267358,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":707,"num_read_kb":90782,"num_write":1268,"num_write_kb":21068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.637884+0000","last_change":"2024-09-12T00:31:52.148985+0000","last_active":"2024-09-12T01:26:05.637884+0000","last_peered":"2024-09-12T01:26:05.637884+0000","last_clean":"2024-09-12T01:26:05.637884+0000","last_became_active":"2024-09-12T00:31:52.148738+0000","last_became_peered":"2024-09-12T00:31:52.148738+0000","last_unstale":"2024-09-12T01:26:05.637884+0000","last_undegraded":"2024-09-12T01:26:05.637884+0000","last_fullsized":"2024-09-12T01:26:05.637884+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:20.806375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'285","reported_seq":870,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.400997+0000","last_change":"2024-09-12T00:31:54.168598+0000","last_active":"2024-09-12T01:29:15.400997+0000","last_peered":"2024-09-12T01:29:15.400997+0000","last_clean":"2024-09-12T01:29:15.400997+0000","last_became_active":"2024-09-12T00:31:54.168247+0000","last_became_peered":"2024-09-12T00:31:54.168247+0000","last_unstale":"2024-09-12T01:29:15.400997+0000","last_undegraded":"2024-09-12T01:29:15.400997+0000","last_fullsized":"2024-09-12T01:29:15.400997+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:53.709459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":1085,"num_write":382,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:23.503173+0000","last_change":"2024-09-12T00:31:56.173852+0000","last_active":"2024-09-12T01:26:23.503173+0000","last_peered":"2024-09-12T01:26:23.503173+0000","last_clean":"2024-09-12T01:26:23.503173+0000","last_became_active":"2024-09-12T00:31:56.173549+0000","last_became_peered":"2024-09-12T00:31:56.173549+0000","last_unstale":"2024-09-12T01:26:23.503173+0000","last_undegraded":"2024-09-12T01:26:23.503173+0000","last_fullsized":"2024-09-12T01:26:23.503173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:31.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'131","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:24.521745+0000","last_change":"2024-09-12T00:31:58.175490+0000","last_active":"2024-09-12T01:28:24.521745+0000","last_peered":"2024-09-12T01:28:24.521745+0000","last_clean":"2024-09-12T01:28:24.521745+0000","last_became_active":"2024-09-12T00:31:58.175195+0000","last_became_peered":"2024-09-12T00:31:58.175195+0000","last_unstale":"2024-09-12T01:28:24.521745+0000","last_undegraded":"2024-09-12T01:28:24.521745+0000","last_fullsized":"2024-09-12T01:28:24.521745+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:18.942923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":426,"num_read_kb":345,"num_write":330,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'360","reported_seq":951,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505956+0000","last_change":"2024-09-12T00:31:50.143092+0000","last_active":"2024-09-12T01:26:14.505956+0000","last_peered":"2024-09-12T01:26:14.505956+0000","last_clean":"2024-09-12T01:26:14.505956+0000","last_became_active":"2024-09-12T00:31:50.142818+0000","last_became_peered":"2024-09-12T00:31:50.142818+0000","last_unstale":"2024-09-12T01:26:14.505956+0000","last_undegraded":"2024-09-12T01:26:14.505956+0000","last_fullsized":"2024-09-12T01:26:14.505956+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:29.886696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1555,"num_read_kb":1227,"num_write":605,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'335","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.451457+0000","last_change":"2024-09-12T00:31:47.113555+0000","last_active":"2024-09-12T01:29:16.451457+0000","last_peered":"2024-09-12T01:29:16.451457+0000","last_clean":"2024-09-12T01:29:16.451457+0000","last_became_active":"2024-09-12T00:31:47.112306+0000","last_became_peered":"2024-09-12T00:31:47.112306+0000","last_unstale":"2024-09-12T01:29:16.451457+0000","last_undegraded":"2024-09-12T01:29:16.451457+0000","last_fullsized":"2024-09-12T01:29:16.451457+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:25.942485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":55420,"num_write":1061,"num_write_kb":24613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:52.497023+0000","last_change":"2024-09-12T00:31:52.154154+0000","last_active":"2024-09-12T01:25:52.497023+0000","last_peered":"2024-09-12T01:25:52.497023+0000","last_clean":"2024-09-12T01:25:52.497023+0000","last_became_active":"2024-09-12T00:31:52.153862+0000","last_became_peered":"2024-09-12T00:31:52.153862+0000","last_unstale":"2024-09-12T01:25:52.497023+0000","last_undegraded":"2024-09-12T01:25:52.497023+0000","last_fullsized":"2024-09-12T01:25:52.497023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:25.663441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'358","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.726954+0000","last_change":"2024-09-12T00:31:54.162856+0000","last_active":"2024-09-12T01:29:14.726954+0000","last_peered":"2024-09-12T01:29:14.726954+0000","last_clean":"2024-09-12T01:29:14.726954+0000","last_became_active":"2024-09-12T00:31:54.162228+0000","last_became_peered":"2024-09-12T00:31:54.162228+0000","last_unstale":"2024-09-12T01:29:14.726954+0000","last_undegraded":"2024-09-12T01:29:14.726954+0000","last_fullsized":"2024-09-12T01:29:14.726954+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:20.520023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50365,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":550,"num_read_kb":1150,"num_write":448,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'783","reported_seq":2599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.925784+0000","last_change":"2024-09-12T00:31:56.172797+0000","last_active":"2024-09-12T01:29:15.925784+0000","last_peered":"2024-09-12T01:29:15.925784+0000","last_clean":"2024-09-12T01:29:15.925784+0000","last_became_active":"2024-09-12T00:31:56.172503+0000","last_became_peered":"2024-09-12T00:31:56.172503+0000","last_unstale":"2024-09-12T01:29:15.925784+0000","last_undegraded":"2024-09-12T01:29:15.925784+0000","last_fullsized":"2024-09-12T01:29:15.925784+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:50.107192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'148","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.305098+0000","last_change":"2024-09-12T00:31:58.175440+0000","last_active":"2024-09-12T01:28:54.305098+0000","last_peered":"2024-09-12T01:28:54.305098+0000","last_clean":"2024-09-12T01:28:54.305098+0000","last_became_active":"2024-09-12T00:31:58.175027+0000","last_became_peered":"2024-09-12T00:31:58.175027+0000","last_unstale":"2024-09-12T01:28:54.305098+0000","last_undegraded":"2024-09-12T01:28:54.305098+0000","last_fullsized":"2024-09-12T01:28:54.305098+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:26.724138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":179,"num_read_kb":162,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'330","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:52.496996+0000","last_change":"2024-09-12T00:31:50.144275+0000","last_active":"2024-09-12T01:25:52.496996+0000","last_peered":"2024-09-12T01:25:52.496996+0000","last_clean":"2024-09-12T01:25:52.496996+0000","last_became_active":"2024-09-12T00:31:50.143814+0000","last_became_peered":"2024-09-12T00:31:50.143814+0000","last_unstale":"2024-09-12T01:25:52.496996+0000","last_undegraded":"2024-09-12T01:25:52.496996+0000","last_fullsized":"2024-09-12T01:25:52.496996+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:41.133905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1421,"num_read_kb":1140,"num_write":511,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'367","reported_seq":1047,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.395586+0000","last_change":"2024-09-12T00:31:47.139001+0000","last_active":"2024-09-12T01:29:16.395586+0000","last_peered":"2024-09-12T01:29:16.395586+0000","last_clean":"2024-09-12T01:29:16.395586+0000","last_became_active":"2024-09-12T00:31:47.138687+0000","last_became_peered":"2024-09-12T00:31:47.138687+0000","last_unstale":"2024-09-12T01:29:16.395586+0000","last_undegraded":"2024-09-12T01:29:16.395586+0000","last_fullsized":"2024-09-12T01:29:16.395586+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:39.040881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6638737,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":559,"num_read_kb":39444,"num_write":1190,"num_write_kb":53128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639608+0000","last_change":"2024-09-12T00:31:52.155135+0000","last_active":"2024-09-12T01:26:15.639608+0000","last_peered":"2024-09-12T01:26:15.639608+0000","last_clean":"2024-09-12T01:26:15.639608+0000","last_became_active":"2024-09-12T00:31:52.154863+0000","last_became_peered":"2024-09-12T00:31:52.154863+0000","last_unstale":"2024-09-12T01:26:15.639608+0000","last_undegraded":"2024-09-12T01:26:15.639608+0000","last_fullsized":"2024-09-12T01:26:15.639608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:40.280300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'512","reported_seq":1165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.577201+0000","last_change":"2024-09-12T00:31:54.169066+0000","last_active":"2024-09-12T01:29:15.577201+0000","last_peered":"2024-09-12T01:29:15.577201+0000","last_clean":"2024-09-12T01:29:15.577201+0000","last_became_active":"2024-09-12T00:31:54.168691+0000","last_became_peered":"2024-09-12T00:31:54.168691+0000","last_unstale":"2024-09-12T01:29:15.577201+0000","last_undegraded":"2024-09-12T01:29:15.577201+0000","last_fullsized":"2024-09-12T01:29:15.577201+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:06.873573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104127,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":909,"num_read_kb":2207,"num_write":754,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499328+0000","last_change":"2024-09-12T00:31:56.175805+0000","last_active":"2024-09-12T01:26:07.499328+0000","last_peered":"2024-09-12T01:26:07.499328+0000","last_clean":"2024-09-12T01:26:07.499328+0000","last_became_active":"2024-09-12T00:31:56.175412+0000","last_became_peered":"2024-09-12T00:31:56.175412+0000","last_unstale":"2024-09-12T01:26:07.499328+0000","last_undegraded":"2024-09-12T01:26:07.499328+0000","last_fullsized":"2024-09-12T01:26:07.499328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:32.829417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'133","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:10.783574+0000","last_change":"2024-09-12T00:31:58.178548+0000","last_active":"2024-09-12T01:26:10.783574+0000","last_peered":"2024-09-12T01:26:10.783574+0000","last_clean":"2024-09-12T01:26:10.783574+0000","last_became_active":"2024-09-12T00:31:58.178027+0000","last_became_peered":"2024-09-12T00:31:58.178027+0000","last_unstale":"2024-09-12T01:26:10.783574+0000","last_undegraded":"2024-09-12T01:26:10.783574+0000","last_fullsized":"2024-09-12T01:26:10.783574+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.407511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'162","reported_seq":791,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.500388+0000","last_change":"2024-09-12T00:31:50.127506+0000","last_active":"2024-09-12T01:25:49.500388+0000","last_peered":"2024-09-12T01:25:49.500388+0000","last_clean":"2024-09-12T01:25:49.500388+0000","last_became_active":"2024-09-12T00:31:50.127193+0000","last_became_peered":"2024-09-12T00:31:50.127193+0000","last_unstale":"2024-09-12T01:25:49.500388+0000","last_undegraded":"2024-09-12T01:25:49.500388+0000","last_fullsized":"2024-09-12T01:25:49.500388+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:52.691594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":547,"num_write":243,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'332","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.455772+0000","last_change":"2024-09-12T00:31:47.130530+0000","last_active":"2024-09-12T01:29:16.455772+0000","last_peered":"2024-09-12T01:29:16.455772+0000","last_clean":"2024-09-12T01:29:16.455772+0000","last_became_active":"2024-09-12T00:31:47.130136+0000","last_became_peered":"2024-09-12T00:31:47.130136+0000","last_unstale":"2024-09-12T01:29:16.455772+0000","last_undegraded":"2024-09-12T01:29:16.455772+0000","last_fullsized":"2024-09-12T01:29:16.455772+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:35.574448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":72156,"num_write":1150,"num_write_kb":60123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.781057+0000","last_change":"2024-09-12T00:31:52.155387+0000","last_active":"2024-09-12T01:25:55.781057+0000","last_peered":"2024-09-12T01:25:55.781057+0000","last_clean":"2024-09-12T01:25:55.781057+0000","last_became_active":"2024-09-12T00:31:52.155083+0000","last_became_peered":"2024-09-12T00:31:52.155083+0000","last_unstale":"2024-09-12T01:25:55.781057+0000","last_undegraded":"2024-09-12T01:25:55.781057+0000","last_fullsized":"2024-09-12T01:25:55.781057+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:51.358822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'323","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.639913+0000","last_change":"2024-09-12T00:31:54.165545+0000","last_active":"2024-09-12T01:29:15.639913+0000","last_peered":"2024-09-12T01:29:15.639913+0000","last_clean":"2024-09-12T01:29:15.639913+0000","last_became_active":"2024-09-12T00:31:54.165221+0000","last_became_peered":"2024-09-12T00:31:54.165221+0000","last_unstale":"2024-09-12T01:29:15.639913+0000","last_undegraded":"2024-09-12T01:29:15.639913+0000","last_fullsized":"2024-09-12T01:29:15.639913+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:34.590028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53280,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":539,"num_read_kb":1166,"num_write":484,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782685+0000","last_change":"2024-09-12T00:31:56.173067+0000","last_active":"2024-09-12T01:26:05.782685+0000","last_peered":"2024-09-12T01:26:05.782685+0000","last_clean":"2024-09-12T01:26:05.782685+0000","last_became_active":"2024-09-12T00:31:56.172777+0000","last_became_peered":"2024-09-12T00:31:56.172777+0000","last_unstale":"2024-09-12T01:26:05.782685+0000","last_undegraded":"2024-09-12T01:26:05.782685+0000","last_fullsized":"2024-09-12T01:26:05.782685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:49.874762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'114","reported_seq":604,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:12.518829+0000","last_change":"2024-09-12T00:31:58.179957+0000","last_active":"2024-09-12T01:28:12.518829+0000","last_peered":"2024-09-12T01:28:12.518829+0000","last_clean":"2024-09-12T01:28:12.518829+0000","last_became_active":"2024-09-12T00:31:58.179667+0000","last_became_peered":"2024-09-12T00:31:58.179667+0000","last_unstale":"2024-09-12T01:28:12.518829+0000","last_undegraded":"2024-09-12T01:28:12.518829+0000","last_fullsized":"2024-09-12T01:28:12.518829+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:04.950082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":909,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":84,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'226","reported_seq":805,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721754+0000","last_change":"2024-09-12T00:31:50.131405+0000","last_active":"2024-09-12T01:25:49.721754+0000","last_peered":"2024-09-12T01:25:49.721754+0000","last_clean":"2024-09-12T01:25:49.721754+0000","last_became_active":"2024-09-12T00:31:50.130807+0000","last_became_peered":"2024-09-12T00:31:50.130807+0000","last_unstale":"2024-09-12T01:25:49.721754+0000","last_undegraded":"2024-09-12T01:25:49.721754+0000","last_fullsized":"2024-09-12T01:25:49.721754+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:43.848144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":940,"num_read_kb":756,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'403","reported_seq":1076,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.459777+0000","last_change":"2024-09-12T00:31:47.113900+0000","last_active":"2024-09-12T01:29:16.459777+0000","last_peered":"2024-09-12T01:29:16.459777+0000","last_clean":"2024-09-12T01:29:16.459777+0000","last_became_active":"2024-09-12T00:31:47.113265+0000","last_became_peered":"2024-09-12T00:31:47.113265+0000","last_unstale":"2024-09-12T01:29:16.459777+0000","last_undegraded":"2024-09-12T01:29:16.459777+0000","last_fullsized":"2024-09-12T01:29:16.459777+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:24.211193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174791,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":600,"num_read_kb":11693,"num_write":1259,"num_write_kb":25282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:52.497051+0000","last_change":"2024-09-12T00:31:52.156164+0000","last_active":"2024-09-12T01:25:52.497051+0000","last_peered":"2024-09-12T01:25:52.497051+0000","last_clean":"2024-09-12T01:25:52.497051+0000","last_became_active":"2024-09-12T00:31:52.155877+0000","last_became_peered":"2024-09-12T00:31:52.155877+0000","last_unstale":"2024-09-12T01:25:52.497051+0000","last_undegraded":"2024-09-12T01:25:52.497051+0000","last_fullsized":"2024-09-12T01:25:52.497051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:38.312330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'310","reported_seq":901,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.216572+0000","last_change":"2024-09-12T00:31:54.165410+0000","last_active":"2024-09-12T01:29:15.216572+0000","last_peered":"2024-09-12T01:29:15.216572+0000","last_clean":"2024-09-12T01:29:15.216572+0000","last_became_active":"2024-09-12T00:31:54.165107+0000","last_became_peered":"2024-09-12T00:31:54.165107+0000","last_unstale":"2024-09-12T01:29:15.216572+0000","last_undegraded":"2024-09-12T01:29:15.216572+0000","last_fullsized":"2024-09-12T01:29:15.216572+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:41.442937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47816,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":1119,"num_write":414,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'743","reported_seq":2476,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.296276+0000","last_change":"2024-09-12T00:31:56.170713+0000","last_active":"2024-09-12T01:29:14.296276+0000","last_peered":"2024-09-12T01:29:14.296276+0000","last_clean":"2024-09-12T01:29:14.296276+0000","last_became_active":"2024-09-12T00:31:56.170388+0000","last_became_peered":"2024-09-12T00:31:56.170388+0000","last_unstale":"2024-09-12T01:29:14.296276+0000","last_undegraded":"2024-09-12T01:29:14.296276+0000","last_fullsized":"2024-09-12T01:29:14.296276+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:46.492927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'162","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:46.479085+0000","last_change":"2024-09-12T00:31:58.172116+0000","last_active":"2024-09-12T01:27:46.479085+0000","last_peered":"2024-09-12T01:27:46.479085+0000","last_clean":"2024-09-12T01:27:46.479085+0000","last_became_active":"2024-09-12T00:31:58.171814+0000","last_became_peered":"2024-09-12T00:31:58.171814+0000","last_unstale":"2024-09-12T01:27:46.479085+0000","last_undegraded":"2024-09-12T01:27:46.479085+0000","last_fullsized":"2024-09-12T01:27:46.479085+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:12.214205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":379,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'117","reported_seq":721,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.318699+0000","last_change":"2024-09-12T00:31:50.142691+0000","last_active":"2024-09-12T01:27:48.318699+0000","last_peered":"2024-09-12T01:27:48.318699+0000","last_clean":"2024-09-12T01:27:48.318699+0000","last_became_active":"2024-09-12T00:31:50.142370+0000","last_became_peered":"2024-09-12T00:31:50.142370+0000","last_unstale":"2024-09-12T01:27:48.318699+0000","last_undegraded":"2024-09-12T01:27:48.318699+0000","last_fullsized":"2024-09-12T01:27:48.318699+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:28.025270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":572,"num_read_kb":482,"num_write":177,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'312","reported_seq":931,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.458782+0000","last_change":"2024-09-12T00:31:47.122868+0000","last_active":"2024-09-12T01:29:16.458782+0000","last_peered":"2024-09-12T01:29:16.458782+0000","last_clean":"2024-09-12T01:29:16.458782+0000","last_became_active":"2024-09-12T00:31:47.122110+0000","last_became_peered":"2024-09-12T00:31:47.122110+0000","last_unstale":"2024-09-12T01:29:16.458782+0000","last_undegraded":"2024-09-12T01:29:16.458782+0000","last_fullsized":"2024-09-12T01:29:16.458782+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:22.824588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":405,"num_read_kb":34909,"num_write":924,"num_write_kb":39966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1454,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.074988+0000","last_change":"2024-09-12T00:31:52.155143+0000","last_active":"2024-09-12T01:29:14.074988+0000","last_peered":"2024-09-12T01:29:14.074988+0000","last_clean":"2024-09-12T01:29:14.074988+0000","last_became_active":"2024-09-12T00:31:52.154858+0000","last_became_peered":"2024-09-12T00:31:52.154858+0000","last_unstale":"2024-09-12T01:29:14.074988+0000","last_undegraded":"2024-09-12T01:29:14.074988+0000","last_fullsized":"2024-09-12T01:29:14.074988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:28.556319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'84","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.636359+0000","last_change":"2024-09-12T00:31:54.167692+0000","last_active":"2024-09-12T01:25:55.636359+0000","last_peered":"2024-09-12T01:25:55.636359+0000","last_clean":"2024-09-12T01:25:55.636359+0000","last_became_active":"2024-09-12T00:31:54.167362+0000","last_became_peered":"2024-09-12T00:31:54.167362+0000","last_unstale":"2024-09-12T01:25:55.636359+0000","last_undegraded":"2024-09-12T01:25:55.636359+0000","last_fullsized":"2024-09-12T01:25:55.636359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:15.421825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'772","reported_seq":2498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.233272+0000","last_change":"2024-09-12T00:31:56.173817+0000","last_active":"2024-09-12T01:29:15.233272+0000","last_peered":"2024-09-12T01:29:15.233272+0000","last_clean":"2024-09-12T01:29:15.233272+0000","last_became_active":"2024-09-12T00:31:56.173548+0000","last_became_peered":"2024-09-12T00:31:56.173548+0000","last_unstale":"2024-09-12T01:29:15.233272+0000","last_undegraded":"2024-09-12T01:29:15.233272+0000","last_fullsized":"2024-09-12T01:29:15.233272+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:34.709914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'124","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.453295+0000","last_change":"2024-09-12T00:31:58.175176+0000","last_active":"2024-09-12T01:27:48.453295+0000","last_peered":"2024-09-12T01:27:48.453295+0000","last_clean":"2024-09-12T01:27:48.453295+0000","last_became_active":"2024-09-12T00:31:58.174886+0000","last_became_peered":"2024-09-12T00:31:58.174886+0000","last_unstale":"2024-09-12T01:27:48.453295+0000","last_undegraded":"2024-09-12T01:27:48.453295+0000","last_fullsized":"2024-09-12T01:27:48.453295+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:21.010979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":123,"num_write":278,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'279","reported_seq":875,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:57.044069+0000","last_change":"2024-09-12T00:31:50.140192+0000","last_active":"2024-09-12T01:26:57.044069+0000","last_peered":"2024-09-12T01:26:57.044069+0000","last_clean":"2024-09-12T01:26:57.044069+0000","last_became_active":"2024-09-12T00:31:50.139923+0000","last_became_peered":"2024-09-12T00:31:50.139923+0000","last_unstale":"2024-09-12T01:26:57.044069+0000","last_undegraded":"2024-09-12T01:26:57.044069+0000","last_fullsized":"2024-09-12T01:26:57.044069+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:45.055920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":954,"num_write":459,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'365","reported_seq":1086,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.458777+0000","last_change":"2024-09-12T00:31:47.122785+0000","last_active":"2024-09-12T01:29:16.458777+0000","last_peered":"2024-09-12T01:29:16.458777+0000","last_clean":"2024-09-12T01:29:16.458777+0000","last_became_active":"2024-09-12T00:31:47.122007+0000","last_became_peered":"2024-09-12T00:31:47.122007+0000","last_unstale":"2024-09-12T01:29:16.458777+0000","last_undegraded":"2024-09-12T01:29:16.458777+0000","last_fullsized":"2024-09-12T01:29:16.458777+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:49.888568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":650,"num_read_kb":69205,"num_write":1195,"num_write_kb":21863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.722337+0000","last_change":"2024-09-12T00:31:52.147230+0000","last_active":"2024-09-12T01:25:54.722337+0000","last_peered":"2024-09-12T01:25:54.722337+0000","last_clean":"2024-09-12T01:25:54.722337+0000","last_became_active":"2024-09-12T00:31:52.146894+0000","last_became_peered":"2024-09-12T00:31:52.146894+0000","last_unstale":"2024-09-12T01:25:54.722337+0000","last_undegraded":"2024-09-12T01:25:54.722337+0000","last_fullsized":"2024-09-12T01:25:54.722337+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:01.319728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'420","reported_seq":1034,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.369838+0000","last_change":"2024-09-12T00:31:54.170886+0000","last_active":"2024-09-12T01:29:16.369838+0000","last_peered":"2024-09-12T01:29:16.369838+0000","last_clean":"2024-09-12T01:29:16.369838+0000","last_became_active":"2024-09-12T00:31:54.170522+0000","last_became_peered":"2024-09-12T00:31:54.170522+0000","last_unstale":"2024-09-12T01:29:16.369838+0000","last_undegraded":"2024-09-12T01:29:16.369838+0000","last_fullsized":"2024-09-12T01:29:16.369838+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":400,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:11.181608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48295,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1274,"num_read_kb":1983,"num_write":1802,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.504440+0000","last_change":"2024-09-12T00:31:56.168824+0000","last_active":"2024-09-12T01:25:59.504440+0000","last_peered":"2024-09-12T01:25:59.504440+0000","last_clean":"2024-09-12T01:25:59.504440+0000","last_became_active":"2024-09-12T00:31:56.168503+0000","last_became_peered":"2024-09-12T00:31:56.168503+0000","last_unstale":"2024-09-12T01:25:59.504440+0000","last_undegraded":"2024-09-12T01:25:59.504440+0000","last_fullsized":"2024-09-12T01:25:59.504440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:47.541247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'129","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:38.383006+0000","last_change":"2024-09-12T00:31:58.173064+0000","last_active":"2024-09-12T01:26:38.383006+0000","last_peered":"2024-09-12T01:26:38.383006+0000","last_clean":"2024-09-12T01:26:38.383006+0000","last_became_active":"2024-09-12T00:31:58.172778+0000","last_became_peered":"2024-09-12T00:31:58.172778+0000","last_unstale":"2024-09-12T01:26:38.383006+0000","last_undegraded":"2024-09-12T01:26:38.383006+0000","last_fullsized":"2024-09-12T01:26:38.383006+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:25.437723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":147,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'168","reported_seq":780,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723659+0000","last_change":"2024-09-12T00:31:50.131714+0000","last_active":"2024-09-12T01:26:04.723659+0000","last_peered":"2024-09-12T01:26:04.723659+0000","last_clean":"2024-09-12T01:26:04.723659+0000","last_became_active":"2024-09-12T00:31:50.131152+0000","last_became_peered":"2024-09-12T00:31:50.131152+0000","last_unstale":"2024-09-12T01:26:04.723659+0000","last_undegraded":"2024-09-12T01:26:04.723659+0000","last_fullsized":"2024-09-12T01:26:04.723659+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:10.401016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":649,"num_write":266,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":618,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.602382+0000","last_change":"2024-09-12T00:31:29.750620+0000","last_active":"2024-09-12T01:25:34.602382+0000","last_peered":"2024-09-12T01:25:34.602382+0000","last_clean":"2024-09-12T01:25:34.602382+0000","last_became_active":"2024-09-12T00:31:29.750331+0000","last_became_peered":"2024-09-12T00:31:29.750331+0000","last_unstale":"2024-09-12T01:25:34.602382+0000","last_undegraded":"2024-09-12T01:25:34.602382+0000","last_fullsized":"2024-09-12T01:25:34.602382+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:28.736382+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:28.736382+0000","last_clean_scrub_stamp":"2024-09-12T00:31:28.736382+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:30.636870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721690+0000","last_change":"2024-09-12T00:31:38.792167+0000","last_active":"2024-09-12T01:25:49.721690+0000","last_peered":"2024-09-12T01:25:49.721690+0000","last_clean":"2024-09-12T01:25:49.721690+0000","last_became_active":"2024-09-12T00:31:36.970959+0000","last_became_peered":"2024-09-12T00:31:36.970959+0000","last_unstale":"2024-09-12T01:25:49.721690+0000","last_undegraded":"2024-09-12T01:25:49.721690+0000","last_fullsized":"2024-09-12T01:25:49.721690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:16.364886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00098350799999999991,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'319","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.470855+0000","last_change":"2024-09-12T00:31:47.130441+0000","last_active":"2024-09-12T01:29:16.470855+0000","last_peered":"2024-09-12T01:29:16.470855+0000","last_clean":"2024-09-12T01:29:16.470855+0000","last_became_active":"2024-09-12T00:31:47.130015+0000","last_became_peered":"2024-09-12T00:31:47.130015+0000","last_unstale":"2024-09-12T01:29:16.470855+0000","last_undegraded":"2024-09-12T01:29:16.470855+0000","last_fullsized":"2024-09-12T01:29:16.470855+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:10.863669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":117828,"num_write":1049,"num_write_kb":35803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.501940+0000","last_change":"2024-09-12T00:31:52.148635+0000","last_active":"2024-09-12T01:26:04.501940+0000","last_peered":"2024-09-12T01:26:04.501940+0000","last_clean":"2024-09-12T01:26:04.501940+0000","last_became_active":"2024-09-12T00:31:52.148316+0000","last_became_peered":"2024-09-12T00:31:52.148316+0000","last_unstale":"2024-09-12T01:26:04.501940+0000","last_undegraded":"2024-09-12T01:26:04.501940+0000","last_fullsized":"2024-09-12T01:26:04.501940+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:30.960630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'713","reported_seq":1425,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.485521+0000","last_change":"2024-09-12T00:31:54.163779+0000","last_active":"2024-09-12T01:29:16.485521+0000","last_peered":"2024-09-12T01:29:16.485521+0000","last_clean":"2024-09-12T01:29:16.485521+0000","last_became_active":"2024-09-12T00:31:54.163482+0000","last_became_peered":"2024-09-12T00:31:54.163482+0000","last_unstale":"2024-09-12T01:29:16.485521+0000","last_undegraded":"2024-09-12T01:29:16.485521+0000","last_fullsized":"2024-09-12T01:29:16.485521+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:12.512568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135081,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1399,"num_read_kb":3136,"num_write":1308,"num_write_kb":1145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499503+0000","last_change":"2024-09-12T00:31:56.170852+0000","last_active":"2024-09-12T01:26:07.499503+0000","last_peered":"2024-09-12T01:26:07.499503+0000","last_clean":"2024-09-12T01:26:07.499503+0000","last_became_active":"2024-09-12T00:31:56.170545+0000","last_became_peered":"2024-09-12T00:31:56.170545+0000","last_unstale":"2024-09-12T01:26:07.499503+0000","last_undegraded":"2024-09-12T01:26:07.499503+0000","last_fullsized":"2024-09-12T01:26:07.499503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:42.166275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'197","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.343679+0000","last_change":"2024-09-12T00:31:58.185222+0000","last_active":"2024-09-12T01:27:48.343679+0000","last_peered":"2024-09-12T01:27:48.343679+0000","last_clean":"2024-09-12T01:27:48.343679+0000","last_became_active":"2024-09-12T00:31:58.184941+0000","last_became_peered":"2024-09-12T00:31:58.184941+0000","last_unstale":"2024-09-12T01:27:48.343679+0000","last_undegraded":"2024-09-12T01:27:48.343679+0000","last_fullsized":"2024-09-12T01:27:48.343679+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:18.883829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1234,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":433,"num_write":415,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'95","reported_seq":667,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498663+0000","last_change":"2024-09-12T00:31:50.138379+0000","last_active":"2024-09-12T01:26:02.498663+0000","last_peered":"2024-09-12T01:26:02.498663+0000","last_clean":"2024-09-12T01:26:02.498663+0000","last_became_active":"2024-09-12T00:31:50.137393+0000","last_became_peered":"2024-09-12T00:31:50.137393+0000","last_unstale":"2024-09-12T01:26:02.498663+0000","last_undegraded":"2024-09-12T01:26:02.498663+0000","last_fullsized":"2024-09-12T01:26:02.498663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:51.466639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":346,"num_write":149,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":528,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.719450+0000","last_change":"2024-09-12T00:31:38.791836+0000","last_active":"2024-09-12T01:25:44.719450+0000","last_peered":"2024-09-12T01:25:44.719450+0000","last_clean":"2024-09-12T01:25:44.719450+0000","last_became_active":"2024-09-12T00:31:36.772301+0000","last_became_peered":"2024-09-12T00:31:36.772301+0000","last_unstale":"2024-09-12T01:25:44.719450+0000","last_undegraded":"2024-09-12T01:25:44.719450+0000","last_fullsized":"2024-09-12T01:25:44.719450+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:18.261088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070272599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'371","reported_seq":1029,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.461226+0000","last_change":"2024-09-12T00:31:47.121968+0000","last_active":"2024-09-12T01:29:16.461226+0000","last_peered":"2024-09-12T01:29:16.461226+0000","last_clean":"2024-09-12T01:29:16.461226+0000","last_became_active":"2024-09-12T00:31:47.121537+0000","last_became_peered":"2024-09-12T00:31:47.121537+0000","last_unstale":"2024-09-12T01:29:16.461226+0000","last_undegraded":"2024-09-12T01:29:16.461226+0000","last_fullsized":"2024-09-12T01:29:16.461226+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:47.444435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306567,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":587,"num_read_kb":9552,"num_write":1166,"num_write_kb":21951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723703+0000","last_change":"2024-09-12T00:31:52.147965+0000","last_active":"2024-09-12T01:26:04.723703+0000","last_peered":"2024-09-12T01:26:04.723703+0000","last_clean":"2024-09-12T01:26:04.723703+0000","last_became_active":"2024-09-12T00:31:52.147719+0000","last_became_peered":"2024-09-12T00:31:52.147719+0000","last_unstale":"2024-09-12T01:26:04.723703+0000","last_undegraded":"2024-09-12T01:26:04.723703+0000","last_fullsized":"2024-09-12T01:26:04.723703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:49.618183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1262","reported_seq":2896,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.430146+0000","last_change":"2024-09-12T00:31:54.168423+0000","last_active":"2024-09-12T01:29:16.430146+0000","last_peered":"2024-09-12T01:29:16.430146+0000","last_clean":"2024-09-12T01:29:16.430146+0000","last_became_active":"2024-09-12T00:31:54.168085+0000","last_became_peered":"2024-09-12T00:31:54.168085+0000","last_unstale":"2024-09-12T01:29:16.430146+0000","last_undegraded":"2024-09-12T01:29:16.430146+0000","last_fullsized":"2024-09-12T01:29:16.430146+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":1200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:38.939256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145044,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2035,"num_read_kb":3748,"num_write":1136,"num_write_kb":952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.725043+0000","last_change":"2024-09-12T00:31:56.171482+0000","last_active":"2024-09-12T01:26:14.725043+0000","last_peered":"2024-09-12T01:26:14.725043+0000","last_clean":"2024-09-12T01:26:14.725043+0000","last_became_active":"2024-09-12T00:31:56.170725+0000","last_became_peered":"2024-09-12T00:31:56.170725+0000","last_unstale":"2024-09-12T01:26:14.725043+0000","last_undegraded":"2024-09-12T01:26:14.725043+0000","last_fullsized":"2024-09-12T01:26:14.725043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:54.802585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'205","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:46.476124+0000","last_change":"2024-09-12T00:31:58.182866+0000","last_active":"2024-09-12T01:27:46.476124+0000","last_peered":"2024-09-12T01:27:46.476124+0000","last_clean":"2024-09-12T01:27:46.476124+0000","last_became_active":"2024-09-12T00:31:58.182565+0000","last_became_peered":"2024-09-12T00:31:58.182565+0000","last_unstale":"2024-09-12T01:27:46.476124+0000","last_undegraded":"2024-09-12T01:27:46.476124+0000","last_fullsized":"2024-09-12T01:27:46.476124+0000","mapping_epoch":35,"log_start":"262'100","ondisk_log_start":"262'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:03.635481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":315,"num_read_kb":314,"num_write":438,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'335","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:28.356649+0000","last_change":"2024-09-12T00:31:50.136242+0000","last_active":"2024-09-12T01:26:28.356649+0000","last_peered":"2024-09-12T01:26:28.356649+0000","last_clean":"2024-09-12T01:26:28.356649+0000","last_became_active":"2024-09-12T00:31:50.135930+0000","last_became_peered":"2024-09-12T00:31:50.135930+0000","last_unstale":"2024-09-12T01:26:28.356649+0000","last_undegraded":"2024-09-12T01:26:28.356649+0000","last_fullsized":"2024-09-12T01:26:28.356649+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:44:16.203493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1457,"num_read_kb":1188,"num_write":528,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":532,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:50.780245+0000","last_change":"2024-09-12T00:31:38.791033+0000","last_active":"2024-09-12T01:25:50.780245+0000","last_peered":"2024-09-12T01:25:50.780245+0000","last_clean":"2024-09-12T01:25:50.780245+0000","last_became_active":"2024-09-12T00:31:36.774484+0000","last_became_peered":"2024-09-12T00:31:36.774484+0000","last_unstale":"2024-09-12T01:25:50.780245+0000","last_undegraded":"2024-09-12T01:25:50.780245+0000","last_fullsized":"2024-09-12T01:25:50.780245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:00.370174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040283499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'343","reported_seq":1002,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.466799+0000","last_change":"2024-09-12T00:31:47.124224+0000","last_active":"2024-09-12T01:29:16.466799+0000","last_peered":"2024-09-12T01:29:16.466799+0000","last_clean":"2024-09-12T01:29:16.466799+0000","last_became_active":"2024-09-12T00:31:47.123249+0000","last_became_peered":"2024-09-12T00:31:47.123249+0000","last_unstale":"2024-09-12T01:29:16.466799+0000","last_undegraded":"2024-09-12T01:29:16.466799+0000","last_fullsized":"2024-09-12T01:29:16.466799+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:41.915420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291498,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":12898,"num_write":1156,"num_write_kb":44550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782647+0000","last_change":"2024-09-12T00:31:52.156266+0000","last_active":"2024-09-12T01:26:05.782647+0000","last_peered":"2024-09-12T01:26:05.782647+0000","last_clean":"2024-09-12T01:26:05.782647+0000","last_became_active":"2024-09-12T00:31:52.155926+0000","last_became_peered":"2024-09-12T00:31:52.155926+0000","last_unstale":"2024-09-12T01:26:05.782647+0000","last_undegraded":"2024-09-12T01:26:05.782647+0000","last_fullsized":"2024-09-12T01:26:05.782647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:04.589366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'249","reported_seq":1479,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.489792+0000","last_change":"2024-09-12T00:31:54.175219+0000","last_active":"2024-09-12T01:28:54.489792+0000","last_peered":"2024-09-12T01:28:54.489792+0000","last_clean":"2024-09-12T01:28:54.489792+0000","last_became_active":"2024-09-12T00:31:54.174937+0000","last_became_peered":"2024-09-12T00:31:54.174937+0000","last_unstale":"2024-09-12T01:28:54.489792+0000","last_undegraded":"2024-09-12T01:28:54.489792+0000","last_fullsized":"2024-09-12T01:28:54.489792+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:50.854821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":202,"num_write":187,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501136+0000","last_change":"2024-09-12T00:31:56.172150+0000","last_active":"2024-09-12T01:26:08.501136+0000","last_peered":"2024-09-12T01:26:08.501136+0000","last_clean":"2024-09-12T01:26:08.501136+0000","last_became_active":"2024-09-12T00:31:56.171071+0000","last_became_peered":"2024-09-12T00:31:56.171071+0000","last_unstale":"2024-09-12T01:26:08.501136+0000","last_undegraded":"2024-09-12T01:26:08.501136+0000","last_fullsized":"2024-09-12T01:26:08.501136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:43.038984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'239","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:13.519595+0000","last_change":"2024-09-12T00:31:58.177224+0000","last_active":"2024-09-12T01:28:13.519595+0000","last_peered":"2024-09-12T01:28:13.519595+0000","last_clean":"2024-09-12T01:28:13.519595+0000","last_became_active":"2024-09-12T00:31:58.176931+0000","last_became_peered":"2024-09-12T00:31:58.176931+0000","last_unstale":"2024-09-12T01:28:13.519595+0000","last_undegraded":"2024-09-12T01:28:13.519595+0000","last_fullsized":"2024-09-12T01:28:13.519595+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:05.868371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":495,"num_write":504,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'416","reported_seq":1066,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637259+0000","last_change":"2024-09-12T00:31:50.139895+0000","last_active":"2024-09-12T01:26:00.637259+0000","last_peered":"2024-09-12T01:26:00.637259+0000","last_clean":"2024-09-12T01:26:00.637259+0000","last_became_active":"2024-09-12T00:31:50.139625+0000","last_became_peered":"2024-09-12T00:31:50.139625+0000","last_unstale":"2024-09-12T01:26:00.637259+0000","last_undegraded":"2024-09-12T01:26:00.637259+0000","last_fullsized":"2024-09-12T01:26:00.637259+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:20.853631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1805,"num_read_kb":1431,"num_write":644,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":529,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721663+0000","last_change":"2024-09-12T00:31:38.792511+0000","last_active":"2024-09-12T01:25:49.721663+0000","last_peered":"2024-09-12T01:25:49.721663+0000","last_clean":"2024-09-12T01:25:49.721663+0000","last_became_active":"2024-09-12T00:31:37.736683+0000","last_became_peered":"2024-09-12T00:31:37.736683+0000","last_unstale":"2024-09-12T01:25:49.721663+0000","last_undegraded":"2024-09-12T01:25:49.721663+0000","last_fullsized":"2024-09-12T01:25:49.721663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:32.835722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001295757,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'316","reported_seq":1154,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.365633+0000","last_change":"2024-09-12T00:31:47.137770+0000","last_active":"2024-09-12T01:29:16.365633+0000","last_peered":"2024-09-12T01:29:16.365633+0000","last_clean":"2024-09-12T01:29:16.365633+0000","last_became_active":"2024-09-12T00:31:47.136714+0000","last_became_peered":"2024-09-12T00:31:47.136714+0000","last_unstale":"2024-09-12T01:29:16.365633+0000","last_undegraded":"2024-09-12T01:29:16.365633+0000","last_fullsized":"2024-09-12T01:29:16.365633+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:36.750876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":889,"num_read_kb":29272,"num_write":1058,"num_write_kb":35686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.784440+0000","last_change":"2024-09-12T00:31:52.149396+0000","last_active":"2024-09-12T01:26:15.784440+0000","last_peered":"2024-09-12T01:26:15.784440+0000","last_clean":"2024-09-12T01:26:15.784440+0000","last_became_active":"2024-09-12T00:31:52.148995+0000","last_became_peered":"2024-09-12T00:31:52.148995+0000","last_unstale":"2024-09-12T01:26:15.784440+0000","last_undegraded":"2024-09-12T01:26:15.784440+0000","last_fullsized":"2024-09-12T01:26:15.784440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:57.905127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'137","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:17.519817+0000","last_change":"2024-09-12T00:31:54.168174+0000","last_active":"2024-09-12T01:28:17.519817+0000","last_peered":"2024-09-12T01:28:17.519817+0000","last_clean":"2024-09-12T01:28:17.519817+0000","last_became_active":"2024-09-12T00:31:54.167813+0000","last_became_peered":"2024-09-12T00:31:54.167813+0000","last_unstale":"2024-09-12T01:28:17.519817+0000","last_undegraded":"2024-09-12T01:28:17.519817+0000","last_fullsized":"2024-09-12T01:28:17.519817+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:55.058242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":166,"num_read_kb":157,"num_write":122,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.724455+0000","last_change":"2024-09-12T00:31:56.173128+0000","last_active":"2024-09-12T01:26:09.724455+0000","last_peered":"2024-09-12T01:26:09.724455+0000","last_clean":"2024-09-12T01:26:09.724455+0000","last_became_active":"2024-09-12T00:31:56.172693+0000","last_became_peered":"2024-09-12T00:31:56.172693+0000","last_unstale":"2024-09-12T01:26:09.724455+0000","last_undegraded":"2024-09-12T01:26:09.724455+0000","last_fullsized":"2024-09-12T01:26:09.724455+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:48.948020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'163","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.606163+0000","last_change":"2024-09-12T00:31:58.177617+0000","last_active":"2024-09-12T01:26:09.606163+0000","last_peered":"2024-09-12T01:26:09.606163+0000","last_clean":"2024-09-12T01:26:09.606163+0000","last_became_active":"2024-09-12T00:31:58.177206+0000","last_became_peered":"2024-09-12T00:31:58.177206+0000","last_unstale":"2024-09-12T01:26:09.606163+0000","last_undegraded":"2024-09-12T01:26:09.606163+0000","last_fullsized":"2024-09-12T01:26:09.606163+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:23.709095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":267,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'249","reported_seq":853,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637190+0000","last_change":"2024-09-12T00:31:50.135626+0000","last_active":"2024-09-12T01:26:00.637190+0000","last_peered":"2024-09-12T01:26:00.637190+0000","last_clean":"2024-09-12T01:26:00.637190+0000","last_became_active":"2024-09-12T00:31:50.135333+0000","last_became_peered":"2024-09-12T00:31:50.135333+0000","last_unstale":"2024-09-12T01:26:00.637190+0000","last_undegraded":"2024-09-12T01:26:00.637190+0000","last_fullsized":"2024-09-12T01:26:00.637190+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:41.887040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1106,"num_read_kb":893,"num_write":406,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'297","reported_seq":906,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.443060+0000","last_change":"2024-09-12T00:31:47.132263+0000","last_active":"2024-09-12T01:29:16.443060+0000","last_peered":"2024-09-12T01:29:16.443060+0000","last_clean":"2024-09-12T01:29:16.443060+0000","last_became_active":"2024-09-12T00:31:47.131943+0000","last_became_peered":"2024-09-12T00:31:47.131943+0000","last_unstale":"2024-09-12T01:29:16.443060+0000","last_undegraded":"2024-09-12T01:29:16.443060+0000","last_fullsized":"2024-09-12T01:29:16.443060+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:25.947785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7951494,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":382,"num_read_kb":39412,"num_write":972,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:47.496403+0000","last_change":"2024-09-12T00:31:38.786719+0000","last_active":"2024-09-12T01:25:47.496403+0000","last_peered":"2024-09-12T01:25:47.496403+0000","last_clean":"2024-09-12T01:25:47.496403+0000","last_became_active":"2024-09-12T00:31:37.736507+0000","last_became_peered":"2024-09-12T00:31:37.736507+0000","last_unstale":"2024-09-12T01:25:47.496403+0000","last_undegraded":"2024-09-12T01:25:47.496403+0000","last_fullsized":"2024-09-12T01:25:47.496403+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:48.124334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050928200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:03.500363+0000","last_change":"2024-09-12T00:31:52.154383+0000","last_active":"2024-09-12T01:26:03.500363+0000","last_peered":"2024-09-12T01:26:03.500363+0000","last_clean":"2024-09-12T01:26:03.500363+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:26:03.500363+0000","last_undegraded":"2024-09-12T01:26:03.500363+0000","last_fullsized":"2024-09-12T01:26:03.500363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:37.921158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'603","reported_seq":1292,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.073618+0000","last_change":"2024-09-12T00:31:54.162920+0000","last_active":"2024-09-12T01:29:16.073618+0000","last_peered":"2024-09-12T01:29:16.073618+0000","last_clean":"2024-09-12T01:29:16.073618+0000","last_became_active":"2024-09-12T00:31:54.162596+0000","last_became_peered":"2024-09-12T00:31:54.162596+0000","last_unstale":"2024-09-12T01:29:16.073618+0000","last_undegraded":"2024-09-12T01:29:16.073618+0000","last_fullsized":"2024-09-12T01:29:16.073618+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":500,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:38.618701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88936,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1027,"num_read_kb":2220,"num_write":890,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.505411+0000","last_change":"2024-09-12T00:31:56.170603+0000","last_active":"2024-09-12T01:26:09.505411+0000","last_peered":"2024-09-12T01:26:09.505411+0000","last_clean":"2024-09-12T01:26:09.505411+0000","last_became_active":"2024-09-12T00:31:56.170246+0000","last_became_peered":"2024-09-12T00:31:56.170246+0000","last_unstale":"2024-09-12T01:26:09.505411+0000","last_undegraded":"2024-09-12T01:26:09.505411+0000","last_fullsized":"2024-09-12T01:26:09.505411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:58.101767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'137","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.305820+0000","last_change":"2024-09-12T00:31:58.183531+0000","last_active":"2024-09-12T01:28:54.305820+0000","last_peered":"2024-09-12T01:28:54.305820+0000","last_clean":"2024-09-12T01:28:54.305820+0000","last_became_active":"2024-09-12T00:31:58.183206+0000","last_became_peered":"2024-09-12T00:31:58.183206+0000","last_unstale":"2024-09-12T01:28:54.305820+0000","last_undegraded":"2024-09-12T01:28:54.305820+0000","last_fullsized":"2024-09-12T01:28:54.305820+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:12.094595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":155,"num_write":341,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'131","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637220+0000","last_change":"2024-09-12T00:31:50.135481+0000","last_active":"2024-09-12T01:26:00.637220+0000","last_peered":"2024-09-12T01:26:00.637220+0000","last_clean":"2024-09-12T01:26:00.637220+0000","last_became_active":"2024-09-12T00:31:50.135197+0000","last_became_peered":"2024-09-12T00:31:50.135197+0000","last_unstale":"2024-09-12T01:26:00.637220+0000","last_undegraded":"2024-09-12T01:26:00.637220+0000","last_fullsized":"2024-09-12T01:26:00.637220+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:37.204019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":577,"num_read_kb":479,"num_write":210,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'302","reported_seq":925,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.438331+0000","last_change":"2024-09-12T00:31:47.121755+0000","last_active":"2024-09-12T01:29:16.438331+0000","last_peered":"2024-09-12T01:29:16.438331+0000","last_clean":"2024-09-12T01:29:16.438331+0000","last_became_active":"2024-09-12T00:31:47.121355+0000","last_became_peered":"2024-09-12T00:31:47.121355+0000","last_unstale":"2024-09-12T01:29:16.438331+0000","last_undegraded":"2024-09-12T01:29:16.438331+0000","last_fullsized":"2024-09-12T01:29:16.438331+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:07.246376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":443,"num_write":1003,"num_write_kb":5362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":527,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.722299+0000","last_change":"2024-09-12T00:31:38.791827+0000","last_active":"2024-09-12T01:25:54.722299+0000","last_peered":"2024-09-12T01:25:54.722299+0000","last_clean":"2024-09-12T01:25:54.722299+0000","last_became_active":"2024-09-12T00:31:36.774289+0000","last_became_peered":"2024-09-12T00:31:36.774289+0000","last_unstale":"2024-09-12T01:25:54.722299+0000","last_undegraded":"2024-09-12T01:25:54.722299+0000","last_fullsized":"2024-09-12T01:25:54.722299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:55.526735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063853100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"37'8","reported_seq":1459,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.075671+0000","last_change":"2024-09-12T00:31:52.148172+0000","last_active":"2024-09-12T01:29:14.075671+0000","last_peered":"2024-09-12T01:29:14.075671+0000","last_clean":"2024-09-12T01:29:14.075671+0000","last_became_active":"2024-09-12T00:31:52.147856+0000","last_became_peered":"2024-09-12T00:31:52.147856+0000","last_unstale":"2024-09-12T01:29:14.075671+0000","last_undegraded":"2024-09-12T01:29:14.075671+0000","last_fullsized":"2024-09-12T01:29:14.075671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:28.451170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1609,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1450,"num_read_kb":1911,"num_write":16,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'176","reported_seq":746,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.637935+0000","last_change":"2024-09-12T00:31:54.170295+0000","last_active":"2024-09-12T01:26:05.637935+0000","last_peered":"2024-09-12T01:26:05.637935+0000","last_clean":"2024-09-12T01:26:05.637935+0000","last_became_active":"2024-09-12T00:31:54.169958+0000","last_became_peered":"2024-09-12T00:31:54.169958+0000","last_unstale":"2024-09-12T01:26:05.637935+0000","last_undegraded":"2024-09-12T01:26:05.637935+0000","last_fullsized":"2024-09-12T01:26:05.637935+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:37.410716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":229,"num_read_kb":218,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'773","reported_seq":2820,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.232071+0000","last_change":"2024-09-12T00:31:56.174875+0000","last_active":"2024-09-12T01:29:15.232071+0000","last_peered":"2024-09-12T01:29:15.232071+0000","last_clean":"2024-09-12T01:29:15.232071+0000","last_became_active":"2024-09-12T00:31:56.174535+0000","last_became_peered":"2024-09-12T00:31:56.174535+0000","last_unstale":"2024-09-12T01:29:15.232071+0000","last_undegraded":"2024-09-12T01:29:15.232071+0000","last_fullsized":"2024-09-12T01:29:15.232071+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:30.561634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'114","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:25.804418+0000","last_change":"2024-09-12T00:31:58.174504+0000","last_active":"2024-09-12T01:28:25.804418+0000","last_peered":"2024-09-12T01:28:25.804418+0000","last_clean":"2024-09-12T01:28:25.804418+0000","last_became_active":"2024-09-12T00:31:58.174086+0000","last_became_peered":"2024-09-12T00:31:58.174086+0000","last_unstale":"2024-09-12T01:28:25.804418+0000","last_undegraded":"2024-09-12T01:28:25.804418+0000","last_fullsized":"2024-09-12T01:28:25.804418+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:34.431865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":255,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'4367","reported_seq":5119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501053+0000","last_change":"2024-09-12T00:31:50.133031+0000","last_active":"2024-09-12T01:26:08.501053+0000","last_peered":"2024-09-12T01:26:08.501053+0000","last_clean":"2024-09-12T01:26:08.501053+0000","last_became_active":"2024-09-12T00:31:50.132703+0000","last_became_peered":"2024-09-12T00:31:50.132703+0000","last_unstale":"2024-09-12T01:26:08.501053+0000","last_undegraded":"2024-09-12T01:26:08.501053+0000","last_fullsized":"2024-09-12T01:26:08.501053+0000","mapping_epoch":27,"log_start":"265'4300","ondisk_log_start":"265'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":3000,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:18.582172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17817,"num_read_kb":14914,"num_write":6561,"num_write_kb":3320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'309","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.380448+0000","last_change":"2024-09-12T00:31:47.116552+0000","last_active":"2024-09-12T01:29:16.380448+0000","last_peered":"2024-09-12T01:29:16.380448+0000","last_clean":"2024-09-12T01:29:16.380448+0000","last_became_active":"2024-09-12T00:31:47.116205+0000","last_became_peered":"2024-09-12T00:31:47.116205+0000","last_unstale":"2024-09-12T01:29:16.380448+0000","last_undegraded":"2024-09-12T01:29:16.380448+0000","last_fullsized":"2024-09-12T01:29:16.380448+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:23.401827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704304,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":481,"num_read_kb":46756,"num_write":1080,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":531,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:48.498503+0000","last_change":"2024-09-12T00:31:38.828567+0000","last_active":"2024-09-12T01:25:48.498503+0000","last_peered":"2024-09-12T01:25:48.498503+0000","last_clean":"2024-09-12T01:25:48.498503+0000","last_became_active":"2024-09-12T00:31:37.434707+0000","last_became_peered":"2024-09-12T00:31:37.434707+0000","last_unstale":"2024-09-12T01:25:48.498503+0000","last_undegraded":"2024-09-12T01:25:48.498503+0000","last_fullsized":"2024-09-12T01:25:48.498503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:44.992055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041578299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723540+0000","last_change":"2024-09-12T00:31:52.147221+0000","last_active":"2024-09-12T01:26:04.723540+0000","last_peered":"2024-09-12T01:26:04.723540+0000","last_clean":"2024-09-12T01:26:04.723540+0000","last_became_active":"2024-09-12T00:31:52.146927+0000","last_became_peered":"2024-09-12T00:31:52.146927+0000","last_unstale":"2024-09-12T01:26:04.723540+0000","last_undegraded":"2024-09-12T01:26:04.723540+0000","last_fullsized":"2024-09-12T01:26:04.723540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:07.292280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'129","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723596+0000","last_change":"2024-09-12T00:31:54.166886+0000","last_active":"2024-09-12T01:26:04.723596+0000","last_peered":"2024-09-12T01:26:04.723596+0000","last_clean":"2024-09-12T01:26:04.723596+0000","last_became_active":"2024-09-12T00:31:54.166612+0000","last_became_peered":"2024-09-12T00:31:54.166612+0000","last_unstale":"2024-09-12T01:26:04.723596+0000","last_undegraded":"2024-09-12T01:26:04.723596+0000","last_fullsized":"2024-09-12T01:26:04.723596+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:22.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":151,"num_read_kb":143,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'784","reported_seq":4660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.926690+0000","last_change":"2024-09-12T00:31:56.170683+0000","last_active":"2024-09-12T01:29:15.926690+0000","last_peered":"2024-09-12T01:29:15.926690+0000","last_clean":"2024-09-12T01:29:15.926690+0000","last_became_active":"2024-09-12T00:31:56.170358+0000","last_became_peered":"2024-09-12T00:31:56.170358+0000","last_unstale":"2024-09-12T01:29:15.926690+0000","last_undegraded":"2024-09-12T01:29:15.926690+0000","last_fullsized":"2024-09-12T01:29:15.926690+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:23.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'175","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:57.497649+0000","last_change":"2024-09-12T00:31:58.178681+0000","last_active":"2024-09-12T01:25:57.497649+0000","last_peered":"2024-09-12T01:25:57.497649+0000","last_clean":"2024-09-12T01:25:57.497649+0000","last_became_active":"2024-09-12T00:31:58.178148+0000","last_became_peered":"2024-09-12T00:31:58.178148+0000","last_unstale":"2024-09-12T01:25:57.497649+0000","last_undegraded":"2024-09-12T01:25:57.497649+0000","last_fullsized":"2024-09-12T01:25:57.497649+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:28.683801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":405,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'112","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:06.005883+0000","last_change":"2024-09-12T00:31:50.143058+0000","last_active":"2024-09-12T01:27:06.005883+0000","last_peered":"2024-09-12T01:27:06.005883+0000","last_clean":"2024-09-12T01:27:06.005883+0000","last_became_active":"2024-09-12T00:31:50.142769+0000","last_became_peered":"2024-09-12T00:31:50.142769+0000","last_unstale":"2024-09-12T01:27:06.005883+0000","last_undegraded":"2024-09-12T01:27:06.005883+0000","last_fullsized":"2024-09-12T01:27:06.005883+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:22.259280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":521,"num_read_kb":437,"num_write":174,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'390","reported_seq":1076,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.423046+0000","last_change":"2024-09-12T00:31:47.116325+0000","last_active":"2024-09-12T01:29:16.423046+0000","last_peered":"2024-09-12T01:29:16.423046+0000","last_clean":"2024-09-12T01:29:16.423046+0000","last_became_active":"2024-09-12T00:31:47.115974+0000","last_became_peered":"2024-09-12T00:31:47.115974+0000","last_unstale":"2024-09-12T01:29:16.423046+0000","last_undegraded":"2024-09-12T01:29:16.423046+0000","last_fullsized":"2024-09-12T01:29:16.423046+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:40.653497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1843869,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":674,"num_read_kb":6022,"num_write":1105,"num_write_kb":14780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":526,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721781+0000","last_change":"2024-09-12T00:31:38.792390+0000","last_active":"2024-09-12T01:25:49.721781+0000","last_peered":"2024-09-12T01:25:49.721781+0000","last_clean":"2024-09-12T01:25:49.721781+0000","last_became_active":"2024-09-12T00:31:37.434487+0000","last_became_peered":"2024-09-12T00:31:37.434487+0000","last_unstale":"2024-09-12T01:25:49.721781+0000","last_undegraded":"2024-09-12T01:25:49.721781+0000","last_fullsized":"2024-09-12T01:25:49.721781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:35.763180+0000","last_clean_scrub_stamp":"2024-09-12T00:31:35.763180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:33.146992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501076+0000","last_change":"2024-09-12T00:31:52.152659+0000","last_active":"2024-09-12T01:26:08.501076+0000","last_peered":"2024-09-12T01:26:08.501076+0000","last_clean":"2024-09-12T01:26:08.501076+0000","last_became_active":"2024-09-12T00:31:52.152173+0000","last_became_peered":"2024-09-12T00:31:52.152173+0000","last_unstale":"2024-09-12T01:26:08.501076+0000","last_undegraded":"2024-09-12T01:26:08.501076+0000","last_fullsized":"2024-09-12T01:26:08.501076+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:41.559045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'736","reported_seq":1466,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.238383+0000","last_change":"2024-09-12T00:31:54.170238+0000","last_active":"2024-09-12T01:29:16.238383+0000","last_peered":"2024-09-12T01:29:16.238383+0000","last_clean":"2024-09-12T01:29:16.238383+0000","last_became_active":"2024-09-12T00:31:54.169994+0000","last_became_peered":"2024-09-12T00:31:54.169994+0000","last_unstale":"2024-09-12T01:29:16.238383+0000","last_undegraded":"2024-09-12T01:29:16.238383+0000","last_fullsized":"2024-09-12T01:29:16.238383+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":700,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:49.480724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143669,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1312,"num_read_kb":3057,"num_write":1064,"num_write_kb":866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501108+0000","last_change":"2024-09-12T00:31:56.172717+0000","last_active":"2024-09-12T01:26:08.501108+0000","last_peered":"2024-09-12T01:26:08.501108+0000","last_clean":"2024-09-12T01:26:08.501108+0000","last_became_active":"2024-09-12T00:31:56.172417+0000","last_became_peered":"2024-09-12T00:31:56.172417+0000","last_unstale":"2024-09-12T01:26:08.501108+0000","last_undegraded":"2024-09-12T01:26:08.501108+0000","last_fullsized":"2024-09-12T01:26:08.501108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:19.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'150","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.504454+0000","last_change":"2024-09-12T00:31:58.180306+0000","last_active":"2024-09-12T01:25:59.504454+0000","last_peered":"2024-09-12T01:25:59.504454+0000","last_clean":"2024-09-12T01:25:59.504454+0000","last_became_active":"2024-09-12T00:31:58.179998+0000","last_became_peered":"2024-09-12T00:31:58.179998+0000","last_unstale":"2024-09-12T01:25:59.504454+0000","last_undegraded":"2024-09-12T01:25:59.504454+0000","last_fullsized":"2024-09-12T01:25:59.504454+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:19.517308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":177,"num_read_kb":166,"num_write":377,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'158","reported_seq":722,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.538025+0000","last_change":"2024-09-12T00:31:58.178240+0000","last_active":"2024-09-12T01:27:48.538025+0000","last_peered":"2024-09-12T01:27:48.538025+0000","last_clean":"2024-09-12T01:27:48.538025+0000","last_became_active":"2024-09-12T00:31:58.177936+0000","last_became_peered":"2024-09-12T00:31:58.177936+0000","last_unstale":"2024-09-12T01:27:48.538025+0000","last_undegraded":"2024-09-12T01:27:48.538025+0000","last_fullsized":"2024-09-12T01:27:48.538025+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:52.216144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":226,"num_read_kb":224,"num_write":377,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'98","reported_seq":681,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:19.340107+0000","last_change":"2024-09-12T00:31:50.142477+0000","last_active":"2024-09-12T01:26:19.340107+0000","last_peered":"2024-09-12T01:26:19.340107+0000","last_clean":"2024-09-12T01:26:19.340107+0000","last_became_active":"2024-09-12T00:31:50.142206+0000","last_became_peered":"2024-09-12T00:31:50.142206+0000","last_unstale":"2024-09-12T01:26:19.340107+0000","last_undegraded":"2024-09-12T01:26:19.340107+0000","last_fullsized":"2024-09-12T01:26:19.340107+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:15.569454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":133,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'318","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.477525+0000","last_change":"2024-09-12T00:31:47.128769+0000","last_active":"2024-09-12T01:29:16.477525+0000","last_peered":"2024-09-12T01:29:16.477525+0000","last_clean":"2024-09-12T01:29:16.477525+0000","last_became_active":"2024-09-12T00:31:47.128005+0000","last_became_peered":"2024-09-12T00:31:47.128005+0000","last_unstale":"2024-09-12T01:29:16.477525+0000","last_undegraded":"2024-09-12T01:29:16.477525+0000","last_fullsized":"2024-09-12T01:29:16.477525+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:09.592563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174744,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":395,"num_read_kb":1002,"num_write":979,"num_write_kb":27047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:35.633125+0000","last_change":"2024-09-12T00:31:52.154225+0000","last_active":"2024-09-12T01:25:35.633125+0000","last_peered":"2024-09-12T01:25:35.633125+0000","last_clean":"2024-09-12T01:25:35.633125+0000","last_became_active":"2024-09-12T00:31:52.153927+0000","last_became_peered":"2024-09-12T00:31:52.153927+0000","last_unstale":"2024-09-12T01:25:35.633125+0000","last_undegraded":"2024-09-12T01:25:35.633125+0000","last_fullsized":"2024-09-12T01:25:35.633125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:05.731540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'289","reported_seq":867,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.667897+0000","last_change":"2024-09-12T00:31:54.167788+0000","last_active":"2024-09-12T01:29:14.667897+0000","last_peered":"2024-09-12T01:29:14.667897+0000","last_clean":"2024-09-12T01:29:14.667897+0000","last_became_active":"2024-09-12T00:31:54.167414+0000","last_became_peered":"2024-09-12T00:31:54.167414+0000","last_unstale":"2024-09-12T01:29:14.667897+0000","last_undegraded":"2024-09-12T01:29:14.667897+0000","last_fullsized":"2024-09-12T01:29:14.667897+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.633567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44314,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":1087,"num_write":386,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:35.777825+0000","last_change":"2024-09-12T00:31:56.173722+0000","last_active":"2024-09-12T01:25:35.777825+0000","last_peered":"2024-09-12T01:25:35.777825+0000","last_clean":"2024-09-12T01:25:35.777825+0000","last_became_active":"2024-09-12T00:31:56.173412+0000","last_became_peered":"2024-09-12T00:31:56.173412+0000","last_unstale":"2024-09-12T01:25:35.777825+0000","last_undegraded":"2024-09-12T01:25:35.777825+0000","last_fullsized":"2024-09-12T01:25:35.777825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:12.092104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'129","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:47.573025+0000","last_change":"2024-09-12T00:31:58.176621+0000","last_active":"2024-09-12T01:26:47.573025+0000","last_peered":"2024-09-12T01:26:47.573025+0000","last_clean":"2024-09-12T01:26:47.573025+0000","last_became_active":"2024-09-12T00:31:58.176322+0000","last_became_peered":"2024-09-12T00:31:58.176322+0000","last_unstale":"2024-09-12T01:26:47.573025+0000","last_undegraded":"2024-09-12T01:26:47.573025+0000","last_fullsized":"2024-09-12T01:26:47.573025+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:12.568369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":158,"num_write":327,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'158","reported_seq":806,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:33.496218+0000","last_change":"2024-09-12T00:31:50.128018+0000","last_active":"2024-09-12T01:25:33.496218+0000","last_peered":"2024-09-12T01:25:33.496218+0000","last_clean":"2024-09-12T01:25:33.496218+0000","last_became_active":"2024-09-12T00:31:50.127724+0000","last_became_peered":"2024-09-12T00:31:50.127724+0000","last_unstale":"2024-09-12T01:25:33.496218+0000","last_undegraded":"2024-09-12T01:25:33.496218+0000","last_fullsized":"2024-09-12T01:25:33.496218+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:22.239207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":587,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'366","reported_seq":1129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.364343+0000","last_change":"2024-09-12T00:31:47.138921+0000","last_active":"2024-09-12T01:29:16.364343+0000","last_peered":"2024-09-12T01:29:16.364343+0000","last_clean":"2024-09-12T01:29:16.364343+0000","last_became_active":"2024-09-12T00:31:47.138565+0000","last_became_peered":"2024-09-12T00:31:47.138565+0000","last_unstale":"2024-09-12T01:29:16.364343+0000","last_undegraded":"2024-09-12T01:29:16.364343+0000","last_fullsized":"2024-09-12T01:29:16.364343+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:02.222341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133731,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":777,"num_read_kb":53412,"num_write":1135,"num_write_kb":60803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:33.496242+0000","last_change":"2024-09-12T00:31:52.155188+0000","last_active":"2024-09-12T01:25:33.496242+0000","last_peered":"2024-09-12T01:25:33.496242+0000","last_clean":"2024-09-12T01:25:33.496242+0000","last_became_active":"2024-09-12T00:31:52.154829+0000","last_became_peered":"2024-09-12T00:31:52.154829+0000","last_unstale":"2024-09-12T01:25:33.496242+0000","last_undegraded":"2024-09-12T01:25:33.496242+0000","last_fullsized":"2024-09-12T01:25:33.496242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:05.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'40","reported_seq":551,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:33.496173+0000","last_change":"2024-09-12T00:31:54.162972+0000","last_active":"2024-09-12T01:25:33.496173+0000","last_peered":"2024-09-12T01:25:33.496173+0000","last_clean":"2024-09-12T01:25:33.496173+0000","last_became_active":"2024-09-12T00:31:54.162657+0000","last_became_peered":"2024-09-12T00:31:54.162657+0000","last_unstale":"2024-09-12T01:25:33.496173+0000","last_undegraded":"2024-09-12T01:25:33.496173+0000","last_fullsized":"2024-09-12T01:25:33.496173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:24.360783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.502236+0000","last_change":"2024-09-12T00:31:56.170942+0000","last_active":"2024-09-12T01:25:39.502236+0000","last_peered":"2024-09-12T01:25:39.502236+0000","last_clean":"2024-09-12T01:25:39.502236+0000","last_became_active":"2024-09-12T00:31:56.170648+0000","last_became_peered":"2024-09-12T00:31:56.170648+0000","last_unstale":"2024-09-12T01:25:39.502236+0000","last_undegraded":"2024-09-12T01:25:39.502236+0000","last_fullsized":"2024-09-12T01:25:39.502236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:28.565117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'217","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.527288+0000","last_change":"2024-09-12T00:31:58.172827+0000","last_active":"2024-09-12T01:27:47.527288+0000","last_peered":"2024-09-12T01:27:47.527288+0000","last_clean":"2024-09-12T01:27:47.527288+0000","last_became_active":"2024-09-12T00:31:58.172511+0000","last_became_peered":"2024-09-12T00:31:58.172511+0000","last_unstale":"2024-09-12T01:27:47.527288+0000","last_undegraded":"2024-09-12T01:27:47.527288+0000","last_fullsized":"2024-09-12T01:27:47.527288+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:38.476612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":356,"num_read_kb":339,"num_write":509,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'63","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:27.801294+0000","last_change":"2024-09-12T00:31:50.125425+0000","last_active":"2024-09-12T01:26:27.801294+0000","last_peered":"2024-09-12T01:26:27.801294+0000","last_clean":"2024-09-12T01:26:27.801294+0000","last_became_active":"2024-09-12T00:31:50.124994+0000","last_became_peered":"2024-09-12T00:31:50.124994+0000","last_unstale":"2024-09-12T01:26:27.801294+0000","last_undegraded":"2024-09-12T01:26:27.801294+0000","last_fullsized":"2024-09-12T01:26:27.801294+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:16.366629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":221,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'334","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.394849+0000","last_change":"2024-09-12T00:31:47.134711+0000","last_active":"2024-09-12T01:29:16.394849+0000","last_peered":"2024-09-12T01:29:16.394849+0000","last_clean":"2024-09-12T01:29:16.394849+0000","last_became_active":"2024-09-12T00:31:47.134398+0000","last_became_peered":"2024-09-12T00:31:47.134398+0000","last_unstale":"2024-09-12T01:29:16.394849+0000","last_undegraded":"2024-09-12T01:29:16.394849+0000","last_fullsized":"2024-09-12T01:29:16.394849+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:31.067474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788554,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":470,"num_read_kb":102268,"num_write":1066,"num_write_kb":44150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.501767+0000","last_change":"2024-09-12T00:31:52.152133+0000","last_active":"2024-09-12T01:25:34.501767+0000","last_peered":"2024-09-12T01:25:34.501767+0000","last_clean":"2024-09-12T01:25:34.501767+0000","last_became_active":"2024-09-12T00:31:52.151826+0000","last_became_peered":"2024-09-12T00:31:52.151826+0000","last_unstale":"2024-09-12T01:25:34.501767+0000","last_undegraded":"2024-09-12T01:25:34.501767+0000","last_fullsized":"2024-09-12T01:25:34.501767+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:53.712859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'301","reported_seq":902,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.946691+0000","last_change":"2024-09-12T00:31:54.162484+0000","last_active":"2024-09-12T01:29:15.946691+0000","last_peered":"2024-09-12T01:29:15.946691+0000","last_clean":"2024-09-12T01:29:15.946691+0000","last_became_active":"2024-09-12T00:31:54.162188+0000","last_became_peered":"2024-09-12T00:31:54.162188+0000","last_unstale":"2024-09-12T01:29:15.946691+0000","last_undegraded":"2024-09-12T01:29:15.946691+0000","last_fullsized":"2024-09-12T01:29:15.946691+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:59.208178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49464,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":505,"num_read_kb":1076,"num_write":398,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.603003+0000","last_change":"2024-09-12T00:31:56.168740+0000","last_active":"2024-09-12T01:25:39.603003+0000","last_peered":"2024-09-12T01:25:39.603003+0000","last_clean":"2024-09-12T01:25:39.603003+0000","last_became_active":"2024-09-12T00:31:56.168434+0000","last_became_peered":"2024-09-12T00:31:56.168434+0000","last_unstale":"2024-09-12T01:25:39.603003+0000","last_undegraded":"2024-09-12T01:25:39.603003+0000","last_fullsized":"2024-09-12T01:25:39.603003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:22.526791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'127","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.333302+0000","last_change":"2024-09-12T00:31:58.173821+0000","last_active":"2024-09-12T01:27:47.333302+0000","last_peered":"2024-09-12T01:27:47.333302+0000","last_clean":"2024-09-12T01:27:47.333302+0000","last_became_active":"2024-09-12T00:31:58.173552+0000","last_became_peered":"2024-09-12T00:31:58.173552+0000","last_unstale":"2024-09-12T01:27:47.333302+0000","last_undegraded":"2024-09-12T01:27:47.333302+0000","last_fullsized":"2024-09-12T01:27:47.333302+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:10.224892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":198,"num_write":331,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'107","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:30.776968+0000","last_change":"2024-09-12T00:31:50.133388+0000","last_active":"2024-09-12T01:25:30.776968+0000","last_peered":"2024-09-12T01:25:30.776968+0000","last_clean":"2024-09-12T01:25:30.776968+0000","last_became_active":"2024-09-12T00:31:50.133117+0000","last_became_peered":"2024-09-12T00:31:50.133117+0000","last_unstale":"2024-09-12T01:25:30.776968+0000","last_undegraded":"2024-09-12T01:25:30.776968+0000","last_fullsized":"2024-09-12T01:25:30.776968+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:46.615971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":426,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'425","reported_seq":1155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.434873+0000","last_change":"2024-09-12T00:31:47.127969+0000","last_active":"2024-09-12T01:29:16.434873+0000","last_peered":"2024-09-12T01:29:16.434873+0000","last_clean":"2024-09-12T01:29:16.434873+0000","last_became_active":"2024-09-12T00:31:47.127603+0000","last_became_peered":"2024-09-12T00:31:47.127603+0000","last_unstale":"2024-09-12T01:29:16.434873+0000","last_undegraded":"2024-09-12T01:29:16.434873+0000","last_fullsized":"2024-09-12T01:29:16.434873+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:19.029593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":834,"num_read_kb":29446,"num_write":1356,"num_write_kb":48637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718269+0000","last_change":"2024-09-12T00:31:52.152698+0000","last_active":"2024-09-12T01:25:34.718269+0000","last_peered":"2024-09-12T01:25:34.718269+0000","last_clean":"2024-09-12T01:25:34.718269+0000","last_became_active":"2024-09-12T00:31:52.152398+0000","last_became_peered":"2024-09-12T00:31:52.152398+0000","last_unstale":"2024-09-12T01:25:34.718269+0000","last_undegraded":"2024-09-12T01:25:34.718269+0000","last_fullsized":"2024-09-12T01:25:34.718269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:18.608839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'276","reported_seq":848,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.775167+0000","last_change":"2024-09-12T00:31:54.171666+0000","last_active":"2024-09-12T01:29:15.775167+0000","last_peered":"2024-09-12T01:29:15.775167+0000","last_clean":"2024-09-12T01:29:15.775167+0000","last_became_active":"2024-09-12T00:31:54.171386+0000","last_became_peered":"2024-09-12T00:31:54.171386+0000","last_unstale":"2024-09-12T01:29:15.775167+0000","last_undegraded":"2024-09-12T01:29:15.775167+0000","last_fullsized":"2024-09-12T01:29:15.775167+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:37.250983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46739,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":1088,"num_write":376,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:35.777911+0000","last_change":"2024-09-12T00:31:56.167578+0000","last_active":"2024-09-12T01:25:35.777911+0000","last_peered":"2024-09-12T01:25:35.777911+0000","last_clean":"2024-09-12T01:25:35.777911+0000","last_became_active":"2024-09-12T00:31:56.167213+0000","last_became_peered":"2024-09-12T00:31:56.167213+0000","last_unstale":"2024-09-12T01:25:35.777911+0000","last_undegraded":"2024-09-12T01:25:35.777911+0000","last_fullsized":"2024-09-12T01:25:35.777911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:56.884166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'120","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.353194+0000","last_change":"2024-09-12T00:31:50.140157+0000","last_active":"2024-09-12T01:26:44.353194+0000","last_peered":"2024-09-12T01:26:44.353194+0000","last_clean":"2024-09-12T01:26:44.353194+0000","last_became_active":"2024-09-12T00:31:50.139863+0000","last_became_peered":"2024-09-12T00:31:50.139863+0000","last_unstale":"2024-09-12T01:26:44.353194+0000","last_undegraded":"2024-09-12T01:26:44.353194+0000","last_fullsized":"2024-09-12T01:26:44.353194+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:39.011610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":466,"num_write":169,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'448","reported_seq":1143,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.447833+0000","last_change":"2024-09-12T00:31:47.133721+0000","last_active":"2024-09-12T01:29:16.447833+0000","last_peered":"2024-09-12T01:29:16.447833+0000","last_clean":"2024-09-12T01:29:16.447833+0000","last_became_active":"2024-09-12T00:31:47.133283+0000","last_became_peered":"2024-09-12T00:31:47.133283+0000","last_unstale":"2024-09-12T01:29:16.447833+0000","last_undegraded":"2024-09-12T01:29:16.447833+0000","last_fullsized":"2024-09-12T01:29:16.447833+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:13.162609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133704,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":743,"num_read_kb":14924,"num_write":1450,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.638064+0000","last_change":"2024-09-12T00:31:52.152988+0000","last_active":"2024-09-12T01:26:05.638064+0000","last_peered":"2024-09-12T01:26:05.638064+0000","last_clean":"2024-09-12T01:26:05.638064+0000","last_became_active":"2024-09-12T00:31:52.152676+0000","last_became_peered":"2024-09-12T00:31:52.152676+0000","last_unstale":"2024-09-12T01:26:05.638064+0000","last_undegraded":"2024-09-12T01:26:05.638064+0000","last_fullsized":"2024-09-12T01:26:05.638064+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:00.660120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'508","reported_seq":1139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.706065+0000","last_change":"2024-09-12T00:31:54.171588+0000","last_active":"2024-09-12T01:29:15.706065+0000","last_peered":"2024-09-12T01:29:15.706065+0000","last_clean":"2024-09-12T01:29:15.706065+0000","last_became_active":"2024-09-12T00:31:54.171225+0000","last_became_peered":"2024-09-12T00:31:54.171225+0000","last_unstale":"2024-09-12T01:29:15.706065+0000","last_undegraded":"2024-09-12T01:29:15.706065+0000","last_fullsized":"2024-09-12T01:29:15.706065+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:56.460340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95922,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":923,"num_read_kb":2207,"num_write":796,"num_write_kb":707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:29.494824+0000","last_change":"2024-09-12T00:31:56.176025+0000","last_active":"2024-09-12T01:24:29.494824+0000","last_peered":"2024-09-12T01:24:29.494824+0000","last_clean":"2024-09-12T01:24:29.494824+0000","last_became_active":"2024-09-12T00:31:56.175562+0000","last_became_peered":"2024-09-12T00:31:56.175562+0000","last_unstale":"2024-09-12T01:24:29.494824+0000","last_undegraded":"2024-09-12T01:24:29.494824+0000","last_fullsized":"2024-09-12T01:24:29.494824+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:07.085146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'142","reported_seq":641,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.598076+0000","last_change":"2024-09-12T00:31:58.183054+0000","last_active":"2024-09-12T01:27:47.598076+0000","last_peered":"2024-09-12T01:27:47.598076+0000","last_clean":"2024-09-12T01:27:47.598076+0000","last_became_active":"2024-09-12T00:31:58.182602+0000","last_became_peered":"2024-09-12T00:31:58.182602+0000","last_unstale":"2024-09-12T01:27:47.598076+0000","last_undegraded":"2024-09-12T01:27:47.598076+0000","last_fullsized":"2024-09-12T01:27:47.598076+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:54.264038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":164,"num_write":296,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'135","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501163+0000","last_change":"2024-09-12T00:31:50.132346+0000","last_active":"2024-09-12T01:26:08.501163+0000","last_peered":"2024-09-12T01:26:08.501163+0000","last_clean":"2024-09-12T01:26:08.501163+0000","last_became_active":"2024-09-12T00:31:50.132053+0000","last_became_peered":"2024-09-12T00:31:50.132053+0000","last_unstale":"2024-09-12T01:26:08.501163+0000","last_undegraded":"2024-09-12T01:26:08.501163+0000","last_fullsized":"2024-09-12T01:26:08.501163+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:42:29.446981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":637,"num_read_kb":540,"num_write":205,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'319","reported_seq":967,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.347660+0000","last_change":"2024-09-12T00:31:47.115298+0000","last_active":"2024-09-12T01:29:16.347660+0000","last_peered":"2024-09-12T01:29:16.347660+0000","last_clean":"2024-09-12T01:29:16.347660+0000","last_became_active":"2024-09-12T00:31:47.114966+0000","last_became_peered":"2024-09-12T00:31:47.114966+0000","last_unstale":"2024-09-12T01:29:16.347660+0000","last_undegraded":"2024-09-12T01:29:16.347660+0000","last_fullsized":"2024-09-12T01:29:16.347660+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:38.967213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279295,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":490,"num_read_kb":26176,"num_write":1107,"num_write_kb":27429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.504979+0000","last_change":"2024-09-12T00:31:52.154420+0000","last_active":"2024-09-12T01:26:04.504979+0000","last_peered":"2024-09-12T01:26:04.504979+0000","last_clean":"2024-09-12T01:26:04.504979+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:26:04.504979+0000","last_undegraded":"2024-09-12T01:26:04.504979+0000","last_fullsized":"2024-09-12T01:26:04.504979+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:52.675576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'293","reported_seq":881,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.825071+0000","last_change":"2024-09-12T00:31:54.166286+0000","last_active":"2024-09-12T01:29:15.825071+0000","last_peered":"2024-09-12T01:29:15.825071+0000","last_clean":"2024-09-12T01:29:15.825071+0000","last_became_active":"2024-09-12T00:31:54.165996+0000","last_became_peered":"2024-09-12T00:31:54.165996+0000","last_unstale":"2024-09-12T01:29:15.825071+0000","last_undegraded":"2024-09-12T01:29:15.825071+0000","last_fullsized":"2024-09-12T01:29:15.825071+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:34.576390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":488,"num_read_kb":1000,"num_write":400,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:27.483919+0000","last_change":"2024-09-12T00:31:56.171294+0000","last_active":"2024-09-12T01:24:27.483919+0000","last_peered":"2024-09-12T01:24:27.483919+0000","last_clean":"2024-09-12T01:24:27.483919+0000","last_became_active":"2024-09-12T00:31:56.170994+0000","last_became_peered":"2024-09-12T00:31:56.170994+0000","last_unstale":"2024-09-12T01:24:27.483919+0000","last_undegraded":"2024-09-12T01:24:27.483919+0000","last_fullsized":"2024-09-12T01:24:27.483919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:36.423772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'162","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:06.007997+0000","last_change":"2024-09-12T00:31:58.183946+0000","last_active":"2024-09-12T01:27:06.007997+0000","last_peered":"2024-09-12T01:27:06.007997+0000","last_clean":"2024-09-12T01:27:06.007997+0000","last_became_active":"2024-09-12T00:31:58.183625+0000","last_became_peered":"2024-09-12T00:31:58.183625+0000","last_unstale":"2024-09-12T01:27:06.007997+0000","last_undegraded":"2024-09-12T01:27:06.007997+0000","last_fullsized":"2024-09-12T01:27:06.007997+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:34.434376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2035,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":465,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'119","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:50.789826+0000","last_change":"2024-09-12T00:31:50.143762+0000","last_active":"2024-09-12T01:26:50.789826+0000","last_peered":"2024-09-12T01:26:50.789826+0000","last_clean":"2024-09-12T01:26:50.789826+0000","last_became_active":"2024-09-12T00:31:50.143427+0000","last_became_peered":"2024-09-12T00:31:50.143427+0000","last_unstale":"2024-09-12T01:26:50.789826+0000","last_undegraded":"2024-09-12T01:26:50.789826+0000","last_fullsized":"2024-09-12T01:26:50.789826+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:04.603054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":539,"num_read_kb":443,"num_write":196,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'364","reported_seq":1043,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.435319+0000","last_change":"2024-09-12T00:31:47.117996+0000","last_active":"2024-09-12T01:29:16.435319+0000","last_peered":"2024-09-12T01:29:16.435319+0000","last_clean":"2024-09-12T01:29:16.435319+0000","last_became_active":"2024-09-12T00:31:47.117631+0000","last_became_peered":"2024-09-12T00:31:47.117631+0000","last_unstale":"2024-09-12T01:29:16.435319+0000","last_undegraded":"2024-09-12T01:29:16.435319+0000","last_fullsized":"2024-09-12T01:29:16.435319+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:35.099357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":597,"num_read_kb":5850,"num_write":1220,"num_write_kb":26346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:24.494220+0000","last_change":"2024-09-12T00:31:52.152113+0000","last_active":"2024-09-12T01:24:24.494220+0000","last_peered":"2024-09-12T01:24:24.494220+0000","last_clean":"2024-09-12T01:24:24.494220+0000","last_became_active":"2024-09-12T00:31:52.151796+0000","last_became_peered":"2024-09-12T00:31:52.151796+0000","last_unstale":"2024-09-12T01:24:24.494220+0000","last_undegraded":"2024-09-12T01:24:24.494220+0000","last_fullsized":"2024-09-12T01:24:24.494220+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:30.115077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'312","reported_seq":893,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.924627+0000","last_change":"2024-09-12T00:31:54.171225+0000","last_active":"2024-09-12T01:29:14.924627+0000","last_peered":"2024-09-12T01:29:14.924627+0000","last_clean":"2024-09-12T01:29:14.924627+0000","last_became_active":"2024-09-12T00:31:54.170965+0000","last_became_peered":"2024-09-12T00:31:54.170965+0000","last_unstale":"2024-09-12T01:29:14.924627+0000","last_undegraded":"2024-09-12T01:29:14.924627+0000","last_fullsized":"2024-09-12T01:29:14.924627+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:10.738478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":509,"num_read_kb":1155,"num_write":420,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782663+0000","last_change":"2024-09-12T00:31:56.172806+0000","last_active":"2024-09-12T01:26:05.782663+0000","last_peered":"2024-09-12T01:26:05.782663+0000","last_clean":"2024-09-12T01:26:05.782663+0000","last_became_active":"2024-09-12T00:31:56.172337+0000","last_became_peered":"2024-09-12T00:31:56.172337+0000","last_unstale":"2024-09-12T01:26:05.782663+0000","last_undegraded":"2024-09-12T01:26:05.782663+0000","last_fullsized":"2024-09-12T01:26:05.782663+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:10.789777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'133","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.342581+0000","last_change":"2024-09-12T00:31:58.178826+0000","last_active":"2024-09-12T01:28:55.342581+0000","last_peered":"2024-09-12T01:28:55.342581+0000","last_clean":"2024-09-12T01:28:55.342581+0000","last_became_active":"2024-09-12T00:31:58.178565+0000","last_became_peered":"2024-09-12T00:31:58.178565+0000","last_unstale":"2024-09-12T01:28:55.342581+0000","last_undegraded":"2024-09-12T01:28:55.342581+0000","last_fullsized":"2024-09-12T01:28:55.342581+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:10.421354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":335,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'510","reported_seq":1278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:38.996474+0000","last_change":"2024-09-12T00:31:50.138366+0000","last_active":"2024-09-12T01:24:38.996474+0000","last_peered":"2024-09-12T01:24:38.996474+0000","last_clean":"2024-09-12T01:24:38.996474+0000","last_became_active":"2024-09-12T00:31:50.137671+0000","last_became_peered":"2024-09-12T00:31:50.137671+0000","last_unstale":"2024-09-12T01:24:38.996474+0000","last_undegraded":"2024-09-12T01:24:38.996474+0000","last_fullsized":"2024-09-12T01:24:38.996474+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:54.842903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2432,"num_read_kb":2072,"num_write":871,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'466","reported_seq":1274,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.447501+0000","last_change":"2024-09-12T00:31:47.130554+0000","last_active":"2024-09-12T01:29:16.447501+0000","last_peered":"2024-09-12T01:29:16.447501+0000","last_clean":"2024-09-12T01:29:16.447501+0000","last_became_active":"2024-09-12T00:31:47.130035+0000","last_became_peered":"2024-09-12T00:31:47.130035+0000","last_unstale":"2024-09-12T01:29:16.447501+0000","last_undegraded":"2024-09-12T01:29:16.447501+0000","last_fullsized":"2024-09-12T01:29:16.447501+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:20.320045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1077,"num_read_kb":24732,"num_write":1307,"num_write_kb":48327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:23.486245+0000","last_change":"2024-09-12T00:31:52.156699+0000","last_active":"2024-09-12T01:24:23.486245+0000","last_peered":"2024-09-12T01:24:23.486245+0000","last_clean":"2024-09-12T01:24:23.486245+0000","last_became_active":"2024-09-12T00:31:52.155279+0000","last_became_peered":"2024-09-12T00:31:52.155279+0000","last_unstale":"2024-09-12T01:24:23.486245+0000","last_undegraded":"2024-09-12T01:24:23.486245+0000","last_fullsized":"2024-09-12T01:24:23.486245+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:38.156587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'113","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.722904+0000","last_change":"2024-09-12T00:31:54.166092+0000","last_active":"2024-09-12T01:25:59.722904+0000","last_peered":"2024-09-12T01:25:59.722904+0000","last_clean":"2024-09-12T01:25:59.722904+0000","last_became_active":"2024-09-12T00:31:54.165779+0000","last_became_peered":"2024-09-12T00:31:54.165779+0000","last_unstale":"2024-09-12T01:25:59.722904+0000","last_undegraded":"2024-09-12T01:25:59.722904+0000","last_fullsized":"2024-09-12T01:25:59.722904+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:53.134965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":137,"num_write":154,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'763","reported_seq":2339,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.071399+0000","last_change":"2024-09-12T00:31:56.172869+0000","last_active":"2024-09-12T01:29:16.071399+0000","last_peered":"2024-09-12T01:29:16.071399+0000","last_clean":"2024-09-12T01:29:16.071399+0000","last_became_active":"2024-09-12T00:31:56.172551+0000","last_became_peered":"2024-09-12T00:31:56.172551+0000","last_unstale":"2024-09-12T01:29:16.071399+0000","last_undegraded":"2024-09-12T01:29:16.071399+0000","last_fullsized":"2024-09-12T01:29:16.071399+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:33.670974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'121","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:33.597265+0000","last_change":"2024-09-12T00:31:58.178960+0000","last_active":"2024-09-12T01:26:33.597265+0000","last_peered":"2024-09-12T01:26:33.597265+0000","last_clean":"2024-09-12T01:26:33.597265+0000","last_became_active":"2024-09-12T00:31:58.178671+0000","last_became_peered":"2024-09-12T00:31:58.178671+0000","last_unstale":"2024-09-12T01:26:33.597265+0000","last_undegraded":"2024-09-12T01:26:33.597265+0000","last_fullsized":"2024-09-12T01:26:33.597265+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:53.455583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'144","reported_seq":784,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:49.509418+0000","last_change":"2024-09-12T00:31:50.143687+0000","last_active":"2024-09-12T01:26:49.509418+0000","last_peered":"2024-09-12T01:26:49.509418+0000","last_clean":"2024-09-12T01:26:49.509418+0000","last_became_active":"2024-09-12T00:31:50.143377+0000","last_became_peered":"2024-09-12T00:31:50.143377+0000","last_unstale":"2024-09-12T01:26:49.509418+0000","last_undegraded":"2024-09-12T01:26:49.509418+0000","last_fullsized":"2024-09-12T01:26:49.509418+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:37.794802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":664,"num_read_kb":566,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'384","reported_seq":1101,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.479220+0000","last_change":"2024-09-12T00:31:47.129018+0000","last_active":"2024-09-12T01:29:16.479220+0000","last_peered":"2024-09-12T01:29:16.479220+0000","last_clean":"2024-09-12T01:29:16.479220+0000","last_became_active":"2024-09-12T00:31:47.128555+0000","last_became_peered":"2024-09-12T00:31:47.128555+0000","last_unstale":"2024-09-12T01:29:16.479220+0000","last_undegraded":"2024-09-12T01:29:16.479220+0000","last_fullsized":"2024-09-12T01:29:16.479220+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:57.399019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2058190,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":740,"num_read_kb":10967,"num_write":1262,"num_write_kb":23618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:24.594787+0000","last_change":"2024-09-12T00:31:52.151155+0000","last_active":"2024-09-12T01:24:24.594787+0000","last_peered":"2024-09-12T01:24:24.594787+0000","last_clean":"2024-09-12T01:24:24.594787+0000","last_became_active":"2024-09-12T00:31:52.150825+0000","last_became_peered":"2024-09-12T00:31:52.150825+0000","last_unstale":"2024-09-12T01:24:24.594787+0000","last_undegraded":"2024-09-12T01:24:24.594787+0000","last_fullsized":"2024-09-12T01:24:24.594787+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:11.561537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'344","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.278535+0000","last_change":"2024-09-12T00:31:54.169556+0000","last_active":"2024-09-12T01:29:15.278535+0000","last_peered":"2024-09-12T01:29:15.278535+0000","last_clean":"2024-09-12T01:29:15.278535+0000","last_became_active":"2024-09-12T00:31:54.169308+0000","last_became_peered":"2024-09-12T00:31:54.169308+0000","last_unstale":"2024-09-12T01:29:15.278535+0000","last_undegraded":"2024-09-12T01:29:15.278535+0000","last_fullsized":"2024-09-12T01:29:15.278535+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:17.921463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45185,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":558,"num_read_kb":1163,"num_write":446,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:08.492547+0000","last_change":"2024-09-12T00:31:56.173701+0000","last_active":"2024-09-12T01:25:08.492547+0000","last_peered":"2024-09-12T01:25:08.492547+0000","last_clean":"2024-09-12T01:25:08.492547+0000","last_became_active":"2024-09-12T00:31:56.173389+0000","last_became_peered":"2024-09-12T00:31:56.173389+0000","last_unstale":"2024-09-12T01:25:08.492547+0000","last_undegraded":"2024-09-12T01:25:08.492547+0000","last_fullsized":"2024-09-12T01:25:08.492547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:28.642695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'140","reported_seq":639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:34.516248+0000","last_change":"2024-09-12T00:31:58.183381+0000","last_active":"2024-09-12T01:27:34.516248+0000","last_peered":"2024-09-12T01:27:34.516248+0000","last_clean":"2024-09-12T01:27:34.516248+0000","last_became_active":"2024-09-12T00:31:58.183017+0000","last_became_peered":"2024-09-12T00:31:58.183017+0000","last_unstale":"2024-09-12T01:27:34.516248+0000","last_undegraded":"2024-09-12T01:27:34.516248+0000","last_fullsized":"2024-09-12T01:27:34.516248+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:38.690748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":129,"num_write":333,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'129","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.406393+0000","last_change":"2024-09-12T00:31:50.137190+0000","last_active":"2024-09-12T01:28:54.406393+0000","last_peered":"2024-09-12T01:28:54.406393+0000","last_clean":"2024-09-12T01:28:54.406393+0000","last_became_active":"2024-09-12T00:31:50.136941+0000","last_became_peered":"2024-09-12T00:31:50.136941+0000","last_unstale":"2024-09-12T01:28:54.406393+0000","last_undegraded":"2024-09-12T01:28:54.406393+0000","last_fullsized":"2024-09-12T01:28:54.406393+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:49.870575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":653,"num_read_kb":587,"num_write":190,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'341","reported_seq":987,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.460424+0000","last_change":"2024-09-12T00:31:47.133016+0000","last_active":"2024-09-12T01:29:16.460424+0000","last_peered":"2024-09-12T01:29:16.460424+0000","last_clean":"2024-09-12T01:29:16.460424+0000","last_became_active":"2024-09-12T00:31:47.131600+0000","last_became_peered":"2024-09-12T00:31:47.131600+0000","last_unstale":"2024-09-12T01:29:16.460424+0000","last_undegraded":"2024-09-12T01:29:16.460424+0000","last_fullsized":"2024-09-12T01:29:16.460424+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:24.795534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":495,"num_read_kb":43314,"num_write":1098,"num_write_kb":38822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:24.494193+0000","last_change":"2024-09-12T00:31:52.152831+0000","last_active":"2024-09-12T01:24:24.494193+0000","last_peered":"2024-09-12T01:24:24.494193+0000","last_clean":"2024-09-12T01:24:24.494193+0000","last_became_active":"2024-09-12T00:31:52.152537+0000","last_became_peered":"2024-09-12T00:31:52.152537+0000","last_unstale":"2024-09-12T01:24:24.494193+0000","last_undegraded":"2024-09-12T01:24:24.494193+0000","last_fullsized":"2024-09-12T01:24:24.494193+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:58.263055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'281","reported_seq":864,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.341577+0000","last_change":"2024-09-12T00:31:54.164435+0000","last_active":"2024-09-12T01:29:15.341577+0000","last_peered":"2024-09-12T01:29:15.341577+0000","last_clean":"2024-09-12T01:29:15.341577+0000","last_became_active":"2024-09-12T00:31:54.163977+0000","last_became_peered":"2024-09-12T00:31:54.163977+0000","last_unstale":"2024-09-12T01:29:15.341577+0000","last_undegraded":"2024-09-12T01:29:15.341577+0000","last_fullsized":"2024-09-12T01:29:15.341577+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:06.747649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44628,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":1027,"num_write":368,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.716184+0000","last_change":"2024-09-12T00:31:56.171991+0000","last_active":"2024-09-12T01:25:14.716184+0000","last_peered":"2024-09-12T01:25:14.716184+0000","last_clean":"2024-09-12T01:25:14.716184+0000","last_became_active":"2024-09-12T00:31:56.171306+0000","last_became_peered":"2024-09-12T00:31:56.171306+0000","last_unstale":"2024-09-12T01:25:14.716184+0000","last_undegraded":"2024-09-12T01:25:14.716184+0000","last_fullsized":"2024-09-12T01:25:14.716184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:32.961885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'124","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:53.708398+0000","last_change":"2024-09-12T00:31:58.183063+0000","last_active":"2024-09-12T01:26:53.708398+0000","last_peered":"2024-09-12T01:26:53.708398+0000","last_clean":"2024-09-12T01:26:53.708398+0000","last_became_active":"2024-09-12T00:31:58.182701+0000","last_became_peered":"2024-09-12T00:31:58.182701+0000","last_unstale":"2024-09-12T01:26:53.708398+0000","last_undegraded":"2024-09-12T01:26:53.708398+0000","last_fullsized":"2024-09-12T01:26:53.708398+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:26.910205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":215,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'42","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:10.774133+0000","last_change":"2024-09-12T00:31:50.137242+0000","last_active":"2024-09-12T01:25:10.774133+0000","last_peered":"2024-09-12T01:25:10.774133+0000","last_clean":"2024-09-12T01:25:10.774133+0000","last_became_active":"2024-09-12T00:31:50.136971+0000","last_became_peered":"2024-09-12T00:31:50.136971+0000","last_unstale":"2024-09-12T01:25:10.774133+0000","last_undegraded":"2024-09-12T01:25:10.774133+0000","last_fullsized":"2024-09-12T01:25:10.774133+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:43.613753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":180,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'353","reported_seq":1014,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.444029+0000","last_change":"2024-09-12T00:31:47.123731+0000","last_active":"2024-09-12T01:29:16.444029+0000","last_peered":"2024-09-12T01:29:16.444029+0000","last_clean":"2024-09-12T01:29:16.444029+0000","last_became_active":"2024-09-12T00:31:47.123001+0000","last_became_peered":"2024-09-12T00:31:47.123001+0000","last_unstale":"2024-09-12T01:29:16.444029+0000","last_undegraded":"2024-09-12T01:29:16.444029+0000","last_fullsized":"2024-09-12T01:29:16.444029+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:56.448580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3599074,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":39607,"num_write":1095,"num_write_kb":26742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.599267+0000","last_change":"2024-09-12T00:31:52.151290+0000","last_active":"2024-09-12T01:25:04.599267+0000","last_peered":"2024-09-12T01:25:04.599267+0000","last_clean":"2024-09-12T01:25:04.599267+0000","last_became_active":"2024-09-12T00:31:52.150969+0000","last_became_peered":"2024-09-12T00:31:52.150969+0000","last_unstale":"2024-09-12T01:25:04.599267+0000","last_undegraded":"2024-09-12T01:25:04.599267+0000","last_fullsized":"2024-09-12T01:25:04.599267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:12.373364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'257","reported_seq":815,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.791165+0000","last_change":"2024-09-12T00:31:54.170159+0000","last_active":"2024-09-12T01:29:14.791165+0000","last_peered":"2024-09-12T01:29:14.791165+0000","last_clean":"2024-09-12T01:29:14.791165+0000","last_became_active":"2024-09-12T00:31:54.169845+0000","last_became_peered":"2024-09-12T00:31:54.169845+0000","last_unstale":"2024-09-12T01:29:14.791165+0000","last_undegraded":"2024-09-12T01:29:14.791165+0000","last_fullsized":"2024-09-12T01:29:14.791165+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:44.500869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47509,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":435,"num_read_kb":1050,"num_write":360,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:29.710613+0000","last_change":"2024-09-12T00:31:56.171144+0000","last_active":"2024-09-12T01:24:29.710613+0000","last_peered":"2024-09-12T01:24:29.710613+0000","last_clean":"2024-09-12T01:24:29.710613+0000","last_became_active":"2024-09-12T00:31:56.170767+0000","last_became_peered":"2024-09-12T00:31:56.170767+0000","last_unstale":"2024-09-12T01:24:29.710613+0000","last_undegraded":"2024-09-12T01:24:29.710613+0000","last_fullsized":"2024-09-12T01:24:29.710613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:18.923254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'182","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:45.513528+0000","last_change":"2024-09-12T00:31:58.173318+0000","last_active":"2024-09-12T01:27:45.513528+0000","last_peered":"2024-09-12T01:27:45.513528+0000","last_clean":"2024-09-12T01:27:45.513528+0000","last_became_active":"2024-09-12T00:31:58.173049+0000","last_became_peered":"2024-09-12T00:31:58.173049+0000","last_unstale":"2024-09-12T01:27:45.513528+0000","last_undegraded":"2024-09-12T01:27:45.513528+0000","last_fullsized":"2024-09-12T01:27:45.513528+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:38.032229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1227,"num_read_kb":1215,"num_write":440,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'220","reported_seq":785,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:51.961896+0000","last_change":"2024-09-12T00:31:50.141286+0000","last_active":"2024-09-12T01:26:51.961896+0000","last_peered":"2024-09-12T01:26:51.961896+0000","last_clean":"2024-09-12T01:26:51.961896+0000","last_became_active":"2024-09-12T00:31:50.141009+0000","last_became_peered":"2024-09-12T00:31:50.141009+0000","last_unstale":"2024-09-12T01:26:51.961896+0000","last_undegraded":"2024-09-12T01:26:51.961896+0000","last_fullsized":"2024-09-12T01:26:51.961896+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:16.669109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":914,"num_read_kb":727,"num_write":339,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'391","reported_seq":1066,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.397714+0000","last_change":"2024-09-12T00:31:47.118759+0000","last_active":"2024-09-12T01:29:16.397714+0000","last_peered":"2024-09-12T01:29:16.397714+0000","last_clean":"2024-09-12T01:29:16.397714+0000","last_became_active":"2024-09-12T00:31:47.118434+0000","last_became_peered":"2024-09-12T00:31:47.118434+0000","last_unstale":"2024-09-12T01:29:16.397714+0000","last_undegraded":"2024-09-12T01:29:16.397714+0000","last_fullsized":"2024-09-12T01:29:16.397714+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:02.477229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":619,"num_read_kb":10821,"num_write":1247,"num_write_kb":40782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:18.494021+0000","last_change":"2024-09-12T00:31:52.149493+0000","last_active":"2024-09-12T01:25:18.494021+0000","last_peered":"2024-09-12T01:25:18.494021+0000","last_clean":"2024-09-12T01:25:18.494021+0000","last_became_active":"2024-09-12T00:31:52.148440+0000","last_became_peered":"2024-09-12T00:31:52.148440+0000","last_unstale":"2024-09-12T01:25:18.494021+0000","last_undegraded":"2024-09-12T01:25:18.494021+0000","last_fullsized":"2024-09-12T01:25:18.494021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:59.545517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'310","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.984948+0000","last_change":"2024-09-12T00:31:54.168195+0000","last_active":"2024-09-12T01:29:14.984948+0000","last_peered":"2024-09-12T01:29:14.984948+0000","last_clean":"2024-09-12T01:29:14.984948+0000","last_became_active":"2024-09-12T00:31:54.167915+0000","last_became_peered":"2024-09-12T00:31:54.167915+0000","last_unstale":"2024-09-12T01:29:14.984948+0000","last_undegraded":"2024-09-12T01:29:14.984948+0000","last_fullsized":"2024-09-12T01:29:14.984948+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:50.298831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44378,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":513,"num_read_kb":1106,"num_write":406,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:28.487167+0000","last_change":"2024-09-12T00:31:56.174946+0000","last_active":"2024-09-12T01:24:28.487167+0000","last_peered":"2024-09-12T01:24:28.487167+0000","last_clean":"2024-09-12T01:24:28.487167+0000","last_became_active":"2024-09-12T00:31:56.171654+0000","last_became_peered":"2024-09-12T00:31:56.171654+0000","last_unstale":"2024-09-12T01:24:28.487167+0000","last_undegraded":"2024-09-12T01:24:28.487167+0000","last_fullsized":"2024-09-12T01:24:28.487167+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:00.032668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'130","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.389173+0000","last_change":"2024-09-12T00:31:58.182334+0000","last_active":"2024-09-12T01:28:54.389173+0000","last_peered":"2024-09-12T01:28:54.389173+0000","last_clean":"2024-09-12T01:28:54.389173+0000","last_became_active":"2024-09-12T00:31:58.181864+0000","last_became_peered":"2024-09-12T00:31:58.181864+0000","last_unstale":"2024-09-12T01:28:54.389173+0000","last_undegraded":"2024-09-12T01:28:54.389173+0000","last_fullsized":"2024-09-12T01:28:54.389173+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:46.609359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":169,"num_write":329,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'138","reported_seq":710,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:53.705713+0000","last_change":"2024-09-12T00:31:50.124123+0000","last_active":"2024-09-12T01:26:53.705713+0000","last_peered":"2024-09-12T01:26:53.705713+0000","last_clean":"2024-09-12T01:26:53.705713+0000","last_became_active":"2024-09-12T00:31:50.123862+0000","last_became_peered":"2024-09-12T00:31:50.123862+0000","last_unstale":"2024-09-12T01:26:53.705713+0000","last_undegraded":"2024-09-12T01:26:53.705713+0000","last_fullsized":"2024-09-12T01:26:53.705713+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:52.021145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":471,"num_write":227,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'354","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.417774+0000","last_change":"2024-09-12T00:31:47.132671+0000","last_active":"2024-09-12T01:29:16.417774+0000","last_peered":"2024-09-12T01:29:16.417774+0000","last_clean":"2024-09-12T01:29:16.417774+0000","last_became_active":"2024-09-12T00:31:47.132236+0000","last_became_peered":"2024-09-12T00:31:47.132236+0000","last_unstale":"2024-09-12T01:29:16.417774+0000","last_undegraded":"2024-09-12T01:29:16.417774+0000","last_fullsized":"2024-09-12T01:29:16.417774+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:26.659884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":457,"num_read_kb":4332,"num_write":1030,"num_write_kb":17381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'142","reported_seq":730,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.781778+0000","last_change":"2024-09-12T00:31:50.140955+0000","last_active":"2024-09-12T01:26:00.781778+0000","last_peered":"2024-09-12T01:26:00.781778+0000","last_clean":"2024-09-12T01:26:00.781778+0000","last_became_active":"2024-09-12T00:31:50.140649+0000","last_became_peered":"2024-09-12T00:31:50.140649+0000","last_unstale":"2024-09-12T01:26:00.781778+0000","last_undegraded":"2024-09-12T01:26:00.781778+0000","last_fullsized":"2024-09-12T01:26:00.781778+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:11.915558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":475,"num_write":199,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'326","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.471271+0000","last_change":"2024-09-12T00:31:47.126483+0000","last_active":"2024-09-12T01:29:16.471271+0000","last_peered":"2024-09-12T01:29:16.471271+0000","last_clean":"2024-09-12T01:29:16.471271+0000","last_became_active":"2024-09-12T00:31:47.126093+0000","last_became_peered":"2024-09-12T00:31:47.126093+0000","last_unstale":"2024-09-12T01:29:16.471271+0000","last_undegraded":"2024-09-12T01:29:16.471271+0000","last_fullsized":"2024-09-12T01:29:16.471271+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:39.767220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":454,"num_read_kb":13702,"num_write":989,"num_write_kb":29796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'259","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:37.319605+0000","last_change":"2024-09-12T00:31:50.133329+0000","last_active":"2024-09-12T01:26:37.319605+0000","last_peered":"2024-09-12T01:26:37.319605+0000","last_clean":"2024-09-12T01:26:37.319605+0000","last_became_active":"2024-09-12T00:31:50.132976+0000","last_became_peered":"2024-09-12T00:31:50.132976+0000","last_unstale":"2024-09-12T01:26:37.319605+0000","last_undegraded":"2024-09-12T01:26:37.319605+0000","last_fullsized":"2024-09-12T01:26:37.319605+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:59.147279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1108,"num_read_kb":908,"num_write":394,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'354","reported_seq":1047,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.463268+0000","last_change":"2024-09-12T00:31:47.117320+0000","last_active":"2024-09-12T01:29:16.463268+0000","last_peered":"2024-09-12T01:29:16.463268+0000","last_clean":"2024-09-12T01:29:16.463268+0000","last_became_active":"2024-09-12T00:31:47.117000+0000","last_became_peered":"2024-09-12T00:31:47.117000+0000","last_unstale":"2024-09-12T01:29:16.463268+0000","last_undegraded":"2024-09-12T01:29:16.463268+0000","last_fullsized":"2024-09-12T01:29:16.463268+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:54.678203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138894,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":591,"num_read_kb":34967,"num_write":1161,"num_write_kb":18512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'188","reported_seq":833,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498610+0000","last_change":"2024-09-12T00:31:50.133892+0000","last_active":"2024-09-12T01:26:02.498610+0000","last_peered":"2024-09-12T01:26:02.498610+0000","last_clean":"2024-09-12T01:26:02.498610+0000","last_became_active":"2024-09-12T00:31:50.133634+0000","last_became_peered":"2024-09-12T00:31:50.133634+0000","last_unstale":"2024-09-12T01:26:02.498610+0000","last_undegraded":"2024-09-12T01:26:02.498610+0000","last_fullsized":"2024-09-12T01:26:02.498610+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:48.244378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":708,"num_write":275,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'366","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.459017+0000","last_change":"2024-09-12T00:31:47.134781+0000","last_active":"2024-09-12T01:29:16.459017+0000","last_peered":"2024-09-12T01:29:16.459017+0000","last_clean":"2024-09-12T01:29:16.459017+0000","last_became_active":"2024-09-12T00:31:47.132735+0000","last_became_peered":"2024-09-12T00:31:47.132735+0000","last_unstale":"2024-09-12T01:29:16.459017+0000","last_undegraded":"2024-09-12T01:29:16.459017+0000","last_fullsized":"2024-09-12T01:29:16.459017+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:17.832111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":462,"num_read_kb":13728,"num_write":961,"num_write_kb":25593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'130","reported_seq":731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501249+0000","last_change":"2024-09-12T00:31:50.139504+0000","last_active":"2024-09-12T01:26:17.501249+0000","last_peered":"2024-09-12T01:26:17.501249+0000","last_clean":"2024-09-12T01:26:17.501249+0000","last_became_active":"2024-09-12T00:31:50.138349+0000","last_became_peered":"2024-09-12T00:31:50.138349+0000","last_unstale":"2024-09-12T01:26:17.501249+0000","last_undegraded":"2024-09-12T01:26:17.501249+0000","last_fullsized":"2024-09-12T01:26:17.501249+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:43.103359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":530,"num_write":219,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'322","reported_seq":960,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.482112+0000","last_change":"2024-09-12T00:31:47.133424+0000","last_active":"2024-09-12T01:29:16.482112+0000","last_peered":"2024-09-12T01:29:16.482112+0000","last_clean":"2024-09-12T01:29:16.482112+0000","last_became_active":"2024-09-12T00:31:47.132959+0000","last_became_peered":"2024-09-12T00:31:47.132959+0000","last_unstale":"2024-09-12T01:29:16.482112+0000","last_undegraded":"2024-09-12T01:29:16.482112+0000","last_fullsized":"2024-09-12T01:29:16.482112+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:33.239107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170196,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":44221,"num_write":1049,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'150","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.559726+0000","last_change":"2024-09-12T00:31:50.131220+0000","last_active":"2024-09-12T01:26:02.559726+0000","last_peered":"2024-09-12T01:26:02.559726+0000","last_clean":"2024-09-12T01:26:02.559726+0000","last_became_active":"2024-09-12T00:31:50.130915+0000","last_became_peered":"2024-09-12T00:31:50.130915+0000","last_unstale":"2024-09-12T01:26:02.559726+0000","last_undegraded":"2024-09-12T01:26:02.559726+0000","last_fullsized":"2024-09-12T01:26:02.559726+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:53.785801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":628,"num_read_kb":507,"num_write":231,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'336","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.446852+0000","last_change":"2024-09-12T00:31:47.122497+0000","last_active":"2024-09-12T01:29:16.446852+0000","last_peered":"2024-09-12T01:29:16.446852+0000","last_clean":"2024-09-12T01:29:16.446852+0000","last_became_active":"2024-09-12T00:31:47.122164+0000","last_became_peered":"2024-09-12T00:31:47.122164+0000","last_unstale":"2024-09-12T01:29:16.446852+0000","last_undegraded":"2024-09-12T01:29:16.446852+0000","last_fullsized":"2024-09-12T01:29:16.446852+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:50.399458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170481,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":503,"num_read_kb":2267,"num_write":1137,"num_write_kb":17589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'295","reported_seq":938,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637163+0000","last_change":"2024-09-12T00:31:50.142581+0000","last_active":"2024-09-12T01:26:00.637163+0000","last_peered":"2024-09-12T01:26:00.637163+0000","last_clean":"2024-09-12T01:26:00.637163+0000","last_became_active":"2024-09-12T00:31:50.142283+0000","last_became_peered":"2024-09-12T00:31:50.142283+0000","last_unstale":"2024-09-12T01:26:00.637163+0000","last_undegraded":"2024-09-12T01:26:00.637163+0000","last_fullsized":"2024-09-12T01:26:00.637163+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:05.162707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1272,"num_read_kb":1039,"num_write":466,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'373","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.410053+0000","last_change":"2024-09-12T00:31:47.137276+0000","last_active":"2024-09-12T01:29:16.410053+0000","last_peered":"2024-09-12T01:29:16.410053+0000","last_clean":"2024-09-12T01:29:16.410053+0000","last_became_active":"2024-09-12T00:31:47.136789+0000","last_became_peered":"2024-09-12T00:31:47.136789+0000","last_unstale":"2024-09-12T01:29:16.410053+0000","last_undegraded":"2024-09-12T01:29:16.410053+0000","last_fullsized":"2024-09-12T01:29:16.410053+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:38.463665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":544,"num_read_kb":49646,"num_write":1113,"num_write_kb":37962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'129","reported_seq":747,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:02.423209+0000","last_change":"2024-09-12T00:31:50.141135+0000","last_active":"2024-09-12T01:27:02.423209+0000","last_peered":"2024-09-12T01:27:02.423209+0000","last_clean":"2024-09-12T01:27:02.423209+0000","last_became_active":"2024-09-12T00:31:50.140717+0000","last_became_peered":"2024-09-12T00:31:50.140717+0000","last_unstale":"2024-09-12T01:27:02.423209+0000","last_undegraded":"2024-09-12T01:27:02.423209+0000","last_fullsized":"2024-09-12T01:27:02.423209+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:42.301934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":623,"num_read_kb":519,"num_write":184,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'384","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.411791+0000","last_change":"2024-09-12T00:31:47.119263+0000","last_active":"2024-09-12T01:29:16.411791+0000","last_peered":"2024-09-12T01:29:16.411791+0000","last_clean":"2024-09-12T01:29:16.411791+0000","last_became_active":"2024-09-12T00:31:47.118928+0000","last_became_peered":"2024-09-12T00:31:47.118928+0000","last_unstale":"2024-09-12T01:29:16.411791+0000","last_undegraded":"2024-09-12T01:29:16.411791+0000","last_fullsized":"2024-09-12T01:29:16.411791+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:35.668011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65022,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":549,"num_read_kb":12208,"num_write":1218,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'133","reported_seq":731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:30.777076+0000","last_change":"2024-09-12T00:31:50.137312+0000","last_active":"2024-09-12T01:25:30.777076+0000","last_peered":"2024-09-12T01:25:30.777076+0000","last_clean":"2024-09-12T01:25:30.777076+0000","last_became_active":"2024-09-12T00:31:50.137034+0000","last_became_peered":"2024-09-12T00:31:50.137034+0000","last_unstale":"2024-09-12T01:25:30.777076+0000","last_undegraded":"2024-09-12T01:25:30.777076+0000","last_fullsized":"2024-09-12T01:25:30.777076+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:39.007332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":471,"num_write":187,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'394","reported_seq":1063,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.461631+0000","last_change":"2024-09-12T00:31:47.119956+0000","last_active":"2024-09-12T01:29:16.461631+0000","last_peered":"2024-09-12T01:29:16.461631+0000","last_clean":"2024-09-12T01:29:16.461631+0000","last_became_active":"2024-09-12T00:31:47.119180+0000","last_became_peered":"2024-09-12T00:31:47.119180+0000","last_unstale":"2024-09-12T01:29:16.461631+0000","last_undegraded":"2024-09-12T01:29:16.461631+0000","last_fullsized":"2024-09-12T01:29:16.461631+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:45.605525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2793702,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":603,"num_read_kb":71015,"num_write":1325,"num_write_kb":54526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'230","reported_seq":877,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.475928+0000","last_change":"2024-09-12T00:31:50.132875+0000","last_active":"2024-09-12T01:25:44.475928+0000","last_peered":"2024-09-12T01:25:44.475928+0000","last_clean":"2024-09-12T01:25:44.475928+0000","last_became_active":"2024-09-12T00:31:50.132605+0000","last_became_peered":"2024-09-12T00:31:50.132605+0000","last_unstale":"2024-09-12T01:25:44.475928+0000","last_undegraded":"2024-09-12T01:25:44.475928+0000","last_fullsized":"2024-09-12T01:25:44.475928+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:04.879402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":781,"num_write":348,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'337","reported_seq":998,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.478081+0000","last_change":"2024-09-12T00:31:47.132644+0000","last_active":"2024-09-12T01:29:16.478081+0000","last_peered":"2024-09-12T01:29:16.478081+0000","last_clean":"2024-09-12T01:29:16.478081+0000","last_became_active":"2024-09-12T00:31:47.131895+0000","last_became_peered":"2024-09-12T00:31:47.131895+0000","last_unstale":"2024-09-12T01:29:16.478081+0000","last_undegraded":"2024-09-12T01:29:16.478081+0000","last_fullsized":"2024-09-12T01:29:16.478081+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:28.078176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":1443,"num_write":1105,"num_write_kb":20830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'184","reported_seq":814,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499443+0000","last_change":"2024-09-12T00:31:50.139015+0000","last_active":"2024-09-12T01:26:07.499443+0000","last_peered":"2024-09-12T01:26:07.499443+0000","last_clean":"2024-09-12T01:26:07.499443+0000","last_became_active":"2024-09-12T00:31:50.138649+0000","last_became_peered":"2024-09-12T00:31:50.138649+0000","last_unstale":"2024-09-12T01:26:07.499443+0000","last_undegraded":"2024-09-12T01:26:07.499443+0000","last_fullsized":"2024-09-12T01:26:07.499443+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:22.461723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":823,"num_read_kb":682,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'312","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.386167+0000","last_change":"2024-09-12T00:31:47.129430+0000","last_active":"2024-09-12T01:29:16.386167+0000","last_peered":"2024-09-12T01:29:16.386167+0000","last_clean":"2024-09-12T01:29:16.386167+0000","last_became_active":"2024-09-12T00:31:47.128598+0000","last_became_peered":"2024-09-12T00:31:47.128598+0000","last_unstale":"2024-09-12T01:29:16.386167+0000","last_undegraded":"2024-09-12T01:29:16.386167+0000","last_fullsized":"2024-09-12T01:29:16.386167+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:35.351098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37912,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":412,"num_read_kb":69389,"num_write":1027,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'97","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.603987+0000","last_change":"2024-09-12T00:31:50.140136+0000","last_active":"2024-09-12T01:25:49.603987+0000","last_peered":"2024-09-12T01:25:49.603987+0000","last_clean":"2024-09-12T01:25:49.603987+0000","last_became_active":"2024-09-12T00:31:50.139830+0000","last_became_peered":"2024-09-12T00:31:50.139830+0000","last_unstale":"2024-09-12T01:25:49.603987+0000","last_undegraded":"2024-09-12T01:25:49.603987+0000","last_fullsized":"2024-09-12T01:25:49.603987+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:35.900525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":425,"num_read_kb":351,"num_write":136,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'293","reported_seq":922,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.400822+0000","last_change":"2024-09-12T00:31:47.125635+0000","last_active":"2024-09-12T01:29:16.400822+0000","last_peered":"2024-09-12T01:29:16.400822+0000","last_clean":"2024-09-12T01:29:16.400822+0000","last_became_active":"2024-09-12T00:31:47.122486+0000","last_became_peered":"2024-09-12T00:31:47.122486+0000","last_unstale":"2024-09-12T01:29:16.400822+0000","last_undegraded":"2024-09-12T01:29:16.400822+0000","last_fullsized":"2024-09-12T01:29:16.400822+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:37.759045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6842428,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":24154,"num_write":874,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'114","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.603977+0000","last_change":"2024-09-12T00:31:50.139699+0000","last_active":"2024-09-12T01:25:49.603977+0000","last_peered":"2024-09-12T01:25:49.603977+0000","last_clean":"2024-09-12T01:25:49.603977+0000","last_became_active":"2024-09-12T00:31:50.139416+0000","last_became_peered":"2024-09-12T00:31:50.139416+0000","last_unstale":"2024-09-12T01:25:49.603977+0000","last_undegraded":"2024-09-12T01:25:49.603977+0000","last_fullsized":"2024-09-12T01:25:49.603977+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:19.143533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":414,"num_write":177,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'362","reported_seq":1032,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.467424+0000","last_change":"2024-09-12T00:31:47.131206+0000","last_active":"2024-09-12T01:29:16.467424+0000","last_peered":"2024-09-12T01:29:16.467424+0000","last_clean":"2024-09-12T01:29:16.467424+0000","last_became_active":"2024-09-12T00:31:47.130353+0000","last_became_peered":"2024-09-12T00:31:47.130353+0000","last_unstale":"2024-09-12T01:29:16.467424+0000","last_undegraded":"2024-09-12T01:29:16.467424+0000","last_fullsized":"2024-09-12T01:29:16.467424+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:29.108085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288069,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":8753,"num_write":1192,"num_write_kb":21611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'161","reported_seq":764,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:50.780274+0000","last_change":"2024-09-12T00:31:50.140996+0000","last_active":"2024-09-12T01:25:50.780274+0000","last_peered":"2024-09-12T01:25:50.780274+0000","last_clean":"2024-09-12T01:25:50.780274+0000","last_became_active":"2024-09-12T00:31:50.140705+0000","last_became_peered":"2024-09-12T00:31:50.140705+0000","last_unstale":"2024-09-12T01:25:50.780274+0000","last_undegraded":"2024-09-12T01:25:50.780274+0000","last_fullsized":"2024-09-12T01:25:50.780274+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:23.070768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":620,"num_write":277,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'387","reported_seq":1105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.452683+0000","last_change":"2024-09-12T00:31:47.120623+0000","last_active":"2024-09-12T01:29:16.452683+0000","last_peered":"2024-09-12T01:29:16.452683+0000","last_clean":"2024-09-12T01:29:16.452683+0000","last_became_active":"2024-09-12T00:31:47.120303+0000","last_became_peered":"2024-09-12T00:31:47.120303+0000","last_unstale":"2024-09-12T01:29:16.452683+0000","last_undegraded":"2024-09-12T01:29:16.452683+0000","last_fullsized":"2024-09-12T01:29:16.452683+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:03.740846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493090,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":704,"num_read_kb":61137,"num_write":1132,"num_write_kb":48224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'210","reported_seq":856,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:38.380401+0000","last_change":"2024-09-12T00:31:50.134000+0000","last_active":"2024-09-12T01:26:38.380401+0000","last_peered":"2024-09-12T01:26:38.380401+0000","last_clean":"2024-09-12T01:26:38.380401+0000","last_became_active":"2024-09-12T00:31:50.133698+0000","last_became_peered":"2024-09-12T00:31:50.133698+0000","last_unstale":"2024-09-12T01:26:38.380401+0000","last_undegraded":"2024-09-12T01:26:38.380401+0000","last_fullsized":"2024-09-12T01:26:38.380401+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:03.963890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":883,"num_write":372,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'279","reported_seq":972,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.446827+0000","last_change":"2024-09-12T00:31:47.118141+0000","last_active":"2024-09-12T01:29:16.446827+0000","last_peered":"2024-09-12T01:29:16.446827+0000","last_clean":"2024-09-12T01:29:16.446827+0000","last_became_active":"2024-09-12T00:31:47.117753+0000","last_became_peered":"2024-09-12T00:31:47.117753+0000","last_unstale":"2024-09-12T01:29:16.446827+0000","last_undegraded":"2024-09-12T01:29:16.446827+0000","last_fullsized":"2024-09-12T01:29:16.446827+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:09.782299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":578,"num_read_kb":553,"num_write":1003,"num_write_kb":11415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'4099","reported_seq":4699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605612+0000","last_change":"2024-09-12T00:31:50.145049+0000","last_active":"2024-09-12T01:26:04.605612+0000","last_peered":"2024-09-12T01:26:04.605612+0000","last_clean":"2024-09-12T01:26:04.605612+0000","last_became_active":"2024-09-12T00:31:50.144782+0000","last_became_peered":"2024-09-12T00:31:50.144782+0000","last_unstale":"2024-09-12T01:26:04.605612+0000","last_undegraded":"2024-09-12T01:26:04.605612+0000","last_fullsized":"2024-09-12T01:26:04.605612+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:19.062901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16473,"num_read_kb":13736,"num_write":6146,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'355","reported_seq":1111,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.455586+0000","last_change":"2024-09-12T00:32:23.829074+0000","last_active":"2024-09-12T01:29:16.455586+0000","last_peered":"2024-09-12T01:29:16.455586+0000","last_clean":"2024-09-12T01:29:16.455586+0000","last_became_active":"2024-09-12T00:32:23.828547+0000","last_became_peered":"2024-09-12T00:32:23.828547+0000","last_unstale":"2024-09-12T01:29:16.455586+0000","last_undegraded":"2024-09-12T01:29:16.455586+0000","last_fullsized":"2024-09-12T01:29:16.455586+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:03.711044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2792674,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":658,"num_read_kb":184067,"num_write":1127,"num_write_kb":52781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"265'313","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.462945+0000","last_change":"2024-09-12T00:31:47.123419+0000","last_active":"2024-09-12T01:29:16.462945+0000","last_peered":"2024-09-12T01:29:16.462945+0000","last_clean":"2024-09-12T01:29:16.462945+0000","last_became_active":"2024-09-12T00:31:47.123083+0000","last_became_peered":"2024-09-12T00:31:47.123083+0000","last_unstale":"2024-09-12T01:29:16.462945+0000","last_undegraded":"2024-09-12T01:29:16.462945+0000","last_fullsized":"2024-09-12T01:29:16.462945+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:12.361365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1292330,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":432,"num_read_kb":16599,"num_write":993,"num_write_kb":37945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'178","reported_seq":753,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:18.494115+0000","last_change":"2024-09-12T00:31:50.145133+0000","last_active":"2024-09-12T01:25:18.494115+0000","last_peered":"2024-09-12T01:25:18.494115+0000","last_clean":"2024-09-12T01:25:18.494115+0000","last_became_active":"2024-09-12T00:31:50.144850+0000","last_became_peered":"2024-09-12T00:31:50.144850+0000","last_unstale":"2024-09-12T01:25:18.494115+0000","last_undegraded":"2024-09-12T01:25:18.494115+0000","last_fullsized":"2024-09-12T01:25:18.494115+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:11.930581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":724,"num_read_kb":585,"num_write":260,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'386","reported_seq":1042,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.409028+0000","last_change":"2024-09-12T00:31:47.132633+0000","last_active":"2024-09-12T01:29:16.409028+0000","last_peered":"2024-09-12T01:29:16.409028+0000","last_clean":"2024-09-12T01:29:16.409028+0000","last_became_active":"2024-09-12T00:31:47.132149+0000","last_became_peered":"2024-09-12T00:31:47.132149+0000","last_unstale":"2024-09-12T01:29:16.409028+0000","last_undegraded":"2024-09-12T01:29:16.409028+0000","last_fullsized":"2024-09-12T01:29:16.409028+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:46.806806+0000","last_clean_scrub_stamp":"2024-09-12T00:31:46.806806+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:43.540773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":304,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":582,"num_read_kb":13776,"num_write":1287,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'126","reported_seq":749,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.598790+0000","last_change":"2024-09-12T00:31:50.137590+0000","last_active":"2024-09-12T01:24:59.598790+0000","last_peered":"2024-09-12T01:24:59.598790+0000","last_clean":"2024-09-12T01:24:59.598790+0000","last_became_active":"2024-09-12T00:31:50.137283+0000","last_became_peered":"2024-09-12T00:31:50.137283+0000","last_unstale":"2024-09-12T01:24:59.598790+0000","last_undegraded":"2024-09-12T01:24:59.598790+0000","last_fullsized":"2024-09-12T01:24:59.598790+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:36.135953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":583,"num_read_kb":491,"num_write":192,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5593,"num_read_kb":3949,"num_write":1897,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1068,"ondisk_log_size":1068,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15046,"num_read_kb":14700,"num_write":16713,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1460,"ondisk_log_size":1460,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1527208,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":18236,"num_read_kb":37365,"num_write":15267,"num_write_kb":11724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1918,"ondisk_log_size":1918,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102878,"num_read_kb":85467,"num_write":37260,"num_write_kb":18832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3662,"ondisk_log_size":3662,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":78246710,"num_objects":378,"num_object_clones":0,"num_object_copies":1134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":378,"num_whiteouts":0,"num_read":36067,"num_read_kb":1971130,"num_write":71284,"num_write_kb":2047906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":119279616,"data_stored":119279616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3444,"ondisk_log_size":3444,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":176023,"num_write":154,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":175285,"num_write":154,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477436,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":217496,"kb_used_data":15580,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94154344,"statfs":{"total":96636764160,"available":96414048256,"internally_reserved":0,"allocated":15953920,"data_stored":13969939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719477435,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111876,"kb_used_data":18292,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94259964,"statfs":{"total":96636764160,"available":96522203136,"internally_reserved":0,"allocated":18731008,"data_stored":16734053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95812038},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,2],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510141,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259996,"kb_used_data":21836,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94111844,"statfs":{"total":96636764160,"available":96370528256,"internally_reserved":0,"allocated":22360064,"data_stored":20343157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":243726791},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510140,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152868,"kb_used_data":27152,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94218972,"statfs":{"total":96636764160,"available":96480227328,"internally_reserved":0,"allocated":27803648,"data_stored":25815269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1],"upper_bound":4},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510140,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":10116,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":10358784,"data_stored":8346083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510138,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120140,"kb_used_data":16624,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94251700,"statfs":{"total":96636764160,"available":96513740800,"internally_reserved":0,"allocated":17022976,"data_stored":15000873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542841,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":206132,"kb_used_data":22256,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94165708,"statfs":{"total":96636764160,"available":96425684992,"internally_reserved":0,"allocated":22790144,"data_stored":20790314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575546,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":270740,"kb_used_data":18836,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94101100,"statfs":{"total":96636764160,"available":96359526400,"internally_reserved":0,"allocated":19288064,"data_stored":17276630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12771328,"data_stored":12771328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5529600,"data_stored":5529600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23588864,"data_stored":23588864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18116608,"data_stored":18116608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18563072,"data_stored":18563072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14458880,"data_stored":14458880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14508032,"data_stored":14508032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11743232,"data_stored":11743232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:29:23.363 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.364 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.364 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.364 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.364 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.364 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.364 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.365 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.365 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.365 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.365 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.365 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.365 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.365 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.365 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.365 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.366 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.366 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.366 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.366 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.366 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.366 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.366 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.366 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.366 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.367 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.367 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.367 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.367 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.367 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.367 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.367 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.367 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.367 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.368 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.368 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.368 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.368 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.368 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.368 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.368 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.368 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.368 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.369 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.369 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.369 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.369 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.369 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.369 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.369 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.369 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.369 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.370 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.370 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.370 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.370 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.370 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.370 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.370 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.370 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.370 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.371 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.371 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.371 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.371 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.371 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.371 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.371 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.371 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.371 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.372 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.372 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.372 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.372 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.372 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.372 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.372 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.372 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.373 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.373 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.373 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.373 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.373 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.373 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.373 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.373 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.373 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.374 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.374 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.374 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.374 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.374 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.374 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.374 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.374 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.374 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.375 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.375 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.375 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.375 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.375 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.375 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.375 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.375 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.375 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.376 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.376 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.376 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.376 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.376 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.376 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.376 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.376 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.376 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.377 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.377 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.377 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.377 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.377 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.377 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.377 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.377 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.377 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.378 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.378 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.378 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.378 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.378 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.378 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.378 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.378 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.378 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.379 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.379 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.379 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.379 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.379 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.379 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.379 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.379 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.379 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.380 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.380 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.380 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.380 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.380 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.380 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.380 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.380 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.381 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.381 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.381 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.381 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.381 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.381 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.381 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.381 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.381 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.382 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.382 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.382 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.382 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.382 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.382 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.382 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.382 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.383 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.383 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.383 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.383 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.383 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.383 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.383 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.383 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.383 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.383 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.384 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.384 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.384 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.384 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.384 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.384 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.384 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.384 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.385 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.385 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.385 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.385 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.385 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.385 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.385 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.385 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.385 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.386 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.386 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.386 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.386 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.386 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.386 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.386 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.386 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.386 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.387 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.387 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.387 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.387 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.387 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.387 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.387 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.387 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.387 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.388 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.388 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.388 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.388 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.388 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.388 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.388 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.388 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.388 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.389 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.389 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.389 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.389 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.389 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.389 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.389 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.389 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.390 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.390 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-12T00:31:28.736382+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=28, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.390 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:31:35.763180+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.390 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.390 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.390 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.390 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.390 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.390 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.391 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T00:31:35.763180+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.391 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.391 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.391 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.391 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.391 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.391 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.391 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T00:31:35.763180+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.391 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.392 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.392 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.392 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.392 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.392 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.392 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T00:31:35.763180+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.392 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.392 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.392 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.393 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.393 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.393 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.393 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.393 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T00:31:35.763180+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.393 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.393 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.393 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.393 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.394 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.394 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.394 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:31:35.763180+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.394 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.394 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.394 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.394 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.394 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.394 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.395 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T00:31:35.763180+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.395 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.395 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.395 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.395 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.395 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.395 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.395 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:31:35.763180+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=35, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.395 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.396 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.396 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.396 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.396 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.396 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.396 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.396 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.396 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.396 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.397 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.397 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.397 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.397 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.397 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.397 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.397 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.397 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.397 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.398 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.398 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.398 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.398 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.398 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.398 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.400 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.400 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.400 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.400 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.401 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.401 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.401 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.401 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.401 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.401 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.401 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.401 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.401 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.402 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.402 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.402 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.402 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.402 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.402 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.402 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.402 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.402 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.403 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.403 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.403 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.403 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.403 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.403 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.403 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.403 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.403 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.404 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.404 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.404 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.404 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.404 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.404 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.404 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.404 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.404 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.405 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.405 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.405 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.405 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.405 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.405 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.405 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.405 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.405 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.406 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.406 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.406 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.406 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.406 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.406 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.406 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.406 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.406 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.407 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.407 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.407 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.407 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.407 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.407 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.407 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.407 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.407 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.408 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.408 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.408 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.408 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.408 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.408 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.408 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.408 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.408 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.409 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.409 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.409 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.409 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.409 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.409 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.409 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.409 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.409 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.410 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:31:46.806806+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.410 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:23.410 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:29:43.411 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:29:43.767 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:29:43.780 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T01:29:43.782 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":2005,"stamp":"2024-09-12T01:29:41.859351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80381543,"num_objects":728,"num_object_clones":0,"num_object_copies":1834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":180567,"num_read_kb":2466850,"num_write":142872,"num_write_kb":2319609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":545532,"num_omap_keys":1321,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12382,"ondisk_log_size":12382,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1640996,"kb_used_data":150692,"kb_used_omap":12,"kb_used_meta":1490163,"kb_avail":753333724,"statfs":{"total":773094113280,"available":771413733376,"internally_reserved":0,"allocated":154308608,"data_stored":138276318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1525927472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":539101,"num_omap_keys":1292,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005590"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.506005+0000","last_change":"2024-09-12T01:04:13.467817+0000","last_active":"2024-09-12T01:26:44.506005+0000","last_peered":"2024-09-12T01:26:44.506005+0000","last_clean":"2024-09-12T01:26:44.506005+0000","last_became_active":"2024-09-12T01:04:13.467533+0000","last_became_peered":"2024-09-12T01:04:13.467533+0000","last_unstale":"2024-09-12T01:26:44.506005+0000","last_undegraded":"2024-09-12T01:26:44.506005+0000","last_fullsized":"2024-09-12T01:26:44.506005+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:05:07.938395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:44.523656+0000","last_change":"2024-09-12T00:48:45.303400+0000","last_active":"2024-09-12T01:28:44.523656+0000","last_peered":"2024-09-12T01:28:44.523656+0000","last_clean":"2024-09-12T01:28:44.523656+0000","last_became_active":"2024-09-12T00:48:45.303088+0000","last_became_peered":"2024-09-12T00:48:45.303088+0000","last_unstale":"2024-09-12T01:28:44.523656+0000","last_undegraded":"2024-09-12T01:28:44.523656+0000","last_fullsized":"2024-09-12T01:28:44.523656+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:39.588987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.784398+0000","last_change":"2024-09-12T00:48:42.290755+0000","last_active":"2024-09-12T01:26:15.784398+0000","last_peered":"2024-09-12T01:26:15.784398+0000","last_clean":"2024-09-12T01:26:15.784398+0000","last_became_active":"2024-09-12T00:48:42.290471+0000","last_became_peered":"2024-09-12T00:48:42.290471+0000","last_unstale":"2024-09-12T01:26:15.784398+0000","last_undegraded":"2024-09-12T01:26:15.784398+0000","last_fullsized":"2024-09-12T01:26:15.784398+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:55.297347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'15","reported_seq":91,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:38.496977+0000","last_change":"2024-09-12T00:46:03.918513+0000","last_active":"2024-09-12T01:25:38.496977+0000","last_peered":"2024-09-12T01:25:38.496977+0000","last_clean":"2024-09-12T01:25:38.496977+0000","last_became_active":"2024-09-12T00:46:03.918235+0000","last_became_peered":"2024-09-12T00:46:03.918235+0000","last_unstale":"2024-09-12T01:25:38.496977+0000","last_undegraded":"2024-09-12T01:25:38.496977+0000","last_fullsized":"2024-09-12T01:25:38.496977+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:35.498415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":51,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.643708+0000","last_change":"2024-09-12T01:04:13.463924+0000","last_active":"2024-09-12T01:26:45.643708+0000","last_peered":"2024-09-12T01:26:45.643708+0000","last_clean":"2024-09-12T01:26:45.643708+0000","last_became_active":"2024-09-12T01:04:13.463645+0000","last_became_peered":"2024-09-12T01:04:13.463645+0000","last_unstale":"2024-09-12T01:26:45.643708+0000","last_undegraded":"2024-09-12T01:26:45.643708+0000","last_fullsized":"2024-09-12T01:26:45.643708+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:54.509681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505992+0000","last_change":"2024-09-12T00:48:45.307402+0000","last_active":"2024-09-12T01:26:14.505992+0000","last_peered":"2024-09-12T01:26:14.505992+0000","last_clean":"2024-09-12T01:26:14.505992+0000","last_became_active":"2024-09-12T00:48:45.307070+0000","last_became_peered":"2024-09-12T00:48:45.307070+0000","last_unstale":"2024-09-12T01:26:14.505992+0000","last_undegraded":"2024-09-12T01:26:14.505992+0000","last_fullsized":"2024-09-12T01:26:14.505992+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:35.964072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:12.500496+0000","last_change":"2024-09-12T00:48:42.297130+0000","last_active":"2024-09-12T01:26:12.500496+0000","last_peered":"2024-09-12T01:26:12.500496+0000","last_clean":"2024-09-12T01:26:12.500496+0000","last_became_active":"2024-09-12T00:48:42.296820+0000","last_became_peered":"2024-09-12T00:48:42.296820+0000","last_unstale":"2024-09-12T01:26:12.500496+0000","last_undegraded":"2024-09-12T01:26:12.500496+0000","last_fullsized":"2024-09-12T01:26:12.500496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:03.334198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'17","reported_seq":98,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:18.502535+0000","last_change":"2024-09-12T00:46:03.920083+0000","last_active":"2024-09-12T01:26:18.502535+0000","last_peered":"2024-09-12T01:26:18.502535+0000","last_clean":"2024-09-12T01:26:18.502535+0000","last_became_active":"2024-09-12T00:46:03.919803+0000","last_became_peered":"2024-09-12T00:46:03.919803+0000","last_unstale":"2024-09-12T01:26:18.502535+0000","last_undegraded":"2024-09-12T01:26:18.502535+0000","last_fullsized":"2024-09-12T01:26:18.502535+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:54.982016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":60,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.605056+0000","last_change":"2024-09-12T01:04:13.470732+0000","last_active":"2024-09-12T01:25:59.605056+0000","last_peered":"2024-09-12T01:25:59.605056+0000","last_clean":"2024-09-12T01:25:59.605056+0000","last_became_active":"2024-09-12T01:04:13.470465+0000","last_became_peered":"2024-09-12T01:04:13.470465+0000","last_unstale":"2024-09-12T01:25:59.605056+0000","last_undegraded":"2024-09-12T01:25:59.605056+0000","last_fullsized":"2024-09-12T01:25:59.605056+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:03.442325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'8","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:22.520613+0000","last_change":"2024-09-12T00:48:45.318707+0000","last_active":"2024-09-12T01:28:22.520613+0000","last_peered":"2024-09-12T01:28:22.520613+0000","last_clean":"2024-09-12T01:28:22.520613+0000","last_became_active":"2024-09-12T00:48:45.318423+0000","last_became_peered":"2024-09-12T00:48:45.318423+0000","last_unstale":"2024-09-12T01:28:22.520613+0000","last_undegraded":"2024-09-12T01:28:22.520613+0000","last_fullsized":"2024-09-12T01:28:22.520613+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:02.110177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4098,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.808894+0000","last_change":"2024-09-12T00:48:42.292914+0000","last_active":"2024-09-12T01:28:55.808894+0000","last_peered":"2024-09-12T01:28:55.808894+0000","last_clean":"2024-09-12T01:28:55.808894+0000","last_became_active":"2024-09-12T00:48:42.292607+0000","last_became_peered":"2024-09-12T00:48:42.292607+0000","last_unstale":"2024-09-12T01:28:55.808894+0000","last_undegraded":"2024-09-12T01:28:55.808894+0000","last_fullsized":"2024-09-12T01:28:55.808894+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:07.172445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'33","reported_seq":141,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.638048+0000","last_change":"2024-09-12T00:46:03.918495+0000","last_active":"2024-09-12T01:26:05.638048+0000","last_peered":"2024-09-12T01:26:05.638048+0000","last_clean":"2024-09-12T01:26:05.638048+0000","last_became_active":"2024-09-12T00:46:03.918204+0000","last_became_peered":"2024-09-12T00:46:03.918204+0000","last_unstale":"2024-09-12T01:26:05.638048+0000","last_undegraded":"2024-09-12T01:26:05.638048+0000","last_fullsized":"2024-09-12T01:26:05.638048+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:39.227048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":133,"num_write":46,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499343+0000","last_change":"2024-09-12T01:04:13.465355+0000","last_active":"2024-09-12T01:26:07.499343+0000","last_peered":"2024-09-12T01:26:07.499343+0000","last_clean":"2024-09-12T01:26:07.499343+0000","last_became_active":"2024-09-12T01:04:13.465081+0000","last_became_peered":"2024-09-12T01:04:13.465081+0000","last_unstale":"2024-09-12T01:26:07.499343+0000","last_undegraded":"2024-09-12T01:26:07.499343+0000","last_fullsized":"2024-09-12T01:26:07.499343+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:11.393872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:57.507200+0000","last_change":"2024-09-12T00:48:45.315792+0000","last_active":"2024-09-12T01:26:57.507200+0000","last_peered":"2024-09-12T01:26:57.507200+0000","last_clean":"2024-09-12T01:26:57.507200+0000","last_became_active":"2024-09-12T00:48:45.314837+0000","last_became_peered":"2024-09-12T00:48:45.314837+0000","last_unstale":"2024-09-12T01:26:57.507200+0000","last_undegraded":"2024-09-12T01:26:57.507200+0000","last_fullsized":"2024-09-12T01:26:57.507200+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:45.469413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'10","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.734028+0000","last_change":"2024-09-12T00:48:42.290832+0000","last_active":"2024-09-12T01:29:14.734028+0000","last_peered":"2024-09-12T01:29:14.734028+0000","last_clean":"2024-09-12T01:29:14.734028+0000","last_became_active":"2024-09-12T00:48:42.290570+0000","last_became_peered":"2024-09-12T00:48:42.290570+0000","last_unstale":"2024-09-12T01:29:14.734028+0000","last_undegraded":"2024-09-12T01:29:14.734028+0000","last_fullsized":"2024-09-12T01:29:14.734028+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:11.754613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":15,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"262'57","reported_seq":245,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.638031+0000","last_change":"2024-09-12T00:46:03.912889+0000","last_active":"2024-09-12T01:26:05.638031+0000","last_peered":"2024-09-12T01:26:05.638031+0000","last_clean":"2024-09-12T01:26:05.638031+0000","last_became_active":"2024-09-12T00:46:03.912603+0000","last_became_peered":"2024-09-12T00:46:03.912603+0000","last_unstale":"2024-09-12T01:26:05.638031+0000","last_undegraded":"2024-09-12T01:26:05.638031+0000","last_fullsized":"2024-09-12T01:26:05.638031+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:41.505661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":263,"num_write":69,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:20.785335+0000","last_change":"2024-09-12T01:04:13.459054+0000","last_active":"2024-09-12T01:26:20.785335+0000","last_peered":"2024-09-12T01:26:20.785335+0000","last_clean":"2024-09-12T01:26:20.785335+0000","last_became_active":"2024-09-12T01:04:13.458781+0000","last_became_peered":"2024-09-12T01:04:13.458781+0000","last_unstale":"2024-09-12T01:26:20.785335+0000","last_undegraded":"2024-09-12T01:26:20.785335+0000","last_fullsized":"2024-09-12T01:26:20.785335+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:22.643443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'5","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:09.496309+0000","last_change":"2024-09-12T00:48:45.318968+0000","last_active":"2024-09-12T01:25:09.496309+0000","last_peered":"2024-09-12T01:25:09.496309+0000","last_clean":"2024-09-12T01:25:09.496309+0000","last_became_active":"2024-09-12T00:48:45.318608+0000","last_became_peered":"2024-09-12T00:48:45.318608+0000","last_unstale":"2024-09-12T01:25:09.496309+0000","last_undegraded":"2024-09-12T01:25:09.496309+0000","last_fullsized":"2024-09-12T01:25:09.496309+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:29.993435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"265'11","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.109667+0000","last_change":"2024-09-12T00:48:42.298222+0000","last_active":"2024-09-12T01:29:15.109667+0000","last_peered":"2024-09-12T01:29:15.109667+0000","last_clean":"2024-09-12T01:29:15.109667+0000","last_became_active":"2024-09-12T00:48:42.297952+0000","last_became_peered":"2024-09-12T00:48:42.297952+0000","last_unstale":"2024-09-12T01:29:15.109667+0000","last_undegraded":"2024-09-12T01:29:15.109667+0000","last_fullsized":"2024-09-12T01:29:15.109667+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:49.640614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16432,"num_write":11,"num_write_kb":16432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'28","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.637984+0000","last_change":"2024-09-12T00:46:03.916594+0000","last_active":"2024-09-12T01:26:05.637984+0000","last_peered":"2024-09-12T01:26:05.637984+0000","last_clean":"2024-09-12T01:26:05.637984+0000","last_became_active":"2024-09-12T00:46:03.915917+0000","last_became_peered":"2024-09-12T00:46:03.915917+0000","last_unstale":"2024-09-12T01:26:05.637984+0000","last_undegraded":"2024-09-12T01:26:05.637984+0000","last_fullsized":"2024-09-12T01:26:05.637984+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:26.873454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:08.509445+0000","last_change":"2024-09-12T01:04:13.465500+0000","last_active":"2024-09-12T01:27:08.509445+0000","last_peered":"2024-09-12T01:27:08.509445+0000","last_clean":"2024-09-12T01:27:08.509445+0000","last_became_active":"2024-09-12T01:04:13.465173+0000","last_became_peered":"2024-09-12T01:04:13.465173+0000","last_unstale":"2024-09-12T01:27:08.509445+0000","last_undegraded":"2024-09-12T01:27:08.509445+0000","last_fullsized":"2024-09-12T01:27:08.509445+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:43.615029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:24.733449+0000","last_change":"2024-09-12T00:48:45.314920+0000","last_active":"2024-09-12T01:27:24.733449+0000","last_peered":"2024-09-12T01:27:24.733449+0000","last_clean":"2024-09-12T01:27:24.733449+0000","last_became_active":"2024-09-12T00:48:45.313443+0000","last_became_peered":"2024-09-12T00:48:45.313443+0000","last_unstale":"2024-09-12T01:27:24.733449+0000","last_undegraded":"2024-09-12T01:27:24.733449+0000","last_fullsized":"2024-09-12T01:27:24.733449+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:01:03.806002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'7","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:29.734050+0000","last_change":"2024-09-12T00:48:42.293510+0000","last_active":"2024-09-12T01:27:29.734050+0000","last_peered":"2024-09-12T01:27:29.734050+0000","last_clean":"2024-09-12T01:27:29.734050+0000","last_became_active":"2024-09-12T00:48:42.293128+0000","last_became_peered":"2024-09-12T00:48:42.293128+0000","last_unstale":"2024-09-12T01:27:29.734050+0000","last_undegraded":"2024-09-12T01:27:29.734050+0000","last_fullsized":"2024-09-12T01:27:29.734050+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:35.032026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":20530,"num_write":7,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'40","reported_seq":157,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.504898+0000","last_change":"2024-09-12T00:46:03.923309+0000","last_active":"2024-09-12T01:26:04.504898+0000","last_peered":"2024-09-12T01:26:04.504898+0000","last_clean":"2024-09-12T01:26:04.504898+0000","last_became_active":"2024-09-12T00:46:03.923029+0000","last_became_peered":"2024-09-12T00:46:03.923029+0000","last_unstale":"2024-09-12T01:26:04.504898+0000","last_undegraded":"2024-09-12T01:26:04.504898+0000","last_fullsized":"2024-09-12T01:26:04.504898+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:33:20.804221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":145,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.508900+0000","last_change":"2024-09-12T01:04:13.472265+0000","last_active":"2024-09-12T01:26:44.508900+0000","last_peered":"2024-09-12T01:26:44.508900+0000","last_clean":"2024-09-12T01:26:44.508900+0000","last_became_active":"2024-09-12T01:04:13.468832+0000","last_became_peered":"2024-09-12T01:04:13.468832+0000","last_unstale":"2024-09-12T01:26:44.508900+0000","last_undegraded":"2024-09-12T01:26:44.508900+0000","last_fullsized":"2024-09-12T01:26:44.508900+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.832023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505982+0000","last_change":"2024-09-12T00:48:45.309486+0000","last_active":"2024-09-12T01:26:14.505982+0000","last_peered":"2024-09-12T01:26:14.505982+0000","last_clean":"2024-09-12T01:26:14.505982+0000","last_became_active":"2024-09-12T00:48:45.309166+0000","last_became_peered":"2024-09-12T00:48:45.309166+0000","last_unstale":"2024-09-12T01:26:14.505982+0000","last_undegraded":"2024-09-12T01:26:14.505982+0000","last_fullsized":"2024-09-12T01:26:14.505982+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:58.753867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.502933+0000","last_change":"2024-09-12T00:48:42.292429+0000","last_active":"2024-09-12T01:26:14.502933+0000","last_peered":"2024-09-12T01:26:14.502933+0000","last_clean":"2024-09-12T01:26:14.502933+0000","last_became_active":"2024-09-12T00:48:42.291800+0000","last_became_peered":"2024-09-12T00:48:42.291800+0000","last_unstale":"2024-09-12T01:26:14.502933+0000","last_undegraded":"2024-09-12T01:26:14.502933+0000","last_fullsized":"2024-09-12T01:26:14.502933+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:58.520610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'17","reported_seq":96,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:55.771942+0000","last_change":"2024-09-12T00:46:03.913895+0000","last_active":"2024-09-12T01:24:55.771942+0000","last_peered":"2024-09-12T01:24:55.771942+0000","last_clean":"2024-09-12T01:24:55.771942+0000","last_became_active":"2024-09-12T00:46:03.913667+0000","last_became_peered":"2024-09-12T00:46:03.913667+0000","last_unstale":"2024-09-12T01:24:55.771942+0000","last_undegraded":"2024-09-12T01:24:55.771942+0000","last_fullsized":"2024-09-12T01:24:55.771942+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:42.230323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":62,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.506059+0000","last_change":"2024-09-12T01:04:13.462929+0000","last_active":"2024-09-12T01:26:44.506059+0000","last_peered":"2024-09-12T01:26:44.506059+0000","last_clean":"2024-09-12T01:26:44.506059+0000","last_became_active":"2024-09-12T01:04:13.462605+0000","last_became_peered":"2024-09-12T01:04:13.462605+0000","last_unstale":"2024-09-12T01:26:44.506059+0000","last_undegraded":"2024-09-12T01:26:44.506059+0000","last_fullsized":"2024-09-12T01:26:44.506059+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:21.801378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:45.807311+0000","last_change":"2024-09-12T00:48:45.314426+0000","last_active":"2024-09-12T01:28:45.807311+0000","last_peered":"2024-09-12T01:28:45.807311+0000","last_clean":"2024-09-12T01:28:45.807311+0000","last_became_active":"2024-09-12T00:48:45.314128+0000","last_became_peered":"2024-09-12T00:48:45.314128+0000","last_unstale":"2024-09-12T01:28:45.807311+0000","last_undegraded":"2024-09-12T01:28:45.807311+0000","last_fullsized":"2024-09-12T01:28:45.807311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:59.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639662+0000","last_change":"2024-09-12T00:48:42.296184+0000","last_active":"2024-09-12T01:26:15.639662+0000","last_peered":"2024-09-12T01:26:15.639662+0000","last_clean":"2024-09-12T01:26:15.639662+0000","last_became_active":"2024-09-12T00:48:42.295886+0000","last_became_peered":"2024-09-12T00:48:42.295886+0000","last_unstale":"2024-09-12T01:26:15.639662+0000","last_undegraded":"2024-09-12T01:26:15.639662+0000","last_fullsized":"2024-09-12T01:26:15.639662+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:20.846127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'14","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:10.647576+0000","last_change":"2024-09-12T00:46:03.919616+0000","last_active":"2024-09-12T01:27:10.647576+0000","last_peered":"2024-09-12T01:27:10.647576+0000","last_clean":"2024-09-12T01:27:10.647576+0000","last_became_active":"2024-09-12T00:46:03.919334+0000","last_became_peered":"2024-09-12T00:46:03.919334+0000","last_unstale":"2024-09-12T01:27:10.647576+0000","last_undegraded":"2024-09-12T01:27:10.647576+0000","last_fullsized":"2024-09-12T01:27:10.647576+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:17.491559+0000","last_change":"2024-09-12T01:04:13.467497+0000","last_active":"2024-09-12T01:25:17.491559+0000","last_peered":"2024-09-12T01:25:17.491559+0000","last_clean":"2024-09-12T01:25:17.491559+0000","last_became_active":"2024-09-12T01:04:13.467230+0000","last_became_peered":"2024-09-12T01:04:13.467230+0000","last_unstale":"2024-09-12T01:25:17.491559+0000","last_undegraded":"2024-09-12T01:25:17.491559+0000","last_fullsized":"2024-09-12T01:25:17.491559+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:19.612980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.862267+0000","last_change":"2024-09-12T00:48:45.309898+0000","last_active":"2024-09-12T01:29:14.862267+0000","last_peered":"2024-09-12T01:29:14.862267+0000","last_clean":"2024-09-12T01:29:14.862267+0000","last_became_active":"2024-09-12T00:48:45.309604+0000","last_became_peered":"2024-09-12T00:48:45.309604+0000","last_unstale":"2024-09-12T01:29:14.862267+0000","last_undegraded":"2024-09-12T01:29:14.862267+0000","last_fullsized":"2024-09-12T01:29:14.862267+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:20.554961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.724362+0000","last_change":"2024-09-12T00:48:42.294022+0000","last_active":"2024-09-12T01:26:09.724362+0000","last_peered":"2024-09-12T01:26:09.724362+0000","last_clean":"2024-09-12T01:26:09.724362+0000","last_became_active":"2024-09-12T00:48:42.293705+0000","last_became_peered":"2024-09-12T00:48:42.293705+0000","last_unstale":"2024-09-12T01:26:09.724362+0000","last_undegraded":"2024-09-12T01:26:09.724362+0000","last_fullsized":"2024-09-12T01:26:09.724362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.053185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'6","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:08.509466+0000","last_change":"2024-09-12T00:46:03.917085+0000","last_active":"2024-09-12T01:27:08.509466+0000","last_peered":"2024-09-12T01:27:08.509466+0000","last_clean":"2024-09-12T01:27:08.509466+0000","last_became_active":"2024-09-12T00:46:03.916699+0000","last_became_peered":"2024-09-12T00:46:03.916699+0000","last_unstale":"2024-09-12T01:27:08.509466+0000","last_undegraded":"2024-09-12T01:27:08.509466+0000","last_fullsized":"2024-09-12T01:27:08.509466+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:15.630269+0000","last_change":"2024-09-12T01:04:13.468912+0000","last_active":"2024-09-12T01:25:15.630269+0000","last_peered":"2024-09-12T01:25:15.630269+0000","last_clean":"2024-09-12T01:25:15.630269+0000","last_became_active":"2024-09-12T01:04:13.468643+0000","last_became_peered":"2024-09-12T01:04:13.468643+0000","last_unstale":"2024-09-12T01:25:15.630269+0000","last_undegraded":"2024-09-12T01:25:15.630269+0000","last_fullsized":"2024-09-12T01:25:15.630269+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:52.505763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:37.523035+0000","last_change":"2024-09-12T00:48:45.314936+0000","last_active":"2024-09-12T01:28:37.523035+0000","last_peered":"2024-09-12T01:28:37.523035+0000","last_clean":"2024-09-12T01:28:37.523035+0000","last_became_active":"2024-09-12T00:48:45.314212+0000","last_became_peered":"2024-09-12T00:48:45.314212+0000","last_unstale":"2024-09-12T01:28:37.523035+0000","last_undegraded":"2024-09-12T01:28:37.523035+0000","last_fullsized":"2024-09-12T01:28:37.523035+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:22.945070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:24.509999+0000","last_change":"2024-09-12T00:48:42.292169+0000","last_active":"2024-09-12T01:27:24.509999+0000","last_peered":"2024-09-12T01:27:24.509999+0000","last_clean":"2024-09-12T01:27:24.509999+0000","last_became_active":"2024-09-12T00:48:42.291818+0000","last_became_peered":"2024-09-12T00:48:42.291818+0000","last_unstale":"2024-09-12T01:27:24.509999+0000","last_undegraded":"2024-09-12T01:27:24.509999+0000","last_fullsized":"2024-09-12T01:27:24.509999+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:26.276296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'35","reported_seq":143,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:08.509418+0000","last_change":"2024-09-12T00:46:03.921103+0000","last_active":"2024-09-12T01:27:08.509418+0000","last_peered":"2024-09-12T01:27:08.509418+0000","last_clean":"2024-09-12T01:27:08.509418+0000","last_became_active":"2024-09-12T00:46:03.920696+0000","last_became_peered":"2024-09-12T00:46:03.920696+0000","last_unstale":"2024-09-12T01:27:08.509418+0000","last_undegraded":"2024-09-12T01:27:08.509418+0000","last_fullsized":"2024-09-12T01:27:08.509418+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.499604+0000","last_change":"2024-09-12T01:04:13.472034+0000","last_active":"2024-09-12T01:25:14.499604+0000","last_peered":"2024-09-12T01:25:14.499604+0000","last_clean":"2024-09-12T01:25:14.499604+0000","last_became_active":"2024-09-12T01:04:13.471741+0000","last_became_peered":"2024-09-12T01:04:13.471741+0000","last_unstale":"2024-09-12T01:25:14.499604+0000","last_undegraded":"2024-09-12T01:25:14.499604+0000","last_fullsized":"2024-09-12T01:25:14.499604+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:37.939219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'7","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:25.794932+0000","last_change":"2024-09-12T00:48:45.317881+0000","last_active":"2024-09-12T01:27:25.794932+0000","last_peered":"2024-09-12T01:27:25.794932+0000","last_clean":"2024-09-12T01:27:25.794932+0000","last_became_active":"2024-09-12T00:48:45.317576+0000","last_became_peered":"2024-09-12T00:48:45.317576+0000","last_unstale":"2024-09-12T01:27:25.794932+0000","last_undegraded":"2024-09-12T01:27:25.794932+0000","last_fullsized":"2024-09-12T01:27:25.794932+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:56.133928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"262'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:00.772850+0000","last_change":"2024-09-12T00:48:42.291771+0000","last_active":"2024-09-12T01:25:00.772850+0000","last_peered":"2024-09-12T01:25:00.772850+0000","last_clean":"2024-09-12T01:25:00.772850+0000","last_became_active":"2024-09-12T00:48:42.291199+0000","last_became_peered":"2024-09-12T00:48:42.291199+0000","last_unstale":"2024-09-12T01:25:00.772850+0000","last_undegraded":"2024-09-12T01:25:00.772850+0000","last_fullsized":"2024-09-12T01:25:00.772850+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:37.299502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5165,"num_write":10,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'6","reported_seq":67,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:10.792607+0000","last_change":"2024-09-12T00:46:03.919765+0000","last_active":"2024-09-12T01:27:10.792607+0000","last_peered":"2024-09-12T01:27:10.792607+0000","last_clean":"2024-09-12T01:27:10.792607+0000","last_became_active":"2024-09-12T00:46:03.919481+0000","last_became_peered":"2024-09-12T00:46:03.919481+0000","last_unstale":"2024-09-12T01:27:10.792607+0000","last_undegraded":"2024-09-12T01:27:10.792607+0000","last_fullsized":"2024-09-12T01:27:10.792607+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.496856+0000","last_change":"2024-09-12T01:04:13.468963+0000","last_active":"2024-09-12T01:25:14.496856+0000","last_peered":"2024-09-12T01:25:14.496856+0000","last_clean":"2024-09-12T01:25:14.496856+0000","last_became_active":"2024-09-12T01:04:13.468317+0000","last_became_peered":"2024-09-12T01:04:13.468317+0000","last_unstale":"2024-09-12T01:25:14.496856+0000","last_undegraded":"2024-09-12T01:25:14.496856+0000","last_fullsized":"2024-09-12T01:25:14.496856+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:50.519451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:24:59.495267+0000","last_change":"2024-09-12T00:48:45.315823+0000","last_active":"2024-09-12T01:24:59.495267+0000","last_peered":"2024-09-12T01:24:59.495267+0000","last_clean":"2024-09-12T01:24:59.495267+0000","last_became_active":"2024-09-12T00:48:45.315546+0000","last_became_peered":"2024-09-12T00:48:45.315546+0000","last_unstale":"2024-09-12T01:24:59.495267+0000","last_undegraded":"2024-09-12T01:24:59.495267+0000","last_fullsized":"2024-09-12T01:24:59.495267+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:54.909978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:22.511246+0000","last_change":"2024-09-12T00:48:42.296841+0000","last_active":"2024-09-12T01:27:22.511246+0000","last_peered":"2024-09-12T01:27:22.511246+0000","last_clean":"2024-09-12T01:27:22.511246+0000","last_became_active":"2024-09-12T00:48:42.296509+0000","last_became_peered":"2024-09-12T00:48:42.296509+0000","last_unstale":"2024-09-12T01:27:22.511246+0000","last_undegraded":"2024-09-12T01:27:22.511246+0000","last_fullsized":"2024-09-12T01:27:22.511246+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:00.906884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'52","reported_seq":188,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721709+0000","last_change":"2024-09-12T00:46:03.920474+0000","last_active":"2024-09-12T01:25:49.721709+0000","last_peered":"2024-09-12T01:25:49.721709+0000","last_clean":"2024-09-12T01:25:49.721709+0000","last_became_active":"2024-09-12T00:46:03.920188+0000","last_became_peered":"2024-09-12T00:46:03.920188+0000","last_unstale":"2024-09-12T01:25:49.721709+0000","last_undegraded":"2024-09-12T01:25:49.721709+0000","last_fullsized":"2024-09-12T01:25:49.721709+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:42.736993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":182,"num_write":95,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498632+0000","last_change":"2024-09-12T01:04:13.462848+0000","last_active":"2024-09-12T01:26:02.498632+0000","last_peered":"2024-09-12T01:26:02.498632+0000","last_clean":"2024-09-12T01:26:02.498632+0000","last_became_active":"2024-09-12T01:04:13.462434+0000","last_became_peered":"2024-09-12T01:04:13.462434+0000","last_unstale":"2024-09-12T01:26:02.498632+0000","last_undegraded":"2024-09-12T01:26:02.498632+0000","last_fullsized":"2024-09-12T01:26:02.498632+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:42.830213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499355+0000","last_change":"2024-09-12T00:48:45.316725+0000","last_active":"2024-09-12T01:26:07.499355+0000","last_peered":"2024-09-12T01:26:07.499355+0000","last_clean":"2024-09-12T01:26:07.499355+0000","last_became_active":"2024-09-12T00:48:45.316432+0000","last_became_peered":"2024-09-12T00:48:45.316432+0000","last_unstale":"2024-09-12T01:26:07.499355+0000","last_undegraded":"2024-09-12T01:26:07.499355+0000","last_fullsized":"2024-09-12T01:26:07.499355+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:20.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605590+0000","last_change":"2024-09-12T00:48:42.290754+0000","last_active":"2024-09-12T01:26:04.605590+0000","last_peered":"2024-09-12T01:26:04.605590+0000","last_clean":"2024-09-12T01:26:04.605590+0000","last_became_active":"2024-09-12T00:48:42.290454+0000","last_became_peered":"2024-09-12T00:48:42.290454+0000","last_unstale":"2024-09-12T01:26:04.605590+0000","last_undegraded":"2024-09-12T01:26:04.605590+0000","last_fullsized":"2024-09-12T01:26:04.605590+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:16.245048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"262'7","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.719526+0000","last_change":"2024-09-12T00:46:03.917579+0000","last_active":"2024-09-12T01:25:44.719526+0000","last_peered":"2024-09-12T01:25:44.719526+0000","last_clean":"2024-09-12T01:25:44.719526+0000","last_became_active":"2024-09-12T00:46:03.917314+0000","last_became_peered":"2024-09-12T00:46:03.917314+0000","last_unstale":"2024-09-12T01:25:44.719526+0000","last_undegraded":"2024-09-12T01:25:44.719526+0000","last_fullsized":"2024-09-12T01:25:44.719526+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:21.892403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":13,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637319+0000","last_change":"2024-09-12T01:04:13.467571+0000","last_active":"2024-09-12T01:26:00.637319+0000","last_peered":"2024-09-12T01:26:00.637319+0000","last_clean":"2024-09-12T01:26:00.637319+0000","last_became_active":"2024-09-12T01:04:13.467119+0000","last_became_peered":"2024-09-12T01:04:13.467119+0000","last_unstale":"2024-09-12T01:26:00.637319+0000","last_undegraded":"2024-09-12T01:26:00.637319+0000","last_fullsized":"2024-09-12T01:26:00.637319+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:23.369147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499300+0000","last_change":"2024-09-12T00:48:45.314598+0000","last_active":"2024-09-12T01:26:07.499300+0000","last_peered":"2024-09-12T01:26:07.499300+0000","last_clean":"2024-09-12T01:26:07.499300+0000","last_became_active":"2024-09-12T00:48:45.314127+0000","last_became_peered":"2024-09-12T00:48:45.314127+0000","last_unstale":"2024-09-12T01:26:07.499300+0000","last_undegraded":"2024-09-12T01:26:07.499300+0000","last_fullsized":"2024-09-12T01:26:07.499300+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:00.050328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'5","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498548+0000","last_change":"2024-09-12T00:48:42.293860+0000","last_active":"2024-09-12T01:26:02.498548+0000","last_peered":"2024-09-12T01:26:02.498548+0000","last_clean":"2024-09-12T01:26:02.498548+0000","last_became_active":"2024-09-12T00:48:42.293153+0000","last_became_peered":"2024-09-12T00:48:42.293153+0000","last_unstale":"2024-09-12T01:26:02.498548+0000","last_undegraded":"2024-09-12T01:26:02.498548+0000","last_fullsized":"2024-09-12T01:26:02.498548+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:12.547450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'49","reported_seq":179,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:45.779451+0000","last_change":"2024-09-12T00:46:03.917417+0000","last_active":"2024-09-12T01:25:45.779451+0000","last_peered":"2024-09-12T01:25:45.779451+0000","last_clean":"2024-09-12T01:25:45.779451+0000","last_became_active":"2024-09-12T00:46:03.917142+0000","last_became_peered":"2024-09-12T00:46:03.917142+0000","last_unstale":"2024-09-12T01:25:45.779451+0000","last_undegraded":"2024-09-12T01:25:45.779451+0000","last_fullsized":"2024-09-12T01:25:45.779451+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:12.229825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":172,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:18.494068+0000","last_change":"2024-09-12T01:04:13.464064+0000","last_active":"2024-09-12T01:25:18.494068+0000","last_peered":"2024-09-12T01:25:18.494068+0000","last_clean":"2024-09-12T01:25:18.494068+0000","last_became_active":"2024-09-12T01:04:13.463766+0000","last_became_peered":"2024-09-12T01:04:13.463766+0000","last_unstale":"2024-09-12T01:25:18.494068+0000","last_undegraded":"2024-09-12T01:25:18.494068+0000","last_fullsized":"2024-09-12T01:25:18.494068+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:14:26.806464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782587+0000","last_change":"2024-09-12T00:48:45.307348+0000","last_active":"2024-09-12T01:26:05.782587+0000","last_peered":"2024-09-12T01:26:05.782587+0000","last_clean":"2024-09-12T01:26:05.782587+0000","last_became_active":"2024-09-12T00:48:45.307036+0000","last_became_peered":"2024-09-12T00:48:45.307036+0000","last_unstale":"2024-09-12T01:26:05.782587+0000","last_undegraded":"2024-09-12T01:26:05.782587+0000","last_fullsized":"2024-09-12T01:26:05.782587+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:21.417276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'5","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:24.521688+0000","last_change":"2024-09-12T00:48:42.294916+0000","last_active":"2024-09-12T01:28:24.521688+0000","last_peered":"2024-09-12T01:28:24.521688+0000","last_clean":"2024-09-12T01:28:24.521688+0000","last_became_active":"2024-09-12T00:48:42.294608+0000","last_became_peered":"2024-09-12T00:48:42.294608+0000","last_unstale":"2024-09-12T01:28:24.521688+0000","last_undegraded":"2024-09-12T01:28:24.521688+0000","last_fullsized":"2024-09-12T01:28:24.521688+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:37.130170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5438,"num_write":5,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.502728+0000","last_change":"2024-09-12T00:46:03.922277+0000","last_active":"2024-09-12T01:25:44.502728+0000","last_peered":"2024-09-12T01:25:44.502728+0000","last_clean":"2024-09-12T01:25:44.502728+0000","last_became_active":"2024-09-12T00:46:03.921844+0000","last_became_peered":"2024-09-12T00:46:03.921844+0000","last_unstale":"2024-09-12T01:25:44.502728+0000","last_undegraded":"2024-09-12T01:25:44.502728+0000","last_fullsized":"2024-09-12T01:25:44.502728+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:57.617387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":67,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637276+0000","last_change":"2024-09-12T01:04:13.462719+0000","last_active":"2024-09-12T01:26:00.637276+0000","last_peered":"2024-09-12T01:26:00.637276+0000","last_clean":"2024-09-12T01:26:00.637276+0000","last_became_active":"2024-09-12T01:04:13.462441+0000","last_became_peered":"2024-09-12T01:04:13.462441+0000","last_unstale":"2024-09-12T01:26:00.637276+0000","last_undegraded":"2024-09-12T01:26:00.637276+0000","last_fullsized":"2024-09-12T01:26:00.637276+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:19.887695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'11","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.407259+0000","last_change":"2024-09-12T00:48:45.312937+0000","last_active":"2024-09-12T01:29:15.407259+0000","last_peered":"2024-09-12T01:29:15.407259+0000","last_clean":"2024-09-12T01:29:15.407259+0000","last_became_active":"2024-09-12T00:48:45.312617+0000","last_became_peered":"2024-09-12T00:48:45.312617+0000","last_unstale":"2024-09-12T01:29:15.407259+0000","last_undegraded":"2024-09-12T01:29:15.407259+0000","last_fullsized":"2024-09-12T01:29:15.407259+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:28.386583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":20528,"num_write":21,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.605671+0000","last_change":"2024-09-12T00:48:42.292806+0000","last_active":"2024-09-12T01:26:04.605671+0000","last_peered":"2024-09-12T01:26:04.605671+0000","last_clean":"2024-09-12T01:26:04.605671+0000","last_became_active":"2024-09-12T00:48:42.292511+0000","last_became_peered":"2024-09-12T00:48:42.292511+0000","last_unstale":"2024-09-12T01:26:04.605671+0000","last_undegraded":"2024-09-12T01:26:04.605671+0000","last_fullsized":"2024-09-12T01:26:04.605671+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:34.992694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'10","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:45.779402+0000","last_change":"2024-09-12T00:46:03.913386+0000","last_active":"2024-09-12T01:25:45.779402+0000","last_peered":"2024-09-12T01:25:45.779402+0000","last_clean":"2024-09-12T01:25:45.779402+0000","last_became_active":"2024-09-12T00:46:03.913098+0000","last_became_peered":"2024-09-12T00:46:03.913098+0000","last_unstale":"2024-09-12T01:25:45.779402+0000","last_undegraded":"2024-09-12T01:25:45.779402+0000","last_fullsized":"2024-09-12T01:25:45.779402+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:29:03.725529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":36,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498570+0000","last_change":"2024-09-12T01:04:13.474135+0000","last_active":"2024-09-12T01:26:02.498570+0000","last_peered":"2024-09-12T01:26:02.498570+0000","last_clean":"2024-09-12T01:26:02.498570+0000","last_became_active":"2024-09-12T01:04:13.473901+0000","last_became_peered":"2024-09-12T01:04:13.473901+0000","last_unstale":"2024-09-12T01:26:02.498570+0000","last_undegraded":"2024-09-12T01:26:02.498570+0000","last_fullsized":"2024-09-12T01:26:02.498570+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:45.848297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.811628+0000","last_change":"2024-09-12T00:48:45.308960+0000","last_active":"2024-09-12T01:29:15.811628+0000","last_peered":"2024-09-12T01:29:15.811628+0000","last_clean":"2024-09-12T01:29:15.811628+0000","last_became_active":"2024-09-12T00:48:45.308676+0000","last_became_peered":"2024-09-12T00:48:45.308676+0000","last_unstale":"2024-09-12T01:29:15.811628+0000","last_undegraded":"2024-09-12T01:29:15.811628+0000","last_fullsized":"2024-09-12T01:29:15.811628+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:11.911720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":80,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'6","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.584388+0000","last_change":"2024-09-12T00:48:42.291979+0000","last_active":"2024-09-12T01:29:15.584388+0000","last_peered":"2024-09-12T01:29:15.584388+0000","last_clean":"2024-09-12T01:29:15.584388+0000","last_became_active":"2024-09-12T00:48:42.291569+0000","last_became_peered":"2024-09-12T00:48:42.291569+0000","last_unstale":"2024-09-12T01:29:15.584388+0000","last_undegraded":"2024-09-12T01:29:15.584388+0000","last_fullsized":"2024-09-12T01:29:15.584388+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:20.262872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'67","reported_seq":233,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.789165+0000","last_change":"2024-09-12T00:46:03.920845+0000","last_active":"2024-09-12T01:26:45.789165+0000","last_peered":"2024-09-12T01:26:45.789165+0000","last_clean":"2024-09-12T01:26:45.789165+0000","last_became_active":"2024-09-12T00:46:03.920387+0000","last_became_peered":"2024-09-12T00:46:03.920387+0000","last_unstale":"2024-09-12T01:26:45.789165+0000","last_undegraded":"2024-09-12T01:26:45.789165+0000","last_fullsized":"2024-09-12T01:26:45.789165+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:02.972369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":242,"num_write":122,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.609771+0000","last_change":"2024-09-12T01:04:13.470050+0000","last_active":"2024-09-12T01:26:44.609771+0000","last_peered":"2024-09-12T01:26:44.609771+0000","last_clean":"2024-09-12T01:26:44.609771+0000","last_became_active":"2024-09-12T01:04:13.469544+0000","last_became_peered":"2024-09-12T01:04:13.469544+0000","last_unstale":"2024-09-12T01:26:44.609771+0000","last_undegraded":"2024-09-12T01:26:44.609771+0000","last_fullsized":"2024-09-12T01:26:44.609771+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:57.676504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.791316+0000","last_change":"2024-09-12T00:48:45.310714+0000","last_active":"2024-09-12T01:27:00.791316+0000","last_peered":"2024-09-12T01:27:00.791316+0000","last_clean":"2024-09-12T01:27:00.791316+0000","last_became_active":"2024-09-12T00:48:45.310425+0000","last_became_peered":"2024-09-12T00:48:45.310425+0000","last_unstale":"2024-09-12T01:27:00.791316+0000","last_undegraded":"2024-09-12T01:27:00.791316+0000","last_fullsized":"2024-09-12T01:27:00.791316+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:11.427037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646110+0000","last_change":"2024-09-12T00:48:42.289205+0000","last_active":"2024-09-12T01:27:00.646110+0000","last_peered":"2024-09-12T01:27:00.646110+0000","last_clean":"2024-09-12T01:27:00.646110+0000","last_became_active":"2024-09-12T00:48:42.288750+0000","last_became_peered":"2024-09-12T00:48:42.288750+0000","last_unstale":"2024-09-12T01:27:00.646110+0000","last_undegraded":"2024-09-12T01:27:00.646110+0000","last_fullsized":"2024-09-12T01:27:00.646110+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:03.592679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'39","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.727351+0000","last_change":"2024-09-12T00:46:03.918651+0000","last_active":"2024-09-12T01:26:34.727351+0000","last_peered":"2024-09-12T01:26:34.727351+0000","last_clean":"2024-09-12T01:26:34.727351+0000","last_became_active":"2024-09-12T00:46:03.918395+0000","last_became_peered":"2024-09-12T00:46:03.918395+0000","last_unstale":"2024-09-12T01:26:34.727351+0000","last_undegraded":"2024-09-12T01:26:34.727351+0000","last_fullsized":"2024-09-12T01:26:34.727351+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:06.038629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":130,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.722217+0000","last_change":"2024-09-12T01:04:13.468761+0000","last_active":"2024-09-12T01:25:54.722217+0000","last_peered":"2024-09-12T01:25:54.722217+0000","last_clean":"2024-09-12T01:25:54.722217+0000","last_became_active":"2024-09-12T01:04:13.468492+0000","last_became_peered":"2024-09-12T01:04:13.468492+0000","last_unstale":"2024-09-12T01:25:54.722217+0000","last_undegraded":"2024-09-12T01:25:54.722217+0000","last_fullsized":"2024-09-12T01:25:54.722217+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:23.228261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.245027+0000","last_change":"2024-09-12T00:48:45.306987+0000","last_active":"2024-09-12T01:29:16.245027+0000","last_peered":"2024-09-12T01:29:16.245027+0000","last_clean":"2024-09-12T01:29:16.245027+0000","last_became_active":"2024-09-12T00:48:45.306581+0000","last_became_peered":"2024-09-12T00:48:45.306581+0000","last_unstale":"2024-09-12T01:29:16.245027+0000","last_undegraded":"2024-09-12T01:29:16.245027+0000","last_fullsized":"2024-09-12T01:29:16.245027+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.791375+0000","last_change":"2024-09-12T00:48:42.291472+0000","last_active":"2024-09-12T01:27:00.791375+0000","last_peered":"2024-09-12T01:27:00.791375+0000","last_clean":"2024-09-12T01:27:00.791375+0000","last_became_active":"2024-09-12T00:48:42.290069+0000","last_became_peered":"2024-09-12T00:48:42.290069+0000","last_unstale":"2024-09-12T01:27:00.791375+0000","last_undegraded":"2024-09-12T01:27:00.791375+0000","last_fullsized":"2024-09-12T01:27:00.791375+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:06.334859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'22","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.608639+0000","last_change":"2024-09-12T00:46:03.917998+0000","last_active":"2024-09-12T01:26:34.608639+0000","last_peered":"2024-09-12T01:26:34.608639+0000","last_clean":"2024-09-12T01:26:34.608639+0000","last_became_active":"2024-09-12T00:46:03.917612+0000","last_became_peered":"2024-09-12T00:46:03.917612+0000","last_unstale":"2024-09-12T01:26:34.608639+0000","last_undegraded":"2024-09-12T01:26:34.608639+0000","last_fullsized":"2024-09-12T01:26:34.608639+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:25.331801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":67,"num_write":52,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.604479+0000","last_change":"2024-09-12T01:04:13.471829+0000","last_active":"2024-09-12T01:25:54.604479+0000","last_peered":"2024-09-12T01:25:54.604479+0000","last_clean":"2024-09-12T01:25:54.604479+0000","last_became_active":"2024-09-12T01:04:13.470494+0000","last_became_peered":"2024-09-12T01:04:13.470494+0000","last_unstale":"2024-09-12T01:25:54.604479+0000","last_undegraded":"2024-09-12T01:25:54.604479+0000","last_fullsized":"2024-09-12T01:25:54.604479+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:21.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:02.508038+0000","last_change":"2024-09-12T00:48:45.317979+0000","last_active":"2024-09-12T01:27:02.508038+0000","last_peered":"2024-09-12T01:27:02.508038+0000","last_clean":"2024-09-12T01:27:02.508038+0000","last_became_active":"2024-09-12T00:48:45.317637+0000","last_became_peered":"2024-09-12T00:48:45.317637+0000","last_unstale":"2024-09-12T01:27:02.508038+0000","last_undegraded":"2024-09-12T01:27:02.508038+0000","last_fullsized":"2024-09-12T01:27:02.508038+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:51.863153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:10.792676+0000","last_change":"2024-09-12T00:48:42.289582+0000","last_active":"2024-09-12T01:27:10.792676+0000","last_peered":"2024-09-12T01:27:10.792676+0000","last_clean":"2024-09-12T01:27:10.792676+0000","last_became_active":"2024-09-12T00:48:42.289304+0000","last_became_peered":"2024-09-12T00:48:42.289304+0000","last_unstale":"2024-09-12T01:27:10.792676+0000","last_undegraded":"2024-09-12T01:27:10.792676+0000","last_fullsized":"2024-09-12T01:27:10.792676+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":140,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.642226+0000","last_change":"2024-09-12T00:46:03.911642+0000","last_active":"2024-09-12T01:26:35.642226+0000","last_peered":"2024-09-12T01:26:35.642226+0000","last_clean":"2024-09-12T01:26:35.642226+0000","last_became_active":"2024-09-12T00:46:03.911316+0000","last_became_peered":"2024-09-12T00:46:03.911316+0000","last_unstale":"2024-09-12T01:26:35.642226+0000","last_undegraded":"2024-09-12T01:26:35.642226+0000","last_fullsized":"2024-09-12T01:26:35.642226+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:27.292826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":121,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:47.505723+0000","last_change":"2024-09-12T01:04:13.462688+0000","last_active":"2024-09-12T01:26:47.505723+0000","last_peered":"2024-09-12T01:26:47.505723+0000","last_clean":"2024-09-12T01:26:47.505723+0000","last_became_active":"2024-09-12T01:04:13.462150+0000","last_became_peered":"2024-09-12T01:04:13.462150+0000","last_unstale":"2024-09-12T01:26:47.505723+0000","last_undegraded":"2024-09-12T01:26:47.505723+0000","last_fullsized":"2024-09-12T01:26:47.505723+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:43.928057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'3","reported_seq":40,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:44.735869+0000","last_change":"2024-09-12T00:48:45.312564+0000","last_active":"2024-09-12T01:27:44.735869+0000","last_peered":"2024-09-12T01:27:44.735869+0000","last_clean":"2024-09-12T01:27:44.735869+0000","last_became_active":"2024-09-12T00:48:45.312283+0000","last_became_peered":"2024-09-12T00:48:45.312283+0000","last_unstale":"2024-09-12T01:27:44.735869+0000","last_undegraded":"2024-09-12T01:27:44.735869+0000","last_fullsized":"2024-09-12T01:27:44.735869+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:08.027455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:45.797614+0000","last_change":"2024-09-12T00:48:42.290364+0000","last_active":"2024-09-12T01:27:45.797614+0000","last_peered":"2024-09-12T01:27:45.797614+0000","last_clean":"2024-09-12T01:27:45.797614+0000","last_became_active":"2024-09-12T00:48:42.290091+0000","last_became_peered":"2024-09-12T00:48:42.290091+0000","last_unstale":"2024-09-12T01:27:45.797614+0000","last_undegraded":"2024-09-12T01:27:45.797614+0000","last_fullsized":"2024-09-12T01:27:45.797614+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:37.718174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'27","reported_seq":128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:35.642191+0000","last_change":"2024-09-12T00:46:03.917233+0000","last_active":"2024-09-12T01:26:35.642191+0000","last_peered":"2024-09-12T01:26:35.642191+0000","last_clean":"2024-09-12T01:26:35.642191+0000","last_became_active":"2024-09-12T00:46:03.916476+0000","last_became_peered":"2024-09-12T00:46:03.916476+0000","last_unstale":"2024-09-12T01:26:35.642191+0000","last_undegraded":"2024-09-12T01:26:35.642191+0000","last_fullsized":"2024-09-12T01:26:35.642191+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:29.196991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:54.509963+0000","last_change":"2024-09-12T01:04:13.467457+0000","last_active":"2024-09-12T01:26:54.509963+0000","last_peered":"2024-09-12T01:26:54.509963+0000","last_clean":"2024-09-12T01:26:54.509963+0000","last_became_active":"2024-09-12T01:04:13.467045+0000","last_became_peered":"2024-09-12T01:04:13.467045+0000","last_unstale":"2024-09-12T01:26:54.509963+0000","last_undegraded":"2024-09-12T01:26:54.509963+0000","last_fullsized":"2024-09-12T01:26:54.509963+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:17.297601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:44.515078+0000","last_change":"2024-09-12T00:48:45.309440+0000","last_active":"2024-09-12T01:27:44.515078+0000","last_peered":"2024-09-12T01:27:44.515078+0000","last_clean":"2024-09-12T01:27:44.515078+0000","last_became_active":"2024-09-12T00:48:45.309113+0000","last_became_peered":"2024-09-12T00:48:45.309113+0000","last_unstale":"2024-09-12T01:27:44.515078+0000","last_undegraded":"2024-09-12T01:27:44.515078+0000","last_fullsized":"2024-09-12T01:27:44.515078+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:40.821689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:42.514018+0000","last_change":"2024-09-12T00:48:42.293380+0000","last_active":"2024-09-12T01:27:42.514018+0000","last_peered":"2024-09-12T01:27:42.514018+0000","last_clean":"2024-09-12T01:27:42.514018+0000","last_became_active":"2024-09-12T00:48:42.292733+0000","last_became_peered":"2024-09-12T00:48:42.292733+0000","last_unstale":"2024-09-12T01:27:42.514018+0000","last_undegraded":"2024-09-12T01:27:42.514018+0000","last_fullsized":"2024-09-12T01:27:42.514018+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:30.445225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"262'8","reported_seq":72,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:29.513506+0000","last_change":"2024-09-12T00:46:03.922414+0000","last_active":"2024-09-12T01:27:29.513506+0000","last_peered":"2024-09-12T01:27:29.513506+0000","last_clean":"2024-09-12T01:27:29.513506+0000","last_became_active":"2024-09-12T00:46:03.922008+0000","last_became_peered":"2024-09-12T00:46:03.922008+0000","last_unstale":"2024-09-12T01:27:29.513506+0000","last_undegraded":"2024-09-12T01:27:29.513506+0000","last_fullsized":"2024-09-12T01:27:29.513506+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.506044+0000","last_change":"2024-09-12T01:04:13.467753+0000","last_active":"2024-09-12T01:26:44.506044+0000","last_peered":"2024-09-12T01:26:44.506044+0000","last_clean":"2024-09-12T01:26:44.506044+0000","last_became_active":"2024-09-12T01:04:13.467476+0000","last_became_peered":"2024-09-12T01:04:13.467476+0000","last_unstale":"2024-09-12T01:26:44.506044+0000","last_undegraded":"2024-09-12T01:26:44.506044+0000","last_fullsized":"2024-09-12T01:26:44.506044+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:36.299465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646039+0000","last_change":"2024-09-12T00:48:45.311842+0000","last_active":"2024-09-12T01:27:00.646039+0000","last_peered":"2024-09-12T01:27:00.646039+0000","last_clean":"2024-09-12T01:27:00.646039+0000","last_became_active":"2024-09-12T00:48:45.311541+0000","last_became_peered":"2024-09-12T00:48:45.311541+0000","last_unstale":"2024-09-12T01:27:00.646039+0000","last_undegraded":"2024-09-12T01:27:00.646039+0000","last_fullsized":"2024-09-12T01:27:00.646039+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:32.767909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:45.779440+0000","last_change":"2024-09-12T00:48:42.281525+0000","last_active":"2024-09-12T01:25:45.779440+0000","last_peered":"2024-09-12T01:25:45.779440+0000","last_clean":"2024-09-12T01:25:45.779440+0000","last_became_active":"2024-09-12T00:48:42.281070+0000","last_became_peered":"2024-09-12T00:48:42.281070+0000","last_unstale":"2024-09-12T01:25:45.779440+0000","last_undegraded":"2024-09-12T01:25:45.779440+0000","last_fullsized":"2024-09-12T01:25:45.779440+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:50.751015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'44","reported_seq":174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:17.510301+0000","last_change":"2024-09-12T00:46:03.917910+0000","last_active":"2024-09-12T01:27:17.510301+0000","last_peered":"2024-09-12T01:27:17.510301+0000","last_clean":"2024-09-12T01:27:17.510301+0000","last_became_active":"2024-09-12T00:46:03.917626+0000","last_became_peered":"2024-09-12T00:46:03.917626+0000","last_unstale":"2024-09-12T01:27:17.510301+0000","last_undegraded":"2024-09-12T01:27:17.510301+0000","last_fullsized":"2024-09-12T01:27:17.510301+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":170,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.789110+0000","last_change":"2024-09-12T01:04:13.463528+0000","last_active":"2024-09-12T01:26:45.789110+0000","last_peered":"2024-09-12T01:26:45.789110+0000","last_clean":"2024-09-12T01:26:45.789110+0000","last_became_active":"2024-09-12T01:04:13.463216+0000","last_became_peered":"2024-09-12T01:04:13.463216+0000","last_unstale":"2024-09-12T01:26:45.789110+0000","last_undegraded":"2024-09-12T01:26:45.789110+0000","last_fullsized":"2024-09-12T01:26:45.789110+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:56.941035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.499853+0000","last_change":"2024-09-12T00:48:45.313761+0000","last_active":"2024-09-12T01:25:44.499853+0000","last_peered":"2024-09-12T01:25:44.499853+0000","last_clean":"2024-09-12T01:25:44.499853+0000","last_became_active":"2024-09-12T00:48:45.313386+0000","last_became_peered":"2024-09-12T00:48:45.313386+0000","last_unstale":"2024-09-12T01:25:44.499853+0000","last_undegraded":"2024-09-12T01:25:44.499853+0000","last_fullsized":"2024-09-12T01:25:44.499853+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:02.140152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:59.730452+0000","last_change":"2024-09-12T00:48:42.293797+0000","last_active":"2024-09-12T01:26:59.730452+0000","last_peered":"2024-09-12T01:26:59.730452+0000","last_clean":"2024-09-12T01:26:59.730452+0000","last_became_active":"2024-09-12T00:48:42.293460+0000","last_became_peered":"2024-09-12T00:48:42.293460+0000","last_unstale":"2024-09-12T01:26:59.730452+0000","last_undegraded":"2024-09-12T01:26:59.730452+0000","last_fullsized":"2024-09-12T01:26:59.730452+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:22.406867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'27","reported_seq":124,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:14.508900+0000","last_change":"2024-09-12T00:46:03.919193+0000","last_active":"2024-09-12T01:27:14.508900+0000","last_peered":"2024-09-12T01:27:14.508900+0000","last_clean":"2024-09-12T01:27:14.508900+0000","last_became_active":"2024-09-12T00:46:03.918921+0000","last_became_peered":"2024-09-12T00:46:03.918921+0000","last_unstale":"2024-09-12T01:27:14.508900+0000","last_undegraded":"2024-09-12T01:27:14.508900+0000","last_fullsized":"2024-09-12T01:27:14.508900+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.508427+0000","last_change":"2024-09-12T01:04:13.467161+0000","last_active":"2024-09-12T01:27:09.508427+0000","last_peered":"2024-09-12T01:27:09.508427+0000","last_clean":"2024-09-12T01:27:09.508427+0000","last_became_active":"2024-09-12T01:04:13.466854+0000","last_became_peered":"2024-09-12T01:04:13.466854+0000","last_unstale":"2024-09-12T01:27:09.508427+0000","last_undegraded":"2024-09-12T01:27:09.508427+0000","last_fullsized":"2024-09-12T01:27:09.508427+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:37.902119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:32.522238+0000","last_change":"2024-09-12T00:48:45.316511+0000","last_active":"2024-09-12T01:28:32.522238+0000","last_peered":"2024-09-12T01:28:32.522238+0000","last_clean":"2024-09-12T01:28:32.522238+0000","last_became_active":"2024-09-12T00:48:45.315966+0000","last_became_peered":"2024-09-12T00:48:45.315966+0000","last_unstale":"2024-09-12T01:28:32.522238+0000","last_undegraded":"2024-09-12T01:28:32.522238+0000","last_fullsized":"2024-09-12T01:28:32.522238+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:04.129604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1396,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:19.741022+0000","last_change":"2024-09-12T00:48:42.294344+0000","last_active":"2024-09-12T01:28:19.741022+0000","last_peered":"2024-09-12T01:28:19.741022+0000","last_clean":"2024-09-12T01:28:19.741022+0000","last_became_active":"2024-09-12T00:48:42.293481+0000","last_became_peered":"2024-09-12T00:48:42.293481+0000","last_unstale":"2024-09-12T01:28:19.741022+0000","last_undegraded":"2024-09-12T01:28:19.741022+0000","last_fullsized":"2024-09-12T01:28:19.741022+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:01.378966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'25","reported_seq":118,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:13.510283+0000","last_change":"2024-09-12T00:46:03.914527+0000","last_active":"2024-09-12T01:27:13.510283+0000","last_peered":"2024-09-12T01:27:13.510283+0000","last_clean":"2024-09-12T01:27:13.510283+0000","last_became_active":"2024-09-12T00:46:03.914207+0000","last_became_peered":"2024-09-12T00:46:03.914207+0000","last_unstale":"2024-09-12T01:27:13.510283+0000","last_undegraded":"2024-09-12T01:27:13.510283+0000","last_fullsized":"2024-09-12T01:27:13.510283+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.508448+0000","last_change":"2024-09-12T01:04:13.466887+0000","last_active":"2024-09-12T01:27:09.508448+0000","last_peered":"2024-09-12T01:27:09.508448+0000","last_clean":"2024-09-12T01:27:09.508448+0000","last_became_active":"2024-09-12T01:04:13.466050+0000","last_became_peered":"2024-09-12T01:04:13.466050+0000","last_unstale":"2024-09-12T01:27:09.508448+0000","last_undegraded":"2024-09-12T01:27:09.508448+0000","last_fullsized":"2024-09-12T01:27:09.508448+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:39.634410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501296+0000","last_change":"2024-09-12T00:48:45.314649+0000","last_active":"2024-09-12T01:26:17.501296+0000","last_peered":"2024-09-12T01:26:17.501296+0000","last_clean":"2024-09-12T01:26:17.501296+0000","last_became_active":"2024-09-12T00:48:45.313692+0000","last_became_peered":"2024-09-12T00:48:45.313692+0000","last_unstale":"2024-09-12T01:26:17.501296+0000","last_undegraded":"2024-09-12T01:26:17.501296+0000","last_fullsized":"2024-09-12T01:26:17.501296+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:19.872019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:23.503219+0000","last_change":"2024-09-12T00:48:42.288243+0000","last_active":"2024-09-12T01:26:23.503219+0000","last_peered":"2024-09-12T01:26:23.503219+0000","last_clean":"2024-09-12T01:26:23.503219+0000","last_became_active":"2024-09-12T00:48:42.287949+0000","last_became_peered":"2024-09-12T00:48:42.287949+0000","last_unstale":"2024-09-12T01:26:23.503219+0000","last_undegraded":"2024-09-12T01:26:23.503219+0000","last_fullsized":"2024-09-12T01:26:23.503219+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:37.161356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'53","reported_seq":195,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:14.732446+0000","last_change":"2024-09-12T00:46:03.918000+0000","last_active":"2024-09-12T01:27:14.732446+0000","last_peered":"2024-09-12T01:27:14.732446+0000","last_clean":"2024-09-12T01:27:14.732446+0000","last_became_active":"2024-09-12T00:46:03.917728+0000","last_became_peered":"2024-09-12T00:46:03.917728+0000","last_unstale":"2024-09-12T01:27:14.732446+0000","last_undegraded":"2024-09-12T01:27:14.732446+0000","last_fullsized":"2024-09-12T01:27:14.732446+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":191,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:22.501894+0000","last_change":"2024-09-12T01:04:13.466462+0000","last_active":"2024-09-12T01:26:22.501894+0000","last_peered":"2024-09-12T01:26:22.501894+0000","last_clean":"2024-09-12T01:26:22.501894+0000","last_became_active":"2024-09-12T01:04:13.466183+0000","last_became_peered":"2024-09-12T01:04:13.466183+0000","last_unstale":"2024-09-12T01:26:22.501894+0000","last_undegraded":"2024-09-12T01:26:22.501894+0000","last_fullsized":"2024-09-12T01:26:22.501894+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:33.706209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.498929+0000","last_change":"2024-09-12T00:48:45.311887+0000","last_active":"2024-09-12T01:25:34.498929+0000","last_peered":"2024-09-12T01:25:34.498929+0000","last_clean":"2024-09-12T01:25:34.498929+0000","last_became_active":"2024-09-12T00:48:45.311453+0000","last_became_peered":"2024-09-12T00:48:45.311453+0000","last_unstale":"2024-09-12T01:25:34.498929+0000","last_undegraded":"2024-09-12T01:25:34.498929+0000","last_fullsized":"2024-09-12T01:25:34.498929+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:34.715672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:44.515176+0000","last_change":"2024-09-12T00:48:42.295708+0000","last_active":"2024-09-12T01:27:44.515176+0000","last_peered":"2024-09-12T01:27:44.515176+0000","last_clean":"2024-09-12T01:27:44.515176+0000","last_became_active":"2024-09-12T00:48:42.295358+0000","last_became_peered":"2024-09-12T00:48:42.295358+0000","last_unstale":"2024-09-12T01:27:44.515176+0000","last_undegraded":"2024-09-12T01:27:44.515176+0000","last_fullsized":"2024-09-12T01:27:44.515176+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:21.788554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'81","reported_seq":278,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.503935+0000","last_change":"2024-09-12T00:46:03.916339+0000","last_active":"2024-09-12T01:25:54.503935+0000","last_peered":"2024-09-12T01:25:54.503935+0000","last_clean":"2024-09-12T01:25:54.503935+0000","last_became_active":"2024-09-12T00:46:03.916021+0000","last_became_peered":"2024-09-12T00:46:03.916021+0000","last_unstale":"2024-09-12T01:25:54.503935+0000","last_undegraded":"2024-09-12T01:25:54.503935+0000","last_fullsized":"2024-09-12T01:25:54.503935+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:09.221542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":326,"num_write":133,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.731804+0000","last_change":"2024-09-12T01:04:13.466014+0000","last_active":"2024-09-12T01:27:09.731804+0000","last_peered":"2024-09-12T01:27:09.731804+0000","last_clean":"2024-09-12T01:27:09.731804+0000","last_became_active":"2024-09-12T01:04:13.465478+0000","last_became_peered":"2024-09-12T01:04:13.465478+0000","last_unstale":"2024-09-12T01:27:09.731804+0000","last_undegraded":"2024-09-12T01:27:09.731804+0000","last_fullsized":"2024-09-12T01:27:09.731804+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:45.735147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":37,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718359+0000","last_change":"2024-09-12T00:48:45.314296+0000","last_active":"2024-09-12T01:25:34.718359+0000","last_peered":"2024-09-12T01:25:34.718359+0000","last_clean":"2024-09-12T01:25:34.718359+0000","last_became_active":"2024-09-12T00:48:45.313057+0000","last_became_peered":"2024-09-12T00:48:45.313057+0000","last_unstale":"2024-09-12T01:25:34.718359+0000","last_undegraded":"2024-09-12T01:25:34.718359+0000","last_fullsized":"2024-09-12T01:25:34.718359+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:38.739439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718378+0000","last_change":"2024-09-12T00:48:42.297183+0000","last_active":"2024-09-12T01:25:34.718378+0000","last_peered":"2024-09-12T01:25:34.718378+0000","last_clean":"2024-09-12T01:25:34.718378+0000","last_became_active":"2024-09-12T00:48:42.296903+0000","last_became_peered":"2024-09-12T00:48:42.296903+0000","last_unstale":"2024-09-12T01:25:34.718378+0000","last_undegraded":"2024-09-12T01:25:34.718378+0000","last_fullsized":"2024-09-12T01:25:34.718378+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:11.352129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'58","reported_seq":244,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:40.778662+0000","last_change":"2024-09-12T00:46:03.917455+0000","last_active":"2024-09-12T01:25:40.778662+0000","last_peered":"2024-09-12T01:25:40.778662+0000","last_clean":"2024-09-12T01:25:40.778662+0000","last_became_active":"2024-09-12T00:46:03.917131+0000","last_became_peered":"2024-09-12T00:46:03.917131+0000","last_unstale":"2024-09-12T01:25:40.778662+0000","last_undegraded":"2024-09-12T01:25:40.778662+0000","last_fullsized":"2024-09-12T01:25:40.778662+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:05.329202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":270,"num_write":80,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.781081+0000","last_change":"2024-09-12T01:04:13.468499+0000","last_active":"2024-09-12T01:25:55.781081+0000","last_peered":"2024-09-12T01:25:55.781081+0000","last_clean":"2024-09-12T01:25:55.781081+0000","last_became_active":"2024-09-12T01:04:13.468116+0000","last_became_peered":"2024-09-12T01:04:13.468116+0000","last_unstale":"2024-09-12T01:25:55.781081+0000","last_undegraded":"2024-09-12T01:25:55.781081+0000","last_fullsized":"2024-09-12T01:25:55.781081+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:15.224566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'5","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.831322+0000","last_change":"2024-09-12T00:48:45.317145+0000","last_active":"2024-09-12T01:29:15.831322+0000","last_peered":"2024-09-12T01:29:15.831322+0000","last_clean":"2024-09-12T01:29:15.831322+0000","last_became_active":"2024-09-12T00:48:45.316713+0000","last_became_peered":"2024-09-12T00:48:45.316713+0000","last_unstale":"2024-09-12T01:29:15.831322+0000","last_undegraded":"2024-09-12T01:29:15.831322+0000","last_fullsized":"2024-09-12T01:29:15.831322+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:25.736540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2096,"num_write":10,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:59.523481+0000","last_change":"2024-09-12T00:48:42.293385+0000","last_active":"2024-09-12T01:28:59.523481+0000","last_peered":"2024-09-12T01:28:59.523481+0000","last_clean":"2024-09-12T01:28:59.523481+0000","last_became_active":"2024-09-12T00:48:42.293111+0000","last_became_peered":"2024-09-12T00:48:42.293111+0000","last_unstale":"2024-09-12T01:28:59.523481+0000","last_undegraded":"2024-09-12T01:28:59.523481+0000","last_fullsized":"2024-09-12T01:28:59.523481+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:17.021932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'34","reported_seq":139,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.502266+0000","last_change":"2024-09-12T00:46:03.914760+0000","last_active":"2024-09-12T01:25:39.502266+0000","last_peered":"2024-09-12T01:25:39.502266+0000","last_clean":"2024-09-12T01:25:39.502266+0000","last_became_active":"2024-09-12T00:46:03.914387+0000","last_became_peered":"2024-09-12T00:46:03.914387+0000","last_unstale":"2024-09-12T01:25:39.502266+0000","last_undegraded":"2024-09-12T01:25:39.502266+0000","last_fullsized":"2024-09-12T01:25:39.502266+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:56.621300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:53.499141+0000","last_change":"2024-09-12T01:04:13.470882+0000","last_active":"2024-09-12T01:25:53.499141+0000","last_peered":"2024-09-12T01:25:53.499141+0000","last_clean":"2024-09-12T01:25:53.499141+0000","last_became_active":"2024-09-12T01:04:13.470597+0000","last_became_peered":"2024-09-12T01:04:13.470597+0000","last_unstale":"2024-09-12T01:25:53.499141+0000","last_undegraded":"2024-09-12T01:25:53.499141+0000","last_fullsized":"2024-09-12T01:25:53.499141+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:44.301395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:49.729085+0000","last_change":"2024-09-12T00:48:45.316493+0000","last_active":"2024-09-12T01:26:49.729085+0000","last_peered":"2024-09-12T01:26:49.729085+0000","last_clean":"2024-09-12T01:26:49.729085+0000","last_became_active":"2024-09-12T00:48:45.316182+0000","last_became_peered":"2024-09-12T00:48:45.316182+0000","last_unstale":"2024-09-12T01:26:49.729085+0000","last_undegraded":"2024-09-12T01:26:49.729085+0000","last_fullsized":"2024-09-12T01:26:49.729085+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:51.175017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:19.740938+0000","last_change":"2024-09-12T00:48:42.294249+0000","last_active":"2024-09-12T01:28:19.740938+0000","last_peered":"2024-09-12T01:28:19.740938+0000","last_clean":"2024-09-12T01:28:19.740938+0000","last_became_active":"2024-09-12T00:48:42.293947+0000","last_became_peered":"2024-09-12T00:48:42.293947+0000","last_unstale":"2024-09-12T01:28:19.740938+0000","last_undegraded":"2024-09-12T01:28:19.740938+0000","last_fullsized":"2024-09-12T01:28:19.740938+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:38.623578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'54","reported_seq":194,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.718948+0000","last_change":"2024-09-12T00:46:03.919567+0000","last_active":"2024-09-12T01:25:39.718948+0000","last_peered":"2024-09-12T01:25:39.718948+0000","last_clean":"2024-09-12T01:25:39.718948+0000","last_became_active":"2024-09-12T00:46:03.919285+0000","last_became_peered":"2024-09-12T00:46:03.919285+0000","last_unstale":"2024-09-12T01:25:39.718948+0000","last_undegraded":"2024-09-12T01:25:39.718948+0000","last_fullsized":"2024-09-12T01:25:39.718948+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:47.685991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":102,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:12.509455+0000","last_change":"2024-09-12T01:04:13.467623+0000","last_active":"2024-09-12T01:27:12.509455+0000","last_peered":"2024-09-12T01:27:12.509455+0000","last_clean":"2024-09-12T01:27:12.509455+0000","last_became_active":"2024-09-12T01:04:13.467374+0000","last_became_peered":"2024-09-12T01:04:13.467374+0000","last_unstale":"2024-09-12T01:27:12.509455+0000","last_undegraded":"2024-09-12T01:27:12.509455+0000","last_fullsized":"2024-09-12T01:27:12.509455+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:34.421544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505968+0000","last_change":"2024-09-12T00:48:45.310759+0000","last_active":"2024-09-12T01:26:14.505968+0000","last_peered":"2024-09-12T01:26:14.505968+0000","last_clean":"2024-09-12T01:26:14.505968+0000","last_became_active":"2024-09-12T00:48:45.310423+0000","last_became_peered":"2024-09-12T00:48:45.310423+0000","last_unstale":"2024-09-12T01:26:14.505968+0000","last_undegraded":"2024-09-12T01:26:14.505968+0000","last_fullsized":"2024-09-12T01:26:14.505968+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:13.622431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639581+0000","last_change":"2024-09-12T00:48:42.296171+0000","last_active":"2024-09-12T01:26:15.639581+0000","last_peered":"2024-09-12T01:26:15.639581+0000","last_clean":"2024-09-12T01:26:15.639581+0000","last_became_active":"2024-09-12T00:48:42.295861+0000","last_became_peered":"2024-09-12T00:48:42.295861+0000","last_unstale":"2024-09-12T01:26:15.639581+0000","last_undegraded":"2024-09-12T01:26:15.639581+0000","last_fullsized":"2024-09-12T01:26:15.639581+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:57.732050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.718904+0000","last_change":"2024-09-12T00:46:03.919535+0000","last_active":"2024-09-12T01:25:39.718904+0000","last_peered":"2024-09-12T01:25:39.718904+0000","last_clean":"2024-09-12T01:25:39.718904+0000","last_became_active":"2024-09-12T00:46:03.917353+0000","last_became_peered":"2024-09-12T00:46:03.917353+0000","last_unstale":"2024-09-12T01:25:39.718904+0000","last_undegraded":"2024-09-12T01:25:39.718904+0000","last_fullsized":"2024-09-12T01:25:39.718904+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:22.130628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":151,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.731874+0000","last_change":"2024-09-12T01:04:13.467110+0000","last_active":"2024-09-12T01:27:09.731874+0000","last_peered":"2024-09-12T01:27:09.731874+0000","last_clean":"2024-09-12T01:27:09.731874+0000","last_became_active":"2024-09-12T01:04:13.466783+0000","last_became_peered":"2024-09-12T01:04:13.466783+0000","last_unstale":"2024-09-12T01:27:09.731874+0000","last_undegraded":"2024-09-12T01:27:09.731874+0000","last_fullsized":"2024-09-12T01:27:09.731874+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:53.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505931+0000","last_change":"2024-09-12T00:48:45.312610+0000","last_active":"2024-09-12T01:26:14.505931+0000","last_peered":"2024-09-12T01:26:14.505931+0000","last_clean":"2024-09-12T01:26:14.505931+0000","last_became_active":"2024-09-12T00:48:45.312329+0000","last_became_peered":"2024-09-12T00:48:45.312329+0000","last_unstale":"2024-09-12T01:26:14.505931+0000","last_undegraded":"2024-09-12T01:26:14.505931+0000","last_fullsized":"2024-09-12T01:26:14.505931+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:29.308504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:19.520998+0000","last_change":"2024-09-12T00:48:42.286718+0000","last_active":"2024-09-12T01:28:19.520998+0000","last_peered":"2024-09-12T01:28:19.520998+0000","last_clean":"2024-09-12T01:28:19.520998+0000","last_became_active":"2024-09-12T00:48:42.286427+0000","last_became_peered":"2024-09-12T00:48:42.286427+0000","last_unstale":"2024-09-12T01:28:19.520998+0000","last_undegraded":"2024-09-12T01:28:19.520998+0000","last_fullsized":"2024-09-12T01:28:19.520998+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:46.315650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'46","reported_seq":175,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:19.506448+0000","last_change":"2024-09-12T00:46:03.919531+0000","last_active":"2024-09-12T01:26:19.506448+0000","last_peered":"2024-09-12T01:26:19.506448+0000","last_clean":"2024-09-12T01:26:19.506448+0000","last_became_active":"2024-09-12T00:46:03.919259+0000","last_became_peered":"2024-09-12T00:46:03.919259+0000","last_unstale":"2024-09-12T01:26:19.506448+0000","last_undegraded":"2024-09-12T01:26:19.506448+0000","last_fullsized":"2024-09-12T01:26:19.506448+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:12.310694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":85,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'380","reported_seq":1134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.020280+0000","last_change":"2024-09-12T01:29:28.020280+0000","last_active":"2024-09-12T01:29:28.020280+0000","last_peered":"2024-09-12T01:29:28.020280+0000","last_clean":"2024-09-12T01:29:28.020280+0000","last_became_active":"2024-09-12T00:31:47.137895+0000","last_became_peered":"2024-09-12T00:31:47.137895+0000","last_unstale":"2024-09-12T01:29:28.020280+0000","last_undegraded":"2024-09-12T01:29:28.020280+0000","last_fullsized":"2024-09-12T01:29:28.020280+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-12T01:29:28.020146+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-12T01:29:28.020146+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.020146+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:56.555166+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":750,"num_read_kb":31522,"num_write":1285,"num_write_kb":24718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'194","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.479650+0000","last_change":"2024-09-12T01:29:36.479650+0000","last_active":"2024-09-12T01:29:36.479650+0000","last_peered":"2024-09-12T01:29:36.479650+0000","last_clean":"2024-09-12T01:29:36.479650+0000","last_became_active":"2024-09-12T00:31:50.138226+0000","last_became_peered":"2024-09-12T00:31:50.138226+0000","last_unstale":"2024-09-12T01:29:36.479650+0000","last_undegraded":"2024-09-12T01:29:36.479650+0000","last_fullsized":"2024-09-12T01:29:36.479650+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'194","last_scrub_stamp":"2024-09-12T01:29:36.479554+0000","last_deep_scrub":"265'194","last_deep_scrub_stamp":"2024-09-12T01:29:36.479554+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.479554+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:41.039566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":913,"num_read_kb":766,"num_write":296,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'314","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.867707+0000","last_change":"2024-09-12T01:29:35.867707+0000","last_active":"2024-09-12T01:29:35.867707+0000","last_peered":"2024-09-12T01:29:35.867707+0000","last_clean":"2024-09-12T01:29:35.867707+0000","last_became_active":"2024-09-12T00:31:47.134134+0000","last_became_peered":"2024-09-12T00:31:47.134134+0000","last_unstale":"2024-09-12T01:29:35.867707+0000","last_undegraded":"2024-09-12T01:29:35.867707+0000","last_fullsized":"2024-09-12T01:29:35.867707+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-12T01:29:35.867548+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-12T01:29:35.867548+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.867548+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:04.584926+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":463,"num_read_kb":16965,"num_write":1018,"num_write_kb":26995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'110","reported_seq":705,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:49.729125+0000","last_change":"2024-09-12T00:31:50.132884+0000","last_active":"2024-09-12T01:26:49.729125+0000","last_peered":"2024-09-12T01:26:49.729125+0000","last_clean":"2024-09-12T01:26:49.729125+0000","last_became_active":"2024-09-12T00:31:50.132639+0000","last_became_peered":"2024-09-12T00:31:50.132639+0000","last_unstale":"2024-09-12T01:26:49.729125+0000","last_undegraded":"2024-09-12T01:26:49.729125+0000","last_fullsized":"2024-09-12T01:26:49.729125+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:24.512638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":165,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'368","reported_seq":1115,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.955684+0000","last_change":"2024-09-12T01:29:32.955684+0000","last_active":"2024-09-12T01:29:32.955684+0000","last_peered":"2024-09-12T01:29:32.955684+0000","last_clean":"2024-09-12T01:29:32.955684+0000","last_became_active":"2024-09-12T00:31:47.119865+0000","last_became_peered":"2024-09-12T00:31:47.119865+0000","last_unstale":"2024-09-12T01:29:32.955684+0000","last_undegraded":"2024-09-12T01:29:32.955684+0000","last_fullsized":"2024-09-12T01:29:32.955684+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T01:29:32.955566+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T01:29:32.955566+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.955566+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:34.193090+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344922,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":840,"num_read_kb":4429,"num_write":1181,"num_write_kb":10543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'286","reported_seq":936,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:49.729160+0000","last_change":"2024-09-12T00:31:50.135767+0000","last_active":"2024-09-12T01:26:49.729160+0000","last_peered":"2024-09-12T01:26:49.729160+0000","last_clean":"2024-09-12T01:26:49.729160+0000","last_became_active":"2024-09-12T00:31:50.135413+0000","last_became_peered":"2024-09-12T00:31:50.135413+0000","last_unstale":"2024-09-12T01:26:49.729160+0000","last_undegraded":"2024-09-12T01:26:49.729160+0000","last_fullsized":"2024-09-12T01:26:49.729160+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:32.753854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1012,"num_write":455,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'315","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.404656+0000","last_change":"2024-09-12T01:29:27.404656+0000","last_active":"2024-09-12T01:29:27.404656+0000","last_peered":"2024-09-12T01:29:27.404656+0000","last_clean":"2024-09-12T01:29:27.404656+0000","last_became_active":"2024-09-12T00:31:47.133414+0000","last_became_peered":"2024-09-12T00:31:47.133414+0000","last_unstale":"2024-09-12T01:29:27.404656+0000","last_undegraded":"2024-09-12T01:29:27.404656+0000","last_fullsized":"2024-09-12T01:29:27.404656+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'315","last_scrub_stamp":"2024-09-12T01:29:27.404449+0000","last_deep_scrub":"265'315","last_deep_scrub_stamp":"2024-09-12T01:29:27.404449+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.404449+0000","objects_scrubbed":11,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:30.134243+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11933654,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":465,"num_read_kb":32236,"num_write":1054,"num_write_kb":37937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'183","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.543227+0000","last_change":"2024-09-12T01:29:35.543227+0000","last_active":"2024-09-12T01:29:35.543227+0000","last_peered":"2024-09-12T01:29:35.543227+0000","last_clean":"2024-09-12T01:29:35.543227+0000","last_became_active":"2024-09-12T00:31:50.135322+0000","last_became_peered":"2024-09-12T00:31:50.135322+0000","last_unstale":"2024-09-12T01:29:35.543227+0000","last_undegraded":"2024-09-12T01:29:35.543227+0000","last_fullsized":"2024-09-12T01:29:35.543227+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'183","last_scrub_stamp":"2024-09-12T01:29:35.543144+0000","last_deep_scrub":"265'183","last_deep_scrub_stamp":"2024-09-12T01:29:35.543144+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.543144+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:36.766989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":591,"num_write":296,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'319","reported_seq":951,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.045050+0000","last_change":"2024-09-12T01:29:29.045050+0000","last_active":"2024-09-12T01:29:29.045050+0000","last_peered":"2024-09-12T01:29:29.045050+0000","last_clean":"2024-09-12T01:29:29.045050+0000","last_became_active":"2024-09-12T00:31:47.128016+0000","last_became_peered":"2024-09-12T00:31:47.128016+0000","last_unstale":"2024-09-12T01:29:29.045050+0000","last_undegraded":"2024-09-12T01:29:29.045050+0000","last_fullsized":"2024-09-12T01:29:29.045050+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T01:29:29.044943+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T01:29:29.044943+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.044943+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:09.317724+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":458,"num_read_kb":35042,"num_write":1048,"num_write_kb":20184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'220","reported_seq":847,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.168558+0000","last_change":"2024-09-12T01:29:36.168558+0000","last_active":"2024-09-12T01:29:36.168558+0000","last_peered":"2024-09-12T01:29:36.168558+0000","last_clean":"2024-09-12T01:29:36.168558+0000","last_became_active":"2024-09-12T00:31:50.132674+0000","last_became_peered":"2024-09-12T00:31:50.132674+0000","last_unstale":"2024-09-12T01:29:36.168558+0000","last_undegraded":"2024-09-12T01:29:36.168558+0000","last_fullsized":"2024-09-12T01:29:36.168558+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'220","last_scrub_stamp":"2024-09-12T01:29:36.168468+0000","last_deep_scrub":"265'220","last_deep_scrub_stamp":"2024-09-12T01:29:36.168468+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.168468+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:46.453708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":967,"num_read_kb":781,"num_write":356,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'365","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.391195+0000","last_change":"2024-09-12T01:29:24.391195+0000","last_active":"2024-09-12T01:29:24.391195+0000","last_peered":"2024-09-12T01:29:24.391195+0000","last_clean":"2024-09-12T01:29:24.391195+0000","last_became_active":"2024-09-12T00:31:47.134887+0000","last_became_peered":"2024-09-12T00:31:47.134887+0000","last_unstale":"2024-09-12T01:29:24.391195+0000","last_undegraded":"2024-09-12T01:29:24.391195+0000","last_fullsized":"2024-09-12T01:29:24.391195+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:29:24.391061+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:29:24.391061+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.391061+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.168982+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396853,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":509,"num_read_kb":3274,"num_write":1223,"num_write_kb":38824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'275","reported_seq":858,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.146593+0000","last_change":"2024-09-12T01:29:34.146593+0000","last_active":"2024-09-12T01:29:34.146593+0000","last_peered":"2024-09-12T01:29:34.146593+0000","last_clean":"2024-09-12T01:29:34.146593+0000","last_became_active":"2024-09-12T00:31:50.140087+0000","last_became_peered":"2024-09-12T00:31:50.140087+0000","last_unstale":"2024-09-12T01:29:34.146593+0000","last_undegraded":"2024-09-12T01:29:34.146593+0000","last_fullsized":"2024-09-12T01:29:34.146593+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'275","last_scrub_stamp":"2024-09-12T01:29:34.146509+0000","last_deep_scrub":"265'275","last_deep_scrub_stamp":"2024-09-12T01:29:34.146509+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.146509+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:19.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1141,"num_read_kb":956,"num_write":415,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'392","reported_seq":1038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.099016+0000","last_change":"2024-09-12T01:29:37.099016+0000","last_active":"2024-09-12T01:29:37.099016+0000","last_peered":"2024-09-12T01:29:37.099016+0000","last_clean":"2024-09-12T01:29:37.099016+0000","last_became_active":"2024-09-12T00:32:23.830676+0000","last_became_peered":"2024-09-12T00:32:23.830676+0000","last_unstale":"2024-09-12T01:29:37.099016+0000","last_undegraded":"2024-09-12T01:29:37.099016+0000","last_fullsized":"2024-09-12T01:29:37.099016+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'392","last_scrub_stamp":"2024-09-12T01:29:37.098873+0000","last_deep_scrub":"265'392","last_deep_scrub_stamp":"2024-09-12T01:29:37.098873+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.098873+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:30.205825+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170251,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":5774,"num_write":1256,"num_write_kb":23845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3e","version":"265'51","reported_seq":598,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.403863+0000","last_change":"2024-09-12T01:29:32.403863+0000","last_active":"2024-09-12T01:29:32.403863+0000","last_peered":"2024-09-12T01:29:32.403863+0000","last_clean":"2024-09-12T01:29:32.403863+0000","last_became_active":"2024-09-12T00:31:50.140207+0000","last_became_peered":"2024-09-12T00:31:50.140207+0000","last_unstale":"2024-09-12T01:29:32.403863+0000","last_undegraded":"2024-09-12T01:29:32.403863+0000","last_fullsized":"2024-09-12T01:29:32.403863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'51","last_scrub_stamp":"2024-09-12T01:29:32.403772+0000","last_deep_scrub":"265'51","last_deep_scrub_stamp":"2024-09-12T01:29:32.403772+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.403772+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:53.477543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":145,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'386","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.878927+0000","last_change":"2024-09-12T01:29:30.878927+0000","last_active":"2024-09-12T01:29:30.878927+0000","last_peered":"2024-09-12T01:29:30.878927+0000","last_clean":"2024-09-12T01:29:30.878927+0000","last_became_active":"2024-09-12T00:31:47.127930+0000","last_became_peered":"2024-09-12T00:31:47.127930+0000","last_unstale":"2024-09-12T01:29:30.878927+0000","last_undegraded":"2024-09-12T01:29:30.878927+0000","last_fullsized":"2024-09-12T01:29:30.878927+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T01:29:30.878794+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T01:29:30.878794+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.878794+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:54.052551+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396864,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":638,"num_read_kb":6946,"num_write":1462,"num_write_kb":29009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'96","reported_seq":688,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498691+0000","last_change":"2024-09-12T00:31:50.142364+0000","last_active":"2024-09-12T01:26:02.498691+0000","last_peered":"2024-09-12T01:26:02.498691+0000","last_clean":"2024-09-12T01:26:02.498691+0000","last_became_active":"2024-09-12T00:31:50.142071+0000","last_became_peered":"2024-09-12T00:31:50.142071+0000","last_unstale":"2024-09-12T01:26:02.498691+0000","last_undegraded":"2024-09-12T01:26:02.498691+0000","last_fullsized":"2024-09-12T01:26:02.498691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:46.856124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":364,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'86","reported_seq":690,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:29.717727+0000","last_change":"2024-09-12T00:31:50.132450+0000","last_active":"2024-09-12T01:25:29.717727+0000","last_peered":"2024-09-12T01:25:29.717727+0000","last_clean":"2024-09-12T01:25:29.717727+0000","last_became_active":"2024-09-12T00:31:50.132178+0000","last_became_peered":"2024-09-12T00:31:50.132178+0000","last_unstale":"2024-09-12T01:25:29.717727+0000","last_undegraded":"2024-09-12T01:25:29.717727+0000","last_fullsized":"2024-09-12T01:25:29.717727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:34.527456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":346,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'333","reported_seq":988,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.353300+0000","last_change":"2024-09-12T01:29:24.353300+0000","last_active":"2024-09-12T01:29:24.353300+0000","last_peered":"2024-09-12T01:29:24.353300+0000","last_clean":"2024-09-12T01:29:24.353300+0000","last_became_active":"2024-09-12T00:31:47.123956+0000","last_became_peered":"2024-09-12T00:31:47.123956+0000","last_unstale":"2024-09-12T01:29:24.353300+0000","last_undegraded":"2024-09-12T01:29:24.353300+0000","last_fullsized":"2024-09-12T01:29:24.353300+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T01:29:24.353156+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T01:29:24.353156+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.353156+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:57.167462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525329,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":483,"num_read_kb":32458,"num_write":1127,"num_write_kb":22794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'162","reported_seq":816,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.098935+0000","last_change":"2024-09-12T01:29:32.098935+0000","last_active":"2024-09-12T01:29:32.098935+0000","last_peered":"2024-09-12T01:29:32.098935+0000","last_clean":"2024-09-12T01:29:32.098935+0000","last_became_active":"2024-09-12T00:31:50.130844+0000","last_became_peered":"2024-09-12T00:31:50.130844+0000","last_unstale":"2024-09-12T01:29:32.098935+0000","last_undegraded":"2024-09-12T01:29:32.098935+0000","last_fullsized":"2024-09-12T01:29:32.098935+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-12T01:29:32.098837+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-12T01:29:32.098837+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.098837+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:49.537667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":634,"num_write":246,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'260","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.982139+0000","last_change":"2024-09-12T01:29:26.982139+0000","last_active":"2024-09-12T01:29:26.982139+0000","last_peered":"2024-09-12T01:29:26.982139+0000","last_clean":"2024-09-12T01:29:26.982139+0000","last_became_active":"2024-09-12T00:31:47.127400+0000","last_became_peered":"2024-09-12T00:31:47.127400+0000","last_unstale":"2024-09-12T01:29:26.982139+0000","last_undegraded":"2024-09-12T01:29:26.982139+0000","last_fullsized":"2024-09-12T01:29:26.982139+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-12T01:29:26.981947+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-12T01:29:26.981947+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.981947+0000","objects_scrubbed":7,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:05.911480+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133724,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":320,"num_read_kb":20510,"num_write":796,"num_write_kb":47522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'404","reported_seq":1178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.443336+0000","last_change":"2024-09-12T01:29:30.443336+0000","last_active":"2024-09-12T01:29:30.443336+0000","last_peered":"2024-09-12T01:29:30.443336+0000","last_clean":"2024-09-12T01:29:30.443336+0000","last_became_active":"2024-09-12T00:31:50.142337+0000","last_became_peered":"2024-09-12T00:31:50.142337+0000","last_unstale":"2024-09-12T01:29:30.443336+0000","last_undegraded":"2024-09-12T01:29:30.443336+0000","last_fullsized":"2024-09-12T01:29:30.443336+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'404","last_scrub_stamp":"2024-09-12T01:29:30.443248+0000","last_deep_scrub":"265'404","last_deep_scrub_stamp":"2024-09-12T01:29:30.443248+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.443248+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:45.435463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1845,"num_write":683,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'316","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.955954+0000","last_change":"2024-09-12T01:29:25.955954+0000","last_active":"2024-09-12T01:29:25.955954+0000","last_peered":"2024-09-12T01:29:25.955954+0000","last_clean":"2024-09-12T01:29:25.955954+0000","last_became_active":"2024-09-12T00:31:47.139517+0000","last_became_peered":"2024-09-12T00:31:47.139517+0000","last_unstale":"2024-09-12T01:29:25.955954+0000","last_undegraded":"2024-09-12T01:29:25.955954+0000","last_fullsized":"2024-09-12T01:29:25.955954+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T01:29:25.955816+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T01:29:25.955816+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.955816+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:56.138848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788540,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":6586,"num_write":1090,"num_write_kb":25928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'147","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.097461+0000","last_change":"2024-09-12T01:29:39.097461+0000","last_active":"2024-09-12T01:29:39.097461+0000","last_peered":"2024-09-12T01:29:39.097461+0000","last_clean":"2024-09-12T01:29:39.097461+0000","last_became_active":"2024-09-12T00:31:50.142311+0000","last_became_peered":"2024-09-12T00:31:50.142311+0000","last_unstale":"2024-09-12T01:29:39.097461+0000","last_undegraded":"2024-09-12T01:29:39.097461+0000","last_fullsized":"2024-09-12T01:29:39.097461+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'147","last_scrub_stamp":"2024-09-12T01:29:39.097377+0000","last_deep_scrub":"265'147","last_deep_scrub_stamp":"2024-09-12T01:29:39.097377+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.097377+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:58.929897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":237,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'262","reported_seq":890,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.987898+0000","last_change":"2024-09-12T01:29:24.987898+0000","last_active":"2024-09-12T01:29:24.987898+0000","last_peered":"2024-09-12T01:29:24.987898+0000","last_clean":"2024-09-12T01:29:24.987898+0000","last_became_active":"2024-09-12T00:31:47.130329+0000","last_became_peered":"2024-09-12T00:31:47.130329+0000","last_unstale":"2024-09-12T01:29:24.987898+0000","last_undegraded":"2024-09-12T01:29:24.987898+0000","last_fullsized":"2024-09-12T01:29:24.987898+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'262","last_scrub_stamp":"2024-09-12T01:29:24.987705+0000","last_deep_scrub":"265'262","last_deep_scrub_stamp":"2024-09-12T01:29:24.987705+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.987705+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:33.987536+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287558,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":37644,"num_write":765,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'112","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:33.595038+0000","last_change":"2024-09-12T00:31:50.136264+0000","last_active":"2024-09-12T01:26:33.595038+0000","last_peered":"2024-09-12T01:26:33.595038+0000","last_clean":"2024-09-12T01:26:33.595038+0000","last_became_active":"2024-09-12T00:31:50.135595+0000","last_became_peered":"2024-09-12T00:31:50.135595+0000","last_unstale":"2024-09-12T01:26:33.595038+0000","last_undegraded":"2024-09-12T01:26:33.595038+0000","last_fullsized":"2024-09-12T01:26:33.595038+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:16.754941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":410,"num_write":180,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'318","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.179350+0000","last_change":"2024-09-12T01:29:31.179350+0000","last_active":"2024-09-12T01:29:31.179350+0000","last_peered":"2024-09-12T01:29:31.179350+0000","last_clean":"2024-09-12T01:29:31.179350+0000","last_became_active":"2024-09-12T00:31:47.133592+0000","last_became_peered":"2024-09-12T00:31:47.133592+0000","last_unstale":"2024-09-12T01:29:31.179350+0000","last_undegraded":"2024-09-12T01:29:31.179350+0000","last_fullsized":"2024-09-12T01:29:31.179350+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T01:29:31.179182+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T01:29:31.179182+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.179182+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:48.318104+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396882,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":783,"num_read_kb":29951,"num_write":1081,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'73","reported_seq":632,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.418672+0000","last_change":"2024-09-12T01:29:31.418672+0000","last_active":"2024-09-12T01:29:31.418672+0000","last_peered":"2024-09-12T01:29:31.418672+0000","last_clean":"2024-09-12T01:29:31.418672+0000","last_became_active":"2024-09-12T00:31:50.135972+0000","last_became_peered":"2024-09-12T00:31:50.135972+0000","last_unstale":"2024-09-12T01:29:31.418672+0000","last_undegraded":"2024-09-12T01:29:31.418672+0000","last_fullsized":"2024-09-12T01:29:31.418672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'73","last_scrub_stamp":"2024-09-12T01:29:31.418583+0000","last_deep_scrub":"265'73","last_deep_scrub_stamp":"2024-09-12T01:29:31.418583+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.418583+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:39.743725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":249,"num_write":116,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'312","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.185734+0000","last_change":"2024-09-12T01:29:30.185734+0000","last_active":"2024-09-12T01:29:30.185734+0000","last_peered":"2024-09-12T01:29:30.185734+0000","last_clean":"2024-09-12T01:29:30.185734+0000","last_became_active":"2024-09-12T00:31:47.118260+0000","last_became_peered":"2024-09-12T00:31:47.118260+0000","last_unstale":"2024-09-12T01:29:30.185734+0000","last_undegraded":"2024-09-12T01:29:30.185734+0000","last_fullsized":"2024-09-12T01:29:30.185734+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T01:29:30.185600+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T01:29:30.185600+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.185600+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:50.982982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":15045,"num_write":981,"num_write_kb":26498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'123","reported_seq":623,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.422976+0000","last_change":"2024-09-12T00:31:58.184465+0000","last_active":"2024-09-12T01:27:48.422976+0000","last_peered":"2024-09-12T01:27:48.422976+0000","last_clean":"2024-09-12T01:27:48.422976+0000","last_became_active":"2024-09-12T00:31:58.183784+0000","last_became_peered":"2024-09-12T00:31:58.183784+0000","last_unstale":"2024-09-12T01:27:48.422976+0000","last_undegraded":"2024-09-12T01:27:48.422976+0000","last_fullsized":"2024-09-12T01:27:48.422976+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:03.783137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":134,"num_write":297,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'230","reported_seq":841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.113884+0000","last_change":"2024-09-12T01:29:36.113884+0000","last_active":"2024-09-12T01:29:36.113884+0000","last_peered":"2024-09-12T01:29:36.113884+0000","last_clean":"2024-09-12T01:29:36.113884+0000","last_became_active":"2024-09-12T00:31:50.140510+0000","last_became_peered":"2024-09-12T00:31:50.140510+0000","last_unstale":"2024-09-12T01:29:36.113884+0000","last_undegraded":"2024-09-12T01:29:36.113884+0000","last_fullsized":"2024-09-12T01:29:36.113884+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'230","last_scrub_stamp":"2024-09-12T01:29:36.113803+0000","last_deep_scrub":"265'230","last_deep_scrub_stamp":"2024-09-12T01:29:36.113803+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.113803+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:49.872114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":944,"num_read_kb":762,"num_write":358,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'334","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.026172+0000","last_change":"2024-09-12T01:29:29.026172+0000","last_active":"2024-09-12T01:29:29.026172+0000","last_peered":"2024-09-12T01:29:29.026172+0000","last_clean":"2024-09-12T01:29:29.026172+0000","last_became_active":"2024-09-12T00:31:47.131940+0000","last_became_peered":"2024-09-12T00:31:47.131940+0000","last_unstale":"2024-09-12T01:29:29.026172+0000","last_undegraded":"2024-09-12T01:29:29.026172+0000","last_fullsized":"2024-09-12T01:29:29.026172+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-12T01:29:29.026060+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-12T01:29:29.026060+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.026060+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:53.704154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":467,"num_read_kb":415,"num_write":1065,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714895+0000","last_change":"2024-09-12T00:31:52.153386+0000","last_active":"2024-09-12T01:25:04.714895+0000","last_peered":"2024-09-12T01:25:04.714895+0000","last_clean":"2024-09-12T01:25:04.714895+0000","last_became_active":"2024-09-12T00:31:52.151351+0000","last_became_peered":"2024-09-12T00:31:52.151351+0000","last_unstale":"2024-09-12T01:25:04.714895+0000","last_undegraded":"2024-09-12T01:25:04.714895+0000","last_fullsized":"2024-09-12T01:25:04.714895+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:30.711260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'341","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.296259+0000","last_change":"2024-09-12T00:31:54.168796+0000","last_active":"2024-09-12T01:29:16.296259+0000","last_peered":"2024-09-12T01:29:16.296259+0000","last_clean":"2024-09-12T01:29:16.296259+0000","last_became_active":"2024-09-12T00:31:54.168545+0000","last_became_peered":"2024-09-12T00:31:54.168545+0000","last_unstale":"2024-09-12T01:29:16.296259+0000","last_undegraded":"2024-09-12T01:29:16.296259+0000","last_fullsized":"2024-09-12T01:29:16.296259+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:43.289137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45599,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":546,"num_read_kb":1097,"num_write":426,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:09.599902+0000","last_change":"2024-09-12T00:31:56.171140+0000","last_active":"2024-09-12T01:25:09.599902+0000","last_peered":"2024-09-12T01:25:09.599902+0000","last_clean":"2024-09-12T01:25:09.599902+0000","last_became_active":"2024-09-12T00:31:56.170837+0000","last_became_peered":"2024-09-12T00:31:56.170837+0000","last_unstale":"2024-09-12T01:25:09.599902+0000","last_undegraded":"2024-09-12T01:25:09.599902+0000","last_fullsized":"2024-09-12T01:25:09.599902+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:56.785552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2464","reported_seq":4352,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.990962+0000","last_change":"2024-09-12T00:31:58.182713+0000","last_active":"2024-09-12T01:27:47.990962+0000","last_peered":"2024-09-12T01:27:47.990962+0000","last_clean":"2024-09-12T01:27:47.990962+0000","last_became_active":"2024-09-12T00:31:58.181552+0000","last_became_peered":"2024-09-12T00:31:58.181552+0000","last_unstale":"2024-09-12T01:27:47.990962+0000","last_undegraded":"2024-09-12T01:27:47.990962+0000","last_fullsized":"2024-09-12T01:27:47.990962+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":2400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:59.050279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":617,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6112,"num_read_kb":6115,"num_write":4931,"num_write_kb":1807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'4138","reported_seq":4758,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.099282+0000","last_change":"2024-09-12T01:29:39.099282+0000","last_active":"2024-09-12T01:29:39.099282+0000","last_peered":"2024-09-12T01:29:39.099282+0000","last_clean":"2024-09-12T01:29:39.099282+0000","last_became_active":"2024-09-12T00:31:50.133357+0000","last_became_peered":"2024-09-12T00:31:50.133357+0000","last_unstale":"2024-09-12T01:29:39.099282+0000","last_undegraded":"2024-09-12T01:29:39.099282+0000","last_fullsized":"2024-09-12T01:29:39.099282+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4138","last_scrub_stamp":"2024-09-12T01:29:39.099192+0000","last_deep_scrub":"265'4138","last_deep_scrub_stamp":"2024-09-12T01:29:39.099192+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.099192+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":3000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:48.646221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16657,"num_read_kb":13895,"num_write":6209,"num_write_kb":3095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'296","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.186057+0000","last_change":"2024-09-12T01:29:27.186057+0000","last_active":"2024-09-12T01:29:27.186057+0000","last_peered":"2024-09-12T01:29:27.186057+0000","last_clean":"2024-09-12T01:29:27.186057+0000","last_became_active":"2024-09-12T00:31:47.131849+0000","last_became_peered":"2024-09-12T00:31:47.131849+0000","last_unstale":"2024-09-12T01:29:27.186057+0000","last_undegraded":"2024-09-12T01:29:27.186057+0000","last_fullsized":"2024-09-12T01:29:27.186057+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'296","last_scrub_stamp":"2024-09-12T01:29:27.185965+0000","last_deep_scrub":"265'296","last_deep_scrub_stamp":"2024-09-12T01:29:27.185965+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.185965+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:13.318989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":405,"num_read_kb":4533,"num_write":946,"num_write_kb":25027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:48.498477+0000","last_change":"2024-09-12T00:31:52.153157+0000","last_active":"2024-09-12T01:25:48.498477+0000","last_peered":"2024-09-12T01:25:48.498477+0000","last_clean":"2024-09-12T01:25:48.498477+0000","last_became_active":"2024-09-12T00:31:52.152244+0000","last_became_peered":"2024-09-12T00:31:52.152244+0000","last_unstale":"2024-09-12T01:25:48.498477+0000","last_undegraded":"2024-09-12T01:25:48.498477+0000","last_fullsized":"2024-09-12T01:25:48.498477+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:13.492533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'94","reported_seq":627,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.599360+0000","last_change":"2024-09-12T00:31:54.167561+0000","last_active":"2024-09-12T01:25:04.599360+0000","last_peered":"2024-09-12T01:25:04.599360+0000","last_clean":"2024-09-12T01:25:04.599360+0000","last_became_active":"2024-09-12T00:31:54.167260+0000","last_became_peered":"2024-09-12T00:31:54.167260+0000","last_unstale":"2024-09-12T01:25:04.599360+0000","last_undegraded":"2024-09-12T01:25:04.599360+0000","last_fullsized":"2024-09-12T01:25:04.599360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:28.995792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":103,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:09.599867+0000","last_change":"2024-09-12T00:31:56.174756+0000","last_active":"2024-09-12T01:25:09.599867+0000","last_peered":"2024-09-12T01:25:09.599867+0000","last_clean":"2024-09-12T01:25:09.599867+0000","last_became_active":"2024-09-12T00:31:56.174452+0000","last_became_peered":"2024-09-12T00:31:56.174452+0000","last_unstale":"2024-09-12T01:25:09.599867+0000","last_undegraded":"2024-09-12T01:25:09.599867+0000","last_fullsized":"2024-09-12T01:25:09.599867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:05.497151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'144","reported_seq":639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:45.923196+0000","last_change":"2024-09-12T00:31:58.179079+0000","last_active":"2024-09-12T01:27:45.923196+0000","last_peered":"2024-09-12T01:27:45.923196+0000","last_clean":"2024-09-12T01:27:45.923196+0000","last_became_active":"2024-09-12T00:31:58.178748+0000","last_became_peered":"2024-09-12T00:31:58.178748+0000","last_unstale":"2024-09-12T01:27:45.923196+0000","last_undegraded":"2024-09-12T01:27:45.923196+0000","last_fullsized":"2024-09-12T01:27:45.923196+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":137,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'401","reported_seq":1070,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:02.489318+0000","last_change":"2024-09-12T00:31:50.143909+0000","last_active":"2024-09-12T01:25:02.489318+0000","last_peered":"2024-09-12T01:25:02.489318+0000","last_clean":"2024-09-12T01:25:02.489318+0000","last_became_active":"2024-09-12T00:31:50.143399+0000","last_became_peered":"2024-09-12T00:31:50.143399+0000","last_unstale":"2024-09-12T01:25:02.489318+0000","last_undegraded":"2024-09-12T01:25:02.489318+0000","last_fullsized":"2024-09-12T01:25:02.489318+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:22.288197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1799,"num_read_kb":1492,"num_write":673,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'331","reported_seq":1119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.234661+0000","last_change":"2024-09-12T01:29:24.234661+0000","last_active":"2024-09-12T01:29:24.234661+0000","last_peered":"2024-09-12T01:29:24.234661+0000","last_clean":"2024-09-12T01:29:24.234661+0000","last_became_active":"2024-09-12T00:32:23.830863+0000","last_became_peered":"2024-09-12T00:32:23.830863+0000","last_unstale":"2024-09-12T01:29:24.234661+0000","last_undegraded":"2024-09-12T01:29:24.234661+0000","last_fullsized":"2024-09-12T01:29:24.234661+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T01:29:24.234562+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T01:29:24.234562+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.234562+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:32.668950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569327,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":866,"num_read_kb":9184,"num_write":1035,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:03.492033+0000","last_change":"2024-09-12T00:31:52.154402+0000","last_active":"2024-09-12T01:25:03.492033+0000","last_peered":"2024-09-12T01:25:03.492033+0000","last_clean":"2024-09-12T01:25:03.492033+0000","last_became_active":"2024-09-12T00:31:52.154077+0000","last_became_peered":"2024-09-12T00:31:52.154077+0000","last_unstale":"2024-09-12T01:25:03.492033+0000","last_undegraded":"2024-09-12T01:25:03.492033+0000","last_fullsized":"2024-09-12T01:25:03.492033+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:27.520584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'119","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:48.498488+0000","last_change":"2024-09-12T00:31:54.164132+0000","last_active":"2024-09-12T01:25:48.498488+0000","last_peered":"2024-09-12T01:25:48.498488+0000","last_clean":"2024-09-12T01:25:48.498488+0000","last_became_active":"2024-09-12T00:31:54.163434+0000","last_became_peered":"2024-09-12T00:31:54.163434+0000","last_unstale":"2024-09-12T01:25:48.498488+0000","last_undegraded":"2024-09-12T01:25:48.498488+0000","last_fullsized":"2024-09-12T01:25:48.498488+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:14.391704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":152,"num_read_kb":145,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'782","reported_seq":4220,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.749785+0000","last_change":"2024-09-12T00:31:56.171437+0000","last_active":"2024-09-12T01:29:14.749785+0000","last_peered":"2024-09-12T01:29:14.749785+0000","last_clean":"2024-09-12T01:29:14.749785+0000","last_became_active":"2024-09-12T00:31:56.171157+0000","last_became_peered":"2024-09-12T00:31:56.171157+0000","last_unstale":"2024-09-12T01:29:14.749785+0000","last_undegraded":"2024-09-12T01:29:14.749785+0000","last_fullsized":"2024-09-12T01:29:14.749785+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:03.870161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'201","reported_seq":1031,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.518152+0000","last_change":"2024-09-12T00:31:58.179919+0000","last_active":"2024-09-12T01:27:48.518152+0000","last_peered":"2024-09-12T01:27:48.518152+0000","last_clean":"2024-09-12T01:27:48.518152+0000","last_became_active":"2024-09-12T00:31:58.179576+0000","last_became_peered":"2024-09-12T00:31:58.179576+0000","last_unstale":"2024-09-12T01:27:48.518152+0000","last_undegraded":"2024-09-12T01:27:48.518152+0000","last_fullsized":"2024-09-12T01:27:48.518152+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":631,"num_write":454,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'417","reported_seq":1156,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:25.005608+0000","last_change":"2024-09-12T00:31:50.140975+0000","last_active":"2024-09-12T01:27:25.005608+0000","last_peered":"2024-09-12T01:27:25.005608+0000","last_clean":"2024-09-12T01:27:25.005608+0000","last_became_active":"2024-09-12T00:31:50.140485+0000","last_became_peered":"2024-09-12T00:31:50.140485+0000","last_unstale":"2024-09-12T01:27:25.005608+0000","last_undegraded":"2024-09-12T01:27:25.005608+0000","last_fullsized":"2024-09-12T01:27:25.005608+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:50:37.616636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2003,"num_read_kb":1658,"num_write":744,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'321","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.346493+0000","last_change":"2024-09-12T01:29:21.346493+0000","last_active":"2024-09-12T01:29:21.346493+0000","last_peered":"2024-09-12T01:29:21.346493+0000","last_clean":"2024-09-12T01:29:21.346493+0000","last_became_active":"2024-09-12T00:31:47.125118+0000","last_became_peered":"2024-09-12T00:31:47.125118+0000","last_unstale":"2024-09-12T01:29:21.346493+0000","last_undegraded":"2024-09-12T01:29:21.346493+0000","last_fullsized":"2024-09-12T01:29:21.346493+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'321","last_scrub_stamp":"2024-09-12T01:29:21.346370+0000","last_deep_scrub":"265'321","last_deep_scrub_stamp":"2024-09-12T01:29:21.346370+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.346370+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:00.319828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209058,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":536,"num_read_kb":32880,"num_write":1078,"num_write_kb":23042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.714949+0000","last_change":"2024-09-12T00:31:52.154490+0000","last_active":"2024-09-12T01:25:04.714949+0000","last_peered":"2024-09-12T01:25:04.714949+0000","last_clean":"2024-09-12T01:25:04.714949+0000","last_became_active":"2024-09-12T00:31:52.154189+0000","last_became_peered":"2024-09-12T00:31:52.154189+0000","last_unstale":"2024-09-12T01:25:04.714949+0000","last_undegraded":"2024-09-12T01:25:04.714949+0000","last_fullsized":"2024-09-12T01:25:04.714949+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:46.021304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'276","reported_seq":850,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.011104+0000","last_change":"2024-09-12T00:31:54.171678+0000","last_active":"2024-09-12T01:29:16.011104+0000","last_peered":"2024-09-12T01:29:16.011104+0000","last_clean":"2024-09-12T01:29:16.011104+0000","last_became_active":"2024-09-12T00:31:54.171354+0000","last_became_peered":"2024-09-12T00:31:54.171354+0000","last_unstale":"2024-09-12T01:29:16.011104+0000","last_undegraded":"2024-09-12T01:29:16.011104+0000","last_fullsized":"2024-09-12T01:29:16.011104+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:44.212575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53613,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":1068,"num_write":372,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'784","reported_seq":2508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.926018+0000","last_change":"2024-09-12T00:31:56.176843+0000","last_active":"2024-09-12T01:29:15.926018+0000","last_peered":"2024-09-12T01:29:15.926018+0000","last_clean":"2024-09-12T01:29:15.926018+0000","last_became_active":"2024-09-12T00:31:56.176464+0000","last_became_peered":"2024-09-12T00:31:56.176464+0000","last_unstale":"2024-09-12T01:29:15.926018+0000","last_undegraded":"2024-09-12T01:29:15.926018+0000","last_fullsized":"2024-09-12T01:29:15.926018+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:39.501516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'324","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.078895+0000","last_change":"2024-09-12T01:29:37.078895+0000","last_active":"2024-09-12T01:29:37.078895+0000","last_peered":"2024-09-12T01:29:37.078895+0000","last_clean":"2024-09-12T01:29:37.078895+0000","last_became_active":"2024-09-12T00:31:50.138335+0000","last_became_peered":"2024-09-12T00:31:50.138335+0000","last_unstale":"2024-09-12T01:29:37.078895+0000","last_undegraded":"2024-09-12T01:29:37.078895+0000","last_fullsized":"2024-09-12T01:29:37.078895+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T01:29:37.078804+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T01:29:37.078804+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.078804+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:03.476907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1108,"num_write":487,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'344","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:20.932719+0000","last_change":"2024-09-12T01:29:20.932719+0000","last_active":"2024-09-12T01:29:20.932719+0000","last_peered":"2024-09-12T01:29:20.932719+0000","last_clean":"2024-09-12T01:29:20.932719+0000","last_became_active":"2024-09-12T00:31:47.137951+0000","last_became_peered":"2024-09-12T00:31:47.137951+0000","last_unstale":"2024-09-12T01:29:20.932719+0000","last_undegraded":"2024-09-12T01:29:20.932719+0000","last_fullsized":"2024-09-12T01:29:20.932719+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T01:29:20.932609+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T01:29:20.932609+0000","last_clean_scrub_stamp":"2024-09-12T01:29:20.932609+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:18.440399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205367,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":21468,"num_write":1112,"num_write_kb":35236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.486850+0000","last_change":"2024-09-12T01:29:37.486850+0000","last_active":"2024-09-12T01:29:37.486850+0000","last_peered":"2024-09-12T01:29:37.486850+0000","last_clean":"2024-09-12T01:29:37.486850+0000","last_became_active":"2024-09-12T00:31:52.155047+0000","last_became_peered":"2024-09-12T00:31:52.155047+0000","last_unstale":"2024-09-12T01:29:37.486850+0000","last_undegraded":"2024-09-12T01:29:37.486850+0000","last_fullsized":"2024-09-12T01:29:37.486850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:37.486756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:37.486756+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.486756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:25.770437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'367","reported_seq":992,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.597835+0000","last_change":"2024-09-12T00:31:54.173591+0000","last_active":"2024-09-12T01:29:14.597835+0000","last_peered":"2024-09-12T01:29:14.597835+0000","last_clean":"2024-09-12T01:29:14.597835+0000","last_became_active":"2024-09-12T00:31:54.173363+0000","last_became_peered":"2024-09-12T00:31:54.173363+0000","last_unstale":"2024-09-12T01:29:14.597835+0000","last_undegraded":"2024-09-12T01:29:14.597835+0000","last_fullsized":"2024-09-12T01:29:14.597835+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:50.016365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48858,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":1144,"num_write":454,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.636308+0000","last_change":"2024-09-12T00:31:56.173079+0000","last_active":"2024-09-12T01:25:55.636308+0000","last_peered":"2024-09-12T01:25:55.636308+0000","last_clean":"2024-09-12T01:25:55.636308+0000","last_became_active":"2024-09-12T00:31:56.172791+0000","last_became_peered":"2024-09-12T00:31:56.172791+0000","last_unstale":"2024-09-12T01:25:55.636308+0000","last_undegraded":"2024-09-12T01:25:55.636308+0000","last_fullsized":"2024-09-12T01:25:55.636308+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:18.460860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'542","reported_seq":1367,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.343041+0000","last_change":"2024-09-12T00:31:58.178597+0000","last_active":"2024-09-12T01:28:55.343041+0000","last_peered":"2024-09-12T01:28:55.343041+0000","last_clean":"2024-09-12T01:28:55.343041+0000","last_became_active":"2024-09-12T00:31:58.177828+0000","last_became_peered":"2024-09-12T00:31:58.177828+0000","last_unstale":"2024-09-12T01:28:55.343041+0000","last_undegraded":"2024-09-12T01:28:55.343041+0000","last_fullsized":"2024-09-12T01:28:55.343041+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:23.485365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1309,"num_read_kb":1288,"num_write":1113,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'199","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.422188+0000","last_change":"2024-09-12T01:29:26.422188+0000","last_active":"2024-09-12T01:29:26.422188+0000","last_peered":"2024-09-12T01:29:26.422188+0000","last_clean":"2024-09-12T01:29:26.422188+0000","last_became_active":"2024-09-12T00:31:50.138261+0000","last_became_peered":"2024-09-12T00:31:50.138261+0000","last_unstale":"2024-09-12T01:29:26.422188+0000","last_undegraded":"2024-09-12T01:29:26.422188+0000","last_fullsized":"2024-09-12T01:29:26.422188+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'199","last_scrub_stamp":"2024-09-12T01:29:26.422100+0000","last_deep_scrub":"265'199","last_deep_scrub_stamp":"2024-09-12T01:29:26.422100+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.422100+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:46.719548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":866,"num_read_kb":707,"num_write":323,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'375","reported_seq":1092,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.384921+0000","last_change":"2024-09-12T01:29:21.384921+0000","last_active":"2024-09-12T01:29:21.384921+0000","last_peered":"2024-09-12T01:29:21.384921+0000","last_clean":"2024-09-12T01:29:21.384921+0000","last_became_active":"2024-09-12T00:31:47.137234+0000","last_became_peered":"2024-09-12T00:31:47.137234+0000","last_unstale":"2024-09-12T01:29:21.384921+0000","last_undegraded":"2024-09-12T01:29:21.384921+0000","last_fullsized":"2024-09-12T01:29:21.384921+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T01:29:21.384774+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T01:29:21.384774+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.384774+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:01.729819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267358,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":707,"num_read_kb":90782,"num_write":1268,"num_write_kb":21068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.084013+0000","last_change":"2024-09-12T01:29:40.084013+0000","last_active":"2024-09-12T01:29:40.084013+0000","last_peered":"2024-09-12T01:29:40.084013+0000","last_clean":"2024-09-12T01:29:40.084013+0000","last_became_active":"2024-09-12T00:31:52.148738+0000","last_became_peered":"2024-09-12T00:31:52.148738+0000","last_unstale":"2024-09-12T01:29:40.084013+0000","last_undegraded":"2024-09-12T01:29:40.084013+0000","last_fullsized":"2024-09-12T01:29:40.084013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:40.083917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:40.083917+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.083917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:08.215110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'285","reported_seq":870,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.400997+0000","last_change":"2024-09-12T00:31:54.168598+0000","last_active":"2024-09-12T01:29:15.400997+0000","last_peered":"2024-09-12T01:29:15.400997+0000","last_clean":"2024-09-12T01:29:15.400997+0000","last_became_active":"2024-09-12T00:31:54.168247+0000","last_became_peered":"2024-09-12T00:31:54.168247+0000","last_unstale":"2024-09-12T01:29:15.400997+0000","last_undegraded":"2024-09-12T01:29:15.400997+0000","last_fullsized":"2024-09-12T01:29:15.400997+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:53.709459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":1085,"num_write":382,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:23.503173+0000","last_change":"2024-09-12T00:31:56.173852+0000","last_active":"2024-09-12T01:26:23.503173+0000","last_peered":"2024-09-12T01:26:23.503173+0000","last_clean":"2024-09-12T01:26:23.503173+0000","last_became_active":"2024-09-12T00:31:56.173549+0000","last_became_peered":"2024-09-12T00:31:56.173549+0000","last_unstale":"2024-09-12T01:26:23.503173+0000","last_undegraded":"2024-09-12T01:26:23.503173+0000","last_fullsized":"2024-09-12T01:26:23.503173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:31.261044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'131","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:24.521745+0000","last_change":"2024-09-12T00:31:58.175490+0000","last_active":"2024-09-12T01:28:24.521745+0000","last_peered":"2024-09-12T01:28:24.521745+0000","last_clean":"2024-09-12T01:28:24.521745+0000","last_became_active":"2024-09-12T00:31:58.175195+0000","last_became_peered":"2024-09-12T00:31:58.175195+0000","last_unstale":"2024-09-12T01:28:24.521745+0000","last_undegraded":"2024-09-12T01:28:24.521745+0000","last_fullsized":"2024-09-12T01:28:24.521745+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:18.942923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":426,"num_read_kb":345,"num_write":330,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'362","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.393387+0000","last_change":"2024-09-12T01:29:28.393387+0000","last_active":"2024-09-12T01:29:28.393387+0000","last_peered":"2024-09-12T01:29:28.393387+0000","last_clean":"2024-09-12T01:29:28.393387+0000","last_became_active":"2024-09-12T00:31:50.142818+0000","last_became_peered":"2024-09-12T00:31:50.142818+0000","last_unstale":"2024-09-12T01:29:28.393387+0000","last_undegraded":"2024-09-12T01:29:28.393387+0000","last_fullsized":"2024-09-12T01:29:28.393387+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T01:29:28.393299+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T01:29:28.393299+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.393299+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:32.642275+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1555,"num_read_kb":1227,"num_write":605,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1024,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'335","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.993496+0000","last_change":"2024-09-12T01:29:25.993496+0000","last_active":"2024-09-12T01:29:25.993496+0000","last_peered":"2024-09-12T01:29:25.993496+0000","last_clean":"2024-09-12T01:29:25.993496+0000","last_became_active":"2024-09-12T00:31:47.112306+0000","last_became_peered":"2024-09-12T00:31:47.112306+0000","last_unstale":"2024-09-12T01:29:25.993496+0000","last_undegraded":"2024-09-12T01:29:25.993496+0000","last_fullsized":"2024-09-12T01:29:25.993496+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T01:29:25.993385+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T01:29:25.993385+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.993385+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:41.871832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":55420,"num_write":1061,"num_write_kb":24613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:52.497023+0000","last_change":"2024-09-12T00:31:52.154154+0000","last_active":"2024-09-12T01:25:52.497023+0000","last_peered":"2024-09-12T01:25:52.497023+0000","last_clean":"2024-09-12T01:25:52.497023+0000","last_became_active":"2024-09-12T00:31:52.153862+0000","last_became_peered":"2024-09-12T00:31:52.153862+0000","last_unstale":"2024-09-12T01:25:52.497023+0000","last_undegraded":"2024-09-12T01:25:52.497023+0000","last_fullsized":"2024-09-12T01:25:52.497023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:25.663441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'358","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.726954+0000","last_change":"2024-09-12T00:31:54.162856+0000","last_active":"2024-09-12T01:29:14.726954+0000","last_peered":"2024-09-12T01:29:14.726954+0000","last_clean":"2024-09-12T01:29:14.726954+0000","last_became_active":"2024-09-12T00:31:54.162228+0000","last_became_peered":"2024-09-12T00:31:54.162228+0000","last_unstale":"2024-09-12T01:29:14.726954+0000","last_undegraded":"2024-09-12T01:29:14.726954+0000","last_fullsized":"2024-09-12T01:29:14.726954+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:20.520023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50365,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":550,"num_read_kb":1150,"num_write":448,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'783","reported_seq":2599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.925784+0000","last_change":"2024-09-12T00:31:56.172797+0000","last_active":"2024-09-12T01:29:15.925784+0000","last_peered":"2024-09-12T01:29:15.925784+0000","last_clean":"2024-09-12T01:29:15.925784+0000","last_became_active":"2024-09-12T00:31:56.172503+0000","last_became_peered":"2024-09-12T00:31:56.172503+0000","last_unstale":"2024-09-12T01:29:15.925784+0000","last_undegraded":"2024-09-12T01:29:15.925784+0000","last_fullsized":"2024-09-12T01:29:15.925784+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:50.107192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'148","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.305098+0000","last_change":"2024-09-12T00:31:58.175440+0000","last_active":"2024-09-12T01:28:54.305098+0000","last_peered":"2024-09-12T01:28:54.305098+0000","last_clean":"2024-09-12T01:28:54.305098+0000","last_became_active":"2024-09-12T00:31:58.175027+0000","last_became_peered":"2024-09-12T00:31:58.175027+0000","last_unstale":"2024-09-12T01:28:54.305098+0000","last_undegraded":"2024-09-12T01:28:54.305098+0000","last_fullsized":"2024-09-12T01:28:54.305098+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:26.724138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":179,"num_read_kb":162,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'330","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.910624+0000","last_change":"2024-09-12T01:29:34.910624+0000","last_active":"2024-09-12T01:29:34.910624+0000","last_peered":"2024-09-12T01:29:34.910624+0000","last_clean":"2024-09-12T01:29:34.910624+0000","last_became_active":"2024-09-12T00:31:50.143814+0000","last_became_peered":"2024-09-12T00:31:50.143814+0000","last_unstale":"2024-09-12T01:29:34.910624+0000","last_undegraded":"2024-09-12T01:29:34.910624+0000","last_fullsized":"2024-09-12T01:29:34.910624+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T01:29:34.910513+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T01:29:34.910513+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.910513+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:08.249264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1421,"num_read_kb":1140,"num_write":511,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'367","reported_seq":1055,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.966235+0000","last_change":"2024-09-12T01:29:22.966235+0000","last_active":"2024-09-12T01:29:22.966235+0000","last_peered":"2024-09-12T01:29:22.966235+0000","last_clean":"2024-09-12T01:29:22.966235+0000","last_became_active":"2024-09-12T00:31:47.138687+0000","last_became_peered":"2024-09-12T00:31:47.138687+0000","last_unstale":"2024-09-12T01:29:22.966235+0000","last_undegraded":"2024-09-12T01:29:22.966235+0000","last_fullsized":"2024-09-12T01:29:22.966235+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T01:29:22.966128+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T01:29:22.966128+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.966128+0000","objects_scrubbed":10,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:35.759401+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6638737,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":559,"num_read_kb":39444,"num_write":1190,"num_write_kb":53128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639608+0000","last_change":"2024-09-12T00:31:52.155135+0000","last_active":"2024-09-12T01:26:15.639608+0000","last_peered":"2024-09-12T01:26:15.639608+0000","last_clean":"2024-09-12T01:26:15.639608+0000","last_became_active":"2024-09-12T00:31:52.154863+0000","last_became_peered":"2024-09-12T00:31:52.154863+0000","last_unstale":"2024-09-12T01:26:15.639608+0000","last_undegraded":"2024-09-12T01:26:15.639608+0000","last_fullsized":"2024-09-12T01:26:15.639608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:40.280300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'512","reported_seq":1165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.577201+0000","last_change":"2024-09-12T00:31:54.169066+0000","last_active":"2024-09-12T01:29:15.577201+0000","last_peered":"2024-09-12T01:29:15.577201+0000","last_clean":"2024-09-12T01:29:15.577201+0000","last_became_active":"2024-09-12T00:31:54.168691+0000","last_became_peered":"2024-09-12T00:31:54.168691+0000","last_unstale":"2024-09-12T01:29:15.577201+0000","last_undegraded":"2024-09-12T01:29:15.577201+0000","last_fullsized":"2024-09-12T01:29:15.577201+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":500,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:06.873573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104127,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":909,"num_read_kb":2207,"num_write":754,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499328+0000","last_change":"2024-09-12T00:31:56.175805+0000","last_active":"2024-09-12T01:26:07.499328+0000","last_peered":"2024-09-12T01:26:07.499328+0000","last_clean":"2024-09-12T01:26:07.499328+0000","last_became_active":"2024-09-12T00:31:56.175412+0000","last_became_peered":"2024-09-12T00:31:56.175412+0000","last_unstale":"2024-09-12T01:26:07.499328+0000","last_undegraded":"2024-09-12T01:26:07.499328+0000","last_fullsized":"2024-09-12T01:26:07.499328+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:32.829417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'133","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:10.783574+0000","last_change":"2024-09-12T00:31:58.178548+0000","last_active":"2024-09-12T01:26:10.783574+0000","last_peered":"2024-09-12T01:26:10.783574+0000","last_clean":"2024-09-12T01:26:10.783574+0000","last_became_active":"2024-09-12T00:31:58.178027+0000","last_became_peered":"2024-09-12T00:31:58.178027+0000","last_unstale":"2024-09-12T01:26:10.783574+0000","last_undegraded":"2024-09-12T01:26:10.783574+0000","last_fullsized":"2024-09-12T01:26:10.783574+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:49.407511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'163","reported_seq":800,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.123130+0000","last_change":"2024-09-12T01:29:33.123130+0000","last_active":"2024-09-12T01:29:33.123130+0000","last_peered":"2024-09-12T01:29:33.123130+0000","last_clean":"2024-09-12T01:29:33.123130+0000","last_became_active":"2024-09-12T00:31:50.127193+0000","last_became_peered":"2024-09-12T00:31:50.127193+0000","last_unstale":"2024-09-12T01:29:33.123130+0000","last_undegraded":"2024-09-12T01:29:33.123130+0000","last_fullsized":"2024-09-12T01:29:33.123130+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'163","last_scrub_stamp":"2024-09-12T01:29:33.123035+0000","last_deep_scrub":"265'163","last_deep_scrub_stamp":"2024-09-12T01:29:33.123035+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.123035+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:08.204389+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":547,"num_write":243,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'332","reported_seq":1005,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.578493+0000","last_change":"2024-09-12T01:29:24.578493+0000","last_active":"2024-09-12T01:29:24.578493+0000","last_peered":"2024-09-12T01:29:24.578493+0000","last_clean":"2024-09-12T01:29:24.578493+0000","last_became_active":"2024-09-12T00:31:47.130136+0000","last_became_peered":"2024-09-12T00:31:47.130136+0000","last_unstale":"2024-09-12T01:29:24.578493+0000","last_undegraded":"2024-09-12T01:29:24.578493+0000","last_fullsized":"2024-09-12T01:29:24.578493+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-12T01:29:24.578387+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-12T01:29:24.578387+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.578387+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:56.888507+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":72156,"num_write":1150,"num_write_kb":60123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":512,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.546401+0000","last_change":"2024-09-12T01:29:36.546401+0000","last_active":"2024-09-12T01:29:36.546401+0000","last_peered":"2024-09-12T01:29:36.546401+0000","last_clean":"2024-09-12T01:29:36.546401+0000","last_became_active":"2024-09-12T00:31:52.155083+0000","last_became_peered":"2024-09-12T00:31:52.155083+0000","last_unstale":"2024-09-12T01:29:36.546401+0000","last_undegraded":"2024-09-12T01:29:36.546401+0000","last_fullsized":"2024-09-12T01:29:36.546401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:36.546308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:36.546308+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.546308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:03.570556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'323","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.639913+0000","last_change":"2024-09-12T00:31:54.165545+0000","last_active":"2024-09-12T01:29:15.639913+0000","last_peered":"2024-09-12T01:29:15.639913+0000","last_clean":"2024-09-12T01:29:15.639913+0000","last_became_active":"2024-09-12T00:31:54.165221+0000","last_became_peered":"2024-09-12T00:31:54.165221+0000","last_unstale":"2024-09-12T01:29:15.639913+0000","last_undegraded":"2024-09-12T01:29:15.639913+0000","last_fullsized":"2024-09-12T01:29:15.639913+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:34.590028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53280,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":539,"num_read_kb":1166,"num_write":484,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.549227+0000","last_change":"2024-09-12T01:29:40.549227+0000","last_active":"2024-09-12T01:29:40.549227+0000","last_peered":"2024-09-12T01:29:40.549227+0000","last_clean":"2024-09-12T01:29:40.549227+0000","last_became_active":"2024-09-12T00:31:56.172777+0000","last_became_peered":"2024-09-12T00:31:56.172777+0000","last_unstale":"2024-09-12T01:29:40.549227+0000","last_undegraded":"2024-09-12T01:29:40.549227+0000","last_fullsized":"2024-09-12T01:29:40.549227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:40.549127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:40.549127+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.549127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:34.798912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'114","reported_seq":604,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:12.518829+0000","last_change":"2024-09-12T00:31:58.179957+0000","last_active":"2024-09-12T01:28:12.518829+0000","last_peered":"2024-09-12T01:28:12.518829+0000","last_clean":"2024-09-12T01:28:12.518829+0000","last_became_active":"2024-09-12T00:31:58.179667+0000","last_became_peered":"2024-09-12T00:31:58.179667+0000","last_unstale":"2024-09-12T01:28:12.518829+0000","last_undegraded":"2024-09-12T01:28:12.518829+0000","last_fullsized":"2024-09-12T01:28:12.518829+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:04.950082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":909,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":84,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'226","reported_seq":813,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.062213+0000","last_change":"2024-09-12T01:29:38.062213+0000","last_active":"2024-09-12T01:29:38.062213+0000","last_peered":"2024-09-12T01:29:38.062213+0000","last_clean":"2024-09-12T01:29:38.062213+0000","last_became_active":"2024-09-12T00:31:50.130807+0000","last_became_peered":"2024-09-12T00:31:50.130807+0000","last_unstale":"2024-09-12T01:29:38.062213+0000","last_undegraded":"2024-09-12T01:29:38.062213+0000","last_fullsized":"2024-09-12T01:29:38.062213+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'226","last_scrub_stamp":"2024-09-12T01:29:38.062123+0000","last_deep_scrub":"265'226","last_deep_scrub_stamp":"2024-09-12T01:29:38.062123+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.062123+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:56.212489+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":940,"num_read_kb":756,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'403","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.017755+0000","last_change":"2024-09-12T01:29:28.017755+0000","last_active":"2024-09-12T01:29:28.017755+0000","last_peered":"2024-09-12T01:29:28.017755+0000","last_clean":"2024-09-12T01:29:28.017755+0000","last_became_active":"2024-09-12T00:31:47.113265+0000","last_became_peered":"2024-09-12T00:31:47.113265+0000","last_unstale":"2024-09-12T01:29:28.017755+0000","last_undegraded":"2024-09-12T01:29:28.017755+0000","last_fullsized":"2024-09-12T01:29:28.017755+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'403","last_scrub_stamp":"2024-09-12T01:29:28.017627+0000","last_deep_scrub":"265'403","last_deep_scrub_stamp":"2024-09-12T01:29:28.017627+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.017627+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:21.400047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174791,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":600,"num_read_kb":11693,"num_write":1259,"num_write_kb":25282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:52.497051+0000","last_change":"2024-09-12T00:31:52.156164+0000","last_active":"2024-09-12T01:25:52.497051+0000","last_peered":"2024-09-12T01:25:52.497051+0000","last_clean":"2024-09-12T01:25:52.497051+0000","last_became_active":"2024-09-12T00:31:52.155877+0000","last_became_peered":"2024-09-12T00:31:52.155877+0000","last_unstale":"2024-09-12T01:25:52.497051+0000","last_undegraded":"2024-09-12T01:25:52.497051+0000","last_fullsized":"2024-09-12T01:25:52.497051+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:38.312330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'310","reported_seq":901,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.216572+0000","last_change":"2024-09-12T00:31:54.165410+0000","last_active":"2024-09-12T01:29:15.216572+0000","last_peered":"2024-09-12T01:29:15.216572+0000","last_clean":"2024-09-12T01:29:15.216572+0000","last_became_active":"2024-09-12T00:31:54.165107+0000","last_became_peered":"2024-09-12T00:31:54.165107+0000","last_unstale":"2024-09-12T01:29:15.216572+0000","last_undegraded":"2024-09-12T01:29:15.216572+0000","last_fullsized":"2024-09-12T01:29:15.216572+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:41.442937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47816,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":1119,"num_write":414,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'743","reported_seq":2476,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.296276+0000","last_change":"2024-09-12T00:31:56.170713+0000","last_active":"2024-09-12T01:29:14.296276+0000","last_peered":"2024-09-12T01:29:14.296276+0000","last_clean":"2024-09-12T01:29:14.296276+0000","last_became_active":"2024-09-12T00:31:56.170388+0000","last_became_peered":"2024-09-12T00:31:56.170388+0000","last_unstale":"2024-09-12T01:29:14.296276+0000","last_undegraded":"2024-09-12T01:29:14.296276+0000","last_fullsized":"2024-09-12T01:29:14.296276+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:46.492927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'162","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:46.479085+0000","last_change":"2024-09-12T00:31:58.172116+0000","last_active":"2024-09-12T01:27:46.479085+0000","last_peered":"2024-09-12T01:27:46.479085+0000","last_clean":"2024-09-12T01:27:46.479085+0000","last_became_active":"2024-09-12T00:31:58.171814+0000","last_became_peered":"2024-09-12T00:31:58.171814+0000","last_unstale":"2024-09-12T01:27:46.479085+0000","last_undegraded":"2024-09-12T01:27:46.479085+0000","last_fullsized":"2024-09-12T01:27:46.479085+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:12.214205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":379,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'118","reported_seq":730,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.424982+0000","last_change":"2024-09-12T01:29:33.424982+0000","last_active":"2024-09-12T01:29:33.424982+0000","last_peered":"2024-09-12T01:29:33.424982+0000","last_clean":"2024-09-12T01:29:33.424982+0000","last_became_active":"2024-09-12T00:31:50.142370+0000","last_became_peered":"2024-09-12T00:31:50.142370+0000","last_unstale":"2024-09-12T01:29:33.424982+0000","last_undegraded":"2024-09-12T01:29:33.424982+0000","last_fullsized":"2024-09-12T01:29:33.424982+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T01:29:33.424886+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T01:29:33.424886+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.424886+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:36.238841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":572,"num_read_kb":482,"num_write":177,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'312","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.966631+0000","last_change":"2024-09-12T01:29:26.966631+0000","last_active":"2024-09-12T01:29:26.966631+0000","last_peered":"2024-09-12T01:29:26.966631+0000","last_clean":"2024-09-12T01:29:26.966631+0000","last_became_active":"2024-09-12T00:31:47.122110+0000","last_became_peered":"2024-09-12T00:31:47.122110+0000","last_unstale":"2024-09-12T01:29:26.966631+0000","last_undegraded":"2024-09-12T01:29:26.966631+0000","last_fullsized":"2024-09-12T01:29:26.966631+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T01:29:26.966535+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T01:29:26.966535+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.966535+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:36.122577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":405,"num_read_kb":34909,"num_write":924,"num_write_kb":39966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1464,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.439536+0000","last_change":"2024-09-12T01:29:33.439536+0000","last_active":"2024-09-12T01:29:33.439536+0000","last_peered":"2024-09-12T01:29:33.439536+0000","last_clean":"2024-09-12T01:29:33.439536+0000","last_became_active":"2024-09-12T00:31:52.154858+0000","last_became_peered":"2024-09-12T00:31:52.154858+0000","last_unstale":"2024-09-12T01:29:33.439536+0000","last_undegraded":"2024-09-12T01:29:33.439536+0000","last_fullsized":"2024-09-12T01:29:33.439536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T01:29:33.439442+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T01:29:33.439442+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.439442+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:52.079011+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'84","reported_seq":602,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.636359+0000","last_change":"2024-09-12T00:31:54.167692+0000","last_active":"2024-09-12T01:25:55.636359+0000","last_peered":"2024-09-12T01:25:55.636359+0000","last_clean":"2024-09-12T01:25:55.636359+0000","last_became_active":"2024-09-12T00:31:54.167362+0000","last_became_peered":"2024-09-12T00:31:54.167362+0000","last_unstale":"2024-09-12T01:25:55.636359+0000","last_undegraded":"2024-09-12T01:25:55.636359+0000","last_fullsized":"2024-09-12T01:25:55.636359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:15.421825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'772","reported_seq":2498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.233272+0000","last_change":"2024-09-12T00:31:56.173817+0000","last_active":"2024-09-12T01:29:15.233272+0000","last_peered":"2024-09-12T01:29:15.233272+0000","last_clean":"2024-09-12T01:29:15.233272+0000","last_became_active":"2024-09-12T00:31:56.173548+0000","last_became_peered":"2024-09-12T00:31:56.173548+0000","last_unstale":"2024-09-12T01:29:15.233272+0000","last_undegraded":"2024-09-12T01:29:15.233272+0000","last_fullsized":"2024-09-12T01:29:15.233272+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:34.709914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'124","reported_seq":626,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.453295+0000","last_change":"2024-09-12T00:31:58.175176+0000","last_active":"2024-09-12T01:27:48.453295+0000","last_peered":"2024-09-12T01:27:48.453295+0000","last_clean":"2024-09-12T01:27:48.453295+0000","last_became_active":"2024-09-12T00:31:58.174886+0000","last_became_peered":"2024-09-12T00:31:58.174886+0000","last_unstale":"2024-09-12T01:27:48.453295+0000","last_undegraded":"2024-09-12T01:27:48.453295+0000","last_fullsized":"2024-09-12T01:27:48.453295+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:48:21.010979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":123,"num_write":278,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'279","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.555522+0000","last_change":"2024-09-12T01:29:27.555522+0000","last_active":"2024-09-12T01:29:27.555522+0000","last_peered":"2024-09-12T01:29:27.555522+0000","last_clean":"2024-09-12T01:29:27.555522+0000","last_became_active":"2024-09-12T00:31:50.139923+0000","last_became_peered":"2024-09-12T00:31:50.139923+0000","last_unstale":"2024-09-12T01:29:27.555522+0000","last_undegraded":"2024-09-12T01:29:27.555522+0000","last_fullsized":"2024-09-12T01:29:27.555522+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'279","last_scrub_stamp":"2024-09-12T01:29:27.555436+0000","last_deep_scrub":"265'279","last_deep_scrub_stamp":"2024-09-12T01:29:27.555436+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.555436+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:35.601614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":954,"num_write":459,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'365","reported_seq":1094,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.691968+0000","last_change":"2024-09-12T01:29:25.691968+0000","last_active":"2024-09-12T01:29:25.691968+0000","last_peered":"2024-09-12T01:29:25.691968+0000","last_clean":"2024-09-12T01:29:25.691968+0000","last_became_active":"2024-09-12T00:31:47.122007+0000","last_became_peered":"2024-09-12T00:31:47.122007+0000","last_unstale":"2024-09-12T01:29:25.691968+0000","last_undegraded":"2024-09-12T01:29:25.691968+0000","last_fullsized":"2024-09-12T01:29:25.691968+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:29:25.691796+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:29:25.691796+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.691796+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:47.700467+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":650,"num_read_kb":69205,"num_write":1195,"num_write_kb":21863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.722337+0000","last_change":"2024-09-12T00:31:52.147230+0000","last_active":"2024-09-12T01:25:54.722337+0000","last_peered":"2024-09-12T01:25:54.722337+0000","last_clean":"2024-09-12T01:25:54.722337+0000","last_became_active":"2024-09-12T00:31:52.146894+0000","last_became_peered":"2024-09-12T00:31:52.146894+0000","last_unstale":"2024-09-12T01:25:54.722337+0000","last_undegraded":"2024-09-12T01:25:54.722337+0000","last_fullsized":"2024-09-12T01:25:54.722337+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:01.319728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'428","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.518807+0000","last_change":"2024-09-12T01:29:38.518807+0000","last_active":"2024-09-12T01:29:38.518807+0000","last_peered":"2024-09-12T01:29:38.518807+0000","last_clean":"2024-09-12T01:29:38.518807+0000","last_became_active":"2024-09-12T00:31:54.170522+0000","last_became_peered":"2024-09-12T00:31:54.170522+0000","last_unstale":"2024-09-12T01:29:38.518807+0000","last_undegraded":"2024-09-12T01:29:38.518807+0000","last_fullsized":"2024-09-12T01:29:38.518807+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'428","last_scrub_stamp":"2024-09-12T01:29:38.518712+0000","last_deep_scrub":"265'428","last_deep_scrub_stamp":"2024-09-12T01:29:38.518712+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.518712+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:16.110530+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48295,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1274,"num_read_kb":1983,"num_write":1802,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487990,"num_omap_keys":1124,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.504440+0000","last_change":"2024-09-12T00:31:56.168824+0000","last_active":"2024-09-12T01:25:59.504440+0000","last_peered":"2024-09-12T01:25:59.504440+0000","last_clean":"2024-09-12T01:25:59.504440+0000","last_became_active":"2024-09-12T00:31:56.168503+0000","last_became_peered":"2024-09-12T00:31:56.168503+0000","last_unstale":"2024-09-12T01:25:59.504440+0000","last_undegraded":"2024-09-12T01:25:59.504440+0000","last_fullsized":"2024-09-12T01:25:59.504440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:47.541247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'129","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:38.383006+0000","last_change":"2024-09-12T00:31:58.173064+0000","last_active":"2024-09-12T01:26:38.383006+0000","last_peered":"2024-09-12T01:26:38.383006+0000","last_clean":"2024-09-12T01:26:38.383006+0000","last_became_active":"2024-09-12T00:31:58.172778+0000","last_became_peered":"2024-09-12T00:31:58.172778+0000","last_unstale":"2024-09-12T01:26:38.383006+0000","last_undegraded":"2024-09-12T01:26:38.383006+0000","last_fullsized":"2024-09-12T01:26:38.383006+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:25.437723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":147,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'168","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.070874+0000","last_change":"2024-09-12T01:29:36.070874+0000","last_active":"2024-09-12T01:29:36.070874+0000","last_peered":"2024-09-12T01:29:36.070874+0000","last_clean":"2024-09-12T01:29:36.070874+0000","last_became_active":"2024-09-12T00:31:50.131152+0000","last_became_peered":"2024-09-12T00:31:50.131152+0000","last_unstale":"2024-09-12T01:29:36.070874+0000","last_undegraded":"2024-09-12T01:29:36.070874+0000","last_fullsized":"2024-09-12T01:29:36.070874+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T01:29:36.070783+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T01:29:36.070783+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.070783+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:43.699210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":649,"num_write":266,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:20.379019+0000","last_change":"2024-09-12T01:29:20.378968+0000","last_active":"2024-09-12T01:29:20.379019+0000","last_peered":"2024-09-12T01:29:20.379019+0000","last_clean":"2024-09-12T01:29:20.379019+0000","last_became_active":"2024-09-12T00:31:29.750331+0000","last_became_peered":"2024-09-12T00:31:29.750331+0000","last_unstale":"2024-09-12T01:29:20.379019+0000","last_undegraded":"2024-09-12T01:29:20.379019+0000","last_fullsized":"2024-09-12T01:29:20.379019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T01:29:20.378884+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T01:29:20.378884+0000","last_clean_scrub_stamp":"2024-09-12T01:29:20.378884+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:33.781295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":537,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.006742+0000","last_change":"2024-09-12T01:29:23.006742+0000","last_active":"2024-09-12T01:29:23.006742+0000","last_peered":"2024-09-12T01:29:23.006742+0000","last_clean":"2024-09-12T01:29:23.006742+0000","last_became_active":"2024-09-12T00:31:36.970959+0000","last_became_peered":"2024-09-12T00:31:36.970959+0000","last_unstale":"2024-09-12T01:29:23.006742+0000","last_undegraded":"2024-09-12T01:29:23.006742+0000","last_fullsized":"2024-09-12T01:29:23.006742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:23.006670+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:23.006670+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.006670+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:37.618480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00098350799999999991,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'319","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.691569+0000","last_change":"2024-09-12T01:29:22.691569+0000","last_active":"2024-09-12T01:29:22.691569+0000","last_peered":"2024-09-12T01:29:22.691569+0000","last_clean":"2024-09-12T01:29:22.691569+0000","last_became_active":"2024-09-12T00:31:47.130015+0000","last_became_peered":"2024-09-12T00:31:47.130015+0000","last_unstale":"2024-09-12T01:29:22.691569+0000","last_undegraded":"2024-09-12T01:29:22.691569+0000","last_fullsized":"2024-09-12T01:29:22.691569+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T01:29:22.691380+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T01:29:22.691380+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.691380+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:41.799155+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":117828,"num_write":1049,"num_write_kb":35803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.185179+0000","last_change":"2024-09-12T01:29:37.185179+0000","last_active":"2024-09-12T01:29:37.185179+0000","last_peered":"2024-09-12T01:29:37.185179+0000","last_clean":"2024-09-12T01:29:37.185179+0000","last_became_active":"2024-09-12T00:31:52.148316+0000","last_became_peered":"2024-09-12T00:31:52.148316+0000","last_unstale":"2024-09-12T01:29:37.185179+0000","last_undegraded":"2024-09-12T01:29:37.185179+0000","last_fullsized":"2024-09-12T01:29:37.185179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:37.185077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:37.185077+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.185077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:01.475225+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'713","reported_seq":1425,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.485521+0000","last_change":"2024-09-12T00:31:54.163779+0000","last_active":"2024-09-12T01:29:16.485521+0000","last_peered":"2024-09-12T01:29:16.485521+0000","last_clean":"2024-09-12T01:29:16.485521+0000","last_became_active":"2024-09-12T00:31:54.163482+0000","last_became_peered":"2024-09-12T00:31:54.163482+0000","last_unstale":"2024-09-12T01:29:16.485521+0000","last_undegraded":"2024-09-12T01:29:16.485521+0000","last_fullsized":"2024-09-12T01:29:16.485521+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":700,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:12.512568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135081,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1399,"num_read_kb":3136,"num_write":1308,"num_write_kb":1145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499503+0000","last_change":"2024-09-12T00:31:56.170852+0000","last_active":"2024-09-12T01:26:07.499503+0000","last_peered":"2024-09-12T01:26:07.499503+0000","last_clean":"2024-09-12T01:26:07.499503+0000","last_became_active":"2024-09-12T00:31:56.170545+0000","last_became_peered":"2024-09-12T00:31:56.170545+0000","last_unstale":"2024-09-12T01:26:07.499503+0000","last_undegraded":"2024-09-12T01:26:07.499503+0000","last_fullsized":"2024-09-12T01:26:07.499503+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:42.166275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'197","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.343679+0000","last_change":"2024-09-12T00:31:58.185222+0000","last_active":"2024-09-12T01:27:48.343679+0000","last_peered":"2024-09-12T01:27:48.343679+0000","last_clean":"2024-09-12T01:27:48.343679+0000","last_became_active":"2024-09-12T00:31:58.184941+0000","last_became_peered":"2024-09-12T00:31:58.184941+0000","last_unstale":"2024-09-12T01:27:48.343679+0000","last_undegraded":"2024-09-12T01:27:48.343679+0000","last_fullsized":"2024-09-12T01:27:48.343679+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:18.883829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1234,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":433,"num_write":415,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'95","reported_seq":667,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498663+0000","last_change":"2024-09-12T00:31:50.138379+0000","last_active":"2024-09-12T01:26:02.498663+0000","last_peered":"2024-09-12T01:26:02.498663+0000","last_clean":"2024-09-12T01:26:02.498663+0000","last_became_active":"2024-09-12T00:31:50.137393+0000","last_became_peered":"2024-09-12T00:31:50.137393+0000","last_unstale":"2024-09-12T01:26:02.498663+0000","last_undegraded":"2024-09-12T01:26:02.498663+0000","last_fullsized":"2024-09-12T01:26:02.498663+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:51.466639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":346,"num_write":149,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.997656+0000","last_change":"2024-09-12T01:29:21.997656+0000","last_active":"2024-09-12T01:29:21.997656+0000","last_peered":"2024-09-12T01:29:21.997656+0000","last_clean":"2024-09-12T01:29:21.997656+0000","last_became_active":"2024-09-12T00:31:36.772301+0000","last_became_peered":"2024-09-12T00:31:36.772301+0000","last_unstale":"2024-09-12T01:29:21.997656+0000","last_undegraded":"2024-09-12T01:29:21.997656+0000","last_fullsized":"2024-09-12T01:29:21.997656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:21.997579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:21.997579+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.997579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:49.342018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070272599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'371","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.260959+0000","last_change":"2024-09-12T01:29:23.260959+0000","last_active":"2024-09-12T01:29:23.260959+0000","last_peered":"2024-09-12T01:29:23.260959+0000","last_clean":"2024-09-12T01:29:23.260959+0000","last_became_active":"2024-09-12T00:31:47.121537+0000","last_became_peered":"2024-09-12T00:31:47.121537+0000","last_unstale":"2024-09-12T01:29:23.260959+0000","last_undegraded":"2024-09-12T01:29:23.260959+0000","last_fullsized":"2024-09-12T01:29:23.260959+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-12T01:29:23.260822+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-12T01:29:23.260822+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.260822+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:08.129052+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306567,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":587,"num_read_kb":9552,"num_write":1166,"num_write_kb":21951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723703+0000","last_change":"2024-09-12T00:31:52.147965+0000","last_active":"2024-09-12T01:26:04.723703+0000","last_peered":"2024-09-12T01:26:04.723703+0000","last_clean":"2024-09-12T01:26:04.723703+0000","last_became_active":"2024-09-12T00:31:52.147719+0000","last_became_peered":"2024-09-12T00:31:52.147719+0000","last_unstale":"2024-09-12T01:26:04.723703+0000","last_undegraded":"2024-09-12T01:26:04.723703+0000","last_fullsized":"2024-09-12T01:26:04.723703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:49.618183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1270","reported_seq":2912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.539274+0000","last_change":"2024-09-12T01:29:38.539274+0000","last_active":"2024-09-12T01:29:38.539274+0000","last_peered":"2024-09-12T01:29:38.539274+0000","last_clean":"2024-09-12T01:29:38.539274+0000","last_became_active":"2024-09-12T00:31:54.168085+0000","last_became_peered":"2024-09-12T00:31:54.168085+0000","last_unstale":"2024-09-12T01:29:38.539274+0000","last_undegraded":"2024-09-12T01:29:38.539274+0000","last_fullsized":"2024-09-12T01:29:38.539274+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1270","last_scrub_stamp":"2024-09-12T01:29:38.539154+0000","last_deep_scrub":"265'1270","last_deep_scrub_stamp":"2024-09-12T01:29:38.539154+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.539154+0000","objects_scrubbed":12,"log_size":70,"log_dups_size":1200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:12.785352+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145044,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2035,"num_read_kb":3748,"num_write":1136,"num_write_kb":952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.725043+0000","last_change":"2024-09-12T00:31:56.171482+0000","last_active":"2024-09-12T01:26:14.725043+0000","last_peered":"2024-09-12T01:26:14.725043+0000","last_clean":"2024-09-12T01:26:14.725043+0000","last_became_active":"2024-09-12T00:31:56.170725+0000","last_became_peered":"2024-09-12T00:31:56.170725+0000","last_unstale":"2024-09-12T01:26:14.725043+0000","last_undegraded":"2024-09-12T01:26:14.725043+0000","last_fullsized":"2024-09-12T01:26:14.725043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:54.802585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'205","reported_seq":726,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:46.476124+0000","last_change":"2024-09-12T00:31:58.182866+0000","last_active":"2024-09-12T01:27:46.476124+0000","last_peered":"2024-09-12T01:27:46.476124+0000","last_clean":"2024-09-12T01:27:46.476124+0000","last_became_active":"2024-09-12T00:31:58.182565+0000","last_became_peered":"2024-09-12T00:31:58.182565+0000","last_unstale":"2024-09-12T01:27:46.476124+0000","last_undegraded":"2024-09-12T01:27:46.476124+0000","last_fullsized":"2024-09-12T01:27:46.476124+0000","mapping_epoch":35,"log_start":"262'100","ondisk_log_start":"262'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:03.635481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":315,"num_read_kb":314,"num_write":438,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'335","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.144020+0000","last_change":"2024-09-12T01:29:35.144020+0000","last_active":"2024-09-12T01:29:35.144020+0000","last_peered":"2024-09-12T01:29:35.144020+0000","last_clean":"2024-09-12T01:29:35.144020+0000","last_became_active":"2024-09-12T00:31:50.135930+0000","last_became_peered":"2024-09-12T00:31:50.135930+0000","last_unstale":"2024-09-12T01:29:35.144020+0000","last_undegraded":"2024-09-12T01:29:35.144020+0000","last_fullsized":"2024-09-12T01:29:35.144020+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T01:29:35.143930+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T01:29:35.143930+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.143930+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:55.298509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1457,"num_read_kb":1188,"num_write":528,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":540,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.623127+0000","last_change":"2024-09-12T01:29:23.623127+0000","last_active":"2024-09-12T01:29:23.623127+0000","last_peered":"2024-09-12T01:29:23.623127+0000","last_clean":"2024-09-12T01:29:23.623127+0000","last_became_active":"2024-09-12T00:31:36.774484+0000","last_became_peered":"2024-09-12T00:31:36.774484+0000","last_unstale":"2024-09-12T01:29:23.623127+0000","last_undegraded":"2024-09-12T01:29:23.623127+0000","last_fullsized":"2024-09-12T01:29:23.623127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:23.623036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:23.623036+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.623036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:41.999199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040283499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'343","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.784214+0000","last_change":"2024-09-12T01:29:23.784214+0000","last_active":"2024-09-12T01:29:23.784214+0000","last_peered":"2024-09-12T01:29:23.784214+0000","last_clean":"2024-09-12T01:29:23.784214+0000","last_became_active":"2024-09-12T00:31:47.123249+0000","last_became_peered":"2024-09-12T00:31:47.123249+0000","last_unstale":"2024-09-12T01:29:23.784214+0000","last_undegraded":"2024-09-12T01:29:23.784214+0000","last_fullsized":"2024-09-12T01:29:23.784214+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T01:29:23.784066+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T01:29:23.784066+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.784066+0000","objects_scrubbed":10,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:32.413879+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291498,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":12898,"num_write":1156,"num_write_kb":44550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.599233+0000","last_change":"2024-09-12T01:29:34.599233+0000","last_active":"2024-09-12T01:29:34.599233+0000","last_peered":"2024-09-12T01:29:34.599233+0000","last_clean":"2024-09-12T01:29:34.599233+0000","last_became_active":"2024-09-12T00:31:52.155926+0000","last_became_peered":"2024-09-12T00:31:52.155926+0000","last_unstale":"2024-09-12T01:29:34.599233+0000","last_undegraded":"2024-09-12T01:29:34.599233+0000","last_fullsized":"2024-09-12T01:29:34.599233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:34.599149+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:34.599149+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.599149+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:15.139311+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'258","reported_seq":1496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.191396+0000","last_change":"2024-09-12T01:29:39.191396+0000","last_active":"2024-09-12T01:29:39.191396+0000","last_peered":"2024-09-12T01:29:39.191396+0000","last_clean":"2024-09-12T01:29:39.191396+0000","last_became_active":"2024-09-12T00:31:54.174937+0000","last_became_peered":"2024-09-12T00:31:54.174937+0000","last_unstale":"2024-09-12T01:29:39.191396+0000","last_undegraded":"2024-09-12T01:29:39.191396+0000","last_fullsized":"2024-09-12T01:29:39.191396+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'258","last_scrub_stamp":"2024-09-12T01:29:39.191302+0000","last_deep_scrub":"265'258","last_deep_scrub_stamp":"2024-09-12T01:29:39.191302+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.191302+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:50.175459+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":202,"num_write":187,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501136+0000","last_change":"2024-09-12T00:31:56.172150+0000","last_active":"2024-09-12T01:26:08.501136+0000","last_peered":"2024-09-12T01:26:08.501136+0000","last_clean":"2024-09-12T01:26:08.501136+0000","last_became_active":"2024-09-12T00:31:56.171071+0000","last_became_peered":"2024-09-12T00:31:56.171071+0000","last_unstale":"2024-09-12T01:26:08.501136+0000","last_undegraded":"2024-09-12T01:26:08.501136+0000","last_fullsized":"2024-09-12T01:26:08.501136+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:43.038984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'239","reported_seq":846,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:13.519595+0000","last_change":"2024-09-12T00:31:58.177224+0000","last_active":"2024-09-12T01:28:13.519595+0000","last_peered":"2024-09-12T01:28:13.519595+0000","last_clean":"2024-09-12T01:28:13.519595+0000","last_became_active":"2024-09-12T00:31:58.176931+0000","last_became_peered":"2024-09-12T00:31:58.176931+0000","last_unstale":"2024-09-12T01:28:13.519595+0000","last_undegraded":"2024-09-12T01:28:13.519595+0000","last_fullsized":"2024-09-12T01:28:13.519595+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:05.868371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":495,"num_write":504,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'416","reported_seq":1074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.172754+0000","last_change":"2024-09-12T01:29:33.172754+0000","last_active":"2024-09-12T01:29:33.172754+0000","last_peered":"2024-09-12T01:29:33.172754+0000","last_clean":"2024-09-12T01:29:33.172754+0000","last_became_active":"2024-09-12T00:31:50.139625+0000","last_became_peered":"2024-09-12T00:31:50.139625+0000","last_unstale":"2024-09-12T01:29:33.172754+0000","last_undegraded":"2024-09-12T01:29:33.172754+0000","last_fullsized":"2024-09-12T01:29:33.172754+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'416","last_scrub_stamp":"2024-09-12T01:29:33.172645+0000","last_deep_scrub":"265'416","last_deep_scrub_stamp":"2024-09-12T01:29:33.172645+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.172645+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:16.906066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1805,"num_read_kb":1431,"num_write":644,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":538,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.003127+0000","last_change":"2024-09-12T01:29:21.003127+0000","last_active":"2024-09-12T01:29:21.003127+0000","last_peered":"2024-09-12T01:29:21.003127+0000","last_clean":"2024-09-12T01:29:21.003127+0000","last_became_active":"2024-09-12T00:31:37.736683+0000","last_became_peered":"2024-09-12T00:31:37.736683+0000","last_unstale":"2024-09-12T01:29:21.003127+0000","last_undegraded":"2024-09-12T01:29:21.003127+0000","last_fullsized":"2024-09-12T01:29:21.003127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:21.003063+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:21.003063+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.003063+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:50.711321+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001295757,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'316","reported_seq":1162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:19.962927+0000","last_change":"2024-09-12T01:29:19.962927+0000","last_active":"2024-09-12T01:29:19.962927+0000","last_peered":"2024-09-12T01:29:19.962927+0000","last_clean":"2024-09-12T01:29:19.962927+0000","last_became_active":"2024-09-12T00:31:47.136714+0000","last_became_peered":"2024-09-12T00:31:47.136714+0000","last_unstale":"2024-09-12T01:29:19.962927+0000","last_undegraded":"2024-09-12T01:29:19.962927+0000","last_fullsized":"2024-09-12T01:29:19.962927+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T01:29:19.962830+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T01:29:19.962830+0000","last_clean_scrub_stamp":"2024-09-12T01:29:19.962830+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:02.608178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":889,"num_read_kb":29272,"num_write":1058,"num_write_kb":35686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.582530+0000","last_change":"2024-09-12T01:29:35.582530+0000","last_active":"2024-09-12T01:29:35.582530+0000","last_peered":"2024-09-12T01:29:35.582530+0000","last_clean":"2024-09-12T01:29:35.582530+0000","last_became_active":"2024-09-12T00:31:52.148995+0000","last_became_peered":"2024-09-12T00:31:52.148995+0000","last_unstale":"2024-09-12T01:29:35.582530+0000","last_undegraded":"2024-09-12T01:29:35.582530+0000","last_fullsized":"2024-09-12T01:29:35.582530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:35.582425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:35.582425+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.582425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:11.996704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'137","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:17.519817+0000","last_change":"2024-09-12T00:31:54.168174+0000","last_active":"2024-09-12T01:28:17.519817+0000","last_peered":"2024-09-12T01:28:17.519817+0000","last_clean":"2024-09-12T01:28:17.519817+0000","last_became_active":"2024-09-12T00:31:54.167813+0000","last_became_peered":"2024-09-12T00:31:54.167813+0000","last_unstale":"2024-09-12T01:28:17.519817+0000","last_undegraded":"2024-09-12T01:28:17.519817+0000","last_fullsized":"2024-09-12T01:28:17.519817+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:55.058242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":166,"num_read_kb":157,"num_write":122,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.724455+0000","last_change":"2024-09-12T00:31:56.173128+0000","last_active":"2024-09-12T01:26:09.724455+0000","last_peered":"2024-09-12T01:26:09.724455+0000","last_clean":"2024-09-12T01:26:09.724455+0000","last_became_active":"2024-09-12T00:31:56.172693+0000","last_became_peered":"2024-09-12T00:31:56.172693+0000","last_unstale":"2024-09-12T01:26:09.724455+0000","last_undegraded":"2024-09-12T01:26:09.724455+0000","last_fullsized":"2024-09-12T01:26:09.724455+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:48.948020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'163","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.606163+0000","last_change":"2024-09-12T00:31:58.177617+0000","last_active":"2024-09-12T01:26:09.606163+0000","last_peered":"2024-09-12T01:26:09.606163+0000","last_clean":"2024-09-12T01:26:09.606163+0000","last_became_active":"2024-09-12T00:31:58.177206+0000","last_became_peered":"2024-09-12T00:31:58.177206+0000","last_unstale":"2024-09-12T01:26:09.606163+0000","last_undegraded":"2024-09-12T01:26:09.606163+0000","last_fullsized":"2024-09-12T01:26:09.606163+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:23.709095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":267,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'249","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.213962+0000","last_change":"2024-09-12T01:29:32.213962+0000","last_active":"2024-09-12T01:29:32.213962+0000","last_peered":"2024-09-12T01:29:32.213962+0000","last_clean":"2024-09-12T01:29:32.213962+0000","last_became_active":"2024-09-12T00:31:50.135333+0000","last_became_peered":"2024-09-12T00:31:50.135333+0000","last_unstale":"2024-09-12T01:29:32.213962+0000","last_undegraded":"2024-09-12T01:29:32.213962+0000","last_fullsized":"2024-09-12T01:29:32.213962+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'249","last_scrub_stamp":"2024-09-12T01:29:32.213855+0000","last_deep_scrub":"265'249","last_deep_scrub_stamp":"2024-09-12T01:29:32.213855+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.213855+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:37.155698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1106,"num_read_kb":893,"num_write":406,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'297","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.373673+0000","last_change":"2024-09-12T01:29:22.373673+0000","last_active":"2024-09-12T01:29:22.373673+0000","last_peered":"2024-09-12T01:29:22.373673+0000","last_clean":"2024-09-12T01:29:22.373673+0000","last_became_active":"2024-09-12T00:31:47.131943+0000","last_became_peered":"2024-09-12T00:31:47.131943+0000","last_unstale":"2024-09-12T01:29:22.373673+0000","last_undegraded":"2024-09-12T01:29:22.373673+0000","last_fullsized":"2024-09-12T01:29:22.373673+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'297","last_scrub_stamp":"2024-09-12T01:29:22.373580+0000","last_deep_scrub":"265'297","last_deep_scrub_stamp":"2024-09-12T01:29:22.373580+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.373580+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:13.861521+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7951494,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":382,"num_read_kb":39412,"num_write":972,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.825062+0000","last_change":"2024-09-12T01:29:22.825062+0000","last_active":"2024-09-12T01:29:22.825062+0000","last_peered":"2024-09-12T01:29:22.825062+0000","last_clean":"2024-09-12T01:29:22.825062+0000","last_became_active":"2024-09-12T00:31:37.736507+0000","last_became_peered":"2024-09-12T00:31:37.736507+0000","last_unstale":"2024-09-12T01:29:22.825062+0000","last_undegraded":"2024-09-12T01:29:22.825062+0000","last_fullsized":"2024-09-12T01:29:22.825062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:22.824962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:22.824962+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.824962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:54.694034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00050928200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:03.500363+0000","last_change":"2024-09-12T00:31:52.154383+0000","last_active":"2024-09-12T01:26:03.500363+0000","last_peered":"2024-09-12T01:26:03.500363+0000","last_clean":"2024-09-12T01:26:03.500363+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:26:03.500363+0000","last_undegraded":"2024-09-12T01:26:03.500363+0000","last_fullsized":"2024-09-12T01:26:03.500363+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:37.921158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'612","reported_seq":1309,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.560415+0000","last_change":"2024-09-12T01:29:37.560415+0000","last_active":"2024-09-12T01:29:37.560415+0000","last_peered":"2024-09-12T01:29:37.560415+0000","last_clean":"2024-09-12T01:29:37.560415+0000","last_became_active":"2024-09-12T00:31:54.162596+0000","last_became_peered":"2024-09-12T00:31:54.162596+0000","last_unstale":"2024-09-12T01:29:37.560415+0000","last_undegraded":"2024-09-12T01:29:37.560415+0000","last_fullsized":"2024-09-12T01:29:37.560415+0000","mapping_epoch":31,"log_start":"265'600","ondisk_log_start":"265'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'612","last_scrub_stamp":"2024-09-12T01:29:37.560320+0000","last_deep_scrub":"265'612","last_deep_scrub_stamp":"2024-09-12T01:29:37.560320+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.560320+0000","objects_scrubbed":11,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:15.707785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88936,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1027,"num_read_kb":2220,"num_write":890,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":489,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.505411+0000","last_change":"2024-09-12T00:31:56.170603+0000","last_active":"2024-09-12T01:26:09.505411+0000","last_peered":"2024-09-12T01:26:09.505411+0000","last_clean":"2024-09-12T01:26:09.505411+0000","last_became_active":"2024-09-12T00:31:56.170246+0000","last_became_peered":"2024-09-12T00:31:56.170246+0000","last_unstale":"2024-09-12T01:26:09.505411+0000","last_undegraded":"2024-09-12T01:26:09.505411+0000","last_fullsized":"2024-09-12T01:26:09.505411+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:58.101767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'137","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.305820+0000","last_change":"2024-09-12T00:31:58.183531+0000","last_active":"2024-09-12T01:28:54.305820+0000","last_peered":"2024-09-12T01:28:54.305820+0000","last_clean":"2024-09-12T01:28:54.305820+0000","last_became_active":"2024-09-12T00:31:58.183206+0000","last_became_peered":"2024-09-12T00:31:58.183206+0000","last_unstale":"2024-09-12T01:28:54.305820+0000","last_undegraded":"2024-09-12T01:28:54.305820+0000","last_fullsized":"2024-09-12T01:28:54.305820+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:12.094595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":155,"num_write":341,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'131","reported_seq":742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.143157+0000","last_change":"2024-09-12T01:29:34.143157+0000","last_active":"2024-09-12T01:29:34.143157+0000","last_peered":"2024-09-12T01:29:34.143157+0000","last_clean":"2024-09-12T01:29:34.143157+0000","last_became_active":"2024-09-12T00:31:50.135197+0000","last_became_peered":"2024-09-12T00:31:50.135197+0000","last_unstale":"2024-09-12T01:29:34.143157+0000","last_undegraded":"2024-09-12T01:29:34.143157+0000","last_fullsized":"2024-09-12T01:29:34.143157+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'131","last_scrub_stamp":"2024-09-12T01:29:34.143073+0000","last_deep_scrub":"265'131","last_deep_scrub_stamp":"2024-09-12T01:29:34.143073+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.143073+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:09.129556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":577,"num_read_kb":479,"num_write":210,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'302","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.253191+0000","last_change":"2024-09-12T01:29:25.253191+0000","last_active":"2024-09-12T01:29:25.253191+0000","last_peered":"2024-09-12T01:29:25.253191+0000","last_clean":"2024-09-12T01:29:25.253191+0000","last_became_active":"2024-09-12T00:31:47.121355+0000","last_became_peered":"2024-09-12T00:31:47.121355+0000","last_unstale":"2024-09-12T01:29:25.253191+0000","last_undegraded":"2024-09-12T01:29:25.253191+0000","last_fullsized":"2024-09-12T01:29:25.253191+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'302","last_scrub_stamp":"2024-09-12T01:29:25.253069+0000","last_deep_scrub":"265'302","last_deep_scrub_stamp":"2024-09-12T01:29:25.253069+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.253069+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:56.001061+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":443,"num_write":1003,"num_write_kb":5362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.031667+0000","last_change":"2024-09-12T01:29:24.031667+0000","last_active":"2024-09-12T01:29:24.031667+0000","last_peered":"2024-09-12T01:29:24.031667+0000","last_clean":"2024-09-12T01:29:24.031667+0000","last_became_active":"2024-09-12T00:31:36.774289+0000","last_became_peered":"2024-09-12T00:31:36.774289+0000","last_unstale":"2024-09-12T01:29:24.031667+0000","last_undegraded":"2024-09-12T01:29:24.031667+0000","last_fullsized":"2024-09-12T01:29:24.031667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:24.031584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:24.031584+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.031584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:30.910975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063853100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"265'10","reported_seq":1469,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.196095+0000","last_change":"2024-09-12T01:29:35.196095+0000","last_active":"2024-09-12T01:29:35.196095+0000","last_peered":"2024-09-12T01:29:35.196095+0000","last_clean":"2024-09-12T01:29:35.196095+0000","last_became_active":"2024-09-12T00:31:52.147856+0000","last_became_peered":"2024-09-12T00:31:52.147856+0000","last_unstale":"2024-09-12T01:29:35.196095+0000","last_undegraded":"2024-09-12T01:29:35.196095+0000","last_fullsized":"2024-09-12T01:29:35.196095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:29:35.195968+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:29:35.195968+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.195968+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:49.978709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1609,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1450,"num_read_kb":1911,"num_write":16,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'176","reported_seq":746,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.637935+0000","last_change":"2024-09-12T00:31:54.170295+0000","last_active":"2024-09-12T01:26:05.637935+0000","last_peered":"2024-09-12T01:26:05.637935+0000","last_clean":"2024-09-12T01:26:05.637935+0000","last_became_active":"2024-09-12T00:31:54.169958+0000","last_became_peered":"2024-09-12T00:31:54.169958+0000","last_unstale":"2024-09-12T01:26:05.637935+0000","last_undegraded":"2024-09-12T01:26:05.637935+0000","last_fullsized":"2024-09-12T01:26:05.637935+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":100,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:37.410716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":229,"num_read_kb":218,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'773","reported_seq":2820,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.232071+0000","last_change":"2024-09-12T00:31:56.174875+0000","last_active":"2024-09-12T01:29:15.232071+0000","last_peered":"2024-09-12T01:29:15.232071+0000","last_clean":"2024-09-12T01:29:15.232071+0000","last_became_active":"2024-09-12T00:31:56.174535+0000","last_became_peered":"2024-09-12T00:31:56.174535+0000","last_unstale":"2024-09-12T01:29:15.232071+0000","last_undegraded":"2024-09-12T01:29:15.232071+0000","last_fullsized":"2024-09-12T01:29:15.232071+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:30.561634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'114","reported_seq":619,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:25.804418+0000","last_change":"2024-09-12T00:31:58.174504+0000","last_active":"2024-09-12T01:28:25.804418+0000","last_peered":"2024-09-12T01:28:25.804418+0000","last_clean":"2024-09-12T01:28:25.804418+0000","last_became_active":"2024-09-12T00:31:58.174086+0000","last_became_peered":"2024-09-12T00:31:58.174086+0000","last_unstale":"2024-09-12T01:28:25.804418+0000","last_undegraded":"2024-09-12T01:28:25.804418+0000","last_fullsized":"2024-09-12T01:28:25.804418+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:34.431865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":255,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'4368","reported_seq":5128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.552027+0000","last_change":"2024-09-12T01:29:30.552027+0000","last_active":"2024-09-12T01:29:30.552027+0000","last_peered":"2024-09-12T01:29:30.552027+0000","last_clean":"2024-09-12T01:29:30.552027+0000","last_became_active":"2024-09-12T00:31:50.132703+0000","last_became_peered":"2024-09-12T00:31:50.132703+0000","last_unstale":"2024-09-12T01:29:30.552027+0000","last_undegraded":"2024-09-12T01:29:30.552027+0000","last_fullsized":"2024-09-12T01:29:30.552027+0000","mapping_epoch":27,"log_start":"265'4300","ondisk_log_start":"265'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4368","last_scrub_stamp":"2024-09-12T01:29:30.551927+0000","last_deep_scrub":"265'4368","last_deep_scrub_stamp":"2024-09-12T01:29:30.551927+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.551927+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:47.227065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17817,"num_read_kb":14914,"num_write":6561,"num_write_kb":3320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25749,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'309","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.675750+0000","last_change":"2024-09-12T01:29:24.675750+0000","last_active":"2024-09-12T01:29:24.675750+0000","last_peered":"2024-09-12T01:29:24.675750+0000","last_clean":"2024-09-12T01:29:24.675750+0000","last_became_active":"2024-09-12T00:31:47.116205+0000","last_became_peered":"2024-09-12T00:31:47.116205+0000","last_unstale":"2024-09-12T01:29:24.675750+0000","last_undegraded":"2024-09-12T01:29:24.675750+0000","last_fullsized":"2024-09-12T01:29:24.675750+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-12T01:29:24.675634+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-12T01:29:24.675634+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.675634+0000","objects_scrubbed":9,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:00.404652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704304,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":481,"num_read_kb":46756,"num_write":1080,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":539,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.710111+0000","last_change":"2024-09-12T01:29:21.710111+0000","last_active":"2024-09-12T01:29:21.710111+0000","last_peered":"2024-09-12T01:29:21.710111+0000","last_clean":"2024-09-12T01:29:21.710111+0000","last_became_active":"2024-09-12T00:31:37.434707+0000","last_became_peered":"2024-09-12T00:31:37.434707+0000","last_unstale":"2024-09-12T01:29:21.710111+0000","last_undegraded":"2024-09-12T01:29:21.710111+0000","last_fullsized":"2024-09-12T01:29:21.710111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:21.710025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:21.710025+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.710025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:10.521409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041578299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723540+0000","last_change":"2024-09-12T00:31:52.147221+0000","last_active":"2024-09-12T01:26:04.723540+0000","last_peered":"2024-09-12T01:26:04.723540+0000","last_clean":"2024-09-12T01:26:04.723540+0000","last_became_active":"2024-09-12T00:31:52.146927+0000","last_became_peered":"2024-09-12T00:31:52.146927+0000","last_unstale":"2024-09-12T01:26:04.723540+0000","last_undegraded":"2024-09-12T01:26:04.723540+0000","last_fullsized":"2024-09-12T01:26:04.723540+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:07.292280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'129","reported_seq":677,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:04.723596+0000","last_change":"2024-09-12T00:31:54.166886+0000","last_active":"2024-09-12T01:26:04.723596+0000","last_peered":"2024-09-12T01:26:04.723596+0000","last_clean":"2024-09-12T01:26:04.723596+0000","last_became_active":"2024-09-12T00:31:54.166612+0000","last_became_peered":"2024-09-12T00:31:54.166612+0000","last_unstale":"2024-09-12T01:26:04.723596+0000","last_undegraded":"2024-09-12T01:26:04.723596+0000","last_fullsized":"2024-09-12T01:26:04.723596+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:22.266894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":151,"num_read_kb":143,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'784","reported_seq":4660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.926690+0000","last_change":"2024-09-12T00:31:56.170683+0000","last_active":"2024-09-12T01:29:15.926690+0000","last_peered":"2024-09-12T01:29:15.926690+0000","last_clean":"2024-09-12T01:29:15.926690+0000","last_became_active":"2024-09-12T00:31:56.170358+0000","last_became_peered":"2024-09-12T00:31:56.170358+0000","last_unstale":"2024-09-12T01:29:15.926690+0000","last_undegraded":"2024-09-12T01:29:15.926690+0000","last_fullsized":"2024-09-12T01:29:15.926690+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:23.683059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'175","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:57.497649+0000","last_change":"2024-09-12T00:31:58.178681+0000","last_active":"2024-09-12T01:25:57.497649+0000","last_peered":"2024-09-12T01:25:57.497649+0000","last_clean":"2024-09-12T01:25:57.497649+0000","last_became_active":"2024-09-12T00:31:58.178148+0000","last_became_peered":"2024-09-12T00:31:58.178148+0000","last_unstale":"2024-09-12T01:25:57.497649+0000","last_undegraded":"2024-09-12T01:25:57.497649+0000","last_fullsized":"2024-09-12T01:25:57.497649+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:28.683801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":405,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'112","reported_seq":718,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.361897+0000","last_change":"2024-09-12T01:29:31.361897+0000","last_active":"2024-09-12T01:29:31.361897+0000","last_peered":"2024-09-12T01:29:31.361897+0000","last_clean":"2024-09-12T01:29:31.361897+0000","last_became_active":"2024-09-12T00:31:50.142769+0000","last_became_peered":"2024-09-12T00:31:50.142769+0000","last_unstale":"2024-09-12T01:29:31.361897+0000","last_undegraded":"2024-09-12T01:29:31.361897+0000","last_fullsized":"2024-09-12T01:29:31.361897+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'112","last_scrub_stamp":"2024-09-12T01:29:31.361797+0000","last_deep_scrub":"265'112","last_deep_scrub_stamp":"2024-09-12T01:29:31.361797+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.361797+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:10.303759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":521,"num_read_kb":437,"num_write":174,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'390","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.683636+0000","last_change":"2024-09-12T01:29:23.683636+0000","last_active":"2024-09-12T01:29:23.683636+0000","last_peered":"2024-09-12T01:29:23.683636+0000","last_clean":"2024-09-12T01:29:23.683636+0000","last_became_active":"2024-09-12T00:31:47.115974+0000","last_became_peered":"2024-09-12T00:31:47.115974+0000","last_unstale":"2024-09-12T01:29:23.683636+0000","last_undegraded":"2024-09-12T01:29:23.683636+0000","last_fullsized":"2024-09-12T01:29:23.683636+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'390","last_scrub_stamp":"2024-09-12T01:29:23.683459+0000","last_deep_scrub":"265'390","last_deep_scrub_stamp":"2024-09-12T01:29:23.683459+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.683459+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:58.878415+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1843869,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":674,"num_read_kb":6022,"num_write":1105,"num_write_kb":14780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.992796+0000","last_change":"2024-09-12T01:29:24.992796+0000","last_active":"2024-09-12T01:29:24.992796+0000","last_peered":"2024-09-12T01:29:24.992796+0000","last_clean":"2024-09-12T01:29:24.992796+0000","last_became_active":"2024-09-12T00:31:37.434487+0000","last_became_peered":"2024-09-12T00:31:37.434487+0000","last_unstale":"2024-09-12T01:29:24.992796+0000","last_undegraded":"2024-09-12T01:29:24.992796+0000","last_fullsized":"2024-09-12T01:29:24.992796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:24.992711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:24.992711+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.992711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:32.901092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.563465+0000","last_change":"2024-09-12T01:29:36.563465+0000","last_active":"2024-09-12T01:29:36.563465+0000","last_peered":"2024-09-12T01:29:36.563465+0000","last_clean":"2024-09-12T01:29:36.563465+0000","last_became_active":"2024-09-12T00:31:52.152173+0000","last_became_peered":"2024-09-12T00:31:52.152173+0000","last_unstale":"2024-09-12T01:29:36.563465+0000","last_undegraded":"2024-09-12T01:29:36.563465+0000","last_fullsized":"2024-09-12T01:29:36.563465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:36.563342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:36.563342+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.563342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:37.784991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'742","reported_seq":1480,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.193979+0000","last_change":"2024-09-12T01:29:38.193979+0000","last_active":"2024-09-12T01:29:38.193979+0000","last_peered":"2024-09-12T01:29:38.193979+0000","last_clean":"2024-09-12T01:29:38.193979+0000","last_became_active":"2024-09-12T00:31:54.169994+0000","last_became_peered":"2024-09-12T00:31:54.169994+0000","last_unstale":"2024-09-12T01:29:38.193979+0000","last_undegraded":"2024-09-12T01:29:38.193979+0000","last_fullsized":"2024-09-12T01:29:38.193979+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'742","last_scrub_stamp":"2024-09-12T01:29:38.193855+0000","last_deep_scrub":"265'742","last_deep_scrub_stamp":"2024-09-12T01:29:38.193855+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.193855+0000","objects_scrubbed":9,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:37.960206+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143669,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1312,"num_read_kb":3057,"num_write":1064,"num_write_kb":866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:08.501108+0000","last_change":"2024-09-12T00:31:56.172717+0000","last_active":"2024-09-12T01:26:08.501108+0000","last_peered":"2024-09-12T01:26:08.501108+0000","last_clean":"2024-09-12T01:26:08.501108+0000","last_became_active":"2024-09-12T00:31:56.172417+0000","last_became_peered":"2024-09-12T00:31:56.172417+0000","last_unstale":"2024-09-12T01:26:08.501108+0000","last_undegraded":"2024-09-12T01:26:08.501108+0000","last_fullsized":"2024-09-12T01:26:08.501108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:19.181440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'150","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.504454+0000","last_change":"2024-09-12T00:31:58.180306+0000","last_active":"2024-09-12T01:25:59.504454+0000","last_peered":"2024-09-12T01:25:59.504454+0000","last_clean":"2024-09-12T01:25:59.504454+0000","last_became_active":"2024-09-12T00:31:58.179998+0000","last_became_peered":"2024-09-12T00:31:58.179998+0000","last_unstale":"2024-09-12T01:25:59.504454+0000","last_undegraded":"2024-09-12T01:25:59.504454+0000","last_fullsized":"2024-09-12T01:25:59.504454+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:19.517308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":177,"num_read_kb":166,"num_write":377,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'158","reported_seq":722,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:48.538025+0000","last_change":"2024-09-12T00:31:58.178240+0000","last_active":"2024-09-12T01:27:48.538025+0000","last_peered":"2024-09-12T01:27:48.538025+0000","last_clean":"2024-09-12T01:27:48.538025+0000","last_became_active":"2024-09-12T00:31:58.177936+0000","last_became_peered":"2024-09-12T00:31:58.177936+0000","last_unstale":"2024-09-12T01:27:48.538025+0000","last_undegraded":"2024-09-12T01:27:48.538025+0000","last_fullsized":"2024-09-12T01:27:48.538025+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:52.216144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":226,"num_read_kb":224,"num_write":377,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'98","reported_seq":689,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.451036+0000","last_change":"2024-09-12T01:29:35.451036+0000","last_active":"2024-09-12T01:29:35.451036+0000","last_peered":"2024-09-12T01:29:35.451036+0000","last_clean":"2024-09-12T01:29:35.451036+0000","last_became_active":"2024-09-12T00:31:50.142206+0000","last_became_peered":"2024-09-12T00:31:50.142206+0000","last_unstale":"2024-09-12T01:29:35.451036+0000","last_undegraded":"2024-09-12T01:29:35.451036+0000","last_fullsized":"2024-09-12T01:29:35.451036+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'98","last_scrub_stamp":"2024-09-12T01:29:35.450943+0000","last_deep_scrub":"265'98","last_deep_scrub_stamp":"2024-09-12T01:29:35.450943+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.450943+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:46.081581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":133,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'318","reported_seq":931,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.980971+0000","last_change":"2024-09-12T01:29:29.980971+0000","last_active":"2024-09-12T01:29:29.980971+0000","last_peered":"2024-09-12T01:29:29.980971+0000","last_clean":"2024-09-12T01:29:29.980971+0000","last_became_active":"2024-09-12T00:31:47.128005+0000","last_became_peered":"2024-09-12T00:31:47.128005+0000","last_unstale":"2024-09-12T01:29:29.980971+0000","last_undegraded":"2024-09-12T01:29:29.980971+0000","last_fullsized":"2024-09-12T01:29:29.980971+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T01:29:29.980824+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T01:29:29.980824+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.980824+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:44.159677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174744,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":395,"num_read_kb":1002,"num_write":979,"num_write_kb":27047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:35.633125+0000","last_change":"2024-09-12T00:31:52.154225+0000","last_active":"2024-09-12T01:25:35.633125+0000","last_peered":"2024-09-12T01:25:35.633125+0000","last_clean":"2024-09-12T01:25:35.633125+0000","last_became_active":"2024-09-12T00:31:52.153927+0000","last_became_peered":"2024-09-12T00:31:52.153927+0000","last_unstale":"2024-09-12T01:25:35.633125+0000","last_undegraded":"2024-09-12T01:25:35.633125+0000","last_fullsized":"2024-09-12T01:25:35.633125+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:05.731540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'289","reported_seq":867,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.667897+0000","last_change":"2024-09-12T00:31:54.167788+0000","last_active":"2024-09-12T01:29:14.667897+0000","last_peered":"2024-09-12T01:29:14.667897+0000","last_clean":"2024-09-12T01:29:14.667897+0000","last_became_active":"2024-09-12T00:31:54.167414+0000","last_became_peered":"2024-09-12T00:31:54.167414+0000","last_unstale":"2024-09-12T01:29:14.667897+0000","last_undegraded":"2024-09-12T01:29:14.667897+0000","last_fullsized":"2024-09-12T01:29:14.667897+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.633567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44314,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":1087,"num_write":386,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:35.777825+0000","last_change":"2024-09-12T00:31:56.173722+0000","last_active":"2024-09-12T01:25:35.777825+0000","last_peered":"2024-09-12T01:25:35.777825+0000","last_clean":"2024-09-12T01:25:35.777825+0000","last_became_active":"2024-09-12T00:31:56.173412+0000","last_became_peered":"2024-09-12T00:31:56.173412+0000","last_unstale":"2024-09-12T01:25:35.777825+0000","last_undegraded":"2024-09-12T01:25:35.777825+0000","last_fullsized":"2024-09-12T01:25:35.777825+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:12.092104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'129","reported_seq":642,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:47.573025+0000","last_change":"2024-09-12T00:31:58.176621+0000","last_active":"2024-09-12T01:26:47.573025+0000","last_peered":"2024-09-12T01:26:47.573025+0000","last_clean":"2024-09-12T01:26:47.573025+0000","last_became_active":"2024-09-12T00:31:58.176322+0000","last_became_peered":"2024-09-12T00:31:58.176322+0000","last_unstale":"2024-09-12T01:26:47.573025+0000","last_undegraded":"2024-09-12T01:26:47.573025+0000","last_fullsized":"2024-09-12T01:26:47.573025+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:12.568369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":158,"num_write":327,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'158","reported_seq":814,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.560489+0000","last_change":"2024-09-12T01:29:29.560489+0000","last_active":"2024-09-12T01:29:29.560489+0000","last_peered":"2024-09-12T01:29:29.560489+0000","last_clean":"2024-09-12T01:29:29.560489+0000","last_became_active":"2024-09-12T00:31:50.127724+0000","last_became_peered":"2024-09-12T00:31:50.127724+0000","last_unstale":"2024-09-12T01:29:29.560489+0000","last_undegraded":"2024-09-12T01:29:29.560489+0000","last_fullsized":"2024-09-12T01:29:29.560489+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'158","last_scrub_stamp":"2024-09-12T01:29:29.560401+0000","last_deep_scrub":"265'158","last_deep_scrub_stamp":"2024-09-12T01:29:29.560401+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.560401+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.392412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":587,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'366","reported_seq":1137,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.924574+0000","last_change":"2024-09-12T01:29:21.924574+0000","last_active":"2024-09-12T01:29:21.924574+0000","last_peered":"2024-09-12T01:29:21.924574+0000","last_clean":"2024-09-12T01:29:21.924574+0000","last_became_active":"2024-09-12T00:31:47.138565+0000","last_became_peered":"2024-09-12T00:31:47.138565+0000","last_unstale":"2024-09-12T01:29:21.924574+0000","last_undegraded":"2024-09-12T01:29:21.924574+0000","last_fullsized":"2024-09-12T01:29:21.924574+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T01:29:21.924465+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T01:29:21.924465+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.924465+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:33.989434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133731,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":777,"num_read_kb":53412,"num_write":1135,"num_write_kb":60803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:33.496242+0000","last_change":"2024-09-12T00:31:52.155188+0000","last_active":"2024-09-12T01:25:33.496242+0000","last_peered":"2024-09-12T01:25:33.496242+0000","last_clean":"2024-09-12T01:25:33.496242+0000","last_became_active":"2024-09-12T00:31:52.154829+0000","last_became_peered":"2024-09-12T00:31:52.154829+0000","last_unstale":"2024-09-12T01:25:33.496242+0000","last_undegraded":"2024-09-12T01:25:33.496242+0000","last_fullsized":"2024-09-12T01:25:33.496242+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:30:05.393711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'40","reported_seq":551,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:33.496173+0000","last_change":"2024-09-12T00:31:54.162972+0000","last_active":"2024-09-12T01:25:33.496173+0000","last_peered":"2024-09-12T01:25:33.496173+0000","last_clean":"2024-09-12T01:25:33.496173+0000","last_became_active":"2024-09-12T00:31:54.162657+0000","last_became_peered":"2024-09-12T00:31:54.162657+0000","last_unstale":"2024-09-12T01:25:33.496173+0000","last_undegraded":"2024-09-12T01:25:33.496173+0000","last_fullsized":"2024-09-12T01:25:33.496173+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:24.360783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.502236+0000","last_change":"2024-09-12T00:31:56.170942+0000","last_active":"2024-09-12T01:25:39.502236+0000","last_peered":"2024-09-12T01:25:39.502236+0000","last_clean":"2024-09-12T01:25:39.502236+0000","last_became_active":"2024-09-12T00:31:56.170648+0000","last_became_peered":"2024-09-12T00:31:56.170648+0000","last_unstale":"2024-09-12T01:25:39.502236+0000","last_undegraded":"2024-09-12T01:25:39.502236+0000","last_fullsized":"2024-09-12T01:25:39.502236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:28.565117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'217","reported_seq":742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.550339+0000","last_change":"2024-09-12T00:31:58.172827+0000","last_active":"2024-09-12T01:27:47.550339+0000","last_peered":"2024-09-12T01:27:47.550339+0000","last_clean":"2024-09-12T01:27:47.550339+0000","last_became_active":"2024-09-12T00:31:58.172511+0000","last_became_peered":"2024-09-12T00:31:58.172511+0000","last_unstale":"2024-09-12T01:27:47.550339+0000","last_undegraded":"2024-09-12T01:27:47.550339+0000","last_fullsized":"2024-09-12T01:27:47.550339+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":356,"num_read_kb":339,"num_write":509,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'63","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.576959+0000","last_change":"2024-09-12T01:29:28.576959+0000","last_active":"2024-09-12T01:29:28.576959+0000","last_peered":"2024-09-12T01:29:28.576959+0000","last_clean":"2024-09-12T01:29:28.576959+0000","last_became_active":"2024-09-12T00:31:50.124994+0000","last_became_peered":"2024-09-12T00:31:50.124994+0000","last_unstale":"2024-09-12T01:29:28.576959+0000","last_undegraded":"2024-09-12T01:29:28.576959+0000","last_fullsized":"2024-09-12T01:29:28.576959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'63","last_scrub_stamp":"2024-09-12T01:29:28.576859+0000","last_deep_scrub":"265'63","last_deep_scrub_stamp":"2024-09-12T01:29:28.576859+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.576859+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:46.559642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":221,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'334","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.395373+0000","last_change":"2024-09-12T01:29:25.395373+0000","last_active":"2024-09-12T01:29:25.395373+0000","last_peered":"2024-09-12T01:29:25.395373+0000","last_clean":"2024-09-12T01:29:25.395373+0000","last_became_active":"2024-09-12T00:31:47.134398+0000","last_became_peered":"2024-09-12T00:31:47.134398+0000","last_unstale":"2024-09-12T01:29:25.395373+0000","last_undegraded":"2024-09-12T01:29:25.395373+0000","last_fullsized":"2024-09-12T01:29:25.395373+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-12T01:29:25.395184+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-12T01:29:25.395184+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.395184+0000","objects_scrubbed":9,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:04.761120+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788554,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":470,"num_read_kb":102268,"num_write":1066,"num_write_kb":44150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.466136+0000","last_change":"2024-09-12T01:29:34.466136+0000","last_active":"2024-09-12T01:29:34.466136+0000","last_peered":"2024-09-12T01:29:34.466136+0000","last_clean":"2024-09-12T01:29:34.466136+0000","last_became_active":"2024-09-12T00:31:52.151826+0000","last_became_peered":"2024-09-12T00:31:52.151826+0000","last_unstale":"2024-09-12T01:29:34.466136+0000","last_undegraded":"2024-09-12T01:29:34.466136+0000","last_fullsized":"2024-09-12T01:29:34.466136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:34.466045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:34.466045+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.466045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:00.120324+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'305","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.528727+0000","last_change":"2024-09-12T01:29:39.528727+0000","last_active":"2024-09-12T01:29:39.528727+0000","last_peered":"2024-09-12T01:29:39.528727+0000","last_clean":"2024-09-12T01:29:39.528727+0000","last_became_active":"2024-09-12T00:31:54.162188+0000","last_became_peered":"2024-09-12T00:31:54.162188+0000","last_unstale":"2024-09-12T01:29:39.528727+0000","last_undegraded":"2024-09-12T01:29:39.528727+0000","last_fullsized":"2024-09-12T01:29:39.528727+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T01:29:39.528595+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T01:29:39.528595+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.528595+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:29.037553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49464,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":505,"num_read_kb":1076,"num_write":398,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":490,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:39.603003+0000","last_change":"2024-09-12T00:31:56.168740+0000","last_active":"2024-09-12T01:25:39.603003+0000","last_peered":"2024-09-12T01:25:39.603003+0000","last_clean":"2024-09-12T01:25:39.603003+0000","last_became_active":"2024-09-12T00:31:56.168434+0000","last_became_peered":"2024-09-12T00:31:56.168434+0000","last_unstale":"2024-09-12T01:25:39.603003+0000","last_undegraded":"2024-09-12T01:25:39.603003+0000","last_fullsized":"2024-09-12T01:25:39.603003+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:22.526791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'127","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.538257+0000","last_change":"2024-09-12T00:31:58.173821+0000","last_active":"2024-09-12T01:27:47.538257+0000","last_peered":"2024-09-12T01:27:47.538257+0000","last_clean":"2024-09-12T01:27:47.538257+0000","last_became_active":"2024-09-12T00:31:58.173552+0000","last_became_peered":"2024-09-12T00:31:58.173552+0000","last_unstale":"2024-09-12T01:27:47.538257+0000","last_undegraded":"2024-09-12T01:27:47.538257+0000","last_fullsized":"2024-09-12T01:27:47.538257+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":198,"num_write":331,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'108","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.592252+0000","last_change":"2024-09-12T01:29:29.592252+0000","last_active":"2024-09-12T01:29:29.592252+0000","last_peered":"2024-09-12T01:29:29.592252+0000","last_clean":"2024-09-12T01:29:29.592252+0000","last_became_active":"2024-09-12T00:31:50.133117+0000","last_became_peered":"2024-09-12T00:31:50.133117+0000","last_unstale":"2024-09-12T01:29:29.592252+0000","last_undegraded":"2024-09-12T01:29:29.592252+0000","last_fullsized":"2024-09-12T01:29:29.592252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'108","last_scrub_stamp":"2024-09-12T01:29:29.592164+0000","last_deep_scrub":"265'108","last_deep_scrub_stamp":"2024-09-12T01:29:29.592164+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.592164+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:46.847768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":426,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'425","reported_seq":1163,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.746585+0000","last_change":"2024-09-12T01:29:24.746585+0000","last_active":"2024-09-12T01:29:24.746585+0000","last_peered":"2024-09-12T01:29:24.746585+0000","last_clean":"2024-09-12T01:29:24.746585+0000","last_became_active":"2024-09-12T00:31:47.127603+0000","last_became_peered":"2024-09-12T00:31:47.127603+0000","last_unstale":"2024-09-12T01:29:24.746585+0000","last_undegraded":"2024-09-12T01:29:24.746585+0000","last_fullsized":"2024-09-12T01:29:24.746585+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'425","last_scrub_stamp":"2024-09-12T01:29:24.746482+0000","last_deep_scrub":"265'425","last_deep_scrub_stamp":"2024-09-12T01:29:24.746482+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.746482+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:59.902513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":834,"num_read_kb":29446,"num_write":1356,"num_write_kb":48637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:34.718269+0000","last_change":"2024-09-12T00:31:52.152698+0000","last_active":"2024-09-12T01:25:34.718269+0000","last_peered":"2024-09-12T01:25:34.718269+0000","last_clean":"2024-09-12T01:25:34.718269+0000","last_became_active":"2024-09-12T00:31:52.152398+0000","last_became_peered":"2024-09-12T00:31:52.152398+0000","last_unstale":"2024-09-12T01:25:34.718269+0000","last_undegraded":"2024-09-12T01:25:34.718269+0000","last_fullsized":"2024-09-12T01:25:34.718269+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:18.608839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'276","reported_seq":848,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.775167+0000","last_change":"2024-09-12T00:31:54.171666+0000","last_active":"2024-09-12T01:29:15.775167+0000","last_peered":"2024-09-12T01:29:15.775167+0000","last_clean":"2024-09-12T01:29:15.775167+0000","last_became_active":"2024-09-12T00:31:54.171386+0000","last_became_peered":"2024-09-12T00:31:54.171386+0000","last_unstale":"2024-09-12T01:29:15.775167+0000","last_undegraded":"2024-09-12T01:29:15.775167+0000","last_fullsized":"2024-09-12T01:29:15.775167+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:37.250983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46739,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":1088,"num_write":376,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:35.777911+0000","last_change":"2024-09-12T00:31:56.167578+0000","last_active":"2024-09-12T01:25:35.777911+0000","last_peered":"2024-09-12T01:25:35.777911+0000","last_clean":"2024-09-12T01:25:35.777911+0000","last_became_active":"2024-09-12T00:31:56.167213+0000","last_became_peered":"2024-09-12T00:31:56.167213+0000","last_unstale":"2024-09-12T01:25:35.777911+0000","last_undegraded":"2024-09-12T01:25:35.777911+0000","last_fullsized":"2024-09-12T01:25:35.777911+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:56.884166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'120","reported_seq":741,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.353194+0000","last_change":"2024-09-12T00:31:50.140157+0000","last_active":"2024-09-12T01:26:44.353194+0000","last_peered":"2024-09-12T01:26:44.353194+0000","last_clean":"2024-09-12T01:26:44.353194+0000","last_became_active":"2024-09-12T00:31:50.139863+0000","last_became_peered":"2024-09-12T00:31:50.139863+0000","last_unstale":"2024-09-12T01:26:44.353194+0000","last_undegraded":"2024-09-12T01:26:44.353194+0000","last_fullsized":"2024-09-12T01:26:44.353194+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:39.011610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":466,"num_write":169,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'448","reported_seq":1151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.795366+0000","last_change":"2024-09-12T01:29:25.795366+0000","last_active":"2024-09-12T01:29:25.795366+0000","last_peered":"2024-09-12T01:29:25.795366+0000","last_clean":"2024-09-12T01:29:25.795366+0000","last_became_active":"2024-09-12T00:31:47.133283+0000","last_became_peered":"2024-09-12T00:31:47.133283+0000","last_unstale":"2024-09-12T01:29:25.795366+0000","last_undegraded":"2024-09-12T01:29:25.795366+0000","last_fullsized":"2024-09-12T01:29:25.795366+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'448","last_scrub_stamp":"2024-09-12T01:29:25.795214+0000","last_deep_scrub":"265'448","last_deep_scrub_stamp":"2024-09-12T01:29:25.795214+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.795214+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:54.503325+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133704,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":743,"num_read_kb":14924,"num_write":1450,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.638064+0000","last_change":"2024-09-12T00:31:52.152988+0000","last_active":"2024-09-12T01:26:05.638064+0000","last_peered":"2024-09-12T01:26:05.638064+0000","last_clean":"2024-09-12T01:26:05.638064+0000","last_became_active":"2024-09-12T00:31:52.152676+0000","last_became_peered":"2024-09-12T00:31:52.152676+0000","last_unstale":"2024-09-12T01:26:05.638064+0000","last_undegraded":"2024-09-12T01:26:05.638064+0000","last_fullsized":"2024-09-12T01:26:05.638064+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:00.660120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'508","reported_seq":1140,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.707027+0000","last_change":"2024-09-12T00:31:54.171588+0000","last_active":"2024-09-12T01:29:15.707027+0000","last_peered":"2024-09-12T01:29:15.707027+0000","last_clean":"2024-09-12T01:29:15.707027+0000","last_became_active":"2024-09-12T00:31:54.171225+0000","last_became_peered":"2024-09-12T00:31:54.171225+0000","last_unstale":"2024-09-12T01:29:15.707027+0000","last_undegraded":"2024-09-12T01:29:15.707027+0000","last_fullsized":"2024-09-12T01:29:15.707027+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":400,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95922,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":923,"num_read_kb":2207,"num_write":796,"num_write_kb":707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:59.510453+0000","last_change":"2024-09-12T00:31:56.176025+0000","last_active":"2024-09-12T01:26:59.510453+0000","last_peered":"2024-09-12T01:26:59.510453+0000","last_clean":"2024-09-12T01:26:59.510453+0000","last_became_active":"2024-09-12T00:31:56.175562+0000","last_became_peered":"2024-09-12T00:31:56.175562+0000","last_unstale":"2024-09-12T01:26:59.510453+0000","last_undegraded":"2024-09-12T01:26:59.510453+0000","last_fullsized":"2024-09-12T01:26:59.510453+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'142","reported_seq":641,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.598076+0000","last_change":"2024-09-12T00:31:58.183054+0000","last_active":"2024-09-12T01:27:47.598076+0000","last_peered":"2024-09-12T01:27:47.598076+0000","last_clean":"2024-09-12T01:27:47.598076+0000","last_became_active":"2024-09-12T00:31:58.182602+0000","last_became_peered":"2024-09-12T00:31:58.182602+0000","last_unstale":"2024-09-12T01:27:47.598076+0000","last_undegraded":"2024-09-12T01:27:47.598076+0000","last_fullsized":"2024-09-12T01:27:47.598076+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:54.264038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":164,"num_write":296,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'135","reported_seq":765,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.579405+0000","last_change":"2024-09-12T01:29:31.579405+0000","last_active":"2024-09-12T01:29:31.579405+0000","last_peered":"2024-09-12T01:29:31.579405+0000","last_clean":"2024-09-12T01:29:31.579405+0000","last_became_active":"2024-09-12T00:31:50.132053+0000","last_became_peered":"2024-09-12T00:31:50.132053+0000","last_unstale":"2024-09-12T01:29:31.579405+0000","last_undegraded":"2024-09-12T01:29:31.579405+0000","last_fullsized":"2024-09-12T01:29:31.579405+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T01:29:31.579303+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T01:29:31.579303+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.579303+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.679511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":637,"num_read_kb":540,"num_write":205,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'319","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.654810+0000","last_change":"2024-09-12T01:29:26.654810+0000","last_active":"2024-09-12T01:29:26.654810+0000","last_peered":"2024-09-12T01:29:26.654810+0000","last_clean":"2024-09-12T01:29:26.654810+0000","last_became_active":"2024-09-12T00:31:47.114966+0000","last_became_peered":"2024-09-12T00:31:47.114966+0000","last_unstale":"2024-09-12T01:29:26.654810+0000","last_undegraded":"2024-09-12T01:29:26.654810+0000","last_fullsized":"2024-09-12T01:29:26.654810+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T01:29:26.654700+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T01:29:26.654700+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.654700+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:07.153488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279295,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":490,"num_read_kb":26176,"num_write":1107,"num_write_kb":27429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.402798+0000","last_change":"2024-09-12T01:29:39.402798+0000","last_active":"2024-09-12T01:29:39.402798+0000","last_peered":"2024-09-12T01:29:39.402798+0000","last_clean":"2024-09-12T01:29:39.402798+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:29:39.402798+0000","last_undegraded":"2024-09-12T01:29:39.402798+0000","last_fullsized":"2024-09-12T01:29:39.402798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:39.402710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:39.402710+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.402710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:26.430951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'293","reported_seq":882,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.826029+0000","last_change":"2024-09-12T00:31:54.166286+0000","last_active":"2024-09-12T01:29:15.826029+0000","last_peered":"2024-09-12T01:29:15.826029+0000","last_clean":"2024-09-12T01:29:15.826029+0000","last_became_active":"2024-09-12T00:31:54.165996+0000","last_became_peered":"2024-09-12T00:31:54.165996+0000","last_unstale":"2024-09-12T01:29:15.826029+0000","last_undegraded":"2024-09-12T01:29:15.826029+0000","last_fullsized":"2024-09-12T01:29:15.826029+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":488,"num_read_kb":1000,"num_write":400,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:57.507155+0000","last_change":"2024-09-12T00:31:56.171294+0000","last_active":"2024-09-12T01:26:57.507155+0000","last_peered":"2024-09-12T01:26:57.507155+0000","last_clean":"2024-09-12T01:26:57.507155+0000","last_became_active":"2024-09-12T00:31:56.170994+0000","last_became_peered":"2024-09-12T00:31:56.170994+0000","last_unstale":"2024-09-12T01:26:57.507155+0000","last_undegraded":"2024-09-12T01:26:57.507155+0000","last_fullsized":"2024-09-12T01:26:57.507155+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'162","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:06.007997+0000","last_change":"2024-09-12T00:31:58.183946+0000","last_active":"2024-09-12T01:27:06.007997+0000","last_peered":"2024-09-12T01:27:06.007997+0000","last_clean":"2024-09-12T01:27:06.007997+0000","last_became_active":"2024-09-12T00:31:58.183625+0000","last_became_peered":"2024-09-12T00:31:58.183625+0000","last_unstale":"2024-09-12T01:27:06.007997+0000","last_undegraded":"2024-09-12T01:27:06.007997+0000","last_fullsized":"2024-09-12T01:27:06.007997+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:34.434376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2035,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":465,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'119","reported_seq":704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.609043+0000","last_change":"2024-09-12T01:29:30.609043+0000","last_active":"2024-09-12T01:29:30.609043+0000","last_peered":"2024-09-12T01:29:30.609043+0000","last_clean":"2024-09-12T01:29:30.609043+0000","last_became_active":"2024-09-12T00:31:50.143427+0000","last_became_peered":"2024-09-12T00:31:50.143427+0000","last_unstale":"2024-09-12T01:29:30.609043+0000","last_undegraded":"2024-09-12T01:29:30.609043+0000","last_fullsized":"2024-09-12T01:29:30.609043+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T01:29:30.608948+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T01:29:30.608948+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.608948+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:44.221971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":539,"num_read_kb":443,"num_write":196,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'364","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.374053+0000","last_change":"2024-09-12T01:29:23.374053+0000","last_active":"2024-09-12T01:29:23.374053+0000","last_peered":"2024-09-12T01:29:23.374053+0000","last_clean":"2024-09-12T01:29:23.374053+0000","last_became_active":"2024-09-12T00:31:47.117631+0000","last_became_peered":"2024-09-12T00:31:47.117631+0000","last_unstale":"2024-09-12T01:29:23.374053+0000","last_undegraded":"2024-09-12T01:29:23.374053+0000","last_fullsized":"2024-09-12T01:29:23.374053+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T01:29:23.373946+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T01:29:23.373946+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.373946+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:26.118563+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":597,"num_read_kb":5850,"num_write":1220,"num_write_kb":26346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.372836+0000","last_change":"2024-09-12T01:29:38.372836+0000","last_active":"2024-09-12T01:29:38.372836+0000","last_peered":"2024-09-12T01:29:38.372836+0000","last_clean":"2024-09-12T01:29:38.372836+0000","last_became_active":"2024-09-12T00:31:52.151796+0000","last_became_peered":"2024-09-12T00:31:52.151796+0000","last_unstale":"2024-09-12T01:29:38.372836+0000","last_undegraded":"2024-09-12T01:29:38.372836+0000","last_fullsized":"2024-09-12T01:29:38.372836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:38.372741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:38.372741+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.372741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:52.582073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'312","reported_seq":893,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.924627+0000","last_change":"2024-09-12T00:31:54.171225+0000","last_active":"2024-09-12T01:29:14.924627+0000","last_peered":"2024-09-12T01:29:14.924627+0000","last_clean":"2024-09-12T01:29:14.924627+0000","last_became_active":"2024-09-12T00:31:54.170965+0000","last_became_peered":"2024-09-12T00:31:54.170965+0000","last_unstale":"2024-09-12T01:29:14.924627+0000","last_undegraded":"2024-09-12T01:29:14.924627+0000","last_fullsized":"2024-09-12T01:29:14.924627+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:10.738478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":509,"num_read_kb":1155,"num_write":420,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782663+0000","last_change":"2024-09-12T00:31:56.172806+0000","last_active":"2024-09-12T01:26:05.782663+0000","last_peered":"2024-09-12T01:26:05.782663+0000","last_clean":"2024-09-12T01:26:05.782663+0000","last_became_active":"2024-09-12T00:31:56.172337+0000","last_became_peered":"2024-09-12T00:31:56.172337+0000","last_unstale":"2024-09-12T01:26:05.782663+0000","last_undegraded":"2024-09-12T01:26:05.782663+0000","last_fullsized":"2024-09-12T01:26:05.782663+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:10.789777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'133","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.342581+0000","last_change":"2024-09-12T00:31:58.178826+0000","last_active":"2024-09-12T01:28:55.342581+0000","last_peered":"2024-09-12T01:28:55.342581+0000","last_clean":"2024-09-12T01:28:55.342581+0000","last_became_active":"2024-09-12T00:31:58.178565+0000","last_became_peered":"2024-09-12T00:31:58.178565+0000","last_unstale":"2024-09-12T01:28:55.342581+0000","last_undegraded":"2024-09-12T01:28:55.342581+0000","last_fullsized":"2024-09-12T01:28:55.342581+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:10.421354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":335,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'510","reported_seq":1287,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.608617+0000","last_change":"2024-09-12T01:29:32.608617+0000","last_active":"2024-09-12T01:29:32.608617+0000","last_peered":"2024-09-12T01:29:32.608617+0000","last_clean":"2024-09-12T01:29:32.608617+0000","last_became_active":"2024-09-12T00:31:50.137671+0000","last_became_peered":"2024-09-12T00:31:50.137671+0000","last_unstale":"2024-09-12T01:29:32.608617+0000","last_undegraded":"2024-09-12T01:29:32.608617+0000","last_fullsized":"2024-09-12T01:29:32.608617+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'510","last_scrub_stamp":"2024-09-12T01:29:32.608525+0000","last_deep_scrub":"265'510","last_deep_scrub_stamp":"2024-09-12T01:29:32.608525+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.608525+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:22.202787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2432,"num_read_kb":2072,"num_write":871,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'466","reported_seq":1282,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.608766+0000","last_change":"2024-09-12T01:29:27.608766+0000","last_active":"2024-09-12T01:29:27.608766+0000","last_peered":"2024-09-12T01:29:27.608766+0000","last_clean":"2024-09-12T01:29:27.608766+0000","last_became_active":"2024-09-12T00:31:47.130035+0000","last_became_peered":"2024-09-12T00:31:47.130035+0000","last_unstale":"2024-09-12T01:29:27.608766+0000","last_undegraded":"2024-09-12T01:29:27.608766+0000","last_fullsized":"2024-09-12T01:29:27.608766+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'466","last_scrub_stamp":"2024-09-12T01:29:27.608666+0000","last_deep_scrub":"265'466","last_deep_scrub_stamp":"2024-09-12T01:29:27.608666+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.608666+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:56.750595+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1077,"num_read_kb":24732,"num_write":1307,"num_write_kb":48327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:53.507292+0000","last_change":"2024-09-12T00:31:52.156699+0000","last_active":"2024-09-12T01:26:53.507292+0000","last_peered":"2024-09-12T01:26:53.507292+0000","last_clean":"2024-09-12T01:26:53.507292+0000","last_became_active":"2024-09-12T00:31:52.155279+0000","last_became_peered":"2024-09-12T00:31:52.155279+0000","last_unstale":"2024-09-12T01:26:53.507292+0000","last_undegraded":"2024-09-12T01:26:53.507292+0000","last_fullsized":"2024-09-12T01:26:53.507292+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'113","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.722904+0000","last_change":"2024-09-12T00:31:54.166092+0000","last_active":"2024-09-12T01:25:59.722904+0000","last_peered":"2024-09-12T01:25:59.722904+0000","last_clean":"2024-09-12T01:25:59.722904+0000","last_became_active":"2024-09-12T00:31:54.165779+0000","last_became_peered":"2024-09-12T00:31:54.165779+0000","last_unstale":"2024-09-12T01:25:59.722904+0000","last_undegraded":"2024-09-12T01:25:59.722904+0000","last_fullsized":"2024-09-12T01:25:59.722904+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:53.134965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":137,"num_write":154,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'763","reported_seq":2339,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.071399+0000","last_change":"2024-09-12T00:31:56.172869+0000","last_active":"2024-09-12T01:29:16.071399+0000","last_peered":"2024-09-12T01:29:16.071399+0000","last_clean":"2024-09-12T01:29:16.071399+0000","last_became_active":"2024-09-12T00:31:56.172551+0000","last_became_peered":"2024-09-12T00:31:56.172551+0000","last_unstale":"2024-09-12T01:29:16.071399+0000","last_undegraded":"2024-09-12T01:29:16.071399+0000","last_fullsized":"2024-09-12T01:29:16.071399+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:33.670974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'121","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:33.597265+0000","last_change":"2024-09-12T00:31:58.178960+0000","last_active":"2024-09-12T01:26:33.597265+0000","last_peered":"2024-09-12T01:26:33.597265+0000","last_clean":"2024-09-12T01:26:33.597265+0000","last_became_active":"2024-09-12T00:31:58.178671+0000","last_became_peered":"2024-09-12T00:31:58.178671+0000","last_unstale":"2024-09-12T01:26:33.597265+0000","last_undegraded":"2024-09-12T01:26:33.597265+0000","last_fullsized":"2024-09-12T01:26:33.597265+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:53.455583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'144","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.413643+0000","last_change":"2024-09-12T01:29:36.413643+0000","last_active":"2024-09-12T01:29:36.413643+0000","last_peered":"2024-09-12T01:29:36.413643+0000","last_clean":"2024-09-12T01:29:36.413643+0000","last_became_active":"2024-09-12T00:31:50.143377+0000","last_became_peered":"2024-09-12T00:31:50.143377+0000","last_unstale":"2024-09-12T01:29:36.413643+0000","last_undegraded":"2024-09-12T01:29:36.413643+0000","last_fullsized":"2024-09-12T01:29:36.413643+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:29:36.413557+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:29:36.413557+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.413557+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:23.640462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":664,"num_read_kb":566,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'384","reported_seq":1109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.374852+0000","last_change":"2024-09-12T01:29:22.374852+0000","last_active":"2024-09-12T01:29:22.374852+0000","last_peered":"2024-09-12T01:29:22.374852+0000","last_clean":"2024-09-12T01:29:22.374852+0000","last_became_active":"2024-09-12T00:31:47.128555+0000","last_became_peered":"2024-09-12T00:31:47.128555+0000","last_unstale":"2024-09-12T01:29:22.374852+0000","last_undegraded":"2024-09-12T01:29:22.374852+0000","last_fullsized":"2024-09-12T01:29:22.374852+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-12T01:29:22.374771+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-12T01:29:22.374771+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.374771+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:28.766984+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2058190,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":740,"num_read_kb":10967,"num_write":1262,"num_write_kb":23618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.443104+0000","last_change":"2024-09-12T01:29:35.443104+0000","last_active":"2024-09-12T01:29:35.443104+0000","last_peered":"2024-09-12T01:29:35.443104+0000","last_clean":"2024-09-12T01:29:35.443104+0000","last_became_active":"2024-09-12T00:31:52.150825+0000","last_became_peered":"2024-09-12T00:31:52.150825+0000","last_unstale":"2024-09-12T01:29:35.443104+0000","last_undegraded":"2024-09-12T01:29:35.443104+0000","last_fullsized":"2024-09-12T01:29:35.443104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:35.443014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:35.443014+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.443014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:07.660789+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'344","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.278535+0000","last_change":"2024-09-12T00:31:54.169556+0000","last_active":"2024-09-12T01:29:15.278535+0000","last_peered":"2024-09-12T01:29:15.278535+0000","last_clean":"2024-09-12T01:29:15.278535+0000","last_became_active":"2024-09-12T00:31:54.169308+0000","last_became_peered":"2024-09-12T00:31:54.169308+0000","last_unstale":"2024-09-12T01:29:15.278535+0000","last_undegraded":"2024-09-12T01:29:15.278535+0000","last_fullsized":"2024-09-12T01:29:15.278535+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:17.921463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45185,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":558,"num_read_kb":1163,"num_write":446,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:08.492547+0000","last_change":"2024-09-12T00:31:56.173701+0000","last_active":"2024-09-12T01:25:08.492547+0000","last_peered":"2024-09-12T01:25:08.492547+0000","last_clean":"2024-09-12T01:25:08.492547+0000","last_became_active":"2024-09-12T00:31:56.173389+0000","last_became_peered":"2024-09-12T00:31:56.173389+0000","last_unstale":"2024-09-12T01:25:08.492547+0000","last_undegraded":"2024-09-12T01:25:08.492547+0000","last_fullsized":"2024-09-12T01:25:08.492547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:28.642695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'140","reported_seq":639,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:34.516248+0000","last_change":"2024-09-12T00:31:58.183381+0000","last_active":"2024-09-12T01:27:34.516248+0000","last_peered":"2024-09-12T01:27:34.516248+0000","last_clean":"2024-09-12T01:27:34.516248+0000","last_became_active":"2024-09-12T00:31:58.183017+0000","last_became_peered":"2024-09-12T00:31:58.183017+0000","last_unstale":"2024-09-12T01:27:34.516248+0000","last_undegraded":"2024-09-12T01:27:34.516248+0000","last_fullsized":"2024-09-12T01:27:34.516248+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:38.690748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":129,"num_write":333,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'130","reported_seq":749,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.356057+0000","last_change":"2024-09-12T01:29:30.356057+0000","last_active":"2024-09-12T01:29:30.356057+0000","last_peered":"2024-09-12T01:29:30.356057+0000","last_clean":"2024-09-12T01:29:30.356057+0000","last_became_active":"2024-09-12T00:31:50.136941+0000","last_became_peered":"2024-09-12T00:31:50.136941+0000","last_unstale":"2024-09-12T01:29:30.356057+0000","last_undegraded":"2024-09-12T01:29:30.356057+0000","last_fullsized":"2024-09-12T01:29:30.356057+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T01:29:30.355971+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T01:29:30.355971+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.355971+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:08.036712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":653,"num_read_kb":587,"num_write":190,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2874,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'341","reported_seq":995,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.019642+0000","last_change":"2024-09-12T01:29:31.019642+0000","last_active":"2024-09-12T01:29:31.019642+0000","last_peered":"2024-09-12T01:29:31.019642+0000","last_clean":"2024-09-12T01:29:31.019642+0000","last_became_active":"2024-09-12T00:31:47.131600+0000","last_became_peered":"2024-09-12T00:31:47.131600+0000","last_unstale":"2024-09-12T01:29:31.019642+0000","last_undegraded":"2024-09-12T01:29:31.019642+0000","last_fullsized":"2024-09-12T01:29:31.019642+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-12T01:29:31.019510+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-12T01:29:31.019510+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.019510+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:11.532544+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":495,"num_read_kb":43314,"num_write":1098,"num_write_kb":38822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.385826+0000","last_change":"2024-09-12T01:29:37.385826+0000","last_active":"2024-09-12T01:29:37.385826+0000","last_peered":"2024-09-12T01:29:37.385826+0000","last_clean":"2024-09-12T01:29:37.385826+0000","last_became_active":"2024-09-12T00:31:52.152537+0000","last_became_peered":"2024-09-12T00:31:52.152537+0000","last_unstale":"2024-09-12T01:29:37.385826+0000","last_undegraded":"2024-09-12T01:29:37.385826+0000","last_fullsized":"2024-09-12T01:29:37.385826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:37.385738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:37.385738+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.385738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:37.788544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'281","reported_seq":864,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.341577+0000","last_change":"2024-09-12T00:31:54.164435+0000","last_active":"2024-09-12T01:29:15.341577+0000","last_peered":"2024-09-12T01:29:15.341577+0000","last_clean":"2024-09-12T01:29:15.341577+0000","last_became_active":"2024-09-12T00:31:54.163977+0000","last_became_peered":"2024-09-12T00:31:54.163977+0000","last_unstale":"2024-09-12T01:29:15.341577+0000","last_undegraded":"2024-09-12T01:29:15.341577+0000","last_fullsized":"2024-09-12T01:29:15.341577+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:06.747649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44628,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":1027,"num_write":368,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.716184+0000","last_change":"2024-09-12T00:31:56.171991+0000","last_active":"2024-09-12T01:25:14.716184+0000","last_peered":"2024-09-12T01:25:14.716184+0000","last_clean":"2024-09-12T01:25:14.716184+0000","last_became_active":"2024-09-12T00:31:56.171306+0000","last_became_peered":"2024-09-12T00:31:56.171306+0000","last_unstale":"2024-09-12T01:25:14.716184+0000","last_undegraded":"2024-09-12T01:25:14.716184+0000","last_fullsized":"2024-09-12T01:25:14.716184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:32.961885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'124","reported_seq":657,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:53.708398+0000","last_change":"2024-09-12T00:31:58.183063+0000","last_active":"2024-09-12T01:26:53.708398+0000","last_peered":"2024-09-12T01:26:53.708398+0000","last_clean":"2024-09-12T01:26:53.708398+0000","last_became_active":"2024-09-12T00:31:58.182701+0000","last_became_peered":"2024-09-12T00:31:58.182701+0000","last_unstale":"2024-09-12T01:26:53.708398+0000","last_undegraded":"2024-09-12T01:26:53.708398+0000","last_fullsized":"2024-09-12T01:26:53.708398+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:26.910205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":215,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'42","reported_seq":610,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.563386+0000","last_change":"2024-09-12T01:29:28.563386+0000","last_active":"2024-09-12T01:29:28.563386+0000","last_peered":"2024-09-12T01:29:28.563386+0000","last_clean":"2024-09-12T01:29:28.563386+0000","last_became_active":"2024-09-12T00:31:50.136971+0000","last_became_peered":"2024-09-12T00:31:50.136971+0000","last_unstale":"2024-09-12T01:29:28.563386+0000","last_undegraded":"2024-09-12T01:29:28.563386+0000","last_fullsized":"2024-09-12T01:29:28.563386+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'42","last_scrub_stamp":"2024-09-12T01:29:28.563295+0000","last_deep_scrub":"265'42","last_deep_scrub_stamp":"2024-09-12T01:29:28.563295+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.563295+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:05.396239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":180,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'353","reported_seq":1022,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.835870+0000","last_change":"2024-09-12T01:29:26.835870+0000","last_active":"2024-09-12T01:29:26.835870+0000","last_peered":"2024-09-12T01:29:26.835870+0000","last_clean":"2024-09-12T01:29:26.835870+0000","last_became_active":"2024-09-12T00:31:47.123001+0000","last_became_peered":"2024-09-12T00:31:47.123001+0000","last_unstale":"2024-09-12T01:29:26.835870+0000","last_undegraded":"2024-09-12T01:29:26.835870+0000","last_fullsized":"2024-09-12T01:29:26.835870+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T01:29:26.835750+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T01:29:26.835750+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.835750+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:58.085367+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3599074,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":39607,"num_write":1095,"num_write_kb":26742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:04.599267+0000","last_change":"2024-09-12T00:31:52.151290+0000","last_active":"2024-09-12T01:25:04.599267+0000","last_peered":"2024-09-12T01:25:04.599267+0000","last_clean":"2024-09-12T01:25:04.599267+0000","last_became_active":"2024-09-12T00:31:52.150969+0000","last_became_peered":"2024-09-12T00:31:52.150969+0000","last_unstale":"2024-09-12T01:25:04.599267+0000","last_undegraded":"2024-09-12T01:25:04.599267+0000","last_fullsized":"2024-09-12T01:25:04.599267+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:12.373364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'257","reported_seq":816,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.792073+0000","last_change":"2024-09-12T00:31:54.170159+0000","last_active":"2024-09-12T01:29:14.792073+0000","last_peered":"2024-09-12T01:29:14.792073+0000","last_clean":"2024-09-12T01:29:14.792073+0000","last_became_active":"2024-09-12T00:31:54.169845+0000","last_became_peered":"2024-09-12T00:31:54.169845+0000","last_unstale":"2024-09-12T01:29:14.792073+0000","last_undegraded":"2024-09-12T01:29:14.792073+0000","last_fullsized":"2024-09-12T01:29:14.792073+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47509,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":435,"num_read_kb":1050,"num_write":360,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:59.730419+0000","last_change":"2024-09-12T00:31:56.171144+0000","last_active":"2024-09-12T01:26:59.730419+0000","last_peered":"2024-09-12T01:26:59.730419+0000","last_clean":"2024-09-12T01:26:59.730419+0000","last_became_active":"2024-09-12T00:31:56.170767+0000","last_became_peered":"2024-09-12T00:31:56.170767+0000","last_unstale":"2024-09-12T01:26:59.730419+0000","last_undegraded":"2024-09-12T01:26:59.730419+0000","last_fullsized":"2024-09-12T01:26:59.730419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'182","reported_seq":1651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:45.513528+0000","last_change":"2024-09-12T00:31:58.173318+0000","last_active":"2024-09-12T01:27:45.513528+0000","last_peered":"2024-09-12T01:27:45.513528+0000","last_clean":"2024-09-12T01:27:45.513528+0000","last_became_active":"2024-09-12T00:31:58.173049+0000","last_became_peered":"2024-09-12T00:31:58.173049+0000","last_unstale":"2024-09-12T01:27:45.513528+0000","last_undegraded":"2024-09-12T01:27:45.513528+0000","last_fullsized":"2024-09-12T01:27:45.513528+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:38.032229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1227,"num_read_kb":1215,"num_write":440,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'221","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.367671+0000","last_change":"2024-09-12T01:29:29.367671+0000","last_active":"2024-09-12T01:29:29.367671+0000","last_peered":"2024-09-12T01:29:29.367671+0000","last_clean":"2024-09-12T01:29:29.367671+0000","last_became_active":"2024-09-12T00:31:50.141009+0000","last_became_peered":"2024-09-12T00:31:50.141009+0000","last_unstale":"2024-09-12T01:29:29.367671+0000","last_undegraded":"2024-09-12T01:29:29.367671+0000","last_fullsized":"2024-09-12T01:29:29.367671+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'221","last_scrub_stamp":"2024-09-12T01:29:29.367587+0000","last_deep_scrub":"265'221","last_deep_scrub_stamp":"2024-09-12T01:29:29.367587+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.367587+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:50.790988+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":914,"num_read_kb":727,"num_write":339,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'391","reported_seq":1074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.837675+0000","last_change":"2024-09-12T01:29:27.837675+0000","last_active":"2024-09-12T01:29:27.837675+0000","last_peered":"2024-09-12T01:29:27.837675+0000","last_clean":"2024-09-12T01:29:27.837675+0000","last_became_active":"2024-09-12T00:31:47.118434+0000","last_became_peered":"2024-09-12T00:31:47.118434+0000","last_unstale":"2024-09-12T01:29:27.837675+0000","last_undegraded":"2024-09-12T01:29:27.837675+0000","last_fullsized":"2024-09-12T01:29:27.837675+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T01:29:27.837556+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T01:29:27.837556+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.837556+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:32.423783+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":619,"num_read_kb":10821,"num_write":1247,"num_write_kb":40782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:18.494021+0000","last_change":"2024-09-12T00:31:52.149493+0000","last_active":"2024-09-12T01:25:18.494021+0000","last_peered":"2024-09-12T01:25:18.494021+0000","last_clean":"2024-09-12T01:25:18.494021+0000","last_became_active":"2024-09-12T00:31:52.148440+0000","last_became_peered":"2024-09-12T00:31:52.148440+0000","last_unstale":"2024-09-12T01:25:18.494021+0000","last_undegraded":"2024-09-12T01:25:18.494021+0000","last_fullsized":"2024-09-12T01:25:18.494021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:51.126613+0000","last_clean_scrub_stamp":"2024-09-12T00:31:51.126613+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:59.545517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'310","reported_seq":909,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:14.985840+0000","last_change":"2024-09-12T00:31:54.168195+0000","last_active":"2024-09-12T01:29:14.985840+0000","last_peered":"2024-09-12T01:29:14.985840+0000","last_clean":"2024-09-12T01:29:14.985840+0000","last_became_active":"2024-09-12T00:31:54.167915+0000","last_became_peered":"2024-09-12T00:31:54.167915+0000","last_unstale":"2024-09-12T01:29:14.985840+0000","last_undegraded":"2024-09-12T01:29:14.985840+0000","last_fullsized":"2024-09-12T01:29:14.985840+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:53.144953+0000","last_clean_scrub_stamp":"2024-09-12T00:31:53.144953+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44378,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":513,"num_read_kb":1106,"num_write":406,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:58.507922+0000","last_change":"2024-09-12T00:31:56.174946+0000","last_active":"2024-09-12T01:26:58.507922+0000","last_peered":"2024-09-12T01:26:58.507922+0000","last_clean":"2024-09-12T01:26:58.507922+0000","last_became_active":"2024-09-12T00:31:56.171654+0000","last_became_peered":"2024-09-12T00:31:56.171654+0000","last_unstale":"2024-09-12T01:26:58.507922+0000","last_undegraded":"2024-09-12T01:26:58.507922+0000","last_fullsized":"2024-09-12T01:26:58.507922+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'130","reported_seq":637,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:54.389173+0000","last_change":"2024-09-12T00:31:58.182334+0000","last_active":"2024-09-12T01:28:54.389173+0000","last_peered":"2024-09-12T01:28:54.389173+0000","last_clean":"2024-09-12T01:28:54.389173+0000","last_became_active":"2024-09-12T00:31:58.181864+0000","last_became_peered":"2024-09-12T00:31:58.181864+0000","last_unstale":"2024-09-12T01:28:54.389173+0000","last_undegraded":"2024-09-12T01:28:54.389173+0000","last_fullsized":"2024-09-12T01:28:54.389173+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:46.609359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":169,"num_write":329,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'138","reported_seq":718,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.569403+0000","last_change":"2024-09-12T01:29:34.569403+0000","last_active":"2024-09-12T01:29:34.569403+0000","last_peered":"2024-09-12T01:29:34.569403+0000","last_clean":"2024-09-12T01:29:34.569403+0000","last_became_active":"2024-09-12T00:31:50.123862+0000","last_became_peered":"2024-09-12T00:31:50.123862+0000","last_unstale":"2024-09-12T01:29:34.569403+0000","last_undegraded":"2024-09-12T01:29:34.569403+0000","last_fullsized":"2024-09-12T01:29:34.569403+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'138","last_scrub_stamp":"2024-09-12T01:29:34.569319+0000","last_deep_scrub":"265'138","last_deep_scrub_stamp":"2024-09-12T01:29:34.569319+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.569319+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:39.432572+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":471,"num_write":227,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'354","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.369781+0000","last_change":"2024-09-12T01:29:23.369781+0000","last_active":"2024-09-12T01:29:23.369781+0000","last_peered":"2024-09-12T01:29:23.369781+0000","last_clean":"2024-09-12T01:29:23.369781+0000","last_became_active":"2024-09-12T00:31:47.132236+0000","last_became_peered":"2024-09-12T00:31:47.132236+0000","last_unstale":"2024-09-12T01:29:23.369781+0000","last_undegraded":"2024-09-12T01:29:23.369781+0000","last_fullsized":"2024-09-12T01:29:23.369781+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T01:29:23.369652+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T01:29:23.369652+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.369652+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:57.694085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":457,"num_read_kb":4332,"num_write":1030,"num_write_kb":17381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'142","reported_seq":738,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.563292+0000","last_change":"2024-09-12T01:29:31.563292+0000","last_active":"2024-09-12T01:29:31.563292+0000","last_peered":"2024-09-12T01:29:31.563292+0000","last_clean":"2024-09-12T01:29:31.563292+0000","last_became_active":"2024-09-12T00:31:50.140649+0000","last_became_peered":"2024-09-12T00:31:50.140649+0000","last_unstale":"2024-09-12T01:29:31.563292+0000","last_undegraded":"2024-09-12T01:29:31.563292+0000","last_fullsized":"2024-09-12T01:29:31.563292+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T01:29:31.563200+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T01:29:31.563200+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.563200+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:34.599331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":475,"num_write":199,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'326","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.578704+0000","last_change":"2024-09-12T01:29:25.578704+0000","last_active":"2024-09-12T01:29:25.578704+0000","last_peered":"2024-09-12T01:29:25.578704+0000","last_clean":"2024-09-12T01:29:25.578704+0000","last_became_active":"2024-09-12T00:31:47.126093+0000","last_became_peered":"2024-09-12T00:31:47.126093+0000","last_unstale":"2024-09-12T01:29:25.578704+0000","last_undegraded":"2024-09-12T01:29:25.578704+0000","last_fullsized":"2024-09-12T01:29:25.578704+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'326","last_scrub_stamp":"2024-09-12T01:29:25.578576+0000","last_deep_scrub":"265'326","last_deep_scrub_stamp":"2024-09-12T01:29:25.578576+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.578576+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:43.122572+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":454,"num_read_kb":13702,"num_write":989,"num_write_kb":29796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'259","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:37.319605+0000","last_change":"2024-09-12T00:31:50.133329+0000","last_active":"2024-09-12T01:26:37.319605+0000","last_peered":"2024-09-12T01:26:37.319605+0000","last_clean":"2024-09-12T01:26:37.319605+0000","last_became_active":"2024-09-12T00:31:50.132976+0000","last_became_peered":"2024-09-12T00:31:50.132976+0000","last_unstale":"2024-09-12T01:26:37.319605+0000","last_undegraded":"2024-09-12T01:26:37.319605+0000","last_fullsized":"2024-09-12T01:26:37.319605+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:59.147279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1108,"num_read_kb":908,"num_write":394,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'354","reported_seq":1055,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.086724+0000","last_change":"2024-09-12T01:29:33.086724+0000","last_active":"2024-09-12T01:29:33.086724+0000","last_peered":"2024-09-12T01:29:33.086724+0000","last_clean":"2024-09-12T01:29:33.086724+0000","last_became_active":"2024-09-12T00:31:47.117000+0000","last_became_peered":"2024-09-12T00:31:47.117000+0000","last_unstale":"2024-09-12T01:29:33.086724+0000","last_undegraded":"2024-09-12T01:29:33.086724+0000","last_fullsized":"2024-09-12T01:29:33.086724+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T01:29:33.086619+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T01:29:33.086619+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.086619+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:18.339050+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138894,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":591,"num_read_kb":34967,"num_write":1161,"num_write_kb":18512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'188","reported_seq":841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.863803+0000","last_change":"2024-09-12T01:29:36.863803+0000","last_active":"2024-09-12T01:29:36.863803+0000","last_peered":"2024-09-12T01:29:36.863803+0000","last_clean":"2024-09-12T01:29:36.863803+0000","last_became_active":"2024-09-12T00:31:50.133634+0000","last_became_peered":"2024-09-12T00:31:50.133634+0000","last_unstale":"2024-09-12T01:29:36.863803+0000","last_undegraded":"2024-09-12T01:29:36.863803+0000","last_fullsized":"2024-09-12T01:29:36.863803+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-12T01:29:36.863688+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-12T01:29:36.863688+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.863688+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:49.117347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":708,"num_write":275,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'366","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.883191+0000","last_change":"2024-09-12T01:29:28.883191+0000","last_active":"2024-09-12T01:29:28.883191+0000","last_peered":"2024-09-12T01:29:28.883191+0000","last_clean":"2024-09-12T01:29:28.883191+0000","last_became_active":"2024-09-12T00:31:47.132735+0000","last_became_peered":"2024-09-12T00:31:47.132735+0000","last_unstale":"2024-09-12T01:29:28.883191+0000","last_undegraded":"2024-09-12T01:29:28.883191+0000","last_fullsized":"2024-09-12T01:29:28.883191+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T01:29:28.883090+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T01:29:28.883090+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.883090+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:41.785346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":462,"num_read_kb":13728,"num_write":961,"num_write_kb":25593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'130","reported_seq":731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501249+0000","last_change":"2024-09-12T00:31:50.139504+0000","last_active":"2024-09-12T01:26:17.501249+0000","last_peered":"2024-09-12T01:26:17.501249+0000","last_clean":"2024-09-12T01:26:17.501249+0000","last_became_active":"2024-09-12T00:31:50.138349+0000","last_became_peered":"2024-09-12T00:31:50.138349+0000","last_unstale":"2024-09-12T01:26:17.501249+0000","last_undegraded":"2024-09-12T01:26:17.501249+0000","last_fullsized":"2024-09-12T01:26:17.501249+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:43.103359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":530,"num_write":219,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'322","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.221519+0000","last_change":"2024-09-12T01:29:26.221519+0000","last_active":"2024-09-12T01:29:26.221519+0000","last_peered":"2024-09-12T01:29:26.221519+0000","last_clean":"2024-09-12T01:29:26.221519+0000","last_became_active":"2024-09-12T00:31:47.132959+0000","last_became_peered":"2024-09-12T00:31:47.132959+0000","last_unstale":"2024-09-12T01:29:26.221519+0000","last_undegraded":"2024-09-12T01:29:26.221519+0000","last_fullsized":"2024-09-12T01:29:26.221519+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T01:29:26.221423+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T01:29:26.221423+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.221423+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:43.791461+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170196,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":44221,"num_write":1049,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'150","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.124626+0000","last_change":"2024-09-12T01:29:31.124626+0000","last_active":"2024-09-12T01:29:31.124626+0000","last_peered":"2024-09-12T01:29:31.124626+0000","last_clean":"2024-09-12T01:29:31.124626+0000","last_became_active":"2024-09-12T00:31:50.130915+0000","last_became_peered":"2024-09-12T00:31:50.130915+0000","last_unstale":"2024-09-12T01:29:31.124626+0000","last_undegraded":"2024-09-12T01:29:31.124626+0000","last_fullsized":"2024-09-12T01:29:31.124626+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'150","last_scrub_stamp":"2024-09-12T01:29:31.124543+0000","last_deep_scrub":"265'150","last_deep_scrub_stamp":"2024-09-12T01:29:31.124543+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.124543+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:03.395062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":628,"num_read_kb":507,"num_write":231,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'336","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.142282+0000","last_change":"2024-09-12T01:29:29.142282+0000","last_active":"2024-09-12T01:29:29.142282+0000","last_peered":"2024-09-12T01:29:29.142282+0000","last_clean":"2024-09-12T01:29:29.142282+0000","last_became_active":"2024-09-12T00:31:47.122164+0000","last_became_peered":"2024-09-12T00:31:47.122164+0000","last_unstale":"2024-09-12T01:29:29.142282+0000","last_undegraded":"2024-09-12T01:29:29.142282+0000","last_fullsized":"2024-09-12T01:29:29.142282+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T01:29:29.142149+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T01:29:29.142149+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.142149+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:51.142516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170481,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":503,"num_read_kb":2267,"num_write":1137,"num_write_kb":17589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'295","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.116198+0000","last_change":"2024-09-12T01:29:38.116198+0000","last_active":"2024-09-12T01:29:38.116198+0000","last_peered":"2024-09-12T01:29:38.116198+0000","last_clean":"2024-09-12T01:29:38.116198+0000","last_became_active":"2024-09-12T00:31:50.142283+0000","last_became_peered":"2024-09-12T00:31:50.142283+0000","last_unstale":"2024-09-12T01:29:38.116198+0000","last_undegraded":"2024-09-12T01:29:38.116198+0000","last_fullsized":"2024-09-12T01:29:38.116198+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'295","last_scrub_stamp":"2024-09-12T01:29:38.116092+0000","last_deep_scrub":"265'295","last_deep_scrub_stamp":"2024-09-12T01:29:38.116092+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.116092+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:29.568062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1272,"num_read_kb":1039,"num_write":466,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'373","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.379186+0000","last_change":"2024-09-12T01:29:26.379186+0000","last_active":"2024-09-12T01:29:26.379186+0000","last_peered":"2024-09-12T01:29:26.379186+0000","last_clean":"2024-09-12T01:29:26.379186+0000","last_became_active":"2024-09-12T00:31:47.136789+0000","last_became_peered":"2024-09-12T00:31:47.136789+0000","last_unstale":"2024-09-12T01:29:26.379186+0000","last_undegraded":"2024-09-12T01:29:26.379186+0000","last_fullsized":"2024-09-12T01:29:26.379186+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T01:29:26.379032+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T01:29:26.379032+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.379032+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:10.288276+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":544,"num_read_kb":49646,"num_write":1113,"num_write_kb":37962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'130","reported_seq":756,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.439811+0000","last_change":"2024-09-12T01:29:27.439811+0000","last_active":"2024-09-12T01:29:27.439811+0000","last_peered":"2024-09-12T01:29:27.439811+0000","last_clean":"2024-09-12T01:29:27.439811+0000","last_became_active":"2024-09-12T00:31:50.140717+0000","last_became_peered":"2024-09-12T00:31:50.140717+0000","last_unstale":"2024-09-12T01:29:27.439811+0000","last_undegraded":"2024-09-12T01:29:27.439811+0000","last_fullsized":"2024-09-12T01:29:27.439811+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T01:29:27.439723+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T01:29:27.439723+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.439723+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:07.649578+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":623,"num_read_kb":519,"num_write":184,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4002,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'384","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.949714+0000","last_change":"2024-09-12T01:29:33.949714+0000","last_active":"2024-09-12T01:29:33.949714+0000","last_peered":"2024-09-12T01:29:33.949714+0000","last_clean":"2024-09-12T01:29:33.949714+0000","last_became_active":"2024-09-12T00:31:47.118928+0000","last_became_peered":"2024-09-12T00:31:47.118928+0000","last_unstale":"2024-09-12T01:29:33.949714+0000","last_undegraded":"2024-09-12T01:29:33.949714+0000","last_fullsized":"2024-09-12T01:29:33.949714+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-12T01:29:33.949597+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-12T01:29:33.949597+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.949597+0000","objects_scrubbed":9,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:44.543182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65022,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":549,"num_read_kb":12208,"num_write":1218,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'133","reported_seq":739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.621360+0000","last_change":"2024-09-12T01:29:33.621360+0000","last_active":"2024-09-12T01:29:33.621360+0000","last_peered":"2024-09-12T01:29:33.621360+0000","last_clean":"2024-09-12T01:29:33.621360+0000","last_became_active":"2024-09-12T00:31:50.137034+0000","last_became_peered":"2024-09-12T00:31:50.137034+0000","last_unstale":"2024-09-12T01:29:33.621360+0000","last_undegraded":"2024-09-12T01:29:33.621360+0000","last_fullsized":"2024-09-12T01:29:33.621360+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-12T01:29:33.621268+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-12T01:29:33.621268+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.621268+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:32.051275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":471,"num_write":187,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'394","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.042100+0000","last_change":"2024-09-12T01:29:34.042100+0000","last_active":"2024-09-12T01:29:34.042100+0000","last_peered":"2024-09-12T01:29:34.042100+0000","last_clean":"2024-09-12T01:29:34.042100+0000","last_became_active":"2024-09-12T00:31:47.119180+0000","last_became_peered":"2024-09-12T00:31:47.119180+0000","last_unstale":"2024-09-12T01:29:34.042100+0000","last_undegraded":"2024-09-12T01:29:34.042100+0000","last_fullsized":"2024-09-12T01:29:34.042100+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T01:29:34.041934+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T01:29:34.041934+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.041934+0000","objects_scrubbed":9,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:04.729277+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2793702,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":603,"num_read_kb":71015,"num_write":1325,"num_write_kb":54526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'230","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.091211+0000","last_change":"2024-09-12T01:29:30.091211+0000","last_active":"2024-09-12T01:29:30.091211+0000","last_peered":"2024-09-12T01:29:30.091211+0000","last_clean":"2024-09-12T01:29:30.091211+0000","last_became_active":"2024-09-12T00:31:50.132605+0000","last_became_peered":"2024-09-12T00:31:50.132605+0000","last_unstale":"2024-09-12T01:29:30.091211+0000","last_undegraded":"2024-09-12T01:29:30.091211+0000","last_fullsized":"2024-09-12T01:29:30.091211+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'230","last_scrub_stamp":"2024-09-12T01:29:30.091128+0000","last_deep_scrub":"265'230","last_deep_scrub_stamp":"2024-09-12T01:29:30.091128+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.091128+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:44.530559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":781,"num_write":348,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'337","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.914501+0000","last_change":"2024-09-12T01:29:29.914501+0000","last_active":"2024-09-12T01:29:29.914501+0000","last_peered":"2024-09-12T01:29:29.914501+0000","last_clean":"2024-09-12T01:29:29.914501+0000","last_became_active":"2024-09-12T00:31:47.131895+0000","last_became_peered":"2024-09-12T00:31:47.131895+0000","last_unstale":"2024-09-12T01:29:29.914501+0000","last_undegraded":"2024-09-12T01:29:29.914501+0000","last_fullsized":"2024-09-12T01:29:29.914501+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-12T01:29:29.914360+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-12T01:29:29.914360+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.914360+0000","objects_scrubbed":9,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:13.576149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":1443,"num_write":1105,"num_write_kb":20830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'184","reported_seq":814,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499443+0000","last_change":"2024-09-12T00:31:50.139015+0000","last_active":"2024-09-12T01:26:07.499443+0000","last_peered":"2024-09-12T01:26:07.499443+0000","last_clean":"2024-09-12T01:26:07.499443+0000","last_became_active":"2024-09-12T00:31:50.138649+0000","last_became_peered":"2024-09-12T00:31:50.138649+0000","last_unstale":"2024-09-12T01:26:07.499443+0000","last_undegraded":"2024-09-12T01:26:07.499443+0000","last_fullsized":"2024-09-12T01:26:07.499443+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:22.461723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":823,"num_read_kb":682,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'312","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.381837+0000","last_change":"2024-09-12T01:29:25.381837+0000","last_active":"2024-09-12T01:29:25.381837+0000","last_peered":"2024-09-12T01:29:25.381837+0000","last_clean":"2024-09-12T01:29:25.381837+0000","last_became_active":"2024-09-12T00:31:47.128598+0000","last_became_peered":"2024-09-12T00:31:47.128598+0000","last_unstale":"2024-09-12T01:29:25.381837+0000","last_undegraded":"2024-09-12T01:29:25.381837+0000","last_fullsized":"2024-09-12T01:29:25.381837+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T01:29:25.381685+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T01:29:25.381685+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.381685+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:02.770818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37912,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":412,"num_read_kb":69389,"num_write":1027,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'98","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.493434+0000","last_change":"2024-09-12T01:29:29.493434+0000","last_active":"2024-09-12T01:29:29.493434+0000","last_peered":"2024-09-12T01:29:29.493434+0000","last_clean":"2024-09-12T01:29:29.493434+0000","last_became_active":"2024-09-12T00:31:50.139830+0000","last_became_peered":"2024-09-12T00:31:50.139830+0000","last_unstale":"2024-09-12T01:29:29.493434+0000","last_undegraded":"2024-09-12T01:29:29.493434+0000","last_fullsized":"2024-09-12T01:29:29.493434+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'98","last_scrub_stamp":"2024-09-12T01:29:29.493346+0000","last_deep_scrub":"265'98","last_deep_scrub_stamp":"2024-09-12T01:29:29.493346+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.493346+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:43.481588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":425,"num_read_kb":351,"num_write":136,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'293","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.596190+0000","last_change":"2024-09-12T01:29:37.596190+0000","last_active":"2024-09-12T01:29:37.596190+0000","last_peered":"2024-09-12T01:29:37.596190+0000","last_clean":"2024-09-12T01:29:37.596190+0000","last_became_active":"2024-09-12T00:31:47.122486+0000","last_became_peered":"2024-09-12T00:31:47.122486+0000","last_unstale":"2024-09-12T01:29:37.596190+0000","last_undegraded":"2024-09-12T01:29:37.596190+0000","last_fullsized":"2024-09-12T01:29:37.596190+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'293","last_scrub_stamp":"2024-09-12T01:29:37.596061+0000","last_deep_scrub":"265'293","last_deep_scrub_stamp":"2024-09-12T01:29:37.596061+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.596061+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:50.615903+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6842428,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":24154,"num_write":874,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'114","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.388319+0000","last_change":"2024-09-12T01:29:32.388319+0000","last_active":"2024-09-12T01:29:32.388319+0000","last_peered":"2024-09-12T01:29:32.388319+0000","last_clean":"2024-09-12T01:29:32.388319+0000","last_became_active":"2024-09-12T00:31:50.139416+0000","last_became_peered":"2024-09-12T00:31:50.139416+0000","last_unstale":"2024-09-12T01:29:32.388319+0000","last_undegraded":"2024-09-12T01:29:32.388319+0000","last_fullsized":"2024-09-12T01:29:32.388319+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'114","last_scrub_stamp":"2024-09-12T01:29:32.388231+0000","last_deep_scrub":"265'114","last_deep_scrub_stamp":"2024-09-12T01:29:32.388231+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.388231+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:16.247658+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":414,"num_write":177,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'362","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.974781+0000","last_change":"2024-09-12T01:29:23.974781+0000","last_active":"2024-09-12T01:29:23.974781+0000","last_peered":"2024-09-12T01:29:23.974781+0000","last_clean":"2024-09-12T01:29:23.974781+0000","last_became_active":"2024-09-12T00:31:47.130353+0000","last_became_peered":"2024-09-12T00:31:47.130353+0000","last_unstale":"2024-09-12T01:29:23.974781+0000","last_undegraded":"2024-09-12T01:29:23.974781+0000","last_fullsized":"2024-09-12T01:29:23.974781+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T01:29:23.974688+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T01:29:23.974688+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.974688+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:26.306312+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288069,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":8753,"num_write":1192,"num_write_kb":21611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'161","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.572299+0000","last_change":"2024-09-12T01:29:32.572299+0000","last_active":"2024-09-12T01:29:32.572299+0000","last_peered":"2024-09-12T01:29:32.572299+0000","last_clean":"2024-09-12T01:29:32.572299+0000","last_became_active":"2024-09-12T00:31:50.140705+0000","last_became_peered":"2024-09-12T00:31:50.140705+0000","last_unstale":"2024-09-12T01:29:32.572299+0000","last_undegraded":"2024-09-12T01:29:32.572299+0000","last_fullsized":"2024-09-12T01:29:32.572299+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'161","last_scrub_stamp":"2024-09-12T01:29:32.572201+0000","last_deep_scrub":"265'161","last_deep_scrub_stamp":"2024-09-12T01:29:32.572201+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.572201+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:57.054566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":620,"num_write":277,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'387","reported_seq":1113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.059874+0000","last_change":"2024-09-12T01:29:32.059874+0000","last_active":"2024-09-12T01:29:32.059874+0000","last_peered":"2024-09-12T01:29:32.059874+0000","last_clean":"2024-09-12T01:29:32.059874+0000","last_became_active":"2024-09-12T00:31:47.120303+0000","last_became_peered":"2024-09-12T00:31:47.120303+0000","last_unstale":"2024-09-12T01:29:32.059874+0000","last_undegraded":"2024-09-12T01:29:32.059874+0000","last_fullsized":"2024-09-12T01:29:32.059874+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T01:29:32.059734+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T01:29:32.059734+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.059734+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:18.350675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493090,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":704,"num_read_kb":61137,"num_write":1132,"num_write_kb":48224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'210","reported_seq":864,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.613124+0000","last_change":"2024-09-12T01:29:33.613124+0000","last_active":"2024-09-12T01:29:33.613124+0000","last_peered":"2024-09-12T01:29:33.613124+0000","last_clean":"2024-09-12T01:29:33.613124+0000","last_became_active":"2024-09-12T00:31:50.133698+0000","last_became_peered":"2024-09-12T00:31:50.133698+0000","last_unstale":"2024-09-12T01:29:33.613124+0000","last_undegraded":"2024-09-12T01:29:33.613124+0000","last_fullsized":"2024-09-12T01:29:33.613124+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'210","last_scrub_stamp":"2024-09-12T01:29:33.613015+0000","last_deep_scrub":"265'210","last_deep_scrub_stamp":"2024-09-12T01:29:33.613015+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.613015+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:38.489746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":883,"num_write":372,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'279","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.574293+0000","last_change":"2024-09-12T01:29:26.574293+0000","last_active":"2024-09-12T01:29:26.574293+0000","last_peered":"2024-09-12T01:29:26.574293+0000","last_clean":"2024-09-12T01:29:26.574293+0000","last_became_active":"2024-09-12T00:31:47.117753+0000","last_became_peered":"2024-09-12T00:31:47.117753+0000","last_unstale":"2024-09-12T01:29:26.574293+0000","last_undegraded":"2024-09-12T01:29:26.574293+0000","last_fullsized":"2024-09-12T01:29:26.574293+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'279","last_scrub_stamp":"2024-09-12T01:29:26.574140+0000","last_deep_scrub":"265'279","last_deep_scrub_stamp":"2024-09-12T01:29:26.574140+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.574140+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:19.980823+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":578,"num_read_kb":553,"num_write":1003,"num_write_kb":11415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'4099","reported_seq":4707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.486832+0000","last_change":"2024-09-12T01:29:28.486832+0000","last_active":"2024-09-12T01:29:28.486832+0000","last_peered":"2024-09-12T01:29:28.486832+0000","last_clean":"2024-09-12T01:29:28.486832+0000","last_became_active":"2024-09-12T00:31:50.144782+0000","last_became_peered":"2024-09-12T00:31:50.144782+0000","last_unstale":"2024-09-12T01:29:28.486832+0000","last_undegraded":"2024-09-12T01:29:28.486832+0000","last_fullsized":"2024-09-12T01:29:28.486832+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4099","last_scrub_stamp":"2024-09-12T01:29:28.486734+0000","last_deep_scrub":"265'4099","last_deep_scrub_stamp":"2024-09-12T01:29:28.486734+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.486734+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:27.424046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16473,"num_read_kb":13736,"num_write":6146,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'355","reported_seq":1119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.168523+0000","last_change":"2024-09-12T01:29:28.168523+0000","last_active":"2024-09-12T01:29:28.168523+0000","last_peered":"2024-09-12T01:29:28.168523+0000","last_clean":"2024-09-12T01:29:28.168523+0000","last_became_active":"2024-09-12T00:32:23.828547+0000","last_became_peered":"2024-09-12T00:32:23.828547+0000","last_unstale":"2024-09-12T01:29:28.168523+0000","last_undegraded":"2024-09-12T01:29:28.168523+0000","last_fullsized":"2024-09-12T01:29:28.168523+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T01:29:28.168363+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T01:29:28.168363+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.168363+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:07.014208+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2792674,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":658,"num_read_kb":184067,"num_write":1127,"num_write_kb":52781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"265'313","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.068584+0000","last_change":"2024-09-12T01:29:35.068584+0000","last_active":"2024-09-12T01:29:35.068584+0000","last_peered":"2024-09-12T01:29:35.068584+0000","last_clean":"2024-09-12T01:29:35.068584+0000","last_became_active":"2024-09-12T00:31:47.123083+0000","last_became_peered":"2024-09-12T00:31:47.123083+0000","last_unstale":"2024-09-12T01:29:35.068584+0000","last_undegraded":"2024-09-12T01:29:35.068584+0000","last_fullsized":"2024-09-12T01:29:35.068584+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'313","last_scrub_stamp":"2024-09-12T01:29:35.068428+0000","last_deep_scrub":"265'313","last_deep_scrub_stamp":"2024-09-12T01:29:35.068428+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.068428+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:18.821874+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1292330,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":432,"num_read_kb":16599,"num_write":993,"num_write_kb":37945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'178","reported_seq":753,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:18.494115+0000","last_change":"2024-09-12T00:31:50.145133+0000","last_active":"2024-09-12T01:25:18.494115+0000","last_peered":"2024-09-12T01:25:18.494115+0000","last_clean":"2024-09-12T01:25:18.494115+0000","last_became_active":"2024-09-12T00:31:50.144850+0000","last_became_peered":"2024-09-12T00:31:50.144850+0000","last_unstale":"2024-09-12T01:25:18.494115+0000","last_undegraded":"2024-09-12T01:25:18.494115+0000","last_fullsized":"2024-09-12T01:25:18.494115+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:49.105980+0000","last_clean_scrub_stamp":"2024-09-12T00:31:49.105980+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:11.930581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":724,"num_read_kb":585,"num_write":260,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'386","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.920017+0000","last_change":"2024-09-12T01:29:31.920017+0000","last_active":"2024-09-12T01:29:31.920017+0000","last_peered":"2024-09-12T01:29:31.920017+0000","last_clean":"2024-09-12T01:29:31.920017+0000","last_became_active":"2024-09-12T00:31:47.132149+0000","last_became_peered":"2024-09-12T00:31:47.132149+0000","last_unstale":"2024-09-12T01:29:31.920017+0000","last_undegraded":"2024-09-12T01:29:31.920017+0000","last_fullsized":"2024-09-12T01:29:31.920017+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T01:29:31.919888+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T01:29:31.919888+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.919888+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:51.126649+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":304,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":582,"num_read_kb":13776,"num_write":1287,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'127","reported_seq":758,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.480631+0000","last_change":"2024-09-12T01:29:34.480631+0000","last_active":"2024-09-12T01:29:34.480631+0000","last_peered":"2024-09-12T01:29:34.480631+0000","last_clean":"2024-09-12T01:29:34.480631+0000","last_became_active":"2024-09-12T00:31:50.137283+0000","last_became_peered":"2024-09-12T00:31:50.137283+0000","last_unstale":"2024-09-12T01:29:34.480631+0000","last_undegraded":"2024-09-12T01:29:34.480631+0000","last_fullsized":"2024-09-12T01:29:34.480631+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-12T01:29:34.480529+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-12T01:29:34.480529+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.480529+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:46.725574+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":583,"num_read_kb":491,"num_write":192,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5593,"num_read_kb":3949,"num_write":1897,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1068,"ondisk_log_size":1068,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15046,"num_read_kb":14700,"num_write":16713,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1460,"ondisk_log_size":1460,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":584,"ondisk_log_size":584,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1527208,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":18236,"num_read_kb":37365,"num_write":15267,"num_write_kb":11724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":509320,"num_omap_keys":1174,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1862,"ondisk_log_size":1862,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102878,"num_read_kb":85467,"num_write":37260,"num_write_kb":18832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36212,"num_omap_keys":147,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3674,"ondisk_log_size":3674,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":78246710,"num_objects":378,"num_object_clones":0,"num_object_copies":1134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":378,"num_whiteouts":0,"num_read":36067,"num_read_kb":1971130,"num_write":71284,"num_write_kb":2047906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":119279616,"data_stored":119279616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3444,"ondisk_log_size":3444,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":176023,"num_write":154,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":175285,"num_write":154,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477440,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":221612,"kb_used_data":15580,"kb_used_omap":1,"kb_used_meta":206014,"kb_avail":94150228,"statfs":{"total":96636764160,"available":96409833472,"internally_reserved":0,"allocated":15953920,"data_stored":13969939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":210958794},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719477439,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111876,"kb_used_data":18292,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94259964,"statfs":{"total":96636764160,"available":96522203136,"internally_reserved":0,"allocated":18731008,"data_stored":16734053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95812038},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510145,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259868,"kb_used_data":21836,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94111972,"statfs":{"total":96636764160,"available":96370659328,"internally_reserved":0,"allocated":22360064,"data_stored":20343157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":243726791},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510144,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152736,"kb_used_data":27152,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94219104,"statfs":{"total":96636764160,"available":96480362496,"internally_reserved":0,"allocated":27803648,"data_stored":25815269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510144,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":10116,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":10358784,"data_stored":8346083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510142,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":120000,"kb_used_data":16624,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94251840,"statfs":{"total":96636764160,"available":96513884160,"internally_reserved":0,"allocated":17022976,"data_stored":15000873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542845,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":206080,"kb_used_data":22256,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94165760,"statfs":{"total":96636764160,"available":96425738240,"internally_reserved":0,"allocated":22790144,"data_stored":20790314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575550,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":270692,"kb_used_data":18836,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94101148,"statfs":{"total":96636764160,"available":96359575552,"internally_reserved":0,"allocated":19288064,"data_stored":17276630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12771328,"data_stored":12771328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5529600,"data_stored":5529600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23588864,"data_stored":23588864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18116608,"data_stored":18116608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18563072,"data_stored":18563072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14458880,"data_stored":14458880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14508032,"data_stored":14508032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11743232,"data_stored":11743232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:29:43.858 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.858 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.858 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.858 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.858 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.858 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.858 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.858 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.859 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.859 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.859 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.859 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.859 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.859 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.859 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.859 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.860 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.860 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.860 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.860 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.860 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.860 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.860 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.860 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.861 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.861 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.861 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.861 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.861 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.861 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.861 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.861 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.861 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.862 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.862 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.862 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.862 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.862 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.862 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.862 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.862 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.862 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.863 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.863 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.863 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.863 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.863 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.863 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.863 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.863 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.863 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.864 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.864 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.864 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.864 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.864 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.864 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.864 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.864 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.864 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.865 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.865 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.865 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.865 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.865 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.865 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.865 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.865 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.865 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.866 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.866 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.866 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.866 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.866 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.866 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.866 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.866 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.866 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.867 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.867 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.867 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.867 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.867 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.867 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.867 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.867 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.867 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.867 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.868 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.868 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.868 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.868 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.868 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.868 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.868 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.868 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.869 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.869 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.869 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.869 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.869 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.869 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.869 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.869 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.869 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.870 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.870 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.870 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.870 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.870 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.870 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.870 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.870 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.870 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.871 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.871 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.871 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.871 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.871 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.871 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.872 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.872 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.872 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.872 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.872 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.872 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.872 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.872 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.873 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.873 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.873 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.873 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.873 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.873 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.874 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.874 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.874 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.874 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.874 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.874 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.874 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.874 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.874 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.875 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.875 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.875 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.875 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.875 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.875 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.875 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.875 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.876 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.876 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.876 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.876 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.876 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.876 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.876 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.876 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.877 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.877 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.877 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.877 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.877 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.877 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.877 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.877 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.878 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.878 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.878 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.878 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.878 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.878 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.878 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.878 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.879 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.879 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.879 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.879 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.879 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.879 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.879 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.879 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.880 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.880 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.880 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.880 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.880 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.880 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.880 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.881 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.881 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.881 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.881 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.881 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.881 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.881 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.881 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.882 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.882 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.882 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.882 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.882 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.882 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.882 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.882 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.883 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.883 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.883 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.883 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.883 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.883 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.883 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.883 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.883 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.884 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.884 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.884 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.884 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.884 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.884 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.884 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.884 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.885 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.885 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.885 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.885 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.885 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.885 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.885 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.885 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.886 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.886 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.886 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.886 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.886 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.888 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.888 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.888 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.888 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.888 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:31:51.126613+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=51, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.888 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:31:53.144953+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=53, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.888 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.889 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.889 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.889 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.889 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.889 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:31:49.105980+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=49, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:29:43.890 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:30:03.891 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:30:04.248 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:30:04.260 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T01:30:04.264 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":2016,"stamp":"2024-09-12T01:30:03.869627+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80381543,"num_objects":728,"num_object_clones":0,"num_object_copies":1834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":180567,"num_read_kb":2466850,"num_write":142872,"num_write_kb":2319609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":726621,"num_omap_keys":1772,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12322,"ondisk_log_size":12322,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1645156,"kb_used_data":150692,"kb_used_omap":12,"kb_used_meta":1494323,"kb_avail":753329564,"statfs":{"total":773094113280,"available":771409473536,"internally_reserved":0,"allocated":154308608,"data_stored":138276318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1530187312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":129285,"num_omap_keys":322,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005735"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.061738+0000","last_change":"2024-09-12T01:29:57.061738+0000","last_active":"2024-09-12T01:29:57.061738+0000","last_peered":"2024-09-12T01:29:57.061738+0000","last_clean":"2024-09-12T01:29:57.061738+0000","last_became_active":"2024-09-12T01:04:13.467533+0000","last_became_peered":"2024-09-12T01:04:13.467533+0000","last_unstale":"2024-09-12T01:29:57.061738+0000","last_undegraded":"2024-09-12T01:29:57.061738+0000","last_fullsized":"2024-09-12T01:29:57.061738+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:57.061646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:57.061646+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.061646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:41.958626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.687343+0000","last_change":"2024-09-12T01:29:54.687343+0000","last_active":"2024-09-12T01:29:54.687343+0000","last_peered":"2024-09-12T01:29:54.687343+0000","last_clean":"2024-09-12T01:29:54.687343+0000","last_became_active":"2024-09-12T00:48:45.303088+0000","last_became_peered":"2024-09-12T00:48:45.303088+0000","last_unstale":"2024-09-12T01:29:54.687343+0000","last_undegraded":"2024-09-12T01:29:54.687343+0000","last_fullsized":"2024-09-12T01:29:54.687343+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:54.687250+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:54.687250+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.687250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:44.841379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"262'3","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.784398+0000","last_change":"2024-09-12T00:48:42.290755+0000","last_active":"2024-09-12T01:26:15.784398+0000","last_peered":"2024-09-12T01:26:15.784398+0000","last_clean":"2024-09-12T01:26:15.784398+0000","last_became_active":"2024-09-12T00:48:42.290471+0000","last_became_peered":"2024-09-12T00:48:42.290471+0000","last_unstale":"2024-09-12T01:26:15.784398+0000","last_undegraded":"2024-09-12T01:26:15.784398+0000","last_fullsized":"2024-09-12T01:26:15.784398+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:55.297347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'15","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:01.569626+0000","last_change":"2024-09-12T01:30:01.569626+0000","last_active":"2024-09-12T01:30:01.569626+0000","last_peered":"2024-09-12T01:30:01.569626+0000","last_clean":"2024-09-12T01:30:01.569626+0000","last_became_active":"2024-09-12T00:46:03.918235+0000","last_became_peered":"2024-09-12T00:46:03.918235+0000","last_unstale":"2024-09-12T01:30:01.569626+0000","last_undegraded":"2024-09-12T01:30:01.569626+0000","last_fullsized":"2024-09-12T01:30:01.569626+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'15","last_scrub_stamp":"2024-09-12T01:30:01.569539+0000","last_deep_scrub":"265'15","last_deep_scrub_stamp":"2024-09-12T01:30:01.569539+0000","last_clean_scrub_stamp":"2024-09-12T01:30:01.569539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:20.877189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":51,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.643708+0000","last_change":"2024-09-12T01:04:13.463924+0000","last_active":"2024-09-12T01:26:45.643708+0000","last_peered":"2024-09-12T01:26:45.643708+0000","last_clean":"2024-09-12T01:26:45.643708+0000","last_became_active":"2024-09-12T01:04:13.463645+0000","last_became_peered":"2024-09-12T01:04:13.463645+0000","last_unstale":"2024-09-12T01:26:45.643708+0000","last_undegraded":"2024-09-12T01:26:45.643708+0000","last_fullsized":"2024-09-12T01:26:45.643708+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:54.509681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.469854+0000","last_change":"2024-09-12T01:29:59.469854+0000","last_active":"2024-09-12T01:29:59.469854+0000","last_peered":"2024-09-12T01:29:59.469854+0000","last_clean":"2024-09-12T01:29:59.469854+0000","last_became_active":"2024-09-12T00:48:45.307070+0000","last_became_peered":"2024-09-12T00:48:45.307070+0000","last_unstale":"2024-09-12T01:29:59.469854+0000","last_undegraded":"2024-09-12T01:29:59.469854+0000","last_fullsized":"2024-09-12T01:29:59.469854+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:29:59.469749+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:29:59.469749+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.469749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:28.682849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"262'3","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:12.500496+0000","last_change":"2024-09-12T00:48:42.297130+0000","last_active":"2024-09-12T01:26:12.500496+0000","last_peered":"2024-09-12T01:26:12.500496+0000","last_clean":"2024-09-12T01:26:12.500496+0000","last_became_active":"2024-09-12T00:48:42.296820+0000","last_became_peered":"2024-09-12T00:48:42.296820+0000","last_unstale":"2024-09-12T01:26:12.500496+0000","last_undegraded":"2024-09-12T01:26:12.500496+0000","last_fullsized":"2024-09-12T01:26:12.500496+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:03.334198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'17","reported_seq":106,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:02.558173+0000","last_change":"2024-09-12T01:30:02.558173+0000","last_active":"2024-09-12T01:30:02.558173+0000","last_peered":"2024-09-12T01:30:02.558173+0000","last_clean":"2024-09-12T01:30:02.558173+0000","last_became_active":"2024-09-12T00:46:03.919803+0000","last_became_peered":"2024-09-12T00:46:03.919803+0000","last_unstale":"2024-09-12T01:30:02.558173+0000","last_undegraded":"2024-09-12T01:30:02.558173+0000","last_fullsized":"2024-09-12T01:30:02.558173+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-12T01:30:02.558090+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-12T01:30:02.558090+0000","last_clean_scrub_stamp":"2024-09-12T01:30:02.558090+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:35.023715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":60,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:59.605056+0000","last_change":"2024-09-12T01:04:13.470732+0000","last_active":"2024-09-12T01:25:59.605056+0000","last_peered":"2024-09-12T01:25:59.605056+0000","last_clean":"2024-09-12T01:25:59.605056+0000","last_became_active":"2024-09-12T01:04:13.470465+0000","last_became_peered":"2024-09-12T01:04:13.470465+0000","last_unstale":"2024-09-12T01:25:59.605056+0000","last_undegraded":"2024-09-12T01:25:59.605056+0000","last_fullsized":"2024-09-12T01:25:59.605056+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:03.442325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'8","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:22.520613+0000","last_change":"2024-09-12T00:48:45.318707+0000","last_active":"2024-09-12T01:28:22.520613+0000","last_peered":"2024-09-12T01:28:22.520613+0000","last_clean":"2024-09-12T01:28:22.520613+0000","last_became_active":"2024-09-12T00:48:45.318423+0000","last_became_peered":"2024-09-12T00:48:45.318423+0000","last_unstale":"2024-09-12T01:28:22.520613+0000","last_undegraded":"2024-09-12T01:28:22.520613+0000","last_fullsized":"2024-09-12T01:28:22.520613+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:08:02.110177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4098,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'3","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.663659+0000","last_change":"2024-09-12T01:30:00.663659+0000","last_active":"2024-09-12T01:30:00.663659+0000","last_peered":"2024-09-12T01:30:00.663659+0000","last_clean":"2024-09-12T01:30:00.663659+0000","last_became_active":"2024-09-12T00:48:42.292607+0000","last_became_peered":"2024-09-12T00:48:42.292607+0000","last_unstale":"2024-09-12T01:30:00.663659+0000","last_undegraded":"2024-09-12T01:30:00.663659+0000","last_fullsized":"2024-09-12T01:30:00.663659+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:30:00.663563+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:30:00.663563+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.663563+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:48.079407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'33","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.084808+0000","last_change":"2024-09-12T01:29:59.084808+0000","last_active":"2024-09-12T01:29:59.084808+0000","last_peered":"2024-09-12T01:29:59.084808+0000","last_clean":"2024-09-12T01:29:59.084808+0000","last_became_active":"2024-09-12T00:46:03.918204+0000","last_became_peered":"2024-09-12T00:46:03.918204+0000","last_unstale":"2024-09-12T01:29:59.084808+0000","last_undegraded":"2024-09-12T01:29:59.084808+0000","last_fullsized":"2024-09-12T01:29:59.084808+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-12T01:29:59.084722+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-12T01:29:59.084722+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.084722+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:25.176184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":133,"num_write":46,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499343+0000","last_change":"2024-09-12T01:04:13.465355+0000","last_active":"2024-09-12T01:26:07.499343+0000","last_peered":"2024-09-12T01:26:07.499343+0000","last_clean":"2024-09-12T01:26:07.499343+0000","last_became_active":"2024-09-12T01:04:13.465081+0000","last_became_peered":"2024-09-12T01:04:13.465081+0000","last_unstale":"2024-09-12T01:26:07.499343+0000","last_undegraded":"2024-09-12T01:26:07.499343+0000","last_fullsized":"2024-09-12T01:26:07.499343+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:11.393872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":39,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:57.507200+0000","last_change":"2024-09-12T00:48:45.315792+0000","last_active":"2024-09-12T01:26:57.507200+0000","last_peered":"2024-09-12T01:26:57.507200+0000","last_clean":"2024-09-12T01:26:57.507200+0000","last_became_active":"2024-09-12T00:48:45.314837+0000","last_became_peered":"2024-09-12T00:48:45.314837+0000","last_unstale":"2024-09-12T01:26:57.507200+0000","last_undegraded":"2024-09-12T01:26:57.507200+0000","last_fullsized":"2024-09-12T01:26:57.507200+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:45.469413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'10","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.692252+0000","last_change":"2024-09-12T01:29:56.692252+0000","last_active":"2024-09-12T01:29:56.692252+0000","last_peered":"2024-09-12T01:29:56.692252+0000","last_clean":"2024-09-12T01:29:56.692252+0000","last_became_active":"2024-09-12T00:48:42.290570+0000","last_became_peered":"2024-09-12T00:48:42.290570+0000","last_unstale":"2024-09-12T01:29:56.692252+0000","last_undegraded":"2024-09-12T01:29:56.692252+0000","last_fullsized":"2024-09-12T01:29:56.692252+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:29:56.692158+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:29:56.692158+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.692158+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:06.893219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":15,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'58","reported_seq":254,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.122726+0000","last_change":"2024-09-12T01:30:00.122726+0000","last_active":"2024-09-12T01:30:00.122726+0000","last_peered":"2024-09-12T01:30:00.122726+0000","last_clean":"2024-09-12T01:30:00.122726+0000","last_became_active":"2024-09-12T00:46:03.912603+0000","last_became_peered":"2024-09-12T00:46:03.912603+0000","last_unstale":"2024-09-12T01:30:00.122726+0000","last_undegraded":"2024-09-12T01:30:00.122726+0000","last_fullsized":"2024-09-12T01:30:00.122726+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'58","last_scrub_stamp":"2024-09-12T01:30:00.122637+0000","last_deep_scrub":"265'58","last_deep_scrub_stamp":"2024-09-12T01:30:00.122637+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.122637+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:26.770381+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":263,"num_write":69,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3960,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:20.785335+0000","last_change":"2024-09-12T01:04:13.459054+0000","last_active":"2024-09-12T01:26:20.785335+0000","last_peered":"2024-09-12T01:26:20.785335+0000","last_clean":"2024-09-12T01:26:20.785335+0000","last_became_active":"2024-09-12T01:04:13.458781+0000","last_became_peered":"2024-09-12T01:04:13.458781+0000","last_unstale":"2024-09-12T01:26:20.785335+0000","last_undegraded":"2024-09-12T01:26:20.785335+0000","last_fullsized":"2024-09-12T01:26:20.785335+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:22.643443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'5","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.110598+0000","last_change":"2024-09-12T01:29:52.110533+0000","last_active":"2024-09-12T01:29:52.110598+0000","last_peered":"2024-09-12T01:29:52.110598+0000","last_clean":"2024-09-12T01:29:52.110598+0000","last_became_active":"2024-09-12T00:48:45.318608+0000","last_became_peered":"2024-09-12T00:48:45.318608+0000","last_unstale":"2024-09-12T01:29:52.110598+0000","last_undegraded":"2024-09-12T01:29:52.110598+0000","last_fullsized":"2024-09-12T01:29:52.110598+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:29:52.110441+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:29:52.110441+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.110441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:57.965213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"265'11","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.166809+0000","last_change":"2024-09-12T00:48:42.298222+0000","last_active":"2024-09-12T01:29:15.166809+0000","last_peered":"2024-09-12T01:29:15.166809+0000","last_clean":"2024-09-12T01:29:15.166809+0000","last_became_active":"2024-09-12T00:48:42.297952+0000","last_became_peered":"2024-09-12T00:48:42.297952+0000","last_unstale":"2024-09-12T01:29:15.166809+0000","last_undegraded":"2024-09-12T01:29:15.166809+0000","last_fullsized":"2024-09-12T01:29:15.166809+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16432,"num_write":11,"num_write_kb":16432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'28","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.115939+0000","last_change":"2024-09-12T01:29:58.115939+0000","last_active":"2024-09-12T01:29:58.115939+0000","last_peered":"2024-09-12T01:29:58.115939+0000","last_clean":"2024-09-12T01:29:58.115939+0000","last_became_active":"2024-09-12T00:46:03.915917+0000","last_became_peered":"2024-09-12T00:46:03.915917+0000","last_unstale":"2024-09-12T01:29:58.115939+0000","last_undegraded":"2024-09-12T01:29:58.115939+0000","last_fullsized":"2024-09-12T01:29:58.115939+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'28","last_scrub_stamp":"2024-09-12T01:29:58.115806+0000","last_deep_scrub":"265'28","last_deep_scrub_stamp":"2024-09-12T01:29:58.115806+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.115806+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:42.369063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:08.509445+0000","last_change":"2024-09-12T01:04:13.465500+0000","last_active":"2024-09-12T01:27:08.509445+0000","last_peered":"2024-09-12T01:27:08.509445+0000","last_clean":"2024-09-12T01:27:08.509445+0000","last_became_active":"2024-09-12T01:04:13.465173+0000","last_became_peered":"2024-09-12T01:04:13.465173+0000","last_unstale":"2024-09-12T01:27:08.509445+0000","last_undegraded":"2024-09-12T01:27:08.509445+0000","last_fullsized":"2024-09-12T01:27:08.509445+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:43.615029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.109029+0000","last_change":"2024-09-12T00:48:45.314920+0000","last_active":"2024-09-12T01:29:15.109029+0000","last_peered":"2024-09-12T01:29:15.109029+0000","last_clean":"2024-09-12T01:29:15.109029+0000","last_became_active":"2024-09-12T00:48:45.313443+0000","last_became_peered":"2024-09-12T00:48:45.313443+0000","last_unstale":"2024-09-12T01:29:15.109029+0000","last_undegraded":"2024-09-12T01:29:15.109029+0000","last_fullsized":"2024-09-12T01:29:15.109029+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'7","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.830606+0000","last_change":"2024-09-12T00:48:42.293510+0000","last_active":"2024-09-12T01:29:15.830606+0000","last_peered":"2024-09-12T01:29:15.830606+0000","last_clean":"2024-09-12T01:29:15.830606+0000","last_became_active":"2024-09-12T00:48:42.293128+0000","last_became_peered":"2024-09-12T00:48:42.293128+0000","last_unstale":"2024-09-12T01:29:15.830606+0000","last_undegraded":"2024-09-12T01:29:15.830606+0000","last_fullsized":"2024-09-12T01:29:15.830606+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":20530,"num_write":7,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'40","reported_seq":165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.491716+0000","last_change":"2024-09-12T01:29:58.491716+0000","last_active":"2024-09-12T01:29:58.491716+0000","last_peered":"2024-09-12T01:29:58.491716+0000","last_clean":"2024-09-12T01:29:58.491716+0000","last_became_active":"2024-09-12T00:46:03.923029+0000","last_became_peered":"2024-09-12T00:46:03.923029+0000","last_unstale":"2024-09-12T01:29:58.491716+0000","last_undegraded":"2024-09-12T01:29:58.491716+0000","last_fullsized":"2024-09-12T01:29:58.491716+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'40","last_scrub_stamp":"2024-09-12T01:29:58.491625+0000","last_deep_scrub":"265'40","last_deep_scrub_stamp":"2024-09-12T01:29:58.491625+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.491625+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:09.588985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":145,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:44.508900+0000","last_change":"2024-09-12T01:04:13.472265+0000","last_active":"2024-09-12T01:26:44.508900+0000","last_peered":"2024-09-12T01:26:44.508900+0000","last_clean":"2024-09-12T01:26:44.508900+0000","last_became_active":"2024-09-12T01:04:13.468832+0000","last_became_peered":"2024-09-12T01:04:13.468832+0000","last_unstale":"2024-09-12T01:26:44.508900+0000","last_undegraded":"2024-09-12T01:26:44.508900+0000","last_fullsized":"2024-09-12T01:26:44.508900+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:39.832023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505982+0000","last_change":"2024-09-12T00:48:45.309486+0000","last_active":"2024-09-12T01:26:14.505982+0000","last_peered":"2024-09-12T01:26:14.505982+0000","last_clean":"2024-09-12T01:26:14.505982+0000","last_became_active":"2024-09-12T00:48:45.309166+0000","last_became_peered":"2024-09-12T00:48:45.309166+0000","last_unstale":"2024-09-12T01:26:14.505982+0000","last_undegraded":"2024-09-12T01:26:14.505982+0000","last_fullsized":"2024-09-12T01:26:14.505982+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:58.753867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.135129+0000","last_change":"2024-09-12T01:29:49.135129+0000","last_active":"2024-09-12T01:29:49.135129+0000","last_peered":"2024-09-12T01:29:49.135129+0000","last_clean":"2024-09-12T01:29:49.135129+0000","last_became_active":"2024-09-12T00:48:42.291800+0000","last_became_peered":"2024-09-12T00:48:42.291800+0000","last_unstale":"2024-09-12T01:29:49.135129+0000","last_undegraded":"2024-09-12T01:29:49.135129+0000","last_fullsized":"2024-09-12T01:29:49.135129+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:49.135008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:49.135008+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.135008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:55.800469+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'17","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.623046+0000","last_change":"2024-09-12T01:29:54.623046+0000","last_active":"2024-09-12T01:29:54.623046+0000","last_peered":"2024-09-12T01:29:54.623046+0000","last_clean":"2024-09-12T01:29:54.623046+0000","last_became_active":"2024-09-12T00:46:03.913667+0000","last_became_peered":"2024-09-12T00:46:03.913667+0000","last_unstale":"2024-09-12T01:29:54.623046+0000","last_undegraded":"2024-09-12T01:29:54.623046+0000","last_fullsized":"2024-09-12T01:29:54.623046+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-12T01:29:54.622956+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-12T01:29:54.622956+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.622956+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:21.226949+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":62,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.079993+0000","last_change":"2024-09-12T01:29:58.079993+0000","last_active":"2024-09-12T01:29:58.079993+0000","last_peered":"2024-09-12T01:29:58.079993+0000","last_clean":"2024-09-12T01:29:58.079993+0000","last_became_active":"2024-09-12T01:04:13.462605+0000","last_became_peered":"2024-09-12T01:04:13.462605+0000","last_unstale":"2024-09-12T01:29:58.079993+0000","last_undegraded":"2024-09-12T01:29:58.079993+0000","last_fullsized":"2024-09-12T01:29:58.079993+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:58.079892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:58.079892+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.079892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:28.907381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:45.807311+0000","last_change":"2024-09-12T00:48:45.314426+0000","last_active":"2024-09-12T01:28:45.807311+0000","last_peered":"2024-09-12T01:28:45.807311+0000","last_clean":"2024-09-12T01:28:45.807311+0000","last_became_active":"2024-09-12T00:48:45.314128+0000","last_became_peered":"2024-09-12T00:48:45.314128+0000","last_unstale":"2024-09-12T01:28:45.807311+0000","last_undegraded":"2024-09-12T01:28:45.807311+0000","last_fullsized":"2024-09-12T01:28:45.807311+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:59.972595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639662+0000","last_change":"2024-09-12T00:48:42.296184+0000","last_active":"2024-09-12T01:26:15.639662+0000","last_peered":"2024-09-12T01:26:15.639662+0000","last_clean":"2024-09-12T01:26:15.639662+0000","last_became_active":"2024-09-12T00:48:42.295886+0000","last_became_peered":"2024-09-12T00:48:42.295886+0000","last_unstale":"2024-09-12T01:26:15.639662+0000","last_undegraded":"2024-09-12T01:26:15.639662+0000","last_fullsized":"2024-09-12T01:26:15.639662+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:20.846127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'14","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.073624+0000","last_change":"2024-09-12T01:29:57.073624+0000","last_active":"2024-09-12T01:29:57.073624+0000","last_peered":"2024-09-12T01:29:57.073624+0000","last_clean":"2024-09-12T01:29:57.073624+0000","last_became_active":"2024-09-12T00:46:03.919334+0000","last_became_peered":"2024-09-12T00:46:03.919334+0000","last_unstale":"2024-09-12T01:29:57.073624+0000","last_undegraded":"2024-09-12T01:29:57.073624+0000","last_fullsized":"2024-09-12T01:29:57.073624+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T01:29:57.073537+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T01:29:57.073537+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.073537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:15.408952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:37.513398+0000","last_change":"2024-09-12T01:04:13.467497+0000","last_active":"2024-09-12T01:27:37.513398+0000","last_peered":"2024-09-12T01:27:37.513398+0000","last_clean":"2024-09-12T01:27:37.513398+0000","last_became_active":"2024-09-12T01:04:13.467230+0000","last_became_peered":"2024-09-12T01:04:13.467230+0000","last_unstale":"2024-09-12T01:27:37.513398+0000","last_undegraded":"2024-09-12T01:27:37.513398+0000","last_fullsized":"2024-09-12T01:27:37.513398+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.108303+0000","last_change":"2024-09-12T00:48:45.309898+0000","last_active":"2024-09-12T01:29:15.108303+0000","last_peered":"2024-09-12T01:29:15.108303+0000","last_clean":"2024-09-12T01:29:15.108303+0000","last_became_active":"2024-09-12T00:48:45.309604+0000","last_became_peered":"2024-09-12T00:48:45.309604+0000","last_unstale":"2024-09-12T01:29:15.108303+0000","last_undegraded":"2024-09-12T01:29:15.108303+0000","last_fullsized":"2024-09-12T01:29:15.108303+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:09.724362+0000","last_change":"2024-09-12T00:48:42.294022+0000","last_active":"2024-09-12T01:26:09.724362+0000","last_peered":"2024-09-12T01:26:09.724362+0000","last_clean":"2024-09-12T01:26:09.724362+0000","last_became_active":"2024-09-12T00:48:42.293705+0000","last_became_peered":"2024-09-12T00:48:42.293705+0000","last_unstale":"2024-09-12T01:26:09.724362+0000","last_undegraded":"2024-09-12T01:26:09.724362+0000","last_fullsized":"2024-09-12T01:26:09.724362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.053185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'6","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.601592+0000","last_change":"2024-09-12T01:30:00.601592+0000","last_active":"2024-09-12T01:30:00.601592+0000","last_peered":"2024-09-12T01:30:00.601592+0000","last_clean":"2024-09-12T01:30:00.601592+0000","last_became_active":"2024-09-12T00:46:03.916699+0000","last_became_peered":"2024-09-12T00:46:03.916699+0000","last_unstale":"2024-09-12T01:30:00.601592+0000","last_undegraded":"2024-09-12T01:30:00.601592+0000","last_fullsized":"2024-09-12T01:30:00.601592+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:30:00.601494+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:30:00.601494+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.601494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:38.098128+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:35.651335+0000","last_change":"2024-09-12T01:04:13.468912+0000","last_active":"2024-09-12T01:27:35.651335+0000","last_peered":"2024-09-12T01:27:35.651335+0000","last_clean":"2024-09-12T01:27:35.651335+0000","last_became_active":"2024-09-12T01:04:13.468643+0000","last_became_peered":"2024-09-12T01:04:13.468643+0000","last_unstale":"2024-09-12T01:27:35.651335+0000","last_undegraded":"2024-09-12T01:27:35.651335+0000","last_fullsized":"2024-09-12T01:27:35.651335+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:37.523035+0000","last_change":"2024-09-12T00:48:45.314936+0000","last_active":"2024-09-12T01:28:37.523035+0000","last_peered":"2024-09-12T01:28:37.523035+0000","last_clean":"2024-09-12T01:28:37.523035+0000","last_became_active":"2024-09-12T00:48:45.314212+0000","last_became_peered":"2024-09-12T00:48:45.314212+0000","last_unstale":"2024-09-12T01:28:37.523035+0000","last_undegraded":"2024-09-12T01:28:37.523035+0000","last_fullsized":"2024-09-12T01:28:37.523035+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:22.945070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"265'3","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.122795+0000","last_change":"2024-09-12T01:29:48.122718+0000","last_active":"2024-09-12T01:29:48.122795+0000","last_peered":"2024-09-12T01:29:48.122795+0000","last_clean":"2024-09-12T01:29:48.122795+0000","last_became_active":"2024-09-12T00:48:42.291818+0000","last_became_peered":"2024-09-12T00:48:42.291818+0000","last_unstale":"2024-09-12T01:29:48.122795+0000","last_undegraded":"2024-09-12T01:29:48.122795+0000","last_fullsized":"2024-09-12T01:29:48.122795+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:48.122622+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:48.122622+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.122622+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:23.762152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'35","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.578624+0000","last_change":"2024-09-12T01:29:59.578624+0000","last_active":"2024-09-12T01:29:59.578624+0000","last_peered":"2024-09-12T01:29:59.578624+0000","last_clean":"2024-09-12T01:29:59.578624+0000","last_became_active":"2024-09-12T00:46:03.920696+0000","last_became_peered":"2024-09-12T00:46:03.920696+0000","last_unstale":"2024-09-12T01:29:59.578624+0000","last_undegraded":"2024-09-12T01:29:59.578624+0000","last_fullsized":"2024-09-12T01:29:59.578624+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'35","last_scrub_stamp":"2024-09-12T01:29:59.578532+0000","last_deep_scrub":"265'35","last_deep_scrub_stamp":"2024-09-12T01:29:59.578532+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.578532+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:44.043628+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:34.514053+0000","last_change":"2024-09-12T01:04:13.472034+0000","last_active":"2024-09-12T01:27:34.514053+0000","last_peered":"2024-09-12T01:27:34.514053+0000","last_clean":"2024-09-12T01:27:34.514053+0000","last_became_active":"2024-09-12T01:04:13.471741+0000","last_became_peered":"2024-09-12T01:04:13.471741+0000","last_unstale":"2024-09-12T01:27:34.514053+0000","last_undegraded":"2024-09-12T01:27:34.514053+0000","last_fullsized":"2024-09-12T01:27:34.514053+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'7","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.244954+0000","last_change":"2024-09-12T00:48:45.317881+0000","last_active":"2024-09-12T01:29:16.244954+0000","last_peered":"2024-09-12T01:29:16.244954+0000","last_clean":"2024-09-12T01:29:16.244954+0000","last_became_active":"2024-09-12T00:48:45.317576+0000","last_became_peered":"2024-09-12T00:48:45.317576+0000","last_unstale":"2024-09-12T01:29:16.244954+0000","last_undegraded":"2024-09-12T01:29:16.244954+0000","last_fullsized":"2024-09-12T01:29:16.244954+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"262'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.619731+0000","last_change":"2024-09-12T01:29:59.619731+0000","last_active":"2024-09-12T01:29:59.619731+0000","last_peered":"2024-09-12T01:29:59.619731+0000","last_clean":"2024-09-12T01:29:59.619731+0000","last_became_active":"2024-09-12T00:48:42.291199+0000","last_became_peered":"2024-09-12T00:48:42.291199+0000","last_unstale":"2024-09-12T01:29:59.619731+0000","last_undegraded":"2024-09-12T01:29:59.619731+0000","last_fullsized":"2024-09-12T01:29:59.619731+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:29:59.619641+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:29:59.619641+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.619641+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:03.736526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5165,"num_write":10,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'6","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.647536+0000","last_change":"2024-09-12T01:29:53.647536+0000","last_active":"2024-09-12T01:29:53.647536+0000","last_peered":"2024-09-12T01:29:53.647536+0000","last_clean":"2024-09-12T01:29:53.647536+0000","last_became_active":"2024-09-12T00:46:03.919481+0000","last_became_peered":"2024-09-12T00:46:03.919481+0000","last_unstale":"2024-09-12T01:29:53.647536+0000","last_undegraded":"2024-09-12T01:29:53.647536+0000","last_fullsized":"2024-09-12T01:29:53.647536+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:29:53.647438+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:29:53.647438+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.647438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:23.272786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.024874+0000","last_change":"2024-09-12T01:29:56.024874+0000","last_active":"2024-09-12T01:29:56.024874+0000","last_peered":"2024-09-12T01:29:56.024874+0000","last_clean":"2024-09-12T01:29:56.024874+0000","last_became_active":"2024-09-12T01:04:13.468317+0000","last_became_peered":"2024-09-12T01:04:13.468317+0000","last_unstale":"2024-09-12T01:29:56.024874+0000","last_undegraded":"2024-09-12T01:29:56.024874+0000","last_fullsized":"2024-09-12T01:29:56.024874+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:56.024783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:56.024783+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.024783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:32.913868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.079981+0000","last_change":"2024-09-12T01:29:59.079981+0000","last_active":"2024-09-12T01:29:59.079981+0000","last_peered":"2024-09-12T01:29:59.079981+0000","last_clean":"2024-09-12T01:29:59.079981+0000","last_became_active":"2024-09-12T00:48:45.315546+0000","last_became_peered":"2024-09-12T00:48:45.315546+0000","last_unstale":"2024-09-12T01:29:59.079981+0000","last_undegraded":"2024-09-12T01:29:59.079981+0000","last_fullsized":"2024-09-12T01:29:59.079981+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:29:59.079883+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:29:59.079883+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.079883+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:24.451968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:01.793480+0000","last_change":"2024-09-12T01:30:01.793480+0000","last_active":"2024-09-12T01:30:01.793480+0000","last_peered":"2024-09-12T01:30:01.793480+0000","last_clean":"2024-09-12T01:30:01.793480+0000","last_became_active":"2024-09-12T00:48:42.296509+0000","last_became_peered":"2024-09-12T00:48:42.296509+0000","last_unstale":"2024-09-12T01:30:01.793480+0000","last_undegraded":"2024-09-12T01:30:01.793480+0000","last_fullsized":"2024-09-12T01:30:01.793480+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:30:01.793380+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:30:01.793380+0000","last_clean_scrub_stamp":"2024-09-12T01:30:01.793380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:33.430960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'52","reported_seq":188,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:49.721709+0000","last_change":"2024-09-12T00:46:03.920474+0000","last_active":"2024-09-12T01:25:49.721709+0000","last_peered":"2024-09-12T01:25:49.721709+0000","last_clean":"2024-09-12T01:25:49.721709+0000","last_became_active":"2024-09-12T00:46:03.920188+0000","last_became_peered":"2024-09-12T00:46:03.920188+0000","last_unstale":"2024-09-12T01:25:49.721709+0000","last_undegraded":"2024-09-12T01:25:49.721709+0000","last_fullsized":"2024-09-12T01:25:49.721709+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:42.736993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":182,"num_write":95,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498632+0000","last_change":"2024-09-12T01:04:13.462848+0000","last_active":"2024-09-12T01:26:02.498632+0000","last_peered":"2024-09-12T01:26:02.498632+0000","last_clean":"2024-09-12T01:26:02.498632+0000","last_became_active":"2024-09-12T01:04:13.462434+0000","last_became_peered":"2024-09-12T01:04:13.462434+0000","last_unstale":"2024-09-12T01:26:02.498632+0000","last_undegraded":"2024-09-12T01:26:02.498632+0000","last_fullsized":"2024-09-12T01:26:02.498632+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:42.830213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499355+0000","last_change":"2024-09-12T00:48:45.316725+0000","last_active":"2024-09-12T01:26:07.499355+0000","last_peered":"2024-09-12T01:26:07.499355+0000","last_clean":"2024-09-12T01:26:07.499355+0000","last_became_active":"2024-09-12T00:48:45.316432+0000","last_became_peered":"2024-09-12T00:48:45.316432+0000","last_unstale":"2024-09-12T01:26:07.499355+0000","last_undegraded":"2024-09-12T01:26:07.499355+0000","last_fullsized":"2024-09-12T01:26:07.499355+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:20.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.730540+0000","last_change":"2024-09-12T01:29:57.730540+0000","last_active":"2024-09-12T01:29:57.730540+0000","last_peered":"2024-09-12T01:29:57.730540+0000","last_clean":"2024-09-12T01:29:57.730540+0000","last_became_active":"2024-09-12T00:48:42.290454+0000","last_became_peered":"2024-09-12T00:48:42.290454+0000","last_unstale":"2024-09-12T01:29:57.730540+0000","last_undegraded":"2024-09-12T01:29:57.730540+0000","last_fullsized":"2024-09-12T01:29:57.730540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:57.730455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:57.730455+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.730455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:31.605867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"262'7","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:44.719526+0000","last_change":"2024-09-12T00:46:03.917579+0000","last_active":"2024-09-12T01:25:44.719526+0000","last_peered":"2024-09-12T01:25:44.719526+0000","last_clean":"2024-09-12T01:25:44.719526+0000","last_became_active":"2024-09-12T00:46:03.917314+0000","last_became_peered":"2024-09-12T00:46:03.917314+0000","last_unstale":"2024-09-12T01:25:44.719526+0000","last_undegraded":"2024-09-12T01:25:44.719526+0000","last_fullsized":"2024-09-12T01:25:44.719526+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:21.892403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":13,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":23,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637319+0000","last_change":"2024-09-12T01:04:13.467571+0000","last_active":"2024-09-12T01:26:00.637319+0000","last_peered":"2024-09-12T01:26:00.637319+0000","last_clean":"2024-09-12T01:26:00.637319+0000","last_became_active":"2024-09-12T01:04:13.467119+0000","last_became_peered":"2024-09-12T01:04:13.467119+0000","last_unstale":"2024-09-12T01:26:00.637319+0000","last_undegraded":"2024-09-12T01:26:00.637319+0000","last_fullsized":"2024-09-12T01:26:00.637319+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:23.369147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":36,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:07.499300+0000","last_change":"2024-09-12T00:48:45.314598+0000","last_active":"2024-09-12T01:26:07.499300+0000","last_peered":"2024-09-12T01:26:07.499300+0000","last_clean":"2024-09-12T01:26:07.499300+0000","last_became_active":"2024-09-12T00:48:45.314127+0000","last_became_peered":"2024-09-12T00:48:45.314127+0000","last_unstale":"2024-09-12T01:26:07.499300+0000","last_undegraded":"2024-09-12T01:26:07.499300+0000","last_fullsized":"2024-09-12T01:26:07.499300+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:00.050328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'5","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498548+0000","last_change":"2024-09-12T00:48:42.293860+0000","last_active":"2024-09-12T01:26:02.498548+0000","last_peered":"2024-09-12T01:26:02.498548+0000","last_clean":"2024-09-12T01:26:02.498548+0000","last_became_active":"2024-09-12T00:48:42.293153+0000","last_became_peered":"2024-09-12T00:48:42.293153+0000","last_unstale":"2024-09-12T01:26:02.498548+0000","last_undegraded":"2024-09-12T01:26:02.498548+0000","last_fullsized":"2024-09-12T01:26:02.498548+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:12.547450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'49","reported_seq":187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.621180+0000","last_change":"2024-09-12T01:29:52.621180+0000","last_active":"2024-09-12T01:29:52.621180+0000","last_peered":"2024-09-12T01:29:52.621180+0000","last_clean":"2024-09-12T01:29:52.621180+0000","last_became_active":"2024-09-12T00:46:03.917142+0000","last_became_peered":"2024-09-12T00:46:03.917142+0000","last_unstale":"2024-09-12T01:29:52.621180+0000","last_undegraded":"2024-09-12T01:29:52.621180+0000","last_fullsized":"2024-09-12T01:29:52.621180+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'49","last_scrub_stamp":"2024-09-12T01:29:52.621077+0000","last_deep_scrub":"265'49","last_deep_scrub_stamp":"2024-09-12T01:29:52.621077+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.621077+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:15.538686+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":172,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"264'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:38.514124+0000","last_change":"2024-09-12T01:04:13.464064+0000","last_active":"2024-09-12T01:27:38.514124+0000","last_peered":"2024-09-12T01:27:38.514124+0000","last_clean":"2024-09-12T01:27:38.514124+0000","last_became_active":"2024-09-12T01:04:13.463766+0000","last_became_peered":"2024-09-12T01:04:13.463766+0000","last_unstale":"2024-09-12T01:27:38.514124+0000","last_undegraded":"2024-09-12T01:27:38.514124+0000","last_fullsized":"2024-09-12T01:27:38.514124+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:05.782587+0000","last_change":"2024-09-12T00:48:45.307348+0000","last_active":"2024-09-12T01:26:05.782587+0000","last_peered":"2024-09-12T01:26:05.782587+0000","last_clean":"2024-09-12T01:26:05.782587+0000","last_became_active":"2024-09-12T00:48:45.307036+0000","last_became_peered":"2024-09-12T00:48:45.307036+0000","last_unstale":"2024-09-12T01:26:05.782587+0000","last_undegraded":"2024-09-12T01:26:05.782587+0000","last_fullsized":"2024-09-12T01:26:05.782587+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:21.417276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'5","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.731204+0000","last_change":"2024-09-12T01:29:53.731204+0000","last_active":"2024-09-12T01:29:53.731204+0000","last_peered":"2024-09-12T01:29:53.731204+0000","last_clean":"2024-09-12T01:29:53.731204+0000","last_became_active":"2024-09-12T00:48:42.294608+0000","last_became_peered":"2024-09-12T00:48:42.294608+0000","last_unstale":"2024-09-12T01:29:53.731204+0000","last_undegraded":"2024-09-12T01:29:53.731204+0000","last_fullsized":"2024-09-12T01:29:53.731204+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:29:53.731118+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:29:53.731118+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.731118+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:26.531554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5438,"num_write":5,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.501369+0000","last_change":"2024-09-12T01:29:52.501369+0000","last_active":"2024-09-12T01:29:52.501369+0000","last_peered":"2024-09-12T01:29:52.501369+0000","last_clean":"2024-09-12T01:29:52.501369+0000","last_became_active":"2024-09-12T00:46:03.921844+0000","last_became_peered":"2024-09-12T00:46:03.921844+0000","last_unstale":"2024-09-12T01:29:52.501369+0000","last_undegraded":"2024-09-12T01:29:52.501369+0000","last_fullsized":"2024-09-12T01:29:52.501369+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-12T01:29:52.501280+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-12T01:29:52.501280+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.501280+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:14.709150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":67,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'1","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:00.637276+0000","last_change":"2024-09-12T01:04:13.462719+0000","last_active":"2024-09-12T01:26:00.637276+0000","last_peered":"2024-09-12T01:26:00.637276+0000","last_clean":"2024-09-12T01:26:00.637276+0000","last_became_active":"2024-09-12T01:04:13.462441+0000","last_became_peered":"2024-09-12T01:04:13.462441+0000","last_unstale":"2024-09-12T01:26:00.637276+0000","last_undegraded":"2024-09-12T01:26:00.637276+0000","last_fullsized":"2024-09-12T01:26:00.637276+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:19.887695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'11","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.407259+0000","last_change":"2024-09-12T00:48:45.312937+0000","last_active":"2024-09-12T01:29:15.407259+0000","last_peered":"2024-09-12T01:29:15.407259+0000","last_clean":"2024-09-12T01:29:15.407259+0000","last_became_active":"2024-09-12T00:48:45.312617+0000","last_became_peered":"2024-09-12T00:48:45.312617+0000","last_unstale":"2024-09-12T01:29:15.407259+0000","last_undegraded":"2024-09-12T01:29:15.407259+0000","last_fullsized":"2024-09-12T01:29:15.407259+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:28.386583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":20528,"num_write":21,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.714484+0000","last_change":"2024-09-12T01:29:52.714484+0000","last_active":"2024-09-12T01:29:52.714484+0000","last_peered":"2024-09-12T01:29:52.714484+0000","last_clean":"2024-09-12T01:29:52.714484+0000","last_became_active":"2024-09-12T00:48:42.292511+0000","last_became_peered":"2024-09-12T00:48:42.292511+0000","last_unstale":"2024-09-12T01:29:52.714484+0000","last_undegraded":"2024-09-12T01:29:52.714484+0000","last_fullsized":"2024-09-12T01:29:52.714484+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:52.714394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:52.714394+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.714394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:59.474523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'10","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.619764+0000","last_change":"2024-09-12T01:29:51.619764+0000","last_active":"2024-09-12T01:29:51.619764+0000","last_peered":"2024-09-12T01:29:51.619764+0000","last_clean":"2024-09-12T01:29:51.619764+0000","last_became_active":"2024-09-12T00:46:03.913098+0000","last_became_peered":"2024-09-12T00:46:03.913098+0000","last_unstale":"2024-09-12T01:29:51.619764+0000","last_undegraded":"2024-09-12T01:29:51.619764+0000","last_fullsized":"2024-09-12T01:29:51.619764+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:29:51.619673+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:29:51.619673+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.619673+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:11.583695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":36,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:02.498570+0000","last_change":"2024-09-12T01:04:13.474135+0000","last_active":"2024-09-12T01:26:02.498570+0000","last_peered":"2024-09-12T01:26:02.498570+0000","last_clean":"2024-09-12T01:26:02.498570+0000","last_became_active":"2024-09-12T01:04:13.473901+0000","last_became_peered":"2024-09-12T01:04:13.473901+0000","last_unstale":"2024-09-12T01:26:02.498570+0000","last_undegraded":"2024-09-12T01:26:02.498570+0000","last_fullsized":"2024-09-12T01:26:02.498570+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:45.848297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'5","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.811628+0000","last_change":"2024-09-12T00:48:45.308960+0000","last_active":"2024-09-12T01:29:15.811628+0000","last_peered":"2024-09-12T01:29:15.811628+0000","last_clean":"2024-09-12T01:29:15.811628+0000","last_became_active":"2024-09-12T00:48:45.308676+0000","last_became_peered":"2024-09-12T00:48:45.308676+0000","last_unstale":"2024-09-12T01:29:15.811628+0000","last_undegraded":"2024-09-12T01:29:15.811628+0000","last_fullsized":"2024-09-12T01:29:15.811628+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:11.911720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":80,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'6","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.469888+0000","last_change":"2024-09-12T01:29:55.469888+0000","last_active":"2024-09-12T01:29:55.469888+0000","last_peered":"2024-09-12T01:29:55.469888+0000","last_clean":"2024-09-12T01:29:55.469888+0000","last_became_active":"2024-09-12T00:48:42.291569+0000","last_became_peered":"2024-09-12T00:48:42.291569+0000","last_unstale":"2024-09-12T01:29:55.469888+0000","last_undegraded":"2024-09-12T01:29:55.469888+0000","last_fullsized":"2024-09-12T01:29:55.469888+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:29:55.469801+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:29:55.469801+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.469801+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:27.799276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'67","reported_seq":241,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.640362+0000","last_change":"2024-09-12T01:29:50.640362+0000","last_active":"2024-09-12T01:29:50.640362+0000","last_peered":"2024-09-12T01:29:50.640362+0000","last_clean":"2024-09-12T01:29:50.640362+0000","last_became_active":"2024-09-12T00:46:03.920387+0000","last_became_peered":"2024-09-12T00:46:03.920387+0000","last_unstale":"2024-09-12T01:29:50.640362+0000","last_undegraded":"2024-09-12T01:29:50.640362+0000","last_fullsized":"2024-09-12T01:29:50.640362+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'67","last_scrub_stamp":"2024-09-12T01:29:50.640239+0000","last_deep_scrub":"265'67","last_deep_scrub_stamp":"2024-09-12T01:29:50.640239+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.640239+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:17.011130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":242,"num_write":122,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.723680+0000","last_change":"2024-09-12T01:29:55.723680+0000","last_active":"2024-09-12T01:29:55.723680+0000","last_peered":"2024-09-12T01:29:55.723680+0000","last_clean":"2024-09-12T01:29:55.723680+0000","last_became_active":"2024-09-12T01:04:13.469544+0000","last_became_peered":"2024-09-12T01:04:13.469544+0000","last_unstale":"2024-09-12T01:29:55.723680+0000","last_undegraded":"2024-09-12T01:29:55.723680+0000","last_fullsized":"2024-09-12T01:29:55.723680+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:55.723589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:55.723589+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.723589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:42.812895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.791316+0000","last_change":"2024-09-12T00:48:45.310714+0000","last_active":"2024-09-12T01:27:00.791316+0000","last_peered":"2024-09-12T01:27:00.791316+0000","last_clean":"2024-09-12T01:27:00.791316+0000","last_became_active":"2024-09-12T00:48:45.310425+0000","last_became_peered":"2024-09-12T00:48:45.310425+0000","last_unstale":"2024-09-12T01:27:00.791316+0000","last_undegraded":"2024-09-12T01:27:00.791316+0000","last_fullsized":"2024-09-12T01:27:00.791316+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:11.427037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646110+0000","last_change":"2024-09-12T00:48:42.289205+0000","last_active":"2024-09-12T01:27:00.646110+0000","last_peered":"2024-09-12T01:27:00.646110+0000","last_clean":"2024-09-12T01:27:00.646110+0000","last_became_active":"2024-09-12T00:48:42.288750+0000","last_became_peered":"2024-09-12T00:48:42.288750+0000","last_unstale":"2024-09-12T01:27:00.646110+0000","last_undegraded":"2024-09-12T01:27:00.646110+0000","last_fullsized":"2024-09-12T01:27:00.646110+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:03.592679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'39","reported_seq":150,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:34.727351+0000","last_change":"2024-09-12T00:46:03.918651+0000","last_active":"2024-09-12T01:26:34.727351+0000","last_peered":"2024-09-12T01:26:34.727351+0000","last_clean":"2024-09-12T01:26:34.727351+0000","last_became_active":"2024-09-12T00:46:03.918395+0000","last_became_peered":"2024-09-12T00:46:03.918395+0000","last_unstale":"2024-09-12T01:26:34.727351+0000","last_undegraded":"2024-09-12T01:26:34.727351+0000","last_fullsized":"2024-09-12T01:26:34.727351+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:06.038629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":130,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.722217+0000","last_change":"2024-09-12T01:04:13.468761+0000","last_active":"2024-09-12T01:25:54.722217+0000","last_peered":"2024-09-12T01:25:54.722217+0000","last_clean":"2024-09-12T01:25:54.722217+0000","last_became_active":"2024-09-12T01:04:13.468492+0000","last_became_peered":"2024-09-12T01:04:13.468492+0000","last_unstale":"2024-09-12T01:25:54.722217+0000","last_undegraded":"2024-09-12T01:25:54.722217+0000","last_fullsized":"2024-09-12T01:25:54.722217+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:23.228261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.245027+0000","last_change":"2024-09-12T00:48:45.306987+0000","last_active":"2024-09-12T01:29:16.245027+0000","last_peered":"2024-09-12T01:29:16.245027+0000","last_clean":"2024-09-12T01:29:16.245027+0000","last_became_active":"2024-09-12T00:48:45.306581+0000","last_became_peered":"2024-09-12T00:48:45.306581+0000","last_unstale":"2024-09-12T01:29:16.245027+0000","last_undegraded":"2024-09-12T01:29:16.245027+0000","last_fullsized":"2024-09-12T01:29:16.245027+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.560659+0000","last_change":"2024-09-12T01:29:57.560659+0000","last_active":"2024-09-12T01:29:57.560659+0000","last_peered":"2024-09-12T01:29:57.560659+0000","last_clean":"2024-09-12T01:29:57.560659+0000","last_became_active":"2024-09-12T00:48:42.290069+0000","last_became_peered":"2024-09-12T00:48:42.290069+0000","last_unstale":"2024-09-12T01:29:57.560659+0000","last_undegraded":"2024-09-12T01:29:57.560659+0000","last_fullsized":"2024-09-12T01:29:57.560659+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:57.560565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:57.560565+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.560565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:21.711185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'22","reported_seq":113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.693045+0000","last_change":"2024-09-12T01:29:50.693045+0000","last_active":"2024-09-12T01:29:50.693045+0000","last_peered":"2024-09-12T01:29:50.693045+0000","last_clean":"2024-09-12T01:29:50.693045+0000","last_became_active":"2024-09-12T00:46:03.917612+0000","last_became_peered":"2024-09-12T00:46:03.917612+0000","last_unstale":"2024-09-12T01:29:50.693045+0000","last_undegraded":"2024-09-12T01:29:50.693045+0000","last_fullsized":"2024-09-12T01:29:50.693045+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'22","last_scrub_stamp":"2024-09-12T01:29:50.692952+0000","last_deep_scrub":"265'22","last_deep_scrub_stamp":"2024-09-12T01:29:50.692952+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.692952+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:44.188500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":67,"num_write":52,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:54.604479+0000","last_change":"2024-09-12T01:04:13.471829+0000","last_active":"2024-09-12T01:25:54.604479+0000","last_peered":"2024-09-12T01:25:54.604479+0000","last_clean":"2024-09-12T01:25:54.604479+0000","last_became_active":"2024-09-12T01:04:13.470494+0000","last_became_peered":"2024-09-12T01:04:13.470494+0000","last_unstale":"2024-09-12T01:25:54.604479+0000","last_undegraded":"2024-09-12T01:25:54.604479+0000","last_fullsized":"2024-09-12T01:25:54.604479+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:36:21.144218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:02.508038+0000","last_change":"2024-09-12T00:48:45.317979+0000","last_active":"2024-09-12T01:27:02.508038+0000","last_peered":"2024-09-12T01:27:02.508038+0000","last_clean":"2024-09-12T01:27:02.508038+0000","last_became_active":"2024-09-12T00:48:45.317637+0000","last_became_peered":"2024-09-12T00:48:45.317637+0000","last_unstale":"2024-09-12T01:27:02.508038+0000","last_undegraded":"2024-09-12T01:27:02.508038+0000","last_fullsized":"2024-09-12T01:27:02.508038+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:51.863153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.593167+0000","last_change":"2024-09-12T01:29:58.593167+0000","last_active":"2024-09-12T01:29:58.593167+0000","last_peered":"2024-09-12T01:29:58.593167+0000","last_clean":"2024-09-12T01:29:58.593167+0000","last_became_active":"2024-09-12T00:48:42.289304+0000","last_became_peered":"2024-09-12T00:48:42.289304+0000","last_unstale":"2024-09-12T01:29:58.593167+0000","last_undegraded":"2024-09-12T01:29:58.593167+0000","last_fullsized":"2024-09-12T01:29:58.593167+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:58.593077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:58.593077+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.593077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:55.655484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.057652+0000","last_change":"2024-09-12T01:29:56.057652+0000","last_active":"2024-09-12T01:29:56.057652+0000","last_peered":"2024-09-12T01:29:56.057652+0000","last_clean":"2024-09-12T01:29:56.057652+0000","last_became_active":"2024-09-12T00:46:03.911316+0000","last_became_peered":"2024-09-12T00:46:03.911316+0000","last_unstale":"2024-09-12T01:29:56.057652+0000","last_undegraded":"2024-09-12T01:29:56.057652+0000","last_fullsized":"2024-09-12T01:29:56.057652+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-12T01:29:56.057564+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-12T01:29:56.057564+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.057564+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:47.597238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":121,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:47.505723+0000","last_change":"2024-09-12T01:04:13.462688+0000","last_active":"2024-09-12T01:26:47.505723+0000","last_peered":"2024-09-12T01:26:47.505723+0000","last_clean":"2024-09-12T01:26:47.505723+0000","last_became_active":"2024-09-12T01:04:13.462150+0000","last_became_peered":"2024-09-12T01:04:13.462150+0000","last_unstale":"2024-09-12T01:26:47.505723+0000","last_undegraded":"2024-09-12T01:26:47.505723+0000","last_fullsized":"2024-09-12T01:26:47.505723+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:43.928057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.895194+0000","last_change":"2024-09-12T00:48:45.312564+0000","last_active":"2024-09-12T01:29:15.895194+0000","last_peered":"2024-09-12T01:29:15.895194+0000","last_clean":"2024-09-12T01:29:15.895194+0000","last_became_active":"2024-09-12T00:48:45.312283+0000","last_became_peered":"2024-09-12T00:48:45.312283+0000","last_unstale":"2024-09-12T01:29:15.895194+0000","last_undegraded":"2024-09-12T01:29:15.895194+0000","last_fullsized":"2024-09-12T01:29:15.895194+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'3","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.594842+0000","last_change":"2024-09-12T01:29:55.594732+0000","last_active":"2024-09-12T01:29:55.594842+0000","last_peered":"2024-09-12T01:29:55.594842+0000","last_clean":"2024-09-12T01:29:55.594842+0000","last_became_active":"2024-09-12T00:48:42.290091+0000","last_became_peered":"2024-09-12T00:48:42.290091+0000","last_unstale":"2024-09-12T01:29:55.594842+0000","last_undegraded":"2024-09-12T01:29:55.594842+0000","last_fullsized":"2024-09-12T01:29:55.594842+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:55.594618+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:55.594618+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.594618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:59.132412+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'27","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.071860+0000","last_change":"2024-09-12T01:29:55.071860+0000","last_active":"2024-09-12T01:29:55.071860+0000","last_peered":"2024-09-12T01:29:55.071860+0000","last_clean":"2024-09-12T01:29:55.071860+0000","last_became_active":"2024-09-12T00:46:03.916476+0000","last_became_peered":"2024-09-12T00:46:03.916476+0000","last_unstale":"2024-09-12T01:29:55.071860+0000","last_undegraded":"2024-09-12T01:29:55.071860+0000","last_fullsized":"2024-09-12T01:29:55.071860+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'27","last_scrub_stamp":"2024-09-12T01:29:55.071769+0000","last_deep_scrub":"265'27","last_deep_scrub_stamp":"2024-09-12T01:29:55.071769+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.071769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:22.084538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:54.509963+0000","last_change":"2024-09-12T01:04:13.467457+0000","last_active":"2024-09-12T01:26:54.509963+0000","last_peered":"2024-09-12T01:26:54.509963+0000","last_clean":"2024-09-12T01:26:54.509963+0000","last_became_active":"2024-09-12T01:04:13.467045+0000","last_became_peered":"2024-09-12T01:04:13.467045+0000","last_unstale":"2024-09-12T01:26:54.509963+0000","last_undegraded":"2024-09-12T01:26:54.509963+0000","last_fullsized":"2024-09-12T01:26:54.509963+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:17.297601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'3","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.447329+0000","last_change":"2024-09-12T01:29:57.447329+0000","last_active":"2024-09-12T01:29:57.447329+0000","last_peered":"2024-09-12T01:29:57.447329+0000","last_clean":"2024-09-12T01:29:57.447329+0000","last_became_active":"2024-09-12T00:48:45.309113+0000","last_became_peered":"2024-09-12T00:48:45.309113+0000","last_unstale":"2024-09-12T01:29:57.447329+0000","last_undegraded":"2024-09-12T01:29:57.447329+0000","last_fullsized":"2024-09-12T01:29:57.447329+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:57.447249+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:57.447249+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.447249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:12.036689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'2","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.164870+0000","last_change":"2024-09-12T00:48:42.293380+0000","last_active":"2024-09-12T01:29:15.164870+0000","last_peered":"2024-09-12T01:29:15.164870+0000","last_clean":"2024-09-12T01:29:15.164870+0000","last_became_active":"2024-09-12T00:48:42.292733+0000","last_became_peered":"2024-09-12T00:48:42.292733+0000","last_unstale":"2024-09-12T01:29:15.164870+0000","last_undegraded":"2024-09-12T01:29:15.164870+0000","last_fullsized":"2024-09-12T01:29:15.164870+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"262'8","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.429819+0000","last_change":"2024-09-12T01:29:56.429819+0000","last_active":"2024-09-12T01:29:56.429819+0000","last_peered":"2024-09-12T01:29:56.429819+0000","last_clean":"2024-09-12T01:29:56.429819+0000","last_became_active":"2024-09-12T00:46:03.922008+0000","last_became_peered":"2024-09-12T00:46:03.922008+0000","last_unstale":"2024-09-12T01:29:56.429819+0000","last_undegraded":"2024-09-12T01:29:56.429819+0000","last_fullsized":"2024-09-12T01:29:56.429819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T01:29:56.429729+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T01:29:56.429729+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.429729+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:53.528881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.060743+0000","last_change":"2024-09-12T01:29:55.060743+0000","last_active":"2024-09-12T01:29:55.060743+0000","last_peered":"2024-09-12T01:29:55.060743+0000","last_clean":"2024-09-12T01:29:55.060743+0000","last_became_active":"2024-09-12T01:04:13.467476+0000","last_became_peered":"2024-09-12T01:04:13.467476+0000","last_unstale":"2024-09-12T01:29:55.060743+0000","last_undegraded":"2024-09-12T01:29:55.060743+0000","last_fullsized":"2024-09-12T01:29:55.060743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:55.060652+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:55.060652+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.060652+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:43.496125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"262'2","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:00.646039+0000","last_change":"2024-09-12T00:48:45.311842+0000","last_active":"2024-09-12T01:27:00.646039+0000","last_peered":"2024-09-12T01:27:00.646039+0000","last_clean":"2024-09-12T01:27:00.646039+0000","last_became_active":"2024-09-12T00:48:45.311541+0000","last_became_peered":"2024-09-12T00:48:45.311541+0000","last_unstale":"2024-09-12T01:27:00.646039+0000","last_undegraded":"2024-09-12T01:27:00.646039+0000","last_fullsized":"2024-09-12T01:27:00.646039+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:32.767909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"262'3","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.583265+0000","last_change":"2024-09-12T01:29:56.583265+0000","last_active":"2024-09-12T01:29:56.583265+0000","last_peered":"2024-09-12T01:29:56.583265+0000","last_clean":"2024-09-12T01:29:56.583265+0000","last_became_active":"2024-09-12T00:48:42.281070+0000","last_became_peered":"2024-09-12T00:48:42.281070+0000","last_unstale":"2024-09-12T01:29:56.583265+0000","last_undegraded":"2024-09-12T01:29:56.583265+0000","last_fullsized":"2024-09-12T01:29:56.583265+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:29:56.583176+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:29:56.583176+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.583176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:19.308803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'44","reported_seq":182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.764807+0000","last_change":"2024-09-12T01:30:00.764807+0000","last_active":"2024-09-12T01:30:00.764807+0000","last_peered":"2024-09-12T01:30:00.764807+0000","last_clean":"2024-09-12T01:30:00.764807+0000","last_became_active":"2024-09-12T00:46:03.917626+0000","last_became_peered":"2024-09-12T00:46:03.917626+0000","last_unstale":"2024-09-12T01:30:00.764807+0000","last_undegraded":"2024-09-12T01:30:00.764807+0000","last_fullsized":"2024-09-12T01:30:00.764807+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'44","last_scrub_stamp":"2024-09-12T01:30:00.764720+0000","last_deep_scrub":"265'44","last_deep_scrub_stamp":"2024-09-12T01:30:00.764720+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.764720+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:01.539586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":170,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:45.789110+0000","last_change":"2024-09-12T01:04:13.463528+0000","last_active":"2024-09-12T01:26:45.789110+0000","last_peered":"2024-09-12T01:26:45.789110+0000","last_clean":"2024-09-12T01:26:45.789110+0000","last_became_active":"2024-09-12T01:04:13.463216+0000","last_became_peered":"2024-09-12T01:04:13.463216+0000","last_unstale":"2024-09-12T01:26:45.789110+0000","last_undegraded":"2024-09-12T01:26:45.789110+0000","last_fullsized":"2024-09-12T01:26:45.789110+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:56.941035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":45,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.128162+0000","last_change":"2024-09-12T01:29:51.128162+0000","last_active":"2024-09-12T01:29:51.128162+0000","last_peered":"2024-09-12T01:29:51.128162+0000","last_clean":"2024-09-12T01:29:51.128162+0000","last_became_active":"2024-09-12T00:48:45.313386+0000","last_became_peered":"2024-09-12T00:48:45.313386+0000","last_unstale":"2024-09-12T01:29:51.128162+0000","last_undegraded":"2024-09-12T01:29:51.128162+0000","last_fullsized":"2024-09-12T01:29:51.128162+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:51.128069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:51.128069+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.128069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:43.991201+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:59.730452+0000","last_change":"2024-09-12T00:48:42.293797+0000","last_active":"2024-09-12T01:26:59.730452+0000","last_peered":"2024-09-12T01:26:59.730452+0000","last_clean":"2024-09-12T01:26:59.730452+0000","last_became_active":"2024-09-12T00:48:42.293460+0000","last_became_peered":"2024-09-12T00:48:42.293460+0000","last_unstale":"2024-09-12T01:26:59.730452+0000","last_undegraded":"2024-09-12T01:26:59.730452+0000","last_fullsized":"2024-09-12T01:26:59.730452+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:22.406867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'27","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.141527+0000","last_change":"2024-09-12T01:29:47.141527+0000","last_active":"2024-09-12T01:29:47.141527+0000","last_peered":"2024-09-12T01:29:47.141527+0000","last_clean":"2024-09-12T01:29:47.141527+0000","last_became_active":"2024-09-12T00:46:03.918921+0000","last_became_peered":"2024-09-12T00:46:03.918921+0000","last_unstale":"2024-09-12T01:29:47.141527+0000","last_undegraded":"2024-09-12T01:29:47.141527+0000","last_fullsized":"2024-09-12T01:29:47.141527+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'27","last_scrub_stamp":"2024-09-12T01:29:47.141429+0000","last_deep_scrub":"265'27","last_deep_scrub_stamp":"2024-09-12T01:29:47.141429+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.141429+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:05.347023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.052832+0000","last_change":"2024-09-12T01:29:54.052832+0000","last_active":"2024-09-12T01:29:54.052832+0000","last_peered":"2024-09-12T01:29:54.052832+0000","last_clean":"2024-09-12T01:29:54.052832+0000","last_became_active":"2024-09-12T01:04:13.466854+0000","last_became_peered":"2024-09-12T01:04:13.466854+0000","last_unstale":"2024-09-12T01:29:54.052832+0000","last_undegraded":"2024-09-12T01:29:54.052832+0000","last_fullsized":"2024-09-12T01:29:54.052832+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:54.052744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:54.052744+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.052744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:59.090715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:32.522238+0000","last_change":"2024-09-12T00:48:45.316511+0000","last_active":"2024-09-12T01:28:32.522238+0000","last_peered":"2024-09-12T01:28:32.522238+0000","last_clean":"2024-09-12T01:28:32.522238+0000","last_became_active":"2024-09-12T00:48:45.315966+0000","last_became_peered":"2024-09-12T00:48:45.315966+0000","last_unstale":"2024-09-12T01:28:32.522238+0000","last_undegraded":"2024-09-12T01:28:32.522238+0000","last_fullsized":"2024-09-12T01:28:32.522238+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:04.129604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1396,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:19.741022+0000","last_change":"2024-09-12T00:48:42.294344+0000","last_active":"2024-09-12T01:28:19.741022+0000","last_peered":"2024-09-12T01:28:19.741022+0000","last_clean":"2024-09-12T01:28:19.741022+0000","last_became_active":"2024-09-12T00:48:42.293481+0000","last_became_peered":"2024-09-12T00:48:42.293481+0000","last_unstale":"2024-09-12T01:28:19.741022+0000","last_undegraded":"2024-09-12T01:28:19.741022+0000","last_fullsized":"2024-09-12T01:28:19.741022+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:01.378966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'25","reported_seq":126,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.550241+0000","last_change":"2024-09-12T01:29:58.550241+0000","last_active":"2024-09-12T01:29:58.550241+0000","last_peered":"2024-09-12T01:29:58.550241+0000","last_clean":"2024-09-12T01:29:58.550241+0000","last_became_active":"2024-09-12T00:46:03.914207+0000","last_became_peered":"2024-09-12T00:46:03.914207+0000","last_unstale":"2024-09-12T01:29:58.550241+0000","last_undegraded":"2024-09-12T01:29:58.550241+0000","last_fullsized":"2024-09-12T01:29:58.550241+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-12T01:29:58.550142+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-12T01:29:58.550142+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.550142+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:12.755829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.078401+0000","last_change":"2024-09-12T01:29:53.078401+0000","last_active":"2024-09-12T01:29:53.078401+0000","last_peered":"2024-09-12T01:29:53.078401+0000","last_clean":"2024-09-12T01:29:53.078401+0000","last_became_active":"2024-09-12T01:04:13.466050+0000","last_became_peered":"2024-09-12T01:04:13.466050+0000","last_unstale":"2024-09-12T01:29:53.078401+0000","last_undegraded":"2024-09-12T01:29:53.078401+0000","last_fullsized":"2024-09-12T01:29:53.078401+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:53.078306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:53.078306+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.078306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:52.505313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":42,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:17.501296+0000","last_change":"2024-09-12T00:48:45.314649+0000","last_active":"2024-09-12T01:26:17.501296+0000","last_peered":"2024-09-12T01:26:17.501296+0000","last_clean":"2024-09-12T01:26:17.501296+0000","last_became_active":"2024-09-12T00:48:45.313692+0000","last_became_peered":"2024-09-12T00:48:45.313692+0000","last_unstale":"2024-09-12T01:26:17.501296+0000","last_undegraded":"2024-09-12T01:26:17.501296+0000","last_fullsized":"2024-09-12T01:26:17.501296+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:19.872019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:23.503219+0000","last_change":"2024-09-12T00:48:42.288243+0000","last_active":"2024-09-12T01:26:23.503219+0000","last_peered":"2024-09-12T01:26:23.503219+0000","last_clean":"2024-09-12T01:26:23.503219+0000","last_became_active":"2024-09-12T00:48:42.287949+0000","last_became_peered":"2024-09-12T00:48:42.287949+0000","last_unstale":"2024-09-12T01:26:23.503219+0000","last_undegraded":"2024-09-12T01:26:23.503219+0000","last_fullsized":"2024-09-12T01:26:23.503219+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:37.161356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'53","reported_seq":195,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:14.732446+0000","last_change":"2024-09-12T00:46:03.918000+0000","last_active":"2024-09-12T01:27:14.732446+0000","last_peered":"2024-09-12T01:27:14.732446+0000","last_clean":"2024-09-12T01:27:14.732446+0000","last_became_active":"2024-09-12T00:46:03.917728+0000","last_became_peered":"2024-09-12T00:46:03.917728+0000","last_unstale":"2024-09-12T01:27:14.732446+0000","last_undegraded":"2024-09-12T01:27:14.732446+0000","last_fullsized":"2024-09-12T01:27:14.732446+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":191,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:22.501894+0000","last_change":"2024-09-12T01:04:13.466462+0000","last_active":"2024-09-12T01:26:22.501894+0000","last_peered":"2024-09-12T01:26:22.501894+0000","last_clean":"2024-09-12T01:26:22.501894+0000","last_became_active":"2024-09-12T01:04:13.466183+0000","last_became_peered":"2024-09-12T01:04:13.466183+0000","last_unstale":"2024-09-12T01:26:22.501894+0000","last_undegraded":"2024-09-12T01:26:22.501894+0000","last_fullsized":"2024-09-12T01:26:22.501894+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:33.706209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.095583+0000","last_change":"2024-09-12T01:29:50.095522+0000","last_active":"2024-09-12T01:29:50.095583+0000","last_peered":"2024-09-12T01:29:50.095583+0000","last_clean":"2024-09-12T01:29:50.095583+0000","last_became_active":"2024-09-12T00:48:45.311453+0000","last_became_peered":"2024-09-12T00:48:45.311453+0000","last_unstale":"2024-09-12T01:29:50.095583+0000","last_undegraded":"2024-09-12T01:29:50.095583+0000","last_fullsized":"2024-09-12T01:29:50.095583+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:50.095438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:50.095438+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.095438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:30.612733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'2","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.451839+0000","last_change":"2024-09-12T01:29:54.451773+0000","last_active":"2024-09-12T01:29:54.451839+0000","last_peered":"2024-09-12T01:29:54.451839+0000","last_clean":"2024-09-12T01:29:54.451839+0000","last_became_active":"2024-09-12T00:48:42.295358+0000","last_became_peered":"2024-09-12T00:48:42.295358+0000","last_unstale":"2024-09-12T01:29:54.451839+0000","last_undegraded":"2024-09-12T01:29:54.451839+0000","last_fullsized":"2024-09-12T01:29:54.451839+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:54.451686+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:54.451686+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.451686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:14.057355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'81","reported_seq":286,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.477737+0000","last_change":"2024-09-12T01:29:51.477737+0000","last_active":"2024-09-12T01:29:51.477737+0000","last_peered":"2024-09-12T01:29:51.477737+0000","last_clean":"2024-09-12T01:29:51.477737+0000","last_became_active":"2024-09-12T00:46:03.916021+0000","last_became_peered":"2024-09-12T00:46:03.916021+0000","last_unstale":"2024-09-12T01:29:51.477737+0000","last_undegraded":"2024-09-12T01:29:51.477737+0000","last_fullsized":"2024-09-12T01:29:51.477737+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'81","last_scrub_stamp":"2024-09-12T01:29:51.477634+0000","last_deep_scrub":"265'81","last_deep_scrub_stamp":"2024-09-12T01:29:51.477634+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.477634+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:25.082743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":326,"num_write":133,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.731804+0000","last_change":"2024-09-12T01:04:13.466014+0000","last_active":"2024-09-12T01:27:09.731804+0000","last_peered":"2024-09-12T01:27:09.731804+0000","last_clean":"2024-09-12T01:27:09.731804+0000","last_became_active":"2024-09-12T01:04:13.465478+0000","last_became_peered":"2024-09-12T01:04:13.465478+0000","last_unstale":"2024-09-12T01:27:09.731804+0000","last_undegraded":"2024-09-12T01:27:09.731804+0000","last_fullsized":"2024-09-12T01:27:09.731804+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:45.735147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:44.735969+0000","last_change":"2024-09-12T00:48:45.314296+0000","last_active":"2024-09-12T01:27:44.735969+0000","last_peered":"2024-09-12T01:27:44.735969+0000","last_clean":"2024-09-12T01:27:44.735969+0000","last_became_active":"2024-09-12T00:48:45.313057+0000","last_became_peered":"2024-09-12T00:48:45.313057+0000","last_unstale":"2024-09-12T01:27:44.735969+0000","last_undegraded":"2024-09-12T01:27:44.735969+0000","last_fullsized":"2024-09-12T01:27:44.735969+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:44.735983+0000","last_change":"2024-09-12T00:48:42.297183+0000","last_active":"2024-09-12T01:27:44.735983+0000","last_peered":"2024-09-12T01:27:44.735983+0000","last_clean":"2024-09-12T01:27:44.735983+0000","last_became_active":"2024-09-12T00:48:42.296903+0000","last_became_peered":"2024-09-12T00:48:42.296903+0000","last_unstale":"2024-09-12T01:27:44.735983+0000","last_undegraded":"2024-09-12T01:27:44.735983+0000","last_fullsized":"2024-09-12T01:27:44.735983+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'59","reported_seq":254,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.615200+0000","last_change":"2024-09-12T01:29:49.615128+0000","last_active":"2024-09-12T01:29:49.615200+0000","last_peered":"2024-09-12T01:29:49.615200+0000","last_clean":"2024-09-12T01:29:49.615200+0000","last_became_active":"2024-09-12T00:46:03.917131+0000","last_became_peered":"2024-09-12T00:46:03.917131+0000","last_unstale":"2024-09-12T01:29:49.615200+0000","last_undegraded":"2024-09-12T01:29:49.615200+0000","last_fullsized":"2024-09-12T01:29:49.615200+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'59","last_scrub_stamp":"2024-09-12T01:29:49.615033+0000","last_deep_scrub":"265'59","last_deep_scrub_stamp":"2024-09-12T01:29:49.615033+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.615033+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:41.631102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":270,"num_write":80,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":6,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"264'1","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:55.781081+0000","last_change":"2024-09-12T01:04:13.468499+0000","last_active":"2024-09-12T01:25:55.781081+0000","last_peered":"2024-09-12T01:25:55.781081+0000","last_clean":"2024-09-12T01:25:55.781081+0000","last_became_active":"2024-09-12T01:04:13.468116+0000","last_became_peered":"2024-09-12T01:04:13.468116+0000","last_unstale":"2024-09-12T01:25:55.781081+0000","last_undegraded":"2024-09-12T01:25:55.781081+0000","last_fullsized":"2024-09-12T01:25:55.781081+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:15.224566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'5","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.831322+0000","last_change":"2024-09-12T00:48:45.317145+0000","last_active":"2024-09-12T01:29:15.831322+0000","last_peered":"2024-09-12T01:29:15.831322+0000","last_clean":"2024-09-12T01:29:15.831322+0000","last_became_active":"2024-09-12T00:48:45.316713+0000","last_became_peered":"2024-09-12T00:48:45.316713+0000","last_unstale":"2024-09-12T01:29:15.831322+0000","last_undegraded":"2024-09-12T01:29:15.831322+0000","last_fullsized":"2024-09-12T01:29:15.831322+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:03:25.736540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2096,"num_write":10,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.456658+0000","last_change":"2024-09-12T01:29:53.456658+0000","last_active":"2024-09-12T01:29:53.456658+0000","last_peered":"2024-09-12T01:29:53.456658+0000","last_clean":"2024-09-12T01:29:53.456658+0000","last_became_active":"2024-09-12T00:48:42.293111+0000","last_became_peered":"2024-09-12T00:48:42.293111+0000","last_unstale":"2024-09-12T01:29:53.456658+0000","last_undegraded":"2024-09-12T01:29:53.456658+0000","last_fullsized":"2024-09-12T01:29:53.456658+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:53.456571+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:53.456571+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.456571+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:44.113416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'34","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.444517+0000","last_change":"2024-09-12T01:29:50.444517+0000","last_active":"2024-09-12T01:29:50.444517+0000","last_peered":"2024-09-12T01:29:50.444517+0000","last_clean":"2024-09-12T01:29:50.444517+0000","last_became_active":"2024-09-12T00:46:03.914387+0000","last_became_peered":"2024-09-12T00:46:03.914387+0000","last_unstale":"2024-09-12T01:29:50.444517+0000","last_undegraded":"2024-09-12T01:29:50.444517+0000","last_fullsized":"2024-09-12T01:29:50.444517+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'34","last_scrub_stamp":"2024-09-12T01:29:50.444421+0000","last_deep_scrub":"265'34","last_deep_scrub_stamp":"2024-09-12T01:29:50.444421+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.444421+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:00.463389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":24,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:53.499141+0000","last_change":"2024-09-12T01:04:13.470882+0000","last_active":"2024-09-12T01:25:53.499141+0000","last_peered":"2024-09-12T01:25:53.499141+0000","last_clean":"2024-09-12T01:25:53.499141+0000","last_became_active":"2024-09-12T01:04:13.470597+0000","last_became_peered":"2024-09-12T01:04:13.470597+0000","last_unstale":"2024-09-12T01:25:53.499141+0000","last_undegraded":"2024-09-12T01:25:53.499141+0000","last_fullsized":"2024-09-12T01:25:53.499141+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:44.301395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"262'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:49.729085+0000","last_change":"2024-09-12T00:48:45.316493+0000","last_active":"2024-09-12T01:26:49.729085+0000","last_peered":"2024-09-12T01:26:49.729085+0000","last_clean":"2024-09-12T01:26:49.729085+0000","last_became_active":"2024-09-12T00:48:45.316182+0000","last_became_peered":"2024-09-12T00:48:45.316182+0000","last_unstale":"2024-09-12T01:26:49.729085+0000","last_undegraded":"2024-09-12T01:26:49.729085+0000","last_fullsized":"2024-09-12T01:26:49.729085+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:51.175017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:19.740938+0000","last_change":"2024-09-12T00:48:42.294249+0000","last_active":"2024-09-12T01:28:19.740938+0000","last_peered":"2024-09-12T01:28:19.740938+0000","last_clean":"2024-09-12T01:28:19.740938+0000","last_became_active":"2024-09-12T00:48:42.293947+0000","last_became_peered":"2024-09-12T00:48:42.293947+0000","last_unstale":"2024-09-12T01:28:19.740938+0000","last_undegraded":"2024-09-12T01:28:19.740938+0000","last_fullsized":"2024-09-12T01:28:19.740938+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:38.623578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'54","reported_seq":195,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:44.735903+0000","last_change":"2024-09-12T00:46:03.919567+0000","last_active":"2024-09-12T01:27:44.735903+0000","last_peered":"2024-09-12T01:27:44.735903+0000","last_clean":"2024-09-12T01:27:44.735903+0000","last_became_active":"2024-09-12T00:46:03.919285+0000","last_became_peered":"2024-09-12T00:46:03.919285+0000","last_unstale":"2024-09-12T01:27:44.735903+0000","last_undegraded":"2024-09-12T01:27:44.735903+0000","last_fullsized":"2024-09-12T01:27:44.735903+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":102,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:12.509455+0000","last_change":"2024-09-12T01:04:13.467623+0000","last_active":"2024-09-12T01:27:12.509455+0000","last_peered":"2024-09-12T01:27:12.509455+0000","last_clean":"2024-09-12T01:27:12.509455+0000","last_became_active":"2024-09-12T01:04:13.467374+0000","last_became_peered":"2024-09-12T01:04:13.467374+0000","last_unstale":"2024-09-12T01:27:12.509455+0000","last_undegraded":"2024-09-12T01:27:12.509455+0000","last_fullsized":"2024-09-12T01:27:12.509455+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:34.421544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":38,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505968+0000","last_change":"2024-09-12T00:48:45.310759+0000","last_active":"2024-09-12T01:26:14.505968+0000","last_peered":"2024-09-12T01:26:14.505968+0000","last_clean":"2024-09-12T01:26:14.505968+0000","last_became_active":"2024-09-12T00:48:45.310423+0000","last_became_peered":"2024-09-12T00:48:45.310423+0000","last_unstale":"2024-09-12T01:26:14.505968+0000","last_undegraded":"2024-09-12T01:26:14.505968+0000","last_fullsized":"2024-09-12T01:26:14.505968+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:13.622431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:15.639581+0000","last_change":"2024-09-12T00:48:42.296171+0000","last_active":"2024-09-12T01:26:15.639581+0000","last_peered":"2024-09-12T01:26:15.639581+0000","last_clean":"2024-09-12T01:26:15.639581+0000","last_became_active":"2024-09-12T00:48:42.295861+0000","last_became_peered":"2024-09-12T00:48:42.295861+0000","last_unstale":"2024-09-12T01:26:15.639581+0000","last_undegraded":"2024-09-12T01:26:15.639581+0000","last_fullsized":"2024-09-12T01:26:15.639581+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:57.732050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":166,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:44.735881+0000","last_change":"2024-09-12T00:46:03.919535+0000","last_active":"2024-09-12T01:27:44.735881+0000","last_peered":"2024-09-12T01:27:44.735881+0000","last_clean":"2024-09-12T01:27:44.735881+0000","last_became_active":"2024-09-12T00:46:03.917353+0000","last_became_peered":"2024-09-12T00:46:03.917353+0000","last_unstale":"2024-09-12T01:27:44.735881+0000","last_undegraded":"2024-09-12T01:27:44.735881+0000","last_fullsized":"2024-09-12T01:27:44.735881+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:46:02.893610+0000","last_clean_scrub_stamp":"2024-09-12T00:46:02.893610+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":151,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.731874+0000","last_change":"2024-09-12T01:04:13.467110+0000","last_active":"2024-09-12T01:27:09.731874+0000","last_peered":"2024-09-12T01:27:09.731874+0000","last_clean":"2024-09-12T01:27:09.731874+0000","last_became_active":"2024-09-12T01:04:13.466783+0000","last_became_peered":"2024-09-12T01:04:13.466783+0000","last_unstale":"2024-09-12T01:27:09.731874+0000","last_undegraded":"2024-09-12T01:27:09.731874+0000","last_fullsized":"2024-09-12T01:27:09.731874+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:53.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'3","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:14.505931+0000","last_change":"2024-09-12T00:48:45.312610+0000","last_active":"2024-09-12T01:26:14.505931+0000","last_peered":"2024-09-12T01:26:14.505931+0000","last_clean":"2024-09-12T01:26:14.505931+0000","last_became_active":"2024-09-12T00:48:45.312329+0000","last_became_peered":"2024-09-12T00:48:45.312329+0000","last_unstale":"2024-09-12T01:26:14.505931+0000","last_undegraded":"2024-09-12T01:26:14.505931+0000","last_fullsized":"2024-09-12T01:26:14.505931+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:29.308504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'2","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.696233+0000","last_change":"2024-09-12T01:29:51.696233+0000","last_active":"2024-09-12T01:29:51.696233+0000","last_peered":"2024-09-12T01:29:51.696233+0000","last_clean":"2024-09-12T01:29:51.696233+0000","last_became_active":"2024-09-12T00:48:42.286427+0000","last_became_peered":"2024-09-12T00:48:42.286427+0000","last_unstale":"2024-09-12T01:29:51.696233+0000","last_undegraded":"2024-09-12T01:29:51.696233+0000","last_fullsized":"2024-09-12T01:29:51.696233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:51.696120+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:51.696120+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.696120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:25.677211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'46","reported_seq":183,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.404321+0000","last_change":"2024-09-12T01:29:49.404321+0000","last_active":"2024-09-12T01:29:49.404321+0000","last_peered":"2024-09-12T01:29:49.404321+0000","last_clean":"2024-09-12T01:29:49.404321+0000","last_became_active":"2024-09-12T00:46:03.919259+0000","last_became_peered":"2024-09-12T00:46:03.919259+0000","last_unstale":"2024-09-12T01:29:49.404321+0000","last_undegraded":"2024-09-12T01:29:49.404321+0000","last_fullsized":"2024-09-12T01:29:49.404321+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'46","last_scrub_stamp":"2024-09-12T01:29:49.404234+0000","last_deep_scrub":"265'46","last_deep_scrub_stamp":"2024-09-12T01:29:49.404234+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.404234+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:07.003544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":85,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'380","reported_seq":1134,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.020280+0000","last_change":"2024-09-12T01:29:28.020280+0000","last_active":"2024-09-12T01:29:28.020280+0000","last_peered":"2024-09-12T01:29:28.020280+0000","last_clean":"2024-09-12T01:29:28.020280+0000","last_became_active":"2024-09-12T00:31:47.137895+0000","last_became_peered":"2024-09-12T00:31:47.137895+0000","last_unstale":"2024-09-12T01:29:28.020280+0000","last_undegraded":"2024-09-12T01:29:28.020280+0000","last_fullsized":"2024-09-12T01:29:28.020280+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-12T01:29:28.020146+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-12T01:29:28.020146+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.020146+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:56.555166+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":750,"num_read_kb":31522,"num_write":1285,"num_write_kb":24718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'194","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.479650+0000","last_change":"2024-09-12T01:29:36.479650+0000","last_active":"2024-09-12T01:29:36.479650+0000","last_peered":"2024-09-12T01:29:36.479650+0000","last_clean":"2024-09-12T01:29:36.479650+0000","last_became_active":"2024-09-12T00:31:50.138226+0000","last_became_peered":"2024-09-12T00:31:50.138226+0000","last_unstale":"2024-09-12T01:29:36.479650+0000","last_undegraded":"2024-09-12T01:29:36.479650+0000","last_fullsized":"2024-09-12T01:29:36.479650+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'194","last_scrub_stamp":"2024-09-12T01:29:36.479554+0000","last_deep_scrub":"265'194","last_deep_scrub_stamp":"2024-09-12T01:29:36.479554+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.479554+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:41.039566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":913,"num_read_kb":766,"num_write":296,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'314","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.867707+0000","last_change":"2024-09-12T01:29:35.867707+0000","last_active":"2024-09-12T01:29:35.867707+0000","last_peered":"2024-09-12T01:29:35.867707+0000","last_clean":"2024-09-12T01:29:35.867707+0000","last_became_active":"2024-09-12T00:31:47.134134+0000","last_became_peered":"2024-09-12T00:31:47.134134+0000","last_unstale":"2024-09-12T01:29:35.867707+0000","last_undegraded":"2024-09-12T01:29:35.867707+0000","last_fullsized":"2024-09-12T01:29:35.867707+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-12T01:29:35.867548+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-12T01:29:35.867548+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.867548+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:04.584926+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":463,"num_read_kb":16965,"num_write":1018,"num_write_kb":26995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'110","reported_seq":713,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.181613+0000","last_change":"2024-09-12T01:29:43.181613+0000","last_active":"2024-09-12T01:29:43.181613+0000","last_peered":"2024-09-12T01:29:43.181613+0000","last_clean":"2024-09-12T01:29:43.181613+0000","last_became_active":"2024-09-12T00:31:50.132639+0000","last_became_peered":"2024-09-12T00:31:50.132639+0000","last_unstale":"2024-09-12T01:29:43.181613+0000","last_undegraded":"2024-09-12T01:29:43.181613+0000","last_fullsized":"2024-09-12T01:29:43.181613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T01:29:43.181524+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T01:29:43.181524+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.181524+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:50.689163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":165,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'368","reported_seq":1115,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.955684+0000","last_change":"2024-09-12T01:29:32.955684+0000","last_active":"2024-09-12T01:29:32.955684+0000","last_peered":"2024-09-12T01:29:32.955684+0000","last_clean":"2024-09-12T01:29:32.955684+0000","last_became_active":"2024-09-12T00:31:47.119865+0000","last_became_peered":"2024-09-12T00:31:47.119865+0000","last_unstale":"2024-09-12T01:29:32.955684+0000","last_undegraded":"2024-09-12T01:29:32.955684+0000","last_fullsized":"2024-09-12T01:29:32.955684+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T01:29:32.955566+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T01:29:32.955566+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.955566+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:34.193090+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344922,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":840,"num_read_kb":4429,"num_write":1181,"num_write_kb":10543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'286","reported_seq":944,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.192741+0000","last_change":"2024-09-12T01:29:44.192741+0000","last_active":"2024-09-12T01:29:44.192741+0000","last_peered":"2024-09-12T01:29:44.192741+0000","last_clean":"2024-09-12T01:29:44.192741+0000","last_became_active":"2024-09-12T00:31:50.135413+0000","last_became_peered":"2024-09-12T00:31:50.135413+0000","last_unstale":"2024-09-12T01:29:44.192741+0000","last_undegraded":"2024-09-12T01:29:44.192741+0000","last_fullsized":"2024-09-12T01:29:44.192741+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'286","last_scrub_stamp":"2024-09-12T01:29:44.192668+0000","last_deep_scrub":"265'286","last_deep_scrub_stamp":"2024-09-12T01:29:44.192668+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.192668+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:39.104901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1012,"num_write":455,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'315","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.404656+0000","last_change":"2024-09-12T01:29:27.404656+0000","last_active":"2024-09-12T01:29:27.404656+0000","last_peered":"2024-09-12T01:29:27.404656+0000","last_clean":"2024-09-12T01:29:27.404656+0000","last_became_active":"2024-09-12T00:31:47.133414+0000","last_became_peered":"2024-09-12T00:31:47.133414+0000","last_unstale":"2024-09-12T01:29:27.404656+0000","last_undegraded":"2024-09-12T01:29:27.404656+0000","last_fullsized":"2024-09-12T01:29:27.404656+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'315","last_scrub_stamp":"2024-09-12T01:29:27.404449+0000","last_deep_scrub":"265'315","last_deep_scrub_stamp":"2024-09-12T01:29:27.404449+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.404449+0000","objects_scrubbed":11,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:30.134243+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11933654,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":465,"num_read_kb":32236,"num_write":1054,"num_write_kb":37937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'183","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.543227+0000","last_change":"2024-09-12T01:29:35.543227+0000","last_active":"2024-09-12T01:29:35.543227+0000","last_peered":"2024-09-12T01:29:35.543227+0000","last_clean":"2024-09-12T01:29:35.543227+0000","last_became_active":"2024-09-12T00:31:50.135322+0000","last_became_peered":"2024-09-12T00:31:50.135322+0000","last_unstale":"2024-09-12T01:29:35.543227+0000","last_undegraded":"2024-09-12T01:29:35.543227+0000","last_fullsized":"2024-09-12T01:29:35.543227+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'183","last_scrub_stamp":"2024-09-12T01:29:35.543144+0000","last_deep_scrub":"265'183","last_deep_scrub_stamp":"2024-09-12T01:29:35.543144+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.543144+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:36.766989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":591,"num_write":296,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'319","reported_seq":951,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.045050+0000","last_change":"2024-09-12T01:29:29.045050+0000","last_active":"2024-09-12T01:29:29.045050+0000","last_peered":"2024-09-12T01:29:29.045050+0000","last_clean":"2024-09-12T01:29:29.045050+0000","last_became_active":"2024-09-12T00:31:47.128016+0000","last_became_peered":"2024-09-12T00:31:47.128016+0000","last_unstale":"2024-09-12T01:29:29.045050+0000","last_undegraded":"2024-09-12T01:29:29.045050+0000","last_fullsized":"2024-09-12T01:29:29.045050+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T01:29:29.044943+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T01:29:29.044943+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.044943+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:09.317724+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":458,"num_read_kb":35042,"num_write":1048,"num_write_kb":20184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'220","reported_seq":848,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.168640+0000","last_change":"2024-09-12T01:29:36.168558+0000","last_active":"2024-09-12T01:29:36.168640+0000","last_peered":"2024-09-12T01:29:36.168640+0000","last_clean":"2024-09-12T01:29:36.168640+0000","last_became_active":"2024-09-12T00:31:50.132674+0000","last_became_peered":"2024-09-12T00:31:50.132674+0000","last_unstale":"2024-09-12T01:29:36.168640+0000","last_undegraded":"2024-09-12T01:29:36.168640+0000","last_fullsized":"2024-09-12T01:29:36.168640+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'220","last_scrub_stamp":"2024-09-12T01:29:36.168468+0000","last_deep_scrub":"265'220","last_deep_scrub_stamp":"2024-09-12T01:29:36.168468+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.168468+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:46.453708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":967,"num_read_kb":781,"num_write":356,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'365","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.391195+0000","last_change":"2024-09-12T01:29:24.391195+0000","last_active":"2024-09-12T01:29:24.391195+0000","last_peered":"2024-09-12T01:29:24.391195+0000","last_clean":"2024-09-12T01:29:24.391195+0000","last_became_active":"2024-09-12T00:31:47.134887+0000","last_became_peered":"2024-09-12T00:31:47.134887+0000","last_unstale":"2024-09-12T01:29:24.391195+0000","last_undegraded":"2024-09-12T01:29:24.391195+0000","last_fullsized":"2024-09-12T01:29:24.391195+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:29:24.391061+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:29:24.391061+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.391061+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.168982+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396853,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":509,"num_read_kb":3274,"num_write":1223,"num_write_kb":38824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'275","reported_seq":858,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.146593+0000","last_change":"2024-09-12T01:29:34.146593+0000","last_active":"2024-09-12T01:29:34.146593+0000","last_peered":"2024-09-12T01:29:34.146593+0000","last_clean":"2024-09-12T01:29:34.146593+0000","last_became_active":"2024-09-12T00:31:50.140087+0000","last_became_peered":"2024-09-12T00:31:50.140087+0000","last_unstale":"2024-09-12T01:29:34.146593+0000","last_undegraded":"2024-09-12T01:29:34.146593+0000","last_fullsized":"2024-09-12T01:29:34.146593+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'275","last_scrub_stamp":"2024-09-12T01:29:34.146509+0000","last_deep_scrub":"265'275","last_deep_scrub_stamp":"2024-09-12T01:29:34.146509+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.146509+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:19.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1141,"num_read_kb":956,"num_write":415,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'392","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.099075+0000","last_change":"2024-09-12T01:29:37.099016+0000","last_active":"2024-09-12T01:29:37.099075+0000","last_peered":"2024-09-12T01:29:37.099075+0000","last_clean":"2024-09-12T01:29:37.099075+0000","last_became_active":"2024-09-12T00:32:23.830676+0000","last_became_peered":"2024-09-12T00:32:23.830676+0000","last_unstale":"2024-09-12T01:29:37.099075+0000","last_undegraded":"2024-09-12T01:29:37.099075+0000","last_fullsized":"2024-09-12T01:29:37.099075+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'392","last_scrub_stamp":"2024-09-12T01:29:37.098873+0000","last_deep_scrub":"265'392","last_deep_scrub_stamp":"2024-09-12T01:29:37.098873+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.098873+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:30.205825+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170251,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":5774,"num_write":1256,"num_write_kb":23845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3e","version":"265'51","reported_seq":598,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.403863+0000","last_change":"2024-09-12T01:29:32.403863+0000","last_active":"2024-09-12T01:29:32.403863+0000","last_peered":"2024-09-12T01:29:32.403863+0000","last_clean":"2024-09-12T01:29:32.403863+0000","last_became_active":"2024-09-12T00:31:50.140207+0000","last_became_peered":"2024-09-12T00:31:50.140207+0000","last_unstale":"2024-09-12T01:29:32.403863+0000","last_undegraded":"2024-09-12T01:29:32.403863+0000","last_fullsized":"2024-09-12T01:29:32.403863+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'51","last_scrub_stamp":"2024-09-12T01:29:32.403772+0000","last_deep_scrub":"265'51","last_deep_scrub_stamp":"2024-09-12T01:29:32.403772+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.403772+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:53.477543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":145,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'386","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.878927+0000","last_change":"2024-09-12T01:29:30.878927+0000","last_active":"2024-09-12T01:29:30.878927+0000","last_peered":"2024-09-12T01:29:30.878927+0000","last_clean":"2024-09-12T01:29:30.878927+0000","last_became_active":"2024-09-12T00:31:47.127930+0000","last_became_peered":"2024-09-12T00:31:47.127930+0000","last_unstale":"2024-09-12T01:29:30.878927+0000","last_undegraded":"2024-09-12T01:29:30.878927+0000","last_fullsized":"2024-09-12T01:29:30.878927+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T01:29:30.878794+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T01:29:30.878794+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.878794+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:54.052551+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396864,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":638,"num_read_kb":6946,"num_write":1462,"num_write_kb":29009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'96","reported_seq":696,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.748418+0000","last_change":"2024-09-12T01:29:45.748418+0000","last_active":"2024-09-12T01:29:45.748418+0000","last_peered":"2024-09-12T01:29:45.748418+0000","last_clean":"2024-09-12T01:29:45.748418+0000","last_became_active":"2024-09-12T00:31:50.142071+0000","last_became_peered":"2024-09-12T00:31:50.142071+0000","last_unstale":"2024-09-12T01:29:45.748418+0000","last_undegraded":"2024-09-12T01:29:45.748418+0000","last_fullsized":"2024-09-12T01:29:45.748418+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T01:29:45.748330+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T01:29:45.748330+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.748330+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:43.499736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":364,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'86","reported_seq":698,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.140496+0000","last_change":"2024-09-12T01:29:42.140496+0000","last_active":"2024-09-12T01:29:42.140496+0000","last_peered":"2024-09-12T01:29:42.140496+0000","last_clean":"2024-09-12T01:29:42.140496+0000","last_became_active":"2024-09-12T00:31:50.132178+0000","last_became_peered":"2024-09-12T00:31:50.132178+0000","last_unstale":"2024-09-12T01:29:42.140496+0000","last_undegraded":"2024-09-12T01:29:42.140496+0000","last_fullsized":"2024-09-12T01:29:42.140496+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'86","last_scrub_stamp":"2024-09-12T01:29:42.140402+0000","last_deep_scrub":"265'86","last_deep_scrub_stamp":"2024-09-12T01:29:42.140402+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.140402+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:41.914291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":346,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'333","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.353401+0000","last_change":"2024-09-12T01:29:24.353300+0000","last_active":"2024-09-12T01:29:24.353401+0000","last_peered":"2024-09-12T01:29:24.353401+0000","last_clean":"2024-09-12T01:29:24.353401+0000","last_became_active":"2024-09-12T00:31:47.123956+0000","last_became_peered":"2024-09-12T00:31:47.123956+0000","last_unstale":"2024-09-12T01:29:24.353401+0000","last_undegraded":"2024-09-12T01:29:24.353401+0000","last_fullsized":"2024-09-12T01:29:24.353401+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T01:29:24.353156+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T01:29:24.353156+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.353156+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:57.167462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525329,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":483,"num_read_kb":32458,"num_write":1127,"num_write_kb":22794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'162","reported_seq":816,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.098935+0000","last_change":"2024-09-12T01:29:32.098935+0000","last_active":"2024-09-12T01:29:32.098935+0000","last_peered":"2024-09-12T01:29:32.098935+0000","last_clean":"2024-09-12T01:29:32.098935+0000","last_became_active":"2024-09-12T00:31:50.130844+0000","last_became_peered":"2024-09-12T00:31:50.130844+0000","last_unstale":"2024-09-12T01:29:32.098935+0000","last_undegraded":"2024-09-12T01:29:32.098935+0000","last_fullsized":"2024-09-12T01:29:32.098935+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-12T01:29:32.098837+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-12T01:29:32.098837+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.098837+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:49.537667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":634,"num_write":246,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'260","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.982245+0000","last_change":"2024-09-12T01:29:26.982139+0000","last_active":"2024-09-12T01:29:26.982245+0000","last_peered":"2024-09-12T01:29:26.982245+0000","last_clean":"2024-09-12T01:29:26.982245+0000","last_became_active":"2024-09-12T00:31:47.127400+0000","last_became_peered":"2024-09-12T00:31:47.127400+0000","last_unstale":"2024-09-12T01:29:26.982245+0000","last_undegraded":"2024-09-12T01:29:26.982245+0000","last_fullsized":"2024-09-12T01:29:26.982245+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-12T01:29:26.981947+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-12T01:29:26.981947+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.981947+0000","objects_scrubbed":7,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:05.911480+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133724,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":320,"num_read_kb":20510,"num_write":796,"num_write_kb":47522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'404","reported_seq":1178,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.443336+0000","last_change":"2024-09-12T01:29:30.443336+0000","last_active":"2024-09-12T01:29:30.443336+0000","last_peered":"2024-09-12T01:29:30.443336+0000","last_clean":"2024-09-12T01:29:30.443336+0000","last_became_active":"2024-09-12T00:31:50.142337+0000","last_became_peered":"2024-09-12T00:31:50.142337+0000","last_unstale":"2024-09-12T01:29:30.443336+0000","last_undegraded":"2024-09-12T01:29:30.443336+0000","last_fullsized":"2024-09-12T01:29:30.443336+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'404","last_scrub_stamp":"2024-09-12T01:29:30.443248+0000","last_deep_scrub":"265'404","last_deep_scrub_stamp":"2024-09-12T01:29:30.443248+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.443248+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:45.435463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1845,"num_write":683,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'316","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.956034+0000","last_change":"2024-09-12T01:29:25.955954+0000","last_active":"2024-09-12T01:29:25.956034+0000","last_peered":"2024-09-12T01:29:25.956034+0000","last_clean":"2024-09-12T01:29:25.956034+0000","last_became_active":"2024-09-12T00:31:47.139517+0000","last_became_peered":"2024-09-12T00:31:47.139517+0000","last_unstale":"2024-09-12T01:29:25.956034+0000","last_undegraded":"2024-09-12T01:29:25.956034+0000","last_fullsized":"2024-09-12T01:29:25.956034+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T01:29:25.955816+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T01:29:25.955816+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.955816+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:56.138848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788540,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":6586,"num_write":1090,"num_write_kb":25928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'147","reported_seq":735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.097542+0000","last_change":"2024-09-12T01:29:39.097461+0000","last_active":"2024-09-12T01:29:39.097542+0000","last_peered":"2024-09-12T01:29:39.097542+0000","last_clean":"2024-09-12T01:29:39.097542+0000","last_became_active":"2024-09-12T00:31:50.142311+0000","last_became_peered":"2024-09-12T00:31:50.142311+0000","last_unstale":"2024-09-12T01:29:39.097542+0000","last_undegraded":"2024-09-12T01:29:39.097542+0000","last_fullsized":"2024-09-12T01:29:39.097542+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'147","last_scrub_stamp":"2024-09-12T01:29:39.097377+0000","last_deep_scrub":"265'147","last_deep_scrub_stamp":"2024-09-12T01:29:39.097377+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.097377+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:58.929897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":237,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'262","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.987977+0000","last_change":"2024-09-12T01:29:24.987898+0000","last_active":"2024-09-12T01:29:24.987977+0000","last_peered":"2024-09-12T01:29:24.987977+0000","last_clean":"2024-09-12T01:29:24.987977+0000","last_became_active":"2024-09-12T00:31:47.130329+0000","last_became_peered":"2024-09-12T00:31:47.130329+0000","last_unstale":"2024-09-12T01:29:24.987977+0000","last_undegraded":"2024-09-12T01:29:24.987977+0000","last_fullsized":"2024-09-12T01:29:24.987977+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'262","last_scrub_stamp":"2024-09-12T01:29:24.987705+0000","last_deep_scrub":"265'262","last_deep_scrub_stamp":"2024-09-12T01:29:24.987705+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.987705+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:33.987536+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287558,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":37644,"num_write":765,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'112","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.800061+0000","last_change":"2024-09-12T01:29:38.800006+0000","last_active":"2024-09-12T01:29:38.800061+0000","last_peered":"2024-09-12T01:29:38.800061+0000","last_clean":"2024-09-12T01:29:38.800061+0000","last_became_active":"2024-09-12T00:31:50.135595+0000","last_became_peered":"2024-09-12T00:31:50.135595+0000","last_unstale":"2024-09-12T01:29:38.800061+0000","last_undegraded":"2024-09-12T01:29:38.800061+0000","last_fullsized":"2024-09-12T01:29:38.800061+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'112","last_scrub_stamp":"2024-09-12T01:29:38.799863+0000","last_deep_scrub":"265'112","last_deep_scrub_stamp":"2024-09-12T01:29:38.799863+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.799863+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:28.775891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":410,"num_write":180,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'318","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.179424+0000","last_change":"2024-09-12T01:29:31.179350+0000","last_active":"2024-09-12T01:29:31.179424+0000","last_peered":"2024-09-12T01:29:31.179424+0000","last_clean":"2024-09-12T01:29:31.179424+0000","last_became_active":"2024-09-12T00:31:47.133592+0000","last_became_peered":"2024-09-12T00:31:47.133592+0000","last_unstale":"2024-09-12T01:29:31.179424+0000","last_undegraded":"2024-09-12T01:29:31.179424+0000","last_fullsized":"2024-09-12T01:29:31.179424+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T01:29:31.179182+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T01:29:31.179182+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.179182+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:48.318104+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396882,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":783,"num_read_kb":29951,"num_write":1081,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'73","reported_seq":633,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.418748+0000","last_change":"2024-09-12T01:29:31.418672+0000","last_active":"2024-09-12T01:29:31.418748+0000","last_peered":"2024-09-12T01:29:31.418748+0000","last_clean":"2024-09-12T01:29:31.418748+0000","last_became_active":"2024-09-12T00:31:50.135972+0000","last_became_peered":"2024-09-12T00:31:50.135972+0000","last_unstale":"2024-09-12T01:29:31.418748+0000","last_undegraded":"2024-09-12T01:29:31.418748+0000","last_fullsized":"2024-09-12T01:29:31.418748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'73","last_scrub_stamp":"2024-09-12T01:29:31.418583+0000","last_deep_scrub":"265'73","last_deep_scrub_stamp":"2024-09-12T01:29:31.418583+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.418583+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:39.743725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":249,"num_write":116,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'312","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.185734+0000","last_change":"2024-09-12T01:29:30.185734+0000","last_active":"2024-09-12T01:29:30.185734+0000","last_peered":"2024-09-12T01:29:30.185734+0000","last_clean":"2024-09-12T01:29:30.185734+0000","last_became_active":"2024-09-12T00:31:47.118260+0000","last_became_peered":"2024-09-12T00:31:47.118260+0000","last_unstale":"2024-09-12T01:29:30.185734+0000","last_undegraded":"2024-09-12T01:29:30.185734+0000","last_fullsized":"2024-09-12T01:29:30.185734+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T01:29:30.185600+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T01:29:30.185600+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.185600+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:50.982982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":15045,"num_write":981,"num_write_kb":26498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'125","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.105584+0000","last_change":"2024-09-12T01:29:46.105512+0000","last_active":"2024-09-12T01:29:46.105584+0000","last_peered":"2024-09-12T01:29:46.105584+0000","last_clean":"2024-09-12T01:29:46.105584+0000","last_became_active":"2024-09-12T00:31:58.183784+0000","last_became_peered":"2024-09-12T00:31:58.183784+0000","last_unstale":"2024-09-12T01:29:46.105584+0000","last_undegraded":"2024-09-12T01:29:46.105584+0000","last_fullsized":"2024-09-12T01:29:46.105584+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-12T01:29:46.105425+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-12T01:29:46.105425+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.105425+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:30.670313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":134,"num_write":297,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'230","reported_seq":841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.113884+0000","last_change":"2024-09-12T01:29:36.113884+0000","last_active":"2024-09-12T01:29:36.113884+0000","last_peered":"2024-09-12T01:29:36.113884+0000","last_clean":"2024-09-12T01:29:36.113884+0000","last_became_active":"2024-09-12T00:31:50.140510+0000","last_became_peered":"2024-09-12T00:31:50.140510+0000","last_unstale":"2024-09-12T01:29:36.113884+0000","last_undegraded":"2024-09-12T01:29:36.113884+0000","last_fullsized":"2024-09-12T01:29:36.113884+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'230","last_scrub_stamp":"2024-09-12T01:29:36.113803+0000","last_deep_scrub":"265'230","last_deep_scrub_stamp":"2024-09-12T01:29:36.113803+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.113803+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:49.872114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":944,"num_read_kb":762,"num_write":358,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'334","reported_seq":954,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.026172+0000","last_change":"2024-09-12T01:29:29.026172+0000","last_active":"2024-09-12T01:29:29.026172+0000","last_peered":"2024-09-12T01:29:29.026172+0000","last_clean":"2024-09-12T01:29:29.026172+0000","last_became_active":"2024-09-12T00:31:47.131940+0000","last_became_peered":"2024-09-12T00:31:47.131940+0000","last_unstale":"2024-09-12T01:29:29.026172+0000","last_undegraded":"2024-09-12T01:29:29.026172+0000","last_fullsized":"2024-09-12T01:29:29.026172+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-12T01:29:29.026060+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-12T01:29:29.026060+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.026060+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:53.704154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":467,"num_read_kb":415,"num_write":1065,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.256489+0000","last_change":"2024-09-12T01:29:48.256427+0000","last_active":"2024-09-12T01:29:48.256489+0000","last_peered":"2024-09-12T01:29:48.256489+0000","last_clean":"2024-09-12T01:29:48.256489+0000","last_became_active":"2024-09-12T00:31:52.151351+0000","last_became_peered":"2024-09-12T00:31:52.151351+0000","last_unstale":"2024-09-12T01:29:48.256489+0000","last_undegraded":"2024-09-12T01:29:48.256489+0000","last_fullsized":"2024-09-12T01:29:48.256489+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:48.256334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:48.256334+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.256334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:34.954985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'347","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.541811+0000","last_change":"2024-09-12T01:29:48.541750+0000","last_active":"2024-09-12T01:29:48.541811+0000","last_peered":"2024-09-12T01:29:48.541811+0000","last_clean":"2024-09-12T01:29:48.541811+0000","last_became_active":"2024-09-12T00:31:54.168545+0000","last_became_peered":"2024-09-12T00:31:54.168545+0000","last_unstale":"2024-09-12T01:29:48.541811+0000","last_undegraded":"2024-09-12T01:29:48.541811+0000","last_fullsized":"2024-09-12T01:29:48.541811+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:29:48.541646+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:29:48.541646+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.541646+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:19.169014+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45599,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":546,"num_read_kb":1097,"num_write":426,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.658861+0000","last_change":"2024-09-12T01:29:46.658802+0000","last_active":"2024-09-12T01:29:46.658861+0000","last_peered":"2024-09-12T01:29:46.658861+0000","last_clean":"2024-09-12T01:29:46.658861+0000","last_became_active":"2024-09-12T00:31:56.170837+0000","last_became_peered":"2024-09-12T00:31:56.170837+0000","last_unstale":"2024-09-12T01:29:46.658861+0000","last_undegraded":"2024-09-12T01:29:46.658861+0000","last_fullsized":"2024-09-12T01:29:46.658861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:46.658708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:46.658708+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.658708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:05.228373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2468","reported_seq":4364,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.727664+0000","last_change":"2024-09-12T01:29:58.727664+0000","last_active":"2024-09-12T01:29:58.727664+0000","last_peered":"2024-09-12T01:29:58.727664+0000","last_clean":"2024-09-12T01:29:58.727664+0000","last_became_active":"2024-09-12T00:31:58.181552+0000","last_became_peered":"2024-09-12T00:31:58.181552+0000","last_unstale":"2024-09-12T01:29:58.727664+0000","last_undegraded":"2024-09-12T01:29:58.727664+0000","last_fullsized":"2024-09-12T01:29:58.727664+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2468","last_scrub_stamp":"2024-09-12T01:29:58.727567+0000","last_deep_scrub":"265'2468","last_deep_scrub_stamp":"2024-09-12T01:29:58.727567+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.727567+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":2400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:51.613333+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":617,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6112,"num_read_kb":6115,"num_write":4931,"num_write_kb":1807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'4138","reported_seq":4759,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.099348+0000","last_change":"2024-09-12T01:29:39.099282+0000","last_active":"2024-09-12T01:29:39.099348+0000","last_peered":"2024-09-12T01:29:39.099348+0000","last_clean":"2024-09-12T01:29:39.099348+0000","last_became_active":"2024-09-12T00:31:50.133357+0000","last_became_peered":"2024-09-12T00:31:50.133357+0000","last_unstale":"2024-09-12T01:29:39.099348+0000","last_undegraded":"2024-09-12T01:29:39.099348+0000","last_fullsized":"2024-09-12T01:29:39.099348+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4138","last_scrub_stamp":"2024-09-12T01:29:39.099192+0000","last_deep_scrub":"265'4138","last_deep_scrub_stamp":"2024-09-12T01:29:39.099192+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.099192+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":3000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:48.646221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16657,"num_read_kb":13895,"num_write":6209,"num_write_kb":3095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'296","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.186057+0000","last_change":"2024-09-12T01:29:27.186057+0000","last_active":"2024-09-12T01:29:27.186057+0000","last_peered":"2024-09-12T01:29:27.186057+0000","last_clean":"2024-09-12T01:29:27.186057+0000","last_became_active":"2024-09-12T00:31:47.131849+0000","last_became_peered":"2024-09-12T00:31:47.131849+0000","last_unstale":"2024-09-12T01:29:27.186057+0000","last_undegraded":"2024-09-12T01:29:27.186057+0000","last_fullsized":"2024-09-12T01:29:27.186057+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'296","last_scrub_stamp":"2024-09-12T01:29:27.185965+0000","last_deep_scrub":"265'296","last_deep_scrub_stamp":"2024-09-12T01:29:27.185965+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.185965+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:13.318989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":405,"num_read_kb":4533,"num_write":946,"num_write_kb":25027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":511,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.614929+0000","last_change":"2024-09-12T01:29:38.614929+0000","last_active":"2024-09-12T01:29:38.614929+0000","last_peered":"2024-09-12T01:29:38.614929+0000","last_clean":"2024-09-12T01:29:38.614929+0000","last_became_active":"2024-09-12T00:31:52.152244+0000","last_became_peered":"2024-09-12T00:31:52.152244+0000","last_unstale":"2024-09-12T01:29:38.614929+0000","last_undegraded":"2024-09-12T01:29:38.614929+0000","last_fullsized":"2024-09-12T01:29:38.614929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:38.614815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:38.614815+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.614815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:05.675092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'98","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.558815+0000","last_change":"2024-09-12T01:29:40.558746+0000","last_active":"2024-09-12T01:29:40.558815+0000","last_peered":"2024-09-12T01:29:40.558815+0000","last_clean":"2024-09-12T01:29:40.558815+0000","last_became_active":"2024-09-12T00:31:54.167260+0000","last_became_peered":"2024-09-12T00:31:54.167260+0000","last_unstale":"2024-09-12T01:29:40.558815+0000","last_undegraded":"2024-09-12T01:29:40.558815+0000","last_fullsized":"2024-09-12T01:29:40.558815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'98","last_scrub_stamp":"2024-09-12T01:29:40.558641+0000","last_deep_scrub":"265'98","last_deep_scrub_stamp":"2024-09-12T01:29:40.558641+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.558641+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:35.210876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":103,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.680896+0000","last_change":"2024-09-12T01:29:45.680841+0000","last_active":"2024-09-12T01:29:45.680896+0000","last_peered":"2024-09-12T01:29:45.680896+0000","last_clean":"2024-09-12T01:29:45.680896+0000","last_became_active":"2024-09-12T00:31:56.174452+0000","last_became_peered":"2024-09-12T00:31:56.174452+0000","last_unstale":"2024-09-12T01:29:45.680896+0000","last_undegraded":"2024-09-12T01:29:45.680896+0000","last_fullsized":"2024-09-12T01:29:45.680896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:45.680751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:45.680751+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.680751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:47.024821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'148","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.109726+0000","last_change":"2024-09-12T01:29:53.109726+0000","last_active":"2024-09-12T01:29:53.109726+0000","last_peered":"2024-09-12T01:29:53.109726+0000","last_clean":"2024-09-12T01:29:53.109726+0000","last_became_active":"2024-09-12T00:31:58.178748+0000","last_became_peered":"2024-09-12T00:31:58.178748+0000","last_unstale":"2024-09-12T01:29:53.109726+0000","last_undegraded":"2024-09-12T01:29:53.109726+0000","last_fullsized":"2024-09-12T01:29:53.109726+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'148","last_scrub_stamp":"2024-09-12T01:29:53.109644+0000","last_deep_scrub":"265'148","last_deep_scrub_stamp":"2024-09-12T01:29:53.109644+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.109644+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:57.155666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":137,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'401","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.760451+0000","last_change":"2024-09-12T01:29:42.760397+0000","last_active":"2024-09-12T01:29:42.760451+0000","last_peered":"2024-09-12T01:29:42.760451+0000","last_clean":"2024-09-12T01:29:42.760451+0000","last_became_active":"2024-09-12T00:31:50.143399+0000","last_became_peered":"2024-09-12T00:31:50.143399+0000","last_unstale":"2024-09-12T01:29:42.760451+0000","last_undegraded":"2024-09-12T01:29:42.760451+0000","last_fullsized":"2024-09-12T01:29:42.760451+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'401","last_scrub_stamp":"2024-09-12T01:29:42.760314+0000","last_deep_scrub":"265'401","last_deep_scrub_stamp":"2024-09-12T01:29:42.760314+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.760314+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:20.228207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1799,"num_read_kb":1492,"num_write":673,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'331","reported_seq":1119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.234661+0000","last_change":"2024-09-12T01:29:24.234661+0000","last_active":"2024-09-12T01:29:24.234661+0000","last_peered":"2024-09-12T01:29:24.234661+0000","last_clean":"2024-09-12T01:29:24.234661+0000","last_became_active":"2024-09-12T00:32:23.830863+0000","last_became_peered":"2024-09-12T00:32:23.830863+0000","last_unstale":"2024-09-12T01:29:24.234661+0000","last_undegraded":"2024-09-12T01:29:24.234661+0000","last_fullsized":"2024-09-12T01:29:24.234661+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T01:29:24.234562+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T01:29:24.234562+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.234562+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:32.668950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569327,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":866,"num_read_kb":9184,"num_write":1035,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":511,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.565070+0000","last_change":"2024-09-12T01:29:42.564959+0000","last_active":"2024-09-12T01:29:42.565070+0000","last_peered":"2024-09-12T01:29:42.565070+0000","last_clean":"2024-09-12T01:29:42.565070+0000","last_became_active":"2024-09-12T00:31:52.154077+0000","last_became_peered":"2024-09-12T00:31:52.154077+0000","last_unstale":"2024-09-12T01:29:42.565070+0000","last_undegraded":"2024-09-12T01:29:42.565070+0000","last_fullsized":"2024-09-12T01:29:42.565070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:42.564848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:42.564848+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.564848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:53.035581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'126","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.592329+0000","last_change":"2024-09-12T01:29:50.592329+0000","last_active":"2024-09-12T01:29:50.592329+0000","last_peered":"2024-09-12T01:29:50.592329+0000","last_clean":"2024-09-12T01:29:50.592329+0000","last_became_active":"2024-09-12T00:31:54.163434+0000","last_became_peered":"2024-09-12T00:31:54.163434+0000","last_unstale":"2024-09-12T01:29:50.592329+0000","last_undegraded":"2024-09-12T01:29:50.592329+0000","last_fullsized":"2024-09-12T01:29:50.592329+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T01:29:50.592220+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T01:29:50.592220+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.592220+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:46.135715+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":152,"num_read_kb":145,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'782","reported_seq":4221,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:16.491460+0000","last_change":"2024-09-12T00:31:56.171437+0000","last_active":"2024-09-12T01:29:16.491460+0000","last_peered":"2024-09-12T01:29:16.491460+0000","last_clean":"2024-09-12T01:29:16.491460+0000","last_became_active":"2024-09-12T00:31:56.171157+0000","last_became_peered":"2024-09-12T00:31:56.171157+0000","last_unstale":"2024-09-12T01:29:16.491460+0000","last_undegraded":"2024-09-12T01:29:16.491460+0000","last_fullsized":"2024-09-12T01:29:16.491460+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":700,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'203","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.417304+0000","last_change":"2024-09-12T01:29:48.417304+0000","last_active":"2024-09-12T01:29:48.417304+0000","last_peered":"2024-09-12T01:29:48.417304+0000","last_clean":"2024-09-12T01:29:48.417304+0000","last_became_active":"2024-09-12T00:31:58.179576+0000","last_became_peered":"2024-09-12T00:31:58.179576+0000","last_unstale":"2024-09-12T01:29:48.417304+0000","last_undegraded":"2024-09-12T01:29:48.417304+0000","last_fullsized":"2024-09-12T01:29:48.417304+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'203","last_scrub_stamp":"2024-09-12T01:29:48.417212+0000","last_deep_scrub":"265'203","last_deep_scrub_stamp":"2024-09-12T01:29:48.417212+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.417212+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:53.762406+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":631,"num_write":454,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'419","reported_seq":1167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.756579+0000","last_change":"2024-09-12T01:29:40.756481+0000","last_active":"2024-09-12T01:29:40.756579+0000","last_peered":"2024-09-12T01:29:40.756579+0000","last_clean":"2024-09-12T01:29:40.756579+0000","last_became_active":"2024-09-12T00:31:50.140485+0000","last_became_peered":"2024-09-12T00:31:50.140485+0000","last_unstale":"2024-09-12T01:29:40.756579+0000","last_undegraded":"2024-09-12T01:29:40.756579+0000","last_fullsized":"2024-09-12T01:29:40.756579+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'419","last_scrub_stamp":"2024-09-12T01:29:40.756379+0000","last_deep_scrub":"265'419","last_deep_scrub_stamp":"2024-09-12T01:29:40.756379+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.756379+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:43.561319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2003,"num_read_kb":1658,"num_write":744,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7569,"num_omap_keys":32,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'321","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.346493+0000","last_change":"2024-09-12T01:29:21.346493+0000","last_active":"2024-09-12T01:29:21.346493+0000","last_peered":"2024-09-12T01:29:21.346493+0000","last_clean":"2024-09-12T01:29:21.346493+0000","last_became_active":"2024-09-12T00:31:47.125118+0000","last_became_peered":"2024-09-12T00:31:47.125118+0000","last_unstale":"2024-09-12T01:29:21.346493+0000","last_undegraded":"2024-09-12T01:29:21.346493+0000","last_fullsized":"2024-09-12T01:29:21.346493+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'321","last_scrub_stamp":"2024-09-12T01:29:21.346370+0000","last_deep_scrub":"265'321","last_deep_scrub_stamp":"2024-09-12T01:29:21.346370+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.346370+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:00.319828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209058,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":536,"num_read_kb":32880,"num_write":1078,"num_write_kb":23042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.268118+0000","last_change":"2024-09-12T01:29:49.268042+0000","last_active":"2024-09-12T01:29:49.268118+0000","last_peered":"2024-09-12T01:29:49.268118+0000","last_clean":"2024-09-12T01:29:49.268118+0000","last_became_active":"2024-09-12T00:31:52.154189+0000","last_became_peered":"2024-09-12T00:31:52.154189+0000","last_unstale":"2024-09-12T01:29:49.268118+0000","last_undegraded":"2024-09-12T01:29:49.268118+0000","last_fullsized":"2024-09-12T01:29:49.268118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:49.267948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:49.267948+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.267948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:55.800816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'280","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.407718+0000","last_change":"2024-09-12T01:29:40.407647+0000","last_active":"2024-09-12T01:29:40.407718+0000","last_peered":"2024-09-12T01:29:40.407718+0000","last_clean":"2024-09-12T01:29:40.407718+0000","last_became_active":"2024-09-12T00:31:54.171354+0000","last_became_peered":"2024-09-12T00:31:54.171354+0000","last_unstale":"2024-09-12T01:29:40.407718+0000","last_undegraded":"2024-09-12T01:29:40.407718+0000","last_fullsized":"2024-09-12T01:29:40.407718+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'280","last_scrub_stamp":"2024-09-12T01:29:40.407559+0000","last_deep_scrub":"265'280","last_deep_scrub_stamp":"2024-09-12T01:29:40.407559+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.407559+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:49.584492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53613,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":1068,"num_write":372,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'785","reported_seq":2517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.801147+0000","last_change":"2024-09-12T01:29:52.801147+0000","last_active":"2024-09-12T01:29:52.801147+0000","last_peered":"2024-09-12T01:29:52.801147+0000","last_clean":"2024-09-12T01:29:52.801147+0000","last_became_active":"2024-09-12T00:31:56.176464+0000","last_became_peered":"2024-09-12T00:31:56.176464+0000","last_unstale":"2024-09-12T01:29:52.801147+0000","last_undegraded":"2024-09-12T01:29:52.801147+0000","last_fullsized":"2024-09-12T01:29:52.801147+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'785","last_scrub_stamp":"2024-09-12T01:29:52.801061+0000","last_deep_scrub":"265'785","last_deep_scrub_stamp":"2024-09-12T01:29:52.801061+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.801061+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:34.132405+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'324","reported_seq":949,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.078895+0000","last_change":"2024-09-12T01:29:37.078895+0000","last_active":"2024-09-12T01:29:37.078895+0000","last_peered":"2024-09-12T01:29:37.078895+0000","last_clean":"2024-09-12T01:29:37.078895+0000","last_became_active":"2024-09-12T00:31:50.138335+0000","last_became_peered":"2024-09-12T00:31:50.138335+0000","last_unstale":"2024-09-12T01:29:37.078895+0000","last_undegraded":"2024-09-12T01:29:37.078895+0000","last_fullsized":"2024-09-12T01:29:37.078895+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T01:29:37.078804+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T01:29:37.078804+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.078804+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:03.476907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1108,"num_write":487,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'344","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:20.932719+0000","last_change":"2024-09-12T01:29:20.932719+0000","last_active":"2024-09-12T01:29:20.932719+0000","last_peered":"2024-09-12T01:29:20.932719+0000","last_clean":"2024-09-12T01:29:20.932719+0000","last_became_active":"2024-09-12T00:31:47.137951+0000","last_became_peered":"2024-09-12T00:31:47.137951+0000","last_unstale":"2024-09-12T01:29:20.932719+0000","last_undegraded":"2024-09-12T01:29:20.932719+0000","last_fullsized":"2024-09-12T01:29:20.932719+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T01:29:20.932609+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T01:29:20.932609+0000","last_clean_scrub_stamp":"2024-09-12T01:29:20.932609+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:18.440399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205367,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":21468,"num_write":1112,"num_write_kb":35236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.486850+0000","last_change":"2024-09-12T01:29:37.486850+0000","last_active":"2024-09-12T01:29:37.486850+0000","last_peered":"2024-09-12T01:29:37.486850+0000","last_clean":"2024-09-12T01:29:37.486850+0000","last_became_active":"2024-09-12T00:31:52.155047+0000","last_became_peered":"2024-09-12T00:31:52.155047+0000","last_unstale":"2024-09-12T01:29:37.486850+0000","last_undegraded":"2024-09-12T01:29:37.486850+0000","last_fullsized":"2024-09-12T01:29:37.486850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:37.486756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:37.486756+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.486756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:25.770437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'376","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.167617+0000","last_change":"2024-09-12T01:29:40.167617+0000","last_active":"2024-09-12T01:29:40.167617+0000","last_peered":"2024-09-12T01:29:40.167617+0000","last_clean":"2024-09-12T01:29:40.167617+0000","last_became_active":"2024-09-12T00:31:54.173363+0000","last_became_peered":"2024-09-12T00:31:54.173363+0000","last_unstale":"2024-09-12T01:29:40.167617+0000","last_undegraded":"2024-09-12T01:29:40.167617+0000","last_fullsized":"2024-09-12T01:29:40.167617+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T01:29:40.167506+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T01:29:40.167506+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.167506+0000","objects_scrubbed":10,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:42.647926+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48858,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":1144,"num_write":454,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.023763+0000","last_change":"2024-09-12T01:29:48.023763+0000","last_active":"2024-09-12T01:29:48.023763+0000","last_peered":"2024-09-12T01:29:48.023763+0000","last_clean":"2024-09-12T01:29:48.023763+0000","last_became_active":"2024-09-12T00:31:56.172791+0000","last_became_peered":"2024-09-12T00:31:56.172791+0000","last_unstale":"2024-09-12T01:29:48.023763+0000","last_undegraded":"2024-09-12T01:29:48.023763+0000","last_fullsized":"2024-09-12T01:29:48.023763+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:48.023666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:48.023666+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.023666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:05.852693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'547","reported_seq":1380,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.460863+0000","last_change":"2024-09-12T01:29:46.460863+0000","last_active":"2024-09-12T01:29:46.460863+0000","last_peered":"2024-09-12T01:29:46.460863+0000","last_clean":"2024-09-12T01:29:46.460863+0000","last_became_active":"2024-09-12T00:31:58.177828+0000","last_became_peered":"2024-09-12T00:31:58.177828+0000","last_unstale":"2024-09-12T01:29:46.460863+0000","last_undegraded":"2024-09-12T01:29:46.460863+0000","last_fullsized":"2024-09-12T01:29:46.460863+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'547","last_scrub_stamp":"2024-09-12T01:29:46.460769+0000","last_deep_scrub":"265'547","last_deep_scrub_stamp":"2024-09-12T01:29:46.460769+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.460769+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:34.924588+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1309,"num_read_kb":1288,"num_write":1113,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'199","reported_seq":834,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.422188+0000","last_change":"2024-09-12T01:29:26.422188+0000","last_active":"2024-09-12T01:29:26.422188+0000","last_peered":"2024-09-12T01:29:26.422188+0000","last_clean":"2024-09-12T01:29:26.422188+0000","last_became_active":"2024-09-12T00:31:50.138261+0000","last_became_peered":"2024-09-12T00:31:50.138261+0000","last_unstale":"2024-09-12T01:29:26.422188+0000","last_undegraded":"2024-09-12T01:29:26.422188+0000","last_fullsized":"2024-09-12T01:29:26.422188+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'199","last_scrub_stamp":"2024-09-12T01:29:26.422100+0000","last_deep_scrub":"265'199","last_deep_scrub_stamp":"2024-09-12T01:29:26.422100+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.422100+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:46.719548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":866,"num_read_kb":707,"num_write":323,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'375","reported_seq":1092,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.384921+0000","last_change":"2024-09-12T01:29:21.384921+0000","last_active":"2024-09-12T01:29:21.384921+0000","last_peered":"2024-09-12T01:29:21.384921+0000","last_clean":"2024-09-12T01:29:21.384921+0000","last_became_active":"2024-09-12T00:31:47.137234+0000","last_became_peered":"2024-09-12T00:31:47.137234+0000","last_unstale":"2024-09-12T01:29:21.384921+0000","last_undegraded":"2024-09-12T01:29:21.384921+0000","last_fullsized":"2024-09-12T01:29:21.384921+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T01:29:21.384774+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T01:29:21.384774+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.384774+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:01.729819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267358,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":707,"num_read_kb":90782,"num_write":1268,"num_write_kb":21068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.084013+0000","last_change":"2024-09-12T01:29:40.084013+0000","last_active":"2024-09-12T01:29:40.084013+0000","last_peered":"2024-09-12T01:29:40.084013+0000","last_clean":"2024-09-12T01:29:40.084013+0000","last_became_active":"2024-09-12T00:31:52.148738+0000","last_became_peered":"2024-09-12T00:31:52.148738+0000","last_unstale":"2024-09-12T01:29:40.084013+0000","last_undegraded":"2024-09-12T01:29:40.084013+0000","last_fullsized":"2024-09-12T01:29:40.084013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:40.083917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:40.083917+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.083917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:08.215110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'289","reported_seq":882,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.582187+0000","last_change":"2024-09-12T01:29:44.582187+0000","last_active":"2024-09-12T01:29:44.582187+0000","last_peered":"2024-09-12T01:29:44.582187+0000","last_clean":"2024-09-12T01:29:44.582187+0000","last_became_active":"2024-09-12T00:31:54.168247+0000","last_became_peered":"2024-09-12T00:31:54.168247+0000","last_unstale":"2024-09-12T01:29:44.582187+0000","last_undegraded":"2024-09-12T01:29:44.582187+0000","last_fullsized":"2024-09-12T01:29:44.582187+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'289","last_scrub_stamp":"2024-09-12T01:29:44.582089+0000","last_deep_scrub":"265'289","last_deep_scrub_stamp":"2024-09-12T01:29:44.582089+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.582089+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:03.321442+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":1085,"num_write":382,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.606504+0000","last_change":"2024-09-12T01:29:52.606504+0000","last_active":"2024-09-12T01:29:52.606504+0000","last_peered":"2024-09-12T01:29:52.606504+0000","last_clean":"2024-09-12T01:29:52.606504+0000","last_became_active":"2024-09-12T00:31:56.173549+0000","last_became_peered":"2024-09-12T00:31:56.173549+0000","last_unstale":"2024-09-12T01:29:52.606504+0000","last_undegraded":"2024-09-12T01:29:52.606504+0000","last_fullsized":"2024-09-12T01:29:52.606504+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:52.606411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:52.606411+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.606411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:19.064185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'133","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.676531+0000","last_change":"2024-09-12T01:29:47.676531+0000","last_active":"2024-09-12T01:29:47.676531+0000","last_peered":"2024-09-12T01:29:47.676531+0000","last_clean":"2024-09-12T01:29:47.676531+0000","last_became_active":"2024-09-12T00:31:58.175195+0000","last_became_peered":"2024-09-12T00:31:58.175195+0000","last_unstale":"2024-09-12T01:29:47.676531+0000","last_undegraded":"2024-09-12T01:29:47.676531+0000","last_fullsized":"2024-09-12T01:29:47.676531+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-12T01:29:47.676437+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-12T01:29:47.676437+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.676437+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:06.315037+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":426,"num_read_kb":345,"num_write":330,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'362","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.393387+0000","last_change":"2024-09-12T01:29:28.393387+0000","last_active":"2024-09-12T01:29:28.393387+0000","last_peered":"2024-09-12T01:29:28.393387+0000","last_clean":"2024-09-12T01:29:28.393387+0000","last_became_active":"2024-09-12T00:31:50.142818+0000","last_became_peered":"2024-09-12T00:31:50.142818+0000","last_unstale":"2024-09-12T01:29:28.393387+0000","last_undegraded":"2024-09-12T01:29:28.393387+0000","last_fullsized":"2024-09-12T01:29:28.393387+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T01:29:28.393299+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T01:29:28.393299+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.393299+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:32.642275+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1555,"num_read_kb":1227,"num_write":605,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1024,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'335","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.993496+0000","last_change":"2024-09-12T01:29:25.993496+0000","last_active":"2024-09-12T01:29:25.993496+0000","last_peered":"2024-09-12T01:29:25.993496+0000","last_clean":"2024-09-12T01:29:25.993496+0000","last_became_active":"2024-09-12T00:31:47.112306+0000","last_became_peered":"2024-09-12T00:31:47.112306+0000","last_unstale":"2024-09-12T01:29:25.993496+0000","last_undegraded":"2024-09-12T01:29:25.993496+0000","last_fullsized":"2024-09-12T01:29:25.993496+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T01:29:25.993385+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T01:29:25.993385+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.993385+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:41.871832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":55420,"num_write":1061,"num_write_kb":24613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.801990+0000","last_change":"2024-09-12T01:29:43.801990+0000","last_active":"2024-09-12T01:29:43.801990+0000","last_peered":"2024-09-12T01:29:43.801990+0000","last_clean":"2024-09-12T01:29:43.801990+0000","last_became_active":"2024-09-12T00:31:52.153862+0000","last_became_peered":"2024-09-12T00:31:52.153862+0000","last_unstale":"2024-09-12T01:29:43.801990+0000","last_undegraded":"2024-09-12T01:29:43.801990+0000","last_fullsized":"2024-09-12T01:29:43.801990+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:43.801898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:43.801898+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.801898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:29.824097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'367","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.282136+0000","last_change":"2024-09-12T01:29:53.282136+0000","last_active":"2024-09-12T01:29:53.282136+0000","last_peered":"2024-09-12T01:29:53.282136+0000","last_clean":"2024-09-12T01:29:53.282136+0000","last_became_active":"2024-09-12T00:31:54.162228+0000","last_became_peered":"2024-09-12T00:31:54.162228+0000","last_unstale":"2024-09-12T01:29:53.282136+0000","last_undegraded":"2024-09-12T01:29:53.282136+0000","last_fullsized":"2024-09-12T01:29:53.282136+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T01:29:53.282029+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T01:29:53.282029+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.282029+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:19.749606+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50365,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":550,"num_read_kb":1150,"num_write":448,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'784","reported_seq":2608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.768980+0000","last_change":"2024-09-12T01:29:51.768980+0000","last_active":"2024-09-12T01:29:51.768980+0000","last_peered":"2024-09-12T01:29:51.768980+0000","last_clean":"2024-09-12T01:29:51.768980+0000","last_became_active":"2024-09-12T00:31:56.172503+0000","last_became_peered":"2024-09-12T00:31:56.172503+0000","last_unstale":"2024-09-12T01:29:51.768980+0000","last_undegraded":"2024-09-12T01:29:51.768980+0000","last_fullsized":"2024-09-12T01:29:51.768980+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'784","last_scrub_stamp":"2024-09-12T01:29:51.768881+0000","last_deep_scrub":"265'784","last_deep_scrub_stamp":"2024-09-12T01:29:51.768881+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.768881+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:05.443524+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'151","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.104405+0000","last_change":"2024-09-12T01:29:52.104405+0000","last_active":"2024-09-12T01:29:52.104405+0000","last_peered":"2024-09-12T01:29:52.104405+0000","last_clean":"2024-09-12T01:29:52.104405+0000","last_became_active":"2024-09-12T00:31:58.175027+0000","last_became_peered":"2024-09-12T00:31:58.175027+0000","last_unstale":"2024-09-12T01:29:52.104405+0000","last_undegraded":"2024-09-12T01:29:52.104405+0000","last_fullsized":"2024-09-12T01:29:52.104405+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T01:29:52.104322+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T01:29:52.104322+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.104322+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:02.882257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":179,"num_read_kb":162,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'330","reported_seq":964,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.910624+0000","last_change":"2024-09-12T01:29:34.910624+0000","last_active":"2024-09-12T01:29:34.910624+0000","last_peered":"2024-09-12T01:29:34.910624+0000","last_clean":"2024-09-12T01:29:34.910624+0000","last_became_active":"2024-09-12T00:31:50.143814+0000","last_became_peered":"2024-09-12T00:31:50.143814+0000","last_unstale":"2024-09-12T01:29:34.910624+0000","last_undegraded":"2024-09-12T01:29:34.910624+0000","last_fullsized":"2024-09-12T01:29:34.910624+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T01:29:34.910513+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T01:29:34.910513+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.910513+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:08.249264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1421,"num_read_kb":1140,"num_write":511,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'367","reported_seq":1055,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.966235+0000","last_change":"2024-09-12T01:29:22.966235+0000","last_active":"2024-09-12T01:29:22.966235+0000","last_peered":"2024-09-12T01:29:22.966235+0000","last_clean":"2024-09-12T01:29:22.966235+0000","last_became_active":"2024-09-12T00:31:47.138687+0000","last_became_peered":"2024-09-12T00:31:47.138687+0000","last_unstale":"2024-09-12T01:29:22.966235+0000","last_undegraded":"2024-09-12T01:29:22.966235+0000","last_fullsized":"2024-09-12T01:29:22.966235+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T01:29:22.966128+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T01:29:22.966128+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.966128+0000","objects_scrubbed":10,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:35.759401+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6638737,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":559,"num_read_kb":39444,"num_write":1190,"num_write_kb":53128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.131699+0000","last_change":"2024-09-12T01:29:41.131699+0000","last_active":"2024-09-12T01:29:41.131699+0000","last_peered":"2024-09-12T01:29:41.131699+0000","last_clean":"2024-09-12T01:29:41.131699+0000","last_became_active":"2024-09-12T00:31:52.154863+0000","last_became_peered":"2024-09-12T00:31:52.154863+0000","last_unstale":"2024-09-12T01:29:41.131699+0000","last_undegraded":"2024-09-12T01:29:41.131699+0000","last_fullsized":"2024-09-12T01:29:41.131699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:41.131612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:41.131612+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.131612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:59.475586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'519","reported_seq":1180,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.584487+0000","last_change":"2024-09-12T01:29:45.584487+0000","last_active":"2024-09-12T01:29:45.584487+0000","last_peered":"2024-09-12T01:29:45.584487+0000","last_clean":"2024-09-12T01:29:45.584487+0000","last_became_active":"2024-09-12T00:31:54.168691+0000","last_became_peered":"2024-09-12T00:31:54.168691+0000","last_unstale":"2024-09-12T01:29:45.584487+0000","last_undegraded":"2024-09-12T01:29:45.584487+0000","last_fullsized":"2024-09-12T01:29:45.584487+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'519","last_scrub_stamp":"2024-09-12T01:29:45.584397+0000","last_deep_scrub":"265'519","last_deep_scrub_stamp":"2024-09-12T01:29:45.584397+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.584397+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:32.698872+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104127,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":909,"num_read_kb":2207,"num_write":754,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.737486+0000","last_change":"2024-09-12T01:29:50.737486+0000","last_active":"2024-09-12T01:29:50.737486+0000","last_peered":"2024-09-12T01:29:50.737486+0000","last_clean":"2024-09-12T01:29:50.737486+0000","last_became_active":"2024-09-12T00:31:56.175412+0000","last_became_peered":"2024-09-12T00:31:56.175412+0000","last_unstale":"2024-09-12T01:29:50.737486+0000","last_undegraded":"2024-09-12T01:29:50.737486+0000","last_fullsized":"2024-09-12T01:29:50.737486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:50.737371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:50.737371+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.737371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:41.626798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'136","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.616146+0000","last_change":"2024-09-12T01:29:46.616146+0000","last_active":"2024-09-12T01:29:46.616146+0000","last_peered":"2024-09-12T01:29:46.616146+0000","last_clean":"2024-09-12T01:29:46.616146+0000","last_became_active":"2024-09-12T00:31:58.178027+0000","last_became_peered":"2024-09-12T00:31:58.178027+0000","last_unstale":"2024-09-12T01:29:46.616146+0000","last_undegraded":"2024-09-12T01:29:46.616146+0000","last_fullsized":"2024-09-12T01:29:46.616146+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T01:29:46.616055+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T01:29:46.616055+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.616055+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:41.007359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'163","reported_seq":800,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.123130+0000","last_change":"2024-09-12T01:29:33.123130+0000","last_active":"2024-09-12T01:29:33.123130+0000","last_peered":"2024-09-12T01:29:33.123130+0000","last_clean":"2024-09-12T01:29:33.123130+0000","last_became_active":"2024-09-12T00:31:50.127193+0000","last_became_peered":"2024-09-12T00:31:50.127193+0000","last_unstale":"2024-09-12T01:29:33.123130+0000","last_undegraded":"2024-09-12T01:29:33.123130+0000","last_fullsized":"2024-09-12T01:29:33.123130+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'163","last_scrub_stamp":"2024-09-12T01:29:33.123035+0000","last_deep_scrub":"265'163","last_deep_scrub_stamp":"2024-09-12T01:29:33.123035+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.123035+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:08.204389+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":547,"num_write":243,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'332","reported_seq":1005,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.578493+0000","last_change":"2024-09-12T01:29:24.578493+0000","last_active":"2024-09-12T01:29:24.578493+0000","last_peered":"2024-09-12T01:29:24.578493+0000","last_clean":"2024-09-12T01:29:24.578493+0000","last_became_active":"2024-09-12T00:31:47.130136+0000","last_became_peered":"2024-09-12T00:31:47.130136+0000","last_unstale":"2024-09-12T01:29:24.578493+0000","last_undegraded":"2024-09-12T01:29:24.578493+0000","last_fullsized":"2024-09-12T01:29:24.578493+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-12T01:29:24.578387+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-12T01:29:24.578387+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.578387+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:56.888507+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":72156,"num_write":1150,"num_write_kb":60123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":512,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.546401+0000","last_change":"2024-09-12T01:29:36.546401+0000","last_active":"2024-09-12T01:29:36.546401+0000","last_peered":"2024-09-12T01:29:36.546401+0000","last_clean":"2024-09-12T01:29:36.546401+0000","last_became_active":"2024-09-12T00:31:52.155083+0000","last_became_peered":"2024-09-12T00:31:52.155083+0000","last_unstale":"2024-09-12T01:29:36.546401+0000","last_undegraded":"2024-09-12T01:29:36.546401+0000","last_fullsized":"2024-09-12T01:29:36.546401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:36.546308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:36.546308+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.546308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:03.570556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'329","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.610592+0000","last_change":"2024-09-12T01:29:41.610592+0000","last_active":"2024-09-12T01:29:41.610592+0000","last_peered":"2024-09-12T01:29:41.610592+0000","last_clean":"2024-09-12T01:29:41.610592+0000","last_became_active":"2024-09-12T00:31:54.165221+0000","last_became_peered":"2024-09-12T00:31:54.165221+0000","last_unstale":"2024-09-12T01:29:41.610592+0000","last_undegraded":"2024-09-12T01:29:41.610592+0000","last_fullsized":"2024-09-12T01:29:41.610592+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'329","last_scrub_stamp":"2024-09-12T01:29:41.610484+0000","last_deep_scrub":"265'329","last_deep_scrub_stamp":"2024-09-12T01:29:41.610484+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.610484+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:29.700202+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53280,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":539,"num_read_kb":1166,"num_write":484,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.549227+0000","last_change":"2024-09-12T01:29:40.549227+0000","last_active":"2024-09-12T01:29:40.549227+0000","last_peered":"2024-09-12T01:29:40.549227+0000","last_clean":"2024-09-12T01:29:40.549227+0000","last_became_active":"2024-09-12T00:31:56.172777+0000","last_became_peered":"2024-09-12T00:31:56.172777+0000","last_unstale":"2024-09-12T01:29:40.549227+0000","last_undegraded":"2024-09-12T01:29:40.549227+0000","last_fullsized":"2024-09-12T01:29:40.549227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:40.549127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:40.549127+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.549127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:34.798912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'119","reported_seq":617,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.738683+0000","last_change":"2024-09-12T01:29:54.738683+0000","last_active":"2024-09-12T01:29:54.738683+0000","last_peered":"2024-09-12T01:29:54.738683+0000","last_clean":"2024-09-12T01:29:54.738683+0000","last_became_active":"2024-09-12T00:31:58.179667+0000","last_became_peered":"2024-09-12T00:31:58.179667+0000","last_unstale":"2024-09-12T01:29:54.738683+0000","last_undegraded":"2024-09-12T01:29:54.738683+0000","last_fullsized":"2024-09-12T01:29:54.738683+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T01:29:54.738574+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T01:29:54.738574+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.738574+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:12.877077+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":909,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":84,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'226","reported_seq":813,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.062213+0000","last_change":"2024-09-12T01:29:38.062213+0000","last_active":"2024-09-12T01:29:38.062213+0000","last_peered":"2024-09-12T01:29:38.062213+0000","last_clean":"2024-09-12T01:29:38.062213+0000","last_became_active":"2024-09-12T00:31:50.130807+0000","last_became_peered":"2024-09-12T00:31:50.130807+0000","last_unstale":"2024-09-12T01:29:38.062213+0000","last_undegraded":"2024-09-12T01:29:38.062213+0000","last_fullsized":"2024-09-12T01:29:38.062213+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'226","last_scrub_stamp":"2024-09-12T01:29:38.062123+0000","last_deep_scrub":"265'226","last_deep_scrub_stamp":"2024-09-12T01:29:38.062123+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.062123+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:56.212489+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":940,"num_read_kb":756,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'403","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.017755+0000","last_change":"2024-09-12T01:29:28.017755+0000","last_active":"2024-09-12T01:29:28.017755+0000","last_peered":"2024-09-12T01:29:28.017755+0000","last_clean":"2024-09-12T01:29:28.017755+0000","last_became_active":"2024-09-12T00:31:47.113265+0000","last_became_peered":"2024-09-12T00:31:47.113265+0000","last_unstale":"2024-09-12T01:29:28.017755+0000","last_undegraded":"2024-09-12T01:29:28.017755+0000","last_fullsized":"2024-09-12T01:29:28.017755+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'403","last_scrub_stamp":"2024-09-12T01:29:28.017627+0000","last_deep_scrub":"265'403","last_deep_scrub_stamp":"2024-09-12T01:29:28.017627+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.017627+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:21.400047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174791,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":600,"num_read_kb":11693,"num_write":1259,"num_write_kb":25282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.796855+0000","last_change":"2024-09-12T01:29:44.796855+0000","last_active":"2024-09-12T01:29:44.796855+0000","last_peered":"2024-09-12T01:29:44.796855+0000","last_clean":"2024-09-12T01:29:44.796855+0000","last_became_active":"2024-09-12T00:31:52.155877+0000","last_became_peered":"2024-09-12T00:31:52.155877+0000","last_unstale":"2024-09-12T01:29:44.796855+0000","last_undegraded":"2024-09-12T01:29:44.796855+0000","last_fullsized":"2024-09-12T01:29:44.796855+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:44.796766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:44.796766+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.796766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:17.737413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'317","reported_seq":916,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.728963+0000","last_change":"2024-09-12T01:29:48.728963+0000","last_active":"2024-09-12T01:29:48.728963+0000","last_peered":"2024-09-12T01:29:48.728963+0000","last_clean":"2024-09-12T01:29:48.728963+0000","last_became_active":"2024-09-12T00:31:54.165107+0000","last_became_peered":"2024-09-12T00:31:54.165107+0000","last_unstale":"2024-09-12T01:29:48.728963+0000","last_undegraded":"2024-09-12T01:29:48.728963+0000","last_fullsized":"2024-09-12T01:29:48.728963+0000","mapping_epoch":31,"log_start":"265'301","ondisk_log_start":"265'301","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'317","last_scrub_stamp":"2024-09-12T01:29:48.728861+0000","last_deep_scrub":"265'317","last_deep_scrub_stamp":"2024-09-12T01:29:48.728861+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.728861+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:29.201879+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47816,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":1119,"num_write":414,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'743","reported_seq":2484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.584137+0000","last_change":"2024-09-12T01:29:41.584137+0000","last_active":"2024-09-12T01:29:41.584137+0000","last_peered":"2024-09-12T01:29:41.584137+0000","last_clean":"2024-09-12T01:29:41.584137+0000","last_became_active":"2024-09-12T00:31:56.170388+0000","last_became_peered":"2024-09-12T00:31:56.170388+0000","last_unstale":"2024-09-12T01:29:41.584137+0000","last_undegraded":"2024-09-12T01:29:41.584137+0000","last_fullsized":"2024-09-12T01:29:41.584137+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'743","last_scrub_stamp":"2024-09-12T01:29:41.584051+0000","last_deep_scrub":"265'743","last_deep_scrub_stamp":"2024-09-12T01:29:41.584051+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.584051+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:32.038767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'166","reported_seq":664,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.065302+0000","last_change":"2024-09-12T01:29:51.065302+0000","last_active":"2024-09-12T01:29:51.065302+0000","last_peered":"2024-09-12T01:29:51.065302+0000","last_clean":"2024-09-12T01:29:51.065302+0000","last_became_active":"2024-09-12T00:31:58.171814+0000","last_became_peered":"2024-09-12T00:31:58.171814+0000","last_unstale":"2024-09-12T01:29:51.065302+0000","last_undegraded":"2024-09-12T01:29:51.065302+0000","last_fullsized":"2024-09-12T01:29:51.065302+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'166","last_scrub_stamp":"2024-09-12T01:29:51.065211+0000","last_deep_scrub":"265'166","last_deep_scrub_stamp":"2024-09-12T01:29:51.065211+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.065211+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:04.903106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":379,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'118","reported_seq":730,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.424982+0000","last_change":"2024-09-12T01:29:33.424982+0000","last_active":"2024-09-12T01:29:33.424982+0000","last_peered":"2024-09-12T01:29:33.424982+0000","last_clean":"2024-09-12T01:29:33.424982+0000","last_became_active":"2024-09-12T00:31:50.142370+0000","last_became_peered":"2024-09-12T00:31:50.142370+0000","last_unstale":"2024-09-12T01:29:33.424982+0000","last_undegraded":"2024-09-12T01:29:33.424982+0000","last_fullsized":"2024-09-12T01:29:33.424982+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T01:29:33.424886+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T01:29:33.424886+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.424886+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:36.238841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":572,"num_read_kb":482,"num_write":177,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'312","reported_seq":939,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.966631+0000","last_change":"2024-09-12T01:29:26.966631+0000","last_active":"2024-09-12T01:29:26.966631+0000","last_peered":"2024-09-12T01:29:26.966631+0000","last_clean":"2024-09-12T01:29:26.966631+0000","last_became_active":"2024-09-12T00:31:47.122110+0000","last_became_peered":"2024-09-12T00:31:47.122110+0000","last_unstale":"2024-09-12T01:29:26.966631+0000","last_undegraded":"2024-09-12T01:29:26.966631+0000","last_fullsized":"2024-09-12T01:29:26.966631+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T01:29:26.966535+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T01:29:26.966535+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.966535+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:36.122577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":405,"num_read_kb":34909,"num_write":924,"num_write_kb":39966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1464,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.439536+0000","last_change":"2024-09-12T01:29:33.439536+0000","last_active":"2024-09-12T01:29:33.439536+0000","last_peered":"2024-09-12T01:29:33.439536+0000","last_clean":"2024-09-12T01:29:33.439536+0000","last_became_active":"2024-09-12T00:31:52.154858+0000","last_became_peered":"2024-09-12T00:31:52.154858+0000","last_unstale":"2024-09-12T01:29:33.439536+0000","last_undegraded":"2024-09-12T01:29:33.439536+0000","last_fullsized":"2024-09-12T01:29:33.439536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T01:29:33.439442+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T01:29:33.439442+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.439442+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:52.079011+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'89","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.066130+0000","last_change":"2024-09-12T01:29:45.066130+0000","last_active":"2024-09-12T01:29:45.066130+0000","last_peered":"2024-09-12T01:29:45.066130+0000","last_clean":"2024-09-12T01:29:45.066130+0000","last_became_active":"2024-09-12T00:31:54.167362+0000","last_became_peered":"2024-09-12T00:31:54.167362+0000","last_unstale":"2024-09-12T01:29:45.066130+0000","last_undegraded":"2024-09-12T01:29:45.066130+0000","last_fullsized":"2024-09-12T01:29:45.066130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'89","last_scrub_stamp":"2024-09-12T01:29:45.066029+0000","last_deep_scrub":"265'89","last_deep_scrub_stamp":"2024-09-12T01:29:45.066029+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.066029+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:34.522067+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'772","reported_seq":2506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.635703+0000","last_change":"2024-09-12T01:29:44.635703+0000","last_active":"2024-09-12T01:29:44.635703+0000","last_peered":"2024-09-12T01:29:44.635703+0000","last_clean":"2024-09-12T01:29:44.635703+0000","last_became_active":"2024-09-12T00:31:56.173548+0000","last_became_peered":"2024-09-12T00:31:56.173548+0000","last_unstale":"2024-09-12T01:29:44.635703+0000","last_undegraded":"2024-09-12T01:29:44.635703+0000","last_fullsized":"2024-09-12T01:29:44.635703+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'772","last_scrub_stamp":"2024-09-12T01:29:44.635606+0000","last_deep_scrub":"265'772","last_deep_scrub_stamp":"2024-09-12T01:29:44.635606+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.635606+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:49.439061+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'124","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.486873+0000","last_change":"2024-09-12T01:29:44.486873+0000","last_active":"2024-09-12T01:29:44.486873+0000","last_peered":"2024-09-12T01:29:44.486873+0000","last_clean":"2024-09-12T01:29:44.486873+0000","last_became_active":"2024-09-12T00:31:58.174886+0000","last_became_peered":"2024-09-12T00:31:58.174886+0000","last_unstale":"2024-09-12T01:29:44.486873+0000","last_undegraded":"2024-09-12T01:29:44.486873+0000","last_fullsized":"2024-09-12T01:29:44.486873+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-12T01:29:44.486786+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-12T01:29:44.486786+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.486786+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:26.176189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":123,"num_write":278,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'279","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.555522+0000","last_change":"2024-09-12T01:29:27.555522+0000","last_active":"2024-09-12T01:29:27.555522+0000","last_peered":"2024-09-12T01:29:27.555522+0000","last_clean":"2024-09-12T01:29:27.555522+0000","last_became_active":"2024-09-12T00:31:50.139923+0000","last_became_peered":"2024-09-12T00:31:50.139923+0000","last_unstale":"2024-09-12T01:29:27.555522+0000","last_undegraded":"2024-09-12T01:29:27.555522+0000","last_fullsized":"2024-09-12T01:29:27.555522+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'279","last_scrub_stamp":"2024-09-12T01:29:27.555436+0000","last_deep_scrub":"265'279","last_deep_scrub_stamp":"2024-09-12T01:29:27.555436+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.555436+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:35.601614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":954,"num_write":459,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'365","reported_seq":1094,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.691968+0000","last_change":"2024-09-12T01:29:25.691968+0000","last_active":"2024-09-12T01:29:25.691968+0000","last_peered":"2024-09-12T01:29:25.691968+0000","last_clean":"2024-09-12T01:29:25.691968+0000","last_became_active":"2024-09-12T00:31:47.122007+0000","last_became_peered":"2024-09-12T00:31:47.122007+0000","last_unstale":"2024-09-12T01:29:25.691968+0000","last_undegraded":"2024-09-12T01:29:25.691968+0000","last_fullsized":"2024-09-12T01:29:25.691968+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:29:25.691796+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:29:25.691796+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.691796+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:47.700467+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":650,"num_read_kb":69205,"num_write":1195,"num_write_kb":21863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.216129+0000","last_change":"2024-09-12T01:29:46.216129+0000","last_active":"2024-09-12T01:29:46.216129+0000","last_peered":"2024-09-12T01:29:46.216129+0000","last_clean":"2024-09-12T01:29:46.216129+0000","last_became_active":"2024-09-12T00:31:52.146894+0000","last_became_peered":"2024-09-12T00:31:52.146894+0000","last_unstale":"2024-09-12T01:29:46.216129+0000","last_undegraded":"2024-09-12T01:29:46.216129+0000","last_fullsized":"2024-09-12T01:29:46.216129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:46.216043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:46.216043+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.216043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:38.272215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'428","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.518807+0000","last_change":"2024-09-12T01:29:38.518807+0000","last_active":"2024-09-12T01:29:38.518807+0000","last_peered":"2024-09-12T01:29:38.518807+0000","last_clean":"2024-09-12T01:29:38.518807+0000","last_became_active":"2024-09-12T00:31:54.170522+0000","last_became_peered":"2024-09-12T00:31:54.170522+0000","last_unstale":"2024-09-12T01:29:38.518807+0000","last_undegraded":"2024-09-12T01:29:38.518807+0000","last_fullsized":"2024-09-12T01:29:38.518807+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'428","last_scrub_stamp":"2024-09-12T01:29:38.518712+0000","last_deep_scrub":"265'428","last_deep_scrub_stamp":"2024-09-12T01:29:38.518712+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.518712+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:16.110530+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48295,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1274,"num_read_kb":1983,"num_write":1802,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487990,"num_omap_keys":1124,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.378148+0000","last_change":"2024-09-12T01:29:41.378148+0000","last_active":"2024-09-12T01:29:41.378148+0000","last_peered":"2024-09-12T01:29:41.378148+0000","last_clean":"2024-09-12T01:29:41.378148+0000","last_became_active":"2024-09-12T00:31:56.168503+0000","last_became_peered":"2024-09-12T00:31:56.168503+0000","last_unstale":"2024-09-12T01:29:41.378148+0000","last_undegraded":"2024-09-12T01:29:41.378148+0000","last_fullsized":"2024-09-12T01:29:41.378148+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:41.378029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:41.378029+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.378029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:55.766428+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'131","reported_seq":645,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.576315+0000","last_change":"2024-09-12T01:29:45.576315+0000","last_active":"2024-09-12T01:29:45.576315+0000","last_peered":"2024-09-12T01:29:45.576315+0000","last_clean":"2024-09-12T01:29:45.576315+0000","last_became_active":"2024-09-12T00:31:58.172778+0000","last_became_peered":"2024-09-12T00:31:58.172778+0000","last_unstale":"2024-09-12T01:29:45.576315+0000","last_undegraded":"2024-09-12T01:29:45.576315+0000","last_fullsized":"2024-09-12T01:29:45.576315+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'131","last_scrub_stamp":"2024-09-12T01:29:45.576233+0000","last_deep_scrub":"265'131","last_deep_scrub_stamp":"2024-09-12T01:29:45.576233+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.576233+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:05.050007+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":147,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'168","reported_seq":788,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.070874+0000","last_change":"2024-09-12T01:29:36.070874+0000","last_active":"2024-09-12T01:29:36.070874+0000","last_peered":"2024-09-12T01:29:36.070874+0000","last_clean":"2024-09-12T01:29:36.070874+0000","last_became_active":"2024-09-12T00:31:50.131152+0000","last_became_peered":"2024-09-12T00:31:50.131152+0000","last_unstale":"2024-09-12T01:29:36.070874+0000","last_undegraded":"2024-09-12T01:29:36.070874+0000","last_fullsized":"2024-09-12T01:29:36.070874+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T01:29:36.070783+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T01:29:36.070783+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.070783+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:43.699210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":649,"num_write":266,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:20.379019+0000","last_change":"2024-09-12T01:29:20.378968+0000","last_active":"2024-09-12T01:29:20.379019+0000","last_peered":"2024-09-12T01:29:20.379019+0000","last_clean":"2024-09-12T01:29:20.379019+0000","last_became_active":"2024-09-12T00:31:29.750331+0000","last_became_peered":"2024-09-12T00:31:29.750331+0000","last_unstale":"2024-09-12T01:29:20.379019+0000","last_undegraded":"2024-09-12T01:29:20.379019+0000","last_fullsized":"2024-09-12T01:29:20.379019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T01:29:20.378884+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T01:29:20.378884+0000","last_clean_scrub_stamp":"2024-09-12T01:29:20.378884+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:33.781295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":538,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.006791+0000","last_change":"2024-09-12T01:29:23.006742+0000","last_active":"2024-09-12T01:29:23.006791+0000","last_peered":"2024-09-12T01:29:23.006791+0000","last_clean":"2024-09-12T01:29:23.006791+0000","last_became_active":"2024-09-12T00:31:36.970959+0000","last_became_peered":"2024-09-12T00:31:36.970959+0000","last_unstale":"2024-09-12T01:29:23.006791+0000","last_undegraded":"2024-09-12T01:29:23.006791+0000","last_fullsized":"2024-09-12T01:29:23.006791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:23.006670+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:23.006670+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.006670+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:37.618480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00098350799999999991,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'319","reported_seq":1008,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.691569+0000","last_change":"2024-09-12T01:29:22.691569+0000","last_active":"2024-09-12T01:29:22.691569+0000","last_peered":"2024-09-12T01:29:22.691569+0000","last_clean":"2024-09-12T01:29:22.691569+0000","last_became_active":"2024-09-12T00:31:47.130015+0000","last_became_peered":"2024-09-12T00:31:47.130015+0000","last_unstale":"2024-09-12T01:29:22.691569+0000","last_undegraded":"2024-09-12T01:29:22.691569+0000","last_fullsized":"2024-09-12T01:29:22.691569+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T01:29:22.691380+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T01:29:22.691380+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.691380+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:41.799155+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":117828,"num_write":1049,"num_write_kb":35803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.185179+0000","last_change":"2024-09-12T01:29:37.185179+0000","last_active":"2024-09-12T01:29:37.185179+0000","last_peered":"2024-09-12T01:29:37.185179+0000","last_clean":"2024-09-12T01:29:37.185179+0000","last_became_active":"2024-09-12T00:31:52.148316+0000","last_became_peered":"2024-09-12T00:31:52.148316+0000","last_unstale":"2024-09-12T01:29:37.185179+0000","last_undegraded":"2024-09-12T01:29:37.185179+0000","last_fullsized":"2024-09-12T01:29:37.185179+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:37.185077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:37.185077+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.185077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:01.475225+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'720","reported_seq":1440,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.252851+0000","last_change":"2024-09-12T01:29:52.252851+0000","last_active":"2024-09-12T01:29:52.252851+0000","last_peered":"2024-09-12T01:29:52.252851+0000","last_clean":"2024-09-12T01:29:52.252851+0000","last_became_active":"2024-09-12T00:31:54.163482+0000","last_became_peered":"2024-09-12T00:31:54.163482+0000","last_unstale":"2024-09-12T01:29:52.252851+0000","last_undegraded":"2024-09-12T01:29:52.252851+0000","last_fullsized":"2024-09-12T01:29:52.252851+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'720","last_scrub_stamp":"2024-09-12T01:29:52.252740+0000","last_deep_scrub":"265'720","last_deep_scrub_stamp":"2024-09-12T01:29:52.252740+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.252740+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:38.458907+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135081,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1399,"num_read_kb":3136,"num_write":1308,"num_write_kb":1145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":90068,"num_omap_keys":220,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.730937+0000","last_change":"2024-09-12T01:29:49.730937+0000","last_active":"2024-09-12T01:29:49.730937+0000","last_peered":"2024-09-12T01:29:49.730937+0000","last_clean":"2024-09-12T01:29:49.730937+0000","last_became_active":"2024-09-12T00:31:56.170545+0000","last_became_peered":"2024-09-12T00:31:56.170545+0000","last_unstale":"2024-09-12T01:29:49.730937+0000","last_undegraded":"2024-09-12T01:29:49.730937+0000","last_fullsized":"2024-09-12T01:29:49.730937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:49.730847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:49.730847+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.730847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:09.954024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'201","reported_seq":910,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.103082+0000","last_change":"2024-09-12T01:29:44.103082+0000","last_active":"2024-09-12T01:29:44.103082+0000","last_peered":"2024-09-12T01:29:44.103082+0000","last_clean":"2024-09-12T01:29:44.103082+0000","last_became_active":"2024-09-12T00:31:58.184941+0000","last_became_peered":"2024-09-12T00:31:58.184941+0000","last_unstale":"2024-09-12T01:29:44.103082+0000","last_undegraded":"2024-09-12T01:29:44.103082+0000","last_fullsized":"2024-09-12T01:29:44.103082+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'201","last_scrub_stamp":"2024-09-12T01:29:44.102997+0000","last_deep_scrub":"265'201","last_deep_scrub_stamp":"2024-09-12T01:29:44.102997+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.102997+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:42.375967+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1234,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":433,"num_write":415,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'95","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.799672+0000","last_change":"2024-09-12T01:29:39.799672+0000","last_active":"2024-09-12T01:29:39.799672+0000","last_peered":"2024-09-12T01:29:39.799672+0000","last_clean":"2024-09-12T01:29:39.799672+0000","last_became_active":"2024-09-12T00:31:50.137393+0000","last_became_peered":"2024-09-12T00:31:50.137393+0000","last_unstale":"2024-09-12T01:29:39.799672+0000","last_undegraded":"2024-09-12T01:29:39.799672+0000","last_fullsized":"2024-09-12T01:29:39.799672+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'95","last_scrub_stamp":"2024-09-12T01:29:39.799515+0000","last_deep_scrub":"265'95","last_deep_scrub_stamp":"2024-09-12T01:29:39.799515+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.799515+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:12.573956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":346,"num_write":149,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":537,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.997701+0000","last_change":"2024-09-12T01:29:21.997656+0000","last_active":"2024-09-12T01:29:21.997701+0000","last_peered":"2024-09-12T01:29:21.997701+0000","last_clean":"2024-09-12T01:29:21.997701+0000","last_became_active":"2024-09-12T00:31:36.772301+0000","last_became_peered":"2024-09-12T00:31:36.772301+0000","last_unstale":"2024-09-12T01:29:21.997701+0000","last_undegraded":"2024-09-12T01:29:21.997701+0000","last_fullsized":"2024-09-12T01:29:21.997701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:21.997579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:21.997579+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.997579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:49.342018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070272599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'371","reported_seq":1037,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.260959+0000","last_change":"2024-09-12T01:29:23.260959+0000","last_active":"2024-09-12T01:29:23.260959+0000","last_peered":"2024-09-12T01:29:23.260959+0000","last_clean":"2024-09-12T01:29:23.260959+0000","last_became_active":"2024-09-12T00:31:47.121537+0000","last_became_peered":"2024-09-12T00:31:47.121537+0000","last_unstale":"2024-09-12T01:29:23.260959+0000","last_undegraded":"2024-09-12T01:29:23.260959+0000","last_fullsized":"2024-09-12T01:29:23.260959+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-12T01:29:23.260822+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-12T01:29:23.260822+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.260822+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:08.129052+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306567,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":587,"num_read_kb":9552,"num_write":1166,"num_write_kb":21951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.199954+0000","last_change":"2024-09-12T01:29:45.199954+0000","last_active":"2024-09-12T01:29:45.199954+0000","last_peered":"2024-09-12T01:29:45.199954+0000","last_clean":"2024-09-12T01:29:45.199954+0000","last_became_active":"2024-09-12T00:31:52.147719+0000","last_became_peered":"2024-09-12T00:31:52.147719+0000","last_unstale":"2024-09-12T01:29:45.199954+0000","last_undegraded":"2024-09-12T01:29:45.199954+0000","last_fullsized":"2024-09-12T01:29:45.199954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:45.199854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:45.199854+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.199854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:45.975132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1270","reported_seq":2912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.539274+0000","last_change":"2024-09-12T01:29:38.539274+0000","last_active":"2024-09-12T01:29:38.539274+0000","last_peered":"2024-09-12T01:29:38.539274+0000","last_clean":"2024-09-12T01:29:38.539274+0000","last_became_active":"2024-09-12T00:31:54.168085+0000","last_became_peered":"2024-09-12T00:31:54.168085+0000","last_unstale":"2024-09-12T01:29:38.539274+0000","last_undegraded":"2024-09-12T01:29:38.539274+0000","last_fullsized":"2024-09-12T01:29:38.539274+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1270","last_scrub_stamp":"2024-09-12T01:29:38.539154+0000","last_deep_scrub":"265'1270","last_deep_scrub_stamp":"2024-09-12T01:29:38.539154+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.539154+0000","objects_scrubbed":12,"log_size":70,"log_dups_size":1200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:12.785352+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145044,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2035,"num_read_kb":3748,"num_write":1136,"num_write_kb":952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.331269+0000","last_change":"2024-09-12T01:29:58.331269+0000","last_active":"2024-09-12T01:29:58.331269+0000","last_peered":"2024-09-12T01:29:58.331269+0000","last_clean":"2024-09-12T01:29:58.331269+0000","last_became_active":"2024-09-12T00:31:56.170725+0000","last_became_peered":"2024-09-12T00:31:56.170725+0000","last_unstale":"2024-09-12T01:29:58.331269+0000","last_undegraded":"2024-09-12T01:29:58.331269+0000","last_fullsized":"2024-09-12T01:29:58.331269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:58.331165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:58.331165+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.331165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:07.468986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'208","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.778945+0000","last_change":"2024-09-12T01:29:55.778945+0000","last_active":"2024-09-12T01:29:55.778945+0000","last_peered":"2024-09-12T01:29:55.778945+0000","last_clean":"2024-09-12T01:29:55.778945+0000","last_became_active":"2024-09-12T00:31:58.182565+0000","last_became_peered":"2024-09-12T00:31:58.182565+0000","last_unstale":"2024-09-12T01:29:55.778945+0000","last_undegraded":"2024-09-12T01:29:55.778945+0000","last_fullsized":"2024-09-12T01:29:55.778945+0000","mapping_epoch":35,"log_start":"262'100","ondisk_log_start":"262'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'208","last_scrub_stamp":"2024-09-12T01:29:55.778831+0000","last_deep_scrub":"265'208","last_deep_scrub_stamp":"2024-09-12T01:29:55.778831+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.778831+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:24.118489+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":315,"num_read_kb":314,"num_write":438,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'335","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.144020+0000","last_change":"2024-09-12T01:29:35.144020+0000","last_active":"2024-09-12T01:29:35.144020+0000","last_peered":"2024-09-12T01:29:35.144020+0000","last_clean":"2024-09-12T01:29:35.144020+0000","last_became_active":"2024-09-12T00:31:50.135930+0000","last_became_peered":"2024-09-12T00:31:50.135930+0000","last_unstale":"2024-09-12T01:29:35.144020+0000","last_undegraded":"2024-09-12T01:29:35.144020+0000","last_fullsized":"2024-09-12T01:29:35.144020+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T01:29:35.143930+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T01:29:35.143930+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.143930+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:55.298509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1457,"num_read_kb":1188,"num_write":528,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":541,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.623192+0000","last_change":"2024-09-12T01:29:23.623127+0000","last_active":"2024-09-12T01:29:23.623192+0000","last_peered":"2024-09-12T01:29:23.623192+0000","last_clean":"2024-09-12T01:29:23.623192+0000","last_became_active":"2024-09-12T00:31:36.774484+0000","last_became_peered":"2024-09-12T00:31:36.774484+0000","last_unstale":"2024-09-12T01:29:23.623192+0000","last_undegraded":"2024-09-12T01:29:23.623192+0000","last_fullsized":"2024-09-12T01:29:23.623192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:23.623036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:23.623036+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.623036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:41.999199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040283499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'343","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.784276+0000","last_change":"2024-09-12T01:29:23.784214+0000","last_active":"2024-09-12T01:29:23.784276+0000","last_peered":"2024-09-12T01:29:23.784276+0000","last_clean":"2024-09-12T01:29:23.784276+0000","last_became_active":"2024-09-12T00:31:47.123249+0000","last_became_peered":"2024-09-12T00:31:47.123249+0000","last_unstale":"2024-09-12T01:29:23.784276+0000","last_undegraded":"2024-09-12T01:29:23.784276+0000","last_fullsized":"2024-09-12T01:29:23.784276+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T01:29:23.784066+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T01:29:23.784066+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.784066+0000","objects_scrubbed":10,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:32.413879+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291498,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":12898,"num_write":1156,"num_write_kb":44550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.599233+0000","last_change":"2024-09-12T01:29:34.599233+0000","last_active":"2024-09-12T01:29:34.599233+0000","last_peered":"2024-09-12T01:29:34.599233+0000","last_clean":"2024-09-12T01:29:34.599233+0000","last_became_active":"2024-09-12T00:31:52.155926+0000","last_became_peered":"2024-09-12T00:31:52.155926+0000","last_unstale":"2024-09-12T01:29:34.599233+0000","last_undegraded":"2024-09-12T01:29:34.599233+0000","last_fullsized":"2024-09-12T01:29:34.599233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:34.599149+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:34.599149+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.599149+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:15.139311+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'258","reported_seq":1496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.191396+0000","last_change":"2024-09-12T01:29:39.191396+0000","last_active":"2024-09-12T01:29:39.191396+0000","last_peered":"2024-09-12T01:29:39.191396+0000","last_clean":"2024-09-12T01:29:39.191396+0000","last_became_active":"2024-09-12T00:31:54.174937+0000","last_became_peered":"2024-09-12T00:31:54.174937+0000","last_unstale":"2024-09-12T01:29:39.191396+0000","last_undegraded":"2024-09-12T01:29:39.191396+0000","last_fullsized":"2024-09-12T01:29:39.191396+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'258","last_scrub_stamp":"2024-09-12T01:29:39.191302+0000","last_deep_scrub":"265'258","last_deep_scrub_stamp":"2024-09-12T01:29:39.191302+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.191302+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:50.175459+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":202,"num_write":187,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.603097+0000","last_change":"2024-09-12T01:29:53.603097+0000","last_active":"2024-09-12T01:29:53.603097+0000","last_peered":"2024-09-12T01:29:53.603097+0000","last_clean":"2024-09-12T01:29:53.603097+0000","last_became_active":"2024-09-12T00:31:56.171071+0000","last_became_peered":"2024-09-12T00:31:56.171071+0000","last_unstale":"2024-09-12T01:29:53.603097+0000","last_undegraded":"2024-09-12T01:29:53.603097+0000","last_fullsized":"2024-09-12T01:29:53.603097+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:53.603007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:53.603007+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.603007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:40.755561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'242","reported_seq":857,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.601359+0000","last_change":"2024-09-12T01:29:56.601359+0000","last_active":"2024-09-12T01:29:56.601359+0000","last_peered":"2024-09-12T01:29:56.601359+0000","last_clean":"2024-09-12T01:29:56.601359+0000","last_became_active":"2024-09-12T00:31:58.176931+0000","last_became_peered":"2024-09-12T00:31:58.176931+0000","last_unstale":"2024-09-12T01:29:56.601359+0000","last_undegraded":"2024-09-12T01:29:56.601359+0000","last_fullsized":"2024-09-12T01:29:56.601359+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'242","last_scrub_stamp":"2024-09-12T01:29:56.601272+0000","last_deep_scrub":"265'242","last_deep_scrub_stamp":"2024-09-12T01:29:56.601272+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.601272+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:19.448047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":495,"num_write":504,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'416","reported_seq":1074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.172754+0000","last_change":"2024-09-12T01:29:33.172754+0000","last_active":"2024-09-12T01:29:33.172754+0000","last_peered":"2024-09-12T01:29:33.172754+0000","last_clean":"2024-09-12T01:29:33.172754+0000","last_became_active":"2024-09-12T00:31:50.139625+0000","last_became_peered":"2024-09-12T00:31:50.139625+0000","last_unstale":"2024-09-12T01:29:33.172754+0000","last_undegraded":"2024-09-12T01:29:33.172754+0000","last_fullsized":"2024-09-12T01:29:33.172754+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'416","last_scrub_stamp":"2024-09-12T01:29:33.172645+0000","last_deep_scrub":"265'416","last_deep_scrub_stamp":"2024-09-12T01:29:33.172645+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.172645+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:16.906066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1805,"num_read_kb":1431,"num_write":644,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":539,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.003186+0000","last_change":"2024-09-12T01:29:21.003127+0000","last_active":"2024-09-12T01:29:21.003186+0000","last_peered":"2024-09-12T01:29:21.003186+0000","last_clean":"2024-09-12T01:29:21.003186+0000","last_became_active":"2024-09-12T00:31:37.736683+0000","last_became_peered":"2024-09-12T00:31:37.736683+0000","last_unstale":"2024-09-12T01:29:21.003186+0000","last_undegraded":"2024-09-12T01:29:21.003186+0000","last_fullsized":"2024-09-12T01:29:21.003186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:21.003063+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:21.003063+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.003063+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:50.711321+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001295757,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'316","reported_seq":1162,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:19.962927+0000","last_change":"2024-09-12T01:29:19.962927+0000","last_active":"2024-09-12T01:29:19.962927+0000","last_peered":"2024-09-12T01:29:19.962927+0000","last_clean":"2024-09-12T01:29:19.962927+0000","last_became_active":"2024-09-12T00:31:47.136714+0000","last_became_peered":"2024-09-12T00:31:47.136714+0000","last_unstale":"2024-09-12T01:29:19.962927+0000","last_undegraded":"2024-09-12T01:29:19.962927+0000","last_fullsized":"2024-09-12T01:29:19.962927+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T01:29:19.962830+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T01:29:19.962830+0000","last_clean_scrub_stamp":"2024-09-12T01:29:19.962830+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:02.608178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":889,"num_read_kb":29272,"num_write":1058,"num_write_kb":35686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.582530+0000","last_change":"2024-09-12T01:29:35.582530+0000","last_active":"2024-09-12T01:29:35.582530+0000","last_peered":"2024-09-12T01:29:35.582530+0000","last_clean":"2024-09-12T01:29:35.582530+0000","last_became_active":"2024-09-12T00:31:52.148995+0000","last_became_peered":"2024-09-12T00:31:52.148995+0000","last_unstale":"2024-09-12T01:29:35.582530+0000","last_undegraded":"2024-09-12T01:29:35.582530+0000","last_fullsized":"2024-09-12T01:29:35.582530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:35.582425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:35.582425+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.582425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:11.996704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'144","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.751175+0000","last_change":"2024-09-12T01:29:47.751175+0000","last_active":"2024-09-12T01:29:47.751175+0000","last_peered":"2024-09-12T01:29:47.751175+0000","last_clean":"2024-09-12T01:29:47.751175+0000","last_became_active":"2024-09-12T00:31:54.167813+0000","last_became_peered":"2024-09-12T00:31:54.167813+0000","last_unstale":"2024-09-12T01:29:47.751175+0000","last_undegraded":"2024-09-12T01:29:47.751175+0000","last_fullsized":"2024-09-12T01:29:47.751175+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:29:47.751074+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:29:47.751074+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.751074+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:58.423569+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":166,"num_read_kb":157,"num_write":122,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.336051+0000","last_change":"2024-09-12T01:29:57.336051+0000","last_active":"2024-09-12T01:29:57.336051+0000","last_peered":"2024-09-12T01:29:57.336051+0000","last_clean":"2024-09-12T01:29:57.336051+0000","last_became_active":"2024-09-12T00:31:56.172693+0000","last_became_peered":"2024-09-12T00:31:56.172693+0000","last_unstale":"2024-09-12T01:29:57.336051+0000","last_undegraded":"2024-09-12T01:29:57.336051+0000","last_fullsized":"2024-09-12T01:29:57.336051+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:57.335968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:57.335968+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.335968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:38.140354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'163","reported_seq":742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.702900+0000","last_change":"2024-09-12T01:29:48.702900+0000","last_active":"2024-09-12T01:29:48.702900+0000","last_peered":"2024-09-12T01:29:48.702900+0000","last_clean":"2024-09-12T01:29:48.702900+0000","last_became_active":"2024-09-12T00:31:58.177206+0000","last_became_peered":"2024-09-12T00:31:58.177206+0000","last_unstale":"2024-09-12T01:29:48.702900+0000","last_undegraded":"2024-09-12T01:29:48.702900+0000","last_fullsized":"2024-09-12T01:29:48.702900+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'163","last_scrub_stamp":"2024-09-12T01:29:48.702813+0000","last_deep_scrub":"265'163","last_deep_scrub_stamp":"2024-09-12T01:29:48.702813+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.702813+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:25.149863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":267,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'249","reported_seq":861,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.213962+0000","last_change":"2024-09-12T01:29:32.213962+0000","last_active":"2024-09-12T01:29:32.213962+0000","last_peered":"2024-09-12T01:29:32.213962+0000","last_clean":"2024-09-12T01:29:32.213962+0000","last_became_active":"2024-09-12T00:31:50.135333+0000","last_became_peered":"2024-09-12T00:31:50.135333+0000","last_unstale":"2024-09-12T01:29:32.213962+0000","last_undegraded":"2024-09-12T01:29:32.213962+0000","last_fullsized":"2024-09-12T01:29:32.213962+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'249","last_scrub_stamp":"2024-09-12T01:29:32.213855+0000","last_deep_scrub":"265'249","last_deep_scrub_stamp":"2024-09-12T01:29:32.213855+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.213855+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:37.155698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1106,"num_read_kb":893,"num_write":406,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'297","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.373673+0000","last_change":"2024-09-12T01:29:22.373673+0000","last_active":"2024-09-12T01:29:22.373673+0000","last_peered":"2024-09-12T01:29:22.373673+0000","last_clean":"2024-09-12T01:29:22.373673+0000","last_became_active":"2024-09-12T00:31:47.131943+0000","last_became_peered":"2024-09-12T00:31:47.131943+0000","last_unstale":"2024-09-12T01:29:22.373673+0000","last_undegraded":"2024-09-12T01:29:22.373673+0000","last_fullsized":"2024-09-12T01:29:22.373673+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'297","last_scrub_stamp":"2024-09-12T01:29:22.373580+0000","last_deep_scrub":"265'297","last_deep_scrub_stamp":"2024-09-12T01:29:22.373580+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.373580+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:13.861521+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7951494,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":382,"num_read_kb":39412,"num_write":972,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.825117+0000","last_change":"2024-09-12T01:29:22.825062+0000","last_active":"2024-09-12T01:29:22.825117+0000","last_peered":"2024-09-12T01:29:22.825117+0000","last_clean":"2024-09-12T01:29:22.825117+0000","last_became_active":"2024-09-12T00:31:37.736507+0000","last_became_peered":"2024-09-12T00:31:37.736507+0000","last_unstale":"2024-09-12T01:29:22.825117+0000","last_undegraded":"2024-09-12T01:29:22.825117+0000","last_fullsized":"2024-09-12T01:29:22.825117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:22.824962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:22.824962+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.824962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:54.694034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00050928200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.575781+0000","last_change":"2024-09-12T01:29:39.575781+0000","last_active":"2024-09-12T01:29:39.575781+0000","last_peered":"2024-09-12T01:29:39.575781+0000","last_clean":"2024-09-12T01:29:39.575781+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:29:39.575781+0000","last_undegraded":"2024-09-12T01:29:39.575781+0000","last_fullsized":"2024-09-12T01:29:39.575781+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:39.575696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:39.575696+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.575696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:20.724735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'612","reported_seq":1309,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.560415+0000","last_change":"2024-09-12T01:29:37.560415+0000","last_active":"2024-09-12T01:29:37.560415+0000","last_peered":"2024-09-12T01:29:37.560415+0000","last_clean":"2024-09-12T01:29:37.560415+0000","last_became_active":"2024-09-12T00:31:54.162596+0000","last_became_peered":"2024-09-12T00:31:54.162596+0000","last_unstale":"2024-09-12T01:29:37.560415+0000","last_undegraded":"2024-09-12T01:29:37.560415+0000","last_fullsized":"2024-09-12T01:29:37.560415+0000","mapping_epoch":31,"log_start":"265'600","ondisk_log_start":"265'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'612","last_scrub_stamp":"2024-09-12T01:29:37.560320+0000","last_deep_scrub":"265'612","last_deep_scrub_stamp":"2024-09-12T01:29:37.560320+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.560320+0000","objects_scrubbed":11,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:15.707785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88936,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1027,"num_read_kb":2220,"num_write":890,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.402364+0000","last_change":"2024-09-12T01:29:42.402364+0000","last_active":"2024-09-12T01:29:42.402364+0000","last_peered":"2024-09-12T01:29:42.402364+0000","last_clean":"2024-09-12T01:29:42.402364+0000","last_became_active":"2024-09-12T00:31:56.170246+0000","last_became_peered":"2024-09-12T00:31:56.170246+0000","last_unstale":"2024-09-12T01:29:42.402364+0000","last_undegraded":"2024-09-12T01:29:42.402364+0000","last_fullsized":"2024-09-12T01:29:42.402364+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:42.402278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:42.402278+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.402278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:40.856339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'142","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.794429+0000","last_change":"2024-09-12T01:29:57.794429+0000","last_active":"2024-09-12T01:29:57.794429+0000","last_peered":"2024-09-12T01:29:57.794429+0000","last_clean":"2024-09-12T01:29:57.794429+0000","last_became_active":"2024-09-12T00:31:58.183206+0000","last_became_peered":"2024-09-12T00:31:58.183206+0000","last_unstale":"2024-09-12T01:29:57.794429+0000","last_undegraded":"2024-09-12T01:29:57.794429+0000","last_fullsized":"2024-09-12T01:29:57.794429+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T01:29:57.794338+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T01:29:57.794338+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.794338+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:29.307740+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":155,"num_write":341,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'131","reported_seq":742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.143157+0000","last_change":"2024-09-12T01:29:34.143157+0000","last_active":"2024-09-12T01:29:34.143157+0000","last_peered":"2024-09-12T01:29:34.143157+0000","last_clean":"2024-09-12T01:29:34.143157+0000","last_became_active":"2024-09-12T00:31:50.135197+0000","last_became_peered":"2024-09-12T00:31:50.135197+0000","last_unstale":"2024-09-12T01:29:34.143157+0000","last_undegraded":"2024-09-12T01:29:34.143157+0000","last_fullsized":"2024-09-12T01:29:34.143157+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'131","last_scrub_stamp":"2024-09-12T01:29:34.143073+0000","last_deep_scrub":"265'131","last_deep_scrub_stamp":"2024-09-12T01:29:34.143073+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.143073+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:09.129556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":577,"num_read_kb":479,"num_write":210,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'302","reported_seq":933,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.253191+0000","last_change":"2024-09-12T01:29:25.253191+0000","last_active":"2024-09-12T01:29:25.253191+0000","last_peered":"2024-09-12T01:29:25.253191+0000","last_clean":"2024-09-12T01:29:25.253191+0000","last_became_active":"2024-09-12T00:31:47.121355+0000","last_became_peered":"2024-09-12T00:31:47.121355+0000","last_unstale":"2024-09-12T01:29:25.253191+0000","last_undegraded":"2024-09-12T01:29:25.253191+0000","last_fullsized":"2024-09-12T01:29:25.253191+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'302","last_scrub_stamp":"2024-09-12T01:29:25.253069+0000","last_deep_scrub":"265'302","last_deep_scrub_stamp":"2024-09-12T01:29:25.253069+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.253069+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:56.001061+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":443,"num_write":1003,"num_write_kb":5362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.031667+0000","last_change":"2024-09-12T01:29:24.031667+0000","last_active":"2024-09-12T01:29:24.031667+0000","last_peered":"2024-09-12T01:29:24.031667+0000","last_clean":"2024-09-12T01:29:24.031667+0000","last_became_active":"2024-09-12T00:31:36.774289+0000","last_became_peered":"2024-09-12T00:31:36.774289+0000","last_unstale":"2024-09-12T01:29:24.031667+0000","last_undegraded":"2024-09-12T01:29:24.031667+0000","last_fullsized":"2024-09-12T01:29:24.031667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:24.031584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:24.031584+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.031584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:30.910975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063853100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"265'10","reported_seq":1469,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.196095+0000","last_change":"2024-09-12T01:29:35.196095+0000","last_active":"2024-09-12T01:29:35.196095+0000","last_peered":"2024-09-12T01:29:35.196095+0000","last_clean":"2024-09-12T01:29:35.196095+0000","last_became_active":"2024-09-12T00:31:52.147856+0000","last_became_peered":"2024-09-12T00:31:52.147856+0000","last_unstale":"2024-09-12T01:29:35.196095+0000","last_undegraded":"2024-09-12T01:29:35.196095+0000","last_fullsized":"2024-09-12T01:29:35.196095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:29:35.195968+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:29:35.195968+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.195968+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:49.978709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1609,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1450,"num_read_kb":1911,"num_write":16,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'184","reported_seq":762,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.102514+0000","last_change":"2024-09-12T01:29:44.102514+0000","last_active":"2024-09-12T01:29:44.102514+0000","last_peered":"2024-09-12T01:29:44.102514+0000","last_clean":"2024-09-12T01:29:44.102514+0000","last_became_active":"2024-09-12T00:31:54.169958+0000","last_became_peered":"2024-09-12T00:31:54.169958+0000","last_unstale":"2024-09-12T01:29:44.102514+0000","last_undegraded":"2024-09-12T01:29:44.102514+0000","last_fullsized":"2024-09-12T01:29:44.102514+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'184","last_scrub_stamp":"2024-09-12T01:29:44.102427+0000","last_deep_scrub":"265'184","last_deep_scrub_stamp":"2024-09-12T01:29:44.102427+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.102427+0000","objects_scrubbed":8,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:26.857668+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":229,"num_read_kb":218,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'773","reported_seq":2828,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.590121+0000","last_change":"2024-09-12T01:29:43.590121+0000","last_active":"2024-09-12T01:29:43.590121+0000","last_peered":"2024-09-12T01:29:43.590121+0000","last_clean":"2024-09-12T01:29:43.590121+0000","last_became_active":"2024-09-12T00:31:56.174535+0000","last_became_peered":"2024-09-12T00:31:56.174535+0000","last_unstale":"2024-09-12T01:29:43.590121+0000","last_undegraded":"2024-09-12T01:29:43.590121+0000","last_fullsized":"2024-09-12T01:29:43.590121+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-12T01:29:43.589995+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-12T01:29:43.589995+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.589995+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:13.733386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'117","reported_seq":630,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.588328+0000","last_change":"2024-09-12T01:29:47.588328+0000","last_active":"2024-09-12T01:29:47.588328+0000","last_peered":"2024-09-12T01:29:47.588328+0000","last_clean":"2024-09-12T01:29:47.588328+0000","last_became_active":"2024-09-12T00:31:58.174086+0000","last_became_peered":"2024-09-12T00:31:58.174086+0000","last_unstale":"2024-09-12T01:29:47.588328+0000","last_undegraded":"2024-09-12T01:29:47.588328+0000","last_fullsized":"2024-09-12T01:29:47.588328+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'117","last_scrub_stamp":"2024-09-12T01:29:47.588239+0000","last_deep_scrub":"265'117","last_deep_scrub_stamp":"2024-09-12T01:29:47.588239+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.588239+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:45.651262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":255,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'4368","reported_seq":5128,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.552027+0000","last_change":"2024-09-12T01:29:30.552027+0000","last_active":"2024-09-12T01:29:30.552027+0000","last_peered":"2024-09-12T01:29:30.552027+0000","last_clean":"2024-09-12T01:29:30.552027+0000","last_became_active":"2024-09-12T00:31:50.132703+0000","last_became_peered":"2024-09-12T00:31:50.132703+0000","last_unstale":"2024-09-12T01:29:30.552027+0000","last_undegraded":"2024-09-12T01:29:30.552027+0000","last_fullsized":"2024-09-12T01:29:30.552027+0000","mapping_epoch":27,"log_start":"265'4300","ondisk_log_start":"265'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4368","last_scrub_stamp":"2024-09-12T01:29:30.551927+0000","last_deep_scrub":"265'4368","last_deep_scrub_stamp":"2024-09-12T01:29:30.551927+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.551927+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:47.227065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17817,"num_read_kb":14914,"num_write":6561,"num_write_kb":3320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25749,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'309","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.675750+0000","last_change":"2024-09-12T01:29:24.675750+0000","last_active":"2024-09-12T01:29:24.675750+0000","last_peered":"2024-09-12T01:29:24.675750+0000","last_clean":"2024-09-12T01:29:24.675750+0000","last_became_active":"2024-09-12T00:31:47.116205+0000","last_became_peered":"2024-09-12T00:31:47.116205+0000","last_unstale":"2024-09-12T01:29:24.675750+0000","last_undegraded":"2024-09-12T01:29:24.675750+0000","last_fullsized":"2024-09-12T01:29:24.675750+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-12T01:29:24.675634+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-12T01:29:24.675634+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.675634+0000","objects_scrubbed":9,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:00.404652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704304,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":481,"num_read_kb":46756,"num_write":1080,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":539,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.710111+0000","last_change":"2024-09-12T01:29:21.710111+0000","last_active":"2024-09-12T01:29:21.710111+0000","last_peered":"2024-09-12T01:29:21.710111+0000","last_clean":"2024-09-12T01:29:21.710111+0000","last_became_active":"2024-09-12T00:31:37.434707+0000","last_became_peered":"2024-09-12T00:31:37.434707+0000","last_unstale":"2024-09-12T01:29:21.710111+0000","last_undegraded":"2024-09-12T01:29:21.710111+0000","last_fullsized":"2024-09-12T01:29:21.710111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:21.710025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:21.710025+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.710025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:10.521409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041578299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.238216+0000","last_change":"2024-09-12T01:29:47.238216+0000","last_active":"2024-09-12T01:29:47.238216+0000","last_peered":"2024-09-12T01:29:47.238216+0000","last_clean":"2024-09-12T01:29:47.238216+0000","last_became_active":"2024-09-12T00:31:52.146927+0000","last_became_peered":"2024-09-12T00:31:52.146927+0000","last_unstale":"2024-09-12T01:29:47.238216+0000","last_undegraded":"2024-09-12T01:29:47.238216+0000","last_fullsized":"2024-09-12T01:29:47.238216+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:47.238121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:47.238121+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.238121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.005209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'135","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.281953+0000","last_change":"2024-09-12T01:29:51.281953+0000","last_active":"2024-09-12T01:29:51.281953+0000","last_peered":"2024-09-12T01:29:51.281953+0000","last_clean":"2024-09-12T01:29:51.281953+0000","last_became_active":"2024-09-12T00:31:54.166612+0000","last_became_peered":"2024-09-12T00:31:54.166612+0000","last_unstale":"2024-09-12T01:29:51.281953+0000","last_undegraded":"2024-09-12T01:29:51.281953+0000","last_fullsized":"2024-09-12T01:29:51.281953+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T01:29:51.281847+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T01:29:51.281847+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.281847+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:09.698559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":151,"num_read_kb":143,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'785","reported_seq":4669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.751847+0000","last_change":"2024-09-12T01:29:46.751847+0000","last_active":"2024-09-12T01:29:46.751847+0000","last_peered":"2024-09-12T01:29:46.751847+0000","last_clean":"2024-09-12T01:29:46.751847+0000","last_became_active":"2024-09-12T00:31:56.170358+0000","last_became_peered":"2024-09-12T00:31:56.170358+0000","last_unstale":"2024-09-12T01:29:46.751847+0000","last_undegraded":"2024-09-12T01:29:46.751847+0000","last_fullsized":"2024-09-12T01:29:46.751847+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'785","last_scrub_stamp":"2024-09-12T01:29:46.751765+0000","last_deep_scrub":"265'785","last_deep_scrub_stamp":"2024-09-12T01:29:46.751765+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.751765+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:48.040351+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'177","reported_seq":692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.751829+0000","last_change":"2024-09-12T01:29:56.751829+0000","last_active":"2024-09-12T01:29:56.751829+0000","last_peered":"2024-09-12T01:29:56.751829+0000","last_clean":"2024-09-12T01:29:56.751829+0000","last_became_active":"2024-09-12T00:31:58.178148+0000","last_became_peered":"2024-09-12T00:31:58.178148+0000","last_unstale":"2024-09-12T01:29:56.751829+0000","last_undegraded":"2024-09-12T01:29:56.751829+0000","last_fullsized":"2024-09-12T01:29:56.751829+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'177","last_scrub_stamp":"2024-09-12T01:29:56.751734+0000","last_deep_scrub":"265'177","last_deep_scrub_stamp":"2024-09-12T01:29:56.751734+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.751734+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:13.896172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":405,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'112","reported_seq":718,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.361897+0000","last_change":"2024-09-12T01:29:31.361897+0000","last_active":"2024-09-12T01:29:31.361897+0000","last_peered":"2024-09-12T01:29:31.361897+0000","last_clean":"2024-09-12T01:29:31.361897+0000","last_became_active":"2024-09-12T00:31:50.142769+0000","last_became_peered":"2024-09-12T00:31:50.142769+0000","last_unstale":"2024-09-12T01:29:31.361897+0000","last_undegraded":"2024-09-12T01:29:31.361897+0000","last_fullsized":"2024-09-12T01:29:31.361897+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'112","last_scrub_stamp":"2024-09-12T01:29:31.361797+0000","last_deep_scrub":"265'112","last_deep_scrub_stamp":"2024-09-12T01:29:31.361797+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.361797+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:10.303759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":521,"num_read_kb":437,"num_write":174,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'390","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.683636+0000","last_change":"2024-09-12T01:29:23.683636+0000","last_active":"2024-09-12T01:29:23.683636+0000","last_peered":"2024-09-12T01:29:23.683636+0000","last_clean":"2024-09-12T01:29:23.683636+0000","last_became_active":"2024-09-12T00:31:47.115974+0000","last_became_peered":"2024-09-12T00:31:47.115974+0000","last_unstale":"2024-09-12T01:29:23.683636+0000","last_undegraded":"2024-09-12T01:29:23.683636+0000","last_fullsized":"2024-09-12T01:29:23.683636+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'390","last_scrub_stamp":"2024-09-12T01:29:23.683459+0000","last_deep_scrub":"265'390","last_deep_scrub_stamp":"2024-09-12T01:29:23.683459+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.683459+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:58.878415+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1843869,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":674,"num_read_kb":6022,"num_write":1105,"num_write_kb":14780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":534,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.992796+0000","last_change":"2024-09-12T01:29:24.992796+0000","last_active":"2024-09-12T01:29:24.992796+0000","last_peered":"2024-09-12T01:29:24.992796+0000","last_clean":"2024-09-12T01:29:24.992796+0000","last_became_active":"2024-09-12T00:31:37.434487+0000","last_became_peered":"2024-09-12T00:31:37.434487+0000","last_unstale":"2024-09-12T01:29:24.992796+0000","last_undegraded":"2024-09-12T01:29:24.992796+0000","last_fullsized":"2024-09-12T01:29:24.992796+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:24.992711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:24.992711+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.992711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:32.901092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.563465+0000","last_change":"2024-09-12T01:29:36.563465+0000","last_active":"2024-09-12T01:29:36.563465+0000","last_peered":"2024-09-12T01:29:36.563465+0000","last_clean":"2024-09-12T01:29:36.563465+0000","last_became_active":"2024-09-12T00:31:52.152173+0000","last_became_peered":"2024-09-12T00:31:52.152173+0000","last_unstale":"2024-09-12T01:29:36.563465+0000","last_undegraded":"2024-09-12T01:29:36.563465+0000","last_fullsized":"2024-09-12T01:29:36.563465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:36.563342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:36.563342+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.563342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:37.784991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'742","reported_seq":1480,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.193979+0000","last_change":"2024-09-12T01:29:38.193979+0000","last_active":"2024-09-12T01:29:38.193979+0000","last_peered":"2024-09-12T01:29:38.193979+0000","last_clean":"2024-09-12T01:29:38.193979+0000","last_became_active":"2024-09-12T00:31:54.169994+0000","last_became_peered":"2024-09-12T00:31:54.169994+0000","last_unstale":"2024-09-12T01:29:38.193979+0000","last_undegraded":"2024-09-12T01:29:38.193979+0000","last_fullsized":"2024-09-12T01:29:38.193979+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'742","last_scrub_stamp":"2024-09-12T01:29:38.193855+0000","last_deep_scrub":"265'742","last_deep_scrub_stamp":"2024-09-12T01:29:38.193855+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.193855+0000","objects_scrubbed":9,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:37.960206+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143669,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1312,"num_read_kb":3057,"num_write":1064,"num_write_kb":866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.589796+0000","last_change":"2024-09-12T01:29:51.589796+0000","last_active":"2024-09-12T01:29:51.589796+0000","last_peered":"2024-09-12T01:29:51.589796+0000","last_clean":"2024-09-12T01:29:51.589796+0000","last_became_active":"2024-09-12T00:31:56.172417+0000","last_became_peered":"2024-09-12T00:31:56.172417+0000","last_unstale":"2024-09-12T01:29:51.589796+0000","last_undegraded":"2024-09-12T01:29:51.589796+0000","last_fullsized":"2024-09-12T01:29:51.589796+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:51.589701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:51.589701+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.589701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:13.456056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'152","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.461726+0000","last_change":"2024-09-12T01:29:47.461726+0000","last_active":"2024-09-12T01:29:47.461726+0000","last_peered":"2024-09-12T01:29:47.461726+0000","last_clean":"2024-09-12T01:29:47.461726+0000","last_became_active":"2024-09-12T00:31:58.179998+0000","last_became_peered":"2024-09-12T00:31:58.179998+0000","last_unstale":"2024-09-12T01:29:47.461726+0000","last_undegraded":"2024-09-12T01:29:47.461726+0000","last_fullsized":"2024-09-12T01:29:47.461726+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'152","last_scrub_stamp":"2024-09-12T01:29:47.461655+0000","last_deep_scrub":"265'152","last_deep_scrub_stamp":"2024-09-12T01:29:47.461655+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.461655+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:32.937279+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":177,"num_read_kb":166,"num_write":377,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'160","reported_seq":732,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.599738+0000","last_change":"2024-09-12T01:29:57.599738+0000","last_active":"2024-09-12T01:29:57.599738+0000","last_peered":"2024-09-12T01:29:57.599738+0000","last_clean":"2024-09-12T01:29:57.599738+0000","last_became_active":"2024-09-12T00:31:58.177936+0000","last_became_peered":"2024-09-12T00:31:58.177936+0000","last_unstale":"2024-09-12T01:29:57.599738+0000","last_undegraded":"2024-09-12T01:29:57.599738+0000","last_fullsized":"2024-09-12T01:29:57.599738+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T01:29:57.599619+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T01:29:57.599619+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.599619+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:16.682708+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":226,"num_read_kb":224,"num_write":377,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'98","reported_seq":689,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.451036+0000","last_change":"2024-09-12T01:29:35.451036+0000","last_active":"2024-09-12T01:29:35.451036+0000","last_peered":"2024-09-12T01:29:35.451036+0000","last_clean":"2024-09-12T01:29:35.451036+0000","last_became_active":"2024-09-12T00:31:50.142206+0000","last_became_peered":"2024-09-12T00:31:50.142206+0000","last_unstale":"2024-09-12T01:29:35.451036+0000","last_undegraded":"2024-09-12T01:29:35.451036+0000","last_fullsized":"2024-09-12T01:29:35.451036+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'98","last_scrub_stamp":"2024-09-12T01:29:35.450943+0000","last_deep_scrub":"265'98","last_deep_scrub_stamp":"2024-09-12T01:29:35.450943+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.450943+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:46.081581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":133,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'318","reported_seq":931,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.980971+0000","last_change":"2024-09-12T01:29:29.980971+0000","last_active":"2024-09-12T01:29:29.980971+0000","last_peered":"2024-09-12T01:29:29.980971+0000","last_clean":"2024-09-12T01:29:29.980971+0000","last_became_active":"2024-09-12T00:31:47.128005+0000","last_became_peered":"2024-09-12T00:31:47.128005+0000","last_unstale":"2024-09-12T01:29:29.980971+0000","last_undegraded":"2024-09-12T01:29:29.980971+0000","last_fullsized":"2024-09-12T01:29:29.980971+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T01:29:29.980824+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T01:29:29.980824+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.980824+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:44.159677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174744,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":395,"num_read_kb":1002,"num_write":979,"num_write_kb":27047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.117730+0000","last_change":"2024-09-12T01:29:42.117730+0000","last_active":"2024-09-12T01:29:42.117730+0000","last_peered":"2024-09-12T01:29:42.117730+0000","last_clean":"2024-09-12T01:29:42.117730+0000","last_became_active":"2024-09-12T00:31:52.153927+0000","last_became_peered":"2024-09-12T00:31:52.153927+0000","last_unstale":"2024-09-12T01:29:42.117730+0000","last_undegraded":"2024-09-12T01:29:42.117730+0000","last_fullsized":"2024-09-12T01:29:42.117730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:42.117637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:42.117637+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.117637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:56.850260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'295","reported_seq":881,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.057570+0000","last_change":"2024-09-12T01:29:46.057570+0000","last_active":"2024-09-12T01:29:46.057570+0000","last_peered":"2024-09-12T01:29:46.057570+0000","last_clean":"2024-09-12T01:29:46.057570+0000","last_became_active":"2024-09-12T00:31:54.167414+0000","last_became_peered":"2024-09-12T00:31:54.167414+0000","last_unstale":"2024-09-12T01:29:46.057570+0000","last_undegraded":"2024-09-12T01:29:46.057570+0000","last_fullsized":"2024-09-12T01:29:46.057570+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'295","last_scrub_stamp":"2024-09-12T01:29:46.057480+0000","last_deep_scrub":"265'295","last_deep_scrub_stamp":"2024-09-12T01:29:46.057480+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.057480+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:24.477901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44314,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":1087,"num_write":386,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.610937+0000","last_change":"2024-09-12T01:29:44.610937+0000","last_active":"2024-09-12T01:29:44.610937+0000","last_peered":"2024-09-12T01:29:44.610937+0000","last_clean":"2024-09-12T01:29:44.610937+0000","last_became_active":"2024-09-12T00:31:56.173412+0000","last_became_peered":"2024-09-12T00:31:56.173412+0000","last_unstale":"2024-09-12T01:29:44.610937+0000","last_undegraded":"2024-09-12T01:29:44.610937+0000","last_fullsized":"2024-09-12T01:29:44.610937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:44.610803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:44.610803+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.610803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:24.276208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'129","reported_seq":650,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.589849+0000","last_change":"2024-09-12T01:29:48.589849+0000","last_active":"2024-09-12T01:29:48.589849+0000","last_peered":"2024-09-12T01:29:48.589849+0000","last_clean":"2024-09-12T01:29:48.589849+0000","last_became_active":"2024-09-12T00:31:58.176322+0000","last_became_peered":"2024-09-12T00:31:58.176322+0000","last_unstale":"2024-09-12T01:29:48.589849+0000","last_undegraded":"2024-09-12T01:29:48.589849+0000","last_fullsized":"2024-09-12T01:29:48.589849+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T01:29:48.589752+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T01:29:48.589752+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.589752+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:17.155396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":158,"num_write":327,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'158","reported_seq":814,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.560489+0000","last_change":"2024-09-12T01:29:29.560489+0000","last_active":"2024-09-12T01:29:29.560489+0000","last_peered":"2024-09-12T01:29:29.560489+0000","last_clean":"2024-09-12T01:29:29.560489+0000","last_became_active":"2024-09-12T00:31:50.127724+0000","last_became_peered":"2024-09-12T00:31:50.127724+0000","last_unstale":"2024-09-12T01:29:29.560489+0000","last_undegraded":"2024-09-12T01:29:29.560489+0000","last_fullsized":"2024-09-12T01:29:29.560489+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'158","last_scrub_stamp":"2024-09-12T01:29:29.560401+0000","last_deep_scrub":"265'158","last_deep_scrub_stamp":"2024-09-12T01:29:29.560401+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.560401+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.392412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":587,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'366","reported_seq":1138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.924631+0000","last_change":"2024-09-12T01:29:21.924574+0000","last_active":"2024-09-12T01:29:21.924631+0000","last_peered":"2024-09-12T01:29:21.924631+0000","last_clean":"2024-09-12T01:29:21.924631+0000","last_became_active":"2024-09-12T00:31:47.138565+0000","last_became_peered":"2024-09-12T00:31:47.138565+0000","last_unstale":"2024-09-12T01:29:21.924631+0000","last_undegraded":"2024-09-12T01:29:21.924631+0000","last_fullsized":"2024-09-12T01:29:21.924631+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T01:29:21.924465+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T01:29:21.924465+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.924465+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:33.989434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133731,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":777,"num_read_kb":53412,"num_write":1135,"num_write_kb":60803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":511,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.596083+0000","last_change":"2024-09-12T01:29:41.596083+0000","last_active":"2024-09-12T01:29:41.596083+0000","last_peered":"2024-09-12T01:29:41.596083+0000","last_clean":"2024-09-12T01:29:41.596083+0000","last_became_active":"2024-09-12T00:31:52.154829+0000","last_became_peered":"2024-09-12T00:31:52.154829+0000","last_unstale":"2024-09-12T01:29:41.596083+0000","last_undegraded":"2024-09-12T01:29:41.596083+0000","last_fullsized":"2024-09-12T01:29:41.596083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:41.595994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:41.595994+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.595994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:10.895105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'43","reported_seq":562,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.512926+0000","last_change":"2024-09-12T01:29:47.512926+0000","last_active":"2024-09-12T01:29:47.512926+0000","last_peered":"2024-09-12T01:29:47.512926+0000","last_clean":"2024-09-12T01:29:47.512926+0000","last_became_active":"2024-09-12T00:31:54.162657+0000","last_became_peered":"2024-09-12T00:31:54.162657+0000","last_unstale":"2024-09-12T01:29:47.512926+0000","last_undegraded":"2024-09-12T01:29:47.512926+0000","last_fullsized":"2024-09-12T01:29:47.512926+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'43","last_scrub_stamp":"2024-09-12T01:29:47.512829+0000","last_deep_scrub":"265'43","last_deep_scrub_stamp":"2024-09-12T01:29:47.512829+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.512829+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:34.991103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.474695+0000","last_change":"2024-09-12T01:29:45.474695+0000","last_active":"2024-09-12T01:29:45.474695+0000","last_peered":"2024-09-12T01:29:45.474695+0000","last_clean":"2024-09-12T01:29:45.474695+0000","last_became_active":"2024-09-12T00:31:56.170648+0000","last_became_peered":"2024-09-12T00:31:56.170648+0000","last_unstale":"2024-09-12T01:29:45.474695+0000","last_undegraded":"2024-09-12T01:29:45.474695+0000","last_fullsized":"2024-09-12T01:29:45.474695+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:45.474603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:45.474603+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.474603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:59.854027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'218","reported_seq":751,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.080957+0000","last_change":"2024-09-12T01:29:54.080957+0000","last_active":"2024-09-12T01:29:54.080957+0000","last_peered":"2024-09-12T01:29:54.080957+0000","last_clean":"2024-09-12T01:29:54.080957+0000","last_became_active":"2024-09-12T00:31:58.172511+0000","last_became_peered":"2024-09-12T00:31:58.172511+0000","last_unstale":"2024-09-12T01:29:54.080957+0000","last_undegraded":"2024-09-12T01:29:54.080957+0000","last_fullsized":"2024-09-12T01:29:54.080957+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'218","last_scrub_stamp":"2024-09-12T01:29:54.080859+0000","last_deep_scrub":"265'218","last_deep_scrub_stamp":"2024-09-12T01:29:54.080859+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.080859+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:57.488220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":356,"num_read_kb":339,"num_write":509,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'63","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.576959+0000","last_change":"2024-09-12T01:29:28.576959+0000","last_active":"2024-09-12T01:29:28.576959+0000","last_peered":"2024-09-12T01:29:28.576959+0000","last_clean":"2024-09-12T01:29:28.576959+0000","last_became_active":"2024-09-12T00:31:50.124994+0000","last_became_peered":"2024-09-12T00:31:50.124994+0000","last_unstale":"2024-09-12T01:29:28.576959+0000","last_undegraded":"2024-09-12T01:29:28.576959+0000","last_fullsized":"2024-09-12T01:29:28.576959+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'63","last_scrub_stamp":"2024-09-12T01:29:28.576859+0000","last_deep_scrub":"265'63","last_deep_scrub_stamp":"2024-09-12T01:29:28.576859+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.576859+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:46.559642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":221,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'334","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.395459+0000","last_change":"2024-09-12T01:29:25.395373+0000","last_active":"2024-09-12T01:29:25.395459+0000","last_peered":"2024-09-12T01:29:25.395459+0000","last_clean":"2024-09-12T01:29:25.395459+0000","last_became_active":"2024-09-12T00:31:47.134398+0000","last_became_peered":"2024-09-12T00:31:47.134398+0000","last_unstale":"2024-09-12T01:29:25.395459+0000","last_undegraded":"2024-09-12T01:29:25.395459+0000","last_fullsized":"2024-09-12T01:29:25.395459+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-12T01:29:25.395184+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-12T01:29:25.395184+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.395184+0000","objects_scrubbed":9,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:04.761120+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788554,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":470,"num_read_kb":102268,"num_write":1066,"num_write_kb":44150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.466136+0000","last_change":"2024-09-12T01:29:34.466136+0000","last_active":"2024-09-12T01:29:34.466136+0000","last_peered":"2024-09-12T01:29:34.466136+0000","last_clean":"2024-09-12T01:29:34.466136+0000","last_became_active":"2024-09-12T00:31:52.151826+0000","last_became_peered":"2024-09-12T00:31:52.151826+0000","last_unstale":"2024-09-12T01:29:34.466136+0000","last_undegraded":"2024-09-12T01:29:34.466136+0000","last_fullsized":"2024-09-12T01:29:34.466136+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:34.466045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:34.466045+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.466045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:00.120324+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'305","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.528727+0000","last_change":"2024-09-12T01:29:39.528727+0000","last_active":"2024-09-12T01:29:39.528727+0000","last_peered":"2024-09-12T01:29:39.528727+0000","last_clean":"2024-09-12T01:29:39.528727+0000","last_became_active":"2024-09-12T00:31:54.162188+0000","last_became_peered":"2024-09-12T00:31:54.162188+0000","last_unstale":"2024-09-12T01:29:39.528727+0000","last_undegraded":"2024-09-12T01:29:39.528727+0000","last_fullsized":"2024-09-12T01:29:39.528727+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T01:29:39.528595+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T01:29:39.528595+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.528595+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:29.037553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49464,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":505,"num_read_kb":1076,"num_write":398,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.559741+0000","last_change":"2024-09-12T01:29:42.559741+0000","last_active":"2024-09-12T01:29:42.559741+0000","last_peered":"2024-09-12T01:29:42.559741+0000","last_clean":"2024-09-12T01:29:42.559741+0000","last_became_active":"2024-09-12T00:31:56.168434+0000","last_became_peered":"2024-09-12T00:31:56.168434+0000","last_unstale":"2024-09-12T01:29:42.559741+0000","last_undegraded":"2024-09-12T01:29:42.559741+0000","last_fullsized":"2024-09-12T01:29:42.559741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:42.559636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:42.559636+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.559636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:26.790467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'127","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:47.538257+0000","last_change":"2024-09-12T00:31:58.173821+0000","last_active":"2024-09-12T01:27:47.538257+0000","last_peered":"2024-09-12T01:27:47.538257+0000","last_clean":"2024-09-12T01:27:47.538257+0000","last_became_active":"2024-09-12T00:31:58.173552+0000","last_became_peered":"2024-09-12T00:31:58.173552+0000","last_unstale":"2024-09-12T01:27:47.538257+0000","last_undegraded":"2024-09-12T01:27:47.538257+0000","last_fullsized":"2024-09-12T01:27:47.538257+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":198,"num_write":331,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'108","reported_seq":702,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.592252+0000","last_change":"2024-09-12T01:29:29.592252+0000","last_active":"2024-09-12T01:29:29.592252+0000","last_peered":"2024-09-12T01:29:29.592252+0000","last_clean":"2024-09-12T01:29:29.592252+0000","last_became_active":"2024-09-12T00:31:50.133117+0000","last_became_peered":"2024-09-12T00:31:50.133117+0000","last_unstale":"2024-09-12T01:29:29.592252+0000","last_undegraded":"2024-09-12T01:29:29.592252+0000","last_fullsized":"2024-09-12T01:29:29.592252+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'108","last_scrub_stamp":"2024-09-12T01:29:29.592164+0000","last_deep_scrub":"265'108","last_deep_scrub_stamp":"2024-09-12T01:29:29.592164+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.592164+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:46.847768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":426,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'425","reported_seq":1164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.746659+0000","last_change":"2024-09-12T01:29:24.746585+0000","last_active":"2024-09-12T01:29:24.746659+0000","last_peered":"2024-09-12T01:29:24.746659+0000","last_clean":"2024-09-12T01:29:24.746659+0000","last_became_active":"2024-09-12T00:31:47.127603+0000","last_became_peered":"2024-09-12T00:31:47.127603+0000","last_unstale":"2024-09-12T01:29:24.746659+0000","last_undegraded":"2024-09-12T01:29:24.746659+0000","last_fullsized":"2024-09-12T01:29:24.746659+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'425","last_scrub_stamp":"2024-09-12T01:29:24.746482+0000","last_deep_scrub":"265'425","last_deep_scrub_stamp":"2024-09-12T01:29:24.746482+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.746482+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:59.902513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":834,"num_read_kb":29446,"num_write":1356,"num_write_kb":48637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.315197+0000","last_change":"2024-09-12T01:29:50.315197+0000","last_active":"2024-09-12T01:29:50.315197+0000","last_peered":"2024-09-12T01:29:50.315197+0000","last_clean":"2024-09-12T01:29:50.315197+0000","last_became_active":"2024-09-12T00:31:52.152398+0000","last_became_peered":"2024-09-12T00:31:52.152398+0000","last_unstale":"2024-09-12T01:29:50.315197+0000","last_undegraded":"2024-09-12T01:29:50.315197+0000","last_fullsized":"2024-09-12T01:29:50.315197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:50.315105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:50.315105+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.315105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:18.800901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'279","reported_seq":859,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.191230+0000","last_change":"2024-09-12T01:29:41.191230+0000","last_active":"2024-09-12T01:29:41.191230+0000","last_peered":"2024-09-12T01:29:41.191230+0000","last_clean":"2024-09-12T01:29:41.191230+0000","last_became_active":"2024-09-12T00:31:54.171386+0000","last_became_peered":"2024-09-12T00:31:54.171386+0000","last_unstale":"2024-09-12T01:29:41.191230+0000","last_undegraded":"2024-09-12T01:29:41.191230+0000","last_fullsized":"2024-09-12T01:29:41.191230+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'279","last_scrub_stamp":"2024-09-12T01:29:41.191130+0000","last_deep_scrub":"265'279","last_deep_scrub_stamp":"2024-09-12T01:29:41.191130+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.191130+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:18.450325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46739,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":1088,"num_write":376,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.601410+0000","last_change":"2024-09-12T01:29:42.601410+0000","last_active":"2024-09-12T01:29:42.601410+0000","last_peered":"2024-09-12T01:29:42.601410+0000","last_clean":"2024-09-12T01:29:42.601410+0000","last_became_active":"2024-09-12T00:31:56.167213+0000","last_became_peered":"2024-09-12T00:31:56.167213+0000","last_unstale":"2024-09-12T01:29:42.601410+0000","last_undegraded":"2024-09-12T01:29:42.601410+0000","last_fullsized":"2024-09-12T01:29:42.601410+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:42.601326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:42.601326+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.601326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:58.024251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'120","reported_seq":749,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.144462+0000","last_change":"2024-09-12T01:29:40.144462+0000","last_active":"2024-09-12T01:29:40.144462+0000","last_peered":"2024-09-12T01:29:40.144462+0000","last_clean":"2024-09-12T01:29:40.144462+0000","last_became_active":"2024-09-12T00:31:50.139863+0000","last_became_peered":"2024-09-12T00:31:50.139863+0000","last_unstale":"2024-09-12T01:29:40.144462+0000","last_undegraded":"2024-09-12T01:29:40.144462+0000","last_fullsized":"2024-09-12T01:29:40.144462+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'120","last_scrub_stamp":"2024-09-12T01:29:40.144376+0000","last_deep_scrub":"265'120","last_deep_scrub_stamp":"2024-09-12T01:29:40.144376+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.144376+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:11.609630+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":466,"num_write":169,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'448","reported_seq":1152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.795430+0000","last_change":"2024-09-12T01:29:25.795366+0000","last_active":"2024-09-12T01:29:25.795430+0000","last_peered":"2024-09-12T01:29:25.795430+0000","last_clean":"2024-09-12T01:29:25.795430+0000","last_became_active":"2024-09-12T00:31:47.133283+0000","last_became_peered":"2024-09-12T00:31:47.133283+0000","last_unstale":"2024-09-12T01:29:25.795430+0000","last_undegraded":"2024-09-12T01:29:25.795430+0000","last_fullsized":"2024-09-12T01:29:25.795430+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'448","last_scrub_stamp":"2024-09-12T01:29:25.795214+0000","last_deep_scrub":"265'448","last_deep_scrub_stamp":"2024-09-12T01:29:25.795214+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.795214+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:54.503325+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133704,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":743,"num_read_kb":14924,"num_write":1450,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.105971+0000","last_change":"2024-09-12T01:29:43.105971+0000","last_active":"2024-09-12T01:29:43.105971+0000","last_peered":"2024-09-12T01:29:43.105971+0000","last_clean":"2024-09-12T01:29:43.105971+0000","last_became_active":"2024-09-12T00:31:52.152676+0000","last_became_peered":"2024-09-12T00:31:52.152676+0000","last_unstale":"2024-09-12T01:29:43.105971+0000","last_undegraded":"2024-09-12T01:29:43.105971+0000","last_fullsized":"2024-09-12T01:29:43.105971+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:43.105857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:43.105857+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.105857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:58.634409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'515","reported_seq":1155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.021086+0000","last_change":"2024-09-12T01:29:50.021086+0000","last_active":"2024-09-12T01:29:50.021086+0000","last_peered":"2024-09-12T01:29:50.021086+0000","last_clean":"2024-09-12T01:29:50.021086+0000","last_became_active":"2024-09-12T00:31:54.171225+0000","last_became_peered":"2024-09-12T00:31:54.171225+0000","last_unstale":"2024-09-12T01:29:50.021086+0000","last_undegraded":"2024-09-12T01:29:50.021086+0000","last_fullsized":"2024-09-12T01:29:50.021086+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'515","last_scrub_stamp":"2024-09-12T01:29:50.020987+0000","last_deep_scrub":"265'515","last_deep_scrub_stamp":"2024-09-12T01:29:50.020987+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.020987+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:30.996334+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95922,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":923,"num_read_kb":2207,"num_write":796,"num_write_kb":707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.447754+0000","last_change":"2024-09-12T01:29:43.447754+0000","last_active":"2024-09-12T01:29:43.447754+0000","last_peered":"2024-09-12T01:29:43.447754+0000","last_clean":"2024-09-12T01:29:43.447754+0000","last_became_active":"2024-09-12T00:31:56.175562+0000","last_became_peered":"2024-09-12T00:31:56.175562+0000","last_unstale":"2024-09-12T01:29:43.447754+0000","last_undegraded":"2024-09-12T01:29:43.447754+0000","last_fullsized":"2024-09-12T01:29:43.447754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:43.447666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:43.447666+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.447666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:05.961632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'144","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.746281+0000","last_change":"2024-09-12T01:29:59.746281+0000","last_active":"2024-09-12T01:29:59.746281+0000","last_peered":"2024-09-12T01:29:59.746281+0000","last_clean":"2024-09-12T01:29:59.746281+0000","last_became_active":"2024-09-12T00:31:58.182602+0000","last_became_peered":"2024-09-12T00:31:58.182602+0000","last_unstale":"2024-09-12T01:29:59.746281+0000","last_undegraded":"2024-09-12T01:29:59.746281+0000","last_fullsized":"2024-09-12T01:29:59.746281+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:29:59.746182+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:29:59.746182+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.746182+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.081045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":164,"num_write":296,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'135","reported_seq":765,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.579405+0000","last_change":"2024-09-12T01:29:31.579405+0000","last_active":"2024-09-12T01:29:31.579405+0000","last_peered":"2024-09-12T01:29:31.579405+0000","last_clean":"2024-09-12T01:29:31.579405+0000","last_became_active":"2024-09-12T00:31:50.132053+0000","last_became_peered":"2024-09-12T00:31:50.132053+0000","last_unstale":"2024-09-12T01:29:31.579405+0000","last_undegraded":"2024-09-12T01:29:31.579405+0000","last_fullsized":"2024-09-12T01:29:31.579405+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T01:29:31.579303+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T01:29:31.579303+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.579303+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.679511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":637,"num_read_kb":540,"num_write":205,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'319","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.654872+0000","last_change":"2024-09-12T01:29:26.654810+0000","last_active":"2024-09-12T01:29:26.654872+0000","last_peered":"2024-09-12T01:29:26.654872+0000","last_clean":"2024-09-12T01:29:26.654872+0000","last_became_active":"2024-09-12T00:31:47.114966+0000","last_became_peered":"2024-09-12T00:31:47.114966+0000","last_unstale":"2024-09-12T01:29:26.654872+0000","last_undegraded":"2024-09-12T01:29:26.654872+0000","last_fullsized":"2024-09-12T01:29:26.654872+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T01:29:26.654700+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T01:29:26.654700+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.654700+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:07.153488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279295,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":490,"num_read_kb":26176,"num_write":1107,"num_write_kb":27429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.402798+0000","last_change":"2024-09-12T01:29:39.402798+0000","last_active":"2024-09-12T01:29:39.402798+0000","last_peered":"2024-09-12T01:29:39.402798+0000","last_clean":"2024-09-12T01:29:39.402798+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:29:39.402798+0000","last_undegraded":"2024-09-12T01:29:39.402798+0000","last_fullsized":"2024-09-12T01:29:39.402798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:39.402710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:39.402710+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.402710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:26.430951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'301","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.295518+0000","last_change":"2024-09-12T01:29:55.295518+0000","last_active":"2024-09-12T01:29:55.295518+0000","last_peered":"2024-09-12T01:29:55.295518+0000","last_clean":"2024-09-12T01:29:55.295518+0000","last_became_active":"2024-09-12T00:31:54.165996+0000","last_became_peered":"2024-09-12T00:31:54.165996+0000","last_unstale":"2024-09-12T01:29:55.295518+0000","last_undegraded":"2024-09-12T01:29:55.295518+0000","last_fullsized":"2024-09-12T01:29:55.295518+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'301","last_scrub_stamp":"2024-09-12T01:29:55.295422+0000","last_deep_scrub":"265'301","last_deep_scrub_stamp":"2024-09-12T01:29:55.295422+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.295422+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:02.542094+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":488,"num_read_kb":1000,"num_write":400,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.762516+0000","last_change":"2024-09-12T01:29:53.762516+0000","last_active":"2024-09-12T01:29:53.762516+0000","last_peered":"2024-09-12T01:29:53.762516+0000","last_clean":"2024-09-12T01:29:53.762516+0000","last_became_active":"2024-09-12T00:31:56.170994+0000","last_became_peered":"2024-09-12T00:31:56.170994+0000","last_unstale":"2024-09-12T01:29:53.762516+0000","last_undegraded":"2024-09-12T01:29:53.762516+0000","last_fullsized":"2024-09-12T01:29:53.762516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:53.762429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:53.762429+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.762429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:18.418793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'162","reported_seq":669,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:06.007997+0000","last_change":"2024-09-12T00:31:58.183946+0000","last_active":"2024-09-12T01:27:06.007997+0000","last_peered":"2024-09-12T01:27:06.007997+0000","last_clean":"2024-09-12T01:27:06.007997+0000","last_became_active":"2024-09-12T00:31:58.183625+0000","last_became_peered":"2024-09-12T00:31:58.183625+0000","last_unstale":"2024-09-12T01:27:06.007997+0000","last_undegraded":"2024-09-12T01:27:06.007997+0000","last_fullsized":"2024-09-12T01:27:06.007997+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:34.434376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2035,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":465,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'119","reported_seq":704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.609043+0000","last_change":"2024-09-12T01:29:30.609043+0000","last_active":"2024-09-12T01:29:30.609043+0000","last_peered":"2024-09-12T01:29:30.609043+0000","last_clean":"2024-09-12T01:29:30.609043+0000","last_became_active":"2024-09-12T00:31:50.143427+0000","last_became_peered":"2024-09-12T00:31:50.143427+0000","last_unstale":"2024-09-12T01:29:30.609043+0000","last_undegraded":"2024-09-12T01:29:30.609043+0000","last_fullsized":"2024-09-12T01:29:30.609043+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T01:29:30.608948+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T01:29:30.608948+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.608948+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:44.221971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":539,"num_read_kb":443,"num_write":196,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'364","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.374053+0000","last_change":"2024-09-12T01:29:23.374053+0000","last_active":"2024-09-12T01:29:23.374053+0000","last_peered":"2024-09-12T01:29:23.374053+0000","last_clean":"2024-09-12T01:29:23.374053+0000","last_became_active":"2024-09-12T00:31:47.117631+0000","last_became_peered":"2024-09-12T00:31:47.117631+0000","last_unstale":"2024-09-12T01:29:23.374053+0000","last_undegraded":"2024-09-12T01:29:23.374053+0000","last_fullsized":"2024-09-12T01:29:23.374053+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T01:29:23.373946+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T01:29:23.373946+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.373946+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:26.118563+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":597,"num_read_kb":5850,"num_write":1220,"num_write_kb":26346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.372836+0000","last_change":"2024-09-12T01:29:38.372836+0000","last_active":"2024-09-12T01:29:38.372836+0000","last_peered":"2024-09-12T01:29:38.372836+0000","last_clean":"2024-09-12T01:29:38.372836+0000","last_became_active":"2024-09-12T00:31:52.151796+0000","last_became_peered":"2024-09-12T00:31:52.151796+0000","last_unstale":"2024-09-12T01:29:38.372836+0000","last_undegraded":"2024-09-12T01:29:38.372836+0000","last_fullsized":"2024-09-12T01:29:38.372836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:38.372741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:38.372741+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.372741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:52.582073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'318","reported_seq":907,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.066860+0000","last_change":"2024-09-12T01:29:49.066860+0000","last_active":"2024-09-12T01:29:49.066860+0000","last_peered":"2024-09-12T01:29:49.066860+0000","last_clean":"2024-09-12T01:29:49.066860+0000","last_became_active":"2024-09-12T00:31:54.170965+0000","last_became_peered":"2024-09-12T00:31:54.170965+0000","last_unstale":"2024-09-12T01:29:49.066860+0000","last_undegraded":"2024-09-12T01:29:49.066860+0000","last_fullsized":"2024-09-12T01:29:49.066860+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T01:29:49.066754+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T01:29:49.066754+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.066754+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:17.398545+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":509,"num_read_kb":1155,"num_write":420,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.649713+0000","last_change":"2024-09-12T01:29:43.649713+0000","last_active":"2024-09-12T01:29:43.649713+0000","last_peered":"2024-09-12T01:29:43.649713+0000","last_clean":"2024-09-12T01:29:43.649713+0000","last_became_active":"2024-09-12T00:31:56.172337+0000","last_became_peered":"2024-09-12T00:31:56.172337+0000","last_unstale":"2024-09-12T01:29:43.649713+0000","last_undegraded":"2024-09-12T01:29:43.649713+0000","last_fullsized":"2024-09-12T01:29:43.649713+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:43.649625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:43.649625+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.649625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:50.361632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'133","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:55.342581+0000","last_change":"2024-09-12T00:31:58.178826+0000","last_active":"2024-09-12T01:28:55.342581+0000","last_peered":"2024-09-12T01:28:55.342581+0000","last_clean":"2024-09-12T01:28:55.342581+0000","last_became_active":"2024-09-12T00:31:58.178565+0000","last_became_peered":"2024-09-12T00:31:58.178565+0000","last_unstale":"2024-09-12T01:28:55.342581+0000","last_undegraded":"2024-09-12T01:28:55.342581+0000","last_fullsized":"2024-09-12T01:28:55.342581+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:24:10.421354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":335,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'510","reported_seq":1287,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.608617+0000","last_change":"2024-09-12T01:29:32.608617+0000","last_active":"2024-09-12T01:29:32.608617+0000","last_peered":"2024-09-12T01:29:32.608617+0000","last_clean":"2024-09-12T01:29:32.608617+0000","last_became_active":"2024-09-12T00:31:50.137671+0000","last_became_peered":"2024-09-12T00:31:50.137671+0000","last_unstale":"2024-09-12T01:29:32.608617+0000","last_undegraded":"2024-09-12T01:29:32.608617+0000","last_fullsized":"2024-09-12T01:29:32.608617+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'510","last_scrub_stamp":"2024-09-12T01:29:32.608525+0000","last_deep_scrub":"265'510","last_deep_scrub_stamp":"2024-09-12T01:29:32.608525+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.608525+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:22.202787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2432,"num_read_kb":2072,"num_write":871,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'466","reported_seq":1282,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.608766+0000","last_change":"2024-09-12T01:29:27.608766+0000","last_active":"2024-09-12T01:29:27.608766+0000","last_peered":"2024-09-12T01:29:27.608766+0000","last_clean":"2024-09-12T01:29:27.608766+0000","last_became_active":"2024-09-12T00:31:47.130035+0000","last_became_peered":"2024-09-12T00:31:47.130035+0000","last_unstale":"2024-09-12T01:29:27.608766+0000","last_undegraded":"2024-09-12T01:29:27.608766+0000","last_fullsized":"2024-09-12T01:29:27.608766+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'466","last_scrub_stamp":"2024-09-12T01:29:27.608666+0000","last_deep_scrub":"265'466","last_deep_scrub_stamp":"2024-09-12T01:29:27.608666+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.608666+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:56.750595+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1077,"num_read_kb":24732,"num_write":1307,"num_write_kb":48327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.580564+0000","last_change":"2024-09-12T01:29:43.580564+0000","last_active":"2024-09-12T01:29:43.580564+0000","last_peered":"2024-09-12T01:29:43.580564+0000","last_clean":"2024-09-12T01:29:43.580564+0000","last_became_active":"2024-09-12T00:31:52.155279+0000","last_became_peered":"2024-09-12T00:31:52.155279+0000","last_unstale":"2024-09-12T01:29:43.580564+0000","last_undegraded":"2024-09-12T01:29:43.580564+0000","last_fullsized":"2024-09-12T01:29:43.580564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:43.580473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:43.580473+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.580473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:44.144061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'121","reported_seq":663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.338024+0000","last_change":"2024-09-12T01:29:56.337967+0000","last_active":"2024-09-12T01:29:56.338024+0000","last_peered":"2024-09-12T01:29:56.338024+0000","last_clean":"2024-09-12T01:29:56.338024+0000","last_became_active":"2024-09-12T00:31:54.165779+0000","last_became_peered":"2024-09-12T00:31:54.165779+0000","last_unstale":"2024-09-12T01:29:56.338024+0000","last_undegraded":"2024-09-12T01:29:56.338024+0000","last_fullsized":"2024-09-12T01:29:56.338024+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'121","last_scrub_stamp":"2024-09-12T01:29:56.337858+0000","last_deep_scrub":"265'121","last_deep_scrub_stamp":"2024-09-12T01:29:56.337858+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.337858+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:59.195945+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":137,"num_write":154,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'763","reported_seq":2347,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.140488+0000","last_change":"2024-09-12T01:29:42.140488+0000","last_active":"2024-09-12T01:29:42.140488+0000","last_peered":"2024-09-12T01:29:42.140488+0000","last_clean":"2024-09-12T01:29:42.140488+0000","last_became_active":"2024-09-12T00:31:56.172551+0000","last_became_peered":"2024-09-12T00:31:56.172551+0000","last_unstale":"2024-09-12T01:29:42.140488+0000","last_undegraded":"2024-09-12T01:29:42.140488+0000","last_fullsized":"2024-09-12T01:29:42.140488+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'763","last_scrub_stamp":"2024-09-12T01:29:42.140404+0000","last_deep_scrub":"265'763","last_deep_scrub_stamp":"2024-09-12T01:29:42.140404+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.140404+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:02.458026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'122","reported_seq":624,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.358220+0000","last_change":"2024-09-12T01:29:59.358220+0000","last_active":"2024-09-12T01:29:59.358220+0000","last_peered":"2024-09-12T01:29:59.358220+0000","last_clean":"2024-09-12T01:29:59.358220+0000","last_became_active":"2024-09-12T00:31:58.178671+0000","last_became_peered":"2024-09-12T00:31:58.178671+0000","last_unstale":"2024-09-12T01:29:59.358220+0000","last_undegraded":"2024-09-12T01:29:59.358220+0000","last_fullsized":"2024-09-12T01:29:59.358220+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'122","last_scrub_stamp":"2024-09-12T01:29:59.358135+0000","last_deep_scrub":"265'122","last_deep_scrub_stamp":"2024-09-12T01:29:59.358135+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.358135+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:49.917414+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'144","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.413643+0000","last_change":"2024-09-12T01:29:36.413643+0000","last_active":"2024-09-12T01:29:36.413643+0000","last_peered":"2024-09-12T01:29:36.413643+0000","last_clean":"2024-09-12T01:29:36.413643+0000","last_became_active":"2024-09-12T00:31:50.143377+0000","last_became_peered":"2024-09-12T00:31:50.143377+0000","last_unstale":"2024-09-12T01:29:36.413643+0000","last_undegraded":"2024-09-12T01:29:36.413643+0000","last_fullsized":"2024-09-12T01:29:36.413643+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:29:36.413557+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:29:36.413557+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.413557+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:23.640462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":664,"num_read_kb":566,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'384","reported_seq":1109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.374852+0000","last_change":"2024-09-12T01:29:22.374852+0000","last_active":"2024-09-12T01:29:22.374852+0000","last_peered":"2024-09-12T01:29:22.374852+0000","last_clean":"2024-09-12T01:29:22.374852+0000","last_became_active":"2024-09-12T00:31:47.128555+0000","last_became_peered":"2024-09-12T00:31:47.128555+0000","last_unstale":"2024-09-12T01:29:22.374852+0000","last_undegraded":"2024-09-12T01:29:22.374852+0000","last_fullsized":"2024-09-12T01:29:22.374852+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-12T01:29:22.374771+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-12T01:29:22.374771+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.374771+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:28.766984+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2058190,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":740,"num_read_kb":10967,"num_write":1262,"num_write_kb":23618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.443104+0000","last_change":"2024-09-12T01:29:35.443104+0000","last_active":"2024-09-12T01:29:35.443104+0000","last_peered":"2024-09-12T01:29:35.443104+0000","last_clean":"2024-09-12T01:29:35.443104+0000","last_became_active":"2024-09-12T00:31:52.150825+0000","last_became_peered":"2024-09-12T00:31:52.150825+0000","last_unstale":"2024-09-12T01:29:35.443104+0000","last_undegraded":"2024-09-12T01:29:35.443104+0000","last_fullsized":"2024-09-12T01:29:35.443104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:35.443014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:35.443014+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.443014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:07.660789+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'354","reported_seq":974,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.144886+0000","last_change":"2024-09-12T01:29:43.144886+0000","last_active":"2024-09-12T01:29:43.144886+0000","last_peered":"2024-09-12T01:29:43.144886+0000","last_clean":"2024-09-12T01:29:43.144886+0000","last_became_active":"2024-09-12T00:31:54.169308+0000","last_became_peered":"2024-09-12T00:31:54.169308+0000","last_unstale":"2024-09-12T01:29:43.144886+0000","last_undegraded":"2024-09-12T01:29:43.144886+0000","last_fullsized":"2024-09-12T01:29:43.144886+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T01:29:43.144787+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T01:29:43.144787+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.144787+0000","objects_scrubbed":11,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:53.988315+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45185,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":558,"num_read_kb":1163,"num_write":446,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.607601+0000","last_change":"2024-09-12T01:29:54.607513+0000","last_active":"2024-09-12T01:29:54.607601+0000","last_peered":"2024-09-12T01:29:54.607601+0000","last_clean":"2024-09-12T01:29:54.607601+0000","last_became_active":"2024-09-12T00:31:56.173389+0000","last_became_peered":"2024-09-12T00:31:56.173389+0000","last_unstale":"2024-09-12T01:29:54.607601+0000","last_undegraded":"2024-09-12T01:29:54.607601+0000","last_fullsized":"2024-09-12T01:29:54.607601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:54.607389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:54.607389+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.607389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:08.775718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'144","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.745357+0000","last_change":"2024-09-12T01:29:49.745293+0000","last_active":"2024-09-12T01:29:49.745357+0000","last_peered":"2024-09-12T01:29:49.745357+0000","last_clean":"2024-09-12T01:29:49.745357+0000","last_became_active":"2024-09-12T00:31:58.183017+0000","last_became_peered":"2024-09-12T00:31:58.183017+0000","last_unstale":"2024-09-12T01:29:49.745357+0000","last_undegraded":"2024-09-12T01:29:49.745357+0000","last_fullsized":"2024-09-12T01:29:49.745357+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:29:49.745191+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:29:49.745191+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.745191+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:32.589811+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":129,"num_write":333,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'130","reported_seq":749,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.356057+0000","last_change":"2024-09-12T01:29:30.356057+0000","last_active":"2024-09-12T01:29:30.356057+0000","last_peered":"2024-09-12T01:29:30.356057+0000","last_clean":"2024-09-12T01:29:30.356057+0000","last_became_active":"2024-09-12T00:31:50.136941+0000","last_became_peered":"2024-09-12T00:31:50.136941+0000","last_unstale":"2024-09-12T01:29:30.356057+0000","last_undegraded":"2024-09-12T01:29:30.356057+0000","last_fullsized":"2024-09-12T01:29:30.356057+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T01:29:30.355971+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T01:29:30.355971+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.355971+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:08.036712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":653,"num_read_kb":587,"num_write":190,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2874,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'341","reported_seq":995,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.019642+0000","last_change":"2024-09-12T01:29:31.019642+0000","last_active":"2024-09-12T01:29:31.019642+0000","last_peered":"2024-09-12T01:29:31.019642+0000","last_clean":"2024-09-12T01:29:31.019642+0000","last_became_active":"2024-09-12T00:31:47.131600+0000","last_became_peered":"2024-09-12T00:31:47.131600+0000","last_unstale":"2024-09-12T01:29:31.019642+0000","last_undegraded":"2024-09-12T01:29:31.019642+0000","last_fullsized":"2024-09-12T01:29:31.019642+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-12T01:29:31.019510+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-12T01:29:31.019510+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.019510+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:11.532544+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":495,"num_read_kb":43314,"num_write":1098,"num_write_kb":38822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.385826+0000","last_change":"2024-09-12T01:29:37.385826+0000","last_active":"2024-09-12T01:29:37.385826+0000","last_peered":"2024-09-12T01:29:37.385826+0000","last_clean":"2024-09-12T01:29:37.385826+0000","last_became_active":"2024-09-12T00:31:52.152537+0000","last_became_peered":"2024-09-12T00:31:52.152537+0000","last_unstale":"2024-09-12T01:29:37.385826+0000","last_undegraded":"2024-09-12T01:29:37.385826+0000","last_fullsized":"2024-09-12T01:29:37.385826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:37.385738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:37.385738+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.385738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:37.788544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'286","reported_seq":878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.549981+0000","last_change":"2024-09-12T01:29:49.549887+0000","last_active":"2024-09-12T01:29:49.549981+0000","last_peered":"2024-09-12T01:29:49.549981+0000","last_clean":"2024-09-12T01:29:49.549981+0000","last_became_active":"2024-09-12T00:31:54.163977+0000","last_became_peered":"2024-09-12T00:31:54.163977+0000","last_unstale":"2024-09-12T01:29:49.549981+0000","last_undegraded":"2024-09-12T01:29:49.549981+0000","last_fullsized":"2024-09-12T01:29:49.549981+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'286","last_scrub_stamp":"2024-09-12T01:29:49.549783+0000","last_deep_scrub":"265'286","last_deep_scrub_stamp":"2024-09-12T01:29:49.549783+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.549783+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:07.473520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44628,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":1027,"num_write":368,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:25:14.716184+0000","last_change":"2024-09-12T00:31:56.171991+0000","last_active":"2024-09-12T01:25:14.716184+0000","last_peered":"2024-09-12T01:25:14.716184+0000","last_clean":"2024-09-12T01:25:14.716184+0000","last_became_active":"2024-09-12T00:31:56.171306+0000","last_became_peered":"2024-09-12T00:31:56.171306+0000","last_unstale":"2024-09-12T01:25:14.716184+0000","last_undegraded":"2024-09-12T01:25:14.716184+0000","last_fullsized":"2024-09-12T01:25:14.716184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:32.961885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'126","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.744913+0000","last_change":"2024-09-12T01:29:58.744913+0000","last_active":"2024-09-12T01:29:58.744913+0000","last_peered":"2024-09-12T01:29:58.744913+0000","last_clean":"2024-09-12T01:29:58.744913+0000","last_became_active":"2024-09-12T00:31:58.182701+0000","last_became_peered":"2024-09-12T00:31:58.182701+0000","last_unstale":"2024-09-12T01:29:58.744913+0000","last_undegraded":"2024-09-12T01:29:58.744913+0000","last_fullsized":"2024-09-12T01:29:58.744913+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T01:29:58.744818+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T01:29:58.744818+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.744818+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:22.475637+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":215,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'42","reported_seq":611,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.563464+0000","last_change":"2024-09-12T01:29:28.563386+0000","last_active":"2024-09-12T01:29:28.563464+0000","last_peered":"2024-09-12T01:29:28.563464+0000","last_clean":"2024-09-12T01:29:28.563464+0000","last_became_active":"2024-09-12T00:31:50.136971+0000","last_became_peered":"2024-09-12T00:31:50.136971+0000","last_unstale":"2024-09-12T01:29:28.563464+0000","last_undegraded":"2024-09-12T01:29:28.563464+0000","last_fullsized":"2024-09-12T01:29:28.563464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'42","last_scrub_stamp":"2024-09-12T01:29:28.563295+0000","last_deep_scrub":"265'42","last_deep_scrub_stamp":"2024-09-12T01:29:28.563295+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.563295+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:05.396239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":180,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'353","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.835972+0000","last_change":"2024-09-12T01:29:26.835870+0000","last_active":"2024-09-12T01:29:26.835972+0000","last_peered":"2024-09-12T01:29:26.835972+0000","last_clean":"2024-09-12T01:29:26.835972+0000","last_became_active":"2024-09-12T00:31:47.123001+0000","last_became_peered":"2024-09-12T00:31:47.123001+0000","last_unstale":"2024-09-12T01:29:26.835972+0000","last_undegraded":"2024-09-12T01:29:26.835972+0000","last_fullsized":"2024-09-12T01:29:26.835972+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T01:29:26.835750+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T01:29:26.835750+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.835750+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:58.085367+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3599074,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":39607,"num_write":1095,"num_write_kb":26742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.541936+0000","last_change":"2024-09-12T01:29:39.541811+0000","last_active":"2024-09-12T01:29:39.541936+0000","last_peered":"2024-09-12T01:29:39.541936+0000","last_clean":"2024-09-12T01:29:39.541936+0000","last_became_active":"2024-09-12T00:31:52.150969+0000","last_became_peered":"2024-09-12T00:31:52.150969+0000","last_unstale":"2024-09-12T01:29:39.541936+0000","last_undegraded":"2024-09-12T01:29:39.541936+0000","last_fullsized":"2024-09-12T01:29:39.541936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:39.541714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:39.541714+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.541714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:07.919979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'260","reported_seq":827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.010775+0000","last_change":"2024-09-12T01:29:47.010775+0000","last_active":"2024-09-12T01:29:47.010775+0000","last_peered":"2024-09-12T01:29:47.010775+0000","last_clean":"2024-09-12T01:29:47.010775+0000","last_became_active":"2024-09-12T00:31:54.169845+0000","last_became_peered":"2024-09-12T00:31:54.169845+0000","last_unstale":"2024-09-12T01:29:47.010775+0000","last_undegraded":"2024-09-12T01:29:47.010775+0000","last_fullsized":"2024-09-12T01:29:47.010775+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-12T01:29:47.010669+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-12T01:29:47.010669+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.010669+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:32.763474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47509,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":435,"num_read_kb":1050,"num_write":360,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:26:59.730419+0000","last_change":"2024-09-12T00:31:56.171144+0000","last_active":"2024-09-12T01:26:59.730419+0000","last_peered":"2024-09-12T01:26:59.730419+0000","last_clean":"2024-09-12T01:26:59.730419+0000","last_became_active":"2024-09-12T00:31:56.170767+0000","last_became_peered":"2024-09-12T00:31:56.170767+0000","last_unstale":"2024-09-12T01:26:59.730419+0000","last_undegraded":"2024-09-12T01:26:59.730419+0000","last_fullsized":"2024-09-12T01:26:59.730419+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:55.151325+0000","last_clean_scrub_stamp":"2024-09-12T00:31:55.151325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'182","reported_seq":1652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:45.531905+0000","last_change":"2024-09-12T00:31:58.173318+0000","last_active":"2024-09-12T01:27:45.531905+0000","last_peered":"2024-09-12T01:27:45.531905+0000","last_clean":"2024-09-12T01:27:45.531905+0000","last_became_active":"2024-09-12T00:31:58.173049+0000","last_became_peered":"2024-09-12T00:31:58.173049+0000","last_unstale":"2024-09-12T01:27:45.531905+0000","last_undegraded":"2024-09-12T01:27:45.531905+0000","last_fullsized":"2024-09-12T01:27:45.531905+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:31:57.155169+0000","last_clean_scrub_stamp":"2024-09-12T00:31:57.155169+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1227,"num_read_kb":1215,"num_write":440,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'221","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.367746+0000","last_change":"2024-09-12T01:29:29.367671+0000","last_active":"2024-09-12T01:29:29.367746+0000","last_peered":"2024-09-12T01:29:29.367746+0000","last_clean":"2024-09-12T01:29:29.367746+0000","last_became_active":"2024-09-12T00:31:50.141009+0000","last_became_peered":"2024-09-12T00:31:50.141009+0000","last_unstale":"2024-09-12T01:29:29.367746+0000","last_undegraded":"2024-09-12T01:29:29.367746+0000","last_fullsized":"2024-09-12T01:29:29.367746+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'221","last_scrub_stamp":"2024-09-12T01:29:29.367587+0000","last_deep_scrub":"265'221","last_deep_scrub_stamp":"2024-09-12T01:29:29.367587+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.367587+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:50.790988+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":914,"num_read_kb":727,"num_write":339,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'391","reported_seq":1074,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.837675+0000","last_change":"2024-09-12T01:29:27.837675+0000","last_active":"2024-09-12T01:29:27.837675+0000","last_peered":"2024-09-12T01:29:27.837675+0000","last_clean":"2024-09-12T01:29:27.837675+0000","last_became_active":"2024-09-12T00:31:47.118434+0000","last_became_peered":"2024-09-12T00:31:47.118434+0000","last_unstale":"2024-09-12T01:29:27.837675+0000","last_undegraded":"2024-09-12T01:29:27.837675+0000","last_fullsized":"2024-09-12T01:29:27.837675+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T01:29:27.837556+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T01:29:27.837556+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.837556+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:32.423783+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":619,"num_read_kb":10821,"num_write":1247,"num_write_kb":40782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":512,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.534898+0000","last_change":"2024-09-12T01:29:46.534898+0000","last_active":"2024-09-12T01:29:46.534898+0000","last_peered":"2024-09-12T01:29:46.534898+0000","last_clean":"2024-09-12T01:29:46.534898+0000","last_became_active":"2024-09-12T00:31:52.148440+0000","last_became_peered":"2024-09-12T00:31:52.148440+0000","last_unstale":"2024-09-12T01:29:46.534898+0000","last_undegraded":"2024-09-12T01:29:46.534898+0000","last_fullsized":"2024-09-12T01:29:46.534898+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:46.534791+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:46.534791+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.534791+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:10.156227+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'316","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.327220+0000","last_change":"2024-09-12T01:29:54.327220+0000","last_active":"2024-09-12T01:29:54.327220+0000","last_peered":"2024-09-12T01:29:54.327220+0000","last_clean":"2024-09-12T01:29:54.327220+0000","last_became_active":"2024-09-12T00:31:54.167915+0000","last_became_peered":"2024-09-12T00:31:54.167915+0000","last_unstale":"2024-09-12T01:29:54.327220+0000","last_undegraded":"2024-09-12T01:29:54.327220+0000","last_fullsized":"2024-09-12T01:29:54.327220+0000","mapping_epoch":31,"log_start":"265'301","ondisk_log_start":"265'301","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T01:29:54.327116+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T01:29:54.327116+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.327116+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":301,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:05.693386+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44378,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":513,"num_read_kb":1106,"num_write":406,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.618555+0000","last_change":"2024-09-12T01:29:55.618555+0000","last_active":"2024-09-12T01:29:55.618555+0000","last_peered":"2024-09-12T01:29:55.618555+0000","last_clean":"2024-09-12T01:29:55.618555+0000","last_became_active":"2024-09-12T00:31:56.171654+0000","last_became_peered":"2024-09-12T00:31:56.171654+0000","last_unstale":"2024-09-12T01:29:55.618555+0000","last_undegraded":"2024-09-12T01:29:55.618555+0000","last_fullsized":"2024-09-12T01:29:55.618555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:55.618473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:55.618473+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.618473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:26.288689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'132","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.138574+0000","last_change":"2024-09-12T01:29:45.138574+0000","last_active":"2024-09-12T01:29:45.138574+0000","last_peered":"2024-09-12T01:29:45.138574+0000","last_clean":"2024-09-12T01:29:45.138574+0000","last_became_active":"2024-09-12T00:31:58.181864+0000","last_became_peered":"2024-09-12T00:31:58.181864+0000","last_unstale":"2024-09-12T01:29:45.138574+0000","last_undegraded":"2024-09-12T01:29:45.138574+0000","last_fullsized":"2024-09-12T01:29:45.138574+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'132","last_scrub_stamp":"2024-09-12T01:29:45.138476+0000","last_deep_scrub":"265'132","last_deep_scrub_stamp":"2024-09-12T01:29:45.138476+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.138476+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.900435+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":169,"num_write":329,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'138","reported_seq":718,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.569403+0000","last_change":"2024-09-12T01:29:34.569403+0000","last_active":"2024-09-12T01:29:34.569403+0000","last_peered":"2024-09-12T01:29:34.569403+0000","last_clean":"2024-09-12T01:29:34.569403+0000","last_became_active":"2024-09-12T00:31:50.123862+0000","last_became_peered":"2024-09-12T00:31:50.123862+0000","last_unstale":"2024-09-12T01:29:34.569403+0000","last_undegraded":"2024-09-12T01:29:34.569403+0000","last_fullsized":"2024-09-12T01:29:34.569403+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'138","last_scrub_stamp":"2024-09-12T01:29:34.569319+0000","last_deep_scrub":"265'138","last_deep_scrub_stamp":"2024-09-12T01:29:34.569319+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.569319+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:39.432572+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":471,"num_write":227,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'354","reported_seq":984,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.369781+0000","last_change":"2024-09-12T01:29:23.369781+0000","last_active":"2024-09-12T01:29:23.369781+0000","last_peered":"2024-09-12T01:29:23.369781+0000","last_clean":"2024-09-12T01:29:23.369781+0000","last_became_active":"2024-09-12T00:31:47.132236+0000","last_became_peered":"2024-09-12T00:31:47.132236+0000","last_unstale":"2024-09-12T01:29:23.369781+0000","last_undegraded":"2024-09-12T01:29:23.369781+0000","last_fullsized":"2024-09-12T01:29:23.369781+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T01:29:23.369652+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T01:29:23.369652+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.369652+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:57.694085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":457,"num_read_kb":4332,"num_write":1030,"num_write_kb":17381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'142","reported_seq":738,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.563292+0000","last_change":"2024-09-12T01:29:31.563292+0000","last_active":"2024-09-12T01:29:31.563292+0000","last_peered":"2024-09-12T01:29:31.563292+0000","last_clean":"2024-09-12T01:29:31.563292+0000","last_became_active":"2024-09-12T00:31:50.140649+0000","last_became_peered":"2024-09-12T00:31:50.140649+0000","last_unstale":"2024-09-12T01:29:31.563292+0000","last_undegraded":"2024-09-12T01:29:31.563292+0000","last_fullsized":"2024-09-12T01:29:31.563292+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T01:29:31.563200+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T01:29:31.563200+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.563200+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:34.599331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":475,"num_write":199,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'326","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.578704+0000","last_change":"2024-09-12T01:29:25.578704+0000","last_active":"2024-09-12T01:29:25.578704+0000","last_peered":"2024-09-12T01:29:25.578704+0000","last_clean":"2024-09-12T01:29:25.578704+0000","last_became_active":"2024-09-12T00:31:47.126093+0000","last_became_peered":"2024-09-12T00:31:47.126093+0000","last_unstale":"2024-09-12T01:29:25.578704+0000","last_undegraded":"2024-09-12T01:29:25.578704+0000","last_fullsized":"2024-09-12T01:29:25.578704+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'326","last_scrub_stamp":"2024-09-12T01:29:25.578576+0000","last_deep_scrub":"265'326","last_deep_scrub_stamp":"2024-09-12T01:29:25.578576+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.578576+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:43.122572+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":454,"num_read_kb":13702,"num_write":989,"num_write_kb":29796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'259","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.178955+0000","last_change":"2024-09-12T01:29:41.178955+0000","last_active":"2024-09-12T01:29:41.178955+0000","last_peered":"2024-09-12T01:29:41.178955+0000","last_clean":"2024-09-12T01:29:41.178955+0000","last_became_active":"2024-09-12T00:31:50.132976+0000","last_became_peered":"2024-09-12T00:31:50.132976+0000","last_unstale":"2024-09-12T01:29:41.178955+0000","last_undegraded":"2024-09-12T01:29:41.178955+0000","last_fullsized":"2024-09-12T01:29:41.178955+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'259","last_scrub_stamp":"2024-09-12T01:29:41.178857+0000","last_deep_scrub":"265'259","last_deep_scrub_stamp":"2024-09-12T01:29:41.178857+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.178857+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:57.345693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1108,"num_read_kb":908,"num_write":394,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'354","reported_seq":1055,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.086724+0000","last_change":"2024-09-12T01:29:33.086724+0000","last_active":"2024-09-12T01:29:33.086724+0000","last_peered":"2024-09-12T01:29:33.086724+0000","last_clean":"2024-09-12T01:29:33.086724+0000","last_became_active":"2024-09-12T00:31:47.117000+0000","last_became_peered":"2024-09-12T00:31:47.117000+0000","last_unstale":"2024-09-12T01:29:33.086724+0000","last_undegraded":"2024-09-12T01:29:33.086724+0000","last_fullsized":"2024-09-12T01:29:33.086724+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T01:29:33.086619+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T01:29:33.086619+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.086619+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:18.339050+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138894,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":591,"num_read_kb":34967,"num_write":1161,"num_write_kb":18512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'188","reported_seq":841,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.863803+0000","last_change":"2024-09-12T01:29:36.863803+0000","last_active":"2024-09-12T01:29:36.863803+0000","last_peered":"2024-09-12T01:29:36.863803+0000","last_clean":"2024-09-12T01:29:36.863803+0000","last_became_active":"2024-09-12T00:31:50.133634+0000","last_became_peered":"2024-09-12T00:31:50.133634+0000","last_unstale":"2024-09-12T01:29:36.863803+0000","last_undegraded":"2024-09-12T01:29:36.863803+0000","last_fullsized":"2024-09-12T01:29:36.863803+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-12T01:29:36.863688+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-12T01:29:36.863688+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.863688+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:49.117347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":708,"num_write":275,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'366","reported_seq":996,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.883191+0000","last_change":"2024-09-12T01:29:28.883191+0000","last_active":"2024-09-12T01:29:28.883191+0000","last_peered":"2024-09-12T01:29:28.883191+0000","last_clean":"2024-09-12T01:29:28.883191+0000","last_became_active":"2024-09-12T00:31:47.132735+0000","last_became_peered":"2024-09-12T00:31:47.132735+0000","last_unstale":"2024-09-12T01:29:28.883191+0000","last_undegraded":"2024-09-12T01:29:28.883191+0000","last_fullsized":"2024-09-12T01:29:28.883191+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T01:29:28.883090+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T01:29:28.883090+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.883090+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:41.785346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":462,"num_read_kb":13728,"num_write":961,"num_write_kb":25593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'130","reported_seq":739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.822573+0000","last_change":"2024-09-12T01:29:37.822573+0000","last_active":"2024-09-12T01:29:37.822573+0000","last_peered":"2024-09-12T01:29:37.822573+0000","last_clean":"2024-09-12T01:29:37.822573+0000","last_became_active":"2024-09-12T00:31:50.138349+0000","last_became_peered":"2024-09-12T00:31:50.138349+0000","last_unstale":"2024-09-12T01:29:37.822573+0000","last_undegraded":"2024-09-12T01:29:37.822573+0000","last_fullsized":"2024-09-12T01:29:37.822573+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T01:29:37.822476+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T01:29:37.822476+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.822476+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:17.917278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":530,"num_write":219,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'322","reported_seq":968,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.221519+0000","last_change":"2024-09-12T01:29:26.221519+0000","last_active":"2024-09-12T01:29:26.221519+0000","last_peered":"2024-09-12T01:29:26.221519+0000","last_clean":"2024-09-12T01:29:26.221519+0000","last_became_active":"2024-09-12T00:31:47.132959+0000","last_became_peered":"2024-09-12T00:31:47.132959+0000","last_unstale":"2024-09-12T01:29:26.221519+0000","last_undegraded":"2024-09-12T01:29:26.221519+0000","last_fullsized":"2024-09-12T01:29:26.221519+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T01:29:26.221423+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T01:29:26.221423+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.221423+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:43.791461+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170196,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":44221,"num_write":1049,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'150","reported_seq":734,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.124626+0000","last_change":"2024-09-12T01:29:31.124626+0000","last_active":"2024-09-12T01:29:31.124626+0000","last_peered":"2024-09-12T01:29:31.124626+0000","last_clean":"2024-09-12T01:29:31.124626+0000","last_became_active":"2024-09-12T00:31:50.130915+0000","last_became_peered":"2024-09-12T00:31:50.130915+0000","last_unstale":"2024-09-12T01:29:31.124626+0000","last_undegraded":"2024-09-12T01:29:31.124626+0000","last_fullsized":"2024-09-12T01:29:31.124626+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'150","last_scrub_stamp":"2024-09-12T01:29:31.124543+0000","last_deep_scrub":"265'150","last_deep_scrub_stamp":"2024-09-12T01:29:31.124543+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.124543+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:03.395062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":628,"num_read_kb":507,"num_write":231,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'336","reported_seq":977,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.142282+0000","last_change":"2024-09-12T01:29:29.142282+0000","last_active":"2024-09-12T01:29:29.142282+0000","last_peered":"2024-09-12T01:29:29.142282+0000","last_clean":"2024-09-12T01:29:29.142282+0000","last_became_active":"2024-09-12T00:31:47.122164+0000","last_became_peered":"2024-09-12T00:31:47.122164+0000","last_unstale":"2024-09-12T01:29:29.142282+0000","last_undegraded":"2024-09-12T01:29:29.142282+0000","last_fullsized":"2024-09-12T01:29:29.142282+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T01:29:29.142149+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T01:29:29.142149+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.142149+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:51.142516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170481,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":503,"num_read_kb":2267,"num_write":1137,"num_write_kb":17589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'295","reported_seq":946,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.116198+0000","last_change":"2024-09-12T01:29:38.116198+0000","last_active":"2024-09-12T01:29:38.116198+0000","last_peered":"2024-09-12T01:29:38.116198+0000","last_clean":"2024-09-12T01:29:38.116198+0000","last_became_active":"2024-09-12T00:31:50.142283+0000","last_became_peered":"2024-09-12T00:31:50.142283+0000","last_unstale":"2024-09-12T01:29:38.116198+0000","last_undegraded":"2024-09-12T01:29:38.116198+0000","last_fullsized":"2024-09-12T01:29:38.116198+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'295","last_scrub_stamp":"2024-09-12T01:29:38.116092+0000","last_deep_scrub":"265'295","last_deep_scrub_stamp":"2024-09-12T01:29:38.116092+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.116092+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:29.568062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1272,"num_read_kb":1039,"num_write":466,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'373","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.379186+0000","last_change":"2024-09-12T01:29:26.379186+0000","last_active":"2024-09-12T01:29:26.379186+0000","last_peered":"2024-09-12T01:29:26.379186+0000","last_clean":"2024-09-12T01:29:26.379186+0000","last_became_active":"2024-09-12T00:31:47.136789+0000","last_became_peered":"2024-09-12T00:31:47.136789+0000","last_unstale":"2024-09-12T01:29:26.379186+0000","last_undegraded":"2024-09-12T01:29:26.379186+0000","last_fullsized":"2024-09-12T01:29:26.379186+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T01:29:26.379032+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T01:29:26.379032+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.379032+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:10.288276+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":544,"num_read_kb":49646,"num_write":1113,"num_write_kb":37962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'130","reported_seq":756,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.439811+0000","last_change":"2024-09-12T01:29:27.439811+0000","last_active":"2024-09-12T01:29:27.439811+0000","last_peered":"2024-09-12T01:29:27.439811+0000","last_clean":"2024-09-12T01:29:27.439811+0000","last_became_active":"2024-09-12T00:31:50.140717+0000","last_became_peered":"2024-09-12T00:31:50.140717+0000","last_unstale":"2024-09-12T01:29:27.439811+0000","last_undegraded":"2024-09-12T01:29:27.439811+0000","last_fullsized":"2024-09-12T01:29:27.439811+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T01:29:27.439723+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T01:29:27.439723+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.439723+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:07.649578+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":623,"num_read_kb":519,"num_write":184,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4002,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'384","reported_seq":1049,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.949714+0000","last_change":"2024-09-12T01:29:33.949714+0000","last_active":"2024-09-12T01:29:33.949714+0000","last_peered":"2024-09-12T01:29:33.949714+0000","last_clean":"2024-09-12T01:29:33.949714+0000","last_became_active":"2024-09-12T00:31:47.118928+0000","last_became_peered":"2024-09-12T00:31:47.118928+0000","last_unstale":"2024-09-12T01:29:33.949714+0000","last_undegraded":"2024-09-12T01:29:33.949714+0000","last_fullsized":"2024-09-12T01:29:33.949714+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-12T01:29:33.949597+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-12T01:29:33.949597+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.949597+0000","objects_scrubbed":9,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:44.543182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65022,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":549,"num_read_kb":12208,"num_write":1218,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'133","reported_seq":739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.621360+0000","last_change":"2024-09-12T01:29:33.621360+0000","last_active":"2024-09-12T01:29:33.621360+0000","last_peered":"2024-09-12T01:29:33.621360+0000","last_clean":"2024-09-12T01:29:33.621360+0000","last_became_active":"2024-09-12T00:31:50.137034+0000","last_became_peered":"2024-09-12T00:31:50.137034+0000","last_unstale":"2024-09-12T01:29:33.621360+0000","last_undegraded":"2024-09-12T01:29:33.621360+0000","last_fullsized":"2024-09-12T01:29:33.621360+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-12T01:29:33.621268+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-12T01:29:33.621268+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.621268+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:32.051275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":471,"num_write":187,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'394","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.042100+0000","last_change":"2024-09-12T01:29:34.042100+0000","last_active":"2024-09-12T01:29:34.042100+0000","last_peered":"2024-09-12T01:29:34.042100+0000","last_clean":"2024-09-12T01:29:34.042100+0000","last_became_active":"2024-09-12T00:31:47.119180+0000","last_became_peered":"2024-09-12T00:31:47.119180+0000","last_unstale":"2024-09-12T01:29:34.042100+0000","last_undegraded":"2024-09-12T01:29:34.042100+0000","last_fullsized":"2024-09-12T01:29:34.042100+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T01:29:34.041934+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T01:29:34.041934+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.041934+0000","objects_scrubbed":9,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:04.729277+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2793702,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":603,"num_read_kb":71015,"num_write":1325,"num_write_kb":54526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'230","reported_seq":885,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.091211+0000","last_change":"2024-09-12T01:29:30.091211+0000","last_active":"2024-09-12T01:29:30.091211+0000","last_peered":"2024-09-12T01:29:30.091211+0000","last_clean":"2024-09-12T01:29:30.091211+0000","last_became_active":"2024-09-12T00:31:50.132605+0000","last_became_peered":"2024-09-12T00:31:50.132605+0000","last_unstale":"2024-09-12T01:29:30.091211+0000","last_undegraded":"2024-09-12T01:29:30.091211+0000","last_fullsized":"2024-09-12T01:29:30.091211+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'230","last_scrub_stamp":"2024-09-12T01:29:30.091128+0000","last_deep_scrub":"265'230","last_deep_scrub_stamp":"2024-09-12T01:29:30.091128+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.091128+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:44.530559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":781,"num_write":348,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'337","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.914501+0000","last_change":"2024-09-12T01:29:29.914501+0000","last_active":"2024-09-12T01:29:29.914501+0000","last_peered":"2024-09-12T01:29:29.914501+0000","last_clean":"2024-09-12T01:29:29.914501+0000","last_became_active":"2024-09-12T00:31:47.131895+0000","last_became_peered":"2024-09-12T00:31:47.131895+0000","last_unstale":"2024-09-12T01:29:29.914501+0000","last_undegraded":"2024-09-12T01:29:29.914501+0000","last_fullsized":"2024-09-12T01:29:29.914501+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-12T01:29:29.914360+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-12T01:29:29.914360+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.914360+0000","objects_scrubbed":9,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:13.576149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":1443,"num_write":1105,"num_write_kb":20830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'184","reported_seq":822,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.728660+0000","last_change":"2024-09-12T01:29:41.728660+0000","last_active":"2024-09-12T01:29:41.728660+0000","last_peered":"2024-09-12T01:29:41.728660+0000","last_clean":"2024-09-12T01:29:41.728660+0000","last_became_active":"2024-09-12T00:31:50.138649+0000","last_became_peered":"2024-09-12T00:31:50.138649+0000","last_unstale":"2024-09-12T01:29:41.728660+0000","last_undegraded":"2024-09-12T01:29:41.728660+0000","last_fullsized":"2024-09-12T01:29:41.728660+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'184","last_scrub_stamp":"2024-09-12T01:29:41.728559+0000","last_deep_scrub":"265'184","last_deep_scrub_stamp":"2024-09-12T01:29:41.728559+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.728559+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:39.497379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":823,"num_read_kb":682,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'312","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.381837+0000","last_change":"2024-09-12T01:29:25.381837+0000","last_active":"2024-09-12T01:29:25.381837+0000","last_peered":"2024-09-12T01:29:25.381837+0000","last_clean":"2024-09-12T01:29:25.381837+0000","last_became_active":"2024-09-12T00:31:47.128598+0000","last_became_peered":"2024-09-12T00:31:47.128598+0000","last_unstale":"2024-09-12T01:29:25.381837+0000","last_undegraded":"2024-09-12T01:29:25.381837+0000","last_fullsized":"2024-09-12T01:29:25.381837+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T01:29:25.381685+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T01:29:25.381685+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.381685+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:02.770818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37912,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":412,"num_read_kb":69389,"num_write":1027,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'98","reported_seq":674,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.493434+0000","last_change":"2024-09-12T01:29:29.493434+0000","last_active":"2024-09-12T01:29:29.493434+0000","last_peered":"2024-09-12T01:29:29.493434+0000","last_clean":"2024-09-12T01:29:29.493434+0000","last_became_active":"2024-09-12T00:31:50.139830+0000","last_became_peered":"2024-09-12T00:31:50.139830+0000","last_unstale":"2024-09-12T01:29:29.493434+0000","last_undegraded":"2024-09-12T01:29:29.493434+0000","last_fullsized":"2024-09-12T01:29:29.493434+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'98","last_scrub_stamp":"2024-09-12T01:29:29.493346+0000","last_deep_scrub":"265'98","last_deep_scrub_stamp":"2024-09-12T01:29:29.493346+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.493346+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:43.481588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":425,"num_read_kb":351,"num_write":136,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'293","reported_seq":930,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.596190+0000","last_change":"2024-09-12T01:29:37.596190+0000","last_active":"2024-09-12T01:29:37.596190+0000","last_peered":"2024-09-12T01:29:37.596190+0000","last_clean":"2024-09-12T01:29:37.596190+0000","last_became_active":"2024-09-12T00:31:47.122486+0000","last_became_peered":"2024-09-12T00:31:47.122486+0000","last_unstale":"2024-09-12T01:29:37.596190+0000","last_undegraded":"2024-09-12T01:29:37.596190+0000","last_fullsized":"2024-09-12T01:29:37.596190+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'293","last_scrub_stamp":"2024-09-12T01:29:37.596061+0000","last_deep_scrub":"265'293","last_deep_scrub_stamp":"2024-09-12T01:29:37.596061+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.596061+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:50.615903+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6842428,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":24154,"num_write":874,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'114","reported_seq":682,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.388319+0000","last_change":"2024-09-12T01:29:32.388319+0000","last_active":"2024-09-12T01:29:32.388319+0000","last_peered":"2024-09-12T01:29:32.388319+0000","last_clean":"2024-09-12T01:29:32.388319+0000","last_became_active":"2024-09-12T00:31:50.139416+0000","last_became_peered":"2024-09-12T00:31:50.139416+0000","last_unstale":"2024-09-12T01:29:32.388319+0000","last_undegraded":"2024-09-12T01:29:32.388319+0000","last_fullsized":"2024-09-12T01:29:32.388319+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'114","last_scrub_stamp":"2024-09-12T01:29:32.388231+0000","last_deep_scrub":"265'114","last_deep_scrub_stamp":"2024-09-12T01:29:32.388231+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.388231+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:16.247658+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":414,"num_write":177,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'362","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.974781+0000","last_change":"2024-09-12T01:29:23.974781+0000","last_active":"2024-09-12T01:29:23.974781+0000","last_peered":"2024-09-12T01:29:23.974781+0000","last_clean":"2024-09-12T01:29:23.974781+0000","last_became_active":"2024-09-12T00:31:47.130353+0000","last_became_peered":"2024-09-12T00:31:47.130353+0000","last_unstale":"2024-09-12T01:29:23.974781+0000","last_undegraded":"2024-09-12T01:29:23.974781+0000","last_fullsized":"2024-09-12T01:29:23.974781+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T01:29:23.974688+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T01:29:23.974688+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.974688+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:26.306312+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288069,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":8753,"num_write":1192,"num_write_kb":21611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'161","reported_seq":772,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.572299+0000","last_change":"2024-09-12T01:29:32.572299+0000","last_active":"2024-09-12T01:29:32.572299+0000","last_peered":"2024-09-12T01:29:32.572299+0000","last_clean":"2024-09-12T01:29:32.572299+0000","last_became_active":"2024-09-12T00:31:50.140705+0000","last_became_peered":"2024-09-12T00:31:50.140705+0000","last_unstale":"2024-09-12T01:29:32.572299+0000","last_undegraded":"2024-09-12T01:29:32.572299+0000","last_fullsized":"2024-09-12T01:29:32.572299+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'161","last_scrub_stamp":"2024-09-12T01:29:32.572201+0000","last_deep_scrub":"265'161","last_deep_scrub_stamp":"2024-09-12T01:29:32.572201+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.572201+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:57.054566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":620,"num_write":277,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'387","reported_seq":1113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.059874+0000","last_change":"2024-09-12T01:29:32.059874+0000","last_active":"2024-09-12T01:29:32.059874+0000","last_peered":"2024-09-12T01:29:32.059874+0000","last_clean":"2024-09-12T01:29:32.059874+0000","last_became_active":"2024-09-12T00:31:47.120303+0000","last_became_peered":"2024-09-12T00:31:47.120303+0000","last_unstale":"2024-09-12T01:29:32.059874+0000","last_undegraded":"2024-09-12T01:29:32.059874+0000","last_fullsized":"2024-09-12T01:29:32.059874+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T01:29:32.059734+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T01:29:32.059734+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.059734+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:18.350675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493090,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":704,"num_read_kb":61137,"num_write":1132,"num_write_kb":48224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'210","reported_seq":864,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.613124+0000","last_change":"2024-09-12T01:29:33.613124+0000","last_active":"2024-09-12T01:29:33.613124+0000","last_peered":"2024-09-12T01:29:33.613124+0000","last_clean":"2024-09-12T01:29:33.613124+0000","last_became_active":"2024-09-12T00:31:50.133698+0000","last_became_peered":"2024-09-12T00:31:50.133698+0000","last_unstale":"2024-09-12T01:29:33.613124+0000","last_undegraded":"2024-09-12T01:29:33.613124+0000","last_fullsized":"2024-09-12T01:29:33.613124+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'210","last_scrub_stamp":"2024-09-12T01:29:33.613015+0000","last_deep_scrub":"265'210","last_deep_scrub_stamp":"2024-09-12T01:29:33.613015+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.613015+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:38.489746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":883,"num_write":372,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'279","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.574293+0000","last_change":"2024-09-12T01:29:26.574293+0000","last_active":"2024-09-12T01:29:26.574293+0000","last_peered":"2024-09-12T01:29:26.574293+0000","last_clean":"2024-09-12T01:29:26.574293+0000","last_became_active":"2024-09-12T00:31:47.117753+0000","last_became_peered":"2024-09-12T00:31:47.117753+0000","last_unstale":"2024-09-12T01:29:26.574293+0000","last_undegraded":"2024-09-12T01:29:26.574293+0000","last_fullsized":"2024-09-12T01:29:26.574293+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'279","last_scrub_stamp":"2024-09-12T01:29:26.574140+0000","last_deep_scrub":"265'279","last_deep_scrub_stamp":"2024-09-12T01:29:26.574140+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.574140+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:19.980823+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":578,"num_read_kb":553,"num_write":1003,"num_write_kb":11415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'4099","reported_seq":4707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.486832+0000","last_change":"2024-09-12T01:29:28.486832+0000","last_active":"2024-09-12T01:29:28.486832+0000","last_peered":"2024-09-12T01:29:28.486832+0000","last_clean":"2024-09-12T01:29:28.486832+0000","last_became_active":"2024-09-12T00:31:50.144782+0000","last_became_peered":"2024-09-12T00:31:50.144782+0000","last_unstale":"2024-09-12T01:29:28.486832+0000","last_undegraded":"2024-09-12T01:29:28.486832+0000","last_fullsized":"2024-09-12T01:29:28.486832+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4099","last_scrub_stamp":"2024-09-12T01:29:28.486734+0000","last_deep_scrub":"265'4099","last_deep_scrub_stamp":"2024-09-12T01:29:28.486734+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.486734+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:27.424046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16473,"num_read_kb":13736,"num_write":6146,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'355","reported_seq":1119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.168523+0000","last_change":"2024-09-12T01:29:28.168523+0000","last_active":"2024-09-12T01:29:28.168523+0000","last_peered":"2024-09-12T01:29:28.168523+0000","last_clean":"2024-09-12T01:29:28.168523+0000","last_became_active":"2024-09-12T00:32:23.828547+0000","last_became_peered":"2024-09-12T00:32:23.828547+0000","last_unstale":"2024-09-12T01:29:28.168523+0000","last_undegraded":"2024-09-12T01:29:28.168523+0000","last_fullsized":"2024-09-12T01:29:28.168523+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T01:29:28.168363+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T01:29:28.168363+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.168363+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:07.014208+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2792674,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":658,"num_read_kb":184067,"num_write":1127,"num_write_kb":52781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"265'313","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.068584+0000","last_change":"2024-09-12T01:29:35.068584+0000","last_active":"2024-09-12T01:29:35.068584+0000","last_peered":"2024-09-12T01:29:35.068584+0000","last_clean":"2024-09-12T01:29:35.068584+0000","last_became_active":"2024-09-12T00:31:47.123083+0000","last_became_peered":"2024-09-12T00:31:47.123083+0000","last_unstale":"2024-09-12T01:29:35.068584+0000","last_undegraded":"2024-09-12T01:29:35.068584+0000","last_fullsized":"2024-09-12T01:29:35.068584+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'313","last_scrub_stamp":"2024-09-12T01:29:35.068428+0000","last_deep_scrub":"265'313","last_deep_scrub_stamp":"2024-09-12T01:29:35.068428+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.068428+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:18.821874+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1292330,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":432,"num_read_kb":16599,"num_write":993,"num_write_kb":37945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'178","reported_seq":761,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.582884+0000","last_change":"2024-09-12T01:29:40.582884+0000","last_active":"2024-09-12T01:29:40.582884+0000","last_peered":"2024-09-12T01:29:40.582884+0000","last_clean":"2024-09-12T01:29:40.582884+0000","last_became_active":"2024-09-12T00:31:50.144850+0000","last_became_peered":"2024-09-12T00:31:50.144850+0000","last_unstale":"2024-09-12T01:29:40.582884+0000","last_undegraded":"2024-09-12T01:29:40.582884+0000","last_fullsized":"2024-09-12T01:29:40.582884+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'178","last_scrub_stamp":"2024-09-12T01:29:40.582801+0000","last_deep_scrub":"265'178","last_deep_scrub_stamp":"2024-09-12T01:29:40.582801+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.582801+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:21.474391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":724,"num_read_kb":585,"num_write":260,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'386","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.920017+0000","last_change":"2024-09-12T01:29:31.920017+0000","last_active":"2024-09-12T01:29:31.920017+0000","last_peered":"2024-09-12T01:29:31.920017+0000","last_clean":"2024-09-12T01:29:31.920017+0000","last_became_active":"2024-09-12T00:31:47.132149+0000","last_became_peered":"2024-09-12T00:31:47.132149+0000","last_unstale":"2024-09-12T01:29:31.920017+0000","last_undegraded":"2024-09-12T01:29:31.920017+0000","last_fullsized":"2024-09-12T01:29:31.920017+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T01:29:31.919888+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T01:29:31.919888+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.919888+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:51.126649+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":304,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":582,"num_read_kb":13776,"num_write":1287,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'127","reported_seq":759,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.480691+0000","last_change":"2024-09-12T01:29:34.480631+0000","last_active":"2024-09-12T01:29:34.480691+0000","last_peered":"2024-09-12T01:29:34.480691+0000","last_clean":"2024-09-12T01:29:34.480691+0000","last_became_active":"2024-09-12T00:31:50.137283+0000","last_became_peered":"2024-09-12T00:31:50.137283+0000","last_unstale":"2024-09-12T01:29:34.480691+0000","last_undegraded":"2024-09-12T01:29:34.480691+0000","last_fullsized":"2024-09-12T01:29:34.480691+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-12T01:29:34.480529+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-12T01:29:34.480529+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.480529+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:46.725574+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":583,"num_read_kb":491,"num_write":192,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5593,"num_read_kb":3949,"num_write":1897,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6768,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1070,"ondisk_log_size":1070,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15046,"num_read_kb":14700,"num_write":16713,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1532,"ondisk_log_size":1532,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":587,"ondisk_log_size":587,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1527208,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":18236,"num_read_kb":37365,"num_write":15267,"num_write_kb":11724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":673192,"num_omap_keys":1560,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1721,"ondisk_log_size":1721,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102878,"num_read_kb":85467,"num_write":37260,"num_write_kb":18832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43781,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3676,"ondisk_log_size":3676,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":78246710,"num_objects":378,"num_object_clones":0,"num_object_copies":1134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":378,"num_whiteouts":0,"num_read":36067,"num_read_kb":1971130,"num_write":71284,"num_write_kb":2047906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":119279616,"data_stored":119279616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3444,"ondisk_log_size":3444,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":176023,"num_write":154,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":175285,"num_write":154,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477444,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":221612,"kb_used_data":15580,"kb_used_omap":1,"kb_used_meta":206014,"kb_avail":94150228,"statfs":{"total":96636764160,"available":96409833472,"internally_reserved":0,"allocated":15953920,"data_stored":13969939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":210958794},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719477443,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111876,"kb_used_data":18292,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94259964,"statfs":{"total":96636764160,"available":96522203136,"internally_reserved":0,"allocated":18731008,"data_stored":16734053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95812038},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510149,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259868,"kb_used_data":21836,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94111972,"statfs":{"total":96636764160,"available":96370659328,"internally_reserved":0,"allocated":22360064,"data_stored":20343157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":243726791},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510148,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152736,"kb_used_data":27152,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94219104,"statfs":{"total":96636764160,"available":96480362496,"internally_reserved":0,"allocated":27803648,"data_stored":25815269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510148,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":10116,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":10358784,"data_stored":8346083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510146,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124160,"kb_used_data":16624,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94247680,"statfs":{"total":96636764160,"available":96509624320,"internally_reserved":0,"allocated":17022976,"data_stored":15000873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542850,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":206080,"kb_used_data":22256,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94165760,"statfs":{"total":96636764160,"available":96425738240,"internally_reserved":0,"allocated":22790144,"data_stored":20790314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575555,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":270692,"kb_used_data":18836,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94101148,"statfs":{"total":96636764160,"available":96359575552,"internally_reserved":0,"allocated":19288064,"data_stored":17276630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12771328,"data_stored":12771328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5529600,"data_stored":5529600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23588864,"data_stored":23588864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18116608,"data_stored":18116608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18563072,"data_stored":18563072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14458880,"data_stored":14458880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14508032,"data_stored":14508032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11743232,"data_stored":11743232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:30:04.287 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.288 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.288 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.289 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.289 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.289 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.290 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.290 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.290 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.290 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.291 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.291 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.291 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.291 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.292 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.292 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.292 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.293 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.293 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.293 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.293 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.294 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.294 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.294 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.294 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.295 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.295 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.295 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.295 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.296 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.296 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.296 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.297 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.297 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.297 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.298 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.298 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.298 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.299 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.299 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.299 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.299 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.300 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.300 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.300 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.301 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.301 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.301 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.301 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.302 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.302 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.302 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.302 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.302 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.303 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.303 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.303 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.303 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.304 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.304 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.304 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.304 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.305 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.305 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.305 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.305 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.305 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.306 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.306 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:46:02.893610+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=46, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.306 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.306 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.308 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.311 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.311 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.312 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.312 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.313 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:31:55.151325+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=55, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.313 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:31:57.155169+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=31, tm_sec=57, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:04.314 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:30:24.315 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:30:24.670 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:30:24.682 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T01:30:24.685 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":2026,"stamp":"2024-09-12T01:30:23.878806+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80381543,"num_objects":728,"num_object_clones":0,"num_object_copies":1834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":180567,"num_read_kb":2466850,"num_write":142872,"num_write_kb":2319609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":727561,"num_omap_keys":1782,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12344,"ondisk_log_size":12344,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1645156,"kb_used_data":150692,"kb_used_omap":12,"kb_used_meta":1494323,"kb_avail":753329564,"statfs":{"total":773094113280,"available":771409473536,"internally_reserved":0,"allocated":154308608,"data_stored":138276318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1530187312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005147"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.061738+0000","last_change":"2024-09-12T01:29:57.061738+0000","last_active":"2024-09-12T01:29:57.061738+0000","last_peered":"2024-09-12T01:29:57.061738+0000","last_clean":"2024-09-12T01:29:57.061738+0000","last_became_active":"2024-09-12T01:04:13.467533+0000","last_became_peered":"2024-09-12T01:04:13.467533+0000","last_unstale":"2024-09-12T01:29:57.061738+0000","last_undegraded":"2024-09-12T01:29:57.061738+0000","last_fullsized":"2024-09-12T01:29:57.061738+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:57.061646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:57.061646+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.061646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:41.958626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.687343+0000","last_change":"2024-09-12T01:29:54.687343+0000","last_active":"2024-09-12T01:29:54.687343+0000","last_peered":"2024-09-12T01:29:54.687343+0000","last_clean":"2024-09-12T01:29:54.687343+0000","last_became_active":"2024-09-12T00:48:45.303088+0000","last_became_peered":"2024-09-12T00:48:45.303088+0000","last_unstale":"2024-09-12T01:29:54.687343+0000","last_undegraded":"2024-09-12T01:29:54.687343+0000","last_fullsized":"2024-09-12T01:29:54.687343+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:54.687250+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:54.687250+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.687250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:44.841379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"262'3","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:01.619724+0000","last_change":"2024-09-12T01:30:01.619724+0000","last_active":"2024-09-12T01:30:01.619724+0000","last_peered":"2024-09-12T01:30:01.619724+0000","last_clean":"2024-09-12T01:30:01.619724+0000","last_became_active":"2024-09-12T00:48:42.290471+0000","last_became_peered":"2024-09-12T00:48:42.290471+0000","last_unstale":"2024-09-12T01:30:01.619724+0000","last_undegraded":"2024-09-12T01:30:01.619724+0000","last_fullsized":"2024-09-12T01:30:01.619724+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:30:01.619628+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:30:01.619628+0000","last_clean_scrub_stamp":"2024-09-12T01:30:01.619628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:01.581709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'15","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:01.569626+0000","last_change":"2024-09-12T01:30:01.569626+0000","last_active":"2024-09-12T01:30:01.569626+0000","last_peered":"2024-09-12T01:30:01.569626+0000","last_clean":"2024-09-12T01:30:01.569626+0000","last_became_active":"2024-09-12T00:46:03.918235+0000","last_became_peered":"2024-09-12T00:46:03.918235+0000","last_unstale":"2024-09-12T01:30:01.569626+0000","last_undegraded":"2024-09-12T01:30:01.569626+0000","last_fullsized":"2024-09-12T01:30:01.569626+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'15","last_scrub_stamp":"2024-09-12T01:30:01.569539+0000","last_deep_scrub":"265'15","last_deep_scrub_stamp":"2024-09-12T01:30:01.569539+0000","last_clean_scrub_stamp":"2024-09-12T01:30:01.569539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:20.877189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":51,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:07.081439+0000","last_change":"2024-09-12T01:30:07.081439+0000","last_active":"2024-09-12T01:30:07.081439+0000","last_peered":"2024-09-12T01:30:07.081439+0000","last_clean":"2024-09-12T01:30:07.081439+0000","last_became_active":"2024-09-12T01:04:13.463645+0000","last_became_peered":"2024-09-12T01:04:13.463645+0000","last_unstale":"2024-09-12T01:30:07.081439+0000","last_undegraded":"2024-09-12T01:30:07.081439+0000","last_fullsized":"2024-09-12T01:30:07.081439+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:07.081345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:07.081345+0000","last_clean_scrub_stamp":"2024-09-12T01:30:07.081345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:49.780249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.469854+0000","last_change":"2024-09-12T01:29:59.469854+0000","last_active":"2024-09-12T01:29:59.469854+0000","last_peered":"2024-09-12T01:29:59.469854+0000","last_clean":"2024-09-12T01:29:59.469854+0000","last_became_active":"2024-09-12T00:48:45.307070+0000","last_became_peered":"2024-09-12T00:48:45.307070+0000","last_unstale":"2024-09-12T01:29:59.469854+0000","last_undegraded":"2024-09-12T01:29:59.469854+0000","last_fullsized":"2024-09-12T01:29:59.469854+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:29:59.469749+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:29:59.469749+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.469749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:28.682849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"262'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:05.766934+0000","last_change":"2024-09-12T01:30:05.766934+0000","last_active":"2024-09-12T01:30:05.766934+0000","last_peered":"2024-09-12T01:30:05.766934+0000","last_clean":"2024-09-12T01:30:05.766934+0000","last_became_active":"2024-09-12T00:48:42.296820+0000","last_became_peered":"2024-09-12T00:48:42.296820+0000","last_unstale":"2024-09-12T01:30:05.766934+0000","last_undegraded":"2024-09-12T01:30:05.766934+0000","last_fullsized":"2024-09-12T01:30:05.766934+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:30:05.766832+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:30:05.766832+0000","last_clean_scrub_stamp":"2024-09-12T01:30:05.766832+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:35.099147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'17","reported_seq":107,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:02.558258+0000","last_change":"2024-09-12T01:30:02.558173+0000","last_active":"2024-09-12T01:30:02.558258+0000","last_peered":"2024-09-12T01:30:02.558258+0000","last_clean":"2024-09-12T01:30:02.558258+0000","last_became_active":"2024-09-12T00:46:03.919803+0000","last_became_peered":"2024-09-12T00:46:03.919803+0000","last_unstale":"2024-09-12T01:30:02.558258+0000","last_undegraded":"2024-09-12T01:30:02.558258+0000","last_fullsized":"2024-09-12T01:30:02.558258+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-12T01:30:02.558090+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-12T01:30:02.558090+0000","last_clean_scrub_stamp":"2024-09-12T01:30:02.558090+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:35.023715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":60,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.755504+0000","last_change":"2024-09-12T01:29:59.755504+0000","last_active":"2024-09-12T01:29:59.755504+0000","last_peered":"2024-09-12T01:29:59.755504+0000","last_clean":"2024-09-12T01:29:59.755504+0000","last_became_active":"2024-09-12T01:04:13.470465+0000","last_became_peered":"2024-09-12T01:04:13.470465+0000","last_unstale":"2024-09-12T01:29:59.755504+0000","last_undegraded":"2024-09-12T01:29:59.755504+0000","last_fullsized":"2024-09-12T01:29:59.755504+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:59.755411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:59.755411+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.755411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:02.098986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'8","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:17.901641+0000","last_change":"2024-09-12T01:30:17.901641+0000","last_active":"2024-09-12T01:30:17.901641+0000","last_peered":"2024-09-12T01:30:17.901641+0000","last_clean":"2024-09-12T01:30:17.901641+0000","last_became_active":"2024-09-12T00:48:45.318423+0000","last_became_peered":"2024-09-12T00:48:45.318423+0000","last_unstale":"2024-09-12T01:30:17.901641+0000","last_undegraded":"2024-09-12T01:30:17.901641+0000","last_fullsized":"2024-09-12T01:30:17.901641+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T01:30:17.901526+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T01:30:17.901526+0000","last_clean_scrub_stamp":"2024-09-12T01:30:17.901526+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:44.673517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4098,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'3","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.663659+0000","last_change":"2024-09-12T01:30:00.663659+0000","last_active":"2024-09-12T01:30:00.663659+0000","last_peered":"2024-09-12T01:30:00.663659+0000","last_clean":"2024-09-12T01:30:00.663659+0000","last_became_active":"2024-09-12T00:48:42.292607+0000","last_became_peered":"2024-09-12T00:48:42.292607+0000","last_unstale":"2024-09-12T01:30:00.663659+0000","last_undegraded":"2024-09-12T01:30:00.663659+0000","last_fullsized":"2024-09-12T01:30:00.663659+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:30:00.663563+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:30:00.663563+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.663563+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:48.079407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'33","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.084808+0000","last_change":"2024-09-12T01:29:59.084808+0000","last_active":"2024-09-12T01:29:59.084808+0000","last_peered":"2024-09-12T01:29:59.084808+0000","last_clean":"2024-09-12T01:29:59.084808+0000","last_became_active":"2024-09-12T00:46:03.918204+0000","last_became_peered":"2024-09-12T00:46:03.918204+0000","last_unstale":"2024-09-12T01:29:59.084808+0000","last_undegraded":"2024-09-12T01:29:59.084808+0000","last_fullsized":"2024-09-12T01:29:59.084808+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-12T01:29:59.084722+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-12T01:29:59.084722+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.084722+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:25.176184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":133,"num_write":46,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:19.866994+0000","last_change":"2024-09-12T01:30:19.866994+0000","last_active":"2024-09-12T01:30:19.866994+0000","last_peered":"2024-09-12T01:30:19.866994+0000","last_clean":"2024-09-12T01:30:19.866994+0000","last_became_active":"2024-09-12T01:04:13.465081+0000","last_became_peered":"2024-09-12T01:04:13.465081+0000","last_unstale":"2024-09-12T01:30:19.866994+0000","last_undegraded":"2024-09-12T01:30:19.866994+0000","last_fullsized":"2024-09-12T01:30:19.866994+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:19.866897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:19.866897+0000","last_clean_scrub_stamp":"2024-09-12T01:30:19.866897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:30.088697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:12.867066+0000","last_change":"2024-09-12T01:30:12.867066+0000","last_active":"2024-09-12T01:30:12.867066+0000","last_peered":"2024-09-12T01:30:12.867066+0000","last_clean":"2024-09-12T01:30:12.867066+0000","last_became_active":"2024-09-12T00:48:45.314837+0000","last_became_peered":"2024-09-12T00:48:45.314837+0000","last_unstale":"2024-09-12T01:30:12.867066+0000","last_undegraded":"2024-09-12T01:30:12.867066+0000","last_fullsized":"2024-09-12T01:30:12.867066+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:12.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:12.866968+0000","last_clean_scrub_stamp":"2024-09-12T01:30:12.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:06.961840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'10","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.692252+0000","last_change":"2024-09-12T01:29:56.692252+0000","last_active":"2024-09-12T01:29:56.692252+0000","last_peered":"2024-09-12T01:29:56.692252+0000","last_clean":"2024-09-12T01:29:56.692252+0000","last_became_active":"2024-09-12T00:48:42.290570+0000","last_became_peered":"2024-09-12T00:48:42.290570+0000","last_unstale":"2024-09-12T01:29:56.692252+0000","last_undegraded":"2024-09-12T01:29:56.692252+0000","last_fullsized":"2024-09-12T01:29:56.692252+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:29:56.692158+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:29:56.692158+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.692158+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:06.893219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":15,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'58","reported_seq":254,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.122726+0000","last_change":"2024-09-12T01:30:00.122726+0000","last_active":"2024-09-12T01:30:00.122726+0000","last_peered":"2024-09-12T01:30:00.122726+0000","last_clean":"2024-09-12T01:30:00.122726+0000","last_became_active":"2024-09-12T00:46:03.912603+0000","last_became_peered":"2024-09-12T00:46:03.912603+0000","last_unstale":"2024-09-12T01:30:00.122726+0000","last_undegraded":"2024-09-12T01:30:00.122726+0000","last_fullsized":"2024-09-12T01:30:00.122726+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'58","last_scrub_stamp":"2024-09-12T01:30:00.122637+0000","last_deep_scrub":"265'58","last_deep_scrub_stamp":"2024-09-12T01:30:00.122637+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.122637+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:26.770381+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":263,"num_write":69,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3960,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:11.672445+0000","last_change":"2024-09-12T01:30:11.672381+0000","last_active":"2024-09-12T01:30:11.672445+0000","last_peered":"2024-09-12T01:30:11.672445+0000","last_clean":"2024-09-12T01:30:11.672445+0000","last_became_active":"2024-09-12T01:04:13.458781+0000","last_became_peered":"2024-09-12T01:04:13.458781+0000","last_unstale":"2024-09-12T01:30:11.672445+0000","last_undegraded":"2024-09-12T01:30:11.672445+0000","last_fullsized":"2024-09-12T01:30:11.672445+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:11.672295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:11.672295+0000","last_clean_scrub_stamp":"2024-09-12T01:30:11.672295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:07.717308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'5","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.110598+0000","last_change":"2024-09-12T01:29:52.110533+0000","last_active":"2024-09-12T01:29:52.110598+0000","last_peered":"2024-09-12T01:29:52.110598+0000","last_clean":"2024-09-12T01:29:52.110598+0000","last_became_active":"2024-09-12T00:48:45.318608+0000","last_became_peered":"2024-09-12T00:48:45.318608+0000","last_unstale":"2024-09-12T01:29:52.110598+0000","last_undegraded":"2024-09-12T01:29:52.110598+0000","last_fullsized":"2024-09-12T01:29:52.110598+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:29:52.110441+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:29:52.110441+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.110441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:57.965213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"265'11","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:03.800870+0000","last_change":"2024-09-12T01:30:03.800870+0000","last_active":"2024-09-12T01:30:03.800870+0000","last_peered":"2024-09-12T01:30:03.800870+0000","last_clean":"2024-09-12T01:30:03.800870+0000","last_became_active":"2024-09-12T00:48:42.297952+0000","last_became_peered":"2024-09-12T00:48:42.297952+0000","last_unstale":"2024-09-12T01:30:03.800870+0000","last_undegraded":"2024-09-12T01:30:03.800870+0000","last_fullsized":"2024-09-12T01:30:03.800870+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T01:30:03.800775+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T01:30:03.800775+0000","last_clean_scrub_stamp":"2024-09-12T01:30:03.800775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:39.917001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16432,"num_write":11,"num_write_kb":16432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'28","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.115939+0000","last_change":"2024-09-12T01:29:58.115939+0000","last_active":"2024-09-12T01:29:58.115939+0000","last_peered":"2024-09-12T01:29:58.115939+0000","last_clean":"2024-09-12T01:29:58.115939+0000","last_became_active":"2024-09-12T00:46:03.915917+0000","last_became_peered":"2024-09-12T00:46:03.915917+0000","last_unstale":"2024-09-12T01:29:58.115939+0000","last_undegraded":"2024-09-12T01:29:58.115939+0000","last_fullsized":"2024-09-12T01:29:58.115939+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'28","last_scrub_stamp":"2024-09-12T01:29:58.115806+0000","last_deep_scrub":"265'28","last_deep_scrub_stamp":"2024-09-12T01:29:58.115806+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.115806+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:42.369063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:07.555255+0000","last_change":"2024-09-12T01:30:07.555255+0000","last_active":"2024-09-12T01:30:07.555255+0000","last_peered":"2024-09-12T01:30:07.555255+0000","last_clean":"2024-09-12T01:30:07.555255+0000","last_became_active":"2024-09-12T01:04:13.465173+0000","last_became_peered":"2024-09-12T01:04:13.465173+0000","last_unstale":"2024-09-12T01:30:07.555255+0000","last_undegraded":"2024-09-12T01:30:07.555255+0000","last_fullsized":"2024-09-12T01:30:07.555255+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:07.555164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:07.555164+0000","last_clean_scrub_stamp":"2024-09-12T01:30:07.555164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:51.960386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.109029+0000","last_change":"2024-09-12T00:48:45.314920+0000","last_active":"2024-09-12T01:29:15.109029+0000","last_peered":"2024-09-12T01:29:15.109029+0000","last_clean":"2024-09-12T01:29:15.109029+0000","last_became_active":"2024-09-12T00:48:45.313443+0000","last_became_peered":"2024-09-12T00:48:45.313443+0000","last_unstale":"2024-09-12T01:29:15.109029+0000","last_undegraded":"2024-09-12T01:29:15.109029+0000","last_fullsized":"2024-09-12T01:29:15.109029+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'7","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.830606+0000","last_change":"2024-09-12T00:48:42.293510+0000","last_active":"2024-09-12T01:29:15.830606+0000","last_peered":"2024-09-12T01:29:15.830606+0000","last_clean":"2024-09-12T01:29:15.830606+0000","last_became_active":"2024-09-12T00:48:42.293128+0000","last_became_peered":"2024-09-12T00:48:42.293128+0000","last_unstale":"2024-09-12T01:29:15.830606+0000","last_undegraded":"2024-09-12T01:29:15.830606+0000","last_fullsized":"2024-09-12T01:29:15.830606+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:41.269149+0000","last_clean_scrub_stamp":"2024-09-12T00:48:41.269149+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":20530,"num_write":7,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'40","reported_seq":165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.491716+0000","last_change":"2024-09-12T01:29:58.491716+0000","last_active":"2024-09-12T01:29:58.491716+0000","last_peered":"2024-09-12T01:29:58.491716+0000","last_clean":"2024-09-12T01:29:58.491716+0000","last_became_active":"2024-09-12T00:46:03.923029+0000","last_became_peered":"2024-09-12T00:46:03.923029+0000","last_unstale":"2024-09-12T01:29:58.491716+0000","last_undegraded":"2024-09-12T01:29:58.491716+0000","last_fullsized":"2024-09-12T01:29:58.491716+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'40","last_scrub_stamp":"2024-09-12T01:29:58.491625+0000","last_deep_scrub":"265'40","last_deep_scrub_stamp":"2024-09-12T01:29:58.491625+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.491625+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:09.588985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":145,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:04.411562+0000","last_change":"2024-09-12T01:30:04.411562+0000","last_active":"2024-09-12T01:30:04.411562+0000","last_peered":"2024-09-12T01:30:04.411562+0000","last_clean":"2024-09-12T01:30:04.411562+0000","last_became_active":"2024-09-12T01:04:13.468832+0000","last_became_peered":"2024-09-12T01:04:13.468832+0000","last_unstale":"2024-09-12T01:30:04.411562+0000","last_undegraded":"2024-09-12T01:30:04.411562+0000","last_fullsized":"2024-09-12T01:30:04.411562+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:04.411496+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:04.411496+0000","last_clean_scrub_stamp":"2024-09-12T01:30:04.411496+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:12.846037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:05.442443+0000","last_change":"2024-09-12T01:30:05.442443+0000","last_active":"2024-09-12T01:30:05.442443+0000","last_peered":"2024-09-12T01:30:05.442443+0000","last_clean":"2024-09-12T01:30:05.442443+0000","last_became_active":"2024-09-12T00:48:45.309166+0000","last_became_peered":"2024-09-12T00:48:45.309166+0000","last_unstale":"2024-09-12T01:30:05.442443+0000","last_undegraded":"2024-09-12T01:30:05.442443+0000","last_fullsized":"2024-09-12T01:30:05.442443+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:05.442358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:05.442358+0000","last_clean_scrub_stamp":"2024-09-12T01:30:05.442358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:47.746432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.135129+0000","last_change":"2024-09-12T01:29:49.135129+0000","last_active":"2024-09-12T01:29:49.135129+0000","last_peered":"2024-09-12T01:29:49.135129+0000","last_clean":"2024-09-12T01:29:49.135129+0000","last_became_active":"2024-09-12T00:48:42.291800+0000","last_became_peered":"2024-09-12T00:48:42.291800+0000","last_unstale":"2024-09-12T01:29:49.135129+0000","last_undegraded":"2024-09-12T01:29:49.135129+0000","last_fullsized":"2024-09-12T01:29:49.135129+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:49.135008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:49.135008+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.135008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:55.800469+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'17","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.623046+0000","last_change":"2024-09-12T01:29:54.623046+0000","last_active":"2024-09-12T01:29:54.623046+0000","last_peered":"2024-09-12T01:29:54.623046+0000","last_clean":"2024-09-12T01:29:54.623046+0000","last_became_active":"2024-09-12T00:46:03.913667+0000","last_became_peered":"2024-09-12T00:46:03.913667+0000","last_unstale":"2024-09-12T01:29:54.623046+0000","last_undegraded":"2024-09-12T01:29:54.623046+0000","last_fullsized":"2024-09-12T01:29:54.623046+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-12T01:29:54.622956+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-12T01:29:54.622956+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.622956+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:21.226949+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":62,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.079993+0000","last_change":"2024-09-12T01:29:58.079993+0000","last_active":"2024-09-12T01:29:58.079993+0000","last_peered":"2024-09-12T01:29:58.079993+0000","last_clean":"2024-09-12T01:29:58.079993+0000","last_became_active":"2024-09-12T01:04:13.462605+0000","last_became_peered":"2024-09-12T01:04:13.462605+0000","last_unstale":"2024-09-12T01:29:58.079993+0000","last_undegraded":"2024-09-12T01:29:58.079993+0000","last_fullsized":"2024-09-12T01:29:58.079993+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:58.079892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:58.079892+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.079892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:28.907381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:08.634063+0000","last_change":"2024-09-12T01:30:08.634063+0000","last_active":"2024-09-12T01:30:08.634063+0000","last_peered":"2024-09-12T01:30:08.634063+0000","last_clean":"2024-09-12T01:30:08.634063+0000","last_became_active":"2024-09-12T00:48:45.314128+0000","last_became_peered":"2024-09-12T00:48:45.314128+0000","last_unstale":"2024-09-12T01:30:08.634063+0000","last_undegraded":"2024-09-12T01:30:08.634063+0000","last_fullsized":"2024-09-12T01:30:08.634063+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:08.633961+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:08.633961+0000","last_clean_scrub_stamp":"2024-09-12T01:30:08.633961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:43.415471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:03.128141+0000","last_change":"2024-09-12T01:30:03.128141+0000","last_active":"2024-09-12T01:30:03.128141+0000","last_peered":"2024-09-12T01:30:03.128141+0000","last_clean":"2024-09-12T01:30:03.128141+0000","last_became_active":"2024-09-12T00:48:42.295886+0000","last_became_peered":"2024-09-12T00:48:42.295886+0000","last_unstale":"2024-09-12T01:30:03.128141+0000","last_undegraded":"2024-09-12T01:30:03.128141+0000","last_fullsized":"2024-09-12T01:30:03.128141+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:03.128020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:03.128020+0000","last_clean_scrub_stamp":"2024-09-12T01:30:03.128020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:53.666167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'14","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.073624+0000","last_change":"2024-09-12T01:29:57.073624+0000","last_active":"2024-09-12T01:29:57.073624+0000","last_peered":"2024-09-12T01:29:57.073624+0000","last_clean":"2024-09-12T01:29:57.073624+0000","last_became_active":"2024-09-12T00:46:03.919334+0000","last_became_peered":"2024-09-12T00:46:03.919334+0000","last_unstale":"2024-09-12T01:29:57.073624+0000","last_undegraded":"2024-09-12T01:29:57.073624+0000","last_fullsized":"2024-09-12T01:29:57.073624+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T01:29:57.073537+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T01:29:57.073537+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.073537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:15.408952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:20.822754+0000","last_change":"2024-09-12T01:30:20.822754+0000","last_active":"2024-09-12T01:30:20.822754+0000","last_peered":"2024-09-12T01:30:20.822754+0000","last_clean":"2024-09-12T01:30:20.822754+0000","last_became_active":"2024-09-12T01:04:13.467230+0000","last_became_peered":"2024-09-12T01:04:13.467230+0000","last_unstale":"2024-09-12T01:30:20.822754+0000","last_undegraded":"2024-09-12T01:30:20.822754+0000","last_fullsized":"2024-09-12T01:30:20.822754+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:20.822614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:20.822614+0000","last_clean_scrub_stamp":"2024-09-12T01:30:20.822614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:49.389761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:07.678153+0000","last_change":"2024-09-12T01:30:07.678153+0000","last_active":"2024-09-12T01:30:07.678153+0000","last_peered":"2024-09-12T01:30:07.678153+0000","last_clean":"2024-09-12T01:30:07.678153+0000","last_became_active":"2024-09-12T00:48:45.309604+0000","last_became_peered":"2024-09-12T00:48:45.309604+0000","last_unstale":"2024-09-12T01:30:07.678153+0000","last_undegraded":"2024-09-12T01:30:07.678153+0000","last_fullsized":"2024-09-12T01:30:07.678153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:30:07.678052+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:30:07.678052+0000","last_clean_scrub_stamp":"2024-09-12T01:30:07.678052+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:10.563758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:14.272080+0000","last_change":"2024-09-12T01:30:14.272080+0000","last_active":"2024-09-12T01:30:14.272080+0000","last_peered":"2024-09-12T01:30:14.272080+0000","last_clean":"2024-09-12T01:30:14.272080+0000","last_became_active":"2024-09-12T00:48:42.293705+0000","last_became_peered":"2024-09-12T00:48:42.293705+0000","last_unstale":"2024-09-12T01:30:14.272080+0000","last_undegraded":"2024-09-12T01:30:14.272080+0000","last_fullsized":"2024-09-12T01:30:14.272080+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:14.271984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:14.271984+0000","last_clean_scrub_stamp":"2024-09-12T01:30:14.271984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:07.407029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'6","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.601592+0000","last_change":"2024-09-12T01:30:00.601592+0000","last_active":"2024-09-12T01:30:00.601592+0000","last_peered":"2024-09-12T01:30:00.601592+0000","last_clean":"2024-09-12T01:30:00.601592+0000","last_became_active":"2024-09-12T00:46:03.916699+0000","last_became_peered":"2024-09-12T00:46:03.916699+0000","last_unstale":"2024-09-12T01:30:00.601592+0000","last_undegraded":"2024-09-12T01:30:00.601592+0000","last_fullsized":"2024-09-12T01:30:00.601592+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:30:00.601494+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:30:00.601494+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.601494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:38.098128+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:05.097921+0000","last_change":"2024-09-12T01:30:05.097921+0000","last_active":"2024-09-12T01:30:05.097921+0000","last_peered":"2024-09-12T01:30:05.097921+0000","last_clean":"2024-09-12T01:30:05.097921+0000","last_became_active":"2024-09-12T01:04:13.468643+0000","last_became_peered":"2024-09-12T01:04:13.468643+0000","last_unstale":"2024-09-12T01:30:05.097921+0000","last_undegraded":"2024-09-12T01:30:05.097921+0000","last_fullsized":"2024-09-12T01:30:05.097921+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:05.097793+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:05.097793+0000","last_clean_scrub_stamp":"2024-09-12T01:30:05.097793+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:48.469135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:11.832074+0000","last_change":"2024-09-12T01:30:11.832074+0000","last_active":"2024-09-12T01:30:11.832074+0000","last_peered":"2024-09-12T01:30:11.832074+0000","last_clean":"2024-09-12T01:30:11.832074+0000","last_became_active":"2024-09-12T00:48:45.314212+0000","last_became_peered":"2024-09-12T00:48:45.314212+0000","last_unstale":"2024-09-12T01:30:11.832074+0000","last_undegraded":"2024-09-12T01:30:11.832074+0000","last_fullsized":"2024-09-12T01:30:11.832074+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:30:11.831990+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:30:11.831990+0000","last_clean_scrub_stamp":"2024-09-12T01:30:11.831990+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:05.913868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"265'3","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.122795+0000","last_change":"2024-09-12T01:29:48.122718+0000","last_active":"2024-09-12T01:29:48.122795+0000","last_peered":"2024-09-12T01:29:48.122795+0000","last_clean":"2024-09-12T01:29:48.122795+0000","last_became_active":"2024-09-12T00:48:42.291818+0000","last_became_peered":"2024-09-12T00:48:42.291818+0000","last_unstale":"2024-09-12T01:29:48.122795+0000","last_undegraded":"2024-09-12T01:29:48.122795+0000","last_fullsized":"2024-09-12T01:29:48.122795+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:48.122622+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:48.122622+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.122622+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:23.762152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'35","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.578624+0000","last_change":"2024-09-12T01:29:59.578624+0000","last_active":"2024-09-12T01:29:59.578624+0000","last_peered":"2024-09-12T01:29:59.578624+0000","last_clean":"2024-09-12T01:29:59.578624+0000","last_became_active":"2024-09-12T00:46:03.920696+0000","last_became_peered":"2024-09-12T00:46:03.920696+0000","last_unstale":"2024-09-12T01:29:59.578624+0000","last_undegraded":"2024-09-12T01:29:59.578624+0000","last_fullsized":"2024-09-12T01:29:59.578624+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'35","last_scrub_stamp":"2024-09-12T01:29:59.578532+0000","last_deep_scrub":"265'35","last_deep_scrub_stamp":"2024-09-12T01:29:59.578532+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.578532+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:44.043628+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:02.404849+0000","last_change":"2024-09-12T01:30:02.404849+0000","last_active":"2024-09-12T01:30:02.404849+0000","last_peered":"2024-09-12T01:30:02.404849+0000","last_clean":"2024-09-12T01:30:02.404849+0000","last_became_active":"2024-09-12T01:04:13.471741+0000","last_became_peered":"2024-09-12T01:04:13.471741+0000","last_unstale":"2024-09-12T01:30:02.404849+0000","last_undegraded":"2024-09-12T01:30:02.404849+0000","last_fullsized":"2024-09-12T01:30:02.404849+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:02.404760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:02.404760+0000","last_clean_scrub_stamp":"2024-09-12T01:30:02.404760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:29.071632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'7","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:06.674710+0000","last_change":"2024-09-12T01:30:06.674710+0000","last_active":"2024-09-12T01:30:06.674710+0000","last_peered":"2024-09-12T01:30:06.674710+0000","last_clean":"2024-09-12T01:30:06.674710+0000","last_became_active":"2024-09-12T00:48:45.317576+0000","last_became_peered":"2024-09-12T00:48:45.317576+0000","last_unstale":"2024-09-12T01:30:06.674710+0000","last_undegraded":"2024-09-12T01:30:06.674710+0000","last_fullsized":"2024-09-12T01:30:06.674710+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T01:30:06.674612+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T01:30:06.674612+0000","last_clean_scrub_stamp":"2024-09-12T01:30:06.674612+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:29.008664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"262'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.619731+0000","last_change":"2024-09-12T01:29:59.619731+0000","last_active":"2024-09-12T01:29:59.619731+0000","last_peered":"2024-09-12T01:29:59.619731+0000","last_clean":"2024-09-12T01:29:59.619731+0000","last_became_active":"2024-09-12T00:48:42.291199+0000","last_became_peered":"2024-09-12T00:48:42.291199+0000","last_unstale":"2024-09-12T01:29:59.619731+0000","last_undegraded":"2024-09-12T01:29:59.619731+0000","last_fullsized":"2024-09-12T01:29:59.619731+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:29:59.619641+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:29:59.619641+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.619641+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:03.736526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5165,"num_write":10,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'6","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.647536+0000","last_change":"2024-09-12T01:29:53.647536+0000","last_active":"2024-09-12T01:29:53.647536+0000","last_peered":"2024-09-12T01:29:53.647536+0000","last_clean":"2024-09-12T01:29:53.647536+0000","last_became_active":"2024-09-12T00:46:03.919481+0000","last_became_peered":"2024-09-12T00:46:03.919481+0000","last_unstale":"2024-09-12T01:29:53.647536+0000","last_undegraded":"2024-09-12T01:29:53.647536+0000","last_fullsized":"2024-09-12T01:29:53.647536+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:29:53.647438+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:29:53.647438+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.647438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:23.272786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.024874+0000","last_change":"2024-09-12T01:29:56.024874+0000","last_active":"2024-09-12T01:29:56.024874+0000","last_peered":"2024-09-12T01:29:56.024874+0000","last_clean":"2024-09-12T01:29:56.024874+0000","last_became_active":"2024-09-12T01:04:13.468317+0000","last_became_peered":"2024-09-12T01:04:13.468317+0000","last_unstale":"2024-09-12T01:29:56.024874+0000","last_undegraded":"2024-09-12T01:29:56.024874+0000","last_fullsized":"2024-09-12T01:29:56.024874+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:56.024783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:56.024783+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.024783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:32.913868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.079981+0000","last_change":"2024-09-12T01:29:59.079981+0000","last_active":"2024-09-12T01:29:59.079981+0000","last_peered":"2024-09-12T01:29:59.079981+0000","last_clean":"2024-09-12T01:29:59.079981+0000","last_became_active":"2024-09-12T00:48:45.315546+0000","last_became_peered":"2024-09-12T00:48:45.315546+0000","last_unstale":"2024-09-12T01:29:59.079981+0000","last_undegraded":"2024-09-12T01:29:59.079981+0000","last_fullsized":"2024-09-12T01:29:59.079981+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:29:59.079883+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:29:59.079883+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.079883+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:24.451968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:01.793480+0000","last_change":"2024-09-12T01:30:01.793480+0000","last_active":"2024-09-12T01:30:01.793480+0000","last_peered":"2024-09-12T01:30:01.793480+0000","last_clean":"2024-09-12T01:30:01.793480+0000","last_became_active":"2024-09-12T00:48:42.296509+0000","last_became_peered":"2024-09-12T00:48:42.296509+0000","last_unstale":"2024-09-12T01:30:01.793480+0000","last_undegraded":"2024-09-12T01:30:01.793480+0000","last_fullsized":"2024-09-12T01:30:01.793480+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:30:01.793380+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:30:01.793380+0000","last_clean_scrub_stamp":"2024-09-12T01:30:01.793380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:33.430960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'52","reported_seq":196,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:12.270362+0000","last_change":"2024-09-12T01:30:12.270362+0000","last_active":"2024-09-12T01:30:12.270362+0000","last_peered":"2024-09-12T01:30:12.270362+0000","last_clean":"2024-09-12T01:30:12.270362+0000","last_became_active":"2024-09-12T00:46:03.920188+0000","last_became_peered":"2024-09-12T00:46:03.920188+0000","last_unstale":"2024-09-12T01:30:12.270362+0000","last_undegraded":"2024-09-12T01:30:12.270362+0000","last_fullsized":"2024-09-12T01:30:12.270362+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'52","last_scrub_stamp":"2024-09-12T01:30:12.270264+0000","last_deep_scrub":"265'52","last_deep_scrub_stamp":"2024-09-12T01:30:12.270264+0000","last_clean_scrub_stamp":"2024-09-12T01:30:12.270264+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.466521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":182,"num_write":95,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:18.866989+0000","last_change":"2024-09-12T01:30:18.866989+0000","last_active":"2024-09-12T01:30:18.866989+0000","last_peered":"2024-09-12T01:30:18.866989+0000","last_clean":"2024-09-12T01:30:18.866989+0000","last_became_active":"2024-09-12T01:04:13.462434+0000","last_became_peered":"2024-09-12T01:04:13.462434+0000","last_unstale":"2024-09-12T01:30:18.866989+0000","last_undegraded":"2024-09-12T01:30:18.866989+0000","last_fullsized":"2024-09-12T01:30:18.866989+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:18.866878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:18.866878+0000","last_clean_scrub_stamp":"2024-09-12T01:30:18.866878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:22.136558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:10.824279+0000","last_change":"2024-09-12T01:30:10.824279+0000","last_active":"2024-09-12T01:30:10.824279+0000","last_peered":"2024-09-12T01:30:10.824279+0000","last_clean":"2024-09-12T01:30:10.824279+0000","last_became_active":"2024-09-12T00:48:45.316432+0000","last_became_peered":"2024-09-12T00:48:45.316432+0000","last_unstale":"2024-09-12T01:30:10.824279+0000","last_undegraded":"2024-09-12T01:30:10.824279+0000","last_fullsized":"2024-09-12T01:30:10.824279+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:10.824164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:10.824164+0000","last_clean_scrub_stamp":"2024-09-12T01:30:10.824164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:05.129693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.730540+0000","last_change":"2024-09-12T01:29:57.730540+0000","last_active":"2024-09-12T01:29:57.730540+0000","last_peered":"2024-09-12T01:29:57.730540+0000","last_clean":"2024-09-12T01:29:57.730540+0000","last_became_active":"2024-09-12T00:48:42.290454+0000","last_became_peered":"2024-09-12T00:48:42.290454+0000","last_unstale":"2024-09-12T01:29:57.730540+0000","last_undegraded":"2024-09-12T01:29:57.730540+0000","last_fullsized":"2024-09-12T01:29:57.730540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:57.730455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:57.730455+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.730455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:31.605867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"262'7","reported_seq":76,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:10.251764+0000","last_change":"2024-09-12T01:30:10.251764+0000","last_active":"2024-09-12T01:30:10.251764+0000","last_peered":"2024-09-12T01:30:10.251764+0000","last_clean":"2024-09-12T01:30:10.251764+0000","last_became_active":"2024-09-12T00:46:03.917314+0000","last_became_peered":"2024-09-12T00:46:03.917314+0000","last_unstale":"2024-09-12T01:30:10.251764+0000","last_undegraded":"2024-09-12T01:30:10.251764+0000","last_fullsized":"2024-09-12T01:30:10.251764+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T01:30:10.251658+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T01:30:10.251658+0000","last_clean_scrub_stamp":"2024-09-12T01:30:10.251658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:25.277948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":13,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:08.045706+0000","last_change":"2024-09-12T01:30:08.045706+0000","last_active":"2024-09-12T01:30:08.045706+0000","last_peered":"2024-09-12T01:30:08.045706+0000","last_clean":"2024-09-12T01:30:08.045706+0000","last_became_active":"2024-09-12T01:04:13.467119+0000","last_became_peered":"2024-09-12T01:04:13.467119+0000","last_unstale":"2024-09-12T01:30:08.045706+0000","last_undegraded":"2024-09-12T01:30:08.045706+0000","last_fullsized":"2024-09-12T01:30:08.045706+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:08.045609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:08.045609+0000","last_clean_scrub_stamp":"2024-09-12T01:30:08.045609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:16.879908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:09.820437+0000","last_change":"2024-09-12T01:30:09.820437+0000","last_active":"2024-09-12T01:30:09.820437+0000","last_peered":"2024-09-12T01:30:09.820437+0000","last_clean":"2024-09-12T01:30:09.820437+0000","last_became_active":"2024-09-12T00:48:45.314127+0000","last_became_peered":"2024-09-12T00:48:45.314127+0000","last_unstale":"2024-09-12T01:30:09.820437+0000","last_undegraded":"2024-09-12T01:30:09.820437+0000","last_fullsized":"2024-09-12T01:30:09.820437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:09.820316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:09.820316+0000","last_clean_scrub_stamp":"2024-09-12T01:30:09.820316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:49.308643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'5","reported_seq":65,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:06.778697+0000","last_change":"2024-09-12T01:30:06.778697+0000","last_active":"2024-09-12T01:30:06.778697+0000","last_peered":"2024-09-12T01:30:06.778697+0000","last_clean":"2024-09-12T01:30:06.778697+0000","last_became_active":"2024-09-12T00:48:42.293153+0000","last_became_peered":"2024-09-12T00:48:42.293153+0000","last_unstale":"2024-09-12T01:30:06.778697+0000","last_undegraded":"2024-09-12T01:30:06.778697+0000","last_fullsized":"2024-09-12T01:30:06.778697+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:30:06.778612+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:30:06.778612+0000","last_clean_scrub_stamp":"2024-09-12T01:30:06.778612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:39.888471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'49","reported_seq":187,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.621180+0000","last_change":"2024-09-12T01:29:52.621180+0000","last_active":"2024-09-12T01:29:52.621180+0000","last_peered":"2024-09-12T01:29:52.621180+0000","last_clean":"2024-09-12T01:29:52.621180+0000","last_became_active":"2024-09-12T00:46:03.917142+0000","last_became_peered":"2024-09-12T00:46:03.917142+0000","last_unstale":"2024-09-12T01:29:52.621180+0000","last_undegraded":"2024-09-12T01:29:52.621180+0000","last_fullsized":"2024-09-12T01:29:52.621180+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'49","last_scrub_stamp":"2024-09-12T01:29:52.621077+0000","last_deep_scrub":"265'49","last_deep_scrub_stamp":"2024-09-12T01:29:52.621077+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.621077+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:15.538686+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":172,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:06.594311+0000","last_change":"2024-09-12T01:30:06.594311+0000","last_active":"2024-09-12T01:30:06.594311+0000","last_peered":"2024-09-12T01:30:06.594311+0000","last_clean":"2024-09-12T01:30:06.594311+0000","last_became_active":"2024-09-12T01:04:13.463766+0000","last_became_peered":"2024-09-12T01:04:13.463766+0000","last_unstale":"2024-09-12T01:30:06.594311+0000","last_undegraded":"2024-09-12T01:30:06.594311+0000","last_fullsized":"2024-09-12T01:30:06.594311+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:06.594226+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:06.594226+0000","last_clean_scrub_stamp":"2024-09-12T01:30:06.594226+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:17.235090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:05.656805+0000","last_change":"2024-09-12T01:30:05.656805+0000","last_active":"2024-09-12T01:30:05.656805+0000","last_peered":"2024-09-12T01:30:05.656805+0000","last_clean":"2024-09-12T01:30:05.656805+0000","last_became_active":"2024-09-12T00:48:45.307036+0000","last_became_peered":"2024-09-12T00:48:45.307036+0000","last_unstale":"2024-09-12T01:30:05.656805+0000","last_undegraded":"2024-09-12T01:30:05.656805+0000","last_fullsized":"2024-09-12T01:30:05.656805+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:30:05.656679+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:30:05.656679+0000","last_clean_scrub_stamp":"2024-09-12T01:30:05.656679+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:21.982090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'5","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.731204+0000","last_change":"2024-09-12T01:29:53.731204+0000","last_active":"2024-09-12T01:29:53.731204+0000","last_peered":"2024-09-12T01:29:53.731204+0000","last_clean":"2024-09-12T01:29:53.731204+0000","last_became_active":"2024-09-12T00:48:42.294608+0000","last_became_peered":"2024-09-12T00:48:42.294608+0000","last_unstale":"2024-09-12T01:29:53.731204+0000","last_undegraded":"2024-09-12T01:29:53.731204+0000","last_fullsized":"2024-09-12T01:29:53.731204+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:29:53.731118+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:29:53.731118+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.731118+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:26.531554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5438,"num_write":5,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":108,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.501369+0000","last_change":"2024-09-12T01:29:52.501369+0000","last_active":"2024-09-12T01:29:52.501369+0000","last_peered":"2024-09-12T01:29:52.501369+0000","last_clean":"2024-09-12T01:29:52.501369+0000","last_became_active":"2024-09-12T00:46:03.921844+0000","last_became_peered":"2024-09-12T00:46:03.921844+0000","last_unstale":"2024-09-12T01:29:52.501369+0000","last_undegraded":"2024-09-12T01:29:52.501369+0000","last_fullsized":"2024-09-12T01:29:52.501369+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-12T01:29:52.501280+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-12T01:29:52.501280+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.501280+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:14.709150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":67,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:06.088720+0000","last_change":"2024-09-12T01:30:06.088720+0000","last_active":"2024-09-12T01:30:06.088720+0000","last_peered":"2024-09-12T01:30:06.088720+0000","last_clean":"2024-09-12T01:30:06.088720+0000","last_became_active":"2024-09-12T01:04:13.462441+0000","last_became_peered":"2024-09-12T01:04:13.462441+0000","last_unstale":"2024-09-12T01:30:06.088720+0000","last_undegraded":"2024-09-12T01:30:06.088720+0000","last_fullsized":"2024-09-12T01:30:06.088720+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:06.088622+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:06.088622+0000","last_clean_scrub_stamp":"2024-09-12T01:30:06.088622+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:39.433672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'11","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.407259+0000","last_change":"2024-09-12T00:48:45.312937+0000","last_active":"2024-09-12T01:29:15.407259+0000","last_peered":"2024-09-12T01:29:15.407259+0000","last_clean":"2024-09-12T01:29:15.407259+0000","last_became_active":"2024-09-12T00:48:45.312617+0000","last_became_peered":"2024-09-12T00:48:45.312617+0000","last_unstale":"2024-09-12T01:29:15.407259+0000","last_undegraded":"2024-09-12T01:29:15.407259+0000","last_fullsized":"2024-09-12T01:29:15.407259+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:28.386583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":20528,"num_write":21,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.714484+0000","last_change":"2024-09-12T01:29:52.714484+0000","last_active":"2024-09-12T01:29:52.714484+0000","last_peered":"2024-09-12T01:29:52.714484+0000","last_clean":"2024-09-12T01:29:52.714484+0000","last_became_active":"2024-09-12T00:48:42.292511+0000","last_became_peered":"2024-09-12T00:48:42.292511+0000","last_unstale":"2024-09-12T01:29:52.714484+0000","last_undegraded":"2024-09-12T01:29:52.714484+0000","last_fullsized":"2024-09-12T01:29:52.714484+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:52.714394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:52.714394+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.714394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:59.474523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'10","reported_seq":84,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.619764+0000","last_change":"2024-09-12T01:29:51.619764+0000","last_active":"2024-09-12T01:29:51.619764+0000","last_peered":"2024-09-12T01:29:51.619764+0000","last_clean":"2024-09-12T01:29:51.619764+0000","last_became_active":"2024-09-12T00:46:03.913098+0000","last_became_peered":"2024-09-12T00:46:03.913098+0000","last_unstale":"2024-09-12T01:29:51.619764+0000","last_undegraded":"2024-09-12T01:29:51.619764+0000","last_fullsized":"2024-09-12T01:29:51.619764+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:29:51.619673+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:29:51.619673+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.619673+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:11.583695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":36,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:16.931047+0000","last_change":"2024-09-12T01:30:16.930991+0000","last_active":"2024-09-12T01:30:16.931047+0000","last_peered":"2024-09-12T01:30:16.931047+0000","last_clean":"2024-09-12T01:30:16.931047+0000","last_became_active":"2024-09-12T01:04:13.473901+0000","last_became_peered":"2024-09-12T01:04:13.473901+0000","last_unstale":"2024-09-12T01:30:16.931047+0000","last_undegraded":"2024-09-12T01:30:16.931047+0000","last_fullsized":"2024-09-12T01:30:16.931047+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:16.930893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:16.930893+0000","last_clean_scrub_stamp":"2024-09-12T01:30:16.930893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:25.949186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:03.648790+0000","last_change":"2024-09-12T01:30:03.648790+0000","last_active":"2024-09-12T01:30:03.648790+0000","last_peered":"2024-09-12T01:30:03.648790+0000","last_clean":"2024-09-12T01:30:03.648790+0000","last_became_active":"2024-09-12T00:48:45.308676+0000","last_became_peered":"2024-09-12T00:48:45.308676+0000","last_unstale":"2024-09-12T01:30:03.648790+0000","last_undegraded":"2024-09-12T01:30:03.648790+0000","last_fullsized":"2024-09-12T01:30:03.648790+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:30:03.648703+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:30:03.648703+0000","last_clean_scrub_stamp":"2024-09-12T01:30:03.648703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:41.348995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":80,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'6","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.469888+0000","last_change":"2024-09-12T01:29:55.469888+0000","last_active":"2024-09-12T01:29:55.469888+0000","last_peered":"2024-09-12T01:29:55.469888+0000","last_clean":"2024-09-12T01:29:55.469888+0000","last_became_active":"2024-09-12T00:48:42.291569+0000","last_became_peered":"2024-09-12T00:48:42.291569+0000","last_unstale":"2024-09-12T01:29:55.469888+0000","last_undegraded":"2024-09-12T01:29:55.469888+0000","last_fullsized":"2024-09-12T01:29:55.469888+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:29:55.469801+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:29:55.469801+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.469801+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:27.799276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'67","reported_seq":241,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.640362+0000","last_change":"2024-09-12T01:29:50.640362+0000","last_active":"2024-09-12T01:29:50.640362+0000","last_peered":"2024-09-12T01:29:50.640362+0000","last_clean":"2024-09-12T01:29:50.640362+0000","last_became_active":"2024-09-12T00:46:03.920387+0000","last_became_peered":"2024-09-12T00:46:03.920387+0000","last_unstale":"2024-09-12T01:29:50.640362+0000","last_undegraded":"2024-09-12T01:29:50.640362+0000","last_fullsized":"2024-09-12T01:29:50.640362+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'67","last_scrub_stamp":"2024-09-12T01:29:50.640239+0000","last_deep_scrub":"265'67","last_deep_scrub_stamp":"2024-09-12T01:29:50.640239+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.640239+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:17.011130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":242,"num_write":122,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.723680+0000","last_change":"2024-09-12T01:29:55.723680+0000","last_active":"2024-09-12T01:29:55.723680+0000","last_peered":"2024-09-12T01:29:55.723680+0000","last_clean":"2024-09-12T01:29:55.723680+0000","last_became_active":"2024-09-12T01:04:13.469544+0000","last_became_peered":"2024-09-12T01:04:13.469544+0000","last_unstale":"2024-09-12T01:29:55.723680+0000","last_undegraded":"2024-09-12T01:29:55.723680+0000","last_fullsized":"2024-09-12T01:29:55.723680+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:55.723589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:55.723589+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.723589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:42.812895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:02.616707+0000","last_change":"2024-09-12T01:30:02.616707+0000","last_active":"2024-09-12T01:30:02.616707+0000","last_peered":"2024-09-12T01:30:02.616707+0000","last_clean":"2024-09-12T01:30:02.616707+0000","last_became_active":"2024-09-12T00:48:45.310425+0000","last_became_peered":"2024-09-12T00:48:45.310425+0000","last_unstale":"2024-09-12T01:30:02.616707+0000","last_undegraded":"2024-09-12T01:30:02.616707+0000","last_fullsized":"2024-09-12T01:30:02.616707+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T01:30:02.616595+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T01:30:02.616595+0000","last_clean_scrub_stamp":"2024-09-12T01:30:02.616595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:12.964549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:02.125670+0000","last_change":"2024-09-12T01:30:02.125670+0000","last_active":"2024-09-12T01:30:02.125670+0000","last_peered":"2024-09-12T01:30:02.125670+0000","last_clean":"2024-09-12T01:30:02.125670+0000","last_became_active":"2024-09-12T00:48:42.288750+0000","last_became_peered":"2024-09-12T00:48:42.288750+0000","last_unstale":"2024-09-12T01:30:02.125670+0000","last_undegraded":"2024-09-12T01:30:02.125670+0000","last_fullsized":"2024-09-12T01:30:02.125670+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:02.125584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:02.125584+0000","last_clean_scrub_stamp":"2024-09-12T01:30:02.125584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:49.724045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'39","reported_seq":158,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:11.280484+0000","last_change":"2024-09-12T01:30:11.280484+0000","last_active":"2024-09-12T01:30:11.280484+0000","last_peered":"2024-09-12T01:30:11.280484+0000","last_clean":"2024-09-12T01:30:11.280484+0000","last_became_active":"2024-09-12T00:46:03.918395+0000","last_became_peered":"2024-09-12T00:46:03.918395+0000","last_unstale":"2024-09-12T01:30:11.280484+0000","last_undegraded":"2024-09-12T01:30:11.280484+0000","last_fullsized":"2024-09-12T01:30:11.280484+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'39","last_scrub_stamp":"2024-09-12T01:30:11.280392+0000","last_deep_scrub":"265'39","last_deep_scrub_stamp":"2024-09-12T01:30:11.280392+0000","last_clean_scrub_stamp":"2024-09-12T01:30:11.280392+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:25.740102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":130,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:28:04.738543+0000","last_change":"2024-09-12T01:04:13.468761+0000","last_active":"2024-09-12T01:28:04.738543+0000","last_peered":"2024-09-12T01:28:04.738543+0000","last_clean":"2024-09-12T01:28:04.738543+0000","last_became_active":"2024-09-12T01:04:13.468492+0000","last_became_peered":"2024-09-12T01:04:13.468492+0000","last_unstale":"2024-09-12T01:28:04.738543+0000","last_undegraded":"2024-09-12T01:28:04.738543+0000","last_fullsized":"2024-09-12T01:28:04.738543+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'3","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:04.672405+0000","last_change":"2024-09-12T01:30:04.672405+0000","last_active":"2024-09-12T01:30:04.672405+0000","last_peered":"2024-09-12T01:30:04.672405+0000","last_clean":"2024-09-12T01:30:04.672405+0000","last_became_active":"2024-09-12T00:48:45.306581+0000","last_became_peered":"2024-09-12T00:48:45.306581+0000","last_unstale":"2024-09-12T01:30:04.672405+0000","last_undegraded":"2024-09-12T01:30:04.672405+0000","last_fullsized":"2024-09-12T01:30:04.672405+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:30:04.672288+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:30:04.672288+0000","last_clean_scrub_stamp":"2024-09-12T01:30:04.672288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:00.839242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.560659+0000","last_change":"2024-09-12T01:29:57.560659+0000","last_active":"2024-09-12T01:29:57.560659+0000","last_peered":"2024-09-12T01:29:57.560659+0000","last_clean":"2024-09-12T01:29:57.560659+0000","last_became_active":"2024-09-12T00:48:42.290069+0000","last_became_peered":"2024-09-12T00:48:42.290069+0000","last_unstale":"2024-09-12T01:29:57.560659+0000","last_undegraded":"2024-09-12T01:29:57.560659+0000","last_fullsized":"2024-09-12T01:29:57.560659+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:57.560565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:57.560565+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.560565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:21.711185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'22","reported_seq":113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.693045+0000","last_change":"2024-09-12T01:29:50.693045+0000","last_active":"2024-09-12T01:29:50.693045+0000","last_peered":"2024-09-12T01:29:50.693045+0000","last_clean":"2024-09-12T01:29:50.693045+0000","last_became_active":"2024-09-12T00:46:03.917612+0000","last_became_peered":"2024-09-12T00:46:03.917612+0000","last_unstale":"2024-09-12T01:29:50.693045+0000","last_undegraded":"2024-09-12T01:29:50.693045+0000","last_fullsized":"2024-09-12T01:29:50.693045+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'22","last_scrub_stamp":"2024-09-12T01:29:50.692952+0000","last_deep_scrub":"265'22","last_deep_scrub_stamp":"2024-09-12T01:29:50.692952+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.692952+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:44.188500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":67,"num_write":52,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.741960+0000","last_change":"2024-09-12T01:30:00.741887+0000","last_active":"2024-09-12T01:30:00.741960+0000","last_peered":"2024-09-12T01:30:00.741960+0000","last_clean":"2024-09-12T01:30:00.741960+0000","last_became_active":"2024-09-12T01:04:13.470494+0000","last_became_peered":"2024-09-12T01:04:13.470494+0000","last_unstale":"2024-09-12T01:30:00.741960+0000","last_undegraded":"2024-09-12T01:30:00.741960+0000","last_fullsized":"2024-09-12T01:30:00.741960+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:00.741800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:00.741800+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.741800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:45.462724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:07.806091+0000","last_change":"2024-09-12T01:30:07.806091+0000","last_active":"2024-09-12T01:30:07.806091+0000","last_peered":"2024-09-12T01:30:07.806091+0000","last_clean":"2024-09-12T01:30:07.806091+0000","last_became_active":"2024-09-12T00:48:45.317637+0000","last_became_peered":"2024-09-12T00:48:45.317637+0000","last_unstale":"2024-09-12T01:30:07.806091+0000","last_undegraded":"2024-09-12T01:30:07.806091+0000","last_fullsized":"2024-09-12T01:30:07.806091+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:30:07.806011+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:30:07.806011+0000","last_clean_scrub_stamp":"2024-09-12T01:30:07.806011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:47.223253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.593167+0000","last_change":"2024-09-12T01:29:58.593167+0000","last_active":"2024-09-12T01:29:58.593167+0000","last_peered":"2024-09-12T01:29:58.593167+0000","last_clean":"2024-09-12T01:29:58.593167+0000","last_became_active":"2024-09-12T00:48:42.289304+0000","last_became_peered":"2024-09-12T00:48:42.289304+0000","last_unstale":"2024-09-12T01:29:58.593167+0000","last_undegraded":"2024-09-12T01:29:58.593167+0000","last_fullsized":"2024-09-12T01:29:58.593167+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:58.593077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:58.593077+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.593077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:55.655484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.057652+0000","last_change":"2024-09-12T01:29:56.057652+0000","last_active":"2024-09-12T01:29:56.057652+0000","last_peered":"2024-09-12T01:29:56.057652+0000","last_clean":"2024-09-12T01:29:56.057652+0000","last_became_active":"2024-09-12T00:46:03.911316+0000","last_became_peered":"2024-09-12T00:46:03.911316+0000","last_unstale":"2024-09-12T01:29:56.057652+0000","last_undegraded":"2024-09-12T01:29:56.057652+0000","last_fullsized":"2024-09-12T01:29:56.057652+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-12T01:29:56.057564+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-12T01:29:56.057564+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.057564+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:47.597238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":121,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:15.944063+0000","last_change":"2024-09-12T01:30:15.944063+0000","last_active":"2024-09-12T01:30:15.944063+0000","last_peered":"2024-09-12T01:30:15.944063+0000","last_clean":"2024-09-12T01:30:15.944063+0000","last_became_active":"2024-09-12T01:04:13.462150+0000","last_became_peered":"2024-09-12T01:04:13.462150+0000","last_unstale":"2024-09-12T01:30:15.944063+0000","last_undegraded":"2024-09-12T01:30:15.944063+0000","last_fullsized":"2024-09-12T01:30:15.944063+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:15.943974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:15.943974+0000","last_clean_scrub_stamp":"2024-09-12T01:30:15.943974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:30.534837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'3","reported_seq":41,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:15.895194+0000","last_change":"2024-09-12T00:48:45.312564+0000","last_active":"2024-09-12T01:29:15.895194+0000","last_peered":"2024-09-12T01:29:15.895194+0000","last_clean":"2024-09-12T01:29:15.895194+0000","last_became_active":"2024-09-12T00:48:45.312283+0000","last_became_peered":"2024-09-12T00:48:45.312283+0000","last_unstale":"2024-09-12T01:29:15.895194+0000","last_undegraded":"2024-09-12T01:29:15.895194+0000","last_fullsized":"2024-09-12T01:29:15.895194+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:48:44.289609+0000","last_clean_scrub_stamp":"2024-09-12T00:48:44.289609+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'3","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.594842+0000","last_change":"2024-09-12T01:29:55.594732+0000","last_active":"2024-09-12T01:29:55.594842+0000","last_peered":"2024-09-12T01:29:55.594842+0000","last_clean":"2024-09-12T01:29:55.594842+0000","last_became_active":"2024-09-12T00:48:42.290091+0000","last_became_peered":"2024-09-12T00:48:42.290091+0000","last_unstale":"2024-09-12T01:29:55.594842+0000","last_undegraded":"2024-09-12T01:29:55.594842+0000","last_fullsized":"2024-09-12T01:29:55.594842+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:55.594618+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:55.594618+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.594618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:59.132412+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'27","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.071860+0000","last_change":"2024-09-12T01:29:55.071860+0000","last_active":"2024-09-12T01:29:55.071860+0000","last_peered":"2024-09-12T01:29:55.071860+0000","last_clean":"2024-09-12T01:29:55.071860+0000","last_became_active":"2024-09-12T00:46:03.916476+0000","last_became_peered":"2024-09-12T00:46:03.916476+0000","last_unstale":"2024-09-12T01:29:55.071860+0000","last_undegraded":"2024-09-12T01:29:55.071860+0000","last_fullsized":"2024-09-12T01:29:55.071860+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'27","last_scrub_stamp":"2024-09-12T01:29:55.071769+0000","last_deep_scrub":"265'27","last_deep_scrub_stamp":"2024-09-12T01:29:55.071769+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.071769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:22.084538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:03.416334+0000","last_change":"2024-09-12T01:30:03.416334+0000","last_active":"2024-09-12T01:30:03.416334+0000","last_peered":"2024-09-12T01:30:03.416334+0000","last_clean":"2024-09-12T01:30:03.416334+0000","last_became_active":"2024-09-12T01:04:13.467045+0000","last_became_peered":"2024-09-12T01:04:13.467045+0000","last_unstale":"2024-09-12T01:30:03.416334+0000","last_undegraded":"2024-09-12T01:30:03.416334+0000","last_fullsized":"2024-09-12T01:30:03.416334+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:03.416086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:03.416086+0000","last_clean_scrub_stamp":"2024-09-12T01:30:03.416086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:19.180132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'3","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.447329+0000","last_change":"2024-09-12T01:29:57.447329+0000","last_active":"2024-09-12T01:29:57.447329+0000","last_peered":"2024-09-12T01:29:57.447329+0000","last_clean":"2024-09-12T01:29:57.447329+0000","last_became_active":"2024-09-12T00:48:45.309113+0000","last_became_peered":"2024-09-12T00:48:45.309113+0000","last_unstale":"2024-09-12T01:29:57.447329+0000","last_undegraded":"2024-09-12T01:29:57.447329+0000","last_fullsized":"2024-09-12T01:29:57.447329+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:57.447249+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:57.447249+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.447249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:12.036689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'2","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:02.800443+0000","last_change":"2024-09-12T01:30:02.800443+0000","last_active":"2024-09-12T01:30:02.800443+0000","last_peered":"2024-09-12T01:30:02.800443+0000","last_clean":"2024-09-12T01:30:02.800443+0000","last_became_active":"2024-09-12T00:48:42.292733+0000","last_became_peered":"2024-09-12T00:48:42.292733+0000","last_unstale":"2024-09-12T01:30:02.800443+0000","last_undegraded":"2024-09-12T01:30:02.800443+0000","last_fullsized":"2024-09-12T01:30:02.800443+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:02.800362+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:02.800362+0000","last_clean_scrub_stamp":"2024-09-12T01:30:02.800362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:45.396047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"262'8","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.429819+0000","last_change":"2024-09-12T01:29:56.429819+0000","last_active":"2024-09-12T01:29:56.429819+0000","last_peered":"2024-09-12T01:29:56.429819+0000","last_clean":"2024-09-12T01:29:56.429819+0000","last_became_active":"2024-09-12T00:46:03.922008+0000","last_became_peered":"2024-09-12T00:46:03.922008+0000","last_unstale":"2024-09-12T01:29:56.429819+0000","last_undegraded":"2024-09-12T01:29:56.429819+0000","last_fullsized":"2024-09-12T01:29:56.429819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T01:29:56.429729+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T01:29:56.429729+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.429729+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:53.528881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.060743+0000","last_change":"2024-09-12T01:29:55.060743+0000","last_active":"2024-09-12T01:29:55.060743+0000","last_peered":"2024-09-12T01:29:55.060743+0000","last_clean":"2024-09-12T01:29:55.060743+0000","last_became_active":"2024-09-12T01:04:13.467476+0000","last_became_peered":"2024-09-12T01:04:13.467476+0000","last_unstale":"2024-09-12T01:29:55.060743+0000","last_undegraded":"2024-09-12T01:29:55.060743+0000","last_fullsized":"2024-09-12T01:29:55.060743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:55.060652+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:55.060652+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.060652+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:43.496125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"262'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:04.110900+0000","last_change":"2024-09-12T01:30:04.110900+0000","last_active":"2024-09-12T01:30:04.110900+0000","last_peered":"2024-09-12T01:30:04.110900+0000","last_clean":"2024-09-12T01:30:04.110900+0000","last_became_active":"2024-09-12T00:48:45.311541+0000","last_became_peered":"2024-09-12T00:48:45.311541+0000","last_unstale":"2024-09-12T01:30:04.110900+0000","last_undegraded":"2024-09-12T01:30:04.110900+0000","last_fullsized":"2024-09-12T01:30:04.110900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T01:30:04.110810+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T01:30:04.110810+0000","last_clean_scrub_stamp":"2024-09-12T01:30:04.110810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:29.345584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"262'3","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.583331+0000","last_change":"2024-09-12T01:29:56.583265+0000","last_active":"2024-09-12T01:29:56.583331+0000","last_peered":"2024-09-12T01:29:56.583331+0000","last_clean":"2024-09-12T01:29:56.583331+0000","last_became_active":"2024-09-12T00:48:42.281070+0000","last_became_peered":"2024-09-12T00:48:42.281070+0000","last_unstale":"2024-09-12T01:29:56.583331+0000","last_undegraded":"2024-09-12T01:29:56.583331+0000","last_fullsized":"2024-09-12T01:29:56.583331+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:29:56.583176+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:29:56.583176+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.583176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:19.308803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'44","reported_seq":182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.764807+0000","last_change":"2024-09-12T01:30:00.764807+0000","last_active":"2024-09-12T01:30:00.764807+0000","last_peered":"2024-09-12T01:30:00.764807+0000","last_clean":"2024-09-12T01:30:00.764807+0000","last_became_active":"2024-09-12T00:46:03.917626+0000","last_became_peered":"2024-09-12T00:46:03.917626+0000","last_unstale":"2024-09-12T01:30:00.764807+0000","last_undegraded":"2024-09-12T01:30:00.764807+0000","last_fullsized":"2024-09-12T01:30:00.764807+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'44","last_scrub_stamp":"2024-09-12T01:30:00.764720+0000","last_deep_scrub":"265'44","last_deep_scrub_stamp":"2024-09-12T01:30:00.764720+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.764720+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:01.539586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":170,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:10.688964+0000","last_change":"2024-09-12T01:30:10.688964+0000","last_active":"2024-09-12T01:30:10.688964+0000","last_peered":"2024-09-12T01:30:10.688964+0000","last_clean":"2024-09-12T01:30:10.688964+0000","last_became_active":"2024-09-12T01:04:13.463216+0000","last_became_peered":"2024-09-12T01:04:13.463216+0000","last_unstale":"2024-09-12T01:30:10.688964+0000","last_undegraded":"2024-09-12T01:30:10.688964+0000","last_fullsized":"2024-09-12T01:30:10.688964+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:10.688861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:10.688861+0000","last_clean_scrub_stamp":"2024-09-12T01:30:10.688861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:01.817944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.128228+0000","last_change":"2024-09-12T01:29:51.128162+0000","last_active":"2024-09-12T01:29:51.128228+0000","last_peered":"2024-09-12T01:29:51.128228+0000","last_clean":"2024-09-12T01:29:51.128228+0000","last_became_active":"2024-09-12T00:48:45.313386+0000","last_became_peered":"2024-09-12T00:48:45.313386+0000","last_unstale":"2024-09-12T01:29:51.128228+0000","last_undegraded":"2024-09-12T01:29:51.128228+0000","last_fullsized":"2024-09-12T01:29:51.128228+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:51.128069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:51.128069+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.128069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:43.991201+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"262'3","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:16.196403+0000","last_change":"2024-09-12T01:30:16.196403+0000","last_active":"2024-09-12T01:30:16.196403+0000","last_peered":"2024-09-12T01:30:16.196403+0000","last_clean":"2024-09-12T01:30:16.196403+0000","last_became_active":"2024-09-12T00:48:42.293460+0000","last_became_peered":"2024-09-12T00:48:42.293460+0000","last_unstale":"2024-09-12T01:30:16.196403+0000","last_undegraded":"2024-09-12T01:30:16.196403+0000","last_fullsized":"2024-09-12T01:30:16.196403+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:30:16.196305+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:30:16.196305+0000","last_clean_scrub_stamp":"2024-09-12T01:30:16.196305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:54.911550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'27","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.141527+0000","last_change":"2024-09-12T01:29:47.141527+0000","last_active":"2024-09-12T01:29:47.141527+0000","last_peered":"2024-09-12T01:29:47.141527+0000","last_clean":"2024-09-12T01:29:47.141527+0000","last_became_active":"2024-09-12T00:46:03.918921+0000","last_became_peered":"2024-09-12T00:46:03.918921+0000","last_unstale":"2024-09-12T01:29:47.141527+0000","last_undegraded":"2024-09-12T01:29:47.141527+0000","last_fullsized":"2024-09-12T01:29:47.141527+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'27","last_scrub_stamp":"2024-09-12T01:29:47.141429+0000","last_deep_scrub":"265'27","last_deep_scrub_stamp":"2024-09-12T01:29:47.141429+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.141429+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:05.347023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.052832+0000","last_change":"2024-09-12T01:29:54.052832+0000","last_active":"2024-09-12T01:29:54.052832+0000","last_peered":"2024-09-12T01:29:54.052832+0000","last_clean":"2024-09-12T01:29:54.052832+0000","last_became_active":"2024-09-12T01:04:13.466854+0000","last_became_peered":"2024-09-12T01:04:13.466854+0000","last_unstale":"2024-09-12T01:29:54.052832+0000","last_undegraded":"2024-09-12T01:29:54.052832+0000","last_fullsized":"2024-09-12T01:29:54.052832+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:54.052744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:54.052744+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.052744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:59.090715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:08.834666+0000","last_change":"2024-09-12T01:30:08.834666+0000","last_active":"2024-09-12T01:30:08.834666+0000","last_peered":"2024-09-12T01:30:08.834666+0000","last_clean":"2024-09-12T01:30:08.834666+0000","last_became_active":"2024-09-12T00:48:45.315966+0000","last_became_peered":"2024-09-12T00:48:45.315966+0000","last_unstale":"2024-09-12T01:30:08.834666+0000","last_undegraded":"2024-09-12T01:30:08.834666+0000","last_fullsized":"2024-09-12T01:30:08.834666+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:08.834581+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:08.834581+0000","last_clean_scrub_stamp":"2024-09-12T01:30:08.834581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:45.177393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1396,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'3","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:13.262449+0000","last_change":"2024-09-12T01:30:13.262449+0000","last_active":"2024-09-12T01:30:13.262449+0000","last_peered":"2024-09-12T01:30:13.262449+0000","last_clean":"2024-09-12T01:30:13.262449+0000","last_became_active":"2024-09-12T00:48:42.293481+0000","last_became_peered":"2024-09-12T00:48:42.293481+0000","last_unstale":"2024-09-12T01:30:13.262449+0000","last_undegraded":"2024-09-12T01:30:13.262449+0000","last_fullsized":"2024-09-12T01:30:13.262449+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:30:13.262355+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:30:13.262355+0000","last_clean_scrub_stamp":"2024-09-12T01:30:13.262355+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:16.023752+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'25","reported_seq":126,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.550241+0000","last_change":"2024-09-12T01:29:58.550241+0000","last_active":"2024-09-12T01:29:58.550241+0000","last_peered":"2024-09-12T01:29:58.550241+0000","last_clean":"2024-09-12T01:29:58.550241+0000","last_became_active":"2024-09-12T00:46:03.914207+0000","last_became_peered":"2024-09-12T00:46:03.914207+0000","last_unstale":"2024-09-12T01:29:58.550241+0000","last_undegraded":"2024-09-12T01:29:58.550241+0000","last_fullsized":"2024-09-12T01:29:58.550241+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-12T01:29:58.550142+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-12T01:29:58.550142+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.550142+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:12.755829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.078401+0000","last_change":"2024-09-12T01:29:53.078401+0000","last_active":"2024-09-12T01:29:53.078401+0000","last_peered":"2024-09-12T01:29:53.078401+0000","last_clean":"2024-09-12T01:29:53.078401+0000","last_became_active":"2024-09-12T01:04:13.466050+0000","last_became_peered":"2024-09-12T01:04:13.466050+0000","last_unstale":"2024-09-12T01:29:53.078401+0000","last_undegraded":"2024-09-12T01:29:53.078401+0000","last_fullsized":"2024-09-12T01:29:53.078401+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:53.078306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:53.078306+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.078306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:52.505313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:04.786550+0000","last_change":"2024-09-12T01:30:04.786550+0000","last_active":"2024-09-12T01:30:04.786550+0000","last_peered":"2024-09-12T01:30:04.786550+0000","last_clean":"2024-09-12T01:30:04.786550+0000","last_became_active":"2024-09-12T00:48:45.313692+0000","last_became_peered":"2024-09-12T00:48:45.313692+0000","last_unstale":"2024-09-12T01:30:04.786550+0000","last_undegraded":"2024-09-12T01:30:04.786550+0000","last_fullsized":"2024-09-12T01:30:04.786550+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T01:30:04.786462+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T01:30:04.786462+0000","last_clean_scrub_stamp":"2024-09-12T01:30:04.786462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:36.803386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:03.590046+0000","last_change":"2024-09-12T01:30:03.590046+0000","last_active":"2024-09-12T01:30:03.590046+0000","last_peered":"2024-09-12T01:30:03.590046+0000","last_clean":"2024-09-12T01:30:03.590046+0000","last_became_active":"2024-09-12T00:48:42.287949+0000","last_became_peered":"2024-09-12T00:48:42.287949+0000","last_unstale":"2024-09-12T01:30:03.590046+0000","last_undegraded":"2024-09-12T01:30:03.590046+0000","last_fullsized":"2024-09-12T01:30:03.590046+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:03.589922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:03.589922+0000","last_clean_scrub_stamp":"2024-09-12T01:30:03.589922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:47.382636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'53","reported_seq":203,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:09.251713+0000","last_change":"2024-09-12T01:30:09.251713+0000","last_active":"2024-09-12T01:30:09.251713+0000","last_peered":"2024-09-12T01:30:09.251713+0000","last_clean":"2024-09-12T01:30:09.251713+0000","last_became_active":"2024-09-12T00:46:03.917728+0000","last_became_peered":"2024-09-12T00:46:03.917728+0000","last_unstale":"2024-09-12T01:30:09.251713+0000","last_undegraded":"2024-09-12T01:30:09.251713+0000","last_fullsized":"2024-09-12T01:30:09.251713+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'53","last_scrub_stamp":"2024-09-12T01:30:09.251628+0000","last_deep_scrub":"265'53","last_deep_scrub_stamp":"2024-09-12T01:30:09.251628+0000","last_clean_scrub_stamp":"2024-09-12T01:30:09.251628+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:32.091991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":191,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:13.859483+0000","last_change":"2024-09-12T01:30:13.859408+0000","last_active":"2024-09-12T01:30:13.859483+0000","last_peered":"2024-09-12T01:30:13.859483+0000","last_clean":"2024-09-12T01:30:13.859483+0000","last_became_active":"2024-09-12T01:04:13.466183+0000","last_became_peered":"2024-09-12T01:04:13.466183+0000","last_unstale":"2024-09-12T01:30:13.859483+0000","last_undegraded":"2024-09-12T01:30:13.859483+0000","last_fullsized":"2024-09-12T01:30:13.859483+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:13.859319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:13.859319+0000","last_clean_scrub_stamp":"2024-09-12T01:30:13.859319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:08.978658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.095583+0000","last_change":"2024-09-12T01:29:50.095522+0000","last_active":"2024-09-12T01:29:50.095583+0000","last_peered":"2024-09-12T01:29:50.095583+0000","last_clean":"2024-09-12T01:29:50.095583+0000","last_became_active":"2024-09-12T00:48:45.311453+0000","last_became_peered":"2024-09-12T00:48:45.311453+0000","last_unstale":"2024-09-12T01:29:50.095583+0000","last_undegraded":"2024-09-12T01:29:50.095583+0000","last_fullsized":"2024-09-12T01:29:50.095583+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:50.095438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:50.095438+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.095438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:30.612733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'2","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.451839+0000","last_change":"2024-09-12T01:29:54.451773+0000","last_active":"2024-09-12T01:29:54.451839+0000","last_peered":"2024-09-12T01:29:54.451839+0000","last_clean":"2024-09-12T01:29:54.451839+0000","last_became_active":"2024-09-12T00:48:42.295358+0000","last_became_peered":"2024-09-12T00:48:42.295358+0000","last_unstale":"2024-09-12T01:29:54.451839+0000","last_undegraded":"2024-09-12T01:29:54.451839+0000","last_fullsized":"2024-09-12T01:29:54.451839+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:54.451686+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:54.451686+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.451686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:14.057355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'81","reported_seq":287,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.477840+0000","last_change":"2024-09-12T01:29:51.477737+0000","last_active":"2024-09-12T01:29:51.477840+0000","last_peered":"2024-09-12T01:29:51.477840+0000","last_clean":"2024-09-12T01:29:51.477840+0000","last_became_active":"2024-09-12T00:46:03.916021+0000","last_became_peered":"2024-09-12T00:46:03.916021+0000","last_unstale":"2024-09-12T01:29:51.477840+0000","last_undegraded":"2024-09-12T01:29:51.477840+0000","last_fullsized":"2024-09-12T01:29:51.477840+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'81","last_scrub_stamp":"2024-09-12T01:29:51.477634+0000","last_deep_scrub":"265'81","last_deep_scrub_stamp":"2024-09-12T01:29:51.477634+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.477634+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:25.082743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":326,"num_write":133,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.731804+0000","last_change":"2024-09-12T01:04:13.466014+0000","last_active":"2024-09-12T01:27:09.731804+0000","last_peered":"2024-09-12T01:27:09.731804+0000","last_clean":"2024-09-12T01:27:09.731804+0000","last_became_active":"2024-09-12T01:04:13.465478+0000","last_became_peered":"2024-09-12T01:04:13.465478+0000","last_unstale":"2024-09-12T01:27:09.731804+0000","last_undegraded":"2024-09-12T01:27:09.731804+0000","last_fullsized":"2024-09-12T01:27:09.731804+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:45.735147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:18.213329+0000","last_change":"2024-09-12T01:30:18.213329+0000","last_active":"2024-09-12T01:30:18.213329+0000","last_peered":"2024-09-12T01:30:18.213329+0000","last_clean":"2024-09-12T01:30:18.213329+0000","last_became_active":"2024-09-12T00:48:45.313057+0000","last_became_peered":"2024-09-12T00:48:45.313057+0000","last_unstale":"2024-09-12T01:30:18.213329+0000","last_undegraded":"2024-09-12T01:30:18.213329+0000","last_fullsized":"2024-09-12T01:30:18.213329+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:18.213237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:18.213237+0000","last_clean_scrub_stamp":"2024-09-12T01:30:18.213237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:27.987977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:15.230835+0000","last_change":"2024-09-12T01:30:15.230835+0000","last_active":"2024-09-12T01:30:15.230835+0000","last_peered":"2024-09-12T01:30:15.230835+0000","last_clean":"2024-09-12T01:30:15.230835+0000","last_became_active":"2024-09-12T00:48:42.296903+0000","last_became_peered":"2024-09-12T00:48:42.296903+0000","last_unstale":"2024-09-12T01:30:15.230835+0000","last_undegraded":"2024-09-12T01:30:15.230835+0000","last_fullsized":"2024-09-12T01:30:15.230835+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:30:15.230724+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:30:15.230724+0000","last_clean_scrub_stamp":"2024-09-12T01:30:15.230724+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:28.541984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'59","reported_seq":254,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.615200+0000","last_change":"2024-09-12T01:29:49.615128+0000","last_active":"2024-09-12T01:29:49.615200+0000","last_peered":"2024-09-12T01:29:49.615200+0000","last_clean":"2024-09-12T01:29:49.615200+0000","last_became_active":"2024-09-12T00:46:03.917131+0000","last_became_peered":"2024-09-12T00:46:03.917131+0000","last_unstale":"2024-09-12T01:29:49.615200+0000","last_undegraded":"2024-09-12T01:29:49.615200+0000","last_fullsized":"2024-09-12T01:29:49.615200+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'59","last_scrub_stamp":"2024-09-12T01:29:49.615033+0000","last_deep_scrub":"265'59","last_deep_scrub_stamp":"2024-09-12T01:29:49.615033+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.615033+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:41.631102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":270,"num_write":80,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":6,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:09.665987+0000","last_change":"2024-09-12T01:30:09.665923+0000","last_active":"2024-09-12T01:30:09.665987+0000","last_peered":"2024-09-12T01:30:09.665987+0000","last_clean":"2024-09-12T01:30:09.665987+0000","last_became_active":"2024-09-12T01:04:13.468116+0000","last_became_peered":"2024-09-12T01:04:13.468116+0000","last_unstale":"2024-09-12T01:30:09.665987+0000","last_undegraded":"2024-09-12T01:30:09.665987+0000","last_fullsized":"2024-09-12T01:30:09.665987+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:09.665826+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:09.665826+0000","last_clean_scrub_stamp":"2024-09-12T01:30:09.665826+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:17.580028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'5","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:04.621370+0000","last_change":"2024-09-12T01:30:04.621370+0000","last_active":"2024-09-12T01:30:04.621370+0000","last_peered":"2024-09-12T01:30:04.621370+0000","last_clean":"2024-09-12T01:30:04.621370+0000","last_became_active":"2024-09-12T00:48:45.316713+0000","last_became_peered":"2024-09-12T00:48:45.316713+0000","last_unstale":"2024-09-12T01:30:04.621370+0000","last_undegraded":"2024-09-12T01:30:04.621370+0000","last_fullsized":"2024-09-12T01:30:04.621370+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:30:04.621296+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:30:04.621296+0000","last_clean_scrub_stamp":"2024-09-12T01:30:04.621296+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:45.131413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2096,"num_write":10,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.456658+0000","last_change":"2024-09-12T01:29:53.456658+0000","last_active":"2024-09-12T01:29:53.456658+0000","last_peered":"2024-09-12T01:29:53.456658+0000","last_clean":"2024-09-12T01:29:53.456658+0000","last_became_active":"2024-09-12T00:48:42.293111+0000","last_became_peered":"2024-09-12T00:48:42.293111+0000","last_unstale":"2024-09-12T01:29:53.456658+0000","last_undegraded":"2024-09-12T01:29:53.456658+0000","last_fullsized":"2024-09-12T01:29:53.456658+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:53.456571+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:53.456571+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.456571+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:44.113416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'34","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.444517+0000","last_change":"2024-09-12T01:29:50.444517+0000","last_active":"2024-09-12T01:29:50.444517+0000","last_peered":"2024-09-12T01:29:50.444517+0000","last_clean":"2024-09-12T01:29:50.444517+0000","last_became_active":"2024-09-12T00:46:03.914387+0000","last_became_peered":"2024-09-12T00:46:03.914387+0000","last_unstale":"2024-09-12T01:29:50.444517+0000","last_undegraded":"2024-09-12T01:29:50.444517+0000","last_fullsized":"2024-09-12T01:29:50.444517+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'34","last_scrub_stamp":"2024-09-12T01:29:50.444421+0000","last_deep_scrub":"265'34","last_deep_scrub_stamp":"2024-09-12T01:29:50.444421+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.444421+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:00.463389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:05.638567+0000","last_change":"2024-09-12T01:30:05.638487+0000","last_active":"2024-09-12T01:30:05.638567+0000","last_peered":"2024-09-12T01:30:05.638567+0000","last_clean":"2024-09-12T01:30:05.638567+0000","last_became_active":"2024-09-12T01:04:13.470597+0000","last_became_peered":"2024-09-12T01:04:13.470597+0000","last_unstale":"2024-09-12T01:30:05.638567+0000","last_undegraded":"2024-09-12T01:30:05.638567+0000","last_fullsized":"2024-09-12T01:30:05.638567+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:05.638397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:05.638397+0000","last_clean_scrub_stamp":"2024-09-12T01:30:05.638397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:13.394876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"262'5","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:17.224292+0000","last_change":"2024-09-12T01:30:17.224292+0000","last_active":"2024-09-12T01:30:17.224292+0000","last_peered":"2024-09-12T01:30:17.224292+0000","last_clean":"2024-09-12T01:30:17.224292+0000","last_became_active":"2024-09-12T00:48:45.316182+0000","last_became_peered":"2024-09-12T00:48:45.316182+0000","last_unstale":"2024-09-12T01:30:17.224292+0000","last_undegraded":"2024-09-12T01:30:17.224292+0000","last_fullsized":"2024-09-12T01:30:17.224292+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:30:17.224183+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:30:17.224183+0000","last_clean_scrub_stamp":"2024-09-12T01:30:17.224183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:54.994118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:19.202612+0000","last_change":"2024-09-12T01:30:19.202612+0000","last_active":"2024-09-12T01:30:19.202612+0000","last_peered":"2024-09-12T01:30:19.202612+0000","last_clean":"2024-09-12T01:30:19.202612+0000","last_became_active":"2024-09-12T00:48:42.293947+0000","last_became_peered":"2024-09-12T00:48:42.293947+0000","last_unstale":"2024-09-12T01:30:19.202612+0000","last_undegraded":"2024-09-12T01:30:19.202612+0000","last_fullsized":"2024-09-12T01:30:19.202612+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:30:19.202519+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:30:19.202519+0000","last_clean_scrub_stamp":"2024-09-12T01:30:19.202519+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:14.901068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'54","reported_seq":203,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:08.262042+0000","last_change":"2024-09-12T01:30:08.262042+0000","last_active":"2024-09-12T01:30:08.262042+0000","last_peered":"2024-09-12T01:30:08.262042+0000","last_clean":"2024-09-12T01:30:08.262042+0000","last_became_active":"2024-09-12T00:46:03.919285+0000","last_became_peered":"2024-09-12T00:46:03.919285+0000","last_unstale":"2024-09-12T01:30:08.262042+0000","last_undegraded":"2024-09-12T01:30:08.262042+0000","last_fullsized":"2024-09-12T01:30:08.262042+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'54","last_scrub_stamp":"2024-09-12T01:30:08.261952+0000","last_deep_scrub":"265'54","last_deep_scrub_stamp":"2024-09-12T01:30:08.261952+0000","last_clean_scrub_stamp":"2024-09-12T01:30:08.261952+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:30.741486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":102,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:14.899096+0000","last_change":"2024-09-12T01:30:14.899096+0000","last_active":"2024-09-12T01:30:14.899096+0000","last_peered":"2024-09-12T01:30:14.899096+0000","last_clean":"2024-09-12T01:30:14.899096+0000","last_became_active":"2024-09-12T01:04:13.467374+0000","last_became_peered":"2024-09-12T01:04:13.467374+0000","last_unstale":"2024-09-12T01:30:14.899096+0000","last_undegraded":"2024-09-12T01:30:14.899096+0000","last_fullsized":"2024-09-12T01:30:14.899096+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:14.898992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:14.898992+0000","last_clean_scrub_stamp":"2024-09-12T01:30:14.898992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:59.749326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.433664+0000","last_change":"2024-09-12T01:30:00.433664+0000","last_active":"2024-09-12T01:30:00.433664+0000","last_peered":"2024-09-12T01:30:00.433664+0000","last_clean":"2024-09-12T01:30:00.433664+0000","last_became_active":"2024-09-12T00:48:45.310423+0000","last_became_peered":"2024-09-12T00:48:45.310423+0000","last_unstale":"2024-09-12T01:30:00.433664+0000","last_undegraded":"2024-09-12T01:30:00.433664+0000","last_fullsized":"2024-09-12T01:30:00.433664+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:00.433576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:00.433576+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.433576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:15.315075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:01.081456+0000","last_change":"2024-09-12T01:30:01.081456+0000","last_active":"2024-09-12T01:30:01.081456+0000","last_peered":"2024-09-12T01:30:01.081456+0000","last_clean":"2024-09-12T01:30:01.081456+0000","last_became_active":"2024-09-12T00:48:42.295861+0000","last_became_peered":"2024-09-12T00:48:42.295861+0000","last_unstale":"2024-09-12T01:30:01.081456+0000","last_undegraded":"2024-09-12T01:30:01.081456+0000","last_fullsized":"2024-09-12T01:30:01.081456+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:01.081358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:01.081358+0000","last_clean_scrub_stamp":"2024-09-12T01:30:01.081358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:33.671551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:07.288505+0000","last_change":"2024-09-12T01:30:07.288505+0000","last_active":"2024-09-12T01:30:07.288505+0000","last_peered":"2024-09-12T01:30:07.288505+0000","last_clean":"2024-09-12T01:30:07.288505+0000","last_became_active":"2024-09-12T00:46:03.917353+0000","last_became_peered":"2024-09-12T00:46:03.917353+0000","last_unstale":"2024-09-12T01:30:07.288505+0000","last_undegraded":"2024-09-12T01:30:07.288505+0000","last_fullsized":"2024-09-12T01:30:07.288505+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'44","last_scrub_stamp":"2024-09-12T01:30:07.288412+0000","last_deep_scrub":"265'44","last_deep_scrub_stamp":"2024-09-12T01:30:07.288412+0000","last_clean_scrub_stamp":"2024-09-12T01:30:07.288412+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:11.383341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":151,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":25,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:27:09.731874+0000","last_change":"2024-09-12T01:04:13.467110+0000","last_active":"2024-09-12T01:27:09.731874+0000","last_peered":"2024-09-12T01:27:09.731874+0000","last_clean":"2024-09-12T01:27:09.731874+0000","last_became_active":"2024-09-12T01:04:13.466783+0000","last_became_peered":"2024-09-12T01:04:13.466783+0000","last_unstale":"2024-09-12T01:27:09.731874+0000","last_undegraded":"2024-09-12T01:27:09.731874+0000","last_fullsized":"2024-09-12T01:27:09.731874+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:04:12.444243+0000","last_clean_scrub_stamp":"2024-09-12T01:04:12.444243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:53.321999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'3","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:01.426223+0000","last_change":"2024-09-12T01:30:01.426223+0000","last_active":"2024-09-12T01:30:01.426223+0000","last_peered":"2024-09-12T01:30:01.426223+0000","last_clean":"2024-09-12T01:30:01.426223+0000","last_became_active":"2024-09-12T00:48:45.312329+0000","last_became_peered":"2024-09-12T00:48:45.312329+0000","last_unstale":"2024-09-12T01:30:01.426223+0000","last_undegraded":"2024-09-12T01:30:01.426223+0000","last_fullsized":"2024-09-12T01:30:01.426223+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:30:01.426124+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:30:01.426124+0000","last_clean_scrub_stamp":"2024-09-12T01:30:01.426124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:21.056475+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'2","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.696233+0000","last_change":"2024-09-12T01:29:51.696233+0000","last_active":"2024-09-12T01:29:51.696233+0000","last_peered":"2024-09-12T01:29:51.696233+0000","last_clean":"2024-09-12T01:29:51.696233+0000","last_became_active":"2024-09-12T00:48:42.286427+0000","last_became_peered":"2024-09-12T00:48:42.286427+0000","last_unstale":"2024-09-12T01:29:51.696233+0000","last_undegraded":"2024-09-12T01:29:51.696233+0000","last_fullsized":"2024-09-12T01:29:51.696233+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:51.696120+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:51.696120+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.696120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:25.677211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'46","reported_seq":184,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.404374+0000","last_change":"2024-09-12T01:29:49.404321+0000","last_active":"2024-09-12T01:29:49.404374+0000","last_peered":"2024-09-12T01:29:49.404374+0000","last_clean":"2024-09-12T01:29:49.404374+0000","last_became_active":"2024-09-12T00:46:03.919259+0000","last_became_peered":"2024-09-12T00:46:03.919259+0000","last_unstale":"2024-09-12T01:29:49.404374+0000","last_undegraded":"2024-09-12T01:29:49.404374+0000","last_fullsized":"2024-09-12T01:29:49.404374+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'46","last_scrub_stamp":"2024-09-12T01:29:49.404234+0000","last_deep_scrub":"265'46","last_deep_scrub_stamp":"2024-09-12T01:29:49.404234+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.404234+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:07.003544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":85,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'380","reported_seq":1135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.020342+0000","last_change":"2024-09-12T01:29:28.020280+0000","last_active":"2024-09-12T01:29:28.020342+0000","last_peered":"2024-09-12T01:29:28.020342+0000","last_clean":"2024-09-12T01:29:28.020342+0000","last_became_active":"2024-09-12T00:31:47.137895+0000","last_became_peered":"2024-09-12T00:31:47.137895+0000","last_unstale":"2024-09-12T01:29:28.020342+0000","last_undegraded":"2024-09-12T01:29:28.020342+0000","last_fullsized":"2024-09-12T01:29:28.020342+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-12T01:29:28.020146+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-12T01:29:28.020146+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.020146+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:56.555166+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":750,"num_read_kb":31522,"num_write":1285,"num_write_kb":24718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'194","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.479650+0000","last_change":"2024-09-12T01:29:36.479650+0000","last_active":"2024-09-12T01:29:36.479650+0000","last_peered":"2024-09-12T01:29:36.479650+0000","last_clean":"2024-09-12T01:29:36.479650+0000","last_became_active":"2024-09-12T00:31:50.138226+0000","last_became_peered":"2024-09-12T00:31:50.138226+0000","last_unstale":"2024-09-12T01:29:36.479650+0000","last_undegraded":"2024-09-12T01:29:36.479650+0000","last_fullsized":"2024-09-12T01:29:36.479650+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'194","last_scrub_stamp":"2024-09-12T01:29:36.479554+0000","last_deep_scrub":"265'194","last_deep_scrub_stamp":"2024-09-12T01:29:36.479554+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.479554+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:41.039566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":913,"num_read_kb":766,"num_write":296,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'314","reported_seq":950,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.867814+0000","last_change":"2024-09-12T01:29:35.867707+0000","last_active":"2024-09-12T01:29:35.867814+0000","last_peered":"2024-09-12T01:29:35.867814+0000","last_clean":"2024-09-12T01:29:35.867814+0000","last_became_active":"2024-09-12T00:31:47.134134+0000","last_became_peered":"2024-09-12T00:31:47.134134+0000","last_unstale":"2024-09-12T01:29:35.867814+0000","last_undegraded":"2024-09-12T01:29:35.867814+0000","last_fullsized":"2024-09-12T01:29:35.867814+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-12T01:29:35.867548+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-12T01:29:35.867548+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.867548+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:04.584926+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":463,"num_read_kb":16965,"num_write":1018,"num_write_kb":26995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'110","reported_seq":713,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.181613+0000","last_change":"2024-09-12T01:29:43.181613+0000","last_active":"2024-09-12T01:29:43.181613+0000","last_peered":"2024-09-12T01:29:43.181613+0000","last_clean":"2024-09-12T01:29:43.181613+0000","last_became_active":"2024-09-12T00:31:50.132639+0000","last_became_peered":"2024-09-12T00:31:50.132639+0000","last_unstale":"2024-09-12T01:29:43.181613+0000","last_undegraded":"2024-09-12T01:29:43.181613+0000","last_fullsized":"2024-09-12T01:29:43.181613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T01:29:43.181524+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T01:29:43.181524+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.181524+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:50.689163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":165,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'368","reported_seq":1116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.955742+0000","last_change":"2024-09-12T01:29:32.955684+0000","last_active":"2024-09-12T01:29:32.955742+0000","last_peered":"2024-09-12T01:29:32.955742+0000","last_clean":"2024-09-12T01:29:32.955742+0000","last_became_active":"2024-09-12T00:31:47.119865+0000","last_became_peered":"2024-09-12T00:31:47.119865+0000","last_unstale":"2024-09-12T01:29:32.955742+0000","last_undegraded":"2024-09-12T01:29:32.955742+0000","last_fullsized":"2024-09-12T01:29:32.955742+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T01:29:32.955566+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T01:29:32.955566+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.955566+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:34.193090+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344922,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":840,"num_read_kb":4429,"num_write":1181,"num_write_kb":10543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'286","reported_seq":944,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.192741+0000","last_change":"2024-09-12T01:29:44.192741+0000","last_active":"2024-09-12T01:29:44.192741+0000","last_peered":"2024-09-12T01:29:44.192741+0000","last_clean":"2024-09-12T01:29:44.192741+0000","last_became_active":"2024-09-12T00:31:50.135413+0000","last_became_peered":"2024-09-12T00:31:50.135413+0000","last_unstale":"2024-09-12T01:29:44.192741+0000","last_undegraded":"2024-09-12T01:29:44.192741+0000","last_fullsized":"2024-09-12T01:29:44.192741+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'286","last_scrub_stamp":"2024-09-12T01:29:44.192668+0000","last_deep_scrub":"265'286","last_deep_scrub_stamp":"2024-09-12T01:29:44.192668+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.192668+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:39.104901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1012,"num_write":455,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'315","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.404726+0000","last_change":"2024-09-12T01:29:27.404656+0000","last_active":"2024-09-12T01:29:27.404726+0000","last_peered":"2024-09-12T01:29:27.404726+0000","last_clean":"2024-09-12T01:29:27.404726+0000","last_became_active":"2024-09-12T00:31:47.133414+0000","last_became_peered":"2024-09-12T00:31:47.133414+0000","last_unstale":"2024-09-12T01:29:27.404726+0000","last_undegraded":"2024-09-12T01:29:27.404726+0000","last_fullsized":"2024-09-12T01:29:27.404726+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'315","last_scrub_stamp":"2024-09-12T01:29:27.404449+0000","last_deep_scrub":"265'315","last_deep_scrub_stamp":"2024-09-12T01:29:27.404449+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.404449+0000","objects_scrubbed":11,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:30.134243+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11933654,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":465,"num_read_kb":32236,"num_write":1054,"num_write_kb":37937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'183","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.543227+0000","last_change":"2024-09-12T01:29:35.543227+0000","last_active":"2024-09-12T01:29:35.543227+0000","last_peered":"2024-09-12T01:29:35.543227+0000","last_clean":"2024-09-12T01:29:35.543227+0000","last_became_active":"2024-09-12T00:31:50.135322+0000","last_became_peered":"2024-09-12T00:31:50.135322+0000","last_unstale":"2024-09-12T01:29:35.543227+0000","last_undegraded":"2024-09-12T01:29:35.543227+0000","last_fullsized":"2024-09-12T01:29:35.543227+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'183","last_scrub_stamp":"2024-09-12T01:29:35.543144+0000","last_deep_scrub":"265'183","last_deep_scrub_stamp":"2024-09-12T01:29:35.543144+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.543144+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:36.766989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":591,"num_write":296,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'319","reported_seq":951,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.045050+0000","last_change":"2024-09-12T01:29:29.045050+0000","last_active":"2024-09-12T01:29:29.045050+0000","last_peered":"2024-09-12T01:29:29.045050+0000","last_clean":"2024-09-12T01:29:29.045050+0000","last_became_active":"2024-09-12T00:31:47.128016+0000","last_became_peered":"2024-09-12T00:31:47.128016+0000","last_unstale":"2024-09-12T01:29:29.045050+0000","last_undegraded":"2024-09-12T01:29:29.045050+0000","last_fullsized":"2024-09-12T01:29:29.045050+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T01:29:29.044943+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T01:29:29.044943+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.044943+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:09.317724+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":458,"num_read_kb":35042,"num_write":1048,"num_write_kb":20184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'220","reported_seq":848,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.168640+0000","last_change":"2024-09-12T01:29:36.168558+0000","last_active":"2024-09-12T01:29:36.168640+0000","last_peered":"2024-09-12T01:29:36.168640+0000","last_clean":"2024-09-12T01:29:36.168640+0000","last_became_active":"2024-09-12T00:31:50.132674+0000","last_became_peered":"2024-09-12T00:31:50.132674+0000","last_unstale":"2024-09-12T01:29:36.168640+0000","last_undegraded":"2024-09-12T01:29:36.168640+0000","last_fullsized":"2024-09-12T01:29:36.168640+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'220","last_scrub_stamp":"2024-09-12T01:29:36.168468+0000","last_deep_scrub":"265'220","last_deep_scrub_stamp":"2024-09-12T01:29:36.168468+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.168468+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:46.453708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":967,"num_read_kb":781,"num_write":356,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'365","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.391195+0000","last_change":"2024-09-12T01:29:24.391195+0000","last_active":"2024-09-12T01:29:24.391195+0000","last_peered":"2024-09-12T01:29:24.391195+0000","last_clean":"2024-09-12T01:29:24.391195+0000","last_became_active":"2024-09-12T00:31:47.134887+0000","last_became_peered":"2024-09-12T00:31:47.134887+0000","last_unstale":"2024-09-12T01:29:24.391195+0000","last_undegraded":"2024-09-12T01:29:24.391195+0000","last_fullsized":"2024-09-12T01:29:24.391195+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:29:24.391061+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:29:24.391061+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.391061+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.168982+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396853,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":509,"num_read_kb":3274,"num_write":1223,"num_write_kb":38824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'275","reported_seq":859,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.146653+0000","last_change":"2024-09-12T01:29:34.146593+0000","last_active":"2024-09-12T01:29:34.146653+0000","last_peered":"2024-09-12T01:29:34.146653+0000","last_clean":"2024-09-12T01:29:34.146653+0000","last_became_active":"2024-09-12T00:31:50.140087+0000","last_became_peered":"2024-09-12T00:31:50.140087+0000","last_unstale":"2024-09-12T01:29:34.146653+0000","last_undegraded":"2024-09-12T01:29:34.146653+0000","last_fullsized":"2024-09-12T01:29:34.146653+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'275","last_scrub_stamp":"2024-09-12T01:29:34.146509+0000","last_deep_scrub":"265'275","last_deep_scrub_stamp":"2024-09-12T01:29:34.146509+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.146509+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:19.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1141,"num_read_kb":956,"num_write":415,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'392","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.099075+0000","last_change":"2024-09-12T01:29:37.099016+0000","last_active":"2024-09-12T01:29:37.099075+0000","last_peered":"2024-09-12T01:29:37.099075+0000","last_clean":"2024-09-12T01:29:37.099075+0000","last_became_active":"2024-09-12T00:32:23.830676+0000","last_became_peered":"2024-09-12T00:32:23.830676+0000","last_unstale":"2024-09-12T01:29:37.099075+0000","last_undegraded":"2024-09-12T01:29:37.099075+0000","last_fullsized":"2024-09-12T01:29:37.099075+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'392","last_scrub_stamp":"2024-09-12T01:29:37.098873+0000","last_deep_scrub":"265'392","last_deep_scrub_stamp":"2024-09-12T01:29:37.098873+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.098873+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:30.205825+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170251,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":5774,"num_write":1256,"num_write_kb":23845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3e","version":"265'51","reported_seq":599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.403940+0000","last_change":"2024-09-12T01:29:32.403863+0000","last_active":"2024-09-12T01:29:32.403940+0000","last_peered":"2024-09-12T01:29:32.403940+0000","last_clean":"2024-09-12T01:29:32.403940+0000","last_became_active":"2024-09-12T00:31:50.140207+0000","last_became_peered":"2024-09-12T00:31:50.140207+0000","last_unstale":"2024-09-12T01:29:32.403940+0000","last_undegraded":"2024-09-12T01:29:32.403940+0000","last_fullsized":"2024-09-12T01:29:32.403940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'51","last_scrub_stamp":"2024-09-12T01:29:32.403772+0000","last_deep_scrub":"265'51","last_deep_scrub_stamp":"2024-09-12T01:29:32.403772+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.403772+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:53.477543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":145,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'386","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.878927+0000","last_change":"2024-09-12T01:29:30.878927+0000","last_active":"2024-09-12T01:29:30.878927+0000","last_peered":"2024-09-12T01:29:30.878927+0000","last_clean":"2024-09-12T01:29:30.878927+0000","last_became_active":"2024-09-12T00:31:47.127930+0000","last_became_peered":"2024-09-12T00:31:47.127930+0000","last_unstale":"2024-09-12T01:29:30.878927+0000","last_undegraded":"2024-09-12T01:29:30.878927+0000","last_fullsized":"2024-09-12T01:29:30.878927+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T01:29:30.878794+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T01:29:30.878794+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.878794+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:54.052551+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396864,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":638,"num_read_kb":6946,"num_write":1462,"num_write_kb":29009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'96","reported_seq":697,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.748479+0000","last_change":"2024-09-12T01:29:45.748418+0000","last_active":"2024-09-12T01:29:45.748479+0000","last_peered":"2024-09-12T01:29:45.748479+0000","last_clean":"2024-09-12T01:29:45.748479+0000","last_became_active":"2024-09-12T00:31:50.142071+0000","last_became_peered":"2024-09-12T00:31:50.142071+0000","last_unstale":"2024-09-12T01:29:45.748479+0000","last_undegraded":"2024-09-12T01:29:45.748479+0000","last_fullsized":"2024-09-12T01:29:45.748479+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T01:29:45.748330+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T01:29:45.748330+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.748330+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:43.499736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":364,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'86","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.140580+0000","last_change":"2024-09-12T01:29:42.140496+0000","last_active":"2024-09-12T01:29:42.140580+0000","last_peered":"2024-09-12T01:29:42.140580+0000","last_clean":"2024-09-12T01:29:42.140580+0000","last_became_active":"2024-09-12T00:31:50.132178+0000","last_became_peered":"2024-09-12T00:31:50.132178+0000","last_unstale":"2024-09-12T01:29:42.140580+0000","last_undegraded":"2024-09-12T01:29:42.140580+0000","last_fullsized":"2024-09-12T01:29:42.140580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'86","last_scrub_stamp":"2024-09-12T01:29:42.140402+0000","last_deep_scrub":"265'86","last_deep_scrub_stamp":"2024-09-12T01:29:42.140402+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.140402+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:41.914291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":346,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'333","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.353401+0000","last_change":"2024-09-12T01:29:24.353300+0000","last_active":"2024-09-12T01:29:24.353401+0000","last_peered":"2024-09-12T01:29:24.353401+0000","last_clean":"2024-09-12T01:29:24.353401+0000","last_became_active":"2024-09-12T00:31:47.123956+0000","last_became_peered":"2024-09-12T00:31:47.123956+0000","last_unstale":"2024-09-12T01:29:24.353401+0000","last_undegraded":"2024-09-12T01:29:24.353401+0000","last_fullsized":"2024-09-12T01:29:24.353401+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T01:29:24.353156+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T01:29:24.353156+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.353156+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:57.167462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525329,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":483,"num_read_kb":32458,"num_write":1127,"num_write_kb":22794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'162","reported_seq":817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.099001+0000","last_change":"2024-09-12T01:29:32.098935+0000","last_active":"2024-09-12T01:29:32.099001+0000","last_peered":"2024-09-12T01:29:32.099001+0000","last_clean":"2024-09-12T01:29:32.099001+0000","last_became_active":"2024-09-12T00:31:50.130844+0000","last_became_peered":"2024-09-12T00:31:50.130844+0000","last_unstale":"2024-09-12T01:29:32.099001+0000","last_undegraded":"2024-09-12T01:29:32.099001+0000","last_fullsized":"2024-09-12T01:29:32.099001+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-12T01:29:32.098837+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-12T01:29:32.098837+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.098837+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:49.537667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":634,"num_write":246,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'260","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.982245+0000","last_change":"2024-09-12T01:29:26.982139+0000","last_active":"2024-09-12T01:29:26.982245+0000","last_peered":"2024-09-12T01:29:26.982245+0000","last_clean":"2024-09-12T01:29:26.982245+0000","last_became_active":"2024-09-12T00:31:47.127400+0000","last_became_peered":"2024-09-12T00:31:47.127400+0000","last_unstale":"2024-09-12T01:29:26.982245+0000","last_undegraded":"2024-09-12T01:29:26.982245+0000","last_fullsized":"2024-09-12T01:29:26.982245+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-12T01:29:26.981947+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-12T01:29:26.981947+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.981947+0000","objects_scrubbed":7,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:05.911480+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133724,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":320,"num_read_kb":20510,"num_write":796,"num_write_kb":47522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'404","reported_seq":1179,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.443400+0000","last_change":"2024-09-12T01:29:30.443336+0000","last_active":"2024-09-12T01:29:30.443400+0000","last_peered":"2024-09-12T01:29:30.443400+0000","last_clean":"2024-09-12T01:29:30.443400+0000","last_became_active":"2024-09-12T00:31:50.142337+0000","last_became_peered":"2024-09-12T00:31:50.142337+0000","last_unstale":"2024-09-12T01:29:30.443400+0000","last_undegraded":"2024-09-12T01:29:30.443400+0000","last_fullsized":"2024-09-12T01:29:30.443400+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'404","last_scrub_stamp":"2024-09-12T01:29:30.443248+0000","last_deep_scrub":"265'404","last_deep_scrub_stamp":"2024-09-12T01:29:30.443248+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.443248+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:45.435463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1845,"num_write":683,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'316","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.956034+0000","last_change":"2024-09-12T01:29:25.955954+0000","last_active":"2024-09-12T01:29:25.956034+0000","last_peered":"2024-09-12T01:29:25.956034+0000","last_clean":"2024-09-12T01:29:25.956034+0000","last_became_active":"2024-09-12T00:31:47.139517+0000","last_became_peered":"2024-09-12T00:31:47.139517+0000","last_unstale":"2024-09-12T01:29:25.956034+0000","last_undegraded":"2024-09-12T01:29:25.956034+0000","last_fullsized":"2024-09-12T01:29:25.956034+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T01:29:25.955816+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T01:29:25.955816+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.955816+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:56.138848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788540,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":6586,"num_write":1090,"num_write_kb":25928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'147","reported_seq":735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.097542+0000","last_change":"2024-09-12T01:29:39.097461+0000","last_active":"2024-09-12T01:29:39.097542+0000","last_peered":"2024-09-12T01:29:39.097542+0000","last_clean":"2024-09-12T01:29:39.097542+0000","last_became_active":"2024-09-12T00:31:50.142311+0000","last_became_peered":"2024-09-12T00:31:50.142311+0000","last_unstale":"2024-09-12T01:29:39.097542+0000","last_undegraded":"2024-09-12T01:29:39.097542+0000","last_fullsized":"2024-09-12T01:29:39.097542+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'147","last_scrub_stamp":"2024-09-12T01:29:39.097377+0000","last_deep_scrub":"265'147","last_deep_scrub_stamp":"2024-09-12T01:29:39.097377+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.097377+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:58.929897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":237,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'262","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.987977+0000","last_change":"2024-09-12T01:29:24.987898+0000","last_active":"2024-09-12T01:29:24.987977+0000","last_peered":"2024-09-12T01:29:24.987977+0000","last_clean":"2024-09-12T01:29:24.987977+0000","last_became_active":"2024-09-12T00:31:47.130329+0000","last_became_peered":"2024-09-12T00:31:47.130329+0000","last_unstale":"2024-09-12T01:29:24.987977+0000","last_undegraded":"2024-09-12T01:29:24.987977+0000","last_fullsized":"2024-09-12T01:29:24.987977+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'262","last_scrub_stamp":"2024-09-12T01:29:24.987705+0000","last_deep_scrub":"265'262","last_deep_scrub_stamp":"2024-09-12T01:29:24.987705+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.987705+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:33.987536+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287558,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":37644,"num_write":765,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'112","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.800061+0000","last_change":"2024-09-12T01:29:38.800006+0000","last_active":"2024-09-12T01:29:38.800061+0000","last_peered":"2024-09-12T01:29:38.800061+0000","last_clean":"2024-09-12T01:29:38.800061+0000","last_became_active":"2024-09-12T00:31:50.135595+0000","last_became_peered":"2024-09-12T00:31:50.135595+0000","last_unstale":"2024-09-12T01:29:38.800061+0000","last_undegraded":"2024-09-12T01:29:38.800061+0000","last_fullsized":"2024-09-12T01:29:38.800061+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'112","last_scrub_stamp":"2024-09-12T01:29:38.799863+0000","last_deep_scrub":"265'112","last_deep_scrub_stamp":"2024-09-12T01:29:38.799863+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.799863+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:28.775891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":410,"num_write":180,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'318","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.179424+0000","last_change":"2024-09-12T01:29:31.179350+0000","last_active":"2024-09-12T01:29:31.179424+0000","last_peered":"2024-09-12T01:29:31.179424+0000","last_clean":"2024-09-12T01:29:31.179424+0000","last_became_active":"2024-09-12T00:31:47.133592+0000","last_became_peered":"2024-09-12T00:31:47.133592+0000","last_unstale":"2024-09-12T01:29:31.179424+0000","last_undegraded":"2024-09-12T01:29:31.179424+0000","last_fullsized":"2024-09-12T01:29:31.179424+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T01:29:31.179182+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T01:29:31.179182+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.179182+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:48.318104+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396882,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":783,"num_read_kb":29951,"num_write":1081,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'73","reported_seq":633,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.418748+0000","last_change":"2024-09-12T01:29:31.418672+0000","last_active":"2024-09-12T01:29:31.418748+0000","last_peered":"2024-09-12T01:29:31.418748+0000","last_clean":"2024-09-12T01:29:31.418748+0000","last_became_active":"2024-09-12T00:31:50.135972+0000","last_became_peered":"2024-09-12T00:31:50.135972+0000","last_unstale":"2024-09-12T01:29:31.418748+0000","last_undegraded":"2024-09-12T01:29:31.418748+0000","last_fullsized":"2024-09-12T01:29:31.418748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'73","last_scrub_stamp":"2024-09-12T01:29:31.418583+0000","last_deep_scrub":"265'73","last_deep_scrub_stamp":"2024-09-12T01:29:31.418583+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.418583+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:39.743725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":249,"num_write":116,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'312","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.185793+0000","last_change":"2024-09-12T01:29:30.185734+0000","last_active":"2024-09-12T01:29:30.185793+0000","last_peered":"2024-09-12T01:29:30.185793+0000","last_clean":"2024-09-12T01:29:30.185793+0000","last_became_active":"2024-09-12T00:31:47.118260+0000","last_became_peered":"2024-09-12T00:31:47.118260+0000","last_unstale":"2024-09-12T01:29:30.185793+0000","last_undegraded":"2024-09-12T01:29:30.185793+0000","last_fullsized":"2024-09-12T01:29:30.185793+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T01:29:30.185600+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T01:29:30.185600+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.185600+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:50.982982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":15045,"num_write":981,"num_write_kb":26498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'125","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.105584+0000","last_change":"2024-09-12T01:29:46.105512+0000","last_active":"2024-09-12T01:29:46.105584+0000","last_peered":"2024-09-12T01:29:46.105584+0000","last_clean":"2024-09-12T01:29:46.105584+0000","last_became_active":"2024-09-12T00:31:58.183784+0000","last_became_peered":"2024-09-12T00:31:58.183784+0000","last_unstale":"2024-09-12T01:29:46.105584+0000","last_undegraded":"2024-09-12T01:29:46.105584+0000","last_fullsized":"2024-09-12T01:29:46.105584+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-12T01:29:46.105425+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-12T01:29:46.105425+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.105425+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:30.670313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":134,"num_write":297,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'230","reported_seq":842,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.113953+0000","last_change":"2024-09-12T01:29:36.113884+0000","last_active":"2024-09-12T01:29:36.113953+0000","last_peered":"2024-09-12T01:29:36.113953+0000","last_clean":"2024-09-12T01:29:36.113953+0000","last_became_active":"2024-09-12T00:31:50.140510+0000","last_became_peered":"2024-09-12T00:31:50.140510+0000","last_unstale":"2024-09-12T01:29:36.113953+0000","last_undegraded":"2024-09-12T01:29:36.113953+0000","last_fullsized":"2024-09-12T01:29:36.113953+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'230","last_scrub_stamp":"2024-09-12T01:29:36.113803+0000","last_deep_scrub":"265'230","last_deep_scrub_stamp":"2024-09-12T01:29:36.113803+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.113803+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:49.872114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":944,"num_read_kb":762,"num_write":358,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'334","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.026257+0000","last_change":"2024-09-12T01:29:29.026172+0000","last_active":"2024-09-12T01:29:29.026257+0000","last_peered":"2024-09-12T01:29:29.026257+0000","last_clean":"2024-09-12T01:29:29.026257+0000","last_became_active":"2024-09-12T00:31:47.131940+0000","last_became_peered":"2024-09-12T00:31:47.131940+0000","last_unstale":"2024-09-12T01:29:29.026257+0000","last_undegraded":"2024-09-12T01:29:29.026257+0000","last_fullsized":"2024-09-12T01:29:29.026257+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-12T01:29:29.026060+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-12T01:29:29.026060+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.026060+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:53.704154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":467,"num_read_kb":415,"num_write":1065,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.256489+0000","last_change":"2024-09-12T01:29:48.256427+0000","last_active":"2024-09-12T01:29:48.256489+0000","last_peered":"2024-09-12T01:29:48.256489+0000","last_clean":"2024-09-12T01:29:48.256489+0000","last_became_active":"2024-09-12T00:31:52.151351+0000","last_became_peered":"2024-09-12T00:31:52.151351+0000","last_unstale":"2024-09-12T01:29:48.256489+0000","last_undegraded":"2024-09-12T01:29:48.256489+0000","last_fullsized":"2024-09-12T01:29:48.256489+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:48.256334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:48.256334+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.256334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:34.954985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'347","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.541811+0000","last_change":"2024-09-12T01:29:48.541750+0000","last_active":"2024-09-12T01:29:48.541811+0000","last_peered":"2024-09-12T01:29:48.541811+0000","last_clean":"2024-09-12T01:29:48.541811+0000","last_became_active":"2024-09-12T00:31:54.168545+0000","last_became_peered":"2024-09-12T00:31:54.168545+0000","last_unstale":"2024-09-12T01:29:48.541811+0000","last_undegraded":"2024-09-12T01:29:48.541811+0000","last_fullsized":"2024-09-12T01:29:48.541811+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:29:48.541646+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:29:48.541646+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.541646+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:19.169014+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45599,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":546,"num_read_kb":1097,"num_write":426,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.658861+0000","last_change":"2024-09-12T01:29:46.658802+0000","last_active":"2024-09-12T01:29:46.658861+0000","last_peered":"2024-09-12T01:29:46.658861+0000","last_clean":"2024-09-12T01:29:46.658861+0000","last_became_active":"2024-09-12T00:31:56.170837+0000","last_became_peered":"2024-09-12T00:31:56.170837+0000","last_unstale":"2024-09-12T01:29:46.658861+0000","last_undegraded":"2024-09-12T01:29:46.658861+0000","last_fullsized":"2024-09-12T01:29:46.658861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:46.658708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:46.658708+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.658708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:05.228373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2468","reported_seq":4365,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.727733+0000","last_change":"2024-09-12T01:29:58.727664+0000","last_active":"2024-09-12T01:29:58.727733+0000","last_peered":"2024-09-12T01:29:58.727733+0000","last_clean":"2024-09-12T01:29:58.727733+0000","last_became_active":"2024-09-12T00:31:58.181552+0000","last_became_peered":"2024-09-12T00:31:58.181552+0000","last_unstale":"2024-09-12T01:29:58.727733+0000","last_undegraded":"2024-09-12T01:29:58.727733+0000","last_fullsized":"2024-09-12T01:29:58.727733+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2468","last_scrub_stamp":"2024-09-12T01:29:58.727567+0000","last_deep_scrub":"265'2468","last_deep_scrub_stamp":"2024-09-12T01:29:58.727567+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.727567+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":2400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:51.613333+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":617,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6112,"num_read_kb":6115,"num_write":4931,"num_write_kb":1807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'4138","reported_seq":4759,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.099348+0000","last_change":"2024-09-12T01:29:39.099282+0000","last_active":"2024-09-12T01:29:39.099348+0000","last_peered":"2024-09-12T01:29:39.099348+0000","last_clean":"2024-09-12T01:29:39.099348+0000","last_became_active":"2024-09-12T00:31:50.133357+0000","last_became_peered":"2024-09-12T00:31:50.133357+0000","last_unstale":"2024-09-12T01:29:39.099348+0000","last_undegraded":"2024-09-12T01:29:39.099348+0000","last_fullsized":"2024-09-12T01:29:39.099348+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4138","last_scrub_stamp":"2024-09-12T01:29:39.099192+0000","last_deep_scrub":"265'4138","last_deep_scrub_stamp":"2024-09-12T01:29:39.099192+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.099192+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":3000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:48.646221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16657,"num_read_kb":13895,"num_write":6209,"num_write_kb":3095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'296","reported_seq":912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.186140+0000","last_change":"2024-09-12T01:29:27.186057+0000","last_active":"2024-09-12T01:29:27.186140+0000","last_peered":"2024-09-12T01:29:27.186140+0000","last_clean":"2024-09-12T01:29:27.186140+0000","last_became_active":"2024-09-12T00:31:47.131849+0000","last_became_peered":"2024-09-12T00:31:47.131849+0000","last_unstale":"2024-09-12T01:29:27.186140+0000","last_undegraded":"2024-09-12T01:29:27.186140+0000","last_fullsized":"2024-09-12T01:29:27.186140+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'296","last_scrub_stamp":"2024-09-12T01:29:27.185965+0000","last_deep_scrub":"265'296","last_deep_scrub_stamp":"2024-09-12T01:29:27.185965+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.185965+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:13.318989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":405,"num_read_kb":4533,"num_write":946,"num_write_kb":25027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":511,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.614929+0000","last_change":"2024-09-12T01:29:38.614929+0000","last_active":"2024-09-12T01:29:38.614929+0000","last_peered":"2024-09-12T01:29:38.614929+0000","last_clean":"2024-09-12T01:29:38.614929+0000","last_became_active":"2024-09-12T00:31:52.152244+0000","last_became_peered":"2024-09-12T00:31:52.152244+0000","last_unstale":"2024-09-12T01:29:38.614929+0000","last_undegraded":"2024-09-12T01:29:38.614929+0000","last_fullsized":"2024-09-12T01:29:38.614929+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:38.614815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:38.614815+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.614815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:05.675092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'98","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.558815+0000","last_change":"2024-09-12T01:29:40.558746+0000","last_active":"2024-09-12T01:29:40.558815+0000","last_peered":"2024-09-12T01:29:40.558815+0000","last_clean":"2024-09-12T01:29:40.558815+0000","last_became_active":"2024-09-12T00:31:54.167260+0000","last_became_peered":"2024-09-12T00:31:54.167260+0000","last_unstale":"2024-09-12T01:29:40.558815+0000","last_undegraded":"2024-09-12T01:29:40.558815+0000","last_fullsized":"2024-09-12T01:29:40.558815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'98","last_scrub_stamp":"2024-09-12T01:29:40.558641+0000","last_deep_scrub":"265'98","last_deep_scrub_stamp":"2024-09-12T01:29:40.558641+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.558641+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:35.210876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":103,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.680896+0000","last_change":"2024-09-12T01:29:45.680841+0000","last_active":"2024-09-12T01:29:45.680896+0000","last_peered":"2024-09-12T01:29:45.680896+0000","last_clean":"2024-09-12T01:29:45.680896+0000","last_became_active":"2024-09-12T00:31:56.174452+0000","last_became_peered":"2024-09-12T00:31:56.174452+0000","last_unstale":"2024-09-12T01:29:45.680896+0000","last_undegraded":"2024-09-12T01:29:45.680896+0000","last_fullsized":"2024-09-12T01:29:45.680896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:45.680751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:45.680751+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.680751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:47.024821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'148","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.109726+0000","last_change":"2024-09-12T01:29:53.109726+0000","last_active":"2024-09-12T01:29:53.109726+0000","last_peered":"2024-09-12T01:29:53.109726+0000","last_clean":"2024-09-12T01:29:53.109726+0000","last_became_active":"2024-09-12T00:31:58.178748+0000","last_became_peered":"2024-09-12T00:31:58.178748+0000","last_unstale":"2024-09-12T01:29:53.109726+0000","last_undegraded":"2024-09-12T01:29:53.109726+0000","last_fullsized":"2024-09-12T01:29:53.109726+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'148","last_scrub_stamp":"2024-09-12T01:29:53.109644+0000","last_deep_scrub":"265'148","last_deep_scrub_stamp":"2024-09-12T01:29:53.109644+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.109644+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:57.155666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":137,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'401","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.760451+0000","last_change":"2024-09-12T01:29:42.760397+0000","last_active":"2024-09-12T01:29:42.760451+0000","last_peered":"2024-09-12T01:29:42.760451+0000","last_clean":"2024-09-12T01:29:42.760451+0000","last_became_active":"2024-09-12T00:31:50.143399+0000","last_became_peered":"2024-09-12T00:31:50.143399+0000","last_unstale":"2024-09-12T01:29:42.760451+0000","last_undegraded":"2024-09-12T01:29:42.760451+0000","last_fullsized":"2024-09-12T01:29:42.760451+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'401","last_scrub_stamp":"2024-09-12T01:29:42.760314+0000","last_deep_scrub":"265'401","last_deep_scrub_stamp":"2024-09-12T01:29:42.760314+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.760314+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:20.228207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1799,"num_read_kb":1492,"num_write":673,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'331","reported_seq":1119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.234661+0000","last_change":"2024-09-12T01:29:24.234661+0000","last_active":"2024-09-12T01:29:24.234661+0000","last_peered":"2024-09-12T01:29:24.234661+0000","last_clean":"2024-09-12T01:29:24.234661+0000","last_became_active":"2024-09-12T00:32:23.830863+0000","last_became_peered":"2024-09-12T00:32:23.830863+0000","last_unstale":"2024-09-12T01:29:24.234661+0000","last_undegraded":"2024-09-12T01:29:24.234661+0000","last_fullsized":"2024-09-12T01:29:24.234661+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T01:29:24.234562+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T01:29:24.234562+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.234562+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:32.668950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569327,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":866,"num_read_kb":9184,"num_write":1035,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":511,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.565070+0000","last_change":"2024-09-12T01:29:42.564959+0000","last_active":"2024-09-12T01:29:42.565070+0000","last_peered":"2024-09-12T01:29:42.565070+0000","last_clean":"2024-09-12T01:29:42.565070+0000","last_became_active":"2024-09-12T00:31:52.154077+0000","last_became_peered":"2024-09-12T00:31:52.154077+0000","last_unstale":"2024-09-12T01:29:42.565070+0000","last_undegraded":"2024-09-12T01:29:42.565070+0000","last_fullsized":"2024-09-12T01:29:42.565070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:42.564848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:42.564848+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.564848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:53.035581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'126","reported_seq":691,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.592329+0000","last_change":"2024-09-12T01:29:50.592329+0000","last_active":"2024-09-12T01:29:50.592329+0000","last_peered":"2024-09-12T01:29:50.592329+0000","last_clean":"2024-09-12T01:29:50.592329+0000","last_became_active":"2024-09-12T00:31:54.163434+0000","last_became_peered":"2024-09-12T00:31:54.163434+0000","last_unstale":"2024-09-12T01:29:50.592329+0000","last_undegraded":"2024-09-12T01:29:50.592329+0000","last_fullsized":"2024-09-12T01:29:50.592329+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T01:29:50.592220+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T01:29:50.592220+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.592220+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:46.135715+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":152,"num_read_kb":145,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'783","reported_seq":4230,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:02.345412+0000","last_change":"2024-09-12T01:30:02.345412+0000","last_active":"2024-09-12T01:30:02.345412+0000","last_peered":"2024-09-12T01:30:02.345412+0000","last_clean":"2024-09-12T01:30:02.345412+0000","last_became_active":"2024-09-12T00:31:56.171157+0000","last_became_peered":"2024-09-12T00:31:56.171157+0000","last_unstale":"2024-09-12T01:30:02.345412+0000","last_undegraded":"2024-09-12T01:30:02.345412+0000","last_fullsized":"2024-09-12T01:30:02.345412+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'783","last_scrub_stamp":"2024-09-12T01:30:02.345309+0000","last_deep_scrub":"265'783","last_deep_scrub_stamp":"2024-09-12T01:30:02.345309+0000","last_clean_scrub_stamp":"2024-09-12T01:30:02.345309+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:24.031687+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'203","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.417304+0000","last_change":"2024-09-12T01:29:48.417304+0000","last_active":"2024-09-12T01:29:48.417304+0000","last_peered":"2024-09-12T01:29:48.417304+0000","last_clean":"2024-09-12T01:29:48.417304+0000","last_became_active":"2024-09-12T00:31:58.179576+0000","last_became_peered":"2024-09-12T00:31:58.179576+0000","last_unstale":"2024-09-12T01:29:48.417304+0000","last_undegraded":"2024-09-12T01:29:48.417304+0000","last_fullsized":"2024-09-12T01:29:48.417304+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'203","last_scrub_stamp":"2024-09-12T01:29:48.417212+0000","last_deep_scrub":"265'203","last_deep_scrub_stamp":"2024-09-12T01:29:48.417212+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.417212+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:53.762406+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":631,"num_write":454,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'419","reported_seq":1167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.756579+0000","last_change":"2024-09-12T01:29:40.756481+0000","last_active":"2024-09-12T01:29:40.756579+0000","last_peered":"2024-09-12T01:29:40.756579+0000","last_clean":"2024-09-12T01:29:40.756579+0000","last_became_active":"2024-09-12T00:31:50.140485+0000","last_became_peered":"2024-09-12T00:31:50.140485+0000","last_unstale":"2024-09-12T01:29:40.756579+0000","last_undegraded":"2024-09-12T01:29:40.756579+0000","last_fullsized":"2024-09-12T01:29:40.756579+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'419","last_scrub_stamp":"2024-09-12T01:29:40.756379+0000","last_deep_scrub":"265'419","last_deep_scrub_stamp":"2024-09-12T01:29:40.756379+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.756379+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:43.561319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2003,"num_read_kb":1658,"num_write":744,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7569,"num_omap_keys":32,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'321","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.346562+0000","last_change":"2024-09-12T01:29:21.346493+0000","last_active":"2024-09-12T01:29:21.346562+0000","last_peered":"2024-09-12T01:29:21.346562+0000","last_clean":"2024-09-12T01:29:21.346562+0000","last_became_active":"2024-09-12T00:31:47.125118+0000","last_became_peered":"2024-09-12T00:31:47.125118+0000","last_unstale":"2024-09-12T01:29:21.346562+0000","last_undegraded":"2024-09-12T01:29:21.346562+0000","last_fullsized":"2024-09-12T01:29:21.346562+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'321","last_scrub_stamp":"2024-09-12T01:29:21.346370+0000","last_deep_scrub":"265'321","last_deep_scrub_stamp":"2024-09-12T01:29:21.346370+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.346370+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:00.319828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209058,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":536,"num_read_kb":32880,"num_write":1078,"num_write_kb":23042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.268118+0000","last_change":"2024-09-12T01:29:49.268042+0000","last_active":"2024-09-12T01:29:49.268118+0000","last_peered":"2024-09-12T01:29:49.268118+0000","last_clean":"2024-09-12T01:29:49.268118+0000","last_became_active":"2024-09-12T00:31:52.154189+0000","last_became_peered":"2024-09-12T00:31:52.154189+0000","last_unstale":"2024-09-12T01:29:49.268118+0000","last_undegraded":"2024-09-12T01:29:49.268118+0000","last_fullsized":"2024-09-12T01:29:49.268118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:49.267948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:49.267948+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.267948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:55.800816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'280","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.407718+0000","last_change":"2024-09-12T01:29:40.407647+0000","last_active":"2024-09-12T01:29:40.407718+0000","last_peered":"2024-09-12T01:29:40.407718+0000","last_clean":"2024-09-12T01:29:40.407718+0000","last_became_active":"2024-09-12T00:31:54.171354+0000","last_became_peered":"2024-09-12T00:31:54.171354+0000","last_unstale":"2024-09-12T01:29:40.407718+0000","last_undegraded":"2024-09-12T01:29:40.407718+0000","last_fullsized":"2024-09-12T01:29:40.407718+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'280","last_scrub_stamp":"2024-09-12T01:29:40.407559+0000","last_deep_scrub":"265'280","last_deep_scrub_stamp":"2024-09-12T01:29:40.407559+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.407559+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:49.584492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53613,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":1068,"num_write":372,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'785","reported_seq":2517,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.801147+0000","last_change":"2024-09-12T01:29:52.801147+0000","last_active":"2024-09-12T01:29:52.801147+0000","last_peered":"2024-09-12T01:29:52.801147+0000","last_clean":"2024-09-12T01:29:52.801147+0000","last_became_active":"2024-09-12T00:31:56.176464+0000","last_became_peered":"2024-09-12T00:31:56.176464+0000","last_unstale":"2024-09-12T01:29:52.801147+0000","last_undegraded":"2024-09-12T01:29:52.801147+0000","last_fullsized":"2024-09-12T01:29:52.801147+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'785","last_scrub_stamp":"2024-09-12T01:29:52.801061+0000","last_deep_scrub":"265'785","last_deep_scrub_stamp":"2024-09-12T01:29:52.801061+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.801061+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:34.132405+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'324","reported_seq":950,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.078967+0000","last_change":"2024-09-12T01:29:37.078895+0000","last_active":"2024-09-12T01:29:37.078967+0000","last_peered":"2024-09-12T01:29:37.078967+0000","last_clean":"2024-09-12T01:29:37.078967+0000","last_became_active":"2024-09-12T00:31:50.138335+0000","last_became_peered":"2024-09-12T00:31:50.138335+0000","last_unstale":"2024-09-12T01:29:37.078967+0000","last_undegraded":"2024-09-12T01:29:37.078967+0000","last_fullsized":"2024-09-12T01:29:37.078967+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T01:29:37.078804+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T01:29:37.078804+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.078804+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:03.476907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1108,"num_write":487,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'344","reported_seq":999,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:20.932719+0000","last_change":"2024-09-12T01:29:20.932719+0000","last_active":"2024-09-12T01:29:20.932719+0000","last_peered":"2024-09-12T01:29:20.932719+0000","last_clean":"2024-09-12T01:29:20.932719+0000","last_became_active":"2024-09-12T00:31:47.137951+0000","last_became_peered":"2024-09-12T00:31:47.137951+0000","last_unstale":"2024-09-12T01:29:20.932719+0000","last_undegraded":"2024-09-12T01:29:20.932719+0000","last_fullsized":"2024-09-12T01:29:20.932719+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T01:29:20.932609+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T01:29:20.932609+0000","last_clean_scrub_stamp":"2024-09-12T01:29:20.932609+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:18.440399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205367,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":21468,"num_write":1112,"num_write_kb":35236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.486850+0000","last_change":"2024-09-12T01:29:37.486850+0000","last_active":"2024-09-12T01:29:37.486850+0000","last_peered":"2024-09-12T01:29:37.486850+0000","last_clean":"2024-09-12T01:29:37.486850+0000","last_became_active":"2024-09-12T00:31:52.155047+0000","last_became_peered":"2024-09-12T00:31:52.155047+0000","last_unstale":"2024-09-12T01:29:37.486850+0000","last_undegraded":"2024-09-12T01:29:37.486850+0000","last_fullsized":"2024-09-12T01:29:37.486850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:37.486756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:37.486756+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.486756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:25.770437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'376","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.167617+0000","last_change":"2024-09-12T01:29:40.167617+0000","last_active":"2024-09-12T01:29:40.167617+0000","last_peered":"2024-09-12T01:29:40.167617+0000","last_clean":"2024-09-12T01:29:40.167617+0000","last_became_active":"2024-09-12T00:31:54.173363+0000","last_became_peered":"2024-09-12T00:31:54.173363+0000","last_unstale":"2024-09-12T01:29:40.167617+0000","last_undegraded":"2024-09-12T01:29:40.167617+0000","last_fullsized":"2024-09-12T01:29:40.167617+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T01:29:40.167506+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T01:29:40.167506+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.167506+0000","objects_scrubbed":10,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:42.647926+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48858,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":1144,"num_write":454,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.023763+0000","last_change":"2024-09-12T01:29:48.023763+0000","last_active":"2024-09-12T01:29:48.023763+0000","last_peered":"2024-09-12T01:29:48.023763+0000","last_clean":"2024-09-12T01:29:48.023763+0000","last_became_active":"2024-09-12T00:31:56.172791+0000","last_became_peered":"2024-09-12T00:31:56.172791+0000","last_unstale":"2024-09-12T01:29:48.023763+0000","last_undegraded":"2024-09-12T01:29:48.023763+0000","last_fullsized":"2024-09-12T01:29:48.023763+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:48.023666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:48.023666+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.023666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:05.852693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'547","reported_seq":1381,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.460939+0000","last_change":"2024-09-12T01:29:46.460863+0000","last_active":"2024-09-12T01:29:46.460939+0000","last_peered":"2024-09-12T01:29:46.460939+0000","last_clean":"2024-09-12T01:29:46.460939+0000","last_became_active":"2024-09-12T00:31:58.177828+0000","last_became_peered":"2024-09-12T00:31:58.177828+0000","last_unstale":"2024-09-12T01:29:46.460939+0000","last_undegraded":"2024-09-12T01:29:46.460939+0000","last_fullsized":"2024-09-12T01:29:46.460939+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'547","last_scrub_stamp":"2024-09-12T01:29:46.460769+0000","last_deep_scrub":"265'547","last_deep_scrub_stamp":"2024-09-12T01:29:46.460769+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.460769+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:34.924588+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1309,"num_read_kb":1288,"num_write":1113,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'199","reported_seq":835,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.422245+0000","last_change":"2024-09-12T01:29:26.422188+0000","last_active":"2024-09-12T01:29:26.422245+0000","last_peered":"2024-09-12T01:29:26.422245+0000","last_clean":"2024-09-12T01:29:26.422245+0000","last_became_active":"2024-09-12T00:31:50.138261+0000","last_became_peered":"2024-09-12T00:31:50.138261+0000","last_unstale":"2024-09-12T01:29:26.422245+0000","last_undegraded":"2024-09-12T01:29:26.422245+0000","last_fullsized":"2024-09-12T01:29:26.422245+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'199","last_scrub_stamp":"2024-09-12T01:29:26.422100+0000","last_deep_scrub":"265'199","last_deep_scrub_stamp":"2024-09-12T01:29:26.422100+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.422100+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:46.719548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":866,"num_read_kb":707,"num_write":323,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'375","reported_seq":1093,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.385013+0000","last_change":"2024-09-12T01:29:21.384921+0000","last_active":"2024-09-12T01:29:21.385013+0000","last_peered":"2024-09-12T01:29:21.385013+0000","last_clean":"2024-09-12T01:29:21.385013+0000","last_became_active":"2024-09-12T00:31:47.137234+0000","last_became_peered":"2024-09-12T00:31:47.137234+0000","last_unstale":"2024-09-12T01:29:21.385013+0000","last_undegraded":"2024-09-12T01:29:21.385013+0000","last_fullsized":"2024-09-12T01:29:21.385013+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T01:29:21.384774+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T01:29:21.384774+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.384774+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:01.729819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267358,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":707,"num_read_kb":90782,"num_write":1268,"num_write_kb":21068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.084013+0000","last_change":"2024-09-12T01:29:40.084013+0000","last_active":"2024-09-12T01:29:40.084013+0000","last_peered":"2024-09-12T01:29:40.084013+0000","last_clean":"2024-09-12T01:29:40.084013+0000","last_became_active":"2024-09-12T00:31:52.148738+0000","last_became_peered":"2024-09-12T00:31:52.148738+0000","last_unstale":"2024-09-12T01:29:40.084013+0000","last_undegraded":"2024-09-12T01:29:40.084013+0000","last_fullsized":"2024-09-12T01:29:40.084013+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:40.083917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:40.083917+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.083917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:08.215110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'289","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.582291+0000","last_change":"2024-09-12T01:29:44.582187+0000","last_active":"2024-09-12T01:29:44.582291+0000","last_peered":"2024-09-12T01:29:44.582291+0000","last_clean":"2024-09-12T01:29:44.582291+0000","last_became_active":"2024-09-12T00:31:54.168247+0000","last_became_peered":"2024-09-12T00:31:54.168247+0000","last_unstale":"2024-09-12T01:29:44.582291+0000","last_undegraded":"2024-09-12T01:29:44.582291+0000","last_fullsized":"2024-09-12T01:29:44.582291+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'289","last_scrub_stamp":"2024-09-12T01:29:44.582089+0000","last_deep_scrub":"265'289","last_deep_scrub_stamp":"2024-09-12T01:29:44.582089+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.582089+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:03.321442+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":1085,"num_write":382,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.606504+0000","last_change":"2024-09-12T01:29:52.606504+0000","last_active":"2024-09-12T01:29:52.606504+0000","last_peered":"2024-09-12T01:29:52.606504+0000","last_clean":"2024-09-12T01:29:52.606504+0000","last_became_active":"2024-09-12T00:31:56.173549+0000","last_became_peered":"2024-09-12T00:31:56.173549+0000","last_unstale":"2024-09-12T01:29:52.606504+0000","last_undegraded":"2024-09-12T01:29:52.606504+0000","last_fullsized":"2024-09-12T01:29:52.606504+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:52.606411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:52.606411+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.606411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:19.064185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'133","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.676531+0000","last_change":"2024-09-12T01:29:47.676531+0000","last_active":"2024-09-12T01:29:47.676531+0000","last_peered":"2024-09-12T01:29:47.676531+0000","last_clean":"2024-09-12T01:29:47.676531+0000","last_became_active":"2024-09-12T00:31:58.175195+0000","last_became_peered":"2024-09-12T00:31:58.175195+0000","last_unstale":"2024-09-12T01:29:47.676531+0000","last_undegraded":"2024-09-12T01:29:47.676531+0000","last_fullsized":"2024-09-12T01:29:47.676531+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-12T01:29:47.676437+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-12T01:29:47.676437+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.676437+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:06.315037+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":426,"num_read_kb":345,"num_write":330,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'362","reported_seq":961,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.393387+0000","last_change":"2024-09-12T01:29:28.393387+0000","last_active":"2024-09-12T01:29:28.393387+0000","last_peered":"2024-09-12T01:29:28.393387+0000","last_clean":"2024-09-12T01:29:28.393387+0000","last_became_active":"2024-09-12T00:31:50.142818+0000","last_became_peered":"2024-09-12T00:31:50.142818+0000","last_unstale":"2024-09-12T01:29:28.393387+0000","last_undegraded":"2024-09-12T01:29:28.393387+0000","last_fullsized":"2024-09-12T01:29:28.393387+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T01:29:28.393299+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T01:29:28.393299+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.393299+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:32.642275+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1555,"num_read_kb":1227,"num_write":605,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1024,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'335","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.993560+0000","last_change":"2024-09-12T01:29:25.993496+0000","last_active":"2024-09-12T01:29:25.993560+0000","last_peered":"2024-09-12T01:29:25.993560+0000","last_clean":"2024-09-12T01:29:25.993560+0000","last_became_active":"2024-09-12T00:31:47.112306+0000","last_became_peered":"2024-09-12T00:31:47.112306+0000","last_unstale":"2024-09-12T01:29:25.993560+0000","last_undegraded":"2024-09-12T01:29:25.993560+0000","last_fullsized":"2024-09-12T01:29:25.993560+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T01:29:25.993385+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T01:29:25.993385+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.993385+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:41.871832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":55420,"num_write":1061,"num_write_kb":24613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.802045+0000","last_change":"2024-09-12T01:29:43.801990+0000","last_active":"2024-09-12T01:29:43.802045+0000","last_peered":"2024-09-12T01:29:43.802045+0000","last_clean":"2024-09-12T01:29:43.802045+0000","last_became_active":"2024-09-12T00:31:52.153862+0000","last_became_peered":"2024-09-12T00:31:52.153862+0000","last_unstale":"2024-09-12T01:29:43.802045+0000","last_undegraded":"2024-09-12T01:29:43.802045+0000","last_fullsized":"2024-09-12T01:29:43.802045+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:43.801898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:43.801898+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.801898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:29.824097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'367","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.282136+0000","last_change":"2024-09-12T01:29:53.282136+0000","last_active":"2024-09-12T01:29:53.282136+0000","last_peered":"2024-09-12T01:29:53.282136+0000","last_clean":"2024-09-12T01:29:53.282136+0000","last_became_active":"2024-09-12T00:31:54.162228+0000","last_became_peered":"2024-09-12T00:31:54.162228+0000","last_unstale":"2024-09-12T01:29:53.282136+0000","last_undegraded":"2024-09-12T01:29:53.282136+0000","last_fullsized":"2024-09-12T01:29:53.282136+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T01:29:53.282029+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T01:29:53.282029+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.282029+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:19.749606+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50365,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":550,"num_read_kb":1150,"num_write":448,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'784","reported_seq":2608,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.768980+0000","last_change":"2024-09-12T01:29:51.768980+0000","last_active":"2024-09-12T01:29:51.768980+0000","last_peered":"2024-09-12T01:29:51.768980+0000","last_clean":"2024-09-12T01:29:51.768980+0000","last_became_active":"2024-09-12T00:31:56.172503+0000","last_became_peered":"2024-09-12T00:31:56.172503+0000","last_unstale":"2024-09-12T01:29:51.768980+0000","last_undegraded":"2024-09-12T01:29:51.768980+0000","last_fullsized":"2024-09-12T01:29:51.768980+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'784","last_scrub_stamp":"2024-09-12T01:29:51.768881+0000","last_deep_scrub":"265'784","last_deep_scrub_stamp":"2024-09-12T01:29:51.768881+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.768881+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:05.443524+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'151","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.104405+0000","last_change":"2024-09-12T01:29:52.104405+0000","last_active":"2024-09-12T01:29:52.104405+0000","last_peered":"2024-09-12T01:29:52.104405+0000","last_clean":"2024-09-12T01:29:52.104405+0000","last_became_active":"2024-09-12T00:31:58.175027+0000","last_became_peered":"2024-09-12T00:31:58.175027+0000","last_unstale":"2024-09-12T01:29:52.104405+0000","last_undegraded":"2024-09-12T01:29:52.104405+0000","last_fullsized":"2024-09-12T01:29:52.104405+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T01:29:52.104322+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T01:29:52.104322+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.104322+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:02.882257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":179,"num_read_kb":162,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'330","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.910713+0000","last_change":"2024-09-12T01:29:34.910624+0000","last_active":"2024-09-12T01:29:34.910713+0000","last_peered":"2024-09-12T01:29:34.910713+0000","last_clean":"2024-09-12T01:29:34.910713+0000","last_became_active":"2024-09-12T00:31:50.143814+0000","last_became_peered":"2024-09-12T00:31:50.143814+0000","last_unstale":"2024-09-12T01:29:34.910713+0000","last_undegraded":"2024-09-12T01:29:34.910713+0000","last_fullsized":"2024-09-12T01:29:34.910713+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T01:29:34.910513+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T01:29:34.910513+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.910513+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:08.249264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1421,"num_read_kb":1140,"num_write":511,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'367","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.966310+0000","last_change":"2024-09-12T01:29:22.966235+0000","last_active":"2024-09-12T01:29:22.966310+0000","last_peered":"2024-09-12T01:29:22.966310+0000","last_clean":"2024-09-12T01:29:22.966310+0000","last_became_active":"2024-09-12T00:31:47.138687+0000","last_became_peered":"2024-09-12T00:31:47.138687+0000","last_unstale":"2024-09-12T01:29:22.966310+0000","last_undegraded":"2024-09-12T01:29:22.966310+0000","last_fullsized":"2024-09-12T01:29:22.966310+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T01:29:22.966128+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T01:29:22.966128+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.966128+0000","objects_scrubbed":10,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:35.759401+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6638737,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":559,"num_read_kb":39444,"num_write":1190,"num_write_kb":53128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.131699+0000","last_change":"2024-09-12T01:29:41.131699+0000","last_active":"2024-09-12T01:29:41.131699+0000","last_peered":"2024-09-12T01:29:41.131699+0000","last_clean":"2024-09-12T01:29:41.131699+0000","last_became_active":"2024-09-12T00:31:52.154863+0000","last_became_peered":"2024-09-12T00:31:52.154863+0000","last_unstale":"2024-09-12T01:29:41.131699+0000","last_undegraded":"2024-09-12T01:29:41.131699+0000","last_fullsized":"2024-09-12T01:29:41.131699+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:41.131612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:41.131612+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.131612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:59.475586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'519","reported_seq":1181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.584542+0000","last_change":"2024-09-12T01:29:45.584487+0000","last_active":"2024-09-12T01:29:45.584542+0000","last_peered":"2024-09-12T01:29:45.584542+0000","last_clean":"2024-09-12T01:29:45.584542+0000","last_became_active":"2024-09-12T00:31:54.168691+0000","last_became_peered":"2024-09-12T00:31:54.168691+0000","last_unstale":"2024-09-12T01:29:45.584542+0000","last_undegraded":"2024-09-12T01:29:45.584542+0000","last_fullsized":"2024-09-12T01:29:45.584542+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'519","last_scrub_stamp":"2024-09-12T01:29:45.584397+0000","last_deep_scrub":"265'519","last_deep_scrub_stamp":"2024-09-12T01:29:45.584397+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.584397+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:32.698872+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104127,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":909,"num_read_kb":2207,"num_write":754,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.737486+0000","last_change":"2024-09-12T01:29:50.737486+0000","last_active":"2024-09-12T01:29:50.737486+0000","last_peered":"2024-09-12T01:29:50.737486+0000","last_clean":"2024-09-12T01:29:50.737486+0000","last_became_active":"2024-09-12T00:31:56.175412+0000","last_became_peered":"2024-09-12T00:31:56.175412+0000","last_unstale":"2024-09-12T01:29:50.737486+0000","last_undegraded":"2024-09-12T01:29:50.737486+0000","last_fullsized":"2024-09-12T01:29:50.737486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:50.737371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:50.737371+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.737371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:41.626798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'136","reported_seq":658,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.616146+0000","last_change":"2024-09-12T01:29:46.616146+0000","last_active":"2024-09-12T01:29:46.616146+0000","last_peered":"2024-09-12T01:29:46.616146+0000","last_clean":"2024-09-12T01:29:46.616146+0000","last_became_active":"2024-09-12T00:31:58.178027+0000","last_became_peered":"2024-09-12T00:31:58.178027+0000","last_unstale":"2024-09-12T01:29:46.616146+0000","last_undegraded":"2024-09-12T01:29:46.616146+0000","last_fullsized":"2024-09-12T01:29:46.616146+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T01:29:46.616055+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T01:29:46.616055+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.616055+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:41.007359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'163","reported_seq":801,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.123199+0000","last_change":"2024-09-12T01:29:33.123130+0000","last_active":"2024-09-12T01:29:33.123199+0000","last_peered":"2024-09-12T01:29:33.123199+0000","last_clean":"2024-09-12T01:29:33.123199+0000","last_became_active":"2024-09-12T00:31:50.127193+0000","last_became_peered":"2024-09-12T00:31:50.127193+0000","last_unstale":"2024-09-12T01:29:33.123199+0000","last_undegraded":"2024-09-12T01:29:33.123199+0000","last_fullsized":"2024-09-12T01:29:33.123199+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'163","last_scrub_stamp":"2024-09-12T01:29:33.123035+0000","last_deep_scrub":"265'163","last_deep_scrub_stamp":"2024-09-12T01:29:33.123035+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.123035+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:08.204389+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":547,"num_write":243,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'332","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.578562+0000","last_change":"2024-09-12T01:29:24.578493+0000","last_active":"2024-09-12T01:29:24.578562+0000","last_peered":"2024-09-12T01:29:24.578562+0000","last_clean":"2024-09-12T01:29:24.578562+0000","last_became_active":"2024-09-12T00:31:47.130136+0000","last_became_peered":"2024-09-12T00:31:47.130136+0000","last_unstale":"2024-09-12T01:29:24.578562+0000","last_undegraded":"2024-09-12T01:29:24.578562+0000","last_fullsized":"2024-09-12T01:29:24.578562+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-12T01:29:24.578387+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-12T01:29:24.578387+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.578387+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:56.888507+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":72156,"num_write":1150,"num_write_kb":60123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":512,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.546401+0000","last_change":"2024-09-12T01:29:36.546401+0000","last_active":"2024-09-12T01:29:36.546401+0000","last_peered":"2024-09-12T01:29:36.546401+0000","last_clean":"2024-09-12T01:29:36.546401+0000","last_became_active":"2024-09-12T00:31:52.155083+0000","last_became_peered":"2024-09-12T00:31:52.155083+0000","last_unstale":"2024-09-12T01:29:36.546401+0000","last_undegraded":"2024-09-12T01:29:36.546401+0000","last_fullsized":"2024-09-12T01:29:36.546401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:36.546308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:36.546308+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.546308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:03.570556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'329","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.610592+0000","last_change":"2024-09-12T01:29:41.610592+0000","last_active":"2024-09-12T01:29:41.610592+0000","last_peered":"2024-09-12T01:29:41.610592+0000","last_clean":"2024-09-12T01:29:41.610592+0000","last_became_active":"2024-09-12T00:31:54.165221+0000","last_became_peered":"2024-09-12T00:31:54.165221+0000","last_unstale":"2024-09-12T01:29:41.610592+0000","last_undegraded":"2024-09-12T01:29:41.610592+0000","last_fullsized":"2024-09-12T01:29:41.610592+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'329","last_scrub_stamp":"2024-09-12T01:29:41.610484+0000","last_deep_scrub":"265'329","last_deep_scrub_stamp":"2024-09-12T01:29:41.610484+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.610484+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:29.700202+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53280,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":539,"num_read_kb":1166,"num_write":484,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.549227+0000","last_change":"2024-09-12T01:29:40.549227+0000","last_active":"2024-09-12T01:29:40.549227+0000","last_peered":"2024-09-12T01:29:40.549227+0000","last_clean":"2024-09-12T01:29:40.549227+0000","last_became_active":"2024-09-12T00:31:56.172777+0000","last_became_peered":"2024-09-12T00:31:56.172777+0000","last_unstale":"2024-09-12T01:29:40.549227+0000","last_undegraded":"2024-09-12T01:29:40.549227+0000","last_fullsized":"2024-09-12T01:29:40.549227+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:40.549127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:40.549127+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.549127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:34.798912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'119","reported_seq":618,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.738745+0000","last_change":"2024-09-12T01:29:54.738683+0000","last_active":"2024-09-12T01:29:54.738745+0000","last_peered":"2024-09-12T01:29:54.738745+0000","last_clean":"2024-09-12T01:29:54.738745+0000","last_became_active":"2024-09-12T00:31:58.179667+0000","last_became_peered":"2024-09-12T00:31:58.179667+0000","last_unstale":"2024-09-12T01:29:54.738745+0000","last_undegraded":"2024-09-12T01:29:54.738745+0000","last_fullsized":"2024-09-12T01:29:54.738745+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T01:29:54.738574+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T01:29:54.738574+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.738574+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:12.877077+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":909,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":84,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'226","reported_seq":814,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.062280+0000","last_change":"2024-09-12T01:29:38.062213+0000","last_active":"2024-09-12T01:29:38.062280+0000","last_peered":"2024-09-12T01:29:38.062280+0000","last_clean":"2024-09-12T01:29:38.062280+0000","last_became_active":"2024-09-12T00:31:50.130807+0000","last_became_peered":"2024-09-12T00:31:50.130807+0000","last_unstale":"2024-09-12T01:29:38.062280+0000","last_undegraded":"2024-09-12T01:29:38.062280+0000","last_fullsized":"2024-09-12T01:29:38.062280+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'226","last_scrub_stamp":"2024-09-12T01:29:38.062123+0000","last_deep_scrub":"265'226","last_deep_scrub_stamp":"2024-09-12T01:29:38.062123+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.062123+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:56.212489+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":940,"num_read_kb":756,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'403","reported_seq":1084,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.017755+0000","last_change":"2024-09-12T01:29:28.017755+0000","last_active":"2024-09-12T01:29:28.017755+0000","last_peered":"2024-09-12T01:29:28.017755+0000","last_clean":"2024-09-12T01:29:28.017755+0000","last_became_active":"2024-09-12T00:31:47.113265+0000","last_became_peered":"2024-09-12T00:31:47.113265+0000","last_unstale":"2024-09-12T01:29:28.017755+0000","last_undegraded":"2024-09-12T01:29:28.017755+0000","last_fullsized":"2024-09-12T01:29:28.017755+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'403","last_scrub_stamp":"2024-09-12T01:29:28.017627+0000","last_deep_scrub":"265'403","last_deep_scrub_stamp":"2024-09-12T01:29:28.017627+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.017627+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:21.400047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174791,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":600,"num_read_kb":11693,"num_write":1259,"num_write_kb":25282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.796919+0000","last_change":"2024-09-12T01:29:44.796855+0000","last_active":"2024-09-12T01:29:44.796919+0000","last_peered":"2024-09-12T01:29:44.796919+0000","last_clean":"2024-09-12T01:29:44.796919+0000","last_became_active":"2024-09-12T00:31:52.155877+0000","last_became_peered":"2024-09-12T00:31:52.155877+0000","last_unstale":"2024-09-12T01:29:44.796919+0000","last_undegraded":"2024-09-12T01:29:44.796919+0000","last_fullsized":"2024-09-12T01:29:44.796919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:44.796766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:44.796766+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.796766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:17.737413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'317","reported_seq":916,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.728963+0000","last_change":"2024-09-12T01:29:48.728963+0000","last_active":"2024-09-12T01:29:48.728963+0000","last_peered":"2024-09-12T01:29:48.728963+0000","last_clean":"2024-09-12T01:29:48.728963+0000","last_became_active":"2024-09-12T00:31:54.165107+0000","last_became_peered":"2024-09-12T00:31:54.165107+0000","last_unstale":"2024-09-12T01:29:48.728963+0000","last_undegraded":"2024-09-12T01:29:48.728963+0000","last_fullsized":"2024-09-12T01:29:48.728963+0000","mapping_epoch":31,"log_start":"265'301","ondisk_log_start":"265'301","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'317","last_scrub_stamp":"2024-09-12T01:29:48.728861+0000","last_deep_scrub":"265'317","last_deep_scrub_stamp":"2024-09-12T01:29:48.728861+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.728861+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:29.201879+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47816,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":1119,"num_write":414,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'743","reported_seq":2484,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.584137+0000","last_change":"2024-09-12T01:29:41.584137+0000","last_active":"2024-09-12T01:29:41.584137+0000","last_peered":"2024-09-12T01:29:41.584137+0000","last_clean":"2024-09-12T01:29:41.584137+0000","last_became_active":"2024-09-12T00:31:56.170388+0000","last_became_peered":"2024-09-12T00:31:56.170388+0000","last_unstale":"2024-09-12T01:29:41.584137+0000","last_undegraded":"2024-09-12T01:29:41.584137+0000","last_fullsized":"2024-09-12T01:29:41.584137+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'743","last_scrub_stamp":"2024-09-12T01:29:41.584051+0000","last_deep_scrub":"265'743","last_deep_scrub_stamp":"2024-09-12T01:29:41.584051+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.584051+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:32.038767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'166","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.065362+0000","last_change":"2024-09-12T01:29:51.065302+0000","last_active":"2024-09-12T01:29:51.065362+0000","last_peered":"2024-09-12T01:29:51.065362+0000","last_clean":"2024-09-12T01:29:51.065362+0000","last_became_active":"2024-09-12T00:31:58.171814+0000","last_became_peered":"2024-09-12T00:31:58.171814+0000","last_unstale":"2024-09-12T01:29:51.065362+0000","last_undegraded":"2024-09-12T01:29:51.065362+0000","last_fullsized":"2024-09-12T01:29:51.065362+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'166","last_scrub_stamp":"2024-09-12T01:29:51.065211+0000","last_deep_scrub":"265'166","last_deep_scrub_stamp":"2024-09-12T01:29:51.065211+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.065211+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:04.903106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":379,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'118","reported_seq":731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.425051+0000","last_change":"2024-09-12T01:29:33.424982+0000","last_active":"2024-09-12T01:29:33.425051+0000","last_peered":"2024-09-12T01:29:33.425051+0000","last_clean":"2024-09-12T01:29:33.425051+0000","last_became_active":"2024-09-12T00:31:50.142370+0000","last_became_peered":"2024-09-12T00:31:50.142370+0000","last_unstale":"2024-09-12T01:29:33.425051+0000","last_undegraded":"2024-09-12T01:29:33.425051+0000","last_fullsized":"2024-09-12T01:29:33.425051+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T01:29:33.424886+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T01:29:33.424886+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.424886+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:36.238841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":572,"num_read_kb":482,"num_write":177,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'312","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.966694+0000","last_change":"2024-09-12T01:29:26.966631+0000","last_active":"2024-09-12T01:29:26.966694+0000","last_peered":"2024-09-12T01:29:26.966694+0000","last_clean":"2024-09-12T01:29:26.966694+0000","last_became_active":"2024-09-12T00:31:47.122110+0000","last_became_peered":"2024-09-12T00:31:47.122110+0000","last_unstale":"2024-09-12T01:29:26.966694+0000","last_undegraded":"2024-09-12T01:29:26.966694+0000","last_fullsized":"2024-09-12T01:29:26.966694+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T01:29:26.966535+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T01:29:26.966535+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.966535+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:36.122577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":405,"num_read_kb":34909,"num_write":924,"num_write_kb":39966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1464,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.439536+0000","last_change":"2024-09-12T01:29:33.439536+0000","last_active":"2024-09-12T01:29:33.439536+0000","last_peered":"2024-09-12T01:29:33.439536+0000","last_clean":"2024-09-12T01:29:33.439536+0000","last_became_active":"2024-09-12T00:31:52.154858+0000","last_became_peered":"2024-09-12T00:31:52.154858+0000","last_unstale":"2024-09-12T01:29:33.439536+0000","last_undegraded":"2024-09-12T01:29:33.439536+0000","last_fullsized":"2024-09-12T01:29:33.439536+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T01:29:33.439442+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T01:29:33.439442+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.439442+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:52.079011+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'89","reported_seq":615,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.066130+0000","last_change":"2024-09-12T01:29:45.066130+0000","last_active":"2024-09-12T01:29:45.066130+0000","last_peered":"2024-09-12T01:29:45.066130+0000","last_clean":"2024-09-12T01:29:45.066130+0000","last_became_active":"2024-09-12T00:31:54.167362+0000","last_became_peered":"2024-09-12T00:31:54.167362+0000","last_unstale":"2024-09-12T01:29:45.066130+0000","last_undegraded":"2024-09-12T01:29:45.066130+0000","last_fullsized":"2024-09-12T01:29:45.066130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'89","last_scrub_stamp":"2024-09-12T01:29:45.066029+0000","last_deep_scrub":"265'89","last_deep_scrub_stamp":"2024-09-12T01:29:45.066029+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.066029+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:34.522067+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'772","reported_seq":2506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.635703+0000","last_change":"2024-09-12T01:29:44.635703+0000","last_active":"2024-09-12T01:29:44.635703+0000","last_peered":"2024-09-12T01:29:44.635703+0000","last_clean":"2024-09-12T01:29:44.635703+0000","last_became_active":"2024-09-12T00:31:56.173548+0000","last_became_peered":"2024-09-12T00:31:56.173548+0000","last_unstale":"2024-09-12T01:29:44.635703+0000","last_undegraded":"2024-09-12T01:29:44.635703+0000","last_fullsized":"2024-09-12T01:29:44.635703+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'772","last_scrub_stamp":"2024-09-12T01:29:44.635606+0000","last_deep_scrub":"265'772","last_deep_scrub_stamp":"2024-09-12T01:29:44.635606+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.635606+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:49.439061+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'124","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.486945+0000","last_change":"2024-09-12T01:29:44.486873+0000","last_active":"2024-09-12T01:29:44.486945+0000","last_peered":"2024-09-12T01:29:44.486945+0000","last_clean":"2024-09-12T01:29:44.486945+0000","last_became_active":"2024-09-12T00:31:58.174886+0000","last_became_peered":"2024-09-12T00:31:58.174886+0000","last_unstale":"2024-09-12T01:29:44.486945+0000","last_undegraded":"2024-09-12T01:29:44.486945+0000","last_fullsized":"2024-09-12T01:29:44.486945+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-12T01:29:44.486786+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-12T01:29:44.486786+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.486786+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:26.176189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":123,"num_write":278,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'279","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.555522+0000","last_change":"2024-09-12T01:29:27.555522+0000","last_active":"2024-09-12T01:29:27.555522+0000","last_peered":"2024-09-12T01:29:27.555522+0000","last_clean":"2024-09-12T01:29:27.555522+0000","last_became_active":"2024-09-12T00:31:50.139923+0000","last_became_peered":"2024-09-12T00:31:50.139923+0000","last_unstale":"2024-09-12T01:29:27.555522+0000","last_undegraded":"2024-09-12T01:29:27.555522+0000","last_fullsized":"2024-09-12T01:29:27.555522+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'279","last_scrub_stamp":"2024-09-12T01:29:27.555436+0000","last_deep_scrub":"265'279","last_deep_scrub_stamp":"2024-09-12T01:29:27.555436+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.555436+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:35.601614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":954,"num_write":459,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'365","reported_seq":1095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.692060+0000","last_change":"2024-09-12T01:29:25.691968+0000","last_active":"2024-09-12T01:29:25.692060+0000","last_peered":"2024-09-12T01:29:25.692060+0000","last_clean":"2024-09-12T01:29:25.692060+0000","last_became_active":"2024-09-12T00:31:47.122007+0000","last_became_peered":"2024-09-12T00:31:47.122007+0000","last_unstale":"2024-09-12T01:29:25.692060+0000","last_undegraded":"2024-09-12T01:29:25.692060+0000","last_fullsized":"2024-09-12T01:29:25.692060+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:29:25.691796+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:29:25.691796+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.691796+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:47.700467+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":650,"num_read_kb":69205,"num_write":1195,"num_write_kb":21863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.216129+0000","last_change":"2024-09-12T01:29:46.216129+0000","last_active":"2024-09-12T01:29:46.216129+0000","last_peered":"2024-09-12T01:29:46.216129+0000","last_clean":"2024-09-12T01:29:46.216129+0000","last_became_active":"2024-09-12T00:31:52.146894+0000","last_became_peered":"2024-09-12T00:31:52.146894+0000","last_unstale":"2024-09-12T01:29:46.216129+0000","last_undegraded":"2024-09-12T01:29:46.216129+0000","last_fullsized":"2024-09-12T01:29:46.216129+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:46.216043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:46.216043+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.216043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:38.272215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'428","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.518807+0000","last_change":"2024-09-12T01:29:38.518807+0000","last_active":"2024-09-12T01:29:38.518807+0000","last_peered":"2024-09-12T01:29:38.518807+0000","last_clean":"2024-09-12T01:29:38.518807+0000","last_became_active":"2024-09-12T00:31:54.170522+0000","last_became_peered":"2024-09-12T00:31:54.170522+0000","last_unstale":"2024-09-12T01:29:38.518807+0000","last_undegraded":"2024-09-12T01:29:38.518807+0000","last_fullsized":"2024-09-12T01:29:38.518807+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'428","last_scrub_stamp":"2024-09-12T01:29:38.518712+0000","last_deep_scrub":"265'428","last_deep_scrub_stamp":"2024-09-12T01:29:38.518712+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.518712+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:16.110530+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48295,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1274,"num_read_kb":1983,"num_write":1802,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487990,"num_omap_keys":1124,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.378148+0000","last_change":"2024-09-12T01:29:41.378148+0000","last_active":"2024-09-12T01:29:41.378148+0000","last_peered":"2024-09-12T01:29:41.378148+0000","last_clean":"2024-09-12T01:29:41.378148+0000","last_became_active":"2024-09-12T00:31:56.168503+0000","last_became_peered":"2024-09-12T00:31:56.168503+0000","last_unstale":"2024-09-12T01:29:41.378148+0000","last_undegraded":"2024-09-12T01:29:41.378148+0000","last_fullsized":"2024-09-12T01:29:41.378148+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:41.378029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:41.378029+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.378029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:55.766428+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'131","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.576369+0000","last_change":"2024-09-12T01:29:45.576315+0000","last_active":"2024-09-12T01:29:45.576369+0000","last_peered":"2024-09-12T01:29:45.576369+0000","last_clean":"2024-09-12T01:29:45.576369+0000","last_became_active":"2024-09-12T00:31:58.172778+0000","last_became_peered":"2024-09-12T00:31:58.172778+0000","last_unstale":"2024-09-12T01:29:45.576369+0000","last_undegraded":"2024-09-12T01:29:45.576369+0000","last_fullsized":"2024-09-12T01:29:45.576369+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'131","last_scrub_stamp":"2024-09-12T01:29:45.576233+0000","last_deep_scrub":"265'131","last_deep_scrub_stamp":"2024-09-12T01:29:45.576233+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.576233+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:05.050007+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":147,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'168","reported_seq":789,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.070962+0000","last_change":"2024-09-12T01:29:36.070874+0000","last_active":"2024-09-12T01:29:36.070962+0000","last_peered":"2024-09-12T01:29:36.070962+0000","last_clean":"2024-09-12T01:29:36.070962+0000","last_became_active":"2024-09-12T00:31:50.131152+0000","last_became_peered":"2024-09-12T00:31:50.131152+0000","last_unstale":"2024-09-12T01:29:36.070962+0000","last_undegraded":"2024-09-12T01:29:36.070962+0000","last_fullsized":"2024-09-12T01:29:36.070962+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T01:29:36.070783+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T01:29:36.070783+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.070783+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:43.699210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":649,"num_write":266,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:20.379019+0000","last_change":"2024-09-12T01:29:20.378968+0000","last_active":"2024-09-12T01:29:20.379019+0000","last_peered":"2024-09-12T01:29:20.379019+0000","last_clean":"2024-09-12T01:29:20.379019+0000","last_became_active":"2024-09-12T00:31:29.750331+0000","last_became_peered":"2024-09-12T00:31:29.750331+0000","last_unstale":"2024-09-12T01:29:20.379019+0000","last_undegraded":"2024-09-12T01:29:20.379019+0000","last_fullsized":"2024-09-12T01:29:20.379019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T01:29:20.378884+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T01:29:20.378884+0000","last_clean_scrub_stamp":"2024-09-12T01:29:20.378884+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:33.781295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":538,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.006791+0000","last_change":"2024-09-12T01:29:23.006742+0000","last_active":"2024-09-12T01:29:23.006791+0000","last_peered":"2024-09-12T01:29:23.006791+0000","last_clean":"2024-09-12T01:29:23.006791+0000","last_became_active":"2024-09-12T00:31:36.970959+0000","last_became_peered":"2024-09-12T00:31:36.970959+0000","last_unstale":"2024-09-12T01:29:23.006791+0000","last_undegraded":"2024-09-12T01:29:23.006791+0000","last_fullsized":"2024-09-12T01:29:23.006791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:23.006670+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:23.006670+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.006670+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:37.618480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00098350799999999991,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'319","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.691668+0000","last_change":"2024-09-12T01:29:22.691569+0000","last_active":"2024-09-12T01:29:22.691668+0000","last_peered":"2024-09-12T01:29:22.691668+0000","last_clean":"2024-09-12T01:29:22.691668+0000","last_became_active":"2024-09-12T00:31:47.130015+0000","last_became_peered":"2024-09-12T00:31:47.130015+0000","last_unstale":"2024-09-12T01:29:22.691668+0000","last_undegraded":"2024-09-12T01:29:22.691668+0000","last_fullsized":"2024-09-12T01:29:22.691668+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T01:29:22.691380+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T01:29:22.691380+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.691380+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:41.799155+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":117828,"num_write":1049,"num_write_kb":35803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.185268+0000","last_change":"2024-09-12T01:29:37.185179+0000","last_active":"2024-09-12T01:29:37.185268+0000","last_peered":"2024-09-12T01:29:37.185268+0000","last_clean":"2024-09-12T01:29:37.185268+0000","last_became_active":"2024-09-12T00:31:52.148316+0000","last_became_peered":"2024-09-12T00:31:52.148316+0000","last_unstale":"2024-09-12T01:29:37.185268+0000","last_undegraded":"2024-09-12T01:29:37.185268+0000","last_fullsized":"2024-09-12T01:29:37.185268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:37.185077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:37.185077+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.185077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:01.475225+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'720","reported_seq":1440,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.252851+0000","last_change":"2024-09-12T01:29:52.252851+0000","last_active":"2024-09-12T01:29:52.252851+0000","last_peered":"2024-09-12T01:29:52.252851+0000","last_clean":"2024-09-12T01:29:52.252851+0000","last_became_active":"2024-09-12T00:31:54.163482+0000","last_became_peered":"2024-09-12T00:31:54.163482+0000","last_unstale":"2024-09-12T01:29:52.252851+0000","last_undegraded":"2024-09-12T01:29:52.252851+0000","last_fullsized":"2024-09-12T01:29:52.252851+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'720","last_scrub_stamp":"2024-09-12T01:29:52.252740+0000","last_deep_scrub":"265'720","last_deep_scrub_stamp":"2024-09-12T01:29:52.252740+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.252740+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:38.458907+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135081,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1399,"num_read_kb":3136,"num_write":1308,"num_write_kb":1145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":90068,"num_omap_keys":220,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.730937+0000","last_change":"2024-09-12T01:29:49.730937+0000","last_active":"2024-09-12T01:29:49.730937+0000","last_peered":"2024-09-12T01:29:49.730937+0000","last_clean":"2024-09-12T01:29:49.730937+0000","last_became_active":"2024-09-12T00:31:56.170545+0000","last_became_peered":"2024-09-12T00:31:56.170545+0000","last_unstale":"2024-09-12T01:29:49.730937+0000","last_undegraded":"2024-09-12T01:29:49.730937+0000","last_fullsized":"2024-09-12T01:29:49.730937+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:49.730847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:49.730847+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.730847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:09.954024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'201","reported_seq":910,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.103082+0000","last_change":"2024-09-12T01:29:44.103082+0000","last_active":"2024-09-12T01:29:44.103082+0000","last_peered":"2024-09-12T01:29:44.103082+0000","last_clean":"2024-09-12T01:29:44.103082+0000","last_became_active":"2024-09-12T00:31:58.184941+0000","last_became_peered":"2024-09-12T00:31:58.184941+0000","last_unstale":"2024-09-12T01:29:44.103082+0000","last_undegraded":"2024-09-12T01:29:44.103082+0000","last_fullsized":"2024-09-12T01:29:44.103082+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'201","last_scrub_stamp":"2024-09-12T01:29:44.102997+0000","last_deep_scrub":"265'201","last_deep_scrub_stamp":"2024-09-12T01:29:44.102997+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.102997+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:42.375967+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1234,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":433,"num_write":415,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'95","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.799727+0000","last_change":"2024-09-12T01:29:39.799672+0000","last_active":"2024-09-12T01:29:39.799727+0000","last_peered":"2024-09-12T01:29:39.799727+0000","last_clean":"2024-09-12T01:29:39.799727+0000","last_became_active":"2024-09-12T00:31:50.137393+0000","last_became_peered":"2024-09-12T00:31:50.137393+0000","last_unstale":"2024-09-12T01:29:39.799727+0000","last_undegraded":"2024-09-12T01:29:39.799727+0000","last_fullsized":"2024-09-12T01:29:39.799727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'95","last_scrub_stamp":"2024-09-12T01:29:39.799515+0000","last_deep_scrub":"265'95","last_deep_scrub_stamp":"2024-09-12T01:29:39.799515+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.799515+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:12.573956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":346,"num_write":149,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":537,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.997701+0000","last_change":"2024-09-12T01:29:21.997656+0000","last_active":"2024-09-12T01:29:21.997701+0000","last_peered":"2024-09-12T01:29:21.997701+0000","last_clean":"2024-09-12T01:29:21.997701+0000","last_became_active":"2024-09-12T00:31:36.772301+0000","last_became_peered":"2024-09-12T00:31:36.772301+0000","last_unstale":"2024-09-12T01:29:21.997701+0000","last_undegraded":"2024-09-12T01:29:21.997701+0000","last_fullsized":"2024-09-12T01:29:21.997701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:21.997579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:21.997579+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.997579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:49.342018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070272599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'371","reported_seq":1038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.261016+0000","last_change":"2024-09-12T01:29:23.260959+0000","last_active":"2024-09-12T01:29:23.261016+0000","last_peered":"2024-09-12T01:29:23.261016+0000","last_clean":"2024-09-12T01:29:23.261016+0000","last_became_active":"2024-09-12T00:31:47.121537+0000","last_became_peered":"2024-09-12T00:31:47.121537+0000","last_unstale":"2024-09-12T01:29:23.261016+0000","last_undegraded":"2024-09-12T01:29:23.261016+0000","last_fullsized":"2024-09-12T01:29:23.261016+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-12T01:29:23.260822+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-12T01:29:23.260822+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.260822+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:08.129052+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306567,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":587,"num_read_kb":9552,"num_write":1166,"num_write_kb":21951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.199954+0000","last_change":"2024-09-12T01:29:45.199954+0000","last_active":"2024-09-12T01:29:45.199954+0000","last_peered":"2024-09-12T01:29:45.199954+0000","last_clean":"2024-09-12T01:29:45.199954+0000","last_became_active":"2024-09-12T00:31:52.147719+0000","last_became_peered":"2024-09-12T00:31:52.147719+0000","last_unstale":"2024-09-12T01:29:45.199954+0000","last_undegraded":"2024-09-12T01:29:45.199954+0000","last_fullsized":"2024-09-12T01:29:45.199954+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:45.199854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:45.199854+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.199854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:45.975132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1270","reported_seq":2913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.539359+0000","last_change":"2024-09-12T01:29:38.539274+0000","last_active":"2024-09-12T01:29:38.539359+0000","last_peered":"2024-09-12T01:29:38.539359+0000","last_clean":"2024-09-12T01:29:38.539359+0000","last_became_active":"2024-09-12T00:31:54.168085+0000","last_became_peered":"2024-09-12T00:31:54.168085+0000","last_unstale":"2024-09-12T01:29:38.539359+0000","last_undegraded":"2024-09-12T01:29:38.539359+0000","last_fullsized":"2024-09-12T01:29:38.539359+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1270","last_scrub_stamp":"2024-09-12T01:29:38.539154+0000","last_deep_scrub":"265'1270","last_deep_scrub_stamp":"2024-09-12T01:29:38.539154+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.539154+0000","objects_scrubbed":12,"log_size":70,"log_dups_size":1200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:12.785352+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145044,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2035,"num_read_kb":3748,"num_write":1136,"num_write_kb":952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.331269+0000","last_change":"2024-09-12T01:29:58.331269+0000","last_active":"2024-09-12T01:29:58.331269+0000","last_peered":"2024-09-12T01:29:58.331269+0000","last_clean":"2024-09-12T01:29:58.331269+0000","last_became_active":"2024-09-12T00:31:56.170725+0000","last_became_peered":"2024-09-12T00:31:56.170725+0000","last_unstale":"2024-09-12T01:29:58.331269+0000","last_undegraded":"2024-09-12T01:29:58.331269+0000","last_fullsized":"2024-09-12T01:29:58.331269+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:58.331165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:58.331165+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.331165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:07.468986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'208","reported_seq":737,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.778945+0000","last_change":"2024-09-12T01:29:55.778945+0000","last_active":"2024-09-12T01:29:55.778945+0000","last_peered":"2024-09-12T01:29:55.778945+0000","last_clean":"2024-09-12T01:29:55.778945+0000","last_became_active":"2024-09-12T00:31:58.182565+0000","last_became_peered":"2024-09-12T00:31:58.182565+0000","last_unstale":"2024-09-12T01:29:55.778945+0000","last_undegraded":"2024-09-12T01:29:55.778945+0000","last_fullsized":"2024-09-12T01:29:55.778945+0000","mapping_epoch":35,"log_start":"262'100","ondisk_log_start":"262'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'208","last_scrub_stamp":"2024-09-12T01:29:55.778831+0000","last_deep_scrub":"265'208","last_deep_scrub_stamp":"2024-09-12T01:29:55.778831+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.778831+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:24.118489+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":315,"num_read_kb":314,"num_write":438,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'335","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.144095+0000","last_change":"2024-09-12T01:29:35.144020+0000","last_active":"2024-09-12T01:29:35.144095+0000","last_peered":"2024-09-12T01:29:35.144095+0000","last_clean":"2024-09-12T01:29:35.144095+0000","last_became_active":"2024-09-12T00:31:50.135930+0000","last_became_peered":"2024-09-12T00:31:50.135930+0000","last_unstale":"2024-09-12T01:29:35.144095+0000","last_undegraded":"2024-09-12T01:29:35.144095+0000","last_fullsized":"2024-09-12T01:29:35.144095+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T01:29:35.143930+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T01:29:35.143930+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.143930+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:55.298509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1457,"num_read_kb":1188,"num_write":528,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":541,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.623192+0000","last_change":"2024-09-12T01:29:23.623127+0000","last_active":"2024-09-12T01:29:23.623192+0000","last_peered":"2024-09-12T01:29:23.623192+0000","last_clean":"2024-09-12T01:29:23.623192+0000","last_became_active":"2024-09-12T00:31:36.774484+0000","last_became_peered":"2024-09-12T00:31:36.774484+0000","last_unstale":"2024-09-12T01:29:23.623192+0000","last_undegraded":"2024-09-12T01:29:23.623192+0000","last_fullsized":"2024-09-12T01:29:23.623192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:23.623036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:23.623036+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.623036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:41.999199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040283499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'343","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.784276+0000","last_change":"2024-09-12T01:29:23.784214+0000","last_active":"2024-09-12T01:29:23.784276+0000","last_peered":"2024-09-12T01:29:23.784276+0000","last_clean":"2024-09-12T01:29:23.784276+0000","last_became_active":"2024-09-12T00:31:47.123249+0000","last_became_peered":"2024-09-12T00:31:47.123249+0000","last_unstale":"2024-09-12T01:29:23.784276+0000","last_undegraded":"2024-09-12T01:29:23.784276+0000","last_fullsized":"2024-09-12T01:29:23.784276+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T01:29:23.784066+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T01:29:23.784066+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.784066+0000","objects_scrubbed":10,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:32.413879+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291498,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":12898,"num_write":1156,"num_write_kb":44550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.599233+0000","last_change":"2024-09-12T01:29:34.599233+0000","last_active":"2024-09-12T01:29:34.599233+0000","last_peered":"2024-09-12T01:29:34.599233+0000","last_clean":"2024-09-12T01:29:34.599233+0000","last_became_active":"2024-09-12T00:31:52.155926+0000","last_became_peered":"2024-09-12T00:31:52.155926+0000","last_unstale":"2024-09-12T01:29:34.599233+0000","last_undegraded":"2024-09-12T01:29:34.599233+0000","last_fullsized":"2024-09-12T01:29:34.599233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:34.599149+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:34.599149+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.599149+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:15.139311+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'258","reported_seq":1496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.191396+0000","last_change":"2024-09-12T01:29:39.191396+0000","last_active":"2024-09-12T01:29:39.191396+0000","last_peered":"2024-09-12T01:29:39.191396+0000","last_clean":"2024-09-12T01:29:39.191396+0000","last_became_active":"2024-09-12T00:31:54.174937+0000","last_became_peered":"2024-09-12T00:31:54.174937+0000","last_unstale":"2024-09-12T01:29:39.191396+0000","last_undegraded":"2024-09-12T01:29:39.191396+0000","last_fullsized":"2024-09-12T01:29:39.191396+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'258","last_scrub_stamp":"2024-09-12T01:29:39.191302+0000","last_deep_scrub":"265'258","last_deep_scrub_stamp":"2024-09-12T01:29:39.191302+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.191302+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:50.175459+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":202,"num_write":187,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.603153+0000","last_change":"2024-09-12T01:29:53.603097+0000","last_active":"2024-09-12T01:29:53.603153+0000","last_peered":"2024-09-12T01:29:53.603153+0000","last_clean":"2024-09-12T01:29:53.603153+0000","last_became_active":"2024-09-12T00:31:56.171071+0000","last_became_peered":"2024-09-12T00:31:56.171071+0000","last_unstale":"2024-09-12T01:29:53.603153+0000","last_undegraded":"2024-09-12T01:29:53.603153+0000","last_fullsized":"2024-09-12T01:29:53.603153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:53.603007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:53.603007+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.603007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:40.755561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'242","reported_seq":857,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.601359+0000","last_change":"2024-09-12T01:29:56.601359+0000","last_active":"2024-09-12T01:29:56.601359+0000","last_peered":"2024-09-12T01:29:56.601359+0000","last_clean":"2024-09-12T01:29:56.601359+0000","last_became_active":"2024-09-12T00:31:58.176931+0000","last_became_peered":"2024-09-12T00:31:58.176931+0000","last_unstale":"2024-09-12T01:29:56.601359+0000","last_undegraded":"2024-09-12T01:29:56.601359+0000","last_fullsized":"2024-09-12T01:29:56.601359+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'242","last_scrub_stamp":"2024-09-12T01:29:56.601272+0000","last_deep_scrub":"265'242","last_deep_scrub_stamp":"2024-09-12T01:29:56.601272+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.601272+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:19.448047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":495,"num_write":504,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'416","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.172832+0000","last_change":"2024-09-12T01:29:33.172754+0000","last_active":"2024-09-12T01:29:33.172832+0000","last_peered":"2024-09-12T01:29:33.172832+0000","last_clean":"2024-09-12T01:29:33.172832+0000","last_became_active":"2024-09-12T00:31:50.139625+0000","last_became_peered":"2024-09-12T00:31:50.139625+0000","last_unstale":"2024-09-12T01:29:33.172832+0000","last_undegraded":"2024-09-12T01:29:33.172832+0000","last_fullsized":"2024-09-12T01:29:33.172832+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'416","last_scrub_stamp":"2024-09-12T01:29:33.172645+0000","last_deep_scrub":"265'416","last_deep_scrub_stamp":"2024-09-12T01:29:33.172645+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.172645+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:16.906066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1805,"num_read_kb":1431,"num_write":644,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":539,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.003186+0000","last_change":"2024-09-12T01:29:21.003127+0000","last_active":"2024-09-12T01:29:21.003186+0000","last_peered":"2024-09-12T01:29:21.003186+0000","last_clean":"2024-09-12T01:29:21.003186+0000","last_became_active":"2024-09-12T00:31:37.736683+0000","last_became_peered":"2024-09-12T00:31:37.736683+0000","last_unstale":"2024-09-12T01:29:21.003186+0000","last_undegraded":"2024-09-12T01:29:21.003186+0000","last_fullsized":"2024-09-12T01:29:21.003186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:21.003063+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:21.003063+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.003063+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:50.711321+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001295757,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'316","reported_seq":1163,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:19.963009+0000","last_change":"2024-09-12T01:29:19.962927+0000","last_active":"2024-09-12T01:29:19.963009+0000","last_peered":"2024-09-12T01:29:19.963009+0000","last_clean":"2024-09-12T01:29:19.963009+0000","last_became_active":"2024-09-12T00:31:47.136714+0000","last_became_peered":"2024-09-12T00:31:47.136714+0000","last_unstale":"2024-09-12T01:29:19.963009+0000","last_undegraded":"2024-09-12T01:29:19.963009+0000","last_fullsized":"2024-09-12T01:29:19.963009+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T01:29:19.962830+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T01:29:19.962830+0000","last_clean_scrub_stamp":"2024-09-12T01:29:19.962830+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:02.608178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":889,"num_read_kb":29272,"num_write":1058,"num_write_kb":35686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":514,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.582530+0000","last_change":"2024-09-12T01:29:35.582530+0000","last_active":"2024-09-12T01:29:35.582530+0000","last_peered":"2024-09-12T01:29:35.582530+0000","last_clean":"2024-09-12T01:29:35.582530+0000","last_became_active":"2024-09-12T00:31:52.148995+0000","last_became_peered":"2024-09-12T00:31:52.148995+0000","last_unstale":"2024-09-12T01:29:35.582530+0000","last_undegraded":"2024-09-12T01:29:35.582530+0000","last_fullsized":"2024-09-12T01:29:35.582530+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:35.582425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:35.582425+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.582425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:11.996704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'144","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.751175+0000","last_change":"2024-09-12T01:29:47.751175+0000","last_active":"2024-09-12T01:29:47.751175+0000","last_peered":"2024-09-12T01:29:47.751175+0000","last_clean":"2024-09-12T01:29:47.751175+0000","last_became_active":"2024-09-12T00:31:54.167813+0000","last_became_peered":"2024-09-12T00:31:54.167813+0000","last_unstale":"2024-09-12T01:29:47.751175+0000","last_undegraded":"2024-09-12T01:29:47.751175+0000","last_fullsized":"2024-09-12T01:29:47.751175+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:29:47.751074+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:29:47.751074+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.751074+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:58.423569+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":166,"num_read_kb":157,"num_write":122,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.336051+0000","last_change":"2024-09-12T01:29:57.336051+0000","last_active":"2024-09-12T01:29:57.336051+0000","last_peered":"2024-09-12T01:29:57.336051+0000","last_clean":"2024-09-12T01:29:57.336051+0000","last_became_active":"2024-09-12T00:31:56.172693+0000","last_became_peered":"2024-09-12T00:31:56.172693+0000","last_unstale":"2024-09-12T01:29:57.336051+0000","last_undegraded":"2024-09-12T01:29:57.336051+0000","last_fullsized":"2024-09-12T01:29:57.336051+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:57.335968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:57.335968+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.335968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:38.140354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'163","reported_seq":742,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.702900+0000","last_change":"2024-09-12T01:29:48.702900+0000","last_active":"2024-09-12T01:29:48.702900+0000","last_peered":"2024-09-12T01:29:48.702900+0000","last_clean":"2024-09-12T01:29:48.702900+0000","last_became_active":"2024-09-12T00:31:58.177206+0000","last_became_peered":"2024-09-12T00:31:58.177206+0000","last_unstale":"2024-09-12T01:29:48.702900+0000","last_undegraded":"2024-09-12T01:29:48.702900+0000","last_fullsized":"2024-09-12T01:29:48.702900+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'163","last_scrub_stamp":"2024-09-12T01:29:48.702813+0000","last_deep_scrub":"265'163","last_deep_scrub_stamp":"2024-09-12T01:29:48.702813+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.702813+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:25.149863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":267,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'249","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.214021+0000","last_change":"2024-09-12T01:29:32.213962+0000","last_active":"2024-09-12T01:29:32.214021+0000","last_peered":"2024-09-12T01:29:32.214021+0000","last_clean":"2024-09-12T01:29:32.214021+0000","last_became_active":"2024-09-12T00:31:50.135333+0000","last_became_peered":"2024-09-12T00:31:50.135333+0000","last_unstale":"2024-09-12T01:29:32.214021+0000","last_undegraded":"2024-09-12T01:29:32.214021+0000","last_fullsized":"2024-09-12T01:29:32.214021+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'249","last_scrub_stamp":"2024-09-12T01:29:32.213855+0000","last_deep_scrub":"265'249","last_deep_scrub_stamp":"2024-09-12T01:29:32.213855+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.213855+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:37.155698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1106,"num_read_kb":893,"num_write":406,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'297","reported_seq":914,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.373673+0000","last_change":"2024-09-12T01:29:22.373673+0000","last_active":"2024-09-12T01:29:22.373673+0000","last_peered":"2024-09-12T01:29:22.373673+0000","last_clean":"2024-09-12T01:29:22.373673+0000","last_became_active":"2024-09-12T00:31:47.131943+0000","last_became_peered":"2024-09-12T00:31:47.131943+0000","last_unstale":"2024-09-12T01:29:22.373673+0000","last_undegraded":"2024-09-12T01:29:22.373673+0000","last_fullsized":"2024-09-12T01:29:22.373673+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'297","last_scrub_stamp":"2024-09-12T01:29:22.373580+0000","last_deep_scrub":"265'297","last_deep_scrub_stamp":"2024-09-12T01:29:22.373580+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.373580+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:13.861521+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7951494,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":382,"num_read_kb":39412,"num_write":972,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.825117+0000","last_change":"2024-09-12T01:29:22.825062+0000","last_active":"2024-09-12T01:29:22.825117+0000","last_peered":"2024-09-12T01:29:22.825117+0000","last_clean":"2024-09-12T01:29:22.825117+0000","last_became_active":"2024-09-12T00:31:37.736507+0000","last_became_peered":"2024-09-12T00:31:37.736507+0000","last_unstale":"2024-09-12T01:29:22.825117+0000","last_undegraded":"2024-09-12T01:29:22.825117+0000","last_fullsized":"2024-09-12T01:29:22.825117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:22.824962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:22.824962+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.824962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:54.694034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00050928200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.575838+0000","last_change":"2024-09-12T01:29:39.575781+0000","last_active":"2024-09-12T01:29:39.575838+0000","last_peered":"2024-09-12T01:29:39.575838+0000","last_clean":"2024-09-12T01:29:39.575838+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:29:39.575838+0000","last_undegraded":"2024-09-12T01:29:39.575838+0000","last_fullsized":"2024-09-12T01:29:39.575838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:39.575696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:39.575696+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.575696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:20.724735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'612","reported_seq":1310,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.560473+0000","last_change":"2024-09-12T01:29:37.560415+0000","last_active":"2024-09-12T01:29:37.560473+0000","last_peered":"2024-09-12T01:29:37.560473+0000","last_clean":"2024-09-12T01:29:37.560473+0000","last_became_active":"2024-09-12T00:31:54.162596+0000","last_became_peered":"2024-09-12T00:31:54.162596+0000","last_unstale":"2024-09-12T01:29:37.560473+0000","last_undegraded":"2024-09-12T01:29:37.560473+0000","last_fullsized":"2024-09-12T01:29:37.560473+0000","mapping_epoch":31,"log_start":"265'600","ondisk_log_start":"265'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'612","last_scrub_stamp":"2024-09-12T01:29:37.560320+0000","last_deep_scrub":"265'612","last_deep_scrub_stamp":"2024-09-12T01:29:37.560320+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.560320+0000","objects_scrubbed":11,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:15.707785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88936,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1027,"num_read_kb":2220,"num_write":890,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.402442+0000","last_change":"2024-09-12T01:29:42.402364+0000","last_active":"2024-09-12T01:29:42.402442+0000","last_peered":"2024-09-12T01:29:42.402442+0000","last_clean":"2024-09-12T01:29:42.402442+0000","last_became_active":"2024-09-12T00:31:56.170246+0000","last_became_peered":"2024-09-12T00:31:56.170246+0000","last_unstale":"2024-09-12T01:29:42.402442+0000","last_undegraded":"2024-09-12T01:29:42.402442+0000","last_fullsized":"2024-09-12T01:29:42.402442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:42.402278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:42.402278+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.402278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:40.856339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'142","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.794429+0000","last_change":"2024-09-12T01:29:57.794429+0000","last_active":"2024-09-12T01:29:57.794429+0000","last_peered":"2024-09-12T01:29:57.794429+0000","last_clean":"2024-09-12T01:29:57.794429+0000","last_became_active":"2024-09-12T00:31:58.183206+0000","last_became_peered":"2024-09-12T00:31:58.183206+0000","last_unstale":"2024-09-12T01:29:57.794429+0000","last_undegraded":"2024-09-12T01:29:57.794429+0000","last_fullsized":"2024-09-12T01:29:57.794429+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T01:29:57.794338+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T01:29:57.794338+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.794338+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:29.307740+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":155,"num_write":341,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'131","reported_seq":743,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.143228+0000","last_change":"2024-09-12T01:29:34.143157+0000","last_active":"2024-09-12T01:29:34.143228+0000","last_peered":"2024-09-12T01:29:34.143228+0000","last_clean":"2024-09-12T01:29:34.143228+0000","last_became_active":"2024-09-12T00:31:50.135197+0000","last_became_peered":"2024-09-12T00:31:50.135197+0000","last_unstale":"2024-09-12T01:29:34.143228+0000","last_undegraded":"2024-09-12T01:29:34.143228+0000","last_fullsized":"2024-09-12T01:29:34.143228+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'131","last_scrub_stamp":"2024-09-12T01:29:34.143073+0000","last_deep_scrub":"265'131","last_deep_scrub_stamp":"2024-09-12T01:29:34.143073+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.143073+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:09.129556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":577,"num_read_kb":479,"num_write":210,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'302","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.253250+0000","last_change":"2024-09-12T01:29:25.253191+0000","last_active":"2024-09-12T01:29:25.253250+0000","last_peered":"2024-09-12T01:29:25.253250+0000","last_clean":"2024-09-12T01:29:25.253250+0000","last_became_active":"2024-09-12T00:31:47.121355+0000","last_became_peered":"2024-09-12T00:31:47.121355+0000","last_unstale":"2024-09-12T01:29:25.253250+0000","last_undegraded":"2024-09-12T01:29:25.253250+0000","last_fullsized":"2024-09-12T01:29:25.253250+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'302","last_scrub_stamp":"2024-09-12T01:29:25.253069+0000","last_deep_scrub":"265'302","last_deep_scrub_stamp":"2024-09-12T01:29:25.253069+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.253069+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:56.001061+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":443,"num_write":1003,"num_write_kb":5362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.031764+0000","last_change":"2024-09-12T01:29:24.031667+0000","last_active":"2024-09-12T01:29:24.031764+0000","last_peered":"2024-09-12T01:29:24.031764+0000","last_clean":"2024-09-12T01:29:24.031764+0000","last_became_active":"2024-09-12T00:31:36.774289+0000","last_became_peered":"2024-09-12T00:31:36.774289+0000","last_unstale":"2024-09-12T01:29:24.031764+0000","last_undegraded":"2024-09-12T01:29:24.031764+0000","last_fullsized":"2024-09-12T01:29:24.031764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:24.031584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:24.031584+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.031584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:30.910975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063853100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"265'10","reported_seq":1470,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.196197+0000","last_change":"2024-09-12T01:29:35.196095+0000","last_active":"2024-09-12T01:29:35.196197+0000","last_peered":"2024-09-12T01:29:35.196197+0000","last_clean":"2024-09-12T01:29:35.196197+0000","last_became_active":"2024-09-12T00:31:52.147856+0000","last_became_peered":"2024-09-12T00:31:52.147856+0000","last_unstale":"2024-09-12T01:29:35.196197+0000","last_undegraded":"2024-09-12T01:29:35.196197+0000","last_fullsized":"2024-09-12T01:29:35.196197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:29:35.195968+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:29:35.195968+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.195968+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:49.978709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1609,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1450,"num_read_kb":1911,"num_write":16,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'184","reported_seq":763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.102578+0000","last_change":"2024-09-12T01:29:44.102514+0000","last_active":"2024-09-12T01:29:44.102578+0000","last_peered":"2024-09-12T01:29:44.102578+0000","last_clean":"2024-09-12T01:29:44.102578+0000","last_became_active":"2024-09-12T00:31:54.169958+0000","last_became_peered":"2024-09-12T00:31:54.169958+0000","last_unstale":"2024-09-12T01:29:44.102578+0000","last_undegraded":"2024-09-12T01:29:44.102578+0000","last_fullsized":"2024-09-12T01:29:44.102578+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'184","last_scrub_stamp":"2024-09-12T01:29:44.102427+0000","last_deep_scrub":"265'184","last_deep_scrub_stamp":"2024-09-12T01:29:44.102427+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.102427+0000","objects_scrubbed":8,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:26.857668+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":229,"num_read_kb":218,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'773","reported_seq":2829,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.590214+0000","last_change":"2024-09-12T01:29:43.590121+0000","last_active":"2024-09-12T01:29:43.590214+0000","last_peered":"2024-09-12T01:29:43.590214+0000","last_clean":"2024-09-12T01:29:43.590214+0000","last_became_active":"2024-09-12T00:31:56.174535+0000","last_became_peered":"2024-09-12T00:31:56.174535+0000","last_unstale":"2024-09-12T01:29:43.590214+0000","last_undegraded":"2024-09-12T01:29:43.590214+0000","last_fullsized":"2024-09-12T01:29:43.590214+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-12T01:29:43.589995+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-12T01:29:43.589995+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.589995+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:13.733386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'117","reported_seq":630,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.588328+0000","last_change":"2024-09-12T01:29:47.588328+0000","last_active":"2024-09-12T01:29:47.588328+0000","last_peered":"2024-09-12T01:29:47.588328+0000","last_clean":"2024-09-12T01:29:47.588328+0000","last_became_active":"2024-09-12T00:31:58.174086+0000","last_became_peered":"2024-09-12T00:31:58.174086+0000","last_unstale":"2024-09-12T01:29:47.588328+0000","last_undegraded":"2024-09-12T01:29:47.588328+0000","last_fullsized":"2024-09-12T01:29:47.588328+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'117","last_scrub_stamp":"2024-09-12T01:29:47.588239+0000","last_deep_scrub":"265'117","last_deep_scrub_stamp":"2024-09-12T01:29:47.588239+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.588239+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:45.651262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":255,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'4368","reported_seq":5129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.552121+0000","last_change":"2024-09-12T01:29:30.552027+0000","last_active":"2024-09-12T01:29:30.552121+0000","last_peered":"2024-09-12T01:29:30.552121+0000","last_clean":"2024-09-12T01:29:30.552121+0000","last_became_active":"2024-09-12T00:31:50.132703+0000","last_became_peered":"2024-09-12T00:31:50.132703+0000","last_unstale":"2024-09-12T01:29:30.552121+0000","last_undegraded":"2024-09-12T01:29:30.552121+0000","last_fullsized":"2024-09-12T01:29:30.552121+0000","mapping_epoch":27,"log_start":"265'4300","ondisk_log_start":"265'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4368","last_scrub_stamp":"2024-09-12T01:29:30.551927+0000","last_deep_scrub":"265'4368","last_deep_scrub_stamp":"2024-09-12T01:29:30.551927+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.551927+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:47.227065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17817,"num_read_kb":14914,"num_write":6561,"num_write_kb":3320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25749,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'309","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.675808+0000","last_change":"2024-09-12T01:29:24.675750+0000","last_active":"2024-09-12T01:29:24.675808+0000","last_peered":"2024-09-12T01:29:24.675808+0000","last_clean":"2024-09-12T01:29:24.675808+0000","last_became_active":"2024-09-12T00:31:47.116205+0000","last_became_peered":"2024-09-12T00:31:47.116205+0000","last_unstale":"2024-09-12T01:29:24.675808+0000","last_undegraded":"2024-09-12T01:29:24.675808+0000","last_fullsized":"2024-09-12T01:29:24.675808+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-12T01:29:24.675634+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-12T01:29:24.675634+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.675634+0000","objects_scrubbed":9,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:00.404652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704304,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":481,"num_read_kb":46756,"num_write":1080,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":540,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.710185+0000","last_change":"2024-09-12T01:29:21.710111+0000","last_active":"2024-09-12T01:29:21.710185+0000","last_peered":"2024-09-12T01:29:21.710185+0000","last_clean":"2024-09-12T01:29:21.710185+0000","last_became_active":"2024-09-12T00:31:37.434707+0000","last_became_peered":"2024-09-12T00:31:37.434707+0000","last_unstale":"2024-09-12T01:29:21.710185+0000","last_undegraded":"2024-09-12T01:29:21.710185+0000","last_fullsized":"2024-09-12T01:29:21.710185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:21.710025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:21.710025+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.710025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:10.521409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041578299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.238291+0000","last_change":"2024-09-12T01:29:47.238216+0000","last_active":"2024-09-12T01:29:47.238291+0000","last_peered":"2024-09-12T01:29:47.238291+0000","last_clean":"2024-09-12T01:29:47.238291+0000","last_became_active":"2024-09-12T00:31:52.146927+0000","last_became_peered":"2024-09-12T00:31:52.146927+0000","last_unstale":"2024-09-12T01:29:47.238291+0000","last_undegraded":"2024-09-12T01:29:47.238291+0000","last_fullsized":"2024-09-12T01:29:47.238291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:47.238121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:47.238121+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.238121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.005209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'135","reported_seq":692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.282008+0000","last_change":"2024-09-12T01:29:51.281953+0000","last_active":"2024-09-12T01:29:51.282008+0000","last_peered":"2024-09-12T01:29:51.282008+0000","last_clean":"2024-09-12T01:29:51.282008+0000","last_became_active":"2024-09-12T00:31:54.166612+0000","last_became_peered":"2024-09-12T00:31:54.166612+0000","last_unstale":"2024-09-12T01:29:51.282008+0000","last_undegraded":"2024-09-12T01:29:51.282008+0000","last_fullsized":"2024-09-12T01:29:51.282008+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T01:29:51.281847+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T01:29:51.281847+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.281847+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:09.698559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":151,"num_read_kb":143,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'785","reported_seq":4670,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.751926+0000","last_change":"2024-09-12T01:29:46.751847+0000","last_active":"2024-09-12T01:29:46.751926+0000","last_peered":"2024-09-12T01:29:46.751926+0000","last_clean":"2024-09-12T01:29:46.751926+0000","last_became_active":"2024-09-12T00:31:56.170358+0000","last_became_peered":"2024-09-12T00:31:56.170358+0000","last_unstale":"2024-09-12T01:29:46.751926+0000","last_undegraded":"2024-09-12T01:29:46.751926+0000","last_fullsized":"2024-09-12T01:29:46.751926+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'785","last_scrub_stamp":"2024-09-12T01:29:46.751765+0000","last_deep_scrub":"265'785","last_deep_scrub_stamp":"2024-09-12T01:29:46.751765+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.751765+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:48.040351+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'177","reported_seq":692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.751829+0000","last_change":"2024-09-12T01:29:56.751829+0000","last_active":"2024-09-12T01:29:56.751829+0000","last_peered":"2024-09-12T01:29:56.751829+0000","last_clean":"2024-09-12T01:29:56.751829+0000","last_became_active":"2024-09-12T00:31:58.178148+0000","last_became_peered":"2024-09-12T00:31:58.178148+0000","last_unstale":"2024-09-12T01:29:56.751829+0000","last_undegraded":"2024-09-12T01:29:56.751829+0000","last_fullsized":"2024-09-12T01:29:56.751829+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'177","last_scrub_stamp":"2024-09-12T01:29:56.751734+0000","last_deep_scrub":"265'177","last_deep_scrub_stamp":"2024-09-12T01:29:56.751734+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.751734+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:13.896172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":405,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'112","reported_seq":719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.362004+0000","last_change":"2024-09-12T01:29:31.361897+0000","last_active":"2024-09-12T01:29:31.362004+0000","last_peered":"2024-09-12T01:29:31.362004+0000","last_clean":"2024-09-12T01:29:31.362004+0000","last_became_active":"2024-09-12T00:31:50.142769+0000","last_became_peered":"2024-09-12T00:31:50.142769+0000","last_unstale":"2024-09-12T01:29:31.362004+0000","last_undegraded":"2024-09-12T01:29:31.362004+0000","last_fullsized":"2024-09-12T01:29:31.362004+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'112","last_scrub_stamp":"2024-09-12T01:29:31.361797+0000","last_deep_scrub":"265'112","last_deep_scrub_stamp":"2024-09-12T01:29:31.361797+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.361797+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:10.303759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":521,"num_read_kb":437,"num_write":174,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'390","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.683738+0000","last_change":"2024-09-12T01:29:23.683636+0000","last_active":"2024-09-12T01:29:23.683738+0000","last_peered":"2024-09-12T01:29:23.683738+0000","last_clean":"2024-09-12T01:29:23.683738+0000","last_became_active":"2024-09-12T00:31:47.115974+0000","last_became_peered":"2024-09-12T00:31:47.115974+0000","last_unstale":"2024-09-12T01:29:23.683738+0000","last_undegraded":"2024-09-12T01:29:23.683738+0000","last_fullsized":"2024-09-12T01:29:23.683738+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'390","last_scrub_stamp":"2024-09-12T01:29:23.683459+0000","last_deep_scrub":"265'390","last_deep_scrub_stamp":"2024-09-12T01:29:23.683459+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.683459+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:58.878415+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1843869,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":674,"num_read_kb":6022,"num_write":1105,"num_write_kb":14780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.992869+0000","last_change":"2024-09-12T01:29:24.992796+0000","last_active":"2024-09-12T01:29:24.992869+0000","last_peered":"2024-09-12T01:29:24.992869+0000","last_clean":"2024-09-12T01:29:24.992869+0000","last_became_active":"2024-09-12T00:31:37.434487+0000","last_became_peered":"2024-09-12T00:31:37.434487+0000","last_unstale":"2024-09-12T01:29:24.992869+0000","last_undegraded":"2024-09-12T01:29:24.992869+0000","last_fullsized":"2024-09-12T01:29:24.992869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:24.992711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:24.992711+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.992711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:32.901092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.563522+0000","last_change":"2024-09-12T01:29:36.563465+0000","last_active":"2024-09-12T01:29:36.563522+0000","last_peered":"2024-09-12T01:29:36.563522+0000","last_clean":"2024-09-12T01:29:36.563522+0000","last_became_active":"2024-09-12T00:31:52.152173+0000","last_became_peered":"2024-09-12T00:31:52.152173+0000","last_unstale":"2024-09-12T01:29:36.563522+0000","last_undegraded":"2024-09-12T01:29:36.563522+0000","last_fullsized":"2024-09-12T01:29:36.563522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:36.563342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:36.563342+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.563342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:37.784991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'742","reported_seq":1481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.194043+0000","last_change":"2024-09-12T01:29:38.193979+0000","last_active":"2024-09-12T01:29:38.194043+0000","last_peered":"2024-09-12T01:29:38.194043+0000","last_clean":"2024-09-12T01:29:38.194043+0000","last_became_active":"2024-09-12T00:31:54.169994+0000","last_became_peered":"2024-09-12T00:31:54.169994+0000","last_unstale":"2024-09-12T01:29:38.194043+0000","last_undegraded":"2024-09-12T01:29:38.194043+0000","last_fullsized":"2024-09-12T01:29:38.194043+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'742","last_scrub_stamp":"2024-09-12T01:29:38.193855+0000","last_deep_scrub":"265'742","last_deep_scrub_stamp":"2024-09-12T01:29:38.193855+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.193855+0000","objects_scrubbed":9,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:37.960206+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143669,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1312,"num_read_kb":3057,"num_write":1064,"num_write_kb":866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.589847+0000","last_change":"2024-09-12T01:29:51.589796+0000","last_active":"2024-09-12T01:29:51.589847+0000","last_peered":"2024-09-12T01:29:51.589847+0000","last_clean":"2024-09-12T01:29:51.589847+0000","last_became_active":"2024-09-12T00:31:56.172417+0000","last_became_peered":"2024-09-12T00:31:56.172417+0000","last_unstale":"2024-09-12T01:29:51.589847+0000","last_undegraded":"2024-09-12T01:29:51.589847+0000","last_fullsized":"2024-09-12T01:29:51.589847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:51.589701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:51.589701+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.589701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:13.456056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'152","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.461726+0000","last_change":"2024-09-12T01:29:47.461726+0000","last_active":"2024-09-12T01:29:47.461726+0000","last_peered":"2024-09-12T01:29:47.461726+0000","last_clean":"2024-09-12T01:29:47.461726+0000","last_became_active":"2024-09-12T00:31:58.179998+0000","last_became_peered":"2024-09-12T00:31:58.179998+0000","last_unstale":"2024-09-12T01:29:47.461726+0000","last_undegraded":"2024-09-12T01:29:47.461726+0000","last_fullsized":"2024-09-12T01:29:47.461726+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'152","last_scrub_stamp":"2024-09-12T01:29:47.461655+0000","last_deep_scrub":"265'152","last_deep_scrub_stamp":"2024-09-12T01:29:47.461655+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.461655+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:32.937279+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":177,"num_read_kb":166,"num_write":377,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'160","reported_seq":733,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.599796+0000","last_change":"2024-09-12T01:29:57.599738+0000","last_active":"2024-09-12T01:29:57.599796+0000","last_peered":"2024-09-12T01:29:57.599796+0000","last_clean":"2024-09-12T01:29:57.599796+0000","last_became_active":"2024-09-12T00:31:58.177936+0000","last_became_peered":"2024-09-12T00:31:58.177936+0000","last_unstale":"2024-09-12T01:29:57.599796+0000","last_undegraded":"2024-09-12T01:29:57.599796+0000","last_fullsized":"2024-09-12T01:29:57.599796+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T01:29:57.599619+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T01:29:57.599619+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.599619+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:16.682708+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":226,"num_read_kb":224,"num_write":377,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'98","reported_seq":690,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.451102+0000","last_change":"2024-09-12T01:29:35.451036+0000","last_active":"2024-09-12T01:29:35.451102+0000","last_peered":"2024-09-12T01:29:35.451102+0000","last_clean":"2024-09-12T01:29:35.451102+0000","last_became_active":"2024-09-12T00:31:50.142206+0000","last_became_peered":"2024-09-12T00:31:50.142206+0000","last_unstale":"2024-09-12T01:29:35.451102+0000","last_undegraded":"2024-09-12T01:29:35.451102+0000","last_fullsized":"2024-09-12T01:29:35.451102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'98","last_scrub_stamp":"2024-09-12T01:29:35.450943+0000","last_deep_scrub":"265'98","last_deep_scrub_stamp":"2024-09-12T01:29:35.450943+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.450943+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:46.081581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":133,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'318","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.981082+0000","last_change":"2024-09-12T01:29:29.980971+0000","last_active":"2024-09-12T01:29:29.981082+0000","last_peered":"2024-09-12T01:29:29.981082+0000","last_clean":"2024-09-12T01:29:29.981082+0000","last_became_active":"2024-09-12T00:31:47.128005+0000","last_became_peered":"2024-09-12T00:31:47.128005+0000","last_unstale":"2024-09-12T01:29:29.981082+0000","last_undegraded":"2024-09-12T01:29:29.981082+0000","last_fullsized":"2024-09-12T01:29:29.981082+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T01:29:29.980824+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T01:29:29.980824+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.980824+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:44.159677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174744,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":395,"num_read_kb":1002,"num_write":979,"num_write_kb":27047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.117797+0000","last_change":"2024-09-12T01:29:42.117730+0000","last_active":"2024-09-12T01:29:42.117797+0000","last_peered":"2024-09-12T01:29:42.117797+0000","last_clean":"2024-09-12T01:29:42.117797+0000","last_became_active":"2024-09-12T00:31:52.153927+0000","last_became_peered":"2024-09-12T00:31:52.153927+0000","last_unstale":"2024-09-12T01:29:42.117797+0000","last_undegraded":"2024-09-12T01:29:42.117797+0000","last_fullsized":"2024-09-12T01:29:42.117797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:42.117637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:42.117637+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.117637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:56.850260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'295","reported_seq":882,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.057645+0000","last_change":"2024-09-12T01:29:46.057570+0000","last_active":"2024-09-12T01:29:46.057645+0000","last_peered":"2024-09-12T01:29:46.057645+0000","last_clean":"2024-09-12T01:29:46.057645+0000","last_became_active":"2024-09-12T00:31:54.167414+0000","last_became_peered":"2024-09-12T00:31:54.167414+0000","last_unstale":"2024-09-12T01:29:46.057645+0000","last_undegraded":"2024-09-12T01:29:46.057645+0000","last_fullsized":"2024-09-12T01:29:46.057645+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'295","last_scrub_stamp":"2024-09-12T01:29:46.057480+0000","last_deep_scrub":"265'295","last_deep_scrub_stamp":"2024-09-12T01:29:46.057480+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.057480+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:24.477901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44314,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":1087,"num_write":386,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.611004+0000","last_change":"2024-09-12T01:29:44.610937+0000","last_active":"2024-09-12T01:29:44.611004+0000","last_peered":"2024-09-12T01:29:44.611004+0000","last_clean":"2024-09-12T01:29:44.611004+0000","last_became_active":"2024-09-12T00:31:56.173412+0000","last_became_peered":"2024-09-12T00:31:56.173412+0000","last_unstale":"2024-09-12T01:29:44.611004+0000","last_undegraded":"2024-09-12T01:29:44.611004+0000","last_fullsized":"2024-09-12T01:29:44.611004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:44.610803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:44.610803+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.610803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:24.276208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'129","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.589898+0000","last_change":"2024-09-12T01:29:48.589849+0000","last_active":"2024-09-12T01:29:48.589898+0000","last_peered":"2024-09-12T01:29:48.589898+0000","last_clean":"2024-09-12T01:29:48.589898+0000","last_became_active":"2024-09-12T00:31:58.176322+0000","last_became_peered":"2024-09-12T00:31:58.176322+0000","last_unstale":"2024-09-12T01:29:48.589898+0000","last_undegraded":"2024-09-12T01:29:48.589898+0000","last_fullsized":"2024-09-12T01:29:48.589898+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T01:29:48.589752+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T01:29:48.589752+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.589752+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:17.155396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":158,"num_write":327,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'158","reported_seq":815,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.560569+0000","last_change":"2024-09-12T01:29:29.560489+0000","last_active":"2024-09-12T01:29:29.560569+0000","last_peered":"2024-09-12T01:29:29.560569+0000","last_clean":"2024-09-12T01:29:29.560569+0000","last_became_active":"2024-09-12T00:31:50.127724+0000","last_became_peered":"2024-09-12T00:31:50.127724+0000","last_unstale":"2024-09-12T01:29:29.560569+0000","last_undegraded":"2024-09-12T01:29:29.560569+0000","last_fullsized":"2024-09-12T01:29:29.560569+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'158","last_scrub_stamp":"2024-09-12T01:29:29.560401+0000","last_deep_scrub":"265'158","last_deep_scrub_stamp":"2024-09-12T01:29:29.560401+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.560401+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.392412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":587,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'366","reported_seq":1138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.924631+0000","last_change":"2024-09-12T01:29:21.924574+0000","last_active":"2024-09-12T01:29:21.924631+0000","last_peered":"2024-09-12T01:29:21.924631+0000","last_clean":"2024-09-12T01:29:21.924631+0000","last_became_active":"2024-09-12T00:31:47.138565+0000","last_became_peered":"2024-09-12T00:31:47.138565+0000","last_unstale":"2024-09-12T01:29:21.924631+0000","last_undegraded":"2024-09-12T01:29:21.924631+0000","last_fullsized":"2024-09-12T01:29:21.924631+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T01:29:21.924465+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T01:29:21.924465+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.924465+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:33.989434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133731,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":777,"num_read_kb":53412,"num_write":1135,"num_write_kb":60803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":512,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.596147+0000","last_change":"2024-09-12T01:29:41.596083+0000","last_active":"2024-09-12T01:29:41.596147+0000","last_peered":"2024-09-12T01:29:41.596147+0000","last_clean":"2024-09-12T01:29:41.596147+0000","last_became_active":"2024-09-12T00:31:52.154829+0000","last_became_peered":"2024-09-12T00:31:52.154829+0000","last_unstale":"2024-09-12T01:29:41.596147+0000","last_undegraded":"2024-09-12T01:29:41.596147+0000","last_fullsized":"2024-09-12T01:29:41.596147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:41.595994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:41.595994+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.595994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:10.895105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'43","reported_seq":563,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.512983+0000","last_change":"2024-09-12T01:29:47.512926+0000","last_active":"2024-09-12T01:29:47.512983+0000","last_peered":"2024-09-12T01:29:47.512983+0000","last_clean":"2024-09-12T01:29:47.512983+0000","last_became_active":"2024-09-12T00:31:54.162657+0000","last_became_peered":"2024-09-12T00:31:54.162657+0000","last_unstale":"2024-09-12T01:29:47.512983+0000","last_undegraded":"2024-09-12T01:29:47.512983+0000","last_fullsized":"2024-09-12T01:29:47.512983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'43","last_scrub_stamp":"2024-09-12T01:29:47.512829+0000","last_deep_scrub":"265'43","last_deep_scrub_stamp":"2024-09-12T01:29:47.512829+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.512829+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:34.991103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.474747+0000","last_change":"2024-09-12T01:29:45.474695+0000","last_active":"2024-09-12T01:29:45.474747+0000","last_peered":"2024-09-12T01:29:45.474747+0000","last_clean":"2024-09-12T01:29:45.474747+0000","last_became_active":"2024-09-12T00:31:56.170648+0000","last_became_peered":"2024-09-12T00:31:56.170648+0000","last_unstale":"2024-09-12T01:29:45.474747+0000","last_undegraded":"2024-09-12T01:29:45.474747+0000","last_fullsized":"2024-09-12T01:29:45.474747+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:45.474603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:45.474603+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.474603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:59.854027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'218","reported_seq":751,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.080957+0000","last_change":"2024-09-12T01:29:54.080957+0000","last_active":"2024-09-12T01:29:54.080957+0000","last_peered":"2024-09-12T01:29:54.080957+0000","last_clean":"2024-09-12T01:29:54.080957+0000","last_became_active":"2024-09-12T00:31:58.172511+0000","last_became_peered":"2024-09-12T00:31:58.172511+0000","last_unstale":"2024-09-12T01:29:54.080957+0000","last_undegraded":"2024-09-12T01:29:54.080957+0000","last_fullsized":"2024-09-12T01:29:54.080957+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'218","last_scrub_stamp":"2024-09-12T01:29:54.080859+0000","last_deep_scrub":"265'218","last_deep_scrub_stamp":"2024-09-12T01:29:54.080859+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.080859+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:57.488220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":356,"num_read_kb":339,"num_write":509,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'63","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.577018+0000","last_change":"2024-09-12T01:29:28.576959+0000","last_active":"2024-09-12T01:29:28.577018+0000","last_peered":"2024-09-12T01:29:28.577018+0000","last_clean":"2024-09-12T01:29:28.577018+0000","last_became_active":"2024-09-12T00:31:50.124994+0000","last_became_peered":"2024-09-12T00:31:50.124994+0000","last_unstale":"2024-09-12T01:29:28.577018+0000","last_undegraded":"2024-09-12T01:29:28.577018+0000","last_fullsized":"2024-09-12T01:29:28.577018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'63","last_scrub_stamp":"2024-09-12T01:29:28.576859+0000","last_deep_scrub":"265'63","last_deep_scrub_stamp":"2024-09-12T01:29:28.576859+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.576859+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:46.559642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":221,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'334","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.395459+0000","last_change":"2024-09-12T01:29:25.395373+0000","last_active":"2024-09-12T01:29:25.395459+0000","last_peered":"2024-09-12T01:29:25.395459+0000","last_clean":"2024-09-12T01:29:25.395459+0000","last_became_active":"2024-09-12T00:31:47.134398+0000","last_became_peered":"2024-09-12T00:31:47.134398+0000","last_unstale":"2024-09-12T01:29:25.395459+0000","last_undegraded":"2024-09-12T01:29:25.395459+0000","last_fullsized":"2024-09-12T01:29:25.395459+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-12T01:29:25.395184+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-12T01:29:25.395184+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.395184+0000","objects_scrubbed":9,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:04.761120+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788554,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":470,"num_read_kb":102268,"num_write":1066,"num_write_kb":44150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.466224+0000","last_change":"2024-09-12T01:29:34.466136+0000","last_active":"2024-09-12T01:29:34.466224+0000","last_peered":"2024-09-12T01:29:34.466224+0000","last_clean":"2024-09-12T01:29:34.466224+0000","last_became_active":"2024-09-12T00:31:52.151826+0000","last_became_peered":"2024-09-12T00:31:52.151826+0000","last_unstale":"2024-09-12T01:29:34.466224+0000","last_undegraded":"2024-09-12T01:29:34.466224+0000","last_fullsized":"2024-09-12T01:29:34.466224+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:34.466045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:34.466045+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.466045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:00.120324+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'305","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.528823+0000","last_change":"2024-09-12T01:29:39.528727+0000","last_active":"2024-09-12T01:29:39.528823+0000","last_peered":"2024-09-12T01:29:39.528823+0000","last_clean":"2024-09-12T01:29:39.528823+0000","last_became_active":"2024-09-12T00:31:54.162188+0000","last_became_peered":"2024-09-12T00:31:54.162188+0000","last_unstale":"2024-09-12T01:29:39.528823+0000","last_undegraded":"2024-09-12T01:29:39.528823+0000","last_fullsized":"2024-09-12T01:29:39.528823+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T01:29:39.528595+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T01:29:39.528595+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.528595+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:29.037553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49464,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":505,"num_read_kb":1076,"num_write":398,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.559866+0000","last_change":"2024-09-12T01:29:42.559741+0000","last_active":"2024-09-12T01:29:42.559866+0000","last_peered":"2024-09-12T01:29:42.559866+0000","last_clean":"2024-09-12T01:29:42.559866+0000","last_became_active":"2024-09-12T00:31:56.168434+0000","last_became_peered":"2024-09-12T00:31:56.168434+0000","last_unstale":"2024-09-12T01:29:42.559866+0000","last_undegraded":"2024-09-12T01:29:42.559866+0000","last_fullsized":"2024-09-12T01:29:42.559866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:42.559636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:42.559636+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.559636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:26.790467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'128","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:05.282196+0000","last_change":"2024-09-12T01:30:05.282196+0000","last_active":"2024-09-12T01:30:05.282196+0000","last_peered":"2024-09-12T01:30:05.282196+0000","last_clean":"2024-09-12T01:30:05.282196+0000","last_became_active":"2024-09-12T00:31:58.173552+0000","last_became_peered":"2024-09-12T00:31:58.173552+0000","last_unstale":"2024-09-12T01:30:05.282196+0000","last_undegraded":"2024-09-12T01:30:05.282196+0000","last_fullsized":"2024-09-12T01:30:05.282196+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'128","last_scrub_stamp":"2024-09-12T01:30:05.282097+0000","last_deep_scrub":"265'128","last_deep_scrub_stamp":"2024-09-12T01:30:05.282097+0000","last_clean_scrub_stamp":"2024-09-12T01:30:05.282097+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:19.758465+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":198,"num_write":331,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'108","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.592310+0000","last_change":"2024-09-12T01:29:29.592252+0000","last_active":"2024-09-12T01:29:29.592310+0000","last_peered":"2024-09-12T01:29:29.592310+0000","last_clean":"2024-09-12T01:29:29.592310+0000","last_became_active":"2024-09-12T00:31:50.133117+0000","last_became_peered":"2024-09-12T00:31:50.133117+0000","last_unstale":"2024-09-12T01:29:29.592310+0000","last_undegraded":"2024-09-12T01:29:29.592310+0000","last_fullsized":"2024-09-12T01:29:29.592310+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'108","last_scrub_stamp":"2024-09-12T01:29:29.592164+0000","last_deep_scrub":"265'108","last_deep_scrub_stamp":"2024-09-12T01:29:29.592164+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.592164+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:46.847768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":426,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'425","reported_seq":1164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.746659+0000","last_change":"2024-09-12T01:29:24.746585+0000","last_active":"2024-09-12T01:29:24.746659+0000","last_peered":"2024-09-12T01:29:24.746659+0000","last_clean":"2024-09-12T01:29:24.746659+0000","last_became_active":"2024-09-12T00:31:47.127603+0000","last_became_peered":"2024-09-12T00:31:47.127603+0000","last_unstale":"2024-09-12T01:29:24.746659+0000","last_undegraded":"2024-09-12T01:29:24.746659+0000","last_fullsized":"2024-09-12T01:29:24.746659+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'425","last_scrub_stamp":"2024-09-12T01:29:24.746482+0000","last_deep_scrub":"265'425","last_deep_scrub_stamp":"2024-09-12T01:29:24.746482+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.746482+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:59.902513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":834,"num_read_kb":29446,"num_write":1356,"num_write_kb":48637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.315253+0000","last_change":"2024-09-12T01:29:50.315197+0000","last_active":"2024-09-12T01:29:50.315253+0000","last_peered":"2024-09-12T01:29:50.315253+0000","last_clean":"2024-09-12T01:29:50.315253+0000","last_became_active":"2024-09-12T00:31:52.152398+0000","last_became_peered":"2024-09-12T00:31:52.152398+0000","last_unstale":"2024-09-12T01:29:50.315253+0000","last_undegraded":"2024-09-12T01:29:50.315253+0000","last_fullsized":"2024-09-12T01:29:50.315253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:50.315105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:50.315105+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.315105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:18.800901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'279","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.191298+0000","last_change":"2024-09-12T01:29:41.191230+0000","last_active":"2024-09-12T01:29:41.191298+0000","last_peered":"2024-09-12T01:29:41.191298+0000","last_clean":"2024-09-12T01:29:41.191298+0000","last_became_active":"2024-09-12T00:31:54.171386+0000","last_became_peered":"2024-09-12T00:31:54.171386+0000","last_unstale":"2024-09-12T01:29:41.191298+0000","last_undegraded":"2024-09-12T01:29:41.191298+0000","last_fullsized":"2024-09-12T01:29:41.191298+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'279","last_scrub_stamp":"2024-09-12T01:29:41.191130+0000","last_deep_scrub":"265'279","last_deep_scrub_stamp":"2024-09-12T01:29:41.191130+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.191130+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:18.450325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46739,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":1088,"num_write":376,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.601476+0000","last_change":"2024-09-12T01:29:42.601410+0000","last_active":"2024-09-12T01:29:42.601476+0000","last_peered":"2024-09-12T01:29:42.601476+0000","last_clean":"2024-09-12T01:29:42.601476+0000","last_became_active":"2024-09-12T00:31:56.167213+0000","last_became_peered":"2024-09-12T00:31:56.167213+0000","last_unstale":"2024-09-12T01:29:42.601476+0000","last_undegraded":"2024-09-12T01:29:42.601476+0000","last_fullsized":"2024-09-12T01:29:42.601476+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:42.601326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:42.601326+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.601326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:58.024251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'120","reported_seq":750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.144531+0000","last_change":"2024-09-12T01:29:40.144462+0000","last_active":"2024-09-12T01:29:40.144531+0000","last_peered":"2024-09-12T01:29:40.144531+0000","last_clean":"2024-09-12T01:29:40.144531+0000","last_became_active":"2024-09-12T00:31:50.139863+0000","last_became_peered":"2024-09-12T00:31:50.139863+0000","last_unstale":"2024-09-12T01:29:40.144531+0000","last_undegraded":"2024-09-12T01:29:40.144531+0000","last_fullsized":"2024-09-12T01:29:40.144531+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'120","last_scrub_stamp":"2024-09-12T01:29:40.144376+0000","last_deep_scrub":"265'120","last_deep_scrub_stamp":"2024-09-12T01:29:40.144376+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.144376+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:11.609630+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":466,"num_write":169,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'448","reported_seq":1152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.795430+0000","last_change":"2024-09-12T01:29:25.795366+0000","last_active":"2024-09-12T01:29:25.795430+0000","last_peered":"2024-09-12T01:29:25.795430+0000","last_clean":"2024-09-12T01:29:25.795430+0000","last_became_active":"2024-09-12T00:31:47.133283+0000","last_became_peered":"2024-09-12T00:31:47.133283+0000","last_unstale":"2024-09-12T01:29:25.795430+0000","last_undegraded":"2024-09-12T01:29:25.795430+0000","last_fullsized":"2024-09-12T01:29:25.795430+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'448","last_scrub_stamp":"2024-09-12T01:29:25.795214+0000","last_deep_scrub":"265'448","last_deep_scrub_stamp":"2024-09-12T01:29:25.795214+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.795214+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:54.503325+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133704,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":743,"num_read_kb":14924,"num_write":1450,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.106038+0000","last_change":"2024-09-12T01:29:43.105971+0000","last_active":"2024-09-12T01:29:43.106038+0000","last_peered":"2024-09-12T01:29:43.106038+0000","last_clean":"2024-09-12T01:29:43.106038+0000","last_became_active":"2024-09-12T00:31:52.152676+0000","last_became_peered":"2024-09-12T00:31:52.152676+0000","last_unstale":"2024-09-12T01:29:43.106038+0000","last_undegraded":"2024-09-12T01:29:43.106038+0000","last_fullsized":"2024-09-12T01:29:43.106038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:43.105857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:43.105857+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.105857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:58.634409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'515","reported_seq":1155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.021086+0000","last_change":"2024-09-12T01:29:50.021086+0000","last_active":"2024-09-12T01:29:50.021086+0000","last_peered":"2024-09-12T01:29:50.021086+0000","last_clean":"2024-09-12T01:29:50.021086+0000","last_became_active":"2024-09-12T00:31:54.171225+0000","last_became_peered":"2024-09-12T00:31:54.171225+0000","last_unstale":"2024-09-12T01:29:50.021086+0000","last_undegraded":"2024-09-12T01:29:50.021086+0000","last_fullsized":"2024-09-12T01:29:50.021086+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'515","last_scrub_stamp":"2024-09-12T01:29:50.020987+0000","last_deep_scrub":"265'515","last_deep_scrub_stamp":"2024-09-12T01:29:50.020987+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.020987+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:30.996334+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95922,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":923,"num_read_kb":2207,"num_write":796,"num_write_kb":707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.447754+0000","last_change":"2024-09-12T01:29:43.447754+0000","last_active":"2024-09-12T01:29:43.447754+0000","last_peered":"2024-09-12T01:29:43.447754+0000","last_clean":"2024-09-12T01:29:43.447754+0000","last_became_active":"2024-09-12T00:31:56.175562+0000","last_became_peered":"2024-09-12T00:31:56.175562+0000","last_unstale":"2024-09-12T01:29:43.447754+0000","last_undegraded":"2024-09-12T01:29:43.447754+0000","last_fullsized":"2024-09-12T01:29:43.447754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:43.447666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:43.447666+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.447666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:05.961632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'144","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.746339+0000","last_change":"2024-09-12T01:29:59.746281+0000","last_active":"2024-09-12T01:29:59.746339+0000","last_peered":"2024-09-12T01:29:59.746339+0000","last_clean":"2024-09-12T01:29:59.746339+0000","last_became_active":"2024-09-12T00:31:58.182602+0000","last_became_peered":"2024-09-12T00:31:58.182602+0000","last_unstale":"2024-09-12T01:29:59.746339+0000","last_undegraded":"2024-09-12T01:29:59.746339+0000","last_fullsized":"2024-09-12T01:29:59.746339+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:29:59.746182+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:29:59.746182+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.746182+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.081045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":164,"num_write":296,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'135","reported_seq":766,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.579485+0000","last_change":"2024-09-12T01:29:31.579405+0000","last_active":"2024-09-12T01:29:31.579485+0000","last_peered":"2024-09-12T01:29:31.579485+0000","last_clean":"2024-09-12T01:29:31.579485+0000","last_became_active":"2024-09-12T00:31:50.132053+0000","last_became_peered":"2024-09-12T00:31:50.132053+0000","last_unstale":"2024-09-12T01:29:31.579485+0000","last_undegraded":"2024-09-12T01:29:31.579485+0000","last_fullsized":"2024-09-12T01:29:31.579485+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T01:29:31.579303+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T01:29:31.579303+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.579303+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.679511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":637,"num_read_kb":540,"num_write":205,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'319","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.654872+0000","last_change":"2024-09-12T01:29:26.654810+0000","last_active":"2024-09-12T01:29:26.654872+0000","last_peered":"2024-09-12T01:29:26.654872+0000","last_clean":"2024-09-12T01:29:26.654872+0000","last_became_active":"2024-09-12T00:31:47.114966+0000","last_became_peered":"2024-09-12T00:31:47.114966+0000","last_unstale":"2024-09-12T01:29:26.654872+0000","last_undegraded":"2024-09-12T01:29:26.654872+0000","last_fullsized":"2024-09-12T01:29:26.654872+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T01:29:26.654700+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T01:29:26.654700+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.654700+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:07.153488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279295,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":490,"num_read_kb":26176,"num_write":1107,"num_write_kb":27429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.402850+0000","last_change":"2024-09-12T01:29:39.402798+0000","last_active":"2024-09-12T01:29:39.402850+0000","last_peered":"2024-09-12T01:29:39.402850+0000","last_clean":"2024-09-12T01:29:39.402850+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:29:39.402850+0000","last_undegraded":"2024-09-12T01:29:39.402850+0000","last_fullsized":"2024-09-12T01:29:39.402850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:39.402710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:39.402710+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.402710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:26.430951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'301","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.295518+0000","last_change":"2024-09-12T01:29:55.295518+0000","last_active":"2024-09-12T01:29:55.295518+0000","last_peered":"2024-09-12T01:29:55.295518+0000","last_clean":"2024-09-12T01:29:55.295518+0000","last_became_active":"2024-09-12T00:31:54.165996+0000","last_became_peered":"2024-09-12T00:31:54.165996+0000","last_unstale":"2024-09-12T01:29:55.295518+0000","last_undegraded":"2024-09-12T01:29:55.295518+0000","last_fullsized":"2024-09-12T01:29:55.295518+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'301","last_scrub_stamp":"2024-09-12T01:29:55.295422+0000","last_deep_scrub":"265'301","last_deep_scrub_stamp":"2024-09-12T01:29:55.295422+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.295422+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:02.542094+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":488,"num_read_kb":1000,"num_write":400,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.762516+0000","last_change":"2024-09-12T01:29:53.762516+0000","last_active":"2024-09-12T01:29:53.762516+0000","last_peered":"2024-09-12T01:29:53.762516+0000","last_clean":"2024-09-12T01:29:53.762516+0000","last_became_active":"2024-09-12T00:31:56.170994+0000","last_became_peered":"2024-09-12T00:31:56.170994+0000","last_unstale":"2024-09-12T01:29:53.762516+0000","last_undegraded":"2024-09-12T01:29:53.762516+0000","last_fullsized":"2024-09-12T01:29:53.762516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:53.762429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:53.762429+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.762429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:18.418793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'168","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:01.378473+0000","last_change":"2024-09-12T01:30:01.378394+0000","last_active":"2024-09-12T01:30:01.378473+0000","last_peered":"2024-09-12T01:30:01.378473+0000","last_clean":"2024-09-12T01:30:01.378473+0000","last_became_active":"2024-09-12T00:31:58.183625+0000","last_became_peered":"2024-09-12T00:31:58.183625+0000","last_unstale":"2024-09-12T01:30:01.378473+0000","last_undegraded":"2024-09-12T01:30:01.378473+0000","last_fullsized":"2024-09-12T01:30:01.378473+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T01:30:01.378303+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T01:30:01.378303+0000","last_clean_scrub_stamp":"2024-09-12T01:30:01.378303+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:35.722105+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2035,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":465,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'119","reported_seq":704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.609043+0000","last_change":"2024-09-12T01:29:30.609043+0000","last_active":"2024-09-12T01:29:30.609043+0000","last_peered":"2024-09-12T01:29:30.609043+0000","last_clean":"2024-09-12T01:29:30.609043+0000","last_became_active":"2024-09-12T00:31:50.143427+0000","last_became_peered":"2024-09-12T00:31:50.143427+0000","last_unstale":"2024-09-12T01:29:30.609043+0000","last_undegraded":"2024-09-12T01:29:30.609043+0000","last_fullsized":"2024-09-12T01:29:30.609043+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T01:29:30.608948+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T01:29:30.608948+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.608948+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:44.221971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":539,"num_read_kb":443,"num_write":196,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'364","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.374053+0000","last_change":"2024-09-12T01:29:23.374053+0000","last_active":"2024-09-12T01:29:23.374053+0000","last_peered":"2024-09-12T01:29:23.374053+0000","last_clean":"2024-09-12T01:29:23.374053+0000","last_became_active":"2024-09-12T00:31:47.117631+0000","last_became_peered":"2024-09-12T00:31:47.117631+0000","last_unstale":"2024-09-12T01:29:23.374053+0000","last_undegraded":"2024-09-12T01:29:23.374053+0000","last_fullsized":"2024-09-12T01:29:23.374053+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T01:29:23.373946+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T01:29:23.373946+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.373946+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:26.118563+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":597,"num_read_kb":5850,"num_write":1220,"num_write_kb":26346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.372836+0000","last_change":"2024-09-12T01:29:38.372836+0000","last_active":"2024-09-12T01:29:38.372836+0000","last_peered":"2024-09-12T01:29:38.372836+0000","last_clean":"2024-09-12T01:29:38.372836+0000","last_became_active":"2024-09-12T00:31:52.151796+0000","last_became_peered":"2024-09-12T00:31:52.151796+0000","last_unstale":"2024-09-12T01:29:38.372836+0000","last_undegraded":"2024-09-12T01:29:38.372836+0000","last_fullsized":"2024-09-12T01:29:38.372836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:38.372741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:38.372741+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.372741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:52.582073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'318","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.066929+0000","last_change":"2024-09-12T01:29:49.066860+0000","last_active":"2024-09-12T01:29:49.066929+0000","last_peered":"2024-09-12T01:29:49.066929+0000","last_clean":"2024-09-12T01:29:49.066929+0000","last_became_active":"2024-09-12T00:31:54.170965+0000","last_became_peered":"2024-09-12T00:31:54.170965+0000","last_unstale":"2024-09-12T01:29:49.066929+0000","last_undegraded":"2024-09-12T01:29:49.066929+0000","last_fullsized":"2024-09-12T01:29:49.066929+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T01:29:49.066754+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T01:29:49.066754+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.066754+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:17.398545+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":509,"num_read_kb":1155,"num_write":420,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.649765+0000","last_change":"2024-09-12T01:29:43.649713+0000","last_active":"2024-09-12T01:29:43.649765+0000","last_peered":"2024-09-12T01:29:43.649765+0000","last_clean":"2024-09-12T01:29:43.649765+0000","last_became_active":"2024-09-12T00:31:56.172337+0000","last_became_peered":"2024-09-12T00:31:56.172337+0000","last_unstale":"2024-09-12T01:29:43.649765+0000","last_undegraded":"2024-09-12T01:29:43.649765+0000","last_fullsized":"2024-09-12T01:29:43.649765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:43.649625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:43.649625+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.649625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:50.361632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'137","reported_seq":638,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.397032+0000","last_change":"2024-09-12T01:30:00.396970+0000","last_active":"2024-09-12T01:30:00.397032+0000","last_peered":"2024-09-12T01:30:00.397032+0000","last_clean":"2024-09-12T01:30:00.397032+0000","last_became_active":"2024-09-12T00:31:58.178565+0000","last_became_peered":"2024-09-12T00:31:58.178565+0000","last_unstale":"2024-09-12T01:30:00.397032+0000","last_undegraded":"2024-09-12T01:30:00.397032+0000","last_fullsized":"2024-09-12T01:30:00.397032+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'137","last_scrub_stamp":"2024-09-12T01:30:00.396864+0000","last_deep_scrub":"265'137","last_deep_scrub_stamp":"2024-09-12T01:30:00.396864+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.396864+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:17.471233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":335,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'510","reported_seq":1287,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.608617+0000","last_change":"2024-09-12T01:29:32.608617+0000","last_active":"2024-09-12T01:29:32.608617+0000","last_peered":"2024-09-12T01:29:32.608617+0000","last_clean":"2024-09-12T01:29:32.608617+0000","last_became_active":"2024-09-12T00:31:50.137671+0000","last_became_peered":"2024-09-12T00:31:50.137671+0000","last_unstale":"2024-09-12T01:29:32.608617+0000","last_undegraded":"2024-09-12T01:29:32.608617+0000","last_fullsized":"2024-09-12T01:29:32.608617+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'510","last_scrub_stamp":"2024-09-12T01:29:32.608525+0000","last_deep_scrub":"265'510","last_deep_scrub_stamp":"2024-09-12T01:29:32.608525+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.608525+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:22.202787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2432,"num_read_kb":2072,"num_write":871,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'466","reported_seq":1282,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.608766+0000","last_change":"2024-09-12T01:29:27.608766+0000","last_active":"2024-09-12T01:29:27.608766+0000","last_peered":"2024-09-12T01:29:27.608766+0000","last_clean":"2024-09-12T01:29:27.608766+0000","last_became_active":"2024-09-12T00:31:47.130035+0000","last_became_peered":"2024-09-12T00:31:47.130035+0000","last_unstale":"2024-09-12T01:29:27.608766+0000","last_undegraded":"2024-09-12T01:29:27.608766+0000","last_fullsized":"2024-09-12T01:29:27.608766+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'466","last_scrub_stamp":"2024-09-12T01:29:27.608666+0000","last_deep_scrub":"265'466","last_deep_scrub_stamp":"2024-09-12T01:29:27.608666+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.608666+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:56.750595+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1077,"num_read_kb":24732,"num_write":1307,"num_write_kb":48327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.580564+0000","last_change":"2024-09-12T01:29:43.580564+0000","last_active":"2024-09-12T01:29:43.580564+0000","last_peered":"2024-09-12T01:29:43.580564+0000","last_clean":"2024-09-12T01:29:43.580564+0000","last_became_active":"2024-09-12T00:31:52.155279+0000","last_became_peered":"2024-09-12T00:31:52.155279+0000","last_unstale":"2024-09-12T01:29:43.580564+0000","last_undegraded":"2024-09-12T01:29:43.580564+0000","last_fullsized":"2024-09-12T01:29:43.580564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:43.580473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:43.580473+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.580473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:44.144061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'121","reported_seq":663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.338024+0000","last_change":"2024-09-12T01:29:56.337967+0000","last_active":"2024-09-12T01:29:56.338024+0000","last_peered":"2024-09-12T01:29:56.338024+0000","last_clean":"2024-09-12T01:29:56.338024+0000","last_became_active":"2024-09-12T00:31:54.165779+0000","last_became_peered":"2024-09-12T00:31:54.165779+0000","last_unstale":"2024-09-12T01:29:56.338024+0000","last_undegraded":"2024-09-12T01:29:56.338024+0000","last_fullsized":"2024-09-12T01:29:56.338024+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'121","last_scrub_stamp":"2024-09-12T01:29:56.337858+0000","last_deep_scrub":"265'121","last_deep_scrub_stamp":"2024-09-12T01:29:56.337858+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.337858+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:59.195945+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":137,"num_write":154,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'763","reported_seq":2348,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.140572+0000","last_change":"2024-09-12T01:29:42.140488+0000","last_active":"2024-09-12T01:29:42.140572+0000","last_peered":"2024-09-12T01:29:42.140572+0000","last_clean":"2024-09-12T01:29:42.140572+0000","last_became_active":"2024-09-12T00:31:56.172551+0000","last_became_peered":"2024-09-12T00:31:56.172551+0000","last_unstale":"2024-09-12T01:29:42.140572+0000","last_undegraded":"2024-09-12T01:29:42.140572+0000","last_fullsized":"2024-09-12T01:29:42.140572+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'763","last_scrub_stamp":"2024-09-12T01:29:42.140404+0000","last_deep_scrub":"265'763","last_deep_scrub_stamp":"2024-09-12T01:29:42.140404+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.140404+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:02.458026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'122","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.358300+0000","last_change":"2024-09-12T01:29:59.358220+0000","last_active":"2024-09-12T01:29:59.358300+0000","last_peered":"2024-09-12T01:29:59.358300+0000","last_clean":"2024-09-12T01:29:59.358300+0000","last_became_active":"2024-09-12T00:31:58.178671+0000","last_became_peered":"2024-09-12T00:31:58.178671+0000","last_unstale":"2024-09-12T01:29:59.358300+0000","last_undegraded":"2024-09-12T01:29:59.358300+0000","last_fullsized":"2024-09-12T01:29:59.358300+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'122","last_scrub_stamp":"2024-09-12T01:29:59.358135+0000","last_deep_scrub":"265'122","last_deep_scrub_stamp":"2024-09-12T01:29:59.358135+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.358135+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:49.917414+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'144","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.413643+0000","last_change":"2024-09-12T01:29:36.413643+0000","last_active":"2024-09-12T01:29:36.413643+0000","last_peered":"2024-09-12T01:29:36.413643+0000","last_clean":"2024-09-12T01:29:36.413643+0000","last_became_active":"2024-09-12T00:31:50.143377+0000","last_became_peered":"2024-09-12T00:31:50.143377+0000","last_unstale":"2024-09-12T01:29:36.413643+0000","last_undegraded":"2024-09-12T01:29:36.413643+0000","last_fullsized":"2024-09-12T01:29:36.413643+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:29:36.413557+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:29:36.413557+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.413557+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:23.640462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":664,"num_read_kb":566,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'384","reported_seq":1109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.374852+0000","last_change":"2024-09-12T01:29:22.374852+0000","last_active":"2024-09-12T01:29:22.374852+0000","last_peered":"2024-09-12T01:29:22.374852+0000","last_clean":"2024-09-12T01:29:22.374852+0000","last_became_active":"2024-09-12T00:31:47.128555+0000","last_became_peered":"2024-09-12T00:31:47.128555+0000","last_unstale":"2024-09-12T01:29:22.374852+0000","last_undegraded":"2024-09-12T01:29:22.374852+0000","last_fullsized":"2024-09-12T01:29:22.374852+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-12T01:29:22.374771+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-12T01:29:22.374771+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.374771+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:28.766984+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2058190,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":740,"num_read_kb":10967,"num_write":1262,"num_write_kb":23618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.443104+0000","last_change":"2024-09-12T01:29:35.443104+0000","last_active":"2024-09-12T01:29:35.443104+0000","last_peered":"2024-09-12T01:29:35.443104+0000","last_clean":"2024-09-12T01:29:35.443104+0000","last_became_active":"2024-09-12T00:31:52.150825+0000","last_became_peered":"2024-09-12T00:31:52.150825+0000","last_unstale":"2024-09-12T01:29:35.443104+0000","last_undegraded":"2024-09-12T01:29:35.443104+0000","last_fullsized":"2024-09-12T01:29:35.443104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:35.443014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:35.443014+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.443014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:07.660789+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'354","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.144962+0000","last_change":"2024-09-12T01:29:43.144886+0000","last_active":"2024-09-12T01:29:43.144962+0000","last_peered":"2024-09-12T01:29:43.144962+0000","last_clean":"2024-09-12T01:29:43.144962+0000","last_became_active":"2024-09-12T00:31:54.169308+0000","last_became_peered":"2024-09-12T00:31:54.169308+0000","last_unstale":"2024-09-12T01:29:43.144962+0000","last_undegraded":"2024-09-12T01:29:43.144962+0000","last_fullsized":"2024-09-12T01:29:43.144962+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T01:29:43.144787+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T01:29:43.144787+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.144787+0000","objects_scrubbed":11,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:53.988315+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45185,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":558,"num_read_kb":1163,"num_write":446,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.607601+0000","last_change":"2024-09-12T01:29:54.607513+0000","last_active":"2024-09-12T01:29:54.607601+0000","last_peered":"2024-09-12T01:29:54.607601+0000","last_clean":"2024-09-12T01:29:54.607601+0000","last_became_active":"2024-09-12T00:31:56.173389+0000","last_became_peered":"2024-09-12T00:31:56.173389+0000","last_unstale":"2024-09-12T01:29:54.607601+0000","last_undegraded":"2024-09-12T01:29:54.607601+0000","last_fullsized":"2024-09-12T01:29:54.607601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:54.607389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:54.607389+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.607389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:08.775718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'144","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.745357+0000","last_change":"2024-09-12T01:29:49.745293+0000","last_active":"2024-09-12T01:29:49.745357+0000","last_peered":"2024-09-12T01:29:49.745357+0000","last_clean":"2024-09-12T01:29:49.745357+0000","last_became_active":"2024-09-12T00:31:58.183017+0000","last_became_peered":"2024-09-12T00:31:58.183017+0000","last_unstale":"2024-09-12T01:29:49.745357+0000","last_undegraded":"2024-09-12T01:29:49.745357+0000","last_fullsized":"2024-09-12T01:29:49.745357+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:29:49.745191+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:29:49.745191+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.745191+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:32.589811+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":129,"num_write":333,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'130","reported_seq":749,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.356057+0000","last_change":"2024-09-12T01:29:30.356057+0000","last_active":"2024-09-12T01:29:30.356057+0000","last_peered":"2024-09-12T01:29:30.356057+0000","last_clean":"2024-09-12T01:29:30.356057+0000","last_became_active":"2024-09-12T00:31:50.136941+0000","last_became_peered":"2024-09-12T00:31:50.136941+0000","last_unstale":"2024-09-12T01:29:30.356057+0000","last_undegraded":"2024-09-12T01:29:30.356057+0000","last_fullsized":"2024-09-12T01:29:30.356057+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T01:29:30.355971+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T01:29:30.355971+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.355971+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:08.036712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":653,"num_read_kb":587,"num_write":190,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2874,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'341","reported_seq":995,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.019642+0000","last_change":"2024-09-12T01:29:31.019642+0000","last_active":"2024-09-12T01:29:31.019642+0000","last_peered":"2024-09-12T01:29:31.019642+0000","last_clean":"2024-09-12T01:29:31.019642+0000","last_became_active":"2024-09-12T00:31:47.131600+0000","last_became_peered":"2024-09-12T00:31:47.131600+0000","last_unstale":"2024-09-12T01:29:31.019642+0000","last_undegraded":"2024-09-12T01:29:31.019642+0000","last_fullsized":"2024-09-12T01:29:31.019642+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-12T01:29:31.019510+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-12T01:29:31.019510+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.019510+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:11.532544+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":495,"num_read_kb":43314,"num_write":1098,"num_write_kb":38822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.385826+0000","last_change":"2024-09-12T01:29:37.385826+0000","last_active":"2024-09-12T01:29:37.385826+0000","last_peered":"2024-09-12T01:29:37.385826+0000","last_clean":"2024-09-12T01:29:37.385826+0000","last_became_active":"2024-09-12T00:31:52.152537+0000","last_became_peered":"2024-09-12T00:31:52.152537+0000","last_unstale":"2024-09-12T01:29:37.385826+0000","last_undegraded":"2024-09-12T01:29:37.385826+0000","last_fullsized":"2024-09-12T01:29:37.385826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:37.385738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:37.385738+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.385738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:37.788544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'286","reported_seq":878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.549981+0000","last_change":"2024-09-12T01:29:49.549887+0000","last_active":"2024-09-12T01:29:49.549981+0000","last_peered":"2024-09-12T01:29:49.549981+0000","last_clean":"2024-09-12T01:29:49.549981+0000","last_became_active":"2024-09-12T00:31:54.163977+0000","last_became_peered":"2024-09-12T00:31:54.163977+0000","last_unstale":"2024-09-12T01:29:49.549981+0000","last_undegraded":"2024-09-12T01:29:49.549981+0000","last_fullsized":"2024-09-12T01:29:49.549981+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'286","last_scrub_stamp":"2024-09-12T01:29:49.549783+0000","last_deep_scrub":"265'286","last_deep_scrub_stamp":"2024-09-12T01:29:49.549783+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.549783+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:07.473520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44628,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":1027,"num_write":368,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:03.371847+0000","last_change":"2024-09-12T01:30:03.371764+0000","last_active":"2024-09-12T01:30:03.371847+0000","last_peered":"2024-09-12T01:30:03.371847+0000","last_clean":"2024-09-12T01:30:03.371847+0000","last_became_active":"2024-09-12T00:31:56.171306+0000","last_became_peered":"2024-09-12T00:31:56.171306+0000","last_unstale":"2024-09-12T01:30:03.371847+0000","last_undegraded":"2024-09-12T01:30:03.371847+0000","last_fullsized":"2024-09-12T01:30:03.371847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:03.371667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:03.371667+0000","last_clean_scrub_stamp":"2024-09-12T01:30:03.371667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:29.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'126","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.744913+0000","last_change":"2024-09-12T01:29:58.744913+0000","last_active":"2024-09-12T01:29:58.744913+0000","last_peered":"2024-09-12T01:29:58.744913+0000","last_clean":"2024-09-12T01:29:58.744913+0000","last_became_active":"2024-09-12T00:31:58.182701+0000","last_became_peered":"2024-09-12T00:31:58.182701+0000","last_unstale":"2024-09-12T01:29:58.744913+0000","last_undegraded":"2024-09-12T01:29:58.744913+0000","last_fullsized":"2024-09-12T01:29:58.744913+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T01:29:58.744818+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T01:29:58.744818+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.744818+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:22.475637+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":215,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'42","reported_seq":611,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.563464+0000","last_change":"2024-09-12T01:29:28.563386+0000","last_active":"2024-09-12T01:29:28.563464+0000","last_peered":"2024-09-12T01:29:28.563464+0000","last_clean":"2024-09-12T01:29:28.563464+0000","last_became_active":"2024-09-12T00:31:50.136971+0000","last_became_peered":"2024-09-12T00:31:50.136971+0000","last_unstale":"2024-09-12T01:29:28.563464+0000","last_undegraded":"2024-09-12T01:29:28.563464+0000","last_fullsized":"2024-09-12T01:29:28.563464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'42","last_scrub_stamp":"2024-09-12T01:29:28.563295+0000","last_deep_scrub":"265'42","last_deep_scrub_stamp":"2024-09-12T01:29:28.563295+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.563295+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:05.396239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":180,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'353","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.835972+0000","last_change":"2024-09-12T01:29:26.835870+0000","last_active":"2024-09-12T01:29:26.835972+0000","last_peered":"2024-09-12T01:29:26.835972+0000","last_clean":"2024-09-12T01:29:26.835972+0000","last_became_active":"2024-09-12T00:31:47.123001+0000","last_became_peered":"2024-09-12T00:31:47.123001+0000","last_unstale":"2024-09-12T01:29:26.835972+0000","last_undegraded":"2024-09-12T01:29:26.835972+0000","last_fullsized":"2024-09-12T01:29:26.835972+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T01:29:26.835750+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T01:29:26.835750+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.835750+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:58.085367+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3599074,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":39607,"num_write":1095,"num_write_kb":26742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.541936+0000","last_change":"2024-09-12T01:29:39.541811+0000","last_active":"2024-09-12T01:29:39.541936+0000","last_peered":"2024-09-12T01:29:39.541936+0000","last_clean":"2024-09-12T01:29:39.541936+0000","last_became_active":"2024-09-12T00:31:52.150969+0000","last_became_peered":"2024-09-12T00:31:52.150969+0000","last_unstale":"2024-09-12T01:29:39.541936+0000","last_undegraded":"2024-09-12T01:29:39.541936+0000","last_fullsized":"2024-09-12T01:29:39.541936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:39.541714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:39.541714+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.541714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:07.919979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'260","reported_seq":827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.010775+0000","last_change":"2024-09-12T01:29:47.010775+0000","last_active":"2024-09-12T01:29:47.010775+0000","last_peered":"2024-09-12T01:29:47.010775+0000","last_clean":"2024-09-12T01:29:47.010775+0000","last_became_active":"2024-09-12T00:31:54.169845+0000","last_became_peered":"2024-09-12T00:31:54.169845+0000","last_unstale":"2024-09-12T01:29:47.010775+0000","last_undegraded":"2024-09-12T01:29:47.010775+0000","last_fullsized":"2024-09-12T01:29:47.010775+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-12T01:29:47.010669+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-12T01:29:47.010669+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.010669+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:32.763474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47509,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":435,"num_read_kb":1050,"num_write":360,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:04.322272+0000","last_change":"2024-09-12T01:30:04.322272+0000","last_active":"2024-09-12T01:30:04.322272+0000","last_peered":"2024-09-12T01:30:04.322272+0000","last_clean":"2024-09-12T01:30:04.322272+0000","last_became_active":"2024-09-12T00:31:56.170767+0000","last_became_peered":"2024-09-12T00:31:56.170767+0000","last_unstale":"2024-09-12T01:30:04.322272+0000","last_undegraded":"2024-09-12T01:30:04.322272+0000","last_fullsized":"2024-09-12T01:30:04.322272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:04.322189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:04.322189+0000","last_clean_scrub_stamp":"2024-09-12T01:30:04.322189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:42.797351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'187","reported_seq":1665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:06.328740+0000","last_change":"2024-09-12T01:30:06.328740+0000","last_active":"2024-09-12T01:30:06.328740+0000","last_peered":"2024-09-12T01:30:06.328740+0000","last_clean":"2024-09-12T01:30:06.328740+0000","last_became_active":"2024-09-12T00:31:58.173049+0000","last_became_peered":"2024-09-12T00:31:58.173049+0000","last_unstale":"2024-09-12T01:30:06.328740+0000","last_undegraded":"2024-09-12T01:30:06.328740+0000","last_fullsized":"2024-09-12T01:30:06.328740+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'187","last_scrub_stamp":"2024-09-12T01:30:06.328648+0000","last_deep_scrub":"265'187","last_deep_scrub_stamp":"2024-09-12T01:30:06.328648+0000","last_clean_scrub_stamp":"2024-09-12T01:30:06.328648+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:29.518927+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1227,"num_read_kb":1215,"num_write":440,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'221","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.367746+0000","last_change":"2024-09-12T01:29:29.367671+0000","last_active":"2024-09-12T01:29:29.367746+0000","last_peered":"2024-09-12T01:29:29.367746+0000","last_clean":"2024-09-12T01:29:29.367746+0000","last_became_active":"2024-09-12T00:31:50.141009+0000","last_became_peered":"2024-09-12T00:31:50.141009+0000","last_unstale":"2024-09-12T01:29:29.367746+0000","last_undegraded":"2024-09-12T01:29:29.367746+0000","last_fullsized":"2024-09-12T01:29:29.367746+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'221","last_scrub_stamp":"2024-09-12T01:29:29.367587+0000","last_deep_scrub":"265'221","last_deep_scrub_stamp":"2024-09-12T01:29:29.367587+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.367587+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:50.790988+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":914,"num_read_kb":727,"num_write":339,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'391","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.837768+0000","last_change":"2024-09-12T01:29:27.837675+0000","last_active":"2024-09-12T01:29:27.837768+0000","last_peered":"2024-09-12T01:29:27.837768+0000","last_clean":"2024-09-12T01:29:27.837768+0000","last_became_active":"2024-09-12T00:31:47.118434+0000","last_became_peered":"2024-09-12T00:31:47.118434+0000","last_unstale":"2024-09-12T01:29:27.837768+0000","last_undegraded":"2024-09-12T01:29:27.837768+0000","last_fullsized":"2024-09-12T01:29:27.837768+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T01:29:27.837556+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T01:29:27.837556+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.837556+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:32.423783+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":619,"num_read_kb":10821,"num_write":1247,"num_write_kb":40782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":513,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.534992+0000","last_change":"2024-09-12T01:29:46.534898+0000","last_active":"2024-09-12T01:29:46.534992+0000","last_peered":"2024-09-12T01:29:46.534992+0000","last_clean":"2024-09-12T01:29:46.534992+0000","last_became_active":"2024-09-12T00:31:52.148440+0000","last_became_peered":"2024-09-12T00:31:52.148440+0000","last_unstale":"2024-09-12T01:29:46.534992+0000","last_undegraded":"2024-09-12T01:29:46.534992+0000","last_fullsized":"2024-09-12T01:29:46.534992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:46.534791+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:46.534791+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.534791+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:10.156227+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'316","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.327220+0000","last_change":"2024-09-12T01:29:54.327220+0000","last_active":"2024-09-12T01:29:54.327220+0000","last_peered":"2024-09-12T01:29:54.327220+0000","last_clean":"2024-09-12T01:29:54.327220+0000","last_became_active":"2024-09-12T00:31:54.167915+0000","last_became_peered":"2024-09-12T00:31:54.167915+0000","last_unstale":"2024-09-12T01:29:54.327220+0000","last_undegraded":"2024-09-12T01:29:54.327220+0000","last_fullsized":"2024-09-12T01:29:54.327220+0000","mapping_epoch":31,"log_start":"265'301","ondisk_log_start":"265'301","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T01:29:54.327116+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T01:29:54.327116+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.327116+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":301,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:05.693386+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44378,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":513,"num_read_kb":1106,"num_write":406,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.618555+0000","last_change":"2024-09-12T01:29:55.618555+0000","last_active":"2024-09-12T01:29:55.618555+0000","last_peered":"2024-09-12T01:29:55.618555+0000","last_clean":"2024-09-12T01:29:55.618555+0000","last_became_active":"2024-09-12T00:31:56.171654+0000","last_became_peered":"2024-09-12T00:31:56.171654+0000","last_unstale":"2024-09-12T01:29:55.618555+0000","last_undegraded":"2024-09-12T01:29:55.618555+0000","last_fullsized":"2024-09-12T01:29:55.618555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:55.618473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:55.618473+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.618473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:26.288689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'132","reported_seq":647,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.138574+0000","last_change":"2024-09-12T01:29:45.138574+0000","last_active":"2024-09-12T01:29:45.138574+0000","last_peered":"2024-09-12T01:29:45.138574+0000","last_clean":"2024-09-12T01:29:45.138574+0000","last_became_active":"2024-09-12T00:31:58.181864+0000","last_became_peered":"2024-09-12T00:31:58.181864+0000","last_unstale":"2024-09-12T01:29:45.138574+0000","last_undegraded":"2024-09-12T01:29:45.138574+0000","last_fullsized":"2024-09-12T01:29:45.138574+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'132","last_scrub_stamp":"2024-09-12T01:29:45.138476+0000","last_deep_scrub":"265'132","last_deep_scrub_stamp":"2024-09-12T01:29:45.138476+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.138476+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.900435+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":169,"num_write":329,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'138","reported_seq":719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.569465+0000","last_change":"2024-09-12T01:29:34.569403+0000","last_active":"2024-09-12T01:29:34.569465+0000","last_peered":"2024-09-12T01:29:34.569465+0000","last_clean":"2024-09-12T01:29:34.569465+0000","last_became_active":"2024-09-12T00:31:50.123862+0000","last_became_peered":"2024-09-12T00:31:50.123862+0000","last_unstale":"2024-09-12T01:29:34.569465+0000","last_undegraded":"2024-09-12T01:29:34.569465+0000","last_fullsized":"2024-09-12T01:29:34.569465+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'138","last_scrub_stamp":"2024-09-12T01:29:34.569319+0000","last_deep_scrub":"265'138","last_deep_scrub_stamp":"2024-09-12T01:29:34.569319+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.569319+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:39.432572+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":471,"num_write":227,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'354","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.369834+0000","last_change":"2024-09-12T01:29:23.369781+0000","last_active":"2024-09-12T01:29:23.369834+0000","last_peered":"2024-09-12T01:29:23.369834+0000","last_clean":"2024-09-12T01:29:23.369834+0000","last_became_active":"2024-09-12T00:31:47.132236+0000","last_became_peered":"2024-09-12T00:31:47.132236+0000","last_unstale":"2024-09-12T01:29:23.369834+0000","last_undegraded":"2024-09-12T01:29:23.369834+0000","last_fullsized":"2024-09-12T01:29:23.369834+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T01:29:23.369652+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T01:29:23.369652+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.369652+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:57.694085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":457,"num_read_kb":4332,"num_write":1030,"num_write_kb":17381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'142","reported_seq":739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.563366+0000","last_change":"2024-09-12T01:29:31.563292+0000","last_active":"2024-09-12T01:29:31.563366+0000","last_peered":"2024-09-12T01:29:31.563366+0000","last_clean":"2024-09-12T01:29:31.563366+0000","last_became_active":"2024-09-12T00:31:50.140649+0000","last_became_peered":"2024-09-12T00:31:50.140649+0000","last_unstale":"2024-09-12T01:29:31.563366+0000","last_undegraded":"2024-09-12T01:29:31.563366+0000","last_fullsized":"2024-09-12T01:29:31.563366+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T01:29:31.563200+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T01:29:31.563200+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.563200+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:34.599331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":475,"num_write":199,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'326","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.578792+0000","last_change":"2024-09-12T01:29:25.578704+0000","last_active":"2024-09-12T01:29:25.578792+0000","last_peered":"2024-09-12T01:29:25.578792+0000","last_clean":"2024-09-12T01:29:25.578792+0000","last_became_active":"2024-09-12T00:31:47.126093+0000","last_became_peered":"2024-09-12T00:31:47.126093+0000","last_unstale":"2024-09-12T01:29:25.578792+0000","last_undegraded":"2024-09-12T01:29:25.578792+0000","last_fullsized":"2024-09-12T01:29:25.578792+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'326","last_scrub_stamp":"2024-09-12T01:29:25.578576+0000","last_deep_scrub":"265'326","last_deep_scrub_stamp":"2024-09-12T01:29:25.578576+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.578576+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:43.122572+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":454,"num_read_kb":13702,"num_write":989,"num_write_kb":29796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'259","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.179020+0000","last_change":"2024-09-12T01:29:41.178955+0000","last_active":"2024-09-12T01:29:41.179020+0000","last_peered":"2024-09-12T01:29:41.179020+0000","last_clean":"2024-09-12T01:29:41.179020+0000","last_became_active":"2024-09-12T00:31:50.132976+0000","last_became_peered":"2024-09-12T00:31:50.132976+0000","last_unstale":"2024-09-12T01:29:41.179020+0000","last_undegraded":"2024-09-12T01:29:41.179020+0000","last_fullsized":"2024-09-12T01:29:41.179020+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'259","last_scrub_stamp":"2024-09-12T01:29:41.178857+0000","last_deep_scrub":"265'259","last_deep_scrub_stamp":"2024-09-12T01:29:41.178857+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.178857+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:57.345693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1108,"num_read_kb":908,"num_write":394,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'354","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.086786+0000","last_change":"2024-09-12T01:29:33.086724+0000","last_active":"2024-09-12T01:29:33.086786+0000","last_peered":"2024-09-12T01:29:33.086786+0000","last_clean":"2024-09-12T01:29:33.086786+0000","last_became_active":"2024-09-12T00:31:47.117000+0000","last_became_peered":"2024-09-12T00:31:47.117000+0000","last_unstale":"2024-09-12T01:29:33.086786+0000","last_undegraded":"2024-09-12T01:29:33.086786+0000","last_fullsized":"2024-09-12T01:29:33.086786+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T01:29:33.086619+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T01:29:33.086619+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.086619+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:18.339050+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138894,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":591,"num_read_kb":34967,"num_write":1161,"num_write_kb":18512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'188","reported_seq":842,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.863880+0000","last_change":"2024-09-12T01:29:36.863803+0000","last_active":"2024-09-12T01:29:36.863880+0000","last_peered":"2024-09-12T01:29:36.863880+0000","last_clean":"2024-09-12T01:29:36.863880+0000","last_became_active":"2024-09-12T00:31:50.133634+0000","last_became_peered":"2024-09-12T00:31:50.133634+0000","last_unstale":"2024-09-12T01:29:36.863880+0000","last_undegraded":"2024-09-12T01:29:36.863880+0000","last_fullsized":"2024-09-12T01:29:36.863880+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-12T01:29:36.863688+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-12T01:29:36.863688+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.863688+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:49.117347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":708,"num_write":275,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'366","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.883257+0000","last_change":"2024-09-12T01:29:28.883191+0000","last_active":"2024-09-12T01:29:28.883257+0000","last_peered":"2024-09-12T01:29:28.883257+0000","last_clean":"2024-09-12T01:29:28.883257+0000","last_became_active":"2024-09-12T00:31:47.132735+0000","last_became_peered":"2024-09-12T00:31:47.132735+0000","last_unstale":"2024-09-12T01:29:28.883257+0000","last_undegraded":"2024-09-12T01:29:28.883257+0000","last_fullsized":"2024-09-12T01:29:28.883257+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T01:29:28.883090+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T01:29:28.883090+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.883090+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:41.785346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":462,"num_read_kb":13728,"num_write":961,"num_write_kb":25593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'130","reported_seq":739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.822573+0000","last_change":"2024-09-12T01:29:37.822573+0000","last_active":"2024-09-12T01:29:37.822573+0000","last_peered":"2024-09-12T01:29:37.822573+0000","last_clean":"2024-09-12T01:29:37.822573+0000","last_became_active":"2024-09-12T00:31:50.138349+0000","last_became_peered":"2024-09-12T00:31:50.138349+0000","last_unstale":"2024-09-12T01:29:37.822573+0000","last_undegraded":"2024-09-12T01:29:37.822573+0000","last_fullsized":"2024-09-12T01:29:37.822573+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T01:29:37.822476+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T01:29:37.822476+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.822476+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:17.917278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":530,"num_write":219,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'322","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.221598+0000","last_change":"2024-09-12T01:29:26.221519+0000","last_active":"2024-09-12T01:29:26.221598+0000","last_peered":"2024-09-12T01:29:26.221598+0000","last_clean":"2024-09-12T01:29:26.221598+0000","last_became_active":"2024-09-12T00:31:47.132959+0000","last_became_peered":"2024-09-12T00:31:47.132959+0000","last_unstale":"2024-09-12T01:29:26.221598+0000","last_undegraded":"2024-09-12T01:29:26.221598+0000","last_fullsized":"2024-09-12T01:29:26.221598+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T01:29:26.221423+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T01:29:26.221423+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.221423+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:43.791461+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170196,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":44221,"num_write":1049,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'150","reported_seq":735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.124701+0000","last_change":"2024-09-12T01:29:31.124626+0000","last_active":"2024-09-12T01:29:31.124701+0000","last_peered":"2024-09-12T01:29:31.124701+0000","last_clean":"2024-09-12T01:29:31.124701+0000","last_became_active":"2024-09-12T00:31:50.130915+0000","last_became_peered":"2024-09-12T00:31:50.130915+0000","last_unstale":"2024-09-12T01:29:31.124701+0000","last_undegraded":"2024-09-12T01:29:31.124701+0000","last_fullsized":"2024-09-12T01:29:31.124701+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'150","last_scrub_stamp":"2024-09-12T01:29:31.124543+0000","last_deep_scrub":"265'150","last_deep_scrub_stamp":"2024-09-12T01:29:31.124543+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.124543+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:03.395062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":628,"num_read_kb":507,"num_write":231,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'336","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.142344+0000","last_change":"2024-09-12T01:29:29.142282+0000","last_active":"2024-09-12T01:29:29.142344+0000","last_peered":"2024-09-12T01:29:29.142344+0000","last_clean":"2024-09-12T01:29:29.142344+0000","last_became_active":"2024-09-12T00:31:47.122164+0000","last_became_peered":"2024-09-12T00:31:47.122164+0000","last_unstale":"2024-09-12T01:29:29.142344+0000","last_undegraded":"2024-09-12T01:29:29.142344+0000","last_fullsized":"2024-09-12T01:29:29.142344+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T01:29:29.142149+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T01:29:29.142149+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.142149+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:51.142516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170481,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":503,"num_read_kb":2267,"num_write":1137,"num_write_kb":17589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'295","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.116289+0000","last_change":"2024-09-12T01:29:38.116198+0000","last_active":"2024-09-12T01:29:38.116289+0000","last_peered":"2024-09-12T01:29:38.116289+0000","last_clean":"2024-09-12T01:29:38.116289+0000","last_became_active":"2024-09-12T00:31:50.142283+0000","last_became_peered":"2024-09-12T00:31:50.142283+0000","last_unstale":"2024-09-12T01:29:38.116289+0000","last_undegraded":"2024-09-12T01:29:38.116289+0000","last_fullsized":"2024-09-12T01:29:38.116289+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'295","last_scrub_stamp":"2024-09-12T01:29:38.116092+0000","last_deep_scrub":"265'295","last_deep_scrub_stamp":"2024-09-12T01:29:38.116092+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.116092+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:29.568062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1272,"num_read_kb":1039,"num_write":466,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'373","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.379329+0000","last_change":"2024-09-12T01:29:26.379186+0000","last_active":"2024-09-12T01:29:26.379329+0000","last_peered":"2024-09-12T01:29:26.379329+0000","last_clean":"2024-09-12T01:29:26.379329+0000","last_became_active":"2024-09-12T00:31:47.136789+0000","last_became_peered":"2024-09-12T00:31:47.136789+0000","last_unstale":"2024-09-12T01:29:26.379329+0000","last_undegraded":"2024-09-12T01:29:26.379329+0000","last_fullsized":"2024-09-12T01:29:26.379329+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T01:29:26.379032+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T01:29:26.379032+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.379032+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:10.288276+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":544,"num_read_kb":49646,"num_write":1113,"num_write_kb":37962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'130","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.439867+0000","last_change":"2024-09-12T01:29:27.439811+0000","last_active":"2024-09-12T01:29:27.439867+0000","last_peered":"2024-09-12T01:29:27.439867+0000","last_clean":"2024-09-12T01:29:27.439867+0000","last_became_active":"2024-09-12T00:31:50.140717+0000","last_became_peered":"2024-09-12T00:31:50.140717+0000","last_unstale":"2024-09-12T01:29:27.439867+0000","last_undegraded":"2024-09-12T01:29:27.439867+0000","last_fullsized":"2024-09-12T01:29:27.439867+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T01:29:27.439723+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T01:29:27.439723+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.439723+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:07.649578+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":623,"num_read_kb":519,"num_write":184,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4002,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'384","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.949772+0000","last_change":"2024-09-12T01:29:33.949714+0000","last_active":"2024-09-12T01:29:33.949772+0000","last_peered":"2024-09-12T01:29:33.949772+0000","last_clean":"2024-09-12T01:29:33.949772+0000","last_became_active":"2024-09-12T00:31:47.118928+0000","last_became_peered":"2024-09-12T00:31:47.118928+0000","last_unstale":"2024-09-12T01:29:33.949772+0000","last_undegraded":"2024-09-12T01:29:33.949772+0000","last_fullsized":"2024-09-12T01:29:33.949772+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-12T01:29:33.949597+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-12T01:29:33.949597+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.949597+0000","objects_scrubbed":9,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:44.543182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65022,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":549,"num_read_kb":12208,"num_write":1218,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'133","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.621422+0000","last_change":"2024-09-12T01:29:33.621360+0000","last_active":"2024-09-12T01:29:33.621422+0000","last_peered":"2024-09-12T01:29:33.621422+0000","last_clean":"2024-09-12T01:29:33.621422+0000","last_became_active":"2024-09-12T00:31:50.137034+0000","last_became_peered":"2024-09-12T00:31:50.137034+0000","last_unstale":"2024-09-12T01:29:33.621422+0000","last_undegraded":"2024-09-12T01:29:33.621422+0000","last_fullsized":"2024-09-12T01:29:33.621422+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-12T01:29:33.621268+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-12T01:29:33.621268+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.621268+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:32.051275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":471,"num_write":187,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'394","reported_seq":1071,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.042100+0000","last_change":"2024-09-12T01:29:34.042100+0000","last_active":"2024-09-12T01:29:34.042100+0000","last_peered":"2024-09-12T01:29:34.042100+0000","last_clean":"2024-09-12T01:29:34.042100+0000","last_became_active":"2024-09-12T00:31:47.119180+0000","last_became_peered":"2024-09-12T00:31:47.119180+0000","last_unstale":"2024-09-12T01:29:34.042100+0000","last_undegraded":"2024-09-12T01:29:34.042100+0000","last_fullsized":"2024-09-12T01:29:34.042100+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T01:29:34.041934+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T01:29:34.041934+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.041934+0000","objects_scrubbed":9,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:04.729277+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2793702,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":603,"num_read_kb":71015,"num_write":1325,"num_write_kb":54526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'230","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.091285+0000","last_change":"2024-09-12T01:29:30.091211+0000","last_active":"2024-09-12T01:29:30.091285+0000","last_peered":"2024-09-12T01:29:30.091285+0000","last_clean":"2024-09-12T01:29:30.091285+0000","last_became_active":"2024-09-12T00:31:50.132605+0000","last_became_peered":"2024-09-12T00:31:50.132605+0000","last_unstale":"2024-09-12T01:29:30.091285+0000","last_undegraded":"2024-09-12T01:29:30.091285+0000","last_fullsized":"2024-09-12T01:29:30.091285+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'230","last_scrub_stamp":"2024-09-12T01:29:30.091128+0000","last_deep_scrub":"265'230","last_deep_scrub_stamp":"2024-09-12T01:29:30.091128+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.091128+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:44.530559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":781,"num_write":348,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'337","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.914567+0000","last_change":"2024-09-12T01:29:29.914501+0000","last_active":"2024-09-12T01:29:29.914567+0000","last_peered":"2024-09-12T01:29:29.914567+0000","last_clean":"2024-09-12T01:29:29.914567+0000","last_became_active":"2024-09-12T00:31:47.131895+0000","last_became_peered":"2024-09-12T00:31:47.131895+0000","last_unstale":"2024-09-12T01:29:29.914567+0000","last_undegraded":"2024-09-12T01:29:29.914567+0000","last_fullsized":"2024-09-12T01:29:29.914567+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-12T01:29:29.914360+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-12T01:29:29.914360+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.914360+0000","objects_scrubbed":9,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:13.576149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":1443,"num_write":1105,"num_write_kb":20830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'184","reported_seq":822,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.728660+0000","last_change":"2024-09-12T01:29:41.728660+0000","last_active":"2024-09-12T01:29:41.728660+0000","last_peered":"2024-09-12T01:29:41.728660+0000","last_clean":"2024-09-12T01:29:41.728660+0000","last_became_active":"2024-09-12T00:31:50.138649+0000","last_became_peered":"2024-09-12T00:31:50.138649+0000","last_unstale":"2024-09-12T01:29:41.728660+0000","last_undegraded":"2024-09-12T01:29:41.728660+0000","last_fullsized":"2024-09-12T01:29:41.728660+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'184","last_scrub_stamp":"2024-09-12T01:29:41.728559+0000","last_deep_scrub":"265'184","last_deep_scrub_stamp":"2024-09-12T01:29:41.728559+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.728559+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:39.497379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":823,"num_read_kb":682,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'312","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.381906+0000","last_change":"2024-09-12T01:29:25.381837+0000","last_active":"2024-09-12T01:29:25.381906+0000","last_peered":"2024-09-12T01:29:25.381906+0000","last_clean":"2024-09-12T01:29:25.381906+0000","last_became_active":"2024-09-12T00:31:47.128598+0000","last_became_peered":"2024-09-12T00:31:47.128598+0000","last_unstale":"2024-09-12T01:29:25.381906+0000","last_undegraded":"2024-09-12T01:29:25.381906+0000","last_fullsized":"2024-09-12T01:29:25.381906+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T01:29:25.381685+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T01:29:25.381685+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.381685+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:02.770818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37912,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":412,"num_read_kb":69389,"num_write":1027,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'98","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.493501+0000","last_change":"2024-09-12T01:29:29.493434+0000","last_active":"2024-09-12T01:29:29.493501+0000","last_peered":"2024-09-12T01:29:29.493501+0000","last_clean":"2024-09-12T01:29:29.493501+0000","last_became_active":"2024-09-12T00:31:50.139830+0000","last_became_peered":"2024-09-12T00:31:50.139830+0000","last_unstale":"2024-09-12T01:29:29.493501+0000","last_undegraded":"2024-09-12T01:29:29.493501+0000","last_fullsized":"2024-09-12T01:29:29.493501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'98","last_scrub_stamp":"2024-09-12T01:29:29.493346+0000","last_deep_scrub":"265'98","last_deep_scrub_stamp":"2024-09-12T01:29:29.493346+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.493346+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:43.481588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":425,"num_read_kb":351,"num_write":136,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'293","reported_seq":931,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.596279+0000","last_change":"2024-09-12T01:29:37.596190+0000","last_active":"2024-09-12T01:29:37.596279+0000","last_peered":"2024-09-12T01:29:37.596279+0000","last_clean":"2024-09-12T01:29:37.596279+0000","last_became_active":"2024-09-12T00:31:47.122486+0000","last_became_peered":"2024-09-12T00:31:47.122486+0000","last_unstale":"2024-09-12T01:29:37.596279+0000","last_undegraded":"2024-09-12T01:29:37.596279+0000","last_fullsized":"2024-09-12T01:29:37.596279+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'293","last_scrub_stamp":"2024-09-12T01:29:37.596061+0000","last_deep_scrub":"265'293","last_deep_scrub_stamp":"2024-09-12T01:29:37.596061+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.596061+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:50.615903+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6842428,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":24154,"num_write":874,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'114","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.388377+0000","last_change":"2024-09-12T01:29:32.388319+0000","last_active":"2024-09-12T01:29:32.388377+0000","last_peered":"2024-09-12T01:29:32.388377+0000","last_clean":"2024-09-12T01:29:32.388377+0000","last_became_active":"2024-09-12T00:31:50.139416+0000","last_became_peered":"2024-09-12T00:31:50.139416+0000","last_unstale":"2024-09-12T01:29:32.388377+0000","last_undegraded":"2024-09-12T01:29:32.388377+0000","last_fullsized":"2024-09-12T01:29:32.388377+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'114","last_scrub_stamp":"2024-09-12T01:29:32.388231+0000","last_deep_scrub":"265'114","last_deep_scrub_stamp":"2024-09-12T01:29:32.388231+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.388231+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:16.247658+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":414,"num_write":177,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'362","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.974843+0000","last_change":"2024-09-12T01:29:23.974781+0000","last_active":"2024-09-12T01:29:23.974843+0000","last_peered":"2024-09-12T01:29:23.974843+0000","last_clean":"2024-09-12T01:29:23.974843+0000","last_became_active":"2024-09-12T00:31:47.130353+0000","last_became_peered":"2024-09-12T00:31:47.130353+0000","last_unstale":"2024-09-12T01:29:23.974843+0000","last_undegraded":"2024-09-12T01:29:23.974843+0000","last_fullsized":"2024-09-12T01:29:23.974843+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T01:29:23.974688+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T01:29:23.974688+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.974688+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:26.306312+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288069,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":8753,"num_write":1192,"num_write_kb":21611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'161","reported_seq":773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.572355+0000","last_change":"2024-09-12T01:29:32.572299+0000","last_active":"2024-09-12T01:29:32.572355+0000","last_peered":"2024-09-12T01:29:32.572355+0000","last_clean":"2024-09-12T01:29:32.572355+0000","last_became_active":"2024-09-12T00:31:50.140705+0000","last_became_peered":"2024-09-12T00:31:50.140705+0000","last_unstale":"2024-09-12T01:29:32.572355+0000","last_undegraded":"2024-09-12T01:29:32.572355+0000","last_fullsized":"2024-09-12T01:29:32.572355+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'161","last_scrub_stamp":"2024-09-12T01:29:32.572201+0000","last_deep_scrub":"265'161","last_deep_scrub_stamp":"2024-09-12T01:29:32.572201+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.572201+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:57.054566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":620,"num_write":277,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'387","reported_seq":1113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.059874+0000","last_change":"2024-09-12T01:29:32.059874+0000","last_active":"2024-09-12T01:29:32.059874+0000","last_peered":"2024-09-12T01:29:32.059874+0000","last_clean":"2024-09-12T01:29:32.059874+0000","last_became_active":"2024-09-12T00:31:47.120303+0000","last_became_peered":"2024-09-12T00:31:47.120303+0000","last_unstale":"2024-09-12T01:29:32.059874+0000","last_undegraded":"2024-09-12T01:29:32.059874+0000","last_fullsized":"2024-09-12T01:29:32.059874+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T01:29:32.059734+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T01:29:32.059734+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.059734+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:18.350675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493090,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":704,"num_read_kb":61137,"num_write":1132,"num_write_kb":48224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'210","reported_seq":865,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.613216+0000","last_change":"2024-09-12T01:29:33.613124+0000","last_active":"2024-09-12T01:29:33.613216+0000","last_peered":"2024-09-12T01:29:33.613216+0000","last_clean":"2024-09-12T01:29:33.613216+0000","last_became_active":"2024-09-12T00:31:50.133698+0000","last_became_peered":"2024-09-12T00:31:50.133698+0000","last_unstale":"2024-09-12T01:29:33.613216+0000","last_undegraded":"2024-09-12T01:29:33.613216+0000","last_fullsized":"2024-09-12T01:29:33.613216+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'210","last_scrub_stamp":"2024-09-12T01:29:33.613015+0000","last_deep_scrub":"265'210","last_deep_scrub_stamp":"2024-09-12T01:29:33.613015+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.613015+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:38.489746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":883,"num_write":372,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'279","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.574378+0000","last_change":"2024-09-12T01:29:26.574293+0000","last_active":"2024-09-12T01:29:26.574378+0000","last_peered":"2024-09-12T01:29:26.574378+0000","last_clean":"2024-09-12T01:29:26.574378+0000","last_became_active":"2024-09-12T00:31:47.117753+0000","last_became_peered":"2024-09-12T00:31:47.117753+0000","last_unstale":"2024-09-12T01:29:26.574378+0000","last_undegraded":"2024-09-12T01:29:26.574378+0000","last_fullsized":"2024-09-12T01:29:26.574378+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'279","last_scrub_stamp":"2024-09-12T01:29:26.574140+0000","last_deep_scrub":"265'279","last_deep_scrub_stamp":"2024-09-12T01:29:26.574140+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.574140+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:19.980823+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":578,"num_read_kb":553,"num_write":1003,"num_write_kb":11415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'4099","reported_seq":4707,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.486832+0000","last_change":"2024-09-12T01:29:28.486832+0000","last_active":"2024-09-12T01:29:28.486832+0000","last_peered":"2024-09-12T01:29:28.486832+0000","last_clean":"2024-09-12T01:29:28.486832+0000","last_became_active":"2024-09-12T00:31:50.144782+0000","last_became_peered":"2024-09-12T00:31:50.144782+0000","last_unstale":"2024-09-12T01:29:28.486832+0000","last_undegraded":"2024-09-12T01:29:28.486832+0000","last_fullsized":"2024-09-12T01:29:28.486832+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4099","last_scrub_stamp":"2024-09-12T01:29:28.486734+0000","last_deep_scrub":"265'4099","last_deep_scrub_stamp":"2024-09-12T01:29:28.486734+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.486734+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:27.424046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16473,"num_read_kb":13736,"num_write":6146,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'355","reported_seq":1119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.168523+0000","last_change":"2024-09-12T01:29:28.168523+0000","last_active":"2024-09-12T01:29:28.168523+0000","last_peered":"2024-09-12T01:29:28.168523+0000","last_clean":"2024-09-12T01:29:28.168523+0000","last_became_active":"2024-09-12T00:32:23.828547+0000","last_became_peered":"2024-09-12T00:32:23.828547+0000","last_unstale":"2024-09-12T01:29:28.168523+0000","last_undegraded":"2024-09-12T01:29:28.168523+0000","last_fullsized":"2024-09-12T01:29:28.168523+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T01:29:28.168363+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T01:29:28.168363+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.168363+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:07.014208+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2792674,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":658,"num_read_kb":184067,"num_write":1127,"num_write_kb":52781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"265'313","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.068686+0000","last_change":"2024-09-12T01:29:35.068584+0000","last_active":"2024-09-12T01:29:35.068686+0000","last_peered":"2024-09-12T01:29:35.068686+0000","last_clean":"2024-09-12T01:29:35.068686+0000","last_became_active":"2024-09-12T00:31:47.123083+0000","last_became_peered":"2024-09-12T00:31:47.123083+0000","last_unstale":"2024-09-12T01:29:35.068686+0000","last_undegraded":"2024-09-12T01:29:35.068686+0000","last_fullsized":"2024-09-12T01:29:35.068686+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'313","last_scrub_stamp":"2024-09-12T01:29:35.068428+0000","last_deep_scrub":"265'313","last_deep_scrub_stamp":"2024-09-12T01:29:35.068428+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.068428+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:18.821874+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1292330,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":432,"num_read_kb":16599,"num_write":993,"num_write_kb":37945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'178","reported_seq":762,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.582964+0000","last_change":"2024-09-12T01:29:40.582884+0000","last_active":"2024-09-12T01:29:40.582964+0000","last_peered":"2024-09-12T01:29:40.582964+0000","last_clean":"2024-09-12T01:29:40.582964+0000","last_became_active":"2024-09-12T00:31:50.144850+0000","last_became_peered":"2024-09-12T00:31:50.144850+0000","last_unstale":"2024-09-12T01:29:40.582964+0000","last_undegraded":"2024-09-12T01:29:40.582964+0000","last_fullsized":"2024-09-12T01:29:40.582964+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'178","last_scrub_stamp":"2024-09-12T01:29:40.582801+0000","last_deep_scrub":"265'178","last_deep_scrub_stamp":"2024-09-12T01:29:40.582801+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.582801+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:21.474391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":724,"num_read_kb":585,"num_write":260,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'386","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.920078+0000","last_change":"2024-09-12T01:29:31.920017+0000","last_active":"2024-09-12T01:29:31.920078+0000","last_peered":"2024-09-12T01:29:31.920078+0000","last_clean":"2024-09-12T01:29:31.920078+0000","last_became_active":"2024-09-12T00:31:47.132149+0000","last_became_peered":"2024-09-12T00:31:47.132149+0000","last_unstale":"2024-09-12T01:29:31.920078+0000","last_undegraded":"2024-09-12T01:29:31.920078+0000","last_fullsized":"2024-09-12T01:29:31.920078+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T01:29:31.919888+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T01:29:31.919888+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.919888+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:51.126649+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":304,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":582,"num_read_kb":13776,"num_write":1287,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'127","reported_seq":759,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.480691+0000","last_change":"2024-09-12T01:29:34.480631+0000","last_active":"2024-09-12T01:29:34.480691+0000","last_peered":"2024-09-12T01:29:34.480691+0000","last_clean":"2024-09-12T01:29:34.480691+0000","last_became_active":"2024-09-12T00:31:50.137283+0000","last_became_peered":"2024-09-12T00:31:50.137283+0000","last_unstale":"2024-09-12T01:29:34.480691+0000","last_undegraded":"2024-09-12T01:29:34.480691+0000","last_fullsized":"2024-09-12T01:29:34.480691+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-12T01:29:34.480529+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-12T01:29:34.480529+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.480529+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:46.725574+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":583,"num_read_kb":491,"num_write":192,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5593,"num_read_kb":3949,"num_write":1897,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6768,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1070,"ondisk_log_size":1070,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15046,"num_read_kb":14700,"num_write":16713,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1548,"ondisk_log_size":1548,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":588,"ondisk_log_size":588,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1527208,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":18236,"num_read_kb":37365,"num_write":15267,"num_write_kb":11724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":673192,"num_omap_keys":1560,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1721,"ondisk_log_size":1721,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102878,"num_read_kb":85467,"num_write":37260,"num_write_kb":18832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43781,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3676,"ondisk_log_size":3676,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":78246710,"num_objects":378,"num_object_clones":0,"num_object_copies":1134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":378,"num_whiteouts":0,"num_read":36067,"num_read_kb":1971130,"num_write":71284,"num_write_kb":2047906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":119279616,"data_stored":119279616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3444,"ondisk_log_size":3444,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":176023,"num_write":154,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":175285,"num_write":154,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477448,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":221612,"kb_used_data":15580,"kb_used_omap":1,"kb_used_meta":206014,"kb_avail":94150228,"statfs":{"total":96636764160,"available":96409833472,"internally_reserved":0,"allocated":15953920,"data_stored":13969939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":210958794},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719477447,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111876,"kb_used_data":18292,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94259964,"statfs":{"total":96636764160,"available":96522203136,"internally_reserved":0,"allocated":18731008,"data_stored":16734053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95812038},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510153,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259868,"kb_used_data":21836,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94111972,"statfs":{"total":96636764160,"available":96370659328,"internally_reserved":0,"allocated":22360064,"data_stored":20343157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":243726791},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510152,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152736,"kb_used_data":27152,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94219104,"statfs":{"total":96636764160,"available":96480362496,"internally_reserved":0,"allocated":27803648,"data_stored":25815269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510152,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":10116,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":10358784,"data_stored":8346083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510150,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124160,"kb_used_data":16624,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94247680,"statfs":{"total":96636764160,"available":96509624320,"internally_reserved":0,"allocated":17022976,"data_stored":15000873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542854,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":206080,"kb_used_data":22256,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94165760,"statfs":{"total":96636764160,"available":96425738240,"internally_reserved":0,"allocated":22790144,"data_stored":20790314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575559,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":270692,"kb_used_data":18836,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94101148,"statfs":{"total":96636764160,"available":96359575552,"internally_reserved":0,"allocated":19288064,"data_stored":17276630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12771328,"data_stored":12771328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5529600,"data_stored":5529600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23588864,"data_stored":23588864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18116608,"data_stored":18116608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18563072,"data_stored":18563072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14458880,"data_stored":14458880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14508032,"data_stored":14508032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11743232,"data_stored":11743232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:30:24.703 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:24.704 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:48:41.269149+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:24.704 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:24.705 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:24.705 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:48:44.289609+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=48, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:24.705 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:24.705 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:04:12.444243+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=4, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=29, tm_sec=18, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:30:24.708 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:30:44.709 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:30:45.061 INFO:teuthology.orchestra.run.smithi062.stdout: 2024-09-12T01:30:45.073 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2024-09-12T01:30:45.075 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":2036,"stamp":"2024-09-12T01:30:43.887811+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80381543,"num_objects":728,"num_object_clones":0,"num_object_copies":1834,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":728,"num_whiteouts":0,"num_read":180567,"num_read_kb":2466850,"num_write":142872,"num_write_kb":2319609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":62,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":727561,"num_omap_keys":1782,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12344,"ondisk_log_size":12344,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1645156,"kb_used_data":150692,"kb_used_omap":12,"kb_used_meta":1494323,"kb_avail":753329564,"statfs":{"total":773094113280,"available":771409473536,"internally_reserved":0,"allocated":154308608,"data_stored":138276318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1530187312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005305"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.061738+0000","last_change":"2024-09-12T01:29:57.061738+0000","last_active":"2024-09-12T01:29:57.061738+0000","last_peered":"2024-09-12T01:29:57.061738+0000","last_clean":"2024-09-12T01:29:57.061738+0000","last_became_active":"2024-09-12T01:04:13.467533+0000","last_became_peered":"2024-09-12T01:04:13.467533+0000","last_unstale":"2024-09-12T01:29:57.061738+0000","last_undegraded":"2024-09-12T01:29:57.061738+0000","last_fullsized":"2024-09-12T01:29:57.061738+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:57.061646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:57.061646+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.061646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:41.958626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"265'3","reported_seq":48,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.687343+0000","last_change":"2024-09-12T01:29:54.687343+0000","last_active":"2024-09-12T01:29:54.687343+0000","last_peered":"2024-09-12T01:29:54.687343+0000","last_clean":"2024-09-12T01:29:54.687343+0000","last_became_active":"2024-09-12T00:48:45.303088+0000","last_became_peered":"2024-09-12T00:48:45.303088+0000","last_unstale":"2024-09-12T01:29:54.687343+0000","last_undegraded":"2024-09-12T01:29:54.687343+0000","last_fullsized":"2024-09-12T01:29:54.687343+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:54.687250+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:54.687250+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.687250+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:44.841379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"262'3","reported_seq":54,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:01.619724+0000","last_change":"2024-09-12T01:30:01.619724+0000","last_active":"2024-09-12T01:30:01.619724+0000","last_peered":"2024-09-12T01:30:01.619724+0000","last_clean":"2024-09-12T01:30:01.619724+0000","last_became_active":"2024-09-12T00:48:42.290471+0000","last_became_peered":"2024-09-12T00:48:42.290471+0000","last_unstale":"2024-09-12T01:30:01.619724+0000","last_undegraded":"2024-09-12T01:30:01.619724+0000","last_fullsized":"2024-09-12T01:30:01.619724+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:30:01.619628+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:30:01.619628+0000","last_clean_scrub_stamp":"2024-09-12T01:30:01.619628+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:01.581709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"265'15","reported_seq":100,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:01.569626+0000","last_change":"2024-09-12T01:30:01.569626+0000","last_active":"2024-09-12T01:30:01.569626+0000","last_peered":"2024-09-12T01:30:01.569626+0000","last_clean":"2024-09-12T01:30:01.569626+0000","last_became_active":"2024-09-12T00:46:03.918235+0000","last_became_peered":"2024-09-12T00:46:03.918235+0000","last_unstale":"2024-09-12T01:30:01.569626+0000","last_undegraded":"2024-09-12T01:30:01.569626+0000","last_fullsized":"2024-09-12T01:30:01.569626+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'15","last_scrub_stamp":"2024-09-12T01:30:01.569539+0000","last_deep_scrub":"265'15","last_deep_scrub_stamp":"2024-09-12T01:30:01.569539+0000","last_clean_scrub_stamp":"2024-09-12T01:30:01.569539+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:20.877189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":51,"num_write":30,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:07.081439+0000","last_change":"2024-09-12T01:30:07.081439+0000","last_active":"2024-09-12T01:30:07.081439+0000","last_peered":"2024-09-12T01:30:07.081439+0000","last_clean":"2024-09-12T01:30:07.081439+0000","last_became_active":"2024-09-12T01:04:13.463645+0000","last_became_peered":"2024-09-12T01:04:13.463645+0000","last_unstale":"2024-09-12T01:30:07.081439+0000","last_undegraded":"2024-09-12T01:30:07.081439+0000","last_fullsized":"2024-09-12T01:30:07.081439+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:07.081345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:07.081345+0000","last_clean_scrub_stamp":"2024-09-12T01:30:07.081345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:49.780249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.469854+0000","last_change":"2024-09-12T01:29:59.469854+0000","last_active":"2024-09-12T01:29:59.469854+0000","last_peered":"2024-09-12T01:29:59.469854+0000","last_clean":"2024-09-12T01:29:59.469854+0000","last_became_active":"2024-09-12T00:48:45.307070+0000","last_became_peered":"2024-09-12T00:48:45.307070+0000","last_unstale":"2024-09-12T01:29:59.469854+0000","last_undegraded":"2024-09-12T01:29:59.469854+0000","last_fullsized":"2024-09-12T01:29:59.469854+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:29:59.469749+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:29:59.469749+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.469749+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:28.682849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"262'3","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:05.766934+0000","last_change":"2024-09-12T01:30:05.766934+0000","last_active":"2024-09-12T01:30:05.766934+0000","last_peered":"2024-09-12T01:30:05.766934+0000","last_clean":"2024-09-12T01:30:05.766934+0000","last_became_active":"2024-09-12T00:48:42.296820+0000","last_became_peered":"2024-09-12T00:48:42.296820+0000","last_unstale":"2024-09-12T01:30:05.766934+0000","last_undegraded":"2024-09-12T01:30:05.766934+0000","last_fullsized":"2024-09-12T01:30:05.766934+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:30:05.766832+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:30:05.766832+0000","last_clean_scrub_stamp":"2024-09-12T01:30:05.766832+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:35.099147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"265'17","reported_seq":107,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:02.558258+0000","last_change":"2024-09-12T01:30:02.558173+0000","last_active":"2024-09-12T01:30:02.558258+0000","last_peered":"2024-09-12T01:30:02.558258+0000","last_clean":"2024-09-12T01:30:02.558258+0000","last_became_active":"2024-09-12T00:46:03.919803+0000","last_became_peered":"2024-09-12T00:46:03.919803+0000","last_unstale":"2024-09-12T01:30:02.558258+0000","last_undegraded":"2024-09-12T01:30:02.558258+0000","last_fullsized":"2024-09-12T01:30:02.558258+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-12T01:30:02.558090+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-12T01:30:02.558090+0000","last_clean_scrub_stamp":"2024-09-12T01:30:02.558090+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:35.023715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":60,"num_write":41,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.755504+0000","last_change":"2024-09-12T01:29:59.755504+0000","last_active":"2024-09-12T01:29:59.755504+0000","last_peered":"2024-09-12T01:29:59.755504+0000","last_clean":"2024-09-12T01:29:59.755504+0000","last_became_active":"2024-09-12T01:04:13.470465+0000","last_became_peered":"2024-09-12T01:04:13.470465+0000","last_unstale":"2024-09-12T01:29:59.755504+0000","last_undegraded":"2024-09-12T01:29:59.755504+0000","last_fullsized":"2024-09-12T01:29:59.755504+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:59.755411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:59.755411+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.755411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:02.098986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"265'8","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:17.901747+0000","last_change":"2024-09-12T01:30:17.901641+0000","last_active":"2024-09-12T01:30:17.901747+0000","last_peered":"2024-09-12T01:30:17.901747+0000","last_clean":"2024-09-12T01:30:17.901747+0000","last_became_active":"2024-09-12T00:48:45.318423+0000","last_became_peered":"2024-09-12T00:48:45.318423+0000","last_unstale":"2024-09-12T01:30:17.901747+0000","last_undegraded":"2024-09-12T01:30:17.901747+0000","last_fullsized":"2024-09-12T01:30:17.901747+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'8","last_scrub_stamp":"2024-09-12T01:30:17.901526+0000","last_deep_scrub":"265'8","last_deep_scrub_stamp":"2024-09-12T01:30:17.901526+0000","last_clean_scrub_stamp":"2024-09-12T01:30:17.901526+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:44.673517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":4098,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"265'3","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.663659+0000","last_change":"2024-09-12T01:30:00.663659+0000","last_active":"2024-09-12T01:30:00.663659+0000","last_peered":"2024-09-12T01:30:00.663659+0000","last_clean":"2024-09-12T01:30:00.663659+0000","last_became_active":"2024-09-12T00:48:42.292607+0000","last_became_peered":"2024-09-12T00:48:42.292607+0000","last_unstale":"2024-09-12T01:30:00.663659+0000","last_undegraded":"2024-09-12T01:30:00.663659+0000","last_fullsized":"2024-09-12T01:30:00.663659+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:30:00.663563+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:30:00.663563+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.663563+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:48.079407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"265'33","reported_seq":149,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.084808+0000","last_change":"2024-09-12T01:29:59.084808+0000","last_active":"2024-09-12T01:29:59.084808+0000","last_peered":"2024-09-12T01:29:59.084808+0000","last_clean":"2024-09-12T01:29:59.084808+0000","last_became_active":"2024-09-12T00:46:03.918204+0000","last_became_peered":"2024-09-12T00:46:03.918204+0000","last_unstale":"2024-09-12T01:29:59.084808+0000","last_undegraded":"2024-09-12T01:29:59.084808+0000","last_fullsized":"2024-09-12T01:29:59.084808+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-12T01:29:59.084722+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-12T01:29:59.084722+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.084722+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:25.176184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":182,"num_read_kb":133,"num_write":46,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:19.866994+0000","last_change":"2024-09-12T01:30:19.866994+0000","last_active":"2024-09-12T01:30:19.866994+0000","last_peered":"2024-09-12T01:30:19.866994+0000","last_clean":"2024-09-12T01:30:19.866994+0000","last_became_active":"2024-09-12T01:04:13.465081+0000","last_became_peered":"2024-09-12T01:04:13.465081+0000","last_unstale":"2024-09-12T01:30:19.866994+0000","last_undegraded":"2024-09-12T01:30:19.866994+0000","last_fullsized":"2024-09-12T01:30:19.866994+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:19.866897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:19.866897+0000","last_clean_scrub_stamp":"2024-09-12T01:30:19.866897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:30.088697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:12.867066+0000","last_change":"2024-09-12T01:30:12.867066+0000","last_active":"2024-09-12T01:30:12.867066+0000","last_peered":"2024-09-12T01:30:12.867066+0000","last_clean":"2024-09-12T01:30:12.867066+0000","last_became_active":"2024-09-12T00:48:45.314837+0000","last_became_peered":"2024-09-12T00:48:45.314837+0000","last_unstale":"2024-09-12T01:30:12.867066+0000","last_undegraded":"2024-09-12T01:30:12.867066+0000","last_fullsized":"2024-09-12T01:30:12.867066+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:12.866968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:12.866968+0000","last_clean_scrub_stamp":"2024-09-12T01:30:12.866968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:06.961840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"265'10","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.692315+0000","last_change":"2024-09-12T01:29:56.692252+0000","last_active":"2024-09-12T01:29:56.692315+0000","last_peered":"2024-09-12T01:29:56.692315+0000","last_clean":"2024-09-12T01:29:56.692315+0000","last_became_active":"2024-09-12T00:48:42.290570+0000","last_became_peered":"2024-09-12T00:48:42.290570+0000","last_unstale":"2024-09-12T01:29:56.692315+0000","last_undegraded":"2024-09-12T01:29:56.692315+0000","last_fullsized":"2024-09-12T01:29:56.692315+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:29:56.692158+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:29:56.692158+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.692158+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:06.893219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":32770,"num_write":15,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"265'58","reported_seq":254,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.122726+0000","last_change":"2024-09-12T01:30:00.122726+0000","last_active":"2024-09-12T01:30:00.122726+0000","last_peered":"2024-09-12T01:30:00.122726+0000","last_clean":"2024-09-12T01:30:00.122726+0000","last_became_active":"2024-09-12T00:46:03.912603+0000","last_became_peered":"2024-09-12T00:46:03.912603+0000","last_unstale":"2024-09-12T01:30:00.122726+0000","last_undegraded":"2024-09-12T01:30:00.122726+0000","last_fullsized":"2024-09-12T01:30:00.122726+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'58","last_scrub_stamp":"2024-09-12T01:30:00.122637+0000","last_deep_scrub":"265'58","last_deep_scrub_stamp":"2024-09-12T01:30:00.122637+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.122637+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:26.770381+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":388,"num_read_kb":263,"num_write":69,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3960,"num_omap_keys":8,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:11.672445+0000","last_change":"2024-09-12T01:30:11.672381+0000","last_active":"2024-09-12T01:30:11.672445+0000","last_peered":"2024-09-12T01:30:11.672445+0000","last_clean":"2024-09-12T01:30:11.672445+0000","last_became_active":"2024-09-12T01:04:13.458781+0000","last_became_peered":"2024-09-12T01:04:13.458781+0000","last_unstale":"2024-09-12T01:30:11.672445+0000","last_undegraded":"2024-09-12T01:30:11.672445+0000","last_fullsized":"2024-09-12T01:30:11.672445+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:11.672295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:11.672295+0000","last_clean_scrub_stamp":"2024-09-12T01:30:11.672295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:07.717308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"262'5","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.110598+0000","last_change":"2024-09-12T01:29:52.110533+0000","last_active":"2024-09-12T01:29:52.110598+0000","last_peered":"2024-09-12T01:29:52.110598+0000","last_clean":"2024-09-12T01:29:52.110598+0000","last_became_active":"2024-09-12T00:48:45.318608+0000","last_became_peered":"2024-09-12T00:48:45.318608+0000","last_unstale":"2024-09-12T01:29:52.110598+0000","last_undegraded":"2024-09-12T01:29:52.110598+0000","last_fullsized":"2024-09-12T01:29:52.110598+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:29:52.110441+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:29:52.110441+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.110441+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:57.965213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"265'11","reported_seq":70,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:03.800870+0000","last_change":"2024-09-12T01:30:03.800870+0000","last_active":"2024-09-12T01:30:03.800870+0000","last_peered":"2024-09-12T01:30:03.800870+0000","last_clean":"2024-09-12T01:30:03.800870+0000","last_became_active":"2024-09-12T00:48:42.297952+0000","last_became_peered":"2024-09-12T00:48:42.297952+0000","last_unstale":"2024-09-12T01:30:03.800870+0000","last_undegraded":"2024-09-12T01:30:03.800870+0000","last_fullsized":"2024-09-12T01:30:03.800870+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T01:30:03.800775+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T01:30:03.800775+0000","last_clean_scrub_stamp":"2024-09-12T01:30:03.800775+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:39.917001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":16432,"num_write":11,"num_write_kb":16432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"265'28","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.115939+0000","last_change":"2024-09-12T01:29:58.115939+0000","last_active":"2024-09-12T01:29:58.115939+0000","last_peered":"2024-09-12T01:29:58.115939+0000","last_clean":"2024-09-12T01:29:58.115939+0000","last_became_active":"2024-09-12T00:46:03.915917+0000","last_became_peered":"2024-09-12T00:46:03.915917+0000","last_unstale":"2024-09-12T01:29:58.115939+0000","last_undegraded":"2024-09-12T01:29:58.115939+0000","last_fullsized":"2024-09-12T01:29:58.115939+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'28","last_scrub_stamp":"2024-09-12T01:29:58.115806+0000","last_deep_scrub":"265'28","last_deep_scrub_stamp":"2024-09-12T01:29:58.115806+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.115806+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:42.369063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":100,"num_write":58,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:07.555255+0000","last_change":"2024-09-12T01:30:07.555255+0000","last_active":"2024-09-12T01:30:07.555255+0000","last_peered":"2024-09-12T01:30:07.555255+0000","last_clean":"2024-09-12T01:30:07.555255+0000","last_became_active":"2024-09-12T01:04:13.465173+0000","last_became_peered":"2024-09-12T01:04:13.465173+0000","last_unstale":"2024-09-12T01:30:07.555255+0000","last_undegraded":"2024-09-12T01:30:07.555255+0000","last_fullsized":"2024-09-12T01:30:07.555255+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:07.555164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:07.555164+0000","last_clean_scrub_stamp":"2024-09-12T01:30:07.555164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:51.960386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:24.284264+0000","last_change":"2024-09-12T01:30:24.284264+0000","last_active":"2024-09-12T01:30:24.284264+0000","last_peered":"2024-09-12T01:30:24.284264+0000","last_clean":"2024-09-12T01:30:24.284264+0000","last_became_active":"2024-09-12T00:48:45.313443+0000","last_became_peered":"2024-09-12T00:48:45.313443+0000","last_unstale":"2024-09-12T01:30:24.284264+0000","last_undegraded":"2024-09-12T01:30:24.284264+0000","last_fullsized":"2024-09-12T01:30:24.284264+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:30:24.284170+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:30:24.284170+0000","last_clean_scrub_stamp":"2024-09-12T01:30:24.284170+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:39.428001+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"265'7","reported_seq":68,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:20.239101+0000","last_change":"2024-09-12T01:30:20.239101+0000","last_active":"2024-09-12T01:30:20.239101+0000","last_peered":"2024-09-12T01:30:20.239101+0000","last_clean":"2024-09-12T01:30:20.239101+0000","last_became_active":"2024-09-12T00:48:42.293128+0000","last_became_peered":"2024-09-12T00:48:42.293128+0000","last_unstale":"2024-09-12T01:30:20.239101+0000","last_undegraded":"2024-09-12T01:30:20.239101+0000","last_fullsized":"2024-09-12T01:30:20.239101+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T01:30:20.239009+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T01:30:20.239009+0000","last_clean_scrub_stamp":"2024-09-12T01:30:20.239009+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:28.521447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":20530,"num_write":7,"num_write_kb":5168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"265'40","reported_seq":165,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.491716+0000","last_change":"2024-09-12T01:29:58.491716+0000","last_active":"2024-09-12T01:29:58.491716+0000","last_peered":"2024-09-12T01:29:58.491716+0000","last_clean":"2024-09-12T01:29:58.491716+0000","last_became_active":"2024-09-12T00:46:03.923029+0000","last_became_peered":"2024-09-12T00:46:03.923029+0000","last_unstale":"2024-09-12T01:29:58.491716+0000","last_undegraded":"2024-09-12T01:29:58.491716+0000","last_fullsized":"2024-09-12T01:29:58.491716+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'40","last_scrub_stamp":"2024-09-12T01:29:58.491625+0000","last_deep_scrub":"265'40","last_deep_scrub_stamp":"2024-09-12T01:29:58.491625+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.491625+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:59:09.588985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":205,"num_read_kb":145,"num_write":75,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"265'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:04.411562+0000","last_change":"2024-09-12T01:30:04.411562+0000","last_active":"2024-09-12T01:30:04.411562+0000","last_peered":"2024-09-12T01:30:04.411562+0000","last_clean":"2024-09-12T01:30:04.411562+0000","last_became_active":"2024-09-12T01:04:13.468832+0000","last_became_peered":"2024-09-12T01:04:13.468832+0000","last_unstale":"2024-09-12T01:30:04.411562+0000","last_undegraded":"2024-09-12T01:30:04.411562+0000","last_fullsized":"2024-09-12T01:30:04.411562+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:04.411496+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:04.411496+0000","last_clean_scrub_stamp":"2024-09-12T01:30:04.411496+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:12.846037+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"0'0","reported_seq":43,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:05.442443+0000","last_change":"2024-09-12T01:30:05.442443+0000","last_active":"2024-09-12T01:30:05.442443+0000","last_peered":"2024-09-12T01:30:05.442443+0000","last_clean":"2024-09-12T01:30:05.442443+0000","last_became_active":"2024-09-12T00:48:45.309166+0000","last_became_peered":"2024-09-12T00:48:45.309166+0000","last_unstale":"2024-09-12T01:30:05.442443+0000","last_undegraded":"2024-09-12T01:30:05.442443+0000","last_fullsized":"2024-09-12T01:30:05.442443+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:05.442358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:05.442358+0000","last_clean_scrub_stamp":"2024-09-12T01:30:05.442358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:47.746432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.135129+0000","last_change":"2024-09-12T01:29:49.135129+0000","last_active":"2024-09-12T01:29:49.135129+0000","last_peered":"2024-09-12T01:29:49.135129+0000","last_clean":"2024-09-12T01:29:49.135129+0000","last_became_active":"2024-09-12T00:48:42.291800+0000","last_became_peered":"2024-09-12T00:48:42.291800+0000","last_unstale":"2024-09-12T01:29:49.135129+0000","last_undegraded":"2024-09-12T01:29:49.135129+0000","last_fullsized":"2024-09-12T01:29:49.135129+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:49.135008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:49.135008+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.135008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:55.800469+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"265'17","reported_seq":105,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.623046+0000","last_change":"2024-09-12T01:29:54.623046+0000","last_active":"2024-09-12T01:29:54.623046+0000","last_peered":"2024-09-12T01:29:54.623046+0000","last_clean":"2024-09-12T01:29:54.623046+0000","last_became_active":"2024-09-12T00:46:03.913667+0000","last_became_peered":"2024-09-12T00:46:03.913667+0000","last_unstale":"2024-09-12T01:29:54.623046+0000","last_undegraded":"2024-09-12T01:29:54.623046+0000","last_fullsized":"2024-09-12T01:29:54.623046+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'17","last_scrub_stamp":"2024-09-12T01:29:54.622956+0000","last_deep_scrub":"265'17","last_deep_scrub_stamp":"2024-09-12T01:29:54.622956+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.622956+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:21.226949+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":62,"num_write":33,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.079993+0000","last_change":"2024-09-12T01:29:58.079993+0000","last_active":"2024-09-12T01:29:58.079993+0000","last_peered":"2024-09-12T01:29:58.079993+0000","last_clean":"2024-09-12T01:29:58.079993+0000","last_became_active":"2024-09-12T01:04:13.462605+0000","last_became_peered":"2024-09-12T01:04:13.462605+0000","last_unstale":"2024-09-12T01:29:58.079993+0000","last_undegraded":"2024-09-12T01:29:58.079993+0000","last_fullsized":"2024-09-12T01:29:58.079993+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:58.079892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:58.079892+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.079892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:28.907381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"265'2","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:08.634063+0000","last_change":"2024-09-12T01:30:08.634063+0000","last_active":"2024-09-12T01:30:08.634063+0000","last_peered":"2024-09-12T01:30:08.634063+0000","last_clean":"2024-09-12T01:30:08.634063+0000","last_became_active":"2024-09-12T00:48:45.314128+0000","last_became_peered":"2024-09-12T00:48:45.314128+0000","last_unstale":"2024-09-12T01:30:08.634063+0000","last_undegraded":"2024-09-12T01:30:08.634063+0000","last_fullsized":"2024-09-12T01:30:08.634063+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:08.633961+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:08.633961+0000","last_clean_scrub_stamp":"2024-09-12T01:30:08.633961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:43.415471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"0'0","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:03.128141+0000","last_change":"2024-09-12T01:30:03.128141+0000","last_active":"2024-09-12T01:30:03.128141+0000","last_peered":"2024-09-12T01:30:03.128141+0000","last_clean":"2024-09-12T01:30:03.128141+0000","last_became_active":"2024-09-12T00:48:42.295886+0000","last_became_peered":"2024-09-12T00:48:42.295886+0000","last_unstale":"2024-09-12T01:30:03.128141+0000","last_undegraded":"2024-09-12T01:30:03.128141+0000","last_fullsized":"2024-09-12T01:30:03.128141+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:03.128020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:03.128020+0000","last_clean_scrub_stamp":"2024-09-12T01:30:03.128020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:53.666167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"265'14","reported_seq":93,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.073624+0000","last_change":"2024-09-12T01:29:57.073624+0000","last_active":"2024-09-12T01:29:57.073624+0000","last_peered":"2024-09-12T01:29:57.073624+0000","last_clean":"2024-09-12T01:29:57.073624+0000","last_became_active":"2024-09-12T00:46:03.919334+0000","last_became_peered":"2024-09-12T00:46:03.919334+0000","last_unstale":"2024-09-12T01:29:57.073624+0000","last_undegraded":"2024-09-12T01:29:57.073624+0000","last_fullsized":"2024-09-12T01:29:57.073624+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'14","last_scrub_stamp":"2024-09-12T01:29:57.073537+0000","last_deep_scrub":"265'14","last_deep_scrub_stamp":"2024-09-12T01:29:57.073537+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.073537+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:15.408952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":46,"num_write":26,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:20.822754+0000","last_change":"2024-09-12T01:30:20.822754+0000","last_active":"2024-09-12T01:30:20.822754+0000","last_peered":"2024-09-12T01:30:20.822754+0000","last_clean":"2024-09-12T01:30:20.822754+0000","last_became_active":"2024-09-12T01:04:13.467230+0000","last_became_peered":"2024-09-12T01:04:13.467230+0000","last_unstale":"2024-09-12T01:30:20.822754+0000","last_undegraded":"2024-09-12T01:30:20.822754+0000","last_fullsized":"2024-09-12T01:30:20.822754+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:20.822614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:20.822614+0000","last_clean_scrub_stamp":"2024-09-12T01:30:20.822614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:49.389761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"265'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:07.678153+0000","last_change":"2024-09-12T01:30:07.678153+0000","last_active":"2024-09-12T01:30:07.678153+0000","last_peered":"2024-09-12T01:30:07.678153+0000","last_clean":"2024-09-12T01:30:07.678153+0000","last_became_active":"2024-09-12T00:48:45.309604+0000","last_became_peered":"2024-09-12T00:48:45.309604+0000","last_unstale":"2024-09-12T01:30:07.678153+0000","last_undegraded":"2024-09-12T01:30:07.678153+0000","last_fullsized":"2024-09-12T01:30:07.678153+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:30:07.678052+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:30:07.678052+0000","last_clean_scrub_stamp":"2024-09-12T01:30:07.678052+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:10.563758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:14.272080+0000","last_change":"2024-09-12T01:30:14.272080+0000","last_active":"2024-09-12T01:30:14.272080+0000","last_peered":"2024-09-12T01:30:14.272080+0000","last_clean":"2024-09-12T01:30:14.272080+0000","last_became_active":"2024-09-12T00:48:42.293705+0000","last_became_peered":"2024-09-12T00:48:42.293705+0000","last_unstale":"2024-09-12T01:30:14.272080+0000","last_undegraded":"2024-09-12T01:30:14.272080+0000","last_fullsized":"2024-09-12T01:30:14.272080+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:14.271984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:14.271984+0000","last_clean_scrub_stamp":"2024-09-12T01:30:14.271984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:07.407029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"265'6","reported_seq":73,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.601592+0000","last_change":"2024-09-12T01:30:00.601592+0000","last_active":"2024-09-12T01:30:00.601592+0000","last_peered":"2024-09-12T01:30:00.601592+0000","last_clean":"2024-09-12T01:30:00.601592+0000","last_became_active":"2024-09-12T00:46:03.916699+0000","last_became_peered":"2024-09-12T00:46:03.916699+0000","last_unstale":"2024-09-12T01:30:00.601592+0000","last_undegraded":"2024-09-12T01:30:00.601592+0000","last_fullsized":"2024-09-12T01:30:00.601592+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:30:00.601494+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:30:00.601494+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.601494+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:38.098128+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:05.097921+0000","last_change":"2024-09-12T01:30:05.097921+0000","last_active":"2024-09-12T01:30:05.097921+0000","last_peered":"2024-09-12T01:30:05.097921+0000","last_clean":"2024-09-12T01:30:05.097921+0000","last_became_active":"2024-09-12T01:04:13.468643+0000","last_became_peered":"2024-09-12T01:04:13.468643+0000","last_unstale":"2024-09-12T01:30:05.097921+0000","last_undegraded":"2024-09-12T01:30:05.097921+0000","last_fullsized":"2024-09-12T01:30:05.097921+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:05.097793+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:05.097793+0000","last_clean_scrub_stamp":"2024-09-12T01:30:05.097793+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:48.469135+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:11.832074+0000","last_change":"2024-09-12T01:30:11.832074+0000","last_active":"2024-09-12T01:30:11.832074+0000","last_peered":"2024-09-12T01:30:11.832074+0000","last_clean":"2024-09-12T01:30:11.832074+0000","last_became_active":"2024-09-12T00:48:45.314212+0000","last_became_peered":"2024-09-12T00:48:45.314212+0000","last_unstale":"2024-09-12T01:30:11.832074+0000","last_undegraded":"2024-09-12T01:30:11.832074+0000","last_fullsized":"2024-09-12T01:30:11.832074+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:30:11.831990+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:30:11.831990+0000","last_clean_scrub_stamp":"2024-09-12T01:30:11.831990+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:05.913868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"265'3","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.122795+0000","last_change":"2024-09-12T01:29:48.122718+0000","last_active":"2024-09-12T01:29:48.122795+0000","last_peered":"2024-09-12T01:29:48.122795+0000","last_clean":"2024-09-12T01:29:48.122795+0000","last_became_active":"2024-09-12T00:48:42.291818+0000","last_became_peered":"2024-09-12T00:48:42.291818+0000","last_unstale":"2024-09-12T01:29:48.122795+0000","last_undegraded":"2024-09-12T01:29:48.122795+0000","last_fullsized":"2024-09-12T01:29:48.122795+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:48.122622+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:48.122622+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.122622+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:23.762152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"265'35","reported_seq":151,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.578624+0000","last_change":"2024-09-12T01:29:59.578624+0000","last_active":"2024-09-12T01:29:59.578624+0000","last_peered":"2024-09-12T01:29:59.578624+0000","last_clean":"2024-09-12T01:29:59.578624+0000","last_became_active":"2024-09-12T00:46:03.920696+0000","last_became_peered":"2024-09-12T00:46:03.920696+0000","last_unstale":"2024-09-12T01:29:59.578624+0000","last_undegraded":"2024-09-12T01:29:59.578624+0000","last_fullsized":"2024-09-12T01:29:59.578624+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'35","last_scrub_stamp":"2024-09-12T01:29:59.578532+0000","last_deep_scrub":"265'35","last_deep_scrub_stamp":"2024-09-12T01:29:59.578532+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.578532+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:44.043628+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":123,"num_write":60,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:02.404849+0000","last_change":"2024-09-12T01:30:02.404849+0000","last_active":"2024-09-12T01:30:02.404849+0000","last_peered":"2024-09-12T01:30:02.404849+0000","last_clean":"2024-09-12T01:30:02.404849+0000","last_became_active":"2024-09-12T01:04:13.471741+0000","last_became_peered":"2024-09-12T01:04:13.471741+0000","last_unstale":"2024-09-12T01:30:02.404849+0000","last_undegraded":"2024-09-12T01:30:02.404849+0000","last_fullsized":"2024-09-12T01:30:02.404849+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:02.404760+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:02.404760+0000","last_clean_scrub_stamp":"2024-09-12T01:30:02.404760+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:29.071632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"265'7","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:06.674710+0000","last_change":"2024-09-12T01:30:06.674710+0000","last_active":"2024-09-12T01:30:06.674710+0000","last_peered":"2024-09-12T01:30:06.674710+0000","last_clean":"2024-09-12T01:30:06.674710+0000","last_became_active":"2024-09-12T00:48:45.317576+0000","last_became_peered":"2024-09-12T00:48:45.317576+0000","last_unstale":"2024-09-12T01:30:06.674710+0000","last_undegraded":"2024-09-12T01:30:06.674710+0000","last_fullsized":"2024-09-12T01:30:06.674710+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'7","last_scrub_stamp":"2024-09-12T01:30:06.674612+0000","last_deep_scrub":"265'7","last_deep_scrub_stamp":"2024-09-12T01:30:06.674612+0000","last_clean_scrub_stamp":"2024-09-12T01:30:06.674612+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:29.008664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":26626,"num_write":7,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"262'5","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.619731+0000","last_change":"2024-09-12T01:29:59.619731+0000","last_active":"2024-09-12T01:29:59.619731+0000","last_peered":"2024-09-12T01:29:59.619731+0000","last_clean":"2024-09-12T01:29:59.619731+0000","last_became_active":"2024-09-12T00:48:42.291199+0000","last_became_peered":"2024-09-12T00:48:42.291199+0000","last_unstale":"2024-09-12T01:29:59.619731+0000","last_undegraded":"2024-09-12T01:29:59.619731+0000","last_fullsized":"2024-09-12T01:29:59.619731+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:29:59.619641+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:29:59.619641+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.619641+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:03.736526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5165,"num_write":10,"num_write_kb":5165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"265'6","reported_seq":75,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.647536+0000","last_change":"2024-09-12T01:29:53.647536+0000","last_active":"2024-09-12T01:29:53.647536+0000","last_peered":"2024-09-12T01:29:53.647536+0000","last_clean":"2024-09-12T01:29:53.647536+0000","last_became_active":"2024-09-12T00:46:03.919481+0000","last_became_peered":"2024-09-12T00:46:03.919481+0000","last_unstale":"2024-09-12T01:29:53.647536+0000","last_undegraded":"2024-09-12T01:29:53.647536+0000","last_fullsized":"2024-09-12T01:29:53.647536+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:29:53.647438+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:29:53.647438+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.647438+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:23.272786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":11,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.024874+0000","last_change":"2024-09-12T01:29:56.024874+0000","last_active":"2024-09-12T01:29:56.024874+0000","last_peered":"2024-09-12T01:29:56.024874+0000","last_clean":"2024-09-12T01:29:56.024874+0000","last_became_active":"2024-09-12T01:04:13.468317+0000","last_became_peered":"2024-09-12T01:04:13.468317+0000","last_unstale":"2024-09-12T01:29:56.024874+0000","last_undegraded":"2024-09-12T01:29:56.024874+0000","last_fullsized":"2024-09-12T01:29:56.024874+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:56.024783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:56.024783+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.024783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:32.913868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"262'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.079981+0000","last_change":"2024-09-12T01:29:59.079981+0000","last_active":"2024-09-12T01:29:59.079981+0000","last_peered":"2024-09-12T01:29:59.079981+0000","last_clean":"2024-09-12T01:29:59.079981+0000","last_became_active":"2024-09-12T00:48:45.315546+0000","last_became_peered":"2024-09-12T00:48:45.315546+0000","last_unstale":"2024-09-12T01:29:59.079981+0000","last_undegraded":"2024-09-12T01:29:59.079981+0000","last_fullsized":"2024-09-12T01:29:59.079981+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:29:59.079883+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:29:59.079883+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.079883+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:24.451968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"265'5","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:01.793480+0000","last_change":"2024-09-12T01:30:01.793480+0000","last_active":"2024-09-12T01:30:01.793480+0000","last_peered":"2024-09-12T01:30:01.793480+0000","last_clean":"2024-09-12T01:30:01.793480+0000","last_became_active":"2024-09-12T00:48:42.296509+0000","last_became_peered":"2024-09-12T00:48:42.296509+0000","last_unstale":"2024-09-12T01:30:01.793480+0000","last_undegraded":"2024-09-12T01:30:01.793480+0000","last_fullsized":"2024-09-12T01:30:01.793480+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:30:01.793380+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:30:01.793380+0000","last_clean_scrub_stamp":"2024-09-12T01:30:01.793380+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:33.430960+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"265'52","reported_seq":197,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:12.270418+0000","last_change":"2024-09-12T01:30:12.270362+0000","last_active":"2024-09-12T01:30:12.270418+0000","last_peered":"2024-09-12T01:30:12.270418+0000","last_clean":"2024-09-12T01:30:12.270418+0000","last_became_active":"2024-09-12T00:46:03.920188+0000","last_became_peered":"2024-09-12T00:46:03.920188+0000","last_unstale":"2024-09-12T01:30:12.270418+0000","last_undegraded":"2024-09-12T01:30:12.270418+0000","last_fullsized":"2024-09-12T01:30:12.270418+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'52","last_scrub_stamp":"2024-09-12T01:30:12.270264+0000","last_deep_scrub":"265'52","last_deep_scrub_stamp":"2024-09-12T01:30:12.270264+0000","last_clean_scrub_stamp":"2024-09-12T01:30:12.270264+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:15.466521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":182,"num_write":95,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:18.866989+0000","last_change":"2024-09-12T01:30:18.866989+0000","last_active":"2024-09-12T01:30:18.866989+0000","last_peered":"2024-09-12T01:30:18.866989+0000","last_clean":"2024-09-12T01:30:18.866989+0000","last_became_active":"2024-09-12T01:04:13.462434+0000","last_became_peered":"2024-09-12T01:04:13.462434+0000","last_unstale":"2024-09-12T01:30:18.866989+0000","last_undegraded":"2024-09-12T01:30:18.866989+0000","last_fullsized":"2024-09-12T01:30:18.866989+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:18.866878+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:18.866878+0000","last_clean_scrub_stamp":"2024-09-12T01:30:18.866878+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:22.136558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:10.824279+0000","last_change":"2024-09-12T01:30:10.824279+0000","last_active":"2024-09-12T01:30:10.824279+0000","last_peered":"2024-09-12T01:30:10.824279+0000","last_clean":"2024-09-12T01:30:10.824279+0000","last_became_active":"2024-09-12T00:48:45.316432+0000","last_became_peered":"2024-09-12T00:48:45.316432+0000","last_unstale":"2024-09-12T01:30:10.824279+0000","last_undegraded":"2024-09-12T01:30:10.824279+0000","last_fullsized":"2024-09-12T01:30:10.824279+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:10.824164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:10.824164+0000","last_clean_scrub_stamp":"2024-09-12T01:30:10.824164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:05.129693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.730540+0000","last_change":"2024-09-12T01:29:57.730540+0000","last_active":"2024-09-12T01:29:57.730540+0000","last_peered":"2024-09-12T01:29:57.730540+0000","last_clean":"2024-09-12T01:29:57.730540+0000","last_became_active":"2024-09-12T00:48:42.290454+0000","last_became_peered":"2024-09-12T00:48:42.290454+0000","last_unstale":"2024-09-12T01:29:57.730540+0000","last_undegraded":"2024-09-12T01:29:57.730540+0000","last_fullsized":"2024-09-12T01:29:57.730540+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:57.730455+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:57.730455+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.730455+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:31.605867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"262'7","reported_seq":77,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:10.251874+0000","last_change":"2024-09-12T01:30:10.251764+0000","last_active":"2024-09-12T01:30:10.251874+0000","last_peered":"2024-09-12T01:30:10.251874+0000","last_clean":"2024-09-12T01:30:10.251874+0000","last_became_active":"2024-09-12T00:46:03.917314+0000","last_became_peered":"2024-09-12T00:46:03.917314+0000","last_unstale":"2024-09-12T01:30:10.251874+0000","last_undegraded":"2024-09-12T01:30:10.251874+0000","last_fullsized":"2024-09-12T01:30:10.251874+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'7","last_scrub_stamp":"2024-09-12T01:30:10.251658+0000","last_deep_scrub":"262'7","last_deep_scrub_stamp":"2024-09-12T01:30:10.251658+0000","last_clean_scrub_stamp":"2024-09-12T01:30:10.251658+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:25.277948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":26,"num_write":13,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":31,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:08.045706+0000","last_change":"2024-09-12T01:30:08.045706+0000","last_active":"2024-09-12T01:30:08.045706+0000","last_peered":"2024-09-12T01:30:08.045706+0000","last_clean":"2024-09-12T01:30:08.045706+0000","last_became_active":"2024-09-12T01:04:13.467119+0000","last_became_peered":"2024-09-12T01:04:13.467119+0000","last_unstale":"2024-09-12T01:30:08.045706+0000","last_undegraded":"2024-09-12T01:30:08.045706+0000","last_fullsized":"2024-09-12T01:30:08.045706+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:08.045609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:08.045609+0000","last_clean_scrub_stamp":"2024-09-12T01:30:08.045609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:16.879908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"0'0","reported_seq":44,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:09.820437+0000","last_change":"2024-09-12T01:30:09.820437+0000","last_active":"2024-09-12T01:30:09.820437+0000","last_peered":"2024-09-12T01:30:09.820437+0000","last_clean":"2024-09-12T01:30:09.820437+0000","last_became_active":"2024-09-12T00:48:45.314127+0000","last_became_peered":"2024-09-12T00:48:45.314127+0000","last_unstale":"2024-09-12T01:30:09.820437+0000","last_undegraded":"2024-09-12T01:30:09.820437+0000","last_fullsized":"2024-09-12T01:30:09.820437+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:09.820316+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:09.820316+0000","last_clean_scrub_stamp":"2024-09-12T01:30:09.820316+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:49.308643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"262'5","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:06.778756+0000","last_change":"2024-09-12T01:30:06.778697+0000","last_active":"2024-09-12T01:30:06.778756+0000","last_peered":"2024-09-12T01:30:06.778756+0000","last_clean":"2024-09-12T01:30:06.778756+0000","last_became_active":"2024-09-12T00:48:42.293153+0000","last_became_peered":"2024-09-12T00:48:42.293153+0000","last_unstale":"2024-09-12T01:30:06.778756+0000","last_undegraded":"2024-09-12T01:30:06.778756+0000","last_fullsized":"2024-09-12T01:30:06.778756+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:30:06.778612+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:30:06.778612+0000","last_clean_scrub_stamp":"2024-09-12T01:30:06.778612+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:39.888471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"265'49","reported_seq":188,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.621240+0000","last_change":"2024-09-12T01:29:52.621180+0000","last_active":"2024-09-12T01:29:52.621240+0000","last_peered":"2024-09-12T01:29:52.621240+0000","last_clean":"2024-09-12T01:29:52.621240+0000","last_became_active":"2024-09-12T00:46:03.917142+0000","last_became_peered":"2024-09-12T00:46:03.917142+0000","last_unstale":"2024-09-12T01:29:52.621240+0000","last_undegraded":"2024-09-12T01:29:52.621240+0000","last_fullsized":"2024-09-12T01:29:52.621240+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'49","last_scrub_stamp":"2024-09-12T01:29:52.621077+0000","last_deep_scrub":"265'49","last_deep_scrub_stamp":"2024-09-12T01:29:52.621077+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.621077+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:15.538686+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":237,"num_read_kb":172,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:06.594311+0000","last_change":"2024-09-12T01:30:06.594311+0000","last_active":"2024-09-12T01:30:06.594311+0000","last_peered":"2024-09-12T01:30:06.594311+0000","last_clean":"2024-09-12T01:30:06.594311+0000","last_became_active":"2024-09-12T01:04:13.463766+0000","last_became_peered":"2024-09-12T01:04:13.463766+0000","last_unstale":"2024-09-12T01:30:06.594311+0000","last_undegraded":"2024-09-12T01:30:06.594311+0000","last_fullsized":"2024-09-12T01:30:06.594311+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:06.594226+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:06.594226+0000","last_clean_scrub_stamp":"2024-09-12T01:30:06.594226+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:17.235090+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"262'3","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:05.656805+0000","last_change":"2024-09-12T01:30:05.656805+0000","last_active":"2024-09-12T01:30:05.656805+0000","last_peered":"2024-09-12T01:30:05.656805+0000","last_clean":"2024-09-12T01:30:05.656805+0000","last_became_active":"2024-09-12T00:48:45.307036+0000","last_became_peered":"2024-09-12T00:48:45.307036+0000","last_unstale":"2024-09-12T01:30:05.656805+0000","last_undegraded":"2024-09-12T01:30:05.656805+0000","last_fullsized":"2024-09-12T01:30:05.656805+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:30:05.656679+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:30:05.656679+0000","last_clean_scrub_stamp":"2024-09-12T01:30:05.656679+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:46:21.982090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"265'5","reported_seq":59,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.731204+0000","last_change":"2024-09-12T01:29:53.731204+0000","last_active":"2024-09-12T01:29:53.731204+0000","last_peered":"2024-09-12T01:29:53.731204+0000","last_clean":"2024-09-12T01:29:53.731204+0000","last_became_active":"2024-09-12T00:48:42.294608+0000","last_became_peered":"2024-09-12T00:48:42.294608+0000","last_unstale":"2024-09-12T01:29:53.731204+0000","last_undegraded":"2024-09-12T01:29:53.731204+0000","last_fullsized":"2024-09-12T01:29:53.731204+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:29:53.731118+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:29:53.731118+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.731118+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:49:26.531554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5438,"num_write":5,"num_write_kb":5438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"265'20","reported_seq":109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.501446+0000","last_change":"2024-09-12T01:29:52.501369+0000","last_active":"2024-09-12T01:29:52.501446+0000","last_peered":"2024-09-12T01:29:52.501446+0000","last_clean":"2024-09-12T01:29:52.501446+0000","last_became_active":"2024-09-12T00:46:03.921844+0000","last_became_peered":"2024-09-12T00:46:03.921844+0000","last_unstale":"2024-09-12T01:29:52.501446+0000","last_undegraded":"2024-09-12T01:29:52.501446+0000","last_fullsized":"2024-09-12T01:29:52.501446+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'20","last_scrub_stamp":"2024-09-12T01:29:52.501280+0000","last_deep_scrub":"265'20","last_deep_scrub_stamp":"2024-09-12T01:29:52.501280+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.501280+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:14.709150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":67,"num_write":37,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"265'2","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:06.088720+0000","last_change":"2024-09-12T01:30:06.088720+0000","last_active":"2024-09-12T01:30:06.088720+0000","last_peered":"2024-09-12T01:30:06.088720+0000","last_clean":"2024-09-12T01:30:06.088720+0000","last_became_active":"2024-09-12T01:04:13.462441+0000","last_became_peered":"2024-09-12T01:04:13.462441+0000","last_unstale":"2024-09-12T01:30:06.088720+0000","last_undegraded":"2024-09-12T01:30:06.088720+0000","last_fullsized":"2024-09-12T01:30:06.088720+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:06.088622+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:06.088622+0000","last_clean_scrub_stamp":"2024-09-12T01:30:06.088622+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:39.433672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"265'11","reported_seq":66,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:22.296070+0000","last_change":"2024-09-12T01:30:22.296070+0000","last_active":"2024-09-12T01:30:22.296070+0000","last_peered":"2024-09-12T01:30:22.296070+0000","last_clean":"2024-09-12T01:30:22.296070+0000","last_became_active":"2024-09-12T00:48:45.312617+0000","last_became_peered":"2024-09-12T00:48:45.312617+0000","last_unstale":"2024-09-12T01:30:22.296070+0000","last_undegraded":"2024-09-12T01:30:22.296070+0000","last_fullsized":"2024-09-12T01:30:22.296070+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'11","last_scrub_stamp":"2024-09-12T01:30:22.295958+0000","last_deep_scrub":"265'11","last_deep_scrub_stamp":"2024-09-12T01:30:22.295958+0000","last_clean_scrub_stamp":"2024-09-12T01:30:22.295958+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:31.143841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":20528,"num_write":21,"num_write_kb":15408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"0'0","reported_seq":50,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.714484+0000","last_change":"2024-09-12T01:29:52.714484+0000","last_active":"2024-09-12T01:29:52.714484+0000","last_peered":"2024-09-12T01:29:52.714484+0000","last_clean":"2024-09-12T01:29:52.714484+0000","last_became_active":"2024-09-12T00:48:42.292511+0000","last_became_peered":"2024-09-12T00:48:42.292511+0000","last_unstale":"2024-09-12T01:29:52.714484+0000","last_undegraded":"2024-09-12T01:29:52.714484+0000","last_fullsized":"2024-09-12T01:29:52.714484+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:52.714394+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:52.714394+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.714394+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:59.474523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"265'10","reported_seq":85,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.619831+0000","last_change":"2024-09-12T01:29:51.619764+0000","last_active":"2024-09-12T01:29:51.619831+0000","last_peered":"2024-09-12T01:29:51.619831+0000","last_clean":"2024-09-12T01:29:51.619831+0000","last_became_active":"2024-09-12T00:46:03.913098+0000","last_became_peered":"2024-09-12T00:46:03.913098+0000","last_unstale":"2024-09-12T01:29:51.619831+0000","last_undegraded":"2024-09-12T01:29:51.619831+0000","last_fullsized":"2024-09-12T01:29:51.619831+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:29:51.619673+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:29:51.619673+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.619673+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:11.583695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":36,"num_write":17,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:16.931047+0000","last_change":"2024-09-12T01:30:16.930991+0000","last_active":"2024-09-12T01:30:16.931047+0000","last_peered":"2024-09-12T01:30:16.931047+0000","last_clean":"2024-09-12T01:30:16.931047+0000","last_became_active":"2024-09-12T01:04:13.473901+0000","last_became_peered":"2024-09-12T01:04:13.473901+0000","last_unstale":"2024-09-12T01:30:16.931047+0000","last_undegraded":"2024-09-12T01:30:16.931047+0000","last_fullsized":"2024-09-12T01:30:16.931047+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:16.930893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:16.930893+0000","last_clean_scrub_stamp":"2024-09-12T01:30:16.930893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:25.949186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"265'5","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:03.648790+0000","last_change":"2024-09-12T01:30:03.648790+0000","last_active":"2024-09-12T01:30:03.648790+0000","last_peered":"2024-09-12T01:30:03.648790+0000","last_clean":"2024-09-12T01:30:03.648790+0000","last_became_active":"2024-09-12T00:48:45.308676+0000","last_became_peered":"2024-09-12T00:48:45.308676+0000","last_unstale":"2024-09-12T01:30:03.648790+0000","last_undegraded":"2024-09-12T01:30:03.648790+0000","last_fullsized":"2024-09-12T01:30:03.648790+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:30:03.648703+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:30:03.648703+0000","last_clean_scrub_stamp":"2024-09-12T01:30:03.648703+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:41.348995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":80,"num_write":10,"num_write_kb":5160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"265'6","reported_seq":61,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.469888+0000","last_change":"2024-09-12T01:29:55.469888+0000","last_active":"2024-09-12T01:29:55.469888+0000","last_peered":"2024-09-12T01:29:55.469888+0000","last_clean":"2024-09-12T01:29:55.469888+0000","last_became_active":"2024-09-12T00:48:42.291569+0000","last_became_peered":"2024-09-12T00:48:42.291569+0000","last_unstale":"2024-09-12T01:29:55.469888+0000","last_undegraded":"2024-09-12T01:29:55.469888+0000","last_fullsized":"2024-09-12T01:29:55.469888+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'6","last_scrub_stamp":"2024-09-12T01:29:55.469801+0000","last_deep_scrub":"265'6","last_deep_scrub_stamp":"2024-09-12T01:29:55.469801+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.469801+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:27.799276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":11,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"265'67","reported_seq":241,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.640362+0000","last_change":"2024-09-12T01:29:50.640362+0000","last_active":"2024-09-12T01:29:50.640362+0000","last_peered":"2024-09-12T01:29:50.640362+0000","last_clean":"2024-09-12T01:29:50.640362+0000","last_became_active":"2024-09-12T00:46:03.920387+0000","last_became_peered":"2024-09-12T00:46:03.920387+0000","last_unstale":"2024-09-12T01:29:50.640362+0000","last_undegraded":"2024-09-12T01:29:50.640362+0000","last_fullsized":"2024-09-12T01:29:50.640362+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'67","last_scrub_stamp":"2024-09-12T01:29:50.640239+0000","last_deep_scrub":"265'67","last_deep_scrub_stamp":"2024-09-12T01:29:50.640239+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.640239+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:17.011130+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":348,"num_read_kb":242,"num_write":122,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.723680+0000","last_change":"2024-09-12T01:29:55.723680+0000","last_active":"2024-09-12T01:29:55.723680+0000","last_peered":"2024-09-12T01:29:55.723680+0000","last_clean":"2024-09-12T01:29:55.723680+0000","last_became_active":"2024-09-12T01:04:13.469544+0000","last_became_peered":"2024-09-12T01:04:13.469544+0000","last_unstale":"2024-09-12T01:29:55.723680+0000","last_undegraded":"2024-09-12T01:29:55.723680+0000","last_fullsized":"2024-09-12T01:29:55.723680+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:55.723589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:55.723589+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.723589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:42.812895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"262'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:02.616707+0000","last_change":"2024-09-12T01:30:02.616707+0000","last_active":"2024-09-12T01:30:02.616707+0000","last_peered":"2024-09-12T01:30:02.616707+0000","last_clean":"2024-09-12T01:30:02.616707+0000","last_became_active":"2024-09-12T00:48:45.310425+0000","last_became_peered":"2024-09-12T00:48:45.310425+0000","last_unstale":"2024-09-12T01:30:02.616707+0000","last_undegraded":"2024-09-12T01:30:02.616707+0000","last_fullsized":"2024-09-12T01:30:02.616707+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T01:30:02.616595+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T01:30:02.616595+0000","last_clean_scrub_stamp":"2024-09-12T01:30:02.616595+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:12.964549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":318,"num_write":2,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:02.125670+0000","last_change":"2024-09-12T01:30:02.125670+0000","last_active":"2024-09-12T01:30:02.125670+0000","last_peered":"2024-09-12T01:30:02.125670+0000","last_clean":"2024-09-12T01:30:02.125670+0000","last_became_active":"2024-09-12T00:48:42.288750+0000","last_became_peered":"2024-09-12T00:48:42.288750+0000","last_unstale":"2024-09-12T01:30:02.125670+0000","last_undegraded":"2024-09-12T01:30:02.125670+0000","last_fullsized":"2024-09-12T01:30:02.125670+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:02.125584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:02.125584+0000","last_clean_scrub_stamp":"2024-09-12T01:30:02.125584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:16:49.724045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"265'39","reported_seq":158,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:11.280484+0000","last_change":"2024-09-12T01:30:11.280484+0000","last_active":"2024-09-12T01:30:11.280484+0000","last_peered":"2024-09-12T01:30:11.280484+0000","last_clean":"2024-09-12T01:30:11.280484+0000","last_became_active":"2024-09-12T00:46:03.918395+0000","last_became_peered":"2024-09-12T00:46:03.918395+0000","last_unstale":"2024-09-12T01:30:11.280484+0000","last_undegraded":"2024-09-12T01:30:11.280484+0000","last_fullsized":"2024-09-12T01:30:11.280484+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'39","last_scrub_stamp":"2024-09-12T01:30:11.280392+0000","last_deep_scrub":"265'39","last_deep_scrub_stamp":"2024-09-12T01:30:11.280392+0000","last_clean_scrub_stamp":"2024-09-12T01:30:11.280392+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:25.740102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":130,"num_write":82,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:26.286214+0000","last_change":"2024-09-12T01:30:26.286214+0000","last_active":"2024-09-12T01:30:26.286214+0000","last_peered":"2024-09-12T01:30:26.286214+0000","last_clean":"2024-09-12T01:30:26.286214+0000","last_became_active":"2024-09-12T01:04:13.468492+0000","last_became_peered":"2024-09-12T01:04:13.468492+0000","last_unstale":"2024-09-12T01:30:26.286214+0000","last_undegraded":"2024-09-12T01:30:26.286214+0000","last_fullsized":"2024-09-12T01:30:26.286214+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:26.286119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:26.286119+0000","last_clean_scrub_stamp":"2024-09-12T01:30:26.286119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:22.465925+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"265'3","reported_seq":52,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:04.672405+0000","last_change":"2024-09-12T01:30:04.672405+0000","last_active":"2024-09-12T01:30:04.672405+0000","last_peered":"2024-09-12T01:30:04.672405+0000","last_clean":"2024-09-12T01:30:04.672405+0000","last_became_active":"2024-09-12T00:48:45.306581+0000","last_became_peered":"2024-09-12T00:48:45.306581+0000","last_unstale":"2024-09-12T01:30:04.672405+0000","last_undegraded":"2024-09-12T01:30:04.672405+0000","last_fullsized":"2024-09-12T01:30:04.672405+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:30:04.672288+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:30:04.672288+0000","last_clean_scrub_stamp":"2024-09-12T01:30:04.672288+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:00.839242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.560659+0000","last_change":"2024-09-12T01:29:57.560659+0000","last_active":"2024-09-12T01:29:57.560659+0000","last_peered":"2024-09-12T01:29:57.560659+0000","last_clean":"2024-09-12T01:29:57.560659+0000","last_became_active":"2024-09-12T00:48:42.290069+0000","last_became_peered":"2024-09-12T00:48:42.290069+0000","last_unstale":"2024-09-12T01:29:57.560659+0000","last_undegraded":"2024-09-12T01:29:57.560659+0000","last_fullsized":"2024-09-12T01:29:57.560659+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:57.560565+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:57.560565+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.560565+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:21.711185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"265'22","reported_seq":113,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.693045+0000","last_change":"2024-09-12T01:29:50.693045+0000","last_active":"2024-09-12T01:29:50.693045+0000","last_peered":"2024-09-12T01:29:50.693045+0000","last_clean":"2024-09-12T01:29:50.693045+0000","last_became_active":"2024-09-12T00:46:03.917612+0000","last_became_peered":"2024-09-12T00:46:03.917612+0000","last_unstale":"2024-09-12T01:29:50.693045+0000","last_undegraded":"2024-09-12T01:29:50.693045+0000","last_fullsized":"2024-09-12T01:29:50.693045+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'22","last_scrub_stamp":"2024-09-12T01:29:50.692952+0000","last_deep_scrub":"265'22","last_deep_scrub_stamp":"2024-09-12T01:29:50.692952+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.692952+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:18:44.188500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":67,"num_write":52,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.741960+0000","last_change":"2024-09-12T01:30:00.741887+0000","last_active":"2024-09-12T01:30:00.741960+0000","last_peered":"2024-09-12T01:30:00.741960+0000","last_clean":"2024-09-12T01:30:00.741960+0000","last_became_active":"2024-09-12T01:04:13.470494+0000","last_became_peered":"2024-09-12T01:04:13.470494+0000","last_unstale":"2024-09-12T01:30:00.741960+0000","last_undegraded":"2024-09-12T01:30:00.741960+0000","last_fullsized":"2024-09-12T01:30:00.741960+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:00.741800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:00.741800+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.741800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:45.462724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"262'3","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:07.806091+0000","last_change":"2024-09-12T01:30:07.806091+0000","last_active":"2024-09-12T01:30:07.806091+0000","last_peered":"2024-09-12T01:30:07.806091+0000","last_clean":"2024-09-12T01:30:07.806091+0000","last_became_active":"2024-09-12T00:48:45.317637+0000","last_became_peered":"2024-09-12T00:48:45.317637+0000","last_unstale":"2024-09-12T01:30:07.806091+0000","last_undegraded":"2024-09-12T01:30:07.806091+0000","last_fullsized":"2024-09-12T01:30:07.806091+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:30:07.806011+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:30:07.806011+0000","last_clean_scrub_stamp":"2024-09-12T01:30:07.806011+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:47.223253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.593167+0000","last_change":"2024-09-12T01:29:58.593167+0000","last_active":"2024-09-12T01:29:58.593167+0000","last_peered":"2024-09-12T01:29:58.593167+0000","last_clean":"2024-09-12T01:29:58.593167+0000","last_became_active":"2024-09-12T00:48:42.289304+0000","last_became_peered":"2024-09-12T00:48:42.289304+0000","last_unstale":"2024-09-12T01:29:58.593167+0000","last_undegraded":"2024-09-12T01:29:58.593167+0000","last_fullsized":"2024-09-12T01:29:58.593167+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:58.593077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:58.593077+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.593077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:55.655484+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"265'33","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.057652+0000","last_change":"2024-09-12T01:29:56.057652+0000","last_active":"2024-09-12T01:29:56.057652+0000","last_peered":"2024-09-12T01:29:56.057652+0000","last_clean":"2024-09-12T01:29:56.057652+0000","last_became_active":"2024-09-12T00:46:03.911316+0000","last_became_peered":"2024-09-12T00:46:03.911316+0000","last_unstale":"2024-09-12T01:29:56.057652+0000","last_undegraded":"2024-09-12T01:29:56.057652+0000","last_fullsized":"2024-09-12T01:29:56.057652+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'33","last_scrub_stamp":"2024-09-12T01:29:56.057564+0000","last_deep_scrub":"265'33","last_deep_scrub_stamp":"2024-09-12T01:29:56.057564+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.057564+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:47.597238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":121,"num_write":55,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:15.944063+0000","last_change":"2024-09-12T01:30:15.944063+0000","last_active":"2024-09-12T01:30:15.944063+0000","last_peered":"2024-09-12T01:30:15.944063+0000","last_clean":"2024-09-12T01:30:15.944063+0000","last_became_active":"2024-09-12T01:04:13.462150+0000","last_became_peered":"2024-09-12T01:04:13.462150+0000","last_unstale":"2024-09-12T01:30:15.944063+0000","last_undegraded":"2024-09-12T01:30:15.944063+0000","last_fullsized":"2024-09-12T01:30:15.944063+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:15.943974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:15.943974+0000","last_clean_scrub_stamp":"2024-09-12T01:30:15.943974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:30.534837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"265'3","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:21.289563+0000","last_change":"2024-09-12T01:30:21.289563+0000","last_active":"2024-09-12T01:30:21.289563+0000","last_peered":"2024-09-12T01:30:21.289563+0000","last_clean":"2024-09-12T01:30:21.289563+0000","last_became_active":"2024-09-12T00:48:45.312283+0000","last_became_peered":"2024-09-12T00:48:45.312283+0000","last_unstale":"2024-09-12T01:30:21.289563+0000","last_undegraded":"2024-09-12T01:30:21.289563+0000","last_fullsized":"2024-09-12T01:30:21.289563+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:30:21.289474+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:30:21.289474+0000","last_clean_scrub_stamp":"2024-09-12T01:30:21.289474+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:01.551766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"265'3","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.594842+0000","last_change":"2024-09-12T01:29:55.594732+0000","last_active":"2024-09-12T01:29:55.594842+0000","last_peered":"2024-09-12T01:29:55.594842+0000","last_clean":"2024-09-12T01:29:55.594842+0000","last_became_active":"2024-09-12T00:48:42.290091+0000","last_became_peered":"2024-09-12T00:48:42.290091+0000","last_unstale":"2024-09-12T01:29:55.594842+0000","last_undegraded":"2024-09-12T01:29:55.594842+0000","last_fullsized":"2024-09-12T01:29:55.594842+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:55.594618+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:55.594618+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.594618+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:59.132412+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"265'27","reported_seq":136,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.071860+0000","last_change":"2024-09-12T01:29:55.071860+0000","last_active":"2024-09-12T01:29:55.071860+0000","last_peered":"2024-09-12T01:29:55.071860+0000","last_clean":"2024-09-12T01:29:55.071860+0000","last_became_active":"2024-09-12T00:46:03.916476+0000","last_became_peered":"2024-09-12T00:46:03.916476+0000","last_unstale":"2024-09-12T01:29:55.071860+0000","last_undegraded":"2024-09-12T01:29:55.071860+0000","last_fullsized":"2024-09-12T01:29:55.071860+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'27","last_scrub_stamp":"2024-09-12T01:29:55.071769+0000","last_deep_scrub":"265'27","last_deep_scrub_stamp":"2024-09-12T01:29:55.071769+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.071769+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:56:22.084538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":150,"num_read_kb":106,"num_write":44,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:03.416334+0000","last_change":"2024-09-12T01:30:03.416334+0000","last_active":"2024-09-12T01:30:03.416334+0000","last_peered":"2024-09-12T01:30:03.416334+0000","last_clean":"2024-09-12T01:30:03.416334+0000","last_became_active":"2024-09-12T01:04:13.467045+0000","last_became_peered":"2024-09-12T01:04:13.467045+0000","last_unstale":"2024-09-12T01:30:03.416334+0000","last_undegraded":"2024-09-12T01:30:03.416334+0000","last_fullsized":"2024-09-12T01:30:03.416334+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:03.416086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:03.416086+0000","last_clean_scrub_stamp":"2024-09-12T01:30:03.416086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:19.180132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"265'3","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.447329+0000","last_change":"2024-09-12T01:29:57.447329+0000","last_active":"2024-09-12T01:29:57.447329+0000","last_peered":"2024-09-12T01:29:57.447329+0000","last_clean":"2024-09-12T01:29:57.447329+0000","last_became_active":"2024-09-12T00:48:45.309113+0000","last_became_peered":"2024-09-12T00:48:45.309113+0000","last_unstale":"2024-09-12T01:29:57.447329+0000","last_undegraded":"2024-09-12T01:29:57.447329+0000","last_fullsized":"2024-09-12T01:29:57.447329+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:57.447249+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:57.447249+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.447249+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:12.036689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"265'2","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:02.800443+0000","last_change":"2024-09-12T01:30:02.800443+0000","last_active":"2024-09-12T01:30:02.800443+0000","last_peered":"2024-09-12T01:30:02.800443+0000","last_clean":"2024-09-12T01:30:02.800443+0000","last_became_active":"2024-09-12T00:48:42.292733+0000","last_became_peered":"2024-09-12T00:48:42.292733+0000","last_unstale":"2024-09-12T01:30:02.800443+0000","last_undegraded":"2024-09-12T01:30:02.800443+0000","last_fullsized":"2024-09-12T01:30:02.800443+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:02.800362+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:02.800362+0000","last_clean_scrub_stamp":"2024-09-12T01:30:02.800362+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:45.396047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"262'8","reported_seq":80,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.429819+0000","last_change":"2024-09-12T01:29:56.429819+0000","last_active":"2024-09-12T01:29:56.429819+0000","last_peered":"2024-09-12T01:29:56.429819+0000","last_clean":"2024-09-12T01:29:56.429819+0000","last_became_active":"2024-09-12T00:46:03.922008+0000","last_became_peered":"2024-09-12T00:46:03.922008+0000","last_unstale":"2024-09-12T01:29:56.429819+0000","last_undegraded":"2024-09-12T01:29:56.429819+0000","last_fullsized":"2024-09-12T01:29:56.429819+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'8","last_scrub_stamp":"2024-09-12T01:29:56.429729+0000","last_deep_scrub":"262'8","last_deep_scrub_stamp":"2024-09-12T01:29:56.429729+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.429729+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:53.528881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":28,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"265'2","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.060743+0000","last_change":"2024-09-12T01:29:55.060743+0000","last_active":"2024-09-12T01:29:55.060743+0000","last_peered":"2024-09-12T01:29:55.060743+0000","last_clean":"2024-09-12T01:29:55.060743+0000","last_became_active":"2024-09-12T01:04:13.467476+0000","last_became_peered":"2024-09-12T01:04:13.467476+0000","last_unstale":"2024-09-12T01:29:55.060743+0000","last_undegraded":"2024-09-12T01:29:55.060743+0000","last_fullsized":"2024-09-12T01:29:55.060743+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:55.060652+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:55.060652+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.060652+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:43.496125+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"262'2","reported_seq":49,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:04.110900+0000","last_change":"2024-09-12T01:30:04.110900+0000","last_active":"2024-09-12T01:30:04.110900+0000","last_peered":"2024-09-12T01:30:04.110900+0000","last_clean":"2024-09-12T01:30:04.110900+0000","last_became_active":"2024-09-12T00:48:45.311541+0000","last_became_peered":"2024-09-12T00:48:45.311541+0000","last_unstale":"2024-09-12T01:30:04.110900+0000","last_undegraded":"2024-09-12T01:30:04.110900+0000","last_fullsized":"2024-09-12T01:30:04.110900+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T01:30:04.110810+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T01:30:04.110810+0000","last_clean_scrub_stamp":"2024-09-12T01:30:04.110810+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:29.345584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":45,"num_write":2,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"262'3","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.583331+0000","last_change":"2024-09-12T01:29:56.583265+0000","last_active":"2024-09-12T01:29:56.583331+0000","last_peered":"2024-09-12T01:29:56.583331+0000","last_clean":"2024-09-12T01:29:56.583331+0000","last_became_active":"2024-09-12T00:48:42.281070+0000","last_became_peered":"2024-09-12T00:48:42.281070+0000","last_unstale":"2024-09-12T01:29:56.583331+0000","last_undegraded":"2024-09-12T01:29:56.583331+0000","last_fullsized":"2024-09-12T01:29:56.583331+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:29:56.583176+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:29:56.583176+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.583176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:19.308803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"265'44","reported_seq":182,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.764807+0000","last_change":"2024-09-12T01:30:00.764807+0000","last_active":"2024-09-12T01:30:00.764807+0000","last_peered":"2024-09-12T01:30:00.764807+0000","last_clean":"2024-09-12T01:30:00.764807+0000","last_became_active":"2024-09-12T00:46:03.917626+0000","last_became_peered":"2024-09-12T00:46:03.917626+0000","last_unstale":"2024-09-12T01:30:00.764807+0000","last_undegraded":"2024-09-12T01:30:00.764807+0000","last_fullsized":"2024-09-12T01:30:00.764807+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'44","last_scrub_stamp":"2024-09-12T01:30:00.764720+0000","last_deep_scrub":"265'44","last_deep_scrub_stamp":"2024-09-12T01:30:00.764720+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.764720+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:01.539586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":234,"num_read_kb":170,"num_write":73,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":32,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:10.688964+0000","last_change":"2024-09-12T01:30:10.688964+0000","last_active":"2024-09-12T01:30:10.688964+0000","last_peered":"2024-09-12T01:30:10.688964+0000","last_clean":"2024-09-12T01:30:10.688964+0000","last_became_active":"2024-09-12T01:04:13.463216+0000","last_became_peered":"2024-09-12T01:04:13.463216+0000","last_unstale":"2024-09-12T01:30:10.688964+0000","last_undegraded":"2024-09-12T01:30:10.688964+0000","last_fullsized":"2024-09-12T01:30:10.688964+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:10.688861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:10.688861+0000","last_clean_scrub_stamp":"2024-09-12T01:30:10.688861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:01.817944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.128228+0000","last_change":"2024-09-12T01:29:51.128162+0000","last_active":"2024-09-12T01:29:51.128228+0000","last_peered":"2024-09-12T01:29:51.128228+0000","last_clean":"2024-09-12T01:29:51.128228+0000","last_became_active":"2024-09-12T00:48:45.313386+0000","last_became_peered":"2024-09-12T00:48:45.313386+0000","last_unstale":"2024-09-12T01:29:51.128228+0000","last_undegraded":"2024-09-12T01:29:51.128228+0000","last_fullsized":"2024-09-12T01:29:51.128228+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:51.128069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:51.128069+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.128069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:43.991201+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"262'3","reported_seq":57,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:16.196403+0000","last_change":"2024-09-12T01:30:16.196403+0000","last_active":"2024-09-12T01:30:16.196403+0000","last_peered":"2024-09-12T01:30:16.196403+0000","last_clean":"2024-09-12T01:30:16.196403+0000","last_became_active":"2024-09-12T00:48:42.293460+0000","last_became_peered":"2024-09-12T00:48:42.293460+0000","last_unstale":"2024-09-12T01:30:16.196403+0000","last_undegraded":"2024-09-12T01:30:16.196403+0000","last_fullsized":"2024-09-12T01:30:16.196403+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:30:16.196305+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:30:16.196305+0000","last_clean_scrub_stamp":"2024-09-12T01:30:16.196305+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:54.911550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"265'27","reported_seq":132,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.141527+0000","last_change":"2024-09-12T01:29:47.141527+0000","last_active":"2024-09-12T01:29:47.141527+0000","last_peered":"2024-09-12T01:29:47.141527+0000","last_clean":"2024-09-12T01:29:47.141527+0000","last_became_active":"2024-09-12T00:46:03.918921+0000","last_became_peered":"2024-09-12T00:46:03.918921+0000","last_unstale":"2024-09-12T01:29:47.141527+0000","last_undegraded":"2024-09-12T01:29:47.141527+0000","last_fullsized":"2024-09-12T01:29:47.141527+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'27","last_scrub_stamp":"2024-09-12T01:29:47.141429+0000","last_deep_scrub":"265'27","last_deep_scrub_stamp":"2024-09-12T01:29:47.141429+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.141429+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:05.347023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":93,"num_write":49,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.052832+0000","last_change":"2024-09-12T01:29:54.052832+0000","last_active":"2024-09-12T01:29:54.052832+0000","last_peered":"2024-09-12T01:29:54.052832+0000","last_clean":"2024-09-12T01:29:54.052832+0000","last_became_active":"2024-09-12T01:04:13.466854+0000","last_became_peered":"2024-09-12T01:04:13.466854+0000","last_unstale":"2024-09-12T01:29:54.052832+0000","last_undegraded":"2024-09-12T01:29:54.052832+0000","last_fullsized":"2024-09-12T01:29:54.052832+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:54.052744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:54.052744+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.052744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:32:59.090715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"265'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:08.834720+0000","last_change":"2024-09-12T01:30:08.834666+0000","last_active":"2024-09-12T01:30:08.834720+0000","last_peered":"2024-09-12T01:30:08.834720+0000","last_clean":"2024-09-12T01:30:08.834720+0000","last_became_active":"2024-09-12T00:48:45.315966+0000","last_became_peered":"2024-09-12T00:48:45.315966+0000","last_unstale":"2024-09-12T01:30:08.834720+0000","last_undegraded":"2024-09-12T01:30:08.834720+0000","last_fullsized":"2024-09-12T01:30:08.834720+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:08.834581+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:08.834581+0000","last_clean_scrub_stamp":"2024-09-12T01:30:08.834581+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:45.177393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1396,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"265'3","reported_seq":60,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:13.262510+0000","last_change":"2024-09-12T01:30:13.262449+0000","last_active":"2024-09-12T01:30:13.262510+0000","last_peered":"2024-09-12T01:30:13.262510+0000","last_clean":"2024-09-12T01:30:13.262510+0000","last_became_active":"2024-09-12T00:48:42.293481+0000","last_became_peered":"2024-09-12T00:48:42.293481+0000","last_unstale":"2024-09-12T01:30:13.262510+0000","last_undegraded":"2024-09-12T01:30:13.262510+0000","last_fullsized":"2024-09-12T01:30:13.262510+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:30:13.262355+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:30:13.262355+0000","last_clean_scrub_stamp":"2024-09-12T01:30:13.262355+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:16.023752+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"265'25","reported_seq":126,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.550241+0000","last_change":"2024-09-12T01:29:58.550241+0000","last_active":"2024-09-12T01:29:58.550241+0000","last_peered":"2024-09-12T01:29:58.550241+0000","last_clean":"2024-09-12T01:29:58.550241+0000","last_became_active":"2024-09-12T00:46:03.914207+0000","last_became_peered":"2024-09-12T00:46:03.914207+0000","last_unstale":"2024-09-12T01:29:58.550241+0000","last_undegraded":"2024-09-12T01:29:58.550241+0000","last_fullsized":"2024-09-12T01:29:58.550241+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'25","last_scrub_stamp":"2024-09-12T01:29:58.550142+0000","last_deep_scrub":"265'25","last_deep_scrub_stamp":"2024-09-12T01:29:58.550142+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.550142+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:12.755829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":88,"num_write":47,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.078401+0000","last_change":"2024-09-12T01:29:53.078401+0000","last_active":"2024-09-12T01:29:53.078401+0000","last_peered":"2024-09-12T01:29:53.078401+0000","last_clean":"2024-09-12T01:29:53.078401+0000","last_became_active":"2024-09-12T01:04:13.466050+0000","last_became_peered":"2024-09-12T01:04:13.466050+0000","last_unstale":"2024-09-12T01:29:53.078401+0000","last_undegraded":"2024-09-12T01:29:53.078401+0000","last_fullsized":"2024-09-12T01:29:53.078401+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:53.078306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:53.078306+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.078306+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:52.505313+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"262'2","reported_seq":51,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:04.786604+0000","last_change":"2024-09-12T01:30:04.786550+0000","last_active":"2024-09-12T01:30:04.786604+0000","last_peered":"2024-09-12T01:30:04.786604+0000","last_clean":"2024-09-12T01:30:04.786604+0000","last_became_active":"2024-09-12T00:48:45.313692+0000","last_became_peered":"2024-09-12T00:48:45.313692+0000","last_unstale":"2024-09-12T01:30:04.786604+0000","last_undegraded":"2024-09-12T01:30:04.786604+0000","last_fullsized":"2024-09-12T01:30:04.786604+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'2","last_scrub_stamp":"2024-09-12T01:30:04.786462+0000","last_deep_scrub":"262'2","last_deep_scrub_stamp":"2024-09-12T01:30:04.786462+0000","last_clean_scrub_stamp":"2024-09-12T01:30:04.786462+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:36.803386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"0'0","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:03.590138+0000","last_change":"2024-09-12T01:30:03.590046+0000","last_active":"2024-09-12T01:30:03.590138+0000","last_peered":"2024-09-12T01:30:03.590138+0000","last_clean":"2024-09-12T01:30:03.590138+0000","last_became_active":"2024-09-12T00:48:42.287949+0000","last_became_peered":"2024-09-12T00:48:42.287949+0000","last_unstale":"2024-09-12T01:30:03.590138+0000","last_undegraded":"2024-09-12T01:30:03.590138+0000","last_fullsized":"2024-09-12T01:30:03.590138+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:03.589922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:03.589922+0000","last_clean_scrub_stamp":"2024-09-12T01:30:03.589922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:47.382636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"265'53","reported_seq":203,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:09.251713+0000","last_change":"2024-09-12T01:30:09.251713+0000","last_active":"2024-09-12T01:30:09.251713+0000","last_peered":"2024-09-12T01:30:09.251713+0000","last_clean":"2024-09-12T01:30:09.251713+0000","last_became_active":"2024-09-12T00:46:03.917728+0000","last_became_peered":"2024-09-12T00:46:03.917728+0000","last_unstale":"2024-09-12T01:30:09.251713+0000","last_undegraded":"2024-09-12T01:30:09.251713+0000","last_fullsized":"2024-09-12T01:30:09.251713+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'53","last_scrub_stamp":"2024-09-12T01:30:09.251628+0000","last_deep_scrub":"265'53","last_deep_scrub_stamp":"2024-09-12T01:30:09.251628+0000","last_clean_scrub_stamp":"2024-09-12T01:30:09.251628+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:32.091991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":272,"num_read_kb":191,"num_write":91,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":34,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:13.859483+0000","last_change":"2024-09-12T01:30:13.859408+0000","last_active":"2024-09-12T01:30:13.859483+0000","last_peered":"2024-09-12T01:30:13.859483+0000","last_clean":"2024-09-12T01:30:13.859483+0000","last_became_active":"2024-09-12T01:04:13.466183+0000","last_became_peered":"2024-09-12T01:04:13.466183+0000","last_unstale":"2024-09-12T01:30:13.859483+0000","last_undegraded":"2024-09-12T01:30:13.859483+0000","last_fullsized":"2024-09-12T01:30:13.859483+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:13.859319+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:13.859319+0000","last_clean_scrub_stamp":"2024-09-12T01:30:13.859319+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:08.978658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.095583+0000","last_change":"2024-09-12T01:29:50.095522+0000","last_active":"2024-09-12T01:29:50.095583+0000","last_peered":"2024-09-12T01:29:50.095583+0000","last_clean":"2024-09-12T01:29:50.095583+0000","last_became_active":"2024-09-12T00:48:45.311453+0000","last_became_peered":"2024-09-12T00:48:45.311453+0000","last_unstale":"2024-09-12T01:29:50.095583+0000","last_undegraded":"2024-09-12T01:29:50.095583+0000","last_fullsized":"2024-09-12T01:29:50.095583+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:50.095438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:50.095438+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.095438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:30.612733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"265'2","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.451839+0000","last_change":"2024-09-12T01:29:54.451773+0000","last_active":"2024-09-12T01:29:54.451839+0000","last_peered":"2024-09-12T01:29:54.451839+0000","last_clean":"2024-09-12T01:29:54.451839+0000","last_became_active":"2024-09-12T00:48:42.295358+0000","last_became_peered":"2024-09-12T00:48:42.295358+0000","last_unstale":"2024-09-12T01:29:54.451839+0000","last_undegraded":"2024-09-12T01:29:54.451839+0000","last_fullsized":"2024-09-12T01:29:54.451839+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:54.451686+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:54.451686+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.451686+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:14.057355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":40,"num_write":2,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"265'81","reported_seq":287,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.477840+0000","last_change":"2024-09-12T01:29:51.477737+0000","last_active":"2024-09-12T01:29:51.477840+0000","last_peered":"2024-09-12T01:29:51.477840+0000","last_clean":"2024-09-12T01:29:51.477840+0000","last_became_active":"2024-09-12T00:46:03.916021+0000","last_became_peered":"2024-09-12T00:46:03.916021+0000","last_unstale":"2024-09-12T01:29:51.477840+0000","last_undegraded":"2024-09-12T01:29:51.477840+0000","last_fullsized":"2024-09-12T01:29:51.477840+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'81","last_scrub_stamp":"2024-09-12T01:29:51.477634+0000","last_deep_scrub":"265'81","last_deep_scrub_stamp":"2024-09-12T01:29:51.477634+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.477634+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:25.082743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":434,"num_read_kb":326,"num_write":133,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:23.268460+0000","last_change":"2024-09-12T01:30:23.268460+0000","last_active":"2024-09-12T01:30:23.268460+0000","last_peered":"2024-09-12T01:30:23.268460+0000","last_clean":"2024-09-12T01:30:23.268460+0000","last_became_active":"2024-09-12T01:04:13.465478+0000","last_became_peered":"2024-09-12T01:04:13.465478+0000","last_unstale":"2024-09-12T01:30:23.268460+0000","last_undegraded":"2024-09-12T01:30:23.268460+0000","last_fullsized":"2024-09-12T01:30:23.268460+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:23.268361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:23.268361+0000","last_clean_scrub_stamp":"2024-09-12T01:30:23.268361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:16.603531+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":46,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:18.213329+0000","last_change":"2024-09-12T01:30:18.213329+0000","last_active":"2024-09-12T01:30:18.213329+0000","last_peered":"2024-09-12T01:30:18.213329+0000","last_clean":"2024-09-12T01:30:18.213329+0000","last_became_active":"2024-09-12T00:48:45.313057+0000","last_became_peered":"2024-09-12T00:48:45.313057+0000","last_unstale":"2024-09-12T01:30:18.213329+0000","last_undegraded":"2024-09-12T01:30:18.213329+0000","last_fullsized":"2024-09-12T01:30:18.213329+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:18.213237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:18.213237+0000","last_clean_scrub_stamp":"2024-09-12T01:30:18.213237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:27.987977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"262'5","reported_seq":63,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:15.230835+0000","last_change":"2024-09-12T01:30:15.230835+0000","last_active":"2024-09-12T01:30:15.230835+0000","last_peered":"2024-09-12T01:30:15.230835+0000","last_clean":"2024-09-12T01:30:15.230835+0000","last_became_active":"2024-09-12T00:48:42.296903+0000","last_became_peered":"2024-09-12T00:48:42.296903+0000","last_unstale":"2024-09-12T01:30:15.230835+0000","last_undegraded":"2024-09-12T01:30:15.230835+0000","last_fullsized":"2024-09-12T01:30:15.230835+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:30:15.230724+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:30:15.230724+0000","last_clean_scrub_stamp":"2024-09-12T01:30:15.230724+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:28.541984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"265'59","reported_seq":254,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.615200+0000","last_change":"2024-09-12T01:29:49.615128+0000","last_active":"2024-09-12T01:29:49.615200+0000","last_peered":"2024-09-12T01:29:49.615200+0000","last_clean":"2024-09-12T01:29:49.615200+0000","last_became_active":"2024-09-12T00:46:03.917131+0000","last_became_peered":"2024-09-12T00:46:03.917131+0000","last_unstale":"2024-09-12T01:29:49.615200+0000","last_undegraded":"2024-09-12T01:29:49.615200+0000","last_fullsized":"2024-09-12T01:29:49.615200+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'59","last_scrub_stamp":"2024-09-12T01:29:49.615033+0000","last_deep_scrub":"265'59","last_deep_scrub_stamp":"2024-09-12T01:29:49.615033+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.615033+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:41.631102+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":375,"num_read_kb":270,"num_write":80,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2808,"num_omap_keys":6,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'2","reported_seq":35,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:09.665987+0000","last_change":"2024-09-12T01:30:09.665923+0000","last_active":"2024-09-12T01:30:09.665987+0000","last_peered":"2024-09-12T01:30:09.665987+0000","last_clean":"2024-09-12T01:30:09.665987+0000","last_became_active":"2024-09-12T01:04:13.468116+0000","last_became_peered":"2024-09-12T01:04:13.468116+0000","last_unstale":"2024-09-12T01:30:09.665987+0000","last_undegraded":"2024-09-12T01:30:09.665987+0000","last_fullsized":"2024-09-12T01:30:09.665987+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:30:09.665826+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:30:09.665826+0000","last_clean_scrub_stamp":"2024-09-12T01:30:09.665826+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:17.580028+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"265'5","reported_seq":55,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:04.621430+0000","last_change":"2024-09-12T01:30:04.621370+0000","last_active":"2024-09-12T01:30:04.621430+0000","last_peered":"2024-09-12T01:30:04.621430+0000","last_clean":"2024-09-12T01:30:04.621430+0000","last_became_active":"2024-09-12T00:48:45.316713+0000","last_became_peered":"2024-09-12T00:48:45.316713+0000","last_unstale":"2024-09-12T01:30:04.621430+0000","last_undegraded":"2024-09-12T01:30:04.621430+0000","last_fullsized":"2024-09-12T01:30:04.621430+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'5","last_scrub_stamp":"2024-09-12T01:30:04.621296+0000","last_deep_scrub":"265'5","last_deep_scrub_stamp":"2024-09-12T01:30:04.621296+0000","last_clean_scrub_stamp":"2024-09-12T01:30:04.621296+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:21:45.131413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2096,"num_write":10,"num_write_kb":1072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"265'2","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.456658+0000","last_change":"2024-09-12T01:29:53.456658+0000","last_active":"2024-09-12T01:29:53.456658+0000","last_peered":"2024-09-12T01:29:53.456658+0000","last_clean":"2024-09-12T01:29:53.456658+0000","last_became_active":"2024-09-12T00:48:42.293111+0000","last_became_peered":"2024-09-12T00:48:42.293111+0000","last_unstale":"2024-09-12T01:29:53.456658+0000","last_undegraded":"2024-09-12T01:29:53.456658+0000","last_fullsized":"2024-09-12T01:29:53.456658+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:53.456571+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:53.456571+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.456571+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:44.113416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"265'34","reported_seq":148,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.444517+0000","last_change":"2024-09-12T01:29:50.444517+0000","last_active":"2024-09-12T01:29:50.444517+0000","last_peered":"2024-09-12T01:29:50.444517+0000","last_clean":"2024-09-12T01:29:50.444517+0000","last_became_active":"2024-09-12T00:46:03.914387+0000","last_became_peered":"2024-09-12T00:46:03.914387+0000","last_unstale":"2024-09-12T01:29:50.444517+0000","last_undegraded":"2024-09-12T01:29:50.444517+0000","last_fullsized":"2024-09-12T01:29:50.444517+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'34","last_scrub_stamp":"2024-09-12T01:29:50.444421+0000","last_deep_scrub":"265'34","last_deep_scrub_stamp":"2024-09-12T01:29:50.444421+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.444421+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:00.463389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":113,"num_write":68,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:05.638567+0000","last_change":"2024-09-12T01:30:05.638487+0000","last_active":"2024-09-12T01:30:05.638567+0000","last_peered":"2024-09-12T01:30:05.638567+0000","last_clean":"2024-09-12T01:30:05.638567+0000","last_became_active":"2024-09-12T01:04:13.470597+0000","last_became_peered":"2024-09-12T01:04:13.470597+0000","last_unstale":"2024-09-12T01:30:05.638567+0000","last_undegraded":"2024-09-12T01:30:05.638567+0000","last_fullsized":"2024-09-12T01:30:05.638567+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:05.638397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:05.638397+0000","last_clean_scrub_stamp":"2024-09-12T01:30:05.638397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:13.394876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"262'5","reported_seq":62,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:17.224292+0000","last_change":"2024-09-12T01:30:17.224292+0000","last_active":"2024-09-12T01:30:17.224292+0000","last_peered":"2024-09-12T01:30:17.224292+0000","last_clean":"2024-09-12T01:30:17.224292+0000","last_became_active":"2024-09-12T00:48:45.316182+0000","last_became_peered":"2024-09-12T00:48:45.316182+0000","last_unstale":"2024-09-12T01:30:17.224292+0000","last_undegraded":"2024-09-12T01:30:17.224292+0000","last_fullsized":"2024-09-12T01:30:17.224292+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'5","last_scrub_stamp":"2024-09-12T01:30:17.224183+0000","last_deep_scrub":"262'5","last_deep_scrub_stamp":"2024-09-12T01:30:17.224183+0000","last_clean_scrub_stamp":"2024-09-12T01:30:17.224183+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:54.994118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"265'3","reported_seq":58,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:19.202678+0000","last_change":"2024-09-12T01:30:19.202612+0000","last_active":"2024-09-12T01:30:19.202678+0000","last_peered":"2024-09-12T01:30:19.202678+0000","last_clean":"2024-09-12T01:30:19.202678+0000","last_became_active":"2024-09-12T00:48:42.293947+0000","last_became_peered":"2024-09-12T00:48:42.293947+0000","last_unstale":"2024-09-12T01:30:19.202678+0000","last_undegraded":"2024-09-12T01:30:19.202678+0000","last_fullsized":"2024-09-12T01:30:19.202678+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:30:19.202519+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:30:19.202519+0000","last_clean_scrub_stamp":"2024-09-12T01:30:19.202519+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:14.901068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"265'54","reported_seq":203,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:08.262042+0000","last_change":"2024-09-12T01:30:08.262042+0000","last_active":"2024-09-12T01:30:08.262042+0000","last_peered":"2024-09-12T01:30:08.262042+0000","last_clean":"2024-09-12T01:30:08.262042+0000","last_became_active":"2024-09-12T00:46:03.919285+0000","last_became_peered":"2024-09-12T00:46:03.919285+0000","last_unstale":"2024-09-12T01:30:08.262042+0000","last_undegraded":"2024-09-12T01:30:08.262042+0000","last_fullsized":"2024-09-12T01:30:08.262042+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'54","last_scrub_stamp":"2024-09-12T01:30:08.261952+0000","last_deep_scrub":"265'54","last_deep_scrub_stamp":"2024-09-12T01:30:08.261952+0000","last_clean_scrub_stamp":"2024-09-12T01:30:08.261952+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:30.741486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":184,"num_write":102,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:14.899096+0000","last_change":"2024-09-12T01:30:14.899096+0000","last_active":"2024-09-12T01:30:14.899096+0000","last_peered":"2024-09-12T01:30:14.899096+0000","last_clean":"2024-09-12T01:30:14.899096+0000","last_became_active":"2024-09-12T01:04:13.467374+0000","last_became_peered":"2024-09-12T01:04:13.467374+0000","last_unstale":"2024-09-12T01:30:14.899096+0000","last_undegraded":"2024-09-12T01:30:14.899096+0000","last_fullsized":"2024-09-12T01:30:14.899096+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:14.898992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:14.898992+0000","last_clean_scrub_stamp":"2024-09-12T01:30:14.898992+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:59.749326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":47,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.433732+0000","last_change":"2024-09-12T01:30:00.433664+0000","last_active":"2024-09-12T01:30:00.433732+0000","last_peered":"2024-09-12T01:30:00.433732+0000","last_clean":"2024-09-12T01:30:00.433732+0000","last_became_active":"2024-09-12T00:48:45.310423+0000","last_became_peered":"2024-09-12T00:48:45.310423+0000","last_unstale":"2024-09-12T01:30:00.433732+0000","last_undegraded":"2024-09-12T01:30:00.433732+0000","last_fullsized":"2024-09-12T01:30:00.433732+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:00.433576+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:00.433576+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.433576+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:15.315075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:01.081551+0000","last_change":"2024-09-12T01:30:01.081456+0000","last_active":"2024-09-12T01:30:01.081551+0000","last_peered":"2024-09-12T01:30:01.081551+0000","last_clean":"2024-09-12T01:30:01.081551+0000","last_became_active":"2024-09-12T00:48:42.295861+0000","last_became_peered":"2024-09-12T00:48:42.295861+0000","last_unstale":"2024-09-12T01:30:01.081551+0000","last_undegraded":"2024-09-12T01:30:01.081551+0000","last_fullsized":"2024-09-12T01:30:01.081551+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:01.081358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:01.081358+0000","last_clean_scrub_stamp":"2024-09-12T01:30:01.081358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:33.671551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"265'44","reported_seq":174,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:07.288505+0000","last_change":"2024-09-12T01:30:07.288505+0000","last_active":"2024-09-12T01:30:07.288505+0000","last_peered":"2024-09-12T01:30:07.288505+0000","last_clean":"2024-09-12T01:30:07.288505+0000","last_became_active":"2024-09-12T00:46:03.917353+0000","last_became_peered":"2024-09-12T00:46:03.917353+0000","last_unstale":"2024-09-12T01:30:07.288505+0000","last_undegraded":"2024-09-12T01:30:07.288505+0000","last_fullsized":"2024-09-12T01:30:07.288505+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'44","last_scrub_stamp":"2024-09-12T01:30:07.288412+0000","last_deep_scrub":"265'44","last_deep_scrub_stamp":"2024-09-12T01:30:07.288412+0000","last_clean_scrub_stamp":"2024-09-12T01:30:07.288412+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:11.383341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":216,"num_read_kb":151,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":33,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:25.300331+0000","last_change":"2024-09-12T01:30:25.300331+0000","last_active":"2024-09-12T01:30:25.300331+0000","last_peered":"2024-09-12T01:30:25.300331+0000","last_clean":"2024-09-12T01:30:25.300331+0000","last_became_active":"2024-09-12T01:04:13.466783+0000","last_became_peered":"2024-09-12T01:04:13.466783+0000","last_unstale":"2024-09-12T01:30:25.300331+0000","last_undegraded":"2024-09-12T01:30:25.300331+0000","last_fullsized":"2024-09-12T01:30:25.300331+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":263,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:25.300248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:25.300248+0000","last_clean_scrub_stamp":"2024-09-12T01:30:25.300248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:23.705061+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"262'3","reported_seq":53,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:01.426288+0000","last_change":"2024-09-12T01:30:01.426223+0000","last_active":"2024-09-12T01:30:01.426288+0000","last_peered":"2024-09-12T01:30:01.426288+0000","last_clean":"2024-09-12T01:30:01.426288+0000","last_became_active":"2024-09-12T00:48:45.312329+0000","last_became_peered":"2024-09-12T00:48:45.312329+0000","last_unstale":"2024-09-12T01:30:01.426288+0000","last_undegraded":"2024-09-12T01:30:01.426288+0000","last_fullsized":"2024-09-12T01:30:01.426288+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":260,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"262'3","last_scrub_stamp":"2024-09-12T01:30:01.426124+0000","last_deep_scrub":"262'3","last_deep_scrub_stamp":"2024-09-12T01:30:01.426124+0000","last_clean_scrub_stamp":"2024-09-12T01:30:01.426124+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:21.056475+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"265'2","reported_seq":56,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.696343+0000","last_change":"2024-09-12T01:29:51.696233+0000","last_active":"2024-09-12T01:29:51.696343+0000","last_peered":"2024-09-12T01:29:51.696343+0000","last_clean":"2024-09-12T01:29:51.696343+0000","last_became_active":"2024-09-12T00:48:42.286427+0000","last_became_peered":"2024-09-12T00:48:42.286427+0000","last_unstale":"2024-09-12T01:29:51.696343+0000","last_undegraded":"2024-09-12T01:29:51.696343+0000","last_fullsized":"2024-09-12T01:29:51.696343+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:51.696120+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:51.696120+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.696120+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:10:25.677211+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"265'46","reported_seq":184,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.404374+0000","last_change":"2024-09-12T01:29:49.404321+0000","last_active":"2024-09-12T01:29:49.404374+0000","last_peered":"2024-09-12T01:29:49.404374+0000","last_clean":"2024-09-12T01:29:49.404374+0000","last_became_active":"2024-09-12T00:46:03.919259+0000","last_became_peered":"2024-09-12T00:46:03.919259+0000","last_unstale":"2024-09-12T01:29:49.404374+0000","last_undegraded":"2024-09-12T01:29:49.404374+0000","last_fullsized":"2024-09-12T01:29:49.404374+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'46","last_scrub_stamp":"2024-09-12T01:29:49.404234+0000","last_deep_scrub":"265'46","last_deep_scrub_stamp":"2024-09-12T01:29:49.404234+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.404234+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:07.003544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":232,"num_read_kb":161,"num_write":85,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"265'380","reported_seq":1135,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.020342+0000","last_change":"2024-09-12T01:29:28.020280+0000","last_active":"2024-09-12T01:29:28.020342+0000","last_peered":"2024-09-12T01:29:28.020342+0000","last_clean":"2024-09-12T01:29:28.020342+0000","last_became_active":"2024-09-12T00:31:47.137895+0000","last_became_peered":"2024-09-12T00:31:47.137895+0000","last_unstale":"2024-09-12T01:29:28.020342+0000","last_undegraded":"2024-09-12T01:29:28.020342+0000","last_fullsized":"2024-09-12T01:29:28.020342+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'380","last_scrub_stamp":"2024-09-12T01:29:28.020146+0000","last_deep_scrub":"265'380","last_deep_scrub_stamp":"2024-09-12T01:29:28.020146+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.020146+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:56.555166+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":750,"num_read_kb":31522,"num_write":1285,"num_write_kb":24718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"265'194","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.479650+0000","last_change":"2024-09-12T01:29:36.479650+0000","last_active":"2024-09-12T01:29:36.479650+0000","last_peered":"2024-09-12T01:29:36.479650+0000","last_clean":"2024-09-12T01:29:36.479650+0000","last_became_active":"2024-09-12T00:31:50.138226+0000","last_became_peered":"2024-09-12T00:31:50.138226+0000","last_unstale":"2024-09-12T01:29:36.479650+0000","last_undegraded":"2024-09-12T01:29:36.479650+0000","last_fullsized":"2024-09-12T01:29:36.479650+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'194","last_scrub_stamp":"2024-09-12T01:29:36.479554+0000","last_deep_scrub":"265'194","last_deep_scrub_stamp":"2024-09-12T01:29:36.479554+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.479554+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:41.039566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":913,"num_read_kb":766,"num_write":296,"num_write_kb":154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"265'314","reported_seq":950,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.867814+0000","last_change":"2024-09-12T01:29:35.867707+0000","last_active":"2024-09-12T01:29:35.867814+0000","last_peered":"2024-09-12T01:29:35.867814+0000","last_clean":"2024-09-12T01:29:35.867814+0000","last_became_active":"2024-09-12T00:31:47.134134+0000","last_became_peered":"2024-09-12T00:31:47.134134+0000","last_unstale":"2024-09-12T01:29:35.867814+0000","last_undegraded":"2024-09-12T01:29:35.867814+0000","last_fullsized":"2024-09-12T01:29:35.867814+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'314","last_scrub_stamp":"2024-09-12T01:29:35.867548+0000","last_deep_scrub":"265'314","last_deep_scrub_stamp":"2024-09-12T01:29:35.867548+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.867548+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":300,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:04.584926+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":463,"num_read_kb":16965,"num_write":1018,"num_write_kb":26995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"265'110","reported_seq":713,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.181613+0000","last_change":"2024-09-12T01:29:43.181613+0000","last_active":"2024-09-12T01:29:43.181613+0000","last_peered":"2024-09-12T01:29:43.181613+0000","last_clean":"2024-09-12T01:29:43.181613+0000","last_became_active":"2024-09-12T00:31:50.132639+0000","last_became_peered":"2024-09-12T00:31:50.132639+0000","last_unstale":"2024-09-12T01:29:43.181613+0000","last_undegraded":"2024-09-12T01:29:43.181613+0000","last_fullsized":"2024-09-12T01:29:43.181613+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'110","last_scrub_stamp":"2024-09-12T01:29:43.181524+0000","last_deep_scrub":"265'110","last_deep_scrub_stamp":"2024-09-12T01:29:43.181524+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.181524+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:50.689163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":505,"num_read_kb":423,"num_write":165,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"265'368","reported_seq":1116,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.955742+0000","last_change":"2024-09-12T01:29:32.955684+0000","last_active":"2024-09-12T01:29:32.955742+0000","last_peered":"2024-09-12T01:29:32.955742+0000","last_clean":"2024-09-12T01:29:32.955742+0000","last_became_active":"2024-09-12T00:31:47.119865+0000","last_became_peered":"2024-09-12T00:31:47.119865+0000","last_unstale":"2024-09-12T01:29:32.955742+0000","last_undegraded":"2024-09-12T01:29:32.955742+0000","last_fullsized":"2024-09-12T01:29:32.955742+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'368","last_scrub_stamp":"2024-09-12T01:29:32.955566+0000","last_deep_scrub":"265'368","last_deep_scrub_stamp":"2024-09-12T01:29:32.955566+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.955566+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:34.193090+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":344922,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":840,"num_read_kb":4429,"num_write":1181,"num_write_kb":10543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"265'286","reported_seq":944,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.192741+0000","last_change":"2024-09-12T01:29:44.192741+0000","last_active":"2024-09-12T01:29:44.192741+0000","last_peered":"2024-09-12T01:29:44.192741+0000","last_clean":"2024-09-12T01:29:44.192741+0000","last_became_active":"2024-09-12T00:31:50.135413+0000","last_became_peered":"2024-09-12T00:31:50.135413+0000","last_unstale":"2024-09-12T01:29:44.192741+0000","last_undegraded":"2024-09-12T01:29:44.192741+0000","last_fullsized":"2024-09-12T01:29:44.192741+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'286","last_scrub_stamp":"2024-09-12T01:29:44.192668+0000","last_deep_scrub":"265'286","last_deep_scrub_stamp":"2024-09-12T01:29:44.192668+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.192668+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:39.104901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1247,"num_read_kb":1012,"num_write":455,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"265'315","reported_seq":966,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.404726+0000","last_change":"2024-09-12T01:29:27.404656+0000","last_active":"2024-09-12T01:29:27.404726+0000","last_peered":"2024-09-12T01:29:27.404726+0000","last_clean":"2024-09-12T01:29:27.404726+0000","last_became_active":"2024-09-12T00:31:47.133414+0000","last_became_peered":"2024-09-12T00:31:47.133414+0000","last_unstale":"2024-09-12T01:29:27.404726+0000","last_undegraded":"2024-09-12T01:29:27.404726+0000","last_fullsized":"2024-09-12T01:29:27.404726+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'315","last_scrub_stamp":"2024-09-12T01:29:27.404449+0000","last_deep_scrub":"265'315","last_deep_scrub_stamp":"2024-09-12T01:29:27.404449+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.404449+0000","objects_scrubbed":11,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:30.134243+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11933654,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":465,"num_read_kb":32236,"num_write":1054,"num_write_kb":37937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"265'183","reported_seq":794,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.543227+0000","last_change":"2024-09-12T01:29:35.543227+0000","last_active":"2024-09-12T01:29:35.543227+0000","last_peered":"2024-09-12T01:29:35.543227+0000","last_clean":"2024-09-12T01:29:35.543227+0000","last_became_active":"2024-09-12T00:31:50.135322+0000","last_became_peered":"2024-09-12T00:31:50.135322+0000","last_unstale":"2024-09-12T01:29:35.543227+0000","last_undegraded":"2024-09-12T01:29:35.543227+0000","last_fullsized":"2024-09-12T01:29:35.543227+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'183","last_scrub_stamp":"2024-09-12T01:29:35.543144+0000","last_deep_scrub":"265'183","last_deep_scrub_stamp":"2024-09-12T01:29:35.543144+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.543144+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:36.766989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":725,"num_read_kb":591,"num_write":296,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"265'319","reported_seq":951,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.045050+0000","last_change":"2024-09-12T01:29:29.045050+0000","last_active":"2024-09-12T01:29:29.045050+0000","last_peered":"2024-09-12T01:29:29.045050+0000","last_clean":"2024-09-12T01:29:29.045050+0000","last_became_active":"2024-09-12T00:31:47.128016+0000","last_became_peered":"2024-09-12T00:31:47.128016+0000","last_unstale":"2024-09-12T01:29:29.045050+0000","last_undegraded":"2024-09-12T01:29:29.045050+0000","last_fullsized":"2024-09-12T01:29:29.045050+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T01:29:29.044943+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T01:29:29.044943+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.044943+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:09.317724+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":458,"num_read_kb":35042,"num_write":1048,"num_write_kb":20184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"265'220","reported_seq":848,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.168640+0000","last_change":"2024-09-12T01:29:36.168558+0000","last_active":"2024-09-12T01:29:36.168640+0000","last_peered":"2024-09-12T01:29:36.168640+0000","last_clean":"2024-09-12T01:29:36.168640+0000","last_became_active":"2024-09-12T00:31:50.132674+0000","last_became_peered":"2024-09-12T00:31:50.132674+0000","last_unstale":"2024-09-12T01:29:36.168640+0000","last_undegraded":"2024-09-12T01:29:36.168640+0000","last_fullsized":"2024-09-12T01:29:36.168640+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'220","last_scrub_stamp":"2024-09-12T01:29:36.168468+0000","last_deep_scrub":"265'220","last_deep_scrub_stamp":"2024-09-12T01:29:36.168468+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.168468+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:46.453708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":967,"num_read_kb":781,"num_write":356,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"265'365","reported_seq":1001,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.391195+0000","last_change":"2024-09-12T01:29:24.391195+0000","last_active":"2024-09-12T01:29:24.391195+0000","last_peered":"2024-09-12T01:29:24.391195+0000","last_clean":"2024-09-12T01:29:24.391195+0000","last_became_active":"2024-09-12T00:31:47.134887+0000","last_became_peered":"2024-09-12T00:31:47.134887+0000","last_unstale":"2024-09-12T01:29:24.391195+0000","last_undegraded":"2024-09-12T01:29:24.391195+0000","last_fullsized":"2024-09-12T01:29:24.391195+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:29:24.391061+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:29:24.391061+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.391061+0000","objects_scrubbed":9,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:37.168982+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396853,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":509,"num_read_kb":3274,"num_write":1223,"num_write_kb":38824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"265'275","reported_seq":859,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.146653+0000","last_change":"2024-09-12T01:29:34.146593+0000","last_active":"2024-09-12T01:29:34.146653+0000","last_peered":"2024-09-12T01:29:34.146653+0000","last_clean":"2024-09-12T01:29:34.146653+0000","last_became_active":"2024-09-12T00:31:50.140087+0000","last_became_peered":"2024-09-12T00:31:50.140087+0000","last_unstale":"2024-09-12T01:29:34.146653+0000","last_undegraded":"2024-09-12T01:29:34.146653+0000","last_fullsized":"2024-09-12T01:29:34.146653+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'275","last_scrub_stamp":"2024-09-12T01:29:34.146509+0000","last_deep_scrub":"265'275","last_deep_scrub_stamp":"2024-09-12T01:29:34.146509+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.146509+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:19.463093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1141,"num_read_kb":956,"num_write":415,"num_write_kb":221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"265'392","reported_seq":1039,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.099075+0000","last_change":"2024-09-12T01:29:37.099016+0000","last_active":"2024-09-12T01:29:37.099075+0000","last_peered":"2024-09-12T01:29:37.099075+0000","last_clean":"2024-09-12T01:29:37.099075+0000","last_became_active":"2024-09-12T00:32:23.830676+0000","last_became_peered":"2024-09-12T00:32:23.830676+0000","last_unstale":"2024-09-12T01:29:37.099075+0000","last_undegraded":"2024-09-12T01:29:37.099075+0000","last_fullsized":"2024-09-12T01:29:37.099075+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'392","last_scrub_stamp":"2024-09-12T01:29:37.098873+0000","last_deep_scrub":"265'392","last_deep_scrub_stamp":"2024-09-12T01:29:37.098873+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.098873+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:44:30.205825+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170251,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":569,"num_read_kb":5774,"num_write":1256,"num_write_kb":23845,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3e","version":"265'51","reported_seq":599,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.403940+0000","last_change":"2024-09-12T01:29:32.403863+0000","last_active":"2024-09-12T01:29:32.403940+0000","last_peered":"2024-09-12T01:29:32.403940+0000","last_clean":"2024-09-12T01:29:32.403940+0000","last_became_active":"2024-09-12T00:31:50.140207+0000","last_became_peered":"2024-09-12T00:31:50.140207+0000","last_unstale":"2024-09-12T01:29:32.403940+0000","last_undegraded":"2024-09-12T01:29:32.403940+0000","last_fullsized":"2024-09-12T01:29:32.403940+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'51","last_scrub_stamp":"2024-09-12T01:29:32.403772+0000","last_deep_scrub":"265'51","last_deep_scrub_stamp":"2024-09-12T01:29:32.403772+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.403772+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:53.477543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":173,"num_read_kb":145,"num_write":71,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"265'386","reported_seq":1073,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.878927+0000","last_change":"2024-09-12T01:29:30.878927+0000","last_active":"2024-09-12T01:29:30.878927+0000","last_peered":"2024-09-12T01:29:30.878927+0000","last_clean":"2024-09-12T01:29:30.878927+0000","last_became_active":"2024-09-12T00:31:47.127930+0000","last_became_peered":"2024-09-12T00:31:47.127930+0000","last_unstale":"2024-09-12T01:29:30.878927+0000","last_undegraded":"2024-09-12T01:29:30.878927+0000","last_fullsized":"2024-09-12T01:29:30.878927+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T01:29:30.878794+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T01:29:30.878794+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.878794+0000","objects_scrubbed":8,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:54.052551+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396864,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":638,"num_read_kb":6946,"num_write":1462,"num_write_kb":29009,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"265'96","reported_seq":697,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.748479+0000","last_change":"2024-09-12T01:29:45.748418+0000","last_active":"2024-09-12T01:29:45.748479+0000","last_peered":"2024-09-12T01:29:45.748479+0000","last_clean":"2024-09-12T01:29:45.748479+0000","last_became_active":"2024-09-12T00:31:50.142071+0000","last_became_peered":"2024-09-12T00:31:50.142071+0000","last_unstale":"2024-09-12T01:29:45.748479+0000","last_undegraded":"2024-09-12T01:29:45.748479+0000","last_fullsized":"2024-09-12T01:29:45.748479+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'96","last_scrub_stamp":"2024-09-12T01:29:45.748330+0000","last_deep_scrub":"265'96","last_deep_scrub_stamp":"2024-09-12T01:29:45.748330+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.748330+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:43.499736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":432,"num_read_kb":364,"num_write":131,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"265'86","reported_seq":699,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.140580+0000","last_change":"2024-09-12T01:29:42.140496+0000","last_active":"2024-09-12T01:29:42.140580+0000","last_peered":"2024-09-12T01:29:42.140580+0000","last_clean":"2024-09-12T01:29:42.140580+0000","last_became_active":"2024-09-12T00:31:50.132178+0000","last_became_peered":"2024-09-12T00:31:50.132178+0000","last_unstale":"2024-09-12T01:29:42.140580+0000","last_undegraded":"2024-09-12T01:29:42.140580+0000","last_fullsized":"2024-09-12T01:29:42.140580+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'86","last_scrub_stamp":"2024-09-12T01:29:42.140402+0000","last_deep_scrub":"265'86","last_deep_scrub_stamp":"2024-09-12T01:29:42.140402+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.140402+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:41.914291+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":402,"num_read_kb":346,"num_write":114,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"265'333","reported_seq":989,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.353401+0000","last_change":"2024-09-12T01:29:24.353300+0000","last_active":"2024-09-12T01:29:24.353401+0000","last_peered":"2024-09-12T01:29:24.353401+0000","last_clean":"2024-09-12T01:29:24.353401+0000","last_became_active":"2024-09-12T00:31:47.123956+0000","last_became_peered":"2024-09-12T00:31:47.123956+0000","last_unstale":"2024-09-12T01:29:24.353401+0000","last_undegraded":"2024-09-12T01:29:24.353401+0000","last_fullsized":"2024-09-12T01:29:24.353401+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'333","last_scrub_stamp":"2024-09-12T01:29:24.353156+0000","last_deep_scrub":"265'333","last_deep_scrub_stamp":"2024-09-12T01:29:24.353156+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.353156+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:57.167462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525329,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":483,"num_read_kb":32458,"num_write":1127,"num_write_kb":22794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"265'162","reported_seq":817,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.099001+0000","last_change":"2024-09-12T01:29:32.098935+0000","last_active":"2024-09-12T01:29:32.099001+0000","last_peered":"2024-09-12T01:29:32.099001+0000","last_clean":"2024-09-12T01:29:32.099001+0000","last_became_active":"2024-09-12T00:31:50.130844+0000","last_became_peered":"2024-09-12T00:31:50.130844+0000","last_unstale":"2024-09-12T01:29:32.099001+0000","last_undegraded":"2024-09-12T01:29:32.099001+0000","last_fullsized":"2024-09-12T01:29:32.099001+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'162","last_scrub_stamp":"2024-09-12T01:29:32.098837+0000","last_deep_scrub":"265'162","last_deep_scrub_stamp":"2024-09-12T01:29:32.098837+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.098837+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:49.537667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":634,"num_write":246,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"265'260","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.982245+0000","last_change":"2024-09-12T01:29:26.982139+0000","last_active":"2024-09-12T01:29:26.982245+0000","last_peered":"2024-09-12T01:29:26.982245+0000","last_clean":"2024-09-12T01:29:26.982245+0000","last_became_active":"2024-09-12T00:31:47.127400+0000","last_became_peered":"2024-09-12T00:31:47.127400+0000","last_unstale":"2024-09-12T01:29:26.982245+0000","last_undegraded":"2024-09-12T01:29:26.982245+0000","last_fullsized":"2024-09-12T01:29:26.982245+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-12T01:29:26.981947+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-12T01:29:26.981947+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.981947+0000","objects_scrubbed":7,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:05.911480+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133724,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":320,"num_read_kb":20510,"num_write":796,"num_write_kb":47522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"265'404","reported_seq":1179,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.443400+0000","last_change":"2024-09-12T01:29:30.443336+0000","last_active":"2024-09-12T01:29:30.443400+0000","last_peered":"2024-09-12T01:29:30.443400+0000","last_clean":"2024-09-12T01:29:30.443400+0000","last_became_active":"2024-09-12T00:31:50.142337+0000","last_became_peered":"2024-09-12T00:31:50.142337+0000","last_unstale":"2024-09-12T01:29:30.443400+0000","last_undegraded":"2024-09-12T01:29:30.443400+0000","last_fullsized":"2024-09-12T01:29:30.443400+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'404","last_scrub_stamp":"2024-09-12T01:29:30.443248+0000","last_deep_scrub":"265'404","last_deep_scrub_stamp":"2024-09-12T01:29:30.443248+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.443248+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:45.435463+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2109,"num_read_kb":1845,"num_write":683,"num_write_kb":385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"265'316","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.956034+0000","last_change":"2024-09-12T01:29:25.955954+0000","last_active":"2024-09-12T01:29:25.956034+0000","last_peered":"2024-09-12T01:29:25.956034+0000","last_clean":"2024-09-12T01:29:25.956034+0000","last_became_active":"2024-09-12T00:31:47.139517+0000","last_became_peered":"2024-09-12T00:31:47.139517+0000","last_unstale":"2024-09-12T01:29:25.956034+0000","last_undegraded":"2024-09-12T01:29:25.956034+0000","last_fullsized":"2024-09-12T01:29:25.956034+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T01:29:25.955816+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T01:29:25.955816+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.955816+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:56.138848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788540,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":6586,"num_write":1090,"num_write_kb":25928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"265'147","reported_seq":735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.097542+0000","last_change":"2024-09-12T01:29:39.097461+0000","last_active":"2024-09-12T01:29:39.097542+0000","last_peered":"2024-09-12T01:29:39.097542+0000","last_clean":"2024-09-12T01:29:39.097542+0000","last_became_active":"2024-09-12T00:31:50.142311+0000","last_became_peered":"2024-09-12T00:31:50.142311+0000","last_unstale":"2024-09-12T01:29:39.097542+0000","last_undegraded":"2024-09-12T01:29:39.097542+0000","last_fullsized":"2024-09-12T01:29:39.097542+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'147","last_scrub_stamp":"2024-09-12T01:29:39.097377+0000","last_deep_scrub":"265'147","last_deep_scrub_stamp":"2024-09-12T01:29:39.097377+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.097377+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:58.929897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":661,"num_read_kb":539,"num_write":237,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"265'262","reported_seq":891,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.987977+0000","last_change":"2024-09-12T01:29:24.987898+0000","last_active":"2024-09-12T01:29:24.987977+0000","last_peered":"2024-09-12T01:29:24.987977+0000","last_clean":"2024-09-12T01:29:24.987977+0000","last_became_active":"2024-09-12T00:31:47.130329+0000","last_became_peered":"2024-09-12T00:31:47.130329+0000","last_unstale":"2024-09-12T01:29:24.987977+0000","last_undegraded":"2024-09-12T01:29:24.987977+0000","last_fullsized":"2024-09-12T01:29:24.987977+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'262","last_scrub_stamp":"2024-09-12T01:29:24.987705+0000","last_deep_scrub":"265'262","last_deep_scrub_stamp":"2024-09-12T01:29:24.987705+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.987705+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:33.987536+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":287558,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":398,"num_read_kb":37644,"num_write":765,"num_write_kb":24202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"265'112","reported_seq":712,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.800061+0000","last_change":"2024-09-12T01:29:38.800006+0000","last_active":"2024-09-12T01:29:38.800061+0000","last_peered":"2024-09-12T01:29:38.800061+0000","last_clean":"2024-09-12T01:29:38.800061+0000","last_became_active":"2024-09-12T00:31:50.135595+0000","last_became_peered":"2024-09-12T00:31:50.135595+0000","last_unstale":"2024-09-12T01:29:38.800061+0000","last_undegraded":"2024-09-12T01:29:38.800061+0000","last_fullsized":"2024-09-12T01:29:38.800061+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'112","last_scrub_stamp":"2024-09-12T01:29:38.799863+0000","last_deep_scrub":"265'112","last_deep_scrub_stamp":"2024-09-12T01:29:38.799863+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.799863+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:28.775891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":490,"num_read_kb":410,"num_write":180,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"265'318","reported_seq":1052,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.179424+0000","last_change":"2024-09-12T01:29:31.179350+0000","last_active":"2024-09-12T01:29:31.179424+0000","last_peered":"2024-09-12T01:29:31.179424+0000","last_clean":"2024-09-12T01:29:31.179424+0000","last_became_active":"2024-09-12T00:31:47.133592+0000","last_became_peered":"2024-09-12T00:31:47.133592+0000","last_unstale":"2024-09-12T01:29:31.179424+0000","last_undegraded":"2024-09-12T01:29:31.179424+0000","last_fullsized":"2024-09-12T01:29:31.179424+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T01:29:31.179182+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T01:29:31.179182+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.179182+0000","objects_scrubbed":7,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:48.318104+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1396882,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":783,"num_read_kb":29951,"num_write":1081,"num_write_kb":46575,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"265'73","reported_seq":633,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.418748+0000","last_change":"2024-09-12T01:29:31.418672+0000","last_active":"2024-09-12T01:29:31.418748+0000","last_peered":"2024-09-12T01:29:31.418748+0000","last_clean":"2024-09-12T01:29:31.418748+0000","last_became_active":"2024-09-12T00:31:50.135972+0000","last_became_peered":"2024-09-12T00:31:50.135972+0000","last_unstale":"2024-09-12T01:29:31.418748+0000","last_undegraded":"2024-09-12T01:29:31.418748+0000","last_fullsized":"2024-09-12T01:29:31.418748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'73","last_scrub_stamp":"2024-09-12T01:29:31.418583+0000","last_deep_scrub":"265'73","last_deep_scrub_stamp":"2024-09-12T01:29:31.418583+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.418583+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:39.743725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":303,"num_read_kb":249,"num_write":116,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"265'312","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.185793+0000","last_change":"2024-09-12T01:29:30.185734+0000","last_active":"2024-09-12T01:29:30.185793+0000","last_peered":"2024-09-12T01:29:30.185793+0000","last_clean":"2024-09-12T01:29:30.185793+0000","last_became_active":"2024-09-12T00:31:47.118260+0000","last_became_peered":"2024-09-12T00:31:47.118260+0000","last_unstale":"2024-09-12T01:29:30.185793+0000","last_undegraded":"2024-09-12T01:29:30.185793+0000","last_fullsized":"2024-09-12T01:29:30.185793+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T01:29:30.185600+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T01:29:30.185600+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.185600+0000","objects_scrubbed":5,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:50.982982+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":446,"num_read_kb":15045,"num_write":981,"num_write_kb":26498,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"265'125","reported_seq":634,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.105584+0000","last_change":"2024-09-12T01:29:46.105512+0000","last_active":"2024-09-12T01:29:46.105584+0000","last_peered":"2024-09-12T01:29:46.105584+0000","last_clean":"2024-09-12T01:29:46.105584+0000","last_became_active":"2024-09-12T00:31:58.183784+0000","last_became_peered":"2024-09-12T00:31:58.183784+0000","last_unstale":"2024-09-12T01:29:46.105584+0000","last_undegraded":"2024-09-12T01:29:46.105584+0000","last_fullsized":"2024-09-12T01:29:46.105584+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'125","last_scrub_stamp":"2024-09-12T01:29:46.105425+0000","last_deep_scrub":"265'125","last_deep_scrub_stamp":"2024-09-12T01:29:46.105425+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.105425+0000","objects_scrubbed":2,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:30.670313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":138,"num_read_kb":134,"num_write":297,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"265'230","reported_seq":842,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.113953+0000","last_change":"2024-09-12T01:29:36.113884+0000","last_active":"2024-09-12T01:29:36.113953+0000","last_peered":"2024-09-12T01:29:36.113953+0000","last_clean":"2024-09-12T01:29:36.113953+0000","last_became_active":"2024-09-12T00:31:50.140510+0000","last_became_peered":"2024-09-12T00:31:50.140510+0000","last_unstale":"2024-09-12T01:29:36.113953+0000","last_undegraded":"2024-09-12T01:29:36.113953+0000","last_fullsized":"2024-09-12T01:29:36.113953+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'230","last_scrub_stamp":"2024-09-12T01:29:36.113803+0000","last_deep_scrub":"265'230","last_deep_scrub_stamp":"2024-09-12T01:29:36.113803+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.113803+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:49.872114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":944,"num_read_kb":762,"num_write":358,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"265'334","reported_seq":955,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.026257+0000","last_change":"2024-09-12T01:29:29.026172+0000","last_active":"2024-09-12T01:29:29.026257+0000","last_peered":"2024-09-12T01:29:29.026257+0000","last_clean":"2024-09-12T01:29:29.026257+0000","last_became_active":"2024-09-12T00:31:47.131940+0000","last_became_peered":"2024-09-12T00:31:47.131940+0000","last_unstale":"2024-09-12T01:29:29.026257+0000","last_undegraded":"2024-09-12T01:29:29.026257+0000","last_fullsized":"2024-09-12T01:29:29.026257+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-12T01:29:29.026060+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-12T01:29:29.026060+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.026060+0000","objects_scrubbed":6,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:53.704154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":467,"num_read_kb":415,"num_write":1065,"num_write_kb":31833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.256489+0000","last_change":"2024-09-12T01:29:48.256427+0000","last_active":"2024-09-12T01:29:48.256489+0000","last_peered":"2024-09-12T01:29:48.256489+0000","last_clean":"2024-09-12T01:29:48.256489+0000","last_became_active":"2024-09-12T00:31:52.151351+0000","last_became_peered":"2024-09-12T00:31:52.151351+0000","last_unstale":"2024-09-12T01:29:48.256489+0000","last_undegraded":"2024-09-12T01:29:48.256489+0000","last_fullsized":"2024-09-12T01:29:48.256489+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:48.256334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:48.256334+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.256334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:34.954985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"265'347","reported_seq":979,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.541811+0000","last_change":"2024-09-12T01:29:48.541750+0000","last_active":"2024-09-12T01:29:48.541811+0000","last_peered":"2024-09-12T01:29:48.541811+0000","last_clean":"2024-09-12T01:29:48.541811+0000","last_became_active":"2024-09-12T00:31:54.168545+0000","last_became_peered":"2024-09-12T00:31:54.168545+0000","last_unstale":"2024-09-12T01:29:48.541811+0000","last_undegraded":"2024-09-12T01:29:48.541811+0000","last_fullsized":"2024-09-12T01:29:48.541811+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'347","last_scrub_stamp":"2024-09-12T01:29:48.541646+0000","last_deep_scrub":"265'347","last_deep_scrub_stamp":"2024-09-12T01:29:48.541646+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.541646+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:19.169014+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45599,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":546,"num_read_kb":1097,"num_write":426,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.658861+0000","last_change":"2024-09-12T01:29:46.658802+0000","last_active":"2024-09-12T01:29:46.658861+0000","last_peered":"2024-09-12T01:29:46.658861+0000","last_clean":"2024-09-12T01:29:46.658861+0000","last_became_active":"2024-09-12T00:31:56.170837+0000","last_became_peered":"2024-09-12T00:31:56.170837+0000","last_unstale":"2024-09-12T01:29:46.658861+0000","last_undegraded":"2024-09-12T01:29:46.658861+0000","last_fullsized":"2024-09-12T01:29:46.658861+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:46.658708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:46.658708+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.658708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:05.228373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"265'2468","reported_seq":4365,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.727733+0000","last_change":"2024-09-12T01:29:58.727664+0000","last_active":"2024-09-12T01:29:58.727733+0000","last_peered":"2024-09-12T01:29:58.727733+0000","last_clean":"2024-09-12T01:29:58.727733+0000","last_became_active":"2024-09-12T00:31:58.181552+0000","last_became_peered":"2024-09-12T00:31:58.181552+0000","last_unstale":"2024-09-12T01:29:58.727733+0000","last_undegraded":"2024-09-12T01:29:58.727733+0000","last_fullsized":"2024-09-12T01:29:58.727733+0000","mapping_epoch":35,"log_start":"265'2400","ondisk_log_start":"265'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2468","last_scrub_stamp":"2024-09-12T01:29:58.727567+0000","last_deep_scrub":"265'2468","last_deep_scrub_stamp":"2024-09-12T01:29:58.727567+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.727567+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":2400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:51.613333+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":617,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6112,"num_read_kb":6115,"num_write":4931,"num_write_kb":1807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"265'4138","reported_seq":4759,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.099348+0000","last_change":"2024-09-12T01:29:39.099282+0000","last_active":"2024-09-12T01:29:39.099348+0000","last_peered":"2024-09-12T01:29:39.099348+0000","last_clean":"2024-09-12T01:29:39.099348+0000","last_became_active":"2024-09-12T00:31:50.133357+0000","last_became_peered":"2024-09-12T00:31:50.133357+0000","last_unstale":"2024-09-12T01:29:39.099348+0000","last_undegraded":"2024-09-12T01:29:39.099348+0000","last_fullsized":"2024-09-12T01:29:39.099348+0000","mapping_epoch":27,"log_start":"265'4100","ondisk_log_start":"265'4100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4138","last_scrub_stamp":"2024-09-12T01:29:39.099192+0000","last_deep_scrub":"265'4138","last_deep_scrub_stamp":"2024-09-12T01:29:39.099192+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.099192+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":3000,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:48.646221+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16657,"num_read_kb":13895,"num_write":6209,"num_write_kb":3095,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"265'296","reported_seq":912,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.186140+0000","last_change":"2024-09-12T01:29:27.186057+0000","last_active":"2024-09-12T01:29:27.186140+0000","last_peered":"2024-09-12T01:29:27.186140+0000","last_clean":"2024-09-12T01:29:27.186140+0000","last_became_active":"2024-09-12T00:31:47.131849+0000","last_became_peered":"2024-09-12T00:31:47.131849+0000","last_unstale":"2024-09-12T01:29:27.186140+0000","last_undegraded":"2024-09-12T01:29:27.186140+0000","last_fullsized":"2024-09-12T01:29:27.186140+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'296","last_scrub_stamp":"2024-09-12T01:29:27.185965+0000","last_deep_scrub":"265'296","last_deep_scrub_stamp":"2024-09-12T01:29:27.185965+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.185965+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:13.318989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":405,"num_read_kb":4533,"num_write":946,"num_write_kb":25027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":512,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.615007+0000","last_change":"2024-09-12T01:29:38.614929+0000","last_active":"2024-09-12T01:29:38.615007+0000","last_peered":"2024-09-12T01:29:38.615007+0000","last_clean":"2024-09-12T01:29:38.615007+0000","last_became_active":"2024-09-12T00:31:52.152244+0000","last_became_peered":"2024-09-12T00:31:52.152244+0000","last_unstale":"2024-09-12T01:29:38.615007+0000","last_undegraded":"2024-09-12T01:29:38.615007+0000","last_fullsized":"2024-09-12T01:29:38.615007+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:38.614815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:38.614815+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.614815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:05.675092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"265'98","reported_seq":640,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.558815+0000","last_change":"2024-09-12T01:29:40.558746+0000","last_active":"2024-09-12T01:29:40.558815+0000","last_peered":"2024-09-12T01:29:40.558815+0000","last_clean":"2024-09-12T01:29:40.558815+0000","last_became_active":"2024-09-12T00:31:54.167260+0000","last_became_peered":"2024-09-12T00:31:54.167260+0000","last_unstale":"2024-09-12T01:29:40.558815+0000","last_undegraded":"2024-09-12T01:29:40.558815+0000","last_fullsized":"2024-09-12T01:29:40.558815+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'98","last_scrub_stamp":"2024-09-12T01:29:40.558641+0000","last_deep_scrub":"265'98","last_deep_scrub_stamp":"2024-09-12T01:29:40.558641+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.558641+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:35.210876+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":107,"num_read_kb":103,"num_write":70,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.680896+0000","last_change":"2024-09-12T01:29:45.680841+0000","last_active":"2024-09-12T01:29:45.680896+0000","last_peered":"2024-09-12T01:29:45.680896+0000","last_clean":"2024-09-12T01:29:45.680896+0000","last_became_active":"2024-09-12T00:31:56.174452+0000","last_became_peered":"2024-09-12T00:31:56.174452+0000","last_unstale":"2024-09-12T01:29:45.680896+0000","last_undegraded":"2024-09-12T01:29:45.680896+0000","last_fullsized":"2024-09-12T01:29:45.680896+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:45.680751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:45.680751+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.680751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:47.024821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"265'148","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.109726+0000","last_change":"2024-09-12T01:29:53.109726+0000","last_active":"2024-09-12T01:29:53.109726+0000","last_peered":"2024-09-12T01:29:53.109726+0000","last_clean":"2024-09-12T01:29:53.109726+0000","last_became_active":"2024-09-12T00:31:58.178748+0000","last_became_peered":"2024-09-12T00:31:58.178748+0000","last_unstale":"2024-09-12T01:29:53.109726+0000","last_undegraded":"2024-09-12T01:29:53.109726+0000","last_fullsized":"2024-09-12T01:29:53.109726+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'148","last_scrub_stamp":"2024-09-12T01:29:53.109644+0000","last_deep_scrub":"265'148","last_deep_scrub_stamp":"2024-09-12T01:29:53.109644+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.109644+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:57.155666+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":142,"num_read_kb":137,"num_write":334,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"265'401","reported_seq":1079,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.760451+0000","last_change":"2024-09-12T01:29:42.760397+0000","last_active":"2024-09-12T01:29:42.760451+0000","last_peered":"2024-09-12T01:29:42.760451+0000","last_clean":"2024-09-12T01:29:42.760451+0000","last_became_active":"2024-09-12T00:31:50.143399+0000","last_became_peered":"2024-09-12T00:31:50.143399+0000","last_unstale":"2024-09-12T01:29:42.760451+0000","last_undegraded":"2024-09-12T01:29:42.760451+0000","last_fullsized":"2024-09-12T01:29:42.760451+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'401","last_scrub_stamp":"2024-09-12T01:29:42.760314+0000","last_deep_scrub":"265'401","last_deep_scrub_stamp":"2024-09-12T01:29:42.760314+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.760314+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":300,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:20.228207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1799,"num_read_kb":1492,"num_write":673,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"265'331","reported_seq":1119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.234661+0000","last_change":"2024-09-12T01:29:24.234661+0000","last_active":"2024-09-12T01:29:24.234661+0000","last_peered":"2024-09-12T01:29:24.234661+0000","last_clean":"2024-09-12T01:29:24.234661+0000","last_became_active":"2024-09-12T00:32:23.830863+0000","last_became_peered":"2024-09-12T00:32:23.830863+0000","last_unstale":"2024-09-12T01:29:24.234661+0000","last_undegraded":"2024-09-12T01:29:24.234661+0000","last_fullsized":"2024-09-12T01:29:24.234661+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'331","last_scrub_stamp":"2024-09-12T01:29:24.234562+0000","last_deep_scrub":"265'331","last_deep_scrub_stamp":"2024-09-12T01:29:24.234562+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.234562+0000","objects_scrubbed":8,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:25:32.668950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569327,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":866,"num_read_kb":9184,"num_write":1035,"num_write_kb":22997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,1],"acting":[6,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":511,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.565070+0000","last_change":"2024-09-12T01:29:42.564959+0000","last_active":"2024-09-12T01:29:42.565070+0000","last_peered":"2024-09-12T01:29:42.565070+0000","last_clean":"2024-09-12T01:29:42.565070+0000","last_became_active":"2024-09-12T00:31:52.154077+0000","last_became_peered":"2024-09-12T00:31:52.154077+0000","last_unstale":"2024-09-12T01:29:42.565070+0000","last_undegraded":"2024-09-12T01:29:42.565070+0000","last_fullsized":"2024-09-12T01:29:42.565070+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:42.564848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:42.564848+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.564848+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:53.035581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"265'126","reported_seq":692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.592404+0000","last_change":"2024-09-12T01:29:50.592329+0000","last_active":"2024-09-12T01:29:50.592404+0000","last_peered":"2024-09-12T01:29:50.592404+0000","last_clean":"2024-09-12T01:29:50.592404+0000","last_became_active":"2024-09-12T00:31:54.163434+0000","last_became_peered":"2024-09-12T00:31:54.163434+0000","last_unstale":"2024-09-12T01:29:50.592404+0000","last_undegraded":"2024-09-12T01:29:50.592404+0000","last_fullsized":"2024-09-12T01:29:50.592404+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T01:29:50.592220+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T01:29:50.592220+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.592220+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:46.135715+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":152,"num_read_kb":145,"num_write":100,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"265'783","reported_seq":4230,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:02.345412+0000","last_change":"2024-09-12T01:30:02.345412+0000","last_active":"2024-09-12T01:30:02.345412+0000","last_peered":"2024-09-12T01:30:02.345412+0000","last_clean":"2024-09-12T01:30:02.345412+0000","last_became_active":"2024-09-12T00:31:56.171157+0000","last_became_peered":"2024-09-12T00:31:56.171157+0000","last_unstale":"2024-09-12T01:30:02.345412+0000","last_undegraded":"2024-09-12T01:30:02.345412+0000","last_fullsized":"2024-09-12T01:30:02.345412+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'783","last_scrub_stamp":"2024-09-12T01:30:02.345309+0000","last_deep_scrub":"265'783","last_deep_scrub_stamp":"2024-09-12T01:30:02.345309+0000","last_clean_scrub_stamp":"2024-09-12T01:30:02.345309+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:24.031687+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"265'203","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.417304+0000","last_change":"2024-09-12T01:29:48.417304+0000","last_active":"2024-09-12T01:29:48.417304+0000","last_peered":"2024-09-12T01:29:48.417304+0000","last_clean":"2024-09-12T01:29:48.417304+0000","last_became_active":"2024-09-12T00:31:58.179576+0000","last_became_peered":"2024-09-12T00:31:58.179576+0000","last_unstale":"2024-09-12T01:29:48.417304+0000","last_undegraded":"2024-09-12T01:29:48.417304+0000","last_fullsized":"2024-09-12T01:29:48.417304+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'203","last_scrub_stamp":"2024-09-12T01:29:48.417212+0000","last_deep_scrub":"265'203","last_deep_scrub_stamp":"2024-09-12T01:29:48.417212+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.417212+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:53.762406+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":647,"num_read_kb":631,"num_write":454,"num_write_kb":115,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"265'419","reported_seq":1167,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.756579+0000","last_change":"2024-09-12T01:29:40.756481+0000","last_active":"2024-09-12T01:29:40.756579+0000","last_peered":"2024-09-12T01:29:40.756579+0000","last_clean":"2024-09-12T01:29:40.756579+0000","last_became_active":"2024-09-12T00:31:50.140485+0000","last_became_peered":"2024-09-12T00:31:50.140485+0000","last_unstale":"2024-09-12T01:29:40.756579+0000","last_undegraded":"2024-09-12T01:29:40.756579+0000","last_fullsized":"2024-09-12T01:29:40.756579+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'419","last_scrub_stamp":"2024-09-12T01:29:40.756379+0000","last_deep_scrub":"265'419","last_deep_scrub_stamp":"2024-09-12T01:29:40.756379+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.756379+0000","objects_scrubbed":2,"log_size":19,"log_dups_size":400,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:43.561319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2003,"num_read_kb":1658,"num_write":744,"num_write_kb":485,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7569,"num_omap_keys":32,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"265'321","reported_seq":1012,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.346562+0000","last_change":"2024-09-12T01:29:21.346493+0000","last_active":"2024-09-12T01:29:21.346562+0000","last_peered":"2024-09-12T01:29:21.346562+0000","last_clean":"2024-09-12T01:29:21.346562+0000","last_became_active":"2024-09-12T00:31:47.125118+0000","last_became_peered":"2024-09-12T00:31:47.125118+0000","last_unstale":"2024-09-12T01:29:21.346562+0000","last_undegraded":"2024-09-12T01:29:21.346562+0000","last_fullsized":"2024-09-12T01:29:21.346562+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'321","last_scrub_stamp":"2024-09-12T01:29:21.346370+0000","last_deep_scrub":"265'321","last_deep_scrub_stamp":"2024-09-12T01:29:21.346370+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.346370+0000","objects_scrubbed":10,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:00.319828+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209058,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":536,"num_read_kb":32880,"num_write":1078,"num_write_kb":23042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.268118+0000","last_change":"2024-09-12T01:29:49.268042+0000","last_active":"2024-09-12T01:29:49.268118+0000","last_peered":"2024-09-12T01:29:49.268118+0000","last_clean":"2024-09-12T01:29:49.268118+0000","last_became_active":"2024-09-12T00:31:52.154189+0000","last_became_peered":"2024-09-12T00:31:52.154189+0000","last_unstale":"2024-09-12T01:29:49.268118+0000","last_undegraded":"2024-09-12T01:29:49.268118+0000","last_fullsized":"2024-09-12T01:29:49.268118+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:49.267948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:49.267948+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.267948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:55.800816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"265'280","reported_seq":863,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.407718+0000","last_change":"2024-09-12T01:29:40.407647+0000","last_active":"2024-09-12T01:29:40.407718+0000","last_peered":"2024-09-12T01:29:40.407718+0000","last_clean":"2024-09-12T01:29:40.407718+0000","last_became_active":"2024-09-12T00:31:54.171354+0000","last_became_peered":"2024-09-12T00:31:54.171354+0000","last_unstale":"2024-09-12T01:29:40.407718+0000","last_undegraded":"2024-09-12T01:29:40.407718+0000","last_fullsized":"2024-09-12T01:29:40.407718+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'280","last_scrub_stamp":"2024-09-12T01:29:40.407559+0000","last_deep_scrub":"265'280","last_deep_scrub_stamp":"2024-09-12T01:29:40.407559+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.407559+0000","objects_scrubbed":5,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:49.584492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53613,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":1068,"num_write":372,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"265'785","reported_seq":2518,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.801214+0000","last_change":"2024-09-12T01:29:52.801147+0000","last_active":"2024-09-12T01:29:52.801214+0000","last_peered":"2024-09-12T01:29:52.801214+0000","last_clean":"2024-09-12T01:29:52.801214+0000","last_became_active":"2024-09-12T00:31:56.176464+0000","last_became_peered":"2024-09-12T00:31:56.176464+0000","last_unstale":"2024-09-12T01:29:52.801214+0000","last_undegraded":"2024-09-12T01:29:52.801214+0000","last_fullsized":"2024-09-12T01:29:52.801214+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'785","last_scrub_stamp":"2024-09-12T01:29:52.801061+0000","last_deep_scrub":"265'785","last_deep_scrub_stamp":"2024-09-12T01:29:52.801061+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.801061+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:34.132405+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"265'324","reported_seq":950,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.078967+0000","last_change":"2024-09-12T01:29:37.078895+0000","last_active":"2024-09-12T01:29:37.078967+0000","last_peered":"2024-09-12T01:29:37.078967+0000","last_clean":"2024-09-12T01:29:37.078967+0000","last_became_active":"2024-09-12T00:31:50.138335+0000","last_became_peered":"2024-09-12T00:31:50.138335+0000","last_unstale":"2024-09-12T01:29:37.078967+0000","last_undegraded":"2024-09-12T01:29:37.078967+0000","last_fullsized":"2024-09-12T01:29:37.078967+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'324","last_scrub_stamp":"2024-09-12T01:29:37.078804+0000","last_deep_scrub":"265'324","last_deep_scrub_stamp":"2024-09-12T01:29:37.078804+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.078804+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:03.476907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1349,"num_read_kb":1108,"num_write":487,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"265'344","reported_seq":1000,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:20.932797+0000","last_change":"2024-09-12T01:29:20.932719+0000","last_active":"2024-09-12T01:29:20.932797+0000","last_peered":"2024-09-12T01:29:20.932797+0000","last_clean":"2024-09-12T01:29:20.932797+0000","last_became_active":"2024-09-12T00:31:47.137951+0000","last_became_peered":"2024-09-12T00:31:47.137951+0000","last_unstale":"2024-09-12T01:29:20.932797+0000","last_undegraded":"2024-09-12T01:29:20.932797+0000","last_fullsized":"2024-09-12T01:29:20.932797+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'344","last_scrub_stamp":"2024-09-12T01:29:20.932609+0000","last_deep_scrub":"265'344","last_deep_scrub_stamp":"2024-09-12T01:29:20.932609+0000","last_clean_scrub_stamp":"2024-09-12T01:29:20.932609+0000","objects_scrubbed":6,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:18.440399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":205367,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":485,"num_read_kb":21468,"num_write":1112,"num_write_kb":35236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.486924+0000","last_change":"2024-09-12T01:29:37.486850+0000","last_active":"2024-09-12T01:29:37.486924+0000","last_peered":"2024-09-12T01:29:37.486924+0000","last_clean":"2024-09-12T01:29:37.486924+0000","last_became_active":"2024-09-12T00:31:52.155047+0000","last_became_peered":"2024-09-12T00:31:52.155047+0000","last_unstale":"2024-09-12T01:29:37.486924+0000","last_undegraded":"2024-09-12T01:29:37.486924+0000","last_fullsized":"2024-09-12T01:29:37.486924+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:37.486756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:37.486756+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.486756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:34:25.770437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"265'376","reported_seq":1010,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.167684+0000","last_change":"2024-09-12T01:29:40.167617+0000","last_active":"2024-09-12T01:29:40.167684+0000","last_peered":"2024-09-12T01:29:40.167684+0000","last_clean":"2024-09-12T01:29:40.167684+0000","last_became_active":"2024-09-12T00:31:54.173363+0000","last_became_peered":"2024-09-12T00:31:54.173363+0000","last_unstale":"2024-09-12T01:29:40.167684+0000","last_undegraded":"2024-09-12T01:29:40.167684+0000","last_fullsized":"2024-09-12T01:29:40.167684+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'376","last_scrub_stamp":"2024-09-12T01:29:40.167506+0000","last_deep_scrub":"265'376","last_deep_scrub_stamp":"2024-09-12T01:29:40.167506+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.167506+0000","objects_scrubbed":10,"log_size":76,"log_dups_size":300,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:09:42.647926+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48858,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":584,"num_read_kb":1144,"num_write":454,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.023848+0000","last_change":"2024-09-12T01:29:48.023763+0000","last_active":"2024-09-12T01:29:48.023848+0000","last_peered":"2024-09-12T01:29:48.023848+0000","last_clean":"2024-09-12T01:29:48.023848+0000","last_became_active":"2024-09-12T00:31:56.172791+0000","last_became_peered":"2024-09-12T00:31:56.172791+0000","last_unstale":"2024-09-12T01:29:48.023848+0000","last_undegraded":"2024-09-12T01:29:48.023848+0000","last_fullsized":"2024-09-12T01:29:48.023848+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:48.023666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:48.023666+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.023666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:05.852693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"265'547","reported_seq":1381,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.460939+0000","last_change":"2024-09-12T01:29:46.460863+0000","last_active":"2024-09-12T01:29:46.460939+0000","last_peered":"2024-09-12T01:29:46.460939+0000","last_clean":"2024-09-12T01:29:46.460939+0000","last_became_active":"2024-09-12T00:31:58.177828+0000","last_became_peered":"2024-09-12T00:31:58.177828+0000","last_unstale":"2024-09-12T01:29:46.460939+0000","last_undegraded":"2024-09-12T01:29:46.460939+0000","last_fullsized":"2024-09-12T01:29:46.460939+0000","mapping_epoch":35,"log_start":"265'500","ondisk_log_start":"265'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'547","last_scrub_stamp":"2024-09-12T01:29:46.460769+0000","last_deep_scrub":"265'547","last_deep_scrub_stamp":"2024-09-12T01:29:46.460769+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.460769+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:34.924588+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":74,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1309,"num_read_kb":1288,"num_write":1113,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"265'199","reported_seq":835,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.422245+0000","last_change":"2024-09-12T01:29:26.422188+0000","last_active":"2024-09-12T01:29:26.422245+0000","last_peered":"2024-09-12T01:29:26.422245+0000","last_clean":"2024-09-12T01:29:26.422245+0000","last_became_active":"2024-09-12T00:31:50.138261+0000","last_became_peered":"2024-09-12T00:31:50.138261+0000","last_unstale":"2024-09-12T01:29:26.422245+0000","last_undegraded":"2024-09-12T01:29:26.422245+0000","last_fullsized":"2024-09-12T01:29:26.422245+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'199","last_scrub_stamp":"2024-09-12T01:29:26.422100+0000","last_deep_scrub":"265'199","last_deep_scrub_stamp":"2024-09-12T01:29:26.422100+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.422100+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:46.719548+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":866,"num_read_kb":707,"num_write":323,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"265'375","reported_seq":1093,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.385013+0000","last_change":"2024-09-12T01:29:21.384921+0000","last_active":"2024-09-12T01:29:21.385013+0000","last_peered":"2024-09-12T01:29:21.385013+0000","last_clean":"2024-09-12T01:29:21.385013+0000","last_became_active":"2024-09-12T00:31:47.137234+0000","last_became_peered":"2024-09-12T00:31:47.137234+0000","last_unstale":"2024-09-12T01:29:21.385013+0000","last_undegraded":"2024-09-12T01:29:21.385013+0000","last_fullsized":"2024-09-12T01:29:21.385013+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'375","last_scrub_stamp":"2024-09-12T01:29:21.384774+0000","last_deep_scrub":"265'375","last_deep_scrub_stamp":"2024-09-12T01:29:21.384774+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.384774+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:01.729819+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267358,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":707,"num_read_kb":90782,"num_write":1268,"num_write_kb":21068,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.084079+0000","last_change":"2024-09-12T01:29:40.084013+0000","last_active":"2024-09-12T01:29:40.084079+0000","last_peered":"2024-09-12T01:29:40.084079+0000","last_clean":"2024-09-12T01:29:40.084079+0000","last_became_active":"2024-09-12T00:31:52.148738+0000","last_became_peered":"2024-09-12T00:31:52.148738+0000","last_unstale":"2024-09-12T01:29:40.084079+0000","last_undegraded":"2024-09-12T01:29:40.084079+0000","last_fullsized":"2024-09-12T01:29:40.084079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:40.083917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:40.083917+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.083917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:08.215110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"265'289","reported_seq":883,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.582291+0000","last_change":"2024-09-12T01:29:44.582187+0000","last_active":"2024-09-12T01:29:44.582291+0000","last_peered":"2024-09-12T01:29:44.582291+0000","last_clean":"2024-09-12T01:29:44.582291+0000","last_became_active":"2024-09-12T00:31:54.168247+0000","last_became_peered":"2024-09-12T00:31:54.168247+0000","last_unstale":"2024-09-12T01:29:44.582291+0000","last_undegraded":"2024-09-12T01:29:44.582291+0000","last_fullsized":"2024-09-12T01:29:44.582291+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'289","last_scrub_stamp":"2024-09-12T01:29:44.582089+0000","last_deep_scrub":"265'289","last_deep_scrub_stamp":"2024-09-12T01:29:44.582089+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.582089+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:03.321442+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50064,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":470,"num_read_kb":1085,"num_write":382,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.606557+0000","last_change":"2024-09-12T01:29:52.606504+0000","last_active":"2024-09-12T01:29:52.606557+0000","last_peered":"2024-09-12T01:29:52.606557+0000","last_clean":"2024-09-12T01:29:52.606557+0000","last_became_active":"2024-09-12T00:31:56.173549+0000","last_became_peered":"2024-09-12T00:31:56.173549+0000","last_unstale":"2024-09-12T01:29:52.606557+0000","last_undegraded":"2024-09-12T01:29:52.606557+0000","last_fullsized":"2024-09-12T01:29:52.606557+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:52.606411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:52.606411+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.606411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:19.064185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"265'133","reported_seq":713,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.676595+0000","last_change":"2024-09-12T01:29:47.676531+0000","last_active":"2024-09-12T01:29:47.676595+0000","last_peered":"2024-09-12T01:29:47.676595+0000","last_clean":"2024-09-12T01:29:47.676595+0000","last_became_active":"2024-09-12T00:31:58.175195+0000","last_became_peered":"2024-09-12T00:31:58.175195+0000","last_unstale":"2024-09-12T01:29:47.676595+0000","last_undegraded":"2024-09-12T01:29:47.676595+0000","last_fullsized":"2024-09-12T01:29:47.676595+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-12T01:29:47.676437+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-12T01:29:47.676437+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.676437+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:55:06.315037+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":841,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":426,"num_read_kb":345,"num_write":330,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"265'362","reported_seq":962,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.393443+0000","last_change":"2024-09-12T01:29:28.393387+0000","last_active":"2024-09-12T01:29:28.393443+0000","last_peered":"2024-09-12T01:29:28.393443+0000","last_clean":"2024-09-12T01:29:28.393443+0000","last_became_active":"2024-09-12T00:31:50.142818+0000","last_became_peered":"2024-09-12T00:31:50.142818+0000","last_unstale":"2024-09-12T01:29:28.393443+0000","last_undegraded":"2024-09-12T01:29:28.393443+0000","last_fullsized":"2024-09-12T01:29:28.393443+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T01:29:28.393299+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T01:29:28.393299+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.393299+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:32.642275+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1555,"num_read_kb":1227,"num_write":605,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1024,"num_omap_keys":5,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"265'335","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.993560+0000","last_change":"2024-09-12T01:29:25.993496+0000","last_active":"2024-09-12T01:29:25.993560+0000","last_peered":"2024-09-12T01:29:25.993560+0000","last_clean":"2024-09-12T01:29:25.993560+0000","last_became_active":"2024-09-12T00:31:47.112306+0000","last_became_peered":"2024-09-12T00:31:47.112306+0000","last_unstale":"2024-09-12T01:29:25.993560+0000","last_undegraded":"2024-09-12T01:29:25.993560+0000","last_fullsized":"2024-09-12T01:29:25.993560+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T01:29:25.993385+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T01:29:25.993385+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.993385+0000","objects_scrubbed":3,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:41.871832+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":460,"num_read_kb":55420,"num_write":1061,"num_write_kb":24613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.802045+0000","last_change":"2024-09-12T01:29:43.801990+0000","last_active":"2024-09-12T01:29:43.802045+0000","last_peered":"2024-09-12T01:29:43.802045+0000","last_clean":"2024-09-12T01:29:43.802045+0000","last_became_active":"2024-09-12T00:31:52.153862+0000","last_became_peered":"2024-09-12T00:31:52.153862+0000","last_unstale":"2024-09-12T01:29:43.802045+0000","last_undegraded":"2024-09-12T01:29:43.802045+0000","last_fullsized":"2024-09-12T01:29:43.802045+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:43.801898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:43.801898+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.801898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:29.824097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"265'367","reported_seq":980,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.282208+0000","last_change":"2024-09-12T01:29:53.282136+0000","last_active":"2024-09-12T01:29:53.282208+0000","last_peered":"2024-09-12T01:29:53.282208+0000","last_clean":"2024-09-12T01:29:53.282208+0000","last_became_active":"2024-09-12T00:31:54.162228+0000","last_became_peered":"2024-09-12T00:31:54.162228+0000","last_unstale":"2024-09-12T01:29:53.282208+0000","last_undegraded":"2024-09-12T01:29:53.282208+0000","last_fullsized":"2024-09-12T01:29:53.282208+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T01:29:53.282029+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T01:29:53.282029+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.282029+0000","objects_scrubbed":9,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:19.749606+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50365,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":550,"num_read_kb":1150,"num_write":448,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"265'784","reported_seq":2609,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.769070+0000","last_change":"2024-09-12T01:29:51.768980+0000","last_active":"2024-09-12T01:29:51.769070+0000","last_peered":"2024-09-12T01:29:51.769070+0000","last_clean":"2024-09-12T01:29:51.769070+0000","last_became_active":"2024-09-12T00:31:56.172503+0000","last_became_peered":"2024-09-12T00:31:56.172503+0000","last_unstale":"2024-09-12T01:29:51.769070+0000","last_undegraded":"2024-09-12T01:29:51.769070+0000","last_fullsized":"2024-09-12T01:29:51.769070+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'784","last_scrub_stamp":"2024-09-12T01:29:51.768881+0000","last_deep_scrub":"265'784","last_deep_scrub_stamp":"2024-09-12T01:29:51.768881+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.768881+0000","objects_scrubbed":1,"log_size":84,"log_dups_size":700,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:05.443524+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"265'151","reported_seq":662,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.104463+0000","last_change":"2024-09-12T01:29:52.104405+0000","last_active":"2024-09-12T01:29:52.104463+0000","last_peered":"2024-09-12T01:29:52.104463+0000","last_clean":"2024-09-12T01:29:52.104463+0000","last_became_active":"2024-09-12T00:31:58.175027+0000","last_became_peered":"2024-09-12T00:31:58.175027+0000","last_unstale":"2024-09-12T01:29:52.104463+0000","last_undegraded":"2024-09-12T01:29:52.104463+0000","last_fullsized":"2024-09-12T01:29:52.104463+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'151","last_scrub_stamp":"2024-09-12T01:29:52.104322+0000","last_deep_scrub":"265'151","last_deep_scrub_stamp":"2024-09-12T01:29:52.104322+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.104322+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:02.882257+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1229,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":179,"num_read_kb":162,"num_write":355,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"265'330","reported_seq":965,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.910713+0000","last_change":"2024-09-12T01:29:34.910624+0000","last_active":"2024-09-12T01:29:34.910713+0000","last_peered":"2024-09-12T01:29:34.910713+0000","last_clean":"2024-09-12T01:29:34.910713+0000","last_became_active":"2024-09-12T00:31:50.143814+0000","last_became_peered":"2024-09-12T00:31:50.143814+0000","last_unstale":"2024-09-12T01:29:34.910713+0000","last_undegraded":"2024-09-12T01:29:34.910713+0000","last_fullsized":"2024-09-12T01:29:34.910713+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'330","last_scrub_stamp":"2024-09-12T01:29:34.910513+0000","last_deep_scrub":"265'330","last_deep_scrub_stamp":"2024-09-12T01:29:34.910513+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.910513+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:08.249264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1421,"num_read_kb":1140,"num_write":511,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"265'367","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.966310+0000","last_change":"2024-09-12T01:29:22.966235+0000","last_active":"2024-09-12T01:29:22.966310+0000","last_peered":"2024-09-12T01:29:22.966310+0000","last_clean":"2024-09-12T01:29:22.966310+0000","last_became_active":"2024-09-12T00:31:47.138687+0000","last_became_peered":"2024-09-12T00:31:47.138687+0000","last_unstale":"2024-09-12T01:29:22.966310+0000","last_undegraded":"2024-09-12T01:29:22.966310+0000","last_fullsized":"2024-09-12T01:29:22.966310+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'367","last_scrub_stamp":"2024-09-12T01:29:22.966128+0000","last_deep_scrub":"265'367","last_deep_scrub_stamp":"2024-09-12T01:29:22.966128+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.966128+0000","objects_scrubbed":10,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:35.759401+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6638737,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":559,"num_read_kb":39444,"num_write":1190,"num_write_kb":53128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.131761+0000","last_change":"2024-09-12T01:29:41.131699+0000","last_active":"2024-09-12T01:29:41.131761+0000","last_peered":"2024-09-12T01:29:41.131761+0000","last_clean":"2024-09-12T01:29:41.131761+0000","last_became_active":"2024-09-12T00:31:52.154863+0000","last_became_peered":"2024-09-12T00:31:52.154863+0000","last_unstale":"2024-09-12T01:29:41.131761+0000","last_undegraded":"2024-09-12T01:29:41.131761+0000","last_fullsized":"2024-09-12T01:29:41.131761+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:41.131612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:41.131612+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.131612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:59.475586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"265'519","reported_seq":1181,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.584542+0000","last_change":"2024-09-12T01:29:45.584487+0000","last_active":"2024-09-12T01:29:45.584542+0000","last_peered":"2024-09-12T01:29:45.584542+0000","last_clean":"2024-09-12T01:29:45.584542+0000","last_became_active":"2024-09-12T00:31:54.168691+0000","last_became_peered":"2024-09-12T00:31:54.168691+0000","last_unstale":"2024-09-12T01:29:45.584542+0000","last_undegraded":"2024-09-12T01:29:45.584542+0000","last_fullsized":"2024-09-12T01:29:45.584542+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'519","last_scrub_stamp":"2024-09-12T01:29:45.584397+0000","last_deep_scrub":"265'519","last_deep_scrub_stamp":"2024-09-12T01:29:45.584397+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.584397+0000","objects_scrubbed":7,"log_size":19,"log_dups_size":500,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:32.698872+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104127,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":909,"num_read_kb":2207,"num_write":754,"num_write_kb":642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.737584+0000","last_change":"2024-09-12T01:29:50.737486+0000","last_active":"2024-09-12T01:29:50.737584+0000","last_peered":"2024-09-12T01:29:50.737584+0000","last_clean":"2024-09-12T01:29:50.737584+0000","last_became_active":"2024-09-12T00:31:56.175412+0000","last_became_peered":"2024-09-12T00:31:56.175412+0000","last_unstale":"2024-09-12T01:29:50.737584+0000","last_undegraded":"2024-09-12T01:29:50.737584+0000","last_fullsized":"2024-09-12T01:29:50.737584+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:50.737371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:50.737371+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.737371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:41.626798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"265'136","reported_seq":659,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.616218+0000","last_change":"2024-09-12T01:29:46.616146+0000","last_active":"2024-09-12T01:29:46.616218+0000","last_peered":"2024-09-12T01:29:46.616218+0000","last_clean":"2024-09-12T01:29:46.616218+0000","last_became_active":"2024-09-12T00:31:58.178027+0000","last_became_peered":"2024-09-12T00:31:58.178027+0000","last_unstale":"2024-09-12T01:29:46.616218+0000","last_undegraded":"2024-09-12T01:29:46.616218+0000","last_fullsized":"2024-09-12T01:29:46.616218+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'136","last_scrub_stamp":"2024-09-12T01:29:46.616055+0000","last_deep_scrub":"265'136","last_deep_scrub_stamp":"2024-09-12T01:29:46.616055+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.616055+0000","objects_scrubbed":3,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:41.007359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":140,"num_read_kb":133,"num_write":321,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"265'163","reported_seq":801,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.123199+0000","last_change":"2024-09-12T01:29:33.123130+0000","last_active":"2024-09-12T01:29:33.123199+0000","last_peered":"2024-09-12T01:29:33.123199+0000","last_clean":"2024-09-12T01:29:33.123199+0000","last_became_active":"2024-09-12T00:31:50.127193+0000","last_became_peered":"2024-09-12T00:31:50.127193+0000","last_unstale":"2024-09-12T01:29:33.123199+0000","last_undegraded":"2024-09-12T01:29:33.123199+0000","last_fullsized":"2024-09-12T01:29:33.123199+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'163","last_scrub_stamp":"2024-09-12T01:29:33.123035+0000","last_deep_scrub":"265'163","last_deep_scrub_stamp":"2024-09-12T01:29:33.123035+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.123035+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:08.204389+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":660,"num_read_kb":547,"num_write":243,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"265'332","reported_seq":1006,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.578562+0000","last_change":"2024-09-12T01:29:24.578493+0000","last_active":"2024-09-12T01:29:24.578562+0000","last_peered":"2024-09-12T01:29:24.578562+0000","last_clean":"2024-09-12T01:29:24.578562+0000","last_became_active":"2024-09-12T00:31:47.130136+0000","last_became_peered":"2024-09-12T00:31:47.130136+0000","last_unstale":"2024-09-12T01:29:24.578562+0000","last_undegraded":"2024-09-12T01:29:24.578562+0000","last_fullsized":"2024-09-12T01:29:24.578562+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'332","last_scrub_stamp":"2024-09-12T01:29:24.578387+0000","last_deep_scrub":"265'332","last_deep_scrub_stamp":"2024-09-12T01:29:24.578387+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.578387+0000","objects_scrubbed":3,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:56.888507+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263200,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":72156,"num_write":1150,"num_write_kb":60123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":513,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.546492+0000","last_change":"2024-09-12T01:29:36.546401+0000","last_active":"2024-09-12T01:29:36.546492+0000","last_peered":"2024-09-12T01:29:36.546492+0000","last_clean":"2024-09-12T01:29:36.546492+0000","last_became_active":"2024-09-12T00:31:52.155083+0000","last_became_peered":"2024-09-12T00:31:52.155083+0000","last_unstale":"2024-09-12T01:29:36.546492+0000","last_undegraded":"2024-09-12T01:29:36.546492+0000","last_fullsized":"2024-09-12T01:29:36.546492+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:36.546308+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:36.546308+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.546308+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:03.570556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"265'329","reported_seq":924,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.610658+0000","last_change":"2024-09-12T01:29:41.610592+0000","last_active":"2024-09-12T01:29:41.610658+0000","last_peered":"2024-09-12T01:29:41.610658+0000","last_clean":"2024-09-12T01:29:41.610658+0000","last_became_active":"2024-09-12T00:31:54.165221+0000","last_became_peered":"2024-09-12T00:31:54.165221+0000","last_unstale":"2024-09-12T01:29:41.610658+0000","last_undegraded":"2024-09-12T01:29:41.610658+0000","last_fullsized":"2024-09-12T01:29:41.610658+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'329","last_scrub_stamp":"2024-09-12T01:29:41.610484+0000","last_deep_scrub":"265'329","last_deep_scrub_stamp":"2024-09-12T01:29:41.610484+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.610484+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:29.700202+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53280,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":539,"num_read_kb":1166,"num_write":484,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.549292+0000","last_change":"2024-09-12T01:29:40.549227+0000","last_active":"2024-09-12T01:29:40.549292+0000","last_peered":"2024-09-12T01:29:40.549292+0000","last_clean":"2024-09-12T01:29:40.549292+0000","last_became_active":"2024-09-12T00:31:56.172777+0000","last_became_peered":"2024-09-12T00:31:56.172777+0000","last_unstale":"2024-09-12T01:29:40.549292+0000","last_undegraded":"2024-09-12T01:29:40.549292+0000","last_fullsized":"2024-09-12T01:29:40.549292+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:40.549127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:40.549127+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.549127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:34.798912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"265'119","reported_seq":618,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.738745+0000","last_change":"2024-09-12T01:29:54.738683+0000","last_active":"2024-09-12T01:29:54.738745+0000","last_peered":"2024-09-12T01:29:54.738745+0000","last_clean":"2024-09-12T01:29:54.738745+0000","last_became_active":"2024-09-12T00:31:58.179667+0000","last_became_peered":"2024-09-12T00:31:58.179667+0000","last_unstale":"2024-09-12T01:29:54.738745+0000","last_undegraded":"2024-09-12T01:29:54.738745+0000","last_fullsized":"2024-09-12T01:29:54.738745+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T01:29:54.738574+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T01:29:54.738574+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.738574+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:27:12.877077+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":909,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":86,"num_read_kb":84,"num_write":266,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"265'226","reported_seq":814,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.062280+0000","last_change":"2024-09-12T01:29:38.062213+0000","last_active":"2024-09-12T01:29:38.062280+0000","last_peered":"2024-09-12T01:29:38.062280+0000","last_clean":"2024-09-12T01:29:38.062280+0000","last_became_active":"2024-09-12T00:31:50.130807+0000","last_became_peered":"2024-09-12T00:31:50.130807+0000","last_unstale":"2024-09-12T01:29:38.062280+0000","last_undegraded":"2024-09-12T01:29:38.062280+0000","last_fullsized":"2024-09-12T01:29:38.062280+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'226","last_scrub_stamp":"2024-09-12T01:29:38.062123+0000","last_deep_scrub":"265'226","last_deep_scrub_stamp":"2024-09-12T01:29:38.062123+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.062123+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:56.212489+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":940,"num_read_kb":756,"num_write":329,"num_write_kb":170,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"265'403","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.017861+0000","last_change":"2024-09-12T01:29:28.017755+0000","last_active":"2024-09-12T01:29:28.017861+0000","last_peered":"2024-09-12T01:29:28.017861+0000","last_clean":"2024-09-12T01:29:28.017861+0000","last_became_active":"2024-09-12T00:31:47.113265+0000","last_became_peered":"2024-09-12T00:31:47.113265+0000","last_unstale":"2024-09-12T01:29:28.017861+0000","last_undegraded":"2024-09-12T01:29:28.017861+0000","last_fullsized":"2024-09-12T01:29:28.017861+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'403","last_scrub_stamp":"2024-09-12T01:29:28.017627+0000","last_deep_scrub":"265'403","last_deep_scrub_stamp":"2024-09-12T01:29:28.017627+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.017627+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":300,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:21.400047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174791,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":600,"num_read_kb":11693,"num_write":1259,"num_write_kb":25282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.796919+0000","last_change":"2024-09-12T01:29:44.796855+0000","last_active":"2024-09-12T01:29:44.796919+0000","last_peered":"2024-09-12T01:29:44.796919+0000","last_clean":"2024-09-12T01:29:44.796919+0000","last_became_active":"2024-09-12T00:31:52.155877+0000","last_became_peered":"2024-09-12T00:31:52.155877+0000","last_unstale":"2024-09-12T01:29:44.796919+0000","last_undegraded":"2024-09-12T01:29:44.796919+0000","last_fullsized":"2024-09-12T01:29:44.796919+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:44.796766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:44.796766+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.796766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:17.737413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"265'317","reported_seq":917,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.729025+0000","last_change":"2024-09-12T01:29:48.728963+0000","last_active":"2024-09-12T01:29:48.729025+0000","last_peered":"2024-09-12T01:29:48.729025+0000","last_clean":"2024-09-12T01:29:48.729025+0000","last_became_active":"2024-09-12T00:31:54.165107+0000","last_became_peered":"2024-09-12T00:31:54.165107+0000","last_unstale":"2024-09-12T01:29:48.729025+0000","last_undegraded":"2024-09-12T01:29:48.729025+0000","last_fullsized":"2024-09-12T01:29:48.729025+0000","mapping_epoch":31,"log_start":"265'301","ondisk_log_start":"265'301","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'317","last_scrub_stamp":"2024-09-12T01:29:48.728861+0000","last_deep_scrub":"265'317","last_deep_scrub_stamp":"2024-09-12T01:29:48.728861+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.728861+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:29.201879+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47816,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":516,"num_read_kb":1119,"num_write":414,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"265'743","reported_seq":2485,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.584208+0000","last_change":"2024-09-12T01:29:41.584137+0000","last_active":"2024-09-12T01:29:41.584208+0000","last_peered":"2024-09-12T01:29:41.584208+0000","last_clean":"2024-09-12T01:29:41.584208+0000","last_became_active":"2024-09-12T00:31:56.170388+0000","last_became_peered":"2024-09-12T00:31:56.170388+0000","last_unstale":"2024-09-12T01:29:41.584208+0000","last_undegraded":"2024-09-12T01:29:41.584208+0000","last_fullsized":"2024-09-12T01:29:41.584208+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'743","last_scrub_stamp":"2024-09-12T01:29:41.584051+0000","last_deep_scrub":"265'743","last_deep_scrub_stamp":"2024-09-12T01:29:41.584051+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.584051+0000","objects_scrubbed":1,"log_size":43,"log_dups_size":700,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:32.038767+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"265'166","reported_seq":665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.065362+0000","last_change":"2024-09-12T01:29:51.065302+0000","last_active":"2024-09-12T01:29:51.065362+0000","last_peered":"2024-09-12T01:29:51.065362+0000","last_clean":"2024-09-12T01:29:51.065362+0000","last_became_active":"2024-09-12T00:31:58.171814+0000","last_became_peered":"2024-09-12T00:31:58.171814+0000","last_unstale":"2024-09-12T01:29:51.065362+0000","last_undegraded":"2024-09-12T01:29:51.065362+0000","last_fullsized":"2024-09-12T01:29:51.065362+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'166","last_scrub_stamp":"2024-09-12T01:29:51.065211+0000","last_deep_scrub":"265'166","last_deep_scrub_stamp":"2024-09-12T01:29:51.065211+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.065211+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:04.903106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1272,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":110,"num_read_kb":106,"num_write":379,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"265'118","reported_seq":731,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.425051+0000","last_change":"2024-09-12T01:29:33.424982+0000","last_active":"2024-09-12T01:29:33.425051+0000","last_peered":"2024-09-12T01:29:33.425051+0000","last_clean":"2024-09-12T01:29:33.425051+0000","last_became_active":"2024-09-12T00:31:50.142370+0000","last_became_peered":"2024-09-12T00:31:50.142370+0000","last_unstale":"2024-09-12T01:29:33.425051+0000","last_undegraded":"2024-09-12T01:29:33.425051+0000","last_fullsized":"2024-09-12T01:29:33.425051+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'118","last_scrub_stamp":"2024-09-12T01:29:33.424886+0000","last_deep_scrub":"265'118","last_deep_scrub_stamp":"2024-09-12T01:29:33.424886+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.424886+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:36.238841+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":572,"num_read_kb":482,"num_write":177,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"265'312","reported_seq":940,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.966694+0000","last_change":"2024-09-12T01:29:26.966631+0000","last_active":"2024-09-12T01:29:26.966694+0000","last_peered":"2024-09-12T01:29:26.966694+0000","last_clean":"2024-09-12T01:29:26.966694+0000","last_became_active":"2024-09-12T00:31:47.122110+0000","last_became_peered":"2024-09-12T00:31:47.122110+0000","last_unstale":"2024-09-12T01:29:26.966694+0000","last_undegraded":"2024-09-12T01:29:26.966694+0000","last_fullsized":"2024-09-12T01:29:26.966694+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T01:29:26.966535+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T01:29:26.966535+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.966535+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:36.122577+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":405,"num_read_kb":34909,"num_write":924,"num_write_kb":39966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"265'4","reported_seq":1465,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.439598+0000","last_change":"2024-09-12T01:29:33.439536+0000","last_active":"2024-09-12T01:29:33.439598+0000","last_peered":"2024-09-12T01:29:33.439598+0000","last_clean":"2024-09-12T01:29:33.439598+0000","last_became_active":"2024-09-12T00:31:52.154858+0000","last_became_peered":"2024-09-12T00:31:52.154858+0000","last_unstale":"2024-09-12T01:29:33.439598+0000","last_undegraded":"2024-09-12T01:29:33.439598+0000","last_fullsized":"2024-09-12T01:29:33.439598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4","last_scrub_stamp":"2024-09-12T01:29:33.439442+0000","last_deep_scrub":"265'4","last_deep_scrub_stamp":"2024-09-12T01:29:33.439442+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.439442+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:52.079011+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":953,"num_read_kb":953,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"265'89","reported_seq":616,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.066190+0000","last_change":"2024-09-12T01:29:45.066130+0000","last_active":"2024-09-12T01:29:45.066190+0000","last_peered":"2024-09-12T01:29:45.066190+0000","last_clean":"2024-09-12T01:29:45.066190+0000","last_became_active":"2024-09-12T00:31:54.167362+0000","last_became_peered":"2024-09-12T00:31:54.167362+0000","last_unstale":"2024-09-12T01:29:45.066190+0000","last_undegraded":"2024-09-12T01:29:45.066190+0000","last_fullsized":"2024-09-12T01:29:45.066190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'89","last_scrub_stamp":"2024-09-12T01:29:45.066029+0000","last_deep_scrub":"265'89","last_deep_scrub_stamp":"2024-09-12T01:29:45.066029+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.066029+0000","objects_scrubbed":5,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:34.522067+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":90,"num_read_kb":85,"num_write":60,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"265'772","reported_seq":2507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.635777+0000","last_change":"2024-09-12T01:29:44.635703+0000","last_active":"2024-09-12T01:29:44.635777+0000","last_peered":"2024-09-12T01:29:44.635777+0000","last_clean":"2024-09-12T01:29:44.635777+0000","last_became_active":"2024-09-12T00:31:56.173548+0000","last_became_peered":"2024-09-12T00:31:56.173548+0000","last_unstale":"2024-09-12T01:29:44.635777+0000","last_undegraded":"2024-09-12T01:29:44.635777+0000","last_fullsized":"2024-09-12T01:29:44.635777+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'772","last_scrub_stamp":"2024-09-12T01:29:44.635606+0000","last_deep_scrub":"265'772","last_deep_scrub_stamp":"2024-09-12T01:29:44.635606+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.635606+0000","objects_scrubbed":1,"log_size":72,"log_dups_size":700,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:49.439061+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"265'124","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.486945+0000","last_change":"2024-09-12T01:29:44.486873+0000","last_active":"2024-09-12T01:29:44.486945+0000","last_peered":"2024-09-12T01:29:44.486945+0000","last_clean":"2024-09-12T01:29:44.486945+0000","last_became_active":"2024-09-12T00:31:58.174886+0000","last_became_peered":"2024-09-12T00:31:58.174886+0000","last_unstale":"2024-09-12T01:29:44.486945+0000","last_undegraded":"2024-09-12T01:29:44.486945+0000","last_fullsized":"2024-09-12T01:29:44.486945+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'124","last_scrub_stamp":"2024-09-12T01:29:44.486786+0000","last_deep_scrub":"265'124","last_deep_scrub_stamp":"2024-09-12T01:29:44.486786+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.486786+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:26.176189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":123,"num_write":278,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"265'279","reported_seq":884,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.555593+0000","last_change":"2024-09-12T01:29:27.555522+0000","last_active":"2024-09-12T01:29:27.555593+0000","last_peered":"2024-09-12T01:29:27.555593+0000","last_clean":"2024-09-12T01:29:27.555593+0000","last_became_active":"2024-09-12T00:31:50.139923+0000","last_became_peered":"2024-09-12T00:31:50.139923+0000","last_unstale":"2024-09-12T01:29:27.555593+0000","last_undegraded":"2024-09-12T01:29:27.555593+0000","last_fullsized":"2024-09-12T01:29:27.555593+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'279","last_scrub_stamp":"2024-09-12T01:29:27.555436+0000","last_deep_scrub":"265'279","last_deep_scrub_stamp":"2024-09-12T01:29:27.555436+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.555436+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:35.601614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1196,"num_read_kb":954,"num_write":459,"num_write_kb":231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"265'365","reported_seq":1095,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.692060+0000","last_change":"2024-09-12T01:29:25.691968+0000","last_active":"2024-09-12T01:29:25.692060+0000","last_peered":"2024-09-12T01:29:25.692060+0000","last_clean":"2024-09-12T01:29:25.692060+0000","last_became_active":"2024-09-12T00:31:47.122007+0000","last_became_peered":"2024-09-12T00:31:47.122007+0000","last_unstale":"2024-09-12T01:29:25.692060+0000","last_undegraded":"2024-09-12T01:29:25.692060+0000","last_fullsized":"2024-09-12T01:29:25.692060+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'365","last_scrub_stamp":"2024-09-12T01:29:25.691796+0000","last_deep_scrub":"265'365","last_deep_scrub_stamp":"2024-09-12T01:29:25.691796+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.691796+0000","objects_scrubbed":7,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:47.700467+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":650,"num_read_kb":69205,"num_write":1195,"num_write_kb":21863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.216192+0000","last_change":"2024-09-12T01:29:46.216129+0000","last_active":"2024-09-12T01:29:46.216192+0000","last_peered":"2024-09-12T01:29:46.216192+0000","last_clean":"2024-09-12T01:29:46.216192+0000","last_became_active":"2024-09-12T00:31:52.146894+0000","last_became_peered":"2024-09-12T00:31:52.146894+0000","last_unstale":"2024-09-12T01:29:46.216192+0000","last_undegraded":"2024-09-12T01:29:46.216192+0000","last_fullsized":"2024-09-12T01:29:46.216192+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:46.216043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:46.216043+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.216043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:38.272215+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"265'428","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.518878+0000","last_change":"2024-09-12T01:29:38.518807+0000","last_active":"2024-09-12T01:29:38.518878+0000","last_peered":"2024-09-12T01:29:38.518878+0000","last_clean":"2024-09-12T01:29:38.518878+0000","last_became_active":"2024-09-12T00:31:54.170522+0000","last_became_peered":"2024-09-12T00:31:54.170522+0000","last_unstale":"2024-09-12T01:29:38.518878+0000","last_undegraded":"2024-09-12T01:29:38.518878+0000","last_fullsized":"2024-09-12T01:29:38.518878+0000","mapping_epoch":31,"log_start":"265'400","ondisk_log_start":"265'400","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'428","last_scrub_stamp":"2024-09-12T01:29:38.518712+0000","last_deep_scrub":"265'428","last_deep_scrub_stamp":"2024-09-12T01:29:38.518712+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.518712+0000","objects_scrubbed":9,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:16.110530+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48295,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1274,"num_read_kb":1983,"num_write":1802,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487990,"num_omap_keys":1124,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.378250+0000","last_change":"2024-09-12T01:29:41.378148+0000","last_active":"2024-09-12T01:29:41.378250+0000","last_peered":"2024-09-12T01:29:41.378250+0000","last_clean":"2024-09-12T01:29:41.378250+0000","last_became_active":"2024-09-12T00:31:56.168503+0000","last_became_peered":"2024-09-12T00:31:56.168503+0000","last_unstale":"2024-09-12T01:29:41.378250+0000","last_undegraded":"2024-09-12T01:29:41.378250+0000","last_fullsized":"2024-09-12T01:29:41.378250+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:41.378029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:41.378029+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.378029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:11:55.766428+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"265'131","reported_seq":646,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.576369+0000","last_change":"2024-09-12T01:29:45.576315+0000","last_active":"2024-09-12T01:29:45.576369+0000","last_peered":"2024-09-12T01:29:45.576369+0000","last_clean":"2024-09-12T01:29:45.576369+0000","last_became_active":"2024-09-12T00:31:58.172778+0000","last_became_peered":"2024-09-12T00:31:58.172778+0000","last_unstale":"2024-09-12T01:29:45.576369+0000","last_undegraded":"2024-09-12T01:29:45.576369+0000","last_fullsized":"2024-09-12T01:29:45.576369+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'131","last_scrub_stamp":"2024-09-12T01:29:45.576233+0000","last_deep_scrub":"265'131","last_deep_scrub_stamp":"2024-09-12T01:29:45.576233+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.576233+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:37:05.050007+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":147,"num_write":308,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"265'168","reported_seq":789,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.070962+0000","last_change":"2024-09-12T01:29:36.070874+0000","last_active":"2024-09-12T01:29:36.070962+0000","last_peered":"2024-09-12T01:29:36.070962+0000","last_clean":"2024-09-12T01:29:36.070962+0000","last_became_active":"2024-09-12T00:31:50.131152+0000","last_became_peered":"2024-09-12T00:31:50.131152+0000","last_unstale":"2024-09-12T01:29:36.070962+0000","last_undegraded":"2024-09-12T01:29:36.070962+0000","last_fullsized":"2024-09-12T01:29:36.070962+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T01:29:36.070783+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T01:29:36.070783+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.070783+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:43.699210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":771,"num_read_kb":649,"num_write":266,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"265'74","reported_seq":629,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:20.379019+0000","last_change":"2024-09-12T01:29:20.378968+0000","last_active":"2024-09-12T01:29:20.379019+0000","last_peered":"2024-09-12T01:29:20.379019+0000","last_clean":"2024-09-12T01:29:20.379019+0000","last_became_active":"2024-09-12T00:31:29.750331+0000","last_became_peered":"2024-09-12T00:31:29.750331+0000","last_unstale":"2024-09-12T01:29:20.379019+0000","last_undegraded":"2024-09-12T01:29:20.379019+0000","last_fullsized":"2024-09-12T01:29:20.379019+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'74","last_scrub_stamp":"2024-09-12T01:29:20.378884+0000","last_deep_scrub":"265'74","last_deep_scrub_stamp":"2024-09-12T01:29:20.378884+0000","last_clean_scrub_stamp":"2024-09-12T01:29:20.378884+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:33.781295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"265'2","reported_seq":538,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.006791+0000","last_change":"2024-09-12T01:29:23.006742+0000","last_active":"2024-09-12T01:29:23.006791+0000","last_peered":"2024-09-12T01:29:23.006791+0000","last_clean":"2024-09-12T01:29:23.006791+0000","last_became_active":"2024-09-12T00:31:36.970959+0000","last_became_peered":"2024-09-12T00:31:36.970959+0000","last_unstale":"2024-09-12T01:29:23.006791+0000","last_undegraded":"2024-09-12T01:29:23.006791+0000","last_fullsized":"2024-09-12T01:29:23.006791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:23.006670+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:23.006670+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.006670+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:37.618480+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00098350799999999991,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"265'319","reported_seq":1009,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.691668+0000","last_change":"2024-09-12T01:29:22.691569+0000","last_active":"2024-09-12T01:29:22.691668+0000","last_peered":"2024-09-12T01:29:22.691668+0000","last_clean":"2024-09-12T01:29:22.691668+0000","last_became_active":"2024-09-12T00:31:47.130015+0000","last_became_peered":"2024-09-12T00:31:47.130015+0000","last_unstale":"2024-09-12T01:29:22.691668+0000","last_undegraded":"2024-09-12T01:29:22.691668+0000","last_fullsized":"2024-09-12T01:29:22.691668+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T01:29:22.691380+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T01:29:22.691380+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.691380+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:46:41.799155+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":510,"num_read_kb":117828,"num_write":1049,"num_write_kb":35803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.185268+0000","last_change":"2024-09-12T01:29:37.185179+0000","last_active":"2024-09-12T01:29:37.185268+0000","last_peered":"2024-09-12T01:29:37.185268+0000","last_clean":"2024-09-12T01:29:37.185268+0000","last_became_active":"2024-09-12T00:31:52.148316+0000","last_became_peered":"2024-09-12T00:31:52.148316+0000","last_unstale":"2024-09-12T01:29:37.185268+0000","last_undegraded":"2024-09-12T01:29:37.185268+0000","last_fullsized":"2024-09-12T01:29:37.185268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:37.185077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:37.185077+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.185077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:01.475225+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"265'720","reported_seq":1441,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:52.252964+0000","last_change":"2024-09-12T01:29:52.252851+0000","last_active":"2024-09-12T01:29:52.252964+0000","last_peered":"2024-09-12T01:29:52.252964+0000","last_clean":"2024-09-12T01:29:52.252964+0000","last_became_active":"2024-09-12T00:31:54.163482+0000","last_became_peered":"2024-09-12T00:31:54.163482+0000","last_unstale":"2024-09-12T01:29:52.252964+0000","last_undegraded":"2024-09-12T01:29:52.252964+0000","last_fullsized":"2024-09-12T01:29:52.252964+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'720","last_scrub_stamp":"2024-09-12T01:29:52.252740+0000","last_deep_scrub":"265'720","last_deep_scrub_stamp":"2024-09-12T01:29:52.252740+0000","last_clean_scrub_stamp":"2024-09-12T01:29:52.252740+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":700,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:38.458907+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":135081,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":1399,"num_read_kb":3136,"num_write":1308,"num_write_kb":1145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":90068,"num_omap_keys":220,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.730989+0000","last_change":"2024-09-12T01:29:49.730937+0000","last_active":"2024-09-12T01:29:49.730989+0000","last_peered":"2024-09-12T01:29:49.730989+0000","last_clean":"2024-09-12T01:29:49.730989+0000","last_became_active":"2024-09-12T00:31:56.170545+0000","last_became_peered":"2024-09-12T00:31:56.170545+0000","last_unstale":"2024-09-12T01:29:49.730989+0000","last_undegraded":"2024-09-12T01:29:49.730989+0000","last_fullsized":"2024-09-12T01:29:49.730989+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:49.730847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:49.730847+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.730847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:09.954024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"265'201","reported_seq":911,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.103171+0000","last_change":"2024-09-12T01:29:44.103082+0000","last_active":"2024-09-12T01:29:44.103171+0000","last_peered":"2024-09-12T01:29:44.103171+0000","last_clean":"2024-09-12T01:29:44.103171+0000","last_became_active":"2024-09-12T00:31:58.184941+0000","last_became_peered":"2024-09-12T00:31:58.184941+0000","last_unstale":"2024-09-12T01:29:44.103171+0000","last_undegraded":"2024-09-12T01:29:44.103171+0000","last_fullsized":"2024-09-12T01:29:44.103171+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'201","last_scrub_stamp":"2024-09-12T01:29:44.102997+0000","last_deep_scrub":"265'201","last_deep_scrub_stamp":"2024-09-12T01:29:44.102997+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.102997+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:42.375967+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1234,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":439,"num_read_kb":433,"num_write":415,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"265'95","reported_seq":676,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.799727+0000","last_change":"2024-09-12T01:29:39.799672+0000","last_active":"2024-09-12T01:29:39.799727+0000","last_peered":"2024-09-12T01:29:39.799727+0000","last_clean":"2024-09-12T01:29:39.799727+0000","last_became_active":"2024-09-12T00:31:50.137393+0000","last_became_peered":"2024-09-12T00:31:50.137393+0000","last_unstale":"2024-09-12T01:29:39.799727+0000","last_undegraded":"2024-09-12T01:29:39.799727+0000","last_fullsized":"2024-09-12T01:29:39.799727+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'95","last_scrub_stamp":"2024-09-12T01:29:39.799515+0000","last_deep_scrub":"265'95","last_deep_scrub_stamp":"2024-09-12T01:29:39.799515+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.799515+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:36:12.573956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":346,"num_write":149,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":537,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.997701+0000","last_change":"2024-09-12T01:29:21.997656+0000","last_active":"2024-09-12T01:29:21.997701+0000","last_peered":"2024-09-12T01:29:21.997701+0000","last_clean":"2024-09-12T01:29:21.997701+0000","last_became_active":"2024-09-12T00:31:36.772301+0000","last_became_peered":"2024-09-12T00:31:36.772301+0000","last_unstale":"2024-09-12T01:29:21.997701+0000","last_undegraded":"2024-09-12T01:29:21.997701+0000","last_fullsized":"2024-09-12T01:29:21.997701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:21.997579+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:21.997579+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.997579+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:49.342018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070272599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"265'371","reported_seq":1038,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.261016+0000","last_change":"2024-09-12T01:29:23.260959+0000","last_active":"2024-09-12T01:29:23.261016+0000","last_peered":"2024-09-12T01:29:23.261016+0000","last_clean":"2024-09-12T01:29:23.261016+0000","last_became_active":"2024-09-12T00:31:47.121537+0000","last_became_peered":"2024-09-12T00:31:47.121537+0000","last_unstale":"2024-09-12T01:29:23.261016+0000","last_undegraded":"2024-09-12T01:29:23.261016+0000","last_fullsized":"2024-09-12T01:29:23.261016+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'371","last_scrub_stamp":"2024-09-12T01:29:23.260822+0000","last_deep_scrub":"265'371","last_deep_scrub_stamp":"2024-09-12T01:29:23.260822+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.260822+0000","objects_scrubbed":6,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:08.129052+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306567,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":587,"num_read_kb":9552,"num_write":1166,"num_write_kb":21951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.200010+0000","last_change":"2024-09-12T01:29:45.199954+0000","last_active":"2024-09-12T01:29:45.200010+0000","last_peered":"2024-09-12T01:29:45.200010+0000","last_clean":"2024-09-12T01:29:45.200010+0000","last_became_active":"2024-09-12T00:31:52.147719+0000","last_became_peered":"2024-09-12T00:31:52.147719+0000","last_unstale":"2024-09-12T01:29:45.200010+0000","last_undegraded":"2024-09-12T01:29:45.200010+0000","last_fullsized":"2024-09-12T01:29:45.200010+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:45.199854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:45.199854+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.199854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:45.975132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"265'1270","reported_seq":2913,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.539359+0000","last_change":"2024-09-12T01:29:38.539274+0000","last_active":"2024-09-12T01:29:38.539359+0000","last_peered":"2024-09-12T01:29:38.539359+0000","last_clean":"2024-09-12T01:29:38.539359+0000","last_became_active":"2024-09-12T00:31:54.168085+0000","last_became_peered":"2024-09-12T00:31:54.168085+0000","last_unstale":"2024-09-12T01:29:38.539359+0000","last_undegraded":"2024-09-12T01:29:38.539359+0000","last_fullsized":"2024-09-12T01:29:38.539359+0000","mapping_epoch":31,"log_start":"265'1200","ondisk_log_start":"265'1200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'1270","last_scrub_stamp":"2024-09-12T01:29:38.539154+0000","last_deep_scrub":"265'1270","last_deep_scrub_stamp":"2024-09-12T01:29:38.539154+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.539154+0000","objects_scrubbed":12,"log_size":70,"log_dups_size":1200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:12.785352+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":145044,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":2035,"num_read_kb":3748,"num_write":1136,"num_write_kb":952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.331325+0000","last_change":"2024-09-12T01:29:58.331269+0000","last_active":"2024-09-12T01:29:58.331325+0000","last_peered":"2024-09-12T01:29:58.331325+0000","last_clean":"2024-09-12T01:29:58.331325+0000","last_became_active":"2024-09-12T00:31:56.170725+0000","last_became_peered":"2024-09-12T00:31:56.170725+0000","last_unstale":"2024-09-12T01:29:58.331325+0000","last_undegraded":"2024-09-12T01:29:58.331325+0000","last_fullsized":"2024-09-12T01:29:58.331325+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:58.331165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:58.331165+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.331165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:07.468986+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"265'208","reported_seq":738,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.779036+0000","last_change":"2024-09-12T01:29:55.778945+0000","last_active":"2024-09-12T01:29:55.779036+0000","last_peered":"2024-09-12T01:29:55.779036+0000","last_clean":"2024-09-12T01:29:55.779036+0000","last_became_active":"2024-09-12T00:31:58.182565+0000","last_became_peered":"2024-09-12T00:31:58.182565+0000","last_unstale":"2024-09-12T01:29:55.779036+0000","last_undegraded":"2024-09-12T01:29:55.779036+0000","last_fullsized":"2024-09-12T01:29:55.779036+0000","mapping_epoch":35,"log_start":"262'100","ondisk_log_start":"262'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'208","last_scrub_stamp":"2024-09-12T01:29:55.778831+0000","last_deep_scrub":"265'208","last_deep_scrub_stamp":"2024-09-12T01:29:55.778831+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.778831+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:24.118489+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":315,"num_read_kb":314,"num_write":438,"num_write_kb":130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"265'335","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.144095+0000","last_change":"2024-09-12T01:29:35.144020+0000","last_active":"2024-09-12T01:29:35.144095+0000","last_peered":"2024-09-12T01:29:35.144095+0000","last_clean":"2024-09-12T01:29:35.144095+0000","last_became_active":"2024-09-12T00:31:50.135930+0000","last_became_peered":"2024-09-12T00:31:50.135930+0000","last_unstale":"2024-09-12T01:29:35.144095+0000","last_undegraded":"2024-09-12T01:29:35.144095+0000","last_fullsized":"2024-09-12T01:29:35.144095+0000","mapping_epoch":27,"log_start":"265'300","ondisk_log_start":"265'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'335","last_scrub_stamp":"2024-09-12T01:29:35.143930+0000","last_deep_scrub":"265'335","last_deep_scrub_stamp":"2024-09-12T01:29:35.143930+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.143930+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:20:55.298509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1457,"num_read_kb":1188,"num_write":528,"num_write_kb":308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":541,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.623192+0000","last_change":"2024-09-12T01:29:23.623127+0000","last_active":"2024-09-12T01:29:23.623192+0000","last_peered":"2024-09-12T01:29:23.623192+0000","last_clean":"2024-09-12T01:29:23.623192+0000","last_became_active":"2024-09-12T00:31:36.774484+0000","last_became_peered":"2024-09-12T00:31:36.774484+0000","last_unstale":"2024-09-12T01:29:23.623192+0000","last_undegraded":"2024-09-12T01:29:23.623192+0000","last_fullsized":"2024-09-12T01:29:23.623192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:23.623036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:23.623036+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.623036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:41.999199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040283499999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"265'343","reported_seq":1011,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.784276+0000","last_change":"2024-09-12T01:29:23.784214+0000","last_active":"2024-09-12T01:29:23.784276+0000","last_peered":"2024-09-12T01:29:23.784276+0000","last_clean":"2024-09-12T01:29:23.784276+0000","last_became_active":"2024-09-12T00:31:47.123249+0000","last_became_peered":"2024-09-12T00:31:47.123249+0000","last_unstale":"2024-09-12T01:29:23.784276+0000","last_undegraded":"2024-09-12T01:29:23.784276+0000","last_fullsized":"2024-09-12T01:29:23.784276+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'343","last_scrub_stamp":"2024-09-12T01:29:23.784066+0000","last_deep_scrub":"265'343","last_deep_scrub_stamp":"2024-09-12T01:29:23.784066+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.784066+0000","objects_scrubbed":10,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:32.413879+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291498,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":597,"num_read_kb":12898,"num_write":1156,"num_write_kb":44550,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"265'2","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.599305+0000","last_change":"2024-09-12T01:29:34.599233+0000","last_active":"2024-09-12T01:29:34.599305+0000","last_peered":"2024-09-12T01:29:34.599305+0000","last_clean":"2024-09-12T01:29:34.599305+0000","last_became_active":"2024-09-12T00:31:52.155926+0000","last_became_peered":"2024-09-12T00:31:52.155926+0000","last_unstale":"2024-09-12T01:29:34.599305+0000","last_undegraded":"2024-09-12T01:29:34.599305+0000","last_fullsized":"2024-09-12T01:29:34.599305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:34.599149+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:34.599149+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.599149+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:15.139311+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"265'258","reported_seq":1497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.191454+0000","last_change":"2024-09-12T01:29:39.191396+0000","last_active":"2024-09-12T01:29:39.191454+0000","last_peered":"2024-09-12T01:29:39.191454+0000","last_clean":"2024-09-12T01:29:39.191454+0000","last_became_active":"2024-09-12T00:31:54.174937+0000","last_became_peered":"2024-09-12T00:31:54.174937+0000","last_unstale":"2024-09-12T01:29:39.191454+0000","last_undegraded":"2024-09-12T01:29:39.191454+0000","last_fullsized":"2024-09-12T01:29:39.191454+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'258","last_scrub_stamp":"2024-09-12T01:29:39.191302+0000","last_deep_scrub":"265'258","last_deep_scrub_stamp":"2024-09-12T01:29:39.191302+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.191302+0000","objects_scrubbed":9,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:50.175459+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":211,"num_read_kb":202,"num_write":187,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.603153+0000","last_change":"2024-09-12T01:29:53.603097+0000","last_active":"2024-09-12T01:29:53.603153+0000","last_peered":"2024-09-12T01:29:53.603153+0000","last_clean":"2024-09-12T01:29:53.603153+0000","last_became_active":"2024-09-12T00:31:56.171071+0000","last_became_peered":"2024-09-12T00:31:56.171071+0000","last_unstale":"2024-09-12T01:29:53.603153+0000","last_undegraded":"2024-09-12T01:29:53.603153+0000","last_fullsized":"2024-09-12T01:29:53.603153+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:53.603007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:53.603007+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.603007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:40.755561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"265'242","reported_seq":858,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.601437+0000","last_change":"2024-09-12T01:29:56.601359+0000","last_active":"2024-09-12T01:29:56.601437+0000","last_peered":"2024-09-12T01:29:56.601437+0000","last_clean":"2024-09-12T01:29:56.601437+0000","last_became_active":"2024-09-12T00:31:58.176931+0000","last_became_peered":"2024-09-12T00:31:58.176931+0000","last_unstale":"2024-09-12T01:29:56.601437+0000","last_undegraded":"2024-09-12T01:29:56.601437+0000","last_fullsized":"2024-09-12T01:29:56.601437+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'242","last_scrub_stamp":"2024-09-12T01:29:56.601272+0000","last_deep_scrub":"265'242","last_deep_scrub_stamp":"2024-09-12T01:29:56.601272+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.601272+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:58:19.448047+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":473,"num_read_kb":495,"num_write":504,"num_write_kb":149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"265'416","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.172832+0000","last_change":"2024-09-12T01:29:33.172754+0000","last_active":"2024-09-12T01:29:33.172832+0000","last_peered":"2024-09-12T01:29:33.172832+0000","last_clean":"2024-09-12T01:29:33.172832+0000","last_became_active":"2024-09-12T00:31:50.139625+0000","last_became_peered":"2024-09-12T00:31:50.139625+0000","last_unstale":"2024-09-12T01:29:33.172832+0000","last_undegraded":"2024-09-12T01:29:33.172832+0000","last_fullsized":"2024-09-12T01:29:33.172832+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'416","last_scrub_stamp":"2024-09-12T01:29:33.172645+0000","last_deep_scrub":"265'416","last_deep_scrub_stamp":"2024-09-12T01:29:33.172645+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.172645+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":400,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:16.906066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1805,"num_read_kb":1431,"num_write":644,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"265'3","reported_seq":539,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.003186+0000","last_change":"2024-09-12T01:29:21.003127+0000","last_active":"2024-09-12T01:29:21.003186+0000","last_peered":"2024-09-12T01:29:21.003186+0000","last_clean":"2024-09-12T01:29:21.003186+0000","last_became_active":"2024-09-12T00:31:37.736683+0000","last_became_peered":"2024-09-12T00:31:37.736683+0000","last_unstale":"2024-09-12T01:29:21.003186+0000","last_undegraded":"2024-09-12T01:29:21.003186+0000","last_fullsized":"2024-09-12T01:29:21.003186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'3","last_scrub_stamp":"2024-09-12T01:29:21.003063+0000","last_deep_scrub":"265'3","last_deep_scrub_stamp":"2024-09-12T01:29:21.003063+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.003063+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:50.711321+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001295757,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"265'316","reported_seq":1163,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:19.963009+0000","last_change":"2024-09-12T01:29:19.962927+0000","last_active":"2024-09-12T01:29:19.963009+0000","last_peered":"2024-09-12T01:29:19.963009+0000","last_clean":"2024-09-12T01:29:19.963009+0000","last_became_active":"2024-09-12T00:31:47.136714+0000","last_became_peered":"2024-09-12T00:31:47.136714+0000","last_unstale":"2024-09-12T01:29:19.963009+0000","last_undegraded":"2024-09-12T01:29:19.963009+0000","last_fullsized":"2024-09-12T01:29:19.963009+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T01:29:19.962830+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T01:29:19.962830+0000","last_clean_scrub_stamp":"2024-09-12T01:29:19.962830+0000","objects_scrubbed":2,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:02.608178+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":889,"num_read_kb":29272,"num_write":1058,"num_write_kb":35686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.582615+0000","last_change":"2024-09-12T01:29:35.582530+0000","last_active":"2024-09-12T01:29:35.582615+0000","last_peered":"2024-09-12T01:29:35.582615+0000","last_clean":"2024-09-12T01:29:35.582615+0000","last_became_active":"2024-09-12T00:31:52.148995+0000","last_became_peered":"2024-09-12T00:31:52.148995+0000","last_unstale":"2024-09-12T01:29:35.582615+0000","last_undegraded":"2024-09-12T01:29:35.582615+0000","last_fullsized":"2024-09-12T01:29:35.582615+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:35.582425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:35.582425+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.582425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:11.996704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"265'144","reported_seq":700,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.751258+0000","last_change":"2024-09-12T01:29:47.751175+0000","last_active":"2024-09-12T01:29:47.751258+0000","last_peered":"2024-09-12T01:29:47.751258+0000","last_clean":"2024-09-12T01:29:47.751258+0000","last_became_active":"2024-09-12T00:31:54.167813+0000","last_became_peered":"2024-09-12T00:31:54.167813+0000","last_unstale":"2024-09-12T01:29:47.751258+0000","last_undegraded":"2024-09-12T01:29:47.751258+0000","last_fullsized":"2024-09-12T01:29:47.751258+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:29:47.751074+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:29:47.751074+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.751074+0000","objects_scrubbed":7,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:58.423569+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":166,"num_read_kb":157,"num_write":122,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3358,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.336107+0000","last_change":"2024-09-12T01:29:57.336051+0000","last_active":"2024-09-12T01:29:57.336107+0000","last_peered":"2024-09-12T01:29:57.336107+0000","last_clean":"2024-09-12T01:29:57.336107+0000","last_became_active":"2024-09-12T00:31:56.172693+0000","last_became_peered":"2024-09-12T00:31:56.172693+0000","last_unstale":"2024-09-12T01:29:57.336107+0000","last_undegraded":"2024-09-12T01:29:57.336107+0000","last_fullsized":"2024-09-12T01:29:57.336107+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:57.335968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:57.335968+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.335968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:45:38.140354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"265'163","reported_seq":743,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.702973+0000","last_change":"2024-09-12T01:29:48.702900+0000","last_active":"2024-09-12T01:29:48.702973+0000","last_peered":"2024-09-12T01:29:48.702973+0000","last_clean":"2024-09-12T01:29:48.702973+0000","last_became_active":"2024-09-12T00:31:58.177206+0000","last_became_peered":"2024-09-12T00:31:58.177206+0000","last_unstale":"2024-09-12T01:29:48.702973+0000","last_undegraded":"2024-09-12T01:29:48.702973+0000","last_fullsized":"2024-09-12T01:29:48.702973+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'163","last_scrub_stamp":"2024-09-12T01:29:48.702813+0000","last_deep_scrub":"265'163","last_deep_scrub_stamp":"2024-09-12T01:29:48.702813+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.702813+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:25.149863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":290,"num_read_kb":264,"num_write":267,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"265'249","reported_seq":862,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.214021+0000","last_change":"2024-09-12T01:29:32.213962+0000","last_active":"2024-09-12T01:29:32.214021+0000","last_peered":"2024-09-12T01:29:32.214021+0000","last_clean":"2024-09-12T01:29:32.214021+0000","last_became_active":"2024-09-12T00:31:50.135333+0000","last_became_peered":"2024-09-12T00:31:50.135333+0000","last_unstale":"2024-09-12T01:29:32.214021+0000","last_undegraded":"2024-09-12T01:29:32.214021+0000","last_fullsized":"2024-09-12T01:29:32.214021+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'249","last_scrub_stamp":"2024-09-12T01:29:32.213855+0000","last_deep_scrub":"265'249","last_deep_scrub_stamp":"2024-09-12T01:29:32.213855+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.213855+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:37.155698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1106,"num_read_kb":893,"num_write":406,"num_write_kb":199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"265'297","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.373768+0000","last_change":"2024-09-12T01:29:22.373673+0000","last_active":"2024-09-12T01:29:22.373768+0000","last_peered":"2024-09-12T01:29:22.373768+0000","last_clean":"2024-09-12T01:29:22.373768+0000","last_became_active":"2024-09-12T00:31:47.131943+0000","last_became_peered":"2024-09-12T00:31:47.131943+0000","last_unstale":"2024-09-12T01:29:22.373768+0000","last_undegraded":"2024-09-12T01:29:22.373768+0000","last_fullsized":"2024-09-12T01:29:22.373768+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'297","last_scrub_stamp":"2024-09-12T01:29:22.373580+0000","last_deep_scrub":"265'297","last_deep_scrub_stamp":"2024-09-12T01:29:22.373580+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.373580+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:13.861521+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7951494,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":382,"num_read_kb":39412,"num_write":972,"num_write_kb":51771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.825117+0000","last_change":"2024-09-12T01:29:22.825062+0000","last_active":"2024-09-12T01:29:22.825117+0000","last_peered":"2024-09-12T01:29:22.825117+0000","last_clean":"2024-09-12T01:29:22.825117+0000","last_became_active":"2024-09-12T00:31:37.736507+0000","last_became_peered":"2024-09-12T00:31:37.736507+0000","last_unstale":"2024-09-12T01:29:22.825117+0000","last_undegraded":"2024-09-12T01:29:22.825117+0000","last_fullsized":"2024-09-12T01:29:22.825117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:22.824962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:22.824962+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.824962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:54.694034+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00050928200000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":515,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.575838+0000","last_change":"2024-09-12T01:29:39.575781+0000","last_active":"2024-09-12T01:29:39.575838+0000","last_peered":"2024-09-12T01:29:39.575838+0000","last_clean":"2024-09-12T01:29:39.575838+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:29:39.575838+0000","last_undegraded":"2024-09-12T01:29:39.575838+0000","last_fullsized":"2024-09-12T01:29:39.575838+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:39.575696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:39.575696+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.575696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:20.724735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"265'612","reported_seq":1310,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.560473+0000","last_change":"2024-09-12T01:29:37.560415+0000","last_active":"2024-09-12T01:29:37.560473+0000","last_peered":"2024-09-12T01:29:37.560473+0000","last_clean":"2024-09-12T01:29:37.560473+0000","last_became_active":"2024-09-12T00:31:54.162596+0000","last_became_peered":"2024-09-12T00:31:54.162596+0000","last_unstale":"2024-09-12T01:29:37.560473+0000","last_undegraded":"2024-09-12T01:29:37.560473+0000","last_fullsized":"2024-09-12T01:29:37.560473+0000","mapping_epoch":31,"log_start":"265'600","ondisk_log_start":"265'600","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'612","last_scrub_stamp":"2024-09-12T01:29:37.560320+0000","last_deep_scrub":"265'612","last_deep_scrub_stamp":"2024-09-12T01:29:37.560320+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.560320+0000","objects_scrubbed":11,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:15.707785+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88936,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1027,"num_read_kb":2220,"num_write":890,"num_write_kb":706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":498,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.402442+0000","last_change":"2024-09-12T01:29:42.402364+0000","last_active":"2024-09-12T01:29:42.402442+0000","last_peered":"2024-09-12T01:29:42.402442+0000","last_clean":"2024-09-12T01:29:42.402442+0000","last_became_active":"2024-09-12T00:31:56.170246+0000","last_became_peered":"2024-09-12T00:31:56.170246+0000","last_unstale":"2024-09-12T01:29:42.402442+0000","last_undegraded":"2024-09-12T01:29:42.402442+0000","last_fullsized":"2024-09-12T01:29:42.402442+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:42.402278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:42.402278+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.402278+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:40.856339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"265'142","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.794496+0000","last_change":"2024-09-12T01:29:57.794429+0000","last_active":"2024-09-12T01:29:57.794496+0000","last_peered":"2024-09-12T01:29:57.794496+0000","last_clean":"2024-09-12T01:29:57.794496+0000","last_became_active":"2024-09-12T00:31:58.183206+0000","last_became_peered":"2024-09-12T00:31:58.183206+0000","last_unstale":"2024-09-12T01:29:57.794496+0000","last_undegraded":"2024-09-12T01:29:57.794496+0000","last_fullsized":"2024-09-12T01:29:57.794496+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T01:29:57.794338+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T01:29:57.794338+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.794338+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:04:29.307740+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1141,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":167,"num_read_kb":155,"num_write":341,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"265'131","reported_seq":743,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.143228+0000","last_change":"2024-09-12T01:29:34.143157+0000","last_active":"2024-09-12T01:29:34.143228+0000","last_peered":"2024-09-12T01:29:34.143228+0000","last_clean":"2024-09-12T01:29:34.143228+0000","last_became_active":"2024-09-12T00:31:50.135197+0000","last_became_peered":"2024-09-12T00:31:50.135197+0000","last_unstale":"2024-09-12T01:29:34.143228+0000","last_undegraded":"2024-09-12T01:29:34.143228+0000","last_fullsized":"2024-09-12T01:29:34.143228+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'131","last_scrub_stamp":"2024-09-12T01:29:34.143073+0000","last_deep_scrub":"265'131","last_deep_scrub_stamp":"2024-09-12T01:29:34.143073+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.143073+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:09.129556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":577,"num_read_kb":479,"num_write":210,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"265'302","reported_seq":934,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.253250+0000","last_change":"2024-09-12T01:29:25.253191+0000","last_active":"2024-09-12T01:29:25.253250+0000","last_peered":"2024-09-12T01:29:25.253250+0000","last_clean":"2024-09-12T01:29:25.253250+0000","last_became_active":"2024-09-12T00:31:47.121355+0000","last_became_peered":"2024-09-12T00:31:47.121355+0000","last_unstale":"2024-09-12T01:29:25.253250+0000","last_undegraded":"2024-09-12T01:29:25.253250+0000","last_fullsized":"2024-09-12T01:29:25.253250+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'302","last_scrub_stamp":"2024-09-12T01:29:25.253069+0000","last_deep_scrub":"265'302","last_deep_scrub_stamp":"2024-09-12T01:29:25.253069+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.253069+0000","objects_scrubbed":5,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:12:56.001061+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":451,"num_read_kb":443,"num_write":1003,"num_write_kb":5362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":536,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.031764+0000","last_change":"2024-09-12T01:29:24.031667+0000","last_active":"2024-09-12T01:29:24.031764+0000","last_peered":"2024-09-12T01:29:24.031764+0000","last_clean":"2024-09-12T01:29:24.031764+0000","last_became_active":"2024-09-12T00:31:36.774289+0000","last_became_peered":"2024-09-12T00:31:36.774289+0000","last_unstale":"2024-09-12T01:29:24.031764+0000","last_undegraded":"2024-09-12T01:29:24.031764+0000","last_fullsized":"2024-09-12T01:29:24.031764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:24.031584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:24.031584+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.031584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:30.910975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00063853100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"265'10","reported_seq":1470,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.196197+0000","last_change":"2024-09-12T01:29:35.196095+0000","last_active":"2024-09-12T01:29:35.196197+0000","last_peered":"2024-09-12T01:29:35.196197+0000","last_clean":"2024-09-12T01:29:35.196197+0000","last_became_active":"2024-09-12T00:31:52.147856+0000","last_became_peered":"2024-09-12T00:31:52.147856+0000","last_unstale":"2024-09-12T01:29:35.196197+0000","last_undegraded":"2024-09-12T01:29:35.196197+0000","last_fullsized":"2024-09-12T01:29:35.196197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'10","last_scrub_stamp":"2024-09-12T01:29:35.195968+0000","last_deep_scrub":"265'10","last_deep_scrub_stamp":"2024-09-12T01:29:35.195968+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.195968+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:49.978709+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1609,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1450,"num_read_kb":1911,"num_write":16,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"265'184","reported_seq":763,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.102578+0000","last_change":"2024-09-12T01:29:44.102514+0000","last_active":"2024-09-12T01:29:44.102578+0000","last_peered":"2024-09-12T01:29:44.102578+0000","last_clean":"2024-09-12T01:29:44.102578+0000","last_became_active":"2024-09-12T00:31:54.169958+0000","last_became_peered":"2024-09-12T00:31:54.169958+0000","last_unstale":"2024-09-12T01:29:44.102578+0000","last_undegraded":"2024-09-12T01:29:44.102578+0000","last_fullsized":"2024-09-12T01:29:44.102578+0000","mapping_epoch":31,"log_start":"262'100","ondisk_log_start":"262'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'184","last_scrub_stamp":"2024-09-12T01:29:44.102427+0000","last_deep_scrub":"265'184","last_deep_scrub_stamp":"2024-09-12T01:29:44.102427+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.102427+0000","objects_scrubbed":8,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:26.857668+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":229,"num_read_kb":218,"num_write":152,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"265'773","reported_seq":2829,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.590214+0000","last_change":"2024-09-12T01:29:43.590121+0000","last_active":"2024-09-12T01:29:43.590214+0000","last_peered":"2024-09-12T01:29:43.590214+0000","last_clean":"2024-09-12T01:29:43.590214+0000","last_became_active":"2024-09-12T00:31:56.174535+0000","last_became_peered":"2024-09-12T00:31:56.174535+0000","last_unstale":"2024-09-12T01:29:43.590214+0000","last_undegraded":"2024-09-12T01:29:43.590214+0000","last_fullsized":"2024-09-12T01:29:43.590214+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'773","last_scrub_stamp":"2024-09-12T01:29:43.589995+0000","last_deep_scrub":"265'773","last_deep_scrub_stamp":"2024-09-12T01:29:43.589995+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.589995+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":700,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:13.733386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"265'117","reported_seq":631,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.588396+0000","last_change":"2024-09-12T01:29:47.588328+0000","last_active":"2024-09-12T01:29:47.588396+0000","last_peered":"2024-09-12T01:29:47.588396+0000","last_clean":"2024-09-12T01:29:47.588396+0000","last_became_active":"2024-09-12T00:31:58.174086+0000","last_became_peered":"2024-09-12T00:31:58.174086+0000","last_unstale":"2024-09-12T01:29:47.588396+0000","last_undegraded":"2024-09-12T01:29:47.588396+0000","last_fullsized":"2024-09-12T01:29:47.588396+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'117","last_scrub_stamp":"2024-09-12T01:29:47.588239+0000","last_deep_scrub":"265'117","last_deep_scrub_stamp":"2024-09-12T01:29:47.588239+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.588239+0000","objects_scrubbed":3,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:45.651262+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":536,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":255,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"265'4368","reported_seq":5129,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.552121+0000","last_change":"2024-09-12T01:29:30.552027+0000","last_active":"2024-09-12T01:29:30.552121+0000","last_peered":"2024-09-12T01:29:30.552121+0000","last_clean":"2024-09-12T01:29:30.552121+0000","last_became_active":"2024-09-12T00:31:50.132703+0000","last_became_peered":"2024-09-12T00:31:50.132703+0000","last_unstale":"2024-09-12T01:29:30.552121+0000","last_undegraded":"2024-09-12T01:29:30.552121+0000","last_fullsized":"2024-09-12T01:29:30.552121+0000","mapping_epoch":27,"log_start":"265'4300","ondisk_log_start":"265'4300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4368","last_scrub_stamp":"2024-09-12T01:29:30.551927+0000","last_deep_scrub":"265'4368","last_deep_scrub_stamp":"2024-09-12T01:29:30.551927+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.551927+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":3000,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:47.227065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17817,"num_read_kb":14914,"num_write":6561,"num_write_kb":3320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25749,"num_omap_keys":101,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"265'309","reported_seq":986,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.675808+0000","last_change":"2024-09-12T01:29:24.675750+0000","last_active":"2024-09-12T01:29:24.675808+0000","last_peered":"2024-09-12T01:29:24.675808+0000","last_clean":"2024-09-12T01:29:24.675808+0000","last_became_active":"2024-09-12T00:31:47.116205+0000","last_became_peered":"2024-09-12T00:31:47.116205+0000","last_unstale":"2024-09-12T01:29:24.675808+0000","last_undegraded":"2024-09-12T01:29:24.675808+0000","last_fullsized":"2024-09-12T01:29:24.675808+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'309","last_scrub_stamp":"2024-09-12T01:29:24.675634+0000","last_deep_scrub":"265'309","last_deep_scrub_stamp":"2024-09-12T01:29:24.675634+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.675634+0000","objects_scrubbed":9,"log_size":109,"log_dups_size":200,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:00.404652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":704304,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":481,"num_read_kb":46756,"num_write":1080,"num_write_kb":37168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":540,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.710185+0000","last_change":"2024-09-12T01:29:21.710111+0000","last_active":"2024-09-12T01:29:21.710185+0000","last_peered":"2024-09-12T01:29:21.710185+0000","last_clean":"2024-09-12T01:29:21.710185+0000","last_became_active":"2024-09-12T00:31:37.434707+0000","last_became_peered":"2024-09-12T00:31:37.434707+0000","last_unstale":"2024-09-12T01:29:21.710185+0000","last_undegraded":"2024-09-12T01:29:21.710185+0000","last_fullsized":"2024-09-12T01:29:21.710185+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:21.710025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:21.710025+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.710025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:10.521409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041578299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":509,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.238291+0000","last_change":"2024-09-12T01:29:47.238216+0000","last_active":"2024-09-12T01:29:47.238291+0000","last_peered":"2024-09-12T01:29:47.238291+0000","last_clean":"2024-09-12T01:29:47.238291+0000","last_became_active":"2024-09-12T00:31:52.146927+0000","last_became_peered":"2024-09-12T00:31:52.146927+0000","last_unstale":"2024-09-12T01:29:47.238291+0000","last_undegraded":"2024-09-12T01:29:47.238291+0000","last_fullsized":"2024-09-12T01:29:47.238291+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:47.238121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:47.238121+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.238121+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:32.005209+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"265'135","reported_seq":692,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.282008+0000","last_change":"2024-09-12T01:29:51.281953+0000","last_active":"2024-09-12T01:29:51.282008+0000","last_peered":"2024-09-12T01:29:51.282008+0000","last_clean":"2024-09-12T01:29:51.282008+0000","last_became_active":"2024-09-12T00:31:54.166612+0000","last_became_peered":"2024-09-12T00:31:54.166612+0000","last_unstale":"2024-09-12T01:29:51.282008+0000","last_undegraded":"2024-09-12T01:29:51.282008+0000","last_fullsized":"2024-09-12T01:29:51.282008+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T01:29:51.281847+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T01:29:51.281847+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.281847+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:09.698559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":151,"num_read_kb":143,"num_write":104,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"265'785","reported_seq":4670,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.751926+0000","last_change":"2024-09-12T01:29:46.751847+0000","last_active":"2024-09-12T01:29:46.751926+0000","last_peered":"2024-09-12T01:29:46.751926+0000","last_clean":"2024-09-12T01:29:46.751926+0000","last_became_active":"2024-09-12T00:31:56.170358+0000","last_became_peered":"2024-09-12T00:31:56.170358+0000","last_unstale":"2024-09-12T01:29:46.751926+0000","last_undegraded":"2024-09-12T01:29:46.751926+0000","last_fullsized":"2024-09-12T01:29:46.751926+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'785","last_scrub_stamp":"2024-09-12T01:29:46.751765+0000","last_deep_scrub":"265'785","last_deep_scrub_stamp":"2024-09-12T01:29:46.751765+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.751765+0000","objects_scrubbed":1,"log_size":85,"log_dups_size":700,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:48.040351+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"265'177","reported_seq":693,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.751893+0000","last_change":"2024-09-12T01:29:56.751829+0000","last_active":"2024-09-12T01:29:56.751893+0000","last_peered":"2024-09-12T01:29:56.751893+0000","last_clean":"2024-09-12T01:29:56.751893+0000","last_became_active":"2024-09-12T00:31:58.178148+0000","last_became_peered":"2024-09-12T00:31:58.178148+0000","last_unstale":"2024-09-12T01:29:56.751893+0000","last_undegraded":"2024-09-12T01:29:56.751893+0000","last_fullsized":"2024-09-12T01:29:56.751893+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'177","last_scrub_stamp":"2024-09-12T01:29:56.751734+0000","last_deep_scrub":"265'177","last_deep_scrub_stamp":"2024-09-12T01:29:56.751734+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.751734+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:13.896172+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":155,"num_read_kb":143,"num_write":405,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"265'112","reported_seq":719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.362004+0000","last_change":"2024-09-12T01:29:31.361897+0000","last_active":"2024-09-12T01:29:31.362004+0000","last_peered":"2024-09-12T01:29:31.362004+0000","last_clean":"2024-09-12T01:29:31.362004+0000","last_became_active":"2024-09-12T00:31:50.142769+0000","last_became_peered":"2024-09-12T00:31:50.142769+0000","last_unstale":"2024-09-12T01:29:31.362004+0000","last_undegraded":"2024-09-12T01:29:31.362004+0000","last_fullsized":"2024-09-12T01:29:31.362004+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'112","last_scrub_stamp":"2024-09-12T01:29:31.361797+0000","last_deep_scrub":"265'112","last_deep_scrub_stamp":"2024-09-12T01:29:31.361797+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.361797+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:22:10.303759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":521,"num_read_kb":437,"num_write":174,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"265'390","reported_seq":1085,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.683738+0000","last_change":"2024-09-12T01:29:23.683636+0000","last_active":"2024-09-12T01:29:23.683738+0000","last_peered":"2024-09-12T01:29:23.683738+0000","last_clean":"2024-09-12T01:29:23.683738+0000","last_became_active":"2024-09-12T00:31:47.115974+0000","last_became_peered":"2024-09-12T00:31:47.115974+0000","last_unstale":"2024-09-12T01:29:23.683738+0000","last_undegraded":"2024-09-12T01:29:23.683738+0000","last_fullsized":"2024-09-12T01:29:23.683738+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'390","last_scrub_stamp":"2024-09-12T01:29:23.683459+0000","last_deep_scrub":"265'390","last_deep_scrub_stamp":"2024-09-12T01:29:23.683459+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.683459+0000","objects_scrubbed":8,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:58.878415+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1843869,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":674,"num_read_kb":6022,"num_write":1105,"num_write_kb":14780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":535,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.992869+0000","last_change":"2024-09-12T01:29:24.992796+0000","last_active":"2024-09-12T01:29:24.992869+0000","last_peered":"2024-09-12T01:29:24.992869+0000","last_clean":"2024-09-12T01:29:24.992869+0000","last_became_active":"2024-09-12T00:31:37.434487+0000","last_became_peered":"2024-09-12T00:31:37.434487+0000","last_unstale":"2024-09-12T01:29:24.992869+0000","last_undegraded":"2024-09-12T01:29:24.992869+0000","last_fullsized":"2024-09-12T01:29:24.992869+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:24.992711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:24.992711+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.992711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:32.901092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184421,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":516,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.563522+0000","last_change":"2024-09-12T01:29:36.563465+0000","last_active":"2024-09-12T01:29:36.563522+0000","last_peered":"2024-09-12T01:29:36.563522+0000","last_clean":"2024-09-12T01:29:36.563522+0000","last_became_active":"2024-09-12T00:31:52.152173+0000","last_became_peered":"2024-09-12T00:31:52.152173+0000","last_unstale":"2024-09-12T01:29:36.563522+0000","last_undegraded":"2024-09-12T01:29:36.563522+0000","last_fullsized":"2024-09-12T01:29:36.563522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:36.563342+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:36.563342+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.563342+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:37.784991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"265'742","reported_seq":1481,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.194043+0000","last_change":"2024-09-12T01:29:38.193979+0000","last_active":"2024-09-12T01:29:38.194043+0000","last_peered":"2024-09-12T01:29:38.194043+0000","last_clean":"2024-09-12T01:29:38.194043+0000","last_became_active":"2024-09-12T00:31:54.169994+0000","last_became_peered":"2024-09-12T00:31:54.169994+0000","last_unstale":"2024-09-12T01:29:38.194043+0000","last_undegraded":"2024-09-12T01:29:38.194043+0000","last_fullsized":"2024-09-12T01:29:38.194043+0000","mapping_epoch":31,"log_start":"265'700","ondisk_log_start":"265'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'742","last_scrub_stamp":"2024-09-12T01:29:38.193855+0000","last_deep_scrub":"265'742","last_deep_scrub_stamp":"2024-09-12T01:29:38.193855+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.193855+0000","objects_scrubbed":9,"log_size":42,"log_dups_size":700,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:37.960206+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143669,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1312,"num_read_kb":3057,"num_write":1064,"num_write_kb":866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":507,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:51.589847+0000","last_change":"2024-09-12T01:29:51.589796+0000","last_active":"2024-09-12T01:29:51.589847+0000","last_peered":"2024-09-12T01:29:51.589847+0000","last_clean":"2024-09-12T01:29:51.589847+0000","last_became_active":"2024-09-12T00:31:56.172417+0000","last_became_peered":"2024-09-12T00:31:56.172417+0000","last_unstale":"2024-09-12T01:29:51.589847+0000","last_undegraded":"2024-09-12T01:29:51.589847+0000","last_fullsized":"2024-09-12T01:29:51.589847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:51.589701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:51.589701+0000","last_clean_scrub_stamp":"2024-09-12T01:29:51.589701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:13.456056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"265'152","reported_seq":661,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.461791+0000","last_change":"2024-09-12T01:29:47.461726+0000","last_active":"2024-09-12T01:29:47.461791+0000","last_peered":"2024-09-12T01:29:47.461791+0000","last_clean":"2024-09-12T01:29:47.461791+0000","last_became_active":"2024-09-12T00:31:58.179998+0000","last_became_peered":"2024-09-12T00:31:58.179998+0000","last_unstale":"2024-09-12T01:29:47.461791+0000","last_undegraded":"2024-09-12T01:29:47.461791+0000","last_fullsized":"2024-09-12T01:29:47.461791+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'152","last_scrub_stamp":"2024-09-12T01:29:47.461655+0000","last_deep_scrub":"265'152","last_deep_scrub_stamp":"2024-09-12T01:29:47.461655+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.461655+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:32.937279+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":177,"num_read_kb":166,"num_write":377,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"265'160","reported_seq":733,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:57.599796+0000","last_change":"2024-09-12T01:29:57.599738+0000","last_active":"2024-09-12T01:29:57.599796+0000","last_peered":"2024-09-12T01:29:57.599796+0000","last_clean":"2024-09-12T01:29:57.599796+0000","last_became_active":"2024-09-12T00:31:58.177936+0000","last_became_peered":"2024-09-12T00:31:58.177936+0000","last_unstale":"2024-09-12T01:29:57.599796+0000","last_undegraded":"2024-09-12T01:29:57.599796+0000","last_fullsized":"2024-09-12T01:29:57.599796+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'160","last_scrub_stamp":"2024-09-12T01:29:57.599619+0000","last_deep_scrub":"265'160","last_deep_scrub_stamp":"2024-09-12T01:29:57.599619+0000","last_clean_scrub_stamp":"2024-09-12T01:29:57.599619+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:16.682708+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":424,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":226,"num_read_kb":224,"num_write":377,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"265'98","reported_seq":690,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.451102+0000","last_change":"2024-09-12T01:29:35.451036+0000","last_active":"2024-09-12T01:29:35.451102+0000","last_peered":"2024-09-12T01:29:35.451102+0000","last_clean":"2024-09-12T01:29:35.451102+0000","last_became_active":"2024-09-12T00:31:50.142206+0000","last_became_peered":"2024-09-12T00:31:50.142206+0000","last_unstale":"2024-09-12T01:29:35.451102+0000","last_undegraded":"2024-09-12T01:29:35.451102+0000","last_fullsized":"2024-09-12T01:29:35.451102+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'98","last_scrub_stamp":"2024-09-12T01:29:35.450943+0000","last_deep_scrub":"265'98","last_deep_scrub_stamp":"2024-09-12T01:29:35.450943+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.450943+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:46.081581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":420,"num_read_kb":355,"num_write":133,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"265'318","reported_seq":932,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.981082+0000","last_change":"2024-09-12T01:29:29.980971+0000","last_active":"2024-09-12T01:29:29.981082+0000","last_peered":"2024-09-12T01:29:29.981082+0000","last_clean":"2024-09-12T01:29:29.981082+0000","last_became_active":"2024-09-12T00:31:47.128005+0000","last_became_peered":"2024-09-12T00:31:47.128005+0000","last_unstale":"2024-09-12T01:29:29.981082+0000","last_undegraded":"2024-09-12T01:29:29.981082+0000","last_fullsized":"2024-09-12T01:29:29.981082+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T01:29:29.980824+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T01:29:29.980824+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.980824+0000","objects_scrubbed":8,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:44.159677+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174744,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":395,"num_read_kb":1002,"num_write":979,"num_write_kb":27047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":500,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.117797+0000","last_change":"2024-09-12T01:29:42.117730+0000","last_active":"2024-09-12T01:29:42.117797+0000","last_peered":"2024-09-12T01:29:42.117797+0000","last_clean":"2024-09-12T01:29:42.117797+0000","last_became_active":"2024-09-12T00:31:52.153927+0000","last_became_peered":"2024-09-12T00:31:52.153927+0000","last_unstale":"2024-09-12T01:29:42.117797+0000","last_undegraded":"2024-09-12T01:29:42.117797+0000","last_fullsized":"2024-09-12T01:29:42.117797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:42.117637+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:42.117637+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.117637+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:56.850260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"265'295","reported_seq":882,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.057645+0000","last_change":"2024-09-12T01:29:46.057570+0000","last_active":"2024-09-12T01:29:46.057645+0000","last_peered":"2024-09-12T01:29:46.057645+0000","last_clean":"2024-09-12T01:29:46.057645+0000","last_became_active":"2024-09-12T00:31:54.167414+0000","last_became_peered":"2024-09-12T00:31:54.167414+0000","last_unstale":"2024-09-12T01:29:46.057645+0000","last_undegraded":"2024-09-12T01:29:46.057645+0000","last_fullsized":"2024-09-12T01:29:46.057645+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'295","last_scrub_stamp":"2024-09-12T01:29:46.057480+0000","last_deep_scrub":"265'295","last_deep_scrub_stamp":"2024-09-12T01:29:46.057480+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.057480+0000","objects_scrubbed":6,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:51:24.477901+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44314,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":479,"num_read_kb":1087,"num_write":386,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:44.611004+0000","last_change":"2024-09-12T01:29:44.610937+0000","last_active":"2024-09-12T01:29:44.611004+0000","last_peered":"2024-09-12T01:29:44.611004+0000","last_clean":"2024-09-12T01:29:44.611004+0000","last_became_active":"2024-09-12T00:31:56.173412+0000","last_became_peered":"2024-09-12T00:31:56.173412+0000","last_unstale":"2024-09-12T01:29:44.611004+0000","last_undegraded":"2024-09-12T01:29:44.611004+0000","last_fullsized":"2024-09-12T01:29:44.611004+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:44.610803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:44.610803+0000","last_clean_scrub_stamp":"2024-09-12T01:29:44.610803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:24.276208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"265'129","reported_seq":651,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:48.589898+0000","last_change":"2024-09-12T01:29:48.589849+0000","last_active":"2024-09-12T01:29:48.589898+0000","last_peered":"2024-09-12T01:29:48.589898+0000","last_clean":"2024-09-12T01:29:48.589898+0000","last_became_active":"2024-09-12T00:31:58.176322+0000","last_became_peered":"2024-09-12T00:31:58.176322+0000","last_unstale":"2024-09-12T01:29:48.589898+0000","last_undegraded":"2024-09-12T01:29:48.589898+0000","last_fullsized":"2024-09-12T01:29:48.589898+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'129","last_scrub_stamp":"2024-09-12T01:29:48.589752+0000","last_deep_scrub":"265'129","last_deep_scrub_stamp":"2024-09-12T01:29:48.589752+0000","last_clean_scrub_stamp":"2024-09-12T01:29:48.589752+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:17.155396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":176,"num_read_kb":158,"num_write":327,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"265'158","reported_seq":815,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.560569+0000","last_change":"2024-09-12T01:29:29.560489+0000","last_active":"2024-09-12T01:29:29.560569+0000","last_peered":"2024-09-12T01:29:29.560569+0000","last_clean":"2024-09-12T01:29:29.560569+0000","last_became_active":"2024-09-12T00:31:50.127724+0000","last_became_peered":"2024-09-12T00:31:50.127724+0000","last_unstale":"2024-09-12T01:29:29.560569+0000","last_undegraded":"2024-09-12T01:29:29.560569+0000","last_fullsized":"2024-09-12T01:29:29.560569+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'158","last_scrub_stamp":"2024-09-12T01:29:29.560401+0000","last_deep_scrub":"265'158","last_deep_scrub_stamp":"2024-09-12T01:29:29.560401+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.560401+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:59.392412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":587,"num_write":236,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"265'366","reported_seq":1138,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:21.924631+0000","last_change":"2024-09-12T01:29:21.924574+0000","last_active":"2024-09-12T01:29:21.924631+0000","last_peered":"2024-09-12T01:29:21.924631+0000","last_clean":"2024-09-12T01:29:21.924631+0000","last_became_active":"2024-09-12T00:31:47.138565+0000","last_became_peered":"2024-09-12T00:31:47.138565+0000","last_unstale":"2024-09-12T01:29:21.924631+0000","last_undegraded":"2024-09-12T01:29:21.924631+0000","last_fullsized":"2024-09-12T01:29:21.924631+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T01:29:21.924465+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T01:29:21.924465+0000","last_clean_scrub_stamp":"2024-09-12T01:29:21.924465+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:33.989434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133731,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":777,"num_read_kb":53412,"num_write":1135,"num_write_kb":60803,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":512,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.596147+0000","last_change":"2024-09-12T01:29:41.596083+0000","last_active":"2024-09-12T01:29:41.596147+0000","last_peered":"2024-09-12T01:29:41.596147+0000","last_clean":"2024-09-12T01:29:41.596147+0000","last_became_active":"2024-09-12T00:31:52.154829+0000","last_became_peered":"2024-09-12T00:31:52.154829+0000","last_unstale":"2024-09-12T01:29:41.596147+0000","last_undegraded":"2024-09-12T01:29:41.596147+0000","last_fullsized":"2024-09-12T01:29:41.596147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:41.595994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:41.595994+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.595994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:10.895105+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"265'43","reported_seq":563,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.512983+0000","last_change":"2024-09-12T01:29:47.512926+0000","last_active":"2024-09-12T01:29:47.512983+0000","last_peered":"2024-09-12T01:29:47.512983+0000","last_clean":"2024-09-12T01:29:47.512983+0000","last_became_active":"2024-09-12T00:31:54.162657+0000","last_became_peered":"2024-09-12T00:31:54.162657+0000","last_unstale":"2024-09-12T01:29:47.512983+0000","last_undegraded":"2024-09-12T01:29:47.512983+0000","last_fullsized":"2024-09-12T01:29:47.512983+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'43","last_scrub_stamp":"2024-09-12T01:29:47.512829+0000","last_deep_scrub":"265'43","last_deep_scrub_stamp":"2024-09-12T01:29:47.512829+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.512829+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:14:34.991103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":36,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":495,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.474747+0000","last_change":"2024-09-12T01:29:45.474695+0000","last_active":"2024-09-12T01:29:45.474747+0000","last_peered":"2024-09-12T01:29:45.474747+0000","last_clean":"2024-09-12T01:29:45.474747+0000","last_became_active":"2024-09-12T00:31:56.170648+0000","last_became_peered":"2024-09-12T00:31:56.170648+0000","last_unstale":"2024-09-12T01:29:45.474747+0000","last_undegraded":"2024-09-12T01:29:45.474747+0000","last_fullsized":"2024-09-12T01:29:45.474747+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:45.474603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:45.474603+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.474603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:14:59.854027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"265'218","reported_seq":751,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.080957+0000","last_change":"2024-09-12T01:29:54.080957+0000","last_active":"2024-09-12T01:29:54.080957+0000","last_peered":"2024-09-12T01:29:54.080957+0000","last_clean":"2024-09-12T01:29:54.080957+0000","last_became_active":"2024-09-12T00:31:58.172511+0000","last_became_peered":"2024-09-12T00:31:58.172511+0000","last_unstale":"2024-09-12T01:29:54.080957+0000","last_undegraded":"2024-09-12T01:29:54.080957+0000","last_fullsized":"2024-09-12T01:29:54.080957+0000","mapping_epoch":35,"log_start":"265'200","ondisk_log_start":"265'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'218","last_scrub_stamp":"2024-09-12T01:29:54.080859+0000","last_deep_scrub":"265'218","last_deep_scrub_stamp":"2024-09-12T01:29:54.080859+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.080859+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:07:57.488220+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":356,"num_read_kb":339,"num_write":509,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"265'63","reported_seq":635,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.577018+0000","last_change":"2024-09-12T01:29:28.576959+0000","last_active":"2024-09-12T01:29:28.577018+0000","last_peered":"2024-09-12T01:29:28.577018+0000","last_clean":"2024-09-12T01:29:28.577018+0000","last_became_active":"2024-09-12T00:31:50.124994+0000","last_became_peered":"2024-09-12T00:31:50.124994+0000","last_unstale":"2024-09-12T01:29:28.577018+0000","last_undegraded":"2024-09-12T01:29:28.577018+0000","last_fullsized":"2024-09-12T01:29:28.577018+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'63","last_scrub_stamp":"2024-09-12T01:29:28.576859+0000","last_deep_scrub":"265'63","last_deep_scrub_stamp":"2024-09-12T01:29:28.576859+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.576859+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:46.559642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":261,"num_read_kb":221,"num_write":86,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"265'334","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.395459+0000","last_change":"2024-09-12T01:29:25.395373+0000","last_active":"2024-09-12T01:29:25.395459+0000","last_peered":"2024-09-12T01:29:25.395459+0000","last_clean":"2024-09-12T01:29:25.395459+0000","last_became_active":"2024-09-12T00:31:47.134398+0000","last_became_peered":"2024-09-12T00:31:47.134398+0000","last_unstale":"2024-09-12T01:29:25.395459+0000","last_undegraded":"2024-09-12T01:29:25.395459+0000","last_fullsized":"2024-09-12T01:29:25.395459+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'334","last_scrub_stamp":"2024-09-12T01:29:25.395184+0000","last_deep_scrub":"265'334","last_deep_scrub_stamp":"2024-09-12T01:29:25.395184+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.395184+0000","objects_scrubbed":9,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:04.761120+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":788554,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":470,"num_read_kb":102268,"num_write":1066,"num_write_kb":44150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.466224+0000","last_change":"2024-09-12T01:29:34.466136+0000","last_active":"2024-09-12T01:29:34.466224+0000","last_peered":"2024-09-12T01:29:34.466224+0000","last_clean":"2024-09-12T01:29:34.466224+0000","last_became_active":"2024-09-12T00:31:52.151826+0000","last_became_peered":"2024-09-12T00:31:52.151826+0000","last_unstale":"2024-09-12T01:29:34.466224+0000","last_undegraded":"2024-09-12T01:29:34.466224+0000","last_fullsized":"2024-09-12T01:29:34.466224+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:34.466045+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:34.466045+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.466045+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:00.120324+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"265'305","reported_seq":915,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.528823+0000","last_change":"2024-09-12T01:29:39.528727+0000","last_active":"2024-09-12T01:29:39.528823+0000","last_peered":"2024-09-12T01:29:39.528823+0000","last_clean":"2024-09-12T01:29:39.528823+0000","last_became_active":"2024-09-12T00:31:54.162188+0000","last_became_peered":"2024-09-12T00:31:54.162188+0000","last_unstale":"2024-09-12T01:29:39.528823+0000","last_undegraded":"2024-09-12T01:29:39.528823+0000","last_fullsized":"2024-09-12T01:29:39.528823+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'305","last_scrub_stamp":"2024-09-12T01:29:39.528595+0000","last_deep_scrub":"265'305","last_deep_scrub_stamp":"2024-09-12T01:29:39.528595+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.528595+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:29.037553+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49464,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":505,"num_read_kb":1076,"num_write":398,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":499,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.559866+0000","last_change":"2024-09-12T01:29:42.559741+0000","last_active":"2024-09-12T01:29:42.559866+0000","last_peered":"2024-09-12T01:29:42.559866+0000","last_clean":"2024-09-12T01:29:42.559866+0000","last_became_active":"2024-09-12T00:31:56.168434+0000","last_became_peered":"2024-09-12T00:31:56.168434+0000","last_unstale":"2024-09-12T01:29:42.559866+0000","last_undegraded":"2024-09-12T01:29:42.559866+0000","last_fullsized":"2024-09-12T01:29:42.559866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:42.559636+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:42.559636+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.559636+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:26.790467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"265'128","reported_seq":660,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:05.282196+0000","last_change":"2024-09-12T01:30:05.282196+0000","last_active":"2024-09-12T01:30:05.282196+0000","last_peered":"2024-09-12T01:30:05.282196+0000","last_clean":"2024-09-12T01:30:05.282196+0000","last_became_active":"2024-09-12T00:31:58.173552+0000","last_became_peered":"2024-09-12T00:31:58.173552+0000","last_unstale":"2024-09-12T01:30:05.282196+0000","last_undegraded":"2024-09-12T01:30:05.282196+0000","last_fullsized":"2024-09-12T01:30:05.282196+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'128","last_scrub_stamp":"2024-09-12T01:30:05.282097+0000","last_deep_scrub":"265'128","last_deep_scrub_stamp":"2024-09-12T01:30:05.282097+0000","last_clean_scrub_stamp":"2024-09-12T01:30:05.282097+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:19.758465+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":198,"num_write":331,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"265'108","reported_seq":703,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.592310+0000","last_change":"2024-09-12T01:29:29.592252+0000","last_active":"2024-09-12T01:29:29.592310+0000","last_peered":"2024-09-12T01:29:29.592310+0000","last_clean":"2024-09-12T01:29:29.592310+0000","last_became_active":"2024-09-12T00:31:50.133117+0000","last_became_peered":"2024-09-12T00:31:50.133117+0000","last_unstale":"2024-09-12T01:29:29.592310+0000","last_undegraded":"2024-09-12T01:29:29.592310+0000","last_fullsized":"2024-09-12T01:29:29.592310+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'108","last_scrub_stamp":"2024-09-12T01:29:29.592164+0000","last_deep_scrub":"265'108","last_deep_scrub_stamp":"2024-09-12T01:29:29.592164+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.592164+0000","objects_scrubbed":1,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:46.847768+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":508,"num_read_kb":426,"num_write":172,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"265'425","reported_seq":1164,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:24.746659+0000","last_change":"2024-09-12T01:29:24.746585+0000","last_active":"2024-09-12T01:29:24.746659+0000","last_peered":"2024-09-12T01:29:24.746659+0000","last_clean":"2024-09-12T01:29:24.746659+0000","last_became_active":"2024-09-12T00:31:47.127603+0000","last_became_peered":"2024-09-12T00:31:47.127603+0000","last_unstale":"2024-09-12T01:29:24.746659+0000","last_undegraded":"2024-09-12T01:29:24.746659+0000","last_fullsized":"2024-09-12T01:29:24.746659+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'425","last_scrub_stamp":"2024-09-12T01:29:24.746482+0000","last_deep_scrub":"265'425","last_deep_scrub_stamp":"2024-09-12T01:29:24.746482+0000","last_clean_scrub_stamp":"2024-09-12T01:29:24.746482+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:59.902513+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":834,"num_read_kb":29446,"num_write":1356,"num_write_kb":48637,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.315253+0000","last_change":"2024-09-12T01:29:50.315197+0000","last_active":"2024-09-12T01:29:50.315253+0000","last_peered":"2024-09-12T01:29:50.315253+0000","last_clean":"2024-09-12T01:29:50.315253+0000","last_became_active":"2024-09-12T00:31:52.152398+0000","last_became_peered":"2024-09-12T00:31:52.152398+0000","last_unstale":"2024-09-12T01:29:50.315253+0000","last_undegraded":"2024-09-12T01:29:50.315253+0000","last_fullsized":"2024-09-12T01:29:50.315253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:50.315105+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:50.315105+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.315105+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:18.800901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"265'279","reported_seq":860,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.191298+0000","last_change":"2024-09-12T01:29:41.191230+0000","last_active":"2024-09-12T01:29:41.191298+0000","last_peered":"2024-09-12T01:29:41.191298+0000","last_clean":"2024-09-12T01:29:41.191298+0000","last_became_active":"2024-09-12T00:31:54.171386+0000","last_became_peered":"2024-09-12T00:31:54.171386+0000","last_unstale":"2024-09-12T01:29:41.191298+0000","last_undegraded":"2024-09-12T01:29:41.191298+0000","last_fullsized":"2024-09-12T01:29:41.191298+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'279","last_scrub_stamp":"2024-09-12T01:29:41.191130+0000","last_deep_scrub":"265'279","last_deep_scrub_stamp":"2024-09-12T01:29:41.191130+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.191130+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:52:18.450325+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46739,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":462,"num_read_kb":1088,"num_write":376,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.601476+0000","last_change":"2024-09-12T01:29:42.601410+0000","last_active":"2024-09-12T01:29:42.601476+0000","last_peered":"2024-09-12T01:29:42.601476+0000","last_clean":"2024-09-12T01:29:42.601476+0000","last_became_active":"2024-09-12T00:31:56.167213+0000","last_became_peered":"2024-09-12T00:31:56.167213+0000","last_unstale":"2024-09-12T01:29:42.601476+0000","last_undegraded":"2024-09-12T01:29:42.601476+0000","last_fullsized":"2024-09-12T01:29:42.601476+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:42.601326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:42.601326+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.601326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:10:58.024251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"265'120","reported_seq":750,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.144531+0000","last_change":"2024-09-12T01:29:40.144462+0000","last_active":"2024-09-12T01:29:40.144531+0000","last_peered":"2024-09-12T01:29:40.144531+0000","last_clean":"2024-09-12T01:29:40.144531+0000","last_became_active":"2024-09-12T00:31:50.139863+0000","last_became_peered":"2024-09-12T00:31:50.139863+0000","last_unstale":"2024-09-12T01:29:40.144531+0000","last_undegraded":"2024-09-12T01:29:40.144531+0000","last_fullsized":"2024-09-12T01:29:40.144531+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'120","last_scrub_stamp":"2024-09-12T01:29:40.144376+0000","last_deep_scrub":"265'120","last_deep_scrub_stamp":"2024-09-12T01:29:40.144376+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.144376+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:11.609630+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":552,"num_read_kb":466,"num_write":169,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"265'448","reported_seq":1152,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.795430+0000","last_change":"2024-09-12T01:29:25.795366+0000","last_active":"2024-09-12T01:29:25.795430+0000","last_peered":"2024-09-12T01:29:25.795430+0000","last_clean":"2024-09-12T01:29:25.795430+0000","last_became_active":"2024-09-12T00:31:47.133283+0000","last_became_peered":"2024-09-12T00:31:47.133283+0000","last_unstale":"2024-09-12T01:29:25.795430+0000","last_undegraded":"2024-09-12T01:29:25.795430+0000","last_fullsized":"2024-09-12T01:29:25.795430+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'448","last_scrub_stamp":"2024-09-12T01:29:25.795214+0000","last_deep_scrub":"265'448","last_deep_scrub_stamp":"2024-09-12T01:29:25.795214+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.795214+0000","objects_scrubbed":7,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:54.503325+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133704,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":743,"num_read_kb":14924,"num_write":1450,"num_write_kb":35691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":504,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.106038+0000","last_change":"2024-09-12T01:29:43.105971+0000","last_active":"2024-09-12T01:29:43.106038+0000","last_peered":"2024-09-12T01:29:43.106038+0000","last_clean":"2024-09-12T01:29:43.106038+0000","last_became_active":"2024-09-12T00:31:52.152676+0000","last_became_peered":"2024-09-12T00:31:52.152676+0000","last_unstale":"2024-09-12T01:29:43.106038+0000","last_undegraded":"2024-09-12T01:29:43.106038+0000","last_fullsized":"2024-09-12T01:29:43.106038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:43.105857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:43.105857+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.105857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:58.634409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"265'515","reported_seq":1155,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:50.021086+0000","last_change":"2024-09-12T01:29:50.021086+0000","last_active":"2024-09-12T01:29:50.021086+0000","last_peered":"2024-09-12T01:29:50.021086+0000","last_clean":"2024-09-12T01:29:50.021086+0000","last_became_active":"2024-09-12T00:31:54.171225+0000","last_became_peered":"2024-09-12T00:31:54.171225+0000","last_unstale":"2024-09-12T01:29:50.021086+0000","last_undegraded":"2024-09-12T01:29:50.021086+0000","last_fullsized":"2024-09-12T01:29:50.021086+0000","mapping_epoch":31,"log_start":"265'500","ondisk_log_start":"265'500","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'515","last_scrub_stamp":"2024-09-12T01:29:50.020987+0000","last_deep_scrub":"265'515","last_deep_scrub_stamp":"2024-09-12T01:29:50.020987+0000","last_clean_scrub_stamp":"2024-09-12T01:29:50.020987+0000","objects_scrubbed":7,"log_size":15,"log_dups_size":500,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:30.996334+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":95922,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":923,"num_read_kb":2207,"num_write":796,"num_write_kb":707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.447754+0000","last_change":"2024-09-12T01:29:43.447754+0000","last_active":"2024-09-12T01:29:43.447754+0000","last_peered":"2024-09-12T01:29:43.447754+0000","last_clean":"2024-09-12T01:29:43.447754+0000","last_became_active":"2024-09-12T00:31:56.175562+0000","last_became_peered":"2024-09-12T00:31:56.175562+0000","last_unstale":"2024-09-12T01:29:43.447754+0000","last_undegraded":"2024-09-12T01:29:43.447754+0000","last_fullsized":"2024-09-12T01:29:43.447754+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:43.447666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:43.447666+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.447666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:05.961632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"265'144","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.746339+0000","last_change":"2024-09-12T01:29:59.746281+0000","last_active":"2024-09-12T01:29:59.746339+0000","last_peered":"2024-09-12T01:29:59.746339+0000","last_clean":"2024-09-12T01:29:59.746339+0000","last_became_active":"2024-09-12T00:31:58.182602+0000","last_became_peered":"2024-09-12T00:31:58.182602+0000","last_unstale":"2024-09-12T01:29:59.746339+0000","last_undegraded":"2024-09-12T01:29:59.746339+0000","last_fullsized":"2024-09-12T01:29:59.746339+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:29:59.746182+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:29:59.746182+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.746182+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:40.081045+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":152,"num_read_kb":164,"num_write":296,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"265'135","reported_seq":766,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.579485+0000","last_change":"2024-09-12T01:29:31.579405+0000","last_active":"2024-09-12T01:29:31.579485+0000","last_peered":"2024-09-12T01:29:31.579485+0000","last_clean":"2024-09-12T01:29:31.579485+0000","last_became_active":"2024-09-12T00:31:50.132053+0000","last_became_peered":"2024-09-12T00:31:50.132053+0000","last_unstale":"2024-09-12T01:29:31.579485+0000","last_undegraded":"2024-09-12T01:29:31.579485+0000","last_fullsized":"2024-09-12T01:29:31.579485+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'135","last_scrub_stamp":"2024-09-12T01:29:31.579303+0000","last_deep_scrub":"265'135","last_deep_scrub_stamp":"2024-09-12T01:29:31.579303+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.579303+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:34.679511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":637,"num_read_kb":540,"num_write":205,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"265'319","reported_seq":976,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.654872+0000","last_change":"2024-09-12T01:29:26.654810+0000","last_active":"2024-09-12T01:29:26.654872+0000","last_peered":"2024-09-12T01:29:26.654872+0000","last_clean":"2024-09-12T01:29:26.654872+0000","last_became_active":"2024-09-12T00:31:47.114966+0000","last_became_peered":"2024-09-12T00:31:47.114966+0000","last_unstale":"2024-09-12T01:29:26.654872+0000","last_undegraded":"2024-09-12T01:29:26.654872+0000","last_fullsized":"2024-09-12T01:29:26.654872+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'319","last_scrub_stamp":"2024-09-12T01:29:26.654700+0000","last_deep_scrub":"265'319","last_deep_scrub_stamp":"2024-09-12T01:29:26.654700+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.654700+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:07.153488+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279295,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":490,"num_read_kb":26176,"num_write":1107,"num_write_kb":27429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.402850+0000","last_change":"2024-09-12T01:29:39.402798+0000","last_active":"2024-09-12T01:29:39.402850+0000","last_peered":"2024-09-12T01:29:39.402850+0000","last_clean":"2024-09-12T01:29:39.402850+0000","last_became_active":"2024-09-12T00:31:52.154093+0000","last_became_peered":"2024-09-12T00:31:52.154093+0000","last_unstale":"2024-09-12T01:29:39.402850+0000","last_undegraded":"2024-09-12T01:29:39.402850+0000","last_fullsized":"2024-09-12T01:29:39.402850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:39.402710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:39.402710+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.402710+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:26.430951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"265'301","reported_seq":898,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.295518+0000","last_change":"2024-09-12T01:29:55.295518+0000","last_active":"2024-09-12T01:29:55.295518+0000","last_peered":"2024-09-12T01:29:55.295518+0000","last_clean":"2024-09-12T01:29:55.295518+0000","last_became_active":"2024-09-12T00:31:54.165996+0000","last_became_peered":"2024-09-12T00:31:54.165996+0000","last_unstale":"2024-09-12T01:29:55.295518+0000","last_undegraded":"2024-09-12T01:29:55.295518+0000","last_fullsized":"2024-09-12T01:29:55.295518+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'301","last_scrub_stamp":"2024-09-12T01:29:55.295422+0000","last_deep_scrub":"265'301","last_deep_scrub_stamp":"2024-09-12T01:29:55.295422+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.295422+0000","objects_scrubbed":8,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:02.542094+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47612,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":488,"num_read_kb":1000,"num_write":400,"num_write_kb":289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:53.762516+0000","last_change":"2024-09-12T01:29:53.762516+0000","last_active":"2024-09-12T01:29:53.762516+0000","last_peered":"2024-09-12T01:29:53.762516+0000","last_clean":"2024-09-12T01:29:53.762516+0000","last_became_active":"2024-09-12T00:31:56.170994+0000","last_became_peered":"2024-09-12T00:31:56.170994+0000","last_unstale":"2024-09-12T01:29:53.762516+0000","last_undegraded":"2024-09-12T01:29:53.762516+0000","last_fullsized":"2024-09-12T01:29:53.762516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:53.762429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:53.762429+0000","last_clean_scrub_stamp":"2024-09-12T01:29:53.762429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:18.418793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"265'168","reported_seq":684,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:01.378473+0000","last_change":"2024-09-12T01:30:01.378394+0000","last_active":"2024-09-12T01:30:01.378473+0000","last_peered":"2024-09-12T01:30:01.378473+0000","last_clean":"2024-09-12T01:30:01.378473+0000","last_became_active":"2024-09-12T00:31:58.183625+0000","last_became_peered":"2024-09-12T00:31:58.183625+0000","last_unstale":"2024-09-12T01:30:01.378473+0000","last_undegraded":"2024-09-12T01:30:01.378473+0000","last_fullsized":"2024-09-12T01:30:01.378473+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'168","last_scrub_stamp":"2024-09-12T01:30:01.378303+0000","last_deep_scrub":"265'168","last_deep_scrub_stamp":"2024-09-12T01:30:01.378303+0000","last_clean_scrub_stamp":"2024-09-12T01:30:01.378303+0000","objects_scrubbed":6,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:15:35.722105+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2035,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":198,"num_read_kb":191,"num_write":465,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"265'119","reported_seq":704,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.609043+0000","last_change":"2024-09-12T01:29:30.609043+0000","last_active":"2024-09-12T01:29:30.609043+0000","last_peered":"2024-09-12T01:29:30.609043+0000","last_clean":"2024-09-12T01:29:30.609043+0000","last_became_active":"2024-09-12T00:31:50.143427+0000","last_became_peered":"2024-09-12T00:31:50.143427+0000","last_unstale":"2024-09-12T01:29:30.609043+0000","last_undegraded":"2024-09-12T01:29:30.609043+0000","last_fullsized":"2024-09-12T01:29:30.609043+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'119","last_scrub_stamp":"2024-09-12T01:29:30.608948+0000","last_deep_scrub":"265'119","last_deep_scrub_stamp":"2024-09-12T01:29:30.608948+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.608948+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:44.221971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":539,"num_read_kb":443,"num_write":196,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"265'364","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.374053+0000","last_change":"2024-09-12T01:29:23.374053+0000","last_active":"2024-09-12T01:29:23.374053+0000","last_peered":"2024-09-12T01:29:23.374053+0000","last_clean":"2024-09-12T01:29:23.374053+0000","last_became_active":"2024-09-12T00:31:47.117631+0000","last_became_peered":"2024-09-12T00:31:47.117631+0000","last_unstale":"2024-09-12T01:29:23.374053+0000","last_undegraded":"2024-09-12T01:29:23.374053+0000","last_fullsized":"2024-09-12T01:29:23.374053+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'364","last_scrub_stamp":"2024-09-12T01:29:23.373946+0000","last_deep_scrub":"265'364","last_deep_scrub_stamp":"2024-09-12T01:29:23.373946+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.373946+0000","objects_scrubbed":7,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:26.118563+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":28,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":597,"num_read_kb":5850,"num_write":1220,"num_write_kb":26346,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.372836+0000","last_change":"2024-09-12T01:29:38.372836+0000","last_active":"2024-09-12T01:29:38.372836+0000","last_peered":"2024-09-12T01:29:38.372836+0000","last_clean":"2024-09-12T01:29:38.372836+0000","last_became_active":"2024-09-12T00:31:52.151796+0000","last_became_peered":"2024-09-12T00:31:52.151796+0000","last_unstale":"2024-09-12T01:29:38.372836+0000","last_undegraded":"2024-09-12T01:29:38.372836+0000","last_fullsized":"2024-09-12T01:29:38.372836+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:38.372741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:38.372741+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.372741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:52.582073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"265'318","reported_seq":908,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.066929+0000","last_change":"2024-09-12T01:29:49.066860+0000","last_active":"2024-09-12T01:29:49.066929+0000","last_peered":"2024-09-12T01:29:49.066929+0000","last_clean":"2024-09-12T01:29:49.066929+0000","last_became_active":"2024-09-12T00:31:54.170965+0000","last_became_peered":"2024-09-12T00:31:54.170965+0000","last_unstale":"2024-09-12T01:29:49.066929+0000","last_undegraded":"2024-09-12T01:29:49.066929+0000","last_fullsized":"2024-09-12T01:29:49.066929+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'318","last_scrub_stamp":"2024-09-12T01:29:49.066754+0000","last_deep_scrub":"265'318","last_deep_scrub_stamp":"2024-09-12T01:29:49.066754+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.066754+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:17.398545+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46556,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":509,"num_read_kb":1155,"num_write":420,"num_write_kb":319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":508,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.649765+0000","last_change":"2024-09-12T01:29:43.649713+0000","last_active":"2024-09-12T01:29:43.649765+0000","last_peered":"2024-09-12T01:29:43.649765+0000","last_clean":"2024-09-12T01:29:43.649765+0000","last_became_active":"2024-09-12T00:31:56.172337+0000","last_became_peered":"2024-09-12T00:31:56.172337+0000","last_unstale":"2024-09-12T01:29:43.649765+0000","last_undegraded":"2024-09-12T01:29:43.649765+0000","last_fullsized":"2024-09-12T01:29:43.649765+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:43.649625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:43.649625+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.649625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:50.361632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"265'137","reported_seq":638,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:00.397032+0000","last_change":"2024-09-12T01:30:00.396970+0000","last_active":"2024-09-12T01:30:00.397032+0000","last_peered":"2024-09-12T01:30:00.397032+0000","last_clean":"2024-09-12T01:30:00.397032+0000","last_became_active":"2024-09-12T00:31:58.178565+0000","last_became_peered":"2024-09-12T00:31:58.178565+0000","last_unstale":"2024-09-12T01:30:00.397032+0000","last_undegraded":"2024-09-12T01:30:00.397032+0000","last_fullsized":"2024-09-12T01:30:00.397032+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'137","last_scrub_stamp":"2024-09-12T01:30:00.396864+0000","last_deep_scrub":"265'137","last_deep_scrub_stamp":"2024-09-12T01:30:00.396864+0000","last_clean_scrub_stamp":"2024-09-12T01:30:00.396864+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:17.471233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":122,"num_read_kb":119,"num_write":335,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"265'510","reported_seq":1287,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.608617+0000","last_change":"2024-09-12T01:29:32.608617+0000","last_active":"2024-09-12T01:29:32.608617+0000","last_peered":"2024-09-12T01:29:32.608617+0000","last_clean":"2024-09-12T01:29:32.608617+0000","last_became_active":"2024-09-12T00:31:50.137671+0000","last_became_peered":"2024-09-12T00:31:50.137671+0000","last_unstale":"2024-09-12T01:29:32.608617+0000","last_undegraded":"2024-09-12T01:29:32.608617+0000","last_fullsized":"2024-09-12T01:29:32.608617+0000","mapping_epoch":27,"log_start":"265'400","ondisk_log_start":"265'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'510","last_scrub_stamp":"2024-09-12T01:29:32.608525+0000","last_deep_scrub":"265'510","last_deep_scrub_stamp":"2024-09-12T01:29:32.608525+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.608525+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:22.202787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2432,"num_read_kb":2072,"num_write":871,"num_write_kb":555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"265'466","reported_seq":1282,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.608766+0000","last_change":"2024-09-12T01:29:27.608766+0000","last_active":"2024-09-12T01:29:27.608766+0000","last_peered":"2024-09-12T01:29:27.608766+0000","last_clean":"2024-09-12T01:29:27.608766+0000","last_became_active":"2024-09-12T00:31:47.130035+0000","last_became_peered":"2024-09-12T00:31:47.130035+0000","last_unstale":"2024-09-12T01:29:27.608766+0000","last_undegraded":"2024-09-12T01:29:27.608766+0000","last_fullsized":"2024-09-12T01:29:27.608766+0000","mapping_epoch":24,"log_start":"265'400","ondisk_log_start":"265'400","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'466","last_scrub_stamp":"2024-09-12T01:29:27.608666+0000","last_deep_scrub":"265'466","last_deep_scrub_stamp":"2024-09-12T01:29:27.608666+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.608666+0000","objects_scrubbed":4,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:56.750595+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1077,"num_read_kb":24732,"num_write":1307,"num_write_kb":48327,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":510,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.580564+0000","last_change":"2024-09-12T01:29:43.580564+0000","last_active":"2024-09-12T01:29:43.580564+0000","last_peered":"2024-09-12T01:29:43.580564+0000","last_clean":"2024-09-12T01:29:43.580564+0000","last_became_active":"2024-09-12T00:31:52.155279+0000","last_became_peered":"2024-09-12T00:31:52.155279+0000","last_unstale":"2024-09-12T01:29:43.580564+0000","last_undegraded":"2024-09-12T01:29:43.580564+0000","last_fullsized":"2024-09-12T01:29:43.580564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:43.580473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:43.580473+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.580473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:44.144061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"265'121","reported_seq":663,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:56.338024+0000","last_change":"2024-09-12T01:29:56.337967+0000","last_active":"2024-09-12T01:29:56.338024+0000","last_peered":"2024-09-12T01:29:56.338024+0000","last_clean":"2024-09-12T01:29:56.338024+0000","last_became_active":"2024-09-12T00:31:54.165779+0000","last_became_peered":"2024-09-12T00:31:54.165779+0000","last_unstale":"2024-09-12T01:29:56.338024+0000","last_undegraded":"2024-09-12T01:29:56.338024+0000","last_fullsized":"2024-09-12T01:29:56.338024+0000","mapping_epoch":31,"log_start":"265'100","ondisk_log_start":"265'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'121","last_scrub_stamp":"2024-09-12T01:29:56.337858+0000","last_deep_scrub":"265'121","last_deep_scrub_stamp":"2024-09-12T01:29:56.337858+0000","last_clean_scrub_stamp":"2024-09-12T01:29:56.337858+0000","objects_scrubbed":8,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:59.195945+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":147,"num_read_kb":137,"num_write":154,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"265'763","reported_seq":2348,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:42.140572+0000","last_change":"2024-09-12T01:29:42.140488+0000","last_active":"2024-09-12T01:29:42.140572+0000","last_peered":"2024-09-12T01:29:42.140572+0000","last_clean":"2024-09-12T01:29:42.140572+0000","last_became_active":"2024-09-12T00:31:56.172551+0000","last_became_peered":"2024-09-12T00:31:56.172551+0000","last_unstale":"2024-09-12T01:29:42.140572+0000","last_undegraded":"2024-09-12T01:29:42.140572+0000","last_fullsized":"2024-09-12T01:29:42.140572+0000","mapping_epoch":33,"log_start":"265'700","ondisk_log_start":"265'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'763","last_scrub_stamp":"2024-09-12T01:29:42.140404+0000","last_deep_scrub":"265'763","last_deep_scrub_stamp":"2024-09-12T01:29:42.140404+0000","last_clean_scrub_stamp":"2024-09-12T01:29:42.140404+0000","objects_scrubbed":1,"log_size":63,"log_dups_size":700,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:02.458026+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"265'122","reported_seq":625,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:59.358300+0000","last_change":"2024-09-12T01:29:59.358220+0000","last_active":"2024-09-12T01:29:59.358300+0000","last_peered":"2024-09-12T01:29:59.358300+0000","last_clean":"2024-09-12T01:29:59.358300+0000","last_became_active":"2024-09-12T00:31:58.178671+0000","last_became_peered":"2024-09-12T00:31:58.178671+0000","last_unstale":"2024-09-12T01:29:59.358300+0000","last_undegraded":"2024-09-12T01:29:59.358300+0000","last_fullsized":"2024-09-12T01:29:59.358300+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'122","last_scrub_stamp":"2024-09-12T01:29:59.358135+0000","last_deep_scrub":"265'122","last_deep_scrub_stamp":"2024-09-12T01:29:59.358135+0000","last_clean_scrub_stamp":"2024-09-12T01:29:59.358135+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:08:49.917414+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":105,"num_read_kb":105,"num_write":292,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"265'144","reported_seq":792,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.413643+0000","last_change":"2024-09-12T01:29:36.413643+0000","last_active":"2024-09-12T01:29:36.413643+0000","last_peered":"2024-09-12T01:29:36.413643+0000","last_clean":"2024-09-12T01:29:36.413643+0000","last_became_active":"2024-09-12T00:31:50.143377+0000","last_became_peered":"2024-09-12T00:31:50.143377+0000","last_unstale":"2024-09-12T01:29:36.413643+0000","last_undegraded":"2024-09-12T01:29:36.413643+0000","last_fullsized":"2024-09-12T01:29:36.413643+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:29:36.413557+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:29:36.413557+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.413557+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:23.640462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":664,"num_read_kb":566,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"265'384","reported_seq":1109,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:22.374852+0000","last_change":"2024-09-12T01:29:22.374852+0000","last_active":"2024-09-12T01:29:22.374852+0000","last_peered":"2024-09-12T01:29:22.374852+0000","last_clean":"2024-09-12T01:29:22.374852+0000","last_became_active":"2024-09-12T00:31:47.128555+0000","last_became_peered":"2024-09-12T00:31:47.128555+0000","last_unstale":"2024-09-12T01:29:22.374852+0000","last_undegraded":"2024-09-12T01:29:22.374852+0000","last_fullsized":"2024-09-12T01:29:22.374852+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-12T01:29:22.374771+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-12T01:29:22.374771+0000","last_clean_scrub_stamp":"2024-09-12T01:29:22.374771+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:28.766984+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2058190,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":740,"num_read_kb":10967,"num_write":1262,"num_write_kb":23618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":505,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.443104+0000","last_change":"2024-09-12T01:29:35.443104+0000","last_active":"2024-09-12T01:29:35.443104+0000","last_peered":"2024-09-12T01:29:35.443104+0000","last_clean":"2024-09-12T01:29:35.443104+0000","last_became_active":"2024-09-12T00:31:52.150825+0000","last_became_peered":"2024-09-12T00:31:52.150825+0000","last_unstale":"2024-09-12T01:29:35.443104+0000","last_undegraded":"2024-09-12T01:29:35.443104+0000","last_fullsized":"2024-09-12T01:29:35.443104+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:35.443014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:35.443014+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.443014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:07.660789+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"265'354","reported_seq":975,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:43.144962+0000","last_change":"2024-09-12T01:29:43.144886+0000","last_active":"2024-09-12T01:29:43.144962+0000","last_peered":"2024-09-12T01:29:43.144962+0000","last_clean":"2024-09-12T01:29:43.144962+0000","last_became_active":"2024-09-12T00:31:54.169308+0000","last_became_peered":"2024-09-12T00:31:54.169308+0000","last_unstale":"2024-09-12T01:29:43.144962+0000","last_undegraded":"2024-09-12T01:29:43.144962+0000","last_fullsized":"2024-09-12T01:29:43.144962+0000","mapping_epoch":31,"log_start":"265'300","ondisk_log_start":"265'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T01:29:43.144787+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T01:29:43.144787+0000","last_clean_scrub_stamp":"2024-09-12T01:29:43.144787+0000","objects_scrubbed":11,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:53.988315+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45185,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":558,"num_read_kb":1163,"num_write":446,"num_write_kb":307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":503,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.607601+0000","last_change":"2024-09-12T01:29:54.607513+0000","last_active":"2024-09-12T01:29:54.607601+0000","last_peered":"2024-09-12T01:29:54.607601+0000","last_clean":"2024-09-12T01:29:54.607601+0000","last_became_active":"2024-09-12T00:31:56.173389+0000","last_became_peered":"2024-09-12T00:31:56.173389+0000","last_unstale":"2024-09-12T01:29:54.607601+0000","last_undegraded":"2024-09-12T01:29:54.607601+0000","last_fullsized":"2024-09-12T01:29:54.607601+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:54.607389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:54.607389+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.607389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:08.775718+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"265'144","reported_seq":652,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.745357+0000","last_change":"2024-09-12T01:29:49.745293+0000","last_active":"2024-09-12T01:29:49.745357+0000","last_peered":"2024-09-12T01:29:49.745357+0000","last_clean":"2024-09-12T01:29:49.745357+0000","last_became_active":"2024-09-12T00:31:58.183017+0000","last_became_peered":"2024-09-12T00:31:58.183017+0000","last_unstale":"2024-09-12T01:29:49.745357+0000","last_undegraded":"2024-09-12T01:29:49.745357+0000","last_fullsized":"2024-09-12T01:29:49.745357+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'144","last_scrub_stamp":"2024-09-12T01:29:49.745191+0000","last_deep_scrub":"265'144","last_deep_scrub_stamp":"2024-09-12T01:29:49.745191+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.745191+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:41:32.589811+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":137,"num_read_kb":129,"num_write":333,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"265'130","reported_seq":749,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.356057+0000","last_change":"2024-09-12T01:29:30.356057+0000","last_active":"2024-09-12T01:29:30.356057+0000","last_peered":"2024-09-12T01:29:30.356057+0000","last_clean":"2024-09-12T01:29:30.356057+0000","last_became_active":"2024-09-12T00:31:50.136941+0000","last_became_peered":"2024-09-12T00:31:50.136941+0000","last_unstale":"2024-09-12T01:29:30.356057+0000","last_undegraded":"2024-09-12T01:29:30.356057+0000","last_fullsized":"2024-09-12T01:29:30.356057+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T01:29:30.355971+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T01:29:30.355971+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.355971+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:08.036712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":653,"num_read_kb":587,"num_write":190,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2874,"num_omap_keys":12,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"265'341","reported_seq":995,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.019642+0000","last_change":"2024-09-12T01:29:31.019642+0000","last_active":"2024-09-12T01:29:31.019642+0000","last_peered":"2024-09-12T01:29:31.019642+0000","last_clean":"2024-09-12T01:29:31.019642+0000","last_became_active":"2024-09-12T00:31:47.131600+0000","last_became_peered":"2024-09-12T00:31:47.131600+0000","last_unstale":"2024-09-12T01:29:31.019642+0000","last_undegraded":"2024-09-12T01:29:31.019642+0000","last_fullsized":"2024-09-12T01:29:31.019642+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'341","last_scrub_stamp":"2024-09-12T01:29:31.019510+0000","last_deep_scrub":"265'341","last_deep_scrub_stamp":"2024-09-12T01:29:31.019510+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.019510+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:11.532544+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":495,"num_read_kb":43314,"num_write":1098,"num_write_kb":38822,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.385826+0000","last_change":"2024-09-12T01:29:37.385826+0000","last_active":"2024-09-12T01:29:37.385826+0000","last_peered":"2024-09-12T01:29:37.385826+0000","last_clean":"2024-09-12T01:29:37.385826+0000","last_became_active":"2024-09-12T00:31:52.152537+0000","last_became_peered":"2024-09-12T00:31:52.152537+0000","last_unstale":"2024-09-12T01:29:37.385826+0000","last_undegraded":"2024-09-12T01:29:37.385826+0000","last_fullsized":"2024-09-12T01:29:37.385826+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:37.385738+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:37.385738+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.385738+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:37.788544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"265'286","reported_seq":878,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:49.549981+0000","last_change":"2024-09-12T01:29:49.549887+0000","last_active":"2024-09-12T01:29:49.549981+0000","last_peered":"2024-09-12T01:29:49.549981+0000","last_clean":"2024-09-12T01:29:49.549981+0000","last_became_active":"2024-09-12T00:31:54.163977+0000","last_became_peered":"2024-09-12T00:31:54.163977+0000","last_unstale":"2024-09-12T01:29:49.549981+0000","last_undegraded":"2024-09-12T01:29:49.549981+0000","last_fullsized":"2024-09-12T01:29:49.549981+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'286","last_scrub_stamp":"2024-09-12T01:29:49.549783+0000","last_deep_scrub":"265'286","last_deep_scrub_stamp":"2024-09-12T01:29:49.549783+0000","last_clean_scrub_stamp":"2024-09-12T01:29:49.549783+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:07.473520+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44628,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":453,"num_read_kb":1027,"num_write":368,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":497,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:03.371847+0000","last_change":"2024-09-12T01:30:03.371764+0000","last_active":"2024-09-12T01:30:03.371847+0000","last_peered":"2024-09-12T01:30:03.371847+0000","last_clean":"2024-09-12T01:30:03.371847+0000","last_became_active":"2024-09-12T00:31:56.171306+0000","last_became_peered":"2024-09-12T00:31:56.171306+0000","last_unstale":"2024-09-12T01:30:03.371847+0000","last_undegraded":"2024-09-12T01:30:03.371847+0000","last_fullsized":"2024-09-12T01:30:03.371847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:03.371667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:03.371667+0000","last_clean_scrub_stamp":"2024-09-12T01:30:03.371667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:16:29.034851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"265'126","reported_seq":668,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:58.744913+0000","last_change":"2024-09-12T01:29:58.744913+0000","last_active":"2024-09-12T01:29:58.744913+0000","last_peered":"2024-09-12T01:29:58.744913+0000","last_clean":"2024-09-12T01:29:58.744913+0000","last_became_active":"2024-09-12T00:31:58.182701+0000","last_became_peered":"2024-09-12T00:31:58.182701+0000","last_unstale":"2024-09-12T01:29:58.744913+0000","last_undegraded":"2024-09-12T01:29:58.744913+0000","last_fullsized":"2024-09-12T01:29:58.744913+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'126","last_scrub_stamp":"2024-09-12T01:29:58.744818+0000","last_deep_scrub":"265'126","last_deep_scrub_stamp":"2024-09-12T01:29:58.744818+0000","last_clean_scrub_stamp":"2024-09-12T01:29:58.744818+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:25:22.475637+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":555,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":215,"num_write":311,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"265'42","reported_seq":611,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.563464+0000","last_change":"2024-09-12T01:29:28.563386+0000","last_active":"2024-09-12T01:29:28.563464+0000","last_peered":"2024-09-12T01:29:28.563464+0000","last_clean":"2024-09-12T01:29:28.563464+0000","last_became_active":"2024-09-12T00:31:50.136971+0000","last_became_peered":"2024-09-12T00:31:50.136971+0000","last_unstale":"2024-09-12T01:29:28.563464+0000","last_undegraded":"2024-09-12T01:29:28.563464+0000","last_fullsized":"2024-09-12T01:29:28.563464+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'42","last_scrub_stamp":"2024-09-12T01:29:28.563295+0000","last_deep_scrub":"265'42","last_deep_scrub_stamp":"2024-09-12T01:29:28.563295+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.563295+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:05.396239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":180,"num_write":56,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"265'353","reported_seq":1023,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.835972+0000","last_change":"2024-09-12T01:29:26.835870+0000","last_active":"2024-09-12T01:29:26.835972+0000","last_peered":"2024-09-12T01:29:26.835972+0000","last_clean":"2024-09-12T01:29:26.835972+0000","last_became_active":"2024-09-12T00:31:47.123001+0000","last_became_peered":"2024-09-12T00:31:47.123001+0000","last_unstale":"2024-09-12T01:29:26.835972+0000","last_undegraded":"2024-09-12T01:29:26.835972+0000","last_fullsized":"2024-09-12T01:29:26.835972+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'353","last_scrub_stamp":"2024-09-12T01:29:26.835750+0000","last_deep_scrub":"265'353","last_deep_scrub_stamp":"2024-09-12T01:29:26.835750+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.835750+0000","objects_scrubbed":3,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:58.085367+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3599074,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":516,"num_read_kb":39607,"num_write":1095,"num_write_kb":26742,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":506,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:39.541936+0000","last_change":"2024-09-12T01:29:39.541811+0000","last_active":"2024-09-12T01:29:39.541936+0000","last_peered":"2024-09-12T01:29:39.541936+0000","last_clean":"2024-09-12T01:29:39.541936+0000","last_became_active":"2024-09-12T00:31:52.150969+0000","last_became_peered":"2024-09-12T00:31:52.150969+0000","last_unstale":"2024-09-12T01:29:39.541936+0000","last_undegraded":"2024-09-12T01:29:39.541936+0000","last_fullsized":"2024-09-12T01:29:39.541936+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:39.541714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:39.541714+0000","last_clean_scrub_stamp":"2024-09-12T01:29:39.541714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:07.919979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"265'260","reported_seq":827,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:47.010775+0000","last_change":"2024-09-12T01:29:47.010775+0000","last_active":"2024-09-12T01:29:47.010775+0000","last_peered":"2024-09-12T01:29:47.010775+0000","last_clean":"2024-09-12T01:29:47.010775+0000","last_became_active":"2024-09-12T00:31:54.169845+0000","last_became_peered":"2024-09-12T00:31:54.169845+0000","last_unstale":"2024-09-12T01:29:47.010775+0000","last_undegraded":"2024-09-12T01:29:47.010775+0000","last_fullsized":"2024-09-12T01:29:47.010775+0000","mapping_epoch":31,"log_start":"265'200","ondisk_log_start":"265'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'260","last_scrub_stamp":"2024-09-12T01:29:47.010669+0000","last_deep_scrub":"265'260","last_deep_scrub_stamp":"2024-09-12T01:29:47.010669+0000","last_clean_scrub_stamp":"2024-09-12T01:29:47.010669+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:32.763474+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47509,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":435,"num_read_kb":1050,"num_write":360,"num_write_kb":302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":496,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:04.322272+0000","last_change":"2024-09-12T01:30:04.322272+0000","last_active":"2024-09-12T01:30:04.322272+0000","last_peered":"2024-09-12T01:30:04.322272+0000","last_clean":"2024-09-12T01:30:04.322272+0000","last_became_active":"2024-09-12T00:31:56.170767+0000","last_became_peered":"2024-09-12T00:31:56.170767+0000","last_unstale":"2024-09-12T01:30:04.322272+0000","last_undegraded":"2024-09-12T01:30:04.322272+0000","last_fullsized":"2024-09-12T01:30:04.322272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:30:04.322189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:30:04.322189+0000","last_clean_scrub_stamp":"2024-09-12T01:30:04.322189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:35:42.797351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"265'187","reported_seq":1665,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:30:06.328740+0000","last_change":"2024-09-12T01:30:06.328740+0000","last_active":"2024-09-12T01:30:06.328740+0000","last_peered":"2024-09-12T01:30:06.328740+0000","last_clean":"2024-09-12T01:30:06.328740+0000","last_became_active":"2024-09-12T00:31:58.173049+0000","last_became_peered":"2024-09-12T00:31:58.173049+0000","last_unstale":"2024-09-12T01:30:06.328740+0000","last_undegraded":"2024-09-12T01:30:06.328740+0000","last_fullsized":"2024-09-12T01:30:06.328740+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'187","last_scrub_stamp":"2024-09-12T01:30:06.328648+0000","last_deep_scrub":"265'187","last_deep_scrub_stamp":"2024-09-12T01:30:06.328648+0000","last_clean_scrub_stamp":"2024-09-12T01:30:06.328648+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:29.518927+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1227,"num_read_kb":1215,"num_write":440,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"265'221","reported_seq":795,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.367746+0000","last_change":"2024-09-12T01:29:29.367671+0000","last_active":"2024-09-12T01:29:29.367746+0000","last_peered":"2024-09-12T01:29:29.367746+0000","last_clean":"2024-09-12T01:29:29.367746+0000","last_became_active":"2024-09-12T00:31:50.141009+0000","last_became_peered":"2024-09-12T00:31:50.141009+0000","last_unstale":"2024-09-12T01:29:29.367746+0000","last_undegraded":"2024-09-12T01:29:29.367746+0000","last_fullsized":"2024-09-12T01:29:29.367746+0000","mapping_epoch":27,"log_start":"262'200","ondisk_log_start":"262'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'221","last_scrub_stamp":"2024-09-12T01:29:29.367587+0000","last_deep_scrub":"265'221","last_deep_scrub_stamp":"2024-09-12T01:29:29.367587+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.367587+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:50.790988+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":914,"num_read_kb":727,"num_write":339,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":685,"num_omap_keys":3,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"265'391","reported_seq":1075,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.837768+0000","last_change":"2024-09-12T01:29:27.837675+0000","last_active":"2024-09-12T01:29:27.837768+0000","last_peered":"2024-09-12T01:29:27.837768+0000","last_clean":"2024-09-12T01:29:27.837768+0000","last_became_active":"2024-09-12T00:31:47.118434+0000","last_became_peered":"2024-09-12T00:31:47.118434+0000","last_unstale":"2024-09-12T01:29:27.837768+0000","last_undegraded":"2024-09-12T01:29:27.837768+0000","last_fullsized":"2024-09-12T01:29:27.837768+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'391","last_scrub_stamp":"2024-09-12T01:29:27.837556+0000","last_deep_scrub":"265'391","last_deep_scrub_stamp":"2024-09-12T01:29:27.837556+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.837556+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:32.423783+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":619,"num_read_kb":10821,"num_write":1247,"num_write_kb":40782,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"265'2","reported_seq":513,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:46.534992+0000","last_change":"2024-09-12T01:29:46.534898+0000","last_active":"2024-09-12T01:29:46.534992+0000","last_peered":"2024-09-12T01:29:46.534992+0000","last_clean":"2024-09-12T01:29:46.534992+0000","last_became_active":"2024-09-12T00:31:52.148440+0000","last_became_peered":"2024-09-12T00:31:52.148440+0000","last_unstale":"2024-09-12T01:29:46.534992+0000","last_undegraded":"2024-09-12T01:29:46.534992+0000","last_fullsized":"2024-09-12T01:29:46.534992+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'2","last_scrub_stamp":"2024-09-12T01:29:46.534791+0000","last_deep_scrub":"265'2","last_deep_scrub_stamp":"2024-09-12T01:29:46.534791+0000","last_clean_scrub_stamp":"2024-09-12T01:29:46.534791+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:10.156227+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"265'316","reported_seq":923,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:54.327220+0000","last_change":"2024-09-12T01:29:54.327220+0000","last_active":"2024-09-12T01:29:54.327220+0000","last_peered":"2024-09-12T01:29:54.327220+0000","last_clean":"2024-09-12T01:29:54.327220+0000","last_became_active":"2024-09-12T00:31:54.167915+0000","last_became_peered":"2024-09-12T00:31:54.167915+0000","last_unstale":"2024-09-12T01:29:54.327220+0000","last_undegraded":"2024-09-12T01:29:54.327220+0000","last_fullsized":"2024-09-12T01:29:54.327220+0000","mapping_epoch":31,"log_start":"265'301","ondisk_log_start":"265'301","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'316","last_scrub_stamp":"2024-09-12T01:29:54.327116+0000","last_deep_scrub":"265'316","last_deep_scrub_stamp":"2024-09-12T01:29:54.327116+0000","last_clean_scrub_stamp":"2024-09-12T01:29:54.327116+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":301,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:05.693386+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44378,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":513,"num_read_kb":1106,"num_write":406,"num_write_kb":294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":502,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:55.618555+0000","last_change":"2024-09-12T01:29:55.618555+0000","last_active":"2024-09-12T01:29:55.618555+0000","last_peered":"2024-09-12T01:29:55.618555+0000","last_clean":"2024-09-12T01:29:55.618555+0000","last_became_active":"2024-09-12T00:31:56.171654+0000","last_became_peered":"2024-09-12T00:31:56.171654+0000","last_unstale":"2024-09-12T01:29:55.618555+0000","last_undegraded":"2024-09-12T01:29:55.618555+0000","last_fullsized":"2024-09-12T01:29:55.618555+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:29:55.618473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:29:55.618473+0000","last_clean_scrub_stamp":"2024-09-12T01:29:55.618473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:26.288689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"265'132","reported_seq":648,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:45.138653+0000","last_change":"2024-09-12T01:29:45.138574+0000","last_active":"2024-09-12T01:29:45.138653+0000","last_peered":"2024-09-12T01:29:45.138653+0000","last_clean":"2024-09-12T01:29:45.138653+0000","last_became_active":"2024-09-12T00:31:58.181864+0000","last_became_peered":"2024-09-12T00:31:58.181864+0000","last_unstale":"2024-09-12T01:29:45.138653+0000","last_undegraded":"2024-09-12T01:29:45.138653+0000","last_fullsized":"2024-09-12T01:29:45.138653+0000","mapping_epoch":35,"log_start":"265'100","ondisk_log_start":"265'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'132","last_scrub_stamp":"2024-09-12T01:29:45.138476+0000","last_deep_scrub":"265'132","last_deep_scrub_stamp":"2024-09-12T01:29:45.138476+0000","last_clean_scrub_stamp":"2024-09-12T01:29:45.138476+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:08.900435+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":198,"num_read_kb":169,"num_write":329,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"265'138","reported_seq":719,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.569465+0000","last_change":"2024-09-12T01:29:34.569403+0000","last_active":"2024-09-12T01:29:34.569465+0000","last_peered":"2024-09-12T01:29:34.569465+0000","last_clean":"2024-09-12T01:29:34.569465+0000","last_became_active":"2024-09-12T00:31:50.123862+0000","last_became_peered":"2024-09-12T00:31:50.123862+0000","last_unstale":"2024-09-12T01:29:34.569465+0000","last_undegraded":"2024-09-12T01:29:34.569465+0000","last_fullsized":"2024-09-12T01:29:34.569465+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'138","last_scrub_stamp":"2024-09-12T01:29:34.569319+0000","last_deep_scrub":"265'138","last_deep_scrub_stamp":"2024-09-12T01:29:34.569319+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.569319+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:51:39.432572+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":581,"num_read_kb":471,"num_write":227,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"265'354","reported_seq":985,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.369834+0000","last_change":"2024-09-12T01:29:23.369781+0000","last_active":"2024-09-12T01:29:23.369834+0000","last_peered":"2024-09-12T01:29:23.369834+0000","last_clean":"2024-09-12T01:29:23.369834+0000","last_became_active":"2024-09-12T00:31:47.132236+0000","last_became_peered":"2024-09-12T00:31:47.132236+0000","last_unstale":"2024-09-12T01:29:23.369834+0000","last_undegraded":"2024-09-12T01:29:23.369834+0000","last_fullsized":"2024-09-12T01:29:23.369834+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T01:29:23.369652+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T01:29:23.369652+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.369652+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:39:57.694085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133653,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":457,"num_read_kb":4332,"num_write":1030,"num_write_kb":17381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"265'142","reported_seq":739,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.563366+0000","last_change":"2024-09-12T01:29:31.563292+0000","last_active":"2024-09-12T01:29:31.563366+0000","last_peered":"2024-09-12T01:29:31.563366+0000","last_clean":"2024-09-12T01:29:31.563366+0000","last_became_active":"2024-09-12T00:31:50.140649+0000","last_became_peered":"2024-09-12T00:31:50.140649+0000","last_unstale":"2024-09-12T01:29:31.563366+0000","last_undegraded":"2024-09-12T01:29:31.563366+0000","last_fullsized":"2024-09-12T01:29:31.563366+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'142","last_scrub_stamp":"2024-09-12T01:29:31.563200+0000","last_deep_scrub":"265'142","last_deep_scrub_stamp":"2024-09-12T01:29:31.563200+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.563200+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:34.599331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":475,"num_write":199,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"265'326","reported_seq":963,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.578792+0000","last_change":"2024-09-12T01:29:25.578704+0000","last_active":"2024-09-12T01:29:25.578792+0000","last_peered":"2024-09-12T01:29:25.578792+0000","last_clean":"2024-09-12T01:29:25.578792+0000","last_became_active":"2024-09-12T00:31:47.126093+0000","last_became_peered":"2024-09-12T00:31:47.126093+0000","last_unstale":"2024-09-12T01:29:25.578792+0000","last_undegraded":"2024-09-12T01:29:25.578792+0000","last_fullsized":"2024-09-12T01:29:25.578792+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'326","last_scrub_stamp":"2024-09-12T01:29:25.578576+0000","last_deep_scrub":"265'326","last_deep_scrub_stamp":"2024-09-12T01:29:25.578576+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.578576+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:19:43.122572+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":454,"num_read_kb":13702,"num_write":989,"num_write_kb":29796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"265'259","reported_seq":941,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.179020+0000","last_change":"2024-09-12T01:29:41.178955+0000","last_active":"2024-09-12T01:29:41.179020+0000","last_peered":"2024-09-12T01:29:41.179020+0000","last_clean":"2024-09-12T01:29:41.179020+0000","last_became_active":"2024-09-12T00:31:50.132976+0000","last_became_peered":"2024-09-12T00:31:50.132976+0000","last_unstale":"2024-09-12T01:29:41.179020+0000","last_undegraded":"2024-09-12T01:29:41.179020+0000","last_fullsized":"2024-09-12T01:29:41.179020+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'259","last_scrub_stamp":"2024-09-12T01:29:41.178857+0000","last_deep_scrub":"265'259","last_deep_scrub_stamp":"2024-09-12T01:29:41.178857+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.178857+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:57.345693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1108,"num_read_kb":908,"num_write":394,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"265'354","reported_seq":1056,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.086786+0000","last_change":"2024-09-12T01:29:33.086724+0000","last_active":"2024-09-12T01:29:33.086786+0000","last_peered":"2024-09-12T01:29:33.086786+0000","last_clean":"2024-09-12T01:29:33.086786+0000","last_became_active":"2024-09-12T00:31:47.117000+0000","last_became_peered":"2024-09-12T00:31:47.117000+0000","last_unstale":"2024-09-12T01:29:33.086786+0000","last_undegraded":"2024-09-12T01:29:33.086786+0000","last_fullsized":"2024-09-12T01:29:33.086786+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'354","last_scrub_stamp":"2024-09-12T01:29:33.086619+0000","last_deep_scrub":"265'354","last_deep_scrub_stamp":"2024-09-12T01:29:33.086619+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.086619+0000","objects_scrubbed":5,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:18.339050+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138894,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":591,"num_read_kb":34967,"num_write":1161,"num_write_kb":18512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"265'188","reported_seq":842,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:36.863880+0000","last_change":"2024-09-12T01:29:36.863803+0000","last_active":"2024-09-12T01:29:36.863880+0000","last_peered":"2024-09-12T01:29:36.863880+0000","last_clean":"2024-09-12T01:29:36.863880+0000","last_became_active":"2024-09-12T00:31:50.133634+0000","last_became_peered":"2024-09-12T00:31:50.133634+0000","last_unstale":"2024-09-12T01:29:36.863880+0000","last_undegraded":"2024-09-12T01:29:36.863880+0000","last_fullsized":"2024-09-12T01:29:36.863880+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'188","last_scrub_stamp":"2024-09-12T01:29:36.863688+0000","last_deep_scrub":"265'188","last_deep_scrub_stamp":"2024-09-12T01:29:36.863688+0000","last_clean_scrub_stamp":"2024-09-12T01:29:36.863688+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:49.117347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":849,"num_read_kb":708,"num_write":275,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"265'366","reported_seq":997,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.883257+0000","last_change":"2024-09-12T01:29:28.883191+0000","last_active":"2024-09-12T01:29:28.883257+0000","last_peered":"2024-09-12T01:29:28.883257+0000","last_clean":"2024-09-12T01:29:28.883257+0000","last_became_active":"2024-09-12T00:31:47.132735+0000","last_became_peered":"2024-09-12T00:31:47.132735+0000","last_unstale":"2024-09-12T01:29:28.883257+0000","last_undegraded":"2024-09-12T01:29:28.883257+0000","last_fullsized":"2024-09-12T01:29:28.883257+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'366","last_scrub_stamp":"2024-09-12T01:29:28.883090+0000","last_deep_scrub":"265'366","last_deep_scrub_stamp":"2024-09-12T01:29:28.883090+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.883090+0000","objects_scrubbed":2,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:56:41.785346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":462,"num_read_kb":13728,"num_write":961,"num_write_kb":25593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"265'130","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.822664+0000","last_change":"2024-09-12T01:29:37.822573+0000","last_active":"2024-09-12T01:29:37.822664+0000","last_peered":"2024-09-12T01:29:37.822664+0000","last_clean":"2024-09-12T01:29:37.822664+0000","last_became_active":"2024-09-12T00:31:50.138349+0000","last_became_peered":"2024-09-12T00:31:50.138349+0000","last_unstale":"2024-09-12T01:29:37.822664+0000","last_undegraded":"2024-09-12T01:29:37.822664+0000","last_fullsized":"2024-09-12T01:29:37.822664+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T01:29:37.822476+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T01:29:37.822476+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.822476+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:17.917278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":634,"num_read_kb":530,"num_write":219,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"265'322","reported_seq":969,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.221598+0000","last_change":"2024-09-12T01:29:26.221519+0000","last_active":"2024-09-12T01:29:26.221598+0000","last_peered":"2024-09-12T01:29:26.221598+0000","last_clean":"2024-09-12T01:29:26.221598+0000","last_became_active":"2024-09-12T00:31:47.132959+0000","last_became_peered":"2024-09-12T00:31:47.132959+0000","last_unstale":"2024-09-12T01:29:26.221598+0000","last_undegraded":"2024-09-12T01:29:26.221598+0000","last_fullsized":"2024-09-12T01:29:26.221598+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'322","last_scrub_stamp":"2024-09-12T01:29:26.221423+0000","last_deep_scrub":"265'322","last_deep_scrub_stamp":"2024-09-12T01:29:26.221423+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.221423+0000","objects_scrubbed":5,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:43.791461+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170196,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":482,"num_read_kb":44221,"num_write":1049,"num_write_kb":17966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"265'150","reported_seq":735,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.124701+0000","last_change":"2024-09-12T01:29:31.124626+0000","last_active":"2024-09-12T01:29:31.124701+0000","last_peered":"2024-09-12T01:29:31.124701+0000","last_clean":"2024-09-12T01:29:31.124701+0000","last_became_active":"2024-09-12T00:31:50.130915+0000","last_became_peered":"2024-09-12T00:31:50.130915+0000","last_unstale":"2024-09-12T01:29:31.124701+0000","last_undegraded":"2024-09-12T01:29:31.124701+0000","last_fullsized":"2024-09-12T01:29:31.124701+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'150","last_scrub_stamp":"2024-09-12T01:29:31.124543+0000","last_deep_scrub":"265'150","last_deep_scrub_stamp":"2024-09-12T01:29:31.124543+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.124543+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:03.395062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":628,"num_read_kb":507,"num_write":231,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"265'336","reported_seq":978,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.142344+0000","last_change":"2024-09-12T01:29:29.142282+0000","last_active":"2024-09-12T01:29:29.142344+0000","last_peered":"2024-09-12T01:29:29.142344+0000","last_clean":"2024-09-12T01:29:29.142344+0000","last_became_active":"2024-09-12T00:31:47.122164+0000","last_became_peered":"2024-09-12T00:31:47.122164+0000","last_unstale":"2024-09-12T01:29:29.142344+0000","last_undegraded":"2024-09-12T01:29:29.142344+0000","last_fullsized":"2024-09-12T01:29:29.142344+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'336","last_scrub_stamp":"2024-09-12T01:29:29.142149+0000","last_deep_scrub":"265'336","last_deep_scrub_stamp":"2024-09-12T01:29:29.142149+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.142149+0000","objects_scrubbed":8,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:51.142516+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170481,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":503,"num_read_kb":2267,"num_write":1137,"num_write_kb":17589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"265'295","reported_seq":947,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:38.116289+0000","last_change":"2024-09-12T01:29:38.116198+0000","last_active":"2024-09-12T01:29:38.116289+0000","last_peered":"2024-09-12T01:29:38.116289+0000","last_clean":"2024-09-12T01:29:38.116289+0000","last_became_active":"2024-09-12T00:31:50.142283+0000","last_became_peered":"2024-09-12T00:31:50.142283+0000","last_unstale":"2024-09-12T01:29:38.116289+0000","last_undegraded":"2024-09-12T01:29:38.116289+0000","last_fullsized":"2024-09-12T01:29:38.116289+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'295","last_scrub_stamp":"2024-09-12T01:29:38.116092+0000","last_deep_scrub":"265'295","last_deep_scrub_stamp":"2024-09-12T01:29:38.116092+0000","last_clean_scrub_stamp":"2024-09-12T01:29:38.116092+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:29.568062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1272,"num_read_kb":1039,"num_write":466,"num_write_kb":253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"265'373","reported_seq":1040,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.379329+0000","last_change":"2024-09-12T01:29:26.379186+0000","last_active":"2024-09-12T01:29:26.379329+0000","last_peered":"2024-09-12T01:29:26.379329+0000","last_clean":"2024-09-12T01:29:26.379329+0000","last_became_active":"2024-09-12T00:31:47.136789+0000","last_became_peered":"2024-09-12T00:31:47.136789+0000","last_unstale":"2024-09-12T01:29:26.379329+0000","last_undegraded":"2024-09-12T01:29:26.379329+0000","last_fullsized":"2024-09-12T01:29:26.379329+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'373","last_scrub_stamp":"2024-09-12T01:29:26.379032+0000","last_deep_scrub":"265'373","last_deep_scrub_stamp":"2024-09-12T01:29:26.379032+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.379032+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:10.288276+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":544,"num_read_kb":49646,"num_write":1113,"num_write_kb":37962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"265'130","reported_seq":757,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:27.439867+0000","last_change":"2024-09-12T01:29:27.439811+0000","last_active":"2024-09-12T01:29:27.439867+0000","last_peered":"2024-09-12T01:29:27.439867+0000","last_clean":"2024-09-12T01:29:27.439867+0000","last_became_active":"2024-09-12T00:31:50.140717+0000","last_became_peered":"2024-09-12T00:31:50.140717+0000","last_unstale":"2024-09-12T01:29:27.439867+0000","last_undegraded":"2024-09-12T01:29:27.439867+0000","last_fullsized":"2024-09-12T01:29:27.439867+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'130","last_scrub_stamp":"2024-09-12T01:29:27.439723+0000","last_deep_scrub":"265'130","last_deep_scrub_stamp":"2024-09-12T01:29:27.439723+0000","last_clean_scrub_stamp":"2024-09-12T01:29:27.439723+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:07.649578+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":623,"num_read_kb":519,"num_write":184,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4002,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"265'384","reported_seq":1050,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.949772+0000","last_change":"2024-09-12T01:29:33.949714+0000","last_active":"2024-09-12T01:29:33.949772+0000","last_peered":"2024-09-12T01:29:33.949772+0000","last_clean":"2024-09-12T01:29:33.949772+0000","last_became_active":"2024-09-12T00:31:47.118928+0000","last_became_peered":"2024-09-12T00:31:47.118928+0000","last_unstale":"2024-09-12T01:29:33.949772+0000","last_undegraded":"2024-09-12T01:29:33.949772+0000","last_fullsized":"2024-09-12T01:29:33.949772+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'384","last_scrub_stamp":"2024-09-12T01:29:33.949597+0000","last_deep_scrub":"265'384","last_deep_scrub_stamp":"2024-09-12T01:29:33.949597+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.949597+0000","objects_scrubbed":9,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:44.543182+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65022,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":549,"num_read_kb":12208,"num_write":1218,"num_write_kb":44971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"265'133","reported_seq":740,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.621422+0000","last_change":"2024-09-12T01:29:33.621360+0000","last_active":"2024-09-12T01:29:33.621422+0000","last_peered":"2024-09-12T01:29:33.621422+0000","last_clean":"2024-09-12T01:29:33.621422+0000","last_became_active":"2024-09-12T00:31:50.137034+0000","last_became_peered":"2024-09-12T00:31:50.137034+0000","last_unstale":"2024-09-12T01:29:33.621422+0000","last_undegraded":"2024-09-12T01:29:33.621422+0000","last_fullsized":"2024-09-12T01:29:33.621422+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'133","last_scrub_stamp":"2024-09-12T01:29:33.621268+0000","last_deep_scrub":"265'133","last_deep_scrub_stamp":"2024-09-12T01:29:33.621268+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.621268+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:32.051275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":574,"num_read_kb":471,"num_write":187,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"265'394","reported_seq":1072,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.042165+0000","last_change":"2024-09-12T01:29:34.042100+0000","last_active":"2024-09-12T01:29:34.042165+0000","last_peered":"2024-09-12T01:29:34.042165+0000","last_clean":"2024-09-12T01:29:34.042165+0000","last_became_active":"2024-09-12T00:31:47.119180+0000","last_became_peered":"2024-09-12T00:31:47.119180+0000","last_unstale":"2024-09-12T01:29:34.042165+0000","last_undegraded":"2024-09-12T01:29:34.042165+0000","last_fullsized":"2024-09-12T01:29:34.042165+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'394","last_scrub_stamp":"2024-09-12T01:29:34.041934+0000","last_deep_scrub":"265'394","last_deep_scrub_stamp":"2024-09-12T01:29:34.041934+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.041934+0000","objects_scrubbed":9,"log_size":94,"log_dups_size":300,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:04.729277+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2793702,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":603,"num_read_kb":71015,"num_write":1325,"num_write_kb":54526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"265'230","reported_seq":886,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:30.091285+0000","last_change":"2024-09-12T01:29:30.091211+0000","last_active":"2024-09-12T01:29:30.091285+0000","last_peered":"2024-09-12T01:29:30.091285+0000","last_clean":"2024-09-12T01:29:30.091285+0000","last_became_active":"2024-09-12T00:31:50.132605+0000","last_became_peered":"2024-09-12T00:31:50.132605+0000","last_unstale":"2024-09-12T01:29:30.091285+0000","last_undegraded":"2024-09-12T01:29:30.091285+0000","last_fullsized":"2024-09-12T01:29:30.091285+0000","mapping_epoch":27,"log_start":"265'200","ondisk_log_start":"265'200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'230","last_scrub_stamp":"2024-09-12T01:29:30.091128+0000","last_deep_scrub":"265'230","last_deep_scrub_stamp":"2024-09-12T01:29:30.091128+0000","last_clean_scrub_stamp":"2024-09-12T01:29:30.091128+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:44.530559+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":781,"num_write":348,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"265'337","reported_seq":1007,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.914567+0000","last_change":"2024-09-12T01:29:29.914501+0000","last_active":"2024-09-12T01:29:29.914567+0000","last_peered":"2024-09-12T01:29:29.914567+0000","last_clean":"2024-09-12T01:29:29.914567+0000","last_became_active":"2024-09-12T00:31:47.131895+0000","last_became_peered":"2024-09-12T00:31:47.131895+0000","last_unstale":"2024-09-12T01:29:29.914567+0000","last_undegraded":"2024-09-12T01:29:29.914567+0000","last_fullsized":"2024-09-12T01:29:29.914567+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'337","last_scrub_stamp":"2024-09-12T01:29:29.914360+0000","last_deep_scrub":"265'337","last_deep_scrub_stamp":"2024-09-12T01:29:29.914360+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.914360+0000","objects_scrubbed":9,"log_size":37,"log_dups_size":300,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:13.576149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":191,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":553,"num_read_kb":1443,"num_write":1105,"num_write_kb":20830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"265'184","reported_seq":823,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:41.728716+0000","last_change":"2024-09-12T01:29:41.728660+0000","last_active":"2024-09-12T01:29:41.728716+0000","last_peered":"2024-09-12T01:29:41.728716+0000","last_clean":"2024-09-12T01:29:41.728716+0000","last_became_active":"2024-09-12T00:31:50.138649+0000","last_became_peered":"2024-09-12T00:31:50.138649+0000","last_unstale":"2024-09-12T01:29:41.728716+0000","last_undegraded":"2024-09-12T01:29:41.728716+0000","last_fullsized":"2024-09-12T01:29:41.728716+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'184","last_scrub_stamp":"2024-09-12T01:29:41.728559+0000","last_deep_scrub":"265'184","last_deep_scrub_stamp":"2024-09-12T01:29:41.728559+0000","last_clean_scrub_stamp":"2024-09-12T01:29:41.728559+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:39.497379+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":823,"num_read_kb":682,"num_write":292,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"265'312","reported_seq":948,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:25.381906+0000","last_change":"2024-09-12T01:29:25.381837+0000","last_active":"2024-09-12T01:29:25.381906+0000","last_peered":"2024-09-12T01:29:25.381906+0000","last_clean":"2024-09-12T01:29:25.381906+0000","last_became_active":"2024-09-12T00:31:47.128598+0000","last_became_peered":"2024-09-12T00:31:47.128598+0000","last_unstale":"2024-09-12T01:29:25.381906+0000","last_undegraded":"2024-09-12T01:29:25.381906+0000","last_fullsized":"2024-09-12T01:29:25.381906+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'312","last_scrub_stamp":"2024-09-12T01:29:25.381685+0000","last_deep_scrub":"265'312","last_deep_scrub_stamp":"2024-09-12T01:29:25.381685+0000","last_clean_scrub_stamp":"2024-09-12T01:29:25.381685+0000","objects_scrubbed":7,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:02.770818+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37912,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":412,"num_read_kb":69389,"num_write":1027,"num_write_kb":38689,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"265'98","reported_seq":675,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:29.493501+0000","last_change":"2024-09-12T01:29:29.493434+0000","last_active":"2024-09-12T01:29:29.493501+0000","last_peered":"2024-09-12T01:29:29.493501+0000","last_clean":"2024-09-12T01:29:29.493501+0000","last_became_active":"2024-09-12T00:31:50.139830+0000","last_became_peered":"2024-09-12T00:31:50.139830+0000","last_unstale":"2024-09-12T01:29:29.493501+0000","last_undegraded":"2024-09-12T01:29:29.493501+0000","last_fullsized":"2024-09-12T01:29:29.493501+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'98","last_scrub_stamp":"2024-09-12T01:29:29.493346+0000","last_deep_scrub":"265'98","last_deep_scrub_stamp":"2024-09-12T01:29:29.493346+0000","last_clean_scrub_stamp":"2024-09-12T01:29:29.493346+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:43.481588+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":425,"num_read_kb":351,"num_write":136,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":720,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"265'293","reported_seq":931,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:37.596279+0000","last_change":"2024-09-12T01:29:37.596190+0000","last_active":"2024-09-12T01:29:37.596279+0000","last_peered":"2024-09-12T01:29:37.596279+0000","last_clean":"2024-09-12T01:29:37.596279+0000","last_became_active":"2024-09-12T00:31:47.122486+0000","last_became_peered":"2024-09-12T00:31:47.122486+0000","last_unstale":"2024-09-12T01:29:37.596279+0000","last_undegraded":"2024-09-12T01:29:37.596279+0000","last_fullsized":"2024-09-12T01:29:37.596279+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'293","last_scrub_stamp":"2024-09-12T01:29:37.596061+0000","last_deep_scrub":"265'293","last_deep_scrub_stamp":"2024-09-12T01:29:37.596061+0000","last_clean_scrub_stamp":"2024-09-12T01:29:37.596061+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:50.615903+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6842428,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":376,"num_read_kb":24154,"num_write":874,"num_write_kb":37460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"265'114","reported_seq":683,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.388377+0000","last_change":"2024-09-12T01:29:32.388319+0000","last_active":"2024-09-12T01:29:32.388377+0000","last_peered":"2024-09-12T01:29:32.388377+0000","last_clean":"2024-09-12T01:29:32.388377+0000","last_became_active":"2024-09-12T00:31:50.139416+0000","last_became_peered":"2024-09-12T00:31:50.139416+0000","last_unstale":"2024-09-12T01:29:32.388377+0000","last_undegraded":"2024-09-12T01:29:32.388377+0000","last_fullsized":"2024-09-12T01:29:32.388377+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'114","last_scrub_stamp":"2024-09-12T01:29:32.388231+0000","last_deep_scrub":"265'114","last_deep_scrub_stamp":"2024-09-12T01:29:32.388231+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.388231+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:47:16.247658+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":513,"num_read_kb":414,"num_write":177,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"265'362","reported_seq":1041,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:23.974843+0000","last_change":"2024-09-12T01:29:23.974781+0000","last_active":"2024-09-12T01:29:23.974843+0000","last_peered":"2024-09-12T01:29:23.974843+0000","last_clean":"2024-09-12T01:29:23.974843+0000","last_became_active":"2024-09-12T00:31:47.130353+0000","last_became_peered":"2024-09-12T00:31:47.130353+0000","last_unstale":"2024-09-12T01:29:23.974843+0000","last_undegraded":"2024-09-12T01:29:23.974843+0000","last_fullsized":"2024-09-12T01:29:23.974843+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'362","last_scrub_stamp":"2024-09-12T01:29:23.974688+0000","last_deep_scrub":"265'362","last_deep_scrub_stamp":"2024-09-12T01:29:23.974688+0000","last_clean_scrub_stamp":"2024-09-12T01:29:23.974688+0000","objects_scrubbed":4,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:26.306312+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288069,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":561,"num_read_kb":8753,"num_write":1192,"num_write_kb":21611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"265'161","reported_seq":773,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.572355+0000","last_change":"2024-09-12T01:29:32.572299+0000","last_active":"2024-09-12T01:29:32.572355+0000","last_peered":"2024-09-12T01:29:32.572355+0000","last_clean":"2024-09-12T01:29:32.572355+0000","last_became_active":"2024-09-12T00:31:50.140705+0000","last_became_peered":"2024-09-12T00:31:50.140705+0000","last_unstale":"2024-09-12T01:29:32.572355+0000","last_undegraded":"2024-09-12T01:29:32.572355+0000","last_fullsized":"2024-09-12T01:29:32.572355+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'161","last_scrub_stamp":"2024-09-12T01:29:32.572201+0000","last_deep_scrub":"265'161","last_deep_scrub_stamp":"2024-09-12T01:29:32.572201+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.572201+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:35:57.054566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":755,"num_read_kb":620,"num_write":277,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"265'387","reported_seq":1114,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:32.059949+0000","last_change":"2024-09-12T01:29:32.059874+0000","last_active":"2024-09-12T01:29:32.059949+0000","last_peered":"2024-09-12T01:29:32.059949+0000","last_clean":"2024-09-12T01:29:32.059949+0000","last_became_active":"2024-09-12T00:31:47.120303+0000","last_became_peered":"2024-09-12T00:31:47.120303+0000","last_unstale":"2024-09-12T01:29:32.059949+0000","last_undegraded":"2024-09-12T01:29:32.059949+0000","last_fullsized":"2024-09-12T01:29:32.059949+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'387","last_scrub_stamp":"2024-09-12T01:29:32.059734+0000","last_deep_scrub":"265'387","last_deep_scrub_stamp":"2024-09-12T01:29:32.059734+0000","last_clean_scrub_stamp":"2024-09-12T01:29:32.059734+0000","objects_scrubbed":7,"log_size":87,"log_dups_size":300,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:18.350675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493090,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":704,"num_read_kb":61137,"num_write":1132,"num_write_kb":48224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"265'210","reported_seq":865,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:33.613216+0000","last_change":"2024-09-12T01:29:33.613124+0000","last_active":"2024-09-12T01:29:33.613216+0000","last_peered":"2024-09-12T01:29:33.613216+0000","last_clean":"2024-09-12T01:29:33.613216+0000","last_became_active":"2024-09-12T00:31:50.133698+0000","last_became_peered":"2024-09-12T00:31:50.133698+0000","last_unstale":"2024-09-12T01:29:33.613216+0000","last_undegraded":"2024-09-12T01:29:33.613216+0000","last_fullsized":"2024-09-12T01:29:33.613216+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'210","last_scrub_stamp":"2024-09-12T01:29:33.613015+0000","last_deep_scrub":"265'210","last_deep_scrub_stamp":"2024-09-12T01:29:33.613015+0000","last_clean_scrub_stamp":"2024-09-12T01:29:33.613015+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:38.489746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1041,"num_read_kb":883,"num_write":372,"num_write_kb":211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"265'279","reported_seq":981,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:26.574378+0000","last_change":"2024-09-12T01:29:26.574293+0000","last_active":"2024-09-12T01:29:26.574378+0000","last_peered":"2024-09-12T01:29:26.574378+0000","last_clean":"2024-09-12T01:29:26.574378+0000","last_became_active":"2024-09-12T00:31:47.117753+0000","last_became_peered":"2024-09-12T00:31:47.117753+0000","last_unstale":"2024-09-12T01:29:26.574378+0000","last_undegraded":"2024-09-12T01:29:26.574378+0000","last_fullsized":"2024-09-12T01:29:26.574378+0000","mapping_epoch":24,"log_start":"265'200","ondisk_log_start":"265'200","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'279","last_scrub_stamp":"2024-09-12T01:29:26.574140+0000","last_deep_scrub":"265'279","last_deep_scrub_stamp":"2024-09-12T01:29:26.574140+0000","last_clean_scrub_stamp":"2024-09-12T01:29:26.574140+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:19.980823+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":578,"num_read_kb":553,"num_write":1003,"num_write_kb":11415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"265'4099","reported_seq":4708,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.486899+0000","last_change":"2024-09-12T01:29:28.486832+0000","last_active":"2024-09-12T01:29:28.486899+0000","last_peered":"2024-09-12T01:29:28.486899+0000","last_clean":"2024-09-12T01:29:28.486899+0000","last_became_active":"2024-09-12T00:31:50.144782+0000","last_became_peered":"2024-09-12T00:31:50.144782+0000","last_unstale":"2024-09-12T01:29:28.486899+0000","last_undegraded":"2024-09-12T01:29:28.486899+0000","last_fullsized":"2024-09-12T01:29:28.486899+0000","mapping_epoch":27,"log_start":"265'4000","ondisk_log_start":"265'4000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'4099","last_scrub_stamp":"2024-09-12T01:29:28.486734+0000","last_deep_scrub":"265'4099","last_deep_scrub_stamp":"2024-09-12T01:29:28.486734+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.486734+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":3000,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:27.424046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16473,"num_read_kb":13736,"num_write":6146,"num_write_kb":3061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"265'355","reported_seq":1119,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:28.168523+0000","last_change":"2024-09-12T01:29:28.168523+0000","last_active":"2024-09-12T01:29:28.168523+0000","last_peered":"2024-09-12T01:29:28.168523+0000","last_clean":"2024-09-12T01:29:28.168523+0000","last_became_active":"2024-09-12T00:32:23.828547+0000","last_became_peered":"2024-09-12T00:32:23.828547+0000","last_unstale":"2024-09-12T01:29:28.168523+0000","last_undegraded":"2024-09-12T01:29:28.168523+0000","last_fullsized":"2024-09-12T01:29:28.168523+0000","mapping_epoch":38,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'355","last_scrub_stamp":"2024-09-12T01:29:28.168363+0000","last_deep_scrub":"265'355","last_deep_scrub_stamp":"2024-09-12T01:29:28.168363+0000","last_clean_scrub_stamp":"2024-09-12T01:29:28.168363+0000","objects_scrubbed":9,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:07.014208+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2792674,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":658,"num_read_kb":184067,"num_write":1127,"num_write_kb":52781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.30","version":"265'313","reported_seq":956,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:35.068686+0000","last_change":"2024-09-12T01:29:35.068584+0000","last_active":"2024-09-12T01:29:35.068686+0000","last_peered":"2024-09-12T01:29:35.068686+0000","last_clean":"2024-09-12T01:29:35.068686+0000","last_became_active":"2024-09-12T00:31:47.123083+0000","last_became_peered":"2024-09-12T00:31:47.123083+0000","last_unstale":"2024-09-12T01:29:35.068686+0000","last_undegraded":"2024-09-12T01:29:35.068686+0000","last_fullsized":"2024-09-12T01:29:35.068686+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'313","last_scrub_stamp":"2024-09-12T01:29:35.068428+0000","last_deep_scrub":"265'313","last_deep_scrub_stamp":"2024-09-12T01:29:35.068428+0000","last_clean_scrub_stamp":"2024-09-12T01:29:35.068428+0000","objects_scrubbed":7,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:18.821874+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1292330,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":432,"num_read_kb":16599,"num_write":993,"num_write_kb":37945,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"265'178","reported_seq":762,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:40.582964+0000","last_change":"2024-09-12T01:29:40.582884+0000","last_active":"2024-09-12T01:29:40.582964+0000","last_peered":"2024-09-12T01:29:40.582964+0000","last_clean":"2024-09-12T01:29:40.582964+0000","last_became_active":"2024-09-12T00:31:50.144850+0000","last_became_peered":"2024-09-12T00:31:50.144850+0000","last_unstale":"2024-09-12T01:29:40.582964+0000","last_undegraded":"2024-09-12T01:29:40.582964+0000","last_fullsized":"2024-09-12T01:29:40.582964+0000","mapping_epoch":27,"log_start":"262'100","ondisk_log_start":"262'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'178","last_scrub_stamp":"2024-09-12T01:29:40.582801+0000","last_deep_scrub":"265'178","last_deep_scrub_stamp":"2024-09-12T01:29:40.582801+0000","last_clean_scrub_stamp":"2024-09-12T01:29:40.582801+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:08:21.474391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":724,"num_read_kb":585,"num_write":260,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"265'386","reported_seq":1051,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:31.920078+0000","last_change":"2024-09-12T01:29:31.920017+0000","last_active":"2024-09-12T01:29:31.920078+0000","last_peered":"2024-09-12T01:29:31.920078+0000","last_clean":"2024-09-12T01:29:31.920078+0000","last_became_active":"2024-09-12T00:31:47.132149+0000","last_became_peered":"2024-09-12T00:31:47.132149+0000","last_unstale":"2024-09-12T01:29:31.920078+0000","last_undegraded":"2024-09-12T01:29:31.920078+0000","last_fullsized":"2024-09-12T01:29:31.920078+0000","mapping_epoch":24,"log_start":"265'300","ondisk_log_start":"265'300","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'386","last_scrub_stamp":"2024-09-12T01:29:31.919888+0000","last_deep_scrub":"265'386","last_deep_scrub_stamp":"2024-09-12T01:29:31.919888+0000","last_clean_scrub_stamp":"2024-09-12T01:29:31.919888+0000","objects_scrubbed":6,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:51.126649+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":304,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":582,"num_read_kb":13776,"num_write":1287,"num_write_kb":29438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"265'127","reported_seq":759,"reported_epoch":265,"state":"active+clean","last_fresh":"2024-09-12T01:29:34.480691+0000","last_change":"2024-09-12T01:29:34.480631+0000","last_active":"2024-09-12T01:29:34.480691+0000","last_peered":"2024-09-12T01:29:34.480691+0000","last_clean":"2024-09-12T01:29:34.480691+0000","last_became_active":"2024-09-12T00:31:50.137283+0000","last_became_peered":"2024-09-12T00:31:50.137283+0000","last_unstale":"2024-09-12T01:29:34.480691+0000","last_undegraded":"2024-09-12T01:29:34.480691+0000","last_fullsized":"2024-09-12T01:29:34.480691+0000","mapping_epoch":27,"log_start":"265'100","ondisk_log_start":"265'100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"265'127","last_scrub_stamp":"2024-09-12T01:29:34.480529+0000","last_deep_scrub":"265'127","last_deep_scrub_stamp":"2024-09-12T01:29:34.480529+0000","last_clean_scrub_stamp":"2024-09-12T01:29:34.480529+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:46.725574+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":583,"num_read_kb":491,"num_write":192,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5593,"num_read_kb":3949,"num_write":1897,"num_write_kb":794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6768,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1070,"ondisk_log_size":1070,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15445,"num_objects":88,"num_object_clones":0,"num_object_copies":176,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":0,"num_read":15046,"num_read_kb":14700,"num_write":16713,"num_write_kb":4879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2692,"num_omap_keys":17,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":573440,"data_stored":30890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1548,"ondisk_log_size":1548,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":588,"ondisk_log_size":588,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1527208,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":18236,"num_read_kb":37365,"num_write":15267,"num_write_kb":11724,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":673192,"num_omap_keys":1560,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1721,"ondisk_log_size":1721,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2403,"num_read_kb":2864,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":102878,"num_read_kb":85467,"num_write":37260,"num_write_kb":18832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43781,"num_omap_keys":179,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3676,"ondisk_log_size":3676,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":78246710,"num_objects":378,"num_object_clones":0,"num_object_copies":1134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":378,"num_whiteouts":0,"num_read":36067,"num_read_kb":1971130,"num_write":71284,"num_write_kb":2047906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":119279616,"data_stored":119279616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3444,"ondisk_log_size":3444,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":176023,"num_write":154,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":175285,"num_write":154,"num_write_kb":116909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":94,"ondisk_log_size":94,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719477452,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":221612,"kb_used_data":15580,"kb_used_omap":1,"kb_used_meta":206014,"kb_avail":94150228,"statfs":{"total":96636764160,"available":96409833472,"internally_reserved":0,"allocated":15953920,"data_stored":13969939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":210958794},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719477451,"num_pgs":104,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":111876,"kb_used_data":18292,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94259964,"statfs":{"total":96636764160,"available":96522203136,"internally_reserved":0,"allocated":18731008,"data_stored":16734053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":95812038},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510157,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":259868,"kb_used_data":21836,"kb_used_omap":1,"kb_used_meta":238014,"kb_avail":94111972,"statfs":{"total":96636764160,"available":96370659328,"internally_reserved":0,"allocated":22360064,"data_stored":20343157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":243726791},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424510156,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":152736,"kb_used_data":27152,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94219104,"statfs":{"total":96636764160,"available":96480362496,"internally_reserved":0,"allocated":27803648,"data_stored":25815269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510156,"num_pgs":92,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298132,"kb_used_data":10116,"kb_used_omap":1,"kb_used_meta":287998,"kb_avail":94073708,"statfs":{"total":96636764160,"available":96331476992,"internally_reserved":0,"allocated":10358784,"data_stored":8346083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":294910405},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424510154,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":124160,"kb_used_data":16624,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94247680,"statfs":{"total":96636764160,"available":96509624320,"internally_reserved":0,"allocated":17022976,"data_stored":15000873,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110098885},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542858,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":206080,"kb_used_data":22256,"kb_used_omap":1,"kb_used_meta":183806,"kb_avail":94165760,"statfs":{"total":96636764160,"available":96425738240,"internally_reserved":0,"allocated":22790144,"data_stored":20790314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":188217797},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575563,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":270692,"kb_used_data":18836,"kb_used_omap":1,"kb_used_meta":251838,"kb_avail":94101148,"statfs":{"total":96636764160,"available":96359575552,"internally_reserved":0,"allocated":19288064,"data_stored":17276630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":257882565},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12771328,"data_stored":12771328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5529600,"data_stored":5529600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":23588864,"data_stored":23588864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":18116608,"data_stored":18116608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":18563072,"data_stored":18563072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14458880,"data_stored":14458880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":14508032,"data_stored":14508032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":11743232,"data_stored":11743232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":2875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4319,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":4068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":4450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2498,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:30:45.096 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T01:30:45.435 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T01:30:45.435 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T01:30:45.436 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T01:30:45.436 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:30:45.474 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T01:30:45.475 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T01:30:45.475 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:30:45.559 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T01:30:45.559 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T01:30:45.559 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:30:45.604 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T01:30:45.604 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T01:30:45.604 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:30:45.646 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T01:30:45.647 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T01:30:45.647 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:30:45.696 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T01:30:45.696 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T01:30:45.696 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:30:45.756 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T01:30:45.756 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T01:30:45.756 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:30:45.797 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T01:30:45.797 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T01:30:45.797 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:30:45.841 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T01:30:45.842 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T01:30:45.842 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T01:30:45.842 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:30:45.868 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T01:30:45.868 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T01:30:45.868 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:30:45.897 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T01:30:45.897 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T01:30:45.898 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T01:30:45.898 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:30:45.924 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T01:30:45.925 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T01:30:45.925 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:30:45.978 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T01:30:45.978 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T01:30:45.978 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:30:45.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-12T01:30:45.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-12T01:30:45.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-09-12T01:30:45.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-12T01:30:45.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-09-12T01:30:45.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-09-12T01:30:45.991 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-09-12T01:30:45.991 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T01:30:45.992 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T01:30:45.992 DEBUG:teuthology.orchestra.run.smithi062:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T01:30:46.061 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T01:30:46.061 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T01:30:46.293 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T01:30:46.293 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T01:30:46.407 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T01:30:46.407 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T01:30:46.482 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T01:30:46.482 DEBUG:teuthology.orchestra.run.smithi062:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T01:30:46.562 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-12T01:30:46.562 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T01:30:46.729 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-12T01:30:46.729 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T01:30:46.831 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-12T01:30:46.831 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T01:30:46.897 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi077.front.sepia.ceph.com 2024-09-12T01:30:46.897 DEBUG:teuthology.orchestra.run.smithi077:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T01:30:46.968 INFO:tasks.ceph:Archiving mon data... 2024-09-12T01:30:46.970 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901870/data/mon.a.tgz 2024-09-12T01:30:46.970 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-09-12T01:30:47.001 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.yDfn8Wrz5n 2024-09-12T01:30:47.001 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.yDfn8Wrz5n 2024-09-12T01:30:47.201 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.yDfn8Wrz5n 2024-09-12T01:30:47.313 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.yDfn8Wrz5n is 489KB 2024-09-12T01:30:47.416 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.yDfn8Wrz5n 2024-09-12T01:30:47.446 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901870/data/mon.c.tgz 2024-09-12T01:30:47.446 DEBUG:teuthology.orchestra.run.smithi062:> mktemp 2024-09-12T01:30:47.516 INFO:teuthology.orchestra.run.smithi062.stdout:/tmp/tmp.idClp3K3i0 2024-09-12T01:30:47.516 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.idClp3K3i0 2024-09-12T01:30:47.705 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0666 /tmp/tmp.idClp3K3i0 2024-09-12T01:30:47.820 DEBUG:teuthology.orchestra.remote:smithi062:/tmp/tmp.idClp3K3i0 is 497KB 2024-09-12T01:30:47.924 DEBUG:teuthology.orchestra.run.smithi062:> rm -fr /tmp/tmp.idClp3K3i0 2024-09-12T01:30:47.953 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901870/data/mon.b.tgz 2024-09-12T01:30:47.953 DEBUG:teuthology.orchestra.run.smithi077:> mktemp 2024-09-12T01:30:47.982 INFO:teuthology.orchestra.run.smithi077.stdout:/tmp/tmp.YVvvu6bDWw 2024-09-12T01:30:47.982 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.YVvvu6bDWw 2024-09-12T01:30:48.193 DEBUG:teuthology.orchestra.run.smithi077:> sudo chmod 0666 /tmp/tmp.YVvvu6bDWw 2024-09-12T01:30:48.304 DEBUG:teuthology.orchestra.remote:smithi077:/tmp/tmp.YVvvu6bDWw is 497KB 2024-09-12T01:30:48.395 DEBUG:teuthology.orchestra.run.smithi077:> rm -fr /tmp/tmp.YVvvu6bDWw 2024-09-12T01:30:48.424 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T01:30:48.425 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:30:48.427 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:30:48.616 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:30:48.645 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:30:48.645 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T01:30:48.647 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901870/remote/smithi062/crash 2024-09-12T01:30:48.647 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:30:48.686 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901870/remote/smithi077/crash 2024-09-12T01:30:48.687 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:30:48.725 INFO:tasks.ceph:Compressing logs... 2024-09-12T01:30:48.726 DEBUG:teuthology.orchestra.run.smithi062:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:30:48.730 DEBUG:teuthology.orchestra.run.smithi077:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:30:48.767 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T01:30:48.768 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160543.log 2024-09-12T01:30:48.768 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79233.log 2024-09-12T01:30:48.768 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.160543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101618.log 2024-09-12T01:30:48.819 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32703.log 2024-09-12T01:30:48.819 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32747.log 2024-09-12T01:30:48.819 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T01:30:48.819 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32703.log.gz 2024-09-12T01:30:48.820 INFO:teuthology.orchestra.run.smithi077.stderr:gzip/var/log/ceph/ceph-client.admin.32747.log: -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T01:30:48.820 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32747.log.gz 2024-09-12T01:30:48.820 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32835.log 2024-09-12T01:30:48.820 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:30:48.820 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32835.log.gz 2024-09-12T01:30:48.820 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32791.log 2024-09-12T01:30:48.820 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32879.log 2024-09-12T01:30:48.820 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32925.log 2024-09-12T01:30:48.820 INFO:teuthology.orchestra.run.smithi077.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32791.log.gz 2024-09-12T01:30:48.820 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32879.log.gz 2024-09-12T01:30:48.820 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T01:30:48.820 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T01:30:48.821 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32925.log.gz 2024-09-12T01:30:48.821 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:30:48.821 INFO:teuthology.orchestra.run.smithi077.stderr: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:30:48.821 INFO:teuthology.orchestra.run.smithi077.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T01:30:48.821 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T01:30:48.821 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32659.log 2024-09-12T01:30:48.821 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32599.log 2024-09-12T01:30:48.821 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32659.log.gz 2024-09-12T01:30:48.821 INFO:teuthology.orchestra.run.smithi077.stderr:/var/log/ceph/ceph-client.admin.32599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32599.log.gz 2024-09-12T01:30:48.821 INFO:teuthology.orchestra.run.smithi077.stderr: 87.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:30:48.892 INFO:teuthology.orchestra.run.smithi062.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.160543.log.gz 2024-09-12T01:30:48.892 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.79233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38466.log 2024-09-12T01:30:48.892 INFO:teuthology.orchestra.run.smithi062.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.79233.log.gz 2024-09-12T01:30:48.892 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129303.log 2024-09-12T01:30:48.892 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101618.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.101618.log.gz 2024-09-12T01:30:48.892 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187930.log 2024-09-12T01:30:48.893 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38466.log.gz 2024-09-12T01:30:48.893 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.129303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92783.log 2024-09-12T01:30:48.893 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.187930.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.129303.log.gzgzip 2024-09-12T01:30:48.893 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.106330.log 2024-09-12T01:30:48.893 INFO:teuthology.orchestra.run.smithi062.stderr: 24.6% -- replaced with /var/log/ceph/ceph-client.admin.187930.log.gz 2024-09-12T01:30:48.893 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.92783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54023.log 2024-09-12T01:30:48.893 INFO:teuthology.orchestra.run.smithi062.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.92783.log.gz 2024-09-12T01:30:48.893 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102796.log 2024-09-12T01:30:48.893 INFO:teuthology.orchestra.run.smithi062.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.106330.log.gz 2024-09-12T01:30:48.893 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.54023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50441.log 2024-09-12T01:30:48.893 INFO:teuthology.orchestra.run.smithi062.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.54023.log.gz 2024-09-12T01:30:48.894 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.102796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191420.log 2024-09-12T01:30:48.894 INFO:teuthology.orchestra.run.smithi062.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.102796.log.gz 2024-09-12T01:30:48.894 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.50441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47448.log 2024-09-12T01:30:48.894 INFO:teuthology.orchestra.run.smithi062.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.50441.log.gz 2024-09-12T01:30:48.894 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183182.log 2024-09-12T01:30:48.894 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191420.log.gz 2024-09-12T01:30:48.894 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.47448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191098.log 2024-09-12T01:30:48.894 INFO:teuthology.orchestra.run.smithi062.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.47448.log.gz 2024-09-12T01:30:48.894 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.183182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40338.log 2024-09-12T01:30:48.894 INFO:teuthology.orchestra.run.smithi062.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.183182.log.gz 2024-09-12T01:30:48.894 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162899.log 2024-09-12T01:30:48.894 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191098.log.gz 2024-09-12T01:30:48.895 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.40338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40183.log 2024-09-12T01:30:48.895 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.162899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149329.log 0.0% 2024-09-12T01:30:48.895 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.162899.log.gz 2024-09-12T01:30:48.895 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97495.log 2024-09-12T01:30:48.895 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40183.log.gz 2024-09-12T01:30:48.895 INFO:teuthology.orchestra.run.smithi062.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.0.40338.log.gz 2024-09-12T01:30:48.895 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.149329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40315.log 2024-09-12T01:30:48.895 INFO:teuthology.orchestra.run.smithi062.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.149329.log.gz 2024-09-12T01:30:48.895 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.97495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89836.log 2024-09-12T01:30:48.895 INFO:teuthology.orchestra.run.smithi062.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.97495.log.gz 2024-09-12T01:30:48.895 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40049.log 2024-09-12T01:30:48.895 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40315.log.gz 2024-09-12T01:30:48.895 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.89836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156398.log 2024-09-12T01:30:48.896 INFO:teuthology.orchestra.run.smithi062.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.89836.log.gz 2024-09-12T01:30:48.896 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40049.log.gz 2024-09-12T01:30:48.896 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191512.log 2024-09-12T01:30:48.896 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.156398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62828.log 2024-09-12T01:30:48.896 INFO:teuthology.orchestra.run.smithi062.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.156398.log.gz 2024-09-12T01:30:48.896 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103385.log 2024-09-12T01:30:48.896 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191512.log.gz 2024-09-12T01:30:48.896 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.62828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40271.log 2024-09-12T01:30:48.896 INFO:teuthology.orchestra.run.smithi062.stderr: 57.6% -- replaced with /var/log/ceph/ceph-client.admin.62828.log.gz 2024-09-12T01:30:48.896 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38703.log 2024-09-12T01:30:48.896 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40271.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.103385.log.gz 2024-09-12T01:30:48.896 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83945.log 2024-09-12T01:30:48.897 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40271.log.gz 2024-09-12T01:30:48.897 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131070.log 2024-09-12T01:30:48.897 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38703.log.gz 2024-09-12T01:30:48.897 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.83945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91015.log 2024-09-12T01:30:48.897 INFO:teuthology.orchestra.run.smithi062.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.83945.log.gz 2024-09-12T01:30:48.897 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.131070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53434.log 2024-09-12T01:30:48.897 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.91015.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.131070.log.gz 2024-09-12T01:30:48.897 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185009.log 2024-09-12T01:30:48.897 INFO:teuthology.orchestra.run.smithi062.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.91015.log.gz 2024-09-12T01:30:48.897 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.53434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171019.log 2024-09-12T01:30:48.897 INFO:teuthology.orchestra.run.smithi062.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.53434.log.gz 2024-09-12T01:30:48.897 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.185009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142850.log 2024-09-12T01:30:48.897 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.171019.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.185009.log.gz 2024-09-12T01:30:48.898 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39049.log 2024-09-12T01:30:48.898 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.142850.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.171019.log.gz 2024-09-12T01:30:48.898 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43974.log 2024-09-12T01:30:48.898 INFO:teuthology.orchestra.run.smithi062.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.142850.log.gz 2024-09-12T01:30:48.898 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83356.log 2024-09-12T01:30:48.898 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39049.log.gz 2024-09-12T01:30:48.898 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.43974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174207.log 2024-09-12T01:30:48.898 INFO:teuthology.orchestra.run.smithi062.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.43974.log.gz 2024-09-12T01:30:48.898 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.83356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191650.log 2024-09-12T01:30:48.898 INFO:teuthology.orchestra.run.smithi062.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.83356.log.gz 2024-09-12T01:30:48.898 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.174207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75682.log 2024-09-12T01:30:48.898 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85712.log 2024-09-12T01:30:48.898 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191650.log.gz 2024-09-12T01:30:48.899 INFO:teuthology.orchestra.run.smithi062.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.174207.log.gz 2024-09-12T01:30:48.899 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.75682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115167.log 2024-09-12T01:30:48.899 INFO:teuthology.orchestra.run.smithi062.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.75682.log.gz 2024-09-12T01:30:48.899 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.85712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191052.log 2024-09-12T01:30:48.899 INFO:teuthology.orchestra.run.smithi062.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.85712.log.gz 2024-09-12T01:30:48.899 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.115167.log: -- /var/log/ceph/ceph-client.admin.57605.log 2024-09-12T01:30:48.899 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191052.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.115167.log.gz 2024-09-12T01:30:48.899 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39044.log 2024-09-12T01:30:48.899 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191052.log.gz 2024-09-12T01:30:48.899 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.57605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130481.log 2024-09-12T01:30:48.899 INFO:teuthology.orchestra.run.smithi062.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.57605.log.gz 2024-09-12T01:30:48.899 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39044.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T01:30:48.899 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39044.log.gz 2024-09-12T01:30:48.900 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.130481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66052.log 2024-09-12T01:30:48.900 INFO:teuthology.orchestra.run.smithi062.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.130481.log.gz 2024-09-12T01:30:48.900 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191882.log 2024-09-12T01:30:48.900 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.66052.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T01:30:48.900 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63427.log 2024-09-12T01:30:48.900 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191882.log.gz 2024-09-12T01:30:48.900 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39795.log 2024-09-12T01:30:48.900 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.63427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57581.log 2024-09-12T01:30:48.900 INFO:teuthology.orchestra.run.smithi062.stderr: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.63427.log.gz 2024-09-12T01:30:48.900 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60009.log 2024-09-12T01:30:48.900 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39795.log.gz 2024-09-12T01:30:48.900 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.57581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190776.log 2024-09-12T01:30:48.901 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57581.log.gz 2024-09-12T01:30:48.901 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.60009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105152.log 2024-09-12T01:30:48.901 INFO:teuthology.orchestra.run.smithi062.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.60009.log.gz 2024-09-12T01:30:48.901 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.190776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59985.log 2024-09-12T01:30:48.901 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190776.log.gz 2024-09-12T01:30:48.901 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76437.log 2024-09-12T01:30:48.901 INFO:teuthology.orchestra.run.smithi062.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.105152.log.gz 2024-09-12T01:30:48.901 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.59985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69149.log 2024-09-12T01:30:48.901 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59985.log.gz 2024-09-12T01:30:48.901 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.76437.log: -- /var/log/ceph/ceph-client.admin.93372.log 2024-09-12T01:30:48.901 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.69149.log: 84.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175844.log 2024-09-12T01:30:48.901 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.0.76437.log.gz 2024-09-12T01:30:48.901 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84534.log 2024-09-12T01:30:48.902 INFO:teuthology.orchestra.run.smithi062.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.93372.log.gz 2024-09-12T01:30:48.902 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43371.log 2024-09-12T01:30:48.902 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.175844.log: 93.1%/var/log/ceph/ceph-client.admin.84534.log: -- replaced with /var/log/ceph/ceph-client.admin.66052.log.gz 2024-09-12T01:30:48.902 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182573.log 2024-09-12T01:30:48.902 INFO:teuthology.orchestra.run.smithi062.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.84534.log.gz/var/log/ceph/ceph-client.0.43371.log: 2024-09-12T01:30:48.902 INFO:teuthology.orchestra.run.smithi062.stderr:gzip 44.2% -- replaced with /var/log/ceph/ceph-client.0.43371.log.gz 2024-09-12T01:30:48.902 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.122824.log 2024-09-12T01:30:48.902 INFO:teuthology.orchestra.run.smithi062.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.175844.log.gz 2024-09-12T01:30:48.902 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.182573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191374.log 2024-09-12T01:30:48.902 INFO:teuthology.orchestra.run.smithi062.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.69149.log.gz 2024-09-12T01:30:48.902 INFO:teuthology.orchestra.run.smithi062.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.182573.log.gz 2024-09-12T01:30:48.902 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5/var/log/ceph/ceph-client.admin.122824.log: --verbose -- /var/log/ceph/ceph-client.admin.162947.log 2024-09-12T01:30:48.903 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150507.log 2024-09-12T01:30:48.903 INFO:teuthology.orchestra.run.smithi062.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122824.log.gz 0.0% 2024-09-12T01:30:48.903 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.191374.log.gz 2024-09-12T01:30:48.903 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.162947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86890.log 2024-09-12T01:30:48.903 INFO:teuthology.orchestra.run.smithi062.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.162947.log.gz 2024-09-12T01:30:48.903 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.150507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33114.log 2024-09-12T01:30:48.903 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.86890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41550.log 2024-09-12T01:30:48.903 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33114.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.187976.log 87.0% 2024-09-12T01:30:48.903 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.86890.log.gz 2024-09-12T01:30:48.903 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33114.log.gz 2024-09-12T01:30:48.903 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.41550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119879.log 2024-09-12T01:30:48.903 INFO:teuthology.orchestra.run.smithi062.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.150507.log.gz 80.5% -- replaced with /var/log/ceph/ceph-client.0.41550.log.gz 2024-09-12T01:30:48.903 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:30:48.904 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.187976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136371.log 2024-09-12T01:30:48.904 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187976.log.gz 2024-09-12T01:30:48.904 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126358.log 2024-09-12T01:30:48.904 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.119879.log: /var/log/ceph/ceph-client.admin.136371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132837.log 2024-09-12T01:30:48.904 INFO:teuthology.orchestra.run.smithi062.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.119879.log.gz 2024-09-12T01:30:48.904 INFO:teuthology.orchestra.run.smithi062.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.136371.log.gz 2024-09-12T01:30:48.904 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.126358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40227.log 2024-09-12T01:30:48.904 INFO:teuthology.orchestra.run.smithi062.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.126358.log.gz 2024-09-12T01:30:48.904 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.132837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108687.log 2024-09-12T01:30:48.904 INFO:teuthology.orchestra.run.smithi062.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.132837.log.gz 2024-09-12T01:30:48.904 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148740.log 2024-09-12T01:30:48.904 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40227.log.gz 2024-09-12T01:30:48.905 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38795.log 2024-09-12T01:30:48.905 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108687.log: /var/log/ceph/ceph-client.admin.148740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71007.log 2024-09-12T01:30:48.905 INFO:teuthology.orchestra.run.smithi062.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.108687.log.gz 2024-09-12T01:30:48.905 INFO:teuthology.orchestra.run.smithi062.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.148740.log.gz 2024-09-12T01:30:48.905 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168640.log 2024-09-12T01:30:48.905 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38795.log.gz 2024-09-12T01:30:48.905 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38749.log 2024-09-12T01:30:48.905 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.71007.log: /var/log/ceph/ceph-client.admin.168640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187952.log 2024-09-12T01:30:48.905 INFO:teuthology.orchestra.run.smithi062.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.168640.log.gz 2024-09-12T01:30:48.905 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49215.log 2024-09-12T01:30:48.905 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38749.log.gz 2024-09-12T01:30:48.906 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.187952.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187952.log.gz 2024-09-12T01:30:48.906 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.71671.log 2024-09-12T01:30:48.906 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.49215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49215.log.gz 2024-09-12T01:30:48.906 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86301.log 2024-09-12T01:30:48.906 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.71671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78644.log 2024-09-12T01:30:48.906 INFO:teuthology.orchestra.run.smithi062.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.71671.log.gz 2024-09-12T01:30:48.906 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.86301.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.86301.log.gz 2024-09-12T01:30:48.906 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128714.log 2024-09-12T01:30:48.906 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140494.log 2024-09-12T01:30:48.906 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.78644.log: /var/log/ceph/ceph-client.admin.128714.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.78644.log.gz 2024-09-12T01:30:48.906 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67290.log 2024-09-12T01:30:48.906 INFO:teuthology.orchestra.run.smithi062.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.128714.log.gz 2024-09-12T01:30:48.906 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.140494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61187.log 2024-09-12T01:30:48.907 INFO:teuthology.orchestra.run.smithi062.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.140494.log.gz 2024-09-12T01:30:48.907 INFO:teuthology.orchestra.run.smithi062.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.71007.log.gz 2024-09-12T01:30:48.907 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.67290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100440.log 2024-09-12T01:30:48.907 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.61187.log: gzip 81.8% -- replaced with /var/log/ceph/ceph-client.admin.61187.log.gz 2024-09-12T01:30:48.907 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.67910.log 2024-09-12T01:30:48.907 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.100440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139316.log 2024-09-12T01:30:48.907 INFO:teuthology.orchestra.run.smithi062.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.100440.log.gz 2024-09-12T01:30:48.907 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.67910.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26685.log 2024-09-12T01:30:48.907 INFO:teuthology.orchestra.run.smithi062.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.67290.log.gz 2024-09-12T01:30:48.907 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.139316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54612.log 2024-09-12T01:30:48.907 INFO:teuthology.orchestra.run.smithi062.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.139316.log.gz 2024-09-12T01:30:48.907 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph.tmp-client.admin.26685.log: -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26685.log.gz 2024-09-12T01:30:48.908 INFO:teuthology.orchestra.run.smithi062.stderr: -- /var/log/ceph/ceph-client.admin.135782.log 2024-09-12T01:30:48.908 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.54612.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.54612.log.gz 2024-09-12T01:30:48.908 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93961.log 2024-09-12T01:30:48.908 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151685.log 2024-09-12T01:30:48.908 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.135782.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67910.log.gz 2024-09-12T01:30:48.908 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.93961.log: gzip 87.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.39409.log 2024-09-12T01:30:48.908 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.135782.log.gz 2024-09-12T01:30:48.908 INFO:teuthology.orchestra.run.smithi062.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.93961.log.gz 2024-09-12T01:30:48.908 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.151685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145795.log 2024-09-12T01:30:48.908 INFO:teuthology.orchestra.run.smithi062.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.151685.log.gz 2024-09-12T01:30:48.908 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109276.log 2024-09-12T01:30:48.908 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39409.log.gz 2024-09-12T01:30:48.908 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.145795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103974.log 2024-09-12T01:30:48.909 INFO:teuthology.orchestra.run.smithi062.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.145795.log.gz 2024-09-12T01:30:48.909 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.109276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88657.log 2024-09-12T01:30:48.909 INFO:teuthology.orchestra.run.smithi062.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.109276.log.gz 2024-09-12T01:30:48.909 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65432.log 2024-09-12T01:30:48.909 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.103974.log: /var/log/ceph/ceph-client.admin.88657.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.103974.log.gz 2024-09-12T01:30:48.909 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73318.log 2024-09-12T01:30:48.909 INFO:teuthology.orchestra.run.smithi062.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.88657.log.gz 2024-09-12T01:30:48.909 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.65432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179528.log 2024-09-12T01:30:48.909 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.73318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105741.log 2024-09-12T01:30:48.909 INFO:teuthology.orchestra.run.smithi062.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.73318.log.gz 2024-09-12T01:30:48.909 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.179528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172383.log 2024-09-12T01:30:48.909 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.105741.log: gzip 84.3% -- replaced with /var/log/ceph/ceph-client.0.179528.log.gz 2024-09-12T01:30:48.909 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.191006.log 2024-09-12T01:30:48.910 INFO:teuthology.orchestra.run.smithi062.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.105741.log.gz 2024-09-12T01:30:48.910 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.172383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172991.log 2024-09-12T01:30:48.910 INFO:teuthology.orchestra.run.smithi062.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.172383.log.gz 2024-09-12T01:30:48.910 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115756.log 2024-09-12T01:30:48.910 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191006.log.gz 2024-09-12T01:30:48.910 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.172991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164738.log 2024-09-12T01:30:48.910 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.115756.log: gzip -5 92.2% -- replaced with /var/log/ceph/ceph-client.admin.172991.log.gz 2024-09-12T01:30:48.910 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.99262.log 2024-09-12T01:30:48.910 INFO:teuthology.orchestra.run.smithi062.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.115756.log.gz 2024-09-12T01:30:48.910 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.164738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164738.log.gz 2024-09-12T01:30:48.911 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171627.log 2024-09-12T01:30:48.911 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129892.log 2024-09-12T01:30:48.911 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99262.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.99262.log.gz 2024-09-12T01:30:48.911 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.171627.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:30:48.911 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.129892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128125.log 2024-09-12T01:30:48.911 INFO:teuthology.orchestra.run.smithi062.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.171627.log.gz 2024-09-12T01:30:48.911 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.audit.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.129892.log.gz 2024-09-12T01:30:48.911 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49239.log 2024-09-12T01:30:48.911 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.128125.log: /var/log/ceph/ceph-client.admin.149918.log 2024-09-12T01:30:48.911 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.49239.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.128125.log.gz 2024-09-12T01:30:48.911 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49239.log.gz 2024-09-12T01:30:48.911 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118701.log 2024-09-12T01:30:48.911 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.149918.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.147562.log 2024-09-12T01:30:48.912 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.118701.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.149918.log.gz 2024-09-12T01:30:48.912 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 81.8% -- replaced with /var/log/ceph/ceph-client.admin.118701.log.gz 2024-09-12T01:30:48.912 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39055.log 2024-09-12T01:30:48.912 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.147562.log: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.65432.log.gz 2024-09-12T01:30:48.912 INFO:teuthology.orchestra.run.smithi062.stderr:gzip 82.5% -- replaced with /var/log/ceph/ceph-client.admin.147562.log.gz 2024-09-12T01:30:48.912 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.162310.log 2024-09-12T01:30:48.912 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75091.log 2024-09-12T01:30:48.912 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39055.log.gz 2024-09-12T01:30:48.912 INFO:teuthology.orchestra.run.smithi062.stderr: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:30:48.912 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40002.log 2024-09-12T01:30:48.912 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.162310.log: /var/log/ceph/ceph-client.admin.75091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170411.log 2024-09-12T01:30:48.912 INFO:teuthology.orchestra.run.smithi062.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.162310.log.gz 2024-09-12T01:30:48.913 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40002.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.75091.log.gz 2024-09-12T01:30:48.913 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70387.log 2024-09-12T01:30:48.913 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40002.log.gz 2024-09-12T01:30:48.913 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92194.log 2024-09-12T01:30:48.913 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.170411.log: /var/log/ceph/ceph-client.admin.70387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181964.log 2024-09-12T01:30:48.913 INFO:teuthology.orchestra.run.smithi062.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.170411.log.gz 2024-09-12T01:30:48.913 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.92194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162923.log 2024-09-12T01:30:48.913 INFO:teuthology.orchestra.run.smithi062.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.92194.log.gz 2024-09-12T01:30:48.913 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.181964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110454.log 2024-09-12T01:30:48.913 INFO:teuthology.orchestra.run.smithi062.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.181964.log.gz 2024-09-12T01:30:48.913 INFO:teuthology.orchestra.run.smithi062.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.70387.log.gz 2024-09-12T01:30:48.913 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.162923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113988.log 2024-09-12T01:30:48.913 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162923.log.gz 2024-09-12T01:30:48.914 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5/var/log/ceph/ceph-client.admin.110454.log: --verbose -- /var/log/ceph/ceph-client.0.42159.log 2024-09-12T01:30:48.914 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.113988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112221.log 2024-09-12T01:30:48.914 INFO:teuthology.orchestra.run.smithi062.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.110454.log.gz 2024-09-12T01:30:48.914 INFO:teuthology.orchestra.run.smithi062.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.113988.log.gz 2024-09-12T01:30:48.914 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152274.log 2024-09-12T01:30:48.914 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.42159.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.42159.log.gz 2024-09-12T01:30:48.914 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.112221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109865.log 2024-09-12T01:30:48.914 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.152274.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.112221.log.gz 2024-09-12T01:30:48.914 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118112.log 2024-09-12T01:30:48.914 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.109865.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62307.log 2024-09-12T01:30:48.914 INFO:teuthology.orchestra.run.smithi062.stderr: 81.9%/var/log/ceph/ceph-client.admin.118112.log: -- replaced with /var/log/ceph/ceph-client.admin.109865.log.gz 2024-09-12T01:30:48.914 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189404.log 2024-09-12T01:30:48.915 INFO:teuthology.orchestra.run.smithi062.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.118112.log.gz 2024-09-12T01:30:48.915 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.62307.log: gzip -5 85.9% -- replaced with /var/log/ceph/ceph-client.admin.152274.log.gz 2024-09-12T01:30:48.915 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose 55.6% -- replaced with /var/log/ceph/ceph-client.admin.62307.log.gz 2024-09-12T01:30:48.915 INFO:teuthology.orchestra.run.smithi062.stderr: -- /var/log/ceph/ceph-client.admin.121057.log 2024-09-12T01:30:48.915 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.189404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96906.log 2024-09-12T01:30:48.915 INFO:teuthology.orchestra.run.smithi062.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.0.189404.log.gz 2024-09-12T01:30:48.915 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.121057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38621.log 2024-09-12T01:30:48.915 INFO:teuthology.orchestra.run.smithi062.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.121057.log.gz 2024-09-12T01:30:48.915 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58783.log 2024-09-12T01:30:48.915 INFO:teuthology.orchestra.run.smithi062.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.96906.log.gz 2024-09-12T01:30:48.915 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45180.log 2024-09-12T01:30:48.915 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38621.log.gz 2024-09-12T01:30:48.916 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144617.log 2024-09-12T01:30:48.916 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.58783.log: /var/log/ceph/ceph-client.0.45180.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.58783.log.gz 2024-09-12T01:30:48.916 INFO:teuthology.orchestra.run.smithi062.stderr:gzip 43.9% -5 --verbose -- replaced with /var/log/ceph/ceph-client.0.45180.log.gz -- 2024-09-12T01:30:48.916 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T01:30:48.916 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.144617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124002.log 2024-09-12T01:30:48.916 INFO:teuthology.orchestra.run.smithi062.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.144617.log.gz 2024-09-12T01:30:48.916 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146973.log 2024-09-12T01:30:48.916 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.124002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143439.log 2024-09-12T01:30:48.916 INFO:teuthology.orchestra.run.smithi062.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.124002.log.gz 2024-09-12T01:30:48.916 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.146973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152863.log 2024-09-12T01:30:48.916 INFO:teuthology.orchestra.run.smithi062.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.146973.log.gz 2024-09-12T01:30:48.916 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.143439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190914.log 2024-09-12T01:30:48.917 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.152863.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.143439.log.gz 2024-09-12T01:30:48.917 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175236.log 2024-09-12T01:30:48.917 INFO:teuthology.orchestra.run.smithi062.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.152863.log.gz 2024-09-12T01:30:48.917 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.190914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190960.log 2024-09-12T01:30:48.917 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190914.log.gz 2024-09-12T01:30:48.917 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.175236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52256.log 2024-09-12T01:30:48.917 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.190960.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190960.log.gz 2024-09-12T01:30:48.917 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.148151.log 2024-09-12T01:30:48.917 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.52256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82178.log 2024-09-12T01:30:48.917 INFO:teuthology.orchestra.run.smithi062.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.52256.log.gz 2024-09-12T01:30:48.917 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.148151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39051.log 2024-09-12T01:30:48.917 INFO:teuthology.orchestra.run.smithi062.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.148151.log.gz 2024-09-12T01:30:48.917 INFO:teuthology.orchestra.run.smithi062.stderr: 94.2% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.175236.log.gz -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T01:30:48.918 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:30:48.918 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56379.log 2024-09-12T01:30:48.918 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.82178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77147.log 2024-09-12T01:30:48.918 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39051.log.gz 2024-09-12T01:30:48.918 INFO:teuthology.orchestra.run.smithi062.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.82178.log.gz 2024-09-12T01:30:48.918 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.56379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131659.log 2024-09-12T01:30:48.918 INFO:teuthology.orchestra.run.smithi062.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.56379.log.gz 2024-09-12T01:30:48.918 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.77147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111043.log 2024-09-12T01:30:48.918 INFO:teuthology.orchestra.run.smithi062.stderr: 50.4% -- replaced with /var/log/ceph/ceph-client.admin.77147.log.gz 2024-09-12T01:30:48.918 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.131659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108097.log 2024-09-12T01:30:48.918 INFO:teuthology.orchestra.run.smithi062.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.131659.log.gz 2024-09-12T01:30:48.918 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.111043.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.132248.log 2024-09-12T01:30:48.919 INFO:teuthology.orchestra.run.smithi062.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.111043.log.gz 2024-09-12T01:30:48.919 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.108097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188709.log 2024-09-12T01:30:48.919 INFO:teuthology.orchestra.run.smithi062.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.108097.log.gz/var/log/ceph/ceph-client.admin.132248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161132.log 2024-09-12T01:30:48.919 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:30:48.919 INFO:teuthology.orchestra.run.smithi062.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.132248.log.gz 2024-09-12T01:30:48.919 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.188709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39408.log 2024-09-12T01:30:48.919 INFO:teuthology.orchestra.run.smithi062.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.188709.log.gz 2024-09-12T01:30:48.919 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156987.log 2024-09-12T01:30:48.919 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.161132.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.161132.log.gz 2024-09-12T01:30:48.919 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89247.log 2024-09-12T01:30:48.919 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39408.log.gz 2024-09-12T01:30:48.919 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.156987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56968.log 2024-09-12T01:30:48.920 INFO:teuthology.orchestra.run.smithi062.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.156987.log.gz 2024-09-12T01:30:48.920 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.89247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168032.log 2024-09-12T01:30:48.920 INFO:teuthology.orchestra.run.smithi062.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.89247.log.gz 2024-09-12T01:30:48.920 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.56968.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62417.log 2024-09-12T01:30:48.920 INFO:teuthology.orchestra.run.smithi062.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.56968.log.gz 2024-09-12T01:30:48.920 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.168032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73910.log 2024-09-12T01:30:48.920 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.62417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.185618.log 2024-09-12T01:30:48.920 INFO:teuthology.orchestra.run.smithi062.stderr: 52.2% -- replaced with /var/log/ceph/ceph-client.admin.62417.log.gz 2024-09-12T01:30:48.920 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.73910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39796.log 2024-09-12T01:30:48.920 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.185618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114577.log 2024-09-12T01:30:48.920 INFO:teuthology.orchestra.run.smithi062.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.185618.log.gz/var/log/ceph/ceph-client.admin.39796.log: 2024-09-12T01:30:48.920 INFO:teuthology.orchestra.run.smithi062.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.73910.log.gz 2024-09-12T01:30:48.921 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39796.log.gz 2024-09-12T01:30:48.921 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T01:30:48.921 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.114577.log: -- /var/log/ceph/ceph-client.admin.125180.log 2024-09-12T01:30:48.921 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.c.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.114577.log.gz 2024-09-12T01:30:48.921 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121646.log 2024-09-12T01:30:48.921 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.125180.log: gzip -5 81.8% -- replaced with /var/log/ceph/ceph-client.admin.125180.log.gz 2024-09-12T01:30:48.921 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.141083.log 2024-09-12T01:30:48.921 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.121646.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.168032.log.gz 2024-09-12T01:30:48.921 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85123.log 2024-09-12T01:30:48.921 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.141083.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39786.log 2024-09-12T01:30:48.921 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.85123.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.141083.log.gz 2024-09-12T01:30:48.921 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62054.log 2024-09-12T01:30:48.921 INFO:teuthology.orchestra.run.smithi062.stderr: 82.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39800.log 2024-09-12T01:30:48.922 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.85123.log.gz 2024-09-12T01:30:48.922 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39786.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.121646.log.gz 2024-09-12T01:30:48.922 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.62054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39786.log.gz 2024-09-12T01:30:48.922 INFO:teuthology.orchestra.run.smithi062.stderr:gzip 59.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.62054.log.gz 2024-09-12T01:30:48.922 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.191282.log 2024-09-12T01:30:48.922 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39800.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39800.log.gz 2024-09-12T01:30:48.922 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.190868.log 2024-09-12T01:30:48.922 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191282.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.190098.log 2024-09-12T01:30:48.922 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.191282.log.gz 2024-09-12T01:30:48.922 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.190868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94550.log 2024-09-12T01:30:48.922 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190868.log.gz 2024-09-12T01:30:48.922 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.190098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176483.log 2024-09-12T01:30:48.923 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.94550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154631.log 2024-09-12T01:30:48.923 INFO:teuthology.orchestra.run.smithi062.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.94550.log.gz 2024-09-12T01:30:48.923 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.176483.log: gzip -5 --verbose -- 83.7% -- replaced with /var/log/ceph/ceph-client.0.176483.log.gz 2024-09-12T01:30:48.923 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.admin.64192.log 2024-09-12T01:30:48.923 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.154631.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.154631.log.gz 2024-09-12T01:30:48.923 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177092.log 2024-09-12T01:30:48.923 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.64192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178310.log 2024-09-12T01:30:48.923 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.177092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39047.log 2024-09-12T01:30:48.923 INFO:teuthology.orchestra.run.smithi062.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.177092.log.gz 2024-09-12T01:30:48.923 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.178310.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.178310.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66671.log 2024-09-12T01:30:48.923 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:30:48.923 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39047.log.gz 2024-09-12T01:30:48.924 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133426.log 2024-09-12T01:30:48.924 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112810.log 2024-09-12T01:30:48.924 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.66671.log: /var/log/ceph/ceph-client.admin.133426.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.133426.log.gz 2024-09-12T01:30:48.924 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39052.log 2024-09-12T01:30:48.924 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.112810.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.112810.log.gz 2024-09-12T01:30:48.924 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58194.log 2024-09-12T01:30:48.924 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39052.log.gz 2024-09-12T01:30:48.924 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51030.log 2024-09-12T01:30:48.924 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.58194.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.58194.log.gz 2024-09-12T01:30:48.924 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49852.log 2024-09-12T01:30:48.924 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.51030.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.51030.log.gz 2024-09-12T01:30:48.924 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62890.log 2024-09-12T01:30:48.924 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.49852.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.49852.log.gz 2024-09-12T01:30:48.925 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62702.log 2024-09-12T01:30:48.925 INFO:teuthology.orchestra.run.smithi062.stderr: 93.0%/var/log/ceph/ceph-client.admin.62890.log: -- replaced with /var/log/ceph/ceph-client.admin.66671.log.gz 2024-09-12T01:30:48.925 INFO:teuthology.orchestra.run.smithi062.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.62890.log.gz 2024-09-12T01:30:48.925 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188000.log 2024-09-12T01:30:48.925 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.62702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62702.log.gz 2024-09-12T01:30:48.925 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188612.log 2024-09-12T01:30:48.925 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51667.log 2024-09-12T01:30:48.925 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.188612.log: /var/log/ceph/ceph-client.admin.188000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188612.log.gz 2024-09-12T01:30:48.925 INFO:teuthology.orchestra.run.smithi062.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.188000.log.gz 2024-09-12T01:30:48.925 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190822.log 2024-09-12T01:30:48.925 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.51667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123413.log 2024-09-12T01:30:48.925 INFO:teuthology.orchestra.run.smithi062.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.51667.log.gz 2024-09-12T01:30:48.925 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.190822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51643.log 2024-09-12T01:30:48.926 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190822.log.gz 2024-09-12T01:30:48.926 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.123413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39421.log 2024-09-12T01:30:48.926 INFO:teuthology.orchestra.run.smithi062.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.123413.log.gz 2024-09-12T01:30:48.926 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.51643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51643.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188636.log 2024-09-12T01:30:48.926 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:30:48.926 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39421.log.gz 2024-09-12T01:30:48.926 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40095.log 2024-09-12T01:30:48.926 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.188636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188636.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127536.log 2024-09-12T01:30:48.926 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:30:48.926 INFO:teuthology.orchestra.run.smithi062.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.64192.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T01:30:48.926 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:30:48.926 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40095.log.gz/var/log/ceph/ceph-client.admin.127536.log: 2024-09-12T01:30:48.927 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72729.log 2024-09-12T01:30:48.927 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38841.log 2024-09-12T01:30:48.927 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.72729.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.72729.log.gz 2024-09-12T01:30:48.927 INFO:teuthology.orchestra.run.smithi062.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.127536.log.gz 2024-09-12T01:30:48.927 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62624.log 2024-09-12T01:30:48.927 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52845.log 2024-09-12T01:30:48.927 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38841.log.gz 2024-09-12T01:30:48.927 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.62624.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.62624.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39632.log 2024-09-12T01:30:48.927 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:30:48.927 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.52845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154042.log 2024-09-12T01:30:48.927 INFO:teuthology.orchestra.run.smithi062.stderr: 81.6%/var/log/ceph/ceph-client.admin.39632.log: -- replaced with /var/log/ceph/ceph-client.admin.52845.log.gz 2024-09-12T01:30:48.927 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39632.log.gz 2024-09-12T01:30:48.927 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134604.log 2024-09-12T01:30:48.927 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.154042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124591.log 2024-09-12T01:30:48.928 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.134604.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.134604.log.gz 2024-09-12T01:30:48.928 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159933.log 2024-09-12T01:30:48.928 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.124591.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.154042.log.gz 84.9% 2024-09-12T01:30:48.928 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.124591.log.gz 2024-09-12T01:30:48.928 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165351.log 2024-09-12T01:30:48.928 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.159933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161721.log 2024-09-12T01:30:48.928 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159933.log.gz 2024-09-12T01:30:48.928 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.165351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81000.log 2024-09-12T01:30:48.928 INFO:teuthology.orchestra.run.smithi062.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.165351.log.gz 2024-09-12T01:30:48.928 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.161721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117523.log 2024-09-12T01:30:48.928 INFO:teuthology.orchestra.run.smithi062.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.161721.log.gz 2024-09-12T01:30:48.928 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.81000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138727.log 2024-09-12T01:30:48.928 INFO:teuthology.orchestra.run.smithi062.stderr: 87.1%/var/log/ceph/ceph-client.admin.117523.log: -- replaced with /var/log/ceph/ceph-client.admin.81000.log.gz 2024-09-12T01:30:48.929 INFO:teuthology.orchestra.run.smithi062.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.117523.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57557.log 2024-09-12T01:30:48.929 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:30:48.929 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.138727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180746.log 2024-09-12T01:30:48.929 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.57557.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.138727.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57557.log.gz 2024-09-12T01:30:48.929 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:30:48.929 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55201.log 2024-09-12T01:30:48.929 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.180746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167383.log 2024-09-12T01:30:48.929 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.55201.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.180746.log.gz 2024-09-12T01:30:48.929 INFO:teuthology.orchestra.run.smithi062.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.55201.log.gz 2024-09-12T01:30:48.929 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183791.log 2024-09-12T01:30:48.929 INFO:teuthology.orchestra.run.smithi062.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.0.190098.log.gz 2024-09-12T01:30:48.929 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.167383.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T01:30:48.930 INFO:teuthology.orchestra.run.smithi062.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.167383.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126947.log 2024-09-12T01:30:48.930 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.183791.log: 2024-09-12T01:30:48.930 INFO:teuthology.orchestra.run.smithi062.stderr: 80.5%/var/log/ceph/ceph-osd.2.log: -- replaced with /var/log/ceph/ceph-client.0.183791.log.gz 2024-09-12T01:30:48.930 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155809.log 2024-09-12T01:30:48.930 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.126947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178919.log 2024-09-12T01:30:48.930 INFO:teuthology.orchestra.run.smithi062.stderr: 81.8%/var/log/ceph/ceph-client.admin.155809.log: -- replaced with /var/log/ceph/ceph-client.admin.126947.log.gz 2024-09-12T01:30:48.930 INFO:teuthology.orchestra.run.smithi062.stderr: 81.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82767.log 2024-09-12T01:30:48.930 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.155809.log.gz 2024-09-12T01:30:48.930 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.178919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74500.log 2024-09-12T01:30:48.930 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.82767.log: 83.7% -- replaced with /var/log/ceph/ceph-client.0.178919.log.gz 2024-09-12T01:30:48.930 INFO:teuthology.orchestra.run.smithi062.stderr: 81.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159954.log 2024-09-12T01:30:48.930 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.82767.log.gz 2024-09-12T01:30:48.930 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.74500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33209.log 2024-09-12T01:30:48.931 INFO:teuthology.orchestra.run.smithi062.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.74500.log.gz 2024-09-12T01:30:48.931 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.159954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87479.log 2024-09-12T01:30:48.931 INFO:teuthology.orchestra.run.smithi062.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.159954.log.gz 2024-09-12T01:30:48.931 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.33209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33209.log.gz 2024-09-12T01:30:48.931 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173599.log 2024-09-12T01:30:48.931 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.87479.log: gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-12T01:30:48.931 INFO:teuthology.orchestra.run.smithi062.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.87479.log.gz/var/log/ceph/ceph-client.admin.173599.log: 2024-09-12T01:30:48.931 INFO:teuthology.orchestra.run.smithi062.stderr:gzip 92.3% -- replaced with /var/log/ceph/ceph-client.admin.173599.log.gz 2024-09-12T01:30:48.931 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.116934.log 2024-09-12T01:30:48.931 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/valgrind/ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107508.log 2024-09-12T01:30:48.931 INFO:teuthology.orchestra.run.smithi062.stderr: 61.9% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-12T01:30:48.931 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.116934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164762.log 2024-09-12T01:30:48.931 INFO:teuthology.orchestra.run.smithi062.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.116934.log.gz 2024-09-12T01:30:48.932 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.107508.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.107508.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191144.log 2024-09-12T01:30:48.932 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:30:48.932 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.164762.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T01:30:48.932 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191144.log: 88.9% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191144.log.gz 2024-09-12T01:30:48.932 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.164762.log.gz 2024-09-12T01:30:48.932 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157576.log 2024-09-12T01:30:48.932 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144028.log 2024-09-12T01:30:48.932 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.157576.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.157576.log.gz 2024-09-12T01:30:48.932 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164714.log 2024-09-12T01:30:48.932 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.144028.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.144028.log.gz 2024-09-12T01:30:48.932 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49263.log 2024-09-12T01:30:48.932 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.164714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164714.log.gz 2024-09-12T01:30:48.932 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39410.log 2024-09-12T01:30:48.933 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.49263.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.49263.log.gz 2024-09-12T01:30:48.933 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191558.log 2024-09-12T01:30:48.933 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39410.log.gz 2024-09-12T01:30:48.933 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42762.log 2024-09-12T01:30:48.933 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191558.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191558.log.gz 2024-09-12T01:30:48.933 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96317.log 2024-09-12T01:30:48.933 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.42762.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.42762.log.gz 2024-09-12T01:30:48.933 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39422.log 2024-09-12T01:30:48.933 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.96317.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.96317.log.gz 2024-09-12T01:30:48.933 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:30:48.933 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39422.log.gz 2024-09-12T01:30:48.933 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191604.log 2024-09-12T01:30:48.984 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153453.log 2024-09-12T01:30:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191604.log.gz 2024-09-12T01:30:48.985 INFO:teuthology.orchestra.run.smithi062.stderr: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:30:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125769.log 2024-09-12T01:30:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.153453.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.153453.log.gz 2024-09-12T01:30:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188590.log 2024-09-12T01:30:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.125769.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.125769.log.gz 2024-09-12T01:30:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191792.log 2024-09-12T01:30:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.188590.log: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.188590.log.gz 2024-09-12T01:30:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62764.log 2024-09-12T01:30:48.985 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191792.log.gz 2024-09-12T01:30:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158754.log 2024-09-12T01:30:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.62764.log: 94.4% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T01:30:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39789.log 2024-09-12T01:30:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.158754.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.158754.log.gz 2024-09-12T01:30:48.986 INFO:teuthology.orchestra.run.smithi062.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62764.log.gz 2024-09-12T01:30:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40947.log 2024-09-12T01:30:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39789.log.gz 2024-09-12T01:30:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102207.log 2024-09-12T01:30:48.986 INFO:teuthology.orchestra.run.smithi062.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T01:30:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163536.log 2024-09-12T01:30:48.986 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.40947.log: /var/log/ceph/ceph-client.admin.102207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191698.log 2024-09-12T01:30:48.986 INFO:teuthology.orchestra.run.smithi062.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.40947.log.gz 2024-09-12T01:30:48.987 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.163536.log: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.102207.log.gz 2024-09-12T01:30:48.987 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146384.log 2024-09-12T01:30:48.987 INFO:teuthology.orchestra.run.smithi062.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.163536.log.gz 2024-09-12T01:30:48.987 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191190.log 2024-09-12T01:30:48.987 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191698.log: /var/log/ceph/ceph-client.admin.146384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81589.log 2024-09-12T01:30:48.987 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191698.log.gz 2024-09-12T01:30:48.987 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39797.log 2024-09-12T01:30:48.987 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191190.log.gz 2024-09-12T01:30:48.987 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.81589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39048.log 2024-09-12T01:30:48.987 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39797.log: 0.0% 81.7% -- replaced with /var/log/ceph/ceph-client.admin.81589.log.gz 2024-09-12T01:30:48.987 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39797.log.gz 2024-09-12T01:30:48.987 INFO:teuthology.orchestra.run.smithi062.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.146384.log.gz 2024-09-12T01:30:48.987 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51619.log 2024-09-12T01:30:48.988 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.39048.log: -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39048.log.gz 2024-09-12T01:30:48.988 INFO:teuthology.orchestra.run.smithi062.stderr: -- /var/log/ceph/ceph-client.admin.48037.log 2024-09-12T01:30:48.988 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.51619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51619.log.gz 2024-09-12T01:30:48.988 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69768.log 2024-09-12T01:30:48.988 INFO:teuthology.orchestra.run.smithi062.stderr:gzip/var/log/ceph/ceph-client.admin.48037.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38557.log 2024-09-12T01:30:48.988 INFO:teuthology.orchestra.run.smithi062.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.48037.log.gz 2024-09-12T01:30:48.988 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.69768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191236.log 2024-09-12T01:30:48.988 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38557.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111632.log 2024-09-12T01:30:48.988 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38557.log.gz 2024-09-12T01:30:48.988 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139905.log 2024-09-12T01:30:48.988 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191236.log: /var/log/ceph/ceph-client.admin.111632.log: 88.3% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191236.log.gz 2024-09-12T01:30:48.988 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69768.log.gz 2024-09-12T01:30:48.989 INFO:teuthology.orchestra.run.smithi062.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.111632.log.gz 2024-09-12T01:30:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138138.log 2024-09-12T01:30:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64811.log/var/log/ceph/ceph-client.admin.139905.log: 2024-09-12T01:30:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.138138.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.139905.log.gz 2024-09-12T01:30:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191466.log 2024-09-12T01:30:48.989 INFO:teuthology.orchestra.run.smithi062.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.138138.log.gz 2024-09-12T01:30:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55790.log/var/log/ceph/ceph-client.admin.64811.log: 2024-09-12T01:30:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191466.log.gz 2024-09-12T01:30:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39054.log 2024-09-12T01:30:48.989 INFO:teuthology.orchestra.run.smithi062.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.64811.log.gz 2024-09-12T01:30:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.55790.log: 80.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80411.log 2024-09-12T01:30:48.989 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55790.log.gz 2024-09-12T01:30:48.989 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59961.log 2024-09-12T01:30:48.990 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39054.log.gz 2024-09-12T01:30:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141672.log 2024-09-12T01:30:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.80411.log: /var/log/ceph/ceph-client.admin.59961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177701.log 2024-09-12T01:30:48.990 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59961.log.gz 2024-09-12T01:30:48.990 INFO:teuthology.orchestra.run.smithi062.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.80411.log.gz 2024-09-12T01:30:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.141672.log: 81.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.141672.log.gz 2024-09-12T01:30:48.990 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63603.log 2024-09-12T01:30:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.177701.log: gzip -5 --verbose 84.0% -- replaced with /var/log/ceph/ceph-client.0.177701.log.gz 2024-09-12T01:30:48.990 INFO:teuthology.orchestra.run.smithi062.stderr: -- /var/log/ceph/ceph-client.admin.39423.log 2024-09-12T01:30:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.63603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158165.log 84.1% -- replaced with /var/log/ceph/ceph-client.admin.63603.log.gz 2024-09-12T01:30:48.990 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:30:48.990 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39423.log.gz 2024-09-12T01:30:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191328.log 2024-09-12T01:30:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.158165.log: gzip -5 81.7% -- replaced with /var/log/ceph/ceph-client.admin.158165.log.gz 2024-09-12T01:30:48.991 INFO:teuthology.orchestra.run.smithi062.stderr: --verbose -- /var/log/ceph/ceph-client.admin.59372.log 2024-09-12T01:30:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191328.log.gz 2024-09-12T01:30:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134015.log 2024-09-12T01:30:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.59372.log: gzip -5 --verbose 80.3% -- replaced with /var/log/ceph/ceph-client.admin.59372.log.gz -- 2024-09-12T01:30:48.991 INFO:teuthology.orchestra.run.smithi062.stderr: /var/log/ceph/ceph-client.admin.104563.log 2024-09-12T01:30:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.134015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32776.log 2024-09-12T01:30:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75828.log 2024-09-12T01:30:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.104563.log: /var/log/ceph/ceph-client.admin.32776.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.104563.log.gz 2024-09-12T01:30:48.991 INFO:teuthology.orchestra.run.smithi062.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32776.log.gz 2024-09-12T01:30:48.991 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186751.log 2024-09-12T01:30:48.992 INFO:teuthology.orchestra.run.smithi062.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.134015.log.gz 2024-09-12T01:30:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40139.log 2024-09-12T01:30:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.75828.log: /var/log/ceph/ceph-client.admin.186751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180137.log 2024-09-12T01:30:48.992 INFO:teuthology.orchestra.run.smithi062.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.0.75828.log.gz 2024-09-12T01:30:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.40139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40139.log.gz 82.6% -- replaced with /var/log/ceph/ceph-client.admin.186751.log.gz 2024-09-12T01:30:48.992 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:30:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136960.log 2024-09-12T01:30:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.180137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135193.log 2024-09-12T01:30:48.992 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.136960.log: 80.4%gzip -- replaced with /var/log/ceph/ceph-client.0.180137.log.gz 2024-09-12T01:30:48.992 INFO:teuthology.orchestra.run.smithi062.stderr: -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:30:48.992 INFO:teuthology.orchestra.run.smithi062.stderr: 81.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77809.log 2024-09-12T01:30:48.993 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.136960.log.gz 2024-09-12T01:30:48.993 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.135193.log: /var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116345.log 2024-09-12T01:30:48.993 INFO:teuthology.orchestra.run.smithi062.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.135193.log.gz 2024-09-12T01:30:48.993 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.77809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77200.log 2024-09-12T01:30:48.993 INFO:teuthology.orchestra.run.smithi062.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.0.77809.log.gz 2024-09-12T01:30:48.993 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.116345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101029.log 2024-09-12T01:30:48.993 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.77200.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.116345.log.gz 2024-09-12T01:30:48.993 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106919.log 2024-09-12T01:30:48.993 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.101029.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.101029.log.gz 2024-09-12T01:30:48.993 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184400.log 2024-09-12T01:30:48.993 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.106919.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.77200.log.gz 2024-09-12T01:30:48.993 INFO:teuthology.orchestra.run.smithi062.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.106919.log.gz 2024-09-12T01:30:48.994 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60598.log 2024-09-12T01:30:48.994 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.184400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113399.log 2024-09-12T01:30:48.994 INFO:teuthology.orchestra.run.smithi062.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.184400.log.gz 2024-09-12T01:30:48.994 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.60598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191838.log 2024-09-12T01:30:48.994 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.113399.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.60598.log.gz 2024-09-12T01:30:48.994 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63491.log 2024-09-12T01:30:48.994 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191838.log.gz 2024-09-12T01:30:48.994 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145206.log 2024-09-12T01:30:48.994 INFO:teuthology.orchestra.run.smithi062.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.113399.log.gz 2024-09-12T01:30:48.994 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.63491.log: 20.3% -- replaced with /var/log/ceph/ceph-client.admin.63491.log.gz 2024-09-12T01:30:48.994 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48626.log 2024-09-12T01:30:48.994 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.145206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181355.log 2024-09-12T01:30:48.995 INFO:teuthology.orchestra.run.smithi062.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.145206.log.gz 2024-09-12T01:30:48.995 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.48626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38644.log 2024-09-12T01:30:48.995 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.181355.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.48626.log.gz 2024-09-12T01:30:48.995 INFO:teuthology.orchestra.run.smithi062.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.181355.log.gz 2024-09-12T01:30:48.995 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137549.log 2024-09-12T01:30:48.995 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.38644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38644.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159343.log 2024-09-12T01:30:48.995 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:30:48.995 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46859.log 2024-09-12T01:30:48.995 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.159343.log: /var/log/ceph/ceph-client.admin.137549.log: 81.0% 85.3% -- replaced with /var/log/ceph/ceph-client.admin.159343.log.gz -- replaced with /var/log/ceph/ceph-client.admin.137549.log.gz 2024-09-12T01:30:48.995 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:30:48.995 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122235.log 2024-09-12T01:30:48.995 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.46859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90426.log 2024-09-12T01:30:48.996 INFO:teuthology.orchestra.run.smithi062.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.46859.log.gz 2024-09-12T01:30:48.996 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.122235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39420.log 2024-09-12T01:30:48.996 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.90426.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.122235.log.gz 2024-09-12T01:30:48.996 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98084.log 2024-09-12T01:30:48.996 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39420.log.gz 2024-09-12T01:30:48.996 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119290.log 2024-09-12T01:30:48.996 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.98084.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.90426.log.gz 2024-09-12T01:30:48.996 INFO:teuthology.orchestra.run.smithi062.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.98084.log.gz 2024-09-12T01:30:48.996 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188685.log 2024-09-12T01:30:48.996 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.119290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98673.log 2024-09-12T01:30:48.996 INFO:teuthology.orchestra.run.smithi062.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.119290.log.gz 2024-09-12T01:30:48.997 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.188685.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91604.log 2024-09-12T01:30:48.997 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.188685.log.gz/var/log/ceph/ceph-client.admin.98673.log: 2024-09-12T01:30:48.997 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88068.log 2024-09-12T01:30:48.997 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.91604.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.91604.log.gz 2024-09-12T01:30:48.997 INFO:teuthology.orchestra.run.smithi062.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.98673.log.gz 2024-09-12T01:30:48.997 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187340.log 2024-09-12T01:30:48.997 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.88068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44577.log 2024-09-12T01:30:48.997 INFO:teuthology.orchestra.run.smithi062.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.88068.log.gz 2024-09-12T01:30:48.997 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.187340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99851.log 2024-09-12T01:30:48.997 INFO:teuthology.orchestra.run.smithi062.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.187340.log.gz 2024-09-12T01:30:48.997 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.0.44577.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.44577.log.gz 2024-09-12T01:30:48.997 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39794.log 2024-09-12T01:30:48.998 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.99851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95728.log 2024-09-12T01:30:48.998 INFO:teuthology.orchestra.run.smithi062.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.99851.log.gz 2024-09-12T01:30:48.998 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.39794.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155220.log 2024-09-12T01:30:48.998 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39794.log.gz 2024-09-12T01:30:48.998 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T01:30:48.998 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95728.log: /var/log/ceph/ceph-client.admin.155220.log: 82.1% 82.4% -- replaced with /var/log/ceph/ceph-client.admin.155220.log.gz 2024-09-12T01:30:48.998 INFO:teuthology.orchestra.run.smithi062.stderr: -- replaced with /var/log/ceph/ceph-client.admin.95728.log.gz 2024-09-12T01:30:48.998 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95139.log 2024-09-12T01:30:48.998 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188660.log 2024-09-12T01:30:48.998 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.95139.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.95139.log.gz 2024-09-12T01:30:48.998 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164125.log 2024-09-12T01:30:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.188660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.188660.log.gz 2024-09-12T01:30:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190730.log 2024-09-12T01:30:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.164125.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.164125.log.gz 2024-09-12T01:30:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120468.log 2024-09-12T01:30:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.190730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190730.log.gz 2024-09-12T01:30:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165940.log 2024-09-12T01:30:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.120468.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.120468.log.gz 2024-09-12T01:30:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79822.log 2024-09-12T01:30:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.165940.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.165940.log.gz 2024-09-12T01:30:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191745.log 2024-09-12T01:30:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.79822.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.79822.log.gz 2024-09-12T01:30:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169803.log 2024-09-12T01:30:48.999 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.191745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191745.log.gz 2024-09-12T01:30:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151096.log 2024-09-12T01:30:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.169803.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.169803.log.gz 2024-09-12T01:30:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142261.log 2024-09-12T01:30:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.151096.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.151096.log.gz 2024-09-12T01:30:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68529.log 2024-09-12T01:30:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.142261.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.142261.log.gz 2024-09-12T01:30:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39411.log 2024-09-12T01:30:49.000 INFO:teuthology.orchestra.run.smithi062.stderr:/var/log/ceph/ceph-client.admin.68529.log: /var/log/ceph/ceph-client.admin.39411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39411.log.gz 2024-09-12T01:30:49.004 INFO:teuthology.orchestra.run.smithi062.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.68529.log.gz 2024-09-12T01:30:49.190 INFO:teuthology.orchestra.run.smithi077.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T01:30:49.806 INFO:teuthology.orchestra.run.smithi077.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T01:30:49.954 INFO:teuthology.orchestra.run.smithi062.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T01:30:50.992 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-12T01:30:50.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-12T01:30:50.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-09-12T01:30:50.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-12T01:30:50.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-09-12T01:30:50.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-09-12T01:30:50.993 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-09-12T01:30:51.820 INFO:teuthology.orchestra.run.smithi062.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T01:30:52.425 INFO:teuthology.orchestra.run.smithi062.stderr: 92.2% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T01:30:55.732 INFO:teuthology.orchestra.run.smithi077.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T01:30:57.303 INFO:teuthology.orchestra.run.smithi062.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T01:30:57.892 INFO:teuthology.orchestra.run.smithi062.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T01:30:58.103 INFO:teuthology.orchestra.run.smithi077.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T01:31:01.369 INFO:teuthology.orchestra.run.smithi062.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T01:31:01.665 INFO:teuthology.orchestra.run.smithi077.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T01:31:07.188 INFO:teuthology.orchestra.run.smithi077.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T01:31:07.190 INFO:teuthology.orchestra.run.smithi077.stderr: 2024-09-12T01:31:07.190 INFO:teuthology.orchestra.run.smithi077.stderr:real 0m18.394s 2024-09-12T01:31:07.190 INFO:teuthology.orchestra.run.smithi077.stderr:user 0m47.098s 2024-09-12T01:31:07.190 INFO:teuthology.orchestra.run.smithi077.stderr:sys 0m1.686s 2024-09-12T01:31:08.837 INFO:teuthology.orchestra.run.smithi062.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T01:31:08.839 INFO:teuthology.orchestra.run.smithi062.stderr: 2024-09-12T01:31:08.839 INFO:teuthology.orchestra.run.smithi062.stderr:real 0m20.082s 2024-09-12T01:31:08.839 INFO:teuthology.orchestra.run.smithi062.stderr:user 0m56.112s 2024-09-12T01:31:08.839 INFO:teuthology.orchestra.run.smithi062.stderr:sys 0m2.060s 2024-09-12T01:31:08.839 INFO:tasks.ceph:Archiving logs... 2024-09-12T01:31:08.840 DEBUG:teuthology.misc:Transferring archived files from smithi062:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901870/remote/smithi062/log 2024-09-12T01:31:08.841 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:31:16.368 DEBUG:teuthology.misc:Transferring archived files from smithi077:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901870/remote/smithi077/log 2024-09-12T01:31:16.369 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:31:23.080 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T01:31:23.091 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T01:31:23.091 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:31:23.094 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:31:23.209 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T01:31:23.220 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T01:31:23.220 DEBUG:teuthology.orchestra.run.smithi062:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:31:23.225 DEBUG:teuthology.orchestra.run.smithi077:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:31:23.255 INFO:teuthology.orchestra.run.smithi062.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:31:23.256 INFO:teuthology.orchestra.run.smithi077.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:31:23.260 INFO:teuthology.orchestra.run.smithi062.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:31:23.260 INFO:teuthology.orchestra.run.smithi062.stdout:=============================================================================== 2024-09-12T01:31:23.260 INFO:teuthology.orchestra.run.smithi062.stdout:^* hv01.front.sepia.ceph.com 3 6 377 49 -1621us[-1616us] +/- 52ms 2024-09-12T01:31:23.260 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 50 -401us[ -396us] +/- 81ms 2024-09-12T01:31:23.260 INFO:teuthology.orchestra.run.smithi062.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 +2395us[+2401us] +/- 61ms 2024-09-12T01:31:23.261 INFO:teuthology.orchestra.run.smithi062.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:31:23.261 INFO:teuthology.orchestra.run.smithi077.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:31:23.261 INFO:teuthology.orchestra.run.smithi077.stdout:=============================================================================== 2024-09-12T01:31:23.261 INFO:teuthology.orchestra.run.smithi077.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 -1660us[-1681us] +/- 52ms 2024-09-12T01:31:23.261 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 -429us[ -429us] +/- 81ms 2024-09-12T01:31:23.261 INFO:teuthology.orchestra.run.smithi077.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 48 +2404us[+2384us] +/- 62ms 2024-09-12T01:31:23.261 INFO:teuthology.orchestra.run.smithi077.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:31:23.262 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T01:31:23.274 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T01:31:23.274 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T01:31:23.284 DEBUG:teuthology.orchestra.run.smithi062:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:31:23.385 DEBUG:teuthology.orchestra.run.smithi077:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:31:23.466 DEBUG:teuthology.orchestra.run.smithi062:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T01:31:23.509 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:31:23.510 DEBUG:teuthology.orchestra.run.smithi077:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T01:31:23.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:31:23.553 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T01:31:23.565 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T01:31:23.575 INFO:teuthology.task.internal:Duration was 4033.731746 seconds 2024-09-12T01:31:23.576 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T01:31:23.585 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T01:31:23.585 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:31:23.588 DEBUG:teuthology.orchestra.run.smithi077:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:31:23.642 INFO:teuthology.orchestra.run.smithi062.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:31:23.646 INFO:teuthology.orchestra.run.smithi077.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:31:23.862 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T01:31:23.863 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi062.front.sepia.ceph.com 2024-09-12T01:31:23.863 DEBUG:teuthology.orchestra.run.smithi062:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:31:23.898 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi077.front.sepia.ceph.com 2024-09-12T01:31:23.898 DEBUG:teuthology.orchestra.run.smithi077:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:31:23.940 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T01:31:23.940 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:31:23.943 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:31:24.020 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T01:31:24.021 DEBUG:teuthology.orchestra.run.smithi062:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:31:24.025 DEBUG:teuthology.orchestra.run.smithi077:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:31:24.174 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T01:31:24.186 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T01:31:24.186 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:31:24.226 DEBUG:teuthology.orchestra.run.smithi077:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:31:24.265 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T01:31:24.277 DEBUG:teuthology.orchestra.run.smithi062:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:31:24.279 DEBUG:teuthology.orchestra.run.smithi077:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:31:24.314 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core 2024-09-12T01:31:24.342 INFO:teuthology.orchestra.run.smithi077.stdout:kernel.core_pattern = core 2024-09-12T01:31:24.364 DEBUG:teuthology.orchestra.run.smithi062:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:31:24.396 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:31:24.397 DEBUG:teuthology.orchestra.run.smithi077:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:31:24.432 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:31:24.433 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T01:31:24.444 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T01:31:24.445 DEBUG:teuthology.misc:Transferring archived files from smithi062:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901870/remote/smithi062 2024-09-12T01:31:24.445 DEBUG:teuthology.orchestra.run.smithi062:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:31:24.497 DEBUG:teuthology.misc:Transferring archived files from smithi077:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901870/remote/smithi077 2024-09-12T01:31:24.497 DEBUG:teuthology.orchestra.run.smithi077:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:31:24.543 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T01:31:24.543 DEBUG:teuthology.orchestra.run.smithi062:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:31:24.546 DEBUG:teuthology.orchestra.run.smithi077:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:31:24.607 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T01:31:24.621 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T01:31:24.621 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T01:31:24.632 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T01:31:24.632 DEBUG:teuthology.orchestra.run.smithi062:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:31:24.635 DEBUG:teuthology.orchestra.run.smithi077:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:31:24.661 INFO:teuthology.orchestra.run.smithi062.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:31 /home/ubuntu/cephtest 2024-09-12T01:31:24.675 INFO:teuthology.orchestra.run.smithi077.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:31 /home/ubuntu/cephtest 2024-09-12T01:31:24.677 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T01:31:24.688 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T01:31:24.715 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 4033.731746196747 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T01:31:24.715 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:31:24.803 INFO:teuthology.run:pass